-- Logs begin at Wed 2022-08-03 00:38:47 UTC, end at Wed 2022-08-03 03:36:30 UTC. -- Aug 03 01:37:08.213472 n-d-826529-8 systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 01:37:08.222886 n-d-826529-8 devstack@n-api.service[110590]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 01:37:08.224892 n-d-826529-8 devstack@n-api.service[110590]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 01:37:08 2022] *** Aug 03 01:37:08.224892 n-d-826529-8 devstack@n-api.service[110590]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 01:37:08.224892 n-d-826529-8 devstack@n-api.service[110590]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 01:37:08.224892 n-d-826529-8 devstack@n-api.service[110590]: nodename: n-d-826529-8 Aug 03 01:37:08.224892 n-d-826529-8 devstack@n-api.service[110590]: machine: x86_64 Aug 03 01:37:08.224892 n-d-826529-8 devstack@n-api.service[110590]: clock source: unix Aug 03 01:37:08.224892 n-d-826529-8 devstack@n-api.service[110590]: pcre jit disabled Aug 03 01:37:08.224892 n-d-826529-8 devstack@n-api.service[110590]: detected number of CPU cores: 4 Aug 03 01:37:08.224892 n-d-826529-8 devstack@n-api.service[110590]: current working directory: / Aug 03 01:37:08.224892 n-d-826529-8 devstack@n-api.service[110590]: detected binary path: /usr/bin/uwsgi-core Aug 03 01:37:08.224892 n-d-826529-8 devstack@n-api.service[110590]: your processes number limit is 47680 Aug 03 01:37:08.225661 n-d-826529-8 devstack@n-api.service[110590]: your memory page size is 4096 bytes Aug 03 01:37:08.225661 n-d-826529-8 devstack@n-api.service[110590]: detected max file descriptor number: 2048 Aug 03 01:37:08.225661 n-d-826529-8 devstack@n-api.service[110590]: lock engine: pthread robust mutexes Aug 03 01:37:08.225661 n-d-826529-8 devstack@n-api.service[110590]: thunder lock: enabled Aug 03 01:37:08.225661 n-d-826529-8 devstack@n-api.service[110590]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 01:37:08.225661 n-d-826529-8 devstack@n-api.service[110590]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 01:37:08.265039 n-d-826529-8 devstack@n-api.service[110590]: Python main interpreter initialized at 0x55bc98d9b9c0 Aug 03 01:37:08.265039 n-d-826529-8 devstack@n-api.service[110590]: python threads support enabled Aug 03 01:37:08.265039 n-d-826529-8 devstack@n-api.service[110590]: your server socket listen backlog is limited to 100 connections Aug 03 01:37:08.265039 n-d-826529-8 devstack@n-api.service[110590]: your mercy for graceful operations on workers is 90 seconds Aug 03 01:37:08.265435 n-d-826529-8 devstack@n-api.service[110590]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 01:37:08.265435 n-d-826529-8 devstack@n-api.service[110590]: *** Operational MODE: preforking *** Aug 03 01:37:08.265703 n-d-826529-8 devstack@n-api.service[110590]: *** uWSGI is running in multiple interpreter mode *** Aug 03 01:37:08.265703 n-d-826529-8 devstack@n-api.service[110590]: spawned uWSGI master process (pid: 110590) Aug 03 01:37:08.265892 n-d-826529-8 systemd[1]: Started Devstack devstack@n-api.service. Aug 03 01:37:08.270927 n-d-826529-8 devstack@n-api.service[110590]: spawned uWSGI worker 1 (pid: 110591, cores: 1) Aug 03 01:37:08.270927 n-d-826529-8 devstack@n-api.service[110590]: spawned uWSGI worker 2 (pid: 110592, cores: 1) Aug 03 01:37:08.270927 n-d-826529-8 devstack@n-api.service[110590]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 01:37:08.938528 n-d-826529-8 devstack@n-api.service[110591]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 01:37:08.947246 n-d-826529-8 devstack@n-api.service[110592]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 01:37:10.034294 n-d-826529-8 devstack@n-api.service[110592]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 01:37:10.034294 n-d-826529-8 devstack@n-api.service[110592]: from cryptography.utils import int_from_bytes Aug 03 01:37:10.035027 n-d-826529-8 devstack@n-api.service[110592]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 01:37:10.035027 n-d-826529-8 devstack@n-api.service[110592]: from cryptography.utils import int_from_bytes Aug 03 01:37:10.037968 n-d-826529-8 devstack@n-api.service[110591]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 01:37:10.037968 n-d-826529-8 devstack@n-api.service[110591]: from cryptography.utils import int_from_bytes Aug 03 01:37:10.038416 n-d-826529-8 devstack@n-api.service[110591]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 01:37:10.038416 n-d-826529-8 devstack@n-api.service[110591]: from cryptography.utils import int_from_bytes Aug 03 01:37:12.568031 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 01:37:12.568607 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 01:37:12.568808 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 01:37:12.569164 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 01:37:12.569417 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 01:37:12.569806 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.570132 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.570454 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.570771 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.571131 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.571441 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.571761 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.572079 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.572406 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.572666 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.572983 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.573303 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826529-8 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.573624 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.573928 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.574231 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 01:37:12.574603 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.574694 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 01:37:12.575371 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.575580 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.575928 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.576130 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 01:37:12.576227 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.576501 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 01:37:12.576713 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.576826 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 01:37:12.577146 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.577255 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.577454 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.577559 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.577769 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.577877 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.578100 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.578202 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.578415 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.578513 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.578726 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.578825 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.579075 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.579189 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.579387 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.579488 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.579709 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.579807 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.579976 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.580099 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.580291 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.580403 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826529-8 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.580600 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826529-8 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.580718 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.580922 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.581025 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.581228 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.581337 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.581539 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.581750 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.581838 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.582062 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.582166 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.582370 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.582471 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.582690 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.582794 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.583033 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.583252 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.583357 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.583561 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.583665 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.583866 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.583959 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.584174 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.584263 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.584506 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.584593 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.584819 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.584928 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.585125 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.585215 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.585455 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.585591 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.585744 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.585871 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.586045 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.586133 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.586349 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.586439 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.586600 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.586736 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826529-8 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.586935 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.587077 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.587246 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.587390 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.587566 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.587741 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.587887 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.588099 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.588190 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.588373 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.588462 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.588687 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.588777 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.589006 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.589102 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.589312 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.589410 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.589619 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.589717 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.589927 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.590058 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.590235 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.590369 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.590568 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.591024 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.591116 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.591345 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.591436 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.591653 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.591750 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.591969 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.592067 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.592282 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.592380 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.592601 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.592690 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.592906 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.593000 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.593208 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.593305 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.593459 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.593602 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.593767 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.593855 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.594087 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.594189 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.594407 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.594497 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.594727 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.594826 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.595068 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.595162 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.595319 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.595409 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.595637 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.595728 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.595958 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.596061 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.596267 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.596356 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.596575 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.596670 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.596881 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.596973 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.597188 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.597277 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.597493 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.597600 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.597742 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.597835 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.598041 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.598131 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.598346 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.598453 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.598660 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.598756 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.598986 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.599079 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.599293 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.599396 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.599597 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.599694 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.599894 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.599984 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.600197 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.600295 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.600499 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.600614 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.600804 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.600913 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.601102 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.601304 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.601393 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.601474 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.601694 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.601790 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.601997 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.602088 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.602303 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.602398 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.602606 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.602708 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.602938 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.603032 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.603252 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.603339 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.603557 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.603734 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.603852 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.603977 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.604160 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.604261 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.604414 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.604525 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.604717 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.604811 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.605021 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.605110 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.605338 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.605439 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.605641 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.605740 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.605966 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.606056 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.606372 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.606690 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.606786 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.607021 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.607115 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.607330 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.607420 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.607646 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.607738 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.607948 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.608037 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.608256 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.608351 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.608563 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.608661 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.608866 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.608964 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.609173 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.609262 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.609475 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.609563 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.609779 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.609868 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.610083 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.610173 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.610388 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.610528 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.610689 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.610780 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.611013 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.611123 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.611314 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.611405 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.611618 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.611721 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.611933 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.612020 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.612237 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.612338 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.612540 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.612628 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.612841 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.612939 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.613149 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.613237 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.613454 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.613543 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.613769 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.613933 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.614076 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.614167 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.614379 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.614468 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.614695 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.614858 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.615018 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.615109 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.615325 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.615415 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.615639 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.615742 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.615946 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.616035 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.616251 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.616395 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.616554 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.616644 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.616858 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.616946 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.617162 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.617252 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.617467 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.617572 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.617769 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.617866 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.618071 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.618160 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.618369 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.618459 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.618683 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.618779 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.619026 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.619119 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.619338 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.619441 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.619646 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.619742 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.619958 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.620055 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.620276 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.620363 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:37:12.620587 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.620677 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.620926 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.621341 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.621521 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.622139 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.622357 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.622678 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.622948 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.623054 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.623300 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.623394 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.623621 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.623717 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.623931 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.624030 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.624255 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.624343 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.624573 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.624669 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.624884 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.624991 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.625203 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.625292 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.625516 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.625604 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.625825 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.625923 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.626134 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.626224 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.626446 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.626534 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.626755 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.626845 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.627101 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.627197 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.627416 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.627511 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.627731 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.627821 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.628040 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.628128 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.628353 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.628439 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.628663 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.628761 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.628972 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.629061 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.629283 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.629371 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.629589 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.629694 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.629899 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.630030 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.630203 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.630366 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.630502 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.630625 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.630804 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.630930 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.631149 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.631253 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.631480 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.631594 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.631785 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.631875 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.632120 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.632224 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.632429 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.632526 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.632741 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.632831 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.633052 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.633151 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.633363 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.633452 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.633668 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.633766 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.633981 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.634072 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.634292 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.634381 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.634595 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.634691 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.634969 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.635064 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.635252 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.635343 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.635557 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.635646 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.635868 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.635957 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.636171 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.636258 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.636475 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.636612 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.636783 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.636872 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.637091 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.637196 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.638007 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.638352 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.638459 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.638666 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.638759 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.639013 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.639126 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.639331 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.639429 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.639643 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.639730 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.639976 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.640063 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.640304 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.640393 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.640609 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.640724 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.640933 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.641032 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.641238 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.641327 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.641552 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.641646 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.641853 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.641938 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.642161 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.642249 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.642464 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.642556 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.642766 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.642864 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.643096 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.643184 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.643400 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.643496 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.643706 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.643878 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.644030 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.644170 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.644308 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.644453 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.644597 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.644742 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.644882 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.645028 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.645189 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.645337 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.645499 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.645648 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.645805 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.645944 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.646109 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.646248 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.646413 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.646553 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.646724 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.646824 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.647070 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.647163 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.647386 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.647478 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.647699 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.647810 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.648029 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.648119 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.648360 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.648450 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.648665 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.648754 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.648989 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.649079 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.649313 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.649404 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.649628 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.649717 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.649935 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.650040 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.650245 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.650336 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.650547 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.650643 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.650856 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.651007 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.651183 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.651289 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.651495 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.651596 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.651796 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.651898 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.652101 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.652189 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.652402 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.652490 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.652704 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.652800 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.653047 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.653387 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.653615 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.653702 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.653955 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.654056 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.654272 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.654368 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.654579 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.654666 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.654888 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.655007 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.655215 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.655314 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.655561 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.655647 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.655870 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.655957 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.656180 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.656266 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.656499 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.656587 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.656812 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.656911 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.657128 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.657216 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.657440 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.657537 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.657762 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.657848 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.658069 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.658155 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.658380 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.658475 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.658686 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.658772 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.659021 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.659111 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.659344 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.659444 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.659658 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.659745 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.659971 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.660070 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.660283 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.660380 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.660605 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.660693 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.660913 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.660994 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.661222 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.661327 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.661523 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.661610 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.661831 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.661923 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.662140 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.662228 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.662452 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.662539 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.662767 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.662854 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.663114 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.663204 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.663425 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.663518 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.663727 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.663819 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.664039 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.664131 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.664345 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.664431 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.664648 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.664736 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.664952 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.665040 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.665263 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.665349 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.665572 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.665667 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.665880 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.665975 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.666188 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.666280 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.666506 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.666601 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.666861 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.666980 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.667134 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.667221 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.667439 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.667539 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.667754 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.667840 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.668058 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.668146 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.668360 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.668525 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.668688 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.669033 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.669282 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.669376 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.669607 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.669696 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.669935 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.670024 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.670254 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.670347 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.670565 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.670653 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.670877 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.671044 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.671211 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.671301 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.671521 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.671645 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.671836 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.671924 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.672149 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.672241 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.672458 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.672552 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.672767 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.672915 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.673073 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.673169 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.673380 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.673466 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.673687 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.673772 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.673994 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.674092 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.674299 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.674403 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.674604 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.674696 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.674956 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.675061 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.675238 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.675325 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.675549 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.675636 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.675867 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.675962 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.676170 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.676474 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.676567 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.676795 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.676908 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.677105 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.677195 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.677409 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.677496 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.677714 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.677808 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.678017 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.678110 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.678358 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.678457 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.678669 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.678765 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.678992 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.679082 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.679311 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.679408 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.679630 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.679730 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.679938 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.680026 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.680245 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.680339 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.680554 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.680647 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.680856 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.680943 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.681208 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.681307 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.681463 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.681551 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.681770 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.681867 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.682072 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.682158 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.682376 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.682472 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.682678 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.682772 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.683005 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.683096 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.683320 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.683419 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.683623 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.683712 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.683930 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.684014 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.684788 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.685111 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.685284 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.685422 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.685655 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.685826 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.685969 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.686120 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.686260 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.686387 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.686650 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.686800 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.686966 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.687168 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.687310 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.687488 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.687616 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.687813 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.687977 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.688136 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.688264 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.688456 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.688598 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.688815 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.688984 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.689112 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.689261 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.689397 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.689498 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.689699 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.689796 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.690010 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.690161 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.690318 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.690405 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.690619 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.690705 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.690953 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.691079 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.691260 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.691364 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.691574 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.691702 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.691877 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.692010 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.692192 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.692331 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.692479 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.692623 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.692785 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.692921 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.693087 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.693223 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.693393 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.693619 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.693754 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.693899 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.694039 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.694174 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.694307 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.694462 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.694602 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.694734 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.694879 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.695023 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.695212 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.695302 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.695513 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.695599 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.695814 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.695901 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.696116 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.696212 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.696416 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.696502 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.696717 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.696812 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.697026 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.697121 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.697333 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.697420 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.697634 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.697721 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.697955 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.698044 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.698263 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.698351 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.698566 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.698662 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.698870 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.699013 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.699199 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.699322 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.699499 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.699595 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.700472 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.700870 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.700959 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.701203 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.701291 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.701514 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.701605 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.701832 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.701935 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.702147 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.702236 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.702462 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.702552 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.702774 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.702858 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.703102 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.703205 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.703414 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.703509 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.703716 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.703802 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.704024 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.704124 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.704330 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.704416 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.704636 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.704721 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.704941 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.705034 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.705259 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.705346 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.705568 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.705654 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.705871 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.705969 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.706175 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.706262 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.706476 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.706561 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.706791 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.706879 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.707121 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.707209 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.707424 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.707523 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.707728 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.707931 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.708025 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.708255 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.708341 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.708575 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.708672 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.708888 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.708976 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.709201 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.709296 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.709517 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.709613 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.709820 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.709908 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.710130 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.710223 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.710432 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.710527 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.710736 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.710829 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.711063 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.711150 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.711371 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.711502 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.711690 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.711777 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.711996 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.712090 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.712307 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.712408 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.712610 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.712696 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.712916 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.713004 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.713223 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.713311 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.713532 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.713625 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.713837 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.713930 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.714141 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.714229 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.714445 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.714539 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.714751 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.714845 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.715081 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.715185 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.715447 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.715879 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.716006 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.716196 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.716285 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.716509 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.716596 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.716824 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.716911 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.717134 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.717223 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.717447 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.717570 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.717761 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.717898 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.718287 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.718397 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.718493 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.718576 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.718684 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.718780 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.719021 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.719113 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.719336 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.719423 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.719644 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.719747 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.719957 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.720045 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.720261 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.720348 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.720581 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.720681 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.720895 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.720990 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.721211 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.721334 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.721517 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.721639 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.721823 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.721937 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.722145 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.722258 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.722460 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.722575 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.722772 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.722885 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.723104 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.723216 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.723430 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.723544 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.723754 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.723872 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.724058 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.724170 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.724369 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.724485 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.724680 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.724791 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.724994 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.725114 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.725301 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.725414 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.725610 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.725721 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.725916 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.726036 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.726221 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.726334 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.726528 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.726646 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.726841 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.726990 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.727173 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.727259 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.727479 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.727565 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.727788 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.727888 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.728097 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.728190 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.728400 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.728486 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.728722 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.728888 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.729033 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.729203 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.729336 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.729514 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.729682 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.729837 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.729950 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.730159 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.730246 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.730483 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.730579 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.730789 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.731517 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.731830 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.732273 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.732433 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.732639 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.732760 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.732970 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.733102 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.733714 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.733850 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.733997 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.734125 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.734256 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.734383 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.734507 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.734636 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.734746 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.734830 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.734935 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.735034 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.735154 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.735296 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.735570 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.735660 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.735896 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.735985 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.736201 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.736298 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.736553 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.736656 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.736814 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.736904 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.737126 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.737226 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.737430 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.737540 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.737733 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.737821 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.738036 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.738126 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.738342 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.738439 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.738653 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.738743 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.739072 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.739177 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.739359 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.739451 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.739677 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.739839 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.739989 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.740081 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.740294 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.740411 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.740982 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.741117 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.741224 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.741330 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.741445 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.741551 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.741655 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.741759 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.741864 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.741967 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.742128 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.742243 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.742449 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.742562 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.742752 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.742874 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.743100 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.743227 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.745074 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.745718 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.745825 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.745918 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.746002 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.746343 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.746434 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.746516 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.747271 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.747358 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.747439 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.747518 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.747597 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.747684 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.747774 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.747855 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.747935 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.748014 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.748101 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.748190 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.748272 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.748272 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.748416 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.748496 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.748496 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.748647 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.748768 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.748891 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.749078 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.749180 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.749383 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.749493 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.749696 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.749811 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.750001 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.750104 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.750310 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.750406 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.750611 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.750708 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.750946 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.751039 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.751244 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.751334 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.751547 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.751635 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.751848 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.751937 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.752152 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.752239 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.752457 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.752545 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.752777 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.752865 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.753082 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.753169 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.753382 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.753468 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.753689 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.753779 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.753993 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.754133 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.754324 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.754459 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.754628 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.754774 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.754970 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.755060 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.755291 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.755377 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.755596 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.755696 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.755903 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.755991 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.756208 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.756296 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.756534 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.756628 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.756844 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.756931 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.757156 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.757249 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.757469 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.757571 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.757782 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.757869 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.758096 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.758185 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.758409 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.758498 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.758722 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.758818 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.759152 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.759887 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.759979 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.760059 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.760127 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.760193 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.760193 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.760338 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.760577 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.760880 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.761125 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.761213 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.761474 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.761698 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.761794 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.762040 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.762134 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.762532 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.762622 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.762893 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.763186 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.763275 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.763524 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.763613 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.763841 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.763951 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.764167 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.764256 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.764482 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.764568 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.764793 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.764889 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.765105 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.765192 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.765421 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.765517 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.765746 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.765878 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.766067 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.766161 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.766403 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.766490 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.766723 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.766811 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.767069 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.767158 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.767389 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.767477 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.767705 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.767801 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.768030 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.768125 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.768349 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.768446 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.768657 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.768744 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.768973 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.769059 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.769287 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.769382 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.769603 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.769697 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.769916 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.770053 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.770229 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.770327 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.770539 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.770626 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.770850 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.770962 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.771189 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.771291 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.771501 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.771590 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.771817 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.772048 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.772145 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.772384 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.772472 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.772707 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.772795 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.773026 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.773188 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.773344 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.773440 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.773661 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.773749 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.773976 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.774073 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.774293 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.774494 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.774606 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.774816 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.774933 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.775215 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.775306 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.775548 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.775636 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.775876 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.775978 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.776197 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.776285 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.776518 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.776612 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.776838 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.776934 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.777146 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.777234 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.777454 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.777544 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.777769 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.777903 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.778103 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.778427 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.778674 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.778766 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.779032 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.779126 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.779349 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.779437 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.779669 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.779755 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.779982 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.780110 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.780296 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.780515 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.780604 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.780867 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.780963 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.781186 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.781274 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.781512 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.781600 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.781823 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.781913 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.782137 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.782225 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.782443 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.782536 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.782755 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.782850 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.783104 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.783192 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.783415 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.783513 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.783733 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.783821 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.784044 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.784133 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.784352 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.784462 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.784657 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.784752 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.785013 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.785179 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.785328 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.785499 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.785632 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.785833 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.786022 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.786159 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.786332 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.786485 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.786661 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.786803 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.786990 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.787141 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.787299 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.787467 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.787607 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.787775 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.787919 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.788081 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.788224 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.788398 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.788527 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.788709 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.788832 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.789013 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.789136 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.789334 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.789449 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.789646 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.789755 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.789951 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.790066 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.790279 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.790364 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.790583 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.790676 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.790981 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.791140 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.791293 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.791488 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.791649 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.791806 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.791972 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.792130 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.792277 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.792454 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.792583 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.792768 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.792899 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.793075 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.793210 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.793925 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.794073 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.794369 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.794702 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.794798 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.795048 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.795141 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.795374 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.795479 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.795697 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.795926 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.796014 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.796256 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.796344 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.796577 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.796665 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.796909 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.797004 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.797213 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.797298 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.797528 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.797624 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.797831 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.797918 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.798134 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.798221 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.798448 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.798536 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.798753 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.798847 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.799081 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.799187 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.799392 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.799478 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.799696 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.799782 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.800000 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.800100 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.800305 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.800393 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.800608 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.800694 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.800918 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.801018 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.801221 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.801314 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.801529 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.801622 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.801831 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.801918 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.802139 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.802225 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.802441 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.802532 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.802749 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.802836 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.803091 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.803210 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.803429 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.803518 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.803734 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.803829 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.804036 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.804173 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.804353 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.804441 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.804666 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.804771 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.804973 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.805060 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.805285 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.805381 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.805591 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.805723 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.805898 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.805988 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.806214 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.806315 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.806541 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.806753 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.806841 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.807111 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.807203 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.807434 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.807577 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.807767 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.807891 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.808099 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.808196 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.808408 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.808503 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.808714 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.808802 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.809622 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.809823 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.809971 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.810287 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.810411 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.810611 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.810740 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.810941 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.811073 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.811273 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.811389 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.811612 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.811700 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.811942 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.812032 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.812267 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.812362 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.812573 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.812670 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.812878 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.812966 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.813180 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.813268 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.813489 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.813589 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.813804 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.813893 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.814111 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.814242 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.814415 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.814511 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.814718 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.814809 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.815049 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.815139 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.815360 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.815450 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.815663 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.815751 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.815964 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.816052 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.816264 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.816354 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.816572 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.816667 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.816874 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.816963 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.817175 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.817271 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.817476 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.817564 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.817776 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.817879 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.818121 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.818219 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.818374 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.818462 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.818683 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.818783 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.819008 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.819099 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.819312 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.819458 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.819612 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.819774 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.819913 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.820095 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.820213 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.820417 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.820542 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.820733 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.820882 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.821056 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.821178 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.821381 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.821518 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.821695 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.821783 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.822019 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.822109 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.822340 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.822478 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.822667 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.822771 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.823029 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.823147 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.823345 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.823453 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.823655 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.823754 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.823965 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.824063 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.824273 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.824384 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.824580 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.824718 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.824911 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.825228 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.825493 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.825591 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.825802 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.825895 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.826118 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.826215 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.826425 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.826517 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.826732 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.826823 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.827072 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.827216 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.827381 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.827481 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.827689 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.827781 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.827996 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.828094 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.828304 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.828401 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.828616 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.828706 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.828922 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.829020 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.829228 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.829328 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.829533 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.829623 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.829836 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.829940 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.830139 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.830229 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.830443 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.830533 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.830776 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.830887 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.831087 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.831169 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.831365 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.831456 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.831669 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.831761 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.831972 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.832062 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.832275 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.832365 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.832597 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.832688 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.832921 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.833018 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.833237 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.833326 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.833561 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.833653 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.833873 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.833971 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.834193 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.834311 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.834505 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.834596 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.834822 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.834939 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.835165 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.835271 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.835469 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.835559 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.835711 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 01:37:12.835801 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.836110 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.836423 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.836736 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.837049 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.837362 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.837677 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.837991 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.838317 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.838642 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.838970 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.839300 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.839620 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.839945 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.840263 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.841144 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.841482 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.841801 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.842118 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.842434 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.842750 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.843093 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.843415 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.843729 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.844045 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.844364 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.844682 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.845012 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.845340 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.845659 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.845986 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.846315 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.846662 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.846998 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.847345 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.847675 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.847989 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.848341 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.848610 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:37:12.848854 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 01:37:12.990312 n-d-826529-8 devstack@n-api.service[110592]: INFO dbcounter [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] Registered counter for database nova_api Aug 03 01:37:13.008318 n-d-826529-8 devstack@n-api.service[110591]: INFO dbcounter [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] Registered counter for database nova_api Aug 03 01:37:13.010770 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_db.sqlalchemy.engines [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:37:13.018614 n-d-826529-8 devstack@n-api.service[110592]: DEBUG dbcounter [-] [110592] Writer thread running {{(pid=110592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:37:13.030083 n-d-826529-8 devstack@n-api.service[110591]: DEBUG oslo_db.sqlalchemy.engines [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:37:13.036666 n-d-826529-8 devstack@n-api.service[110591]: DEBUG dbcounter [-] [110591] Writer thread running {{(pid=110591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:37:13.075481 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.context [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),812a442e-24ba-4152-b2b0-f99907b19272(cell1) {{(pid=110592) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 01:37:13.079497 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_concurrency.lockutils [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:37:13.081079 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_concurrency.lockutils [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:37:13.081879 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_concurrency.lockutils [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:37:13.083894 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_concurrency.lockutils [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:37:13.085967 n-d-826529-8 devstack@n-api.service[110592]: INFO dbcounter [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] Registered counter for database nova_cell0 Aug 03 01:37:13.091539 n-d-826529-8 devstack@n-api.service[110592]: INFO dbcounter [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] Registered counter for database nova_cell1 Aug 03 01:37:13.091690 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.context [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),812a442e-24ba-4152-b2b0-f99907b19272(cell1) {{(pid=110591) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 01:37:13.095641 n-d-826529-8 devstack@n-api.service[110591]: DEBUG oslo_concurrency.lockutils [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:37:13.097211 n-d-826529-8 devstack@n-api.service[110591]: DEBUG oslo_concurrency.lockutils [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:37:13.098017 n-d-826529-8 devstack@n-api.service[110591]: DEBUG oslo_concurrency.lockutils [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:37:13.100023 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_db.sqlalchemy.engines [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:37:13.100165 n-d-826529-8 devstack@n-api.service[110591]: DEBUG oslo_concurrency.lockutils [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:37:13.101697 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_db.sqlalchemy.engines [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:37:13.102068 n-d-826529-8 devstack@n-api.service[110591]: INFO dbcounter [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] Registered counter for database nova_cell0 Aug 03 01:37:13.108101 n-d-826529-8 devstack@n-api.service[110591]: INFO dbcounter [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] Registered counter for database nova_cell1 Aug 03 01:37:13.108286 n-d-826529-8 devstack@n-api.service[110592]: DEBUG dbcounter [-] [110592] Writer thread running {{(pid=110592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:37:13.111189 n-d-826529-8 devstack@n-api.service[110592]: DEBUG dbcounter [-] [110592] Writer thread running {{(pid=110592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:37:13.115765 n-d-826529-8 devstack@n-api.service[110591]: DEBUG oslo_db.sqlalchemy.engines [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:37:13.118662 n-d-826529-8 devstack@n-api.service[110591]: DEBUG oslo_db.sqlalchemy.engines [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:37:13.123964 n-d-826529-8 devstack@n-api.service[110591]: DEBUG dbcounter [-] [110591] Writer thread running {{(pid=110591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:37:13.259561 n-d-826529-8 devstack@n-api.service[110592]: INFO dbcounter [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] Registered counter for database nova_cell0 Aug 03 01:37:13.265000 n-d-826529-8 devstack@n-api.service[110591]: DEBUG dbcounter [-] [110591] Writer thread running {{(pid=110591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:37:13.269400 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_db.sqlalchemy.engines [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:37:13.273726 n-d-826529-8 devstack@n-api.service[110592]: DEBUG dbcounter [-] [110592] Writer thread running {{(pid=110592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:37:13.275167 n-d-826529-8 devstack@n-api.service[110591]: INFO dbcounter [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] Registered counter for database nova_cell0 Aug 03 01:37:13.282327 n-d-826529-8 devstack@n-api.service[110591]: DEBUG oslo_db.sqlalchemy.engines [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:37:13.286996 n-d-826529-8 devstack@n-api.service[110591]: DEBUG dbcounter [-] [110591] Writer thread running {{(pid=110591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:37:13.614712 n-d-826529-8 devstack@n-api.service[110591]: WARNING keystonemiddleware.auth_token [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 01:37:13.615415 n-d-826529-8 devstack@n-api.service[110592]: WARNING keystonemiddleware.auth_token [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 01:37:13.622984 n-d-826529-8 devstack@n-api.service[110591]: WARNING keystonemiddleware.auth_token [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 01:37:13.623433 n-d-826529-8 devstack@n-api.service[110592]: WARNING keystonemiddleware.auth_token [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 01:37:13.966642 n-d-826529-8 devstack@n-api.service[110591]: WARNING keystonemiddleware.auth_token [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 01:37:13.967938 n-d-826529-8 devstack@n-api.service[110592]: WARNING keystonemiddleware.auth_token [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 01:37:13.972560 n-d-826529-8 devstack@n-api.service[110591]: WARNING keystonemiddleware.auth_token [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 01:37:13.973890 n-d-826529-8 devstack@n-api.service[110592]: WARNING keystonemiddleware.auth_token [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 01:37:13.977886 n-d-826529-8 devstack@n-api.service[110591]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bc98d9b9c0 pid: 110591 (default app) Aug 03 01:37:13.979179 n-d-826529-8 devstack@n-api.service[110592]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bc98d9b9c0 pid: 110592 (default app) Aug 03 01:37:13.979974 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:37:13.981180 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-9774f4e0-6d90-4465-9e8c-f5b7863366be None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001729 Aug 03 01:37:13.981586 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 788 bytes} [Wed Aug 3 01:37:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:38:30.506495 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:38:30.507750 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002007 Aug 03 01:38:30.508147 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 930 bytes} [Wed Aug 3 01:38:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:38:30.520048 n-d-826529-8 devstack@n-api.service[110591]: DEBUG dbcounter [-] [110591] Writing DB stats nova_api:SELECT=3 {{(pid=110591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:38:30.520923 n-d-826529-8 devstack@n-api.service[110591]: DEBUG dbcounter [-] [110591] Writing DB stats nova_cell0:SELECT=3 {{(pid=110591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:38:30.521903 n-d-826529-8 devstack@n-api.service[110591]: DEBUG dbcounter [-] [110591] Writing DB stats nova_cell1:SELECT=3 {{(pid=110591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:38:30.522943 n-d-826529-8 devstack@n-api.service[110591]: DEBUG dbcounter [-] [110591] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:38:31.406994 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-8ad8194c-8595-4789-a8a6-69137d8edabf admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:38:31.439042 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-8ad8194c-8595-4789-a8a6-69137d8edabf admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.924098 Aug 03 01:38:31.439784 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 2/3] 10.222.0.67 () {60 vars in 1291 bytes} [Wed Aug 3 01:38:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:38:33.705966 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:38:33.707031 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-55960cf9-aa32-4375-a819-5130fd050a61 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 03 01:38:33.707432 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 2/4] 10.222.0.67 () {54 vars in 930 bytes} [Wed Aug 3 01:38:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:38:34.200690 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-89dbd4fa-a58f-4fb5-b6f5-0178eed57fa5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "c1", "vcpus": 1, "ram": 256}} {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:34.220229 n-d-826529-8 devstack@n-api.service[110591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:38:34.220229 n-d-826529-8 devstack@n-api.service[110591]: warnings.warn(msg) Aug 03 01:38:34.249359 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-89dbd4fa-a58f-4fb5-b6f5-0178eed57fa5 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.533929 Aug 03 01:38:34.250223 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 3/5] 10.222.0.67 () {64 vars in 1282 bytes} [Wed Aug 3 01:38:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:38:34.264283 n-d-826529-8 devstack@n-api.service[110592]: DEBUG dbcounter [-] [110592] Writing DB stats nova_api:SELECT=3 {{(pid=110592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:38:34.265513 n-d-826529-8 devstack@n-api.service[110592]: DEBUG dbcounter [-] [110592] Writing DB stats nova_cell0:SELECT=3 {{(pid=110592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:38:34.266834 n-d-826529-8 devstack@n-api.service[110592]: DEBUG dbcounter [-] [110592] Writing DB stats nova_cell1:SELECT=3 {{(pid=110592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:38:34.267578 n-d-826529-8 devstack@n-api.service[110592]: DEBUG dbcounter [-] [110592] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:38:34.473055 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-a26837ae-8e9e-4c0d-a900-519bae0cd9fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:34.478081 n-d-826529-8 devstack@n-api.service[110592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:38:34.478081 n-d-826529-8 devstack@n-api.service[110592]: warnings.warn(msg) Aug 03 01:38:34.545362 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-a26837ae-8e9e-4c0d-a900-519bae0cd9fa admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286959 Aug 03 01:38:34.546289 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 3/6] 10.222.0.67 () {64 vars in 1335 bytes} [Wed Aug 3 01:38:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:38:36.809260 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-89dbd4fa-a58f-4fb5-b6f5-0178eed57fa5 admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:38:36.810219 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-89dbd4fa-a58f-4fb5-b6f5-0178eed57fa5 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 03 01:38:36.810625 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 4/7] 10.222.0.67 () {54 vars in 930 bytes} [Wed Aug 3 01:38:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:38:37.606122 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-bbac1052-4daa-4422-8d1a-0d8ab800bd8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "swap": 0, "ram": 512, "vcpus": 1}} {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:37.634312 n-d-826529-8 devstack@n-api.service[110592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:38:37.634312 n-d-826529-8 devstack@n-api.service[110592]: warnings.warn(msg) Aug 03 01:38:37.657092 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-bbac1052-4daa-4422-8d1a-0d8ab800bd8b admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.840386 Aug 03 01:38:37.658322 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 4/8] 10.222.0.67 () {64 vars in 1282 bytes} [Wed Aug 3 01:38:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 01:38:37.671040 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-53a44ffd-df91-4321-b363-292018e2566c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:37.673882 n-d-826529-8 devstack@n-api.service[110591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:38:37.673882 n-d-826529-8 devstack@n-api.service[110591]: warnings.warn(msg) Aug 03 01:38:37.708154 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-53a44ffd-df91-4321-b363-292018e2566c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040675 Aug 03 01:38:37.708666 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 5/9] 10.222.0.67 () {64 vars in 1335 bytes} [Wed Aug 3 01:38:37 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:38:40.182809 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-bbac1052-4daa-4422-8d1a-0d8ab800bd8b admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:38:40.184154 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-bbac1052-4daa-4422-8d1a-0d8ab800bd8b admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001819 Aug 03 01:38:40.184795 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 930 bytes} [Wed Aug 3 01:38:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:38:40.776115 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-dba5d9c1-02a2-4087-bddf-9308837f9383 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "id": "d2", "ram": 1024, "swap": 0, "rxtx_factor": 1.0}} {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:40.798383 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-dba5d9c1-02a2-4087-bddf-9308837f9383 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.600926 Aug 03 01:38:40.807044 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 6/11] 10.222.0.67 () {64 vars in 1282 bytes} [Wed Aug 3 01:38:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 01:38:40.812917 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-b7d944e2-ef05-4ff3-914a-1ffade7477ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:40.841728 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-b7d944e2-ef05-4ff3-914a-1ffade7477ae admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032562 Aug 03 01:38:40.843350 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 6/12] 10.222.0.67 () {64 vars in 1335 bytes} [Wed Aug 3 01:38:40 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:38:43.118916 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-dba5d9c1-02a2-4087-bddf-9308837f9383 admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:38:43.119947 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-dba5d9c1-02a2-4087-bddf-9308837f9383 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Aug 03 01:38:43.120746 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 7/13] 10.222.0.67 () {54 vars in 930 bytes} [Wed Aug 3 01:38:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:38:43.504837 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-25584a4b-708b-4e12-9a28-890653c73ba5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "ram": 2048, "disk": 10, "swap": 0, "vcpus": 2, "id": "d3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:43.530044 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-25584a4b-708b-4e12-9a28-890653c73ba5 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.403383 Aug 03 01:38:43.530598 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 7/14] 10.222.0.67 () {64 vars in 1282 bytes} [Wed Aug 3 01:38:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:38:43.543450 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-5f4f5205-f11a-4c9e-a360-417711ed31db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:43.567638 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-5f4f5205-f11a-4c9e-a360-417711ed31db admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028687 Aug 03 01:38:43.568588 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 8/15] 10.222.0.67 () {64 vars in 1335 bytes} [Wed Aug 3 01:38:43 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:38:45.859322 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-25584a4b-708b-4e12-9a28-890653c73ba5 admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:38:45.860361 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-25584a4b-708b-4e12-9a28-890653c73ba5 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Aug 03 01:38:45.860758 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 8/16] 10.222.0.67 () {54 vars in 930 bytes} [Wed Aug 3 01:38:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:38:46.345603 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-feffa16d-9c11-4870-94d0-bbb9cf511fd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "disk": 20, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:46.371266 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-feffa16d-9c11-4870-94d0-bbb9cf511fd1 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.504303 Aug 03 01:38:46.371826 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 9/17] 10.222.0.67 () {64 vars in 1282 bytes} [Wed Aug 3 01:38:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 01:38:46.384351 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-b2da608f-683c-4f09-b887-28ccd3c66f9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:46.420375 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-b2da608f-683c-4f09-b887-28ccd3c66f9d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040154 Aug 03 01:38:46.421682 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 9/18] 10.222.0.67 () {64 vars in 1335 bytes} [Wed Aug 3 01:38:46 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:38:48.802173 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-feffa16d-9c11-4870-94d0-bbb9cf511fd1 admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:38:48.803985 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-feffa16d-9c11-4870-94d0-bbb9cf511fd1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002049 Aug 03 01:38:48.805397 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 10/19] 10.222.0.67 () {54 vars in 930 bytes} [Wed Aug 3 01:38:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:38:49.270330 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-dfc38b99-b881-4c93-81b2-17c59321a70e admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:38:49.298152 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-dfc38b99-b881-4c93-81b2-17c59321a70e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.486641 Aug 03 01:38:49.319614 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 10/20] 10.222.0.67 () {60 vars in 1291 bytes} [Wed Aug 3 01:38:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:38:51.670514 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-feffa16d-9c11-4870-94d0-bbb9cf511fd1 admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:38:51.671590 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-feffa16d-9c11-4870-94d0-bbb9cf511fd1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 03 01:38:51.671985 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 11/21] 10.222.0.67 () {54 vars in 930 bytes} [Wed Aug 3 01:38:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:38:52.137006 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-1f8d44bc-0614-426b-9303-76ab6b029f8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512}} {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:52.156765 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-1f8d44bc-0614-426b-9303-76ab6b029f8e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.474324 Aug 03 01:38:52.157510 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 11/22] 10.222.0.67 () {64 vars in 1282 bytes} [Wed Aug 3 01:38:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 01:38:52.170463 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-bd7c7498-f71c-4502-b916-acd78e966b05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:52.195065 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-bd7c7498-f71c-4502-b916-acd78e966b05 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028214 Aug 03 01:38:52.195678 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 12/23] 10.222.0.67 () {64 vars in 1332 bytes} [Wed Aug 3 01:38:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:38:54.449634 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-1f8d44bc-0614-426b-9303-76ab6b029f8e admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:38:54.450645 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-1f8d44bc-0614-426b-9303-76ab6b029f8e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 03 01:38:54.451100 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 12/24] 10.222.0.67 () {54 vars in 930 bytes} [Wed Aug 3 01:38:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:38:54.864337 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-4c744f87-c220-4526-99ff-6acb655bef26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:54.884940 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-4c744f87-c220-4526-99ff-6acb655bef26 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.427973 Aug 03 01:38:54.885497 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 13/25] 10.222.0.67 () {64 vars in 1282 bytes} [Wed Aug 3 01:38:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:38:54.897545 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-3e7a69ef-2c66-49d6-ac2b-7ed53d516adf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:54.921498 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-3e7a69ef-2c66-49d6-ac2b-7ed53d516adf admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027595 Aug 03 01:38:54.922075 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 13/26] 10.222.0.67 () {64 vars in 1332 bytes} [Wed Aug 3 01:38:54 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:38:57.133216 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-4c744f87-c220-4526-99ff-6acb655bef26 admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:38:57.134224 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-4c744f87-c220-4526-99ff-6acb655bef26 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002178 Aug 03 01:38:57.134629 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 14/27] 10.222.0.67 () {54 vars in 930 bytes} [Wed Aug 3 01:38:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:38:57.547614 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-63d0db71-3d74-4686-be7c-8d2e54b3eed9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "name": "m1.medium", "disk": 40, "ram": 4096}} {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:57.567680 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-63d0db71-3d74-4686-be7c-8d2e54b3eed9 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.427022 Aug 03 01:38:57.568357 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 14/28] 10.222.0.67 () {64 vars in 1282 bytes} [Wed Aug 3 01:38:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 01:38:57.580649 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-bff70562-f8e7-4703-95b3-4637fa25d67e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:38:57.608753 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-bff70562-f8e7-4703-95b3-4637fa25d67e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031893 Aug 03 01:38:57.609333 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 15/29] 10.222.0.67 () {64 vars in 1332 bytes} [Wed Aug 3 01:38:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:38:59.836319 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-63d0db71-3d74-4686-be7c-8d2e54b3eed9 admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:38:59.837232 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-63d0db71-3d74-4686-be7c-8d2e54b3eed9 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 03 01:38:59.837830 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 15/30] 10.222.0.67 () {54 vars in 930 bytes} [Wed Aug 3 01:38:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:39:00.210882 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-1139d905-0db6-46dc-ae26-f9a5f1ce6942 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4", "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:39:00.232026 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-1139d905-0db6-46dc-ae26-f9a5f1ce6942 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.388108 Aug 03 01:39:00.232596 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 16/31] 10.222.0.67 () {64 vars in 1282 bytes} [Wed Aug 3 01:38:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 01:39:00.245460 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-d15623e4-c138-4905-b193-9e4144b34708 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:39:00.269160 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-d15623e4-c138-4905-b193-9e4144b34708 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028217 Aug 03 01:39:00.269754 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 16/32] 10.222.0.67 () {64 vars in 1332 bytes} [Wed Aug 3 01:39:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:39:02.551259 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-1139d905-0db6-46dc-ae26-f9a5f1ce6942 admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:02.552904 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-1139d905-0db6-46dc-ae26-f9a5f1ce6942 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002404 Aug 03 01:39:02.553599 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 17/33] 10.222.0.67 () {54 vars in 930 bytes} [Wed Aug 3 01:39:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:39:03.017333 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-37c092d3-0e19-427b-8854-60269e707387 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "disk": 160, "vcpus": 8, "swap": 0, "ram": 16384}} {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:39:03.039244 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-37c092d3-0e19-427b-8854-60269e707387 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.478939 Aug 03 01:39:03.040546 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 17/34] 10.222.0.67 () {64 vars in 1282 bytes} [Wed Aug 3 01:39:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 01:39:03.052250 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-3858e5c4-9eb1-4b7d-b37a-7e50bbfa4617 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:39:03.057596 n-d-826529-8 devstack@n-api.service[110591]: DEBUG dbcounter [-] [110591] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:39:03.084439 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-3858e5c4-9eb1-4b7d-b37a-7e50bbfa4617 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035845 Aug 03 01:39:03.086046 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 18/35] 10.222.0.67 () {64 vars in 1332 bytes} [Wed Aug 3 01:39:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:39:27.748730 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-37c092d3-0e19-427b-8854-60269e707387 admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:27.749773 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-37c092d3-0e19-427b-8854-60269e707387 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 03 01:39:27.750172 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 18/36] 10.222.0.67 () {54 vars in 930 bytes} [Wed Aug 3 01:39:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:39:27.760676 n-d-826529-8 devstack@n-api.service[110591]: DEBUG dbcounter [-] [110591] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=110591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:39:28.136772 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-d55d019b-6021-4bf8-9a86-39cdddfc0d4e admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:28.155462 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-d55d019b-6021-4bf8-9a86-39cdddfc0d4e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399297 Aug 03 01:39:28.155996 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 19/37] 10.222.0.67 () {60 vars in 1291 bytes} [Wed Aug 3 01:39:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:39:29.226815 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-37c092d3-0e19-427b-8854-60269e707387 admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:29.227874 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-37c092d3-0e19-427b-8854-60269e707387 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 03 01:39:29.228276 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 19/38] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 3 01:39:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:39:29.775041 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-e8d3b288-2190-4382-905a-13a797cd77f1 admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:29.780934 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.wsgi [None req-e8d3b288-2190-4382-905a-13a797cd77f1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-e8d3b288-2190-4382-905a-13a797cd77f1 admin admin] Request method failure captured: Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: Accept: application/json Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: Accept-Encoding: gzip, deflate Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: Connection: keep-alive Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: Content-Length: 0 Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: Host: 10.222.0.67 Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: Openstack-Api-Version: compute 2.90 Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: Openstack-System-Scope: None Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: User-Agent: python-novaclient Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: X-Auth-Token: gAAAAABi6dHRm1iG9d6xa6nqxmdYx1o6tPCmsmgIX7mnuLAcP1QlR9APS54MpwC3mXg4T4R1WdIDGk-xp40swc9ZNqjxiVXCKAL4doNgEihLF2w0pg_CN1He5h0DZKjRy-VGv8qNASN2mmLgOGEMsd_SBRMAbvJjoHEbM3mLlfKG0Ed3OFLIt1U Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: X-Domain-Id: None Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: X-Domain-Name: None Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: X-Identity-Status: Confirmed Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: X-Is-Admin-Project: True Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: X-Project-Domain-Id: default Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: X-Project-Domain-Name: Default Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: X-Project-Id: 87971d478a7c40f29840c615523a2c8d Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: X-Project-Name: admin Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: X-Role: admin,member,reader Aug 03 01:39:29.784210 n-d-826529-8 devstack@n-api.service[110591]: X-Roles: admin,member,reader Aug 03 01:39:29.785839 n-d-826529-8 devstack@n-api.service[110591]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_87971d478a7c40f29840c615523a2c8d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/87971d478a7c40f29840c615523a2c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/87971d478a7c40f29840c615523a2c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/87971d478a7c40f29840c615523a2c8d"}]}] Aug 03 01:39:29.785839 n-d-826529-8 devstack@n-api.service[110591]: X-Tenant: admin Aug 03 01:39:29.785839 n-d-826529-8 devstack@n-api.service[110591]: X-Tenant-Id: 87971d478a7c40f29840c615523a2c8d Aug 03 01:39:29.785839 n-d-826529-8 devstack@n-api.service[110591]: X-Tenant-Name: admin Aug 03 01:39:29.785839 n-d-826529-8 devstack@n-api.service[110591]: X-User: admin Aug 03 01:39:29.785839 n-d-826529-8 devstack@n-api.service[110591]: X-User-Domain-Id: default Aug 03 01:39:29.785839 n-d-826529-8 devstack@n-api.service[110591]: X-User-Domain-Name: Default Aug 03 01:39:29.785839 n-d-826529-8 devstack@n-api.service[110591]: X-User-Id: 21c05f9a10284c739340a2d328ce360d Aug 03 01:39:29.785839 n-d-826529-8 devstack@n-api.service[110591]: X-User-Name: admin Aug 03 01:39:29.785839 n-d-826529-8 devstack@n-api.service[110591]: method: > Aug 03 01:39:29.785839 n-d-826529-8 devstack@n-api.service[110591]: exception: Flavor 42 could not be found. Aug 03 01:39:29.785839 n-d-826529-8 devstack@n-api.service[110591]: action_args: {'id': '42'} Aug 03 01:39:29.785839 n-d-826529-8 devstack@n-api.service[110591]: {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:39:29.785839 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:39:29.786707 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Aug 03 01:39:29.787975 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-e8d3b288-2190-4382-905a-13a797cd77f1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:39:29.789008 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-e8d3b288-2190-4382-905a-13a797cd77f1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397504 Aug 03 01:39:29.789008 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 20/39] 10.222.0.67 () {60 vars in 1190 bytes} [Wed Aug 3 01:39:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 01:39:29.795341 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-c96b2066-86b7-470f-8bbe-a196534084ff admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:29.799539 n-d-826529-8 devstack@n-api.service[110592]: DEBUG dbcounter [-] [110592] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:39:29.820379 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-c96b2066-86b7-470f-8bbe-a196534084ff admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028539 Aug 03 01:39:29.820952 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 20/40] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 3 01:39:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:39:29.836094 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-9321289f-e7bf-4a3c-ba15-deb5162e1bd1 admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:29.860731 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-9321289f-e7bf-4a3c-ba15-deb5162e1bd1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028299 Aug 03 01:39:29.861285 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 21/41] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 3 01:39:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:39:29.871607 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-7fa0c73d-d430-4e70-a8a4-88cb76d71a57 admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:29.878065 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.wsgi [None req-7fa0c73d-d430-4e70-a8a4-88cb76d71a57 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-7fa0c73d-d430-4e70-a8a4-88cb76d71a57 admin admin] Request method failure captured: Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: Accept: application/json Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: Accept-Encoding: gzip, deflate Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: Connection: keep-alive Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: Content-Length: 0 Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: Host: 10.222.0.67 Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: Openstack-Api-Version: compute 2.90 Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: Openstack-System-Scope: None Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: User-Agent: python-novaclient Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: X-Auth-Token: gAAAAABi6dHRm1iG9d6xa6nqxmdYx1o6tPCmsmgIX7mnuLAcP1QlR9APS54MpwC3mXg4T4R1WdIDGk-xp40swc9ZNqjxiVXCKAL4doNgEihLF2w0pg_CN1He5h0DZKjRy-VGv8qNASN2mmLgOGEMsd_SBRMAbvJjoHEbM3mLlfKG0Ed3OFLIt1U Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: X-Domain-Id: None Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: X-Domain-Name: None Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: X-Identity-Status: Confirmed Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: X-Is-Admin-Project: True Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: X-Project-Domain-Id: default Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: X-Project-Domain-Name: Default Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: X-Project-Id: 87971d478a7c40f29840c615523a2c8d Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: X-Project-Name: admin Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: X-Role: admin,member,reader Aug 03 01:39:29.881997 n-d-826529-8 devstack@n-api.service[110592]: X-Roles: admin,member,reader Aug 03 01:39:29.883590 n-d-826529-8 devstack@n-api.service[110592]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_87971d478a7c40f29840c615523a2c8d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/87971d478a7c40f29840c615523a2c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/87971d478a7c40f29840c615523a2c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/87971d478a7c40f29840c615523a2c8d"}]}] Aug 03 01:39:29.883590 n-d-826529-8 devstack@n-api.service[110592]: X-Tenant: admin Aug 03 01:39:29.883590 n-d-826529-8 devstack@n-api.service[110592]: X-Tenant-Id: 87971d478a7c40f29840c615523a2c8d Aug 03 01:39:29.883590 n-d-826529-8 devstack@n-api.service[110592]: X-Tenant-Name: admin Aug 03 01:39:29.883590 n-d-826529-8 devstack@n-api.service[110592]: X-User: admin Aug 03 01:39:29.883590 n-d-826529-8 devstack@n-api.service[110592]: X-User-Domain-Id: default Aug 03 01:39:29.883590 n-d-826529-8 devstack@n-api.service[110592]: X-User-Domain-Name: Default Aug 03 01:39:29.883590 n-d-826529-8 devstack@n-api.service[110592]: X-User-Id: 21c05f9a10284c739340a2d328ce360d Aug 03 01:39:29.883590 n-d-826529-8 devstack@n-api.service[110592]: X-User-Name: admin Aug 03 01:39:29.883590 n-d-826529-8 devstack@n-api.service[110592]: method: > Aug 03 01:39:29.883590 n-d-826529-8 devstack@n-api.service[110592]: exception: Flavor 42 could not be found. Aug 03 01:39:29.883590 n-d-826529-8 devstack@n-api.service[110592]: action_args: {'id': '42'} Aug 03 01:39:29.883590 n-d-826529-8 devstack@n-api.service[110592]: {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:39:29.883590 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:39:29.884455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Aug 03 01:39:29.885484 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-7fa0c73d-d430-4e70-a8a4-88cb76d71a57 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:39:29.886516 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-7fa0c73d-d430-4e70-a8a4-88cb76d71a57 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015602 Aug 03 01:39:29.886516 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 21/42] 10.222.0.67 () {60 vars in 1190 bytes} [Wed Aug 3 01:39:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 01:39:30.865305 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-9321289f-e7bf-4a3c-ba15-deb5162e1bd1 admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:30.866492 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-9321289f-e7bf-4a3c-ba15-deb5162e1bd1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001706 Aug 03 01:39:30.866885 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 22/43] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 3 01:39:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:39:31.400238 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-09ad5b90-38f9-4e14-b16d-1d1815e6ec20 admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:31.405536 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.wsgi [None req-09ad5b90-38f9-4e14-b16d-1d1815e6ec20 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-09ad5b90-38f9-4e14-b16d-1d1815e6ec20 admin admin] Request method failure captured: Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: Accept: application/json Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: Accept-Encoding: gzip, deflate Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: Connection: keep-alive Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: Content-Length: 0 Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: Host: 10.222.0.67 Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: Openstack-Api-Version: compute 2.90 Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: Openstack-System-Scope: None Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: User-Agent: python-novaclient Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: X-Auth-Token: gAAAAABi6dHS-J-QwbRGnXyu0vAXKXGArBexi6_tZPHIUIrNPiPI9fPAqpu8F8hYRZdvjbeyV86j69hvGUaPEdWuXXOsW4rf4fJEueFLP_oJsLyVf5GsqjcSCugbmbpaO8lKAurhq0uSQGx7NNho6aET4xPh1LfGbSradSEUZ7uprRv-fj8GXS0 Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: X-Domain-Id: None Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: X-Domain-Name: None Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: X-Identity-Status: Confirmed Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: X-Is-Admin-Project: True Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: X-Project-Domain-Id: default Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: X-Project-Domain-Name: Default Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: X-Project-Id: 87971d478a7c40f29840c615523a2c8d Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: X-Project-Name: admin Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: X-Role: admin,member,reader Aug 03 01:39:31.407061 n-d-826529-8 devstack@n-api.service[110592]: X-Roles: admin,member,reader Aug 03 01:39:31.408530 n-d-826529-8 devstack@n-api.service[110592]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_87971d478a7c40f29840c615523a2c8d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/87971d478a7c40f29840c615523a2c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/87971d478a7c40f29840c615523a2c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/87971d478a7c40f29840c615523a2c8d"}]}] Aug 03 01:39:31.408530 n-d-826529-8 devstack@n-api.service[110592]: X-Tenant: admin Aug 03 01:39:31.408530 n-d-826529-8 devstack@n-api.service[110592]: X-Tenant-Id: 87971d478a7c40f29840c615523a2c8d Aug 03 01:39:31.408530 n-d-826529-8 devstack@n-api.service[110592]: X-Tenant-Name: admin Aug 03 01:39:31.408530 n-d-826529-8 devstack@n-api.service[110592]: X-User: admin Aug 03 01:39:31.408530 n-d-826529-8 devstack@n-api.service[110592]: X-User-Domain-Id: default Aug 03 01:39:31.408530 n-d-826529-8 devstack@n-api.service[110592]: X-User-Domain-Name: Default Aug 03 01:39:31.408530 n-d-826529-8 devstack@n-api.service[110592]: X-User-Id: 21c05f9a10284c739340a2d328ce360d Aug 03 01:39:31.408530 n-d-826529-8 devstack@n-api.service[110592]: X-User-Name: admin Aug 03 01:39:31.408530 n-d-826529-8 devstack@n-api.service[110592]: method: > Aug 03 01:39:31.408530 n-d-826529-8 devstack@n-api.service[110592]: exception: Flavor 84 could not be found. Aug 03 01:39:31.408530 n-d-826529-8 devstack@n-api.service[110592]: action_args: {'id': '84'} Aug 03 01:39:31.408530 n-d-826529-8 devstack@n-api.service[110592]: {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:39:31.408530 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:39:31.409362 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Aug 03 01:39:31.410455 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-09ad5b90-38f9-4e14-b16d-1d1815e6ec20 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:39:31.411494 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-09ad5b90-38f9-4e14-b16d-1d1815e6ec20 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398717 Aug 03 01:39:31.411494 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 22/44] 10.222.0.67 () {60 vars in 1190 bytes} [Wed Aug 3 01:39:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 01:39:31.418204 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-532bb1db-f7f1-4f5b-a3a7-feb40d77e29a admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:31.433725 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-532bb1db-f7f1-4f5b-a3a7-feb40d77e29a admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019051 Aug 03 01:39:31.434286 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 23/45] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 3 01:39:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:39:31.444420 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-aa93c8cf-3e77-418a-b251-eb8f73e0cbe0 admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:31.459561 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-aa93c8cf-3e77-418a-b251-eb8f73e0cbe0 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019407 Aug 03 01:39:31.460096 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 23/46] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 3 01:39:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:39:31.469446 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-8acecacd-d256-41de-9d0c-ed1970f0d8be admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:31.475613 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.wsgi [None req-8acecacd-d256-41de-9d0c-ed1970f0d8be admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-8acecacd-d256-41de-9d0c-ed1970f0d8be admin admin] Request method failure captured: Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: Accept: application/json Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: Accept-Encoding: gzip, deflate Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: Connection: keep-alive Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: Content-Length: 0 Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: Host: 10.222.0.67 Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: Openstack-Api-Version: compute 2.90 Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: Openstack-System-Scope: None Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: User-Agent: python-novaclient Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: X-Auth-Token: gAAAAABi6dHS-J-QwbRGnXyu0vAXKXGArBexi6_tZPHIUIrNPiPI9fPAqpu8F8hYRZdvjbeyV86j69hvGUaPEdWuXXOsW4rf4fJEueFLP_oJsLyVf5GsqjcSCugbmbpaO8lKAurhq0uSQGx7NNho6aET4xPh1LfGbSradSEUZ7uprRv-fj8GXS0 Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: X-Domain-Id: None Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: X-Domain-Name: None Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: X-Identity-Status: Confirmed Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: X-Is-Admin-Project: True Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: X-Project-Domain-Id: default Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: X-Project-Domain-Name: Default Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: X-Project-Id: 87971d478a7c40f29840c615523a2c8d Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: X-Project-Name: admin Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: X-Role: admin,member,reader Aug 03 01:39:31.477099 n-d-826529-8 devstack@n-api.service[110591]: X-Roles: admin,member,reader Aug 03 01:39:31.478605 n-d-826529-8 devstack@n-api.service[110591]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_87971d478a7c40f29840c615523a2c8d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/87971d478a7c40f29840c615523a2c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/87971d478a7c40f29840c615523a2c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/87971d478a7c40f29840c615523a2c8d"}]}] Aug 03 01:39:31.478605 n-d-826529-8 devstack@n-api.service[110591]: X-Tenant: admin Aug 03 01:39:31.478605 n-d-826529-8 devstack@n-api.service[110591]: X-Tenant-Id: 87971d478a7c40f29840c615523a2c8d Aug 03 01:39:31.478605 n-d-826529-8 devstack@n-api.service[110591]: X-Tenant-Name: admin Aug 03 01:39:31.478605 n-d-826529-8 devstack@n-api.service[110591]: X-User: admin Aug 03 01:39:31.478605 n-d-826529-8 devstack@n-api.service[110591]: X-User-Domain-Id: default Aug 03 01:39:31.478605 n-d-826529-8 devstack@n-api.service[110591]: X-User-Domain-Name: Default Aug 03 01:39:31.478605 n-d-826529-8 devstack@n-api.service[110591]: X-User-Id: 21c05f9a10284c739340a2d328ce360d Aug 03 01:39:31.478605 n-d-826529-8 devstack@n-api.service[110591]: X-User-Name: admin Aug 03 01:39:31.478605 n-d-826529-8 devstack@n-api.service[110591]: method: > Aug 03 01:39:31.478605 n-d-826529-8 devstack@n-api.service[110591]: exception: Flavor 84 could not be found. Aug 03 01:39:31.478605 n-d-826529-8 devstack@n-api.service[110591]: action_args: {'id': '84'} Aug 03 01:39:31.478605 n-d-826529-8 devstack@n-api.service[110591]: {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:39:31.478605 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:39:31.479696 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Aug 03 01:39:31.481012 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-8acecacd-d256-41de-9d0c-ed1970f0d8be admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:39:31.482269 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-8acecacd-d256-41de-9d0c-ed1970f0d8be admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012523 Aug 03 01:39:31.482269 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 24/47] 10.222.0.67 () {60 vars in 1190 bytes} [Wed Aug 3 01:39:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 01:39:32.444304 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-aa93c8cf-3e77-418a-b251-eb8f73e0cbe0 admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:32.445372 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-aa93c8cf-3e77-418a-b251-eb8f73e0cbe0 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002045 Aug 03 01:39:32.445772 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 24/48] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 3 01:39:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:39:32.970823 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-6f4d8a69-949b-4d87-b1af-df77f6152915 admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:32.977382 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.wsgi [None req-6f4d8a69-949b-4d87-b1af-df77f6152915 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-6f4d8a69-949b-4d87-b1af-df77f6152915 admin admin] Request method failure captured: Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: Accept: application/json Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: Accept-Encoding: gzip, deflate Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: Connection: keep-alive Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: Content-Length: 0 Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: Host: 10.222.0.67 Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: Openstack-Api-Version: compute 2.90 Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: Openstack-System-Scope: None Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: User-Agent: python-novaclient Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: X-Auth-Token: gAAAAABi6dHUwv_UW3iDq7-JaceJ7fW3a6vPz5EuaFOEUawE3jFOGKmgMv5Ue6PHTOpxW3antHlif3RuVntAyzb9BqcfT2ZgpGoPS2Nc5j0_ZjNzd9C_lAh9upxMv9jBn4gUIZAunXjV0hCi66ubHlPZJfgUqN9NXOMlRtVw_BMij1Fe6ZFUXog Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: X-Domain-Id: None Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: X-Domain-Name: None Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: X-Identity-Status: Confirmed Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: X-Is-Admin-Project: True Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: X-Project-Domain-Id: default Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: X-Project-Domain-Name: Default Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: X-Project-Id: 87971d478a7c40f29840c615523a2c8d Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: X-Project-Name: admin Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: X-Role: admin,member,reader Aug 03 01:39:32.978875 n-d-826529-8 devstack@n-api.service[110591]: X-Roles: admin,member,reader Aug 03 01:39:32.980480 n-d-826529-8 devstack@n-api.service[110591]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_87971d478a7c40f29840c615523a2c8d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/87971d478a7c40f29840c615523a2c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/87971d478a7c40f29840c615523a2c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/87971d478a7c40f29840c615523a2c8d"}]}] Aug 03 01:39:32.980480 n-d-826529-8 devstack@n-api.service[110591]: X-Tenant: admin Aug 03 01:39:32.980480 n-d-826529-8 devstack@n-api.service[110591]: X-Tenant-Id: 87971d478a7c40f29840c615523a2c8d Aug 03 01:39:32.980480 n-d-826529-8 devstack@n-api.service[110591]: X-Tenant-Name: admin Aug 03 01:39:32.980480 n-d-826529-8 devstack@n-api.service[110591]: X-User: admin Aug 03 01:39:32.980480 n-d-826529-8 devstack@n-api.service[110591]: X-User-Domain-Id: default Aug 03 01:39:32.980480 n-d-826529-8 devstack@n-api.service[110591]: X-User-Domain-Name: Default Aug 03 01:39:32.980480 n-d-826529-8 devstack@n-api.service[110591]: X-User-Id: 21c05f9a10284c739340a2d328ce360d Aug 03 01:39:32.980480 n-d-826529-8 devstack@n-api.service[110591]: X-User-Name: admin Aug 03 01:39:32.980480 n-d-826529-8 devstack@n-api.service[110591]: method: > Aug 03 01:39:32.980480 n-d-826529-8 devstack@n-api.service[110591]: exception: Flavor 451 could not be found. Aug 03 01:39:32.980480 n-d-826529-8 devstack@n-api.service[110591]: action_args: {'id': '451'} Aug 03 01:39:32.980480 n-d-826529-8 devstack@n-api.service[110591]: {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:39:32.980480 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:39:32.983735 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: ERROR nova.api.openstack.wsgi Aug 03 01:39:32.985111 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-6f4d8a69-949b-4d87-b1af-df77f6152915 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:39:32.986323 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-6f4d8a69-949b-4d87-b1af-df77f6152915 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.396322 Aug 03 01:39:32.986323 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 25/49] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 3 01:39:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 03 01:39:32.989989 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-27991511-369b-4b9a-acdd-d8cc7bd59f99 admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:33.005142 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-27991511-369b-4b9a-acdd-d8cc7bd59f99 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018725 Aug 03 01:39:33.006098 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 25/50] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 3 01:39:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:39:33.015597 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-0a62945b-707d-44bc-8c16-f2b128139fdc admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:33.031046 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-0a62945b-707d-44bc-8c16-f2b128139fdc admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018969 Aug 03 01:39:33.031582 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 26/51] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 3 01:39:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:39:33.041189 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-94c32356-6272-4126-a1ea-7a562a26ed35 admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:33.046528 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.wsgi [None req-94c32356-6272-4126-a1ea-7a562a26ed35 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-94c32356-6272-4126-a1ea-7a562a26ed35 admin admin] Request method failure captured: Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: Accept: application/json Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: Accept-Encoding: gzip, deflate Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: Connection: keep-alive Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: Content-Length: 0 Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: Host: 10.222.0.67 Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: Openstack-Api-Version: compute 2.90 Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: Openstack-System-Scope: None Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: User-Agent: python-novaclient Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: X-Auth-Token: gAAAAABi6dHUwv_UW3iDq7-JaceJ7fW3a6vPz5EuaFOEUawE3jFOGKmgMv5Ue6PHTOpxW3antHlif3RuVntAyzb9BqcfT2ZgpGoPS2Nc5j0_ZjNzd9C_lAh9upxMv9jBn4gUIZAunXjV0hCi66ubHlPZJfgUqN9NXOMlRtVw_BMij1Fe6ZFUXog Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: X-Domain-Id: None Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: X-Domain-Name: None Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: X-Identity-Status: Confirmed Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: X-Is-Admin-Project: True Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: X-Project-Domain-Id: default Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: X-Project-Domain-Name: Default Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: X-Project-Id: 87971d478a7c40f29840c615523a2c8d Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: X-Project-Name: admin Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: X-Role: admin,member,reader Aug 03 01:39:33.048061 n-d-826529-8 devstack@n-api.service[110592]: X-Roles: admin,member,reader Aug 03 01:39:33.049744 n-d-826529-8 devstack@n-api.service[110592]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_87971d478a7c40f29840c615523a2c8d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/87971d478a7c40f29840c615523a2c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/87971d478a7c40f29840c615523a2c8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/87971d478a7c40f29840c615523a2c8d"}]}] Aug 03 01:39:33.049744 n-d-826529-8 devstack@n-api.service[110592]: X-Tenant: admin Aug 03 01:39:33.049744 n-d-826529-8 devstack@n-api.service[110592]: X-Tenant-Id: 87971d478a7c40f29840c615523a2c8d Aug 03 01:39:33.049744 n-d-826529-8 devstack@n-api.service[110592]: X-Tenant-Name: admin Aug 03 01:39:33.049744 n-d-826529-8 devstack@n-api.service[110592]: X-User: admin Aug 03 01:39:33.049744 n-d-826529-8 devstack@n-api.service[110592]: X-User-Domain-Id: default Aug 03 01:39:33.049744 n-d-826529-8 devstack@n-api.service[110592]: X-User-Domain-Name: Default Aug 03 01:39:33.049744 n-d-826529-8 devstack@n-api.service[110592]: X-User-Id: 21c05f9a10284c739340a2d328ce360d Aug 03 01:39:33.049744 n-d-826529-8 devstack@n-api.service[110592]: X-User-Name: admin Aug 03 01:39:33.049744 n-d-826529-8 devstack@n-api.service[110592]: method: > Aug 03 01:39:33.049744 n-d-826529-8 devstack@n-api.service[110592]: exception: Flavor 451 could not be found. Aug 03 01:39:33.049744 n-d-826529-8 devstack@n-api.service[110592]: action_args: {'id': '451'} Aug 03 01:39:33.049744 n-d-826529-8 devstack@n-api.service[110592]: {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:39:33.049744 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:39:33.050730 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: ERROR nova.api.openstack.wsgi Aug 03 01:39:33.052116 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-94c32356-6272-4126-a1ea-7a562a26ed35 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:39:33.054353 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-94c32356-6272-4126-a1ea-7a562a26ed35 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012286 Aug 03 01:39:33.054353 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 26/52] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 3 01:39:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 03 01:39:34.017133 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-0a62945b-707d-44bc-8c16-f2b128139fdc admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:34.018144 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-0a62945b-707d-44bc-8c16-f2b128139fdc admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 03 01:39:34.018538 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 27/53] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 3 01:39:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:39:34.545772 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-32f320fb-101d-4918-a40e-ceb61d4f9864 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:39:34.564508 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-32f320fb-101d-4918-a40e-ceb61d4f9864 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.405611 Aug 03 01:39:34.565044 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 27/54] 10.222.0.67 () {64 vars in 1235 bytes} [Wed Aug 3 01:39:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 01:39:35.527053 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-0a62945b-707d-44bc-8c16-f2b128139fdc admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:35.528088 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-0a62945b-707d-44bc-8c16-f2b128139fdc admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 03 01:39:35.528489 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 28/55] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 3 01:39:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:39:36.060871 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-cad74aca-d290-4b16-98aa-e6f6d4e7f4e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:39:36.078872 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-cad74aca-d290-4b16-98aa-e6f6d4e7f4e7 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.408601 Aug 03 01:39:36.079443 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 28/56] 10.222.0.67 () {64 vars in 1235 bytes} [Wed Aug 3 01:39:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 01:39:37.050343 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-0a62945b-707d-44bc-8c16-f2b128139fdc admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:37.051382 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-0a62945b-707d-44bc-8c16-f2b128139fdc admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 03 01:39:37.051785 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 29/57] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 3 01:39:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:39:37.578222 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-3c509f1f-ea66-429f-ace6-cb22847b0cf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:39:37.604814 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-3c509f1f-ea66-429f-ace6-cb22847b0cf7 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.414064 Aug 03 01:39:37.605374 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 29/58] 10.222.0.67 () {64 vars in 1235 bytes} [Wed Aug 3 01:39:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:39:38.580929 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-0a62945b-707d-44bc-8c16-f2b128139fdc admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:38.581921 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-0a62945b-707d-44bc-8c16-f2b128139fdc admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 03 01:39:38.582310 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 30/59] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 3 01:39:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:39:39.111019 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-f6db2146-d3af-4b08-bdb8-79b5cb5463f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:39:39.129240 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-f6db2146-d3af-4b08-bdb8-79b5cb5463f6 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.409136 Aug 03 01:39:39.129787 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 30/60] 10.222.0.67 () {64 vars in 1235 bytes} [Wed Aug 3 01:39:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:39:40.108674 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-0a62945b-707d-44bc-8c16-f2b128139fdc admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:40.109819 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-0a62945b-707d-44bc-8c16-f2b128139fdc admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 03 01:39:40.110295 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 31/61] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 3 01:39:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:39:40.629966 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-61c4a570-f53b-4927-bdb9-b522257e7f4b admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:39:40.651219 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-61c4a570-f53b-4927-bdb9-b522257e7f4b admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.400913 Aug 03 01:39:40.651755 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 31/62] 10.222.0.67 () {60 vars in 1202 bytes} [Wed Aug 3 01:39:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:40:32.417252 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-0a62945b-707d-44bc-8c16-f2b128139fdc admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:40:32.418270 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-0a62945b-707d-44bc-8c16-f2b128139fdc admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 03 01:40:32.418667 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 32/63] 10.222.0.67 () {54 vars in 930 bytes} [Wed Aug 3 01:40:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:40:32.429573 n-d-826529-8 devstack@n-api.service[110592]: DEBUG dbcounter [-] [110592] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:40:32.815508 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-93f8113e-01b0-48d7-a54e-2473e2e0db66 admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:40:32.835756 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-93f8113e-01b0-48d7-a54e-2473e2e0db66 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411172 Aug 03 01:40:32.836297 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 32/64] 10.222.0.67 () {60 vars in 1291 bytes} [Wed Aug 3 01:40:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:40:32.859659 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-0a4fb1c6-7371-4811-ad6b-f20406d95070 admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:40:32.863746 n-d-826529-8 devstack@n-api.service[110591]: DEBUG dbcounter [-] [110591] Writing DB stats nova_api:SELECT=14 {{(pid=110591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:40:32.869497 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-0a4fb1c6-7371-4811-ad6b-f20406d95070 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013436 Aug 03 01:40:32.870137 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 33/65] 10.222.0.67 () {60 vars in 1282 bytes} [Wed Aug 3 01:40:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:40:32.881512 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-9d72e0a5-0859-4af4-a04d-a39a22582618 admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:40:32.889420 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-9d72e0a5-0859-4af4-a04d-a39a22582618 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011539 Aug 03 01:40:32.889937 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 33/66] 10.222.0.67 () {60 vars in 1285 bytes} [Wed Aug 3 01:40:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:40:32.901462 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-08b4ddf0-48be-452b-a151-ad1de0d0994f admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:40:32.909481 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-08b4ddf0-48be-452b-a151-ad1de0d0994f admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011279 Aug 03 01:40:32.910044 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 34/67] 10.222.0.67 () {60 vars in 1285 bytes} [Wed Aug 3 01:40:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:40:32.920850 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-83f0a1d6-6f1b-4934-a235-1ed81a8d0090 admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:40:32.929317 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-83f0a1d6-6f1b-4934-a235-1ed81a8d0090 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011926 Aug 03 01:40:32.929840 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 34/68] 10.222.0.67 () {60 vars in 1282 bytes} [Wed Aug 3 01:40:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:46:00.505201 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-08b4ddf0-48be-452b-a151-ad1de0d0994f admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:46:00.506204 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-08b4ddf0-48be-452b-a151-ad1de0d0994f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 03 01:46:00.506595 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 35/69] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 3 01:46:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:46:00.648172 n-d-826529-8 devstack@n-api.service[110592]: DEBUG dbcounter [-] [110592] Writing DB stats nova_api:SELECT=6 {{(pid=110592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:46:00.794255 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-238ec5fd-b88f-4b34-8288-74442c78772c admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:46:00.796651 n-d-826529-8 devstack@n-api.service[110592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:46:00.796651 n-d-826529-8 devstack@n-api.service[110592]: warnings.warn(msg) Aug 03 01:46:00.797864 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_concurrency.lockutils [None req-238ec5fd-b88f-4b34-8288-74442c78772c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:46:00.798305 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_concurrency.lockutils [None req-238ec5fd-b88f-4b34-8288-74442c78772c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:46:00.799158 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_concurrency.lockutils [None req-238ec5fd-b88f-4b34-8288-74442c78772c admin admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:46:00.799767 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_concurrency.lockutils [None req-238ec5fd-b88f-4b34-8288-74442c78772c admin admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:46:00.841209 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-238ec5fd-b88f-4b34-8288-74442c78772c admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.194966 Aug 03 01:46:00.841775 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 35/70] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 3 01:46:00 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:46:01.678026 n-d-826529-8 devstack@n-api.service[110591]: DEBUG nova.api.openstack.wsgi [None req-08b4ddf0-48be-452b-a151-ad1de0d0994f admin admin] Calling method '>' {{(pid=110591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:46:01.679157 n-d-826529-8 devstack@n-api.service[110591]: INFO nova.api.openstack.requestlog [None req-08b4ddf0-48be-452b-a151-ad1de0d0994f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 03 01:46:01.679560 n-d-826529-8 devstack@n-api.service[110591]: [pid: 110591|app: 0|req: 36/71] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 3 01:46:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:46:01.871757 n-d-826529-8 devstack@n-api.service[110592]: DEBUG nova.api.openstack.wsgi [None req-d92926ca-02fa-4503-88ff-abeb5de60c44 admin admin] Calling method '>' {{(pid=110592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:46:01.874106 n-d-826529-8 devstack@n-api.service[110592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:46:01.874106 n-d-826529-8 devstack@n-api.service[110592]: warnings.warn(msg) Aug 03 01:46:01.875392 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_concurrency.lockutils [None req-d92926ca-02fa-4503-88ff-abeb5de60c44 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:46:01.875837 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_concurrency.lockutils [None req-d92926ca-02fa-4503-88ff-abeb5de60c44 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:46:01.876626 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_concurrency.lockutils [None req-d92926ca-02fa-4503-88ff-abeb5de60c44 admin admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:46:01.877055 n-d-826529-8 devstack@n-api.service[110592]: DEBUG oslo_concurrency.lockutils [None req-d92926ca-02fa-4503-88ff-abeb5de60c44 admin admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:46:01.900215 n-d-826529-8 devstack@n-api.service[110592]: INFO nova.api.openstack.requestlog [None req-d92926ca-02fa-4503-88ff-abeb5de60c44 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.081046 Aug 03 01:46:01.900699 n-d-826529-8 devstack@n-api.service[110592]: [pid: 110592|app: 0|req: 36/72] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 3 01:46:01 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:46:46.373007 n-d-826529-8 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 03 01:46:46.373973 n-d-826529-8 devstack@n-api.service[110590]: Wed Aug 3 01:46:46 2022 - graceful shutdown triggered... Aug 03 01:46:46.374436 n-d-826529-8 devstack@n-api.service[110592]: Gracefully killing worker 2 (pid: 110592)... Aug 03 01:46:46.374813 n-d-826529-8 devstack@n-api.service[110591]: Gracefully killing worker 1 (pid: 110591)... Aug 03 01:46:47.374579 n-d-826529-8 devstack@n-api.service[110590]: worker 1 buried after 1 seconds Aug 03 01:46:47.374579 n-d-826529-8 devstack@n-api.service[110590]: worker 2 buried after 1 seconds Aug 03 01:46:47.374579 n-d-826529-8 devstack@n-api.service[110590]: goodbye to uWSGI. Aug 03 01:46:47.376223 n-d-826529-8 systemd[1]: devstack@n-api.service: Succeeded. Aug 03 01:46:47.376820 n-d-826529-8 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 03 01:46:47.379588 n-d-826529-8 systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 01:46:47.394893 n-d-826529-8 devstack@n-api.service[125920]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 01:46:47.420838 n-d-826529-8 devstack@n-api.service[125920]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 01:46:47 2022] *** Aug 03 01:46:47.420838 n-d-826529-8 devstack@n-api.service[125920]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 01:46:47.420838 n-d-826529-8 devstack@n-api.service[125920]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 01:46:47.420838 n-d-826529-8 devstack@n-api.service[125920]: nodename: n-d-826529-8 Aug 03 01:46:47.420838 n-d-826529-8 devstack@n-api.service[125920]: machine: x86_64 Aug 03 01:46:47.420838 n-d-826529-8 devstack@n-api.service[125920]: clock source: unix Aug 03 01:46:47.420838 n-d-826529-8 devstack@n-api.service[125920]: pcre jit disabled Aug 03 01:46:47.420838 n-d-826529-8 devstack@n-api.service[125920]: detected number of CPU cores: 4 Aug 03 01:46:47.420838 n-d-826529-8 devstack@n-api.service[125920]: current working directory: / Aug 03 01:46:47.420838 n-d-826529-8 devstack@n-api.service[125920]: detected binary path: /usr/bin/uwsgi-core Aug 03 01:46:47.420838 n-d-826529-8 devstack@n-api.service[125920]: your processes number limit is 47680 Aug 03 01:46:47.421718 n-d-826529-8 devstack@n-api.service[125920]: your memory page size is 4096 bytes Aug 03 01:46:47.421718 n-d-826529-8 devstack@n-api.service[125920]: detected max file descriptor number: 2048 Aug 03 01:46:47.421718 n-d-826529-8 devstack@n-api.service[125920]: lock engine: pthread robust mutexes Aug 03 01:46:47.421718 n-d-826529-8 devstack@n-api.service[125920]: thunder lock: enabled Aug 03 01:46:47.421718 n-d-826529-8 devstack@n-api.service[125920]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 01:46:47.421718 n-d-826529-8 devstack@n-api.service[125920]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 01:46:47.462446 n-d-826529-8 devstack@n-api.service[125920]: Python main interpreter initialized at 0x55f7f9ad59c0 Aug 03 01:46:47.462446 n-d-826529-8 devstack@n-api.service[125920]: python threads support enabled Aug 03 01:46:47.462446 n-d-826529-8 devstack@n-api.service[125920]: your server socket listen backlog is limited to 100 connections Aug 03 01:46:47.462446 n-d-826529-8 devstack@n-api.service[125920]: your mercy for graceful operations on workers is 90 seconds Aug 03 01:46:47.462928 n-d-826529-8 devstack@n-api.service[125920]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 01:46:47.462928 n-d-826529-8 devstack@n-api.service[125920]: *** Operational MODE: preforking *** Aug 03 01:46:47.463216 n-d-826529-8 devstack@n-api.service[125920]: *** uWSGI is running in multiple interpreter mode *** Aug 03 01:46:47.463216 n-d-826529-8 devstack@n-api.service[125920]: spawned uWSGI master process (pid: 125920) Aug 03 01:46:47.463383 n-d-826529-8 systemd[1]: Started Devstack devstack@n-api.service. Aug 03 01:46:47.464245 n-d-826529-8 devstack@n-api.service[125920]: spawned uWSGI worker 1 (pid: 125941, cores: 1) Aug 03 01:46:47.464359 n-d-826529-8 devstack@n-api.service[125920]: spawned uWSGI worker 2 (pid: 125942, cores: 1) Aug 03 01:46:47.464526 n-d-826529-8 devstack@n-api.service[125920]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 01:46:48.145093 n-d-826529-8 devstack@n-api.service[125942]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 01:46:48.147216 n-d-826529-8 devstack@n-api.service[125941]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 01:46:49.321503 n-d-826529-8 devstack@n-api.service[125942]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 01:46:49.321503 n-d-826529-8 devstack@n-api.service[125942]: from cryptography.utils import int_from_bytes Aug 03 01:46:49.322236 n-d-826529-8 devstack@n-api.service[125942]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 01:46:49.322236 n-d-826529-8 devstack@n-api.service[125942]: from cryptography.utils import int_from_bytes Aug 03 01:46:49.340662 n-d-826529-8 devstack@n-api.service[125941]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 01:46:49.340662 n-d-826529-8 devstack@n-api.service[125941]: from cryptography.utils import int_from_bytes Aug 03 01:46:49.341216 n-d-826529-8 devstack@n-api.service[125941]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 01:46:49.341216 n-d-826529-8 devstack@n-api.service[125941]: from cryptography.utils import int_from_bytes Aug 03 01:46:51.806845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 01:46:51.807538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 01:46:51.807684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 01:46:51.808055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 01:46:51.808317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 01:46:51.808715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.809047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.809373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.809698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.810034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.810348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.810677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.811041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.811376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.811643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.811959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.812294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826529-8 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.812614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.813112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.813435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.813763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.814075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.814411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.814741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.815284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.815968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.816566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.816899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.817252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.817574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.817974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.818222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.818536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.818870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.819214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.819635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826529-8 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.819957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.820274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.820594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.821749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.822095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.822418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.822751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.823129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.823448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.823784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.824111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.824442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.824767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.825076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.825390 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.825706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.826029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.826341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.826650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.826919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.827256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.827575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.827901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.828228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.828485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.828741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.829062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.829384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.829695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.830007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.830317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.830626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.830963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.831276 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.831582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.831891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.832217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.832537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.832862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.833173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.833496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.833900 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.834154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.834469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.834814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.835170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.835483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.835806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.836129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.836441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.836820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.837132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.837460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.837803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.838491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.838491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.838651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.838959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.839283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.839593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.839905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.840214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.840517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.840825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.841134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.841444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.841752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.842069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.842359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.842668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.842789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 01:46:51.843206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.843398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 01:46:51.843557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.843706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 01:46:51.843844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.843972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 01:46:51.844108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.844353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 01:46:51.844451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.844545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.844629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.845112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.845112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.845294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.845425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.845555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.845742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.845855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.846051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.846153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.846375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.846477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.846684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.846803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.847016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.847111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.847339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.847444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.847669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.847771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.847962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.848063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.848284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.848403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826529-8 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.848588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.848685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.848896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.849067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.849215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.849385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.849524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.849800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.849891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.850119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.850219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.850423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.850513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.850729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.850830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.851062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.851291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.851403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.851608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.851705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.851923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.852037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.852365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.852483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.852616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.852766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.852933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.853076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.853248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.853354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.853555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.853655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.853877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.853983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.854220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.854317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.854532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.854632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.854897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.855013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826529-8 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.855241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.855344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.855573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.855691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.855886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.855985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.856208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.856304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.856526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.856637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.856845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.856938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.857174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.857266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.857491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.857595 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.857807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.857904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.858122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.858220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.858443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.858543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.858764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.858854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.859113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.859214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.859421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.859521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.859741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.860065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.860161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.860383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.860490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.860697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.860799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.861028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.861126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.861339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.861439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.861595 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.861687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.861907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.862013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.862234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.862327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.862563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.862667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.862887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.863011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.863171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.863300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.863432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.863576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.863754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.863891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.864080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.864204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.864393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.864536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.864706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.864878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.865015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.865198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.865589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.865793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.865914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.866113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.866212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.866432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.866536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.866749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.866883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.867091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.867230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.867408 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.867551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.868277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.868456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.868590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.868755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.868905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.869082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.869224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.869471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.869565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.869730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.869848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.870041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.870161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.870386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.870486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.870710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.870808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.871054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.871156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.871379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.871480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.871691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.871782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.871998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.872119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.872307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.872407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.872620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.872817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.872944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.873112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.873295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.873415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.873586 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.873783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.873880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.873970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.874160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.874250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.874489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.874593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.874801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.874895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.875179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.875464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.875773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.875996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.876090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.876319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.876410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.876637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.876725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.876947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.877042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.877261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.877349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.877574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.877669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.877889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.877970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.878202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.878284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.878569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.878671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.878824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.878938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.879950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.880222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.880309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.880382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.880453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.880532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.880614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.880687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.880782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.880886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.880980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.881070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.881169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.881255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.881346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.881431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.881665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.881776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.881986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.882085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.882294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.882400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.882606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.882872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.883001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.883100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.883235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.884113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.884204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.884378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.884582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.884676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.884912 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.885013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.885224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.885323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.885563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.885679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.885841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.885946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.886149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.886243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.886476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.886570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.886785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.886877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.887122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.887212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.887430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.887534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.887737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.887827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.888044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.888141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.888354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.888454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.888745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.888855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.888965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.889065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.889269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.889433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.889594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.889693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.889920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.890011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.890233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.890341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.890545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.890637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.890858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.890971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.891207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 01:46:51.891299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.891521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.891620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.891847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.891941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.892164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.892263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.892483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.892583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.892904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.893021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.893120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.893207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.893426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.893526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.893750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.893849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.894060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.894161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.894379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.894490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.894702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.894815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.895042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.895137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.895360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.895451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.895682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.895792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.896005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.896097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.896325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.896416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.896640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.896744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.896955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.897047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.897269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.897362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.897581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.897681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.897900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.898000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.898216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.898379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.898548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.898696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.898878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.899098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.899267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.899387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.899570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.899753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.899854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.900078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.900182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.900409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.900562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.900741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.900897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.901167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.901304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.901441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.901584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.901721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.901851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.901985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.902122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.902308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.902450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.902677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.902815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.903099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.903241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.903382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.903519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.903655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.903791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.903929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.904057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.904195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.904331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.904535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.904677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.904912 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.905036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.905157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.905438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.905752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.906051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.906211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.906374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.906522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.906677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.906826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.907074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.907249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.907412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.907568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.907716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.907869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.908017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.908164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.908329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.908519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.908847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.909154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.909311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.909467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.909653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.909917 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.910079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.910228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.910383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.910540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.910705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.910858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.911036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.911311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.911465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.911622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.911783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.911938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.912086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.912240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.912395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.912559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.912709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.912864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.913012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.913281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.913436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.913598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.913754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.913915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.914063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.914218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.914375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.914530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.914798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.915345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.915592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.915842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.915842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.916209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.916358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.916506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.916666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.916821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.916980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.917137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.917286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.917432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.917587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.917742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.917903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.918051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.918205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.918354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.918501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.918667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.918815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.918988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.919156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.919311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.919459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.919459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.919755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.919928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.920198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.920359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.920508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.920508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.920508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.921046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.921192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.921466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.921632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.921790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.921946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.922101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.922316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.922473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.922632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.922780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.922989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.923145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.923329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.923588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.923742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.923899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.924048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.924195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.924353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.924501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.924649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.924804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.924959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.925118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.925433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.925590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.925738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.925893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.926048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.926205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.926359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.926518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.926666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.926813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.927114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.927291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.927462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.927610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.927759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.927914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.928062 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.928220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.928374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.928523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.928670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.928825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.928986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.929143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.929313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.929462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.929623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.929771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.929932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.930081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.930977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.931230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.931503 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.931885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.932149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.932399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.932651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.932901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.932901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.933219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.933382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.933531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.933810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.933967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.934115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.934269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.934433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.934582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.934737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.934886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.935102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.935264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.935431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.935690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.935853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.936002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.936148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.936304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.936452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.936599 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.936746 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.936894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.937049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.937225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.937382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.937536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.937731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.937892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.938041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.938198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.938345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.938493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.938640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.938786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.938979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.939145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.939293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.939446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.939601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.939796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.939959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.940108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.940255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.940409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.940563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.940718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.940903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.941169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.941341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.941497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.941651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.941826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.942079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.942254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.942418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.942567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.942715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.942875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.943050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.943200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.943347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.943505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.943663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.943844 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.944084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.944084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.944372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.944542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.944700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.944858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.945014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.945014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.945306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.945306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.945607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.946641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.946842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.947074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.947226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.947404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.947674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.947840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.947995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.948150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.948306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.948456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.948613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.948774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.948930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.949085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.949232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.949379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.949536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.949692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.949840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.949988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.949988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.950290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.950439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.950597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.950764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.951175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.951444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.951617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.951782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.951932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.952097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.952356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.952517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.952681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.952830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.952830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.953133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.953280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.953435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.953435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.953728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.954745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.954981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.954981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.955289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.955454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.955610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.955760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.956046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.956227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.956466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.956625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.956773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.956921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.957068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.957215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.957376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.957538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.957730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.957955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.958107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.958255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.958423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.958580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.958728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.958876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.959061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.959220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.959381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.959529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.959677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.959824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.959824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.959824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.959824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.959824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.959824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.959824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.959824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.960955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.961112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.961261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.961428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.961428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.962166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.962684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.962844 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.963070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.963223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.963379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.963542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.963707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.963862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.964018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.964174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.964330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.964565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.964716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.964991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.965147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.965147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.965457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.965615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.965764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.965918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.966189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.966346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.966511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.966675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.966825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.967064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.967225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.967376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.967541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.967699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.967856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.968004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.968004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.968285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.968443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.968601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.968601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.968889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.969058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.969215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.969389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.969538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.969693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.969849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.970005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.970153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.970301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.970449 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.970596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.970756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.970952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.971120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.971270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.971435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.971585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.971745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.971745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.972165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.972319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.972477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.972647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.972907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.973070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.973219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.973219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.973506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.973666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.973828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.973977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.974199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.974351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.974519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.974680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.974828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.975102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.975259 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.975408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.975564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.975732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.975898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.976047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.976219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.976479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.977879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.978450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.978633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.978799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.978979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.979135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.979744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.980543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.980704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.980862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.981012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.981331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.981482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.981721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.981871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.982020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.982210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.982455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.982620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.982769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.983411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.983574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.983737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.983893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.984042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.984191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.984346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.984494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.984650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.984799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.984962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.985085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.985193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.985293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.985386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.985667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.985771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.985865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.985951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.986039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.986119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.986669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.986774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.986861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.987015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.987103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.987296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.987399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.987495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.987583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.987664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.987745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.987819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.988393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.989082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.989192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.989269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.989353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.989431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.989522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.989620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.989707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.989790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.989880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.989967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.990050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.990142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.990486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.990579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.990677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.990768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.990853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.990969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.991805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.992533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.992533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.992533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.992533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.992533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.993889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.993967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.993967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.993967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.993967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.993967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.993967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.993967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.993967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.994753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.994753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.994964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.995067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.995154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.995249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.995249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.995404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.995501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.995501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.995667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.995753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.995838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.995921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.996017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.996103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.996186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.996272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.996345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.996415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.996415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.996556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.996788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.996898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.996992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.997087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.997180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.997265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.997358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.997538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.997631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.997888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.997992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.998217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.998307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.998540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.998646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.998863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.998988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.999206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.999306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.999529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.999623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.999852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:51.999944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.000181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.000350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.000596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.000765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.000926 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.001100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.001265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.001424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.001592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.001747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.001919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.002068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.002253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.002388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.002574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.002708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.002994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.003108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.003254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.003358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.003585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.003698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.003903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.004014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.004219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.004332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.004551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.004648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.004875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.004980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.005199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.005313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.005529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.005622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.005862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.005952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.006184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.006288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.006497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.006597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.006823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.007029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.007181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.007288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.007491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.007584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.007813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.007913 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.008132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.008234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.009084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.009212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.009675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.009819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.009819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.009995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.010080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.010249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.010344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.010577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.010678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.011011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.011111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.011248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.011340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.011571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.011665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.011889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.011991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.012235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.012340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.012560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.012685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.012882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.012988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.013198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.013303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.013514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.013608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.013839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.014044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.014138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.014365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.014590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.014692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.014934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.015041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.015259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.015523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.015605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.015685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.015881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.016161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.016269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.016642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.016783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.017176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.017385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.017745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.017946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.018332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.018915 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.019506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.019912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.020066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.020514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.020636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.021127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.021250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.021707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.021835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.022268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.022411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.022945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.023668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.024321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.024835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.024939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.025446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.025538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.025986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.026108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.026581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.026746 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.027195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.027410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.027767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.028031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.028535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.028631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.028984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.029078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.029386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.029566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.029970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.030070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.030349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.030575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.030821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.031212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.031792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.032403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.032790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.033035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.033175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.033547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.033712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.033985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.034098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.034254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.034362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.034585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.034677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.034953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.035074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.035297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.035397 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.035623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.035724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.035945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.036042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.036267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.036384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.036584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.036695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.036908 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.037022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.037284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.037405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.037541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.037686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.037867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.037998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.038184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.038335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.038507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.038663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.038824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.039040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.039202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.039382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.039519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.040423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.040533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.040628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.040724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.040912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.041044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.041215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.041365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.041536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.041680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.041873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.042013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.042198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.042442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.042538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.042776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.042883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.043127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.043256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.043451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.043548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.043771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.043863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.044107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.044214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.044418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.044692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.044786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.045043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.045136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.045377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.045470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.045707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.045808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.046024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.046119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.046356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.046463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.046674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.046784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.047015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.047158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.047402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.047507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.047643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.047783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.047971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.048069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.048292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.048393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.048615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.048714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.048935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.049027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.049255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.049363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.049574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.049666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.049891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.049984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.050209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.050313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.050527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.050628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.050844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.050951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.051203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.051306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.051517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.051610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.051830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.051931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.052154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.052247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.052468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.052568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.052782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.052882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.053093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.053232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.053409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.053537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.053718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.053839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.054027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.054135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.054339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.054450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.054675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.054947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.055054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.055140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.055948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.056086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.056222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.056359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.056548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.056687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.056880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.057005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.057284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.057611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.057938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.058102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.058267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.058866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.059040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.059164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.059276 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.059395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.059505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.059617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.059737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.059856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.059974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.060119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.060246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.060441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.060572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.060775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.060904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.061102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.061197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.061426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.061534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.061751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.061851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.062066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.062165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.062377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.062477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.062694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.062796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.063049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.063201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.063366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.063488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.063778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.063970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.066925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.067061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.067183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.067291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.067291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.067465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.067555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.067638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.067727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.067818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.067900 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.067986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.068081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.068182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.068277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.068364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.068457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.068553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.068765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.068765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.068765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.068765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.068765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.068765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.068765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.069308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.069395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.069674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.069822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.070016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.070323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.070428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.070666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.070884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.071138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.071291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.071759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.071864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.072151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.072248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.072503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.072604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.072801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.072964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.073137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.073242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.073465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.073576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.073779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.073911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.074230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.074388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.074612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.074964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.075067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.075293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.075412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.075624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.075721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.075958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.076063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.076290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.076396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.076617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.076729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.076944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.077063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.077308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.077410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.077578 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.077721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.123174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.123174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.124290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.124753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.124952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.125199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.125489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.125796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.126093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.126868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.126868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.127411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.127593 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.127593 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.127960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.128152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.128345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.128345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.128672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.128846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.129020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.129263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.129894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.130170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.130427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.130706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.131102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.131338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.131563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.131737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.132155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.132317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.132452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.132583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.132715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.132847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.132979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.133119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.133252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.133443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.133655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.133804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.133963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.134301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.134540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.134844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.135008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.135144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.135290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.135425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.135425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.135678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.135678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.135929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.135929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.136205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.136338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.136470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.136602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 01:46:52.141139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.141139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.141139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.141139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.141139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.141139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.141139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.141139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.144504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.144504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.144504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.144504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.144504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.144504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.144504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.144504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.145557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.145557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.145557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.145557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.145557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.145557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.145557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.145557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.148690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.148690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.148690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.148690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.148690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.148690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.148690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.148690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.153799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.153799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.153799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.153799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.153799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.153799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.153799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.153799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.154856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.154856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.154856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.154856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.154856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.154856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.154856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.154856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.157079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.157079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.157079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.157079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.157079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.157079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.157079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.157079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.158101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.158101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.158101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.158101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.158101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.158101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.158101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.158101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.159867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.159867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.159867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.159867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.159867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.159867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.159867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.159867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.162775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.162775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.162775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.162775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.162775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.162775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.162775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.162775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.163879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.163879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.163879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.163879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.163879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.163879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.163879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.163879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.166080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.166080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.166080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.166080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.166080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.166080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.166080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.166080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.167373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.167373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.167373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.167373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.167373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.167373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.167373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.167373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.169622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.169622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.169622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.169622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.169622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.169622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.169622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.169622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.170857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.170857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.170857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.170857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.170857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.170857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.170857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.170857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.171809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.171809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.171809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.171809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.171809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.171809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.171809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.171809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.173162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.173162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.173162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.173162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.173162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.173162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.173162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.173162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.174248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.174248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.174248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.174248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.174248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.174248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.174248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.174248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.175663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.175663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.175663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.175663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.175663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.175663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.175663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.175663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.176712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.176712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.176712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.176712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.176712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.176712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.176712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.176712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.178299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.178299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.178299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.178299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.178299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.178299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.178299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.178299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.179675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.179675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 01:46:52.179675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 01:46:52.180964 n-d-826529-8 devstack@n-api.service[125942]: INFO dbcounter [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] Registered counter for database nova_api Aug 03 01:46:52.188958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_db.sqlalchemy.engines [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:46:52.196285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writer thread running {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:46:52.226672 n-d-826529-8 devstack@n-api.service[125941]: INFO dbcounter [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] Registered counter for database nova_api Aug 03 01:46:52.249088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_db.sqlalchemy.engines [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:46:52.253827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.context [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),812a442e-24ba-4152-b2b0-f99907b19272(cell1) {{(pid=125942) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 01:46:52.256673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writer thread running {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:46:52.257937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:46:52.259715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:46:52.260532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:46:52.262511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:46:52.264740 n-d-826529-8 devstack@n-api.service[125942]: INFO dbcounter [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] Registered counter for database nova_cell0 Aug 03 01:46:52.269023 n-d-826529-8 devstack@n-api.service[125942]: INFO dbcounter [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] Registered counter for database nova_cell1 Aug 03 01:46:52.276688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_db.sqlalchemy.engines [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:46:52.280448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_db.sqlalchemy.engines [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:46:52.282774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writer thread running {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:46:52.316282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.context [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),812a442e-24ba-4152-b2b0-f99907b19272(cell1) {{(pid=125941) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 01:46:52.320529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:46:52.322359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:46:52.323202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:46:52.325197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:46:52.327227 n-d-826529-8 devstack@n-api.service[125941]: INFO dbcounter [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] Registered counter for database nova_cell0 Aug 03 01:46:52.331423 n-d-826529-8 devstack@n-api.service[125941]: INFO dbcounter [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] Registered counter for database nova_cell1 Aug 03 01:46:52.338783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_db.sqlalchemy.engines [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:46:52.342520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_db.sqlalchemy.engines [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:46:52.348943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writer thread running {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:46:52.350578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writer thread running {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:46:52.430639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writer thread running {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:46:52.439669 n-d-826529-8 devstack@n-api.service[125942]: INFO dbcounter [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] Registered counter for database nova_cell0 Aug 03 01:46:52.448195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_db.sqlalchemy.engines [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:46:52.453709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writer thread running {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:46:52.505449 n-d-826529-8 devstack@n-api.service[125941]: INFO dbcounter [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] Registered counter for database nova_cell0 Aug 03 01:46:52.512589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_db.sqlalchemy.engines [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 01:46:52.517357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writer thread running {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 01:46:52.777227 n-d-826529-8 devstack@n-api.service[125942]: WARNING keystonemiddleware.auth_token [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 01:46:52.784520 n-d-826529-8 devstack@n-api.service[125942]: WARNING keystonemiddleware.auth_token [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 01:46:52.842688 n-d-826529-8 devstack@n-api.service[125941]: WARNING keystonemiddleware.auth_token [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 01:46:52.850438 n-d-826529-8 devstack@n-api.service[125941]: WARNING keystonemiddleware.auth_token [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 01:46:53.125518 n-d-826529-8 devstack@n-api.service[125942]: WARNING keystonemiddleware.auth_token [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 01:46:53.131645 n-d-826529-8 devstack@n-api.service[125942]: WARNING keystonemiddleware.auth_token [None req-7189a2ed-d072-4177-a405-6a68957008a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 01:46:53.137532 n-d-826529-8 devstack@n-api.service[125942]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f7f9ad59c0 pid: 125942 (default app) Aug 03 01:46:53.193549 n-d-826529-8 devstack@n-api.service[125941]: WARNING keystonemiddleware.auth_token [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 01:46:53.200394 n-d-826529-8 devstack@n-api.service[125941]: WARNING keystonemiddleware.auth_token [None req-b0fa457a-ec62-47e8-a281-0758e41174f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 01:46:53.205737 n-d-826529-8 devstack@n-api.service[125941]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f7f9ad59c0 pid: 125941 (default app) Aug 03 01:47:37.822308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:47:37.823472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:47:37.824456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:47:37.825463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:47:39.105216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f8863589-2eca-4528-b589-3cf923233df3 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:39.110035 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:39.110035 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:39.111376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8863589-2eca-4528-b589-3cf923233df3 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:39.111833 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8863589-2eca-4528-b589-3cf923233df3 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:39.112641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8863589-2eca-4528-b589-3cf923233df3 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:39.113245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8863589-2eca-4528-b589-3cf923233df3 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:39.157578 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f8863589-2eca-4528-b589-3cf923233df3 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.344799 Aug 03 01:47:39.158995 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1/1] 10.222.0.67 () {58 vars in 1176 bytes} [Wed Aug 3 01:47:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:47:39.404168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b638032-2088-451e-a35d-bae99db05d11 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-194046694"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:39.423865 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:39.423865 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:39.424905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.aggregate [None req-8b638032-2088-451e-a35d-bae99db05d11 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Generated uuid 0c8856d9-4a3a-482e-a347-62e6ae48dc8e for aggregate {{(pid=125941) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:47:39.433158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:47:39.434441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:47:39.435203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:47:39.436135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:47:39.523816 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8b638032-2088-451e-a35d-bae99db05d11 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.353051 Aug 03 01:47:39.530203 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1/2] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:47:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:39.538057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e03ceb5d-dc10-47b9-a220-9fc4a1db12ab tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826529-8"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:39.540966 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:39.540966 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:39.579952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e03ceb5d-dc10-47b9-a220-9fc4a1db12ab tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:39.580481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e03ceb5d-dc10-47b9-a220-9fc4a1db12ab tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:40.642742 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e03ceb5d-dc10-47b9-a220-9fc4a1db12ab tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 1.109488 Aug 03 01:47:40.644002 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2/3] 10.222.0.67 () {60 vars in 1191 bytes} [Wed Aug 3 01:47:39 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:40.656013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-16b0503c-50f3-4d07-95ad-5119baebc911 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826529-8"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:40.658782 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:40.658782 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:40.675197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16b0503c-50f3-4d07-95ad-5119baebc911 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:40.675643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16b0503c-50f3-4d07-95ad-5119baebc911 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:40.726893 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-16b0503c-50f3-4d07-95ad-5119baebc911 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-826529-8. Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-16b0503c-50f3-4d07-95ad-5119baebc911 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Request method failure captured: Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 39 Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO5U3lvrSRC66QKE0Qh6aG2O3yMQfDfBae24RYCaxWnmHtJB6f2_WdbSTn43TRVX3SjRb-wl2ghDqfBiQsDYCnPiWnN0M63sm8EyOIrmH-8nArLYPzLmKNUsTjRApWt-50teubl1nJo1hbG-gllNhWycmoDG5pNKcGPQ6hCWSkeaAg Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:47:40.745723 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:47:40.746928 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1d6d252ce76241528e2df5d551375c3b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}] Aug 03 01:47:40.746928 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:40.746928 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:47:40.746928 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:40.746928 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:47:40.746928 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:47:40.746928 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:47:40.746928 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e9200402c0c644dd88c842b7e52c0007 Aug 03 01:47:40.746928 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:47:40.746928 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:47:40.746928 n-d-826529-8 devstack@n-api.service[125941]: {"add_host": {"host": "n-h1-826529-8"}} Aug 03 01:47:40.746928 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:47:40.746928 n-d-826529-8 devstack@n-api.service[125941]: exception: Aggregate 1 already has host n-h1-826529-8. Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-826529-8'}}} Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result.read() Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 01:47:40.747608 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-826529-8-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi session.flush() Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 01:47:40.749191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 01:47:40.750112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 01:47:40.751112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result.read() Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-826529-8-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 3, 1, 47, 40, 711659), 'updated_at': None, 'host': 'n-h1-826529-8', 'aggregate_id': 1}] Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:40.751951 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6594, in add_host_to_aggregate Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-826529-8. Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:40.754360 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-826529-8. Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:47:40.758285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:47:40.760763 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-826529-8. Aug 03 01:47:40.760763 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:40.760763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-16b0503c-50f3-4d07-95ad-5119baebc911 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-826529-8. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:40.760763 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-16b0503c-50f3-4d07-95ad-5119baebc911 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.095484 Aug 03 01:47:40.760763 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2/4] 10.222.0.67 () {60 vars in 1191 bytes} [Wed Aug 3 01:47:40 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 03 01:47:40.760763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-390766f5-113c-4279-8ddd-82e0b008837c tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826529-8"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:40.764963 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:40.764963 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:40.774034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-390766f5-113c-4279-8ddd-82e0b008837c tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:40.774493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-390766f5-113c-4279-8ddd-82e0b008837c tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:41.132905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e3ae0f97-5774-432c-b1f6-188cf17c293d tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Calling method '.version_select at 0x7f5b21303f70>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:41.133982 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:41.133982 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:41.141127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e3ae0f97-5774-432c-b1f6-188cf17c293d tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),812a442e-24ba-4152-b2b0-f99907b19272(cell1) {{(pid=125942) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 03 01:47:41.142233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3ae0f97-5774-432c-b1f6-188cf17c293d tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:41.142676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3ae0f97-5774-432c-b1f6-188cf17c293d tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:41.160570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3ae0f97-5774-432c-b1f6-188cf17c293d tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:41.161019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3ae0f97-5774-432c-b1f6-188cf17c293d tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:41.172785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3ae0f97-5774-432c-b1f6-188cf17c293d tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:41.172785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3ae0f97-5774-432c-b1f6-188cf17c293d tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:41.179242 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e3ae0f97-5774-432c-b1f6-188cf17c293d tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.456085 Aug 03 01:47:41.179806 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3/5] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:47:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:47:41.490617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-66fe0d62-45d3-4576-8616-b897ca8ecc81 tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Calling method '.version_select at 0x7f5b202ae5e0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:41.493402 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:41.493402 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:41.494612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66fe0d62-45d3-4576-8616-b897ca8ecc81 tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:41.495147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66fe0d62-45d3-4576-8616-b897ca8ecc81 tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:41.511659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66fe0d62-45d3-4576-8616-b897ca8ecc81 tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:41.512324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66fe0d62-45d3-4576-8616-b897ca8ecc81 tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:41.524463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66fe0d62-45d3-4576-8616-b897ca8ecc81 tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:41.524949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66fe0d62-45d3-4576-8616-b897ca8ecc81 tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:41.531572 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-66fe0d62-45d3-4576-8616-b897ca8ecc81 tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.344051 Aug 03 01:47:41.532152 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 4/6] 10.222.0.67 () {60 vars in 1208 bytes} [Wed Aug 3 01:47:41 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:47:41.719445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-272d1c8c-3c75-42f6-82a1-aa0af2d31590 tempest-AZAdminNegativeTestJSON-83126918 tempest-AZAdminNegativeTestJSON-83126918-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:41.720894 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:41.720894 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:41.729122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-272d1c8c-3c75-42f6-82a1-aa0af2d31590 tempest-AZAdminNegativeTestJSON-83126918 tempest-AZAdminNegativeTestJSON-83126918-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '834fe08235764e2381fa84dd4e93c986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65eb6c4fe96453aa4821c69cd68b6a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:41.731611 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-390766f5-113c-4279-8ddd-82e0b008837c tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.977415 Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-272d1c8c-3c75-42f6-82a1-aa0af2d31590 tempest-AZAdminNegativeTestJSON-83126918 tempest-AZAdminNegativeTestJSON-83126918-project] Request method failure captured: Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dO6J0ZxPLGKCptPKm7DA-mBQ1-C4M1nITFojfTBoINeOVH69DTiD6NCPc7U8pTI9idYzsWY5MZMMFxeAQoYnjJPhDmxL7qUCFcjQgQwd7HjfQDxRx6XWU-Ig51fzIwRLUTlHYrwnCr_TNq4Qb2jvGiyZLp4n6xY3j-1OVoGwTacoZM Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: e65eb6c4fe96453aa4821c69cd68b6a1 Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AZAdminNegativeTestJSON-83126918 Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:47:41.733237 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:47:41.734306 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e65eb6c4fe96453aa4821c69cd68b6a1", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e65eb6c4fe96453aa4821c69cd68b6a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e65eb6c4fe96453aa4821c69cd68b6a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e65eb6c4fe96453aa4821c69cd68b6a1"}]}] Aug 03 01:47:41.734306 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AZAdminNegativeTestJSON-83126918 Aug 03 01:47:41.734306 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: e65eb6c4fe96453aa4821c69cd68b6a1 Aug 03 01:47:41.734306 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-83126918 Aug 03 01:47:41.734306 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AZAdminNegativeTestJSON-83126918-project Aug 03 01:47:41.734306 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:47:41.734306 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:47:41.734306 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 834fe08235764e2381fa84dd4e93c986 Aug 03 01:47:41.734306 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AZAdminNegativeTestJSON-83126918-project Aug 03 01:47:41.734306 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:47:41.734306 n-d-826529-8 devstack@n-api.service[125942]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 03 01:47:41.734306 n-d-826529-8 devstack@n-api.service[125942]: action_args: {} Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:47:41.734944 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 03 01:47:41.735950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:41.738272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-272d1c8c-3c75-42f6-82a1-aa0af2d31590 tempest-AZAdminNegativeTestJSON-83126918 tempest-AZAdminNegativeTestJSON-83126918-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:41.739474 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-272d1c8c-3c75-42f6-82a1-aa0af2d31590 tempest-AZAdminNegativeTestJSON-83126918 tempest-AZAdminNegativeTestJSON-83126918-project] 10.222.0.67 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.206203 Aug 03 01:47:41.740636 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 5/8] 10.222.0.67 () {58 vars in 1185 bytes} [Wed Aug 3 01:47:41 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 208 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:47:41.741693 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3/8] 10.222.0.67 () {60 vars in 1191 bytes} [Wed Aug 3 01:47:40 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:41.750821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-304fd51a-4bd8-4958-86ef-e2f2e0b4d58c tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Calling method '.version_select at 0x7f5b202b2ee0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:41.751815 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:41.751815 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:41.753115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-304fd51a-4bd8-4958-86ef-e2f2e0b4d58c tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:41.753638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-304fd51a-4bd8-4958-86ef-e2f2e0b4d58c tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:41.773175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-304fd51a-4bd8-4958-86ef-e2f2e0b4d58c tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:41.773798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-304fd51a-4bd8-4958-86ef-e2f2e0b4d58c tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:41.818105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-304fd51a-4bd8-4958-86ef-e2f2e0b4d58c tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:41.818688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-304fd51a-4bd8-4958-86ef-e2f2e0b4d58c tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:41.827579 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-304fd51a-4bd8-4958-86ef-e2f2e0b4d58c tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/n-h1-826529-8/servers" status: 200 len: 104 microversion: 2.1 time: 0.079584 Aug 03 01:47:41.834104 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 6/9] 10.222.0.67 () {58 vars in 1212 bytes} [Wed Aug 3 01:47:41 2022] GET /compute/v2.1/os-hypervisors/n-h1-826529-8/servers => generated 104 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:42.149290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1629218784", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:42.261860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed40386c-b3e5-47aa-950f-a551891410bd tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '.version_select at 0x7f5b2007f940>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:42.263784 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:42.263784 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:42.271280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ed40386c-b3e5-47aa-950f-a551891410bd tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),812a442e-24ba-4152-b2b0-f99907b19272(cell1) {{(pid=125941) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 03 01:47:42.273074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed40386c-b3e5-47aa-950f-a551891410bd tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:42.273974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed40386c-b3e5-47aa-950f-a551891410bd tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:42.291526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed40386c-b3e5-47aa-950f-a551891410bd tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:42.291978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed40386c-b3e5-47aa-950f-a551891410bd tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:42.303982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed40386c-b3e5-47aa-950f-a551891410bd tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:42.304940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed40386c-b3e5-47aa-950f-a551891410bd tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:42.311478 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed40386c-b3e5-47aa-950f-a551891410bd tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.568260 Aug 03 01:47:42.312127 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 4/10] 10.222.0.67 () {58 vars in 1167 bytes} [Wed Aug 3 01:47:41 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:42.316750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-49c0bc26-295b-4cdf-b0a1-d18ca3dc4481 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:42.317571 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:42.317571 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:42.345483 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-49c0bc26-295b-4cdf-b0a1-d18ca3dc4481 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.032027 Aug 03 01:47:42.346570 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 5/11] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:47:42 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:47:42.596033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-735943dd-3d6d-4479-a222-c6be704bb326 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1869206176", "id": 332126655, "os-flavor-access:is_public": "False"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:42.600144 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:42.600144 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:42.638055 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-735943dd-3d6d-4479-a222-c6be704bb326 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.289901 Aug 03 01:47:42.639220 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 6/12] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:47:42 2022] POST /compute/v2.1/flavors => generated 436 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:42.644230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-66c2c85c-839e-4ab6-8626-ca23bc079cd8 tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Calling method '.version_select at 0x7f5b13fc80d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:42.645279 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:42.645279 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:42.646755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66c2c85c-839e-4ab6-8626-ca23bc079cd8 tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:42.648000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66c2c85c-839e-4ab6-8626-ca23bc079cd8 tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:42.663774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66c2c85c-839e-4ab6-8626-ca23bc079cd8 tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:42.664496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66c2c85c-839e-4ab6-8626-ca23bc079cd8 tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:42.675881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66c2c85c-839e-4ab6-8626-ca23bc079cd8 tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:42.676414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66c2c85c-839e-4ab6-8626-ca23bc079cd8 tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:42.683994 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-66c2c85c-839e-4ab6-8626-ca23bc079cd8 tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.043514 Aug 03 01:47:42.684911 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 7/13] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:47:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:42.689516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a26cd103-d861-4e04-ac31-85902fb973a4 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-713683665"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:42.692665 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:42.692665 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:42.694664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.aggregate [None req-a26cd103-d861-4e04-ac31-85902fb973a4 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Generated uuid ccdb6e6e-650a-4063-b19b-98d0fd6ac889 for aggregate {{(pid=125941) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:47:42.719811 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a26cd103-d861-4e04-ac31-85902fb973a4 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.033154 Aug 03 01:47:42.721360 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 8/14] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:47:42 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:42.727085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f5d9ffb9-f167-4147-b13d-2728cfaaecc1 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-939751374", "name": "tempest-test_aggregate-58163513"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:42.753457 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:42.753457 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:42.755331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.aggregate [None req-f5d9ffb9-f167-4147-b13d-2728cfaaecc1 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Generated uuid 90277b8f-a3e8-47a2-ac9f-b3dcc45e5f7e for aggregate {{(pid=125941) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:47:42.788224 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f5d9ffb9-f167-4147-b13d-2728cfaaecc1 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.065396 Aug 03 01:47:42.788830 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 9/15] 10.222.0.67 () {60 vars in 1165 bytes} [Wed Aug 3 01:47:42 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:42.799637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-996697c4-25e7-4246-bdc5-a05d54bb2318 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "733b2219fe944c48ade63012f3b236a9"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:42.801992 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:42.801992 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:42.820059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:47:43.017516 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-996697c4-25e7-4246-bdc5-a05d54bb2318 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/332126655/action" status: 200 len: 96 microversion: 2.1 time: 0.221429 Aug 03 01:47:43.018229 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 10/16] 10.222.0.67 () {60 vars in 1197 bytes} [Wed Aug 3 01:47:42 2022] POST /compute/v2.1/flavors/332126655/action => generated 96 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:47:43.028733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20c9c96f-a875-4f59-b480-26f32ee77d66 tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Calling method '.version_select at 0x7f5b13ff1e50>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:43.029548 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:43.029548 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:43.030646 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20c9c96f-a875-4f59-b480-26f32ee77d66 tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:43.031126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20c9c96f-a875-4f59-b480-26f32ee77d66 tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:43.049867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20c9c96f-a875-4f59-b480-26f32ee77d66 tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:43.050556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20c9c96f-a875-4f59-b480-26f32ee77d66 tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:43.057490 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-20c9c96f-a875-4f59-b480-26f32ee77d66 tempest-HypervisorAdminUnderV252Test-1789559222 tempest-HypervisorAdminUnderV252Test-1789559222-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/n-h1-826529-8/search" status: 200 len: 104 microversion: 2.1 time: 0.032345 Aug 03 01:47:43.058262 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 11/17] 10.222.0.67 () {58 vars in 1209 bytes} [Wed Aug 3 01:47:43 2022] GET /compute/v2.1/os-hypervisors/n-h1-826529-8/search => generated 104 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:43.068299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:47:43.068857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:47:43.069362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:47:43.069776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:47:43.070434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:47:43.084295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:43.085013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:43.085839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:43.086362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:43.119239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Getting quotas for project 62d622c1784b435c8d44d8f2067c5ddf. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:47:43.125672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Getting quotas for user dccc81c8286d41b69d04688322aafed3 and project 62d622c1784b435c8d44d8f2067c5ddf. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:47:43.137800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:47:43.140615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:47:43.198096 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-187a626d-36e9-447d-bf0d-3d679822d334 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.362425 Aug 03 01:47:43.199134 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 7/18] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:47:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:47:43.304865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ea57a3ed-8703-4d82-a27c-8fa6bd20c39c tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826529-8"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:43.308229 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:43.308229 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:43.309441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ea57a3ed-8703-4d82-a27c-8fa6bd20c39c tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '071f8bf291ab4b9b988d487f667c8ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ffe737cc4d3aa19447daf90b919c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ea57a3ed-8703-4d82-a27c-8fa6bd20c39c tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Request method failure captured: Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 39 Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO3cX250jIXNYHhmQUNRn7HehvTs_yu6zt40TEXVS281otg-DAxP3I0DQ3OQlac4T_QyavTFouFvTKTafpGmlp9_2Dfg-t0eKNJFs7QWaT6q_I8NVCruti-OAhui2NX_VergD_YOcIUbvjVAX-MNQeA9t8-GBkyuV1vyPpRoxjW2-I Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 4760ffe737cc4d3aa19447daf90b919c Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:47:43.312445 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:47:43.313621 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4760ffe737cc4d3aa19447daf90b919c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4760ffe737cc4d3aa19447daf90b919c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4760ffe737cc4d3aa19447daf90b919c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4760ffe737cc4d3aa19447daf90b919c"}]}] Aug 03 01:47:43.313621 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:47:43.313621 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 4760ffe737cc4d3aa19447daf90b919c Aug 03 01:47:43.313621 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:47:43.313621 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AggregatesAdminNegativeTestJSON-742854162-project Aug 03 01:47:43.313621 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:47:43.313621 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:47:43.313621 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 071f8bf291ab4b9b988d487f667c8ef3 Aug 03 01:47:43.313621 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-742854162-project Aug 03 01:47:43.313621 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:47:43.313621 n-d-826529-8 devstack@n-api.service[125941]: {"add_host": {"host": "n-h1-826529-8"}} Aug 03 01:47:43.313621 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:47:43.313621 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-826529-8'}}} Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:47:43.314399 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 03 01:47:43.315523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:43.316617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ea57a3ed-8703-4d82-a27c-8fa6bd20c39c tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:43.316617 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ea57a3ed-8703-4d82-a27c-8fa6bd20c39c tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] 10.222.0.67 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.254529 Aug 03 01:47:43.317979 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 12/19] 10.222.0.67 () {60 vars in 1191 bytes} [Wed Aug 3 01:47:43 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 259 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:47:43.323219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9b05038b-3b94-4116-8628-ca49c50e6c24 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:43.324635 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:43.324635 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:43.336413 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9b05038b-3b94-4116-8628-ca49c50e6c24 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 200 len: 512 microversion: 2.1 time: 0.016997 Aug 03 01:47:43.337507 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 13/20] 10.222.0.67 () {58 vars in 1143 bytes} [Wed Aug 3 01:47:43 2022] GET /compute/v2.1/os-aggregates => generated 512 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:43.342723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20f166d4-5f0a-4615-99af-91643a54801b tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "733b2219fe944c48ade63012f3b236a9"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:43.345534 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:43.345534 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:43.544191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2017579f-6bb3-484c-a550-12ee50d64440 tempest-AZAdminV2TestJSON-1038533740 tempest-AZAdminV2TestJSON-1038533740-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:43.546026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2017579f-6bb3-484c-a550-12ee50d64440 tempest-AZAdminV2TestJSON-1038533740 tempest-AZAdminV2TestJSON-1038533740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:43.546443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2017579f-6bb3-484c-a550-12ee50d64440 tempest-AZAdminV2TestJSON-1038533740 tempest-AZAdminV2TestJSON-1038533740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:43.548284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2017579f-6bb3-484c-a550-12ee50d64440 tempest-AZAdminV2TestJSON-1038533740 tempest-AZAdminV2TestJSON-1038533740-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:43.548752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2017579f-6bb3-484c-a550-12ee50d64440 tempest-AZAdminV2TestJSON-1038533740 tempest-AZAdminV2TestJSON-1038533740-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:43.581329 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2017579f-6bb3-484c-a550-12ee50d64440 tempest-AZAdminV2TestJSON-1038533740 tempest-AZAdminV2TestJSON-1038533740-project-admin] 10.222.0.67 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.380639 Aug 03 01:47:43.582603 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 8/21] 10.222.0.67 () {58 vars in 1164 bytes} [Wed Aug 3 01:47:43 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:47:43.588081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c147bb0e-0fc3-4fba-b60a-9781bfdd4d7d tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:43.588874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c147bb0e-0fc3-4fba-b60a-9781bfdd4d7d tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:43.681105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c147bb0e-0fc3-4fba-b60a-9781bfdd4d7d tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:43.696413 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c147bb0e-0fc3-4fba-b60a-9781bfdd4d7d tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1220 microversion: 2.1 time: 0.112516 Aug 03 01:47:43.697010 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 9/22] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:43 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1220 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:43.701572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-46537cfa-e243-49c9-9d67-3a534967ac1b tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:43.702429 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:43.702429 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:43.736663 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-46537cfa-e243-49c9-9d67-3a534967ac1b tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.038540 Aug 03 01:47:43.737459 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 10/23] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:47:43 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:47:43.747029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-58fd1259-9bc8-4b02-bff8-69da8f4d6abe tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826529-8"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:43.750022 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:43.750022 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:43.759808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58fd1259-9bc8-4b02-bff8-69da8f4d6abe tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:43.760484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58fd1259-9bc8-4b02-bff8-69da8f4d6abe tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:43.929353 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-58fd1259-9bc8-4b02-bff8-69da8f4d6abe tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 311 microversion: 2.1 time: 0.186145 Aug 03 01:47:43.943205 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 11/24] 10.222.0.67 () {60 vars in 1191 bytes} [Wed Aug 3 01:47:43 2022] POST /compute/v2.1/os-aggregates/3/action => generated 311 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:43.948508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b91a709f-db1a-400a-a00b-5bf201a88502 tempest-AZAdminV2TestJSON-1038533740 tempest-AZAdminV2TestJSON-1038533740-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:43.949557 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:43.949557 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:43.951011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b91a709f-db1a-400a-a00b-5bf201a88502 tempest-AZAdminV2TestJSON-1038533740 tempest-AZAdminV2TestJSON-1038533740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:43.951680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b91a709f-db1a-400a-a00b-5bf201a88502 tempest-AZAdminV2TestJSON-1038533740 tempest-AZAdminV2TestJSON-1038533740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:43.952584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b91a709f-db1a-400a-a00b-5bf201a88502 tempest-AZAdminV2TestJSON-1038533740 tempest-AZAdminV2TestJSON-1038533740-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:43.953389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b91a709f-db1a-400a-a00b-5bf201a88502 tempest-AZAdminV2TestJSON-1038533740 tempest-AZAdminV2TestJSON-1038533740-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:43.978625 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b91a709f-db1a-400a-a00b-5bf201a88502 tempest-AZAdminV2TestJSON-1038533740 tempest-AZAdminV2TestJSON-1038533740-project-admin] 10.222.0.67 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 700 microversion: 2.1 time: 0.034024 Aug 03 01:47:43.979714 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 12/25] 10.222.0.67 () {58 vars in 1185 bytes} [Wed Aug 3 01:47:43 2022] GET /compute/v2.1/os-availability-zone/detail => generated 700 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:43.985889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b5973fe6-dbe7-48bd-a990-bf840b96c496 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-316036100"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:43.992486 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:43.992486 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:43.993763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.aggregate [None req-b5973fe6-dbe7-48bd-a990-bf840b96c496 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Generated uuid 66bb6b0b-0cff-4044-92d2-086b55332313 for aggregate {{(pid=125942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:47:44.011376 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-20f166d4-5f0a-4615-99af-91643a54801b tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] HTTP exception thrown: Flavor access already exists for flavor 15 and project 733b2219fe944c48ade63012f3b236a9 combination. Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20f166d4-5f0a-4615-99af-91643a54801b tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Request method failure captured: Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/flavors/332126655/action HTTP/1.1 Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 67 Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO8IEJ9M2LsRZp6xQZSE7aWko6UgO7FlZ2XaelwKv0rFIifur8RogkJ95Az4ytM6aQfUkSj_GXi40rD6y50M-KwUgrC_D2oxsWwjJXOuQXXvyT44xwJbwZQ6GxDjg5WNOduUfvqm_w2p8Hruo5lsL5vxK498BYAtifc90t_c9zbuWg Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: faacef6a8b1d46a483e8975538a1a578 Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-494135577 Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:47:44.016619 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:47:44.018197 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_faacef6a8b1d46a483e8975538a1a578", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/faacef6a8b1d46a483e8975538a1a578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/faacef6a8b1d46a483e8975538a1a578"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/faacef6a8b1d46a483e8975538a1a578"}]}] Aug 03 01:47:44.018197 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-494135577 Aug 03 01:47:44.018197 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: faacef6a8b1d46a483e8975538a1a578 Aug 03 01:47:44.018197 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-494135577 Aug 03 01:47:44.018197 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin Aug 03 01:47:44.018197 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:47:44.018197 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:47:44.018197 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: d4cb3279cd6a4206a7ca76f640fe7b39 Aug 03 01:47:44.018197 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin Aug 03 01:47:44.018197 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:47:44.018197 n-d-826529-8 devstack@n-api.service[125941]: {"addTenantAccess": {"tenant": "733b2219fe944c48ade63012f3b236a9"}} Aug 03 01:47:44.018197 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: exception: Flavor access already exists for flavor 15 and project 733b2219fe944c48ade63012f3b236a9 combination. Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '332126655', 'body': {'addTenantAccess': {'tenant': '733b2219fe944c48ade63012f3b236a9'}}} Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result.read() Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 01:47:44.019077 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '15-733b2219fe944c48ade63012f3b236a9' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi session.flush() Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 01:47:44.020156 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 01:47:44.021291 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 01:47:44.022583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result.read() Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '15-733b2219fe944c48ade63012f3b236a9' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 3, 1, 47, 44, 3741), 'updated_at': None, 'flavor_id': 15, 'project_id': '733b2219fe944c48ade63012f3b236a9'}] Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:44.024389 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 15 and project 733b2219fe944c48ade63012f3b236a9 combination. Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:44.026244 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 15 and project 733b2219fe944c48ade63012f3b236a9 combination. Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:47:44.029155 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:47:44.033893 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 15 and project 733b2219fe944c48ade63012f3b236a9 combination. Aug 03 01:47:44.033893 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.033893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20f166d4-5f0a-4615-99af-91643a54801b tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Returning 409 to user: Flavor access already exists for flavor 15 and project 733b2219fe944c48ade63012f3b236a9 combination. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:44.033893 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-20f166d4-5f0a-4615-99af-91643a54801b tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/332126655/action" status: 409 len: 152 microversion: 2.1 time: 0.680122 Aug 03 01:47:44.048540 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b5973fe6-dbe7-48bd-a990-bf840b96c496 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.067336 Aug 03 01:47:44.049591 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 13/27] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:47:43 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:44.051023 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 14/27] 10.222.0.67 () {60 vars in 1197 bytes} [Wed Aug 3 01:47:43 2022] POST /compute/v2.1/flavors/332126655/action => generated 152 bytes in 709 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:47:44.061405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a2c803c0-4542-4ea0-8e17-b44997509373 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "733b2219fe944c48ade63012f3b236a9"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:44.062653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1913bb8-52b2-433f-8bcf-745c7161706d tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-625182915"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:44.065554 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:44.065554 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:44.067364 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:44.067364 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:44.085812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1913bb8-52b2-433f-8bcf-745c7161706d tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:44.086473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1913bb8-52b2-433f-8bcf-745c7161706d tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:44.100409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1913bb8-52b2-433f-8bcf-745c7161706d tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:44.102028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1913bb8-52b2-433f-8bcf-745c7161706d tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:44.111152 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-b1913bb8-52b2-433f-8bcf-745c7161706d tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-625182915 could not be found. Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1913bb8-52b2-433f-8bcf-745c7161706d tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Request method failure captured: Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 57 Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO5U3lvrSRC66QKE0Qh6aG2O3yMQfDfBae24RYCaxWnmHtJB6f2_WdbSTn43TRVX3SjRb-wl2ghDqfBiQsDYCnPiWnN0M63sm8EyOIrmH-8nArLYPzLmKNUsTjRApWt-50teubl1nJo1hbG-gllNhWycmoDG5pNKcGPQ6hCWSkeaAg Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:47:44.114220 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:47:44.116655 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1d6d252ce76241528e2df5d551375c3b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}] Aug 03 01:47:44.116655 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:44.116655 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:47:44.116655 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:44.116655 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:47:44.116655 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:47:44.116655 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:47:44.116655 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e9200402c0c644dd88c842b7e52c0007 Aug 03 01:47:44.116655 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:47:44.116655 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:47:44.116655 n-d-826529-8 devstack@n-api.service[125941]: {"add_host": {"host": "tempest-nonexist_host-625182915"}} Aug 03 01:47:44.116655 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: exception: Compute host tempest-nonexist_host-625182915 could not be found. Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-625182915'}}} Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-625182915' is not mapped to any cell Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.117259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6574, in add_host_to_aggregate Aug 03 01:47:44.118215 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-625182915 could not be found. Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-625182915 could not be found. Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:44.119620 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.121212 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.121212 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:44.121212 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:44.121212 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:47:44.121212 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:47:44.121212 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-625182915 could not be found. Aug 03 01:47:44.121212 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.121212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1913bb8-52b2-433f-8bcf-745c7161706d tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-625182915 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:44.121633 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b1913bb8-52b2-433f-8bcf-745c7161706d tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.064383 Aug 03 01:47:44.125549 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 15/28] 10.222.0.67 () {60 vars in 1191 bytes} [Wed Aug 3 01:47:44 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:47:44.130878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cebcf040-c10c-4be3-9ded-d33b5f5d95ed tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:44.131940 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:44.131940 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:44.167200 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cebcf040-c10c-4be3-9ded-d33b5f5d95ed tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.040225 Aug 03 01:47:44.167861 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 16/29] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:47:44 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:47:44.178486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5075c5bf-6315-45ca-a653-0174a93cd5a3 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5075c5bf-6315-45ca-a653-0174a93cd5a3 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Request method failure captured: Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 283 Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO5U3lvrSRC66QKE0Qh6aG2O3yMQfDfBae24RYCaxWnmHtJB6f2_WdbSTn43TRVX3SjRb-wl2ghDqfBiQsDYCnPiWnN0M63sm8EyOIrmH-8nArLYPzLmKNUsTjRApWt-50teubl1nJo1hbG-gllNhWycmoDG5pNKcGPQ6hCWSkeaAg Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:47:44.184009 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:47:44.185253 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1d6d252ce76241528e2df5d551375c3b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}] Aug 03 01:47:44.185253 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:44.185253 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:47:44.185253 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:44.185253 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:47:44.185253 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:47:44.185253 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:47:44.185253 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e9200402c0c644dd88c842b7e52c0007 Aug 03 01:47:44.185253 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:47:44.185253 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:47:44.185795 n-d-826529-8 devstack@n-api.service[125941]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 03 01:47:44.185795 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:47:44.185795 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 01:47:44.185795 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 03 01:47:44.185795 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:44.185795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.185795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 01:47:44.185795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 01:47:44.185795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 01:47:44.185795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:44.186306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:44.187220 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:47:44.187220 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:47:44.187220 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 01:47:44.187220 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 01:47:44.187220 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 01:47:44.187220 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 01:47:44.187220 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 01:47:44.187220 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 01:47:44.187220 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 01:47:44.187220 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.187220 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:44.187220 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.187220 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.187220 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:44.187220 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:44.188053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 01:47:44.188053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 01:47:44.188053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 01:47:44.188053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.188053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5075c5bf-6315-45ca-a653-0174a93cd5a3 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:44.188369 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5075c5bf-6315-45ca-a653-0174a93cd5a3 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.011619 Aug 03 01:47:44.190388 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 17/30] 10.222.0.67 () {60 vars in 1165 bytes} [Wed Aug 3 01:47:44 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:47:44.200894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-af98e115-a80c-4e7c-a6d0-8a8dcd841644 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-af98e115-a80c-4e7c-a6d0-8a8dcd841644 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Request method failure captured: Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 27 Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO5U3lvrSRC66QKE0Qh6aG2O3yMQfDfBae24RYCaxWnmHtJB6f2_WdbSTn43TRVX3SjRb-wl2ghDqfBiQsDYCnPiWnN0M63sm8EyOIrmH-8nArLYPzLmKNUsTjRApWt-50teubl1nJo1hbG-gllNhWycmoDG5pNKcGPQ6hCWSkeaAg Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:47:44.206081 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:47:44.207189 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1d6d252ce76241528e2df5d551375c3b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}] Aug 03 01:47:44.207189 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:44.207189 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:47:44.207189 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:44.207189 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:47:44.207189 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:47:44.207189 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:47:44.207189 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e9200402c0c644dd88c842b7e52c0007 Aug 03 01:47:44.207189 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:47:44.207189 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:47:44.207189 n-d-826529-8 devstack@n-api.service[125941]: {"aggregate": {"name": ""}} Aug 03 01:47:44.207189 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:47:44.207189 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi '' Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:44.207870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 03 01:47:44.208974 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.212413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-af98e115-a80c-4e7c-a6d0-8a8dcd841644 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:44.213479 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-af98e115-a80c-4e7c-a6d0-8a8dcd841644 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.022069 Aug 03 01:47:44.214360 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 18/31] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:47:44 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:47:44.579905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1805201569", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "availability_zone": "tempest-test_az-939751374"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:44.618437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:44.619525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:44.620816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:44.621326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:44.659788 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a2c803c0-4542-4ea0-8e17-b44997509373 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/332126655/action" status: 200 len: 21 microversion: 2.1 time: 0.608129 Aug 03 01:47:44.660975 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 14/32] 10.222.0.67 () {60 vars in 1197 bytes} [Wed Aug 3 01:47:44 2022] POST /compute/v2.1/flavors/332126655/action => generated 21 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:47:44.672393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bc0d953f-cf21-4aab-961f-76330725faf3 tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1503238359"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:44.683651 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:44.683651 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:44.684950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bc0d953f-cf21-4aab-961f-76330725faf3 tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '071f8bf291ab4b9b988d487f667c8ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ffe737cc4d3aa19447daf90b919c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bc0d953f-cf21-4aab-961f-76330725faf3 tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Request method failure captured: Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 60 Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dO3cX250jIXNYHhmQUNRn7HehvTs_yu6zt40TEXVS281otg-DAxP3I0DQ3OQlac4T_QyavTFouFvTKTafpGmlp9_2Dfg-t0eKNJFs7QWaT6q_I8NVCruti-OAhui2NX_VergD_YOcIUbvjVAX-MNQeA9t8-GBkyuV1vyPpRoxjW2-I Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 4760ffe737cc4d3aa19447daf90b919c Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:47:44.688736 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:47:44.689856 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4760ffe737cc4d3aa19447daf90b919c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4760ffe737cc4d3aa19447daf90b919c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4760ffe737cc4d3aa19447daf90b919c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4760ffe737cc4d3aa19447daf90b919c"}]}] Aug 03 01:47:44.689856 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:47:44.689856 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 4760ffe737cc4d3aa19447daf90b919c Aug 03 01:47:44.689856 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:47:44.689856 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AggregatesAdminNegativeTestJSON-742854162-project Aug 03 01:47:44.689856 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:47:44.689856 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:47:44.689856 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 071f8bf291ab4b9b988d487f667c8ef3 Aug 03 01:47:44.689856 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-742854162-project Aug 03 01:47:44.689856 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:47:44.689856 n-d-826529-8 devstack@n-api.service[125942]: {"aggregate": {"name": "tempest-test_aggregate-1503238359"}} Aug 03 01:47:44.689856 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:47:44.689856 n-d-826529-8 devstack@n-api.service[125942]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1503238359'}}} Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:47:44.690521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:47:44.691670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 03 01:47:44.694350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:44.694350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bc0d953f-cf21-4aab-961f-76330725faf3 tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:44.694350 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bc0d953f-cf21-4aab-961f-76330725faf3 tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.028016 Aug 03 01:47:44.694350 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 15/33] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:47:44 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:47:44.701257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f61744cb-b39c-44b6-a370-1b48100b4825 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:44.702319 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:44.702319 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:44.728426 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f61744cb-b39c-44b6-a370-1b48100b4825 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/332126655" status: 202 len: 0 microversion: 2.1 time: 0.030796 Aug 03 01:47:44.732469 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 16/34] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 01:47:44 2022] DELETE /compute/v2.1/flavors/332126655 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:47:44.738952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-08e939ee-c5a9-4f28-bd56-4639c448323b tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1250751612"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:44.743153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.aggregate [None req-08e939ee-c5a9-4f28-bd56-4639c448323b tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Generated uuid 5c893049-d21d-401b-96ba-afdafc5e5d39 for aggregate {{(pid=125942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:47:44.773593 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-08e939ee-c5a9-4f28-bd56-4639c448323b tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040993 Aug 03 01:47:44.781608 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 17/35] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:47:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:44.786920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b1940488-7f0c-4914-a232-56cbccc4eed0 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:44.787611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b1940488-7f0c-4914-a232-56cbccc4eed0 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:44.795931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1940488-7f0c-4914-a232-56cbccc4eed0 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:44.796386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1940488-7f0c-4914-a232-56cbccc4eed0 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:44.797355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1940488-7f0c-4914-a232-56cbccc4eed0 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:44.797799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1940488-7f0c-4914-a232-56cbccc4eed0 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:44.942434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b1940488-7f0c-4914-a232-56cbccc4eed0 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:44.962854 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b1940488-7f0c-4914-a232-56cbccc4eed0 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1237 microversion: 2.1 time: 0.180092 Aug 03 01:47:44.964620 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 18/36] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:44 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1237 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:44.981280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-95414e5f-7e82-4f98-87b2-dc626cf1f8db tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:45.020530 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-95414e5f-7e82-4f98-87b2-dc626cf1f8db tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054284 Aug 03 01:47:45.035461 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 19/37] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:47:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:45.041244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0565d995-18ae-47b9-94aa-cdf579383a1c tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1250751612"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:45.043872 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:45.043872 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:45.046050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.aggregate [None req-0565d995-18ae-47b9-94aa-cdf579383a1c tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Generated uuid 91bdf1ab-e0fc-46db-8fc8-61a9555f93c4 for aggregate {{(pid=125942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:47:45.067089 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-0565d995-18ae-47b9-94aa-cdf579383a1c tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1250751612 already exists. Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0565d995-18ae-47b9-94aa-cdf579383a1c tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Request method failure captured: Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 60 Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dO5U3lvrSRC66QKE0Qh6aG2O3yMQfDfBae24RYCaxWnmHtJB6f2_WdbSTn43TRVX3SjRb-wl2ghDqfBiQsDYCnPiWnN0M63sm8EyOIrmH-8nArLYPzLmKNUsTjRApWt-50teubl1nJo1hbG-gllNhWycmoDG5pNKcGPQ6hCWSkeaAg Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:47:45.074051 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:47:45.075261 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1d6d252ce76241528e2df5d551375c3b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}] Aug 03 01:47:45.075261 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:45.075261 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:47:45.075261 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:45.075261 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:47:45.075261 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:47:45.075261 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:47:45.075261 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: e9200402c0c644dd88c842b7e52c0007 Aug 03 01:47:45.075261 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:47:45.075261 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:47:45.075261 n-d-826529-8 devstack@n-api.service[125942]: {"aggregate": {"name": "tempest-test_aggregate-1250751612"}} Aug 03 01:47:45.075261 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:47:45.075261 n-d-826529-8 devstack@n-api.service[125942]: exception: Aggregate tempest-test_aggregate-1250751612 already exists. Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1250751612'}}} Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6411, in create_aggregate Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 03 01:47:45.075918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1250751612 already exists. Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:47:45.076861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 03 01:47:45.078266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 03 01:47:45.078266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1250751612 already exists. Aug 03 01:47:45.078266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.078266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:45.078266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.078266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:45.078266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:45.078266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:45.078266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:47:45.078266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:47:45.078266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1250751612 already exists. Aug 03 01:47:45.078266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.078266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0565d995-18ae-47b9-94aa-cdf579383a1c tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1250751612 already exists. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:45.078266 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0565d995-18ae-47b9-94aa-cdf579383a1c tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.039319 Aug 03 01:47:45.079624 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 20/38] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:47:45 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:47:45.087410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f9a94d29-78ed-4538-b241-1d8cdeb6ca3c tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1423579365", "id": 1421220603, "os-flavor-access:is_public": "True"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:45.090880 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:45.090880 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:45.097490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:47:45.140681 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f9a94d29-78ed-4538-b241-1d8cdeb6ca3c tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.058893 Aug 03 01:47:45.143431 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 21/39] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:47:45 2022] POST /compute/v2.1/flavors => generated 438 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:45.153260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b0ee8322-361c-44e4-a75f-62c93de7bdc5 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:45.157041 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:45.157041 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:45.201458 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b0ee8322-361c-44e4-a75f-62c93de7bdc5 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.054683 Aug 03 01:47:45.202793 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 22/40] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:47:45 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:47:45.218487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-15061f52-f0ef-43f0-b67e-db7c41a4ec9a tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:45.219505 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:45.219505 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:45.228646 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-15061f52-f0ef-43f0-b67e-db7c41a4ec9a tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-15061f52-f0ef-43f0-b67e-db7c41a4ec9a tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Request method failure captured: Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/flavors/1421220603/os-flavor-access HTTP/1.1 Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dO8IEJ9M2LsRZp6xQZSE7aWko6UgO7FlZ2XaelwKv0rFIifur8RogkJ95Az4ytM6aQfUkSj_GXi40rD6y50M-KwUgrC_D2oxsWwjJXOuQXXvyT44xwJbwZQ6GxDjg5WNOduUfvqm_w2p8Hruo5lsL5vxK498BYAtifc90t_c9zbuWg Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: faacef6a8b1d46a483e8975538a1a578 Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-494135577 Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:47:45.231601 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:47:45.232792 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_faacef6a8b1d46a483e8975538a1a578", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/faacef6a8b1d46a483e8975538a1a578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/faacef6a8b1d46a483e8975538a1a578"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/faacef6a8b1d46a483e8975538a1a578"}]}] Aug 03 01:47:45.232792 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-494135577 Aug 03 01:47:45.232792 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: faacef6a8b1d46a483e8975538a1a578 Aug 03 01:47:45.232792 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-494135577 Aug 03 01:47:45.232792 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin Aug 03 01:47:45.232792 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:47:45.232792 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:47:45.232792 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: d4cb3279cd6a4206a7ca76f640fe7b39 Aug 03 01:47:45.232792 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin Aug 03 01:47:45.232792 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:47:45.232792 n-d-826529-8 devstack@n-api.service[125942]: exception: Access list not available for public flavors. Aug 03 01:47:45.232792 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'flavor_id': '1421220603'} Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 03 01:47:45.233439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.234595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-15061f52-f0ef-43f0-b67e-db7c41a4ec9a tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:45.234595 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-15061f52-f0ef-43f0-b67e-db7c41a4ec9a tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/1421220603/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.029821 Aug 03 01:47:45.234595 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 23/41] 10.222.0.67 () {58 vars in 1209 bytes} [Wed Aug 3 01:47:45 2022] GET /compute/v2.1/flavors/1421220603/os-flavor-access => generated 91 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:47:45.244117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-217aace8-3f90-43c6-a48c-73b0377faadc tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-827829191"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:45.253095 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:45.253095 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:45.257885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.aggregate [None req-217aace8-3f90-43c6-a48c-73b0377faadc tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Generated uuid 3385523c-d112-4db0-9ffe-b0761c56123d for aggregate {{(pid=125942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:47:45.306744 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-217aace8-3f90-43c6-a48c-73b0377faadc tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.071565 Aug 03 01:47:45.308264 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 24/42] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:47:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:45.320269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-406163ae-408c-4ecd-bf0b-c64d160e8ecf tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:45.321389 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:45.321389 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:45.341124 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-406163ae-408c-4ecd-bf0b-c64d160e8ecf tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1421220603" status: 202 len: 0 microversion: 2.1 time: 0.031319 Aug 03 01:47:45.345103 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 25/43] 10.222.0.67 () {58 vars in 1161 bytes} [Wed Aug 3 01:47:45 2022] DELETE /compute/v2.1/flavors/1421220603 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:47:45.348762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cce5bf63-c3d3-41ec-b94e-b8d3c115c3f3 tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:45.350373 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:45.350373 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:45.351607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cce5bf63-c3d3-41ec-b94e-b8d3c115c3f3 tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '071f8bf291ab4b9b988d487f667c8ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ffe737cc4d3aa19447daf90b919c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cce5bf63-c3d3-41ec-b94e-b8d3c115c3f3 tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Request method failure captured: Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dO3cX250jIXNYHhmQUNRn7HehvTs_yu6zt40TEXVS281otg-DAxP3I0DQ3OQlac4T_QyavTFouFvTKTafpGmlp9_2Dfg-t0eKNJFs7QWaT6q_I8NVCruti-OAhui2NX_VergD_YOcIUbvjVAX-MNQeA9t8-GBkyuV1vyPpRoxjW2-I Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 4760ffe737cc4d3aa19447daf90b919c Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:47:45.353171 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:47:45.354296 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4760ffe737cc4d3aa19447daf90b919c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4760ffe737cc4d3aa19447daf90b919c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4760ffe737cc4d3aa19447daf90b919c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4760ffe737cc4d3aa19447daf90b919c"}]}] Aug 03 01:47:45.354296 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:47:45.354296 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 4760ffe737cc4d3aa19447daf90b919c Aug 03 01:47:45.354296 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:47:45.354296 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AggregatesAdminNegativeTestJSON-742854162-project Aug 03 01:47:45.354296 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:47:45.354296 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:47:45.354296 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 071f8bf291ab4b9b988d487f667c8ef3 Aug 03 01:47:45.354296 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-742854162-project Aug 03 01:47:45.354296 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:47:45.354296 n-d-826529-8 devstack@n-api.service[125942]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 03 01:47:45.354296 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '6'} Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:47:45.354963 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.357017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cce5bf63-c3d3-41ec-b94e-b8d3c115c3f3 tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:45.358675 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cce5bf63-c3d3-41ec-b94e-b8d3c115c3f3 tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.011058 Aug 03 01:47:45.358675 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 26/44] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:47:45 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:47:45.363775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0f04aaa6-4cda-4274-a841-adb8edb793f9 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:45.391301 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0f04aaa6-4cda-4274-a841-adb8edb793f9 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034891 Aug 03 01:47:45.392234 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 27/45] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:47:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:45.398503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a62e6108-c2fe-4754-bbb8-cde5466bf525 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:45.430461 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a62e6108-c2fe-4754-bbb8-cde5466bf525 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.036160 Aug 03 01:47:45.431588 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 28/46] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:47:45 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:47:45.438771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a4c89c1b-f756-4623-86df-259ebed2b12d tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2041898994", "id": 2015760473, "os-flavor-access:is_public": "False"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:45.441614 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:45.441614 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:45.464404 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a4c89c1b-f756-4623-86df-259ebed2b12d tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.030615 Aug 03 01:47:45.465000 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 29/47] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:47:45 2022] POST /compute/v2.1/flavors => generated 439 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:45.469908 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-281c82ff-cdb7-4d85-8953-e72cb87f23dd tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:45.470851 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:45.470851 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:45.481867 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-281c82ff-cdb7-4d85-8953-e72cb87f23dd tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-281c82ff-cdb7-4d85-8953-e72cb87f23dd tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Request method failure captured: Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dO5U3lvrSRC66QKE0Qh6aG2O3yMQfDfBae24RYCaxWnmHtJB6f2_WdbSTn43TRVX3SjRb-wl2ghDqfBiQsDYCnPiWnN0M63sm8EyOIrmH-8nArLYPzLmKNUsTjRApWt-50teubl1nJo1hbG-gllNhWycmoDG5pNKcGPQ6hCWSkeaAg Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:47:45.483790 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:47:45.484919 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1d6d252ce76241528e2df5d551375c3b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}] Aug 03 01:47:45.484919 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:45.484919 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:47:45.484919 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:45.484919 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:47:45.484919 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:47:45.484919 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:47:45.484919 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: e9200402c0c644dd88c842b7e52c0007 Aug 03 01:47:45.484919 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:47:45.484919 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:47:45.484919 n-d-826529-8 devstack@n-api.service[125942]: exception: Aggregate -1 could not be found. Aug 03 01:47:45.484919 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '-1'} Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 03 01:47:45.485531 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.486463 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:45.487548 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:45.487548 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:45.487548 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:47:45.487548 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:47:45.487548 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 03 01:47:45.487548 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.489684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-281c82ff-cdb7-4d85-8953-e72cb87f23dd tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:45.491790 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-281c82ff-cdb7-4d85-8953-e72cb87f23dd tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.025476 Aug 03 01:47:45.496086 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 30/48] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 01:47:45 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:47:45.638864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:47:45.892908 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9c92c0b0-e86f-4ff1-845b-06d6bc3b4b2e tempest-FlavorsAccessNegativeTestJSON-940835994 tempest-FlavorsAccessNegativeTestJSON-940835994-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "733b2219fe944c48ade63012f3b236a9"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:45.895458 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:45.895458 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:45.900478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9c92c0b0-e86f-4ff1-845b-06d6bc3b4b2e tempest-FlavorsAccessNegativeTestJSON-940835994 tempest-FlavorsAccessNegativeTestJSON-940835994-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'fbd37b0f10f7457a97e12b1039093e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733b2219fe944c48ade63012f3b236a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9c92c0b0-e86f-4ff1-845b-06d6bc3b4b2e tempest-FlavorsAccessNegativeTestJSON-940835994 tempest-FlavorsAccessNegativeTestJSON-940835994-project] Request method failure captured: Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/flavors/2015760473/action HTTP/1.1 Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 67 Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dO6CIIwwhlmx-TmolZz5ybWdGi-BAB_B2Coq_0x9Y7BC2Hsbme1fHUyy4U30m4VyqbVKCvXx--BSLlbMfFOh8Dz8wlZ0KAQmcMPb4GJAvKNS_s-4LQ5WG9vU-jtcuQXE4YId7HKbdh7G3lVdMTInfNteF8jZTlAYXtLoXsCFKpzSrE Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 733b2219fe944c48ade63012f3b236a9 Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-940835994 Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:47:45.904509 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:47:45.905900 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_733b2219fe944c48ade63012f3b236a9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/733b2219fe944c48ade63012f3b236a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/733b2219fe944c48ade63012f3b236a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/733b2219fe944c48ade63012f3b236a9"}]}] Aug 03 01:47:45.905900 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-940835994 Aug 03 01:47:45.905900 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 733b2219fe944c48ade63012f3b236a9 Aug 03 01:47:45.905900 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-940835994 Aug 03 01:47:45.905900 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-FlavorsAccessNegativeTestJSON-940835994-project Aug 03 01:47:45.905900 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:47:45.905900 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:47:45.905900 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: fbd37b0f10f7457a97e12b1039093e49 Aug 03 01:47:45.905900 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-940835994-project Aug 03 01:47:45.905900 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:47:45.905900 n-d-826529-8 devstack@n-api.service[125942]: {"addTenantAccess": {"tenant": "733b2219fe944c48ade63012f3b236a9"}} Aug 03 01:47:45.905900 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '2015760473', 'body': {'addTenantAccess': {'tenant': '733b2219fe944c48ade63012f3b236a9'}}} Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:47:45.906512 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 03 01:47:45.907496 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:45.910021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9c92c0b0-e86f-4ff1-845b-06d6bc3b4b2e tempest-FlavorsAccessNegativeTestJSON-940835994 tempest-FlavorsAccessNegativeTestJSON-940835994-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:45.915415 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9c92c0b0-e86f-4ff1-845b-06d6bc3b4b2e tempest-FlavorsAccessNegativeTestJSON-940835994 tempest-FlavorsAccessNegativeTestJSON-940835994-project] 10.222.0.67 "POST /compute/v2.1/flavors/2015760473/action" status: 403 len: 130 microversion: 2.1 time: 0.414484 Aug 03 01:47:45.916455 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 31/49] 10.222.0.67 () {60 vars in 1200 bytes} [Wed Aug 3 01:47:45 2022] POST /compute/v2.1/flavors/2015760473/action => generated 130 bytes in 419 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:47:45.931571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f4c44095-6c45-4693-bf4b-a6e20b1189e0 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-674268596"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:45.936537 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:45.936537 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:45.938463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.aggregate [None req-f4c44095-6c45-4693-bf4b-a6e20b1189e0 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Generated uuid f667c906-9b83-45ea-83cd-014fa1fe76e5 for aggregate {{(pid=125942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:47:45.980425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:47:45.980668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:47:45.981153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:47:45.981565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:47:45.981979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:47:45.995864 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f4c44095-6c45-4693-bf4b-a6e20b1189e0 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.075540 Aug 03 01:47:45.996478 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 32/50] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:47:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:46.006794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:46.007801 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:46.009784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:46.011080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:46.013623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ec89cc3f-0519-4ca5-afca-a9e401624a69 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:46.014469 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:46.014469 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:46.054827 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ec89cc3f-0519-4ca5-afca-a9e401624a69 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/2015760473" status: 202 len: 0 microversion: 2.1 time: 0.048482 Aug 03 01:47:46.054827 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 33/51] 10.222.0.67 () {58 vars in 1161 bytes} [Wed Aug 3 01:47:45 2022] DELETE /compute/v2.1/flavors/2015760473 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:47:46.070796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d35406cc-73c8-4231-b120-31a624cf4f37 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:46.072413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d35406cc-73c8-4231-b120-31a624cf4f37 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:46.074050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Getting quotas for project 926cb51a68dc46d9a90c6899095a1d84. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:47:46.082977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d35406cc-73c8-4231-b120-31a624cf4f37 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:46.083385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Getting quotas for user 9ba2c713701049f7bc1ef8438279a418 and project 926cb51a68dc46d9a90c6899095a1d84. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:47:46.086760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d35406cc-73c8-4231-b120-31a624cf4f37 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:46.090340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d35406cc-73c8-4231-b120-31a624cf4f37 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:46.091216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d35406cc-73c8-4231-b120-31a624cf4f37 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:46.097817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:47:46.101078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:47:46.196203 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-190c01b0-080a-455b-8474-431414ea857d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.976071 Aug 03 01:47:46.196866 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 19/52] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:47:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:47:46.211273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4bc0eb57-b4dd-4156-9804-51c8fd73af3b tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:46.214140 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:46.214140 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:46.218871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4bc0eb57-b4dd-4156-9804-51c8fd73af3b tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '071f8bf291ab4b9b988d487f667c8ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ffe737cc4d3aa19447daf90b919c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:46.222801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d35406cc-73c8-4231-b120-31a624cf4f37 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4bc0eb57-b4dd-4156-9804-51c8fd73af3b tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Request method failure captured: Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO3cX250jIXNYHhmQUNRn7HehvTs_yu6zt40TEXVS281otg-DAxP3I0DQ3OQlac4T_QyavTFouFvTKTafpGmlp9_2Dfg-t0eKNJFs7QWaT6q_I8NVCruti-OAhui2NX_VergD_YOcIUbvjVAX-MNQeA9t8-GBkyuV1vyPpRoxjW2-I Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 4760ffe737cc4d3aa19447daf90b919c Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:47:46.224175 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:47:46.225410 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4760ffe737cc4d3aa19447daf90b919c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4760ffe737cc4d3aa19447daf90b919c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4760ffe737cc4d3aa19447daf90b919c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4760ffe737cc4d3aa19447daf90b919c"}]}] Aug 03 01:47:46.225410 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:47:46.225410 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 4760ffe737cc4d3aa19447daf90b919c Aug 03 01:47:46.225410 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:47:46.225410 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AggregatesAdminNegativeTestJSON-742854162-project Aug 03 01:47:46.225410 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:47:46.225410 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:47:46.225410 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 071f8bf291ab4b9b988d487f667c8ef3 Aug 03 01:47:46.225410 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-742854162-project Aug 03 01:47:46.225410 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:47:46.225410 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 03 01:47:46.225410 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '7'} Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:47:46.226173 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 03 01:47:46.227902 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:46.232802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4bc0eb57-b4dd-4156-9804-51c8fd73af3b tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:46.233954 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4bc0eb57-b4dd-4156-9804-51c8fd73af3b tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] 10.222.0.67 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.035126 Aug 03 01:47:46.235509 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d35406cc-73c8-4231-b120-31a624cf4f37 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1299 microversion: 2.1 time: 0.181594 Aug 03 01:47:46.235819 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 20/53] 10.222.0.67 () {58 vars in 1149 bytes} [Wed Aug 3 01:47:46 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:47:46.237352 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 34/54] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:46 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1299 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:46.256593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2daf4564-9e4a-46a6-8d01-0fbd2f9155f8 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:46.257566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2cedc1ea-e7ba-4017-b264-b026685fe1d5 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:46.258270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2daf4564-9e4a-46a6-8d01-0fbd2f9155f8 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:46.327697 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2cedc1ea-e7ba-4017-b264-b026685fe1d5 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088753 Aug 03 01:47:46.328799 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 21/55] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:47:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:46.336285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cc1b0ed4-d160-44be-8fde-7a23a40dd0ab tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:46.337503 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:46.337503 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:46.387842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2daf4564-9e4a-46a6-8d01-0fbd2f9155f8 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:46.393432 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cc1b0ed4-d160-44be-8fde-7a23a40dd0ab tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.062725 Aug 03 01:47:46.395645 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 22/56] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:47:46 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:47:46.408715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e3de411f-36f2-42d8-9ed4-e0d6b6cf3428 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-706413712", "id": 800268257, "os-flavor-access:is_public": "False"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:46.410926 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2daf4564-9e4a-46a6-8d01-0fbd2f9155f8 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1242 microversion: 2.1 time: 0.171416 Aug 03 01:47:46.412018 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 35/57] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:46 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1242 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:46.427456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-52f25a08-fd5d-43e1-a198-5f0c3ba87cbb tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:46.429127 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:46.429127 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:46.430053 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:46.430053 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:46.437669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=11,nova_api:DELETE=7 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:47:46.441318 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-52f25a08-fd5d-43e1-a198-5f0c3ba87cbb tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-52f25a08-fd5d-43e1-a198-5f0c3ba87cbb tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Request method failure captured: Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dO5U3lvrSRC66QKE0Qh6aG2O3yMQfDfBae24RYCaxWnmHtJB6f2_WdbSTn43TRVX3SjRb-wl2ghDqfBiQsDYCnPiWnN0M63sm8EyOIrmH-8nArLYPzLmKNUsTjRApWt-50teubl1nJo1hbG-gllNhWycmoDG5pNKcGPQ6hCWSkeaAg Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:47:46.445558 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:47:46.447097 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1d6d252ce76241528e2df5d551375c3b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}] Aug 03 01:47:46.447097 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:46.447097 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:47:46.447097 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:47:46.447097 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:47:46.447097 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:47:46.447097 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:47:46.447097 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: e9200402c0c644dd88c842b7e52c0007 Aug 03 01:47:46.447097 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:47:46.447097 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:47:46.447097 n-d-826529-8 devstack@n-api.service[125942]: exception: Aggregate -1 could not be found. Aug 03 01:47:46.447097 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '-1'} Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:46.448014 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 03 01:47:46.449564 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:46.455174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-52f25a08-fd5d-43e1-a198-5f0c3ba87cbb tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:46.456343 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-52f25a08-fd5d-43e1-a198-5f0c3ba87cbb tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.042396 Aug 03 01:47:46.457805 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 36/58] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:47:46 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:47:46.462414 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e3de411f-36f2-42d8-9ed4-e0d6b6cf3428 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.060370 Aug 03 01:47:46.463344 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 23/59] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:47:46 2022] POST /compute/v2.1/flavors => generated 435 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:46.475249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5c084d18-82f2-4ad0-8759-453e55c60fef tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:46.476239 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:46.476239 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:46.478065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5c084d18-82f2-4ad0-8759-453e55c60fef tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '071f8bf291ab4b9b988d487f667c8ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ffe737cc4d3aa19447daf90b919c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5c084d18-82f2-4ad0-8759-453e55c60fef tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Request method failure captured: Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dO3cX250jIXNYHhmQUNRn7HehvTs_yu6zt40TEXVS281otg-DAxP3I0DQ3OQlac4T_QyavTFouFvTKTafpGmlp9_2Dfg-t0eKNJFs7QWaT6q_I8NVCruti-OAhui2NX_VergD_YOcIUbvjVAX-MNQeA9t8-GBkyuV1vyPpRoxjW2-I Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 4760ffe737cc4d3aa19447daf90b919c Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:47:46.479658 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:47:46.480737 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4760ffe737cc4d3aa19447daf90b919c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4760ffe737cc4d3aa19447daf90b919c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4760ffe737cc4d3aa19447daf90b919c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4760ffe737cc4d3aa19447daf90b919c"}]}] Aug 03 01:47:46.480737 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:47:46.480737 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 4760ffe737cc4d3aa19447daf90b919c Aug 03 01:47:46.480737 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:47:46.480737 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AggregatesAdminNegativeTestJSON-742854162-project Aug 03 01:47:46.480737 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:47:46.480737 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:47:46.480737 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 071f8bf291ab4b9b988d487f667c8ef3 Aug 03 01:47:46.480737 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-742854162-project Aug 03 01:47:46.480737 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:47:46.480737 n-d-826529-8 devstack@n-api.service[125942]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 03 01:47:46.480737 n-d-826529-8 devstack@n-api.service[125942]: action_args: {} Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:47:46.481341 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 03 01:47:46.482256 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:47:46.484510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4a295b37-f288-4d76-81e4-92ced41530da tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "733b2219fe944c48ade63012f3b236a9"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:46.484604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5c084d18-82f2-4ad0-8759-453e55c60fef tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:46.484604 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5c084d18-82f2-4ad0-8759-453e55c60fef tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.010864 Aug 03 01:47:46.484759 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:46.484759 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:46.484895 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 37/60] 10.222.0.67 () {58 vars in 1143 bytes} [Wed Aug 3 01:47:46 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:47:47.260053 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4a295b37-f288-4d76-81e4-92ced41530da tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/800268257/action" status: 200 len: 96 microversion: 2.1 time: 0.788109 Aug 03 01:47:47.261402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c9de5124-3536-4770-9beb-45de24827f4f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:47.261760 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 24/61] 10.222.0.67 () {60 vars in 1197 bytes} [Wed Aug 3 01:47:46 2022] POST /compute/v2.1/flavors/800268257/action => generated 96 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 01:47:47.261910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c9de5124-3536-4770-9beb-45de24827f4f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:47.272910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9de5124-3536-4770-9beb-45de24827f4f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:47.273531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9de5124-3536-4770-9beb-45de24827f4f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:47.276879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9de5124-3536-4770-9beb-45de24827f4f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:47.277688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9de5124-3536-4770-9beb-45de24827f4f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:47.297381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bc2028b6-dd2e-4efa-9855-d5df5b8b555b tempest-FlavorsAccessNegativeTestJSON-940835994 tempest-FlavorsAccessNegativeTestJSON-940835994-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "733b2219fe944c48ade63012f3b236a9"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:47.305263 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:47.305263 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:47.306702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bc2028b6-dd2e-4efa-9855-d5df5b8b555b tempest-FlavorsAccessNegativeTestJSON-940835994 tempest-FlavorsAccessNegativeTestJSON-940835994-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'fbd37b0f10f7457a97e12b1039093e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733b2219fe944c48ade63012f3b236a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bc2028b6-dd2e-4efa-9855-d5df5b8b555b tempest-FlavorsAccessNegativeTestJSON-940835994 tempest-FlavorsAccessNegativeTestJSON-940835994-project] Request method failure captured: Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/flavors/800268257/action HTTP/1.1 Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 70 Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO6CIIwwhlmx-TmolZz5ybWdGi-BAB_B2Coq_0x9Y7BC2Hsbme1fHUyy4U30m4VyqbVKCvXx--BSLlbMfFOh8Dz8wlZ0KAQmcMPb4GJAvKNS_s-4LQ5WG9vU-jtcuQXE4YId7HKbdh7G3lVdMTInfNteF8jZTlAYXtLoXsCFKpzSrE Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 733b2219fe944c48ade63012f3b236a9 Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-940835994 Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:47:47.317092 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:47:47.319572 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_733b2219fe944c48ade63012f3b236a9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/733b2219fe944c48ade63012f3b236a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/733b2219fe944c48ade63012f3b236a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/733b2219fe944c48ade63012f3b236a9"}]}] Aug 03 01:47:47.319572 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-940835994 Aug 03 01:47:47.319572 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 733b2219fe944c48ade63012f3b236a9 Aug 03 01:47:47.319572 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-940835994 Aug 03 01:47:47.319572 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FlavorsAccessNegativeTestJSON-940835994-project Aug 03 01:47:47.319572 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:47:47.319572 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:47:47.319572 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: fbd37b0f10f7457a97e12b1039093e49 Aug 03 01:47:47.319572 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-940835994-project Aug 03 01:47:47.319572 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:47:47.319572 n-d-826529-8 devstack@n-api.service[125941]: {"removeTenantAccess": {"tenant": "733b2219fe944c48ade63012f3b236a9"}} Aug 03 01:47:47.319572 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '800268257', 'body': {'removeTenantAccess': {'tenant': '733b2219fe944c48ade63012f3b236a9'}}} Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can( Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:47:47.320370 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 03 01:47:47.321345 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:47.329923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bc2028b6-dd2e-4efa-9855-d5df5b8b555b tempest-FlavorsAccessNegativeTestJSON-940835994 tempest-FlavorsAccessNegativeTestJSON-940835994-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:47.330922 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bc2028b6-dd2e-4efa-9855-d5df5b8b555b tempest-FlavorsAccessNegativeTestJSON-940835994 tempest-FlavorsAccessNegativeTestJSON-940835994-project] 10.222.0.67 "POST /compute/v2.1/flavors/800268257/action" status: 403 len: 133 microversion: 2.1 time: 0.054789 Aug 03 01:47:47.331579 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 25/62] 10.222.0.67 () {60 vars in 1197 bytes} [Wed Aug 3 01:47:47 2022] POST /compute/v2.1/flavors/800268257/action => generated 133 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:47:47.347997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5edaf33f-2eb5-4537-9e9a-92526f048d0a tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "733b2219fe944c48ade63012f3b236a9"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:47.980788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c9de5124-3536-4770-9beb-45de24827f4f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:47.989707 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c9de5124-3536-4770-9beb-45de24827f4f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1341 microversion: 2.1 time: 0.735928 Aug 03 01:47:48.008992 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 38/63] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:47 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1341 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:48.014487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-53f50a1e-f7d2-4f41-93db-b57052e34714 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:48.015136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-53f50a1e-f7d2-4f41-93db-b57052e34714 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:48.025564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53f50a1e-f7d2-4f41-93db-b57052e34714 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:48.026645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53f50a1e-f7d2-4f41-93db-b57052e34714 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:48.027860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53f50a1e-f7d2-4f41-93db-b57052e34714 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:48.029271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53f50a1e-f7d2-4f41-93db-b57052e34714 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:48.173288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-53f50a1e-f7d2-4f41-93db-b57052e34714 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:48.185293 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-53f50a1e-f7d2-4f41-93db-b57052e34714 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1290 microversion: 2.1 time: 0.174604 Aug 03 01:47:48.186177 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 39/64] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:48 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1290 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:48.237321 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5edaf33f-2eb5-4537-9e9a-92526f048d0a tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/800268257/action" status: 200 len: 21 microversion: 2.1 time: 0.893350 Aug 03 01:47:48.247095 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 26/65] 10.222.0.67 () {60 vars in 1197 bytes} [Wed Aug 3 01:47:47 2022] POST /compute/v2.1/flavors/800268257/action => generated 21 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:47:48.262254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-03f857d3-ef19-4e73-97e0-2334c6ed6c8a tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:48.263906 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:48.263906 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:48.303567 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-03f857d3-ef19-4e73-97e0-2334c6ed6c8a tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/800268257" status: 202 len: 0 microversion: 2.1 time: 0.049290 Aug 03 01:47:48.305888 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 40/66] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 01:47:48 2022] DELETE /compute/v2.1/flavors/800268257 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:47:48.319256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3aab0f69-8b0b-40d7-83c8-55d18e03b8b4 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:48.376774 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3aab0f69-8b0b-40d7-83c8-55d18e03b8b4 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066533 Aug 03 01:47:48.378466 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 27/67] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:47:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:48.399808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9ab9e807-6e85-4d3a-b707-0d3b8674c8b9 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1105044428", "id": 182645409, "os-flavor-access:is_public": "False"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:48.403406 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:48.403406 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:48.433484 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9ab9e807-6e85-4d3a-b707-0d3b8674c8b9 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.037811 Aug 03 01:47:48.434271 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 41/68] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:47:48 2022] POST /compute/v2.1/flavors => generated 436 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:48.450544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aaa80dfc-7480-4602-bc4a-167ade607eab tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "17b0ec32375042ca9ecc8ee0d0fd195f"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:48.919293 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-aaa80dfc-7480-4602-bc4a-167ade607eab tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] HTTP exception thrown: Flavor access not found for 19 / 17b0ec32375042ca9ecc8ee0d0fd195f combination. Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aaa80dfc-7480-4602-bc4a-167ade607eab tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Request method failure captured: Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/flavors/182645409/action HTTP/1.1 Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 70 Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO8IEJ9M2LsRZp6xQZSE7aWko6UgO7FlZ2XaelwKv0rFIifur8RogkJ95Az4ytM6aQfUkSj_GXi40rD6y50M-KwUgrC_D2oxsWwjJXOuQXXvyT44xwJbwZQ6GxDjg5WNOduUfvqm_w2p8Hruo5lsL5vxK498BYAtifc90t_c9zbuWg Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: faacef6a8b1d46a483e8975538a1a578 Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-494135577 Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:47:48.922712 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:47:48.924343 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_faacef6a8b1d46a483e8975538a1a578", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/faacef6a8b1d46a483e8975538a1a578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/faacef6a8b1d46a483e8975538a1a578"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/faacef6a8b1d46a483e8975538a1a578"}]}] Aug 03 01:47:48.924343 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-494135577 Aug 03 01:47:48.924343 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: faacef6a8b1d46a483e8975538a1a578 Aug 03 01:47:48.924343 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-494135577 Aug 03 01:47:48.924343 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin Aug 03 01:47:48.924343 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:47:48.924343 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:47:48.924343 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: d4cb3279cd6a4206a7ca76f640fe7b39 Aug 03 01:47:48.924343 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin Aug 03 01:47:48.924343 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:47:48.924343 n-d-826529-8 devstack@n-api.service[125941]: {"removeTenantAccess": {"tenant": "17b0ec32375042ca9ecc8ee0d0fd195f"}} Aug 03 01:47:48.924343 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: exception: Flavor access not found for 19 / 17b0ec32375042ca9ecc8ee0d0fd195f combination. Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '182645409', 'body': {'removeTenantAccess': {'tenant': '17b0ec32375042ca9ecc8ee0d0fd195f'}}} Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 03 01:47:48.925298 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 19 / 17b0ec32375042ca9ecc8ee0d0fd195f combination. Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 19 / 17b0ec32375042ca9ecc8ee0d0fd195f combination. Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:48.926629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:47:48.928523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:47:48.928523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:47:48.928523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:47:48.928523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:47:48.928523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 19 / 17b0ec32375042ca9ecc8ee0d0fd195f combination. Aug 03 01:47:48.928523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:47:48.930763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aaa80dfc-7480-4602-bc4a-167ade607eab tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Returning 404 to user: Flavor access not found for 19 / 17b0ec32375042ca9ecc8ee0d0fd195f combination. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:47:48.932331 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-aaa80dfc-7480-4602-bc4a-167ade607eab tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/182645409/action" status: 404 len: 124 microversion: 2.1 time: 0.488672 Aug 03 01:47:48.933354 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 28/69] 10.222.0.67 () {60 vars in 1197 bytes} [Wed Aug 3 01:47:48 2022] POST /compute/v2.1/flavors/182645409/action => generated 124 bytes in 490 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:47:48.945490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ad89f392-a715-4ec8-ba8c-04008e197d4c tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:48.946324 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:48.946324 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:48.955580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c14dd379-18bc-43ca-a434-2b3fec651989 tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-756113346", "id": 926503597, "os-flavor-access:is_public": "False"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:48.998301 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c14dd379-18bc-43ca-a434-2b3fec651989 tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.313792 Aug 03 01:47:49.011553 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 42/70] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:47:48 2022] POST /compute/v2.1/flavors => generated 427 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:49.017284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fd7faf0f-140e-4288-a115-b7b53dd24407 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:49.018347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fd7faf0f-140e-4288-a115-b7b53dd24407 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:49.026973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd7faf0f-140e-4288-a115-b7b53dd24407 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:49.028419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd7faf0f-140e-4288-a115-b7b53dd24407 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:49.029461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd7faf0f-140e-4288-a115-b7b53dd24407 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:49.030251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd7faf0f-140e-4288-a115-b7b53dd24407 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:49.042509 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ad89f392-a715-4ec8-ba8c-04008e197d4c tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/182645409" status: 202 len: 0 microversion: 2.1 time: 0.103955 Aug 03 01:47:49.043880 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 29/71] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 01:47:48 2022] DELETE /compute/v2.1/flavors/182645409 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:47:49.053423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d9b18a11-0bce-4d85-8946-fd653f0c67d5 tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "07c38e777dc64d06b43a41dd4bc02888"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:49.220474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fd7faf0f-140e-4288-a115-b7b53dd24407 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:49.231067 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fd7faf0f-140e-4288-a115-b7b53dd24407 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1341 microversion: 2.1 time: 0.217904 Aug 03 01:47:49.231893 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 43/72] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:49 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1341 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:49.236893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0926e834-e072-4536-aaf9-ad84157b4029 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:49.260024 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0926e834-e072-4536-aaf9-ad84157b4029 tempest-FlavorsAccessNegativeTestJSON-494135577 tempest-FlavorsAccessNegativeTestJSON-494135577-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026139 Aug 03 01:47:49.273465 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 44/73] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:47:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:49.281739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-71545064-894d-477e-a4fe-feec7168f242 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:49.282788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-71545064-894d-477e-a4fe-feec7168f242 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:49.306401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71545064-894d-477e-a4fe-feec7168f242 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:49.308270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71545064-894d-477e-a4fe-feec7168f242 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:49.310204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71545064-894d-477e-a4fe-feec7168f242 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:49.310319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71545064-894d-477e-a4fe-feec7168f242 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:49.422339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-71545064-894d-477e-a4fe-feec7168f242 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:49.431515 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-71545064-894d-477e-a4fe-feec7168f242 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1290 microversion: 2.1 time: 0.154222 Aug 03 01:47:49.433123 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 45/74] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:49 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1290 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:49.581361 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d9b18a11-0bce-4d85-8946-fd653f0c67d5 tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/926503597/action" status: 200 len: 96 microversion: 2.1 time: 0.533478 Aug 03 01:47:49.581361 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 30/75] 10.222.0.67 () {60 vars in 1197 bytes} [Wed Aug 3 01:47:49 2022] POST /compute/v2.1/flavors/926503597/action => generated 96 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:47:49.937928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6f74f8c4-9515-4c68-9691-2cb223370036 tempest-FlavorsAccessTestJSON-16478950 tempest-FlavorsAccessTestJSON-16478950-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:49.989485 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6f74f8c4-9515-4c68-9691-2cb223370036 tempest-FlavorsAccessTestJSON-16478950 tempest-FlavorsAccessTestJSON-16478950-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.402074 Aug 03 01:47:49.991660 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 46/76] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:47:49 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:50.014253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0387c611-0550-4b09-bc78-4fa2dddb4004 tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "07c38e777dc64d06b43a41dd4bc02888"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:50.259651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b05bd18d-6def-4053-b5ca-7d0f28e0eb5b tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:50.266386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b05bd18d-6def-4053-b5ca-7d0f28e0eb5b tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:50.281889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b05bd18d-6def-4053-b5ca-7d0f28e0eb5b tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:50.283513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b05bd18d-6def-4053-b5ca-7d0f28e0eb5b tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:50.290153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b05bd18d-6def-4053-b5ca-7d0f28e0eb5b tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:50.291041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b05bd18d-6def-4053-b5ca-7d0f28e0eb5b tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:50.589679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b05bd18d-6def-4053-b5ca-7d0f28e0eb5b tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:50.603270 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b05bd18d-6def-4053-b5ca-7d0f28e0eb5b tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1341 microversion: 2.1 time: 0.349111 Aug 03 01:47:50.619975 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 47/77] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:50 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1341 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:47:50.633772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e04f0acb-04d9-46a0-ac39-384bbeeb32f3 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:50.635201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e04f0acb-04d9-46a0-ac39-384bbeeb32f3 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:50.644416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e04f0acb-04d9-46a0-ac39-384bbeeb32f3 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:50.645233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e04f0acb-04d9-46a0-ac39-384bbeeb32f3 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:50.647080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e04f0acb-04d9-46a0-ac39-384bbeeb32f3 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:50.648032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e04f0acb-04d9-46a0-ac39-384bbeeb32f3 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:50.781438 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0387c611-0550-4b09-bc78-4fa2dddb4004 tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/926503597/action" status: 200 len: 21 microversion: 2.1 time: 0.773406 Aug 03 01:47:50.782301 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 31/78] 10.222.0.67 () {60 vars in 1197 bytes} [Wed Aug 3 01:47:50 2022] POST /compute/v2.1/flavors/926503597/action => generated 21 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:47:50.784039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e04f0acb-04d9-46a0-ac39-384bbeeb32f3 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:50.808418 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e04f0acb-04d9-46a0-ac39-384bbeeb32f3 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1290 microversion: 2.1 time: 0.187032 Aug 03 01:47:50.810800 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 48/79] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:50 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1290 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:50.818013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-63825c6d-5c84-4c2f-840d-e28ee6c579f8 tempest-FlavorsAccessTestJSON-16478950 tempest-FlavorsAccessTestJSON-16478950-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:50.861686 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-63825c6d-5c84-4c2f-840d-e28ee6c579f8 tempest-FlavorsAccessTestJSON-16478950 tempest-FlavorsAccessTestJSON-16478950-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048056 Aug 03 01:47:50.867573 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 49/80] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:47:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:50.881973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25641861-30bf-476c-8f9d-b78069dae0dd tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:50.882752 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:50.882752 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:50.909419 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-25641861-30bf-476c-8f9d-b78069dae0dd tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/926503597" status: 202 len: 0 microversion: 2.1 time: 0.031139 Aug 03 01:47:50.915528 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 50/81] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 01:47:50 2022] DELETE /compute/v2.1/flavors/926503597 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 01:47:50.921623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5733f707-6941-4fba-9dd3-d35e9f3daa71 tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:50.964165 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5733f707-6941-4fba-9dd3-d35e9f3daa71 tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047301 Aug 03 01:47:50.979448 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 51/82] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:47:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:50.993509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-70b62bef-334d-4a91-b8cb-7b1abbfb0f22 tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-583203591", "id": 362911847, "os-flavor-access:is_public": "False"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:50.998173 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:50.998173 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:51.028795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=16,nova_api:INSERT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:47:51.038701 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-70b62bef-334d-4a91-b8cb-7b1abbfb0f22 tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.051298 Aug 03 01:47:51.039625 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 52/83] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:47:50 2022] POST /compute/v2.1/flavors => generated 427 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:47:51.062294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ed3e0731-d3fa-42b2-8b26-c6ac50151b53 tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:51.071483 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:51.071483 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:51.094948 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ed3e0731-d3fa-42b2-8b26-c6ac50151b53 tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/362911847/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.044500 Aug 03 01:47:51.095534 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 53/84] 10.222.0.67 () {58 vars in 1206 bytes} [Wed Aug 3 01:47:51 2022] GET /compute/v2.1/flavors/362911847/os-flavor-access => generated 21 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:47:51.113485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-110988d8-4bd8-4a6c-b789-70e9b99ab06c tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:51.133078 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-110988d8-4bd8-4a6c-b789-70e9b99ab06c tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/362911847" status: 202 len: 0 microversion: 2.1 time: 0.023127 Aug 03 01:47:51.135817 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 54/85] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 01:47:51 2022] DELETE /compute/v2.1/flavors/362911847 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:47:51.150785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d6811806-3919-4cf0-98d9-a17db5c7ff09 tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:51.195781 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d6811806-3919-4cf0-98d9-a17db5c7ff09 tempest-FlavorsAccessTestJSON-1479984180 tempest-FlavorsAccessTestJSON-1479984180-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054273 Aug 03 01:47:51.207715 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 55/86] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:47:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:51.258648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd68cae9-a20f-425a-8858-e1e707a868ec tempest-FlavorsV261TestJSON-88248861 tempest-FlavorsV261TestJSON-88248861-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-604160254", "id": 414494176, "os-flavor-access:is_public": "True"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:51.316763 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cd68cae9-a20f-425a-8858-e1e707a868ec tempest-FlavorsV261TestJSON-88248861 tempest-FlavorsV261TestJSON-88248861-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.533478 Aug 03 01:47:51.319774 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 32/87] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 01:47:50 2022] POST /compute/v2.1/flavors => generated 464 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:47:52.128313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-605230197", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:52.184254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a15731c9-7a1d-4815-9193-42ab759638a5 tempest-FlavorsV261TestJSON-51408976 tempest-FlavorsV261TestJSON-51408976-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:52.217872 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a15731c9-7a1d-4815-9193-42ab759638a5 tempest-FlavorsV261TestJSON-51408976 tempest-FlavorsV261TestJSON-51408976-project] 10.222.0.67 "GET /compute/v2.1/flavors/414494176" status: 200 len: 464 microversion: 2.61 time: 0.873023 Aug 03 01:47:52.220084 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 56/88] 10.222.0.67 () {60 vars in 1196 bytes} [Wed Aug 3 01:47:51 2022] GET /compute/v2.1/flavors/414494176 => generated 464 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:47:52.225574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9bff3a3e-2f64-475e-9f73-1095f151e6e7 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:52.226362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9bff3a3e-2f64-475e-9f73-1095f151e6e7 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:52.235765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:47:52.255334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9bff3a3e-2f64-475e-9f73-1095f151e6e7 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:52.255991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9bff3a3e-2f64-475e-9f73-1095f151e6e7 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:52.257145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9bff3a3e-2f64-475e-9f73-1095f151e6e7 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:52.257720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9bff3a3e-2f64-475e-9f73-1095f151e6e7 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:53.509421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9bff3a3e-2f64-475e-9f73-1095f151e6e7 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:53.535007 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9bff3a3e-2f64-475e-9f73-1095f151e6e7 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1341 microversion: 2.1 time: 1.313778 Aug 03 01:47:53.535811 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 57/89] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:52 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1341 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:53.543306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-337b4b1e-6eb3-4c89-a427-79a61c63aad2 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:53.547369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-337b4b1e-6eb3-4c89-a427-79a61c63aad2 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:53.563997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-337b4b1e-6eb3-4c89-a427-79a61c63aad2 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:53.565646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-337b4b1e-6eb3-4c89-a427-79a61c63aad2 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:53.569448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-337b4b1e-6eb3-4c89-a427-79a61c63aad2 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:53.576974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-337b4b1e-6eb3-4c89-a427-79a61c63aad2 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:53.723212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:47:53.724489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:47:53.725218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:47:53.725865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:47:53.727295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:47:53.759564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:53.760621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:53.762235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:53.762730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:53.807089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Getting quotas for project 6e247e7134ad41bfa92b6eff8111c86e. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:47:53.827018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Getting quotas for user 241ed53f42f84abc8efc7edb5f41f6ed and project 6e247e7134ad41bfa92b6eff8111c86e. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:47:53.844810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:47:53.848077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:47:53.919883 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-652b5478-e009-4380-ae49-eda89d76f1a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.568894 Aug 03 01:47:53.921226 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 33/90] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:47:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:47:53.929801 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-64c79f38-494c-4d71-b36d-19d13b20c6a0 tempest-FlavorsV261TestJSON-88248861 tempest-FlavorsV261TestJSON-88248861-project-admin] Action: 'update', calling method: .version_select at 0x7f5b220c8670>, body: {"flavor": {"description": "new"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:53.942875 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:53.942875 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:47:53.959869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:47:54.061684 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-64c79f38-494c-4d71-b36d-19d13b20c6a0 tempest-FlavorsV261TestJSON-88248861 tempest-FlavorsV261TestJSON-88248861-project-admin] 10.222.0.67 "PUT /compute/v2.1/flavors/414494176" status: 200 len: 465 microversion: 2.61 time: 0.138696 Aug 03 01:47:54.063141 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 34/91] 10.222.0.67 () {62 vars in 1216 bytes} [Wed Aug 3 01:47:53 2022] PUT /compute/v2.1/flavors/414494176 => generated 465 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:47:54.089230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1e844bb9-2762-4ffd-9c95-2320e709ad0c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:54.089540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1e844bb9-2762-4ffd-9c95-2320e709ad0c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:54.643487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-337b4b1e-6eb3-4c89-a427-79a61c63aad2 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:54.651399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1e844bb9-2762-4ffd-9c95-2320e709ad0c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:54.657425 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-337b4b1e-6eb3-4c89-a427-79a61c63aad2 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1338 microversion: 2.1 time: 1.117883 Aug 03 01:47:54.659771 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 58/92] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:53 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1338 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:54.672038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d4fcdc81-10c7-41ed-bbee-b3279fa137df tempest-FlavorsV261TestJSON-51408976 tempest-FlavorsV261TestJSON-51408976-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:54.686404 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1e844bb9-2762-4ffd-9c95-2320e709ad0c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1212 microversion: 2.1 time: 0.622071 Aug 03 01:47:54.689330 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 35/93] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:54 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1212 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:54.711690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f3bff93a-90a0-4ba9-9b99-66fa5981c000 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:54.712297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f3bff93a-90a0-4ba9-9b99-66fa5981c000 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:54.728158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f3bff93a-90a0-4ba9-9b99-66fa5981c000 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:54.728855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f3bff93a-90a0-4ba9-9b99-66fa5981c000 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:54.729455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f3bff93a-90a0-4ba9-9b99-66fa5981c000 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:54.729906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f3bff93a-90a0-4ba9-9b99-66fa5981c000 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:54.784442 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d4fcdc81-10c7-41ed-bbee-b3279fa137df tempest-FlavorsV261TestJSON-51408976 tempest-FlavorsV261TestJSON-51408976-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.119085 Aug 03 01:47:54.803630 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 59/94] 10.222.0.67 () {60 vars in 1187 bytes} [Wed Aug 3 01:47:54 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:47:54.822309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dac4b21b-0089-4c36-9615-d8fb227cd6c5 tempest-FlavorsV261TestJSON-51408976 tempest-FlavorsV261TestJSON-51408976-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:54.901569 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dac4b21b-0089-4c36-9615-d8fb227cd6c5 tempest-FlavorsV261TestJSON-51408976 tempest-FlavorsV261TestJSON-51408976-project] 10.222.0.67 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.091004 Aug 03 01:47:54.906375 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 60/95] 10.222.0.67 () {60 vars in 1166 bytes} [Wed Aug 3 01:47:54 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:47:54.933403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a70ca857-e356-43b7-a0ea-8b3bef4429a6 tempest-FlavorsV261TestJSON-88248861 tempest-FlavorsV261TestJSON-88248861-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:54.934513 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:47:54.934513 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:47:54.975266 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a70ca857-e356-43b7-a0ea-8b3bef4429a6 tempest-FlavorsV261TestJSON-88248861 tempest-FlavorsV261TestJSON-88248861-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/414494176" status: 202 len: 0 microversion: 2.61 time: 0.044432 Aug 03 01:47:54.977892 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 61/96] 10.222.0.67 () {60 vars in 1199 bytes} [Wed Aug 3 01:47:54 2022] DELETE /compute/v2.1/flavors/414494176 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:47:55.182398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-eddf7a0d-52e7-4635-91f7-eae6ef89f263 req-bf3b2ca9-9db4-461f-8427-a3d09a5c3502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f22df40-9a6d-46da-930d-d6ac26a21ca8", "tag": "acad373f-e2d6-49de-963a-0b96fc1f1bce"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:55.208473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-eddf7a0d-52e7-4635-91f7-eae6ef89f263 req-bf3b2ca9-9db4-461f-8427-a3d09a5c3502 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:55.221889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-eddf7a0d-52e7-4635-91f7-eae6ef89f263 req-bf3b2ca9-9db4-461f-8427-a3d09a5c3502 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:55.276749 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-eddf7a0d-52e7-4635-91f7-eae6ef89f263 req-bf3b2ca9-9db4-461f-8427-a3d09a5c3502 service nova] Creating event network-changed:acad373f-e2d6-49de-963a-0b96fc1f1bce for instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 on n-h1-826529-8 Aug 03 01:47:55.278056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-eddf7a0d-52e7-4635-91f7-eae6ef89f263 req-bf3b2ca9-9db4-461f-8427-a3d09a5c3502 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 01:47:55.279516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d6fbf7e-2883-49e9-b296-d912b54f8606 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:55.280696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d6fbf7e-2883-49e9-b296-d912b54f8606 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:55.282648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d6fbf7e-2883-49e9-b296-d912b54f8606 None None] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:55.284122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d6fbf7e-2883-49e9-b296-d912b54f8606 None None] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:55.300735 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.compute.rpcapi [None req-1d6fbf7e-2883-49e9-b296-d912b54f8606 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 01:47:55.301760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d6fbf7e-2883-49e9-b296-d912b54f8606 None None] Releasing lock "compute-rpcapi-router" {{(pid=125942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 01:47:55.351770 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1d6fbf7e-2883-49e9-b296-d912b54f8606 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.372073 Aug 03 01:47:55.352777 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 62/97] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:47:55.381650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8855220d-1c4c-4731-accc-497833564a19 tempest-FlavorsV261TestJSON-88248861 tempest-FlavorsV261TestJSON-88248861-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:55.449529 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8855220d-1c4c-4731-accc-497833564a19 tempest-FlavorsV261TestJSON-88248861 tempest-FlavorsV261TestJSON-88248861-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.088725 Aug 03 01:47:55.468128 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 63/98] 10.222.0.67 () {60 vars in 1187 bytes} [Wed Aug 3 01:47:55 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:47:55.586490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f3bff93a-90a0-4ba9-9b99-66fa5981c000 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:55.644425 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f3bff93a-90a0-4ba9-9b99-66fa5981c000 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1341 microversion: 2.1 time: 0.950288 Aug 03 01:47:55.658740 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 36/99] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:54 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1341 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:55.686459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0ff246ab-b8ac-4724-a87f-8ac1e8de042d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:55.687307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0ff246ab-b8ac-4724-a87f-8ac1e8de042d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:55.704939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ff246ab-b8ac-4724-a87f-8ac1e8de042d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:55.705485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ff246ab-b8ac-4724-a87f-8ac1e8de042d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:55.712493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ff246ab-b8ac-4724-a87f-8ac1e8de042d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:55.713076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ff246ab-b8ac-4724-a87f-8ac1e8de042d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:55.716462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2c514c54-c53f-48e2-b5c4-164c9c3e0931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:55.717704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2c514c54-c53f-48e2-b5c4-164c9c3e0931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:55.734284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:47:55.738034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c514c54-c53f-48e2-b5c4-164c9c3e0931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:55.741171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c514c54-c53f-48e2-b5c4-164c9c3e0931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:55.747078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c514c54-c53f-48e2-b5c4-164c9c3e0931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:55.749161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c514c54-c53f-48e2-b5c4-164c9c3e0931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:56.124018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2c514c54-c53f-48e2-b5c4-164c9c3e0931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:56.145652 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2c514c54-c53f-48e2-b5c4-164c9c3e0931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1264 microversion: 2.1 time: 0.435493 Aug 03 01:47:56.167819 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 37/100] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:55 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1264 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:56.396974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=10 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:47:56.577538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-1f949055-e375-4d0c-8895-0d1bb0ece78d req-0cda7e5e-e57f-4fce-beaa-9b666d524c09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b18352-3867-4a22-be5a-8355da571cb3", "tag": "f094f215-5719-47bc-8c83-6c2a23da374a"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:47:56.621391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1f949055-e375-4d0c-8895-0d1bb0ece78d req-0cda7e5e-e57f-4fce-beaa-9b666d524c09 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:56.621820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1f949055-e375-4d0c-8895-0d1bb0ece78d req-0cda7e5e-e57f-4fce-beaa-9b666d524c09 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:56.661677 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-1f949055-e375-4d0c-8895-0d1bb0ece78d req-0cda7e5e-e57f-4fce-beaa-9b666d524c09 service nova] Creating event network-changed:f094f215-5719-47bc-8c83-6c2a23da374a for instance a7b18352-3867-4a22-be5a-8355da571cb3 on n-h1-826529-8 Aug 03 01:47:56.663690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1f949055-e375-4d0c-8895-0d1bb0ece78d req-0cda7e5e-e57f-4fce-beaa-9b666d524c09 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 01:47:56.665256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-252272bd-c2e1-4a10-8d65-80fca204f857 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:56.666018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-252272bd-c2e1-4a10-8d65-80fca204f857 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:56.667010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-252272bd-c2e1-4a10-8d65-80fca204f857 None None] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:56.667931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-252272bd-c2e1-4a10-8d65-80fca204f857 None None] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:56.683023 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.compute.rpcapi [None req-252272bd-c2e1-4a10-8d65-80fca204f857 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 01:47:56.689158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-252272bd-c2e1-4a10-8d65-80fca204f857 None None] Releasing lock "compute-rpcapi-router" {{(pid=125941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 01:47:56.739243 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-252272bd-c2e1-4a10-8d65-80fca204f857 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292830 Aug 03 01:47:56.743507 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 38/101] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:47:56.774422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f1898ff6-660a-43ff-8e98-68aeb6aaf197 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:56.779972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f1898ff6-660a-43ff-8e98-68aeb6aaf197 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:56.793858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1898ff6-660a-43ff-8e98-68aeb6aaf197 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:56.794858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1898ff6-660a-43ff-8e98-68aeb6aaf197 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:56.796650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1898ff6-660a-43ff-8e98-68aeb6aaf197 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:56.797525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1898ff6-660a-43ff-8e98-68aeb6aaf197 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:57.028114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0ff246ab-b8ac-4724-a87f-8ac1e8de042d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:57.038637 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0ff246ab-b8ac-4724-a87f-8ac1e8de042d tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1338 microversion: 2.1 time: 1.358104 Aug 03 01:47:57.039522 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 64/102] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:55 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1338 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:57.181349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e63c8d7f-e31b-4dc5-bafc-8244978a9b81 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:57.182050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e63c8d7f-e31b-4dc5-bafc-8244978a9b81 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:57.194804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e63c8d7f-e31b-4dc5-bafc-8244978a9b81 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:57.195340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e63c8d7f-e31b-4dc5-bafc-8244978a9b81 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:57.196140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e63c8d7f-e31b-4dc5-bafc-8244978a9b81 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:57.196817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e63c8d7f-e31b-4dc5-bafc-8244978a9b81 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:57.534822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e63c8d7f-e31b-4dc5-bafc-8244978a9b81 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:57.538617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f1898ff6-660a-43ff-8e98-68aeb6aaf197 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:57.542710 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e63c8d7f-e31b-4dc5-bafc-8244978a9b81 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1270 microversion: 2.1 time: 0.366528 Aug 03 01:47:57.545053 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 65/103] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:57 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1270 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:47:57.555005 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f1898ff6-660a-43ff-8e98-68aeb6aaf197 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1341 microversion: 2.1 time: 0.807747 Aug 03 01:47:57.559655 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 39/104] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:56 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1341 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:58.064830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-09fde7d8-c8ad-45aa-bf16-4f76942a0089 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:58.066166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-09fde7d8-c8ad-45aa-bf16-4f76942a0089 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:58.077612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09fde7d8-c8ad-45aa-bf16-4f76942a0089 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:58.078074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09fde7d8-c8ad-45aa-bf16-4f76942a0089 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:58.078866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09fde7d8-c8ad-45aa-bf16-4f76942a0089 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:58.079334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09fde7d8-c8ad-45aa-bf16-4f76942a0089 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:58.399834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-09fde7d8-c8ad-45aa-bf16-4f76942a0089 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:58.410057 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-09fde7d8-c8ad-45aa-bf16-4f76942a0089 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1338 microversion: 2.1 time: 0.354073 Aug 03 01:47:58.416440 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 66/105] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:58 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1338 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:58.567271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-94855ed3-f651-4be8-a5bd-a6598d099e7d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:58.574212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-94855ed3-f651-4be8-a5bd-a6598d099e7d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:58.584269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f18300ce-6b66-4cfb-b519-b693af2cab42 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:58.585077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f18300ce-6b66-4cfb-b519-b693af2cab42 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:58.588067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94855ed3-f651-4be8-a5bd-a6598d099e7d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:58.595970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94855ed3-f651-4be8-a5bd-a6598d099e7d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:58.597133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94855ed3-f651-4be8-a5bd-a6598d099e7d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:58.597543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f18300ce-6b66-4cfb-b519-b693af2cab42 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:58.598198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94855ed3-f651-4be8-a5bd-a6598d099e7d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:58.598318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f18300ce-6b66-4cfb-b519-b693af2cab42 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:58.600580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f18300ce-6b66-4cfb-b519-b693af2cab42 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:58.605543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f18300ce-6b66-4cfb-b519-b693af2cab42 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:58.878399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-94855ed3-f651-4be8-a5bd-a6598d099e7d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:58.897776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f18300ce-6b66-4cfb-b519-b693af2cab42 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:58.904129 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-94855ed3-f651-4be8-a5bd-a6598d099e7d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1312 microversion: 2.1 time: 0.342106 Aug 03 01:47:58.910656 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f18300ce-6b66-4cfb-b519-b693af2cab42 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1341 microversion: 2.1 time: 0.332067 Aug 03 01:47:58.911306 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 40/106] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:58 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1312 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:58.924012 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 67/107] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:58 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1341 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:59.442762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-24e8520f-144b-4c66-afd1-db40ce1ff3dd tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:59.444529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-24e8520f-144b-4c66-afd1-db40ce1ff3dd tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:59.464248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24e8520f-144b-4c66-afd1-db40ce1ff3dd tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:59.466780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24e8520f-144b-4c66-afd1-db40ce1ff3dd tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:59.468346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24e8520f-144b-4c66-afd1-db40ce1ff3dd tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:59.472389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24e8520f-144b-4c66-afd1-db40ce1ff3dd tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:59.654864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-24e8520f-144b-4c66-afd1-db40ce1ff3dd tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:47:59.665347 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-24e8520f-144b-4c66-afd1-db40ce1ff3dd tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1338 microversion: 2.1 time: 0.227177 Aug 03 01:47:59.665941 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 41/108] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:59 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1338 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:47:59.938607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0d633dc6-254a-4b7b-972e-7f1195f91d3f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:47:59.939474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0d633dc6-254a-4b7b-972e-7f1195f91d3f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:47:59.951510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d633dc6-254a-4b7b-972e-7f1195f91d3f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:59.952394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d633dc6-254a-4b7b-972e-7f1195f91d3f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:47:59.953499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d633dc6-254a-4b7b-972e-7f1195f91d3f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:47:59.954104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d633dc6-254a-4b7b-972e-7f1195f91d3f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:00.081313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-888b50fe-a52e-4214-8000-159cf2147f80 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Calling method '.version_select at 0x7f5b2012c940>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:00.083220 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:00.083220 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:00.085469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-888b50fe-a52e-4214-8000-159cf2147f80 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:00.086228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-888b50fe-a52e-4214-8000-159cf2147f80 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:00.123253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-888b50fe-a52e-4214-8000-159cf2147f80 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:00.124232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-888b50fe-a52e-4214-8000-159cf2147f80 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:00.150403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-888b50fe-a52e-4214-8000-159cf2147f80 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:00.153565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-888b50fe-a52e-4214-8000-159cf2147f80 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:00.168896 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-888b50fe-a52e-4214-8000-159cf2147f80 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.300172 Aug 03 01:48:00.171435 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 68/109] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:47:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:00.180180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dba76845-0a7c-459a-8441-835838b9e931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:00.182165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dba76845-0a7c-459a-8441-835838b9e931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:00.196022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dba76845-0a7c-459a-8441-835838b9e931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:00.196472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dba76845-0a7c-459a-8441-835838b9e931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:00.198703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dba76845-0a7c-459a-8441-835838b9e931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:00.199213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dba76845-0a7c-459a-8441-835838b9e931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:00.225933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0d633dc6-254a-4b7b-972e-7f1195f91d3f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:00.243880 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0d633dc6-254a-4b7b-972e-7f1195f91d3f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1341 microversion: 2.1 time: 0.313465 Aug 03 01:48:00.259593 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 42/110] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:47:59 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1341 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:00.575107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dba76845-0a7c-459a-8441-835838b9e931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:00.589148 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dba76845-0a7c-459a-8441-835838b9e931 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1312 microversion: 2.1 time: 0.413503 Aug 03 01:48:00.589952 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 69/111] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:00 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1312 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:00.693593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8bd5ed3f-cb5d-4747-82d9-e48b4225c1d0 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:00.694246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8bd5ed3f-cb5d-4747-82d9-e48b4225c1d0 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:00.703902 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bd5ed3f-cb5d-4747-82d9-e48b4225c1d0 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:00.704370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bd5ed3f-cb5d-4747-82d9-e48b4225c1d0 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:00.716700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bd5ed3f-cb5d-4747-82d9-e48b4225c1d0 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:00.717287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bd5ed3f-cb5d-4747-82d9-e48b4225c1d0 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:00.863951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8e671b3b-9217-4db5-963d-2c36cb785682 tempest-HypervisorAdminNegativeUnderV252Test-251056723 tempest-HypervisorAdminNegativeUnderV252Test-251056723-project] Calling method '.version_select at 0x7f5b13d25280>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:00.865302 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:00.865302 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:00.867204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8e671b3b-9217-4db5-963d-2c36cb785682 tempest-HypervisorAdminNegativeUnderV252Test-251056723 tempest-HypervisorAdminNegativeUnderV252Test-251056723-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '325ff1f4f0b147cf9a9ea7403d4072ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a95a2ebf945c6a1613f3ba5f2bbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8e671b3b-9217-4db5-963d-2c36cb785682 tempest-HypervisorAdminNegativeUnderV252Test-251056723 tempest-HypervisorAdminNegativeUnderV252Test-251056723-project] Request method failure captured: Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-hypervisors/n-h1-826529-8/search HTTP/1.1 Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPOKho-bT7ftFI84SIhBMgS6u-m8YohZ_6qxc57SDkcvq-UumS5-cAMlPsp5Dt0vNFs_2C_EGk2_YE3sFvt4q6IfYZLdIMChbm3qVHgf1-xxs9gdCTx4zf5c-MFtua-HMO-rQMxrzNoL5E1UbDOxKA0vhYqOp41ZgZoBxav17iihx8 Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 618a95a2ebf945c6a1613f3ba5f2bbcf Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-251056723 Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:00.869542 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:00.870739 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_618a95a2ebf945c6a1613f3ba5f2bbcf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/618a95a2ebf945c6a1613f3ba5f2bbcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/618a95a2ebf945c6a1613f3ba5f2bbcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/618a95a2ebf945c6a1613f3ba5f2bbcf"}]}] Aug 03 01:48:00.870739 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-251056723 Aug 03 01:48:00.870739 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 618a95a2ebf945c6a1613f3ba5f2bbcf Aug 03 01:48:00.870739 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-251056723 Aug 03 01:48:00.870739 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-251056723-project Aug 03 01:48:00.870739 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:00.870739 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:00.870739 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 325ff1f4f0b147cf9a9ea7403d4072ec Aug 03 01:48:00.870739 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-251056723-project Aug 03 01:48:00.870739 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:48:00.870739 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 03 01:48:00.870739 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'n-h1-826529-8'} Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:00.871455 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 03 01:48:00.872469 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:00.882163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8e671b3b-9217-4db5-963d-2c36cb785682 tempest-HypervisorAdminNegativeUnderV252Test-251056723 tempest-HypervisorAdminNegativeUnderV252Test-251056723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:00.885594 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8e671b3b-9217-4db5-963d-2c36cb785682 tempest-HypervisorAdminNegativeUnderV252Test-251056723 tempest-HypervisorAdminNegativeUnderV252Test-251056723-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/n-h1-826529-8/search" status: 403 len: 117 microversion: 2.1 time: 0.624060 Aug 03 01:48:00.887322 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 43/112] 10.222.0.67 () {58 vars in 1209 bytes} [Wed Aug 3 01:48:00 2022] GET /compute/v2.1/os-hypervisors/n-h1-826529-8/search => generated 117 bytes in 627 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:00.896956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9abb86e8-2766-4da3-86bb-6999b287c85b tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Calling method '.version_select at 0x7f5b13d17670>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:00.899695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9abb86e8-2766-4da3-86bb-6999b287c85b tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:00.900489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9abb86e8-2766-4da3-86bb-6999b287c85b tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:00.909364 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-9abb86e8-2766-4da3-86bb-6999b287c85b tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9abb86e8-2766-4da3-86bb-6999b287c85b tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Request method failure captured: Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPPy9x0zz-yisGpsvb6P3zXkBRanCE-gPehohxZMrv_cCMH4YxltoBRgkYnxwhMi_C1iFwONhOh0z1ynV76IBidNA6Aue7-2Uva7viVKKjRVBBT67e2mDvZ1EfhCspTJaux364zur5BctqZqdgQ9J0qcZUmPTfn-f7gHjHaouXIP3s Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 7a2a92e5f4834412b040bf46a6a39ef3 Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-232143831 Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:48:00.910880 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:48:00.912801 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7a2a92e5f4834412b040bf46a6a39ef3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a2a92e5f4834412b040bf46a6a39ef3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7a2a92e5f4834412b040bf46a6a39ef3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a2a92e5f4834412b040bf46a6a39ef3"}]}] Aug 03 01:48:00.912801 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-232143831 Aug 03 01:48:00.912801 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 7a2a92e5f4834412b040bf46a6a39ef3 Aug 03 01:48:00.912801 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-232143831 Aug 03 01:48:00.912801 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin Aug 03 01:48:00.912801 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:00.912801 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:00.912801 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1360dec61c6b43f1a59480cf4fcf3653 Aug 03 01:48:00.912801 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin Aug 03 01:48:00.912801 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:48:00.912801 n-d-826529-8 devstack@n-api.service[125941]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 03 01:48:00.912801 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:00.913497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:00.914484 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:00.914484 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:00.914484 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:00.914484 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 03 01:48:00.914484 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:00.914484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9abb86e8-2766-4da3-86bb-6999b287c85b tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:00.914484 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9abb86e8-2766-4da3-86bb-6999b287c85b tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.020995 Aug 03 01:48:00.914484 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 44/113] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 3 01:48:00 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:00.939419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d5aee624-7681-433b-9f2b-4ccf7c65dd54 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Calling method '.version_select at 0x7f5b13d37820>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:00.942841 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:00.942841 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:00.945667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5aee624-7681-433b-9f2b-4ccf7c65dd54 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:00.953292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5aee624-7681-433b-9f2b-4ccf7c65dd54 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:00.981227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5aee624-7681-433b-9f2b-4ccf7c65dd54 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:00.982229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5aee624-7681-433b-9f2b-4ccf7c65dd54 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:00.994788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8bd5ed3f-cb5d-4747-82d9-e48b4225c1d0 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:01.004431 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8bd5ed3f-cb5d-4747-82d9-e48b4225c1d0 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1338 microversion: 2.1 time: 0.320785 Aug 03 01:48:01.016032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5aee624-7681-433b-9f2b-4ccf7c65dd54 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:01.016032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5aee624-7681-433b-9f2b-4ccf7c65dd54 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:01.018227 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 70/114] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:00 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1338 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:01.021626 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d5aee624-7681-433b-9f2b-4ccf7c65dd54 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.102149 Aug 03 01:48:01.024315 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 45/115] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:48:01.040618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-abe9ac4c-83e9-4c77-af05-ed7dbfcef652 tempest-HypervisorAdminNegativeUnderV252Test-251056723 tempest-HypervisorAdminNegativeUnderV252Test-251056723-project] Calling method '.version_select at 0x7f5b13d37a60>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:01.043465 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:01.043465 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:01.045549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-abe9ac4c-83e9-4c77-af05-ed7dbfcef652 tempest-HypervisorAdminNegativeUnderV252Test-251056723 tempest-HypervisorAdminNegativeUnderV252Test-251056723-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '325ff1f4f0b147cf9a9ea7403d4072ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618a95a2ebf945c6a1613f3ba5f2bbcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-abe9ac4c-83e9-4c77-af05-ed7dbfcef652 tempest-HypervisorAdminNegativeUnderV252Test-251056723 tempest-HypervisorAdminNegativeUnderV252Test-251056723-project] Request method failure captured: Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPOKho-bT7ftFI84SIhBMgS6u-m8YohZ_6qxc57SDkcvq-UumS5-cAMlPsp5Dt0vNFs_2C_EGk2_YE3sFvt4q6IfYZLdIMChbm3qVHgf1-xxs9gdCTx4zf5c-MFtua-HMO-rQMxrzNoL5E1UbDOxKA0vhYqOp41ZgZoBxav17iihx8 Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 618a95a2ebf945c6a1613f3ba5f2bbcf Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-251056723 Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:01.049565 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:01.051237 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_618a95a2ebf945c6a1613f3ba5f2bbcf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/618a95a2ebf945c6a1613f3ba5f2bbcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/618a95a2ebf945c6a1613f3ba5f2bbcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/618a95a2ebf945c6a1613f3ba5f2bbcf"}]}] Aug 03 01:48:01.051237 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-251056723 Aug 03 01:48:01.051237 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 618a95a2ebf945c6a1613f3ba5f2bbcf Aug 03 01:48:01.051237 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-251056723 Aug 03 01:48:01.051237 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-251056723-project Aug 03 01:48:01.051237 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:01.051237 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:01.051237 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 325ff1f4f0b147cf9a9ea7403d4072ec Aug 03 01:48:01.051237 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-251056723-project Aug 03 01:48:01.051237 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:48:01.051237 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 03 01:48:01.051237 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '1'} Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:01.052333 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 03 01:48:01.053808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:01.056030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-abe9ac4c-83e9-4c77-af05-ed7dbfcef652 tempest-HypervisorAdminNegativeUnderV252Test-251056723 tempest-HypervisorAdminNegativeUnderV252Test-251056723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:01.058028 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-abe9ac4c-83e9-4c77-af05-ed7dbfcef652 tempest-HypervisorAdminNegativeUnderV252Test-251056723 tempest-HypervisorAdminNegativeUnderV252Test-251056723-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.021066 Aug 03 01:48:01.059367 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 46/116] 10.222.0.67 () {58 vars in 1176 bytes} [Wed Aug 3 01:48:01 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:01.069205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e4af43e3-8219-4bd5-892b-3bf88bae73e6 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Calling method '.version_select at 0x7f5b200bbe50>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:01.070221 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:01.070221 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:01.071407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4af43e3-8219-4bd5-892b-3bf88bae73e6 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:01.071860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4af43e3-8219-4bd5-892b-3bf88bae73e6 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:01.087436 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-e4af43e3-8219-4bd5-892b-3bf88bae73e6 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] HTTP exception thrown: No hypervisor matching '3c3ba2a2-bc2f-42b3-a86d-2cf8fa8d83ad' could be found. Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e4af43e3-8219-4bd5-892b-3bf88bae73e6 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Request method failure captured: Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-hypervisors/3c3ba2a2-bc2f-42b3-a86d-2cf8fa8d83ad/servers HTTP/1.1 Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPPy9x0zz-yisGpsvb6P3zXkBRanCE-gPehohxZMrv_cCMH4YxltoBRgkYnxwhMi_C1iFwONhOh0z1ynV76IBidNA6Aue7-2Uva7viVKKjRVBBT67e2mDvZ1EfhCspTJaux364zur5BctqZqdgQ9J0qcZUmPTfn-f7gHjHaouXIP3s Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 7a2a92e5f4834412b040bf46a6a39ef3 Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-232143831 Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:48:01.106824 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:48:01.108446 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7a2a92e5f4834412b040bf46a6a39ef3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a2a92e5f4834412b040bf46a6a39ef3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7a2a92e5f4834412b040bf46a6a39ef3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7a2a92e5f4834412b040bf46a6a39ef3"}]}] Aug 03 01:48:01.108446 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-232143831 Aug 03 01:48:01.108446 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 7a2a92e5f4834412b040bf46a6a39ef3 Aug 03 01:48:01.108446 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-232143831 Aug 03 01:48:01.108446 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin Aug 03 01:48:01.108446 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:01.108446 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:01.108446 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1360dec61c6b43f1a59480cf4fcf3653 Aug 03 01:48:01.108446 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin Aug 03 01:48:01.108446 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:48:01.108446 n-d-826529-8 devstack@n-api.service[125942]: exception: No hypervisor matching '3c3ba2a2-bc2f-42b3-a86d-2cf8fa8d83ad' could be found. Aug 03 01:48:01.108446 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '3c3ba2a2-bc2f-42b3-a86d-2cf8fa8d83ad'} Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '3c3ba2a2-bc2f-42b3-a86d-2cf8fa8d83ad' could be found. Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:01.109161 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:01.110123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:01.110123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:01.110123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:01.110123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:01.110123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '3c3ba2a2-bc2f-42b3-a86d-2cf8fa8d83ad' could be found. Aug 03 01:48:01.110123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:01.110123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e4af43e3-8219-4bd5-892b-3bf88bae73e6 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] Returning 404 to user: No hypervisor matching '3c3ba2a2-bc2f-42b3-a86d-2cf8fa8d83ad' could be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:01.110123 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e4af43e3-8219-4bd5-892b-3bf88bae73e6 tempest-HypervisorAdminNegativeUnderV252Test-232143831 tempest-HypervisorAdminNegativeUnderV252Test-232143831-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/3c3ba2a2-bc2f-42b3-a86d-2cf8fa8d83ad/servers" status: 404 len: 123 microversion: 2.1 time: 0.043996 Aug 03 01:48:01.110123 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 71/117] 10.222.0.67 () {58 vars in 1281 bytes} [Wed Aug 3 01:48:01 2022] GET /compute/v2.1/os-hypervisors/3c3ba2a2-bc2f-42b3-a86d-2cf8fa8d83ad/servers => generated 123 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 01:48:01.293220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6097f39d-41f5-46d9-89c2-06a7992029f9 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:01.303962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6097f39d-41f5-46d9-89c2-06a7992029f9 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:01.329764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6097f39d-41f5-46d9-89c2-06a7992029f9 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:01.330232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6097f39d-41f5-46d9-89c2-06a7992029f9 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:01.332664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6097f39d-41f5-46d9-89c2-06a7992029f9 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:01.333358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6097f39d-41f5-46d9-89c2-06a7992029f9 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:01.548265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6097f39d-41f5-46d9-89c2-06a7992029f9 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:01.557065 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6097f39d-41f5-46d9-89c2-06a7992029f9 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1341 microversion: 2.1 time: 0.295209 Aug 03 01:48:01.574191 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 47/118] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:01 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1341 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:01.611032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d5bc12e-8507-4fc5-9b09-2b62008f7fef tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:01.611940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8d5bc12e-8507-4fc5-9b09-2b62008f7fef tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:01.619618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d5bc12e-8507-4fc5-9b09-2b62008f7fef tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:01.620760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d5bc12e-8507-4fc5-9b09-2b62008f7fef tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:01.622197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d5bc12e-8507-4fc5-9b09-2b62008f7fef tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:01.622853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d5bc12e-8507-4fc5-9b09-2b62008f7fef tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:01.796179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8d5bc12e-8507-4fc5-9b09-2b62008f7fef tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:01.805825 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8d5bc12e-8507-4fc5-9b09-2b62008f7fef tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1312 microversion: 2.1 time: 0.197584 Aug 03 01:48:01.806670 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 72/119] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:01 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1312 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:02.040902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-97a94811-9ebb-4ce6-887e-e327b1779aa9 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:02.041721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-97a94811-9ebb-4ce6-887e-e327b1779aa9 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:02.051598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97a94811-9ebb-4ce6-887e-e327b1779aa9 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.052117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97a94811-9ebb-4ce6-887e-e327b1779aa9 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:02.052938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97a94811-9ebb-4ce6-887e-e327b1779aa9 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.054677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97a94811-9ebb-4ce6-887e-e327b1779aa9 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:02.315358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-97a94811-9ebb-4ce6-887e-e327b1779aa9 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:02.325565 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-97a94811-9ebb-4ce6-887e-e327b1779aa9 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1338 microversion: 2.1 time: 0.290536 Aug 03 01:48:02.326493 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 48/120] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:02 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1338 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:02.589234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b933de6-2c26-4053-9aa1-9183cdec858f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:02.590137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8b933de6-2c26-4053-9aa1-9183cdec858f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:02.603473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b933de6-2c26-4053-9aa1-9183cdec858f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.604251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b933de6-2c26-4053-9aa1-9183cdec858f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:02.605658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b933de6-2c26-4053-9aa1-9183cdec858f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.606453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b933de6-2c26-4053-9aa1-9183cdec858f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:02.660088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-619a31d9-ae41-4f33-bc25-58564c37d4fe tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Calling method '.version_select at 0x7f5b200b3af0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:02.664744 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:02.664744 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:02.678605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-619a31d9-ae41-4f33-bc25-58564c37d4fe tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.681451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-619a31d9-ae41-4f33-bc25-58564c37d4fe tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:02.682679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-619a31d9-ae41-4f33-bc25-58564c37d4fe tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.683352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-619a31d9-ae41-4f33-bc25-58564c37d4fe tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:02.716098 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-619a31d9-ae41-4f33-bc25-58564c37d4fe tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.505598 Aug 03 01:48:02.717370 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 73/121] 10.222.0.67 () {58 vars in 1128 bytes} [Wed Aug 3 01:48:02 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:02.800485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8b933de6-2c26-4053-9aa1-9183cdec858f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:02.809054 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8b933de6-2c26-4053-9aa1-9183cdec858f tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1341 microversion: 2.1 time: 0.231582 Aug 03 01:48:02.809904 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 49/122] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:02 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1341 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:02.830091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-55c4c1be-34f6-4bef-b629-9a39297221d3 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Calling method '.version_select at 0x7f5b13d17dc0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:02.833013 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:02.833013 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:02.835511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55c4c1be-34f6-4bef-b629-9a39297221d3 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.836279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55c4c1be-34f6-4bef-b629-9a39297221d3 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:02.837310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55c4c1be-34f6-4bef-b629-9a39297221d3 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.838117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55c4c1be-34f6-4bef-b629-9a39297221d3 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:02.871367 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-55c4c1be-34f6-4bef-b629-9a39297221d3 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.046272 Aug 03 01:48:02.878642 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 50/123] 10.222.0.67 () {58 vars in 1139 bytes} [Wed Aug 3 01:48:02 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:02.883193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cae5c3ad-f25e-477e-986b-c31d2f0820f3 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:02.885588 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:02.885588 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:02.886843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cae5c3ad-f25e-477e-986b-c31d2f0820f3 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.887482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cae5c3ad-f25e-477e-986b-c31d2f0820f3 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:02.888318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cae5c3ad-f25e-477e-986b-c31d2f0820f3 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.889836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-949e4f6b-9562-42b9-84fc-ad02c4bb029a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:02.890459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-949e4f6b-9562-42b9-84fc-ad02c4bb029a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:02.890849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cae5c3ad-f25e-477e-986b-c31d2f0820f3 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:02.899155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=86,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:02.904637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-949e4f6b-9562-42b9-84fc-ad02c4bb029a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.904637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-949e4f6b-9562-42b9-84fc-ad02c4bb029a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:02.904637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-949e4f6b-9562-42b9-84fc-ad02c4bb029a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.904869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-949e4f6b-9562-42b9-84fc-ad02c4bb029a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:02.909604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:02.923425 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cae5c3ad-f25e-477e-986b-c31d2f0820f3 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.204612 Aug 03 01:48:02.924017 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 74/124] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:48:02 2022] GET /compute/v2.1/os-services => generated 965 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:02.937544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ab4b4dd2-4ad9-4a2f-a97a-9212821c0b91 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Calling method '.version_select at 0x7f5b13e84700>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:02.940066 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:02.940066 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:02.941332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab4b4dd2-4ad9-4a2f-a97a-9212821c0b91 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.941795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab4b4dd2-4ad9-4a2f-a97a-9212821c0b91 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:02.944729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab4b4dd2-4ad9-4a2f-a97a-9212821c0b91 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.945231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab4b4dd2-4ad9-4a2f-a97a-9212821c0b91 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:02.976308 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ab4b4dd2-4ad9-4a2f-a97a-9212821c0b91 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.042287 Aug 03 01:48:02.976942 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 75/125] 10.222.0.67 () {58 vars in 1145 bytes} [Wed Aug 3 01:48:02 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:48:02.988684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-394e88cf-1b7b-4700-a648-4092c3252fb9 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:02.993378 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:02.993378 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:02.995924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-394e88cf-1b7b-4700-a648-4092c3252fb9 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.996619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-394e88cf-1b7b-4700-a648-4092c3252fb9 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:02.997767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-394e88cf-1b7b-4700-a648-4092c3252fb9 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:02.998724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-394e88cf-1b7b-4700-a648-4092c3252fb9 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:03.029689 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-394e88cf-1b7b-4700-a648-4092c3252fb9 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.045489 Aug 03 01:48:03.039423 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 76/126] 10.222.0.67 () {58 vars in 1170 bytes} [Wed Aug 3 01:48:02 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 965 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:03.049662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6b399d39-1512-41b0-bff6-eb6e3f181b9f tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:03.053134 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:03.053134 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:03.054591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b399d39-1512-41b0-bff6-eb6e3f181b9f tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:03.055218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b399d39-1512-41b0-bff6-eb6e3f181b9f tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:03.056047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b399d39-1512-41b0-bff6-eb6e3f181b9f tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:03.056483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b399d39-1512-41b0-bff6-eb6e3f181b9f tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:03.124793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-949e4f6b-9562-42b9-84fc-ad02c4bb029a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:03.129756 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6b399d39-1512-41b0-bff6-eb6e3f181b9f tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.088702 Aug 03 01:48:03.134878 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-949e4f6b-9562-42b9-84fc-ad02c4bb029a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1312 microversion: 2.1 time: 0.258710 Aug 03 01:48:03.139775 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 77/127] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:48:03 2022] GET /compute/v2.1/os-services => generated 965 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:48:03.142060 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 51/128] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:02 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1312 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:03.166667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0b2849e6-9a2b-4ecb-915f-d2e481eac633 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:03.170955 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:03.170955 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:03.172907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b2849e6-9a2b-4ecb-915f-d2e481eac633 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:03.173610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b2849e6-9a2b-4ecb-915f-d2e481eac633 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:03.174548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b2849e6-9a2b-4ecb-915f-d2e481eac633 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:03.175463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b2849e6-9a2b-4ecb-915f-d2e481eac633 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:03.206434 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0b2849e6-9a2b-4ecb-915f-d2e481eac633 tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?host=n-d-826529-8&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.064674 Aug 03 01:48:03.207177 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 78/129] 10.222.0.67 () {58 vars in 1194 bytes} [Wed Aug 3 01:48:03 2022] GET /compute/v2.1/os-services?host=n-d-826529-8&binary=xxx => generated 16 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:48:03.222092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-649f77cc-a5e3-4f48-bc85-d63e014955eb tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:03.225149 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:03.225149 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:03.226878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-649f77cc-a5e3-4f48-bc85-d63e014955eb tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:03.227594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-649f77cc-a5e3-4f48-bc85-d63e014955eb tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:03.229313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-649f77cc-a5e3-4f48-bc85-d63e014955eb tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:03.229978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-649f77cc-a5e3-4f48-bc85-d63e014955eb tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:03.257393 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-649f77cc-a5e3-4f48-bc85-d63e014955eb tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.038862 Aug 03 01:48:03.258507 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 52/130] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:48:03 2022] GET /compute/v2.1/os-services => generated 965 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:03.272004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9f0fb0f5-1f67-4765-9723-d54620b35b7e tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:03.274982 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:03.274982 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:03.276624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f0fb0f5-1f67-4765-9723-d54620b35b7e tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:03.279682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f0fb0f5-1f67-4765-9723-d54620b35b7e tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:03.282514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f0fb0f5-1f67-4765-9723-d54620b35b7e tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:03.283189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f0fb0f5-1f67-4765-9723-d54620b35b7e tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:03.323445 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9f0fb0f5-1f67-4765-9723-d54620b35b7e tempest-ServicesAdminNegativeTestJSON-1029566428 tempest-ServicesAdminNegativeTestJSON-1029566428-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.056469 Aug 03 01:48:03.331227 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 79/131] 10.222.0.67 () {58 vars in 1198 bytes} [Wed Aug 3 01:48:03 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:48:03.367315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4b7aacc4-62c8-4eb3-990a-cfa596d0953a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:03.368125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4b7aacc4-62c8-4eb3-990a-cfa596d0953a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:03.384800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b7aacc4-62c8-4eb3-990a-cfa596d0953a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:03.385196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b7aacc4-62c8-4eb3-990a-cfa596d0953a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:03.389785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b7aacc4-62c8-4eb3-990a-cfa596d0953a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:03.390249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b7aacc4-62c8-4eb3-990a-cfa596d0953a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:03.675195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4b7aacc4-62c8-4eb3-990a-cfa596d0953a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:03.694302 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4b7aacc4-62c8-4eb3-990a-cfa596d0953a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1338 microversion: 2.1 time: 0.333592 Aug 03 01:48:03.706945 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 80/132] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:03 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1338 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:03.823050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2beb9e78-1133-4841-acf9-70651d91064b tempest-ServicesAdminNegativeTestJSON-1108945254 tempest-ServicesAdminNegativeTestJSON-1108945254-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:03.828008 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:03.828008 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:03.831684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2beb9e78-1133-4841-acf9-70651d91064b tempest-ServicesAdminNegativeTestJSON-1108945254 tempest-ServicesAdminNegativeTestJSON-1108945254-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e659bd48f0444ffba0536b2e5d8adb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597b5e639ce64aa08c5b88997853f5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2beb9e78-1133-4841-acf9-70651d91064b tempest-ServicesAdminNegativeTestJSON-1108945254 tempest-ServicesAdminNegativeTestJSON-1108945254-project] Request method failure captured: Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPRc3cvt0q23LG4BIh5ReeY7Ch92QL2feYPcn5C0GC9ZzgXbb_xwMqAnhj-SYNuo1vljrvCwEOLceulSZ_qtBPMwjrRYnVbi9Q1LhWJU7uMFvQqaRa3MfQdG4RaaAO65FmT-QdqNsIUHGtCvqw7q8sLeeUPe0RRx1nOatHKMhTr9pE Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 597b5e639ce64aa08c5b88997853f5bc Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1108945254 Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:03.839079 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:03.840345 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_597b5e639ce64aa08c5b88997853f5bc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/597b5e639ce64aa08c5b88997853f5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/597b5e639ce64aa08c5b88997853f5bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/597b5e639ce64aa08c5b88997853f5bc"}]}] Aug 03 01:48:03.840345 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1108945254 Aug 03 01:48:03.840345 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 597b5e639ce64aa08c5b88997853f5bc Aug 03 01:48:03.840345 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1108945254 Aug 03 01:48:03.840345 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServicesAdminNegativeTestJSON-1108945254-project Aug 03 01:48:03.840345 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:03.840345 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:03.840345 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e659bd48f0444ffba0536b2e5d8adb33 Aug 03 01:48:03.840345 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1108945254-project Aug 03 01:48:03.840345 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:03.840345 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 03 01:48:03.840345 n-d-826529-8 devstack@n-api.service[125941]: action_args: {} Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:03.841290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 03 01:48:03.842321 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:03.844275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2beb9e78-1133-4841-acf9-70651d91064b tempest-ServicesAdminNegativeTestJSON-1108945254 tempest-ServicesAdminNegativeTestJSON-1108945254-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:03.844275 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2beb9e78-1133-4841-acf9-70651d91064b tempest-ServicesAdminNegativeTestJSON-1108945254 tempest-ServicesAdminNegativeTestJSON-1108945254-project] 10.222.0.67 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.507952 Aug 03 01:48:03.844275 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 53/133] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:48:03 2022] GET /compute/v2.1/os-services => generated 112 bytes in 509 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:03.853570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a20944cb-9cc7-478c-b1c2-423e939c6c06 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:03.854198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a20944cb-9cc7-478c-b1c2-423e939c6c06 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:03.866861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-7afd88b1-db5c-4242-82a5-d432f03aff75 req-eb5870f1-fd6a-4107-9249-92a05203f07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f22df40-9a6d-46da-930d-d6ac26a21ca8", "name": "network-vif-plugged", "status": "completed", "tag": "acad373f-e2d6-49de-963a-0b96fc1f1bce"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:03.873032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a20944cb-9cc7-478c-b1c2-423e939c6c06 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:03.873527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a20944cb-9cc7-478c-b1c2-423e939c6c06 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:03.874406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a20944cb-9cc7-478c-b1c2-423e939c6c06 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:03.874852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a20944cb-9cc7-478c-b1c2-423e939c6c06 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:03.895009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7afd88b1-db5c-4242-82a5-d432f03aff75 req-eb5870f1-fd6a-4107-9249-92a05203f07d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:03.896887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7afd88b1-db5c-4242-82a5-d432f03aff75 req-eb5870f1-fd6a-4107-9249-92a05203f07d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:03.925851 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-7afd88b1-db5c-4242-82a5-d432f03aff75 req-eb5870f1-fd6a-4107-9249-92a05203f07d service nova] Creating event network-vif-plugged:acad373f-e2d6-49de-963a-0b96fc1f1bce for instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 on n-h1-826529-8 Aug 03 01:48:03.938866 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-7afd88b1-db5c-4242-82a5-d432f03aff75 req-eb5870f1-fd6a-4107-9249-92a05203f07d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169601 Aug 03 01:48:03.940078 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 81/134] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:04.165467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4b1ec079-3481-4d46-867f-2366b3a46190 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:04.166317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4b1ec079-3481-4d46-867f-2366b3a46190 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:04.180980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b1ec079-3481-4d46-867f-2366b3a46190 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:04.182595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b1ec079-3481-4d46-867f-2366b3a46190 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:04.184243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b1ec079-3481-4d46-867f-2366b3a46190 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:04.187198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b1ec079-3481-4d46-867f-2366b3a46190 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:04.201162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a20944cb-9cc7-478c-b1c2-423e939c6c06 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:04.213201 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a20944cb-9cc7-478c-b1c2-423e939c6c06 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1341 microversion: 2.1 time: 0.368220 Aug 03 01:48:04.214340 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 54/135] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:03 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1341 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:04.385405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4b1ec079-3481-4d46-867f-2366b3a46190 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:04.403703 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4b1ec079-3481-4d46-867f-2366b3a46190 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1312 microversion: 2.1 time: 0.243608 Aug 03 01:48:04.404896 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 82/136] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:04 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:04.725134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ca74be32-fa1a-4c5a-b577-4456e8564c54 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:04.726005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ca74be32-fa1a-4c5a-b577-4456e8564c54 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:04.731925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=14 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:04.758126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca74be32-fa1a-4c5a-b577-4456e8564c54 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:04.758861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca74be32-fa1a-4c5a-b577-4456e8564c54 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:04.759936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca74be32-fa1a-4c5a-b577-4456e8564c54 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:04.761071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca74be32-fa1a-4c5a-b577-4456e8564c54 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:05.061944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ca74be32-fa1a-4c5a-b577-4456e8564c54 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:05.073603 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ca74be32-fa1a-4c5a-b577-4456e8564c54 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1338 microversion: 2.1 time: 0.356674 Aug 03 01:48:05.074788 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 55/137] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:04 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1338 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:05.237994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-01a09ad2-c18f-411d-b12f-49b1866374dc tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:05.240358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-01a09ad2-c18f-411d-b12f-49b1866374dc tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:05.250233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01a09ad2-c18f-411d-b12f-49b1866374dc tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:05.251021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01a09ad2-c18f-411d-b12f-49b1866374dc tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:05.252103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01a09ad2-c18f-411d-b12f-49b1866374dc tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:05.252814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01a09ad2-c18f-411d-b12f-49b1866374dc tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:05.427577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ccf693b6-7769-428f-bfff-b4b64c59a58c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:05.428292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ccf693b6-7769-428f-bfff-b4b64c59a58c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:05.449958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-01a09ad2-c18f-411d-b12f-49b1866374dc tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:05.454961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccf693b6-7769-428f-bfff-b4b64c59a58c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:05.455437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccf693b6-7769-428f-bfff-b4b64c59a58c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:05.456224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccf693b6-7769-428f-bfff-b4b64c59a58c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:05.457714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccf693b6-7769-428f-bfff-b4b64c59a58c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:05.461705 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-01a09ad2-c18f-411d-b12f-49b1866374dc tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1341 microversion: 2.1 time: 0.229359 Aug 03 01:48:05.463050 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 83/138] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:05 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1341 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:05.619177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ccf693b6-7769-428f-bfff-b4b64c59a58c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:05.628166 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ccf693b6-7769-428f-bfff-b4b64c59a58c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1312 microversion: 2.1 time: 0.206796 Aug 03 01:48:05.628732 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 56/139] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:05 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1312 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:05.960838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-bc35c89d-ebff-4a28-9996-bc061811f5e9 req-b4dd3e23-7344-4e45-a8df-612432b4ac27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b18352-3867-4a22-be5a-8355da571cb3", "name": "network-vif-plugged", "status": "completed", "tag": "f094f215-5719-47bc-8c83-6c2a23da374a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:05.976835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bc35c89d-ebff-4a28-9996-bc061811f5e9 req-b4dd3e23-7344-4e45-a8df-612432b4ac27 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:05.977685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bc35c89d-ebff-4a28-9996-bc061811f5e9 req-b4dd3e23-7344-4e45-a8df-612432b4ac27 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:06.002514 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-bc35c89d-ebff-4a28-9996-bc061811f5e9 req-b4dd3e23-7344-4e45-a8df-612432b4ac27 service nova] Creating event network-vif-plugged:f094f215-5719-47bc-8c83-6c2a23da374a for instance a7b18352-3867-4a22-be5a-8355da571cb3 on n-h1-826529-8 Aug 03 01:48:06.008899 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-bc35c89d-ebff-4a28-9996-bc061811f5e9 req-b4dd3e23-7344-4e45-a8df-612432b4ac27 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052817 Aug 03 01:48:06.009967 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 84/140] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:06.096242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-15aa4173-6ac5-4264-b1a2-392569ee66db tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:06.097191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-15aa4173-6ac5-4264-b1a2-392569ee66db tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:06.108135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-15aa4173-6ac5-4264-b1a2-392569ee66db tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:06.108600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-15aa4173-6ac5-4264-b1a2-392569ee66db tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:06.109397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-15aa4173-6ac5-4264-b1a2-392569ee66db tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:06.109844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-15aa4173-6ac5-4264-b1a2-392569ee66db tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:06.400382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-15aa4173-6ac5-4264-b1a2-392569ee66db tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:06.402891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0d8a9314-bd86-429a-8ed0-8ca8797b306e tempest-InstanceUsageAuditLogNegativeTestJSON-1896029008 tempest-InstanceUsageAuditLogNegativeTestJSON-1896029008-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:06.403946 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:06.403946 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:06.406099 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-0d8a9314-bd86-429a-8ed0-8ca8797b306e tempest-InstanceUsageAuditLogNegativeTestJSON-1896029008 tempest-InstanceUsageAuditLogNegativeTestJSON-1896029008-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 03 01:48:06.412145 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-15aa4173-6ac5-4264-b1a2-392569ee66db tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1338 microversion: 2.1 time: 0.319199 Aug 03 01:48:06.413176 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 85/141] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:06 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1338 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0d8a9314-bd86-429a-8ed0-8ca8797b306e tempest-InstanceUsageAuditLogNegativeTestJSON-1896029008 tempest-InstanceUsageAuditLogNegativeTestJSON-1896029008-project-admin] Request method failure captured: Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPVBn4uomwM3tlo5WaWiETRbyFlZBWRfpw8xXLLgml-wzLjFfcerm4r5STLYSAVH4FdOwh4o5ll2lt759EFsXH2E2l94sLUJaVt6kbHGxtGSwbJuuJ9-P7YIxgXcvkAM-GU8YF33CzW9ip4aKD7KD4zVdm9SdXgqr1QIzhMuVdhkKY Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 740ed3d876854de580fa691539b8e0ad Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1896029008 Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:48:06.416920 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:48:06.418503 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_740ed3d876854de580fa691539b8e0ad", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/740ed3d876854de580fa691539b8e0ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/740ed3d876854de580fa691539b8e0ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/740ed3d876854de580fa691539b8e0ad"}]}] Aug 03 01:48:06.418503 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1896029008 Aug 03 01:48:06.418503 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 740ed3d876854de580fa691539b8e0ad Aug 03 01:48:06.418503 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1896029008 Aug 03 01:48:06.418503 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1896029008-project-admin Aug 03 01:48:06.418503 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:06.418503 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:06.418503 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: c19ee040d91e49ca9d639ac5efae8792 Aug 03 01:48:06.418503 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1896029008-project-admin Aug 03 01:48:06.418503 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:06.418503 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid timestamp for date invalid_time Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'invalid_time'} Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:06.419292 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:06.420508 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 03 01:48:06.420508 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 03 01:48:06.420508 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 03 01:48:06.420508 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:06.420508 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:06.420508 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:06.420508 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:06.420508 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:06.420508 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:06.420508 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:06.420508 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:06.420508 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 03 01:48:06.420508 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:06.422586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0d8a9314-bd86-429a-8ed0-8ca8797b306e tempest-InstanceUsageAuditLogNegativeTestJSON-1896029008 tempest-InstanceUsageAuditLogNegativeTestJSON-1896029008-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:06.423653 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0d8a9314-bd86-429a-8ed0-8ca8797b306e tempest-InstanceUsageAuditLogNegativeTestJSON-1896029008 tempest-InstanceUsageAuditLogNegativeTestJSON-1896029008-project-admin] 10.222.0.67 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.403850 Aug 03 01:48:06.424474 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 57/142] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Aug 3 01:48:06 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 405 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 01:48:06.484853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37b17e98-3507-4c52-879b-5d1a097134f1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:06.485746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-37b17e98-3507-4c52-879b-5d1a097134f1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:06.495816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37b17e98-3507-4c52-879b-5d1a097134f1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:06.496645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37b17e98-3507-4c52-879b-5d1a097134f1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:06.498069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37b17e98-3507-4c52-879b-5d1a097134f1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:06.498820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37b17e98-3507-4c52-879b-5d1a097134f1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:06.589534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a7073b1f-7498-4f71-ae8a-85abc5a43262 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:06.590696 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:06.590696 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:06.593136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a7073b1f-7498-4f71-ae8a-85abc5a43262 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '47cd2fdf96d84c799b95c67a10d88158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b210cd5441a649acbb57b6e68d2640c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a7073b1f-7498-4f71-ae8a-85abc5a43262 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511-project] Request method failure captured: Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPVyFhiicuWpo48z3j3FfbdLNhlVPlnSv5sTSvn58nn6oDGJFkhMfi1amlA8DeFRGY_KCgKFrFvW50-8ueHks0HMglj3T5dUKvacqCLqLj9B1OwE1r8sFT6NdPAxv5UFH0z-6x45AyNUVqIeqZZQTCzUQU_6dIbDepgM9l4q0tB-d0 Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: b210cd5441a649acbb57b6e68d2640c6 Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:48:06.596234 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:48:06.597741 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b210cd5441a649acbb57b6e68d2640c6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b210cd5441a649acbb57b6e68d2640c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b210cd5441a649acbb57b6e68d2640c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b210cd5441a649acbb57b6e68d2640c6"}]}] Aug 03 01:48:06.597741 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 Aug 03 01:48:06.597741 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: b210cd5441a649acbb57b6e68d2640c6 Aug 03 01:48:06.597741 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 Aug 03 01:48:06.597741 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-505160511-project Aug 03 01:48:06.597741 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:06.597741 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:06.597741 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 47cd2fdf96d84c799b95c67a10d88158 Aug 03 01:48:06.597741 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-505160511-project Aug 03 01:48:06.597741 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: action_args: {} Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:06.598455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 03 01:48:06.599759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:06.601909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a7073b1f-7498-4f71-ae8a-85abc5a43262 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:06.603145 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a7073b1f-7498-4f71-ae8a-85abc5a43262 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511-project] 10.222.0.67 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.172064 Aug 03 01:48:06.609639 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 86/143] 10.222.0.67 () {58 vars in 1185 bytes} [Wed Aug 3 01:48:06 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 180 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:06.624699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0c3a728d-69a0-4062-8b74-bd6e4d82fe64 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:06.625493 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:06.625493 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:06.627168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0c3a728d-69a0-4062-8b74-bd6e4d82fe64 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '47cd2fdf96d84c799b95c67a10d88158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b210cd5441a649acbb57b6e68d2640c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0c3a728d-69a0-4062-8b74-bd6e4d82fe64 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511-project] Request method failure captured: Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-03%2001:48:06 HTTP/1.1 Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPVyFhiicuWpo48z3j3FfbdLNhlVPlnSv5sTSvn58nn6oDGJFkhMfi1amlA8DeFRGY_KCgKFrFvW50-8ueHks0HMglj3T5dUKvacqCLqLj9B1OwE1r8sFT6NdPAxv5UFH0z-6x45AyNUVqIeqZZQTCzUQU_6dIbDepgM9l4q0tB-d0 Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: b210cd5441a649acbb57b6e68d2640c6 Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:48:06.629322 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:48:06.631033 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b210cd5441a649acbb57b6e68d2640c6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b210cd5441a649acbb57b6e68d2640c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b210cd5441a649acbb57b6e68d2640c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b210cd5441a649acbb57b6e68d2640c6"}]}] Aug 03 01:48:06.631033 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 Aug 03 01:48:06.631033 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: b210cd5441a649acbb57b6e68d2640c6 Aug 03 01:48:06.631033 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 Aug 03 01:48:06.631033 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-505160511-project Aug 03 01:48:06.631033 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:06.631033 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:06.631033 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 47cd2fdf96d84c799b95c67a10d88158 Aug 03 01:48:06.631033 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-505160511-project Aug 03 01:48:06.631033 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '2022-08-03 01:48:06'} Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:06.632424 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 03 01:48:06.633466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:06.635001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0c3a728d-69a0-4062-8b74-bd6e4d82fe64 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:06.635001 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0c3a728d-69a0-4062-8b74-bd6e4d82fe64 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511 tempest-InstanceUsageAuditLogNegativeTestJSON-505160511-project] 10.222.0.67 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-03 01:48:06" status: 403 len: 128 microversion: 2.1 time: 0.016935 Aug 03 01:48:06.635001 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 87/144] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 3 01:48:06 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-03%2001%3A48%3A06 => generated 128 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:06.661688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a704f058-c2fb-4390-a008-ceaf81c6b6af tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:06.663946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a704f058-c2fb-4390-a008-ceaf81c6b6af tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:06.682384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a704f058-c2fb-4390-a008-ceaf81c6b6af tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:06.685249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a704f058-c2fb-4390-a008-ceaf81c6b6af tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:06.687316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a704f058-c2fb-4390-a008-ceaf81c6b6af tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:06.688109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a704f058-c2fb-4390-a008-ceaf81c6b6af tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:06.691345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-37b17e98-3507-4c52-879b-5d1a097134f1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:06.710955 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-37b17e98-3507-4c52-879b-5d1a097134f1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1341 microversion: 2.1 time: 0.231026 Aug 03 01:48:06.712860 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 58/145] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:06 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1341 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:06.891632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a704f058-c2fb-4390-a008-ceaf81c6b6af tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:06.900799 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a704f058-c2fb-4390-a008-ceaf81c6b6af tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1312 microversion: 2.1 time: 0.253614 Aug 03 01:48:06.901889 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 88/146] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:06 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1312 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:06.938257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-18afef88-da37-4881-bc7d-e751c92cb414 req-dab49e71-2c38-4328-b542-5d8504499229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dacc86a-058f-479b-b490-1866c660048b", "tag": "088945bb-f722-4c0a-8dfe-6f40991b1450"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:06.957857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-18afef88-da37-4881-bc7d-e751c92cb414 req-dab49e71-2c38-4328-b542-5d8504499229 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:06.958480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-18afef88-da37-4881-bc7d-e751c92cb414 req-dab49e71-2c38-4328-b542-5d8504499229 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:06.990526 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-18afef88-da37-4881-bc7d-e751c92cb414 req-dab49e71-2c38-4328-b542-5d8504499229 service nova] Creating event network-changed:088945bb-f722-4c0a-8dfe-6f40991b1450 for instance 7dacc86a-058f-479b-b490-1866c660048b on n-h2-826529-8 Aug 03 01:48:06.996982 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-18afef88-da37-4881-bc7d-e751c92cb414 req-dab49e71-2c38-4328-b542-5d8504499229 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062466 Aug 03 01:48:06.997698 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 59/147] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:07.194605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-313199116", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:07.258347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:48:07.438378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7c3205d3-3413-4ad4-b6e1-dfa270ebf863 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:07.439339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7c3205d3-3413-4ad4-b6e1-dfa270ebf863 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:07.446286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c3205d3-3413-4ad4-b6e1-dfa270ebf863 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:07.446726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c3205d3-3413-4ad4-b6e1-dfa270ebf863 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:07.447743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c3205d3-3413-4ad4-b6e1-dfa270ebf863 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:07.448572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c3205d3-3413-4ad4-b6e1-dfa270ebf863 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:07.559703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:48:07.560191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:48:07.561038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:48:07.561680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:48:07.562105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:48:07.571439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:07.571885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:07.572685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:07.573119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:07.587649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:07.593835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Getting quotas for project bf1b4aebbcd24c16b2f30966a762c819. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:48:07.598522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Getting quotas for user 8537e15eb8f24ee3a1e1d925bba2bc68 and project bf1b4aebbcd24c16b2f30966a762c819. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:48:07.610453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:48:07.612761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:48:07.662017 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d29a17be-bfdd-4182-b561-bfcaf23a13de tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591165 Aug 03 01:48:07.662837 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 89/148] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:48:07.675147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4beaf498-7a59-4b12-a574-c7645ee9675d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:07.675970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4beaf498-7a59-4b12-a574-c7645ee9675d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:07.681240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7c3205d3-3413-4ad4-b6e1-dfa270ebf863 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:07.698832 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7c3205d3-3413-4ad4-b6e1-dfa270ebf863 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1338 microversion: 2.1 time: 0.264869 Aug 03 01:48:07.699506 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 60/149] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:07 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1338 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:07.740428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c98d2f51-7086-4442-ae56-c9ec4e0f404c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:07.741844 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c98d2f51-7086-4442-ae56-c9ec4e0f404c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:07.748231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4beaf498-7a59-4b12-a574-c7645ee9675d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:07.763480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c98d2f51-7086-4442-ae56-c9ec4e0f404c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:07.764096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c98d2f51-7086-4442-ae56-c9ec4e0f404c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:07.765150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c98d2f51-7086-4442-ae56-c9ec4e0f404c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:07.765655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c98d2f51-7086-4442-ae56-c9ec4e0f404c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:07.787860 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4beaf498-7a59-4b12-a574-c7645ee9675d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1216 microversion: 2.1 time: 0.114339 Aug 03 01:48:07.789375 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 90/150] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:07 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1216 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:07.926947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c98d2f51-7086-4442-ae56-c9ec4e0f404c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:07.928144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5a0193d4-d154-4d5a-b0c6-8a53689bb4d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:07.929191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5a0193d4-d154-4d5a-b0c6-8a53689bb4d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:07.937381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a0193d4-d154-4d5a-b0c6-8a53689bb4d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:07.938334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a0193d4-d154-4d5a-b0c6-8a53689bb4d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:07.939315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a0193d4-d154-4d5a-b0c6-8a53689bb4d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:07.939750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a0193d4-d154-4d5a-b0c6-8a53689bb4d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:07.941098 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c98d2f51-7086-4442-ae56-c9ec4e0f404c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1491 microversion: 2.1 time: 0.203840 Aug 03 01:48:07.941714 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 61/151] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:07 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1491 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:07.945236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:08.099745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5a0193d4-d154-4d5a-b0c6-8a53689bb4d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:08.107996 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5a0193d4-d154-4d5a-b0c6-8a53689bb4d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1312 microversion: 2.1 time: 0.187551 Aug 03 01:48:08.108572 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 91/152] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:07 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:08.201700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7f2bdeba-c2cb-4235-ba88-f75ceb907287 tempest-DeleteServersAdminTestJSON-900211381 tempest-DeleteServersAdminTestJSON-900211381-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:08.202404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7f2bdeba-c2cb-4235-ba88-f75ceb907287 tempest-DeleteServersAdminTestJSON-900211381 tempest-DeleteServersAdminTestJSON-900211381-project-admin] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:08.209216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f2bdeba-c2cb-4235-ba88-f75ceb907287 tempest-DeleteServersAdminTestJSON-900211381 tempest-DeleteServersAdminTestJSON-900211381-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:08.209705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f2bdeba-c2cb-4235-ba88-f75ceb907287 tempest-DeleteServersAdminTestJSON-900211381 tempest-DeleteServersAdminTestJSON-900211381-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:08.210528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f2bdeba-c2cb-4235-ba88-f75ceb907287 tempest-DeleteServersAdminTestJSON-900211381 tempest-DeleteServersAdminTestJSON-900211381-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:08.211045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f2bdeba-c2cb-4235-ba88-f75ceb907287 tempest-DeleteServersAdminTestJSON-900211381 tempest-DeleteServersAdminTestJSON-900211381-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:08.281951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7f2bdeba-c2cb-4235-ba88-f75ceb907287 tempest-DeleteServersAdminTestJSON-900211381 tempest-DeleteServersAdminTestJSON-900211381-project-admin] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:48:08.411311 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7f2bdeba-c2cb-4235-ba88-f75ceb907287 tempest-DeleteServersAdminTestJSON-900211381 tempest-DeleteServersAdminTestJSON-900211381-project-admin] 10.222.0.67 "DELETE /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 204 len: 0 microversion: 2.1 time: 0.450831 Aug 03 01:48:08.412149 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 62/153] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:48:07 2022] DELETE /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 01:48:08.420032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1f622e5b-a69e-4b30-a0d2-4d7fa1104530 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:08.420735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1f622e5b-a69e-4b30-a0d2-4d7fa1104530 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:08.426706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f622e5b-a69e-4b30-a0d2-4d7fa1104530 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:08.428371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f622e5b-a69e-4b30-a0d2-4d7fa1104530 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:08.429157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f622e5b-a69e-4b30-a0d2-4d7fa1104530 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:08.429599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f622e5b-a69e-4b30-a0d2-4d7fa1104530 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:08.570692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1f622e5b-a69e-4b30-a0d2-4d7fa1104530 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:08.578149 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1f622e5b-a69e-4b30-a0d2-4d7fa1104530 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1497 microversion: 2.1 time: 0.161906 Aug 03 01:48:08.578704 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 92/154] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:08 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:08.721837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-72a04dee-49c8-439f-9c92-286060c3d48a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:08.722647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-72a04dee-49c8-439f-9c92-286060c3d48a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:08.730070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72a04dee-49c8-439f-9c92-286060c3d48a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:08.730547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72a04dee-49c8-439f-9c92-286060c3d48a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:08.731363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72a04dee-49c8-439f-9c92-286060c3d48a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:08.731808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72a04dee-49c8-439f-9c92-286060c3d48a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:08.810091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d9017b12-b7e3-47b6-bae7-7e8f78792b9d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:08.810716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d9017b12-b7e3-47b6-bae7-7e8f78792b9d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:08.818950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9017b12-b7e3-47b6-bae7-7e8f78792b9d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:08.820300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9017b12-b7e3-47b6-bae7-7e8f78792b9d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:08.821965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9017b12-b7e3-47b6-bae7-7e8f78792b9d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:08.822601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9017b12-b7e3-47b6-bae7-7e8f78792b9d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:08.891929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d9017b12-b7e3-47b6-bae7-7e8f78792b9d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:08.901041 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d9017b12-b7e3-47b6-bae7-7e8f78792b9d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1220 microversion: 2.1 time: 0.095104 Aug 03 01:48:08.901707 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 93/155] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:08 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:09.015034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-72a04dee-49c8-439f-9c92-286060c3d48a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:09.023079 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-72a04dee-49c8-439f-9c92-286060c3d48a tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1487 microversion: 2.1 time: 0.305802 Aug 03 01:48:09.023662 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 63/156] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:08 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1487 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:09.044198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-036da457-71ec-4073-b500-8cdbe2b45e80 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:09.045303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-036da457-71ec-4073-b500-8cdbe2b45e80 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:09.056715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-036da457-71ec-4073-b500-8cdbe2b45e80 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:09.057511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-036da457-71ec-4073-b500-8cdbe2b45e80 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:09.058947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-036da457-71ec-4073-b500-8cdbe2b45e80 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:09.059403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-036da457-71ec-4073-b500-8cdbe2b45e80 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:09.129826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0037177c-6e77-4892-a880-b29aa4c3f4ce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:09.132034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0037177c-6e77-4892-a880-b29aa4c3f4ce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:09.142507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0037177c-6e77-4892-a880-b29aa4c3f4ce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:09.142986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0037177c-6e77-4892-a880-b29aa4c3f4ce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:09.147467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0037177c-6e77-4892-a880-b29aa4c3f4ce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:09.150090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0037177c-6e77-4892-a880-b29aa4c3f4ce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:09.393014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0037177c-6e77-4892-a880-b29aa4c3f4ce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:09.417442 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0037177c-6e77-4892-a880-b29aa4c3f4ce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1312 microversion: 2.1 time: 0.291761 Aug 03 01:48:09.422945 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 64/157] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:09 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1312 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:09.547905 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-036da457-71ec-4073-b500-8cdbe2b45e80 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1638 microversion: 2.1 time: 0.507923 Aug 03 01:48:09.559305 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 94/158] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:09 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1638 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:09.569792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9f6640e8-a008-4112-96d1-56e48613bb31 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:09.570302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9f6640e8-a008-4112-96d1-56e48613bb31 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:09.576386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f6640e8-a008-4112-96d1-56e48613bb31 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:09.577092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f6640e8-a008-4112-96d1-56e48613bb31 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:09.577920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f6640e8-a008-4112-96d1-56e48613bb31 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:09.578310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f6640e8-a008-4112-96d1-56e48613bb31 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:09.598417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-822a8757-8c3c-4e1d-a88f-94887fddc342 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:09.599114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-822a8757-8c3c-4e1d-a88f-94887fddc342 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:09.605484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9f6640e8-a008-4112-96d1-56e48613bb31 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:48:09.605971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-822a8757-8c3c-4e1d-a88f-94887fddc342 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:09.606601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-822a8757-8c3c-4e1d-a88f-94887fddc342 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:09.607764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-822a8757-8c3c-4e1d-a88f-94887fddc342 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:09.608369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-822a8757-8c3c-4e1d-a88f-94887fddc342 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:09.730847 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9f6640e8-a008-4112-96d1-56e48613bb31 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 204 len: 0 microversion: 2.1 time: 0.165676 Aug 03 01:48:09.734823 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 65/159] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:48:09 2022] DELETE /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:48:09.741235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7fbf6d6d-cfcc-48a9-8f17-f837f3cc3d48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:09.742211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7fbf6d6d-cfcc-48a9-8f17-f837f3cc3d48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:09.750064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7fbf6d6d-cfcc-48a9-8f17-f837f3cc3d48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:09.750680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7fbf6d6d-cfcc-48a9-8f17-f837f3cc3d48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:09.751497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7fbf6d6d-cfcc-48a9-8f17-f837f3cc3d48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:09.752675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7fbf6d6d-cfcc-48a9-8f17-f837f3cc3d48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:09.789261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-822a8757-8c3c-4e1d-a88f-94887fddc342 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:09.797768 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-822a8757-8c3c-4e1d-a88f-94887fddc342 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1497 microversion: 2.1 time: 0.203406 Aug 03 01:48:09.813713 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 95/160] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:09 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1497 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:09.915782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7fbf6d6d-cfcc-48a9-8f17-f837f3cc3d48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:09.924366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8123ae50-655b-4f5b-8a24-44eafa25e8ce tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:09.925927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8123ae50-655b-4f5b-8a24-44eafa25e8ce tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:09.926201 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7fbf6d6d-cfcc-48a9-8f17-f837f3cc3d48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1493 microversion: 2.1 time: 0.189584 Aug 03 01:48:09.927807 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 66/161] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:09 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1493 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:09.952733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8123ae50-655b-4f5b-8a24-44eafa25e8ce tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:09.953682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8123ae50-655b-4f5b-8a24-44eafa25e8ce tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:09.954884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8123ae50-655b-4f5b-8a24-44eafa25e8ce tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:09.955456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8123ae50-655b-4f5b-8a24-44eafa25e8ce tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:10.195730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8123ae50-655b-4f5b-8a24-44eafa25e8ce tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:10.203611 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8123ae50-655b-4f5b-8a24-44eafa25e8ce tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1276 microversion: 2.1 time: 0.283800 Aug 03 01:48:10.204179 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 96/162] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:09 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1276 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:10.286326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-655794642", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:10.343390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:48:10.437690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-048e05f8-f1fb-4514-89ce-af1d564cab61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:10.438749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-048e05f8-f1fb-4514-89ce-af1d564cab61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:10.446133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-048e05f8-f1fb-4514-89ce-af1d564cab61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:10.446925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-048e05f8-f1fb-4514-89ce-af1d564cab61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:10.447783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-048e05f8-f1fb-4514-89ce-af1d564cab61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:10.448322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-048e05f8-f1fb-4514-89ce-af1d564cab61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:10.574637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:48:10.575102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:48:10.575740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:48:10.576157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:48:10.576591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:48:10.586241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:10.586781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:10.587563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:10.588006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:10.595252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=15 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:10.607864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Getting quotas for project 36f606d386d74db39a1088bb1d3dec27. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:48:10.612303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Getting quotas for user 301ad92d37f142b9b3a2f77bbe5a6655 and project 36f606d386d74db39a1088bb1d3dec27. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:48:10.624933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:48:10.627371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-048e05f8-f1fb-4514-89ce-af1d564cab61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:10.627841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:48:10.636043 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-048e05f8-f1fb-4514-89ce-af1d564cab61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1312 microversion: 2.1 time: 0.202159 Aug 03 01:48:10.638946 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 97/163] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:10 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1312 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:10.675519 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5d087f07-4fc5-4815-a137-23e8dfe611af tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512302 Aug 03 01:48:10.676402 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 67/164] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:48:10.687480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fb8578df-8507-4e12-8362-d51c9bce4c12 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:10.688092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fb8578df-8507-4e12-8362-d51c9bce4c12 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:10.776434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fb8578df-8507-4e12-8362-d51c9bce4c12 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:10.792177 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fb8578df-8507-4e12-8362-d51c9bce4c12 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 200 len: 1221 microversion: 2.1 time: 0.108357 Aug 03 01:48:10.792940 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 98/165] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:10 2022] GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 1221 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:10.822500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e3c30fed-0f21-4679-982f-16389562f6d5 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:10.824115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e3c30fed-0f21-4679-982f-16389562f6d5 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:10.832838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3c30fed-0f21-4679-982f-16389562f6d5 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:10.833495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3c30fed-0f21-4679-982f-16389562f6d5 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:10.834436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3c30fed-0f21-4679-982f-16389562f6d5 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:10.835447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3c30fed-0f21-4679-982f-16389562f6d5 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:10.860953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:10.952300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5160453e-221b-4985-a6a7-fed567d2c692 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:10.953314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5160453e-221b-4985-a6a7-fed567d2c692 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:10.961125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5160453e-221b-4985-a6a7-fed567d2c692 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:10.961710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5160453e-221b-4985-a6a7-fed567d2c692 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:10.962739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5160453e-221b-4985-a6a7-fed567d2c692 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:10.963538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5160453e-221b-4985-a6a7-fed567d2c692 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:11.025199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3c30fed-0f21-4679-982f-16389562f6d5 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:11.035400 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e3c30fed-0f21-4679-982f-16389562f6d5 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1497 microversion: 2.1 time: 0.217531 Aug 03 01:48:11.040228 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 68/166] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:10 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1497 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:11.167079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5160453e-221b-4985-a6a7-fed567d2c692 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:11.181058 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5160453e-221b-4985-a6a7-fed567d2c692 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1493 microversion: 2.1 time: 0.232637 Aug 03 01:48:11.196949 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 99/167] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:10 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1493 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:11.229778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-67644b9e-11f2-47a0-9875-b4d69a6fcf74 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:11.230809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-67644b9e-11f2-47a0-9875-b4d69a6fcf74 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:11.242419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67644b9e-11f2-47a0-9875-b4d69a6fcf74 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:11.242934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67644b9e-11f2-47a0-9875-b4d69a6fcf74 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:11.243761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67644b9e-11f2-47a0-9875-b4d69a6fcf74 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:11.244427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67644b9e-11f2-47a0-9875-b4d69a6fcf74 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:11.409640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-67644b9e-11f2-47a0-9875-b4d69a6fcf74 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:11.419585 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-67644b9e-11f2-47a0-9875-b4d69a6fcf74 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1316 microversion: 2.1 time: 0.197861 Aug 03 01:48:11.426964 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 69/168] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:11 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:11.657317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2a7ab0b0-445c-4a90-88be-2558a658c4a9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:11.658716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2a7ab0b0-445c-4a90-88be-2558a658c4a9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:11.667494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a7ab0b0-445c-4a90-88be-2558a658c4a9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:11.668245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a7ab0b0-445c-4a90-88be-2558a658c4a9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:11.669306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a7ab0b0-445c-4a90-88be-2558a658c4a9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:11.670105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a7ab0b0-445c-4a90-88be-2558a658c4a9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:11.818703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-863ea1c7-e1d8-48a7-95ac-b55d8e3c91f4 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:11.820995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-863ea1c7-e1d8-48a7-95ac-b55d8e3c91f4 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:11.828729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-863ea1c7-e1d8-48a7-95ac-b55d8e3c91f4 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:11.830046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-863ea1c7-e1d8-48a7-95ac-b55d8e3c91f4 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:11.831284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-863ea1c7-e1d8-48a7-95ac-b55d8e3c91f4 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:11.831977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-863ea1c7-e1d8-48a7-95ac-b55d8e3c91f4 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:11.916283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2a7ab0b0-445c-4a90-88be-2558a658c4a9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:11.928230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-863ea1c7-e1d8-48a7-95ac-b55d8e3c91f4 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:11.929012 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2a7ab0b0-445c-4a90-88be-2558a658c4a9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1312 microversion: 2.1 time: 0.273280 Aug 03 01:48:11.930447 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 100/169] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:11 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1312 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:11.943507 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-863ea1c7-e1d8-48a7-95ac-b55d8e3c91f4 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 200 len: 1294 microversion: 2.1 time: 0.126228 Aug 03 01:48:11.943507 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 70/170] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:11 2022] GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 1294 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:11.959181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-10207d6d-38e6-4550-bdd8-1b0414fae566 req-001e103f-b17d-4083-beba-e6195039c03d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6", "tag": "d59c4745-6408-4d6f-a309-951c6fc953d9"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:11.969696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-10207d6d-38e6-4550-bdd8-1b0414fae566 req-001e103f-b17d-4083-beba-e6195039c03d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:11.970151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-10207d6d-38e6-4550-bdd8-1b0414fae566 req-001e103f-b17d-4083-beba-e6195039c03d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:11.991249 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-10207d6d-38e6-4550-bdd8-1b0414fae566 req-001e103f-b17d-4083-beba-e6195039c03d service nova] Creating event network-changed:d59c4745-6408-4d6f-a309-951c6fc953d9 for instance fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 on n-h2-826529-8 Aug 03 01:48:11.996554 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-10207d6d-38e6-4550-bdd8-1b0414fae566 req-001e103f-b17d-4083-beba-e6195039c03d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055642 Aug 03 01:48:11.997752 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 71/171] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:12.060962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-030bd871-d6c8-49b6-a69c-c59f4ec14a03 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:12.061827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-030bd871-d6c8-49b6-a69c-c59f4ec14a03 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:12.071153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-030bd871-d6c8-49b6-a69c-c59f4ec14a03 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:12.072248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-030bd871-d6c8-49b6-a69c-c59f4ec14a03 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:12.073895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-030bd871-d6c8-49b6-a69c-c59f4ec14a03 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:12.074932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-030bd871-d6c8-49b6-a69c-c59f4ec14a03 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:12.207357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03015919-5084-4d0c-a3d1-e5a91293217c tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:12.209020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-03015919-5084-4d0c-a3d1-e5a91293217c tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:12.216502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03015919-5084-4d0c-a3d1-e5a91293217c tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:12.217246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03015919-5084-4d0c-a3d1-e5a91293217c tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:12.218268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03015919-5084-4d0c-a3d1-e5a91293217c tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:12.219675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03015919-5084-4d0c-a3d1-e5a91293217c tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:12.465094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03015919-5084-4d0c-a3d1-e5a91293217c tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ba2c713701049f7bc1ef8438279a418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926cb51a68dc46d9a90c6899095a1d84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:12.475843 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03015919-5084-4d0c-a3d1-e5a91293217c tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 200 len: 1451 microversion: 2.1 time: 0.274095 Aug 03 01:48:12.487284 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 72/172] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:12 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 1451 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:12.492021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d00c0051-1136-482d-9298-3e367ce4ff77 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:12.492021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d00c0051-1136-482d-9298-3e367ce4ff77 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:12.505751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d00c0051-1136-482d-9298-3e367ce4ff77 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:12.506282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d00c0051-1136-482d-9298-3e367ce4ff77 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:12.507507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d00c0051-1136-482d-9298-3e367ce4ff77 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:12.508248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d00c0051-1136-482d-9298-3e367ce4ff77 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:12.583572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-030bd871-d6c8-49b6-a69c-c59f4ec14a03 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:12.592771 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-030bd871-d6c8-49b6-a69c-c59f4ec14a03 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 200 len: 1497 microversion: 2.1 time: 0.536020 Aug 03 01:48:12.601407 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 101/173] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:12 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 1497 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:12.615521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-f1f854f4-c87b-4cd7-994f-902d945c1b44 req-2c62990d-cb98-4698-9d88-55d4be1084c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b18352-3867-4a22-be5a-8355da571cb3", "name": "network-vif-deleted", "tag": "f094f215-5719-47bc-8c83-6c2a23da374a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:12.628393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f1f854f4-c87b-4cd7-994f-902d945c1b44 req-2c62990d-cb98-4698-9d88-55d4be1084c1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:12.630007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f1f854f4-c87b-4cd7-994f-902d945c1b44 req-2c62990d-cb98-4698-9d88-55d4be1084c1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:12.649773 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-f1f854f4-c87b-4cd7-994f-902d945c1b44 req-2c62990d-cb98-4698-9d88-55d4be1084c1 service nova] Creating event network-vif-deleted:f094f215-5719-47bc-8c83-6c2a23da374a for instance a7b18352-3867-4a22-be5a-8355da571cb3 on n-h1-826529-8 Aug 03 01:48:12.656765 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-f1f854f4-c87b-4cd7-994f-902d945c1b44 req-2c62990d-cb98-4698-9d88-55d4be1084c1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053159 Aug 03 01:48:12.666502 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 102/174] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:12.706075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d00c0051-1136-482d-9298-3e367ce4ff77 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:12.716899 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d00c0051-1136-482d-9298-3e367ce4ff77 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1316 microversion: 2.1 time: 0.239333 Aug 03 01:48:12.750959 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 73/175] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:12 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:12.952007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8f5ecac1-9cf5-4167-ae80-ecf2cb7482e5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:12.952704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8f5ecac1-9cf5-4167-ae80-ecf2cb7482e5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:12.960977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f5ecac1-9cf5-4167-ae80-ecf2cb7482e5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:12.961360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f5ecac1-9cf5-4167-ae80-ecf2cb7482e5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:12.961490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6b9e78cf-d990-4a8c-b5db-640a685235d5 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:12.962133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6b9e78cf-d990-4a8c-b5db-640a685235d5 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:12.962234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f5ecac1-9cf5-4167-ae80-ecf2cb7482e5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:12.962567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f5ecac1-9cf5-4167-ae80-ecf2cb7482e5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:12.968456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b9e78cf-d990-4a8c-b5db-640a685235d5 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:12.968903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b9e78cf-d990-4a8c-b5db-640a685235d5 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:12.969868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b9e78cf-d990-4a8c-b5db-640a685235d5 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:12.970312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b9e78cf-d990-4a8c-b5db-640a685235d5 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:13.064730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6b9e78cf-d990-4a8c-b5db-640a685235d5 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:13.085903 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6b9e78cf-d990-4a8c-b5db-640a685235d5 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 200 len: 1300 microversion: 2.1 time: 0.129138 Aug 03 01:48:13.101014 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 74/176] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:12 2022] GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 1300 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:13.186249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8f5ecac1-9cf5-4167-ae80-ecf2cb7482e5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:13.194522 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8f5ecac1-9cf5-4167-ae80-ecf2cb7482e5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1312 microversion: 2.1 time: 0.246665 Aug 03 01:48:13.195118 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 103/177] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:12 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1312 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:13.217352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-ec434b19-f0cd-49d0-8f35-8c8deec1aa14 req-1862f7ba-8299-4424-9d3a-a4d097fed65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dacc86a-058f-479b-b490-1866c660048b", "name": "network-vif-plugged", "status": "completed", "tag": "088945bb-f722-4c0a-8dfe-6f40991b1450"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:13.227647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ec434b19-f0cd-49d0-8f35-8c8deec1aa14 req-1862f7ba-8299-4424-9d3a-a4d097fed65b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:13.228186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ec434b19-f0cd-49d0-8f35-8c8deec1aa14 req-1862f7ba-8299-4424-9d3a-a4d097fed65b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:13.241347 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-ec434b19-f0cd-49d0-8f35-8c8deec1aa14 req-1862f7ba-8299-4424-9d3a-a4d097fed65b service nova] Creating event network-vif-plugged:088945bb-f722-4c0a-8dfe-6f40991b1450 for instance 7dacc86a-058f-479b-b490-1866c660048b on n-h2-826529-8 Aug 03 01:48:13.246668 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-ec434b19-f0cd-49d0-8f35-8c8deec1aa14 req-1862f7ba-8299-4424-9d3a-a4d097fed65b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032949 Aug 03 01:48:13.247397 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 75/178] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:13.500059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-df8a9270-6833-40b8-806c-401c7e0e87d1 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:13.500925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-df8a9270-6833-40b8-806c-401c7e0e87d1 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:13.510348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df8a9270-6833-40b8-806c-401c7e0e87d1 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:13.510853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df8a9270-6833-40b8-806c-401c7e0e87d1 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:13.511753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df8a9270-6833-40b8-806c-401c7e0e87d1 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:13.512188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df8a9270-6833-40b8-806c-401c7e0e87d1 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:13.528692 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-df8a9270-6833-40b8-806c-401c7e0e87d1 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] HTTP exception thrown: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-df8a9270-6833-40b8-806c-401c7e0e87d1 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Request method failure captured: Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 HTTP/1.1 Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dO7HwE8ZlVDeKp9CMSC6UG71fOqzcG5_rZlCJ7NnnieIIYnK_JGALfpDqNw7UIv_9CJ45lzH8sZMU5LAP7tNDMan3GVPVNXEdgttjDeqx8nafVysmDwf5E13J3ip7livMROqkOC3eqqaPqxhw-MzopOjEjuhsQgqwfJPHg4mqjG8Vc Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 926cb51a68dc46d9a90c6899095a1d84 Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AggregatesAdminTestJSON-796795747 Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:48:13.549411 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:48:13.550975 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_926cb51a68dc46d9a90c6899095a1d84", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/926cb51a68dc46d9a90c6899095a1d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/926cb51a68dc46d9a90c6899095a1d84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/926cb51a68dc46d9a90c6899095a1d84"}]}] Aug 03 01:48:13.550975 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AggregatesAdminTestJSON-796795747 Aug 03 01:48:13.550975 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 926cb51a68dc46d9a90c6899095a1d84 Aug 03 01:48:13.550975 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-796795747 Aug 03 01:48:13.550975 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AggregatesAdminTestJSON-796795747-project Aug 03 01:48:13.550975 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:13.550975 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:13.550975 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 9ba2c713701049f7bc1ef8438279a418 Aug 03 01:48:13.550975 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AggregatesAdminTestJSON-796795747-project Aug 03 01:48:13.550975 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:13.550975 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. Aug 03 01:48:13.550975 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'a7b18352-3867-4a22-be5a-8355da571cb3'} Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:13.551789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. Aug 03 01:48:13.553105 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:13.554288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-df8a9270-6833-40b8-806c-401c7e0e87d1 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Returning 404 to user: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:13.554288 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-df8a9270-6833-40b8-806c-401c7e0e87d1 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 404 len: 111 microversion: 2.1 time: 0.055955 Aug 03 01:48:13.561547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b510055-92a5-4a70-a447-3d6834eba426 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826529-8"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:13.564191 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:13.564191 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:13.564509 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 104/179] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:13 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:13.581484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b510055-92a5-4a70-a447-3d6834eba426 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:13.582239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b510055-92a5-4a70-a447-3d6834eba426 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:13.621887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f4745ed4-c8c6-46da-b80d-ad10b885e354 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:13.622496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f4745ed4-c8c6-46da-b80d-ad10b885e354 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:13.629164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4745ed4-c8c6-46da-b80d-ad10b885e354 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:13.630210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4745ed4-c8c6-46da-b80d-ad10b885e354 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:13.631236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4745ed4-c8c6-46da-b80d-ad10b885e354 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:13.632051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4745ed4-c8c6-46da-b80d-ad10b885e354 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:13.657672 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-f4745ed4-c8c6-46da-b80d-ad10b885e354 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] HTTP exception thrown: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f4745ed4-c8c6-46da-b80d-ad10b885e354 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Request method failure captured: Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 HTTP/1.1 Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dO6vBuZlfQRfpl2ZW3VOz41_IghacpEQrkWX3xfTtpzLfLTOWFK6LZL2e7YrvJTPnTTii9MYLse8sy5diZuxq5L0x8pV6SjnNq1R9F3otLoFidhHTt_Fa7TCOtHFn7h1qs_A9SnBjfCYFy8WJH6D3OK6BkKqEzP16YNL3C6S99gXhw Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 62d622c1784b435c8d44d8f2067c5ddf Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:48:13.663866 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:48:13.665058 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_62d622c1784b435c8d44d8f2067c5ddf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62d622c1784b435c8d44d8f2067c5ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/62d622c1784b435c8d44d8f2067c5ddf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62d622c1784b435c8d44d8f2067c5ddf"}]}] Aug 03 01:48:13.665058 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:13.665058 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 62d622c1784b435c8d44d8f2067c5ddf Aug 03 01:48:13.665058 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:13.665058 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-DeleteServersAdminTestJSON-1698606032-project Aug 03 01:48:13.665058 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:13.665058 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:13.665058 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: dccc81c8286d41b69d04688322aafed3 Aug 03 01:48:13.665058 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-DeleteServersAdminTestJSON-1698606032-project Aug 03 01:48:13.665058 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:13.665058 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. Aug 03 01:48:13.665058 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '8f22df40-9a6d-46da-930d-d6ac26a21ca8'} Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:13.665750 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. Aug 03 01:48:13.667329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:13.668304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f4745ed4-c8c6-46da-b80d-ad10b885e354 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Returning 404 to user: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:13.668304 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f4745ed4-c8c6-46da-b80d-ad10b885e354 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 404 len: 111 microversion: 2.1 time: 0.047317 Aug 03 01:48:13.677034 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 105/180] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:13 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 01:48:13.739376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5d7cd004-1991-4e46-a2e0-d580760ced0f tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:13.740623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5d7cd004-1991-4e46-a2e0-d580760ced0f tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:13.747620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d7cd004-1991-4e46-a2e0-d580760ced0f tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:13.748309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d7cd004-1991-4e46-a2e0-d580760ced0f tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:13.750534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d7cd004-1991-4e46-a2e0-d580760ced0f tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:13.751012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d7cd004-1991-4e46-a2e0-d580760ced0f tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:13.808049 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8b510055-92a5-4a70-a447-3d6834eba426 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 296 microversion: 2.1 time: 0.250278 Aug 03 01:48:13.808884 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 76/181] 10.222.0.67 () {60 vars in 1191 bytes} [Wed Aug 3 01:48:13 2022] POST /compute/v2.1/os-aggregates/3/action => generated 296 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:13.820665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-863284685", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:13.884792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:48:13.925801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5d7cd004-1991-4e46-a2e0-d580760ced0f tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:13.934377 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5d7cd004-1991-4e46-a2e0-d580760ced0f tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1316 microversion: 2.1 time: 0.200026 Aug 03 01:48:13.934975 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 106/182] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:13 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:13.939686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-65ce821c-6371-47cd-85f4-2e488f63966a tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:13.940537 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:13.940537 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:13.974933 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-65ce821c-6371-47cd-85f4-2e488f63966a tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.038601 Aug 03 01:48:13.982384 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 107/183] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:48:13 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:48:13.988769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-36031bab-b078-48c1-b71d-907710547e30 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-721017567"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:13.991702 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:13.991702 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:13.992601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.aggregate [None req-36031bab-b078-48c1-b71d-907710547e30 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Generated uuid 7fc9fed0-f760-4fd2-8c36-3e75ba5520cc for aggregate {{(pid=125942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:48:14.035293 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-36031bab-b078-48c1-b71d-907710547e30 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.050189 Aug 03 01:48:14.037017 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 108/184] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:48:13 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:14.044020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-951b6114-31a4-481b-81ac-d8320128fe59 req-d3b67277-53c1-4af6-8ca8-a106b1aac765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f22df40-9a6d-46da-930d-d6ac26a21ca8", "name": "network-vif-deleted", "tag": "acad373f-e2d6-49de-963a-0b96fc1f1bce"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:14.059646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-951b6114-31a4-481b-81ac-d8320128fe59 req-d3b67277-53c1-4af6-8ca8-a106b1aac765 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:14.063087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-951b6114-31a4-481b-81ac-d8320128fe59 req-d3b67277-53c1-4af6-8ca8-a106b1aac765 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:14.075944 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-951b6114-31a4-481b-81ac-d8320128fe59 req-d3b67277-53c1-4af6-8ca8-a106b1aac765 service nova] Creating event network-vif-deleted:acad373f-e2d6-49de-963a-0b96fc1f1bce for instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 on n-h1-826529-8 Aug 03 01:48:14.081331 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-951b6114-31a4-481b-81ac-d8320128fe59 req-d3b67277-53c1-4af6-8ca8-a106b1aac765 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042873 Aug 03 01:48:14.082039 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 109/185] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:14.088657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d233ddc7-3e25-4a2c-9fa2-e381495ec36f tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826529-8"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:14.091278 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:14.091278 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:14.100363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d233ddc7-3e25-4a2c-9fa2-e381495ec36f tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:14.100820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d233ddc7-3e25-4a2c-9fa2-e381495ec36f tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:14.121389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:48:14.121948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:48:14.122942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:48:14.123673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:48:14.124220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:48:14.135540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:14.136352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:14.137460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:14.138250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:14.207329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Getting quotas for project 62d622c1784b435c8d44d8f2067c5ddf. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:48:14.229261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Getting quotas for user dccc81c8286d41b69d04688322aafed3 and project 62d622c1784b435c8d44d8f2067c5ddf. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:48:14.243757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:48:14.246666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:48:14.294954 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d233ddc7-3e25-4a2c-9fa2-e381495ec36f tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 241 microversion: 2.1 time: 0.211044 Aug 03 01:48:14.295790 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 110/186] 10.222.0.67 () {60 vars in 1191 bytes} [Wed Aug 3 01:48:14 2022] POST /compute/v2.1/os-aggregates/8/action => generated 241 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:14.301366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ec8db952-0ba2-424f-b0ad-8aa7da064664 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:14.303474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ec8db952-0ba2-424f-b0ad-8aa7da064664 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:14.310339 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-475e206f-b605-4e02-8eee-22c257f96568 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493829 Aug 03 01:48:14.311734 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 77/187] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:48:14.322229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-98a4bb82-7372-4aef-9bb1-9d36b90c8ba7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:14.323026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-98a4bb82-7372-4aef-9bb1-9d36b90c8ba7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:14.326986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:14.327157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ec8db952-0ba2-424f-b0ad-8aa7da064664 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:14.330890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ec8db952-0ba2-424f-b0ad-8aa7da064664 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:14.332074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ec8db952-0ba2-424f-b0ad-8aa7da064664 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:14.332688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ec8db952-0ba2-424f-b0ad-8aa7da064664 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:14.334262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98a4bb82-7372-4aef-9bb1-9d36b90c8ba7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:14.334796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98a4bb82-7372-4aef-9bb1-9d36b90c8ba7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:14.335724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98a4bb82-7372-4aef-9bb1-9d36b90c8ba7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:14.336420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98a4bb82-7372-4aef-9bb1-9d36b90c8ba7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:14.582422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-98a4bb82-7372-4aef-9bb1-9d36b90c8ba7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:14.590794 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-98a4bb82-7372-4aef-9bb1-9d36b90c8ba7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1312 microversion: 2.1 time: 0.277730 Aug 03 01:48:14.592103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ec8db952-0ba2-424f-b0ad-8aa7da064664 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:14.603746 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ec8db952-0ba2-424f-b0ad-8aa7da064664 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 200 len: 1321 microversion: 2.1 time: 0.306302 Aug 03 01:48:14.604265 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 78/188] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:14 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1312 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:14.604604 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 111/189] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:14 2022] GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:14.609354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-78699a3c-b8aa-4199-b366-a9dda787c81c tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:14.610155 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:14.610155 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:14.612693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b3fe6f3f-7143-4a35-918d-c994b672be53 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:14.614195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b3fe6f3f-7143-4a35-918d-c994b672be53 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:14.622261 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-78699a3c-b8aa-4199-b366-a9dda787c81c tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.016471 Aug 03 01:48:14.623180 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 79/190] 10.222.0.67 () {58 vars in 1149 bytes} [Wed Aug 3 01:48:14 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:14.635258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cf7d16d8-4ea3-486f-9b90-41211d962241 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826529-8"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:14.637964 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:14.637964 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:14.653253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf7d16d8-4ea3-486f-9b90-41211d962241 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:14.653808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf7d16d8-4ea3-486f-9b90-41211d962241 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:14.674157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b3fe6f3f-7143-4a35-918d-c994b672be53 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:14.682363 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b3fe6f3f-7143-4a35-918d-c994b672be53 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 200 len: 1219 microversion: 2.1 time: 0.076393 Aug 03 01:48:14.682826 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 112/191] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:14 2022] GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:14.812175 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cf7d16d8-4ea3-486f-9b90-41211d962241 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 226 microversion: 2.1 time: 0.180515 Aug 03 01:48:14.817591 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 80/192] 10.222.0.67 () {60 vars in 1191 bytes} [Wed Aug 3 01:48:14 2022] POST /compute/v2.1/os-aggregates/8/action => generated 226 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:14.824527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-48ce34eb-4121-4d16-90d9-c868644f12f6 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:14.825295 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:14.825295 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:14.854377 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-48ce34eb-4121-4d16-90d9-c868644f12f6 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.033365 Aug 03 01:48:14.855092 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 113/193] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:48:14 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:48:14.866470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dd996817-7eed-447d-a396-9a5a5a815288 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1781460220"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:14.871173 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:14.871173 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:14.872365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.aggregate [None req-dd996817-7eed-447d-a396-9a5a5a815288 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Generated uuid 1cc42a9d-0f5b-4906-b412-c07925877b23 for aggregate {{(pid=125941) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:48:14.901393 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dd996817-7eed-447d-a396-9a5a5a815288 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.039933 Aug 03 01:48:14.910951 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 81/194] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:48:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:48:14.919428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d82c64fd-a891-405a-bf51-a9b52c399953 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826529-8"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:14.922046 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:14.922046 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:14.932073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d82c64fd-a891-405a-bf51-a9b52c399953 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:14.932514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d82c64fd-a891-405a-bf51-a9b52c399953 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:14.961227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-79afc31f-a3e0-41c0-a2c1-64a0f56bb1a9 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:14.962521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-79afc31f-a3e0-41c0-a2c1-64a0f56bb1a9 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:14.972714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-79afc31f-a3e0-41c0-a2c1-64a0f56bb1a9 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:14.973441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-79afc31f-a3e0-41c0-a2c1-64a0f56bb1a9 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:14.975297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-79afc31f-a3e0-41c0-a2c1-64a0f56bb1a9 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:14.979573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-79afc31f-a3e0-41c0-a2c1-64a0f56bb1a9 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.083410 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d82c64fd-a891-405a-bf51-a9b52c399953 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.167824 Aug 03 01:48:15.090009 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 114/195] 10.222.0.67 () {60 vars in 1191 bytes} [Wed Aug 3 01:48:14 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:15.094501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a5cf016e-6c25-41e2-85a2-5bbd145b497e tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:15.095298 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:15.095298 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:15.105836 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a5cf016e-6c25-41e2-85a2-5bbd145b497e tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.014719 Aug 03 01:48:15.106694 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 115/196] 10.222.0.67 () {58 vars in 1143 bytes} [Wed Aug 3 01:48:15 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:15.119552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8b7e0cad-bacf-4866-821b-dc33f0da650d tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826529-8"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:15.122151 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:15.122151 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:15.125884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-79afc31f-a3e0-41c0-a2c1-64a0f56bb1a9 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:15.133148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8b7e0cad-bacf-4866-821b-dc33f0da650d tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:15.133592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8b7e0cad-bacf-4866-821b-dc33f0da650d tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.134974 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-79afc31f-a3e0-41c0-a2c1-64a0f56bb1a9 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1316 microversion: 2.1 time: 0.181598 Aug 03 01:48:15.135669 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 82/197] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:14 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:15.241790 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8b7e0cad-bacf-4866-821b-dc33f0da650d tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.126402 Aug 03 01:48:15.242490 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 116/198] 10.222.0.67 () {60 vars in 1191 bytes} [Wed Aug 3 01:48:15 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:15.253616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ad8dbd62-8c65-47fc-9d87-06a44d03416f tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:15.254515 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:15.254515 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:15.276180 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ad8dbd62-8c65-47fc-9d87-06a44d03416f tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.026281 Aug 03 01:48:15.276768 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 83/199] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:48:15 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:48:15.289169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9c71fa12-3d74-4a75-8147-2d69ba216d54 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-851265714"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:15.291924 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:15.291924 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:15.292821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.aggregate [None req-9c71fa12-3d74-4a75-8147-2d69ba216d54 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Generated uuid d1807ac7-5a3b-4ea5-a24a-987b0fa6bfa1 for aggregate {{(pid=125942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:48:15.301190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:DELETE=5 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:15.314584 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9c71fa12-3d74-4a75-8147-2d69ba216d54 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.029981 Aug 03 01:48:15.315376 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 117/200] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:48:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:15.326433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b0599994-97f9-41f9-b961-a67c454f16f8 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826529-8"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:15.328981 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:15.328981 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:15.337859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0599994-97f9-41f9-b961-a67c454f16f8 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:15.338307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0599994-97f9-41f9-b961-a67c454f16f8 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.446798 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b0599994-97f9-41f9-b961-a67c454f16f8 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.124151 Aug 03 01:48:15.447423 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 84/201] 10.222.0.67 () {60 vars in 1194 bytes} [Wed Aug 3 01:48:15 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:15.459721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2d3b37d3-f0ec-4745-8b3d-804947a46511 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826529-8"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:15.462158 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:15.462158 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:15.469889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d3b37d3-f0ec-4745-8b3d-804947a46511 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:15.470364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d3b37d3-f0ec-4745-8b3d-804947a46511 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.484591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:15.582569 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2d3b37d3-f0ec-4745-8b3d-804947a46511 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.126738 Aug 03 01:48:15.589327 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 118/202] 10.222.0.67 () {60 vars in 1194 bytes} [Wed Aug 3 01:48:15 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:15.594321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b3b54126-94d3-41fa-adcc-a093871c9c15 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:15.595103 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:15.595103 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:15.612708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-363a0acd-a1ba-497a-bea1-d40f144a98be tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:15.613501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-363a0acd-a1ba-497a-bea1-d40f144a98be tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:15.621114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-363a0acd-a1ba-497a-bea1-d40f144a98be tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:15.621844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-363a0acd-a1ba-497a-bea1-d40f144a98be tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.622653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-363a0acd-a1ba-497a-bea1-d40f144a98be tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:15.623210 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b3b54126-94d3-41fa-adcc-a093871c9c15 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.031822 Aug 03 01:48:15.623326 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-363a0acd-a1ba-497a-bea1-d40f144a98be tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.623731 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 85/203] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 01:48:15 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:48:15.631948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-508ccf10-0655-44e8-91aa-8d3a4302fd65 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:15.632567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-508ccf10-0655-44e8-91aa-8d3a4302fd65 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:15.639205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-508ccf10-0655-44e8-91aa-8d3a4302fd65 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:15.639665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-508ccf10-0655-44e8-91aa-8d3a4302fd65 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.641027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-508ccf10-0655-44e8-91aa-8d3a4302fd65 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:15.641027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-508ccf10-0655-44e8-91aa-8d3a4302fd65 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.833247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-363a0acd-a1ba-497a-bea1-d40f144a98be tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:15.839813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-508ccf10-0655-44e8-91aa-8d3a4302fd65 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:15.841021 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-363a0acd-a1ba-497a-bea1-d40f144a98be tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1312 microversion: 2.1 time: 0.233006 Aug 03 01:48:15.841592 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 119/204] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:15 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1312 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:15.847506 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-508ccf10-0655-44e8-91aa-8d3a4302fd65 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 200 len: 1321 microversion: 2.1 time: 0.222769 Aug 03 01:48:15.850137 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 86/205] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:15 2022] GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:15.857042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8cffc728-244d-4621-9fe3-c8837870d24f tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-492988399"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:15.858067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-41e4f99b-487a-4a96-a741-5342eef5f0ef tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Calling method '.version_select at 0x7f5b13cb4f70>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:15.859982 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:15.859982 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:15.860580 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:15.860580 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:15.860959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.aggregate [None req-8cffc728-244d-4621-9fe3-c8837870d24f tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Generated uuid df5ed17e-b652-4f05-980c-d01c02eede74 for aggregate {{(pid=125942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:48:15.862149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41e4f99b-487a-4a96-a741-5342eef5f0ef tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:15.862609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41e4f99b-487a-4a96-a741-5342eef5f0ef tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.863478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41e4f99b-487a-4a96-a741-5342eef5f0ef tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:15.864034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41e4f99b-487a-4a96-a741-5342eef5f0ef tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.882533 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8cffc728-244d-4621-9fe3-c8837870d24f tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.030893 Aug 03 01:48:15.883189 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 120/206] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:48:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:15.896345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-da602a90-f217-406c-8718-f8969dca4c76 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:15.896493 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-41e4f99b-487a-4a96-a741-5342eef5f0ef tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.038437 Aug 03 01:48:15.896628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-da602a90-f217-406c-8718-f8969dca4c76 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:15.896709 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 87/207] 10.222.0.67 () {58 vars in 1128 bytes} [Wed Aug 3 01:48:15 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:15.896709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eaa538ea-6eee-44de-a864-f36aa2debb51 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:15.896709 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:15.896709 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:15.897107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da602a90-f217-406c-8718-f8969dca4c76 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:15.897563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da602a90-f217-406c-8718-f8969dca4c76 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.898346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da602a90-f217-406c-8718-f8969dca4c76 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:15.898780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da602a90-f217-406c-8718-f8969dca4c76 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.918968 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eaa538ea-6eee-44de-a864-f36aa2debb51 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.028441 Aug 03 01:48:15.919778 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 88/208] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 01:48:15 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 03 01:48:15.927265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ea7b83ea-b3d7-47a5-b943-6f95f22e9755 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Calling method '.version_select at 0x7f5b13d175e0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:15.931745 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:15.931745 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:15.931745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea7b83ea-b3d7-47a5-b943-6f95f22e9755 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:15.932325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea7b83ea-b3d7-47a5-b943-6f95f22e9755 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.933153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea7b83ea-b3d7-47a5-b943-6f95f22e9755 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:15.933594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea7b83ea-b3d7-47a5-b943-6f95f22e9755 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.960148 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ea7b83ea-b3d7-47a5-b943-6f95f22e9755 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.039480 Aug 03 01:48:15.960972 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 89/209] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 01:48:15 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:15.965932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6c1d6e95-a7e5-4c1b-8730-d217706fcd91 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:15.967686 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:15.967686 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-6c1d6e95-a7e5-4c1b-8730-d217706fcd91 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6c1d6e95-a7e5-4c1b-8730-d217706fcd91 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Request method failure captured: Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO9DVUhG6adMfhjZ9qYirRpmxPUFVTmAI4XTWNoAQtGQ7sDFYlF-dXSULvqyvJitFQfmOcv1YY-a7T7PtsZZgOkhBSi7tJyImaXJnzaC4OK012depItMIOzxcO3pR0h1tBa5Eb-aWstty2c12No_PQy_KYvmuB4ke9Bi5CVmlFPGsQ Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a91fb3707fb74d6984cb7d4fb1c0fa44 Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AggregatesAdminTestJSON-1406696841 Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:48:15.976429 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:48:15.978030 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a91fb3707fb74d6984cb7d4fb1c0fa44", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a91fb3707fb74d6984cb7d4fb1c0fa44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a91fb3707fb74d6984cb7d4fb1c0fa44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a91fb3707fb74d6984cb7d4fb1c0fa44"}]}] Aug 03 01:48:15.978030 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AggregatesAdminTestJSON-1406696841 Aug 03 01:48:15.978030 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a91fb3707fb74d6984cb7d4fb1c0fa44 Aug 03 01:48:15.978030 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1406696841 Aug 03 01:48:15.978030 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AggregatesAdminTestJSON-1406696841-project-admin Aug 03 01:48:15.978030 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:15.978030 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:15.978030 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5ef0fb3a978745d784b9beeafca4a8d9 Aug 03 01:48:15.978030 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AggregatesAdminTestJSON-1406696841-project-admin Aug 03 01:48:15.978030 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:15.978030 n-d-826529-8 devstack@n-api.service[125941]: exception: Aggregate 11 could not be found. Aug 03 01:48:15.978030 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '11'} Aug 03 01:48:15.978030 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:15.978888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Aug 03 01:48:15.980044 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:15.981295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6c1d6e95-a7e5-4c1b-8730-d217706fcd91 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:15.981295 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6c1d6e95-a7e5-4c1b-8730-d217706fcd91 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.016090 Aug 03 01:48:15.981295 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 90/210] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:48:15 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:48:15.984520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d79d44ee-f795-4a83-940a-de7e399d784d tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Calling method '.version_select at 0x7f5b13c5caf0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:15.986479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-da602a90-f217-406c-8718-f8969dca4c76 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:15.986847 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:15.986847 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:15.988035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d79d44ee-f795-4a83-940a-de7e399d784d tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:15.988485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d79d44ee-f795-4a83-940a-de7e399d784d tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.989500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d79d44ee-f795-4a83-940a-de7e399d784d tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:15.990224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d79d44ee-f795-4a83-940a-de7e399d784d tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:15.996590 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-da602a90-f217-406c-8718-f8969dca4c76 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 200 len: 1215 microversion: 2.1 time: 0.112393 Aug 03 01:48:15.997162 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 121/211] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:15 2022] GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:16.009111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1976f341-3e86-418e-a288-7fc29532e21b tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1534245718"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:16.011885 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.011885 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:16.013137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.aggregate [None req-1976f341-3e86-418e-a288-7fc29532e21b tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Generated uuid f2d7a2ec-3e7a-48a2-857c-f55838786655 for aggregate {{(pid=125942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:48:16.021904 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d79d44ee-f795-4a83-940a-de7e399d784d tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.042555 Aug 03 01:48:16.022544 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 91/212] 10.222.0.67 () {58 vars in 1128 bytes} [Wed Aug 3 01:48:15 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:16.028871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9b6450aa-075a-4591-adef-95fd42047911 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:16.029896 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.029896 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:16.040250 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1976f341-3e86-418e-a288-7fc29532e21b tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.041592 Aug 03 01:48:16.040969 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 122/213] 10.222.0.67 () {62 vars in 1205 bytes} [Wed Aug 3 01:48:15 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:48:16.041064 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-9b6450aa-075a-4591-adef-95fd42047911 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9b6450aa-075a-4591-adef-95fd42047911 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Request method failure captured: Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO9DVUhG6adMfhjZ9qYirRpmxPUFVTmAI4XTWNoAQtGQ7sDFYlF-dXSULvqyvJitFQfmOcv1YY-a7T7PtsZZgOkhBSi7tJyImaXJnzaC4OK012depItMIOzxcO3pR0h1tBa5Eb-aWstty2c12No_PQy_KYvmuB4ke9Bi5CVmlFPGsQ Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a91fb3707fb74d6984cb7d4fb1c0fa44 Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AggregatesAdminTestJSON-1406696841 Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:48:16.042884 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:48:16.044066 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a91fb3707fb74d6984cb7d4fb1c0fa44", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a91fb3707fb74d6984cb7d4fb1c0fa44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a91fb3707fb74d6984cb7d4fb1c0fa44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a91fb3707fb74d6984cb7d4fb1c0fa44"}]}] Aug 03 01:48:16.044066 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AggregatesAdminTestJSON-1406696841 Aug 03 01:48:16.044066 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a91fb3707fb74d6984cb7d4fb1c0fa44 Aug 03 01:48:16.044066 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1406696841 Aug 03 01:48:16.044066 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AggregatesAdminTestJSON-1406696841-project-admin Aug 03 01:48:16.044066 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:16.044066 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:16.044066 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5ef0fb3a978745d784b9beeafca4a8d9 Aug 03 01:48:16.044066 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AggregatesAdminTestJSON-1406696841-project-admin Aug 03 01:48:16.044066 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:16.044066 n-d-826529-8 devstack@n-api.service[125941]: exception: Aggregate 11 could not be found. Aug 03 01:48:16.044066 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '11'} Aug 03 01:48:16.044066 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:48:16.044781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:16.046297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:16.047768 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:16.047768 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:16.047768 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:16.047768 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Aug 03 01:48:16.047768 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:16.047768 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9b6450aa-075a-4591-adef-95fd42047911 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:16.047768 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9b6450aa-075a-4591-adef-95fd42047911 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.020602 Aug 03 01:48:16.047768 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 92/214] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 01:48:16 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:48:16.050003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9c16b748-6468-4353-acca-1d6741e31481 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Calling method '.version_select at 0x7f5b13e31430>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:16.050892 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.050892 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:16.053320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2a678555-ff38-431c-a2ac-b6a78d50546e tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1781169294"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:16.057589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c16b748-6468-4353-acca-1d6741e31481 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:16.058046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c16b748-6468-4353-acca-1d6741e31481 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:16.071685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c16b748-6468-4353-acca-1d6741e31481 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:16.072140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c16b748-6468-4353-acca-1d6741e31481 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:16.092000 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9c16b748-6468-4353-acca-1d6741e31481 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-h1-826529-8" status: 200 len: 598 microversion: 2.1 time: 0.049939 Aug 03 01:48:16.096883 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 123/215] 10.222.0.67 () {58 vars in 1170 bytes} [Wed Aug 3 01:48:16 2022] GET /compute/v2.1/os-hosts/n-h1-826529-8 => generated 598 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:16.097320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4ebc72d9-c9eb-4aa5-acd4-bda6e36fb33b tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-915062773", "name": "tempest-test_aggregate-383949919"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:16.116546 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.116546 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:16.117510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.aggregate [None req-4ebc72d9-c9eb-4aa5-acd4-bda6e36fb33b tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Generated uuid 37b9b16a-dbd1-4cfc-aac6-550e686fc6be for aggregate {{(pid=125942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:48:16.127616 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.127616 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:16.143974 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4ebc72d9-c9eb-4aa5-acd4-bda6e36fb33b tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.050066 Aug 03 01:48:16.144754 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 124/216] 10.222.0.67 () {60 vars in 1165 bytes} [Wed Aug 3 01:48:16 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:16.154975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-250a547e-dc7f-458c-8ce0-4368ffa755fb req-65de0896-1246-46c7-af06-397eed241536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77121f3e-c5a9-4057-808c-572c59ff77ea", "tag": "506dd21b-00d7-4476-9ca9-b19cbb34995c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:16.160462 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2a678555-ff38-431c-a2ac-b6a78d50546e tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 300 microversion: 2.41 time: 0.110854 Aug 03 01:48:16.161330 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 93/217] 10.222.0.67 () {62 vars in 1213 bytes} [Wed Aug 3 01:48:16 2022] PUT /compute/v2.1/os-aggregates/12 => generated 300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:48:16.165863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2c1f7854-fdac-4ea3-8ecc-0a7063fbb5a5 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Calling method '.version_select at 0x7f5b13b698b0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:16.166479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-250a547e-dc7f-458c-8ce0-4368ffa755fb req-65de0896-1246-46c7-af06-397eed241536 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:16.166670 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.166670 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:16.166955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-250a547e-dc7f-458c-8ce0-4368ffa755fb req-65de0896-1246-46c7-af06-397eed241536 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:16.173454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c1f7854-fdac-4ea3-8ecc-0a7063fbb5a5 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:16.173903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c1f7854-fdac-4ea3-8ecc-0a7063fbb5a5 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:16.179189 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-250a547e-dc7f-458c-8ce0-4368ffa755fb req-65de0896-1246-46c7-af06-397eed241536 service nova] Creating event network-changed:506dd21b-00d7-4476-9ca9-b19cbb34995c for instance 77121f3e-c5a9-4057-808c-572c59ff77ea on n-h1-826529-8 Aug 03 01:48:16.184442 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-250a547e-dc7f-458c-8ce0-4368ffa755fb req-65de0896-1246-46c7-af06-397eed241536 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036407 Aug 03 01:48:16.185205 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 125/218] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:16.187538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c1f7854-fdac-4ea3-8ecc-0a7063fbb5a5 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:16.187977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c1f7854-fdac-4ea3-8ecc-0a7063fbb5a5 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:16.189928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-656b10f2-4c5f-4149-a2d3-011091becb7b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:16.190636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-656b10f2-4c5f-4149-a2d3-011091becb7b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:16.197614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-656b10f2-4c5f-4149-a2d3-011091becb7b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:16.198070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-656b10f2-4c5f-4149-a2d3-011091becb7b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:16.198848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-656b10f2-4c5f-4149-a2d3-011091becb7b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:16.199323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-656b10f2-4c5f-4149-a2d3-011091becb7b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:16.219426 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2c1f7854-fdac-4ea3-8ecc-0a7063fbb5a5 tempest-HostsAdminTestJSON-1805716781 tempest-HostsAdminTestJSON-1805716781-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-h2-826529-8" status: 200 len: 598 microversion: 2.1 time: 0.056965 Aug 03 01:48:16.220016 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 94/219] 10.222.0.67 () {58 vars in 1170 bytes} [Wed Aug 3 01:48:16 2022] GET /compute/v2.1/os-hosts/n-h2-826529-8 => generated 598 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:16.225336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc8f8e86-3916-4daf-ad66-693aa854ea4b tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:16.225336 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.225336 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:16.248586 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fc8f8e86-3916-4daf-ad66-693aa854ea4b tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.027519 Aug 03 01:48:16.249619 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 95/220] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 01:48:16 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:48:16.257007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4f53e180-822f-4aed-91ca-2f6807390caa tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:16.257945 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.257945 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:16.267432 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4f53e180-822f-4aed-91ca-2f6807390caa tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/12" status: 200 len: 300 microversion: 2.41 time: 0.015468 Aug 03 01:48:16.268323 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 96/221] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 3 01:48:16 2022] GET /compute/v2.1/os-aggregates/12 => generated 300 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:48:16.274240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eaa5707f-5eaa-49a7-bba9-bc29558b4d3e tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:16.275327 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.275327 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:16.282152 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-eaa5707f-5eaa-49a7-bba9-bc29558b4d3e tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eaa5707f-5eaa-49a7-bba9-bc29558b4d3e tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Request method failure captured: Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO9DVUhG6adMfhjZ9qYirRpmxPUFVTmAI4XTWNoAQtGQ7sDFYlF-dXSULvqyvJitFQfmOcv1YY-a7T7PtsZZgOkhBSi7tJyImaXJnzaC4OK012depItMIOzxcO3pR0h1tBa5Eb-aWstty2c12No_PQy_KYvmuB4ke9Bi5CVmlFPGsQ Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a91fb3707fb74d6984cb7d4fb1c0fa44 Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AggregatesAdminTestJSON-1406696841 Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:48:16.284324 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:48:16.285736 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a91fb3707fb74d6984cb7d4fb1c0fa44", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a91fb3707fb74d6984cb7d4fb1c0fa44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a91fb3707fb74d6984cb7d4fb1c0fa44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a91fb3707fb74d6984cb7d4fb1c0fa44"}]}] Aug 03 01:48:16.285736 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AggregatesAdminTestJSON-1406696841 Aug 03 01:48:16.285736 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a91fb3707fb74d6984cb7d4fb1c0fa44 Aug 03 01:48:16.285736 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1406696841 Aug 03 01:48:16.285736 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AggregatesAdminTestJSON-1406696841-project-admin Aug 03 01:48:16.285736 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:16.285736 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:16.285736 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5ef0fb3a978745d784b9beeafca4a8d9 Aug 03 01:48:16.285736 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AggregatesAdminTestJSON-1406696841-project-admin Aug 03 01:48:16.285736 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:16.285736 n-d-826529-8 devstack@n-api.service[125941]: exception: Aggregate 13 could not be found. Aug 03 01:48:16.285736 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '13'} Aug 03 01:48:16.285736 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:16.286834 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Aug 03 01:48:16.288089 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:16.290205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eaa5707f-5eaa-49a7-bba9-bc29558b4d3e tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:16.291735 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eaa5707f-5eaa-49a7-bba9-bc29558b4d3e tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.022055 Aug 03 01:48:16.292307 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 97/222] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:48:16 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:48:16.297431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-63b4bb34-b10f-4785-83e7-ca9445fdfd78 tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826529-8"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:16.300848 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.300848 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:16.311012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63b4bb34-b10f-4785-83e7-ca9445fdfd78 tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:16.311689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63b4bb34-b10f-4785-83e7-ca9445fdfd78 tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:16.422884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-656b10f2-4c5f-4149-a2d3-011091becb7b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:16.432817 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-656b10f2-4c5f-4149-a2d3-011091becb7b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1316 microversion: 2.1 time: 0.246467 Aug 03 01:48:16.433406 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 126/223] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:16 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:16.438786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-39d52983-683f-46f7-b2ad-0352a779663b tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:16.439953 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.439953 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:16.452774 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-39d52983-683f-46f7-b2ad-0352a779663b tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-39d52983-683f-46f7-b2ad-0352a779663b tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Request method failure captured: Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dO9DVUhG6adMfhjZ9qYirRpmxPUFVTmAI4XTWNoAQtGQ7sDFYlF-dXSULvqyvJitFQfmOcv1YY-a7T7PtsZZgOkhBSi7tJyImaXJnzaC4OK012depItMIOzxcO3pR0h1tBa5Eb-aWstty2c12No_PQy_KYvmuB4ke9Bi5CVmlFPGsQ Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: a91fb3707fb74d6984cb7d4fb1c0fa44 Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AggregatesAdminTestJSON-1406696841 Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:48:16.456326 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:48:16.457506 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a91fb3707fb74d6984cb7d4fb1c0fa44", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a91fb3707fb74d6984cb7d4fb1c0fa44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a91fb3707fb74d6984cb7d4fb1c0fa44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a91fb3707fb74d6984cb7d4fb1c0fa44"}]}] Aug 03 01:48:16.457506 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AggregatesAdminTestJSON-1406696841 Aug 03 01:48:16.457506 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: a91fb3707fb74d6984cb7d4fb1c0fa44 Aug 03 01:48:16.457506 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1406696841 Aug 03 01:48:16.457506 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AggregatesAdminTestJSON-1406696841-project-admin Aug 03 01:48:16.457506 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:16.457506 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:16.457506 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 5ef0fb3a978745d784b9beeafca4a8d9 Aug 03 01:48:16.457506 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AggregatesAdminTestJSON-1406696841-project-admin Aug 03 01:48:16.457506 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:16.457506 n-d-826529-8 devstack@n-api.service[125942]: exception: Aggregate 13 could not be found. Aug 03 01:48:16.457506 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '13'} Aug 03 01:48:16.457506 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:48:16.458677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:16.459861 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:16.461040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:16.461040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:16.461040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:16.461040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Aug 03 01:48:16.461040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:16.461040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-39d52983-683f-46f7-b2ad-0352a779663b tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:16.461040 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-39d52983-683f-46f7-b2ad-0352a779663b tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.026129 Aug 03 01:48:16.467613 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 127/224] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 01:48:16 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:48:16.480678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b66ffff2-cbbe-49dd-9bd1-af60f0665791 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-692138279"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:16.483520 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-63b4bb34-b10f-4785-83e7-ca9445fdfd78 tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 315 microversion: 2.41 time: 0.189887 Aug 03 01:48:16.484273 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 98/225] 10.222.0.67 () {62 vars in 1235 bytes} [Wed Aug 3 01:48:16 2022] POST /compute/v2.1/os-aggregates/12/action => generated 315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:48:16.485701 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.485701 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:16.487011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.aggregate [None req-b66ffff2-cbbe-49dd-9bd1-af60f0665791 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Generated uuid d3cdbcee-61d1-466d-97a3-29fdee2741e3 for aggregate {{(pid=125942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:48:16.497647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3c983108-c40e-4b60-8718-370b6bfa70bb tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826529-8"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:16.504255 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.504255 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:16.515119 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b66ffff2-cbbe-49dd-9bd1-af60f0665791 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046283 Aug 03 01:48:16.516406 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 128/226] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:48:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:16.532089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0712c3ee-19ee-4bb6-b788-452edd803f5e tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:16.533145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3c983108-c40e-4b60-8718-370b6bfa70bb tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:16.533336 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.533336 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:16.533593 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3c983108-c40e-4b60-8718-370b6bfa70bb tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:16.544697 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0712c3ee-19ee-4bb6-b788-452edd803f5e tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 227 microversion: 2.1 time: 0.019491 Aug 03 01:48:16.545360 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 129/227] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:48:16 2022] GET /compute/v2.1/os-aggregates/14 => generated 227 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:16.561845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2600fa06-879c-44a4-9ddc-bcfc43a611d8 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:16.579032 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.579032 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:16.633019 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2600fa06-879c-44a4-9ddc-bcfc43a611d8 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 265 microversion: 2.1 time: 0.077265 Aug 03 01:48:16.636108 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 130/228] 10.222.0.67 () {60 vars in 1194 bytes} [Wed Aug 3 01:48:16 2022] POST /compute/v2.1/os-aggregates/14/action => generated 265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:16.661088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0f9d3d72-2c95-4924-897e-fdcfd7c8714d tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:16.663768 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.663768 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:16.681102 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0f9d3d72-2c95-4924-897e-fdcfd7c8714d tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 241 microversion: 2.1 time: 0.040210 Aug 03 01:48:16.689536 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 131/229] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:48:16 2022] GET /compute/v2.1/os-aggregates/14 => generated 241 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:16.696306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a45738f3-102f-4ef2-809d-dd3b80818b42 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:16.697061 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.697061 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:16.734046 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3c983108-c40e-4b60-8718-370b6bfa70bb tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 300 microversion: 2.41 time: 0.241074 Aug 03 01:48:16.742232 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 99/230] 10.222.0.67 () {62 vars in 1235 bytes} [Wed Aug 3 01:48:16 2022] POST /compute/v2.1/os-aggregates/12/action => generated 300 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 01:48:16.742645 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a45738f3-102f-4ef2-809d-dd3b80818b42 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.050431 Aug 03 01:48:16.742645 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 132/231] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 01:48:16 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:48:16.758636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dfab98de-b9f5-422e-ba72-574a7e1d8d84 tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:16.760384 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.760384 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:16.773682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0ed3fc0-9089-4d98-b516-c278b27734f9 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-787602683", "availability_zone": "tempest-test_az-1694329821"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:16.777474 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.777474 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:16.778690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.aggregate [None req-a0ed3fc0-9089-4d98-b516-c278b27734f9 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Generated uuid af6722a6-1b33-4429-9bf3-bd8584beca22 for aggregate {{(pid=125942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:48:16.790996 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dfab98de-b9f5-422e-ba72-574a7e1d8d84 tempest-AggregatesAdminTestV241-1995501677 tempest-AggregatesAdminTestV241-1995501677-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.41 time: 0.038269 Aug 03 01:48:16.792024 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 100/232] 10.222.0.67 () {60 vars in 1196 bytes} [Wed Aug 3 01:48:16 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:16.821061 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0ed3fc0-9089-4d98-b516-c278b27734f9 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.059999 Aug 03 01:48:16.822630 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 133/233] 10.222.0.67 () {60 vars in 1165 bytes} [Wed Aug 3 01:48:16 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:16.825137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2bddff1e-028c-4d5f-af0d-d37d1613f4a5 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1909808306"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:16.828613 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.828613 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:16.830133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.aggregate [None req-2bddff1e-028c-4d5f-af0d-d37d1613f4a5 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Generated uuid afb20176-f66e-4348-a50e-d4388294e8ea for aggregate {{(pid=125941) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:48:16.833510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4ca768f7-f708-46d4-afd5-fa11dd175568 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-787602683_new", "availability_zone": "tempest-test_az-1694329821_new"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:16.840805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=12,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:16.872853 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2bddff1e-028c-4d5f-af0d-d37d1613f4a5 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.053061 Aug 03 01:48:16.873382 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 101/234] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:48:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:16.887219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-19090b84-2285-4d39-8992-2121015994c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:16.887894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-19090b84-2285-4d39-8992-2121015994c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:16.904089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19090b84-2285-4d39-8992-2121015994c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:16.904578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19090b84-2285-4d39-8992-2121015994c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:16.905411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19090b84-2285-4d39-8992-2121015994c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:16.905861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19090b84-2285-4d39-8992-2121015994c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:16.952126 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:16.952126 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:17.000887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ca768f7-f708-46d4-afd5-fa11dd175568 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:17.001360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ca768f7-f708-46d4-afd5-fa11dd175568 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:17.048073 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4ca768f7-f708-46d4-afd5-fa11dd175568 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-aggregates/15" status: 200 len: 336 microversion: 2.1 time: 0.219321 Aug 03 01:48:17.055445 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 134/235] 10.222.0.67 () {60 vars in 1173 bytes} [Wed Aug 3 01:48:16 2022] PUT /compute/v2.1/os-aggregates/15 => generated 336 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:48:17.060500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7b6746ca-8d26-49c2-851f-dc9a6bac9970 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:17.061100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7b6746ca-8d26-49c2-851f-dc9a6bac9970 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:17.068223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b6746ca-8d26-49c2-851f-dc9a6bac9970 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:17.068738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b6746ca-8d26-49c2-851f-dc9a6bac9970 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:17.069538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b6746ca-8d26-49c2-851f-dc9a6bac9970 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:17.069984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b6746ca-8d26-49c2-851f-dc9a6bac9970 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:17.182096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-19090b84-2285-4d39-8992-2121015994c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:17.192690 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-19090b84-2285-4d39-8992-2121015994c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1461 microversion: 2.1 time: 0.318144 Aug 03 01:48:17.203521 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 102/236] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:16 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1461 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:17.218244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7e43363f-c4b6-4cd3-97c3-957735e66ced tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826529-8"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:17.222024 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:17.222024 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:17.233329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e43363f-c4b6-4cd3-97c3-957735e66ced tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:17.234458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e43363f-c4b6-4cd3-97c3-957735e66ced tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:17.524655 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7e43363f-c4b6-4cd3-97c3-957735e66ced tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 243 microversion: 2.1 time: 0.319897 Aug 03 01:48:17.525310 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 103/237] 10.222.0.67 () {60 vars in 1194 bytes} [Wed Aug 3 01:48:17 2022] POST /compute/v2.1/os-aggregates/16/action => generated 243 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:17.531862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a559966d-57c5-42fb-a820-4a13e838f3c3 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:17.533485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a559966d-57c5-42fb-a820-4a13e838f3c3 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:17.543042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a559966d-57c5-42fb-a820-4a13e838f3c3 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:17.543545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a559966d-57c5-42fb-a820-4a13e838f3c3 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:17.544338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a559966d-57c5-42fb-a820-4a13e838f3c3 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:17.544774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a559966d-57c5-42fb-a820-4a13e838f3c3 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:17.549053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7b6746ca-8d26-49c2-851f-dc9a6bac9970 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:17.558814 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7b6746ca-8d26-49c2-851f-dc9a6bac9970 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 200 len: 1321 microversion: 2.1 time: 0.502463 Aug 03 01:48:17.559808 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 135/238] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:17 2022] GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 1321 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:17.579803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e90b400f-5a37-4873-88ed-9fa0eb1f1e68 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:17.580898 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:17.580898 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:17.585076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=18 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:17.586000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:17.598089 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e90b400f-5a37-4873-88ed-9fa0eb1f1e68 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 200 len: 569 microversion: 2.1 time: 0.019278 Aug 03 01:48:17.598930 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 136/239] 10.222.0.67 () {58 vars in 1143 bytes} [Wed Aug 3 01:48:17 2022] GET /compute/v2.1/os-aggregates => generated 569 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:17.649825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a559966d-57c5-42fb-a820-4a13e838f3c3 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:17.658644 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a559966d-57c5-42fb-a820-4a13e838f3c3 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 200 len: 1277 microversion: 2.1 time: 0.132264 Aug 03 01:48:17.668393 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 104/240] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:17 2022] GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 1277 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:17.668393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fd37f382-6c74-4e02-b9c0-8a02576d9bbd tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:17.668393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fd37f382-6c74-4e02-b9c0-8a02576d9bbd tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:17.678223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd37f382-6c74-4e02-b9c0-8a02576d9bbd tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:17.678680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd37f382-6c74-4e02-b9c0-8a02576d9bbd tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:17.679502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd37f382-6c74-4e02-b9c0-8a02576d9bbd tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:17.679963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd37f382-6c74-4e02-b9c0-8a02576d9bbd tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:17.988424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fd37f382-6c74-4e02-b9c0-8a02576d9bbd tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:18.007990 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fd37f382-6c74-4e02-b9c0-8a02576d9bbd tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1316 microversion: 2.1 time: 0.347095 Aug 03 01:48:18.025269 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 105/241] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:17 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:18.045499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-73d44650-20bb-4a4d-9c51-91dd41e06498 tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826529-8"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:18.055671 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:18.055671 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:18.056670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-73d44650-20bb-4a4d-9c51-91dd41e06498 tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '071f8bf291ab4b9b988d487f667c8ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4760ffe737cc4d3aa19447daf90b919c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-73d44650-20bb-4a4d-9c51-91dd41e06498 tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Request method failure captured: Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 42 Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO3cX250jIXNYHhmQUNRn7HehvTs_yu6zt40TEXVS281otg-DAxP3I0DQ3OQlac4T_QyavTFouFvTKTafpGmlp9_2Dfg-t0eKNJFs7QWaT6q_I8NVCruti-OAhui2NX_VergD_YOcIUbvjVAX-MNQeA9t8-GBkyuV1vyPpRoxjW2-I Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 4760ffe737cc4d3aa19447daf90b919c Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:18.067961 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:18.069243 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4760ffe737cc4d3aa19447daf90b919c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4760ffe737cc4d3aa19447daf90b919c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4760ffe737cc4d3aa19447daf90b919c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4760ffe737cc4d3aa19447daf90b919c"}]}] Aug 03 01:48:18.069243 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:48:18.069243 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 4760ffe737cc4d3aa19447daf90b919c Aug 03 01:48:18.069243 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-742854162 Aug 03 01:48:18.069243 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AggregatesAdminNegativeTestJSON-742854162-project Aug 03 01:48:18.069243 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:18.069243 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:18.069243 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 071f8bf291ab4b9b988d487f667c8ef3 Aug 03 01:48:18.069243 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-742854162-project Aug 03 01:48:18.069243 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:48:18.069243 n-d-826529-8 devstack@n-api.service[125941]: {"remove_host": {"host": "n-h1-826529-8"}} Aug 03 01:48:18.069243 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:18.069243 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'n-h1-826529-8'}}} Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:18.070062 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 03 01:48:18.071103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:18.072793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-73d44650-20bb-4a4d-9c51-91dd41e06498 tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:18.073500 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-73d44650-20bb-4a4d-9c51-91dd41e06498 tempest-AggregatesAdminNegativeTestJSON-742854162 tempest-AggregatesAdminNegativeTestJSON-742854162-project] 10.222.0.67 "POST /compute/v2.1/os-aggregates/16/action" status: 403 len: 121 microversion: 2.1 time: 0.044084 Aug 03 01:48:18.077504 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 106/242] 10.222.0.67 () {60 vars in 1194 bytes} [Wed Aug 3 01:48:18 2022] POST /compute/v2.1/os-aggregates/16/action => generated 121 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:18.082163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c55de372-968f-4836-ba25-ebb408398b4f tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:18.088764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9ef54e00-7797-4ac5-b9aa-c96a5a07840c tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:18.089383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9ef54e00-7797-4ac5-b9aa-c96a5a07840c tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:18.089815 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:18.089815 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:18.105598 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9ef54e00-7797-4ac5-b9aa-c96a5a07840c tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:18.106359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9ef54e00-7797-4ac5-b9aa-c96a5a07840c tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:18.107504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9ef54e00-7797-4ac5-b9aa-c96a5a07840c tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:18.108130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9ef54e00-7797-4ac5-b9aa-c96a5a07840c tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:18.152865 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c55de372-968f-4836-ba25-ebb408398b4f tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.073915 Aug 03 01:48:18.153988 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 107/243] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 01:48:18 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:48:18.169433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-083257b7-575c-4ecd-b9dc-840e465d7a8a tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826529-8"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:18.172015 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:18.172015 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:18.184131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-083257b7-575c-4ecd-b9dc-840e465d7a8a tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:18.184765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-083257b7-575c-4ecd-b9dc-840e465d7a8a tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:18.318782 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-083257b7-575c-4ecd-b9dc-840e465d7a8a tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 228 microversion: 2.1 time: 0.163509 Aug 03 01:48:18.323058 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 108/244] 10.222.0.67 () {60 vars in 1194 bytes} [Wed Aug 3 01:48:18 2022] POST /compute/v2.1/os-aggregates/16/action => generated 228 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:18.330591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b18f9b0b-25cb-4148-9603-feeb5e6be80d tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1320241558"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:18.335058 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:18.335058 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:18.337013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.aggregate [None req-b18f9b0b-25cb-4148-9603-feeb5e6be80d tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Generated uuid fb33e904-1421-4ed9-8357-c384b1867c5b for aggregate {{(pid=125941) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:48:18.375282 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b18f9b0b-25cb-4148-9603-feeb5e6be80d tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.048728 Aug 03 01:48:18.376505 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 109/245] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:48:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:18.385213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3d3219d9-78f6-4062-beda-c5aaf70de24e tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:18.388680 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:18.388680 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:18.445215 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3d3219d9-78f6-4062-beda-c5aaf70de24e tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.066171 Aug 03 01:48:18.447764 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 110/246] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 01:48:18 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:48:18.485269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ddefbda3-80d9-445b-9821-4e902bdba985 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:18.487949 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:18.487949 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:18.512293 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ddefbda3-80d9-445b-9821-4e902bdba985 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.062796 Aug 03 01:48:18.521555 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 111/247] 10.222.0.67 () {58 vars in 1143 bytes} [Wed Aug 3 01:48:18 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:18.540594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d57c4ceb-8168-4996-af25-a3ee76f5f3d3 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-493053381"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:18.556635 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:18.556635 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:18.558458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.aggregate [None req-d57c4ceb-8168-4996-af25-a3ee76f5f3d3 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Generated uuid 806b0c12-e204-4b46-b84c-3cae2d88aa5a for aggregate {{(pid=125941) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 01:48:18.625180 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d57c4ceb-8168-4996-af25-a3ee76f5f3d3 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.100863 Aug 03 01:48:18.629174 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 112/248] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 01:48:18 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:18.634357 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9ef54e00-7797-4ac5-b9aa-c96a5a07840c tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1612 microversion: 2.1 time: 1.031633 Aug 03 01:48:18.635196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bf4379c7-41bd-42d2-80d3-75112231c795 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:18.635423 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 137/249] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:17 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1612 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:18.647052 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:18.647052 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:18.658300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6729ee3e-d0e0-4a19-8700-127e49645fa3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:18.659162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6729ee3e-d0e0-4a19-8700-127e49645fa3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:18.666596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6729ee3e-d0e0-4a19-8700-127e49645fa3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:18.666964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6729ee3e-d0e0-4a19-8700-127e49645fa3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:18.668083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6729ee3e-d0e0-4a19-8700-127e49645fa3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:18.668481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6729ee3e-d0e0-4a19-8700-127e49645fa3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:18.689160 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bf4379c7-41bd-42d2-80d3-75112231c795 tempest-AggregatesAdminTestJSON-1406696841 tempest-AggregatesAdminTestJSON-1406696841-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.058231 Aug 03 01:48:18.691011 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 113/250] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 01:48:18 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:48:18.699904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a802be8d-4464-494f-a2c0-f06a623b34d8 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:18.702510 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:18.702510 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:18.725282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a802be8d-4464-494f-a2c0-f06a623b34d8 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:18.726393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a802be8d-4464-494f-a2c0-f06a623b34d8 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:18.751036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a802be8d-4464-494f-a2c0-f06a623b34d8 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:18.757440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a802be8d-4464-494f-a2c0-f06a623b34d8 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:18.780138 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.compute.aggregates [None req-a802be8d-4464-494f-a2c0-f06a623b34d8 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 03 01:48:18.781457 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-a802be8d-4464-494f-a2c0-f06a623b34d8 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a802be8d-4464-494f-a2c0-f06a623b34d8 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Request method failure captured: Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 42 Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO5U3lvrSRC66QKE0Qh6aG2O3yMQfDfBae24RYCaxWnmHtJB6f2_WdbSTn43TRVX3SjRb-wl2ghDqfBiQsDYCnPiWnN0M63sm8EyOIrmH-8nArLYPzLmKNUsTjRApWt-50teubl1nJo1hbG-gllNhWycmoDG5pNKcGPQ6hCWSkeaAg Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:48:18.799673 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:48:18.802651 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1d6d252ce76241528e2df5d551375c3b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1d6d252ce76241528e2df5d551375c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1d6d252ce76241528e2df5d551375c3b"}]}] Aug 03 01:48:18.802651 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:48:18.802651 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 1d6d252ce76241528e2df5d551375c3b Aug 03 01:48:18.802651 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379 Aug 03 01:48:18.802651 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:48:18.802651 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:18.802651 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:18.802651 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e9200402c0c644dd88c842b7e52c0007 Aug 03 01:48:18.802651 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin Aug 03 01:48:18.802651 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:48:18.802651 n-d-826529-8 devstack@n-api.service[125941]: {"remove_host": {"host": "nonexist_host"}} Aug 03 01:48:18.802651 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:18.802651 n-d-826529-8 devstack@n-api.service[125941]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 03 01:48:18.805541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in remove_host_from_aggregate Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 03 01:48:18.810436 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:18.816290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:18.823313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:18.823313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:18.823313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:18.823313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:18.823313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 03 01:48:18.823313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:18.825574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a802be8d-4464-494f-a2c0-f06a623b34d8 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:18.828053 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a802be8d-4464-494f-a2c0-f06a623b34d8 tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.136631 Aug 03 01:48:18.831283 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 114/251] 10.222.0.67 () {60 vars in 1194 bytes} [Wed Aug 3 01:48:18 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:48:18.849187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4ca8beaf-d71e-476e-9aa6-7d349faab854 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:18.849887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4ca8beaf-d71e-476e-9aa6-7d349faab854 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:18.857064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6729ee3e-d0e0-4a19-8700-127e49645fa3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:18.871957 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6729ee3e-d0e0-4a19-8700-127e49645fa3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 200 len: 1321 microversion: 2.1 time: 0.222070 Aug 03 01:48:18.880757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4ca8beaf-d71e-476e-9aa6-7d349faab854 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:18.881820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4ca8beaf-d71e-476e-9aa6-7d349faab854 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:18.883283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4ca8beaf-d71e-476e-9aa6-7d349faab854 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:18.884672 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 138/252] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:18 2022] GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:18.888288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4ca8beaf-d71e-476e-9aa6-7d349faab854 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:18.891209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fbd64f74-d369-4a2d-a262-3a74d9405bed tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:18.892324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fbd64f74-d369-4a2d-a262-3a74d9405bed tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:18.900235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbd64f74-d369-4a2d-a262-3a74d9405bed tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:18.900774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbd64f74-d369-4a2d-a262-3a74d9405bed tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:18.901642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbd64f74-d369-4a2d-a262-3a74d9405bed tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:18.902076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbd64f74-d369-4a2d-a262-3a74d9405bed tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:19.146101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fbd64f74-d369-4a2d-a262-3a74d9405bed tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:19.154416 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fbd64f74-d369-4a2d-a262-3a74d9405bed tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 200 len: 1319 microversion: 2.1 time: 0.268570 Aug 03 01:48:19.158925 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 139/253] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:18 2022] GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:19.181871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a561aaed-1330-479c-b1c4-489c64c14a48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:19.186420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a561aaed-1330-479c-b1c4-489c64c14a48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:19.199043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a561aaed-1330-479c-b1c4-489c64c14a48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:19.199962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a561aaed-1330-479c-b1c4-489c64c14a48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:19.200845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a561aaed-1330-479c-b1c4-489c64c14a48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:19.201374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a561aaed-1330-479c-b1c4-489c64c14a48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:19.242670 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-a561aaed-1330-479c-b1c4-489c64c14a48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] HTTP exception thrown: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a561aaed-1330-479c-b1c4-489c64c14a48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Request method failure captured: Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 HTTP/1.1 Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dO7HwE8ZlVDeKp9CMSC6UG71fOqzcG5_rZlCJ7NnnieIIYnK_JGALfpDqNw7UIv_9CJ45lzH8sZMU5LAP7tNDMan3GVPVNXEdgttjDeqx8nafVysmDwf5E13J3ip7livMROqkOC3eqqaPqxhw-MzopOjEjuhsQgqwfJPHg4mqjG8Vc Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 926cb51a68dc46d9a90c6899095a1d84 Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AggregatesAdminTestJSON-796795747 Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:48:19.244540 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:48:19.246569 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_926cb51a68dc46d9a90c6899095a1d84", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/926cb51a68dc46d9a90c6899095a1d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/926cb51a68dc46d9a90c6899095a1d84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/926cb51a68dc46d9a90c6899095a1d84"}]}] Aug 03 01:48:19.246569 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AggregatesAdminTestJSON-796795747 Aug 03 01:48:19.246569 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 926cb51a68dc46d9a90c6899095a1d84 Aug 03 01:48:19.246569 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-796795747 Aug 03 01:48:19.246569 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AggregatesAdminTestJSON-796795747-project Aug 03 01:48:19.246569 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:19.246569 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:19.246569 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 9ba2c713701049f7bc1ef8438279a418 Aug 03 01:48:19.246569 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AggregatesAdminTestJSON-796795747-project Aug 03 01:48:19.246569 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:19.246569 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. Aug 03 01:48:19.246569 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'a7b18352-3867-4a22-be5a-8355da571cb3'} Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:19.247350 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. Aug 03 01:48:19.248536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:19.249840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a561aaed-1330-479c-b1c4-489c64c14a48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Returning 404 to user: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:19.251165 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a561aaed-1330-479c-b1c4-489c64c14a48 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 404 len: 111 microversion: 2.1 time: 0.090770 Aug 03 01:48:19.252182 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 140/254] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:48:19 2022] DELETE /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:19.259090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8f717c95-d11b-4b48-9707-b81e8330ea0e tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:19.265282 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:19.265282 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:19.296339 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8f717c95-d11b-4b48-9707-b81e8330ea0e tempest-AggregatesAdminNegativeTestJSON-1738047379 tempest-AggregatesAdminNegativeTestJSON-1738047379-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.042915 Aug 03 01:48:19.297898 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 141/255] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 01:48:19 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:48:19.312778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4d66d4a6-20d5-4b88-86ac-6fcade29c1d7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:19.313722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4d66d4a6-20d5-4b88-86ac-6fcade29c1d7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:19.318179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=5,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:19.325937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d66d4a6-20d5-4b88-86ac-6fcade29c1d7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:19.326744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d66d4a6-20d5-4b88-86ac-6fcade29c1d7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:19.329956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d66d4a6-20d5-4b88-86ac-6fcade29c1d7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:19.330489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d66d4a6-20d5-4b88-86ac-6fcade29c1d7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:19.612646 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4ca8beaf-d71e-476e-9aa6-7d349faab854 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '796d645eef7a420699fcbe3db3a689da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec87c17d7564edaab4c66b4594bcdc8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:19.614933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4ca8beaf-d71e-476e-9aa6-7d349faab854 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] [instance: 7dacc86a-058f-479b-b490-1866c660048b] flavor_id is None. Assuming migration. {{(pid=125941) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 03 01:48:19.615497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4ca8beaf-d71e-476e-9aa6-7d349faab854 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125941) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 01:48:19.710826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4d66d4a6-20d5-4b88-86ac-6fcade29c1d7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:19.721624 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4d66d4a6-20d5-4b88-86ac-6fcade29c1d7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1316 microversion: 2.1 time: 0.422346 Aug 03 01:48:19.722437 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 142/256] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:19 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:19.735607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-9cd75016-5243-4df6-8c5c-065a89826175 req-1393ba8b-4c48-4177-ba9a-8d38503bc99d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed63babc-ecd7-42f5-8c5a-2bf930298b3c", "tag": "d7a2040c-8892-4e49-b05d-34f17a4fad4a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:19.742521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9cd75016-5243-4df6-8c5c-065a89826175 req-1393ba8b-4c48-4177-ba9a-8d38503bc99d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:19.743133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9cd75016-5243-4df6-8c5c-065a89826175 req-1393ba8b-4c48-4177-ba9a-8d38503bc99d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:19.758605 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-9cd75016-5243-4df6-8c5c-065a89826175 req-1393ba8b-4c48-4177-ba9a-8d38503bc99d service nova] Creating event network-changed:d7a2040c-8892-4e49-b05d-34f17a4fad4a for instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c on n-h1-826529-8 Aug 03 01:48:19.764468 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-9cd75016-5243-4df6-8c5c-065a89826175 req-1393ba8b-4c48-4177-ba9a-8d38503bc99d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039266 Aug 03 01:48:19.765740 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 143/257] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:19.773190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-67167974-bf7a-4e99-ac72-69ecc76bad61 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:19.774176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-67167974-bf7a-4e99-ac72-69ecc76bad61 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] [instance: a7b18352-3867-4a22-be5a-8355da571cb3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:19.799002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67167974-bf7a-4e99-ac72-69ecc76bad61 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:19.800084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67167974-bf7a-4e99-ac72-69ecc76bad61 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:19.801121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67167974-bf7a-4e99-ac72-69ecc76bad61 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:19.801956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67167974-bf7a-4e99-ac72-69ecc76bad61 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:19.821442 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-67167974-bf7a-4e99-ac72-69ecc76bad61 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] HTTP exception thrown: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-67167974-bf7a-4e99-ac72-69ecc76bad61 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Request method failure captured: Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 HTTP/1.1 Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dO7HwE8ZlVDeKp9CMSC6UG71fOqzcG5_rZlCJ7NnnieIIYnK_JGALfpDqNw7UIv_9CJ45lzH8sZMU5LAP7tNDMan3GVPVNXEdgttjDeqx8nafVysmDwf5E13J3ip7livMROqkOC3eqqaPqxhw-MzopOjEjuhsQgqwfJPHg4mqjG8Vc Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 926cb51a68dc46d9a90c6899095a1d84 Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AggregatesAdminTestJSON-796795747 Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:48:19.823643 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:48:19.830617 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_926cb51a68dc46d9a90c6899095a1d84", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/926cb51a68dc46d9a90c6899095a1d84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/926cb51a68dc46d9a90c6899095a1d84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/926cb51a68dc46d9a90c6899095a1d84"}]}] Aug 03 01:48:19.830617 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AggregatesAdminTestJSON-796795747 Aug 03 01:48:19.830617 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 926cb51a68dc46d9a90c6899095a1d84 Aug 03 01:48:19.830617 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-796795747 Aug 03 01:48:19.830617 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AggregatesAdminTestJSON-796795747-project Aug 03 01:48:19.830617 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:19.830617 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:19.830617 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 9ba2c713701049f7bc1ef8438279a418 Aug 03 01:48:19.830617 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AggregatesAdminTestJSON-796795747-project Aug 03 01:48:19.830617 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:19.830617 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. Aug 03 01:48:19.830617 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'a7b18352-3867-4a22-be5a-8355da571cb3'} Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:19.832310 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. Aug 03 01:48:19.834285 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:19.837575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-67167974-bf7a-4e99-ac72-69ecc76bad61 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] Returning 404 to user: Instance a7b18352-3867-4a22-be5a-8355da571cb3 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:19.837575 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-67167974-bf7a-4e99-ac72-69ecc76bad61 tempest-AggregatesAdminTestJSON-796795747 tempest-AggregatesAdminTestJSON-796795747-project] 10.222.0.67 "GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3" status: 404 len: 111 microversion: 2.1 time: 0.058705 Aug 03 01:48:19.839676 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 144/258] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:19 2022] GET /compute/v2.1/servers/a7b18352-3867-4a22-be5a-8355da571cb3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:19.848233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-0c4719d1-f67f-4687-945b-cdf0cba20c4c req-155af80b-10c0-45d7-997e-e8019f703d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6", "name": "network-vif-plugged", "status": "completed", "tag": "d59c4745-6408-4d6f-a309-951c6fc953d9"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:19.870357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0c4719d1-f67f-4687-945b-cdf0cba20c4c req-155af80b-10c0-45d7-997e-e8019f703d69 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:19.874478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0c4719d1-f67f-4687-945b-cdf0cba20c4c req-155af80b-10c0-45d7-997e-e8019f703d69 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:19.895661 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-0c4719d1-f67f-4687-945b-cdf0cba20c4c req-155af80b-10c0-45d7-997e-e8019f703d69 service nova] Creating event network-vif-plugged:d59c4745-6408-4d6f-a309-951c6fc953d9 for instance fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 on n-h2-826529-8 Aug 03 01:48:19.901216 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-0c4719d1-f67f-4687-945b-cdf0cba20c4c req-155af80b-10c0-45d7-997e-e8019f703d69 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059205 Aug 03 01:48:19.902667 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 145/259] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:19.909286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b6a6cb3d-223b-4ead-be06-b3f67ee6cb93 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:19.910174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b6a6cb3d-223b-4ead-be06-b3f67ee6cb93 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:19.933708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6a6cb3d-223b-4ead-be06-b3f67ee6cb93 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:19.935470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6a6cb3d-223b-4ead-be06-b3f67ee6cb93 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:19.937648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6a6cb3d-223b-4ead-be06-b3f67ee6cb93 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:19.938462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6a6cb3d-223b-4ead-be06-b3f67ee6cb93 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:20.143460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b6a6cb3d-223b-4ead-be06-b3f67ee6cb93 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:20.152455 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b6a6cb3d-223b-4ead-be06-b3f67ee6cb93 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 200 len: 1321 microversion: 2.1 time: 0.248402 Aug 03 01:48:20.167303 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 146/260] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:19 2022] GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:20.185256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e6e318d9-4771-456b-a285-b70e4f6fe149 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:20.187648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e6e318d9-4771-456b-a285-b70e4f6fe149 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:20.200142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6e318d9-4771-456b-a285-b70e4f6fe149 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:20.200781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6e318d9-4771-456b-a285-b70e4f6fe149 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:20.201731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6e318d9-4771-456b-a285-b70e4f6fe149 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:20.202324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6e318d9-4771-456b-a285-b70e4f6fe149 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:20.420877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e6e318d9-4771-456b-a285-b70e4f6fe149 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:20.432481 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e6e318d9-4771-456b-a285-b70e4f6fe149 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 200 len: 1319 microversion: 2.1 time: 0.252169 Aug 03 01:48:20.444294 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 147/261] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:20 2022] GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:20.729451 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4ca8beaf-d71e-476e-9aa6-7d349faab854 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b/action" status: 202 len: 0 microversion: 2.1 time: 1.893018 Aug 03 01:48:20.730076 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 115/262] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:48:18 2022] POST /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b/action => generated 0 bytes in 1895 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:48:20.738308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fae96839-72b0-4a17-8718-9893279ae71b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:20.739220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fae96839-72b0-4a17-8718-9893279ae71b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:20.746441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fae96839-72b0-4a17-8718-9893279ae71b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:20.747278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fae96839-72b0-4a17-8718-9893279ae71b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:20.749322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2a0c20d1-e2c6-4f82-8888-3266fc9f5443 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:20.749572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fae96839-72b0-4a17-8718-9893279ae71b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:20.749750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2a0c20d1-e2c6-4f82-8888-3266fc9f5443 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:20.750421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fae96839-72b0-4a17-8718-9893279ae71b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:20.777491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2a0c20d1-e2c6-4f82-8888-3266fc9f5443 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:20.778017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2a0c20d1-e2c6-4f82-8888-3266fc9f5443 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:20.781276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2a0c20d1-e2c6-4f82-8888-3266fc9f5443 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:20.781778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2a0c20d1-e2c6-4f82-8888-3266fc9f5443 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:20.989773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fae96839-72b0-4a17-8718-9893279ae71b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:21.006024 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fae96839-72b0-4a17-8718-9893279ae71b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1470 microversion: 2.1 time: 0.271636 Aug 03 01:48:21.006949 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 148/263] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:20 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1470 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:21.011419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2a0c20d1-e2c6-4f82-8888-3266fc9f5443 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:21.021174 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2a0c20d1-e2c6-4f82-8888-3266fc9f5443 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1316 microversion: 2.1 time: 0.277244 Aug 03 01:48:21.022073 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 116/264] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:20 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:21.177301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0045818f-d63a-4a2c-b337-f48a74058ea0 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:21.178093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0045818f-d63a-4a2c-b337-f48a74058ea0 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:21.196859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0045818f-d63a-4a2c-b337-f48a74058ea0 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:21.198492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0045818f-d63a-4a2c-b337-f48a74058ea0 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:21.200436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0045818f-d63a-4a2c-b337-f48a74058ea0 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:21.200893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0045818f-d63a-4a2c-b337-f48a74058ea0 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:21.455525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-39bd9d0d-3c61-4958-9e0e-665f79494410 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:21.456564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-39bd9d0d-3c61-4958-9e0e-665f79494410 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:21.478671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39bd9d0d-3c61-4958-9e0e-665f79494410 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:21.481166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39bd9d0d-3c61-4958-9e0e-665f79494410 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:21.482860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39bd9d0d-3c61-4958-9e0e-665f79494410 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:21.486199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39bd9d0d-3c61-4958-9e0e-665f79494410 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:21.533831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0045818f-d63a-4a2c-b337-f48a74058ea0 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:21.553057 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0045818f-d63a-4a2c-b337-f48a74058ea0 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 200 len: 1321 microversion: 2.1 time: 0.383237 Aug 03 01:48:21.561443 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 149/265] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:21 2022] GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:21.841237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-39bd9d0d-3c61-4958-9e0e-665f79494410 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:21.852754 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-39bd9d0d-3c61-4958-9e0e-665f79494410 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 200 len: 1319 microversion: 2.1 time: 0.404583 Aug 03 01:48:21.854138 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 117/266] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:21 2022] GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:21.930566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-e037e478-f8df-4f56-835b-875a5c88f9dd req-428fdb39-5d48-409b-bd4e-be989a65cef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77121f3e-c5a9-4057-808c-572c59ff77ea", "name": "network-vif-plugged", "status": "completed", "tag": "506dd21b-00d7-4476-9ca9-b19cbb34995c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:21.955670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e037e478-f8df-4f56-835b-875a5c88f9dd req-428fdb39-5d48-409b-bd4e-be989a65cef8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:21.956142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e037e478-f8df-4f56-835b-875a5c88f9dd req-428fdb39-5d48-409b-bd4e-be989a65cef8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:21.969768 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e037e478-f8df-4f56-835b-875a5c88f9dd req-428fdb39-5d48-409b-bd4e-be989a65cef8 service nova] Creating event network-vif-plugged:506dd21b-00d7-4476-9ca9-b19cbb34995c for instance 77121f3e-c5a9-4057-808c-572c59ff77ea on n-h1-826529-8 Aug 03 01:48:21.978951 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-e037e478-f8df-4f56-835b-875a5c88f9dd req-428fdb39-5d48-409b-bd4e-be989a65cef8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053123 Aug 03 01:48:21.979884 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 150/267] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:22.027880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-55acaf13-36c9-45a1-b27e-22a1a8a2824f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:22.028496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-55acaf13-36c9-45a1-b27e-22a1a8a2824f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:22.045465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55acaf13-36c9-45a1-b27e-22a1a8a2824f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:22.047555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55acaf13-36c9-45a1-b27e-22a1a8a2824f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:22.048569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55acaf13-36c9-45a1-b27e-22a1a8a2824f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:22.050297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55acaf13-36c9-45a1-b27e-22a1a8a2824f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:22.055248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-750be9f2-bf82-4863-a471-2c4fdc2a59fb tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:22.056204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-750be9f2-bf82-4863-a471-2c4fdc2a59fb tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:22.073877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-750be9f2-bf82-4863-a471-2c4fdc2a59fb tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:22.074346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-750be9f2-bf82-4863-a471-2c4fdc2a59fb tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:22.076009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-750be9f2-bf82-4863-a471-2c4fdc2a59fb tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:22.077189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-750be9f2-bf82-4863-a471-2c4fdc2a59fb tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:22.436343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-55acaf13-36c9-45a1-b27e-22a1a8a2824f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:22.447819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-750be9f2-bf82-4863-a471-2c4fdc2a59fb tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:22.452229 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-55acaf13-36c9-45a1-b27e-22a1a8a2824f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1470 microversion: 2.1 time: 0.427354 Aug 03 01:48:22.457299 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 118/268] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:22 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1470 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:22.458126 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-750be9f2-bf82-4863-a471-2c4fdc2a59fb tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1465 microversion: 2.1 time: 0.415743 Aug 03 01:48:22.475258 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 151/269] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:22 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1465 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:22.488596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-44d108b3-5d37-4fdf-bb72-d9b84bf609a0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-410322210", "metadata": {"image_type": "test"}}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:22.494931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-44d108b3-5d37-4fdf-bb72-d9b84bf609a0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:22.503548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-44d108b3-5d37-4fdf-bb72-d9b84bf609a0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:22.504597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-44d108b3-5d37-4fdf-bb72-d9b84bf609a0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:22.505999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-44d108b3-5d37-4fdf-bb72-d9b84bf609a0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:22.506921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-44d108b3-5d37-4fdf-bb72-d9b84bf609a0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:22.564963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-44d108b3-5d37-4fdf-bb72-d9b84bf609a0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Getting quotas for project bf1b4aebbcd24c16b2f30966a762c819. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:48:22.571632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-44d108b3-5d37-4fdf-bb72-d9b84bf609a0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Getting quotas for user 8537e15eb8f24ee3a1e1d925bba2bc68 and project bf1b4aebbcd24c16b2f30966a762c819. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:48:22.583704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1772fbc8-6951-417b-9f31-0048bd1e9014 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:22.584704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1772fbc8-6951-417b-9f31-0048bd1e9014 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:22.592614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1772fbc8-6951-417b-9f31-0048bd1e9014 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:22.593387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1772fbc8-6951-417b-9f31-0048bd1e9014 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:22.594337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1772fbc8-6951-417b-9f31-0048bd1e9014 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:22.594964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1772fbc8-6951-417b-9f31-0048bd1e9014 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:22.600995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:22.766060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1772fbc8-6951-417b-9f31-0048bd1e9014 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:22.782018 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1772fbc8-6951-417b-9f31-0048bd1e9014 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 200 len: 1321 microversion: 2.1 time: 0.203875 Aug 03 01:48:22.787563 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 152/270] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:22 2022] GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:22.849360 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-44d108b3-5d37-4fdf-bb72-d9b84bf609a0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "POST /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6/action" status: 202 len: 0 microversion: 2.1 time: 0.365851 Aug 03 01:48:22.850480 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 119/271] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:48:22 2022] POST /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 01:48:22.861188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-29491a20-6621-44bd-8610-25db986e8ab7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13d0f3a0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:22.875224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1b42a1d0-1e67-4ff7-80ab-319007703198 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:22.876367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1b42a1d0-1e67-4ff7-80ab-319007703198 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:22.884883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b42a1d0-1e67-4ff7-80ab-319007703198 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:22.885517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b42a1d0-1e67-4ff7-80ab-319007703198 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:22.886485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b42a1d0-1e67-4ff7-80ab-319007703198 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:22.887123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b42a1d0-1e67-4ff7-80ab-319007703198 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:22.934514 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-29491a20-6621-44bd-8610-25db986e8ab7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.075351 Aug 03 01:48:22.935525 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 153/272] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:22 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:23.063277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1b42a1d0-1e67-4ff7-80ab-319007703198 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:23.074774 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1b42a1d0-1e67-4ff7-80ab-319007703198 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 200 len: 1319 microversion: 2.1 time: 0.203730 Aug 03 01:48:23.076268 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 120/273] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:22 2022] GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:23.480680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3c8ed6c3-cb3b-4179-97c8-e4b05eeac839 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:23.481229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3c8ed6c3-cb3b-4179-97c8-e4b05eeac839 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:23.490968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c8ed6c3-cb3b-4179-97c8-e4b05eeac839 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:23.491870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c8ed6c3-cb3b-4179-97c8-e4b05eeac839 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:23.492992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c8ed6c3-cb3b-4179-97c8-e4b05eeac839 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:23.493950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c8ed6c3-cb3b-4179-97c8-e4b05eeac839 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:23.662762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3c8ed6c3-cb3b-4179-97c8-e4b05eeac839 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:23.670611 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3c8ed6c3-cb3b-4179-97c8-e4b05eeac839 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1470 microversion: 2.1 time: 0.194422 Aug 03 01:48:23.671225 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 154/274] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:23 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1470 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:23.807049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a1fa5aa2-0bee-43d6-a60b-6c137a5d667d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:23.808193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a1fa5aa2-0bee-43d6-a60b-6c137a5d667d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:23.820803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1fa5aa2-0bee-43d6-a60b-6c137a5d667d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:23.824691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1fa5aa2-0bee-43d6-a60b-6c137a5d667d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:23.826545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1fa5aa2-0bee-43d6-a60b-6c137a5d667d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:23.827185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1fa5aa2-0bee-43d6-a60b-6c137a5d667d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.007878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d18d9cff-d0bd-4fca-bbd3-29122493bb59 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Calling method '.version_select at 0x7f5b13af4f70>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:24.011093 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:24.011093 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:24.013639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d18d9cff-d0bd-4fca-bbd3-29122493bb59 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.014202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d18d9cff-d0bd-4fca-bbd3-29122493bb59 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.074125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d18d9cff-d0bd-4fca-bbd3-29122493bb59 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.074702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d18d9cff-d0bd-4fca-bbd3-29122493bb59 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.087396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a1fa5aa2-0bee-43d6-a60b-6c137a5d667d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:24.099801 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a1fa5aa2-0bee-43d6-a60b-6c137a5d667d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 200 len: 1471 microversion: 2.1 time: 0.298020 Aug 03 01:48:24.100913 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 155/275] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:23 2022] GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 1471 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:24.108281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cd0dcb1c-0904-4d78-a239-a63f0146f88c tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13e31c10>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:24.128993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d18d9cff-d0bd-4fca-bbd3-29122493bb59 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.129860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d18d9cff-d0bd-4fca-bbd3-29122493bb59 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.155899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d18d9cff-d0bd-4fca-bbd3-29122493bb59 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.157797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d18d9cff-d0bd-4fca-bbd3-29122493bb59 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.171492 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cd0dcb1c-0904-4d78-a239-a63f0146f88c tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.069325 Aug 03 01:48:24.179633 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 156/276] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:24 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:24.179633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a1119505-7be4-4247-b4b5-332698d9a05e tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:24.179633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a1119505-7be4-4247-b4b5-332698d9a05e tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:24.194505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1119505-7be4-4247-b4b5-332698d9a05e tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.196178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1119505-7be4-4247-b4b5-332698d9a05e tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.197085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1119505-7be4-4247-b4b5-332698d9a05e tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.197528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1119505-7be4-4247-b4b5-332698d9a05e tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.237563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d18d9cff-d0bd-4fca-bbd3-29122493bb59 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.238064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d18d9cff-d0bd-4fca-bbd3-29122493bb59 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.242448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=12 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:24.257304 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d18d9cff-d0bd-4fca-bbd3-29122493bb59 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.523111 Aug 03 01:48:24.264329 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 121/277] 10.222.0.67 () {60 vars in 1243 bytes} [Wed Aug 3 01:48:23 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:48:24.393122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a1119505-7be4-4247-b4b5-332698d9a05e tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:24.403585 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a1119505-7be4-4247-b4b5-332698d9a05e tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 200 len: 1319 microversion: 2.1 time: 0.229852 Aug 03 01:48:24.407810 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 157/278] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:24 2022] GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:24.420445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5035d6bc-c63d-4ece-b5af-e26bc69c9904 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Calling method '.version_select at 0x7f5b13e84790>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:24.424681 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:24.424681 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:24.429853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5035d6bc-c63d-4ece-b5af-e26bc69c9904 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.430751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5035d6bc-c63d-4ece-b5af-e26bc69c9904 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.497347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5035d6bc-c63d-4ece-b5af-e26bc69c9904 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.498545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5035d6bc-c63d-4ece-b5af-e26bc69c9904 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.522330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5035d6bc-c63d-4ece-b5af-e26bc69c9904 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.522786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5035d6bc-c63d-4ece-b5af-e26bc69c9904 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.537234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5035d6bc-c63d-4ece-b5af-e26bc69c9904 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.537978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5035d6bc-c63d-4ece-b5af-e26bc69c9904 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.575572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5035d6bc-c63d-4ece-b5af-e26bc69c9904 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.576507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5035d6bc-c63d-4ece-b5af-e26bc69c9904 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.584022 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5035d6bc-c63d-4ece-b5af-e26bc69c9904 tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.174133 Aug 03 01:48:24.585283 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 158/279] 10.222.0.67 () {60 vars in 1222 bytes} [Wed Aug 3 01:48:24 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:48:24.635686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-abae7e47-6d4e-46d4-a7a4-81a955fe0f84 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:24.636576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-abae7e47-6d4e-46d4-a7a4-81a955fe0f84 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] [instance: ad4ca894-09b6-458d-a677-17a8942b6e63] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:24.642603 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-abae7e47-6d4e-46d4-a7a4-81a955fe0f84 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] HTTP exception thrown: Instance ad4ca894-09b6-458d-a677-17a8942b6e63 could not be found. Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-abae7e47-6d4e-46d4-a7a4-81a955fe0f84 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Request method failure captured: Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/ad4ca894-09b6-458d-a677-17a8942b6e63/action HTTP/1.1 Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 15 Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPZd8EetOR7NImJYZifBlfIai_F6olI6FWaUe5seFK53RBbeH4tjsVswZhJuTfpC-ey4FXB-RKU9xq3YmyOBVx7_rgNjf6F6Jzlsk2Y7mod21oL94dAEBlb3UqIq-P1TJ7IjwKGtnA-TCQL0GbzOZPkqZ4qGCgZEtRQMuhSHPPLM6M Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: c90431eeef1b4caaad1a71d335300803 Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-345093534 Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:48:24.645324 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:48:24.646650 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c90431eeef1b4caaad1a71d335300803", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c90431eeef1b4caaad1a71d335300803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c90431eeef1b4caaad1a71d335300803"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c90431eeef1b4caaad1a71d335300803"}]}] Aug 03 01:48:24.646650 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersAdminNegativeTestJSON-345093534 Aug 03 01:48:24.646650 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: c90431eeef1b4caaad1a71d335300803 Aug 03 01:48:24.646650 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-345093534 Aug 03 01:48:24.646650 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersAdminNegativeTestJSON-345093534-project-admin Aug 03 01:48:24.646650 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:24.646650 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:24.646650 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1569a39bf3e248d9a2a9e363d5612afd Aug 03 01:48:24.646650 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersAdminNegativeTestJSON-345093534-project-admin Aug 03 01:48:24.646650 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:48:24.646650 n-d-826529-8 devstack@n-api.service[125941]: {"migrate": {}} Aug 03 01:48:24.646650 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:24.646650 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance ad4ca894-09b6-458d-a677-17a8942b6e63 could not be found. Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'ad4ca894-09b6-458d-a677-17a8942b6e63', 'body': {'migrate': {}}} Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad4ca894-09b6-458d-a677-17a8942b6e63 could not be found. Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:24.647675 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad4ca894-09b6-458d-a677-17a8942b6e63 could not be found. Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad4ca894-09b6-458d-a677-17a8942b6e63 could not be found. Aug 03 01:48:24.648750 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:24.650360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-abae7e47-6d4e-46d4-a7a4-81a955fe0f84 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Returning 404 to user: Instance ad4ca894-09b6-458d-a677-17a8942b6e63 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:24.650360 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-abae7e47-6d4e-46d4-a7a4-81a955fe0f84 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/ad4ca894-09b6-458d-a677-17a8942b6e63/action" status: 404 len: 111 microversion: 2.1 time: 0.382269 Aug 03 01:48:24.650360 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 122/280] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:48:24 2022] POST /compute/v2.1/servers/ad4ca894-09b6-458d-a677-17a8942b6e63/action => generated 111 bytes in 383 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:24.654225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed16c0ff-130c-4670-9898-b16786431a2e tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Calling method '.version_select at 0x7f5b13af4430>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:24.656729 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:24.656729 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:24.657975 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed16c0ff-130c-4670-9898-b16786431a2e tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.658598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed16c0ff-130c-4670-9898-b16786431a2e tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.677521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed16c0ff-130c-4670-9898-b16786431a2e tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.679339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=12 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:24.688619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed16c0ff-130c-4670-9898-b16786431a2e tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.699789 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed16c0ff-130c-4670-9898-b16786431a2e tempest-HypervisorAdminV253TestBase-508529538 tempest-HypervisorAdminV253TestBase-508529538-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/8239d75e-8099-477c-a270-ebdcabb89c54" status: 200 len: 792 microversion: 2.53 time: 0.049972 Aug 03 01:48:24.700456 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 123/281] 10.222.0.67 () {60 vars in 1298 bytes} [Wed Aug 3 01:48:24 2022] GET /compute/v2.1/os-hypervisors/8239d75e-8099-477c-a270-ebdcabb89c54 => generated 792 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:48:24.708373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0c437b69-2fee-4e25-8570-2a69d355d22d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:24.709609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0c437b69-2fee-4e25-8570-2a69d355d22d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:24.720401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c437b69-2fee-4e25-8570-2a69d355d22d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.732036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c437b69-2fee-4e25-8570-2a69d355d22d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.733622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c437b69-2fee-4e25-8570-2a69d355d22d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:24.734233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c437b69-2fee-4e25-8570-2a69d355d22d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:24.871910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2a4abdb8-3761-490b-94b1-4b4add9fa374 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-694678196", "ram": 512, "vcpus": 1, "disk": 10, "id": 1940071876, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:24.875000 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:24.875000 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:24.921438 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2a4abdb8-3761-490b-94b1-4b4add9fa374 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.334978 Aug 03 01:48:24.922800 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 159/282] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:24 2022] POST /compute/v2.1/flavors => generated 415 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:24.952116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0c437b69-2fee-4e25-8570-2a69d355d22d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:24.960783 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0c437b69-2fee-4e25-8570-2a69d355d22d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1470 microversion: 2.1 time: 0.258960 Aug 03 01:48:24.961237 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 124/283] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:24 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1470 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:25.006167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-390391747", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:25.063395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:48:25.420941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7777ea3e-9373-4e47-883b-8530ff857d51 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:25.435703 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-7777ea3e-9373-4e47-883b-8530ff857d51 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] HTTP exception thrown: Flavor 1940071876 has no extra specs with key hw:cpu_thread_policy. Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7777ea3e-9373-4e47-883b-8530ff857d51 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] Request method failure captured: Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/flavors/1940071876/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPmX_HKsBGprczOzBUFkqCTwRiP2UCnGcfNmydmSMPHRRbpFYqvmedKLlLnkr7G69DF3B-UzPT_hjbD7Zuh1LjWr_dG0wKG8LGL5iQchJ5z2cmJKCeEPbCeNpiwqs8krKPCcitzpIbocbV4d9QbVYJzN0DaAb0yCaGYdcToQ7koarE Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 158dc9f9c9df4fdda4dad33b422e1d2c Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:48:25.458156 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:48:25.459829 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_158dc9f9c9df4fdda4dad33b422e1d2c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/158dc9f9c9df4fdda4dad33b422e1d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/158dc9f9c9df4fdda4dad33b422e1d2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/158dc9f9c9df4fdda4dad33b422e1d2c"}]}] Aug 03 01:48:25.459829 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 Aug 03 01:48:25.459829 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 158dc9f9c9df4fdda4dad33b422e1d2c Aug 03 01:48:25.459829 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 Aug 03 01:48:25.459829 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project Aug 03 01:48:25.459829 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:25.459829 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:25.459829 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 74cb72af93eb430ca185c58726072f26 Aug 03 01:48:25.459829 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project Aug 03 01:48:25.459829 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:25.459829 n-d-826529-8 devstack@n-api.service[125942]: exception: Flavor 1940071876 has no extra specs with key hw:cpu_thread_policy. Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'flavor_id': '1940071876', 'id': 'hw:cpu_thread_policy'} Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1940071876 has no extra specs with key hw:cpu_thread_policy. Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:25.460557 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:25.462093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:25.462093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:25.462093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:25.462093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:25.462093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:25.462093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1940071876 has no extra specs with key hw:cpu_thread_policy. Aug 03 01:48:25.462093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:25.464293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7777ea3e-9373-4e47-883b-8530ff857d51 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] Returning 404 to user: Flavor 1940071876 has no extra specs with key hw:cpu_thread_policy. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:25.465374 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7777ea3e-9373-4e47-883b-8530ff857d51 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] 10.222.0.67 "GET /compute/v2.1/flavors/1940071876/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.529060 Aug 03 01:48:25.470471 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 160/284] 10.222.0.67 () {58 vars in 1266 bytes} [Wed Aug 3 01:48:24 2022] GET /compute/v2.1/flavors/1940071876/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 539 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:25.477210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ac963d41-f209-4e4e-bd81-1f87b899dc35 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13d0fee0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:25.533045 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ac963d41-f209-4e4e-bd81-1f87b899dc35 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.061160 Aug 03 01:48:25.536073 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 161/285] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:25 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:25.540847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ef755613-4a92-4a40-a977-4cdf621ea54c req-f557a1d2-2a9e-442e-8a4a-4313af1f3b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed63babc-ecd7-42f5-8c5a-2bf930298b3c", "name": "network-vif-plugged", "status": "completed", "tag": "d7a2040c-8892-4e49-b05d-34f17a4fad4a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:25.546793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:48:25.547267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:48:25.547754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:48:25.548161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:48:25.548573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:48:25.563952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:25.566603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ef755613-4a92-4a40-a977-4cdf621ea54c req-f557a1d2-2a9e-442e-8a4a-4313af1f3b76 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:25.567305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:25.568358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:25.568941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:25.571495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ef755613-4a92-4a40-a977-4cdf621ea54c req-f557a1d2-2a9e-442e-8a4a-4313af1f3b76 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:25.592936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:25.597511 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ef755613-4a92-4a40-a977-4cdf621ea54c req-f557a1d2-2a9e-442e-8a4a-4313af1f3b76 service nova] Creating event network-vif-plugged:d7a2040c-8892-4e49-b05d-34f17a4fad4a for instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c on n-h1-826529-8 Aug 03 01:48:25.609701 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ef755613-4a92-4a40-a977-4cdf621ea54c req-f557a1d2-2a9e-442e-8a4a-4313af1f3b76 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072228 Aug 03 01:48:25.615628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Getting quotas for project 36f606d386d74db39a1088bb1d3dec27. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:48:25.616827 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 162/286] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:25.636972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f3f24943-90e9-4e8c-a552-41ca3ad11bfe tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:25.639708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f3f24943-90e9-4e8c-a552-41ca3ad11bfe tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:25.647627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Getting quotas for user 301ad92d37f142b9b3a2f77bbe5a6655 and project 36f606d386d74db39a1088bb1d3dec27. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:48:25.670269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3f24943-90e9-4e8c-a552-41ca3ad11bfe tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:25.672277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3f24943-90e9-4e8c-a552-41ca3ad11bfe tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:25.673087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3f24943-90e9-4e8c-a552-41ca3ad11bfe tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:25.673527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3f24943-90e9-4e8c-a552-41ca3ad11bfe tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:25.699549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:48:25.727419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:48:25.761741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=7 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:25.817541 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c993c955-71f9-4a65-bf2e-60ca2c39fe1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.814853 Aug 03 01:48:25.820801 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 125/287] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:48:25.839462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-57f7af6f-11eb-4900-84cd-2130c041ac83 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:25.841942 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:25.841942 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:25.842805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-57f7af6f-11eb-4900-84cd-2130c041ac83 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '74cb72af93eb430ca185c58726072f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158dc9f9c9df4fdda4dad33b422e1d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-57f7af6f-11eb-4900-84cd-2130c041ac83 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] Request method failure captured: Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/flavors/1940071876/os-extra_specs HTTP/1.1 Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 66 Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPmX_HKsBGprczOzBUFkqCTwRiP2UCnGcfNmydmSMPHRRbpFYqvmedKLlLnkr7G69DF3B-UzPT_hjbD7Zuh1LjWr_dG0wKG8LGL5iQchJ5z2cmJKCeEPbCeNpiwqs8krKPCcitzpIbocbV4d9QbVYJzN0DaAb0yCaGYdcToQ7koarE Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 158dc9f9c9df4fdda4dad33b422e1d2c Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:25.853631 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:25.855141 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_158dc9f9c9df4fdda4dad33b422e1d2c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/158dc9f9c9df4fdda4dad33b422e1d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/158dc9f9c9df4fdda4dad33b422e1d2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/158dc9f9c9df4fdda4dad33b422e1d2c"}]}] Aug 03 01:48:25.855141 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 Aug 03 01:48:25.855141 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 158dc9f9c9df4fdda4dad33b422e1d2c Aug 03 01:48:25.855141 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 Aug 03 01:48:25.855141 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project Aug 03 01:48:25.855141 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:25.855141 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:25.855141 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 74cb72af93eb430ca185c58726072f26 Aug 03 01:48:25.855141 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project Aug 03 01:48:25.855141 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:48:25.855141 n-d-826529-8 devstack@n-api.service[125941]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 03 01:48:25.855141 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'flavor_id': '1940071876', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:25.855972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 03 01:48:25.857295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:25.861424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-57f7af6f-11eb-4900-84cd-2130c041ac83 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:25.862704 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-57f7af6f-11eb-4900-84cd-2130c041ac83 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] 10.222.0.67 "POST /compute/v2.1/flavors/1940071876/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.040726 Aug 03 01:48:25.871108 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 126/288] 10.222.0.67 () {60 vars in 1224 bytes} [Wed Aug 3 01:48:25 2022] POST /compute/v2.1/flavors/1940071876/os-extra_specs => generated 124 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:25.876411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-16c65a40-0069-4b2f-a6a0-bd4345b0f63d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:25.877208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-16c65a40-0069-4b2f-a6a0-bd4345b0f63d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:26.155849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-16c65a40-0069-4b2f-a6a0-bd4345b0f63d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:26.167470 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-16c65a40-0069-4b2f-a6a0-bd4345b0f63d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 200 len: 1221 microversion: 2.1 time: 0.294894 Aug 03 01:48:26.168729 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 127/289] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:25 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 1221 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:26.173700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fd262ccf-c5c7-4b68-b5a7-b544a7c761c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:26.177276 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:26.177276 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:26.216445 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fd262ccf-c5c7-4b68-b5a7-b544a7c761c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1940071876/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046037 Aug 03 01:48:26.218061 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 128/290] 10.222.0.67 () {60 vars in 1224 bytes} [Wed Aug 3 01:48:26 2022] POST /compute/v2.1/flavors/1940071876/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:48:26.224668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd455b41-f76f-4a4f-a9c7-d25834a55642 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:26.225564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cd455b41-f76f-4a4f-a9c7-d25834a55642 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:26.244567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd455b41-f76f-4a4f-a9c7-d25834a55642 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:26.245354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd455b41-f76f-4a4f-a9c7-d25834a55642 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:26.246343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd455b41-f76f-4a4f-a9c7-d25834a55642 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:26.246948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd455b41-f76f-4a4f-a9c7-d25834a55642 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:26.309228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f3f24943-90e9-4e8c-a552-41ca3ad11bfe tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:26.320682 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f3f24943-90e9-4e8c-a552-41ca3ad11bfe tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 200 len: 1319 microversion: 2.1 time: 0.702440 Aug 03 01:48:26.321371 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 163/291] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:25 2022] GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 1319 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:26.506080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cd455b41-f76f-4a4f-a9c7-d25834a55642 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:26.517782 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cd455b41-f76f-4a4f-a9c7-d25834a55642 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1470 microversion: 2.1 time: 0.297264 Aug 03 01:48:26.520395 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 129/292] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:26 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1470 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:26.532811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b19d14ae-5f47-47ec-8e2e-144beb3762db tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:26.533597 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:26.533597 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:26.535492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b19d14ae-5f47-47ec-8e2e-144beb3762db tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '74cb72af93eb430ca185c58726072f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158dc9f9c9df4fdda4dad33b422e1d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b19d14ae-5f47-47ec-8e2e-144beb3762db tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] Request method failure captured: Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/flavors/1940071876/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPmX_HKsBGprczOzBUFkqCTwRiP2UCnGcfNmydmSMPHRRbpFYqvmedKLlLnkr7G69DF3B-UzPT_hjbD7Zuh1LjWr_dG0wKG8LGL5iQchJ5z2cmJKCeEPbCeNpiwqs8krKPCcitzpIbocbV4d9QbVYJzN0DaAb0yCaGYdcToQ7koarE Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 158dc9f9c9df4fdda4dad33b422e1d2c Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:26.537717 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:26.539370 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_158dc9f9c9df4fdda4dad33b422e1d2c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/158dc9f9c9df4fdda4dad33b422e1d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/158dc9f9c9df4fdda4dad33b422e1d2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/158dc9f9c9df4fdda4dad33b422e1d2c"}]}] Aug 03 01:48:26.539370 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 Aug 03 01:48:26.539370 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 158dc9f9c9df4fdda4dad33b422e1d2c Aug 03 01:48:26.539370 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 Aug 03 01:48:26.539370 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project Aug 03 01:48:26.539370 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:26.539370 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:26.539370 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 74cb72af93eb430ca185c58726072f26 Aug 03 01:48:26.539370 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project Aug 03 01:48:26.539370 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:26.539370 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'flavor_id': '1940071876', 'id': 'hw:numa_nodes'} Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:26.540050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.541454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b19d14ae-5f47-47ec-8e2e-144beb3762db tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:26.543211 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b19d14ae-5f47-47ec-8e2e-144beb3762db tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] 10.222.0.67 "DELETE /compute/v2.1/flavors/1940071876/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.021678 Aug 03 01:48:26.546847 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 130/293] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 01:48:26 2022] DELETE /compute/v2.1/flavors/1940071876/os-extra_specs/hw:numa_nodes => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:26.554860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0662789e-d5d8-43ce-85eb-d9f1fffbcbc3 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13967280>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:26.668424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fd2454bd-c0d8-4c80-9d40-9a72502c495f tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1810002877", "id": 88530645, "os-flavor-access:is_public": "True"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:26.674084 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:26.674084 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:26.688235 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0662789e-d5d8-43ce-85eb-d9f1fffbcbc3 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.139872 Aug 03 01:48:26.688964 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 131/294] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:26 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:26.695339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-262b590e-d85d-4bd6-8ebd-16db8bb03eb8 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:26.698530 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:26.698530 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:26.705557 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fd2454bd-c0d8-4c80-9d40-9a72502c495f tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.382663 Aug 03 01:48:26.706166 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 164/295] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:26 2022] POST /compute/v2.1/flavors => generated 424 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:26.724530 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-262b590e-d85d-4bd6-8ebd-16db8bb03eb8 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1940071876/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.033995 Aug 03 01:48:26.730844 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 132/296] 10.222.0.67 () {60 vars in 1224 bytes} [Wed Aug 3 01:48:26 2022] POST /compute/v2.1/flavors/1940071876/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:48:26.735100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5f43f350-6c05-426f-9224-12943a4cc53a tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:26.736689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-408ee540-59b6-4933-879d-1e3d62c75df7 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:26.737868 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:26.737868 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:26.740254 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:26.740254 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:26.741604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-408ee540-59b6-4933-879d-1e3d62c75df7 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '74cb72af93eb430ca185c58726072f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158dc9f9c9df4fdda4dad33b422e1d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-408ee540-59b6-4933-879d-1e3d62c75df7 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] Request method failure captured: Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: request: PUT /compute/v2.1/flavors/1940071876/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 22 Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPmX_HKsBGprczOzBUFkqCTwRiP2UCnGcfNmydmSMPHRRbpFYqvmedKLlLnkr7G69DF3B-UzPT_hjbD7Zuh1LjWr_dG0wKG8LGL5iQchJ5z2cmJKCeEPbCeNpiwqs8krKPCcitzpIbocbV4d9QbVYJzN0DaAb0yCaGYdcToQ7koarE Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 158dc9f9c9df4fdda4dad33b422e1d2c Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:26.743551 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:26.744958 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_158dc9f9c9df4fdda4dad33b422e1d2c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/158dc9f9c9df4fdda4dad33b422e1d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/158dc9f9c9df4fdda4dad33b422e1d2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/158dc9f9c9df4fdda4dad33b422e1d2c"}]}] Aug 03 01:48:26.744958 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 Aug 03 01:48:26.744958 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 158dc9f9c9df4fdda4dad33b422e1d2c Aug 03 01:48:26.744958 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 Aug 03 01:48:26.744958 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project Aug 03 01:48:26.744958 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:26.744958 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:26.744958 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 74cb72af93eb430ca185c58726072f26 Aug 03 01:48:26.744958 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project Aug 03 01:48:26.744958 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:48:26.744958 n-d-826529-8 devstack@n-api.service[125941]: {"hw:numa_nodes": "1"} Aug 03 01:48:26.744958 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:26.744958 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'flavor_id': '1940071876', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:26.745810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 03 01:48:26.747087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.749126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-408ee540-59b6-4933-879d-1e3d62c75df7 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:26.750188 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-408ee540-59b6-4933-879d-1e3d62c75df7 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959 tempest-FlavorsExtraSpecsNegativeTestJSON-873591959-project] 10.222.0.67 "PUT /compute/v2.1/flavors/1940071876/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018107 Aug 03 01:48:26.752479 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 133/297] 10.222.0.67 () {60 vars in 1265 bytes} [Wed Aug 3 01:48:26 2022] PUT /compute/v2.1/flavors/1940071876/os-extra_specs/hw:numa_nodes => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:26.763891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f6ff0ffb-ba38-482f-be7d-fcf07bee27d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:26.775216 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-f6ff0ffb-ba38-482f-be7d-fcf07bee27d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] HTTP exception thrown: Flavor 1940071876 has no extra specs with key hw:cpu_thread_policy. Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f6ff0ffb-ba38-482f-be7d-fcf07bee27d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] Request method failure captured: Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/flavors/1940071876/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPoT52cpO5SpiC5NwIfyg7uY59CU-zddLc3Sn1Ji9NcgD__c-XR178QnHp9vx-VSZRlbxMYSqakNGxR5aeimHLqWPnSwyIjjlmj5cWI_J61yaXPErn1dzehO8dEm4UVTkY6LfUEfHg6iNax4LULmrF1WWE85ReEmnsOwc7qU_HEFo8 Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 97c6b776ae234247aa5b0846720120d7 Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:48:26.777160 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:48:26.778890 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_97c6b776ae234247aa5b0846720120d7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/97c6b776ae234247aa5b0846720120d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/97c6b776ae234247aa5b0846720120d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/97c6b776ae234247aa5b0846720120d7"}]}] Aug 03 01:48:26.778890 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 Aug 03 01:48:26.778890 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 97c6b776ae234247aa5b0846720120d7 Aug 03 01:48:26.778890 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 Aug 03 01:48:26.778890 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin Aug 03 01:48:26.778890 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:26.778890 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:26.778890 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: b889ea31caed40d1978e7938f2fb7966 Aug 03 01:48:26.778890 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin Aug 03 01:48:26.778890 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:26.778890 n-d-826529-8 devstack@n-api.service[125941]: exception: Flavor 1940071876 has no extra specs with key hw:cpu_thread_policy. Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'flavor_id': '1940071876', 'id': 'hw:cpu_thread_policy'} Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1940071876 has no extra specs with key hw:cpu_thread_policy. Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:26.779773 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.781288 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:26.781288 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:26.781288 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:26.781288 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:26.781288 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:26.781288 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1940071876 has no extra specs with key hw:cpu_thread_policy. Aug 03 01:48:26.781288 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.782706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f6ff0ffb-ba38-482f-be7d-fcf07bee27d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] Returning 404 to user: Flavor 1940071876 has no extra specs with key hw:cpu_thread_policy. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:26.784565 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f6ff0ffb-ba38-482f-be7d-fcf07bee27d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1940071876/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.024284 Aug 03 01:48:26.805101 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 134/298] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 01:48:26 2022] DELETE /compute/v2.1/flavors/1940071876/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:26.812654 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5f43f350-6c05-426f-9224-12943a4cc53a tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/88530645" status: 202 len: 0 microversion: 2.1 time: 0.096594 Aug 03 01:48:26.813610 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 165/299] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 01:48:26 2022] DELETE /compute/v2.1/flavors/88530645 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:48:26.819754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-97a82e18-13de-4b90-867d-a2ee6eec7414 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:26.830178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3dcc9a45-cd6c-44e7-b973-de24b596e257 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:26.838951 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-97a82e18-13de-4b90-867d-a2ee6eec7414 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-97a82e18-13de-4b90-867d-a2ee6eec7414 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] Request method failure captured: Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: request: PUT /compute/v2.1/flavors/1940071876/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 27 Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPoT52cpO5SpiC5NwIfyg7uY59CU-zddLc3Sn1Ji9NcgD__c-XR178QnHp9vx-VSZRlbxMYSqakNGxR5aeimHLqWPnSwyIjjlmj5cWI_J61yaXPErn1dzehO8dEm4UVTkY6LfUEfHg6iNax4LULmrF1WWE85ReEmnsOwc7qU_HEFo8 Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 97c6b776ae234247aa5b0846720120d7 Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:48:26.841298 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:48:26.844419 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_97c6b776ae234247aa5b0846720120d7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/97c6b776ae234247aa5b0846720120d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/97c6b776ae234247aa5b0846720120d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/97c6b776ae234247aa5b0846720120d7"}]}] Aug 03 01:48:26.844419 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 Aug 03 01:48:26.844419 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 97c6b776ae234247aa5b0846720120d7 Aug 03 01:48:26.844419 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 Aug 03 01:48:26.844419 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin Aug 03 01:48:26.844419 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:26.844419 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:26.844419 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: b889ea31caed40d1978e7938f2fb7966 Aug 03 01:48:26.844419 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin Aug 03 01:48:26.844419 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:48:26.844419 n-d-826529-8 devstack@n-api.service[125941]: {"hw:cpu_policy": "shared"} Aug 03 01:48:26.844419 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:26.844419 n-d-826529-8 devstack@n-api.service[125941]: exception: Request body and URI mismatch Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'flavor_id': '1940071876', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:26.846069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:26.848504 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:26.848504 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:26.848504 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 03 01:48:26.848504 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.848504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-97a82e18-13de-4b90-867d-a2ee6eec7414 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:26.849508 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-97a82e18-13de-4b90-867d-a2ee6eec7414 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] 10.222.0.67 "PUT /compute/v2.1/flavors/1940071876/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.041754 Aug 03 01:48:26.850244 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 135/300] 10.222.0.67 () {60 vars in 1265 bytes} [Wed Aug 3 01:48:26 2022] PUT /compute/v2.1/flavors/1940071876/os-extra_specs/hw:numa_nodes => generated 73 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 01:48:26.867250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9db4da3d-461d-48e0-ba60-c83e0a79ef0b tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9db4da3d-461d-48e0-ba60-c83e0a79ef0b tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] Request method failure captured: Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: request: PUT /compute/v2.1/flavors/1940071876/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 49 Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPoT52cpO5SpiC5NwIfyg7uY59CU-zddLc3Sn1Ji9NcgD__c-XR178QnHp9vx-VSZRlbxMYSqakNGxR5aeimHLqWPnSwyIjjlmj5cWI_J61yaXPErn1dzehO8dEm4UVTkY6LfUEfHg6iNax4LULmrF1WWE85ReEmnsOwc7qU_HEFo8 Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 97c6b776ae234247aa5b0846720120d7 Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:48:26.874006 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:48:26.875694 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_97c6b776ae234247aa5b0846720120d7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/97c6b776ae234247aa5b0846720120d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/97c6b776ae234247aa5b0846720120d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/97c6b776ae234247aa5b0846720120d7"}]}] Aug 03 01:48:26.875694 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 Aug 03 01:48:26.875694 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 97c6b776ae234247aa5b0846720120d7 Aug 03 01:48:26.875694 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 Aug 03 01:48:26.875694 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin Aug 03 01:48:26.875694 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:26.875694 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:26.875694 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: b889ea31caed40d1978e7938f2fb7966 Aug 03 01:48:26.875694 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin Aug 03 01:48:26.875694 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:48:26.875694 n-d-826529-8 devstack@n-api.service[125941]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 03 01:48:26.875694 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'flavor_id': '1940071876', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance: Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 03 01:48:26.876577 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.878135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:26.881561 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:26.881561 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:26.881561 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 01:48:26.881561 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 01:48:26.881561 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 03 01:48:26.881561 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:26.881561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9db4da3d-461d-48e0-ba60-c83e0a79ef0b tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:26.881561 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9db4da3d-461d-48e0-ba60-c83e0a79ef0b tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] 10.222.0.67 "PUT /compute/v2.1/flavors/1940071876/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.020830 Aug 03 01:48:26.885287 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 136/301] 10.222.0.67 () {60 vars in 1265 bytes} [Wed Aug 3 01:48:26 2022] PUT /compute/v2.1/flavors/1940071876/os-extra_specs/hw:numa_nodes => generated 117 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 01:48:26.891241 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3dcc9a45-cd6c-44e7-b973-de24b596e257 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.072763 Aug 03 01:48:26.892397 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 166/302] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:26 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:26.892972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0b7e9a5b-7454-484f-b993-d10507ae2a9d tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:26.893901 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:26.893901 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:26.912804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-15fb2189-06b0-4769-943b-ca701fcdf50d tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-372170609", "id": 1533089586, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:26.923188 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0b7e9a5b-7454-484f-b993-d10507ae2a9d tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1940071876" status: 202 len: 0 microversion: 2.1 time: 0.034953 Aug 03 01:48:26.929011 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 137/303] 10.222.0.67 () {58 vars in 1161 bytes} [Wed Aug 3 01:48:26 2022] DELETE /compute/v2.1/flavors/1940071876 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:48:26.935508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-36ce7566-222c-44ef-ab79-800680a73a85 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:26.969183 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-36ce7566-222c-44ef-ab79-800680a73a85 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739 tempest-FlavorsExtraSpecsNegativeTestJSON-1302545739-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037772 Aug 03 01:48:26.971869 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-15fb2189-06b0-4769-943b-ca701fcdf50d tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.063824 Aug 03 01:48:26.973714 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 167/304] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:26 2022] POST /compute/v2.1/flavors => generated 416 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:48:26.975735 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 138/305] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:27.000082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-02684199-4806-48f5-be71-6b19ef24f1cc tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:27.055292 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-02684199-4806-48f5-be71-6b19ef24f1cc tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.062789 Aug 03 01:48:27.069078 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 139/306] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:26 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:27.076076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d0c9eb67-02a1-491f-9595-f1cc06baf340 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:27.112463 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d0c9eb67-02a1-491f-9595-f1cc06baf340 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1533089586" status: 202 len: 0 microversion: 2.1 time: 0.040124 Aug 03 01:48:27.114937 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 168/307] 10.222.0.67 () {58 vars in 1161 bytes} [Wed Aug 3 01:48:27 2022] DELETE /compute/v2.1/flavors/1533089586 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:48:27.123630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-39a84703-9c2f-496f-8cdc-ad1d8e389207 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:27.179149 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-39a84703-9c2f-496f-8cdc-ad1d8e389207 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056614 Aug 03 01:48:27.180888 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 140/308] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:27.197891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-440b2c69-5b4e-4ac3-8db2-85cf374220cb tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:27.200396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-440b2c69-5b4e-4ac3-8db2-85cf374220cb tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:27.200632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b40b721a-eebc-4320-a044-e4668a31640a tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-623051579", "id": 290831326, "os-flavor-access:is_public": "True"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:27.203905 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:27.203905 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:27.226040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-440b2c69-5b4e-4ac3-8db2-85cf374220cb tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:27.228717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-440b2c69-5b4e-4ac3-8db2-85cf374220cb tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:27.233839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-440b2c69-5b4e-4ac3-8db2-85cf374220cb tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:27.234655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-440b2c69-5b4e-4ac3-8db2-85cf374220cb tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:27.238176 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b40b721a-eebc-4320-a044-e4668a31640a tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.041373 Aug 03 01:48:27.240125 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 141/309] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:27 2022] POST /compute/v2.1/flavors => generated 425 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:48:27.255121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-302fce0a-8152-4a93-ae3d-1091d919f069 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:27.316465 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-302fce0a-8152-4a93-ae3d-1091d919f069 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/290831326" status: 202 len: 0 microversion: 2.1 time: 0.067605 Aug 03 01:48:27.320724 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 142/310] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 01:48:27 2022] DELETE /compute/v2.1/flavors/290831326 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:48:27.325372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5e5ce863-c728-40e1-890d-f9e007c71e13 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:27.367475 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5e5ce863-c728-40e1-890d-f9e007c71e13 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045437 Aug 03 01:48:27.368503 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 143/311] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:27.373205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-27e68b77-ba1f-4fdc-a013-55d80392ac3c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:27.374089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-27e68b77-ba1f-4fdc-a013-55d80392ac3c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:27.393972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27e68b77-ba1f-4fdc-a013-55d80392ac3c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:27.395971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27e68b77-ba1f-4fdc-a013-55d80392ac3c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:27.398150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27e68b77-ba1f-4fdc-a013-55d80392ac3c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:27.398702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27e68b77-ba1f-4fdc-a013-55d80392ac3c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:27.529201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-440b2c69-5b4e-4ac3-8db2-85cf374220cb tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:27.547930 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-440b2c69-5b4e-4ac3-8db2-85cf374220cb tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 200 len: 1273 microversion: 2.1 time: 0.357586 Aug 03 01:48:27.549213 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 169/312] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:27 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 1273 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:27.559856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-43686d61-0a29-4a9c-a30d-0ecb378b0400 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1684457808", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:27.568827 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:27.568827 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:27.597316 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-43686d61-0a29-4a9c-a30d-0ecb378b0400 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.045678 Aug 03 01:48:27.599201 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 170/313] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:27 2022] POST /compute/v2.1/flavors => generated 507 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:27.612229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0cfe848-4d29-41ee-a227-f44acd057f0a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:27.612928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0cfe848-4d29-41ee-a227-f44acd057f0a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:27.627092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0cfe848-4d29-41ee-a227-f44acd057f0a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:27.642527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0cfe848-4d29-41ee-a227-f44acd057f0a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:27.643413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0cfe848-4d29-41ee-a227-f44acd057f0a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:27.650643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0cfe848-4d29-41ee-a227-f44acd057f0a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:27.839368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-27e68b77-ba1f-4fdc-a013-55d80392ac3c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:27.851852 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-27e68b77-ba1f-4fdc-a013-55d80392ac3c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 200 len: 1467 microversion: 2.1 time: 0.482036 Aug 03 01:48:27.854148 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 144/314] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:27 2022] GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 1467 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:27.865699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-88d9a112-c14a-4bab-9f17-41339cb2fb77 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:27.869873 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:27.869873 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:27.914691 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-88d9a112-c14a-4bab-9f17-41339cb2fb77 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/78c77de3-8cf0-4dcb-a9a1-57ea95984da8" status: 202 len: 0 microversion: 2.1 time: 0.058664 Aug 03 01:48:27.915330 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 145/315] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:48:27 2022] DELETE /compute/v2.1/flavors/78c77de3-8cf0-4dcb-a9a1-57ea95984da8 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:48:27.920606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a01d2eb5-d7eb-4b10-b1cc-a5d2e4813762 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13af4790>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:28.021089 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a01d2eb5-d7eb-4b10-b1cc-a5d2e4813762 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.104434 Aug 03 01:48:28.023892 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 146/316] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:27 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:28.037120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-70777089-e7ab-47af-b973-e13f363ee6ee tempest-DeleteServersAdminTestJSON-900211381 tempest-DeleteServersAdminTestJSON-900211381-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:28.043289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-70777089-e7ab-47af-b973-e13f363ee6ee tempest-DeleteServersAdminTestJSON-900211381 tempest-DeleteServersAdminTestJSON-900211381-project-admin] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:28.062580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70777089-e7ab-47af-b973-e13f363ee6ee tempest-DeleteServersAdminTestJSON-900211381 tempest-DeleteServersAdminTestJSON-900211381-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:28.065439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70777089-e7ab-47af-b973-e13f363ee6ee tempest-DeleteServersAdminTestJSON-900211381 tempest-DeleteServersAdminTestJSON-900211381-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:28.068903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70777089-e7ab-47af-b973-e13f363ee6ee tempest-DeleteServersAdminTestJSON-900211381 tempest-DeleteServersAdminTestJSON-900211381-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:28.070985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70777089-e7ab-47af-b973-e13f363ee6ee tempest-DeleteServersAdminTestJSON-900211381 tempest-DeleteServersAdminTestJSON-900211381-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:28.189183 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-70777089-e7ab-47af-b973-e13f363ee6ee tempest-DeleteServersAdminTestJSON-900211381 tempest-DeleteServersAdminTestJSON-900211381-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c/action" status: 202 len: 0 microversion: 2.1 time: 0.162952 Aug 03 01:48:28.192225 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 147/317] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:48:28 2022] POST /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:48:28.201548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0cfe848-4d29-41ee-a227-f44acd057f0a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:28.202672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-888361ae-b1d2-4d95-9d66-4d9afdd2d692 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:28.219392 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0cfe848-4d29-41ee-a227-f44acd057f0a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.611108 Aug 03 01:48:28.219954 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 171/318] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:27 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:28.226404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-948ceaf0-0288-4f18-b3b5-a64052ce7b66 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:28.232234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-948ceaf0-0288-4f18-b3b5-a64052ce7b66 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:28.233768 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-888361ae-b1d2-4d95-9d66-4d9afdd2d692 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039499 Aug 03 01:48:28.244859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-948ceaf0-0288-4f18-b3b5-a64052ce7b66 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:28.245586 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-948ceaf0-0288-4f18-b3b5-a64052ce7b66 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:28.246539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-948ceaf0-0288-4f18-b3b5-a64052ce7b66 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:28.247156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-948ceaf0-0288-4f18-b3b5-a64052ce7b66 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:28.250804 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 148/319] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:28.256362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2ef633fa-e10e-4d01-94be-54a9819fb705 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1388043933", "id": "b70bd70f-b76e-41da-b4fc-011e368aab17", "os-flavor-access:is_public": "True"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:28.259923 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:28.259923 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:28.289954 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2ef633fa-e10e-4d01-94be-54a9819fb705 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.035610 Aug 03 01:48:28.291813 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 149/320] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:28 2022] POST /compute/v2.1/flavors => generated 507 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:28.307934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6eef5e01-0372-4a40-b4f9-7194e311a911 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:28.308927 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:28.308927 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:28.313728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-948ceaf0-0288-4f18-b3b5-a64052ce7b66 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:28.314440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-948ceaf0-0288-4f18-b3b5-a64052ce7b66 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:28.315308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-948ceaf0-0288-4f18-b3b5-a64052ce7b66 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lazy-loading 'fault' on Instance uuid ed63babc-ecd7-42f5-8c5a-2bf930298b3c {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:48:28.357959 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6eef5e01-0372-4a40-b4f9-7194e311a911 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/b70bd70f-b76e-41da-b4fc-011e368aab17" status: 202 len: 0 microversion: 2.1 time: 0.057479 Aug 03 01:48:28.359008 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 150/321] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:48:28 2022] DELETE /compute/v2.1/flavors/b70bd70f-b76e-41da-b4fc-011e368aab17 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:48:28.368848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5e634130-1d8e-4986-b96c-47b667c4e790 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:28.399214 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5e634130-1d8e-4986-b96c-47b667c4e790 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035649 Aug 03 01:48:28.400819 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 151/322] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:28.424798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1ab2c88e-882e-47ca-ac11-35acf1805e6e tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1133014166", "id": 1150034523, "os-flavor-access:is_public": "True"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:28.465276 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1ab2c88e-882e-47ca-ac11-35acf1805e6e tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.045496 Aug 03 01:48:28.466830 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 152/323] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:28 2022] POST /compute/v2.1/flavors => generated 414 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:28.503874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bcf6494b-168f-4938-8080-f7216b1d55bc tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:28.522460 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bcf6494b-168f-4938-8080-f7216b1d55bc tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/1150034523" status: 200 len: 414 microversion: 2.1 time: 0.033634 Aug 03 01:48:28.530725 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 153/324] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 01:48:28 2022] GET /compute/v2.1/flavors/1150034523 => generated 414 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:28.933733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0fe8cf86-2433-4473-8f15-112d07478b52 tempest-FlavorsAdminTestJSON-1784580708 tempest-FlavorsAdminTestJSON-1784580708-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:28.985917 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0fe8cf86-2433-4473-8f15-112d07478b52 tempest-FlavorsAdminTestJSON-1784580708 tempest-FlavorsAdminTestJSON-1784580708-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.451194 Aug 03 01:48:28.986523 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 154/325] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:28 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:29.007855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b2567706-9aa1-49a4-ba6c-78ac78640ef9 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:29.008394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b2567706-9aa1-49a4-ba6c-78ac78640ef9 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:29.016694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2567706-9aa1-49a4-ba6c-78ac78640ef9 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:29.017141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2567706-9aa1-49a4-ba6c-78ac78640ef9 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:29.017922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2567706-9aa1-49a4-ba6c-78ac78640ef9 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:29.018466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2567706-9aa1-49a4-ba6c-78ac78640ef9 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:29.737742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-948ceaf0-0288-4f18-b3b5-a64052ce7b66 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:29.769748 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-948ceaf0-0288-4f18-b3b5-a64052ce7b66 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 200 len: 1450 microversion: 2.1 time: 1.533611 Aug 03 01:48:29.775951 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 172/326] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:28 2022] GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 1450 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:29.804874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-feeaa041-2478-4c18-9ad4-d3d70fb1b9f5 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:29.807170 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:29.807170 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:29.872551 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-feeaa041-2478-4c18-9ad4-d3d70fb1b9f5 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1150034523" status: 202 len: 0 microversion: 2.1 time: 0.092048 Aug 03 01:48:29.874717 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 173/327] 10.222.0.67 () {58 vars in 1161 bytes} [Wed Aug 3 01:48:29 2022] DELETE /compute/v2.1/flavors/1150034523 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:48:29.893066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1a81035e-d17c-44e0-bc37-0a1d0ec3ffcf tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b201f1e50>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:29.974222 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1a81035e-d17c-44e0-bc37-0a1d0ec3ffcf tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.088438 Aug 03 01:48:29.980281 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 174/328] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:29 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:29.997227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cb074ea5-1e79-4cf8-b3dc-94ba05a2cb32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:29.998362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cb074ea5-1e79-4cf8-b3dc-94ba05a2cb32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:30.009867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cb074ea5-1e79-4cf8-b3dc-94ba05a2cb32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:30.024628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cb074ea5-1e79-4cf8-b3dc-94ba05a2cb32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:30.027284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cb074ea5-1e79-4cf8-b3dc-94ba05a2cb32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:30.027751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cb074ea5-1e79-4cf8-b3dc-94ba05a2cb32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:30.248575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b2567706-9aa1-49a4-ba6c-78ac78640ef9 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:30.261133 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b2567706-9aa1-49a4-ba6c-78ac78640ef9 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 200 len: 1321 microversion: 2.1 time: 1.258305 Aug 03 01:48:30.265430 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 155/329] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:28 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 1321 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:30.272176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-fc2c45ab-f7da-48c4-a23a-6061467535a3 req-54b6ee46-2a43-4bac-9f23-4ece4577c69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6", "name": "network-vif-plugged", "status": "completed", "tag": "d59c4745-6408-4d6f-a309-951c6fc953d9"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:30.306424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-fc2c45ab-f7da-48c4-a23a-6061467535a3 req-54b6ee46-2a43-4bac-9f23-4ece4577c69d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:30.307125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-fc2c45ab-f7da-48c4-a23a-6061467535a3 req-54b6ee46-2a43-4bac-9f23-4ece4577c69d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:30.326891 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-fc2c45ab-f7da-48c4-a23a-6061467535a3 req-54b6ee46-2a43-4bac-9f23-4ece4577c69d service nova] Creating event network-vif-plugged:d59c4745-6408-4d6f-a309-951c6fc953d9 for instance fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 on n-h2-826529-8 Aug 03 01:48:30.343551 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-fc2c45ab-f7da-48c4-a23a-6061467535a3 req-54b6ee46-2a43-4bac-9f23-4ece4577c69d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076561 Aug 03 01:48:30.344342 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 156/330] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:30.359836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b555234a-e9b5-43f8-9ce5-8c534e9ea10c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:30.360692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b555234a-e9b5-43f8-9ce5-8c534e9ea10c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:30.376578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b555234a-e9b5-43f8-9ce5-8c534e9ea10c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:30.377225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b555234a-e9b5-43f8-9ce5-8c534e9ea10c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:30.379333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b555234a-e9b5-43f8-9ce5-8c534e9ea10c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:30.381275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b555234a-e9b5-43f8-9ce5-8c534e9ea10c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:30.452820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b555234a-e9b5-43f8-9ce5-8c534e9ea10c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:48:30.610626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=73,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=12 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:30.665265 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b555234a-e9b5-43f8-9ce5-8c534e9ea10c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 204 len: 0 microversion: 2.1 time: 0.319361 Aug 03 01:48:30.665863 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 157/331] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:48:30 2022] DELETE /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:48:30.675262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7985f92f-745b-4245-9a93-2b547e1f160b tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:30.773761 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7985f92f-745b-4245-9a93-2b547e1f160b tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.106625 Aug 03 01:48:30.775777 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 158/332] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:30.793468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c4a3d8d5-424c-45ec-8341-5f0d253125e1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:30.794622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c4a3d8d5-424c-45ec-8341-5f0d253125e1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:30.824107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a3d8d5-424c-45ec-8341-5f0d253125e1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:30.827215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a3d8d5-424c-45ec-8341-5f0d253125e1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:30.828654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a3d8d5-424c-45ec-8341-5f0d253125e1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:30.833144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a3d8d5-424c-45ec-8341-5f0d253125e1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:30.879316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a3d8d5-424c-45ec-8341-5f0d253125e1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:30.880626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a3d8d5-424c-45ec-8341-5f0d253125e1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:30.881542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-c4a3d8d5-424c-45ec-8341-5f0d253125e1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lazy-loading 'fault' on Instance uuid ed63babc-ecd7-42f5-8c5a-2bf930298b3c {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:48:31.386988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cb074ea5-1e79-4cf8-b3dc-94ba05a2cb32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:31.404220 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cb074ea5-1e79-4cf8-b3dc-94ba05a2cb32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 1.422325 Aug 03 01:48:31.404722 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 175/333] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:29 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:31.410403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-84335404-c86d-45ca-bdd2-ee1c8254be9a tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-670023768", "id": 336548996, "os-flavor-access:is_public": "False"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:31.418916 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:31.418916 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:31.434745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:31.455090 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-84335404-c86d-45ca-bdd2-ee1c8254be9a tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.048818 Aug 03 01:48:31.455778 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 176/334] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:31 2022] POST /compute/v2.1/flavors => generated 426 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:31.461736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4cb13dd8-98c8-48c6-a3c6-8ce15c1baa09 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13e84d30>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:31.556308 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4cb13dd8-98c8-48c6-a3c6-8ce15c1baa09 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.099180 Aug 03 01:48:31.558049 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 177/335] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:31 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:31.568935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-0ffb27fd-02ff-43c7-8028-98c3b73c0fcc req-f5f416c6-4f87-4076-80fd-70da9e6aa268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c808b6-416a-4dcb-af4e-cfc78f56dfa3", "tag": "aa497ae6-661e-4ad4-a847-0576f80c3772"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:31.596323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0ffb27fd-02ff-43c7-8028-98c3b73c0fcc req-f5f416c6-4f87-4076-80fd-70da9e6aa268 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:31.607667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0ffb27fd-02ff-43c7-8028-98c3b73c0fcc req-f5f416c6-4f87-4076-80fd-70da9e6aa268 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:31.631103 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-0ffb27fd-02ff-43c7-8028-98c3b73c0fcc req-f5f416c6-4f87-4076-80fd-70da9e6aa268 service nova] Creating event network-changed:aa497ae6-661e-4ad4-a847-0576f80c3772 for instance 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 on n-h2-826529-8 Aug 03 01:48:31.641392 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-0ffb27fd-02ff-43c7-8028-98c3b73c0fcc req-f5f416c6-4f87-4076-80fd-70da9e6aa268 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081876 Aug 03 01:48:31.642420 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 178/336] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:31.653830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b9ae4de6-439c-4c9f-8d9c-644c12ce4173 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:31.661273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b9ae4de6-439c-4c9f-8d9c-644c12ce4173 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:31.668153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b9ae4de6-439c-4c9f-8d9c-644c12ce4173 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:31.670627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b9ae4de6-439c-4c9f-8d9c-644c12ce4173 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:31.676825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b9ae4de6-439c-4c9f-8d9c-644c12ce4173 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:31.677779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b9ae4de6-439c-4c9f-8d9c-644c12ce4173 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:31.747190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c4a3d8d5-424c-45ec-8341-5f0d253125e1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:31.760011 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c4a3d8d5-424c-45ec-8341-5f0d253125e1 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 200 len: 1456 microversion: 2.1 time: 0.983147 Aug 03 01:48:31.761087 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 159/337] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:30 2022] GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 1456 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:31.767581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-910eaadf-d2dd-452f-b59c-f749b7b0b3ec tempest-FlavorsAdminTestJSON-1784580708 tempest-FlavorsAdminTestJSON-1784580708-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "336548996"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:31.802287 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-910eaadf-d2dd-452f-b59c-f749b7b0b3ec tempest-FlavorsAdminTestJSON-1784580708 tempest-FlavorsAdminTestJSON-1784580708-project] HTTP exception thrown: Flavor 336548996 could not be found. Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-910eaadf-d2dd-452f-b59c-f749b7b0b3ec tempest-FlavorsAdminTestJSON-1784580708 tempest-FlavorsAdminTestJSON-1784580708-project] Request method failure captured: Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 106 Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPoCHBjFAh3MPRmxngkJ6qQTqhhPQjBgs8Jw5c1gP8iKT2Kx-3qNYxhPHmeFmaeSIdl5-RkeRKK3GyVhEacUEAfk6WAMbZ4H34_h8ZqwwbMjH5JIMvasYGECxAMTaUOC4CTUERipOY8kvvjHxcKEVGDs3IbvYTHF9NJngFT_nfF-pA Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: b0ed32c2c56d4835a86e7a170ecde6e1 Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FlavorsAdminTestJSON-1784580708 Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:31.817155 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:31.818801 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b0ed32c2c56d4835a86e7a170ecde6e1", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b0ed32c2c56d4835a86e7a170ecde6e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b0ed32c2c56d4835a86e7a170ecde6e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b0ed32c2c56d4835a86e7a170ecde6e1"}]}] Aug 03 01:48:31.818801 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FlavorsAdminTestJSON-1784580708 Aug 03 01:48:31.818801 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: b0ed32c2c56d4835a86e7a170ecde6e1 Aug 03 01:48:31.818801 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1784580708 Aug 03 01:48:31.818801 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FlavorsAdminTestJSON-1784580708-project Aug 03 01:48:31.818801 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:31.818801 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:31.818801 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: dcac2227fafd4c48a750d93575feec7e Aug 03 01:48:31.818801 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FlavorsAdminTestJSON-1784580708-project Aug 03 01:48:31.818801 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:48:31.818801 n-d-826529-8 devstack@n-api.service[125941]: {"server": {"name": "test", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "336548996"}} Aug 03 01:48:31.818801 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:31.818801 n-d-826529-8 devstack@n-api.service[125941]: exception: Flavor 336548996 could not be found. Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '336548996'}}} Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 336548996 could not be found. Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:31.820290 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 336548996 could not be found. Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:31.821789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:31.823325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:31.823325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:31.823325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:31.823325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 336548996 could not be found. Aug 03 01:48:31.823325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:31.840638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-910eaadf-d2dd-452f-b59c-f749b7b0b3ec tempest-FlavorsAdminTestJSON-1784580708 tempest-FlavorsAdminTestJSON-1784580708-project] Returning 400 to user: Flavor 336548996 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:31.842142 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-910eaadf-d2dd-452f-b59c-f749b7b0b3ec tempest-FlavorsAdminTestJSON-1784580708 tempest-FlavorsAdminTestJSON-1784580708-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.079878 Aug 03 01:48:31.844275 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 160/338] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:31 2022] POST /compute/v2.1/servers => generated 80 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 01:48:31.853123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7dc45405-18ab-40ff-a5c7-dded183abb46 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:31.862926 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:31.862926 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:31.917606 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7dc45405-18ab-40ff-a5c7-dded183abb46 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/336548996" status: 202 len: 0 microversion: 2.1 time: 0.068157 Aug 03 01:48:31.918453 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 161/339] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 01:48:31 2022] DELETE /compute/v2.1/flavors/336548996 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:48:31.928771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c3f9eb61-f30f-4d19-856c-6dbd360f50be tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:32.000197 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c3f9eb61-f30f-4d19-856c-6dbd360f50be tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060933 Aug 03 01:48:32.003142 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 162/340] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:32.028524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-89cc328f-b8d8-4416-ac5c-839237aead42 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-620251260", "id": 775062405, "os-flavor-access:is_public": "False"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:32.032993 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:32.032993 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:32.068720 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-89cc328f-b8d8-4416-ac5c-839237aead42 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.046834 Aug 03 01:48:32.078772 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 163/341] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:32 2022] POST /compute/v2.1/flavors => generated 411 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:32.083667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b71cecba-5fdf-40f0-87a7-60c19dff3d5e tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-622843557", "id": 61548305, "os-flavor-access:is_public": "True"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:32.165972 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b71cecba-5fdf-40f0-87a7-60c19dff3d5e tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.1 time: 0.086285 Aug 03 01:48:32.172584 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 164/342] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:32.188322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9a1d551f-c329-4868-96b9-6d9e8729a47b tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:32.252788 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9a1d551f-c329-4868-96b9-6d9e8729a47b tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.076454 Aug 03 01:48:32.258029 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 165/343] 10.222.0.67 () {58 vars in 1169 bytes} [Wed Aug 3 01:48:32 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:32.266950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-09cfcdca-2dbb-482c-b896-e9f296573370 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:32.306511 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-09cfcdca-2dbb-482c-b896-e9f296573370 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.043064 Aug 03 01:48:32.313414 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 166/344] 10.222.0.67 () {58 vars in 1177 bytes} [Wed Aug 3 01:48:32 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:32.326171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a25ee0be-f463-4422-a221-777b19d6ad22 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:32.342855 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a25ee0be-f463-4422-a221-777b19d6ad22 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.020459 Aug 03 01:48:32.351576 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 167/345] 10.222.0.67 () {58 vars in 1171 bytes} [Wed Aug 3 01:48:32 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:48:32.396373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b9ae4de6-439c-4c9f-8d9c-644c12ce4173 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:32.423581 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b9ae4de6-439c-4c9f-8d9c-644c12ce4173 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 200 len: 1321 microversion: 2.1 time: 0.774882 Aug 03 01:48:32.427710 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 179/346] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:31 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 1321 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:32.440672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-11e71ba6-4227-4d34-909b-b9f1511c690f tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:32.496879 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-11e71ba6-4227-4d34-909b-b9f1511c690f tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.067499 Aug 03 01:48:32.498405 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 180/347] 10.222.0.67 () {58 vars in 1169 bytes} [Wed Aug 3 01:48:32 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:32.510611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ebfed235-dee0-4635-afd7-b64f71869362 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:32.516139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ebfed235-dee0-4635-afd7-b64f71869362 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:32.532182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebfed235-dee0-4635-afd7-b64f71869362 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:32.534998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebfed235-dee0-4635-afd7-b64f71869362 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:32.539333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebfed235-dee0-4635-afd7-b64f71869362 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:32.540123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebfed235-dee0-4635-afd7-b64f71869362 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:32.935138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8cf1b736-de40-47db-95c8-84d7826f5114 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Calling method '.version_select at 0x7f5b138c3280>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:33.003807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ebfed235-dee0-4635-afd7-b64f71869362 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:33.019433 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ebfed235-dee0-4635-afd7-b64f71869362 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.517044 Aug 03 01:48:33.045555 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 181/348] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:32 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:33.058413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b04427c4-c666-471e-8a14-ea35cbd50f3e tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:33.135253 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b04427c4-c666-471e-8a14-ea35cbd50f3e tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5388 microversion: 2.1 time: 0.088657 Aug 03 01:48:33.142931 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 182/349] 10.222.0.67 () {58 vars in 1169 bytes} [Wed Aug 3 01:48:33 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:33.149135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e6b8bd08-43ed-4c0b-9c08-9c9a1dfe5ac3 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13d0ff70>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:33.302783 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8cf1b736-de40-47db-95c8-84d7826f5114 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7" status: 200 len: 371 microversion: 2.1 time: 0.946022 Aug 03 01:48:33.303934 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 168/350] 10.222.0.67 () {58 vars in 1242 bytes} [Wed Aug 3 01:48:32 2022] GET /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7 => generated 371 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:33.317037 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e6b8bd08-43ed-4c0b-9c08-9c9a1dfe5ac3 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.172222 Aug 03 01:48:33.318219 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 183/351] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:33 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:33.324190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-40f08331-c7c9-4325-8081-1a71bebe5f39 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:33.325097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-40f08331-c7c9-4325-8081-1a71bebe5f39 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:33.332108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-261a3dec-56df-47cb-b883-0b7b0489c67f tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:33.341841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40f08331-c7c9-4325-8081-1a71bebe5f39 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:33.345620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40f08331-c7c9-4325-8081-1a71bebe5f39 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:33.345620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40f08331-c7c9-4325-8081-1a71bebe5f39 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:33.345620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40f08331-c7c9-4325-8081-1a71bebe5f39 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:33.394099 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-261a3dec-56df-47cb-b883-0b7b0489c67f tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5388 microversion: 2.1 time: 0.068854 Aug 03 01:48:33.398698 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 184/352] 10.222.0.67 () {58 vars in 1175 bytes} [Wed Aug 3 01:48:33 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5388 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:33.407574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-534936bf-f58e-4b26-b005-4c3790417c13 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13d38c10>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:33.435962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40f08331-c7c9-4325-8081-1a71bebe5f39 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:33.439028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40f08331-c7c9-4325-8081-1a71bebe5f39 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:33.439969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-40f08331-c7c9-4325-8081-1a71bebe5f39 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lazy-loading 'fault' on Instance uuid ed63babc-ecd7-42f5-8c5a-2bf930298b3c {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:48:33.693385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-534936bf-f58e-4b26-b005-4c3790417c13 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:33.694342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-534936bf-f58e-4b26-b005-4c3790417c13 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:33.695426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-534936bf-f58e-4b26-b005-4c3790417c13 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:33.696027 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-534936bf-f58e-4b26-b005-4c3790417c13 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:33.809475 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-534936bf-f58e-4b26-b005-4c3790417c13 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7" status: 200 len: 328 microversion: 2.1 time: 0.408679 Aug 03 01:48:33.816333 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 185/353] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 3 01:48:33 2022] PUT /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7 => generated 328 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:33.824431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aee15c58-fce1-4d35-89a8-7dfd0d049f3c tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:33.896500 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aee15c58-fce1-4d35-89a8-7dfd0d049f3c tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5388 microversion: 2.1 time: 0.071903 Aug 03 01:48:33.897811 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 186/354] 10.222.0.67 () {58 vars in 1173 bytes} [Wed Aug 3 01:48:33 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5388 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:33.902880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e817b5ab-73cf-4485-a33a-141479dea00a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:33.907742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e817b5ab-73cf-4485-a33a-141479dea00a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:33.921056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e817b5ab-73cf-4485-a33a-141479dea00a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:33.927959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e817b5ab-73cf-4485-a33a-141479dea00a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:33.929076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e817b5ab-73cf-4485-a33a-141479dea00a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:33.929738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e817b5ab-73cf-4485-a33a-141479dea00a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:34.040151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-40f08331-c7c9-4325-8081-1a71bebe5f39 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dccc81c8286d41b69d04688322aafed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d622c1784b435c8d44d8f2067c5ddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:34.048469 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-40f08331-c7c9-4325-8081-1a71bebe5f39 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 200 len: 1456 microversion: 2.1 time: 0.739746 Aug 03 01:48:34.049050 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 169/355] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:33 2022] GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 1456 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:34.076146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1d58b60e-a1e2-4b9c-937c-fd7e1bde5f76 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:34.121797 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1d58b60e-a1e2-4b9c-937c-fd7e1bde5f76 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5388 microversion: 2.1 time: 0.071638 Aug 03 01:48:34.122400 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 170/356] 10.222.0.67 () {58 vars in 1169 bytes} [Wed Aug 3 01:48:34 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5388 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:34.136338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-8aced396-0fe3-4832-b617-3065d0102c28 req-e56efc51-d99b-4480-8a52-360d32bb12a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed63babc-ecd7-42f5-8c5a-2bf930298b3c", "name": "network-vif-deleted", "tag": "d7a2040c-8892-4e49-b05d-34f17a4fad4a"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:34.159921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8aced396-0fe3-4832-b617-3065d0102c28 req-e56efc51-d99b-4480-8a52-360d32bb12a1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:34.164478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8aced396-0fe3-4832-b617-3065d0102c28 req-e56efc51-d99b-4480-8a52-360d32bb12a1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:34.188883 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-8aced396-0fe3-4832-b617-3065d0102c28 req-e56efc51-d99b-4480-8a52-360d32bb12a1 service nova] Creating event network-vif-deleted:d7a2040c-8892-4e49-b05d-34f17a4fad4a for instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c on n-h1-826529-8 Aug 03 01:48:34.201789 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-8aced396-0fe3-4832-b617-3065d0102c28 req-e56efc51-d99b-4480-8a52-360d32bb12a1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069366 Aug 03 01:48:34.202732 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 171/357] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:34.214617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7e7503cd-08a4-4d98-9f06-4c53e9b0dc4a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:34.217221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7e7503cd-08a4-4d98-9f06-4c53e9b0dc4a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:34.246654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e7503cd-08a4-4d98-9f06-4c53e9b0dc4a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:34.247459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e7503cd-08a4-4d98-9f06-4c53e9b0dc4a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:34.248481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e7503cd-08a4-4d98-9f06-4c53e9b0dc4a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:34.249115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e7503cd-08a4-4d98-9f06-4c53e9b0dc4a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:34.794191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e817b5ab-73cf-4485-a33a-141479dea00a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:34.806504 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e817b5ab-73cf-4485-a33a-141479dea00a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 200 len: 1321 microversion: 2.1 time: 0.907355 Aug 03 01:48:34.810522 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 187/358] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:33 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 1321 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:35.129493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7e7503cd-08a4-4d98-9f06-4c53e9b0dc4a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:35.138879 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7e7503cd-08a4-4d98-9f06-4c53e9b0dc4a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.934571 Aug 03 01:48:35.139799 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 172/359] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:34 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:35.152529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-50fd078b-239c-4ecc-aabb-3cc074be5f19 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:35.158304 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:35.158304 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:35.221415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-586964268", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:35.230259 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-50fd078b-239c-4ecc-aabb-3cc074be5f19 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/61548305" status: 202 len: 0 microversion: 2.1 time: 0.088367 Aug 03 01:48:35.246300 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 173/360] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 01:48:35 2022] DELETE /compute/v2.1/flavors/61548305 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:48:35.274187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d972b34b-a465-40f4-992c-128200126520 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13896ca0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:35.372250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:48:35.466072 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d972b34b-a465-40f4-992c-128200126520 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.218248 Aug 03 01:48:35.475517 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 174/361] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:35 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:35.494045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3cbc05fc-9b56-4d2f-9cd9-4769879adecb tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:35.494731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3cbc05fc-9b56-4d2f-9cd9-4769879adecb tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:35.509803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3cbc05fc-9b56-4d2f-9cd9-4769879adecb tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:35.510253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3cbc05fc-9b56-4d2f-9cd9-4769879adecb tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:35.517593 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3cbc05fc-9b56-4d2f-9cd9-4769879adecb tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:35.518173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3cbc05fc-9b56-4d2f-9cd9-4769879adecb tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:35.544908 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-3cbc05fc-9b56-4d2f-9cd9-4769879adecb tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] HTTP exception thrown: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3cbc05fc-9b56-4d2f-9cd9-4769879adecb tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Request method failure captured: Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c HTTP/1.1 Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO6vBuZlfQRfpl2ZW3VOz41_IghacpEQrkWX3xfTtpzLfLTOWFK6LZL2e7YrvJTPnTTii9MYLse8sy5diZuxq5L0x8pV6SjnNq1R9F3otLoFidhHTt_Fa7TCOtHFn7h1qs_A9SnBjfCYFy8WJH6D3OK6BkKqEzP16YNL3C6S99gXhw Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 62d622c1784b435c8d44d8f2067c5ddf Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:35.553397 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:35.555012 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_62d622c1784b435c8d44d8f2067c5ddf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62d622c1784b435c8d44d8f2067c5ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/62d622c1784b435c8d44d8f2067c5ddf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62d622c1784b435c8d44d8f2067c5ddf"}]}] Aug 03 01:48:35.555012 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:35.555012 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 62d622c1784b435c8d44d8f2067c5ddf Aug 03 01:48:35.555012 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:35.555012 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersAdminTestJSON-1698606032-project Aug 03 01:48:35.555012 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:35.555012 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:35.555012 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: dccc81c8286d41b69d04688322aafed3 Aug 03 01:48:35.555012 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersAdminTestJSON-1698606032-project Aug 03 01:48:35.555012 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:35.555012 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. Aug 03 01:48:35.555012 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'ed63babc-ecd7-42f5-8c5a-2bf930298b3c'} Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:35.555737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. Aug 03 01:48:35.556830 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:35.558759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3cbc05fc-9b56-4d2f-9cd9-4769879adecb tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Returning 404 to user: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:35.558759 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3cbc05fc-9b56-4d2f-9cd9-4769879adecb tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 404 len: 111 microversion: 2.1 time: 0.078144 Aug 03 01:48:35.564702 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 175/362] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:35 2022] GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:35.570211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e08c22bd-bd65-4da9-8436-db944e0ecb1a tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:35.601220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=13 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:35.638850 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e08c22bd-bd65-4da9-8436-db944e0ecb1a tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072953 Aug 03 01:48:35.653808 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 176/363] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:35.665869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d0568d60-7336-401c-8dce-3d17639a3cfd tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:35.676563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d0568d60-7336-401c-8dce-3d17639a3cfd tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:35.698023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0568d60-7336-401c-8dce-3d17639a3cfd tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:35.698474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0568d60-7336-401c-8dce-3d17639a3cfd tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:35.699442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0568d60-7336-401c-8dce-3d17639a3cfd tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:35.709112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0568d60-7336-401c-8dce-3d17639a3cfd tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:35.728870 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-d0568d60-7336-401c-8dce-3d17639a3cfd tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] HTTP exception thrown: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d0568d60-7336-401c-8dce-3d17639a3cfd tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Request method failure captured: Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c HTTP/1.1 Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO6vBuZlfQRfpl2ZW3VOz41_IghacpEQrkWX3xfTtpzLfLTOWFK6LZL2e7YrvJTPnTTii9MYLse8sy5diZuxq5L0x8pV6SjnNq1R9F3otLoFidhHTt_Fa7TCOtHFn7h1qs_A9SnBjfCYFy8WJH6D3OK6BkKqEzP16YNL3C6S99gXhw Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 62d622c1784b435c8d44d8f2067c5ddf Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:35.730992 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:35.732382 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_62d622c1784b435c8d44d8f2067c5ddf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62d622c1784b435c8d44d8f2067c5ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/62d622c1784b435c8d44d8f2067c5ddf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62d622c1784b435c8d44d8f2067c5ddf"}]}] Aug 03 01:48:35.732382 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:35.732382 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 62d622c1784b435c8d44d8f2067c5ddf Aug 03 01:48:35.732382 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:35.732382 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersAdminTestJSON-1698606032-project Aug 03 01:48:35.732382 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:35.732382 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:35.732382 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: dccc81c8286d41b69d04688322aafed3 Aug 03 01:48:35.732382 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersAdminTestJSON-1698606032-project Aug 03 01:48:35.732382 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:35.732382 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. Aug 03 01:48:35.732382 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'ed63babc-ecd7-42f5-8c5a-2bf930298b3c'} Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:35.733094 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. Aug 03 01:48:35.734277 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:35.737645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d0568d60-7336-401c-8dce-3d17639a3cfd tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Returning 404 to user: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:35.739875 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d0568d60-7336-401c-8dce-3d17639a3cfd tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 404 len: 111 microversion: 2.1 time: 0.084525 Aug 03 01:48:35.743852 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 177/364] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:48:35 2022] DELETE /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:35.750690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fbb3bb12-0834-419d-bca8-8844d377a235 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:35.751720 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:35.751720 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:35.776085 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fbb3bb12-0834-419d-bca8-8844d377a235 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/775062405" status: 202 len: 0 microversion: 2.1 time: 0.030704 Aug 03 01:48:35.780114 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 178/365] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 01:48:35 2022] DELETE /compute/v2.1/flavors/775062405 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:48:35.789129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2dcd474a-5f9e-4e64-ae75-d80380c90eb8 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:35.790208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2dcd474a-5f9e-4e64-ae75-d80380c90eb8 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: ed63babc-ecd7-42f5-8c5a-2bf930298b3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:35.798478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2dcd474a-5f9e-4e64-ae75-d80380c90eb8 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:35.799748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2dcd474a-5f9e-4e64-ae75-d80380c90eb8 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:35.801450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2dcd474a-5f9e-4e64-ae75-d80380c90eb8 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:35.802187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2dcd474a-5f9e-4e64-ae75-d80380c90eb8 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:35.833701 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-2dcd474a-5f9e-4e64-ae75-d80380c90eb8 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] HTTP exception thrown: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2dcd474a-5f9e-4e64-ae75-d80380c90eb8 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Request method failure captured: Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c HTTP/1.1 Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO6vBuZlfQRfpl2ZW3VOz41_IghacpEQrkWX3xfTtpzLfLTOWFK6LZL2e7YrvJTPnTTii9MYLse8sy5diZuxq5L0x8pV6SjnNq1R9F3otLoFidhHTt_Fa7TCOtHFn7h1qs_A9SnBjfCYFy8WJH6D3OK6BkKqEzP16YNL3C6S99gXhw Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 62d622c1784b435c8d44d8f2067c5ddf Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:35.835724 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:35.836954 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_62d622c1784b435c8d44d8f2067c5ddf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62d622c1784b435c8d44d8f2067c5ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/62d622c1784b435c8d44d8f2067c5ddf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62d622c1784b435c8d44d8f2067c5ddf"}]}] Aug 03 01:48:35.836954 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:35.836954 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 62d622c1784b435c8d44d8f2067c5ddf Aug 03 01:48:35.836954 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:35.836954 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersAdminTestJSON-1698606032-project Aug 03 01:48:35.836954 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:35.836954 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:35.836954 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: dccc81c8286d41b69d04688322aafed3 Aug 03 01:48:35.836954 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersAdminTestJSON-1698606032-project Aug 03 01:48:35.836954 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:35.836954 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. Aug 03 01:48:35.836954 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'ed63babc-ecd7-42f5-8c5a-2bf930298b3c'} Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:35.837697 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. Aug 03 01:48:35.838810 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:35.841828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2dcd474a-5f9e-4e64-ae75-d80380c90eb8 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Returning 404 to user: Instance ed63babc-ecd7-42f5-8c5a-2bf930298b3c could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:35.842990 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2dcd474a-5f9e-4e64-ae75-d80380c90eb8 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c" status: 404 len: 111 microversion: 2.1 time: 0.060832 Aug 03 01:48:35.847045 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 179/366] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:35 2022] GET /compute/v2.1/servers/ed63babc-ecd7-42f5-8c5a-2bf930298b3c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:35.853486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b9f76f8e-a258-46c2-b563-da7e08772b6c tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:35.878071 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b9f76f8e-a258-46c2-b563-da7e08772b6c tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028605 Aug 03 01:48:35.879808 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 180/367] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:35.904506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d208df33-7e35-40a8-8798-59e97abd4b15 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:35.905406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d208df33-7e35-40a8-8798-59e97abd4b15 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:35.913711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d208df33-7e35-40a8-8798-59e97abd4b15 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:35.914510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d208df33-7e35-40a8-8798-59e97abd4b15 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:35.915588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d208df33-7e35-40a8-8798-59e97abd4b15 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:35.916339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d208df33-7e35-40a8-8798-59e97abd4b15 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:36.065724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:48:36.068125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:48:36.068855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:48:36.069537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:48:36.070342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:48:36.098761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:36.100799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:36.106350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:36.108516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:36.176700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Getting quotas for project bd6b5447e45547deb53aa1631e2ca1c7. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:48:36.187155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Getting quotas for user 137737f5122e46cc85ec51b8d76fb0c1 and project bd6b5447e45547deb53aa1631e2ca1c7. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:48:36.209384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d208df33-7e35-40a8-8798-59e97abd4b15 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:36.217140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.utils [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] cores quota exceeded for bd6b5447e45547deb53aa1631e2ca1c7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125942) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 03 01:48:36.218030 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 03 01:48:36.221910 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d208df33-7e35-40a8-8798-59e97abd4b15 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 200 len: 1321 microversion: 2.1 time: 0.339574 Aug 03 01:48:36.223316 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 181/368] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:35 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Request method failure captured: Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 144 Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPupL3rnJq-PBUZ_aZh57vMh0HZivNBvWCbnS-ESbVCip89RUa6UzxettuScZJupzwXAL45laefJVuIKLLIVDP20sw5O8NOcw3ddir4SnKOaLC0UFFcl0zNv3s7T2k6L460ZIjHxCu_4yCSQY6WpN9azMBqeyTMc3Vn941TjWpf5zc Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: bd6b5447e45547deb53aa1631e2ca1c7 Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-QuotasAdminNegativeTest-1524471278 Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:48:36.227498 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:48:36.228758 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd6b5447e45547deb53aa1631e2ca1c7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6b5447e45547deb53aa1631e2ca1c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd6b5447e45547deb53aa1631e2ca1c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6b5447e45547deb53aa1631e2ca1c7"}]}] Aug 03 01:48:36.228758 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-QuotasAdminNegativeTest-1524471278 Aug 03 01:48:36.228758 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: bd6b5447e45547deb53aa1631e2ca1c7 Aug 03 01:48:36.228758 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1524471278 Aug 03 01:48:36.228758 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-QuotasAdminNegativeTest-1524471278-project Aug 03 01:48:36.228758 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:36.228758 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:36.228758 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 137737f5122e46cc85ec51b8d76fb0c1 Aug 03 01:48:36.228758 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-QuotasAdminNegativeTest-1524471278-project Aug 03 01:48:36.228758 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:48:36.228758 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-586964268", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} Aug 03 01:48:36.228758 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-586964268', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452'}}} Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 03 01:48:36.229467 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:36.230426 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:36.232193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:36.233305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:36.233305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:36.233305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:36.233305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:36.233305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 03 01:48:36.233305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:36.233305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:36.233305 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ea7f0b52-5c55-471b-bd34-2e6db0f7a061 tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.414323 Aug 03 01:48:36.233305 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 188/369] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:34 2022] POST /compute/v2.1/servers => generated 111 bytes in 1417 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:36.240337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-63d4d343-656d-439f-8a43-460f846f294c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:36.240850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-63d4d343-656d-439f-8a43-460f846f294c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:36.241343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-765f868f-42ac-4bb6-84f8-9641cac8ab6d tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1161416322", "id": 1046339756, "os-flavor-access:is_public": "False"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:36.249431 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:36.249431 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:36.266074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63d4d343-656d-439f-8a43-460f846f294c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:36.266518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63d4d343-656d-439f-8a43-460f846f294c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:36.267428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63d4d343-656d-439f-8a43-460f846f294c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:36.272680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63d4d343-656d-439f-8a43-460f846f294c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:36.282391 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-765f868f-42ac-4bb6-84f8-9641cac8ab6d tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.049084 Aug 03 01:48:36.284808 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 189/370] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:36 2022] POST /compute/v2.1/flavors => generated 415 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:36.299220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4d90fd3b-1f19-4bf9-b9df-85bdddf9b601 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:36.302863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4d90fd3b-1f19-4bf9-b9df-85bdddf9b601 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:36.318446 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-63d4d343-656d-439f-8a43-460f846f294c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] HTTP exception thrown: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-63d4d343-656d-439f-8a43-460f846f294c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Request method failure captured: Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 HTTP/1.1 Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dO6vBuZlfQRfpl2ZW3VOz41_IghacpEQrkWX3xfTtpzLfLTOWFK6LZL2e7YrvJTPnTTii9MYLse8sy5diZuxq5L0x8pV6SjnNq1R9F3otLoFidhHTt_Fa7TCOtHFn7h1qs_A9SnBjfCYFy8WJH6D3OK6BkKqEzP16YNL3C6S99gXhw Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 62d622c1784b435c8d44d8f2067c5ddf Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:36.323606 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:36.325203 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_62d622c1784b435c8d44d8f2067c5ddf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62d622c1784b435c8d44d8f2067c5ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/62d622c1784b435c8d44d8f2067c5ddf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62d622c1784b435c8d44d8f2067c5ddf"}]}] Aug 03 01:48:36.325203 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:36.325203 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 62d622c1784b435c8d44d8f2067c5ddf Aug 03 01:48:36.325203 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:36.325203 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersAdminTestJSON-1698606032-project Aug 03 01:48:36.325203 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:36.325203 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:36.325203 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: dccc81c8286d41b69d04688322aafed3 Aug 03 01:48:36.325203 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersAdminTestJSON-1698606032-project Aug 03 01:48:36.325203 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:36.325203 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. Aug 03 01:48:36.325203 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '8f22df40-9a6d-46da-930d-d6ac26a21ca8'} Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:36.325864 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. Aug 03 01:48:36.326936 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:36.328015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d90fd3b-1f19-4bf9-b9df-85bdddf9b601 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:36.330095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-63d4d343-656d-439f-8a43-460f846f294c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Returning 404 to user: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:36.331248 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-63d4d343-656d-439f-8a43-460f846f294c tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 404 len: 111 microversion: 2.1 time: 0.106863 Aug 03 01:48:36.333343 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 182/371] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:48:36 2022] DELETE /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:36.336450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d90fd3b-1f19-4bf9-b9df-85bdddf9b601 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:36.337318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d90fd3b-1f19-4bf9-b9df-85bdddf9b601 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:36.337770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d90fd3b-1f19-4bf9-b9df-85bdddf9b601 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:36.339877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-84c4da3e-3ab4-4de9-ac88-81d9b028248c tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Action: 'update', calling method: .version_select at 0x7f5b138964c0>, body: {"quota_set": {"cores": 20}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:36.829722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4d90fd3b-1f19-4bf9-b9df-85bdddf9b601 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:36.881706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:36.887268 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4d90fd3b-1f19-4bf9-b9df-85bdddf9b601 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.599336 Aug 03 01:48:36.903240 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 190/372] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:36 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:36.914577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-39cdf297-885d-4396-94bb-5b99b54832b5 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:36.955006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84c4da3e-3ab4-4de9-ac88-81d9b028248c tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:36.955460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84c4da3e-3ab4-4de9-ac88-81d9b028248c tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:36.956268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84c4da3e-3ab4-4de9-ac88-81d9b028248c tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:36.958824 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-39cdf297-885d-4396-94bb-5b99b54832b5 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052368 Aug 03 01:48:36.960291 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 191/373] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:36.966720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84c4da3e-3ab4-4de9-ac88-81d9b028248c tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:36.986627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a5ee199f-ca4a-4a19-af54-28da3e18be72 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:36.988159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a5ee199f-ca4a-4a19-af54-28da3e18be72 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] [instance: 8f22df40-9a6d-46da-930d-d6ac26a21ca8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:37.003016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5ee199f-ca4a-4a19-af54-28da3e18be72 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:37.003999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5ee199f-ca4a-4a19-af54-28da3e18be72 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:37.005398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5ee199f-ca4a-4a19-af54-28da3e18be72 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:37.006114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5ee199f-ca4a-4a19-af54-28da3e18be72 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:37.029827 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-a5ee199f-ca4a-4a19-af54-28da3e18be72 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] HTTP exception thrown: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a5ee199f-ca4a-4a19-af54-28da3e18be72 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Request method failure captured: Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 HTTP/1.1 Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dO6vBuZlfQRfpl2ZW3VOz41_IghacpEQrkWX3xfTtpzLfLTOWFK6LZL2e7YrvJTPnTTii9MYLse8sy5diZuxq5L0x8pV6SjnNq1R9F3otLoFidhHTt_Fa7TCOtHFn7h1qs_A9SnBjfCYFy8WJH6D3OK6BkKqEzP16YNL3C6S99gXhw Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 62d622c1784b435c8d44d8f2067c5ddf Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:48:37.031530 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:48:37.032812 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_62d622c1784b435c8d44d8f2067c5ddf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62d622c1784b435c8d44d8f2067c5ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/62d622c1784b435c8d44d8f2067c5ddf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62d622c1784b435c8d44d8f2067c5ddf"}]}] Aug 03 01:48:37.032812 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:37.032812 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 62d622c1784b435c8d44d8f2067c5ddf Aug 03 01:48:37.032812 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1698606032 Aug 03 01:48:37.032812 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-DeleteServersAdminTestJSON-1698606032-project Aug 03 01:48:37.032812 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:37.032812 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:37.032812 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: dccc81c8286d41b69d04688322aafed3 Aug 03 01:48:37.032812 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-DeleteServersAdminTestJSON-1698606032-project Aug 03 01:48:37.032812 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:37.032812 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. Aug 03 01:48:37.032812 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '8f22df40-9a6d-46da-930d-d6ac26a21ca8'} Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:37.033513 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. Aug 03 01:48:37.034622 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:37.037152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a5ee199f-ca4a-4a19-af54-28da3e18be72 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] Returning 404 to user: Instance 8f22df40-9a6d-46da-930d-d6ac26a21ca8 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:37.037152 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a5ee199f-ca4a-4a19-af54-28da3e18be72 tempest-DeleteServersAdminTestJSON-1698606032 tempest-DeleteServersAdminTestJSON-1698606032-project] 10.222.0.67 "GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8" status: 404 len: 111 microversion: 2.1 time: 0.071473 Aug 03 01:48:37.038288 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 192/374] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:36 2022] GET /compute/v2.1/servers/8f22df40-9a6d-46da-930d-d6ac26a21ca8 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:37.044274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4b73b80a-4d71-47db-97e5-779cebf42085 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13c89f70>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:37.125965 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-84c4da3e-3ab4-4de9-ac88-81d9b028248c tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7" status: 200 len: 329 microversion: 2.1 time: 0.791228 Aug 03 01:48:37.129553 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4b73b80a-4d71-47db-97e5-779cebf42085 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.089897 Aug 03 01:48:37.135493 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 183/375] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 3 01:48:36 2022] PUT /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7 => generated 329 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:37.139447 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 193/376] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:37 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:37.163580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-54fe9b79-5e50-4900-8710-ad9f8369ea36 tempest-FlavorsAdminTestJSON-1784580708 tempest-FlavorsAdminTestJSON-1784580708-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:37.219805 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-54fe9b79-5e50-4900-8710-ad9f8369ea36 tempest-FlavorsAdminTestJSON-1784580708 tempest-FlavorsAdminTestJSON-1784580708-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079161 Aug 03 01:48:37.220728 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 194/377] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:37.227033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6926f451-8a11-4e7b-a7f9-6853f7f553d0 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Calling method '.version_select at 0x7f5b13c89310>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:37.399918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0c729b62-195f-4612-8fe8-09f6e2dc642f tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Calling method '.version_select at 0x7f5b13896790>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:37.405789 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:37.405789 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:37.408269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c729b62-195f-4612-8fe8-09f6e2dc642f tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:37.409063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c729b62-195f-4612-8fe8-09f6e2dc642f tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:37.411619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c729b62-195f-4612-8fe8-09f6e2dc642f tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:37.412581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c729b62-195f-4612-8fe8-09f6e2dc642f tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:37.474282 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0c729b62-195f-4612-8fe8-09f6e2dc642f tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.333446 Aug 03 01:48:37.476230 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 184/378] 10.222.0.67 () {58 vars in 1128 bytes} [Wed Aug 3 01:48:37 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:37.486156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d67a8c55-eaae-4899-b92f-a519c645036c tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:37.487729 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:37.487729 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:37.504263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=10,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:37.520881 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d67a8c55-eaae-4899-b92f-a519c645036c tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1046339756" status: 202 len: 0 microversion: 2.1 time: 0.041415 Aug 03 01:48:37.522514 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 185/379] 10.222.0.67 () {58 vars in 1161 bytes} [Wed Aug 3 01:48:37 2022] DELETE /compute/v2.1/flavors/1046339756 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:48:37.551692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e9983b31-1402-4cf4-ba5e-da5a15791f6c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:37.552517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e9983b31-1402-4cf4-ba5e-da5a15791f6c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:37.572517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9983b31-1402-4cf4-ba5e-da5a15791f6c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:37.572984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9983b31-1402-4cf4-ba5e-da5a15791f6c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:37.573786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9983b31-1402-4cf4-ba5e-da5a15791f6c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:37.574234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9983b31-1402-4cf4-ba5e-da5a15791f6c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:37.902809 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6926f451-8a11-4e7b-a7f9-6853f7f553d0 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7" status: 200 len: 371 microversion: 2.1 time: 0.679116 Aug 03 01:48:37.907307 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 195/380] 10.222.0.67 () {58 vars in 1242 bytes} [Wed Aug 3 01:48:37 2022] GET /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7 => generated 371 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:38.108917 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c27e991f-452a-4de9-bf3e-ab9e02b08f94 tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Calling method '.version_select at 0x7f5b13c6df70>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:38.112391 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:38.112391 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:38.114737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c27e991f-452a-4de9-bf3e-ab9e02b08f94 tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '34aa75eff6bc467b8b91e4e17fb48817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e21e65c5154d2b9534e4ef26bc2cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c27e991f-452a-4de9-bf3e-ab9e02b08f94 tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Request method failure captured: Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPzfQOxNNgwX60iadzdMvdtAI7V9IROka7bWE7CCl2BQYTkDHRrMEPLJz0Ros843nE_UaSNQJaFRi0GGCOemfkTFIk5hwuZ2NxwQBF14n7PTz8NvZe9mPZNj24RBsq-zsXrEDhMK3LicFxZjbv01d0xDyI1YGtQPogTEL--Wkx9kWc Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 58e21e65c5154d2b9534e4ef26bc2cfc Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:48:38.116996 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:48:38.118217 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_58e21e65c5154d2b9534e4ef26bc2cfc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58e21e65c5154d2b9534e4ef26bc2cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/58e21e65c5154d2b9534e4ef26bc2cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58e21e65c5154d2b9534e4ef26bc2cfc"}]}] Aug 03 01:48:38.118217 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:38.118217 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 58e21e65c5154d2b9534e4ef26bc2cfc Aug 03 01:48:38.118217 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:38.118217 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-HostsAdminNegativeTestJSON-1290537893-project Aug 03 01:48:38.118217 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:38.118217 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:38.118217 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 34aa75eff6bc467b8b91e4e17fb48817 Aug 03 01:48:38.118217 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1290537893-project Aug 03 01:48:38.118217 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:48:38.118217 n-d-826529-8 devstack@n-api.service[125942]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 03 01:48:38.118217 n-d-826529-8 devstack@n-api.service[125942]: action_args: {} Aug 03 01:48:38.118217 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:38.119206 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 03 01:48:38.120473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:38.123699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c27e991f-452a-4de9-bf3e-ab9e02b08f94 tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:38.125310 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c27e991f-452a-4de9-bf3e-ab9e02b08f94 tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] 10.222.0.67 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.216214 Aug 03 01:48:38.126404 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 196/381] 10.222.0.67 () {58 vars in 1128 bytes} [Wed Aug 3 01:48:37 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 218 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:38.141478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-811628df-b7fd-471e-ade8-46d73fad73b9 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:38.210589 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-811628df-b7fd-471e-ade8-46d73fad73b9 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082561 Aug 03 01:48:38.235595 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 197/382] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:38.242624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-6f6d2596-11f7-4245-90d9-bbcd58eb92d0 req-2a479821-23f2-4fb3-a1fc-aa6c522acf1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c808b6-416a-4dcb-af4e-cfc78f56dfa3", "name": "network-vif-plugged", "status": "completed", "tag": "aa497ae6-661e-4ad4-a847-0576f80c3772"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:38.258387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6f6d2596-11f7-4245-90d9-bbcd58eb92d0 req-2a479821-23f2-4fb3-a1fc-aa6c522acf1e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:38.259046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6f6d2596-11f7-4245-90d9-bbcd58eb92d0 req-2a479821-23f2-4fb3-a1fc-aa6c522acf1e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:38.268697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e9983b31-1402-4cf4-ba5e-da5a15791f6c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:38.273606 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-6f6d2596-11f7-4245-90d9-bbcd58eb92d0 req-2a479821-23f2-4fb3-a1fc-aa6c522acf1e service nova] Creating event network-vif-plugged:aa497ae6-661e-4ad4-a847-0576f80c3772 for instance 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 on n-h2-826529-8 Aug 03 01:48:38.276438 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e9983b31-1402-4cf4-ba5e-da5a15791f6c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 200 len: 1321 microversion: 2.1 time: 0.752554 Aug 03 01:48:38.287855 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-6f6d2596-11f7-4245-90d9-bbcd58eb92d0 req-2a479821-23f2-4fb3-a1fc-aa6c522acf1e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050757 Aug 03 01:48:38.288471 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 198/383] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:38.304280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7ec14d62-5819-4261-9399-eaa5de5649b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:38.305250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7ec14d62-5819-4261-9399-eaa5de5649b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:38.312775 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 186/384] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:37 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 1321 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:38.330116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ec14d62-5819-4261-9399-eaa5de5649b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:38.333001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ec14d62-5819-4261-9399-eaa5de5649b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:38.333355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7c4f9b85-bc1a-42a5-878b-759968379a12 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Action: 'update', calling method: .version_select at 0x7f5b138b7790>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:38.334198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ec14d62-5819-4261-9399-eaa5de5649b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:38.336419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ec14d62-5819-4261-9399-eaa5de5649b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:38.584471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c4f9b85-bc1a-42a5-878b-759968379a12 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:38.589513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c4f9b85-bc1a-42a5-878b-759968379a12 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:38.590467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c4f9b85-bc1a-42a5-878b-759968379a12 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:38.590981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c4f9b85-bc1a-42a5-878b-759968379a12 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:38.639892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:38.751660 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7c4f9b85-bc1a-42a5-878b-759968379a12 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7" status: 200 len: 328 microversion: 2.1 time: 0.427223 Aug 03 01:48:38.757309 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 187/385] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 3 01:48:38 2022] PUT /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7 => generated 328 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:38.772448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2b72e140-db84-4ba6-9a3c-ce75e8e4045e tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Calling method '.version_select at 0x7f5b13852940>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:38.774593 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:38.774593 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:38.776100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2b72e140-db84-4ba6-9a3c-ce75e8e4045e tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '34aa75eff6bc467b8b91e4e17fb48817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e21e65c5154d2b9534e4ef26bc2cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2b72e140-db84-4ba6-9a3c-ce75e8e4045e tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Request method failure captured: Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-hosts/n-d-826529-8/reboot HTTP/1.1 Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPzfQOxNNgwX60iadzdMvdtAI7V9IROka7bWE7CCl2BQYTkDHRrMEPLJz0Ros843nE_UaSNQJaFRi0GGCOemfkTFIk5hwuZ2NxwQBF14n7PTz8NvZe9mPZNj24RBsq-zsXrEDhMK3LicFxZjbv01d0xDyI1YGtQPogTEL--Wkx9kWc Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 58e21e65c5154d2b9534e4ef26bc2cfc Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:38.778106 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:38.779567 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_58e21e65c5154d2b9534e4ef26bc2cfc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58e21e65c5154d2b9534e4ef26bc2cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/58e21e65c5154d2b9534e4ef26bc2cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58e21e65c5154d2b9534e4ef26bc2cfc"}]}] Aug 03 01:48:38.779567 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:38.779567 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 58e21e65c5154d2b9534e4ef26bc2cfc Aug 03 01:48:38.779567 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:38.779567 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HostsAdminNegativeTestJSON-1290537893-project Aug 03 01:48:38.779567 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:38.779567 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:38.779567 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 34aa75eff6bc467b8b91e4e17fb48817 Aug 03 01:48:38.779567 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1290537893-project Aug 03 01:48:38.779567 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:48:38.779567 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 03 01:48:38.779567 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'n-d-826529-8'} Aug 03 01:48:38.779567 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:38.780271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 03 01:48:38.781268 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:38.782171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2b72e140-db84-4ba6-9a3c-ce75e8e4045e tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:38.782171 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2b72e140-db84-4ba6-9a3c-ce75e8e4045e tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-d-826529-8/reboot" status: 403 len: 111 microversion: 2.1 time: 0.028069 Aug 03 01:48:38.783377 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 188/386] 10.222.0.67 () {58 vars in 1188 bytes} [Wed Aug 3 01:48:38 2022] GET /compute/v2.1/os-hosts/n-d-826529-8/reboot => generated 111 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:38.790949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2cc64ba1-4354-417e-a7f3-1a74d969f71c tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b138b7700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:38.799494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7ec14d62-5819-4261-9399-eaa5de5649b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:38.808434 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7ec14d62-5819-4261-9399-eaa5de5649b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.518778 Aug 03 01:48:38.809003 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 199/387] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:38 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:38.814105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d5274099-4478-4df3-a66e-51f7a215d419 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-748697622", "id": 1777161807, "os-flavor-access:is_public": "True"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:38.819867 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:38.819867 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:38.857934 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d5274099-4478-4df3-a66e-51f7a215d419 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.047639 Aug 03 01:48:38.867157 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 200/388] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:38 2022] POST /compute/v2.1/flavors => generated 413 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:38.873951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-57f0d5ec-1adb-483d-883c-9430071dabbd tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Calling method '.version_select at 0x7f5b13c6d550>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:38.876877 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:38.876877 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:38.890517 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2cc64ba1-4354-417e-a7f3-1a74d969f71c tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.104807 Aug 03 01:48:38.895657 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 189/389] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:38 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:38.908574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9268d637-b59c-4ede-be29-83d83cf4bc0c tempest-FlavorsAdminTestJSON-1784580708 tempest-FlavorsAdminTestJSON-1784580708-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:38.910094 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-57f0d5ec-1adb-483d-883c-9430071dabbd tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-57f0d5ec-1adb-483d-883c-9430071dabbd tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Request method failure captured: Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dP0D0hCdSwvOuKcZdvSq_BAtB_Z05MwdVjtfSQ6yhE8QayZcXekNsadWqwtOd_84FRV4o1kko2tJaYLDzBopbWLD6gINJg6kuY44T8fH9F1U4sHCA5q5xVIaEiGRTNnOUteQGb8jGwzLEo7d7YZ1Rw0bQ9Ow48o_aKcovidgdjHxfA Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:48:38.914597 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:48:38.916156 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_40438bc67f234c12bfdf760fcb7ea395", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}] Aug 03 01:48:38.916156 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:38.916156 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:38.916156 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:38.916156 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:38.916156 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:38.916156 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:38.916156 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 79b474ea90124ced99834ac4fff45405 Aug 03 01:48:38.916156 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:38.916156 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:48:38.916156 n-d-826529-8 devstack@n-api.service[125942]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:38.916156 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'nonexistent_hostname'} Aug 03 01:48:38.916156 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:48:38.917842 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 03 01:48:38.920813 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:38.922189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:38.922189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:38.922189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:38.922189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:38.922189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:38.922189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:38.922189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:38.922189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:38.922189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:38.922189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:38.922189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:38.922189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-57f0d5ec-1adb-483d-883c-9430071dabbd tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:38.924549 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-57f0d5ec-1adb-483d-883c-9430071dabbd tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.056089 Aug 03 01:48:38.929062 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 201/390] 10.222.0.67 () {58 vars in 1212 bytes} [Wed Aug 3 01:48:38 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:48:38.942059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7660a065-1792-48c3-97ba-728b7979b11b tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Calling method '.version_select at 0x7f5b13c89790>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:38.945833 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:38.945833 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:38.950099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7660a065-1792-48c3-97ba-728b7979b11b tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '34aa75eff6bc467b8b91e4e17fb48817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e21e65c5154d2b9534e4ef26bc2cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7660a065-1792-48c3-97ba-728b7979b11b tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Request method failure captured: Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-hosts/n-d-826529-8 HTTP/1.1 Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPzfQOxNNgwX60iadzdMvdtAI7V9IROka7bWE7CCl2BQYTkDHRrMEPLJz0Ros843nE_UaSNQJaFRi0GGCOemfkTFIk5hwuZ2NxwQBF14n7PTz8NvZe9mPZNj24RBsq-zsXrEDhMK3LicFxZjbv01d0xDyI1YGtQPogTEL--Wkx9kWc Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 58e21e65c5154d2b9534e4ef26bc2cfc Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:48:38.954387 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:48:38.955647 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_58e21e65c5154d2b9534e4ef26bc2cfc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58e21e65c5154d2b9534e4ef26bc2cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/58e21e65c5154d2b9534e4ef26bc2cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58e21e65c5154d2b9534e4ef26bc2cfc"}]}] Aug 03 01:48:38.955647 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:38.955647 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 58e21e65c5154d2b9534e4ef26bc2cfc Aug 03 01:48:38.955647 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:38.955647 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-HostsAdminNegativeTestJSON-1290537893-project Aug 03 01:48:38.955647 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:38.955647 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:38.955647 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 34aa75eff6bc467b8b91e4e17fb48817 Aug 03 01:48:38.955647 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1290537893-project Aug 03 01:48:38.955647 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:48:38.955647 n-d-826529-8 devstack@n-api.service[125942]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 03 01:48:38.955647 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'n-d-826529-8'} Aug 03 01:48:38.955647 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:38.956342 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 03 01:48:38.957533 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:38.963753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7660a065-1792-48c3-97ba-728b7979b11b tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:38.966806 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7660a065-1792-48c3-97ba-728b7979b11b tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-d-826529-8" status: 403 len: 109 microversion: 2.1 time: 0.030527 Aug 03 01:48:38.971778 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 202/391] 10.222.0.67 () {58 vars in 1167 bytes} [Wed Aug 3 01:48:38 2022] GET /compute/v2.1/os-hosts/n-d-826529-8 => generated 109 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 03 01:48:38.979714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6043cb11-bcdf-46ae-9f3d-8148589b61f8 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Calling method '.version_select at 0x7f5b13c89280>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:38.985723 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9268d637-b59c-4ede-be29-83d83cf4bc0c tempest-FlavorsAdminTestJSON-1784580708 tempest-FlavorsAdminTestJSON-1784580708-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.089430 Aug 03 01:48:38.989990 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 190/392] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:38 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:39.012389 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-6043cb11-bcdf-46ae-9f3d-8148589b61f8 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6043cb11-bcdf-46ae-9f3d-8148589b61f8 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Request method failure captured: Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dP0D0hCdSwvOuKcZdvSq_BAtB_Z05MwdVjtfSQ6yhE8QayZcXekNsadWqwtOd_84FRV4o1kko2tJaYLDzBopbWLD6gINJg6kuY44T8fH9F1U4sHCA5q5xVIaEiGRTNnOUteQGb8jGwzLEo7d7YZ1Rw0bQ9Ow48o_aKcovidgdjHxfA Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:48:39.014263 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:48:39.015885 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_40438bc67f234c12bfdf760fcb7ea395", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}] Aug 03 01:48:39.015885 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:39.015885 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:39.015885 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:39.015885 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:39.015885 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:39.015885 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:39.015885 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 79b474ea90124ced99834ac4fff45405 Aug 03 01:48:39.015885 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:39.015885 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:48:39.015885 n-d-826529-8 devstack@n-api.service[125942]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:39.015885 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'nonexistent_hostname'} Aug 03 01:48:39.015885 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.016775 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:39.018025 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.024662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6043cb11-bcdf-46ae-9f3d-8148589b61f8 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:39.026601 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6043cb11-bcdf-46ae-9f3d-8148589b61f8 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.051499 Aug 03 01:48:39.027911 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 203/393] 10.222.0.67 () {58 vars in 1191 bytes} [Wed Aug 3 01:48:38 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 03 01:48:39.030144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-15a0c3d2-53e3-448a-becc-fb703ae4e587 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:39.030857 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:39.030857 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:39.038322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8f6f5a11-5ebc-4f7c-8202-bd2a57ebd41a tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Calling method '.version_select at 0x7f5b13c6dca0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:39.039543 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:39.039543 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:39.040751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8f6f5a11-5ebc-4f7c-8202-bd2a57ebd41a tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '34aa75eff6bc467b8b91e4e17fb48817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e21e65c5154d2b9534e4ef26bc2cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8f6f5a11-5ebc-4f7c-8202-bd2a57ebd41a tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Request method failure captured: Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-hosts/n-d-826529-8/shutdown HTTP/1.1 Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPzfQOxNNgwX60iadzdMvdtAI7V9IROka7bWE7CCl2BQYTkDHRrMEPLJz0Ros843nE_UaSNQJaFRi0GGCOemfkTFIk5hwuZ2NxwQBF14n7PTz8NvZe9mPZNj24RBsq-zsXrEDhMK3LicFxZjbv01d0xDyI1YGtQPogTEL--Wkx9kWc Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 58e21e65c5154d2b9534e4ef26bc2cfc Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:48:39.043562 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:48:39.046224 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_58e21e65c5154d2b9534e4ef26bc2cfc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58e21e65c5154d2b9534e4ef26bc2cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/58e21e65c5154d2b9534e4ef26bc2cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58e21e65c5154d2b9534e4ef26bc2cfc"}]}] Aug 03 01:48:39.046224 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:39.046224 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 58e21e65c5154d2b9534e4ef26bc2cfc Aug 03 01:48:39.046224 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:39.046224 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-HostsAdminNegativeTestJSON-1290537893-project Aug 03 01:48:39.046224 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:39.046224 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:39.046224 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 34aa75eff6bc467b8b91e4e17fb48817 Aug 03 01:48:39.046224 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1290537893-project Aug 03 01:48:39.046224 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:48:39.046224 n-d-826529-8 devstack@n-api.service[125942]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 03 01:48:39.046224 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'n-d-826529-8'} Aug 03 01:48:39.046224 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:39.047121 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 03 01:48:39.048379 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.049472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8f6f5a11-5ebc-4f7c-8202-bd2a57ebd41a tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:39.049472 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8f6f5a11-5ebc-4f7c-8202-bd2a57ebd41a tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-d-826529-8/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.011561 Aug 03 01:48:39.050190 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 204/394] 10.222.0.67 () {58 vars in 1194 bytes} [Wed Aug 3 01:48:39 2022] GET /compute/v2.1/os-hosts/n-d-826529-8/shutdown => generated 113 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:39.061385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-97500020", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:39.089211 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-15a0c3d2-53e3-448a-becc-fb703ae4e587 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1777161807" status: 202 len: 0 microversion: 2.1 time: 0.080871 Aug 03 01:48:39.094230 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 191/395] 10.222.0.67 () {58 vars in 1161 bytes} [Wed Aug 3 01:48:39 2022] DELETE /compute/v2.1/flavors/1777161807 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:48:39.096784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2fdc050f-0b28-4ded-bc33-ec37c899501a tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Calling method '.version_select at 0x7f5b13896790>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:39.097616 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:39.097616 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:39.115910 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-2fdc050f-0b28-4ded-bc33-ec37c899501a tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2fdc050f-0b28-4ded-bc33-ec37c899501a tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Request method failure captured: Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dP0D0hCdSwvOuKcZdvSq_BAtB_Z05MwdVjtfSQ6yhE8QayZcXekNsadWqwtOd_84FRV4o1kko2tJaYLDzBopbWLD6gINJg6kuY44T8fH9F1U4sHCA5q5xVIaEiGRTNnOUteQGb8jGwzLEo7d7YZ1Rw0bQ9Ow48o_aKcovidgdjHxfA Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:48:39.118494 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:48:39.120344 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_40438bc67f234c12bfdf760fcb7ea395", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}] Aug 03 01:48:39.120344 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:39.120344 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:39.120344 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:39.120344 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:39.120344 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:39.120344 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:39.120344 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 79b474ea90124ced99834ac4fff45405 Aug 03 01:48:39.120344 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:39.120344 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:48:39.120344 n-d-826529-8 devstack@n-api.service[125941]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:39.120344 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'nonexistent_hostname'} Aug 03 01:48:39.120344 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:48:39.121692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 03 01:48:39.123097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:39.124299 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:39.124299 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.124299 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.124299 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.124299 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.124299 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.124299 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.124299 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:39.124299 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:39.124299 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:39.124299 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.127385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2fdc050f-0b28-4ded-bc33-ec37c899501a tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:39.130237 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2fdc050f-0b28-4ded-bc33-ec37c899501a tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.035947 Aug 03 01:48:39.134784 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 192/396] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 3 01:48:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:48:39.140199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ad83cd8c-924d-4d4a-a6c2-5fe691029ed7 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:39.165334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:48:39.176290 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ad83cd8c-924d-4d4a-a6c2-5fe691029ed7 tempest-FlavorsAdminTestJSON-1221048614 tempest-FlavorsAdminTestJSON-1221048614-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039540 Aug 03 01:48:39.181031 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 193/397] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:39.197148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9bffd9af-bc60-4e58-bfba-5851c8fc53a4 tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Calling method '.version_select at 0x7f5b13852310>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:39.199989 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:39.199989 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:39.203911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9bffd9af-bc60-4e58-bfba-5851c8fc53a4 tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '34aa75eff6bc467b8b91e4e17fb48817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e21e65c5154d2b9534e4ef26bc2cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9bffd9af-bc60-4e58-bfba-5851c8fc53a4 tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Request method failure captured: Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-hosts/n-d-826529-8/startup HTTP/1.1 Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPzfQOxNNgwX60iadzdMvdtAI7V9IROka7bWE7CCl2BQYTkDHRrMEPLJz0Ros843nE_UaSNQJaFRi0GGCOemfkTFIk5hwuZ2NxwQBF14n7PTz8NvZe9mPZNj24RBsq-zsXrEDhMK3LicFxZjbv01d0xDyI1YGtQPogTEL--Wkx9kWc Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 58e21e65c5154d2b9534e4ef26bc2cfc Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:39.206986 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:39.208289 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_58e21e65c5154d2b9534e4ef26bc2cfc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58e21e65c5154d2b9534e4ef26bc2cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/58e21e65c5154d2b9534e4ef26bc2cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58e21e65c5154d2b9534e4ef26bc2cfc"}]}] Aug 03 01:48:39.208289 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:39.208289 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 58e21e65c5154d2b9534e4ef26bc2cfc Aug 03 01:48:39.208289 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:39.208289 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HostsAdminNegativeTestJSON-1290537893-project Aug 03 01:48:39.208289 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:39.208289 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:39.208289 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 34aa75eff6bc467b8b91e4e17fb48817 Aug 03 01:48:39.208289 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1290537893-project Aug 03 01:48:39.208289 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:48:39.208289 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 03 01:48:39.208289 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'n-d-826529-8'} Aug 03 01:48:39.208289 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:39.209174 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 03 01:48:39.210405 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.213438 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9bffd9af-bc60-4e58-bfba-5851c8fc53a4 tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:39.214293 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9bffd9af-bc60-4e58-bfba-5851c8fc53a4 tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] 10.222.0.67 "GET /compute/v2.1/os-hosts/n-d-826529-8/startup" status: 403 len: 110 microversion: 2.1 time: 0.029106 Aug 03 01:48:39.215059 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 194/398] 10.222.0.67 () {58 vars in 1191 bytes} [Wed Aug 3 01:48:39 2022] GET /compute/v2.1/os-hosts/n-d-826529-8/startup => generated 110 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:39.233961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e6cb3c6-dedc-4914-bf10-e6b2ea64f3a5 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Calling method '.version_select at 0x7f5b13896430>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:39.269172 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-3e6cb3c6-dedc-4914-bf10-e6b2ea64f3a5 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e6cb3c6-dedc-4914-bf10-e6b2ea64f3a5 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Request method failure captured: Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dP0D0hCdSwvOuKcZdvSq_BAtB_Z05MwdVjtfSQ6yhE8QayZcXekNsadWqwtOd_84FRV4o1kko2tJaYLDzBopbWLD6gINJg6kuY44T8fH9F1U4sHCA5q5xVIaEiGRTNnOUteQGb8jGwzLEo7d7YZ1Rw0bQ9Ow48o_aKcovidgdjHxfA Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:48:39.274197 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:48:39.275522 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_40438bc67f234c12bfdf760fcb7ea395", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}] Aug 03 01:48:39.275522 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:39.275522 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:39.275522 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:39.275522 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:39.275522 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:39.275522 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:39.275522 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 79b474ea90124ced99834ac4fff45405 Aug 03 01:48:39.275522 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:39.275522 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:48:39.275522 n-d-826529-8 devstack@n-api.service[125941]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:39.275522 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'nonexistent_hostname'} Aug 03 01:48:39.275522 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:48:39.276270 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 03 01:48:39.277302 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:39.278320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:39.278320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.278320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.278320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.278320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.278320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.278320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.278320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:39.278320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:39.278320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:39.278320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.278320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e6cb3c6-dedc-4914-bf10-e6b2ea64f3a5 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:39.278320 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e6cb3c6-dedc-4914-bf10-e6b2ea64f3a5 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.047898 Aug 03 01:48:39.281642 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 195/399] 10.222.0.67 () {58 vars in 1215 bytes} [Wed Aug 3 01:48:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:48:39.296325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-81b45607-ebcc-46d0-b492-99a2cf873219 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13896040>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-81b45607-ebcc-46d0-b492-99a2cf873219 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Request method failure captured: Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: request: PUT /compute/v2.1/os-hosts/n-d-826529-8 HTTP/1.1 Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 51 Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dP0D0hCdSwvOuKcZdvSq_BAtB_Z05MwdVjtfSQ6yhE8QayZcXekNsadWqwtOd_84FRV4o1kko2tJaYLDzBopbWLD6gINJg6kuY44T8fH9F1U4sHCA5q5xVIaEiGRTNnOUteQGb8jGwzLEo7d7YZ1Rw0bQ9Ow48o_aKcovidgdjHxfA Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:48:39.309452 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:48:39.311114 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_40438bc67f234c12bfdf760fcb7ea395", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}] Aug 03 01:48:39.311114 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:39.311114 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:39.311114 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:39.311114 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:39.311114 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:39.311114 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:39.311114 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 79b474ea90124ced99834ac4fff45405 Aug 03 01:48:39.311114 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:39.311114 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:48:39.311114 n-d-826529-8 devstack@n-api.service[125941]: {"status": "enable", "maintenance_mode": "invalid"} Aug 03 01:48:39.311114 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:48:39.311114 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'n-d-826529-8', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'disable', Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'Enable', Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'Disable', Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance: Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'invalid' Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.312166 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.313573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.314826 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.314826 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 01:48:39.314826 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 01:48:39.314826 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 01:48:39.314826 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.314826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-81b45607-ebcc-46d0-b492-99a2cf873219 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:39.314826 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-81b45607-ebcc-46d0-b492-99a2cf873219 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-hosts/n-d-826529-8" status: 400 len: 199 microversion: 2.1 time: 0.030217 Aug 03 01:48:39.320713 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 196/400] 10.222.0.67 () {60 vars in 1187 bytes} [Wed Aug 3 01:48:39 2022] PUT /compute/v2.1/os-hosts/n-d-826529-8 => generated 199 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:48:39.325778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fedd0b23-db18-464f-9d1a-9511600810ca tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Action: 'update', calling method: .version_select at 0x7f5b138520d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fedd0b23-db18-464f-9d1a-9511600810ca tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Request method failure captured: Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: request: PUT /compute/v2.1/os-hosts/n-d-826529-8 HTTP/1.1 Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 51 Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dP0D0hCdSwvOuKcZdvSq_BAtB_Z05MwdVjtfSQ6yhE8QayZcXekNsadWqwtOd_84FRV4o1kko2tJaYLDzBopbWLD6gINJg6kuY44T8fH9F1U4sHCA5q5xVIaEiGRTNnOUteQGb8jGwzLEo7d7YZ1Rw0bQ9Ow48o_aKcovidgdjHxfA Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:48:39.341718 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:48:39.343057 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_40438bc67f234c12bfdf760fcb7ea395", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}] Aug 03 01:48:39.343057 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:39.343057 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:39.343057 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:39.343057 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:39.343057 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:39.343057 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:39.343057 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 79b474ea90124ced99834ac4fff45405 Aug 03 01:48:39.343057 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:39.343057 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:48:39.343057 n-d-826529-8 devstack@n-api.service[125941]: {"status": "invalid", "maintenance_mode": "enable"} Aug 03 01:48:39.343057 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:48:39.343057 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'n-d-826529-8', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'disable', Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'Enable', Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'Disable', Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance: Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'invalid' Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.343795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.345162 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.347858 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.347858 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 01:48:39.347858 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 01:48:39.347858 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 01:48:39.347858 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.347858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fedd0b23-db18-464f-9d1a-9511600810ca tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:39.347858 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fedd0b23-db18-464f-9d1a-9511600810ca tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-hosts/n-d-826529-8" status: 400 len: 189 microversion: 2.1 time: 0.021507 Aug 03 01:48:39.347858 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 197/401] 10.222.0.67 () {60 vars in 1187 bytes} [Wed Aug 3 01:48:39 2022] PUT /compute/v2.1/os-hosts/n-d-826529-8 => generated 189 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:48:39.362121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-50e476aa-2f85-4914-9cbb-9a862eda594c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:39.368914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-50e476aa-2f85-4914-9cbb-9a862eda594c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:39.377873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50e476aa-2f85-4914-9cbb-9a862eda594c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:39.379176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50e476aa-2f85-4914-9cbb-9a862eda594c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:39.380204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50e476aa-2f85-4914-9cbb-9a862eda594c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:39.380855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50e476aa-2f85-4914-9cbb-9a862eda594c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:39.637779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:48:39.638761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:48:39.639657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:48:39.640326 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:48:39.640957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:48:39.674378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:39.676968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:39.685960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:39.686782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:39.754104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Getting quotas for project bd6b5447e45547deb53aa1631e2ca1c7. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:48:39.763588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Getting quotas for user 137737f5122e46cc85ec51b8d76fb0c1 and project bd6b5447e45547deb53aa1631e2ca1c7. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:48:39.783366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-50e476aa-2f85-4914-9cbb-9a862eda594c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:39.793984 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-50e476aa-2f85-4914-9cbb-9a862eda594c tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 200 len: 1321 microversion: 2.1 time: 0.446662 Aug 03 01:48:39.802834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.utils [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] instances quota exceeded for bd6b5447e45547deb53aa1631e2ca1c7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125942) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 03 01:48:39.803756 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 198/402] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:39 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 1321 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:39.811149 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Request method failure captured: Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 143 Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPupL3rnJq-PBUZ_aZh57vMh0HZivNBvWCbnS-ESbVCip89RUa6UzxettuScZJupzwXAL45laefJVuIKLLIVDP20sw5O8NOcw3ddir4SnKOaLC0UFFcl0zNv3s7T2k6L460ZIjHxCu_4yCSQY6WpN9azMBqeyTMc3Vn941TjWpf5zc Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: bd6b5447e45547deb53aa1631e2ca1c7 Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-QuotasAdminNegativeTest-1524471278 Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:48:39.813345 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:48:39.814579 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd6b5447e45547deb53aa1631e2ca1c7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6b5447e45547deb53aa1631e2ca1c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd6b5447e45547deb53aa1631e2ca1c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6b5447e45547deb53aa1631e2ca1c7"}]}] Aug 03 01:48:39.814579 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-QuotasAdminNegativeTest-1524471278 Aug 03 01:48:39.814579 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: bd6b5447e45547deb53aa1631e2ca1c7 Aug 03 01:48:39.814579 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1524471278 Aug 03 01:48:39.814579 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-QuotasAdminNegativeTest-1524471278-project Aug 03 01:48:39.814579 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:39.814579 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:39.814579 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 137737f5122e46cc85ec51b8d76fb0c1 Aug 03 01:48:39.814579 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-QuotasAdminNegativeTest-1524471278-project Aug 03 01:48:39.814579 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:48:39.814579 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-97500020", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} Aug 03 01:48:39.814579 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-97500020', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452'}}} Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 03 01:48:39.815271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.816258 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.817490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.818621 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.818621 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.818621 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:39.818621 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:39.818621 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 03 01:48:39.818621 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.825985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-94e4e075-c885-4d7b-aeff-e580eb0fc582 tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Action: 'update', calling method: .version_select at 0x7f5b13852790>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:39.830952 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:39.830952 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:39.832737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:39.835398 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5b2552cd-ccc7-4e62-a830-99cdfc1a223f tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.783231 Aug 03 01:48:39.836969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-94e4e075-c885-4d7b-aeff-e580eb0fc582 tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '34aa75eff6bc467b8b91e4e17fb48817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58e21e65c5154d2b9534e4ef26bc2cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:39.839374 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 205/403] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:39 2022] POST /compute/v2.1/servers => generated 119 bytes in 789 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-94e4e075-c885-4d7b-aeff-e580eb0fc582 tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Request method failure captured: Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: request: PUT /compute/v2.1/os-hosts/n-d-826529-8 HTTP/1.1 Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 50 Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPzfQOxNNgwX60iadzdMvdtAI7V9IROka7bWE7CCl2BQYTkDHRrMEPLJz0Ros843nE_UaSNQJaFRi0GGCOemfkTFIk5hwuZ2NxwQBF14n7PTz8NvZe9mPZNj24RBsq-zsXrEDhMK3LicFxZjbv01d0xDyI1YGtQPogTEL--Wkx9kWc Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 58e21e65c5154d2b9534e4ef26bc2cfc Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:39.848167 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:39.849539 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_58e21e65c5154d2b9534e4ef26bc2cfc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58e21e65c5154d2b9534e4ef26bc2cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/58e21e65c5154d2b9534e4ef26bc2cfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/58e21e65c5154d2b9534e4ef26bc2cfc"}]}] Aug 03 01:48:39.849539 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:39.849539 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 58e21e65c5154d2b9534e4ef26bc2cfc Aug 03 01:48:39.849539 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1290537893 Aug 03 01:48:39.849539 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HostsAdminNegativeTestJSON-1290537893-project Aug 03 01:48:39.849539 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:39.849539 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:39.849539 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 34aa75eff6bc467b8b91e4e17fb48817 Aug 03 01:48:39.849539 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1290537893-project Aug 03 01:48:39.849539 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:48:39.849539 n-d-826529-8 devstack@n-api.service[125941]: {"status": "enable", "maintenance_mode": "enable"} Aug 03 01:48:39.849539 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:48:39.849539 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 03 01:48:39.849539 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'n-d-826529-8', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:39.850331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 03 01:48:39.851565 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:39.854006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-94e4e075-c885-4d7b-aeff-e580eb0fc582 tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:39.855108 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-94e4e075-c885-4d7b-aeff-e580eb0fc582 tempest-HostsAdminNegativeTestJSON-1290537893 tempest-HostsAdminNegativeTestJSON-1290537893-project] 10.222.0.67 "PUT /compute/v2.1/os-hosts/n-d-826529-8" status: 403 len: 111 microversion: 2.1 time: 0.050168 Aug 03 01:48:39.855901 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 199/404] 10.222.0.67 () {60 vars in 1187 bytes} [Wed Aug 3 01:48:39 2022] PUT /compute/v2.1/os-hosts/n-d-826529-8 => generated 111 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:39.860353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0ac7f8d5-7243-4505-8cb8-8e50cf9e8950 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:39.861230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0ac7f8d5-7243-4505-8cb8-8e50cf9e8950 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:39.870283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5a789a99-3f97-408a-b975-5adbf8233f32 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13896d30>, body: {"quota_set": {"instances": 10}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:39.883808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ac7f8d5-7243-4505-8cb8-8e50cf9e8950 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:39.884663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ac7f8d5-7243-4505-8cb8-8e50cf9e8950 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:39.885815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ac7f8d5-7243-4505-8cb8-8e50cf9e8950 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:39.887540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ac7f8d5-7243-4505-8cb8-8e50cf9e8950 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:40.160307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0ac7f8d5-7243-4505-8cb8-8e50cf9e8950 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:40.171933 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0ac7f8d5-7243-4505-8cb8-8e50cf9e8950 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.331275 Aug 03 01:48:40.187665 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 206/405] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:39 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:40.193447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9a39de0f-0d48-4c69-9388-e014510ca5d1 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13c6d670>, body: {"status": null, "maintenance_mode": null} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9a39de0f-0d48-4c69-9388-e014510ca5d1 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Request method failure captured: Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: request: PUT /compute/v2.1/os-hosts/n-d-826529-8 HTTP/1.1 Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 42 Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dP0D0hCdSwvOuKcZdvSq_BAtB_Z05MwdVjtfSQ6yhE8QayZcXekNsadWqwtOd_84FRV4o1kko2tJaYLDzBopbWLD6gINJg6kuY44T8fH9F1U4sHCA5q5xVIaEiGRTNnOUteQGb8jGwzLEo7d7YZ1Rw0bQ9Ow48o_aKcovidgdjHxfA Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:48:40.211968 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:48:40.214037 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_40438bc67f234c12bfdf760fcb7ea395", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}] Aug 03 01:48:40.214037 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:40.214037 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:40.214037 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:40.214037 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:40.214037 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:40.214037 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:40.214037 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 79b474ea90124ced99834ac4fff45405 Aug 03 01:48:40.214037 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:40.214037 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:48:40.214037 n-d-826529-8 devstack@n-api.service[125942]: {"status": null, "maintenance_mode": null} Aug 03 01:48:40.214037 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:48:40.214037 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 03 01:48:40.214037 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'n-d-826529-8', 'body': {'status': None, 'maintenance_mode': None}} Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'disable', Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'Enable', Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'Disable', Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance: Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi None Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:40.215216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:40.217123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:40.219352 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 01:48:40.219352 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 01:48:40.219352 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 03 01:48:40.219352 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:40.222039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9a39de0f-0d48-4c69-9388-e014510ca5d1 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:40.223881 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9a39de0f-0d48-4c69-9388-e014510ca5d1 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-hosts/n-d-826529-8" status: 400 len: 127 microversion: 2.1 time: 0.034625 Aug 03 01:48:40.225113 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 207/406] 10.222.0.67 () {60 vars in 1187 bytes} [Wed Aug 3 01:48:40 2022] PUT /compute/v2.1/os-hosts/n-d-826529-8 => generated 127 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:48:40.234750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ec3ed714-f014-4339-b7a8-640f676a35bb tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13c041f0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:40.323742 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ec3ed714-f014-4339-b7a8-640f676a35bb tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.097160 Aug 03 01:48:40.325037 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 208/407] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:40 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:40.336390 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-48d81519-3e71-445c-a367-0db0e5b4fd25 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13c6d4c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:40.350981 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:40.350981 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:40.351995 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.hosts [None req-48d81519-3e71-445c-a367-0db0e5b4fd25 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Enabling host nonexistent_hostname. Aug 03 01:48:40.373360 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-48d81519-3e71-445c-a367-0db0e5b4fd25 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-48d81519-3e71-445c-a367-0db0e5b4fd25 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Request method failure captured: Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 50 Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dP0D0hCdSwvOuKcZdvSq_BAtB_Z05MwdVjtfSQ6yhE8QayZcXekNsadWqwtOd_84FRV4o1kko2tJaYLDzBopbWLD6gINJg6kuY44T8fH9F1U4sHCA5q5xVIaEiGRTNnOUteQGb8jGwzLEo7d7YZ1Rw0bQ9Ow48o_aKcovidgdjHxfA Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:48:40.377697 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:48:40.379932 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_40438bc67f234c12bfdf760fcb7ea395", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/40438bc67f234c12bfdf760fcb7ea395"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/40438bc67f234c12bfdf760fcb7ea395"}]}] Aug 03 01:48:40.379932 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:40.379932 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 40438bc67f234c12bfdf760fcb7ea395 Aug 03 01:48:40.379932 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-21717845 Aug 03 01:48:40.379932 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:40.379932 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:40.379932 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:40.379932 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 79b474ea90124ced99834ac4fff45405 Aug 03 01:48:40.379932 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-HostsAdminNegativeTestJSON-21717845-project-admin Aug 03 01:48:40.379932 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:48:40.379932 n-d-826529-8 devstack@n-api.service[125942]: {"status": "enable", "maintenance_mode": "enable"} Aug 03 01:48:40.379932 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:48:40.379932 n-d-826529-8 devstack@n-api.service[125942]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:40.379932 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 03 01:48:40.380742 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:40.381734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 03 01:48:40.382808 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 03 01:48:40.382808 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 03 01:48:40.382808 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:40.382808 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:40.382808 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:40.382808 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:40.382808 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:40.382808 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:40.382808 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:40.382808 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:40.382808 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:40.382808 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:40.382808 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 01:48:40.382808 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:40.382808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-48d81519-3e71-445c-a367-0db0e5b4fd25 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:40.383701 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-48d81519-3e71-445c-a367-0db0e5b4fd25 tempest-HostsAdminNegativeTestJSON-21717845 tempest-HostsAdminNegativeTestJSON-21717845-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.054913 Aug 03 01:48:40.383701 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 209/408] 10.222.0.67 () {60 vars in 1211 bytes} [Wed Aug 3 01:48:40 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:48:40.723223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a789a99-3f97-408a-b975-5adbf8233f32 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:40.723703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a789a99-3f97-408a-b975-5adbf8233f32 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:40.731472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a789a99-3f97-408a-b975-5adbf8233f32 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:40.731984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a789a99-3f97-408a-b975-5adbf8233f32 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:40.833426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3e959992-63be-46d5-a805-c32b1652a742 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:40.834172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3e959992-63be-46d5-a805-c32b1652a742 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:40.850341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e959992-63be-46d5-a805-c32b1652a742 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:40.862880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e959992-63be-46d5-a805-c32b1652a742 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:40.869244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e959992-63be-46d5-a805-c32b1652a742 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:40.869991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e959992-63be-46d5-a805-c32b1652a742 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:41.081895 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5a789a99-3f97-408a-b975-5adbf8233f32 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7" status: 200 len: 329 microversion: 2.1 time: 1.223080 Aug 03 01:48:41.084378 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 200/409] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 3 01:48:39 2022] PUT /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7 => generated 329 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:41.095542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-86e07999-867c-443f-b5fd-13ebee97eb9b tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Calling method '.version_select at 0x7f5b138b7b80>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:41.290318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3e959992-63be-46d5-a805-c32b1652a742 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:41.299184 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3e959992-63be-46d5-a805-c32b1652a742 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 200 len: 1470 microversion: 2.1 time: 0.476830 Aug 03 01:48:41.303220 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 210/410] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:40 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 1470 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:41.315553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3da0e2d1-c379-4936-a26b-766b15bda5ee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:41.316533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3da0e2d1-c379-4936-a26b-766b15bda5ee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:41.333548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3da0e2d1-c379-4936-a26b-766b15bda5ee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:41.334374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3da0e2d1-c379-4936-a26b-766b15bda5ee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:41.335443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3da0e2d1-c379-4936-a26b-766b15bda5ee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:41.336085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3da0e2d1-c379-4936-a26b-766b15bda5ee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:41.767667 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-86e07999-867c-443f-b5fd-13ebee97eb9b tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7" status: 200 len: 371 microversion: 2.1 time: 0.673575 Aug 03 01:48:41.771304 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 201/411] 10.222.0.67 () {58 vars in 1242 bytes} [Wed Aug 3 01:48:41 2022] GET /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7 => generated 371 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:41.787919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1ea41ad-85d2-4041-8cf4-a11958930182 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:41.792177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b1ea41ad-85d2-4041-8cf4-a11958930182 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:41.807387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1ea41ad-85d2-4041-8cf4-a11958930182 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:41.807848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1ea41ad-85d2-4041-8cf4-a11958930182 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:41.808630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1ea41ad-85d2-4041-8cf4-a11958930182 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:41.811139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1ea41ad-85d2-4041-8cf4-a11958930182 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:41.866104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-b1ea41ad-85d2-4041-8cf4-a11958930182 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lazy-loading 'flavor' on Instance uuid 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:48:42.059360 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b1ea41ad-85d2-4041-8cf4-a11958930182 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3/action" status: 202 len: 0 microversion: 2.1 time: 0.281396 Aug 03 01:48:42.060996 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 202/412] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:48:41 2022] POST /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:48:42.065034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3da0e2d1-c379-4936-a26b-766b15bda5ee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:42.076272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-13cdb9d7-3487-48e2-9286-9d5f57803021 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13852f70>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:42.088923 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3da0e2d1-c379-4936-a26b-766b15bda5ee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.784365 Aug 03 01:48:42.095137 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 211/413] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:41 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:42.123657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4c7ca197-c52d-4cd1-9ec6-2ed6005e6991 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13c041f0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:42.193561 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-13cdb9d7-3487-48e2-9286-9d5f57803021 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.130977 Aug 03 01:48:42.194809 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 203/414] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:42 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:42.216231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8dd7ad94-8f9e-488b-9e5b-93e985a1cf4b tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:42.217928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8dd7ad94-8f9e-488b-9e5b-93e985a1cf4b tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:42.235552 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dd7ad94-8f9e-488b-9e5b-93e985a1cf4b tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:42.237018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dd7ad94-8f9e-488b-9e5b-93e985a1cf4b tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:42.240418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dd7ad94-8f9e-488b-9e5b-93e985a1cf4b tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:42.241192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dd7ad94-8f9e-488b-9e5b-93e985a1cf4b tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:42.793920 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8dd7ad94-8f9e-488b-9e5b-93e985a1cf4b tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 200 len: 1629 microversion: 2.1 time: 0.597758 Aug 03 01:48:42.795706 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 204/415] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:42 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 1629 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:42.909346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c7ca197-c52d-4cd1-9ec6-2ed6005e6991 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:42.910794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c7ca197-c52d-4cd1-9ec6-2ed6005e6991 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:42.912609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c7ca197-c52d-4cd1-9ec6-2ed6005e6991 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:42.913269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c7ca197-c52d-4cd1-9ec6-2ed6005e6991 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:42.944109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:43.012133 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4c7ca197-c52d-4cd1-9ec6-2ed6005e6991 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7" status: 200 len: 325 microversion: 2.1 time: 0.920786 Aug 03 01:48:43.020034 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 212/416] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 3 01:48:42 2022] PUT /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7 => generated 325 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:43.119674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-64c4fc93-b483-4abf-8254-4ad3699eb2d5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:43.120896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-64c4fc93-b483-4abf-8254-4ad3699eb2d5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:43.132714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-64c4fc93-b483-4abf-8254-4ad3699eb2d5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:43.134000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-64c4fc93-b483-4abf-8254-4ad3699eb2d5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:43.135132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-64c4fc93-b483-4abf-8254-4ad3699eb2d5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:43.135847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-64c4fc93-b483-4abf-8254-4ad3699eb2d5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:43.209612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2eef3586-f158-4b20-8d5f-43bb9c676882 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13c6d5e0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:43.287391 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2eef3586-f158-4b20-8d5f-43bb9c676882 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.081849 Aug 03 01:48:43.295298 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 213/417] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:43 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:43.305493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1956475594", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:43.436278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-64c4fc93-b483-4abf-8254-4ad3699eb2d5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:43.447811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:48:43.450469 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-64c4fc93-b483-4abf-8254-4ad3699eb2d5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.343047 Aug 03 01:48:43.454745 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 205/418] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:43 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:43.817419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-acd2ff1b-882b-4dc3-9941-423812421425 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:43.818285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-acd2ff1b-882b-4dc3-9941-423812421425 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:43.836048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-acd2ff1b-882b-4dc3-9941-423812421425 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:43.836550 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-acd2ff1b-882b-4dc3-9941-423812421425 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:43.837389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-acd2ff1b-882b-4dc3-9941-423812421425 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:43.839027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-acd2ff1b-882b-4dc3-9941-423812421425 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:43.941924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:48:43.942843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:48:43.943538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:48:43.944107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:48:43.945422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:48:43.978485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:43.978954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:43.981668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:43.983912 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:44.050399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Getting quotas for project bd6b5447e45547deb53aa1631e2ca1c7. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:48:44.070058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Getting quotas for user 137737f5122e46cc85ec51b8d76fb0c1 and project bd6b5447e45547deb53aa1631e2ca1c7. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:48:44.093179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.utils [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] ram quota exceeded for bd6b5447e45547deb53aa1631e2ca1c7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125942) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 03 01:48:44.093716 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Request method failure captured: Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 145 Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPupL3rnJq-PBUZ_aZh57vMh0HZivNBvWCbnS-ESbVCip89RUa6UzxettuScZJupzwXAL45laefJVuIKLLIVDP20sw5O8NOcw3ddir4SnKOaLC0UFFcl0zNv3s7T2k6L460ZIjHxCu_4yCSQY6WpN9azMBqeyTMc3Vn941TjWpf5zc Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: bd6b5447e45547deb53aa1631e2ca1c7 Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-QuotasAdminNegativeTest-1524471278 Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:48:44.097393 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:48:44.099015 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd6b5447e45547deb53aa1631e2ca1c7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6b5447e45547deb53aa1631e2ca1c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd6b5447e45547deb53aa1631e2ca1c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6b5447e45547deb53aa1631e2ca1c7"}]}] Aug 03 01:48:44.099015 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-QuotasAdminNegativeTest-1524471278 Aug 03 01:48:44.099015 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: bd6b5447e45547deb53aa1631e2ca1c7 Aug 03 01:48:44.099015 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1524471278 Aug 03 01:48:44.099015 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-QuotasAdminNegativeTest-1524471278-project Aug 03 01:48:44.099015 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:44.099015 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:44.099015 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 137737f5122e46cc85ec51b8d76fb0c1 Aug 03 01:48:44.099015 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-QuotasAdminNegativeTest-1524471278-project Aug 03 01:48:44.099015 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:48:44.099015 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1956475594", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} Aug 03 01:48:44.099015 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1956475594', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452'}}} Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 03 01:48:44.099815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:44.100840 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:44.101996 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:44.103192 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:44.103192 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:44.103192 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:44.103192 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:44.103192 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 03 01:48:44.103192 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:44.116718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:44.118769 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-44a65f50-6b82-47e0-8046-2fdfc78072ba tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.818707 Aug 03 01:48:44.122323 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 214/419] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:43 2022] POST /compute/v2.1/servers => generated 110 bytes in 826 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:44.139246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1fdbff68-3637-4994-a5f5-a4b8f60eeaa5 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13c04e50>, body: {"quota_set": {"ram": 51200}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:44.621415 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-acd2ff1b-882b-4dc3-9941-423812421425 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 200 len: 1612 microversion: 2.1 time: 0.806465 Aug 03 01:48:44.624127 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 206/420] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:43 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 1612 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:44.650446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fdbff68-3637-4994-a5f5-a4b8f60eeaa5 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:44.652253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fdbff68-3637-4994-a5f5-a4b8f60eeaa5 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:44.653217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fdbff68-3637-4994-a5f5-a4b8f60eeaa5 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:44.655048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fdbff68-3637-4994-a5f5-a4b8f60eeaa5 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:44.886813 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1fdbff68-3637-4994-a5f5-a4b8f60eeaa5 tempest-QuotasAdminNegativeTest-2123812275 tempest-QuotasAdminNegativeTest-2123812275-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7" status: 200 len: 329 microversion: 2.1 time: 0.760540 Aug 03 01:48:44.887614 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 215/421] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 3 01:48:44 2022] PUT /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7 => generated 329 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:44.900482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-10193c16-5dce-4e10-b585-d8cc7ac2b2eb tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13c6dee0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:45.002075 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-10193c16-5dce-4e10-b585-d8cc7ac2b2eb tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.113092 Aug 03 01:48:45.002846 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 216/422] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:44 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:45.022931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-28da025a-0985-4b47-9a0b-b4791a82b093 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:45.026541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3b215dea-cf0b-4c4d-902e-52b18c0e32a9 tempest-FlavorMetadataValidation-2139131799 tempest-FlavorMetadataValidation-2139131799-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1242203039", "id": 1701929838, "os-flavor-access:is_public": "True"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:45.027654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-28da025a-0985-4b47-9a0b-b4791a82b093 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:45.030170 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:45.030170 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:45.039103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28da025a-0985-4b47-9a0b-b4791a82b093 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:45.039459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28da025a-0985-4b47-9a0b-b4791a82b093 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:45.040246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28da025a-0985-4b47-9a0b-b4791a82b093 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:45.040678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28da025a-0985-4b47-9a0b-b4791a82b093 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:45.061165 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3b215dea-cf0b-4c4d-902e-52b18c0e32a9 tempest-FlavorMetadataValidation-2139131799 tempest-FlavorMetadataValidation-2139131799-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.434806 Aug 03 01:48:45.067248 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 207/423] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 01:48:44 2022] POST /compute/v2.1/flavors => generated 471 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:48:45.076702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5a48b5ae-54da-49a1-9879-679d8840d3a9 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:45.081749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5a48b5ae-54da-49a1-9879-679d8840d3a9 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:45.100278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a48b5ae-54da-49a1-9879-679d8840d3a9 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:45.100741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a48b5ae-54da-49a1-9879-679d8840d3a9 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:45.116713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a48b5ae-54da-49a1-9879-679d8840d3a9 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:45.117172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a48b5ae-54da-49a1-9879-679d8840d3a9 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:45.205522 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-5a48b5ae-54da-49a1-9879-679d8840d3a9 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] HTTP exception thrown: Cannot 'migrate' instance 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 while it is in vm_state suspended Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5a48b5ae-54da-49a1-9879-679d8840d3a9 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Request method failure captured: Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3/action HTTP/1.1 Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 15 Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPZd8EetOR7NImJYZifBlfIai_F6olI6FWaUe5seFK53RBbeH4tjsVswZhJuTfpC-ey4FXB-RKU9xq3YmyOBVx7_rgNjf6F6Jzlsk2Y7mod21oL94dAEBlb3UqIq-P1TJ7IjwKGtnA-TCQL0GbzOZPkqZ4qGCgZEtRQMuhSHPPLM6M Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: c90431eeef1b4caaad1a71d335300803 Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-345093534 Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:48:45.209762 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:48:45.211306 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c90431eeef1b4caaad1a71d335300803", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c90431eeef1b4caaad1a71d335300803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c90431eeef1b4caaad1a71d335300803"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c90431eeef1b4caaad1a71d335300803"}]}] Aug 03 01:48:45.211306 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersAdminNegativeTestJSON-345093534 Aug 03 01:48:45.211306 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: c90431eeef1b4caaad1a71d335300803 Aug 03 01:48:45.211306 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-345093534 Aug 03 01:48:45.211306 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersAdminNegativeTestJSON-345093534-project-admin Aug 03 01:48:45.211306 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:45.211306 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:45.211306 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1569a39bf3e248d9a2a9e363d5612afd Aug 03 01:48:45.211306 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersAdminNegativeTestJSON-345093534-project-admin Aug 03 01:48:45.211306 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:48:45.211306 n-d-826529-8 devstack@n-api.service[125941]: {"migrate": {}} Aug 03 01:48:45.211306 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:45.211306 n-d-826529-8 devstack@n-api.service[125941]: exception: Cannot 'migrate' instance 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 while it is in vm_state suspended Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '60c808b6-416a-4dcb-af4e-cfc78f56dfa3', 'body': {'migrate': {}}} Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 in vm_state suspended. Cannot resize while the instance is in this state. Aug 03 01:48:45.212154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 while it is in vm_state suspended Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.213443 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:45.214814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:45.214814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:45.214814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:45.214814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:45.214814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 while it is in vm_state suspended Aug 03 01:48:45.214814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.218723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5a48b5ae-54da-49a1-9879-679d8840d3a9 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Returning 409 to user: Cannot 'migrate' instance 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 while it is in vm_state suspended {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:45.219652 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5a48b5ae-54da-49a1-9879-679d8840d3a9 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3/action" status: 409 len: 148 microversion: 2.1 time: 0.147076 Aug 03 01:48:45.220234 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 208/424] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:48:45 2022] POST /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3/action => generated 148 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:48:45.239754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-458c7ecb-069d-4051-9529-e947210788ef tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Action: 'update', calling method: .version_select at 0x7f5b13829700>, body: {"quota_set": {"ram": 0}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:45.252450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-458c7ecb-069d-4051-9529-e947210788ef tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '137737f5122e46cc85ec51b8d76fb0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b5447e45547deb53aa1631e2ca1c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-458c7ecb-069d-4051-9529-e947210788ef tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Request method failure captured: Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: request: PUT /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7 HTTP/1.1 Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 25 Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPupL3rnJq-PBUZ_aZh57vMh0HZivNBvWCbnS-ESbVCip89RUa6UzxettuScZJupzwXAL45laefJVuIKLLIVDP20sw5O8NOcw3ddir4SnKOaLC0UFFcl0zNv3s7T2k6L460ZIjHxCu_4yCSQY6WpN9azMBqeyTMc3Vn941TjWpf5zc Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: bd6b5447e45547deb53aa1631e2ca1c7 Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-QuotasAdminNegativeTest-1524471278 Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:45.257719 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:45.259204 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd6b5447e45547deb53aa1631e2ca1c7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6b5447e45547deb53aa1631e2ca1c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd6b5447e45547deb53aa1631e2ca1c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6b5447e45547deb53aa1631e2ca1c7"}]}] Aug 03 01:48:45.259204 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-QuotasAdminNegativeTest-1524471278 Aug 03 01:48:45.259204 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: bd6b5447e45547deb53aa1631e2ca1c7 Aug 03 01:48:45.259204 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1524471278 Aug 03 01:48:45.259204 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-QuotasAdminNegativeTest-1524471278-project Aug 03 01:48:45.259204 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:45.259204 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:45.259204 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 137737f5122e46cc85ec51b8d76fb0c1 Aug 03 01:48:45.259204 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-QuotasAdminNegativeTest-1524471278-project Aug 03 01:48:45.259204 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:48:45.259204 n-d-826529-8 devstack@n-api.service[125941]: {"quota_set": {"ram": 0}} Aug 03 01:48:45.259204 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:48:45.259204 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 03 01:48:45.259204 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'bd6b5447e45547deb53aa1631e2ca1c7', 'body': {'quota_set': {'ram': 0}}} Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:45.260074 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.261146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:45.262325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:45.262325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:45.262325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:48:45.262325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:48:45.262325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 03 01:48:45.262325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.266845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-458c7ecb-069d-4051-9529-e947210788ef tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:45.267963 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-458c7ecb-069d-4051-9529-e947210788ef tempest-QuotasAdminNegativeTest-1524471278 tempest-QuotasAdminNegativeTest-1524471278-project] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7" status: 403 len: 116 microversion: 2.1 time: 0.038799 Aug 03 01:48:45.270365 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 209/425] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 3 01:48:45 2022] PUT /compute/v2.1/os-quota-sets/bd6b5447e45547deb53aa1631e2ca1c7 => generated 116 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:45.287642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1a89d6f8-bd1e-47a3-aaf6-b9ba6d7eb9c4 tempest-FlavorMetadataValidation-2139131799 tempest-FlavorMetadataValidation-2139131799-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:45.296666 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:45.296666 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:45.485688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-28da025a-0985-4b47-9a0b-b4791a82b093 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:45.499849 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-28da025a-0985-4b47-9a0b-b4791a82b093 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.492259 Aug 03 01:48:45.500454 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 217/426] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:45 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:45.526525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8ceee5b5-a0fa-45de-b69b-57e712745d6a tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8ceee5b5-a0fa-45de-b69b-57e712745d6a tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Request method failure captured: Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea/action HTTP/1.1 Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 39 Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPZd8EetOR7NImJYZifBlfIai_F6olI6FWaUe5seFK53RBbeH4tjsVswZhJuTfpC-ey4FXB-RKU9xq3YmyOBVx7_rgNjf6F6Jzlsk2Y7mod21oL94dAEBlb3UqIq-P1TJ7IjwKGtnA-TCQL0GbzOZPkqZ4qGCgZEtRQMuhSHPPLM6M Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c90431eeef1b4caaad1a71d335300803 Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-345093534 Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:48:45.549241 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:48:45.551740 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c90431eeef1b4caaad1a71d335300803", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c90431eeef1b4caaad1a71d335300803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c90431eeef1b4caaad1a71d335300803"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c90431eeef1b4caaad1a71d335300803"}]}] Aug 03 01:48:45.551740 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersAdminNegativeTestJSON-345093534 Aug 03 01:48:45.551740 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c90431eeef1b4caaad1a71d335300803 Aug 03 01:48:45.551740 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-345093534 Aug 03 01:48:45.551740 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersAdminNegativeTestJSON-345093534-project-admin Aug 03 01:48:45.551740 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:45.551740 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:45.551740 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1569a39bf3e248d9a2a9e363d5612afd Aug 03 01:48:45.551740 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersAdminNegativeTestJSON-345093534-project-admin Aug 03 01:48:45.551740 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:48:45.551740 n-d-826529-8 devstack@n-api.service[125942]: {"os-resetState": {"state": "invalid"}} Aug 03 01:48:45.551740 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '77121f3e-c5a9-4057-808c-572c59ff77ea', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'invalid' Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:45.552734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 01:48:45.555110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 03 01:48:45.556470 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.556470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8ceee5b5-a0fa-45de-b69b-57e712745d6a tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:45.556470 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8ceee5b5-a0fa-45de-b69b-57e712745d6a tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea/action" status: 400 len: 144 microversion: 2.1 time: 0.049410 Aug 03 01:48:45.556470 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 218/427] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:48:45 2022] POST /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea/action => generated 144 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:48:45.578546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0e7e6650-13f3-4f5a-8a08-64effb71402d tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0e7e6650-13f3-4f5a-8a08-64effb71402d tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Request method failure captured: Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea/action HTTP/1.1 Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 31 Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPZd8EetOR7NImJYZifBlfIai_F6olI6FWaUe5seFK53RBbeH4tjsVswZhJuTfpC-ey4FXB-RKU9xq3YmyOBVx7_rgNjf6F6Jzlsk2Y7mod21oL94dAEBlb3UqIq-P1TJ7IjwKGtnA-TCQL0GbzOZPkqZ4qGCgZEtRQMuhSHPPLM6M Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c90431eeef1b4caaad1a71d335300803 Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-345093534 Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:48:45.592010 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:48:45.593505 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c90431eeef1b4caaad1a71d335300803", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c90431eeef1b4caaad1a71d335300803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c90431eeef1b4caaad1a71d335300803"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c90431eeef1b4caaad1a71d335300803"}]}] Aug 03 01:48:45.593505 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersAdminNegativeTestJSON-345093534 Aug 03 01:48:45.593505 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c90431eeef1b4caaad1a71d335300803 Aug 03 01:48:45.593505 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-345093534 Aug 03 01:48:45.593505 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersAdminNegativeTestJSON-345093534-project-admin Aug 03 01:48:45.593505 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:45.593505 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:45.593505 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1569a39bf3e248d9a2a9e363d5612afd Aug 03 01:48:45.593505 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersAdminNegativeTestJSON-345093534-project-admin Aug 03 01:48:45.593505 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:48:45.593505 n-d-826529-8 devstack@n-api.service[125942]: {"os-resetState": {"state": 1}} Aug 03 01:48:45.593505 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:45.593505 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '77121f3e-c5a9-4057-808c-572c59ff77ea', 'body': {'os-resetState': {'state': 1}}} Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 1 Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:45.594239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 03 01:48:45.595481 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.599096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0e7e6650-13f3-4f5a-8a08-64effb71402d tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:45.601868 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0e7e6650-13f3-4f5a-8a08-64effb71402d tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea/action" status: 400 len: 120 microversion: 2.1 time: 0.037277 Aug 03 01:48:45.606548 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 219/428] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:48:45 2022] POST /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea/action => generated 120 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:48:45.621453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f024a83b-0a72-4001-b134-81d088a451d6 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:45.629509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f024a83b-0a72-4001-b134-81d088a451d6 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Failed to fetch instance by id 999 {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 03 01:48:45.632293 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-f024a83b-0a72-4001-b134-81d088a451d6 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f024a83b-0a72-4001-b134-81d088a451d6 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Request method failure captured: Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 37 Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPZd8EetOR7NImJYZifBlfIai_F6olI6FWaUe5seFK53RBbeH4tjsVswZhJuTfpC-ey4FXB-RKU9xq3YmyOBVx7_rgNjf6F6Jzlsk2Y7mod21oL94dAEBlb3UqIq-P1TJ7IjwKGtnA-TCQL0GbzOZPkqZ4qGCgZEtRQMuhSHPPLM6M Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c90431eeef1b4caaad1a71d335300803 Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-345093534 Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:48:45.645224 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:48:45.646577 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c90431eeef1b4caaad1a71d335300803", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c90431eeef1b4caaad1a71d335300803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c90431eeef1b4caaad1a71d335300803"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c90431eeef1b4caaad1a71d335300803"}]}] Aug 03 01:48:45.646577 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersAdminNegativeTestJSON-345093534 Aug 03 01:48:45.646577 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c90431eeef1b4caaad1a71d335300803 Aug 03 01:48:45.646577 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-345093534 Aug 03 01:48:45.646577 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersAdminNegativeTestJSON-345093534-project-admin Aug 03 01:48:45.646577 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:45.646577 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:45.646577 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1569a39bf3e248d9a2a9e363d5612afd Aug 03 01:48:45.646577 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersAdminNegativeTestJSON-345093534-project-admin Aug 03 01:48:45.646577 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:48:45.646577 n-d-826529-8 devstack@n-api.service[125942]: {"os-resetState": {"state": "error"}} Aug 03 01:48:45.646577 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:45.646577 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 999 could not be found. Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:48:45.647458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f024a83b-0a72-4001-b134-81d088a451d6 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:45.648780 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f024a83b-0a72-4001-b134-81d088a451d6 tempest-ServersAdminNegativeTestJSON-345093534 tempest-ServersAdminNegativeTestJSON-345093534-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.038563 Aug 03 01:48:45.649722 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 220/429] 10.222.0.67 () {60 vars in 1179 bytes} [Wed Aug 3 01:48:45 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:48:45.657212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9a3ead10-2d3e-45e7-9ccb-f7d736022cd3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:45.657710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9a3ead10-2d3e-45e7-9ccb-f7d736022cd3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:45.682485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a3ead10-2d3e-45e7-9ccb-f7d736022cd3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:45.687214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a3ead10-2d3e-45e7-9ccb-f7d736022cd3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:45.688183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a3ead10-2d3e-45e7-9ccb-f7d736022cd3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:45.688641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a3ead10-2d3e-45e7-9ccb-f7d736022cd3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:45.765098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9a3ead10-2d3e-45e7-9ccb-f7d736022cd3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:48:45.993138 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1a89d6f8-bd1e-47a3-aaf6-b9ba6d7eb9c4 tempest-FlavorMetadataValidation-2139131799 tempest-FlavorMetadataValidation-2139131799-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/1701929838/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.716419 Aug 03 01:48:46.009621 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 210/430] 10.222.0.67 () {62 vars in 1265 bytes} [Wed Aug 3 01:48:45 2022] POST /compute/v2.1/flavors/1701929838/os-extra_specs => generated 62 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:46.016511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d89eb922-791f-4750-8ca8-613d7373d60f tempest-FlavorMetadataValidation-2139131799 tempest-FlavorMetadataValidation-2139131799-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:46.017693 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:46.017693 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:46.063393 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d89eb922-791f-4750-8ca8-613d7373d60f tempest-FlavorMetadataValidation-2139131799 tempest-FlavorMetadataValidation-2139131799-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1701929838" status: 202 len: 0 microversion: 2.86 time: 0.048236 Aug 03 01:48:46.070450 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 211/431] 10.222.0.67 () {60 vars in 1202 bytes} [Wed Aug 3 01:48:46 2022] DELETE /compute/v2.1/flavors/1701929838 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:48:46.100141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-52f59f0d-b616-4635-bf33-d4b1bc1dea45 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13829d30>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:46.104814 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9a3ead10-2d3e-45e7-9ccb-f7d736022cd3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "DELETE /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 204 len: 0 microversion: 2.1 time: 0.450484 Aug 03 01:48:46.106487 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 221/432] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:48:45 2022] DELETE /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:48:46.146033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d820213f-23a5-4a5b-b00c-02e82a78184c tempest-FlavorMetadataValidation-2139131799 tempest-FlavorMetadataValidation-2139131799-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:46.210587 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-52f59f0d-b616-4635-bf33-d4b1bc1dea45 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.141147 Aug 03 01:48:46.211443 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 212/433] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:46 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:46.226472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3063d112-8e20-4cd4-87dc-86d6fc7ba0a8 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:46.227635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3063d112-8e20-4cd4-87dc-86d6fc7ba0a8 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:46.243922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3063d112-8e20-4cd4-87dc-86d6fc7ba0a8 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:46.245345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3063d112-8e20-4cd4-87dc-86d6fc7ba0a8 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:46.248933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3063d112-8e20-4cd4-87dc-86d6fc7ba0a8 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:46.249630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3063d112-8e20-4cd4-87dc-86d6fc7ba0a8 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:46.265999 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d820213f-23a5-4a5b-b00c-02e82a78184c tempest-FlavorMetadataValidation-2139131799 tempest-FlavorMetadataValidation-2139131799-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.157807 Aug 03 01:48:46.276701 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 222/434] 10.222.0.67 () {60 vars in 1187 bytes} [Wed Aug 3 01:48:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:48:46.522239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3cb3c83c-d1d8-4e3f-b148-617aa9628a75 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:46.523284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3cb3c83c-d1d8-4e3f-b148-617aa9628a75 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:46.539565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3cb3c83c-d1d8-4e3f-b148-617aa9628a75 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:46.540406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3cb3c83c-d1d8-4e3f-b148-617aa9628a75 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:46.547932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3cb3c83c-d1d8-4e3f-b148-617aa9628a75 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:46.549456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3063d112-8e20-4cd4-87dc-86d6fc7ba0a8 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:46.551195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3cb3c83c-d1d8-4e3f-b148-617aa9628a75 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:46.559602 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3063d112-8e20-4cd4-87dc-86d6fc7ba0a8 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 200 len: 1467 microversion: 2.1 time: 0.346523 Aug 03 01:48:46.560345 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 213/435] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:46 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 1467 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:46.909818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3cb3c83c-d1d8-4e3f-b148-617aa9628a75 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:46.924482 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3cb3c83c-d1d8-4e3f-b148-617aa9628a75 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.406258 Aug 03 01:48:46.928733 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 223/436] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:46 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:47.226491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-065511bc-b002-4ac6-b2e5-4fce35dcc9f0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13829550>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:47.329959 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-065511bc-b002-4ac6-b2e5-4fce35dcc9f0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.108266 Aug 03 01:48:47.339164 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 214/437] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:47 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:47.581578 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e7e516a9-e98d-4590-8e83-70e0cbc3bef3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:47.582978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e7e516a9-e98d-4590-8e83-70e0cbc3bef3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:47.603197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7e516a9-e98d-4590-8e83-70e0cbc3bef3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:47.611705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7e516a9-e98d-4590-8e83-70e0cbc3bef3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:47.612584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7e516a9-e98d-4590-8e83-70e0cbc3bef3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:47.613575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7e516a9-e98d-4590-8e83-70e0cbc3bef3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:47.947689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-82b9ae87-f8df-4c54-b087-74b16d548f71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:47.948318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-82b9ae87-f8df-4c54-b087-74b16d548f71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:47.961292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82b9ae87-f8df-4c54-b087-74b16d548f71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:47.961751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82b9ae87-f8df-4c54-b087-74b16d548f71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:47.962555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82b9ae87-f8df-4c54-b087-74b16d548f71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:47.963143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82b9ae87-f8df-4c54-b087-74b16d548f71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:48.307853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e7e516a9-e98d-4590-8e83-70e0cbc3bef3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:48.323988 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e7e516a9-e98d-4590-8e83-70e0cbc3bef3 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 200 len: 1467 microversion: 2.1 time: 0.746287 Aug 03 01:48:48.337938 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 224/438] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:47 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 1467 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:48.344850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-17f43146-0ac0-4ba7-969c-83b412837b5f tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13c3e160>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:48.396270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-82b9ae87-f8df-4c54-b087-74b16d548f71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:48.406700 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-82b9ae87-f8df-4c54-b087-74b16d548f71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.462885 Aug 03 01:48:48.421788 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 215/439] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:47 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:48.471407 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-17f43146-0ac0-4ba7-969c-83b412837b5f tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.130098 Aug 03 01:48:48.472903 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 225/440] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:48 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:49.344786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8e956d7d-9f7e-4dc7-90b1-0e16a20380b6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:49.345394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8e956d7d-9f7e-4dc7-90b1-0e16a20380b6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:49.352766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e956d7d-9f7e-4dc7-90b1-0e16a20380b6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:49.359812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e956d7d-9f7e-4dc7-90b1-0e16a20380b6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:49.360691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e956d7d-9f7e-4dc7-90b1-0e16a20380b6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:49.361145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e956d7d-9f7e-4dc7-90b1-0e16a20380b6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:49.439116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-287ca37f-7a26-4366-81ee-79047b112000 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:49.441116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-287ca37f-7a26-4366-81ee-79047b112000 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:49.463612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-287ca37f-7a26-4366-81ee-79047b112000 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:49.466673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-287ca37f-7a26-4366-81ee-79047b112000 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:49.472487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-287ca37f-7a26-4366-81ee-79047b112000 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:49.474606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-287ca37f-7a26-4366-81ee-79047b112000 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:49.627348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8e956d7d-9f7e-4dc7-90b1-0e16a20380b6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:49.635655 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8e956d7d-9f7e-4dc7-90b1-0e16a20380b6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 200 len: 1467 microversion: 2.1 time: 0.294633 Aug 03 01:48:49.657634 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 216/441] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:49 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 1467 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:49.668559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3f8ce698-6dd8-4e28-b123-90b425de288b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13852160>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:49.788990 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3f8ce698-6dd8-4e28-b123-90b425de288b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.123406 Aug 03 01:48:49.789251 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 217/442] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:49 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:50.132862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-287ca37f-7a26-4366-81ee-79047b112000 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:50.151411 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-287ca37f-7a26-4366-81ee-79047b112000 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.721253 Aug 03 01:48:50.154767 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 226/443] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:49 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:50.384714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-4a032465-f181-4308-b23d-1ad064d440ce req-0795a661-8bbd-467a-93be-55a9733ef7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c808b6-416a-4dcb-af4e-cfc78f56dfa3", "name": "network-vif-deleted", "tag": "aa497ae6-661e-4ad4-a847-0576f80c3772"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:50.423898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4a032465-f181-4308-b23d-1ad064d440ce req-0795a661-8bbd-467a-93be-55a9733ef7f3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:50.445090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4a032465-f181-4308-b23d-1ad064d440ce req-0795a661-8bbd-467a-93be-55a9733ef7f3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:50.519404 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-4a032465-f181-4308-b23d-1ad064d440ce req-0795a661-8bbd-467a-93be-55a9733ef7f3 service nova] Creating event network-vif-deleted:aa497ae6-661e-4ad4-a847-0576f80c3772 for instance 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 on n-h2-826529-8 Aug 03 01:48:50.548171 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-4a032465-f181-4308-b23d-1ad064d440ce req-0795a661-8bbd-467a-93be-55a9733ef7f3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167282 Aug 03 01:48:50.556110 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 218/444] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:48:50.661341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1ad5845f-78c2-41d0-b7f7-99b7a694c621 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:50.661975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1ad5845f-78c2-41d0-b7f7-99b7a694c621 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:50.682042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ad5845f-78c2-41d0-b7f7-99b7a694c621 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:50.682895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ad5845f-78c2-41d0-b7f7-99b7a694c621 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:50.688405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ad5845f-78c2-41d0-b7f7-99b7a694c621 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:50.693210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ad5845f-78c2-41d0-b7f7-99b7a694c621 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:50.803255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:50.807672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0d9d376f-0142-470a-bfdf-01d41e3c5fba tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b138523a0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:50.832301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ad5845f-78c2-41d0-b7f7-99b7a694c621 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:50.832759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ad5845f-78c2-41d0-b7f7-99b7a694c621 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:50.838069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-1ad5845f-78c2-41d0-b7f7-99b7a694c621 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lazy-loading 'fault' on Instance uuid 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:48:50.900509 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0d9d376f-0142-470a-bfdf-01d41e3c5fba tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.097867 Aug 03 01:48:50.902265 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 219/445] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:50 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:51.046424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1ad5845f-78c2-41d0-b7f7-99b7a694c621 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:51.060045 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1ad5845f-78c2-41d0-b7f7-99b7a694c621 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 200 len: 1311 microversion: 2.1 time: 0.403761 Aug 03 01:48:51.082100 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 227/446] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:50 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 1311 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:51.190353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5596f185-5fb6-45a6-a9c1-c98a55e06949 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:51.192012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5596f185-5fb6-45a6-a9c1-c98a55e06949 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:51.206841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5596f185-5fb6-45a6-a9c1-c98a55e06949 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:51.215637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5596f185-5fb6-45a6-a9c1-c98a55e06949 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:51.224868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5596f185-5fb6-45a6-a9c1-c98a55e06949 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:51.225605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5596f185-5fb6-45a6-a9c1-c98a55e06949 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:51.749009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=36 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:51.761215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7845c6bb-8ddc-4d9e-9e0e-a93e00779a9a tempest-FlavorsV255TestJSON-148371138 tempest-FlavorsV255TestJSON-148371138-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1379093355", "id": 1845870666, "os-flavor-access:is_public": "True"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:51.792866 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:51.792866 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:51.807092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=81,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:51.831926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5596f185-5fb6-45a6-a9c1-c98a55e06949 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:51.849148 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7845c6bb-8ddc-4d9e-9e0e-a93e00779a9a tempest-FlavorsV255TestJSON-148371138 tempest-FlavorsV255TestJSON-148371138-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.765082 Aug 03 01:48:51.851360 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 220/447] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 01:48:51 2022] POST /compute/v2.1/flavors => generated 449 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:48:51.856881 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5596f185-5fb6-45a6-a9c1-c98a55e06949 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.682643 Aug 03 01:48:51.859675 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 228/448] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:51 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:52.593540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-df23898a-d276-4f30-8dcc-479e4503115c tempest-FlavorsV255TestJSON-2082229349 tempest-FlavorsV255TestJSON-2082229349-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:52.615924 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-df23898a-d276-4f30-8dcc-479e4503115c tempest-FlavorsV255TestJSON-2082229349 tempest-FlavorsV255TestJSON-2082229349-project] 10.222.0.67 "GET /compute/v2.1/flavors/1845870666" status: 200 len: 449 microversion: 2.55 time: 0.754835 Aug 03 01:48:52.628165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ba5d1e74-4a77-4f5e-91d2-b696f59dda9d tempest-HypervisorAdminV228Test-162002484 tempest-HypervisorAdminV228Test-162002484-project-admin] Calling method '.version_select at 0x7f5b13852700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:52.629642 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:52.629642 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:52.631286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba5d1e74-4a77-4f5e-91d2-b696f59dda9d tempest-HypervisorAdminV228Test-162002484 tempest-HypervisorAdminV228Test-162002484-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:52.632312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba5d1e74-4a77-4f5e-91d2-b696f59dda9d tempest-HypervisorAdminV228Test-162002484 tempest-HypervisorAdminV228Test-162002484-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:52.637271 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 229/449] 10.222.0.67 () {60 vars in 1199 bytes} [Wed Aug 3 01:48:51 2022] GET /compute/v2.1/flavors/1845870666 => generated 449 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:48:52.660128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fb8942f8-a7ad-4401-83f4-08772af7b143 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13c04700>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:52.686854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba5d1e74-4a77-4f5e-91d2-b696f59dda9d tempest-HypervisorAdminV228Test-162002484 tempest-HypervisorAdminV228Test-162002484-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:52.689393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba5d1e74-4a77-4f5e-91d2-b696f59dda9d tempest-HypervisorAdminV228Test-162002484 tempest-HypervisorAdminV228Test-162002484-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:52.714548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba5d1e74-4a77-4f5e-91d2-b696f59dda9d tempest-HypervisorAdminV228Test-162002484 tempest-HypervisorAdminV228Test-162002484-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:52.715842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba5d1e74-4a77-4f5e-91d2-b696f59dda9d tempest-HypervisorAdminV228Test-162002484 tempest-HypervisorAdminV228Test-162002484-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:52.743374 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ba5d1e74-4a77-4f5e-91d2-b696f59dda9d tempest-HypervisorAdminV228Test-162002484 tempest-HypervisorAdminV228Test-162002484-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.889874 Aug 03 01:48:52.744834 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 221/450] 10.222.0.67 () {60 vars in 1187 bytes} [Wed Aug 3 01:48:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:48:52.762140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c47b297b-f4d8-4a05-b494-598a4579051a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:52.763286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c47b297b-f4d8-4a05-b494-598a4579051a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 60c808b6-416a-4dcb-af4e-cfc78f56dfa3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:52.782230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c47b297b-f4d8-4a05-b494-598a4579051a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:52.791456 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fb8942f8-a7ad-4401-83f4-08772af7b143 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1423 microversion: 2.1 time: 0.152921 Aug 03 01:48:52.792692 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 230/451] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:52 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1423 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:52.796659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c47b297b-f4d8-4a05-b494-598a4579051a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:52.798583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c47b297b-f4d8-4a05-b494-598a4579051a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:52.802042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c47b297b-f4d8-4a05-b494-598a4579051a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:52.814240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ae29162c-cab7-4125-badf-1ae2c581bf54 tempest-FlavorsV255TestJSON-148371138 tempest-FlavorsV255TestJSON-148371138-project-admin] Action: 'update', calling method: .version_select at 0x7f5b220c2b80>, body: {"flavor": {"description": "new"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:52.851850 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:52.851850 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:52.855910 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-c47b297b-f4d8-4a05-b494-598a4579051a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] HTTP exception thrown: Instance 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 could not be found. Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c47b297b-f4d8-4a05-b494-598a4579051a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Request method failure captured: Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 HTTP/1.1 Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPZpjAq3B47wli3_JsXMArF7ESOWqOwXx66OfthUor9JEyFKewlgjOI_tRrNiYTJjz7yWuHP0oeh-UEF9oxBoJRSrhxn1hhRsKJsPBD9Caff5SIofy1wC5PuDu_-dSGPSMFOta8KpX_ewOJXybcRqccvMDf2lcuIGb9CSXnZJo22kM Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 36f606d386d74db39a1088bb1d3dec27 Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1037734365 Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:52.863774 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:52.865347 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_36f606d386d74db39a1088bb1d3dec27", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/36f606d386d74db39a1088bb1d3dec27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/36f606d386d74db39a1088bb1d3dec27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/36f606d386d74db39a1088bb1d3dec27"}]}] Aug 03 01:48:52.865347 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1037734365 Aug 03 01:48:52.865347 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 36f606d386d74db39a1088bb1d3dec27 Aug 03 01:48:52.865347 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1037734365 Aug 03 01:48:52.865347 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersAdminNegativeTestJSON-1037734365-project Aug 03 01:48:52.865347 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:52.865347 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:52.865347 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 301ad92d37f142b9b3a2f77bbe5a6655 Aug 03 01:48:52.865347 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1037734365-project Aug 03 01:48:52.865347 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:48:52.865347 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 could not be found. Aug 03 01:48:52.865347 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '60c808b6-416a-4dcb-af4e-cfc78f56dfa3'} Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 could not be found. Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:52.866100 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 could not be found. Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 could not be found. Aug 03 01:48:52.867400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:52.869504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c47b297b-f4d8-4a05-b494-598a4579051a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Returning 404 to user: Instance 60c808b6-416a-4dcb-af4e-cfc78f56dfa3 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:52.869504 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c47b297b-f4d8-4a05-b494-598a4579051a tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3" status: 404 len: 111 microversion: 2.1 time: 0.117606 Aug 03 01:48:52.869504 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 222/452] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:52 2022] GET /compute/v2.1/servers/60c808b6-416a-4dcb-af4e-cfc78f56dfa3 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:52.888336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d83b8d09-dd53-4e5f-806e-828b5875ff5d tempest-HypervisorAdminV228Test-162002484 tempest-HypervisorAdminV228Test-162002484-project-admin] Calling method '.version_select at 0x7f5b13829310>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:52.900726 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:52.900726 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:52.904820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d83b8d09-dd53-4e5f-806e-828b5875ff5d tempest-HypervisorAdminV228Test-162002484 tempest-HypervisorAdminV228Test-162002484-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:52.908453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d83b8d09-dd53-4e5f-806e-828b5875ff5d tempest-HypervisorAdminV228Test-162002484 tempest-HypervisorAdminV228Test-162002484-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:52.939923 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ae29162c-cab7-4125-badf-1ae2c581bf54 tempest-FlavorsV255TestJSON-148371138 tempest-FlavorsV255TestJSON-148371138-project-admin] 10.222.0.67 "PUT /compute/v2.1/flavors/1845870666" status: 200 len: 450 microversion: 2.55 time: 0.142472 Aug 03 01:48:52.941841 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 231/453] 10.222.0.67 () {62 vars in 1219 bytes} [Wed Aug 3 01:48:52 2022] PUT /compute/v2.1/flavors/1845870666 => generated 450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:48:52.952686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eb19a6b2-97f4-4520-a076-a765ad2cd7e6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:52.962063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eb19a6b2-97f4-4520-a076-a765ad2cd7e6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:52.962653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d83b8d09-dd53-4e5f-806e-828b5875ff5d tempest-HypervisorAdminV228Test-162002484 tempest-HypervisorAdminV228Test-162002484-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:52.964622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d83b8d09-dd53-4e5f-806e-828b5875ff5d tempest-HypervisorAdminV228Test-162002484 tempest-HypervisorAdminV228Test-162002484-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:52.983682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb19a6b2-97f4-4520-a076-a765ad2cd7e6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:52.984517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb19a6b2-97f4-4520-a076-a765ad2cd7e6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:52.985602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb19a6b2-97f4-4520-a076-a765ad2cd7e6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:52.986283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb19a6b2-97f4-4520-a076-a765ad2cd7e6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:52.986671 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d83b8d09-dd53-4e5f-806e-828b5875ff5d tempest-HypervisorAdminV228Test-162002484 tempest-HypervisorAdminV228Test-162002484-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.114619 Aug 03 01:48:52.991419 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 223/454] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 3 01:48:52 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:48:53.001542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5b04e658-d8b9-41c6-a052-3cb3f4aa4e7c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:53.003750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5b04e658-d8b9-41c6-a052-3cb3f4aa4e7c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:53.022571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b04e658-d8b9-41c6-a052-3cb3f4aa4e7c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:53.023357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b04e658-d8b9-41c6-a052-3cb3f4aa4e7c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:53.024355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b04e658-d8b9-41c6-a052-3cb3f4aa4e7c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:53.026392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b04e658-d8b9-41c6-a052-3cb3f4aa4e7c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:53.057705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eb19a6b2-97f4-4520-a076-a765ad2cd7e6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:48:53.122141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:53.275621 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eb19a6b2-97f4-4520-a076-a765ad2cd7e6 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "DELETE /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 204 len: 0 microversion: 2.1 time: 0.330332 Aug 03 01:48:53.276760 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 232/455] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:48:52 2022] DELETE /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:48:53.286081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-396cc14c-7ff0-4b4a-ac83-21b6185d444d tempest-FlavorsV255TestJSON-2082229349 tempest-FlavorsV255TestJSON-2082229349-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:53.334697 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-396cc14c-7ff0-4b4a-ac83-21b6185d444d tempest-FlavorsV255TestJSON-2082229349 tempest-FlavorsV255TestJSON-2082229349-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.056170 Aug 03 01:48:53.354311 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 233/456] 10.222.0.67 () {60 vars in 1187 bytes} [Wed Aug 3 01:48:53 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:48:53.362948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-db27c90f-2d0c-4008-9036-7636ed1a3d1d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:53.363605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-db27c90f-2d0c-4008-9036-7636ed1a3d1d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:53.372224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db27c90f-2d0c-4008-9036-7636ed1a3d1d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:53.373055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db27c90f-2d0c-4008-9036-7636ed1a3d1d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:53.374070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db27c90f-2d0c-4008-9036-7636ed1a3d1d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:53.374704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db27c90f-2d0c-4008-9036-7636ed1a3d1d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:53.380057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5b04e658-d8b9-41c6-a052-3cb3f4aa4e7c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:53.390865 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5b04e658-d8b9-41c6-a052-3cb3f4aa4e7c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.397333 Aug 03 01:48:53.404295 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 224/457] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:52 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:53.417668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-55e1c4db-1108-46c3-a580-828514117f3e tempest-FlavorsV255TestJSON-2082229349 tempest-FlavorsV255TestJSON-2082229349-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:53.465925 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-55e1c4db-1108-46c3-a580-828514117f3e tempest-FlavorsV255TestJSON-2082229349 tempest-FlavorsV255TestJSON-2082229349-project] 10.222.0.67 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.060442 Aug 03 01:48:53.466965 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 225/458] 10.222.0.67 () {60 vars in 1166 bytes} [Wed Aug 3 01:48:53 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:48:53.483567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-647943fa-9f3c-466f-a324-447b76ec9c3a tempest-FlavorsV255TestJSON-148371138 tempest-FlavorsV255TestJSON-148371138-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:53.484778 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:53.484778 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:53.511365 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-647943fa-9f3c-466f-a324-447b76ec9c3a tempest-FlavorsV255TestJSON-148371138 tempest-FlavorsV255TestJSON-148371138-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1845870666" status: 202 len: 0 microversion: 2.55 time: 0.031884 Aug 03 01:48:53.512610 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 226/459] 10.222.0.67 () {60 vars in 1202 bytes} [Wed Aug 3 01:48:53 2022] DELETE /compute/v2.1/flavors/1845870666 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 03 01:48:53.521918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b3354877-4774-4b4c-a8ff-612959a20ca5 tempest-FlavorsV255TestJSON-148371138 tempest-FlavorsV255TestJSON-148371138-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:53.570030 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b3354877-4774-4b4c-a8ff-612959a20ca5 tempest-FlavorsV255TestJSON-148371138 tempest-FlavorsV255TestJSON-148371138-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.047230 Aug 03 01:48:53.571640 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 227/460] 10.222.0.67 () {60 vars in 1187 bytes} [Wed Aug 3 01:48:53 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:48:53.610437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-db27c90f-2d0c-4008-9036-7636ed1a3d1d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:53.621298 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-db27c90f-2d0c-4008-9036-7636ed1a3d1d tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 200 len: 1477 microversion: 2.1 time: 0.265938 Aug 03 01:48:53.622540 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 234/461] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:53 2022] GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 1477 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:53.810530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-875f0b3d-4e28-4f4f-ac8f-93a2a5973311 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13c3e550>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:53.871211 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-875f0b3d-4e28-4f4f-ac8f-93a2a5973311 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1432 microversion: 2.1 time: 0.067237 Aug 03 01:48:53.872095 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 235/462] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:53 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1432 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:53.889116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f5119fd5-fb70-470d-8b14-96d7b850534b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13b95280>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:53.946297 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f5119fd5-fb70-470d-8b14-96d7b850534b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 200 len: 1432 microversion: 2.1 time: 0.063029 Aug 03 01:48:53.947801 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 236/463] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:53 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 1432 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:53.973184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-39535ff4-29f5-49e4-9006-41b0de318a7a tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:53.973813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-39535ff4-29f5-49e4-9006-41b0de318a7a tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:53.984303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39535ff4-29f5-49e4-9006-41b0de318a7a tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:53.985060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39535ff4-29f5-49e4-9006-41b0de318a7a tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:53.986076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39535ff4-29f5-49e4-9006-41b0de318a7a tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:53.987060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39535ff4-29f5-49e4-9006-41b0de318a7a tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:54.115844 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d2694195-8ddc-4d5f-bc9d-f97fd8c581cd tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:54.135723 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d2694195-8ddc-4d5f-bc9d-f97fd8c581cd tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.429231 Aug 03 01:48:54.144622 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 228/464] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:48:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:54.218760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-39535ff4-29f5-49e4-9006-41b0de318a7a tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:54.228007 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-39535ff4-29f5-49e4-9006-41b0de318a7a tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1478 microversion: 2.1 time: 0.271505 Aug 03 01:48:54.242858 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 237/465] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:53 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1478 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:54.416555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93bd1f20-023b-4e84-9052-bce471d4d7b8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:54.417513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93bd1f20-023b-4e84-9052-bce471d4d7b8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:54.428083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93bd1f20-023b-4e84-9052-bce471d4d7b8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:54.428472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93bd1f20-023b-4e84-9052-bce471d4d7b8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:54.437966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93bd1f20-023b-4e84-9052-bce471d4d7b8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:54.438584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93bd1f20-023b-4e84-9052-bce471d4d7b8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:54.553925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-899b5bf1-d87d-4c82-94a1-69bba32a6ed6 tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1446361369", "id": 1364948124, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:54.557529 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:54.557529 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:54.606258 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-899b5bf1-d87d-4c82-94a1-69bba32a6ed6 tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.455618 Aug 03 01:48:54.606922 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 229/466] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:54 2022] POST /compute/v2.1/flavors => generated 425 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:54.622336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-779eeed4-a527-4588-a9fe-17644972bca7 tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:54.677541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-93bd1f20-023b-4e84-9052-bce471d4d7b8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:54.687981 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93bd1f20-023b-4e84-9052-bce471d4d7b8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.275121 Aug 03 01:48:54.688649 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-779eeed4-a527-4588-a9fe-17644972bca7 tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.073058 Aug 03 01:48:54.689038 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 238/467] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:54 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:54.690957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=12 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:54.703467 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 230/468] 10.222.0.67 () {58 vars in 1182 bytes} [Wed Aug 3 01:48:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:48:54.730445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ae964dd-bfeb-4fbf-bdf5-708424f5e5a2 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:54.733563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-44880e78-732a-42a0-b3d1-721e512afb52 tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-418414260", "id": 1056396905, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:54.734502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2ae964dd-bfeb-4fbf-bdf5-708424f5e5a2 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:54.768249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ae964dd-bfeb-4fbf-bdf5-708424f5e5a2 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:54.771166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ae964dd-bfeb-4fbf-bdf5-708424f5e5a2 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:54.774977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ae964dd-bfeb-4fbf-bdf5-708424f5e5a2 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:54.777170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ae964dd-bfeb-4fbf-bdf5-708424f5e5a2 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:54.805320 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-44880e78-732a-42a0-b3d1-721e512afb52 tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.088822 Aug 03 01:48:54.805320 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 231/469] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:54 2022] POST /compute/v2.1/flavors => generated 424 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:54.830663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cb41a3e8-1aba-48b7-865f-7020f9ca04b9 tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:54.851669 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cb41a3e8-1aba-48b7-865f-7020f9ca04b9 tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040995 Aug 03 01:48:54.857380 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 232/470] 10.222.0.67 () {58 vars in 1182 bytes} [Wed Aug 3 01:48:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:48:54.876873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fbb733e5-3d42-41c1-af2e-3f7a69b3549f tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Action: 'create', calling method: .version_select at 0x7f5b138b70d0>, body: {"keypair": {"name": "tempest-keypair-1119800332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQTXx0a2jsiLrLBpo8yTZyzTCkiH6gQScAn6Fu5D8NBj6nsacojJ74JXPxIn0swEp+acZ8cEeKMt294y61jS2UIyXqRb0rzO5j/p0w2P80y4H6EaL9gODgrex+dDmsOOw=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:54.882007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=44 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:54.959856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-fbb733e5-3d42-41c1-af2e-3f7a69b3549f tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Getting quotas for project 631d6080e5d14fb3906ecf8c339478d7. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:48:54.966802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-fbb733e5-3d42-41c1-af2e-3f7a69b3549f tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Getting quotas for user 141f8784088448cdafee6cee8955dc71 and project 631d6080e5d14fb3906ecf8c339478d7. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:48:55.036676 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fbb733e5-3d42-41c1-af2e-3f7a69b3549f tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.168575 Aug 03 01:48:55.037686 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 233/471] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 01:48:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:55.135970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2ae964dd-bfeb-4fbf-bdf5-708424f5e5a2 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:55.150285 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2ae964dd-bfeb-4fbf-bdf5-708424f5e5a2 tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 200 len: 1477 microversion: 2.1 time: 0.458883 Aug 03 01:48:55.171140 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 239/472] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:54 2022] GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 1477 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:55.253347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-60dc46f6-0ad1-4b1c-947d-f1544fadd2a5 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:55.254529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-60dc46f6-0ad1-4b1c-947d-f1544fadd2a5 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:55.275070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60dc46f6-0ad1-4b1c-947d-f1544fadd2a5 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:55.275849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60dc46f6-0ad1-4b1c-947d-f1544fadd2a5 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:55.282221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60dc46f6-0ad1-4b1c-947d-f1544fadd2a5 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:55.282935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60dc46f6-0ad1-4b1c-947d-f1544fadd2a5 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:55.711567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a180cc13-6d77-4a99-aea4-175131513c92 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:55.712532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a180cc13-6d77-4a99-aea4-175131513c92 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:55.754718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a180cc13-6d77-4a99-aea4-175131513c92 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:55.755218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a180cc13-6d77-4a99-aea4-175131513c92 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:55.756062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a180cc13-6d77-4a99-aea4-175131513c92 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:55.756592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a180cc13-6d77-4a99-aea4-175131513c92 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:55.972618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-60dc46f6-0ad1-4b1c-947d-f1544fadd2a5 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:55.986364 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-60dc46f6-0ad1-4b1c-947d-f1544fadd2a5 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1465 microversion: 2.1 time: 0.738856 Aug 03 01:48:56.004278 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 234/473] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:55 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1465 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:56.018036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c3e2534f-b061-4dfc-a0b5-b7c0b15e10bc req-113e9c63-1b20-46b1-9c9d-ce9797bc972b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77121f3e-c5a9-4057-808c-572c59ff77ea", "name": "network-vif-deleted", "tag": "506dd21b-00d7-4476-9ca9-b19cbb34995c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:56.040559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c3e2534f-b061-4dfc-a0b5-b7c0b15e10bc req-113e9c63-1b20-46b1-9c9d-ce9797bc972b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:56.041006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c3e2534f-b061-4dfc-a0b5-b7c0b15e10bc req-113e9c63-1b20-46b1-9c9d-ce9797bc972b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:56.079923 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c3e2534f-b061-4dfc-a0b5-b7c0b15e10bc req-113e9c63-1b20-46b1-9c9d-ce9797bc972b service nova] Creating event network-vif-deleted:506dd21b-00d7-4476-9ca9-b19cbb34995c for instance 77121f3e-c5a9-4057-808c-572c59ff77ea on n-h1-826529-8 Aug 03 01:48:56.099994 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c3e2534f-b061-4dfc-a0b5-b7c0b15e10bc req-113e9c63-1b20-46b1-9c9d-ce9797bc972b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092324 Aug 03 01:48:56.101142 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 235/474] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:56.110381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37f96f3c-3212-4f89-a6be-5152ea541dbd tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b138965e0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:56.164288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a180cc13-6d77-4a99-aea4-175131513c92 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:56.177940 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-37f96f3c-3212-4f89-a6be-5152ea541dbd tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/b851b45e-5c09-4153-a051-b8cb3fbe48b3" status: 200 len: 784 microversion: 2.1 time: 0.072065 Aug 03 01:48:56.178608 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a180cc13-6d77-4a99-aea4-175131513c92 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.468756 Aug 03 01:48:56.187351 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 236/475] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:56 2022] GET /compute/v2.1/images/b851b45e-5c09-4153-a051-b8cb3fbe48b3 => generated 784 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:56.195413 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 240/476] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:55 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:56.208014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8d7b8437-0cde-4a47-8e6f-6b5add0f3f1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:56.208954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8d7b8437-0cde-4a47-8e6f-6b5add0f3f1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:56.222016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b35cdfbe-ad6e-4e88-922d-ef658eae9c70 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:56.226970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d7b8437-0cde-4a47-8e6f-6b5add0f3f1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:56.227713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d7b8437-0cde-4a47-8e6f-6b5add0f3f1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:56.231192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d7b8437-0cde-4a47-8e6f-6b5add0f3f1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:56.231889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d7b8437-0cde-4a47-8e6f-6b5add0f3f1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:56.275510 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b35cdfbe-ad6e-4e88-922d-ef658eae9c70 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.077673 Aug 03 01:48:56.279057 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 241/477] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:48:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:56.294617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ee15dac4-2027-473d-bd08-cd3b7310db9f tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13c89670>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:56.373228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d7b8437-0cde-4a47-8e6f-6b5add0f3f1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:56.373649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d7b8437-0cde-4a47-8e6f-6b5add0f3f1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:56.374100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-8d7b8437-0cde-4a47-8e6f-6b5add0f3f1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lazy-loading 'fault' on Instance uuid 77121f3e-c5a9-4057-808c-572c59ff77ea {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:48:56.501720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8d7b8437-0cde-4a47-8e6f-6b5add0f3f1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ad92d37f142b9b3a2f77bbe5a6655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f606d386d74db39a1088bb1d3dec27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:56.505416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:56.521920 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8d7b8437-0cde-4a47-8e6f-6b5add0f3f1e tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 200 len: 1311 microversion: 2.1 time: 0.326011 Aug 03 01:48:56.523113 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 237/478] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:56 2022] GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 1311 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:57.206755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9d0b923f-26e4-4d9e-9fc6-516594294713 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:57.207782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9d0b923f-26e4-4d9e-9fc6-516594294713 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:57.226268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d0b923f-26e4-4d9e-9fc6-516594294713 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:57.228524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d0b923f-26e4-4d9e-9fc6-516594294713 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:57.233893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d0b923f-26e4-4d9e-9fc6-516594294713 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:57.234817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d0b923f-26e4-4d9e-9fc6-516594294713 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:57.611702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9d0b923f-26e4-4d9e-9fc6-516594294713 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:57.625507 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9d0b923f-26e4-4d9e-9fc6-516594294713 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.424623 Aug 03 01:48:57.626971 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 238/479] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:57 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:48:58.171779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3a3c9810-2000-408f-9d85-ea03205a6547 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Calling method '.version_select at 0x7f5b138b7280>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:58.174598 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:58.174598 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:58.179090 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ee15dac4-2027-473d-bd08-cd3b7310db9f tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "DELETE /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 204 len: 0 microversion: 2.1 time: 1.892437 Aug 03 01:48:58.179723 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 242/480] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:56 2022] DELETE /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 0 bytes in 1894 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 01:48:58.183523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a3c9810-2000-408f-9d85-ea03205a6547 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.184287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a3c9810-2000-408f-9d85-ea03205a6547 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.187451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d3cab980-5bdc-4b9c-9e5a-602e477457cd req-478455f0-87f9-46bf-97e1-69550edc55d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6", "name": "network-vif-unplugged", "status": "completed", "tag": "d59c4745-6408-4d6f-a309-951c6fc953d9"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:58.206769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d3cab980-5bdc-4b9c-9e5a-602e477457cd req-478455f0-87f9-46bf-97e1-69550edc55d4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.208870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d3cab980-5bdc-4b9c-9e5a-602e477457cd req-478455f0-87f9-46bf-97e1-69550edc55d4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.230254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a3c9810-2000-408f-9d85-ea03205a6547 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.231274 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d3cab980-5bdc-4b9c-9e5a-602e477457cd req-478455f0-87f9-46bf-97e1-69550edc55d4 service nova] Creating event network-vif-unplugged:d59c4745-6408-4d6f-a309-951c6fc953d9 for instance fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 on n-h2-826529-8 Aug 03 01:48:58.234448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a3c9810-2000-408f-9d85-ea03205a6547 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.240426 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d3cab980-5bdc-4b9c-9e5a-602e477457cd req-478455f0-87f9-46bf-97e1-69550edc55d4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058621 Aug 03 01:48:58.241760 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 243/481] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:58.254413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c6d219c1-71e1-45c2-9c96-eba42f10f5aa tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:58.254640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a3c9810-2000-408f-9d85-ea03205a6547 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.256101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a3c9810-2000-408f-9d85-ea03205a6547 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.259653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c6d219c1-71e1-45c2-9c96-eba42f10f5aa tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] [instance: 77121f3e-c5a9-4057-808c-572c59ff77ea] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:58.266718 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3a3c9810-2000-408f-9d85-ea03205a6547 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.631299 Aug 03 01:48:58.276450 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 239/482] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:58.276687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c6d219c1-71e1-45c2-9c96-eba42f10f5aa tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.278681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c6d219c1-71e1-45c2-9c96-eba42f10f5aa tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.279604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c6d219c1-71e1-45c2-9c96-eba42f10f5aa tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.280600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c6d219c1-71e1-45c2-9c96-eba42f10f5aa tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.282365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dd268cd0-ca7f-4edc-b5fd-92d0cbf0ea0d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13829b80>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:58.307931 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-c6d219c1-71e1-45c2-9c96-eba42f10f5aa tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] HTTP exception thrown: Instance 77121f3e-c5a9-4057-808c-572c59ff77ea could not be found. Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c6d219c1-71e1-45c2-9c96-eba42f10f5aa tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Request method failure captured: Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea HTTP/1.1 Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPZpjAq3B47wli3_JsXMArF7ESOWqOwXx66OfthUor9JEyFKewlgjOI_tRrNiYTJjz7yWuHP0oeh-UEF9oxBoJRSrhxn1hhRsKJsPBD9Caff5SIofy1wC5PuDu_-dSGPSMFOta8KpX_ewOJXybcRqccvMDf2lcuIGb9CSXnZJo22kM Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 36f606d386d74db39a1088bb1d3dec27 Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1037734365 Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:48:58.309580 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:48:58.311060 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_36f606d386d74db39a1088bb1d3dec27", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/36f606d386d74db39a1088bb1d3dec27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/36f606d386d74db39a1088bb1d3dec27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/36f606d386d74db39a1088bb1d3dec27"}]}] Aug 03 01:48:58.311060 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1037734365 Aug 03 01:48:58.311060 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 36f606d386d74db39a1088bb1d3dec27 Aug 03 01:48:58.311060 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1037734365 Aug 03 01:48:58.311060 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersAdminNegativeTestJSON-1037734365-project Aug 03 01:48:58.311060 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:48:58.311060 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:48:58.311060 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 301ad92d37f142b9b3a2f77bbe5a6655 Aug 03 01:48:58.311060 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1037734365-project Aug 03 01:48:58.311060 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:48:58.311060 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 77121f3e-c5a9-4057-808c-572c59ff77ea could not be found. Aug 03 01:48:58.311060 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '77121f3e-c5a9-4057-808c-572c59ff77ea'} Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77121f3e-c5a9-4057-808c-572c59ff77ea could not be found. Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:58.311865 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77121f3e-c5a9-4057-808c-572c59ff77ea could not be found. Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77121f3e-c5a9-4057-808c-572c59ff77ea could not be found. Aug 03 01:48:58.313099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:48:58.314050 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-dd268cd0-ca7f-4edc-b5fd-92d0cbf0ea0d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] HTTP exception thrown: Image not found. Aug 03 01:48:58.318512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c6d219c1-71e1-45c2-9c96-eba42f10f5aa tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] Returning 404 to user: Instance 77121f3e-c5a9-4057-808c-572c59ff77ea could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:58.319586 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c6d219c1-71e1-45c2-9c96-eba42f10f5aa tempest-ServersAdminNegativeTestJSON-1037734365 tempest-ServersAdminNegativeTestJSON-1037734365-project] 10.222.0.67 "GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea" status: 404 len: 111 microversion: 2.1 time: 0.076587 Aug 03 01:48:58.320579 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 244/483] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:58 2022] GET /compute/v2.1/servers/77121f3e-c5a9-4057-808c-572c59ff77ea => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dd268cd0-ca7f-4edc-b5fd-92d0cbf0ea0d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Request method failure captured: Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df HTTP/1.1 Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPWFUJlsnJ1ple2jr05hs-O_UQqOi5t8qMsi0MoLvFV2iKQatV8Qb_Tcaf_3fpV5IZzGunH-ikN_kqhU8Uvb6ARvftnUzDAE2w6yjxEmH2TXh4Lk7W-oWiScCuDPWcjf05EsVO9SEg1mugEZIl7zj6vp6rl5LSw2tlUuQe1x6AtZ_Q Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: bf1b4aebbcd24c16b2f30966a762c819 Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesOneServerTestJSON-1488369923 Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:48:58.329564 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:48:58.331719 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bf1b4aebbcd24c16b2f30966a762c819", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf1b4aebbcd24c16b2f30966a762c819"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bf1b4aebbcd24c16b2f30966a762c819"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf1b4aebbcd24c16b2f30966a762c819"}]}] Aug 03 01:48:58.331719 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesOneServerTestJSON-1488369923 Aug 03 01:48:58.331719 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: bf1b4aebbcd24c16b2f30966a762c819 Aug 03 01:48:58.331719 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1488369923 Aug 03 01:48:58.331719 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesOneServerTestJSON-1488369923-project Aug 03 01:48:58.331719 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:48:58.331719 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:48:58.331719 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 8537e15eb8f24ee3a1e1d925bba2bc68 Aug 03 01:48:58.331719 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesOneServerTestJSON-1488369923-project Aug 03 01:48:58.331719 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:48:58.331719 n-d-826529-8 devstack@n-api.service[125941]: exception: Image not found. Aug 03 01:48:58.331719 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '3e82a91c-3e9c-4507-8c68-1af9c7ae08df'} Aug 03 01:48:58.331719 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:48:58.332684 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3e82a91c-3e9c-4507-8c68-1af9c7ae08df Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:48:58.333890 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3e82a91c-3e9c-4507-8c68-1af9c7ae08df could not be found. Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:48:58.335235 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dd268cd0-ca7f-4edc-b5fd-92d0cbf0ea0d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Returning 404 to user: Image not found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:48:58.336491 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dd268cd0-ca7f-4edc-b5fd-92d0cbf0ea0d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 404 len: 62 microversion: 2.1 time: 0.056743 Aug 03 01:48:58.341133 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 240/484] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:58 2022] GET /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:48:58.348580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a2ade043-9c94-465c-bde7-ca4544f531eb tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Calling method '.version_select at 0x7f5b13852ca0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:58.352036 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:58.352036 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:58.355394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2ade043-9c94-465c-bde7-ca4544f531eb tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.358065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2ade043-9c94-465c-bde7-ca4544f531eb tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.385935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2ade043-9c94-465c-bde7-ca4544f531eb tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.386732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2ade043-9c94-465c-bde7-ca4544f531eb tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.403160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2ade043-9c94-465c-bde7-ca4544f531eb tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.403775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2ade043-9c94-465c-bde7-ca4544f531eb tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.414036 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a2ade043-9c94-465c-bde7-ca4544f531eb tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.070557 Aug 03 01:48:58.415309 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 241/485] 10.222.0.67 () {58 vars in 1167 bytes} [Wed Aug 3 01:48:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:58.423732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d0a1a41c-88cd-4601-883d-16229d6075be tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-174575702"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:58.430777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d0a1a41c-88cd-4601-883d-16229d6075be tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:58.442326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0a1a41c-88cd-4601-883d-16229d6075be tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.442927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0a1a41c-88cd-4601-883d-16229d6075be tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.444020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0a1a41c-88cd-4601-883d-16229d6075be tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.444657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0a1a41c-88cd-4601-883d-16229d6075be tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.759374 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d0a1a41c-88cd-4601-883d-16229d6075be tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "POST /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6/action" status: 202 len: 0 microversion: 2.1 time: 0.341012 Aug 03 01:48:58.761729 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 242/486] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:48:58 2022] POST /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 01:48:58.771033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ba18b3c1-41bb-46ab-aa1c-d56a28482d4b tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Calling method '.version_select at 0x7f5b13829b80>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:58.772447 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:58.772447 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:48:58.774676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba18b3c1-41bb-46ab-aa1c-d56a28482d4b tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.775462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba18b3c1-41bb-46ab-aa1c-d56a28482d4b tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.775878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ec7bc6d7-ceb4-489c-acf1-67b7b33c59d2 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1503350438", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": "none"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:58.794106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba18b3c1-41bb-46ab-aa1c-d56a28482d4b tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.794778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:UPDATE=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:48:58.795680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba18b3c1-41bb-46ab-aa1c-d56a28482d4b tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.810585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba18b3c1-41bb-46ab-aa1c-d56a28482d4b tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.811273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba18b3c1-41bb-46ab-aa1c-d56a28482d4b tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.820732 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ba18b3c1-41bb-46ab-aa1c-d56a28482d4b tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.057050 Aug 03 01:48:58.822031 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 243/487] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:58.827687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3b479fa2-fda3-4114-b3f1-60fd4262d9b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:58.828620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3b479fa2-fda3-4114-b3f1-60fd4262d9b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:58.838448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b479fa2-fda3-4114-b3f1-60fd4262d9b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.839293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b479fa2-fda3-4114-b3f1-60fd4262d9b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.840248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b479fa2-fda3-4114-b3f1-60fd4262d9b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.840843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b479fa2-fda3-4114-b3f1-60fd4262d9b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.906923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ec7bc6d7-ceb4-489c-acf1-67b7b33c59d2 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:48:58.907360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ec7bc6d7-ceb4-489c-acf1-67b7b33c59d2 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:48:58.907839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ec7bc6d7-ceb4-489c-acf1-67b7b33c59d2 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:48:58.908266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ec7bc6d7-ceb4-489c-acf1-67b7b33c59d2 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:48:58.908677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ec7bc6d7-ceb4-489c-acf1-67b7b33c59d2 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:48:58.938475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ec7bc6d7-ceb4-489c-acf1-67b7b33c59d2 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.938953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ec7bc6d7-ceb4-489c-acf1-67b7b33c59d2 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.939780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ec7bc6d7-ceb4-489c-acf1-67b7b33c59d2 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:58.940803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ec7bc6d7-ceb4-489c-acf1-67b7b33c59d2 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:58.986223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ec7bc6d7-ceb4-489c-acf1-67b7b33c59d2 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Getting quotas for project b583c1e5f68241e2811e543567879cc0. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:48:58.995705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ec7bc6d7-ceb4-489c-acf1-67b7b33c59d2 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Getting quotas for user 32bee898d9d141bfaa0915665466a30f and project b583c1e5f68241e2811e543567879cc0. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:48:59.017929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ec7bc6d7-ceb4-489c-acf1-67b7b33c59d2 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:48:59.022424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ec7bc6d7-ceb4-489c-acf1-67b7b33c59d2 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:48:59.068054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3b479fa2-fda3-4114-b3f1-60fd4262d9b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:59.081758 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3b479fa2-fda3-4114-b3f1-60fd4262d9b3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.257037 Aug 03 01:48:59.083555 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 244/488] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:48:58 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:59.090220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-02b99318-e9c3-4132-b375-2fce49ebb2cd tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b1376bdc0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:59.109183 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ec7bc6d7-ceb4-489c-acf1-67b7b33c59d2 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.786213 Aug 03 01:48:59.110814 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 245/489] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 01:48:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 01:48:59.120937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-07fb9695-e1c6-4602-98a4-1aa966096fdb tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Calling method '.version_select at 0x7f5b13c049d0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:59.122024 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:59.122024 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:59.124901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07fb9695-e1c6-4602-98a4-1aa966096fdb tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:59.125472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07fb9695-e1c6-4602-98a4-1aa966096fdb tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:59.183498 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-02b99318-e9c3-4132-b375-2fce49ebb2cd tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.098183 Aug 03 01:48:59.184793 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 245/490] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:48:59 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:48:59.197363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07fb9695-e1c6-4602-98a4-1aa966096fdb tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:59.207159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07fb9695-e1c6-4602-98a4-1aa966096fdb tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:59.213218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1160432169", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "1056396905", "adminPass": "***", "networks": [{"uuid": "8ede81e3-375c-499e-90c5-c149d68b9fd2"}], "security_groups": [{"name": "tempest-securitygroup--243209664"}], "key_name": "tempest-keypair-1119800332", "user_data": "}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:59.236170 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-07fb9695-e1c6-4602-98a4-1aa966096fdb tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.123915 Aug 03 01:48:59.244081 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 246/491] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:48:59 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:59.248972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7b27dc7d-6dca-4865-b8ca-57a2fe8a1dc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:48:59.270263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7b27dc7d-6dca-4865-b8ca-57a2fe8a1dc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:59.452771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7b27dc7d-6dca-4865-b8ca-57a2fe8a1dc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:59.467009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7b27dc7d-6dca-4865-b8ca-57a2fe8a1dc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:59.468618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7b27dc7d-6dca-4865-b8ca-57a2fe8a1dc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:59.484478 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7b27dc7d-6dca-4865-b8ca-57a2fe8a1dc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "PUT /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1359 microversion: 2.75 time: 0.239250 Aug 03 01:48:59.493110 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 247/492] 10.222.0.67 () {62 vars in 1297 bytes} [Wed Aug 3 01:48:59 2022] PUT /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:48:59.502632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9a8dbcb5-58c5-417e-9f5f-20cf72264ec3 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Calling method '.version_select at 0x7f5b13c79ee0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:59.504856 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:59.504856 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:59.507215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a8dbcb5-58c5-417e-9f5f-20cf72264ec3 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:59.511594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a8dbcb5-58c5-417e-9f5f-20cf72264ec3 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:59.517902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] validate_networks() for [('8ede81e3-375c-499e-90c5-c149d68b9fd2', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:48:59.556367 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9a8dbcb5-58c5-417e-9f5f-20cf72264ec3 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.061097 Aug 03 01:48:59.557766 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 248/493] 10.222.0.67 () {58 vars in 1179 bytes} [Wed Aug 3 01:48:59 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:59.563769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2f0e7b0b-c036-4126-a9d4-9d78b6fa880c tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:59.564670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2f0e7b0b-c036-4126-a9d4-9d78b6fa880c tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:48:59.675514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2f0e7b0b-c036-4126-a9d4-9d78b6fa880c tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:59.684067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2f0e7b0b-c036-4126-a9d4-9d78b6fa880c tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:59.685585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2f0e7b0b-c036-4126-a9d4-9d78b6fa880c tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:48:59.703313 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2f0e7b0b-c036-4126-a9d4-9d78b6fa880c tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1359 microversion: 2.75 time: 0.144266 Aug 03 01:48:59.704171 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 249/494] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:48:59 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:48:59.719938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3a1732ae-5264-47b2-b74f-8f3e4c8ca29e tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Calling method '.version_select at 0x7f5b13c6daf0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:59.721085 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:59.721085 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:59.729316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a1732ae-5264-47b2-b74f-8f3e4c8ca29e tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:59.730027 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a1732ae-5264-47b2-b74f-8f3e4c8ca29e tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:59.770311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a1732ae-5264-47b2-b74f-8f3e4c8ca29e tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:59.770787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a1732ae-5264-47b2-b74f-8f3e4c8ca29e tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:59.787510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a1732ae-5264-47b2-b74f-8f3e4c8ca29e tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:59.788052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a1732ae-5264-47b2-b74f-8f3e4c8ca29e tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:59.798961 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3a1732ae-5264-47b2-b74f-8f3e4c8ca29e tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.090698 Aug 03 01:48:59.806739 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 250/495] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:48:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:59.825786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6a50f01a-5c3f-4dce-ba1c-2cbbe8e7e283 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Calling method '.version_select at 0x7f5b13c6d550>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:59.826704 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:59.826704 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:59.828997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a50f01a-5c3f-4dce-ba1c-2cbbe8e7e283 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:59.829457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a50f01a-5c3f-4dce-ba1c-2cbbe8e7e283 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:59.855735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a50f01a-5c3f-4dce-ba1c-2cbbe8e7e283 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:59.860766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a50f01a-5c3f-4dce-ba1c-2cbbe8e7e283 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:59.872252 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6a50f01a-5c3f-4dce-ba1c-2cbbe8e7e283 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.062874 Aug 03 01:48:59.882406 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 251/496] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:48:59 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:59.887495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-45a1531b-b68d-454a-a5dd-0db2f4f8d0a6 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Calling method '.version_select at 0x7f5b13c041f0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:59.888304 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:59.888304 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:59.889618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45a1531b-b68d-454a-a5dd-0db2f4f8d0a6 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:59.890354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45a1531b-b68d-454a-a5dd-0db2f4f8d0a6 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:59.905636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45a1531b-b68d-454a-a5dd-0db2f4f8d0a6 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:59.906084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45a1531b-b68d-454a-a5dd-0db2f4f8d0a6 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:59.914892 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-45a1531b-b68d-454a-a5dd-0db2f4f8d0a6 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.031167 Aug 03 01:48:59.915656 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 252/497] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:48:59 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:48:59.930729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aa19547c-2c6a-4589-93b0-453d42ac3c42 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Calling method '.version_select at 0x7f5b13c04f70>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:48:59.931567 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:48:59.931567 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:48:59.932918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa19547c-2c6a-4589-93b0-453d42ac3c42 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:59.933383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa19547c-2c6a-4589-93b0-453d42ac3c42 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:59.949354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa19547c-2c6a-4589-93b0-453d42ac3c42 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:59.950230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa19547c-2c6a-4589-93b0-453d42ac3c42 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:48:59.963351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa19547c-2c6a-4589-93b0-453d42ac3c42 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:48:59.964398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa19547c-2c6a-4589-93b0-453d42ac3c42 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:00.014588 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aa19547c-2c6a-4589-93b0-453d42ac3c42 tempest-HypervisorAdminTestJSON-53704987 tempest-HypervisorAdminTestJSON-53704987-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.088181 Aug 03 01:49:00.016103 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 253/498] 10.222.0.67 () {58 vars in 1173 bytes} [Wed Aug 3 01:48:59 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:00.112475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-20ca2436-0fea-4a86-a465-e342a8f9a06a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:00.114442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-20ca2436-0fea-4a86-a465-e342a8f9a06a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:00.136082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20ca2436-0fea-4a86-a465-e342a8f9a06a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:00.136760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20ca2436-0fea-4a86-a465-e342a8f9a06a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:00.137723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20ca2436-0fea-4a86-a465-e342a8f9a06a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:00.138159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20ca2436-0fea-4a86-a465-e342a8f9a06a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:00.401764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:49:00.402794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:49:00.404019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:49:00.404511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:49:00.404914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:49:00.425759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:00.426497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:00.427570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:00.433148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:00.482193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Getting quotas for project 631d6080e5d14fb3906ecf8c339478d7. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:49:00.491622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Getting quotas for user 141f8784088448cdafee6cee8955dc71 and project 631d6080e5d14fb3906ecf8c339478d7. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:49:00.522921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:49:00.525961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:49:00.638095 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a76f3d1b-c352-44c6-8d87-78837196c1aa tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.443150 Aug 03 01:49:00.639083 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 246/499] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:48:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:49:00.645081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a5dae919-6a98-4b00-a503-dd5e29a4ee04 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b138b7af0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:00.657619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-20ca2436-0fea-4a86-a465-e342a8f9a06a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:00.672669 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-20ca2436-0fea-4a86-a465-e342a8f9a06a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1475 microversion: 2.1 time: 0.571940 Aug 03 01:49:00.673388 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 254/500] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:00 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1475 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:00.680826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-22afe1f6-637c-4956-9c3a-0f53b432ac9e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:00.681878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-22afe1f6-637c-4956-9c3a-0f53b432ac9e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:00.734333 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a5dae919-6a98-4b00-a503-dd5e29a4ee04 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.091434 Aug 03 01:49:00.735534 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 247/501] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:00 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:00.745257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3b3eaace-6f25-4ab7-93c8-6f39c56c6cb9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:00.748483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3b3eaace-6f25-4ab7-93c8-6f39c56c6cb9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:00.775988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b3eaace-6f25-4ab7-93c8-6f39c56c6cb9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:00.777477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b3eaace-6f25-4ab7-93c8-6f39c56c6cb9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:00.778682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b3eaace-6f25-4ab7-93c8-6f39c56c6cb9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:00.782963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b3eaace-6f25-4ab7-93c8-6f39c56c6cb9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:00.828042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-22afe1f6-637c-4956-9c3a-0f53b432ac9e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:00.837852 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-22afe1f6-637c-4956-9c3a-0f53b432ac9e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 200 len: 1265 microversion: 2.1 time: 0.161564 Aug 03 01:49:00.859478 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 255/502] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:00 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:01.011652 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3b3eaace-6f25-4ab7-93c8-6f39c56c6cb9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:01.022238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3b3eaace-6f25-4ab7-93c8-6f39c56c6cb9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:01.024195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3b3eaace-6f25-4ab7-93c8-6f39c56c6cb9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:01.036218 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3b3eaace-6f25-4ab7-93c8-6f39c56c6cb9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1419 microversion: 2.75 time: 0.293754 Aug 03 01:49:01.038806 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 248/503] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:00 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1419 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:49:01.631287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-b7170e85-7d01-4d30-b26d-5607fadd4c86 req-7d5fd51c-220e-45a4-acc5-48def31e56f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dacc86a-058f-479b-b490-1866c660048b", "name": "network-vif-unplugged", "status": "completed", "tag": "088945bb-f722-4c0a-8dfe-6f40991b1450"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:01.673664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b7170e85-7d01-4d30-b26d-5607fadd4c86 req-7d5fd51c-220e-45a4-acc5-48def31e56f5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:01.675472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b7170e85-7d01-4d30-b26d-5607fadd4c86 req-7d5fd51c-220e-45a4-acc5-48def31e56f5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:01.697387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-01f76f28-401d-4148-99ab-575b8e964a30 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:01.698746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-01f76f28-401d-4148-99ab-575b8e964a30 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:01.704983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:01.707277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01f76f28-401d-4148-99ab-575b8e964a30 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:01.708219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01f76f28-401d-4148-99ab-575b8e964a30 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:01.709517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01f76f28-401d-4148-99ab-575b8e964a30 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:01.710175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01f76f28-401d-4148-99ab-575b8e964a30 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:01.722959 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-b7170e85-7d01-4d30-b26d-5607fadd4c86 req-7d5fd51c-220e-45a4-acc5-48def31e56f5 service nova] Creating event network-vif-unplugged:088945bb-f722-4c0a-8dfe-6f40991b1450 for instance 7dacc86a-058f-479b-b490-1866c660048b on n-h1-826529-8 Aug 03 01:49:01.765541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-b7170e85-7d01-4d30-b26d-5607fadd4c86 req-7d5fd51c-220e-45a4-acc5-48def31e56f5 service nova] Instance 7dacc86a-058f-479b-b490-1866c660048b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 01:49:01.792899 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-b7170e85-7d01-4d30-b26d-5607fadd4c86 req-7d5fd51c-220e-45a4-acc5-48def31e56f5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173834 Aug 03 01:49:01.793952 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 256/504] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:01.805195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4c1c4a76-7dbd-43e1-8e08-779b5ba49696 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13c79430>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:01.913148 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4c1c4a76-7dbd-43e1-8e08-779b5ba49696 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.116961 Aug 03 01:49:01.915522 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 257/505] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:01 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:01.921895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cea3dbd9-5460-45c5-9f3c-5ea896ff304f tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:01.922784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cea3dbd9-5460-45c5-9f3c-5ea896ff304f tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:01.932113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cea3dbd9-5460-45c5-9f3c-5ea896ff304f tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:01.932407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cea3dbd9-5460-45c5-9f3c-5ea896ff304f tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:01.933365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cea3dbd9-5460-45c5-9f3c-5ea896ff304f tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:01.933955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cea3dbd9-5460-45c5-9f3c-5ea896ff304f tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:01.962567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-01f76f28-401d-4148-99ab-575b8e964a30 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:01.972366 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-01f76f28-401d-4148-99ab-575b8e964a30 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1474 microversion: 2.1 time: 0.278881 Aug 03 01:49:01.987776 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 249/506] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:01 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1474 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:02.028706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cea3dbd9-5460-45c5-9f3c-5ea896ff304f tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:02.045711 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cea3dbd9-5460-45c5-9f3c-5ea896ff304f tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 200 len: 1269 microversion: 2.1 time: 0.128695 Aug 03 01:49:02.062219 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 258/507] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:01 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 1269 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:02.069056 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f1b236b6-701e-49d0-ab5c-34ae673a6cc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:02.070023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f1b236b6-701e-49d0-ab5c-34ae673a6cc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:02.078965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1b236b6-701e-49d0-ab5c-34ae673a6cc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:02.079759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1b236b6-701e-49d0-ab5c-34ae673a6cc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:02.080819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1b236b6-701e-49d0-ab5c-34ae673a6cc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:02.081514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1b236b6-701e-49d0-ab5c-34ae673a6cc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:02.212825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f1b236b6-701e-49d0-ab5c-34ae673a6cc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:02.222358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f1b236b6-701e-49d0-ab5c-34ae673a6cc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:02.224197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f1b236b6-701e-49d0-ab5c-34ae673a6cc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:02.230404 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f1b236b6-701e-49d0-ab5c-34ae673a6cc6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1417 microversion: 2.75 time: 0.165989 Aug 03 01:49:02.231007 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 250/508] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:02 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1417 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:02.882573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f5a4a375-94fa-497f-bf68-7b5672abb958 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Calling method '.version_select at 0x7f5b13b45820>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:02.885168 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:02.885168 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:49:02.886493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f5a4a375-94fa-497f-bf68-7b5672abb958 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '5435913026d348999315699c6528f426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bafe74061849ef82db32e4ec886f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f5a4a375-94fa-497f-bf68-7b5672abb958 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Request method failure captured: Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dQLzI19FCJh8AMJwTu0Hq_yYGf6DvMcMSN3jLm6RdnV-mwjSP6_X9Dp3br6Um6eoKJk5E_3OBICNd9Rk7j-DiFDqSgE_8X9cQnEVt0znj1H27EhpD0Zb9nW8Prqo9t6P1PYhBRrraZbrwVmioMU2FJOF5EgfIrFgSjJJKNZDRJr1nc Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 61bafe74061849ef82db32e4ec886f3c Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-499950608 Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:49:02.889191 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:49:02.890471 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_61bafe74061849ef82db32e4ec886f3c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/61bafe74061849ef82db32e4ec886f3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/61bafe74061849ef82db32e4ec886f3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/61bafe74061849ef82db32e4ec886f3c"}]}] Aug 03 01:49:02.890471 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-499950608 Aug 03 01:49:02.890471 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 61bafe74061849ef82db32e4ec886f3c Aug 03 01:49:02.890471 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-499950608 Aug 03 01:49:02.890471 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-HypervisorAdminNegativeTestJSON-499950608-project Aug 03 01:49:02.890471 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:49:02.890471 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:49:02.890471 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 5435913026d348999315699c6528f426 Aug 03 01:49:02.890471 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-499950608-project Aug 03 01:49:02.890471 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:49:02.890471 n-d-826529-8 devstack@n-api.service[125942]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 03 01:49:02.890471 n-d-826529-8 devstack@n-api.service[125942]: action_args: {} Aug 03 01:49:02.890471 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:49:02.891250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 03 01:49:02.892305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:02.896985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f5a4a375-94fa-497f-bf68-7b5672abb958 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:02.898125 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f5a4a375-94fa-497f-bf68-7b5672abb958 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.410028 Aug 03 01:49:02.898880 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 259/509] 10.222.0.67 () {58 vars in 1167 bytes} [Wed Aug 3 01:49:02 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 412 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:49:02.910200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9881c6f4-5e79-455c-8180-f3006c1c12e1 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Calling method '.version_select at 0x7f5b136c7700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:02.914220 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:02.914220 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:49:02.914220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9881c6f4-5e79-455c-8180-f3006c1c12e1 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '5435913026d348999315699c6528f426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bafe74061849ef82db32e4ec886f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9881c6f4-5e79-455c-8180-f3006c1c12e1 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Request method failure captured: Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dQLzI19FCJh8AMJwTu0Hq_yYGf6DvMcMSN3jLm6RdnV-mwjSP6_X9Dp3br6Um6eoKJk5E_3OBICNd9Rk7j-DiFDqSgE_8X9cQnEVt0znj1H27EhpD0Zb9nW8Prqo9t6P1PYhBRrraZbrwVmioMU2FJOF5EgfIrFgSjJJKNZDRJr1nc Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 61bafe74061849ef82db32e4ec886f3c Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-499950608 Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:49:02.915194 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:49:02.916392 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_61bafe74061849ef82db32e4ec886f3c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/61bafe74061849ef82db32e4ec886f3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/61bafe74061849ef82db32e4ec886f3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/61bafe74061849ef82db32e4ec886f3c"}]}] Aug 03 01:49:02.916392 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-499950608 Aug 03 01:49:02.916392 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 61bafe74061849ef82db32e4ec886f3c Aug 03 01:49:02.916392 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-499950608 Aug 03 01:49:02.916392 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HypervisorAdminNegativeTestJSON-499950608-project Aug 03 01:49:02.916392 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:49:02.916392 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:49:02.916392 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5435913026d348999315699c6528f426 Aug 03 01:49:02.916392 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-499950608-project Aug 03 01:49:02.916392 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:49:02.916392 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 03 01:49:02.916392 n-d-826529-8 devstack@n-api.service[125941]: action_args: {} Aug 03 01:49:02.916392 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:49:02.917111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 03 01:49:02.918239 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:02.919309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9881c6f4-5e79-455c-8180-f3006c1c12e1 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:02.919309 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9881c6f4-5e79-455c-8180-f3006c1c12e1 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.012750 Aug 03 01:49:02.927120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f5a4a375-94fa-497f-bf68-7b5672abb958 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:02.927120 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f5a4a375-94fa-497f-bf68-7b5672abb958 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] 10.222.0.67 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004618 Aug 03 01:49:02.927120 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 260/510] 10.222.0.67 () {56 vars in 886 bytes} [Wed Aug 3 01:49:02 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 03 01:49:02.927635 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 251/511] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:49:02 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:49:02.928332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-24426d2d-58ba-4961-a0ee-7d66fa7868b7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13b2d040>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:02.929150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e677357c-5647-4d4a-9ca1-b384b54e8c8c tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Calling method '.version_select at 0x7f5b13852700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:02.929471 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:02.929471 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:49:02.930560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e677357c-5647-4d4a-9ca1-b384b54e8c8c tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '5435913026d348999315699c6528f426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bafe74061849ef82db32e4ec886f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e677357c-5647-4d4a-9ca1-b384b54e8c8c tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Request method failure captured: Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dQLzI19FCJh8AMJwTu0Hq_yYGf6DvMcMSN3jLm6RdnV-mwjSP6_X9Dp3br6Um6eoKJk5E_3OBICNd9Rk7j-DiFDqSgE_8X9cQnEVt0znj1H27EhpD0Zb9nW8Prqo9t6P1PYhBRrraZbrwVmioMU2FJOF5EgfIrFgSjJJKNZDRJr1nc Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 61bafe74061849ef82db32e4ec886f3c Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-499950608 Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:49:02.932295 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:49:02.933791 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_61bafe74061849ef82db32e4ec886f3c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/61bafe74061849ef82db32e4ec886f3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/61bafe74061849ef82db32e4ec886f3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/61bafe74061849ef82db32e4ec886f3c"}]}] Aug 03 01:49:02.933791 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-499950608 Aug 03 01:49:02.933791 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 61bafe74061849ef82db32e4ec886f3c Aug 03 01:49:02.933791 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-499950608 Aug 03 01:49:02.933791 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HypervisorAdminNegativeTestJSON-499950608-project Aug 03 01:49:02.933791 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:49:02.933791 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:49:02.933791 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5435913026d348999315699c6528f426 Aug 03 01:49:02.933791 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-499950608-project Aug 03 01:49:02.933791 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:49:02.933791 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 03 01:49:02.933791 n-d-826529-8 devstack@n-api.service[125941]: action_args: {} Aug 03 01:49:02.933791 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:49:02.934604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 03 01:49:02.935937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:02.937084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e677357c-5647-4d4a-9ca1-b384b54e8c8c tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:02.937084 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e677357c-5647-4d4a-9ca1-b384b54e8c8c tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.009697 Aug 03 01:49:02.937084 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 252/512] 10.222.0.67 () {58 vars in 1179 bytes} [Wed Aug 3 01:49:02 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:49:02.990552 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-24426d2d-58ba-4961-a0ee-7d66fa7868b7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.066060 Aug 03 01:49:02.991434 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 261/513] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:02 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:03.002370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c5a7851c-1bde-42e0-baf0-7e4fd97c0cce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:03.004069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c5a7851c-1bde-42e0-baf0-7e4fd97c0cce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:03.010992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5a7851c-1bde-42e0-baf0-7e4fd97c0cce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:03.011456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5a7851c-1bde-42e0-baf0-7e4fd97c0cce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:03.012244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5a7851c-1bde-42e0-baf0-7e4fd97c0cce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:03.012683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5a7851c-1bde-42e0-baf0-7e4fd97c0cce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:03.189448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c5a7851c-1bde-42e0-baf0-7e4fd97c0cce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:03.200639 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c5a7851c-1bde-42e0-baf0-7e4fd97c0cce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1474 microversion: 2.1 time: 0.208142 Aug 03 01:49:03.201302 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 262/514] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:02 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1474 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:03.207946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2176fe56-a517-4b37-8d6c-adf76f5e8bc8 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:03.208846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2176fe56-a517-4b37-8d6c-adf76f5e8bc8 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:03.216783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2176fe56-a517-4b37-8d6c-adf76f5e8bc8 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:03.217597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2176fe56-a517-4b37-8d6c-adf76f5e8bc8 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:03.218884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2176fe56-a517-4b37-8d6c-adf76f5e8bc8 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:03.220135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2176fe56-a517-4b37-8d6c-adf76f5e8bc8 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:03.345687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2176fe56-a517-4b37-8d6c-adf76f5e8bc8 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:03.355219 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2176fe56-a517-4b37-8d6c-adf76f5e8bc8 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 200 len: 1325 microversion: 2.1 time: 0.152682 Aug 03 01:49:03.359532 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 263/515] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:03 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 1325 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:03.375898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a1c58d11-1fa4-4d15-a221-9908501416ed tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:03.376745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a1c58d11-1fa4-4d15-a221-9908501416ed tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:03.389118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1c58d11-1fa4-4d15-a221-9908501416ed tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:03.392004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1c58d11-1fa4-4d15-a221-9908501416ed tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:03.398221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1c58d11-1fa4-4d15-a221-9908501416ed tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:03.398973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1c58d11-1fa4-4d15-a221-9908501416ed tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:03.568748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:03.594131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0e08038d-4ab4-487a-89e6-5d375bf8e8c4 tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Calling method '.version_select at 0x7f5b1376bc10>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:03.596512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e08038d-4ab4-487a-89e6-5d375bf8e8c4 tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:03.597015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e08038d-4ab4-487a-89e6-5d375bf8e8c4 tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:03.630670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e08038d-4ab4-487a-89e6-5d375bf8e8c4 tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:03.631169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e08038d-4ab4-487a-89e6-5d375bf8e8c4 tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:03.660490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e08038d-4ab4-487a-89e6-5d375bf8e8c4 tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:03.660959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e08038d-4ab4-487a-89e6-5d375bf8e8c4 tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:03.676375 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0e08038d-4ab4-487a-89e6-5d375bf8e8c4 tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.731304 Aug 03 01:49:03.678831 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 253/516] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:49:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:03.691838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2edc5c8-6b78-41d0-b905-280cf0ae2a26 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Calling method '.version_select at 0x7f5b1399c0d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:03.696268 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:03.696268 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:49:03.700837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c2edc5c8-6b78-41d0-b905-280cf0ae2a26 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '5435913026d348999315699c6528f426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bafe74061849ef82db32e4ec886f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2edc5c8-6b78-41d0-b905-280cf0ae2a26 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Request method failure captured: Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dQLzI19FCJh8AMJwTu0Hq_yYGf6DvMcMSN3jLm6RdnV-mwjSP6_X9Dp3br6Um6eoKJk5E_3OBICNd9Rk7j-DiFDqSgE_8X9cQnEVt0znj1H27EhpD0Zb9nW8Prqo9t6P1PYhBRrraZbrwVmioMU2FJOF5EgfIrFgSjJJKNZDRJr1nc Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 61bafe74061849ef82db32e4ec886f3c Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-499950608 Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:49:03.713823 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:49:03.715913 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_61bafe74061849ef82db32e4ec886f3c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/61bafe74061849ef82db32e4ec886f3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/61bafe74061849ef82db32e4ec886f3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/61bafe74061849ef82db32e4ec886f3c"}]}] Aug 03 01:49:03.715913 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-499950608 Aug 03 01:49:03.715913 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 61bafe74061849ef82db32e4ec886f3c Aug 03 01:49:03.715913 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-499950608 Aug 03 01:49:03.715913 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HypervisorAdminNegativeTestJSON-499950608-project Aug 03 01:49:03.715913 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:49:03.715913 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:49:03.715913 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5435913026d348999315699c6528f426 Aug 03 01:49:03.715913 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-499950608-project Aug 03 01:49:03.715913 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:49:03.715913 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 03 01:49:03.715913 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '1'} Aug 03 01:49:03.715913 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:49:03.716726 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 03 01:49:03.717765 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:03.720475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2edc5c8-6b78-41d0-b905-280cf0ae2a26 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:03.722218 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c2edc5c8-6b78-41d0-b905-280cf0ae2a26 tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.038839 Aug 03 01:49:03.733864 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 254/517] 10.222.0.67 () {58 vars in 1173 bytes} [Wed Aug 3 01:49:03 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 03 01:49:03.761170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-18b120e2-122a-4cbe-82c3-4c5656c4513b tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Calling method '.version_select at 0x7f5b136c7ca0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:03.771977 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-18b120e2-122a-4cbe-82c3-4c5656c4513b tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] HTTP exception thrown: Hypervisor with ID '51cf0371-2965-4ce9-bd16-a41d2f3ec696' could not be found. Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-18b120e2-122a-4cbe-82c3-4c5656c4513b tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Request method failure captured: Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-hypervisors/51cf0371-2965-4ce9-bd16-a41d2f3ec696/uptime HTTP/1.1 Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dQO8Im35_WfPT5aDtA0uk62ghbL_188MbzTs_t2G9hR9MMeJNoZGZeYL7xW-kR_-zBF4eIhD5hJ5oto6DB3-70EfXkzSwhCK3ah-fSH88gNlwiT6NgE_5LYM-bg1jSJKumGmGEeuxIlQptIJunHNBzYSKhk1MERpMCci1t4uCCeGZs Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a3b74ab85e2341c591c3b985dba4914e Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-719843908 Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:49:03.802711 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:49:03.804027 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a3b74ab85e2341c591c3b985dba4914e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a3b74ab85e2341c591c3b985dba4914e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a3b74ab85e2341c591c3b985dba4914e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a3b74ab85e2341c591c3b985dba4914e"}]}] Aug 03 01:49:03.804027 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-719843908 Aug 03 01:49:03.804027 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a3b74ab85e2341c591c3b985dba4914e Aug 03 01:49:03.804027 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-719843908 Aug 03 01:49:03.804027 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin Aug 03 01:49:03.804027 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:49:03.804027 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:49:03.804027 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 9fc5535643264dd9ad56de1e2d06ae0f Aug 03 01:49:03.804027 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin Aug 03 01:49:03.804027 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:49:03.804027 n-d-826529-8 devstack@n-api.service[125941]: exception: Hypervisor with ID '51cf0371-2965-4ce9-bd16-a41d2f3ec696' could not be found. Aug 03 01:49:03.804027 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '51cf0371-2965-4ce9-bd16-a41d2f3ec696'} Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '51cf0371-2965-4ce9-bd16-a41d2f3ec696' Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 03 01:49:03.804712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '51cf0371-2965-4ce9-bd16-a41d2f3ec696' could not be found. Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:03.806049 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:03.807226 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:03.807226 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:03.807226 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:03.807226 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:49:03.807226 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:49:03.807226 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '51cf0371-2965-4ce9-bd16-a41d2f3ec696' could not be found. Aug 03 01:49:03.807226 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:03.809902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-18b120e2-122a-4cbe-82c3-4c5656c4513b tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Returning 404 to user: Hypervisor with ID '51cf0371-2965-4ce9-bd16-a41d2f3ec696' could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:03.811387 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-18b120e2-122a-4cbe-82c3-4c5656c4513b tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/51cf0371-2965-4ce9-bd16-a41d2f3ec696/uptime" status: 404 len: 123 microversion: 2.1 time: 0.076484 Aug 03 01:49:03.812193 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 255/518] 10.222.0.67 () {58 vars in 1278 bytes} [Wed Aug 3 01:49:03 2022] GET /compute/v2.1/os-hypervisors/51cf0371-2965-4ce9-bd16-a41d2f3ec696/uptime => generated 123 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:49:03.821619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-65d4bb71-5a15-42a5-be1d-c526ca82651e tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Calling method '.version_select at 0x7f5b138c33a0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:03.822760 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:03.822760 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:49:03.825143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65d4bb71-5a15-42a5-be1d-c526ca82651e tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:03.825812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65d4bb71-5a15-42a5-be1d-c526ca82651e tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:03.858963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65d4bb71-5a15-42a5-be1d-c526ca82651e tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:03.863390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65d4bb71-5a15-42a5-be1d-c526ca82651e tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:03.889942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65d4bb71-5a15-42a5-be1d-c526ca82651e tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:03.892942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65d4bb71-5a15-42a5-be1d-c526ca82651e tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:03.916394 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-65d4bb71-5a15-42a5-be1d-c526ca82651e tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.094822 Aug 03 01:49:03.918220 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 256/519] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:49:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:49:03.923207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-1a3b78a3-016d-492c-98f0-a339a82214d7 req-da7ba93c-f4ec-4a28-b66a-3daac2986e9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dacc86a-058f-479b-b490-1866c660048b", "tag": "088945bb-f722-4c0a-8dfe-6f40991b1450"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:03.959876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1a3b78a3-016d-492c-98f0-a339a82214d7 req-da7ba93c-f4ec-4a28-b66a-3daac2986e9e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:03.963867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1a3b78a3-016d-492c-98f0-a339a82214d7 req-da7ba93c-f4ec-4a28-b66a-3daac2986e9e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:03.987872 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-1a3b78a3-016d-492c-98f0-a339a82214d7 req-da7ba93c-f4ec-4a28-b66a-3daac2986e9e service nova] Creating event network-changed:088945bb-f722-4c0a-8dfe-6f40991b1450 for instance 7dacc86a-058f-479b-b490-1866c660048b on n-h1-826529-8 Aug 03 01:49:04.016371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-1a3b78a3-016d-492c-98f0-a339a82214d7 req-da7ba93c-f4ec-4a28-b66a-3daac2986e9e service nova] Instance 7dacc86a-058f-479b-b490-1866c660048b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 01:49:04.045993 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-1a3b78a3-016d-492c-98f0-a339a82214d7 req-da7ba93c-f4ec-4a28-b66a-3daac2986e9e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126305 Aug 03 01:49:04.047475 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 257/520] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:04.060948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7d394993-f5f6-4ae3-bd3e-78b82f0fe3cd tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Calling method '.version_select at 0x7f5b136a4dc0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:04.065890 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:04.065890 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:49:04.072393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7d394993-f5f6-4ae3-bd3e-78b82f0fe3cd tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '5435913026d348999315699c6528f426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bafe74061849ef82db32e4ec886f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7d394993-f5f6-4ae3-bd3e-78b82f0fe3cd tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Request method failure captured: Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dQLzI19FCJh8AMJwTu0Hq_yYGf6DvMcMSN3jLm6RdnV-mwjSP6_X9Dp3br6Um6eoKJk5E_3OBICNd9Rk7j-DiFDqSgE_8X9cQnEVt0znj1H27EhpD0Zb9nW8Prqo9t6P1PYhBRrraZbrwVmioMU2FJOF5EgfIrFgSjJJKNZDRJr1nc Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 61bafe74061849ef82db32e4ec886f3c Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-499950608 Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:49:04.074434 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:49:04.075911 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_61bafe74061849ef82db32e4ec886f3c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/61bafe74061849ef82db32e4ec886f3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/61bafe74061849ef82db32e4ec886f3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/61bafe74061849ef82db32e4ec886f3c"}]}] Aug 03 01:49:04.075911 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-499950608 Aug 03 01:49:04.075911 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 61bafe74061849ef82db32e4ec886f3c Aug 03 01:49:04.075911 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-499950608 Aug 03 01:49:04.075911 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HypervisorAdminNegativeTestJSON-499950608-project Aug 03 01:49:04.075911 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:49:04.075911 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:49:04.075911 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5435913026d348999315699c6528f426 Aug 03 01:49:04.075911 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-499950608-project Aug 03 01:49:04.075911 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:49:04.075911 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 03 01:49:04.075911 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '1'} Aug 03 01:49:04.075911 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:49:04.077102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 03 01:49:04.079186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:04.084196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7d394993-f5f6-4ae3-bd3e-78b82f0fe3cd tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:04.084196 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7d394993-f5f6-4ae3-bd3e-78b82f0fe3cd tempest-HypervisorAdminNegativeTestJSON-499950608 tempest-HypervisorAdminNegativeTestJSON-499950608-project] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.028214 Aug 03 01:49:04.084196 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 258/521] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:49:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:49:04.093920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b089e2ac-65c6-4d9c-8c5c-94b3264e9fe5 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b138965e0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:04.195607 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b089e2ac-65c6-4d9c-8c5c-94b3264e9fe5 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.112383 Aug 03 01:49:04.196190 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 259/522] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:04 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:04.215812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-29648136-ea55-408c-a067-16b865fb040a tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Calling method '.version_select at 0x7f5b136a4dc0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:04.223331 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-29648136-ea55-408c-a067-16b865fb040a tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] HTTP exception thrown: Hypervisor with ID '868e2161-aaf7-4ddb-9db9-0f5bfef7fac7' could not be found. Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-29648136-ea55-408c-a067-16b865fb040a tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Request method failure captured: Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-hypervisors/868e2161-aaf7-4ddb-9db9-0f5bfef7fac7 HTTP/1.1 Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dQO8Im35_WfPT5aDtA0uk62ghbL_188MbzTs_t2G9hR9MMeJNoZGZeYL7xW-kR_-zBF4eIhD5hJ5oto6DB3-70EfXkzSwhCK3ah-fSH88gNlwiT6NgE_5LYM-bg1jSJKumGmGEeuxIlQptIJunHNBzYSKhk1MERpMCci1t4uCCeGZs Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a3b74ab85e2341c591c3b985dba4914e Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-719843908 Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:49:04.231755 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:49:04.233223 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a3b74ab85e2341c591c3b985dba4914e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a3b74ab85e2341c591c3b985dba4914e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a3b74ab85e2341c591c3b985dba4914e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a3b74ab85e2341c591c3b985dba4914e"}]}] Aug 03 01:49:04.233223 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-719843908 Aug 03 01:49:04.233223 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a3b74ab85e2341c591c3b985dba4914e Aug 03 01:49:04.233223 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-719843908 Aug 03 01:49:04.233223 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin Aug 03 01:49:04.233223 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:49:04.233223 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:49:04.233223 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 9fc5535643264dd9ad56de1e2d06ae0f Aug 03 01:49:04.233223 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin Aug 03 01:49:04.233223 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:49:04.233223 n-d-826529-8 devstack@n-api.service[125941]: exception: Hypervisor with ID '868e2161-aaf7-4ddb-9db9-0f5bfef7fac7' could not be found. Aug 03 01:49:04.233223 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '868e2161-aaf7-4ddb-9db9-0f5bfef7fac7'} Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '868e2161-aaf7-4ddb-9db9-0f5bfef7fac7' Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 03 01:49:04.234043 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 01:49:04.235604 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '868e2161-aaf7-4ddb-9db9-0f5bfef7fac7' could not be found. Aug 03 01:49:04.236895 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:04.236895 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:04.236895 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:04.236895 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:04.236895 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:04.236895 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:04.236895 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:49:04.236895 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:49:04.236895 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '868e2161-aaf7-4ddb-9db9-0f5bfef7fac7' could not be found. Aug 03 01:49:04.236895 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:04.236895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-29648136-ea55-408c-a067-16b865fb040a tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] Returning 404 to user: Hypervisor with ID '868e2161-aaf7-4ddb-9db9-0f5bfef7fac7' could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:04.236895 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-29648136-ea55-408c-a067-16b865fb040a tempest-HypervisorAdminNegativeTestJSON-719843908 tempest-HypervisorAdminNegativeTestJSON-719843908-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors/868e2161-aaf7-4ddb-9db9-0f5bfef7fac7" status: 404 len: 123 microversion: 2.1 time: 0.029572 Aug 03 01:49:04.236895 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 260/523] 10.222.0.67 () {58 vars in 1257 bytes} [Wed Aug 3 01:49:04 2022] GET /compute/v2.1/os-hypervisors/868e2161-aaf7-4ddb-9db9-0f5bfef7fac7 => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:49:04.242244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d4e9230d-7521-4bfe-a4b0-c368f963d77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:04.243005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d4e9230d-7521-4bfe-a4b0-c368f963d77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:04.260344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4e9230d-7521-4bfe-a4b0-c368f963d77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:04.261215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4e9230d-7521-4bfe-a4b0-c368f963d77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:04.261770 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4e9230d-7521-4bfe-a4b0-c368f963d77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:04.262224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4e9230d-7521-4bfe-a4b0-c368f963d77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:04.279795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a1c58d11-1fa4-4d15-a221-9908501416ed tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:04.292831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a1c58d11-1fa4-4d15-a221-9908501416ed tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:04.302659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a1c58d11-1fa4-4d15-a221-9908501416ed tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:04.308517 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a1c58d11-1fa4-4d15-a221-9908501416ed tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1438 microversion: 2.75 time: 0.936438 Aug 03 01:49:04.312043 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 264/524] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:03 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1438 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:04.337422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:04.341248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:04.353942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:04.354672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:04.355710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:04.356342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:04.460954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:49:04.461820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:49:04.462491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:49:04.463155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:49:04.463761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:49:04.559665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d4e9230d-7521-4bfe-a4b0-c368f963d77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:04.570255 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d4e9230d-7521-4bfe-a4b0-c368f963d77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1472 microversion: 2.1 time: 0.333805 Aug 03 01:49:04.572100 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 261/525] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:04 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1472 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:04.583337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-258b418e-231c-4bb6-87b9-7b0c9b83213d tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:04.584498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-258b418e-231c-4bb6-87b9-7b0c9b83213d tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:04.592352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-258b418e-231c-4bb6-87b9-7b0c9b83213d tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:04.593141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-258b418e-231c-4bb6-87b9-7b0c9b83213d tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:04.594291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-258b418e-231c-4bb6-87b9-7b0c9b83213d tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:04.595033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-258b418e-231c-4bb6-87b9-7b0c9b83213d tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:04.600433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:04.611371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:04.612686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:04.613951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:04.615024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:04.758113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-258b418e-231c-4bb6-87b9-7b0c9b83213d tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:04.761414 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:04.775372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:04.778151 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-258b418e-231c-4bb6-87b9-7b0c9b83213d tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 200 len: 1323 microversion: 2.1 time: 0.202083 Aug 03 01:49:04.781846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:04.794927 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 262/526] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:04 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 1323 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:04.795361 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a3084a36-86a1-4cdc-9fd0-11b33e74753b tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "POST /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9/action" status: 202 len: 1495 microversion: 2.75 time: 0.456681 Aug 03 01:49:04.795361 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 265/527] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 3 01:49:04 2022] POST /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9/action => generated 1495 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 03 01:49:04.816901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed8e2e6d-c85f-434c-9f37-714b55cbe510 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:04.817494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ed8e2e6d-c85f-434c-9f37-714b55cbe510 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:04.824663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed8e2e6d-c85f-434c-9f37-714b55cbe510 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:04.825115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed8e2e6d-c85f-434c-9f37-714b55cbe510 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:04.825906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed8e2e6d-c85f-434c-9f37-714b55cbe510 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:04.829551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed8e2e6d-c85f-434c-9f37-714b55cbe510 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:04.904950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ed8e2e6d-c85f-434c-9f37-714b55cbe510 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:04.917057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ed8e2e6d-c85f-434c-9f37-714b55cbe510 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:04.923557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ed8e2e6d-c85f-434c-9f37-714b55cbe510 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:04.933829 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed8e2e6d-c85f-434c-9f37-714b55cbe510 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.121666 Aug 03 01:49:04.947093 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 263/528] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:04 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:05.218834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e222ad44-6462-436b-a303-ffc83c5be64e tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13604820>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:05.304690 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e222ad44-6462-436b-a303-ffc83c5be64e tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.093281 Aug 03 01:49:05.308732 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 264/529] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:05 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:05.596473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed8dda5d-10dc-4d1e-a891-be3f1706c23d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:05.596666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ed8dda5d-10dc-4d1e-a891-be3f1706c23d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:05.603732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed8dda5d-10dc-4d1e-a891-be3f1706c23d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:05.604189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed8dda5d-10dc-4d1e-a891-be3f1706c23d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:05.641722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed8dda5d-10dc-4d1e-a891-be3f1706c23d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:05.642050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed8dda5d-10dc-4d1e-a891-be3f1706c23d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:05.752515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2fc8a40d-7c02-4e3d-973d-3c705b554bd3 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:05.756740 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:05.756740 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:49:05.760766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2fc8a40d-7c02-4e3d-973d-3c705b554bd3 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:05.761963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2fc8a40d-7c02-4e3d-973d-3c705b554bd3 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:05.763580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2fc8a40d-7c02-4e3d-973d-3c705b554bd3 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:05.765347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2fc8a40d-7c02-4e3d-973d-3c705b554bd3 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:05.803253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:05.855984 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2fc8a40d-7c02-4e3d-973d-3c705b554bd3 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.663625 Aug 03 01:49:05.863744 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 266/530] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:49:05 2022] GET /compute/v2.1/os-services => generated 944 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:05.897083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aa86ec44-9a21-4738-92b5-d82ba0116258 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:05.899684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-aa86ec44-9a21-4738-92b5-d82ba0116258 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:05.932476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa86ec44-9a21-4738-92b5-d82ba0116258 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:05.933898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa86ec44-9a21-4738-92b5-d82ba0116258 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:05.936981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa86ec44-9a21-4738-92b5-d82ba0116258 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:05.939357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa86ec44-9a21-4738-92b5-d82ba0116258 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:06.493705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ed8dda5d-10dc-4d1e-a891-be3f1706c23d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:06.511661 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed8dda5d-10dc-4d1e-a891-be3f1706c23d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1472 microversion: 2.1 time: 0.919224 Aug 03 01:49:06.513562 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 265/531] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:05 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1472 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:06.520698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-3e76818a-9389-4ec1-8ed0-e044d4b40414 req-ca836c39-21c6-4b9d-9232-9a509733acbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6", "name": "network-vif-plugged", "status": "completed", "tag": "d59c4745-6408-4d6f-a309-951c6fc953d9"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:06.564493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3e76818a-9389-4ec1-8ed0-e044d4b40414 req-ca836c39-21c6-4b9d-9232-9a509733acbf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:06.575013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-aa86ec44-9a21-4738-92b5-d82ba0116258 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:06.583639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3e76818a-9389-4ec1-8ed0-e044d4b40414 req-ca836c39-21c6-4b9d-9232-9a509733acbf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:06.586222 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aa86ec44-9a21-4738-92b5-d82ba0116258 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 200 len: 1390 microversion: 2.1 time: 0.720803 Aug 03 01:49:06.603246 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 267/532] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:05 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 1390 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:06.624465 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-3e76818a-9389-4ec1-8ed0-e044d4b40414 req-ca836c39-21c6-4b9d-9232-9a509733acbf service nova] Creating event network-vif-plugged:d59c4745-6408-4d6f-a309-951c6fc953d9 for instance fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 on n-h2-826529-8 Aug 03 01:49:06.630204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3e2980e6-6f7b-42b3-a05c-44d6a3fe4602 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:06.632390 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-3e76818a-9389-4ec1-8ed0-e044d4b40414 req-ca836c39-21c6-4b9d-9232-9a509733acbf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116848 Aug 03 01:49:06.636890 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:06.636890 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:49:06.639279 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 266/533] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:06.641793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e2980e6-6f7b-42b3-a05c-44d6a3fe4602 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:06.644498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e2980e6-6f7b-42b3-a05c-44d6a3fe4602 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:06.645865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e2980e6-6f7b-42b3-a05c-44d6a3fe4602 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:06.646743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e2980e6-6f7b-42b3-a05c-44d6a3fe4602 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:06.649158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-85480686-42ab-4014-83fd-966f50b08b2e tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:06.650362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-85480686-42ab-4014-83fd-966f50b08b2e tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:06.661309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85480686-42ab-4014-83fd-966f50b08b2e tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:06.662178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85480686-42ab-4014-83fd-966f50b08b2e tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:06.665149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85480686-42ab-4014-83fd-966f50b08b2e tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:06.666761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85480686-42ab-4014-83fd-966f50b08b2e tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:06.738984 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3e2980e6-6f7b-42b3-a05c-44d6a3fe4602 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?host=n-d-826529-8" status: 200 len: 578 microversion: 2.1 time: 0.134559 Aug 03 01:49:06.747772 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 268/534] 10.222.0.67 () {58 vars in 1172 bytes} [Wed Aug 3 01:49:06 2022] GET /compute/v2.1/os-services?host=n-d-826529-8 => generated 578 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:06.758385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f15e7ce0-9077-4760-b819-9f55998960ff tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13b12ca0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:06.808282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-85480686-42ab-4014-83fd-966f50b08b2e tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:06.825960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-85480686-42ab-4014-83fd-966f50b08b2e tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:06.830351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-85480686-42ab-4014-83fd-966f50b08b2e tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:06.840083 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f15e7ce0-9077-4760-b819-9f55998960ff tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.090860 Aug 03 01:49:06.843753 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-85480686-42ab-4014-83fd-966f50b08b2e tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.199780 Aug 03 01:49:06.843905 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 269/535] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:06 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:06.845632 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 267/536] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:06 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:06.874968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ae239c79-42df-4764-a972-d8b814174a59 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:06.897754 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:06.897754 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:49:06.901369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ae239c79-42df-4764-a972-d8b814174a59 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:06.906617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ae239c79-42df-4764-a972-d8b814174a59 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:06.907917 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ae239c79-42df-4764-a972-d8b814174a59 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:06.910137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ae239c79-42df-4764-a972-d8b814174a59 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:07.009945 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ae239c79-42df-4764-a972-d8b814174a59 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.151565 Aug 03 01:49:07.010854 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 270/537] 10.222.0.67 () {58 vars in 1176 bytes} [Wed Aug 3 01:49:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:07.027716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-069b4a21-7dc0-4348-b715-219e6e1a9892 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:07.030618 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:07.030618 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:49:07.032136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-069b4a21-7dc0-4348-b715-219e6e1a9892 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:07.034364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-069b4a21-7dc0-4348-b715-219e6e1a9892 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:07.037836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-069b4a21-7dc0-4348-b715-219e6e1a9892 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:07.038365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-069b4a21-7dc0-4348-b715-219e6e1a9892 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:07.130697 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-069b4a21-7dc0-4348-b715-219e6e1a9892 tempest-ServicesAdminTestJSON-624426449 tempest-ServicesAdminTestJSON-624426449-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.111375 Aug 03 01:49:07.140059 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 268/538] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:49:07 2022] GET /compute/v2.1/os-services => generated 944 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:07.425817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ebc19a94-d975-4570-9191-c168b5d79278 req-7a6292d0-36e0-4729-8718-7203154e288d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c171ccf7-988b-441b-acb8-7332e481ec09", "tag": "82736730-4f04-4297-8b74-d92a1952c26d"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:07.461322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ebc19a94-d975-4570-9191-c168b5d79278 req-7a6292d0-36e0-4729-8718-7203154e288d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:07.463891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ebc19a94-d975-4570-9191-c168b5d79278 req-7a6292d0-36e0-4729-8718-7203154e288d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:07.514630 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ebc19a94-d975-4570-9191-c168b5d79278 req-7a6292d0-36e0-4729-8718-7203154e288d service nova] Creating event network-changed:82736730-4f04-4297-8b74-d92a1952c26d for instance c171ccf7-988b-441b-acb8-7332e481ec09 on n-h1-826529-8 Aug 03 01:49:07.534078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-51896232-2bcb-435b-9823-4ce5d30470a4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:07.537318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-51896232-2bcb-435b-9823-4ce5d30470a4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:07.543940 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ebc19a94-d975-4570-9191-c168b5d79278 req-7a6292d0-36e0-4729-8718-7203154e288d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119986 Aug 03 01:49:07.545279 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 271/539] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:07.549533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51896232-2bcb-435b-9823-4ce5d30470a4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:07.550440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51896232-2bcb-435b-9823-4ce5d30470a4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:07.551566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51896232-2bcb-435b-9823-4ce5d30470a4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:07.552920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51896232-2bcb-435b-9823-4ce5d30470a4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:07.618715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-04dafde3-46d1-4c76-9cec-7977cd6c9587 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:07.620299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-04dafde3-46d1-4c76-9cec-7977cd6c9587 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:07.658048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04dafde3-46d1-4c76-9cec-7977cd6c9587 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:07.659358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04dafde3-46d1-4c76-9cec-7977cd6c9587 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:07.665236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04dafde3-46d1-4c76-9cec-7977cd6c9587 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:07.665903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04dafde3-46d1-4c76-9cec-7977cd6c9587 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:08.110232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-04dafde3-46d1-4c76-9cec-7977cd6c9587 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:08.131379 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-04dafde3-46d1-4c76-9cec-7977cd6c9587 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 200 len: 1390 microversion: 2.1 time: 0.517725 Aug 03 01:49:08.137591 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 272/540] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:07 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 1390 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:49:08.156253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-91811aa3-429a-4f6f-abef-3735c545a35c tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13b12430>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:08.211679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-51896232-2bcb-435b-9823-4ce5d30470a4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:08.220149 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-51896232-2bcb-435b-9823-4ce5d30470a4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1469 microversion: 2.1 time: 0.691397 Aug 03 01:49:08.229456 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 269/541] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:07 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1469 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:49:08.237992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c9cda184-8ba8-4bc2-8d09-b6eb35b28f97 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:08.244119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c9cda184-8ba8-4bc2-8d09-b6eb35b28f97 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:08.256629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9cda184-8ba8-4bc2-8d09-b6eb35b28f97 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:08.265923 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-91811aa3-429a-4f6f-abef-3735c545a35c tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.126976 Aug 03 01:49:08.266603 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 273/542] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:08 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:08.272506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9cda184-8ba8-4bc2-8d09-b6eb35b28f97 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:08.273586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9cda184-8ba8-4bc2-8d09-b6eb35b28f97 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:08.276607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9cda184-8ba8-4bc2-8d09-b6eb35b28f97 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:08.287998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-db806aa8-a063-4b5e-85a1-ab03027f7e80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:08.289756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-db806aa8-a063-4b5e-85a1-ab03027f7e80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:08.300031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db806aa8-a063-4b5e-85a1-ab03027f7e80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:08.302332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db806aa8-a063-4b5e-85a1-ab03027f7e80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:08.303485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db806aa8-a063-4b5e-85a1-ab03027f7e80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:08.304334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db806aa8-a063-4b5e-85a1-ab03027f7e80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:08.420856 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-db806aa8-a063-4b5e-85a1-ab03027f7e80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "POST /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b/action" status: 204 len: 0 microversion: 2.1 time: 0.149350 Aug 03 01:49:08.426229 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 274/543] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:49:08 2022] POST /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b/action => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:49:08.452371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fb3bf9ac-7fd6-4f47-b0d0-17e865bb5173 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:08.456147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fb3bf9ac-7fd6-4f47-b0d0-17e865bb5173 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:08.478325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb3bf9ac-7fd6-4f47-b0d0-17e865bb5173 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:08.479078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb3bf9ac-7fd6-4f47-b0d0-17e865bb5173 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:08.482625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb3bf9ac-7fd6-4f47-b0d0-17e865bb5173 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:08.484793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb3bf9ac-7fd6-4f47-b0d0-17e865bb5173 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:08.499739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c9cda184-8ba8-4bc2-8d09-b6eb35b28f97 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:08.522998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c9cda184-8ba8-4bc2-8d09-b6eb35b28f97 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:08.527658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c9cda184-8ba8-4bc2-8d09-b6eb35b28f97 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:08.549679 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c9cda184-8ba8-4bc2-8d09-b6eb35b28f97 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.318196 Aug 03 01:49:08.551761 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 270/544] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:08 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:08.841068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fb3bf9ac-7fd6-4f47-b0d0-17e865bb5173 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:08.853690 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fb3bf9ac-7fd6-4f47-b0d0-17e865bb5173 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1469 microversion: 2.1 time: 0.423727 Aug 03 01:49:08.868986 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 275/545] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:08 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1469 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:09.164946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cac30721-e8f1-4962-a884-78334e5542b7 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:09.165696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cac30721-e8f1-4962-a884-78334e5542b7 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:09.185888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cac30721-e8f1-4962-a884-78334e5542b7 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:09.186679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cac30721-e8f1-4962-a884-78334e5542b7 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:09.195294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cac30721-e8f1-4962-a884-78334e5542b7 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:09.196177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cac30721-e8f1-4962-a884-78334e5542b7 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:09.212414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-32168179-4279-48d5-850c-c735446f55b8 tempest-InstanceUsageAuditLogTestJSON-1698004430 tempest-InstanceUsageAuditLogTestJSON-1698004430-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:09.213490 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:09.213490 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:49:09.331858 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-32168179-4279-48d5-850c-c735446f55b8 tempest-InstanceUsageAuditLogTestJSON-1698004430 tempest-InstanceUsageAuditLogTestJSON-1698004430-project-admin] 10.222.0.67 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-03 01:49:08" status: 200 len: 318 microversion: 2.1 time: 0.704382 Aug 03 01:49:09.332532 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 271/546] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 3 01:49:08 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-03%2001%3A49%3A08 => generated 318 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:49:09.337713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d6a32ede-d438-4b9f-870d-8bd9d65f25a7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b136c7ca0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:09.446258 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d6a32ede-d438-4b9f-870d-8bd9d65f25a7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.112064 Aug 03 01:49:09.448325 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 272/547] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:09 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:09.466641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a49bdc8e-2929-41c3-bbac-c0b103545d9e tempest-InstanceUsageAuditLogTestJSON-1698004430 tempest-InstanceUsageAuditLogTestJSON-1698004430-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:09.472535 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:09.472535 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:49:09.513076 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a49bdc8e-2929-41c3-bbac-c0b103545d9e tempest-InstanceUsageAuditLogTestJSON-1698004430 tempest-InstanceUsageAuditLogTestJSON-1698004430-project-admin] 10.222.0.67 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.063649 Aug 03 01:49:09.520741 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 273/548] 10.222.0.67 () {58 vars in 1185 bytes} [Wed Aug 3 01:49:09 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:09.580054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0558a3fe-8b3b-4437-bd10-455c0dc27b51 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:09.580990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0558a3fe-8b3b-4437-bd10-455c0dc27b51 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:09.589629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0558a3fe-8b3b-4437-bd10-455c0dc27b51 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:09.590086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0558a3fe-8b3b-4437-bd10-455c0dc27b51 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:09.590997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0558a3fe-8b3b-4437-bd10-455c0dc27b51 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:09.599454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0558a3fe-8b3b-4437-bd10-455c0dc27b51 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:09.622812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cac30721-e8f1-4962-a884-78334e5542b7 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:09.640816 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cac30721-e8f1-4962-a884-78334e5542b7 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 200 len: 1390 microversion: 2.1 time: 0.479872 Aug 03 01:49:09.642175 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 276/549] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:09 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 1390 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:49:09.761201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0558a3fe-8b3b-4437-bd10-455c0dc27b51 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:09.776207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0558a3fe-8b3b-4437-bd10-455c0dc27b51 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:09.777739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0558a3fe-8b3b-4437-bd10-455c0dc27b51 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:09.790081 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0558a3fe-8b3b-4437-bd10-455c0dc27b51 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.213799 Aug 03 01:49:09.791593 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 274/550] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:09 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:09.875865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2b9d207e-9cf0-476a-b865-2ffe4e2936d7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:09.876798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2b9d207e-9cf0-476a-b865-2ffe4e2936d7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:09.891292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b9d207e-9cf0-476a-b865-2ffe4e2936d7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:09.894462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c8477644-7681-4ce2-8134-21a93abe8cc3 req-08aae59b-c498-4066-9d5e-dd1193c141ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dacc86a-058f-479b-b490-1866c660048b", "name": "network-vif-plugged", "status": "completed", "tag": "088945bb-f722-4c0a-8dfe-6f40991b1450"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:09.895022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b9d207e-9cf0-476a-b865-2ffe4e2936d7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:09.896772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b9d207e-9cf0-476a-b865-2ffe4e2936d7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:09.898657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b9d207e-9cf0-476a-b865-2ffe4e2936d7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:09.917985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c8477644-7681-4ce2-8134-21a93abe8cc3 req-08aae59b-c498-4066-9d5e-dd1193c141ac service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:09.919736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c8477644-7681-4ce2-8134-21a93abe8cc3 req-08aae59b-c498-4066-9d5e-dd1193c141ac service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:09.954254 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c8477644-7681-4ce2-8134-21a93abe8cc3 req-08aae59b-c498-4066-9d5e-dd1193c141ac service nova] Creating event network-vif-plugged:088945bb-f722-4c0a-8dfe-6f40991b1450 for instance 7dacc86a-058f-479b-b490-1866c660048b on n-h1-826529-8 Aug 03 01:49:09.980440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-c8477644-7681-4ce2-8134-21a93abe8cc3 req-08aae59b-c498-4066-9d5e-dd1193c141ac service nova] Instance 7dacc86a-058f-479b-b490-1866c660048b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 01:49:10.021567 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c8477644-7681-4ce2-8134-21a93abe8cc3 req-08aae59b-c498-4066-9d5e-dd1193c141ac service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131323 Aug 03 01:49:10.027102 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 275/551] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:49:10.238664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2b9d207e-9cf0-476a-b865-2ffe4e2936d7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:10.247242 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2b9d207e-9cf0-476a-b865-2ffe4e2936d7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1469 microversion: 2.1 time: 0.375866 Aug 03 01:49:10.247826 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 277/552] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:09 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1469 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:10.469788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4dfd09d6-8c17-4bac-ad18-2988445b8a97 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b136115e0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:10.538955 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4dfd09d6-8c17-4bac-ad18-2988445b8a97 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.076373 Aug 03 01:49:10.540286 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 276/553] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:10 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:10.668716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-429885b3-82d4-4ab4-9024-8127108d1120 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:10.669686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-429885b3-82d4-4ab4-9024-8127108d1120 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:10.714413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-429885b3-82d4-4ab4-9024-8127108d1120 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:10.716021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-429885b3-82d4-4ab4-9024-8127108d1120 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:10.716929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-429885b3-82d4-4ab4-9024-8127108d1120 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:10.717288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-429885b3-82d4-4ab4-9024-8127108d1120 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:10.819528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-809e2f71-7d30-4422-a424-33f18e117d2f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:10.820436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-809e2f71-7d30-4422-a424-33f18e117d2f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:10.833591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-809e2f71-7d30-4422-a424-33f18e117d2f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:10.838838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-809e2f71-7d30-4422-a424-33f18e117d2f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:10.842253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-809e2f71-7d30-4422-a424-33f18e117d2f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:10.843763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-809e2f71-7d30-4422-a424-33f18e117d2f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:10.847629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=12 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:10.998248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-809e2f71-7d30-4422-a424-33f18e117d2f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:11.008023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-809e2f71-7d30-4422-a424-33f18e117d2f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:11.014703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-809e2f71-7d30-4422-a424-33f18e117d2f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:11.027397 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-809e2f71-7d30-4422-a424-33f18e117d2f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.214069 Aug 03 01:49:11.028257 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 277/554] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:10 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:11.273032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-861dc3ef-3bd8-43db-aa97-93bcb6e7a95a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:11.274022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-861dc3ef-3bd8-43db-aa97-93bcb6e7a95a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:11.286146 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-429885b3-82d4-4ab4-9024-8127108d1120 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:11.294680 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-429885b3-82d4-4ab4-9024-8127108d1120 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 200 len: 1390 microversion: 2.1 time: 0.630990 Aug 03 01:49:11.296855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-861dc3ef-3bd8-43db-aa97-93bcb6e7a95a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:11.301140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-861dc3ef-3bd8-43db-aa97-93bcb6e7a95a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:11.302826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-861dc3ef-3bd8-43db-aa97-93bcb6e7a95a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:11.303667 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 278/555] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:10 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 1390 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:11.306394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-861dc3ef-3bd8-43db-aa97-93bcb6e7a95a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:11.557080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bc2d96ea-ae81-44c3-ae8c-c3ca445216fa tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13a04670>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:11.630836 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bc2d96ea-ae81-44c3-ae8c-c3ca445216fa tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.078088 Aug 03 01:49:11.639262 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 279/556] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:11 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:49:11.827085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-861dc3ef-3bd8-43db-aa97-93bcb6e7a95a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:11.843036 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-861dc3ef-3bd8-43db-aa97-93bcb6e7a95a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1461 microversion: 2.1 time: 0.577260 Aug 03 01:49:11.844366 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 278/557] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:11 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1461 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:11.867125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3520fce3-3c90-4d5d-934e-9e8900af70b7 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:11.868749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3520fce3-3c90-4d5d-934e-9e8900af70b7 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:11.876171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:11.885072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3520fce3-3c90-4d5d-934e-9e8900af70b7 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:11.889256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3520fce3-3c90-4d5d-934e-9e8900af70b7 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:11.890262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3520fce3-3c90-4d5d-934e-9e8900af70b7 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:11.890650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3520fce3-3c90-4d5d-934e-9e8900af70b7 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:12.053479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-564b3d66-d90a-42a4-b923-fb5f0dd84119 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:12.054381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-564b3d66-d90a-42a4-b923-fb5f0dd84119 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:12.076264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-564b3d66-d90a-42a4-b923-fb5f0dd84119 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:12.076726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-564b3d66-d90a-42a4-b923-fb5f0dd84119 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:12.077526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-564b3d66-d90a-42a4-b923-fb5f0dd84119 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:12.078156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-564b3d66-d90a-42a4-b923-fb5f0dd84119 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:12.208115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-564b3d66-d90a-42a4-b923-fb5f0dd84119 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:12.228515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-564b3d66-d90a-42a4-b923-fb5f0dd84119 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:12.233066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-564b3d66-d90a-42a4-b923-fb5f0dd84119 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:12.239728 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-564b3d66-d90a-42a4-b923-fb5f0dd84119 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.190316 Aug 03 01:49:12.240664 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 279/558] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:12 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:49:12.298545 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3520fce3-3c90-4d5d-934e-9e8900af70b7 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1612 microversion: 2.1 time: 0.434190 Aug 03 01:49:12.308043 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 280/559] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:11 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1612 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:12.336065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c37154b9-3eb1-42c4-b998-14126333b683 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Calling method '.version_select at 0x7f5b13afe280>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:12.345174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f49ad2ca-8a09-4a56-9b79-6893edb9483a tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:12.347548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c37154b9-3eb1-42c4-b998-14126333b683 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:12.348698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c37154b9-3eb1-42c4-b998-14126333b683 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:12.350952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f49ad2ca-8a09-4a56-9b79-6893edb9483a tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:12.366858 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c37154b9-3eb1-42c4-b998-14126333b683 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.037296 Aug 03 01:49:12.368459 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 281/560] 10.222.0.67 () {58 vars in 1143 bytes} [Wed Aug 3 01:49:12 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:12.383661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f49ad2ca-8a09-4a56-9b79-6893edb9483a tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:12.384158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f49ad2ca-8a09-4a56-9b79-6893edb9483a tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:12.385036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f49ad2ca-8a09-4a56-9b79-6893edb9483a tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:12.385624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f49ad2ca-8a09-4a56-9b79-6893edb9483a tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:12.647392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d7c3c30d-1a16-4479-9526-ad47756387ed tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13a60d30>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:12.727398 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d7c3c30d-1a16-4479-9526-ad47756387ed tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.085223 Aug 03 01:49:12.729481 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 282/561] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:12 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:49:12.751332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f49ad2ca-8a09-4a56-9b79-6893edb9483a tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:12.762202 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f49ad2ca-8a09-4a56-9b79-6893edb9483a tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 200 len: 1390 microversion: 2.1 time: 0.433470 Aug 03 01:49:12.775778 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 280/562] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:12 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 1390 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:12.883307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1367640150", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:13.024999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:49:13.269312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-52d734aa-f97b-4034-9047-4bb37fd7c581 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:13.270804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-52d734aa-f97b-4034-9047-4bb37fd7c581 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:13.290717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52d734aa-f97b-4034-9047-4bb37fd7c581 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:13.292906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52d734aa-f97b-4034-9047-4bb37fd7c581 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:13.295868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52d734aa-f97b-4034-9047-4bb37fd7c581 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:13.297671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52d734aa-f97b-4034-9047-4bb37fd7c581 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:13.547725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-52d734aa-f97b-4034-9047-4bb37fd7c581 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:13.556356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:49:13.557392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:49:13.558028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:49:13.558609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:49:13.559206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:49:13.568345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-52d734aa-f97b-4034-9047-4bb37fd7c581 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:13.574196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-52d734aa-f97b-4034-9047-4bb37fd7c581 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:13.582802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:13.583677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:13.584672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:13.585279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:13.598126 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-52d734aa-f97b-4034-9047-4bb37fd7c581 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.330092 Aug 03 01:49:13.601773 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 281/563] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:13 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:13.641374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Getting quotas for project 6e247e7134ad41bfa92b6eff8111c86e. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:49:13.648295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Getting quotas for user 241ed53f42f84abc8efc7edb5f41f6ed and project 6e247e7134ad41bfa92b6eff8111c86e. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:49:13.663328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:49:13.666623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:49:13.761597 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-da4b2295-3c3e-4791-b622-15377491fce6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882838 Aug 03 01:49:13.771258 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 283/564] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:49:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:49:13.782863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-45b0a9d5-ea47-4c0a-bb73-9341b939c2f0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13a04dc0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:13.880622 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-45b0a9d5-ea47-4c0a-bb73-9341b939c2f0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.105320 Aug 03 01:49:13.884665 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 284/565] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:13 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:13.909346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7d0461ba-b755-4dbb-80d4-7b33fe4998ad tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:13.913677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7d0461ba-b755-4dbb-80d4-7b33fe4998ad tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:14.020337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7d0461ba-b755-4dbb-80d4-7b33fe4998ad tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:14.030262 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7d0461ba-b755-4dbb-80d4-7b33fe4998ad tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1213 microversion: 2.1 time: 0.136577 Aug 03 01:49:14.034308 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 285/566] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:13 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1213 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:14.056257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8f00437b-8ba8-47c1-984f-37a273518521 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:14.059840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8f00437b-8ba8-47c1-984f-37a273518521 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:14.077379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f00437b-8ba8-47c1-984f-37a273518521 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:14.079885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f00437b-8ba8-47c1-984f-37a273518521 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:14.084064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f00437b-8ba8-47c1-984f-37a273518521 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:14.086744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f00437b-8ba8-47c1-984f-37a273518521 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:14.333378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3b6b11a5-57f8-476c-8812-2dc089f5a9f4 tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] Action: 'create', calling method: .version_select at 0x7f5b135cb9d0>, body: {"keypair": {"name": "tempest-keypair-208076734", "type": "ssh", "user_id": "95e3198755ce4a4c8930b6f88e77363c", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEn259pMCWlxtJ3wvZ54n9pl9mR7zaPehSBViVU7cc91qGqR4xCJVzBT3f9Nv1UC5BNpa4UX15cBXgxWhCfDMyRso5YIrlsyqi5AGITpOk9qF81vm+LrRW1VK5plJ6n1w=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:14.417845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-3b6b11a5-57f8-476c-8812-2dc089f5a9f4 tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] Getting quotas for project e366cd81e8454cf1ac22cfa40f12ed46. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:49:14.431747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-3b6b11a5-57f8-476c-8812-2dc089f5a9f4 tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] Getting quotas for user 75e0a0e5c9014b04bf0bcb63f1155dce and project e366cd81e8454cf1ac22cfa40f12ed46. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:49:14.508439 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3b6b11a5-57f8-476c-8812-2dc089f5a9f4 tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.905287 Aug 03 01:49:14.520136 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 282/567] 10.222.0.67 () {62 vars in 1200 bytes} [Wed Aug 3 01:49:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 918 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 01:49:14.531417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8f00437b-8ba8-47c1-984f-37a273518521 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:14.543145 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8f00437b-8ba8-47c1-984f-37a273518521 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 200 len: 1390 microversion: 2.1 time: 0.506414 Aug 03 01:49:14.545209 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 286/568] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:14 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 1390 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:14.551815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1394f250-cbbd-4e70-aed8-d2e58c4000c3 tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] Action: 'create', calling method: .version_select at 0x7f5b137a83a0>, body: {"keypair": {"name": "tempest-keypair-1096652671", "type": "ssh", "user_id": "95e3198755ce4a4c8930b6f88e77363c", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6nmlM8MwyRpSktOoEYcd/l4fI6tBy0gbtjDWktvpc7PFo44npHoo3VWdOpub8pW+GljQhyvxr2tFLT5qBOmpjzebBBv+nR2eFeJxF15nALUBApgH8YpUbGg9FPgfom1Q=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:14.629101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-227251ba-649a-4e68-80b5-f3a6c50d06c4 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:14.630726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-227251ba-649a-4e68-80b5-f3a6c50d06c4 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:14.635750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1394f250-cbbd-4e70-aed8-d2e58c4000c3 tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] Getting quotas for project e366cd81e8454cf1ac22cfa40f12ed46. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:49:14.648680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-227251ba-649a-4e68-80b5-f3a6c50d06c4 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:14.650225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1394f250-cbbd-4e70-aed8-d2e58c4000c3 tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] Getting quotas for user 75e0a0e5c9014b04bf0bcb63f1155dce and project e366cd81e8454cf1ac22cfa40f12ed46. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:49:14.654143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-227251ba-649a-4e68-80b5-f3a6c50d06c4 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:14.656470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-227251ba-649a-4e68-80b5-f3a6c50d06c4 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:14.661681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-227251ba-649a-4e68-80b5-f3a6c50d06c4 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:14.710262 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1394f250-cbbd-4e70-aed8-d2e58c4000c3 tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.188729 Aug 03 01:49:14.711104 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 283/569] 10.222.0.67 () {62 vars in 1200 bytes} [Wed Aug 3 01:49:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 190 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 01:49:14.731506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-53ea955c-33cd-4e42-a34e-873174f1898b tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] Calling method '.version_select at 0x7f5b135f3550>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:14.774659 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-53ea955c-33cd-4e42-a34e-873174f1898b tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] 10.222.0.67 "GET /compute/v2.1/os-keypairs/tempest-keypair-208076734?user_id=95e3198755ce4a4c8930b6f88e77363c" status: 200 len: 511 microversion: 2.10 time: 0.056641 Aug 03 01:49:14.778148 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 284/570] 10.222.0.67 () {60 vars in 1337 bytes} [Wed Aug 3 01:49:14 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-208076734?user_id=95e3198755ce4a4c8930b6f88e77363c => generated 511 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 01:49:14.793239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-24304d4f-0e63-45da-9a4f-0dc5ccbef12f tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] Action: 'create', calling method: .version_select at 0x7f5b135e2c10>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1146925246", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMe7zpScshhEirTsQ4VH1MPSkWTw9xuPAnrb3fUFWLhx8ZpZin+mNQBe3Yws5LTM/dtAY4XMEfyf57isVrgu7GVLe6NzllUK8BCNkl3CnN9Od63Rh1Gv6Zhh/s3XgluNBA=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:14.837921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-24304d4f-0e63-45da-9a4f-0dc5ccbef12f tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] Getting quotas for project e366cd81e8454cf1ac22cfa40f12ed46. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:49:14.852227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-24304d4f-0e63-45da-9a4f-0dc5ccbef12f tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] Getting quotas for user 75e0a0e5c9014b04bf0bcb63f1155dce and project e366cd81e8454cf1ac22cfa40f12ed46. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:49:14.878785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:14.894988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-227251ba-649a-4e68-80b5-f3a6c50d06c4 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:14.907483 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-24304d4f-0e63-45da-9a4f-0dc5ccbef12f tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.118515 Aug 03 01:49:14.908653 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 285/571] 10.222.0.67 () {62 vars in 1200 bytes} [Wed Aug 3 01:49:14 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 03 01:49:14.918939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:14.922481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6f1b2c5e-b708-4026-ab96-d68dd3a4caf5 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b135f3700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:14.935918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-227251ba-649a-4e68-80b5-f3a6c50d06c4 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:14.955194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-227251ba-649a-4e68-80b5-f3a6c50d06c4 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:14.987707 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-227251ba-649a-4e68-80b5-f3a6c50d06c4 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.361860 Aug 03 01:49:14.990610 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 287/572] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:14 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:15.005387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-601c8b37-628b-4a3b-8379-f9f35cae4a63 tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] Calling method '.version_select at 0x7f5b13a74820>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:15.020769 n-d-826529-8 devstack@n-api.service[125942]: WARNING oslo_db.sqlalchemy.utils [None req-601c8b37-628b-4a3b-8379-f9f35cae4a63 tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 03 01:49:15.041023 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6f1b2c5e-b708-4026-ab96-d68dd3a4caf5 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.131000 Aug 03 01:49:15.042369 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 286/573] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:14 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:15.057891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-28fcbc72-2d30-4fe7-8fca-f0452892abf1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:15.061906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-28fcbc72-2d30-4fe7-8fca-f0452892abf1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:15.063694 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-601c8b37-628b-4a3b-8379-f9f35cae4a63 tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] 10.222.0.67 "GET /compute/v2.1/os-keypairs?user_id=95e3198755ce4a4c8930b6f88e77363c" status: 200 len: 725 microversion: 2.10 time: 0.071169 Aug 03 01:49:15.070751 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 288/574] 10.222.0.67 () {60 vars in 1259 bytes} [Wed Aug 3 01:49:14 2022] GET /compute/v2.1/os-keypairs?user_id=95e3198755ce4a4c8930b6f88e77363c => generated 725 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:49:15.076874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-28fcbc72-2d30-4fe7-8fca-f0452892abf1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:15.078844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f7d03f4d-26bd-43f9-8ddc-7afbbf194e8b tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] Calling method '.version_select at 0x7f5b13b2d1f0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:15.081903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-28fcbc72-2d30-4fe7-8fca-f0452892abf1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:15.083324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-28fcbc72-2d30-4fe7-8fca-f0452892abf1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:15.085043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-28fcbc72-2d30-4fe7-8fca-f0452892abf1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:15.159562 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f7d03f4d-26bd-43f9-8ddc-7afbbf194e8b tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1146925246" status: 204 len: 0 microversion: 2.10 time: 0.086283 Aug 03 01:49:15.167529 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 289/575] 10.222.0.67 () {60 vars in 1325 bytes} [Wed Aug 3 01:49:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1146925246 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:49:15.189189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-59bfcfc1-a03b-4a1b-929f-3714942cdc2a tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] Calling method '.version_select at 0x7f5b13b2d940>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:15.271606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-28fcbc72-2d30-4fe7-8fca-f0452892abf1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:15.272210 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-59bfcfc1-a03b-4a1b-929f-3714942cdc2a tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096652671?user_id=95e3198755ce4a4c8930b6f88e77363c" status: 204 len: 0 microversion: 2.10 time: 0.100058 Aug 03 01:49:15.273807 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 290/576] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 01:49:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096652671?user_id=95e3198755ce4a4c8930b6f88e77363c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:49:15.284321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-49261d3a-ff70-4cbf-875f-b68986ad6752 tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] Calling method '.version_select at 0x7f5b13a72c10>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:15.284782 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-28fcbc72-2d30-4fe7-8fca-f0452892abf1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1217 microversion: 2.1 time: 0.231088 Aug 03 01:49:15.300314 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 287/577] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:15 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1217 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:15.326364 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-49261d3a-ff70-4cbf-875f-b68986ad6752 tempest-KeyPairsV210TestJSON-1562735920 tempest-KeyPairsV210TestJSON-1562735920-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208076734?user_id=95e3198755ce4a4c8930b6f88e77363c" status: 204 len: 0 microversion: 2.10 time: 0.048000 Aug 03 01:49:15.327488 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 291/578] 10.222.0.67 () {60 vars in 1340 bytes} [Wed Aug 3 01:49:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208076734?user_id=95e3198755ce4a4c8930b6f88e77363c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 03 01:49:15.565775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b067344e-a22a-41fd-a5eb-205e31321bc6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:15.567402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b067344e-a22a-41fd-a5eb-205e31321bc6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:15.583398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b067344e-a22a-41fd-a5eb-205e31321bc6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:15.586983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b067344e-a22a-41fd-a5eb-205e31321bc6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:15.588399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b067344e-a22a-41fd-a5eb-205e31321bc6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:15.589738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b067344e-a22a-41fd-a5eb-205e31321bc6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:15.918045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b067344e-a22a-41fd-a5eb-205e31321bc6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:15.944363 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b067344e-a22a-41fd-a5eb-205e31321bc6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 200 len: 1390 microversion: 2.1 time: 0.375049 Aug 03 01:49:15.959570 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 288/579] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:15 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 1390 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:16.018511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c69271ba-c4a5-4712-8c86-adb1518cec0a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:16.020258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c69271ba-c4a5-4712-8c86-adb1518cec0a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:16.037461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c69271ba-c4a5-4712-8c86-adb1518cec0a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:16.039397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c69271ba-c4a5-4712-8c86-adb1518cec0a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:16.044038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c69271ba-c4a5-4712-8c86-adb1518cec0a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:16.048831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c69271ba-c4a5-4712-8c86-adb1518cec0a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:16.057470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-381132ff-6ddf-48dd-8774-c71ba0b6aaad tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b135e2550>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:16.160406 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-381132ff-6ddf-48dd-8774-c71ba0b6aaad tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.106810 Aug 03 01:49:16.164220 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 289/580] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:16 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:49:16.282930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c69271ba-c4a5-4712-8c86-adb1518cec0a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:16.292613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c69271ba-c4a5-4712-8c86-adb1518cec0a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:16.298462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c69271ba-c4a5-4712-8c86-adb1518cec0a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:16.306836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-74d9ffaf-f7ae-4089-ae1d-c108cc583450 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:16.307743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-74d9ffaf-f7ae-4089-ae1d-c108cc583450 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:16.314845 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c69271ba-c4a5-4712-8c86-adb1518cec0a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.301628 Aug 03 01:49:16.318985 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 292/581] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:16 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:16.338754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74d9ffaf-f7ae-4089-ae1d-c108cc583450 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:16.346827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74d9ffaf-f7ae-4089-ae1d-c108cc583450 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:16.349042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74d9ffaf-f7ae-4089-ae1d-c108cc583450 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:16.350569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74d9ffaf-f7ae-4089-ae1d-c108cc583450 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:16.518354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-74d9ffaf-f7ae-4089-ae1d-c108cc583450 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:16.531894 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-74d9ffaf-f7ae-4089-ae1d-c108cc583450 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1271 microversion: 2.1 time: 0.230131 Aug 03 01:49:16.549322 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 290/582] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:16 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:49:16.967149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-64bce27c-c542-4d71-b951-eb1b2625f8d6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:16.968123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-64bce27c-c542-4d71-b951-eb1b2625f8d6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:16.983314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-64bce27c-c542-4d71-b951-eb1b2625f8d6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:16.988529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-64bce27c-c542-4d71-b951-eb1b2625f8d6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:16.993081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-64bce27c-c542-4d71-b951-eb1b2625f8d6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:16.994378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-64bce27c-c542-4d71-b951-eb1b2625f8d6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:17.089894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a2cec4af-745c-4d9b-9bac-ce6ca6b4d9b0 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13b05790>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:17.094797 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:17.094797 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:49:17.100396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2cec4af-745c-4d9b-9bac-ce6ca6b4d9b0 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:17.100907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2cec4af-745c-4d9b-9bac-ce6ca6b4d9b0 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:17.115354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:17.122939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2cec4af-745c-4d9b-9bac-ce6ca6b4d9b0 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:17.123922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2cec4af-745c-4d9b-9bac-ce6ca6b4d9b0 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:17.154523 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-a2cec4af-745c-4d9b-9bac-ce6ca6b4d9b0 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] HTTP exception thrown: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a2cec4af-745c-4d9b-9bac-ce6ca6b4d9b0 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Request method failure captured: Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: request: PUT /compute/v2.1/os-services/46eb4899-fc95-434b-ab4b-9c472f66e592 HTTP/1.1 Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 56 Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dQcRRxu8yOVeJMEnnZAPuNV28qOm9X_0AF9evjAS58htJewih_aRnkiLrw0RbYu06xQr-jVdc_jZYLCABpBjGGG1LND6_vjGjwsl3S-Gmiq79df4PDER6rcagDVlBiFCVl1_2nao5Icxn8YZmr5V6orDFq6l11bQ3J3MNUSRjHRP7s Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.53 Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: d3f824b64e4943a9acfd660dcdf0a7fa Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-672997367 Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:49:17.157012 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:49:17.158798 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d3f824b64e4943a9acfd660dcdf0a7fa", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3f824b64e4943a9acfd660dcdf0a7fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d3f824b64e4943a9acfd660dcdf0a7fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3f824b64e4943a9acfd660dcdf0a7fa"}]}] Aug 03 01:49:17.158798 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-672997367 Aug 03 01:49:17.158798 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: d3f824b64e4943a9acfd660dcdf0a7fa Aug 03 01:49:17.158798 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-672997367 Aug 03 01:49:17.158798 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin Aug 03 01:49:17.158798 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:49:17.158798 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:49:17.158798 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: b3402c3b539c49d59f426989654269bb Aug 03 01:49:17.158798 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin Aug 03 01:49:17.158798 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:49:17.158798 n-d-826529-8 devstack@n-api.service[125942]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 03 01:49:17.158798 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:49:17.158798 n-d-826529-8 devstack@n-api.service[125942]: exception: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '46eb4899-fc95-434b-ab4b-9c472f66e592', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.159833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:17.161397 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:49:17.162919 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:49:17.162919 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. Aug 03 01:49:17.162919 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.167830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a2cec4af-745c-4d9b-9bac-ce6ca6b4d9b0 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Returning 404 to user: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:17.169042 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a2cec4af-745c-4d9b-9bac-ce6ca6b4d9b0 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-services/46eb4899-fc95-434b-ab4b-9c472f66e592" status: 404 len: 110 microversion: 2.53 time: 0.345752 Aug 03 01:49:17.170182 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 293/583] 10.222.0.67 () {62 vars in 1309 bytes} [Wed Aug 3 01:49:16 2022] PUT /compute/v2.1/os-services/46eb4899-fc95-434b-ab4b-9c472f66e592 => generated 110 bytes in 347 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:49:17.183367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b1658813-a5cb-4817-a0dd-a97d91c18f1c tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13b053a0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:17.251132 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b1658813-a5cb-4817-a0dd-a97d91c18f1c tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.076187 Aug 03 01:49:17.252940 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 294/584] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:17 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:49:17.258283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5cef0766-fd1b-466e-aacf-0c115ea7cc3a tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13a239d0>, body: {"status": "disabled"} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:17.267325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cef0766-fd1b-466e-aacf-0c115ea7cc3a tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:17.268516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cef0766-fd1b-466e-aacf-0c115ea7cc3a tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:17.281406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cef0766-fd1b-466e-aacf-0c115ea7cc3a tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:17.282061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cef0766-fd1b-466e-aacf-0c115ea7cc3a tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:17.301268 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-5cef0766-fd1b-466e-aacf-0c115ea7cc3a tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] HTTP exception thrown: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5cef0766-fd1b-466e-aacf-0c115ea7cc3a tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Request method failure captured: Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: request: PUT /compute/v2.1/os-services/46eb4899-fc95-434b-ab4b-9c472f66e592 HTTP/1.1 Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 22 Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dQcRRxu8yOVeJMEnnZAPuNV28qOm9X_0AF9evjAS58htJewih_aRnkiLrw0RbYu06xQr-jVdc_jZYLCABpBjGGG1LND6_vjGjwsl3S-Gmiq79df4PDER6rcagDVlBiFCVl1_2nao5Icxn8YZmr5V6orDFq6l11bQ3J3MNUSRjHRP7s Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.53 Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: d3f824b64e4943a9acfd660dcdf0a7fa Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-672997367 Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:49:17.303325 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:49:17.304927 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d3f824b64e4943a9acfd660dcdf0a7fa", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3f824b64e4943a9acfd660dcdf0a7fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d3f824b64e4943a9acfd660dcdf0a7fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3f824b64e4943a9acfd660dcdf0a7fa"}]}] Aug 03 01:49:17.304927 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-672997367 Aug 03 01:49:17.304927 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: d3f824b64e4943a9acfd660dcdf0a7fa Aug 03 01:49:17.304927 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-672997367 Aug 03 01:49:17.304927 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin Aug 03 01:49:17.304927 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:49:17.304927 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:49:17.304927 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: b3402c3b539c49d59f426989654269bb Aug 03 01:49:17.304927 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin Aug 03 01:49:17.304927 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:49:17.304927 n-d-826529-8 devstack@n-api.service[125942]: {"status": "disabled"} Aug 03 01:49:17.304927 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:49:17.304927 n-d-826529-8 devstack@n-api.service[125942]: exception: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. Aug 03 01:49:17.304927 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '46eb4899-fc95-434b-ab4b-9c472f66e592', 'body': {'status': 'disabled'}} Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:17.305937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:49:17.307446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:49:17.308875 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. Aug 03 01:49:17.308875 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.310107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5cef0766-fd1b-466e-aacf-0c115ea7cc3a tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Returning 404 to user: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:17.311178 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5cef0766-fd1b-466e-aacf-0c115ea7cc3a tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-services/46eb4899-fc95-434b-ab4b-9c472f66e592" status: 404 len: 110 microversion: 2.53 time: 0.056721 Aug 03 01:49:17.312016 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 295/585] 10.222.0.67 () {62 vars in 1309 bytes} [Wed Aug 3 01:49:17 2022] PUT /compute/v2.1/os-services/46eb4899-fc95-434b-ab4b-9c472f66e592 => generated 110 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:49:17.339727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7e252db9-44fc-4a9b-a7f4-72f1f98673c3 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13a74700>, body: {"status": "enabled"} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:17.372512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e252db9-44fc-4a9b-a7f4-72f1f98673c3 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:17.375780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e252db9-44fc-4a9b-a7f4-72f1f98673c3 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:17.414357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e252db9-44fc-4a9b-a7f4-72f1f98673c3 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:17.424671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e252db9-44fc-4a9b-a7f4-72f1f98673c3 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:17.447870 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-7e252db9-44fc-4a9b-a7f4-72f1f98673c3 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] HTTP exception thrown: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. Aug 03 01:49:17.451551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-64bce27c-c542-4d71-b951-eb1b2625f8d6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:17.466213 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-64bce27c-c542-4d71-b951-eb1b2625f8d6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 200 len: 1390 microversion: 2.1 time: 0.503887 Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7e252db9-44fc-4a9b-a7f4-72f1f98673c3 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Request method failure captured: Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: request: PUT /compute/v2.1/os-services/46eb4899-fc95-434b-ab4b-9c472f66e592 HTTP/1.1 Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 21 Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dQcRRxu8yOVeJMEnnZAPuNV28qOm9X_0AF9evjAS58htJewih_aRnkiLrw0RbYu06xQr-jVdc_jZYLCABpBjGGG1LND6_vjGjwsl3S-Gmiq79df4PDER6rcagDVlBiFCVl1_2nao5Icxn8YZmr5V6orDFq6l11bQ3J3MNUSRjHRP7s Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.53 Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: d3f824b64e4943a9acfd660dcdf0a7fa Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-672997367 Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:49:17.469234 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:49:17.470643 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d3f824b64e4943a9acfd660dcdf0a7fa", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3f824b64e4943a9acfd660dcdf0a7fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d3f824b64e4943a9acfd660dcdf0a7fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d3f824b64e4943a9acfd660dcdf0a7fa"}]}] Aug 03 01:49:17.470643 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-672997367 Aug 03 01:49:17.470643 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: d3f824b64e4943a9acfd660dcdf0a7fa Aug 03 01:49:17.470643 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-672997367 Aug 03 01:49:17.470643 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin Aug 03 01:49:17.470643 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:49:17.470643 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:49:17.470643 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: b3402c3b539c49d59f426989654269bb Aug 03 01:49:17.470643 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin Aug 03 01:49:17.470643 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:49:17.470643 n-d-826529-8 devstack@n-api.service[125942]: {"status": "enabled"} Aug 03 01:49:17.470643 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:49:17.470643 n-d-826529-8 devstack@n-api.service[125942]: exception: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. Aug 03 01:49:17.470643 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '46eb4899-fc95-434b-ab4b-9c472f66e592', 'body': {'status': 'enabled'}} Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:17.471677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:49:17.472835 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:49:17.473972 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. Aug 03 01:49:17.473972 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:17.475691 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 291/586] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:16 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 1390 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:17.479516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7e252db9-44fc-4a9b-a7f4-72f1f98673c3 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Returning 404 to user: Service 46eb4899-fc95-434b-ab4b-9c472f66e592 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:17.481158 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7e252db9-44fc-4a9b-a7f4-72f1f98673c3 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-services/46eb4899-fc95-434b-ab4b-9c472f66e592" status: 404 len: 110 microversion: 2.53 time: 0.156743 Aug 03 01:49:17.484081 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 296/587] 10.222.0.67 () {62 vars in 1309 bytes} [Wed Aug 3 01:49:17 2022] PUT /compute/v2.1/os-services/46eb4899-fc95-434b-ab4b-9c472f66e592 => generated 110 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:49:17.501058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-108b0cb8-d49e-4868-9a80-a6b833ce8642 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:17.505585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-108b0cb8-d49e-4868-9a80-a6b833ce8642 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:17.507331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8f90450e-3c32-499d-8b90-5f9bdd5a09a2 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:17.524234 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:17.524234 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:49:17.529061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f90450e-3c32-499d-8b90-5f9bdd5a09a2 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:17.531089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f90450e-3c32-499d-8b90-5f9bdd5a09a2 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:17.533814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f90450e-3c32-499d-8b90-5f9bdd5a09a2 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:17.538170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f90450e-3c32-499d-8b90-5f9bdd5a09a2 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:17.541527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-108b0cb8-d49e-4868-9a80-a6b833ce8642 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:17.541994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-108b0cb8-d49e-4868-9a80-a6b833ce8642 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:17.555008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-108b0cb8-d49e-4868-9a80-a6b833ce8642 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:17.561711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-108b0cb8-d49e-4868-9a80-a6b833ce8642 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:17.675253 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8f90450e-3c32-499d-8b90-5f9bdd5a09a2 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.180255 Aug 03 01:49:17.678936 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 297/588] 10.222.0.67 () {60 vars in 1178 bytes} [Wed Aug 3 01:49:17 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:17.701295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b410474a-b5bd-4bea-9799-a46d5913d29a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:17.707876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b410474a-b5bd-4bea-9799-a46d5913d29a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:17.745114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b410474a-b5bd-4bea-9799-a46d5913d29a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:17.749928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b410474a-b5bd-4bea-9799-a46d5913d29a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:17.755758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b410474a-b5bd-4bea-9799-a46d5913d29a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:17.756932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b410474a-b5bd-4bea-9799-a46d5913d29a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:17.840319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-108b0cb8-d49e-4868-9a80-a6b833ce8642 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:17.859422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-108b0cb8-d49e-4868-9a80-a6b833ce8642 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:17.869605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-108b0cb8-d49e-4868-9a80-a6b833ce8642 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:17.909085 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-108b0cb8-d49e-4868-9a80-a6b833ce8642 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.427994 Aug 03 01:49:17.930950 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 292/589] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:17 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:17.946231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a076ed8e-cc86-4ff3-97f6-2e12fbf3be95 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:17.960782 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:17.960782 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:49:17.962210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a076ed8e-cc86-4ff3-97f6-2e12fbf3be95 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:17.962668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a076ed8e-cc86-4ff3-97f6-2e12fbf3be95 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:17.963512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a076ed8e-cc86-4ff3-97f6-2e12fbf3be95 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:17.963955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a076ed8e-cc86-4ff3-97f6-2e12fbf3be95 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:18.059568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b410474a-b5bd-4bea-9799-a46d5913d29a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:18.071129 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b410474a-b5bd-4bea-9799-a46d5913d29a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1271 microversion: 2.1 time: 0.388105 Aug 03 01:49:18.082931 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 298/590] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:17 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1271 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:18.083737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-86f91b67-c6d5-453f-be6b-f3d84c2ade02 req-6a5c85bb-da35-4c2b-935c-6bbf238d487c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c171ccf7-988b-441b-acb8-7332e481ec09", "name": "network-vif-plugged", "status": "completed", "tag": "82736730-4f04-4297-8b74-d92a1952c26d"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:18.088215 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a076ed8e-cc86-4ff3-97f6-2e12fbf3be95 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.153279 Aug 03 01:49:18.108388 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 293/591] 10.222.0.67 () {60 vars in 1211 bytes} [Wed Aug 3 01:49:17 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:18.119793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b4b7e242-ce3f-4fb9-92a4-982de64bba0b tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:18.121210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-86f91b67-c6d5-453f-be6b-f3d84c2ade02 req-6a5c85bb-da35-4c2b-935c-6bbf238d487c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:18.128713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-86f91b67-c6d5-453f-be6b-f3d84c2ade02 req-6a5c85bb-da35-4c2b-935c-6bbf238d487c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:18.144662 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:18.144662 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:49:18.148921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4b7e242-ce3f-4fb9-92a4-982de64bba0b tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:18.154635 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-86f91b67-c6d5-453f-be6b-f3d84c2ade02 req-6a5c85bb-da35-4c2b-935c-6bbf238d487c service nova] Creating event network-vif-plugged:82736730-4f04-4297-8b74-d92a1952c26d for instance c171ccf7-988b-441b-acb8-7332e481ec09 on n-h1-826529-8 Aug 03 01:49:18.157860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4b7e242-ce3f-4fb9-92a4-982de64bba0b tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:18.159651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4b7e242-ce3f-4fb9-92a4-982de64bba0b tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:18.160212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4b7e242-ce3f-4fb9-92a4-982de64bba0b tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:18.174862 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-86f91b67-c6d5-453f-be6b-f3d84c2ade02 req-6a5c85bb-da35-4c2b-935c-6bbf238d487c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096508 Aug 03 01:49:18.177769 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 299/592] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:18.186789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:18.230022 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b4b7e242-ce3f-4fb9-92a4-982de64bba0b tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.120077 Aug 03 01:49:18.238449 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 294/593] 10.222.0.67 () {60 vars in 1178 bytes} [Wed Aug 3 01:49:18 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:18.247663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e278320d-c343-43fb-82a4-189cf7fd1aef tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:18.251783 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:18.251783 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:49:18.266724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b300c70c-1cd5-4da7-a80e-37d92d86d9bf tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b138b7280>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:18.272698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e278320d-c343-43fb-82a4-189cf7fd1aef tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:18.273478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e278320d-c343-43fb-82a4-189cf7fd1aef tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:18.277595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e278320d-c343-43fb-82a4-189cf7fd1aef tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:18.280216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e278320d-c343-43fb-82a4-189cf7fd1aef tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:18.353143 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b300c70c-1cd5-4da7-a80e-37d92d86d9bf tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.090188 Aug 03 01:49:18.354580 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 295/594] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:18 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:49:18.374966 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e278320d-c343-43fb-82a4-189cf7fd1aef tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?host=n-d-826529-8&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.133804 Aug 03 01:49:18.375591 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 300/595] 10.222.0.67 () {60 vars in 1235 bytes} [Wed Aug 3 01:49:18 2022] GET /compute/v2.1/os-services?host=n-d-826529-8&binary=xxx => generated 16 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:18.390708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-57b3e163-34ce-4a0e-b397-4720191276ae tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:18.393973 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:18.393973 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:49:18.398731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57b3e163-34ce-4a0e-b397-4720191276ae tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:18.400134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57b3e163-34ce-4a0e-b397-4720191276ae tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:18.402969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57b3e163-34ce-4a0e-b397-4720191276ae tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:18.405042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57b3e163-34ce-4a0e-b397-4720191276ae tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:18.470142 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-57b3e163-34ce-4a0e-b397-4720191276ae tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.085412 Aug 03 01:49:18.471575 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 296/596] 10.222.0.67 () {60 vars in 1178 bytes} [Wed Aug 3 01:49:18 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:18.486281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c3c4610e-23c5-4cf8-b142-e01dc9a9ad89 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:18.490615 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:18.490615 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:49:18.495469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3c4610e-23c5-4cf8-b142-e01dc9a9ad89 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:18.498512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3c4610e-23c5-4cf8-b142-e01dc9a9ad89 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:18.500999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3c4610e-23c5-4cf8-b142-e01dc9a9ad89 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:18.505673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3c4610e-23c5-4cf8-b142-e01dc9a9ad89 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:18.517007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-760dccb0-adac-45f5-bbe4-737f541fe753 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:18.528197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-760dccb0-adac-45f5-bbe4-737f541fe753 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:18.556764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-760dccb0-adac-45f5-bbe4-737f541fe753 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:18.557411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-760dccb0-adac-45f5-bbe4-737f541fe753 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:18.565178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-760dccb0-adac-45f5-bbe4-737f541fe753 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:18.565955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-760dccb0-adac-45f5-bbe4-737f541fe753 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:18.605935 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c3c4610e-23c5-4cf8-b142-e01dc9a9ad89 tempest-ServicesAdminNegativeV253TestJSON-672997367 tempest-ServicesAdminNegativeV253TestJSON-672997367-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.124143 Aug 03 01:49:18.607971 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 301/597] 10.222.0.67 () {60 vars in 1239 bytes} [Wed Aug 3 01:49:18 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:19.127977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a9471963-dc3d-49c5-9b82-f5232f125fc9 tempest-ServicesAdminNegativeV253TestJSON-1668733289 tempest-ServicesAdminNegativeV253TestJSON-1668733289-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:19.131526 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:49:19.131526 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:49:19.134525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a9471963-dc3d-49c5-9b82-f5232f125fc9 tempest-ServicesAdminNegativeV253TestJSON-1668733289 tempest-ServicesAdminNegativeV253TestJSON-1668733289-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '839888e90ebc4ab68ea031f5baadfdb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f52651b7d34dff8685f90abd4fab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a9471963-dc3d-49c5-9b82-f5232f125fc9 tempest-ServicesAdminNegativeV253TestJSON-1668733289 tempest-ServicesAdminNegativeV253TestJSON-1668733289-project] Request method failure captured: Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dQaFOAe9BbKtTK9QjY6hyrQm7M9FigW4J-WTb36ngGm06NOJ2hSxj6DJxM1DWSwWCPv9ryJ-iWLPmo7PyC46rlMbiCkFyHzbYEl15gJckVE0zMxoofaDVM4bCVj-q5ipVKL_K8LggS5VQWlRGAOLR4ITeYctxZyj-fcYZEs7Ujv77Y Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.53 Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 14f52651b7d34dff8685f90abd4fab4e Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1668733289 Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:49:19.140959 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:49:19.142579 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_14f52651b7d34dff8685f90abd4fab4e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/14f52651b7d34dff8685f90abd4fab4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/14f52651b7d34dff8685f90abd4fab4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/14f52651b7d34dff8685f90abd4fab4e"}]}] Aug 03 01:49:19.142579 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1668733289 Aug 03 01:49:19.142579 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 14f52651b7d34dff8685f90abd4fab4e Aug 03 01:49:19.142579 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1668733289 Aug 03 01:49:19.142579 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1668733289-project Aug 03 01:49:19.142579 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:49:19.142579 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:49:19.142579 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 839888e90ebc4ab68ea031f5baadfdb7 Aug 03 01:49:19.142579 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1668733289-project Aug 03 01:49:19.142579 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:49:19.142579 n-d-826529-8 devstack@n-api.service[125942]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 03 01:49:19.142579 n-d-826529-8 devstack@n-api.service[125942]: action_args: {} Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:49:19.143510 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 03 01:49:19.144644 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:19.151540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a9471963-dc3d-49c5-9b82-f5232f125fc9 tempest-ServicesAdminNegativeV253TestJSON-1668733289 tempest-ServicesAdminNegativeV253TestJSON-1668733289-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:19.156298 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a9471963-dc3d-49c5-9b82-f5232f125fc9 tempest-ServicesAdminNegativeV253TestJSON-1668733289 tempest-ServicesAdminNegativeV253TestJSON-1668733289-project] 10.222.0.67 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.539006 Aug 03 01:49:19.160344 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 302/598] 10.222.0.67 () {60 vars in 1178 bytes} [Wed Aug 3 01:49:18 2022] GET /compute/v2.1/os-services => generated 112 bytes in 544 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:49:19.181907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-30c4b7b4-4ca1-446b-9cd7-e820694646b1 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:19.183050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-30c4b7b4-4ca1-446b-9cd7-e820694646b1 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:19.190712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30c4b7b4-4ca1-446b-9cd7-e820694646b1 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:19.192983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30c4b7b4-4ca1-446b-9cd7-e820694646b1 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:19.195173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30c4b7b4-4ca1-446b-9cd7-e820694646b1 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:19.197439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30c4b7b4-4ca1-446b-9cd7-e820694646b1 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:19.410321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-760dccb0-adac-45f5-bbe4-737f541fe753 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:19.431111 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-760dccb0-adac-45f5-bbe4-737f541fe753 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 200 len: 1390 microversion: 2.1 time: 0.926510 Aug 03 01:49:19.435808 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 297/599] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:18 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 1390 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:19.472634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-58f92a09-5449-4399-abc9-1a00a7544afe tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:19.473801 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-58f92a09-5449-4399-abc9-1a00a7544afe tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:19.499792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58f92a09-5449-4399-abc9-1a00a7544afe tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:19.513804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58f92a09-5449-4399-abc9-1a00a7544afe tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:19.520965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58f92a09-5449-4399-abc9-1a00a7544afe tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:19.521949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58f92a09-5449-4399-abc9-1a00a7544afe tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:19.552694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-30c4b7b4-4ca1-446b-9cd7-e820694646b1 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:19.566861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-30c4b7b4-4ca1-446b-9cd7-e820694646b1 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:19.571839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-30c4b7b4-4ca1-446b-9cd7-e820694646b1 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:19.587728 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-30c4b7b4-4ca1-446b-9cd7-e820694646b1 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.425658 Aug 03 01:49:19.603272 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 303/600] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:19 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:19.611793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-72ace338-1064-44cf-af4e-ee49e0f2de6a tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13b05940>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:19.702651 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-72ace338-1064-44cf-af4e-ee49e0f2de6a tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.098074 Aug 03 01:49:19.704354 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 304/601] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:19 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:20.463462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7aa8480f-e971-4765-a4cd-80145ccc0a84 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:20.464884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7aa8480f-e971-4765-a4cd-80145ccc0a84 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:20.481262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7aa8480f-e971-4765-a4cd-80145ccc0a84 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:20.481958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7aa8480f-e971-4765-a4cd-80145ccc0a84 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:20.488714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7aa8480f-e971-4765-a4cd-80145ccc0a84 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:20.489718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7aa8480f-e971-4765-a4cd-80145ccc0a84 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:20.607581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-58f92a09-5449-4399-abc9-1a00a7544afe tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:20.617647 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-58f92a09-5449-4399-abc9-1a00a7544afe tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1313 microversion: 2.1 time: 1.180298 Aug 03 01:49:20.635994 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 298/602] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:19 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1313 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:20.649306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e95dff5c-32c8-43fb-9899-c61eed78b4ea tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:20.649932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e95dff5c-32c8-43fb-9899-c61eed78b4ea tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:20.668547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e95dff5c-32c8-43fb-9899-c61eed78b4ea tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:20.669295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e95dff5c-32c8-43fb-9899-c61eed78b4ea tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:20.670270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e95dff5c-32c8-43fb-9899-c61eed78b4ea tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:20.677511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e95dff5c-32c8-43fb-9899-c61eed78b4ea tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:20.909347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e95dff5c-32c8-43fb-9899-c61eed78b4ea tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:20.918190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e95dff5c-32c8-43fb-9899-c61eed78b4ea tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:20.920055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e95dff5c-32c8-43fb-9899-c61eed78b4ea tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:20.930945 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e95dff5c-32c8-43fb-9899-c61eed78b4ea tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.293334 Aug 03 01:49:20.932181 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 299/603] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:20 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:20.937517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2ff09991-723c-4b7d-9d6e-781dc140c69d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b135f3040>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:21.068045 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2ff09991-723c-4b7d-9d6e-781dc140c69d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.134548 Aug 03 01:49:21.068921 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 300/604] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:20 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:21.098646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7aa8480f-e971-4765-a4cd-80145ccc0a84 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:21.124805 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7aa8480f-e971-4765-a4cd-80145ccc0a84 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 200 len: 1588 microversion: 2.1 time: 0.665957 Aug 03 01:49:21.126226 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 305/605] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:20 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 1588 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:21.153636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f1d51a69-4e49-4272-8cb1-f0ea37abb5ca tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:21.154153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f1d51a69-4e49-4272-8cb1-f0ea37abb5ca tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:21.167028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1d51a69-4e49-4272-8cb1-f0ea37abb5ca tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:21.167296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1d51a69-4e49-4272-8cb1-f0ea37abb5ca tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:21.168776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1d51a69-4e49-4272-8cb1-f0ea37abb5ca tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:21.169391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1d51a69-4e49-4272-8cb1-f0ea37abb5ca tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:21.648954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f9251ec2-ba1f-4605-b0fb-86bd1a3b9d1b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:21.649586 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f9251ec2-ba1f-4605-b0fb-86bd1a3b9d1b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:21.657996 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f1d51a69-4e49-4272-8cb1-f0ea37abb5ca tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.509593 Aug 03 01:49:21.659743 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 301/606] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 01:49:21 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09/os-interface => generated 284 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:21.671290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9251ec2-ba1f-4605-b0fb-86bd1a3b9d1b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:21.672136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9251ec2-ba1f-4605-b0fb-86bd1a3b9d1b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:21.673164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9251ec2-ba1f-4605-b0fb-86bd1a3b9d1b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:21.674309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9251ec2-ba1f-4605-b0fb-86bd1a3b9d1b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:21.883105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-df1e61d9-cf0b-4b8b-b49a-eb2279041bbc req-d139f1e9-1c1d-4c5a-bb42-8890e8fde6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f490eab-9c88-441e-8768-ae1e5eed8093", "tag": "9f0663d7-6a0d-4d64-8ff5-d5196b0ca3bf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:21.902032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-df1e61d9-cf0b-4b8b-b49a-eb2279041bbc req-d139f1e9-1c1d-4c5a-bb42-8890e8fde6a1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:21.902687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-df1e61d9-cf0b-4b8b-b49a-eb2279041bbc req-d139f1e9-1c1d-4c5a-bb42-8890e8fde6a1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:21.928587 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-df1e61d9-cf0b-4b8b-b49a-eb2279041bbc req-d139f1e9-1c1d-4c5a-bb42-8890e8fde6a1 service nova] Creating event network-changed:9f0663d7-6a0d-4d64-8ff5-d5196b0ca3bf for instance 9f490eab-9c88-441e-8768-ae1e5eed8093 on n-h2-826529-8 Aug 03 01:49:21.945826 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-df1e61d9-cf0b-4b8b-b49a-eb2279041bbc req-d139f1e9-1c1d-4c5a-bb42-8890e8fde6a1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066807 Aug 03 01:49:21.946781 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 302/607] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:21.958358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-08d33817-fb2f-4ede-82bd-1fe706268b84 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:21.959102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-08d33817-fb2f-4ede-82bd-1fe706268b84 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:21.971449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08d33817-fb2f-4ede-82bd-1fe706268b84 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:21.974102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08d33817-fb2f-4ede-82bd-1fe706268b84 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:21.975155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08d33817-fb2f-4ede-82bd-1fe706268b84 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:21.979191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08d33817-fb2f-4ede-82bd-1fe706268b84 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:22.410140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-08d33817-fb2f-4ede-82bd-1fe706268b84 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:22.435754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-08d33817-fb2f-4ede-82bd-1fe706268b84 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:22.442268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-08d33817-fb2f-4ede-82bd-1fe706268b84 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:22.458111 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-08d33817-fb2f-4ede-82bd-1fe706268b84 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.503722 Aug 03 01:49:22.476536 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 303/608] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:21 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:22.491050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0346ef06-e87b-4862-af05-18883cd41a58 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b137a8dc0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:22.608291 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0346ef06-e87b-4862-af05-18883cd41a58 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.123821 Aug 03 01:49:22.616762 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 304/609] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:22 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:23.018677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f9251ec2-ba1f-4605-b0fb-86bd1a3b9d1b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:23.039793 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f9251ec2-ba1f-4605-b0fb-86bd1a3b9d1b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1313 microversion: 2.1 time: 1.394886 Aug 03 01:49:23.057227 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 306/610] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:21 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1313 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:23.496873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-337b4ead-9c0e-4992-9946-05497a2a3991 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:23.498201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-337b4ead-9c0e-4992-9946-05497a2a3991 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:23.523820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-337b4ead-9c0e-4992-9946-05497a2a3991 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:23.525504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-337b4ead-9c0e-4992-9946-05497a2a3991 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:23.528105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-337b4ead-9c0e-4992-9946-05497a2a3991 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:23.530120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-337b4ead-9c0e-4992-9946-05497a2a3991 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:23.625606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e9534ee2-cb4b-4ae6-a9bf-142648d84dad tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13b2d8b0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:23.719581 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e9534ee2-cb4b-4ae6-a9bf-142648d84dad tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.097930 Aug 03 01:49:23.731921 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 307/611] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:23 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:23.974169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-337b4ead-9c0e-4992-9946-05497a2a3991 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:24.020645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-337b4ead-9c0e-4992-9946-05497a2a3991 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:24.031641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-337b4ead-9c0e-4992-9946-05497a2a3991 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:24.061013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:24.061482 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-337b4ead-9c0e-4992-9946-05497a2a3991 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.559833 Aug 03 01:49:24.062149 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 305/612] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:23 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:24.081475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ebaf28f7-e464-4719-bf02-fce1cd01c970 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:24.082143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ebaf28f7-e464-4719-bf02-fce1cd01c970 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:24.107253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebaf28f7-e464-4719-bf02-fce1cd01c970 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:24.107711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebaf28f7-e464-4719-bf02-fce1cd01c970 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:24.117451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebaf28f7-e464-4719-bf02-fce1cd01c970 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:24.128587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebaf28f7-e464-4719-bf02-fce1cd01c970 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:24.736068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d2e8474f-6694-4c9e-82a0-3f874ecb8dc5 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b135f38b0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:24.817398 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d2e8474f-6694-4c9e-82a0-3f874ecb8dc5 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.085400 Aug 03 01:49:24.818521 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 306/613] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:24 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:49:25.089470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-35779fea-28fe-4a20-a60d-a9cd615bda57 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:25.090280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-35779fea-28fe-4a20-a60d-a9cd615bda57 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:25.093131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=30 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:25.108968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35779fea-28fe-4a20-a60d-a9cd615bda57 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:25.112456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35779fea-28fe-4a20-a60d-a9cd615bda57 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:25.113490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35779fea-28fe-4a20-a60d-a9cd615bda57 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:25.116624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35779fea-28fe-4a20-a60d-a9cd615bda57 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:25.427594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-35779fea-28fe-4a20-a60d-a9cd615bda57 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:25.440302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-35779fea-28fe-4a20-a60d-a9cd615bda57 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:25.443922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-35779fea-28fe-4a20-a60d-a9cd615bda57 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:25.458180 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-35779fea-28fe-4a20-a60d-a9cd615bda57 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.372413 Aug 03 01:49:25.459394 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 307/614] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:25 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:25.648406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ebaf28f7-e464-4719-bf02-fce1cd01c970 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:25.651951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e9f33c07-db4a-479c-8890-14194bafb12a tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Calling method '.version_select at 0x7f5b136043a0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:25.663320 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ebaf28f7-e464-4719-bf02-fce1cd01c970 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1313 microversion: 2.1 time: 1.604976 Aug 03 01:49:25.677693 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 308/615] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:24 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1313 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:25.787666 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e9f33c07-db4a-479c-8890-14194bafb12a tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/84ffeee8d7794d1fb9de6639045d0ed8" status: 200 len: 371 microversion: 2.1 time: 0.325856 Aug 03 01:49:25.788297 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 308/616] 10.222.0.67 () {58 vars in 1242 bytes} [Wed Aug 3 01:49:25 2022] GET /compute/v2.1/os-quota-sets/84ffeee8d7794d1fb9de6639045d0ed8 => generated 371 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:25.802378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-41a34fd8-b6e2-46a6-90c3-76489eb0ce86 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13a958b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:25.843482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03741da4-12bf-466e-b28e-c61ebc7c1f0e tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b135cb0d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:25.922525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41a34fd8-b6e2-46a6-90c3-76489eb0ce86 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:25.924163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41a34fd8-b6e2-46a6-90c3-76489eb0ce86 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:25.926147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41a34fd8-b6e2-46a6-90c3-76489eb0ce86 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:25.926968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41a34fd8-b6e2-46a6-90c3-76489eb0ce86 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:25.946487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=23 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:25.975692 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03741da4-12bf-466e-b28e-c61ebc7c1f0e tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.146264 Aug 03 01:49:25.978985 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 309/617] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:25 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:26.024243 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-41a34fd8-b6e2-46a6-90c3-76489eb0ce86 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/84ffeee8d7794d1fb9de6639045d0ed8" status: 200 len: 328 microversion: 2.1 time: 0.228165 Aug 03 01:49:26.026068 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 309/618] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 3 01:49:25 2022] PUT /compute/v2.1/os-quota-sets/84ffeee8d7794d1fb9de6639045d0ed8 => generated 328 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:26.043760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-33376b4b-e66b-438a-bc8e-0579a1618f52 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:26.072593 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-33376b4b-e66b-438a-bc8e-0579a1618f52 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-quota-sets/84ffeee8d7794d1fb9de6639045d0ed8" status: 202 len: 0 microversion: 2.1 time: 0.037819 Aug 03 01:49:26.076052 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 310/619] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 01:49:26 2022] DELETE /compute/v2.1/os-quota-sets/84ffeee8d7794d1fb9de6639045d0ed8 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:49:26.091799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5dd7863d-3ef0-44b8-aa6c-e422302cd04e tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Calling method '.version_select at 0x7f5b13a72dc0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:26.264491 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5dd7863d-3ef0-44b8-aa6c-e422302cd04e tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/84ffeee8d7794d1fb9de6639045d0ed8" status: 200 len: 371 microversion: 2.1 time: 0.182560 Aug 03 01:49:26.277348 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 310/620] 10.222.0.67 () {58 vars in 1242 bytes} [Wed Aug 3 01:49:26 2022] GET /compute/v2.1/os-quota-sets/84ffeee8d7794d1fb9de6639045d0ed8 => generated 371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:26.493100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-faa9f1b6-706e-4dff-b39d-d4d6d79da340 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:26.495756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-faa9f1b6-706e-4dff-b39d-d4d6d79da340 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:26.514526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faa9f1b6-706e-4dff-b39d-d4d6d79da340 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:26.519178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faa9f1b6-706e-4dff-b39d-d4d6d79da340 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:26.520164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faa9f1b6-706e-4dff-b39d-d4d6d79da340 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:26.520622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faa9f1b6-706e-4dff-b39d-d4d6d79da340 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:26.608504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b1e43bbb-d5d2-47cf-bd4a-b70f0cf07617 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Calling method '.version_select at 0x7f5b13b05160>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:26.763336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-faa9f1b6-706e-4dff-b39d-d4d6d79da340 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:26.789132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-faa9f1b6-706e-4dff-b39d-d4d6d79da340 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:26.791684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-faa9f1b6-706e-4dff-b39d-d4d6d79da340 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:26.810616 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-faa9f1b6-706e-4dff-b39d-d4d6d79da340 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.322026 Aug 03 01:49:26.827931 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 311/621] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:26 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:26.863950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1d6a2416-a452-4739-bcd3-704769bc73e3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:26.864897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1d6a2416-a452-4739-bcd3-704769bc73e3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:26.887979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d6a2416-a452-4739-bcd3-704769bc73e3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:26.895684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d6a2416-a452-4739-bcd3-704769bc73e3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:26.901289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d6a2416-a452-4739-bcd3-704769bc73e3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:26.901766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d6a2416-a452-4739-bcd3-704769bc73e3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:27.009884 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b1e43bbb-d5d2-47cf-bd4a-b70f0cf07617 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/83116cb4b4aa40cc8807ba4915b4742d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.417481 Aug 03 01:49:27.010461 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 311/622] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 01:49:26 2022] GET /compute/v2.1/os-quota-sets/83116cb4b4aa40cc8807ba4915b4742d/defaults => generated 371 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:27.023600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4392b6a1-7bde-4d37-8e56-dc34fbb6160d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13c79160>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:27.109672 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4392b6a1-7bde-4d37-8e56-dc34fbb6160d tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.097826 Aug 03 01:49:27.114557 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 312/623] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:27 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:27.664149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69c906e3-27c0-482c-bf16-b0b4c7185353 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13b05a60>, body: {"quota_set": {"ram": "5120"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:27.686866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1d6a2416-a452-4739-bcd3-704769bc73e3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:27.697663 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1d6a2416-a452-4739-bcd3-704769bc73e3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1313 microversion: 2.1 time: 0.868588 Aug 03 01:49:27.704204 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 312/624] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:26 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1313 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:27.841683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f93c1dac-2095-4c54-a828-4e9bf360447b tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:27.842296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f93c1dac-2095-4c54-a828-4e9bf360447b tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:27.853159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f93c1dac-2095-4c54-a828-4e9bf360447b tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:27.853655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f93c1dac-2095-4c54-a828-4e9bf360447b tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:27.854375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f93c1dac-2095-4c54-a828-4e9bf360447b tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:27.867538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f93c1dac-2095-4c54-a828-4e9bf360447b tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:28.431803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:28.836122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f93c1dac-2095-4c54-a828-4e9bf360447b tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:28.847163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69c906e3-27c0-482c-bf16-b0b4c7185353 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:28.847713 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f93c1dac-2095-4c54-a828-4e9bf360447b tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 200 len: 1588 microversion: 2.1 time: 1.006951 Aug 03 01:49:28.848728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69c906e3-27c0-482c-bf16-b0b4c7185353 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:28.851207 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 313/625] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:27 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 1588 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:49:28.852070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69c906e3-27c0-482c-bf16-b0b4c7185353 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:28.852993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69c906e3-27c0-482c-bf16-b0b4c7185353 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:28.872849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-522d5ca1-f972-428c-bb87-2967cd95bf75 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:28.874384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-522d5ca1-f972-428c-bb87-2967cd95bf75 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:28.884810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-522d5ca1-f972-428c-bb87-2967cd95bf75 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:28.887986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-522d5ca1-f972-428c-bb87-2967cd95bf75 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:28.889579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-522d5ca1-f972-428c-bb87-2967cd95bf75 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:28.894100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-522d5ca1-f972-428c-bb87-2967cd95bf75 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:28.977075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-522d5ca1-f972-428c-bb87-2967cd95bf75 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:28.978844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:28.990810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-522d5ca1-f972-428c-bb87-2967cd95bf75 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:28.993112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-522d5ca1-f972-428c-bb87-2967cd95bf75 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:28.999673 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-522d5ca1-f972-428c-bb87-2967cd95bf75 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.146844 Aug 03 01:49:29.000938 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 314/626] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:28 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:29.015221 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-69c906e3-27c0-482c-bf16-b0b4c7185353 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/bfb515abf6424ca78b7f531e3c275377" status: 200 len: 328 microversion: 2.1 time: 1.349809 Aug 03 01:49:29.015221 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 313/627] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 3 01:49:27 2022] PUT /compute/v2.1/os-quota-sets/bfb515abf6424ca78b7f531e3c275377 => generated 328 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:29.027700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-07b86a6a-a4ce-44b9-8ec0-ad4161f19813 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b135cbb80>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:29.038160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-240a5627-d1fe-4fd9-acc6-91f82032ef6d req-d1cce8e1-06e2-4f7f-8a8e-bd4a7467c4dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c171ccf7-988b-441b-acb8-7332e481ec09", "tag": "82736730-4f04-4297-8b74-d92a1952c26d"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:29.056152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-240a5627-d1fe-4fd9-acc6-91f82032ef6d req-d1cce8e1-06e2-4f7f-8a8e-bd4a7467c4dd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:29.056814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-240a5627-d1fe-4fd9-acc6-91f82032ef6d req-d1cce8e1-06e2-4f7f-8a8e-bd4a7467c4dd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:29.114656 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-240a5627-d1fe-4fd9-acc6-91f82032ef6d req-d1cce8e1-06e2-4f7f-8a8e-bd4a7467c4dd service nova] Creating event network-changed:82736730-4f04-4297-8b74-d92a1952c26d for instance c171ccf7-988b-441b-acb8-7332e481ec09 on n-h1-826529-8 Aug 03 01:49:29.131043 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-240a5627-d1fe-4fd9-acc6-91f82032ef6d req-d1cce8e1-06e2-4f7f-8a8e-bd4a7467c4dd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116787 Aug 03 01:49:29.133001 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 314/628] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:29.146268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-97437bd5-9d8a-4dfa-a579-ea327a87ef4b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:29.149701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-97437bd5-9d8a-4dfa-a579-ea327a87ef4b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:29.159331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97437bd5-9d8a-4dfa-a579-ea327a87ef4b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:29.164422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97437bd5-9d8a-4dfa-a579-ea327a87ef4b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:29.165085 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-07b86a6a-a4ce-44b9-8ec0-ad4161f19813 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.141085 Aug 03 01:49:29.165739 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 315/629] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:29 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:29.170189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97437bd5-9d8a-4dfa-a579-ea327a87ef4b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:29.170343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-25379626-4458-4fe4-a18b-ea9414bfd40b tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Calling method '.version_select at 0x7f5b13611310>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:29.171035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97437bd5-9d8a-4dfa-a579-ea327a87ef4b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:29.601938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-97437bd5-9d8a-4dfa-a579-ea327a87ef4b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:29.619475 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-97437bd5-9d8a-4dfa-a579-ea327a87ef4b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1313 microversion: 2.1 time: 0.482151 Aug 03 01:49:29.620060 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 315/630] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:29 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:30.014260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-25379626-4458-4fe4-a18b-ea9414bfd40b tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:30.014782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-25379626-4458-4fe4-a18b-ea9414bfd40b tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:30.018787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-25379626-4458-4fe4-a18b-ea9414bfd40b tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:30.021973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-25379626-4458-4fe4-a18b-ea9414bfd40b tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:30.031030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-90a61c82-8123-4d36-ae82-43f1a99514db tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:30.032212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-90a61c82-8123-4d36-ae82-43f1a99514db tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:30.063082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90a61c82-8123-4d36-ae82-43f1a99514db tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:30.064404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90a61c82-8123-4d36-ae82-43f1a99514db tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:30.065376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90a61c82-8123-4d36-ae82-43f1a99514db tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:30.068269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90a61c82-8123-4d36-ae82-43f1a99514db tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:30.085118 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-25379626-4458-4fe4-a18b-ea9414bfd40b tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/bfb515abf6424ca78b7f531e3c275377/detail" status: 200 len: 916 microversion: 2.1 time: 0.915408 Aug 03 01:49:30.097221 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 316/631] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 01:49:29 2022] GET /compute/v2.1/os-quota-sets/bfb515abf6424ca78b7f531e3c275377/detail => generated 916 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:30.181045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-48021239-3f03-4994-a901-66d4ea3bffb7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b1359c280>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:30.264962 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-48021239-3f03-4994-a901-66d4ea3bffb7 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1428 microversion: 2.1 time: 0.086459 Aug 03 01:49:30.266071 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 317/632] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:30 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:30.278131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-90a61c82-8123-4d36-ae82-43f1a99514db tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:30.289002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-90a61c82-8123-4d36-ae82-43f1a99514db tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:30.295384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-90a61c82-8123-4d36-ae82-43f1a99514db tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:30.306100 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-90a61c82-8123-4d36-ae82-43f1a99514db tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.279494 Aug 03 01:49:30.311332 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 316/633] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:30 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:30.428519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2ae28f37-be64-4997-9eee-c7c39c3b5cec tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13611160>, body: {"quota_set": {"ram": "2048"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:30.641020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f8401817-b336-460e-a746-2c1054c23a3b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:30.641635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f8401817-b336-460e-a746-2c1054c23a3b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:30.663579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8401817-b336-460e-a746-2c1054c23a3b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:30.664065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8401817-b336-460e-a746-2c1054c23a3b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:30.664879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8401817-b336-460e-a746-2c1054c23a3b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:30.665319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8401817-b336-460e-a746-2c1054c23a3b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:30.870457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ae28f37-be64-4997-9eee-c7c39c3b5cec tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:30.870931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ae28f37-be64-4997-9eee-c7c39c3b5cec tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:30.871906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ae28f37-be64-4997-9eee-c7c39c3b5cec tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:30.872346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ae28f37-be64-4997-9eee-c7c39c3b5cec tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:30.935307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ae28f37-be64-4997-9eee-c7c39c3b5cec tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:30.935917 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ae28f37-be64-4997-9eee-c7c39c3b5cec tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:30.936739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ae28f37-be64-4997-9eee-c7c39c3b5cec tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:30.937366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ae28f37-be64-4997-9eee-c7c39c3b5cec tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:30.964726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f8401817-b336-460e-a746-2c1054c23a3b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:30.976880 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f8401817-b336-460e-a746-2c1054c23a3b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1313 microversion: 2.1 time: 0.337388 Aug 03 01:49:30.978220 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 317/634] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:30 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:49:31.059184 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2ae28f37-be64-4997-9eee-c7c39c3b5cec tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/bfb515abf6424ca78b7f531e3c275377?user_id=2c7a56e6ee1a446f94aa07700ebf27c3" status: 200 len: 328 microversion: 2.1 time: 0.636333 Aug 03 01:49:31.061649 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 318/635] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 01:49:30 2022] PUT /compute/v2.1/os-quota-sets/bfb515abf6424ca78b7f531e3c275377?user_id=2c7a56e6ee1a446f94aa07700ebf27c3 => generated 328 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:31.073640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9a84365d-5fe0-4d39-8349-80c4149c8dc5 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Calling method '.version_select at 0x7f5b13b05ca0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:31.192574 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9a84365d-5fe0-4d39-8349-80c4149c8dc5 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/bfb515abf6424ca78b7f531e3c275377?user_id=2c7a56e6ee1a446f94aa07700ebf27c3" status: 200 len: 370 microversion: 2.1 time: 0.123293 Aug 03 01:49:31.193760 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 318/636] 10.222.0.67 () {58 vars in 1323 bytes} [Wed Aug 3 01:49:31 2022] GET /compute/v2.1/os-quota-sets/bfb515abf6424ca78b7f531e3c275377?user_id=2c7a56e6ee1a446f94aa07700ebf27c3 => generated 370 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:31.285471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5e6d4ff9-5913-4d49-91e4-ee85a33a61df tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b135cb9d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:31.337937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6d27a48b-eaa6-4817-a9db-57f1f9e91cfa tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:31.338862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6d27a48b-eaa6-4817-a9db-57f1f9e91cfa tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:31.354863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d27a48b-eaa6-4817-a9db-57f1f9e91cfa tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:31.360599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d27a48b-eaa6-4817-a9db-57f1f9e91cfa tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:31.370784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d27a48b-eaa6-4817-a9db-57f1f9e91cfa tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:31.371532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d27a48b-eaa6-4817-a9db-57f1f9e91cfa tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:31.375668 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5e6d4ff9-5913-4d49-91e4-ee85a33a61df tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1437 microversion: 2.1 time: 0.097553 Aug 03 01:49:31.378036 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 319/637] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:31 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1437 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:31.397594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2ba0db7b-3c78-41de-90ee-c8cd6f073918 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13611550>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:31.483692 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2ba0db7b-3c78-41de-90ee-c8cd6f073918 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 200 len: 1437 microversion: 2.1 time: 0.095843 Aug 03 01:49:31.495085 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 320/638] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:49:31 2022] GET /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 1437 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:49:31.508925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aec9f4fb-3c86-4490-bcb1-db54b78790dc tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:31.518389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-aec9f4fb-3c86-4490-bcb1-db54b78790dc tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:31.530104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aec9f4fb-3c86-4490-bcb1-db54b78790dc tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:31.530930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aec9f4fb-3c86-4490-bcb1-db54b78790dc tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:31.532311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aec9f4fb-3c86-4490-bcb1-db54b78790dc tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:31.533483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aec9f4fb-3c86-4490-bcb1-db54b78790dc tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:31.593413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6d27a48b-eaa6-4817-a9db-57f1f9e91cfa tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:31.606850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6d27a48b-eaa6-4817-a9db-57f1f9e91cfa tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:31.612077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6d27a48b-eaa6-4817-a9db-57f1f9e91cfa tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:31.629814 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6d27a48b-eaa6-4817-a9db-57f1f9e91cfa tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.296521 Aug 03 01:49:31.632592 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 319/639] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:31 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:31.800876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-67e9cbe1-ab04-4cd3-a875-2f5ae08c70a1 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Calling method '.version_select at 0x7f5b13b05160>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:32.010343 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-67e9cbe1-ab04-4cd3-a875-2f5ae08c70a1 tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/83116cb4b4aa40cc8807ba4915b4742d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.214518 Aug 03 01:49:32.011066 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 320/640] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 01:49:31 2022] GET /compute/v2.1/os-quota-sets/83116cb4b4aa40cc8807ba4915b4742d/defaults => generated 371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:32.020670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4d4bcd5a-2fc5-42ef-8646-664c84858a51 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:32.021333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4d4bcd5a-2fc5-42ef-8646-664c84858a51 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:32.034846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d4bcd5a-2fc5-42ef-8646-664c84858a51 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:32.035774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d4bcd5a-2fc5-42ef-8646-664c84858a51 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:32.037234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d4bcd5a-2fc5-42ef-8646-664c84858a51 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:32.041910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d4bcd5a-2fc5-42ef-8646-664c84858a51 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:32.113393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-aec9f4fb-3c86-4490-bcb1-db54b78790dc tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:32.125775 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-aec9f4fb-3c86-4490-bcb1-db54b78790dc tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1465 microversion: 2.1 time: 0.629293 Aug 03 01:49:32.136474 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 321/641] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:31 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1465 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:32.152442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03cf0731-6bfe-4153-87d2-6209581a9ccc tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13611dc0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:32.247499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:DELETE=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:32.260703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03cf0731-6bfe-4153-87d2-6209581a9ccc tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:32.261163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03cf0731-6bfe-4153-87d2-6209581a9ccc tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:32.261985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03cf0731-6bfe-4153-87d2-6209581a9ccc tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:32.264857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03cf0731-6bfe-4153-87d2-6209581a9ccc tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:32.723162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4d4bcd5a-2fc5-42ef-8646-664c84858a51 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:32.737608 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4d4bcd5a-2fc5-42ef-8646-664c84858a51 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1313 microversion: 2.1 time: 0.725292 Aug 03 01:49:32.739839 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 321/642] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:32 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1313 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:32.751993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0c9525b4-2c8c-4d11-9737-e57ad4fa15fc tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13afed30>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:32.778453 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03cf0731-6bfe-4153-87d2-6209581a9ccc tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/83116cb4b4aa40cc8807ba4915b4742d" status: 200 len: 329 microversion: 2.1 time: 0.633910 Aug 03 01:49:32.779384 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 322/643] 10.222.0.67 () {60 vars in 1263 bytes} [Wed Aug 3 01:49:32 2022] PUT /compute/v2.1/os-quota-sets/83116cb4b4aa40cc8807ba4915b4742d => generated 329 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:32.785824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-59c742c5-fcec-4318-b548-76ee54f2cb25 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:32.787137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-59c742c5-fcec-4318-b548-76ee54f2cb25 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:32.794728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59c742c5-fcec-4318-b548-76ee54f2cb25 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:32.795446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59c742c5-fcec-4318-b548-76ee54f2cb25 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:32.796624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59c742c5-fcec-4318-b548-76ee54f2cb25 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:32.797256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59c742c5-fcec-4318-b548-76ee54f2cb25 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:32.925598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-59c742c5-fcec-4318-b548-76ee54f2cb25 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:32.940235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-59c742c5-fcec-4318-b548-76ee54f2cb25 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:32.942292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-59c742c5-fcec-4318-b548-76ee54f2cb25 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:32.953270 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-59c742c5-fcec-4318-b548-76ee54f2cb25 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.172424 Aug 03 01:49:32.959334 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 323/644] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:32 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:32.972076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b5bba378-9637-4f98-9a81-ee47bfb9ffdb tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13611e50>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:33.171436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5bba378-9637-4f98-9a81-ee47bfb9ffdb tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:33.183770 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5bba378-9637-4f98-9a81-ee47bfb9ffdb tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:33.184608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5bba378-9637-4f98-9a81-ee47bfb9ffdb tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:33.185047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5bba378-9637-4f98-9a81-ee47bfb9ffdb tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:33.778212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=26,nova_api:UPDATE=12 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:33.888292 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0c9525b4-2c8c-4d11-9737-e57ad4fa15fc tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "DELETE /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77" status: 204 len: 0 microversion: 2.1 time: 1.146117 Aug 03 01:49:33.889385 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b5bba378-9637-4f98-9a81-ee47bfb9ffdb tempest-QuotasAdminTestJSON-301010965 tempest-QuotasAdminTestJSON-301010965-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/83116cb4b4aa40cc8807ba4915b4742d" status: 200 len: 329 microversion: 2.1 time: 0.928568 Aug 03 01:49:33.890108 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 322/645] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:32 2022] DELETE /compute/v2.1/images/8e7344e1-08c0-4d15-ba11-1d01b1bd0d77 => generated 0 bytes in 1149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:49:33.896997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1b264c1e-d03f-403c-a027-b4bba5b34a21 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:33.899754 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 324/646] 10.222.0.67 () {60 vars in 1263 bytes} [Wed Aug 3 01:49:32 2022] PUT /compute/v2.1/os-quota-sets/83116cb4b4aa40cc8807ba4915b4742d => generated 329 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:33.910829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1b264c1e-d03f-403c-a027-b4bba5b34a21 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:33.916233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-07b6aed2-dfa7-42e9-96d3-b65f4f9f60f2 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '.version_select at 0x7f5b13611160>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:33.936709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b264c1e-d03f-403c-a027-b4bba5b34a21 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:33.940615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b264c1e-d03f-403c-a027-b4bba5b34a21 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:33.941688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b264c1e-d03f-403c-a027-b4bba5b34a21 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:33.943854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b264c1e-d03f-403c-a027-b4bba5b34a21 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:33.988625 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-07b6aed2-dfa7-42e9-96d3-b65f4f9f60f2 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] HTTP exception thrown: Image not found. Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-07b6aed2-dfa7-42e9-96d3-b65f4f9f60f2 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Request method failure captured: Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df HTTP/1.1 Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPWFUJlsnJ1ple2jr05hs-O_UQqOi5t8qMsi0MoLvFV2iKQatV8Qb_Tcaf_3fpV5IZzGunH-ikN_kqhU8Uvb6ARvftnUzDAE2w6yjxEmH2TXh4Lk7W-oWiScCuDPWcjf05EsVO9SEg1mugEZIl7zj6vp6rl5LSw2tlUuQe1x6AtZ_Q Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: bf1b4aebbcd24c16b2f30966a762c819 Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesOneServerTestJSON-1488369923 Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:49:33.991158 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:49:33.992761 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bf1b4aebbcd24c16b2f30966a762c819", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf1b4aebbcd24c16b2f30966a762c819"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bf1b4aebbcd24c16b2f30966a762c819"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf1b4aebbcd24c16b2f30966a762c819"}]}] Aug 03 01:49:33.992761 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesOneServerTestJSON-1488369923 Aug 03 01:49:33.992761 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: bf1b4aebbcd24c16b2f30966a762c819 Aug 03 01:49:33.992761 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1488369923 Aug 03 01:49:33.992761 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesOneServerTestJSON-1488369923-project Aug 03 01:49:33.992761 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:49:33.992761 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:49:33.992761 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 8537e15eb8f24ee3a1e1d925bba2bc68 Aug 03 01:49:33.992761 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesOneServerTestJSON-1488369923-project Aug 03 01:49:33.992761 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:49:33.992761 n-d-826529-8 devstack@n-api.service[125941]: exception: Image not found. Aug 03 01:49:33.992761 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '3e82a91c-3e9c-4507-8c68-1af9c7ae08df'} Aug 03 01:49:33.992761 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3e82a91c-3e9c-4507-8c68-1af9c7ae08df to delete Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:33.993695 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3e82a91c-3e9c-4507-8c68-1af9c7ae08df could not be found. Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:33.995052 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:33.996536 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 01:49:33.996536 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 01:49:33.996536 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:49:33.996536 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:33.996536 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:33.996536 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:33.996536 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:33.996536 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:33.996536 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:33.996536 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:49:33.996536 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:49:33.996536 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:49:33.996536 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:34.000699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-07b6aed2-dfa7-42e9-96d3-b65f4f9f60f2 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Returning 404 to user: Image not found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:34.000699 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-07b6aed2-dfa7-42e9-96d3-b65f4f9f60f2 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "DELETE /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df" status: 404 len: 62 microversion: 2.1 time: 0.097132 Aug 03 01:49:34.001005 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 325/647] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:33 2022] DELETE /compute/v2.1/images/3e82a91c-3e9c-4507-8c68-1af9c7ae08df => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:49:34.018502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-88d2e722-765e-41d4-92a1-632db562125a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:34.019353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-88d2e722-765e-41d4-92a1-632db562125a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:34.040387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88d2e722-765e-41d4-92a1-632db562125a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:34.041013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88d2e722-765e-41d4-92a1-632db562125a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:34.042343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88d2e722-765e-41d4-92a1-632db562125a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:34.043046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88d2e722-765e-41d4-92a1-632db562125a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:34.255154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-88d2e722-765e-41d4-92a1-632db562125a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:34.266299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-88d2e722-765e-41d4-92a1-632db562125a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:34.271523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-88d2e722-765e-41d4-92a1-632db562125a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:34.287368 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-88d2e722-765e-41d4-92a1-632db562125a tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.281963 Aug 03 01:49:34.299508 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 326/648] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:34 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:34.310562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-554f948b-fa66-4730-a99e-fab34bb7ce0b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:34.311103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-554f948b-fa66-4730-a99e-fab34bb7ce0b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:34.326352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-554f948b-fa66-4730-a99e-fab34bb7ce0b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:34.326817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-554f948b-fa66-4730-a99e-fab34bb7ce0b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:34.327646 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-554f948b-fa66-4730-a99e-fab34bb7ce0b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:34.328089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-554f948b-fa66-4730-a99e-fab34bb7ce0b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:34.344805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:34.384949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-554f948b-fa66-4730-a99e-fab34bb7ce0b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:49:34.536051 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-554f948b-fa66-4730-a99e-fab34bb7ce0b tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 204 len: 0 microversion: 2.1 time: 0.235034 Aug 03 01:49:34.536952 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 327/649] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:49:34 2022] DELETE /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:49:34.562028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dcc635a8-56af-4d23-a66a-6725872f5ec0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:34.562752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dcc635a8-56af-4d23-a66a-6725872f5ec0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:34.575705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dcc635a8-56af-4d23-a66a-6725872f5ec0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:34.577225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dcc635a8-56af-4d23-a66a-6725872f5ec0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:34.578991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dcc635a8-56af-4d23-a66a-6725872f5ec0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:34.579718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dcc635a8-56af-4d23-a66a-6725872f5ec0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:34.930277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1b264c1e-d03f-403c-a027-b4bba5b34a21 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:34.939406 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1b264c1e-d03f-403c-a027-b4bba5b34a21 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1313 microversion: 2.1 time: 1.046927 Aug 03 01:49:34.943310 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 323/650] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:33 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1313 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:35.302181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dcc635a8-56af-4d23-a66a-6725872f5ec0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:35.313160 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dcc635a8-56af-4d23-a66a-6725872f5ec0 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1471 microversion: 2.1 time: 0.770541 Aug 03 01:49:35.317239 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 328/651] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:34 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1471 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:35.331996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-147b65f8-994e-447c-b020-47f9cdc692c0 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:35.333942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-147b65f8-994e-447c-b020-47f9cdc692c0 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:35.363761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-147b65f8-994e-447c-b020-47f9cdc692c0 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:35.366642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-147b65f8-994e-447c-b020-47f9cdc692c0 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:35.367983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-147b65f8-994e-447c-b020-47f9cdc692c0 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:35.369965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-147b65f8-994e-447c-b020-47f9cdc692c0 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:35.505827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-147b65f8-994e-447c-b020-47f9cdc692c0 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:35.527476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-147b65f8-994e-447c-b020-47f9cdc692c0 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:35.536850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-147b65f8-994e-447c-b020-47f9cdc692c0 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:35.550284 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-147b65f8-994e-447c-b020-47f9cdc692c0 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.239209 Aug 03 01:49:35.568991 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 324/652] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:35 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:35.977529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-67fce28c-eaa8-488e-aca0-515d31f1747a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:35.978494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-67fce28c-eaa8-488e-aca0-515d31f1747a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:35.992629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67fce28c-eaa8-488e-aca0-515d31f1747a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:35.996499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67fce28c-eaa8-488e-aca0-515d31f1747a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:35.997522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67fce28c-eaa8-488e-aca0-515d31f1747a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:36.002154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67fce28c-eaa8-488e-aca0-515d31f1747a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:36.336632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a506c625-7f4e-406d-948a-4cb720183aaf tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:36.337332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a506c625-7f4e-406d-948a-4cb720183aaf tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:36.387982 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a506c625-7f4e-406d-948a-4cb720183aaf tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:36.393585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a506c625-7f4e-406d-948a-4cb720183aaf tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:36.397002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a506c625-7f4e-406d-948a-4cb720183aaf tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:36.406791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a506c625-7f4e-406d-948a-4cb720183aaf tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:36.426338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:37.013946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-67fce28c-eaa8-488e-aca0-515d31f1747a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:37.028729 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-67fce28c-eaa8-488e-aca0-515d31f1747a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1313 microversion: 2.1 time: 1.068065 Aug 03 01:49:37.044936 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 329/653] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:35 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1313 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:37.060563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e7f0cfe2-802a-461d-99d3-a2d8d2307bb3 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:37.064681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e7f0cfe2-802a-461d-99d3-a2d8d2307bb3 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:37.073023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7f0cfe2-802a-461d-99d3-a2d8d2307bb3 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:37.073896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7f0cfe2-802a-461d-99d3-a2d8d2307bb3 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:37.076370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7f0cfe2-802a-461d-99d3-a2d8d2307bb3 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:37.076370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7f0cfe2-802a-461d-99d3-a2d8d2307bb3 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:37.439437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e7f0cfe2-802a-461d-99d3-a2d8d2307bb3 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:37.450010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e7f0cfe2-802a-461d-99d3-a2d8d2307bb3 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:37.451613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e7f0cfe2-802a-461d-99d3-a2d8d2307bb3 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:37.463102 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e7f0cfe2-802a-461d-99d3-a2d8d2307bb3 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1447 microversion: 2.75 time: 0.416993 Aug 03 01:49:37.467433 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 330/654] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:37 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1447 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:37.479107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-74c10611-ffa5-431a-8301-35050c3d7043 req-5879ad0d-c3ba-42bb-8af9-d4d5b8e57eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f490eab-9c88-441e-8768-ae1e5eed8093", "name": "network-vif-plugged", "status": "completed", "tag": "9f0663d7-6a0d-4d64-8ff5-d5196b0ca3bf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:37.504174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a506c625-7f4e-406d-948a-4cb720183aaf tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:37.537499 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a506c625-7f4e-406d-948a-4cb720183aaf tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1471 microversion: 2.1 time: 1.198952 Aug 03 01:49:37.539376 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 325/655] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:36 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1471 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:37.552312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-74c10611-ffa5-431a-8301-35050c3d7043 req-5879ad0d-c3ba-42bb-8af9-d4d5b8e57eb3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:37.552781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-74c10611-ffa5-431a-8301-35050c3d7043 req-5879ad0d-c3ba-42bb-8af9-d4d5b8e57eb3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:37.584275 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-74c10611-ffa5-431a-8301-35050c3d7043 req-5879ad0d-c3ba-42bb-8af9-d4d5b8e57eb3 service nova] Creating event network-vif-plugged:9f0663d7-6a0d-4d64-8ff5-d5196b0ca3bf for instance 9f490eab-9c88-441e-8768-ae1e5eed8093 on n-h2-826529-8 Aug 03 01:49:37.594342 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-74c10611-ffa5-431a-8301-35050c3d7043 req-5879ad0d-c3ba-42bb-8af9-d4d5b8e57eb3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125390 Aug 03 01:49:37.596833 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 331/656] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:38.049861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1f494def-32c8-4d03-8ebe-06651f31699d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:38.050487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1f494def-32c8-4d03-8ebe-06651f31699d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:38.064874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f494def-32c8-4d03-8ebe-06651f31699d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:38.067473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f494def-32c8-4d03-8ebe-06651f31699d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:38.069987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f494def-32c8-4d03-8ebe-06651f31699d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:38.071440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f494def-32c8-4d03-8ebe-06651f31699d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:38.499145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-030f69e5-89e0-4645-8d0c-f4c876ba2a5f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:38.500432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-030f69e5-89e0-4645-8d0c-f4c876ba2a5f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:38.517683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-030f69e5-89e0-4645-8d0c-f4c876ba2a5f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:38.518284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-030f69e5-89e0-4645-8d0c-f4c876ba2a5f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:38.519543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-030f69e5-89e0-4645-8d0c-f4c876ba2a5f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:38.520331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-030f69e5-89e0-4645-8d0c-f4c876ba2a5f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:38.690863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-030f69e5-89e0-4645-8d0c-f4c876ba2a5f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:38.709538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-030f69e5-89e0-4645-8d0c-f4c876ba2a5f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:38.711828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-030f69e5-89e0-4645-8d0c-f4c876ba2a5f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:38.725107 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-030f69e5-89e0-4645-8d0c-f4c876ba2a5f tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1453 microversion: 2.75 time: 0.230645 Aug 03 01:49:38.735561 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 332/657] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:38 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1453 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:38.750027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3b4151d2-de8b-4eaa-beeb-e38b9e61c345 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:38.750660 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3b4151d2-de8b-4eaa-beeb-e38b9e61c345 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:38.771589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b4151d2-de8b-4eaa-beeb-e38b9e61c345 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:38.772054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b4151d2-de8b-4eaa-beeb-e38b9e61c345 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:38.772865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b4151d2-de8b-4eaa-beeb-e38b9e61c345 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:38.773308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b4151d2-de8b-4eaa-beeb-e38b9e61c345 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:38.880550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:39.219250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3b4151d2-de8b-4eaa-beeb-e38b9e61c345 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8537e15eb8f24ee3a1e1d925bba2bc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1b4aebbcd24c16b2f30966a762c819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:39.234954 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3b4151d2-de8b-4eaa-beeb-e38b9e61c345 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 200 len: 1429 microversion: 2.1 time: 0.497741 Aug 03 01:49:39.237234 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 333/658] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:38 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 1429 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:39.371144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-45937502-e941-4f83-b981-6e0764d6d84e req-2af7a95c-6160-4137-9e9d-e787aa758d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6", "name": "network-vif-deleted", "tag": "d59c4745-6408-4d6f-a309-951c6fc953d9"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:39.396061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-45937502-e941-4f83-b981-6e0764d6d84e req-2af7a95c-6160-4137-9e9d-e787aa758d55 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:39.396702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-45937502-e941-4f83-b981-6e0764d6d84e req-2af7a95c-6160-4137-9e9d-e787aa758d55 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:39.400672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1f494def-32c8-4d03-8ebe-06651f31699d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:39.415327 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1f494def-32c8-4d03-8ebe-06651f31699d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1313 microversion: 2.1 time: 1.368620 Aug 03 01:49:39.415944 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 326/659] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:38 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1313 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:39.417004 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-45937502-e941-4f83-b981-6e0764d6d84e req-2af7a95c-6160-4137-9e9d-e787aa758d55 service nova] Creating event network-vif-deleted:d59c4745-6408-4d6f-a309-951c6fc953d9 for instance fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 on n-h2-826529-8 Aug 03 01:49:39.440830 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-45937502-e941-4f83-b981-6e0764d6d84e req-2af7a95c-6160-4137-9e9d-e787aa758d55 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073162 Aug 03 01:49:39.442074 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 334/660] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:39.667356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-5f9ba5c2-e2b3-4279-bcbd-b193f02734b6 req-10dd369b-4d62-413b-8deb-efcffd3f83e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6", "name": "network-vif-unplugged", "status": "completed", "tag": "d59c4745-6408-4d6f-a309-951c6fc953d9"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:39.690507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5f9ba5c2-e2b3-4279-bcbd-b193f02734b6 req-10dd369b-4d62-413b-8deb-efcffd3f83e1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:39.691286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5f9ba5c2-e2b3-4279-bcbd-b193f02734b6 req-10dd369b-4d62-413b-8deb-efcffd3f83e1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:39.712507 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-5f9ba5c2-e2b3-4279-bcbd-b193f02734b6 req-10dd369b-4d62-413b-8deb-efcffd3f83e1 service nova] Creating event network-vif-unplugged:d59c4745-6408-4d6f-a309-951c6fc953d9 for instance fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 on n-h2-826529-8 Aug 03 01:49:39.729353 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-5f9ba5c2-e2b3-4279-bcbd-b193f02734b6 req-10dd369b-4d62-413b-8deb-efcffd3f83e1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069428 Aug 03 01:49:39.730542 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 327/661] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:39.758030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9c6f1256-d569-4517-a137-f5d23869d103 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:39.760252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9c6f1256-d569-4517-a137-f5d23869d103 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:39.792425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c6f1256-d569-4517-a137-f5d23869d103 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:39.797194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c6f1256-d569-4517-a137-f5d23869d103 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:39.802169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c6f1256-d569-4517-a137-f5d23869d103 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:39.802713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c6f1256-d569-4517-a137-f5d23869d103 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:39.999740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-708bb813-6ee1-43bf-a933-1254051bad0a tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Action: 'update', calling method: .version_select at 0x7f5b1399c0d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:40.026528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9c6f1256-d569-4517-a137-f5d23869d103 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:40.046634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9c6f1256-d569-4517-a137-f5d23869d103 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:40.048597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9c6f1256-d569-4517-a137-f5d23869d103 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:40.074531 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9c6f1256-d569-4517-a137-f5d23869d103 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1453 microversion: 2.75 time: 0.321367 Aug 03 01:49:40.075162 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 328/662] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:39 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1453 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:40.131346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-708bb813-6ee1-43bf-a933-1254051bad0a tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:40.131849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-708bb813-6ee1-43bf-a933-1254051bad0a tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:40.132917 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-708bb813-6ee1-43bf-a933-1254051bad0a tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:40.133522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-708bb813-6ee1-43bf-a933-1254051bad0a tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:40.218364 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-708bb813-6ee1-43bf-a933-1254051bad0a tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/76be6ac2e6154646b3ef3b42b70c66d7" status: 200 len: 240 microversion: 2.36 time: 0.523137 Aug 03 01:49:40.227031 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 335/663] 10.222.0.67 () {62 vars in 1303 bytes} [Wed Aug 3 01:49:39 2022] PUT /compute/v2.1/os-quota-sets/76be6ac2e6154646b3ef3b42b70c66d7 => generated 240 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 01:49:40.235179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2806a8f2-e140-47d5-92e0-fc4fd7cafc6a tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Calling method '.version_select at 0x7f5b13a04700>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:40.260729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e25631b7-c5ce-4e87-ba05-cca11ee86033 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:40.262018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e25631b7-c5ce-4e87-ba05-cca11ee86033 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] [instance: fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:40.276513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e25631b7-c5ce-4e87-ba05-cca11ee86033 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:40.277034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e25631b7-c5ce-4e87-ba05-cca11ee86033 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:40.279804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e25631b7-c5ce-4e87-ba05-cca11ee86033 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:40.281609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e25631b7-c5ce-4e87-ba05-cca11ee86033 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:40.320330 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-e25631b7-c5ce-4e87-ba05-cca11ee86033 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] HTTP exception thrown: Instance fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 could not be found. Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e25631b7-c5ce-4e87-ba05-cca11ee86033 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Request method failure captured: Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 HTTP/1.1 Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPWFUJlsnJ1ple2jr05hs-O_UQqOi5t8qMsi0MoLvFV2iKQatV8Qb_Tcaf_3fpV5IZzGunH-ikN_kqhU8Uvb6ARvftnUzDAE2w6yjxEmH2TXh4Lk7W-oWiScCuDPWcjf05EsVO9SEg1mugEZIl7zj6vp6rl5LSw2tlUuQe1x6AtZ_Q Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: bf1b4aebbcd24c16b2f30966a762c819 Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesOneServerTestJSON-1488369923 Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:49:40.324620 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:49:40.325919 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bf1b4aebbcd24c16b2f30966a762c819", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf1b4aebbcd24c16b2f30966a762c819"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bf1b4aebbcd24c16b2f30966a762c819"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bf1b4aebbcd24c16b2f30966a762c819"}]}] Aug 03 01:49:40.325919 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesOneServerTestJSON-1488369923 Aug 03 01:49:40.325919 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: bf1b4aebbcd24c16b2f30966a762c819 Aug 03 01:49:40.325919 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1488369923 Aug 03 01:49:40.325919 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesOneServerTestJSON-1488369923-project Aug 03 01:49:40.325919 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:49:40.325919 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:49:40.325919 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 8537e15eb8f24ee3a1e1d925bba2bc68 Aug 03 01:49:40.325919 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesOneServerTestJSON-1488369923-project Aug 03 01:49:40.325919 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:49:40.325919 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 could not be found. Aug 03 01:49:40.325919 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6'} Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 could not be found. Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:40.326666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 could not be found. Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 could not be found. Aug 03 01:49:40.328957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:40.333448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e25631b7-c5ce-4e87-ba05-cca11ee86033 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] Returning 404 to user: Instance fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:40.335898 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e25631b7-c5ce-4e87-ba05-cca11ee86033 tempest-ImagesOneServerTestJSON-1488369923 tempest-ImagesOneServerTestJSON-1488369923-project] 10.222.0.67 "GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6" status: 404 len: 111 microversion: 2.1 time: 0.080499 Aug 03 01:49:40.338223 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 336/664] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:40 2022] GET /compute/v2.1/servers/fd00daaf-1d92-449c-8c80-1e1dcdf6a5d6 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 01:49:40.416930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2806a8f2-e140-47d5-92e0-fc4fd7cafc6a tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:40.417399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2806a8f2-e140-47d5-92e0-fc4fd7cafc6a tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:40.418225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2806a8f2-e140-47d5-92e0-fc4fd7cafc6a tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:40.418671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2806a8f2-e140-47d5-92e0-fc4fd7cafc6a tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:40.436633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d8ee2eac-fa1e-411a-8ba7-c22b324f55fb tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:40.437701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d8ee2eac-fa1e-411a-8ba7-c22b324f55fb tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:40.448965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8ee2eac-fa1e-411a-8ba7-c22b324f55fb tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:40.449526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8ee2eac-fa1e-411a-8ba7-c22b324f55fb tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:40.451496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8ee2eac-fa1e-411a-8ba7-c22b324f55fb tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:40.453256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8ee2eac-fa1e-411a-8ba7-c22b324f55fb tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:40.479019 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2806a8f2-e140-47d5-92e0-fc4fd7cafc6a tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/76be6ac2e6154646b3ef3b42b70c66d7/detail" status: 200 len: 672 microversion: 2.36 time: 0.234310 Aug 03 01:49:40.480326 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 329/665] 10.222.0.67 () {60 vars in 1304 bytes} [Wed Aug 3 01:49:40 2022] GET /compute/v2.1/os-quota-sets/76be6ac2e6154646b3ef3b42b70c66d7/detail => generated 672 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:49:40.767275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4a0ac669-2e68-48bb-a23b-ed71dd459db0 tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Action: 'update', calling method: .version_select at 0x7f5b13b125e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:40.951239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a0ac669-2e68-48bb-a23b-ed71dd459db0 tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:40.952677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a0ac669-2e68-48bb-a23b-ed71dd459db0 tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:40.953765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a0ac669-2e68-48bb-a23b-ed71dd459db0 tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:40.955272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a0ac669-2e68-48bb-a23b-ed71dd459db0 tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:40.998652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a0ac669-2e68-48bb-a23b-ed71dd459db0 tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:40.999627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a0ac669-2e68-48bb-a23b-ed71dd459db0 tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:41.001062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a0ac669-2e68-48bb-a23b-ed71dd459db0 tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:41.003011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a0ac669-2e68-48bb-a23b-ed71dd459db0 tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:41.140595 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4a0ac669-2e68-48bb-a23b-ed71dd459db0 tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/76be6ac2e6154646b3ef3b42b70c66d7?user_id=e4d6ff62b0414eb6a36baab463517511" status: 200 len: 240 microversion: 2.36 time: 0.382627 Aug 03 01:49:41.154426 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 330/666] 10.222.0.67 () {62 vars in 1384 bytes} [Wed Aug 3 01:49:40 2022] PUT /compute/v2.1/os-quota-sets/76be6ac2e6154646b3ef3b42b70c66d7?user_id=e4d6ff62b0414eb6a36baab463517511 => generated 240 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:49:41.160741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8013d098-5676-4d42-ab7b-e80bb9645341 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:41.169686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8013d098-5676-4d42-ab7b-e80bb9645341 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:41.180554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8013d098-5676-4d42-ab7b-e80bb9645341 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:41.181246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8013d098-5676-4d42-ab7b-e80bb9645341 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:41.182189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8013d098-5676-4d42-ab7b-e80bb9645341 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:41.182770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8013d098-5676-4d42-ab7b-e80bb9645341 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:41.520123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d8ee2eac-fa1e-411a-8ba7-c22b324f55fb tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:41.528834 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d8ee2eac-fa1e-411a-8ba7-c22b324f55fb tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1463 microversion: 2.1 time: 1.096430 Aug 03 01:49:41.529405 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 337/667] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:40 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1463 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:49:41.540436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c6a997b8-2779-4130-b52b-bd5ba0f85e4d tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] Calling method '.version_select at 0x7f5b138528b0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:41.922203 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c6a997b8-2779-4130-b52b-bd5ba0f85e4d tempest-QuotasAdminTestV236-1940308681 tempest-QuotasAdminTestV236-1940308681-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/76be6ac2e6154646b3ef3b42b70c66d7?user_id=e4d6ff62b0414eb6a36baab463517511" status: 200 len: 282 microversion: 2.36 time: 0.391707 Aug 03 01:49:41.927918 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 338/668] 10.222.0.67 () {60 vars in 1364 bytes} [Wed Aug 3 01:49:41 2022] GET /compute/v2.1/os-quota-sets/76be6ac2e6154646b3ef3b42b70c66d7?user_id=e4d6ff62b0414eb6a36baab463517511 => generated 282 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:49:41.941637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a5bbb004-5854-4d3c-9ee8-9460469f318b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:41.953497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a5bbb004-5854-4d3c-9ee8-9460469f318b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:41.978947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5bbb004-5854-4d3c-9ee8-9460469f318b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:41.979422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5bbb004-5854-4d3c-9ee8-9460469f318b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:41.992954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5bbb004-5854-4d3c-9ee8-9460469f318b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:41.993444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5bbb004-5854-4d3c-9ee8-9460469f318b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:42.257283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8013d098-5676-4d42-ab7b-e80bb9645341 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:42.284458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8013d098-5676-4d42-ab7b-e80bb9645341 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:42.288343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8013d098-5676-4d42-ab7b-e80bb9645341 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:42.309295 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8013d098-5676-4d42-ab7b-e80bb9645341 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1453 microversion: 2.75 time: 1.151116 Aug 03 01:49:42.339344 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 331/669] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:41 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1453 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:42.450325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a5bbb004-5854-4d3c-9ee8-9460469f318b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:42.458145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a5bbb004-5854-4d3c-9ee8-9460469f318b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Old instance type m1.heat2, new instance type m1.heat {{(pid=125941) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 01:49:42.481806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a5bbb004-5854-4d3c-9ee8-9460469f318b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:49:42.489237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a5bbb004-5854-4d3c-9ee8-9460469f318b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:49:42.489785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a5bbb004-5854-4d3c-9ee8-9460469f318b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:49:42.490204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a5bbb004-5854-4d3c-9ee8-9460469f318b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:49:42.490623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a5bbb004-5854-4d3c-9ee8-9460469f318b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:49:42.800609 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a5bbb004-5854-4d3c-9ee8-9460469f318b tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "POST /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093/action" status: 202 len: 0 microversion: 2.1 time: 0.870981 Aug 03 01:49:42.804777 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 339/670] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:49:41 2022] POST /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093/action => generated 0 bytes in 876 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:49:42.820963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fcf47fe2-708e-42b9-8ba9-9a5c97853408 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:42.822040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fcf47fe2-708e-42b9-8ba9-9a5c97853408 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:42.860117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcf47fe2-708e-42b9-8ba9-9a5c97853408 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:42.862364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcf47fe2-708e-42b9-8ba9-9a5c97853408 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:42.863554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcf47fe2-708e-42b9-8ba9-9a5c97853408 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:42.865699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcf47fe2-708e-42b9-8ba9-9a5c97853408 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:43.340712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-62d60881-0c6f-4da4-aee3-57d28c4ba8c9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:43.341563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-62d60881-0c6f-4da4-aee3-57d28c4ba8c9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:43.354996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62d60881-0c6f-4da4-aee3-57d28c4ba8c9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:43.361311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62d60881-0c6f-4da4-aee3-57d28c4ba8c9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:43.363665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62d60881-0c6f-4da4-aee3-57d28c4ba8c9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:43.365033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62d60881-0c6f-4da4-aee3-57d28c4ba8c9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:43.781142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-62d60881-0c6f-4da4-aee3-57d28c4ba8c9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:43.799253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-62d60881-0c6f-4da4-aee3-57d28c4ba8c9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:43.808416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-62d60881-0c6f-4da4-aee3-57d28c4ba8c9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:43.825234 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-62d60881-0c6f-4da4-aee3-57d28c4ba8c9 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1438 microversion: 2.75 time: 0.487473 Aug 03 01:49:43.825870 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 340/671] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:43 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1438 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:49:43.936385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fcf47fe2-708e-42b9-8ba9-9a5c97853408 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:43.947182 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fcf47fe2-708e-42b9-8ba9-9a5c97853408 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1472 microversion: 2.1 time: 1.141368 Aug 03 01:49:43.947830 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 332/672] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:42 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1472 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:44.528400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:44.532606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:44.560342 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:44.562416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:44.569859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:44.572359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:44.780226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:49:44.781154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:49:44.781890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:49:44.782745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:49:44.783587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:49:44.967231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:44.976485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-24d24a89-55fe-468d-93dc-7c6a276dcf71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:44.978023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-24d24a89-55fe-468d-93dc-7c6a276dcf71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:44.989875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:44.996123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-24d24a89-55fe-468d-93dc-7c6a276dcf71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:44.997267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-24d24a89-55fe-468d-93dc-7c6a276dcf71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:44.997582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:44.999274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:44.999730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:45.000464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-24d24a89-55fe-468d-93dc-7c6a276dcf71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:45.003164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-24d24a89-55fe-468d-93dc-7c6a276dcf71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:45.630306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lazy-loading 'services' on Instance uuid 12d08110-b059-4437-bd10-c2a7ecd926f9 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:49:45.759466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:45.846827 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f7bdaf08-76eb-4bbb-88f1-7ac5763c0d82 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9/action" status: 202 len: 1942 microversion: 2.75 time: 1.992907 Aug 03 01:49:45.848774 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 341/673] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 3 01:49:43 2022] POST /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9/action => generated 1942 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 03 01:49:45.919468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-24d24a89-55fe-468d-93dc-7c6a276dcf71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:45.929051 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-24d24a89-55fe-468d-93dc-7c6a276dcf71 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1472 microversion: 2.1 time: 0.959748 Aug 03 01:49:45.949761 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 333/674] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:44 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1472 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:49:46.015444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37ac6bb6-f1bc-4f3f-9874-459b373eac02 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Action: 'create', calling method: .version_select at 0x7f5b1359c310>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8W7mQ9bCwekEN9lbSTUIAPzV0B+ePx85kzJ/t2UWEUulha8YxhdrLvT/bcm10mlfJ78Sp+xlTKtFFNUpcj3LOwarQ72oznxpqNEpD7vGoz4zak/bfVH9LkBd1OCoRl2Q=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37ac6bb6-f1bc-4f3f-9874-459b373eac02 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Request method failure captured: Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 257 Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dQ54b47QFc31q3lzpEGZRTf73Bz23UkOzQoYr7Mzpz4u_7t05J3cVXCMbXPiioVy-DyOCY2FoEFIalqWeAwFhhYXEsgIMApILgBiKL87qggSGBtv7j9tfX_TTQV0Oq1NX2KCmaJ3ylOWWqvO0ik6ALqK3W-XalCJ07Wd3V5D_9HKcU Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:49:46.021000 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:49:46.022729 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_579e0ea3d3114bef8aaccab640f5e559", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}] Aug 03 01:49:46.022729 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:46.022729 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:49:46.022729 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:46.022729 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:49:46.022729 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:49:46.022729 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:49:46.022729 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7c7b8032e5a04973aa24876895b07990 Aug 03 01:49:46.022729 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:49:46.022729 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:49:46.022729 n-d-826529-8 devstack@n-api.service[125941]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8W7mQ9bCwekEN9lbSTUIAPzV0B+ePx85kzJ/t2UWEUulha8YxhdrLvT/bcm10mlfJ78Sp+xlTKtFFNUpcj3LOwarQ72oznxpqNEpD7vGoz4zak/bfVH9LkBd1OCoRl2Q=="}} Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8W7mQ9bCwekEN9lbSTUIAPzV0B+ePx85kzJ/t2UWEUulha8YxhdrLvT/bcm10mlfJ78Sp+xlTKtFFNUpcj3LOwarQ72oznxpqNEpD7vGoz4zak/bfVH9LkBd1OCoRl2Q=='}}} Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:46.023655 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:46.025186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 01:49:46.027058 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 01:49:46.028444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 03 01:49:46.028444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:46.031131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37ac6bb6-f1bc-4f3f-9874-459b373eac02 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:46.037853 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-37ac6bb6-f1bc-4f3f-9874-459b373eac02 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.186545 Aug 03 01:49:46.039144 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 342/675] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 01:49:45 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:49:46.056773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-10d810fc-8a5c-4f26-9c56-e8b0088cdbdd tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:46.059879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-10d810fc-8a5c-4f26-9c56-e8b0088cdbdd tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:46.077873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10d810fc-8a5c-4f26-9c56-e8b0088cdbdd tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:46.078857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10d810fc-8a5c-4f26-9c56-e8b0088cdbdd tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:46.080279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10d810fc-8a5c-4f26-9c56-e8b0088cdbdd tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:46.080906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10d810fc-8a5c-4f26-9c56-e8b0088cdbdd tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:46.219728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1397249993", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "8587fddf-9abd-4c52-98e3-97c18dcab027"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:46.368972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] validate_networks() for [('8587fddf-9abd-4c52-98e3-97c18dcab027', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:49:46.900363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-10d810fc-8a5c-4f26-9c56-e8b0088cdbdd tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lazy-loading 'services' on Instance uuid 12d08110-b059-4437-bd10-c2a7ecd926f9 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:49:46.982355 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-10d810fc-8a5c-4f26-9c56-e8b0088cdbdd tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1929 microversion: 2.75 time: 0.938982 Aug 03 01:49:46.982986 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 343/676] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:46 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1929 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:47.560420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-480ee668-9760-488b-bde2-3f92c86fb53f tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] Action: 'create', calling method: .version_select at 0x7f5b1342f550>, body: {"pool": null} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:49.213249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:49:49.214394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:49:49.215111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:49:49.215776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:49:49.216602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:49:49.228586 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:49.229369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:49.230450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:49.231150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:49.257431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Getting quotas for project 5f232cf4e61b4213b592b2a020961630. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:49:49.263178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Getting quotas for user dd2c77c8ab314584939f1f580d5a6d14 and project 5f232cf4e61b4213b592b2a020961630. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:49:49.277059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:49:49.283775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:49:49.354579 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9c41aa53-0216-4fd9-ba52-3d41ecf39a9a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.389613 Aug 03 01:49:49.362151 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 334/677] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:49:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:49:49.371554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-73a8ed46-f00b-4a13-8609-b16273b66028 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Action: 'create', calling method: .version_select at 0x7f5b13b45d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-599558906", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:49.386518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:49.404094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-73a8ed46-f00b-4a13-8609-b16273b66028 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Getting quotas for project 579e0ea3d3114bef8aaccab640f5e559. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:49:49.411701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-73a8ed46-f00b-4a13-8609-b16273b66028 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Getting quotas for user 7c7b8032e5a04973aa24876895b07990 and project 579e0ea3d3114bef8aaccab640f5e559. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:49:49.448774 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-73a8ed46-f00b-4a13-8609-b16273b66028 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-73a8ed46-f00b-4a13-8609-b16273b66028 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Request method failure captured: Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 2166 Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dQ54b47QFc31q3lzpEGZRTf73Bz23UkOzQoYr7Mzpz4u_7t05J3cVXCMbXPiioVy-DyOCY2FoEFIalqWeAwFhhYXEsgIMApILgBiKL87qggSGBtv7j9tfX_TTQV0Oq1NX2KCmaJ3ylOWWqvO0ik6ALqK3W-XalCJ07Wd3V5D_9HKcU Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_579e0ea3d3114bef8aaccab640f5e559", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}] Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7c7b8032e5a04973aa24876895b07990 Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-599558906", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:49:49.472316 n-d-826529-8 devstack@n-api.service[125942]: exception: Keypair data is invalid: failed to generate fingerprint Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-599558906', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:49.474719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-73a8ed46-f00b-4a13-8609-b16273b66028 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-73a8ed46-f00b-4a13-8609-b16273b66028 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.115530 Aug 03 01:49:49.478799 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 335/678] 10.222.0.67 () {60 vars in 1160 bytes} [Wed Aug 3 01:49:49 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 01:49:49.482452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b02d218b-7005-416c-997f-337828454e9f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:49.483178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b02d218b-7005-416c-997f-337828454e9f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:49.495899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b02d218b-7005-416c-997f-337828454e9f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:49.496348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b02d218b-7005-416c-997f-337828454e9f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:49.497247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b02d218b-7005-416c-997f-337828454e9f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:49.497686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b02d218b-7005-416c-997f-337828454e9f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:49.976950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b02d218b-7005-416c-997f-337828454e9f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:49.986547 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b02d218b-7005-416c-997f-337828454e9f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1472 microversion: 2.1 time: 0.506880 Aug 03 01:49:50.000061 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 336/679] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:49 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1472 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:50.011262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4342f397-f4b3-4c6e-b823-5d5b264018b0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:50.012169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4342f397-f4b3-4c6e-b823-5d5b264018b0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:50.020767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4342f397-f4b3-4c6e-b823-5d5b264018b0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:50.021438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4342f397-f4b3-4c6e-b823-5d5b264018b0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:50.022431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4342f397-f4b3-4c6e-b823-5d5b264018b0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:50.023166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4342f397-f4b3-4c6e-b823-5d5b264018b0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:50.146063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=13 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:50.232946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-4342f397-f4b3-4c6e-b823-5d5b264018b0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lazy-loading 'services' on Instance uuid 12d08110-b059-4437-bd10-c2a7ecd926f9 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:49:50.318127 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4342f397-f4b3-4c6e-b823-5d5b264018b0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1929 microversion: 2.75 time: 0.312728 Aug 03 01:49:50.319060 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 337/680] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:50 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1929 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:50.479720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1840307385", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "db14d09c-b745-4579-af9f-767661c49472"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:50.601270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] validate_networks() for [('db14d09c-b745-4579-af9f-767661c49472', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:49:51.840812 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-480ee668-9760-488b-bde2-3f92c86fb53f tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.850872 Aug 03 01:49:51.841586 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 344/681] 10.222.0.67 () {60 vars in 1170 bytes} [Wed Aug 3 01:49:46 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:51.847355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-46a83433-4d09-4fa3-8dbc-3138a3e4694e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:51.849778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-46a83433-4d09-4fa3-8dbc-3138a3e4694e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:51.864991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46a83433-4d09-4fa3-8dbc-3138a3e4694e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:51.866798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46a83433-4d09-4fa3-8dbc-3138a3e4694e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:51.867818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46a83433-4d09-4fa3-8dbc-3138a3e4694e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:51.871541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46a83433-4d09-4fa3-8dbc-3138a3e4694e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:52.137681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=96 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:52.249963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-46a83433-4d09-4fa3-8dbc-3138a3e4694e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:52.263556 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-46a83433-4d09-4fa3-8dbc-3138a3e4694e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1269 microversion: 2.1 time: 0.420724 Aug 03 01:49:52.274953 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 345/682] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:51 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1269 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:52.293650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-233bf8fe-be27-4592-ad34-003d166a6df3 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Action: 'create', calling method: .version_select at 0x7f5b13896820>, body: {"keypair": {"name": "tempest-keypair-801715465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK554GEprelYKFrS3dwDA4RgQ1V5H0fWfOlX7Qh4Etc0jQStN7oMmwuQMBJL3ZENiwOzKgum5UrcHbNIDiYEI/bgpC1buPgaK2bQSeUzmORC834jd3t54CtQbZwEEq8owQ=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:52.310866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:49:52.311441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:49:52.311837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:49:52.312255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:49:52.313557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:49:52.330084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:52.331652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:52.334581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:52.335346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:52.346830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-233bf8fe-be27-4592-ad34-003d166a6df3 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Getting quotas for project 579e0ea3d3114bef8aaccab640f5e559. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:49:52.363719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-233bf8fe-be27-4592-ad34-003d166a6df3 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Getting quotas for user 7c7b8032e5a04973aa24876895b07990 and project 579e0ea3d3114bef8aaccab640f5e559. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:49:52.374680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Getting quotas for project 162addf8f6634e7fa0a1f9c6004258d1. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:49:52.392629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Getting quotas for user 4cb821820bbb4d3a8c999e1dec6a06a4 and project 162addf8f6634e7fa0a1f9c6004258d1. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:49:52.411573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=94,nova_api:UPDATE=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:49:52.425819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:49:52.428497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:49:52.431893 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-233bf8fe-be27-4592-ad34-003d166a6df3 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.166292 Aug 03 01:49:52.433380 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 346/683] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 01:49:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:52.452628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0b814a68-3853-407f-902d-200c6270e16a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:52.454209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0b814a68-3853-407f-902d-200c6270e16a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:52.471761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b814a68-3853-407f-902d-200c6270e16a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:52.474314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b814a68-3853-407f-902d-200c6270e16a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:52.479181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b814a68-3853-407f-902d-200c6270e16a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:52.479916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b814a68-3853-407f-902d-200c6270e16a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:52.619599 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-44decd14-fd7b-414b-b73e-a3a7b094a8e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.299316 Aug 03 01:49:52.634624 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 338/684] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 01:49:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2315 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 01:49:52.641654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1fde8994-c39b-49ab-80f8-bba7b1ee86b3 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:52.643529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1fde8994-c39b-49ab-80f8-bba7b1ee86b3 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:52.653074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fde8994-c39b-49ab-80f8-bba7b1ee86b3 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:52.653874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fde8994-c39b-49ab-80f8-bba7b1ee86b3 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:52.655104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fde8994-c39b-49ab-80f8-bba7b1ee86b3 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:52.656026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fde8994-c39b-49ab-80f8-bba7b1ee86b3 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:52.879425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-1fde8994-c39b-49ab-80f8-bba7b1ee86b3 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lazy-loading 'services' on Instance uuid 12d08110-b059-4437-bd10-c2a7ecd926f9 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:49:52.932349 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1fde8994-c39b-49ab-80f8-bba7b1ee86b3 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1929 microversion: 2.75 time: 0.296233 Aug 03 01:49:52.959851 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 339/685] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:52 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1929 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:52.976000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-976c8b97-026c-452c-8ee4-5282808e4b3d tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] Action: 'create', calling method: .version_select at 0x7f5b13b123a0>, body: {"pool": null} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:53.266835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0b814a68-3853-407f-902d-200c6270e16a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:53.283473 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0b814a68-3853-407f-902d-200c6270e16a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1477 microversion: 2.1 time: 0.846119 Aug 03 01:49:53.284810 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 347/686] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:52 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1477 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:53.302551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-14d2f4dd-fa07-40f8-9476-79877d61a252 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Action: 'create', calling method: .version_select at 0x7f5b1355c5e0>, body: {"keypair": {"name": "tempest-keypair-801715465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHtGvXWqF8kmKw/OmzGmBbnyJHR02LIH9Pi17uLZofWt5E5lHyQq/o0t831Pncko7DRKqByvehs7p87FrLgWzsII4oXyCjdX+J9ImKxp9wo01lOz8MJXd7BP8UGVp0w0A=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:53.364363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-14d2f4dd-fa07-40f8-9476-79877d61a252 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Getting quotas for project 579e0ea3d3114bef8aaccab640f5e559. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:49:53.379123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-14d2f4dd-fa07-40f8-9476-79877d61a252 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Getting quotas for user 7c7b8032e5a04973aa24876895b07990 and project 579e0ea3d3114bef8aaccab640f5e559. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:49:53.442362 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-14d2f4dd-fa07-40f8-9476-79877d61a252 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] HTTP exception thrown: Key pair 'tempest-keypair-801715465' already exists. Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-14d2f4dd-fa07-40f8-9476-79877d61a252 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Request method failure captured: Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 272 Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dQ54b47QFc31q3lzpEGZRTf73Bz23UkOzQoYr7Mzpz4u_7t05J3cVXCMbXPiioVy-DyOCY2FoEFIalqWeAwFhhYXEsgIMApILgBiKL87qggSGBtv7j9tfX_TTQV0Oq1NX2KCmaJ3ylOWWqvO0ik6ALqK3W-XalCJ07Wd3V5D_9HKcU Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_579e0ea3d3114bef8aaccab640f5e559", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}] Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7c7b8032e5a04973aa24876895b07990 Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: {"keypair": {"name": "tempest-keypair-801715465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHtGvXWqF8kmKw/OmzGmBbnyJHR02LIH9Pi17uLZofWt5E5lHyQq/o0t831Pncko7DRKqByvehs7p87FrLgWzsII4oXyCjdX+J9ImKxp9wo01lOz8MJXd7BP8UGVp0w0A=="}} Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: exception: Key pair 'tempest-keypair-801715465' already exists. Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-801715465', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHtGvXWqF8kmKw/OmzGmBbnyJHR02LIH9Pi17uLZofWt5E5lHyQq/o0t831Pncko7DRKqByvehs7p87FrLgWzsII4oXyCjdX+J9ImKxp9wo01lOz8MJXd7BP8UGVp0w0A=='}}} Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result.read() Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '7c7b8032e5a04973aa24876895b07990-tempest-keypair-801715465' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 03 01:49:53.445797 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi session.flush() Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result.read() Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 03 01:49:53.450050 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '7c7b8032e5a04973aa24876895b07990-tempest-keypair-801715465' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 3, 1, 49, 53, 423576), 'updated_at': None, 'name': 'tempest-keypair-801715465', 'user_id': '7c7b8032e5a04973aa24876895b07990', 'fingerprint': 'a1:d6:1d:43:f0:76:e9:1b:84:72:67:7e:08:49:83:56', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHtGvXWqF8kmKw/OmzGmBbnyJHR02LIH9Pi17uLZofWt5E5lHyQq/o0t831Pncko7DRKqByvehs7p87FrLgWzsII4oXyCjdX+J9ImKxp9wo01lOz8MJXd7BP8UGVp0w0A==', 'type': 'ssh'}] Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6730, in import_key_pair Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi keypair.create() Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._create() Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-801715465' already exists. Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 03 01:49:53.456522 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-801715465' already exists. Aug 03 01:49:53.465729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:53.465729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:53.465729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:53.465729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:53.465729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:53.465729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:53.465729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:49:53.465729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:49:53.465729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-801715465' already exists. Aug 03 01:49:53.465729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:53.465729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-14d2f4dd-fa07-40f8-9476-79877d61a252 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Returning 409 to user: Key pair 'tempest-keypair-801715465' already exists. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:53.465729 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-14d2f4dd-fa07-40f8-9476-79877d61a252 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.172366 Aug 03 01:49:53.465729 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 348/687] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 01:49:53 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:49:53.476105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b959a5c1-944d-47f6-adcd-4c4b8e4d4e63 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:53.477005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b959a5c1-944d-47f6-adcd-4c4b8e4d4e63 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:53.871418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b959a5c1-944d-47f6-adcd-4c4b8e4d4e63 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:53.883579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b959a5c1-944d-47f6-adcd-4c4b8e4d4e63 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:53.908729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b959a5c1-944d-47f6-adcd-4c4b8e4d4e63 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:53.911990 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b959a5c1-944d-47f6-adcd-4c4b8e4d4e63 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1262 microversion: 2.25 time: 0.442840 Aug 03 01:49:53.923426 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 349/688] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:53 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1262 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:53.950120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-570adee3-9194-4654-ad87-144641535797 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:53.954298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-570adee3-9194-4654-ad87-144641535797 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:53.977349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-570adee3-9194-4654-ad87-144641535797 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:53.984324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-570adee3-9194-4654-ad87-144641535797 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:53.987835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-570adee3-9194-4654-ad87-144641535797 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:53.990130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-570adee3-9194-4654-ad87-144641535797 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:54.397302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-570adee3-9194-4654-ad87-144641535797 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:54.412213 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-570adee3-9194-4654-ad87-144641535797 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1311 microversion: 2.1 time: 0.487453 Aug 03 01:49:54.415340 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 350/689] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:53 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1311 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:54.423556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e9d0714-db76-4282-8128-617ae73ac6f9 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Calling method '.version_select at 0x7f5b13611940>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:54.502185 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e9d0714-db76-4282-8128-617ae73ac6f9 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-801715465" status: 202 len: 0 microversion: 2.1 time: 0.082195 Aug 03 01:49:54.503229 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 351/690] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 3 01:49:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-801715465 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:49:54.507967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2f47536-3b92-4790-bc9f-fbf7fad0dc0e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:54.508592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c2f47536-3b92-4790-bc9f-fbf7fad0dc0e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:54.521701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2f47536-3b92-4790-bc9f-fbf7fad0dc0e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:54.534858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2f47536-3b92-4790-bc9f-fbf7fad0dc0e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:54.536584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2f47536-3b92-4790-bc9f-fbf7fad0dc0e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:54.537207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2f47536-3b92-4790-bc9f-fbf7fad0dc0e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:54.813991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-c2f47536-3b92-4790-bc9f-fbf7fad0dc0e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lazy-loading 'services' on Instance uuid 12d08110-b059-4437-bd10-c2a7ecd926f9 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:49:54.872052 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c2f47536-3b92-4790-bc9f-fbf7fad0dc0e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1929 microversion: 2.75 time: 0.367632 Aug 03 01:49:54.876220 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 352/691] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:54 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1929 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:54.886586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1fec422c-effa-4bcb-8cd4-5f9081efd851 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:54.890533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1fec422c-effa-4bcb-8cd4-5f9081efd851 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:54.905656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fec422c-effa-4bcb-8cd4-5f9081efd851 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:54.912270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fec422c-effa-4bcb-8cd4-5f9081efd851 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:54.913679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fec422c-effa-4bcb-8cd4-5f9081efd851 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:54.914384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fec422c-effa-4bcb-8cd4-5f9081efd851 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:55.389587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1fec422c-effa-4bcb-8cd4-5f9081efd851 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:55.398142 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1fec422c-effa-4bcb-8cd4-5f9081efd851 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1477 microversion: 2.1 time: 0.520548 Aug 03 01:49:55.402622 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 353/692] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:54 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1477 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:55.420151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4b1e1fe-0dc2-46a2-adeb-8c77a0ab0b09 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Action: 'create', calling method: .version_select at 0x7f5b136c78b0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtnjAJWred9ObiVO2CJ6ypi/LdSygBV0OGdzcBjXr+WePftULkFbv31mMz/uszoAC1LL6DH4paABwbZZ5kTSC+tog7x4PyLRZugua3/oUeo5oV8B1HVzrb1kGqQJ2fDlg=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4b1e1fe-0dc2-46a2-adeb-8c77a0ab0b09 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Request method failure captured: Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 247 Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dQ54b47QFc31q3lzpEGZRTf73Bz23UkOzQoYr7Mzpz4u_7t05J3cVXCMbXPiioVy-DyOCY2FoEFIalqWeAwFhhYXEsgIMApILgBiKL87qggSGBtv7j9tfX_TTQV0Oq1NX2KCmaJ3ylOWWqvO0ik6ALqK3W-XalCJ07Wd3V5D_9HKcU Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_579e0ea3d3114bef8aaccab640f5e559", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}] Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7c7b8032e5a04973aa24876895b07990 Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtnjAJWred9ObiVO2CJ6ypi/LdSygBV0OGdzcBjXr+WePftULkFbv31mMz/uszoAC1LL6DH4paABwbZZ5kTSC+tog7x4PyLRZugua3/oUeo5oV8B1HVzrb1kGqQJ2fDlg=="}} Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtnjAJWred9ObiVO2CJ6ypi/LdSygBV0OGdzcBjXr+WePftULkFbv31mMz/uszoAC1LL6DH4paABwbZZ5kTSC+tog7x4PyLRZugua3/oUeo5oV8B1HVzrb1kGqQJ2fDlg=='}}} Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi '' Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 01:49:55.444104 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4b1e1fe-0dc2-46a2-adeb-8c77a0ab0b09 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f4b1e1fe-0dc2-46a2-adeb-8c77a0ab0b09 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.029502 Aug 03 01:49:55.450230 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 354/693] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 01:49:55 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:49:55.451632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-07abc260-cca3-445a-bb2d-a2c8eaffc6c6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:55.452044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-07abc260-cca3-445a-bb2d-a2c8eaffc6c6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:55.474744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-07abc260-cca3-445a-bb2d-a2c8eaffc6c6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:55.475181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-07abc260-cca3-445a-bb2d-a2c8eaffc6c6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:55.476219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-07abc260-cca3-445a-bb2d-a2c8eaffc6c6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:55.476679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-07abc260-cca3-445a-bb2d-a2c8eaffc6c6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:55.747378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-07abc260-cca3-445a-bb2d-a2c8eaffc6c6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:55.759119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-07abc260-cca3-445a-bb2d-a2c8eaffc6c6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:55.765004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-07abc260-cca3-445a-bb2d-a2c8eaffc6c6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:55.771475 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-07abc260-cca3-445a-bb2d-a2c8eaffc6c6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1320 microversion: 2.25 time: 0.323752 Aug 03 01:49:55.772942 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 355/694] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:55 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1320 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:55.784989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-051a571e-8176-48bc-9e23-27bee47ecd16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:55.785810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-051a571e-8176-48bc-9e23-27bee47ecd16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:55.800499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-051a571e-8176-48bc-9e23-27bee47ecd16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:55.802681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-051a571e-8176-48bc-9e23-27bee47ecd16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:55.807036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-051a571e-8176-48bc-9e23-27bee47ecd16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:55.807734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-051a571e-8176-48bc-9e23-27bee47ecd16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:56.249411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-051a571e-8176-48bc-9e23-27bee47ecd16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:56.263686 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-051a571e-8176-48bc-9e23-27bee47ecd16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1311 microversion: 2.1 time: 0.489451 Aug 03 01:49:56.264507 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 356/695] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:55 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1311 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:56.285223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-073d8cbd-4c34-4466-a5b1-ae3a78f999a3 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Action: 'create', calling method: .version_select at 0x7f5b13611e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-973888658", "public_key": " "}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:56.313992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-073d8cbd-4c34-4466-a5b1-ae3a78f999a3 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Getting quotas for project 579e0ea3d3114bef8aaccab640f5e559. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:49:56.319415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-073d8cbd-4c34-4466-a5b1-ae3a78f999a3 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Getting quotas for user 7c7b8032e5a04973aa24876895b07990 and project 579e0ea3d3114bef8aaccab640f5e559. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:49:56.395251 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-073d8cbd-4c34-4466-a5b1-ae3a78f999a3 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-073d8cbd-4c34-4466-a5b1-ae3a78f999a3 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Request method failure captured: Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 94 Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dQ54b47QFc31q3lzpEGZRTf73Bz23UkOzQoYr7Mzpz4u_7t05J3cVXCMbXPiioVy-DyOCY2FoEFIalqWeAwFhhYXEsgIMApILgBiKL87qggSGBtv7j9tfX_TTQV0Oq1NX2KCmaJ3ylOWWqvO0ik6ALqK3W-XalCJ07Wd3V5D_9HKcU Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_579e0ea3d3114bef8aaccab640f5e559", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}] Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7c7b8032e5a04973aa24876895b07990 Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-973888658", "public_key": " "}} Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: exception: Keypair data is invalid: failed to generate fingerprint Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-973888658', 'public_key': ' '}}} Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:56.404578 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 03 01:49:56.414804 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:56.422072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-073d8cbd-4c34-4466-a5b1-ae3a78f999a3 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:56.422072 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-073d8cbd-4c34-4466-a5b1-ae3a78f999a3 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.149564 Aug 03 01:49:56.422072 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 357/696] 10.222.0.67 () {60 vars in 1158 bytes} [Wed Aug 3 01:49:56 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 01:49:56.439087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-76345994-2ba1-46e1-813f-ced618230f00 req-df3cfa80-fe7d-4381-a583-b04851302785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6607345-8b9f-47e7-8686-65443ffc6cde", "tag": "27843825-da5f-416a-883d-1724fb6835b3"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:56.467606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-76345994-2ba1-46e1-813f-ced618230f00 req-df3cfa80-fe7d-4381-a583-b04851302785 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:56.469565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-76345994-2ba1-46e1-813f-ced618230f00 req-df3cfa80-fe7d-4381-a583-b04851302785 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:56.483308 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-76345994-2ba1-46e1-813f-ced618230f00 req-df3cfa80-fe7d-4381-a583-b04851302785 service nova] Creating event network-changed:27843825-da5f-416a-883d-1724fb6835b3 for instance d6607345-8b9f-47e7-8686-65443ffc6cde on n-h2-826529-8 Aug 03 01:49:56.490505 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-76345994-2ba1-46e1-813f-ced618230f00 req-df3cfa80-fe7d-4381-a583-b04851302785 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057641 Aug 03 01:49:56.491438 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 358/697] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:56.496682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e4810c20-c4ff-4438-b412-8f69014427b1 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:56.497394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e4810c20-c4ff-4438-b412-8f69014427b1 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:56.506501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4810c20-c4ff-4438-b412-8f69014427b1 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:56.507028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4810c20-c4ff-4438-b412-8f69014427b1 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:56.507816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4810c20-c4ff-4438-b412-8f69014427b1 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:56.508784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4810c20-c4ff-4438-b412-8f69014427b1 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:57.208670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-e4810c20-c4ff-4438-b412-8f69014427b1 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lazy-loading 'services' on Instance uuid 12d08110-b059-4437-bd10-c2a7ecd926f9 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:49:57.257153 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e4810c20-c4ff-4438-b412-8f69014427b1 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1929 microversion: 2.75 time: 0.764482 Aug 03 01:49:57.257753 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 359/698] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:56 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1929 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:57.266758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed83e800-79ab-423e-bd9d-70312178a414 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:57.267417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ed83e800-79ab-423e-bd9d-70312178a414 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:57.290868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed83e800-79ab-423e-bd9d-70312178a414 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:57.291088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed83e800-79ab-423e-bd9d-70312178a414 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:57.293231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed83e800-79ab-423e-bd9d-70312178a414 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:57.294606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed83e800-79ab-423e-bd9d-70312178a414 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:57.876405 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-976c8b97-026c-452c-8ee4-5282808e4b3d tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.913589 Aug 03 01:49:57.888155 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 340/699] 10.222.0.67 () {60 vars in 1170 bytes} [Wed Aug 3 01:49:52 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:49:57.894537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5945aaea-ab23-4653-9fe9-bb279e4abe16 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Action: 'create', calling method: .version_select at 0x7f5b13906ca0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1UtIZCx4qL66TSUl4VU018HSXA8uKJbJuaw2bo/38K3NGi6cduwPwOaBK2FOe9hRngdDhW5dHwU2hJlOdpSwGDSQYKKF9ocmJRUYU4hF3Mn46nEIagq6ZiQ4q6TqzXRg=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5945aaea-ab23-4653-9fe9-bb279e4abe16 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Request method failure captured: Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 507 Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dQ54b47QFc31q3lzpEGZRTf73Bz23UkOzQoYr7Mzpz4u_7t05J3cVXCMbXPiioVy-DyOCY2FoEFIalqWeAwFhhYXEsgIMApILgBiKL87qggSGBtv7j9tfX_TTQV0Oq1NX2KCmaJ3ylOWWqvO0ik6ALqK3W-XalCJ07Wd3V5D_9HKcU Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_579e0ea3d3114bef8aaccab640f5e559", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}] Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7c7b8032e5a04973aa24876895b07990 Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1UtIZCx4qL66TSUl4VU018HSXA8uKJbJuaw2bo/38K3NGi6cduwPwOaBK2FOe9hRngdDhW5dHwU2hJlOdpSwGDSQYKKF9ocmJRUYU4hF3Mn46nEIagq6ZiQ4q6TqzXRg=="}} Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1UtIZCx4qL66TSUl4VU018HSXA8uKJbJuaw2bo/38K3NGi6cduwPwOaBK2FOe9hRngdDhW5dHwU2hJlOdpSwGDSQYKKF9ocmJRUYU4hF3Mn46nEIagq6ZiQ4q6TqzXRg=='}}} Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 03 01:49:57.905239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 03 01:49:57.909221 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:49:57.913125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5945aaea-ab23-4653-9fe9-bb279e4abe16 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:57.914083 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5945aaea-ab23-4653-9fe9-bb279e4abe16 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.024350 Aug 03 01:49:57.914801 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 341/700] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 01:49:57 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:49:57.924465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-12a1b543-88bd-4b0f-b749-e42c075c4f4a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:57.925329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-12a1b543-88bd-4b0f-b749-e42c075c4f4a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:57.931978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ed83e800-79ab-423e-bd9d-70312178a414 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:57.933885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12a1b543-88bd-4b0f-b749-e42c075c4f4a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:57.934427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12a1b543-88bd-4b0f-b749-e42c075c4f4a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:57.936654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12a1b543-88bd-4b0f-b749-e42c075c4f4a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:57.940141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12a1b543-88bd-4b0f-b749-e42c075c4f4a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:57.942678 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed83e800-79ab-423e-bd9d-70312178a414 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1477 microversion: 2.1 time: 0.680803 Aug 03 01:49:57.954930 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 360/701] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:57 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1477 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:57.954930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e399108f-7e7c-4a81-aada-2e9b9329ba11 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:49:57.954930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e399108f-7e7c-4a81-aada-2e9b9329ba11 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:49:57.972944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e399108f-7e7c-4a81-aada-2e9b9329ba11 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:57.973410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e399108f-7e7c-4a81-aada-2e9b9329ba11 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:57.974220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e399108f-7e7c-4a81-aada-2e9b9329ba11 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:49:57.974661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e399108f-7e7c-4a81-aada-2e9b9329ba11 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:49:58.259064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-12a1b543-88bd-4b0f-b749-e42c075c4f4a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:58.270043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-12a1b543-88bd-4b0f-b749-e42c075c4f4a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:58.276916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-12a1b543-88bd-4b0f-b749-e42c075c4f4a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:58.283335 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-12a1b543-88bd-4b0f-b749-e42c075c4f4a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1362 microversion: 2.25 time: 0.363267 Aug 03 01:49:58.284255 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 342/702] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:49:57 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:49:58.289273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-903992a0-5b08-4f56-baa3-a4e5077329dc tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] Action: 'create', calling method: .version_select at 0x7f5b13906790>, body: {"pool": null} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:58.318807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e399108f-7e7c-4a81-aada-2e9b9329ba11 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:49:58.326833 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e399108f-7e7c-4a81-aada-2e9b9329ba11 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1311 microversion: 2.1 time: 0.379656 Aug 03 01:49:58.340070 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 361/703] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:49:57 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1311 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:49:58.345820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c43b3ba4-be77-43a3-bff2-b205e4bede17 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Action: 'create', calling method: .version_select at 0x7f5b138965e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-361755109", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:49:58.381213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-c43b3ba4-be77-43a3-bff2-b205e4bede17 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Getting quotas for project 579e0ea3d3114bef8aaccab640f5e559. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:49:58.385805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-c43b3ba4-be77-43a3-bff2-b205e4bede17 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Getting quotas for user 7c7b8032e5a04973aa24876895b07990 and project 579e0ea3d3114bef8aaccab640f5e559. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:49:58.414832 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-c43b3ba4-be77-43a3-bff2-b205e4bede17 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c43b3ba4-be77-43a3-bff2-b205e4bede17 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Request method failure captured: Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 117 Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dQ54b47QFc31q3lzpEGZRTf73Bz23UkOzQoYr7Mzpz4u_7t05J3cVXCMbXPiioVy-DyOCY2FoEFIalqWeAwFhhYXEsgIMApILgBiKL87qggSGBtv7j9tfX_TTQV0Oq1NX2KCmaJ3ylOWWqvO0ik6ALqK3W-XalCJ07Wd3V5D_9HKcU Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_579e0ea3d3114bef8aaccab640f5e559", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}] Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7c7b8032e5a04973aa24876895b07990 Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-361755109", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: exception: Keypair data is invalid: failed to generate fingerprint Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-361755109', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 03 01:49:58.429355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 03 01:49:58.433821 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:49:58.436988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c43b3ba4-be77-43a3-bff2-b205e4bede17 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:49:58.438793 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c43b3ba4-be77-43a3-bff2-b205e4bede17 tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.097189 Aug 03 01:49:58.439586 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 362/704] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 01:49:58 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 01:49:58.570581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f8c80c0b-2df8-460a-9755-6c150fbbb574 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] Action: 'create', calling method: .version_select at 0x7f5b138b7c10>, body: {"pool": null} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:00.633376 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-903992a0-5b08-4f56-baa3-a4e5077329dc tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.347665 Aug 03 01:50:00.633974 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 343/705] 10.222.0.67 () {60 vars in 1170 bytes} [Wed Aug 3 01:49:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:00.641226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-e07de028-c902-48b3-8892-ec33750f5cca req-24862e43-62fe-43ce-91e3-92911d91b74d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb726272-286a-410e-8911-d328476b7755", "tag": "1fa2be26-8348-4842-ada3-bc3a43cd46ee"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:00.652997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e07de028-c902-48b3-8892-ec33750f5cca req-24862e43-62fe-43ce-91e3-92911d91b74d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:00.653635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e07de028-c902-48b3-8892-ec33750f5cca req-24862e43-62fe-43ce-91e3-92911d91b74d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:00.666057 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e07de028-c902-48b3-8892-ec33750f5cca req-24862e43-62fe-43ce-91e3-92911d91b74d service nova] Creating event network-changed:1fa2be26-8348-4842-ada3-bc3a43cd46ee for instance cb726272-286a-410e-8911-d328476b7755 on n-h1-826529-8 Aug 03 01:50:00.673535 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-e07de028-c902-48b3-8892-ec33750f5cca req-24862e43-62fe-43ce-91e3-92911d91b74d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036676 Aug 03 01:50:00.674494 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 344/706] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:00.679763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0504cc01-4439-4113-a7f3-14974a032e9b tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:00.680468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0504cc01-4439-4113-a7f3-14974a032e9b tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:00.687169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0504cc01-4439-4113-a7f3-14974a032e9b tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:00.688871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0504cc01-4439-4113-a7f3-14974a032e9b tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:00.689709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0504cc01-4439-4113-a7f3-14974a032e9b tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:00.690157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0504cc01-4439-4113-a7f3-14974a032e9b tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:00.955488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-0504cc01-4439-4113-a7f3-14974a032e9b tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lazy-loading 'services' on Instance uuid 12d08110-b059-4437-bd10-c2a7ecd926f9 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:50:00.976010 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0504cc01-4439-4113-a7f3-14974a032e9b tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1929 microversion: 2.75 time: 0.300143 Aug 03 01:50:00.976895 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 345/707] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:00 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1929 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:00.991226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cb696a2f-b87c-4c4c-9500-44a99a14f85c tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Calling method '.version_select at 0x7f5b13906820>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:01.004825 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-cb696a2f-b87c-4c4c-9500-44a99a14f85c tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1460947196 not found for user 7c7b8032e5a04973aa24876895b07990 Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cb696a2f-b87c-4c4c-9500-44a99a14f85c tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Request method failure captured: Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1460947196 HTTP/1.1 Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dQ54b47QFc31q3lzpEGZRTf73Bz23UkOzQoYr7Mzpz4u_7t05J3cVXCMbXPiioVy-DyOCY2FoEFIalqWeAwFhhYXEsgIMApILgBiKL87qggSGBtv7j9tfX_TTQV0Oq1NX2KCmaJ3ylOWWqvO0ik6ALqK3W-XalCJ07Wd3V5D_9HKcU Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_579e0ea3d3114bef8aaccab640f5e559", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/579e0ea3d3114bef8aaccab640f5e559"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/579e0ea3d3114bef8aaccab640f5e559"}]}] Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 579e0ea3d3114bef8aaccab640f5e559 Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1555440832 Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7c7b8032e5a04973aa24876895b07990 Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1555440832-project Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: exception: Keypair tempest-keypair-non-existent-1460947196 not found for user 7c7b8032e5a04973aa24876895b07990 Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'tempest-keypair-non-existent-1460947196'} Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6814, in delete_key_pair Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6835, in get_key_pair Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1460947196 not found for user 7c7b8032e5a04973aa24876895b07990 Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:01.006930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1460947196 not found for user 7c7b8032e5a04973aa24876895b07990 Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1460947196 not found for user 7c7b8032e5a04973aa24876895b07990 Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cb696a2f-b87c-4c4c-9500-44a99a14f85c tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1460947196 not found for user 7c7b8032e5a04973aa24876895b07990 {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:50:01.011157 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cb696a2f-b87c-4c4c-9500-44a99a14f85c tempest-KeyPairsNegativeTestJSON-1555440832 tempest-KeyPairsNegativeTestJSON-1555440832-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1460947196" status: 404 len: 145 microversion: 2.1 time: 0.030406 Aug 03 01:50:01.014449 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 346/708] 10.222.0.67 () {58 vars in 1260 bytes} [Wed Aug 3 01:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1460947196 => generated 145 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:50:01.020556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-26be4d2d-2cb1-419c-a7da-b5a538aad449 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:01.022121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-26be4d2d-2cb1-419c-a7da-b5a538aad449 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:01.028601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26be4d2d-2cb1-419c-a7da-b5a538aad449 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:01.029058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26be4d2d-2cb1-419c-a7da-b5a538aad449 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:01.029849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26be4d2d-2cb1-419c-a7da-b5a538aad449 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:01.030293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26be4d2d-2cb1-419c-a7da-b5a538aad449 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:01.321340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-26be4d2d-2cb1-419c-a7da-b5a538aad449 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:01.333318 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-26be4d2d-2cb1-419c-a7da-b5a538aad449 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1477 microversion: 2.1 time: 0.317535 Aug 03 01:50:01.334183 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 347/709] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:01 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1477 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:01.339768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6dd3332e-bbed-49c3-b461-2198600d14ae tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:01.340847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6dd3332e-bbed-49c3-b461-2198600d14ae tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:01.355387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dd3332e-bbed-49c3-b461-2198600d14ae tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:01.357750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dd3332e-bbed-49c3-b461-2198600d14ae tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:01.360219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dd3332e-bbed-49c3-b461-2198600d14ae tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:01.362686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dd3332e-bbed-49c3-b461-2198600d14ae tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:01.414673 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f8c80c0b-2df8-460a-9755-6c150fbbb574 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.969599 Aug 03 01:50:01.416152 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 363/710] 10.222.0.67 () {60 vars in 1170 bytes} [Wed Aug 3 01:49:58 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:01.428194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2ed00bfd-c93a-4599-b702-81e44082956e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:01.429321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2ed00bfd-c93a-4599-b702-81e44082956e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:01.440706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ed00bfd-c93a-4599-b702-81e44082956e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:01.441170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ed00bfd-c93a-4599-b702-81e44082956e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:01.441961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ed00bfd-c93a-4599-b702-81e44082956e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:01.442642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ed00bfd-c93a-4599-b702-81e44082956e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:01.650866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6dd3332e-bbed-49c3-b461-2198600d14ae tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:01.662193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6dd3332e-bbed-49c3-b461-2198600d14ae tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:01.664051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2ed00bfd-c93a-4599-b702-81e44082956e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:01.664473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6dd3332e-bbed-49c3-b461-2198600d14ae tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:01.666015 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6dd3332e-bbed-49c3-b461-2198600d14ae tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1362 microversion: 2.25 time: 0.330535 Aug 03 01:50:01.666994 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 348/711] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:01 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:01.677478 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2ed00bfd-c93a-4599-b702-81e44082956e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1311 microversion: 2.1 time: 0.257833 Aug 03 01:50:01.690297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b4eaef88-b920-4e4c-b59c-145c602585b3 tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] Action: 'create', calling method: .version_select at 0x7f5b13918670>, body: {"pool": null} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:01.695946 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 364/712] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:01 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1311 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:01.701400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-40d69f32-3ed1-4d85-9a08-5fab04928a82 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] Calling method '.version_select at 0x7f5b1399cca0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:02.091583 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-40d69f32-3ed1-4d85-9a08-5fab04928a82 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips/64683d6f-00dd-4ccb-b514-8e7fe77c8ed8" status: 200 len: 141 microversion: 2.1 time: 0.393838 Aug 03 01:50:02.092598 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 365/713] 10.222.0.67 () {58 vars in 1260 bytes} [Wed Aug 3 01:50:01 2022] GET /compute/v2.1/os-floating-ips/64683d6f-00dd-4ccb-b514-8e7fe77c8ed8 => generated 141 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:02.107993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a9e0804b-58fd-4acb-b556-943134f79436 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:02.108601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a9e0804b-58fd-4acb-b556-943134f79436 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:02.118040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9e0804b-58fd-4acb-b556-943134f79436 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:02.118680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9e0804b-58fd-4acb-b556-943134f79436 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:02.120463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9e0804b-58fd-4acb-b556-943134f79436 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:02.121074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9e0804b-58fd-4acb-b556-943134f79436 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:02.293516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-a9e0804b-58fd-4acb-b556-943134f79436 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lazy-loading 'services' on Instance uuid 12d08110-b059-4437-bd10-c2a7ecd926f9 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:50:02.331086 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a9e0804b-58fd-4acb-b556-943134f79436 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1929 microversion: 2.75 time: 0.228316 Aug 03 01:50:02.331683 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 366/714] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:02 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1929 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:02.338961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-151efc39-a628-4614-a75c-d3338bfb2d32 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] Calling method '.version_select at 0x7f5b13829550>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:02.353224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=11 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:02.415317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=52 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:02.684296 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-151efc39-a628-4614-a75c-d3338bfb2d32 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.350489 Aug 03 01:50:02.685518 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 367/715] 10.222.0.67 () {58 vars in 1149 bytes} [Wed Aug 3 01:50:02 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:02.706306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-285f92ef-b98b-4a7a-9715-4fad63ae561a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:02.708434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-285f92ef-b98b-4a7a-9715-4fad63ae561a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:02.719919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-285f92ef-b98b-4a7a-9715-4fad63ae561a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:02.721803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-285f92ef-b98b-4a7a-9715-4fad63ae561a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:02.723514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-285f92ef-b98b-4a7a-9715-4fad63ae561a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:02.724300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-285f92ef-b98b-4a7a-9715-4fad63ae561a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:02.967204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-285f92ef-b98b-4a7a-9715-4fad63ae561a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:02.978659 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-285f92ef-b98b-4a7a-9715-4fad63ae561a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1477 microversion: 2.1 time: 0.291648 Aug 03 01:50:02.979629 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 368/716] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:02 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1477 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:03.000789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f769321e-9a93-444d-92d1-19ba60dbf88a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:03.001902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f769321e-9a93-444d-92d1-19ba60dbf88a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:03.010943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f769321e-9a93-444d-92d1-19ba60dbf88a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:03.012065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f769321e-9a93-444d-92d1-19ba60dbf88a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:03.013111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f769321e-9a93-444d-92d1-19ba60dbf88a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:03.016849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f769321e-9a93-444d-92d1-19ba60dbf88a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:03.342064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f769321e-9a93-444d-92d1-19ba60dbf88a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:03.347706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:03.353576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f769321e-9a93-444d-92d1-19ba60dbf88a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:03.355118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f769321e-9a93-444d-92d1-19ba60dbf88a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:03.357021 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f769321e-9a93-444d-92d1-19ba60dbf88a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1362 microversion: 2.25 time: 0.374052 Aug 03 01:50:03.374798 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 369/717] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:02 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:03.380588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-52371c64-b066-444f-8499-656e92b11cf5 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] Calling method '.version_select at 0x7f5b1399c9d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:04.216965 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b4eaef88-b920-4e4c-b59c-145c602585b3 tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.532285 Aug 03 01:50:04.225872 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 349/718] 10.222.0.67 () {60 vars in 1170 bytes} [Wed Aug 3 01:50:01 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:04.225872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-60038582-3e2e-49cd-afe2-2bbf47083f56 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:04.225872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-60038582-3e2e-49cd-afe2-2bbf47083f56 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:04.235270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60038582-3e2e-49cd-afe2-2bbf47083f56 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:04.236526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60038582-3e2e-49cd-afe2-2bbf47083f56 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:04.238155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60038582-3e2e-49cd-afe2-2bbf47083f56 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:04.239199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60038582-3e2e-49cd-afe2-2bbf47083f56 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:04.244487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:04.507739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-60038582-3e2e-49cd-afe2-2bbf47083f56 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:04.522698 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-60038582-3e2e-49cd-afe2-2bbf47083f56 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1311 microversion: 2.1 time: 0.303121 Aug 03 01:50:04.524254 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 350/719] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:04 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1311 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:04.529706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6e68b55e-efc3-4ed9-9682-4e21fd12ca01 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:04.530634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6e68b55e-efc3-4ed9-9682-4e21fd12ca01 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:04.543954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6e68b55e-efc3-4ed9-9682-4e21fd12ca01 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:04.547462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6e68b55e-efc3-4ed9-9682-4e21fd12ca01 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:04.550678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6e68b55e-efc3-4ed9-9682-4e21fd12ca01 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:04.552033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6e68b55e-efc3-4ed9-9682-4e21fd12ca01 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:04.689117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-6e68b55e-efc3-4ed9-9682-4e21fd12ca01 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lazy-loading 'services' on Instance uuid 12d08110-b059-4437-bd10-c2a7ecd926f9 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:50:04.715122 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6e68b55e-efc3-4ed9-9682-4e21fd12ca01 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1929 microversion: 2.75 time: 0.189264 Aug 03 01:50:04.716869 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 351/720] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:04 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1929 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:04.737278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-32db4b8c-2aa8-48e2-8a42-60994d533c80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:04.739310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-32db4b8c-2aa8-48e2-8a42-60994d533c80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:04.753719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-32db4b8c-2aa8-48e2-8a42-60994d533c80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:04.754218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-32db4b8c-2aa8-48e2-8a42-60994d533c80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:04.755099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-32db4b8c-2aa8-48e2-8a42-60994d533c80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:04.755544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-32db4b8c-2aa8-48e2-8a42-60994d533c80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:04.767648 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-52371c64-b066-444f-8499-656e92b11cf5 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/64683d6f-00dd-4ccb-b514-8e7fe77c8ed8" status: 202 len: 0 microversion: 2.1 time: 1.391087 Aug 03 01:50:04.768246 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 370/721] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 01:50:03 2022] DELETE /compute/v2.1/os-floating-ips/64683d6f-00dd-4ccb-b514-8e7fe77c8ed8 => generated 0 bytes in 1393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:50:04.774040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-410672a7-1a3b-421e-82bd-f9c6fea38066 req-a3c11d3a-b08f-4033-8e62-60e1ffa273b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6607345-8b9f-47e7-8686-65443ffc6cde", "name": "network-vif-plugged", "status": "completed", "tag": "27843825-da5f-416a-883d-1724fb6835b3"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:04.794879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-410672a7-1a3b-421e-82bd-f9c6fea38066 req-a3c11d3a-b08f-4033-8e62-60e1ffa273b2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:04.795357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-410672a7-1a3b-421e-82bd-f9c6fea38066 req-a3c11d3a-b08f-4033-8e62-60e1ffa273b2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:04.807930 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-410672a7-1a3b-421e-82bd-f9c6fea38066 req-a3c11d3a-b08f-4033-8e62-60e1ffa273b2 service nova] Creating event network-vif-plugged:27843825-da5f-416a-883d-1724fb6835b3 for instance d6607345-8b9f-47e7-8686-65443ffc6cde on n-h2-826529-8 Aug 03 01:50:04.814743 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-410672a7-1a3b-421e-82bd-f9c6fea38066 req-a3c11d3a-b08f-4033-8e62-60e1ffa273b2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044453 Aug 03 01:50:04.816006 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 371/722] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:04.822204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b3e568d-cefb-402c-91b9-caa16fd55341 tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] Calling method '.version_select at 0x7f5b136c7c10>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:05.417892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-32db4b8c-2aa8-48e2-8a42-60994d533c80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:05.430133 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8b3e568d-cefb-402c-91b9-caa16fd55341 tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips/940301e5-5213-48cf-94fa-e5d24b176c57" status: 200 len: 141 microversion: 2.1 time: 0.611943 Aug 03 01:50:05.431399 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 372/723] 10.222.0.67 () {58 vars in 1260 bytes} [Wed Aug 3 01:50:04 2022] GET /compute/v2.1/os-floating-ips/940301e5-5213-48cf-94fa-e5d24b176c57 => generated 141 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:05.437159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-145c8426-15b3-4aad-b100-4583e387a918 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:05.438719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-145c8426-15b3-4aad-b100-4583e387a918 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:05.442243 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-32db4b8c-2aa8-48e2-8a42-60994d533c80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1477 microversion: 2.1 time: 0.721068 Aug 03 01:50:05.442853 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 352/724] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:04 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1477 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:05.448487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-145c8426-15b3-4aad-b100-4583e387a918 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:05.449270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-145c8426-15b3-4aad-b100-4583e387a918 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:05.449444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-56840c73-e4a4-42cb-9154-4df52cd3a3aa tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] Action: 'create', calling method: .version_select at 0x7f5b13d269d0>, body: {"pool": null} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:05.450873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-145c8426-15b3-4aad-b100-4583e387a918 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:05.451875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-145c8426-15b3-4aad-b100-4583e387a918 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:05.776132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-145c8426-15b3-4aad-b100-4583e387a918 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:05.789131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-145c8426-15b3-4aad-b100-4583e387a918 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:05.792333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-145c8426-15b3-4aad-b100-4583e387a918 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:05.794281 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-145c8426-15b3-4aad-b100-4583e387a918 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1362 microversion: 2.25 time: 0.361696 Aug 03 01:50:05.814696 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 373/725] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:05 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:05.819812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1fa066b8-4a06-4912-993a-8bd86d9f987e tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] Calling method '.version_select at 0x7f5b138b7700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:07.603536 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1fa066b8-4a06-4912-993a-8bd86d9f987e tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/940301e5-5213-48cf-94fa-e5d24b176c57" status: 202 len: 0 microversion: 2.1 time: 1.787463 Aug 03 01:50:07.612150 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 374/726] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 01:50:05 2022] DELETE /compute/v2.1/os-floating-ips/940301e5-5213-48cf-94fa-e5d24b176c57 => generated 0 bytes in 1796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:50:07.630637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-42d23580-48b6-4018-ac4b-14e3205defe9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:07.634455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-42d23580-48b6-4018-ac4b-14e3205defe9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:07.660636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42d23580-48b6-4018-ac4b-14e3205defe9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:07.661138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42d23580-48b6-4018-ac4b-14e3205defe9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:07.666491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42d23580-48b6-4018-ac4b-14e3205defe9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:07.667398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42d23580-48b6-4018-ac4b-14e3205defe9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:08.017197 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-56840c73-e4a4-42cb-9154-4df52cd3a3aa tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.573218 Aug 03 01:50:08.018247 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 353/727] 10.222.0.67 () {60 vars in 1170 bytes} [Wed Aug 3 01:50:05 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:08.022552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9c5ee4bc-019d-4753-bb94-c1aaea1d4122 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:08.024948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9c5ee4bc-019d-4753-bb94-c1aaea1d4122 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:08.034014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-42d23580-48b6-4018-ac4b-14e3205defe9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:08.045818 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-42d23580-48b6-4018-ac4b-14e3205defe9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1494 microversion: 2.1 time: 0.430152 Aug 03 01:50:08.048328 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 375/728] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:07 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1494 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:08.051775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c5ee4bc-019d-4753-bb94-c1aaea1d4122 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:08.052550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c5ee4bc-019d-4753-bb94-c1aaea1d4122 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:08.055925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c5ee4bc-019d-4753-bb94-c1aaea1d4122 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:08.056773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b5ac1aa9-00cc-45a6-b73e-bc6c46558ce9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:08.057716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c5ee4bc-019d-4753-bb94-c1aaea1d4122 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:08.059490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b5ac1aa9-00cc-45a6-b73e-bc6c46558ce9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:08.067200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5ac1aa9-00cc-45a6-b73e-bc6c46558ce9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:08.067863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5ac1aa9-00cc-45a6-b73e-bc6c46558ce9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:08.068896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5ac1aa9-00cc-45a6-b73e-bc6c46558ce9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:08.069490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5ac1aa9-00cc-45a6-b73e-bc6c46558ce9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:08.202526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-9c5ee4bc-019d-4753-bb94-c1aaea1d4122 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lazy-loading 'services' on Instance uuid 12d08110-b059-4437-bd10-c2a7ecd926f9 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:50:08.231520 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9c5ee4bc-019d-4753-bb94-c1aaea1d4122 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1929 microversion: 2.75 time: 0.212065 Aug 03 01:50:08.233968 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 354/729] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:08 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1929 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:08.240240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-944bef3b-a911-4c18-be69-680fa3fa03be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:08.241486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-944bef3b-a911-4c18-be69-680fa3fa03be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:08.249444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-944bef3b-a911-4c18-be69-680fa3fa03be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:08.250112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-944bef3b-a911-4c18-be69-680fa3fa03be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:08.251386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-944bef3b-a911-4c18-be69-680fa3fa03be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:08.252072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-944bef3b-a911-4c18-be69-680fa3fa03be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:08.267703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b5ac1aa9-00cc-45a6-b73e-bc6c46558ce9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:08.275810 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b5ac1aa9-00cc-45a6-b73e-bc6c46558ce9 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1477 microversion: 2.1 time: 0.226186 Aug 03 01:50:08.276412 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 376/730] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:08 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1477 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:08.282261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-616d5035-d2f5-4a5c-99d2-8da65e890dc8 req-e0045e1a-8890-4365-8b7b-a1a30e2ece71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb726272-286a-410e-8911-d328476b7755", "name": "network-vif-plugged", "status": "completed", "tag": "1fa2be26-8348-4842-ada3-bc3a43cd46ee"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:08.292943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-616d5035-d2f5-4a5c-99d2-8da65e890dc8 req-e0045e1a-8890-4365-8b7b-a1a30e2ece71 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:08.293392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-616d5035-d2f5-4a5c-99d2-8da65e890dc8 req-e0045e1a-8890-4365-8b7b-a1a30e2ece71 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:08.316646 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-616d5035-d2f5-4a5c-99d2-8da65e890dc8 req-e0045e1a-8890-4365-8b7b-a1a30e2ece71 service nova] Creating event network-vif-plugged:1fa2be26-8348-4842-ada3-bc3a43cd46ee for instance cb726272-286a-410e-8911-d328476b7755 on n-h1-826529-8 Aug 03 01:50:08.322304 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-616d5035-d2f5-4a5c-99d2-8da65e890dc8 req-e0045e1a-8890-4365-8b7b-a1a30e2ece71 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044574 Aug 03 01:50:08.323096 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 377/731] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:08.329229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ac89ede8-4bd3-4cf8-9581-4935083d79dc tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] Calling method '.version_select at 0x7f5b136111f0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:08.403630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=18 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:08.580790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-944bef3b-a911-4c18-be69-680fa3fa03be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:08.589451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-944bef3b-a911-4c18-be69-680fa3fa03be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:08.591009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-944bef3b-a911-4c18-be69-680fa3fa03be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:08.592125 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-944bef3b-a911-4c18-be69-680fa3fa03be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1362 microversion: 2.25 time: 0.356765 Aug 03 01:50:08.592686 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 355/732] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:08 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:08.599235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f022d967-e22a-4825-a6af-a32fa0baf5f8 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] Calling method '.version_select at 0x7f5b13a12b80>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:08.703330 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ac89ede8-4bd3-4cf8-9581-4935083d79dc tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.378578 Aug 03 01:50:08.703922 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 378/733] 10.222.0.67 () {58 vars in 1164 bytes} [Wed Aug 3 01:50:08 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:50:09.100894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5fa3a6af-4798-43b2-a065-90c1ba5334cc tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:09.103054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5fa3a6af-4798-43b2-a065-90c1ba5334cc tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:09.110351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fa3a6af-4798-43b2-a065-90c1ba5334cc tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:09.110796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fa3a6af-4798-43b2-a065-90c1ba5334cc tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:09.111789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fa3a6af-4798-43b2-a065-90c1ba5334cc tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:09.112225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fa3a6af-4798-43b2-a065-90c1ba5334cc tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:09.371794 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5fa3a6af-4798-43b2-a065-90c1ba5334cc tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1645 microversion: 2.1 time: 0.666538 Aug 03 01:50:09.373006 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 379/734] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:08 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1645 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:09.381303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9b979b1f-27b4-45bc-aa87-349b56353ffd tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:09.382195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9b979b1f-27b4-45bc-aa87-349b56353ffd tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:09.397528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b979b1f-27b4-45bc-aa87-349b56353ffd tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:09.398422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b979b1f-27b4-45bc-aa87-349b56353ffd tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:09.399795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b979b1f-27b4-45bc-aa87-349b56353ffd tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:09.400485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b979b1f-27b4-45bc-aa87-349b56353ffd tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:09.437646 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9b979b1f-27b4-45bc-aa87-349b56353ffd tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:50:09.542234 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9b979b1f-27b4-45bc-aa87-349b56353ffd tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 204 len: 0 microversion: 2.1 time: 0.167313 Aug 03 01:50:09.543851 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 380/735] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:50:09 2022] DELETE /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:50:09.553443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cb3a8f55-c86f-4ebf-8a6a-0e359c8303e0 tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] Calling method '.version_select at 0x7f5b13f9e4c0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:09.782460 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f022d967-e22a-4825-a6af-a32fa0baf5f8 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/3fe3f93e-7204-49ca-a0fd-cea478abef07" status: 202 len: 0 microversion: 2.1 time: 1.187875 Aug 03 01:50:09.783652 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 356/736] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 01:50:08 2022] DELETE /compute/v2.1/os-floating-ips/3fe3f93e-7204-49ca-a0fd-cea478abef07 => generated 0 bytes in 1190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:50:09.823083 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cb3a8f55-c86f-4ebf-8a6a-0e359c8303e0 tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.277177 Aug 03 01:50:09.825271 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 381/737] 10.222.0.67 () {58 vars in 1149 bytes} [Wed Aug 3 01:50:09 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:09.831953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-76dda4a0-675f-40e7-b9d2-4f10247404f9 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:09.832315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-76dda4a0-675f-40e7-b9d2-4f10247404f9 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:09.842757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76dda4a0-675f-40e7-b9d2-4f10247404f9 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:09.843962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76dda4a0-675f-40e7-b9d2-4f10247404f9 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:09.845793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76dda4a0-675f-40e7-b9d2-4f10247404f9 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:09.846247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76dda4a0-675f-40e7-b9d2-4f10247404f9 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:09.857213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2132094200", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "72337701-008d-4d04-a67f-25370e2c6384"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:09.917022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] validate_networks() for [('72337701-008d-4d04-a67f-25370e2c6384', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:50:09.927794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-76dda4a0-675f-40e7-b9d2-4f10247404f9 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lazy-loading 'services' on Instance uuid 12d08110-b059-4437-bd10-c2a7ecd926f9 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:50:09.945354 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-76dda4a0-675f-40e7-b9d2-4f10247404f9 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1929 microversion: 2.75 time: 0.118995 Aug 03 01:50:09.946047 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 382/738] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:09 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1929 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:09.960641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d6264459-ac30-4e6b-99a8-e686c3ae14d0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:09.961188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d6264459-ac30-4e6b-99a8-e686c3ae14d0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:09.963178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:09.969728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6264459-ac30-4e6b-99a8-e686c3ae14d0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:09.970387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6264459-ac30-4e6b-99a8-e686c3ae14d0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:09.971406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6264459-ac30-4e6b-99a8-e686c3ae14d0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:09.971960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6264459-ac30-4e6b-99a8-e686c3ae14d0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:10.382414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d6264459-ac30-4e6b-99a8-e686c3ae14d0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:10.390842 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d6264459-ac30-4e6b-99a8-e686c3ae14d0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1477 microversion: 2.1 time: 0.433535 Aug 03 01:50:10.391847 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 383/739] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:09 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1477 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:10.396086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c00cb7a4-d099-4e0e-a253-f52a3f586ed2 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:10.398084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c00cb7a4-d099-4e0e-a253-f52a3f586ed2 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:10.404108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c00cb7a4-d099-4e0e-a253-f52a3f586ed2 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:10.404564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c00cb7a4-d099-4e0e-a253-f52a3f586ed2 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:10.405347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c00cb7a4-d099-4e0e-a253-f52a3f586ed2 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:10.405909 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c00cb7a4-d099-4e0e-a253-f52a3f586ed2 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:10.629702 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c00cb7a4-d099-4e0e-a253-f52a3f586ed2 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1645 microversion: 2.1 time: 0.236989 Aug 03 01:50:10.630281 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 384/740] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:10 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1645 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:10.642739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3ae662df-824f-4a13-bf6f-405cf25c32e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:10.643367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3ae662df-824f-4a13-bf6f-405cf25c32e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:10.647750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:50:10.648297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:50:10.649160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:50:10.650021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:50:10.650378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ae662df-824f-4a13-bf6f-405cf25c32e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:10.650829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ae662df-824f-4a13-bf6f-405cf25c32e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:10.651084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:50:10.651629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ae662df-824f-4a13-bf6f-405cf25c32e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:10.652090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ae662df-824f-4a13-bf6f-405cf25c32e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:10.667269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:10.667962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:10.668866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:10.669386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:10.688358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Getting quotas for project 359b651cd3fd4147b171fed1c77eccb2. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:50:10.692773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Getting quotas for user 6600500765544c6188019442f54380ad and project 359b651cd3fd4147b171fed1c77eccb2. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:50:10.704639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Going to run 2 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:50:10.706999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: 6e67dfa9-cf64-4603-9644-f7162e4e869d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:50:10.743345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: b164a45c-f12c-411c-8a2a-0680571316dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=6e67dfa9-cf64-4603-9644-f7162e4e869d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:50:10.810559 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-231b9220-f758-4fbf-9302-bb5a80aa2dcc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.025632 Aug 03 01:50:10.818171 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 357/741] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:50:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:50:10.825469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-963698449", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "1364948124", "adminPass": "***", "networks": [{"uuid": "8ede81e3-375c-499e-90c5-c149d68b9fd2"}], "security_groups": [{"name": "tempest-securitygroup--243209664"}], "key_name": "tempest-keypair-1119800332", "user_data": "}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:10.834033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3ae662df-824f-4a13-bf6f-405cf25c32e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:10.857937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3ae662df-824f-4a13-bf6f-405cf25c32e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:10.864081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3ae662df-824f-4a13-bf6f-405cf25c32e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:10.866591 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3ae662df-824f-4a13-bf6f-405cf25c32e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1362 microversion: 2.25 time: 0.227489 Aug 03 01:50:10.867842 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 385/742] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:10 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:10.874246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c53a392d-da93-469b-8dbe-d025114fc677 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] Calling method '.version_select at 0x7f5b13c31a60>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:10.932843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG neutronclient.v2_0.client [None req-c53a392d-da93-469b-8dbe-d025114fc677 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3fe3f93e-7204-49ca-a0fd-cea478abef07 could not be found", "detail": ""}} {{(pid=125941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:50:10.933789 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-c53a392d-da93-469b-8dbe-d025114fc677 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] HTTP exception thrown: Floating IP not found for ID 3fe3f93e-7204-49ca-a0fd-cea478abef07 Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c53a392d-da93-469b-8dbe-d025114fc677 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] Request method failure captured: Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-floating-ips/3fe3f93e-7204-49ca-a0fd-cea478abef07 HTTP/1.1 Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dRFDqY83pMg05THj0_qZKp8hsvU1JYcflZ4J_cAk8zbF1o77qmx4DqB_gR9k99R-Mwlvgs0qyalXkoD0jTSDtyBg34koIqp_wadnanG4iu_FfSR63fAcaIlbkXCcLiwLxPEQkAjX8rpQV8XP3fmUsAy9a2RWpwrVt04XQsbZ_zdTI0 Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a624d721fc954cd49e1f437b0a22271e Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FloatingIPsTestJSON-897574675 Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a624d721fc954cd49e1f437b0a22271e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a624d721fc954cd49e1f437b0a22271e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a624d721fc954cd49e1f437b0a22271e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a624d721fc954cd49e1f437b0a22271e"}]}] Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FloatingIPsTestJSON-897574675 Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a624d721fc954cd49e1f437b0a22271e Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FloatingIPsTestJSON-897574675 Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FloatingIPsTestJSON-897574675-project Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 2d6234d04900465ebccc52a35419c037 Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FloatingIPsTestJSON-897574675-project Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: exception: Floating IP not found for ID 3fe3f93e-7204-49ca-a0fd-cea478abef07 Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '3fe3f93e-7204-49ca-a0fd-cea478abef07'} Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3fe3f93e-7204-49ca-a0fd-cea478abef07 could not be found Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f360f7c8-542f-428f-863c-234c04f068c7'] Aug 03 01:50:10.949844 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3fe3f93e-7204-49ca-a0fd-cea478abef07. Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3fe3f93e-7204-49ca-a0fd-cea478abef07 Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3fe3f93e-7204-49ca-a0fd-cea478abef07 Aug 03 01:50:10.954653 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:10.959620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c53a392d-da93-469b-8dbe-d025114fc677 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] Returning 404 to user: Floating IP not found for ID 3fe3f93e-7204-49ca-a0fd-cea478abef07 {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:50:10.959620 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c53a392d-da93-469b-8dbe-d025114fc677 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips/3fe3f93e-7204-49ca-a0fd-cea478abef07" status: 404 len: 111 microversion: 2.1 time: 0.088965 Aug 03 01:50:10.959620 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 386/743] 10.222.0.67 () {58 vars in 1260 bytes} [Wed Aug 3 01:50:10 2022] GET /compute/v2.1/os-floating-ips/3fe3f93e-7204-49ca-a0fd-cea478abef07 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:50:10.967216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-379268f0-2bd2-4a42-a10f-d3c55bc804c4 tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] Calling method '.version_select at 0x7f5b135b3040>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:11.004910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] validate_networks() for [('8ede81e3-375c-499e-90c5-c149d68b9fd2', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:50:11.911122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:50:11.911768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:50:11.912146 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:50:11.913704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:50:11.914150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:50:11.944286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:11.947184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:11.948454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:11.948904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:12.013212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Getting quotas for project 631d6080e5d14fb3906ecf8c339478d7. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:50:12.018030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Getting quotas for user 141f8784088448cdafee6cee8955dc71 and project 631d6080e5d14fb3906ecf8c339478d7. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:50:12.037970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:50:12.045316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:50:12.083534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:12.117569 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-03ed47b4-3313-4f75-9700-22b8ec022c2c tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.297444 Aug 03 01:50:12.118779 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 358/744] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:50:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:50:12.124124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-efe4e300-563b-48e8-bff8-d2ceb2a2a8fd tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:12.129140 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:50:12.129140 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:50:12.131470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-efe4e300-563b-48e8-bff8-d2ceb2a2a8fd tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:12.132083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-efe4e300-563b-48e8-bff8-d2ceb2a2a8fd tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:12.133088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-efe4e300-563b-48e8-bff8-d2ceb2a2a8fd tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:12.133588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-efe4e300-563b-48e8-bff8-d2ceb2a2a8fd tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:12.192100 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-efe4e300-563b-48e8-bff8-d2ceb2a2a8fd tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.072085 Aug 03 01:50:12.199557 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 359/745] 10.222.0.67 () {58 vars in 1176 bytes} [Wed Aug 3 01:50:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:12.199557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ddb50191-120c-4025-99b9-7b12c0dc7a0a tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:12.207035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ddb50191-120c-4025-99b9-7b12c0dc7a0a tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:12.208095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ddb50191-120c-4025-99b9-7b12c0dc7a0a tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Searching by: {'deleted': False, 'project_id': '359b651cd3fd4147b171fed1c77eccb2'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:50:12.216338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ddb50191-120c-4025-99b9-7b12c0dc7a0a tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:12.216806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ddb50191-120c-4025-99b9-7b12c0dc7a0a tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:12.217603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ddb50191-120c-4025-99b9-7b12c0dc7a0a tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:12.218353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ddb50191-120c-4025-99b9-7b12c0dc7a0a tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:12.344397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-ddb50191-120c-4025-99b9-7b12c0dc7a0a tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:50:12.495895 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ddb50191-120c-4025-99b9-7b12c0dc7a0a tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.302042 Aug 03 01:50:12.497458 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 360/746] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 3 01:50:12 2022] GET /compute/v2.1/servers => generated 677 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:12.503983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a363e1ca-c8a7-4172-ab69-8db15d45b3f5 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] Calling method '.version_select at 0x7f5b13b2dca0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:12.707309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG neutronclient.v2_0.client [None req-a363e1ca-c8a7-4172-ab69-8db15d45b3f5 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3fe3f93e-7204-49ca-a0fd-cea478abef07 could not be found", "detail": ""}} {{(pid=125942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:50:12.708806 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-a363e1ca-c8a7-4172-ab69-8db15d45b3f5 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] HTTP exception thrown: Floating IP not found for ID 3fe3f93e-7204-49ca-a0fd-cea478abef07 Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a363e1ca-c8a7-4172-ab69-8db15d45b3f5 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] Request method failure captured: Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/os-floating-ips/3fe3f93e-7204-49ca-a0fd-cea478abef07 HTTP/1.1 Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dRFDqY83pMg05THj0_qZKp8hsvU1JYcflZ4J_cAk8zbF1o77qmx4DqB_gR9k99R-Mwlvgs0qyalXkoD0jTSDtyBg34koIqp_wadnanG4iu_FfSR63fAcaIlbkXCcLiwLxPEQkAjX8rpQV8XP3fmUsAy9a2RWpwrVt04XQsbZ_zdTI0 Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: a624d721fc954cd49e1f437b0a22271e Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-FloatingIPsTestJSON-897574675 Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a624d721fc954cd49e1f437b0a22271e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a624d721fc954cd49e1f437b0a22271e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a624d721fc954cd49e1f437b0a22271e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a624d721fc954cd49e1f437b0a22271e"}]}] Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-FloatingIPsTestJSON-897574675 Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: a624d721fc954cd49e1f437b0a22271e Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-FloatingIPsTestJSON-897574675 Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-FloatingIPsTestJSON-897574675-project Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 2d6234d04900465ebccc52a35419c037 Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-FloatingIPsTestJSON-897574675-project Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: exception: Floating IP not found for ID 3fe3f93e-7204-49ca-a0fd-cea478abef07 Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '3fe3f93e-7204-49ca-a0fd-cea478abef07'} Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3fe3f93e-7204-49ca-a0fd-cea478abef07 could not be found Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf58d7d9-d853-4f79-9c9a-0b40cf8a089d'] Aug 03 01:50:12.713638 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3fe3f93e-7204-49ca-a0fd-cea478abef07. Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3fe3f93e-7204-49ca-a0fd-cea478abef07 Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3fe3f93e-7204-49ca-a0fd-cea478abef07 Aug 03 01:50:12.717976 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:12.723603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a363e1ca-c8a7-4172-ab69-8db15d45b3f5 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] Returning 404 to user: Floating IP not found for ID 3fe3f93e-7204-49ca-a0fd-cea478abef07 {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:50:12.724755 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a363e1ca-c8a7-4172-ab69-8db15d45b3f5 tempest-FloatingIPsTestJSON-897574675 tempest-FloatingIPsTestJSON-897574675-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/3fe3f93e-7204-49ca-a0fd-cea478abef07" status: 404 len: 111 microversion: 2.1 time: 0.226079 Aug 03 01:50:12.725895 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 361/747] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 01:50:12 2022] DELETE /compute/v2.1/os-floating-ips/3fe3f93e-7204-49ca-a0fd-cea478abef07 => generated 111 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:50:12.745048 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-379268f0-2bd2-4a42-a10f-d3c55bc804c4 tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/f5ff1815-af11-4e6b-af85-051a37ceae07" status: 202 len: 0 microversion: 2.1 time: 1.784070 Aug 03 01:50:12.746850 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 387/748] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 01:50:10 2022] DELETE /compute/v2.1/os-floating-ips/f5ff1815-af11-4e6b-af85-051a37ceae07 => generated 0 bytes in 1787 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:50:12.753711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2404d88d-256a-453a-bea5-1ad6a2e6c40a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:12.754650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2404d88d-256a-453a-bea5-1ad6a2e6c40a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:12.756488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-31877eb4-6fad-4e5e-b633-640def53ff2a tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:12.768395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-31877eb4-6fad-4e5e-b633-640def53ff2a tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:12.789603 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2404d88d-256a-453a-bea5-1ad6a2e6c40a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:12.790809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2404d88d-256a-453a-bea5-1ad6a2e6c40a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:12.800138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2404d88d-256a-453a-bea5-1ad6a2e6c40a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:12.800762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2404d88d-256a-453a-bea5-1ad6a2e6c40a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:12.809359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31877eb4-6fad-4e5e-b633-640def53ff2a tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:12.810025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31877eb4-6fad-4e5e-b633-640def53ff2a tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:12.817980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31877eb4-6fad-4e5e-b633-640def53ff2a tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:12.819018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31877eb4-6fad-4e5e-b633-640def53ff2a tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:13.054365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-31877eb4-6fad-4e5e-b633-640def53ff2a tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lazy-loading 'services' on Instance uuid 12d08110-b059-4437-bd10-c2a7ecd926f9 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:50:13.131024 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-31877eb4-6fad-4e5e-b633-640def53ff2a tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1929 microversion: 2.75 time: 0.403661 Aug 03 01:50:13.131644 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 362/749] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:12 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1929 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:13.145038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b57af3fe-3bd1-4510-aeaf-3efc331bae5e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:13.145657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b57af3fe-3bd1-4510-aeaf-3efc331bae5e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:13.183228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b57af3fe-3bd1-4510-aeaf-3efc331bae5e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:13.184141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b57af3fe-3bd1-4510-aeaf-3efc331bae5e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:13.185160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b57af3fe-3bd1-4510-aeaf-3efc331bae5e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:13.185758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b57af3fe-3bd1-4510-aeaf-3efc331bae5e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:13.543729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2404d88d-256a-453a-bea5-1ad6a2e6c40a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:13.552711 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2404d88d-256a-453a-bea5-1ad6a2e6c40a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1476 microversion: 2.1 time: 0.804441 Aug 03 01:50:13.568554 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 388/750] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:12 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1476 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:13.575597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-93e446e0-ab3b-43b6-9ad3-7c8505a0fa70 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:13.575744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b57af3fe-3bd1-4510-aeaf-3efc331bae5e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:13.576515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-93e446e0-ab3b-43b6-9ad3-7c8505a0fa70 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:13.583732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93e446e0-ab3b-43b6-9ad3-7c8505a0fa70 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:13.584468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93e446e0-ab3b-43b6-9ad3-7c8505a0fa70 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:13.586111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93e446e0-ab3b-43b6-9ad3-7c8505a0fa70 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:13.586788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93e446e0-ab3b-43b6-9ad3-7c8505a0fa70 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:13.595145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b57af3fe-3bd1-4510-aeaf-3efc331bae5e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:13.596826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b57af3fe-3bd1-4510-aeaf-3efc331bae5e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:13.598009 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b57af3fe-3bd1-4510-aeaf-3efc331bae5e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1558 microversion: 2.25 time: 0.458222 Aug 03 01:50:13.598881 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 363/751] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:13 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1558 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:13.603364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-822dd17d-65ab-4b65-b42c-eb975a78e4b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-826529-8", "block_migration": true, "disk_over_commit": false}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:13.605808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-822dd17d-65ab-4b65-b42c-eb975a78e4b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:13.631482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-822dd17d-65ab-4b65-b42c-eb975a78e4b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:13.631842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-822dd17d-65ab-4b65-b42c-eb975a78e4b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:13.639059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-822dd17d-65ab-4b65-b42c-eb975a78e4b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:13.640152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-822dd17d-65ab-4b65-b42c-eb975a78e4b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:13.670136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-93e446e0-ab3b-43b6-9ad3-7c8505a0fa70 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:13.681520 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-93e446e0-ab3b-43b6-9ad3-7c8505a0fa70 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 200 len: 1316 microversion: 2.1 time: 0.111231 Aug 03 01:50:13.683989 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 389/752] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:13 2022] GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 1316 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:13.699550 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a53c2b8a-54f0-49fe-804d-4230fd983156 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:13.700579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a53c2b8a-54f0-49fe-804d-4230fd983156 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: 6e67dfa9-cf64-4603-9644-f7162e4e869d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:13.710619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a53c2b8a-54f0-49fe-804d-4230fd983156 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:13.711559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a53c2b8a-54f0-49fe-804d-4230fd983156 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:13.712845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a53c2b8a-54f0-49fe-804d-4230fd983156 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:13.713509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a53c2b8a-54f0-49fe-804d-4230fd983156 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:13.862767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a53c2b8a-54f0-49fe-804d-4230fd983156 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:13.877721 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a53c2b8a-54f0-49fe-804d-4230fd983156 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d" status: 200 len: 1278 microversion: 2.1 time: 0.191003 Aug 03 01:50:13.878566 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 390/753] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:13 2022] GET /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:13.896730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-084c2ace-b7fd-4f59-9d75-546ae5121f4f tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] Calling method '.version_select at 0x7f5b135b31f0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:14.340818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-822dd17d-65ab-4b65-b42c-eb975a78e4b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lazy-loading 'flavor' on Instance uuid d6607345-8b9f-47e7-8686-65443ffc6cde {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:50:14.429253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-822dd17d-65ab-4b65-b42c-eb975a78e4b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Going to try to live migrate instance to n-h1-826529-8 {{(pid=125942) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 01:50:16.652944 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-084c2ace-b7fd-4f59-9d75-546ae5121f4f tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/db5c271f-778b-4d4e-905e-eabcbd5149e6" status: 202 len: 0 microversion: 2.1 time: 2.773072 Aug 03 01:50:16.657531 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 391/754] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 01:50:13 2022] DELETE /compute/v2.1/os-floating-ips/db5c271f-778b-4d4e-905e-eabcbd5149e6 => generated 0 bytes in 2778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:50:16.872882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-764c2264-f783-4d5b-ba01-d11bc08030f9 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:16.873767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-764c2264-f783-4d5b-ba01-d11bc08030f9 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:16.882842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-764c2264-f783-4d5b-ba01-d11bc08030f9 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:16.883657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-764c2264-f783-4d5b-ba01-d11bc08030f9 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:16.884650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-764c2264-f783-4d5b-ba01-d11bc08030f9 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:16.885459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-764c2264-f783-4d5b-ba01-d11bc08030f9 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:17.353512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-764c2264-f783-4d5b-ba01-d11bc08030f9 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'services' on Instance uuid cb726272-286a-410e-8911-d328476b7755 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:50:17.368606 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-764c2264-f783-4d5b-ba01-d11bc08030f9 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 2051 microversion: 2.25 time: 0.709810 Aug 03 01:50:17.369419 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 392/755] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:16 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 2051 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:17.374845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9c1f74aa-f792-4292-b6fd-a23fdcf1e82e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:17.375550 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9c1f74aa-f792-4292-b6fd-a23fdcf1e82e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:17.391598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c1f74aa-f792-4292-b6fd-a23fdcf1e82e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:17.392352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c1f74aa-f792-4292-b6fd-a23fdcf1e82e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:17.392868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c1f74aa-f792-4292-b6fd-a23fdcf1e82e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:17.393306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c1f74aa-f792-4292-b6fd-a23fdcf1e82e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:17.415367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:17.482039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-9c1f74aa-f792-4292-b6fd-a23fdcf1e82e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lazy-loading 'services' on Instance uuid 12d08110-b059-4437-bd10-c2a7ecd926f9 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:50:17.508533 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9c1f74aa-f792-4292-b6fd-a23fdcf1e82e tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1935 microversion: 2.75 time: 0.137904 Aug 03 01:50:17.509722 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 393/756] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:17 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1935 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:17.514364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-ba31b6e0-e67e-4708-8982-5ae06e068725 req-58516e3a-597b-4e96-b3e0-4cdb825f6b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c171ccf7-988b-441b-acb8-7332e481ec09", "name": "network-vif-deleted", "tag": "82736730-4f04-4297-8b74-d92a1952c26d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:17.525061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ba31b6e0-e67e-4708-8982-5ae06e068725 req-58516e3a-597b-4e96-b3e0-4cdb825f6b10 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:17.525834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ba31b6e0-e67e-4708-8982-5ae06e068725 req-58516e3a-597b-4e96-b3e0-4cdb825f6b10 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:17.541710 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-ba31b6e0-e67e-4708-8982-5ae06e068725 req-58516e3a-597b-4e96-b3e0-4cdb825f6b10 service nova] Creating event network-vif-deleted:82736730-4f04-4297-8b74-d92a1952c26d for instance c171ccf7-988b-441b-acb8-7332e481ec09 on n-h1-826529-8 Aug 03 01:50:17.548183 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-ba31b6e0-e67e-4708-8982-5ae06e068725 req-58516e3a-597b-4e96-b3e0-4cdb825f6b10 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036664 Aug 03 01:50:17.549113 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 394/757] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:17.554999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-186b17d6-18c0-45d3-b23c-0025637d10db tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:17.555801 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-186b17d6-18c0-45d3-b23c-0025637d10db tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:17.563677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-186b17d6-18c0-45d3-b23c-0025637d10db tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:17.564290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-186b17d6-18c0-45d3-b23c-0025637d10db tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:17.565551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-186b17d6-18c0-45d3-b23c-0025637d10db tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:17.566366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-186b17d6-18c0-45d3-b23c-0025637d10db tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:17.838786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-186b17d6-18c0-45d3-b23c-0025637d10db tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:17.852599 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-186b17d6-18c0-45d3-b23c-0025637d10db tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1474 microversion: 2.1 time: 0.302087 Aug 03 01:50:17.853307 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 395/758] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:17 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1474 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:17.860214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bddf3c6e-1387-47bd-b67d-1d83ac2cec83 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:17.860842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bddf3c6e-1387-47bd-b67d-1d83ac2cec83 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:17.869016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bddf3c6e-1387-47bd-b67d-1d83ac2cec83 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:17.869878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bddf3c6e-1387-47bd-b67d-1d83ac2cec83 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:17.871104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bddf3c6e-1387-47bd-b67d-1d83ac2cec83 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:17.871765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bddf3c6e-1387-47bd-b67d-1d83ac2cec83 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:18.131803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bddf3c6e-1387-47bd-b67d-1d83ac2cec83 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:18.168687 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bddf3c6e-1387-47bd-b67d-1d83ac2cec83 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 200 len: 1389 microversion: 2.1 time: 0.313945 Aug 03 01:50:18.171753 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 396/759] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:17 2022] GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 1389 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:18.180226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2f8eab4d-c399-4151-92ac-6a7ac7aaea6d tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:18.181359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2f8eab4d-c399-4151-92ac-6a7ac7aaea6d tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: 6e67dfa9-cf64-4603-9644-f7162e4e869d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:18.207971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f8eab4d-c399-4151-92ac-6a7ac7aaea6d tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:18.210313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f8eab4d-c399-4151-92ac-6a7ac7aaea6d tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:18.211544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f8eab4d-c399-4151-92ac-6a7ac7aaea6d tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:18.212764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f8eab4d-c399-4151-92ac-6a7ac7aaea6d tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:18.520300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2f8eab4d-c399-4151-92ac-6a7ac7aaea6d tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:18.537951 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2f8eab4d-c399-4151-92ac-6a7ac7aaea6d tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d" status: 200 len: 1320 microversion: 2.1 time: 0.364362 Aug 03 01:50:18.540604 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 397/760] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:18 2022] GET /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d => generated 1320 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:18.545390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2fc8c0e2-c49f-42d7-b794-db9be440e15d req-9cc37c72-0ec4-4e7c-b0f2-3d1fa7289fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f490eab-9c88-441e-8768-ae1e5eed8093", "name": "network-vif-unplugged", "status": "completed", "tag": "9f0663d7-6a0d-4d64-8ff5-d5196b0ca3bf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:18.560437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2fc8c0e2-c49f-42d7-b794-db9be440e15d req-9cc37c72-0ec4-4e7c-b0f2-3d1fa7289fb9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:18.560879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2fc8c0e2-c49f-42d7-b794-db9be440e15d req-9cc37c72-0ec4-4e7c-b0f2-3d1fa7289fb9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:18.573717 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2fc8c0e2-c49f-42d7-b794-db9be440e15d req-9cc37c72-0ec4-4e7c-b0f2-3d1fa7289fb9 service nova] Creating event network-vif-unplugged:9f0663d7-6a0d-4d64-8ff5-d5196b0ca3bf for instance 9f490eab-9c88-441e-8768-ae1e5eed8093 on n-h2-826529-8 Aug 03 01:50:18.579787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-2fc8c0e2-c49f-42d7-b794-db9be440e15d req-9cc37c72-0ec4-4e7c-b0f2-3d1fa7289fb9 service nova] Instance 9f490eab-9c88-441e-8768-ae1e5eed8093 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 01:50:18.586695 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2fc8c0e2-c49f-42d7-b794-db9be440e15d req-9cc37c72-0ec4-4e7c-b0f2-3d1fa7289fb9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044131 Aug 03 01:50:18.589729 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 398/761] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:18.595540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f0f8cc81-892e-4cd6-ad1f-758861965908 tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] Calling method '.version_select at 0x7f5b13604dc0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:19.464471 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-822dd17d-65ab-4b65-b42c-eb975a78e4b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde/action" status: 202 len: 0 microversion: 2.1 time: 5.864456 Aug 03 01:50:19.468974 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 364/762] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:50:13 2022] POST /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde/action => generated 0 bytes in 5870 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:50:19.474254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-57c2f7f6-d348-4d8e-8b61-e22ce49f176f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:19.475199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-57c2f7f6-d348-4d8e-8b61-e22ce49f176f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:19.485095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57c2f7f6-d348-4d8e-8b61-e22ce49f176f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:19.485767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57c2f7f6-d348-4d8e-8b61-e22ce49f176f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:19.487000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57c2f7f6-d348-4d8e-8b61-e22ce49f176f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:19.487469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57c2f7f6-d348-4d8e-8b61-e22ce49f176f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:19.887726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-57c2f7f6-d348-4d8e-8b61-e22ce49f176f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'services' on Instance uuid cb726272-286a-410e-8911-d328476b7755 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:50:19.933697 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-57c2f7f6-d348-4d8e-8b61-e22ce49f176f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 2051 microversion: 2.25 time: 0.463276 Aug 03 01:50:19.935180 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 365/763] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:19 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 2051 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:19.940921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9c76ab52-e637-4ac1-b1d6-2a6c408339d0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:19.941682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9c76ab52-e637-4ac1-b1d6-2a6c408339d0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:19.957379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c76ab52-e637-4ac1-b1d6-2a6c408339d0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:19.957837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c76ab52-e637-4ac1-b1d6-2a6c408339d0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:19.959028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c76ab52-e637-4ac1-b1d6-2a6c408339d0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:19.963213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c76ab52-e637-4ac1-b1d6-2a6c408339d0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:20.082377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-9c76ab52-e637-4ac1-b1d6-2a6c408339d0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] Lazy-loading 'services' on Instance uuid 12d08110-b059-4437-bd10-c2a7ecd926f9 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:50:20.103899 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9c76ab52-e637-4ac1-b1d6-2a6c408339d0 tempest-ServersAdmin275Test-1925732890 tempest-ServersAdmin275Test-1925732890-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1920 microversion: 2.75 time: 0.167458 Aug 03 01:50:20.104789 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 366/764] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:19 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1920 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:20.109915 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3808c695-b4ad-42bd-b5e8-28539f4720d8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:20.110851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3808c695-b4ad-42bd-b5e8-28539f4720d8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:20.119763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3808c695-b4ad-42bd-b5e8-28539f4720d8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:20.120215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3808c695-b4ad-42bd-b5e8-28539f4720d8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:20.120995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3808c695-b4ad-42bd-b5e8-28539f4720d8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:20.126585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3808c695-b4ad-42bd-b5e8-28539f4720d8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:20.164981 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f0f8cc81-892e-4cd6-ad1f-758861965908 tempest-FloatingIPDetailsTestJSON-1890559551 tempest-FloatingIPDetailsTestJSON-1890559551-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/7c0e1b50-3bd9-417a-a4be-b4f37e42c838" status: 202 len: 0 microversion: 2.1 time: 1.573571 Aug 03 01:50:20.169323 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 399/765] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 01:50:18 2022] DELETE /compute/v2.1/os-floating-ips/7c0e1b50-3bd9-417a-a4be-b4f37e42c838 => generated 0 bytes in 1576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:50:20.191450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-816dcc36-948c-43f7-8cd8-7dbf1943aa80 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:20.196522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-816dcc36-948c-43f7-8cd8-7dbf1943aa80 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:20.213650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-816dcc36-948c-43f7-8cd8-7dbf1943aa80 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:20.215787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-816dcc36-948c-43f7-8cd8-7dbf1943aa80 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:20.216705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-816dcc36-948c-43f7-8cd8-7dbf1943aa80 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:20.218920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-816dcc36-948c-43f7-8cd8-7dbf1943aa80 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:20.550338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-816dcc36-948c-43f7-8cd8-7dbf1943aa80 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:20.558705 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-816dcc36-948c-43f7-8cd8-7dbf1943aa80 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 200 len: 1389 microversion: 2.1 time: 0.391106 Aug 03 01:50:20.559599 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 400/766] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:20 2022] GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 1389 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:20.565590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d6536d68-e2e6-45b3-8069-d6fed8f7fbf5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:20.566195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d6536d68-e2e6-45b3-8069-d6fed8f7fbf5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:20.578934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3808c695-b4ad-42bd-b5e8-28539f4720d8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:20.582295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6536d68-e2e6-45b3-8069-d6fed8f7fbf5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:20.583200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6536d68-e2e6-45b3-8069-d6fed8f7fbf5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:20.584443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6536d68-e2e6-45b3-8069-d6fed8f7fbf5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:20.586002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6536d68-e2e6-45b3-8069-d6fed8f7fbf5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:20.588512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:20.593793 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3808c695-b4ad-42bd-b5e8-28539f4720d8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1471 microversion: 2.1 time: 0.487810 Aug 03 01:50:20.596389 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 367/767] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:20 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1471 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:20.610637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-27329945-d54d-4d49-9b2e-e6af028d1a5f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:20.611521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-27329945-d54d-4d49-9b2e-e6af028d1a5f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: 6e67dfa9-cf64-4603-9644-f7162e4e869d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:20.630351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27329945-d54d-4d49-9b2e-e6af028d1a5f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:20.630975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27329945-d54d-4d49-9b2e-e6af028d1a5f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:20.632328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27329945-d54d-4d49-9b2e-e6af028d1a5f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:20.634341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27329945-d54d-4d49-9b2e-e6af028d1a5f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:21.360030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d6536d68-e2e6-45b3-8069-d6fed8f7fbf5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:21.362661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-27329945-d54d-4d49-9b2e-e6af028d1a5f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:21.372454 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d6536d68-e2e6-45b3-8069-d6fed8f7fbf5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1504 microversion: 2.1 time: 0.811503 Aug 03 01:50:21.373004 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 401/768] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:20 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1504 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:21.374461 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-27329945-d54d-4d49-9b2e-e6af028d1a5f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d" status: 200 len: 1320 microversion: 2.1 time: 0.775438 Aug 03 01:50:21.378156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-cddbb1c7-65f4-4e20-b157-bd80e75a6a69 req-1f098a16-95c0-406d-8d1e-d9b54914e1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e67dfa9-cf64-4603-9644-f7162e4e869d", "tag": "0c081b64-9735-4fa7-883e-398c4753226e"}, {"name": "network-changed", "server_uuid": "b164a45c-f12c-411c-8a2a-0680571316dc", "tag": "f87bb68d-4e20-4a65-91db-362ddfcdec29"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:21.387864 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 368/769] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:20 2022] GET /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d => generated 1320 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:21.401300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0f8d7e5f-d60f-4b34-9af3-db4acc7a3a54 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:21.407186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-cddbb1c7-65f4-4e20-b157-bd80e75a6a69 req-1f098a16-95c0-406d-8d1e-d9b54914e1e9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:21.407657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-cddbb1c7-65f4-4e20-b157-bd80e75a6a69 req-1f098a16-95c0-406d-8d1e-d9b54914e1e9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:21.421505 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-cddbb1c7-65f4-4e20-b157-bd80e75a6a69 req-1f098a16-95c0-406d-8d1e-d9b54914e1e9 service nova] Creating event network-changed:0c081b64-9735-4fa7-883e-398c4753226e for instance 6e67dfa9-cf64-4603-9644-f7162e4e869d on n-h2-826529-8 Aug 03 01:50:21.422028 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-cddbb1c7-65f4-4e20-b157-bd80e75a6a69 req-1f098a16-95c0-406d-8d1e-d9b54914e1e9 service nova] Creating event network-changed:f87bb68d-4e20-4a65-91db-362ddfcdec29 for instance b164a45c-f12c-411c-8a2a-0680571316dc on n-h1-826529-8 Aug 03 01:50:21.429450 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:50:21.429450 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:50:21.432510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f8d7e5f-d60f-4b34-9af3-db4acc7a3a54 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:21.432667 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-cddbb1c7-65f4-4e20-b157-bd80e75a6a69 req-1f098a16-95c0-406d-8d1e-d9b54914e1e9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058367 Aug 03 01:50:21.433463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f8d7e5f-d60f-4b34-9af3-db4acc7a3a54 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:21.434723 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 402/770] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:21.434877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f8d7e5f-d60f-4b34-9af3-db4acc7a3a54 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:21.435463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f8d7e5f-d60f-4b34-9af3-db4acc7a3a54 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:21.440586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3db51499-dfb9-4b88-a0a8-125b2cbac938 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:21.441100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3db51499-dfb9-4b88-a0a8-125b2cbac938 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:21.462959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3db51499-dfb9-4b88-a0a8-125b2cbac938 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:21.463425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3db51499-dfb9-4b88-a0a8-125b2cbac938 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:21.464231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3db51499-dfb9-4b88-a0a8-125b2cbac938 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:21.464678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3db51499-dfb9-4b88-a0a8-125b2cbac938 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:21.486838 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0f8d7e5f-d60f-4b34-9af3-db4acc7a3a54 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.096932 Aug 03 01:50:21.487956 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 369/771] 10.222.0.67 () {60 vars in 1217 bytes} [Wed Aug 3 01:50:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:50:21.494719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7598e140-5bab-4876-95d7-ae82a6e0e5e1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:21.495852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7598e140-5bab-4876-95d7-ae82a6e0e5e1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:21.506606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7598e140-5bab-4876-95d7-ae82a6e0e5e1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:21.507462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7598e140-5bab-4876-95d7-ae82a6e0e5e1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:21.508420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7598e140-5bab-4876-95d7-ae82a6e0e5e1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:21.509155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7598e140-5bab-4876-95d7-ae82a6e0e5e1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:21.518967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3db51499-dfb9-4b88-a0a8-125b2cbac938 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:50:21.598990 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7598e140-5bab-4876-95d7-ae82a6e0e5e1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "POST /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093/action" status: 204 len: 0 microversion: 2.1 time: 0.109046 Aug 03 01:50:21.600252 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 370/772] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:50:21 2022] POST /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093/action => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:50:21.605441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a3bd7108-083e-4862-9de7-8ff352ac1686 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826529-8", "block_migration": "auto"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:21.608245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a3bd7108-083e-4862-9de7-8ff352ac1686 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:21.615944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3bd7108-083e-4862-9de7-8ff352ac1686 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:21.616423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3bd7108-083e-4862-9de7-8ff352ac1686 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:21.617458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3bd7108-083e-4862-9de7-8ff352ac1686 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:21.618053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3bd7108-083e-4862-9de7-8ff352ac1686 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:21.654806 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3db51499-dfb9-4b88-a0a8-125b2cbac938 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "DELETE /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 204 len: 0 microversion: 2.75 time: 0.218585 Aug 03 01:50:21.655897 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 403/773] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 01:50:21 2022] DELETE /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:50:21.664199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8f3d57c-f865-44eb-b29a-19c8728a8e16 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:21.665020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8f3d57c-f865-44eb-b29a-19c8728a8e16 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:21.672427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8f3d57c-f865-44eb-b29a-19c8728a8e16 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:21.673210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8f3d57c-f865-44eb-b29a-19c8728a8e16 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:21.674140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-a3bd7108-083e-4862-9de7-8ff352ac1686 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'flavor' on Instance uuid cb726272-286a-410e-8911-d328476b7755 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:50:21.674462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8f3d57c-f865-44eb-b29a-19c8728a8e16 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:21.675135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8f3d57c-f865-44eb-b29a-19c8728a8e16 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:21.725584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a3bd7108-083e-4862-9de7-8ff352ac1686 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: cb726272-286a-410e-8911-d328476b7755] Going to try to live migrate instance to n-h2-826529-8 {{(pid=125942) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 01:50:22.032938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=12 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:22.195106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8f3d57c-f865-44eb-b29a-19c8728a8e16 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:22.204944 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8f3d57c-f865-44eb-b29a-19c8728a8e16 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 200 len: 1389 microversion: 2.1 time: 0.544996 Aug 03 01:50:22.207127 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 404/774] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:21 2022] GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 1389 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:22.212200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-35c35677-e857-47e1-9921-ddfd3b382802 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:22.216698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-35c35677-e857-47e1-9921-ddfd3b382802 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:22.242791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35c35677-e857-47e1-9921-ddfd3b382802 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:22.246303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35c35677-e857-47e1-9921-ddfd3b382802 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:22.247192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35c35677-e857-47e1-9921-ddfd3b382802 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:22.247648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35c35677-e857-47e1-9921-ddfd3b382802 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:22.533332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-35c35677-e857-47e1-9921-ddfd3b382802 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:22.545143 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-35c35677-e857-47e1-9921-ddfd3b382802 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1471 microversion: 2.1 time: 0.336467 Aug 03 01:50:22.547283 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 405/775] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:22 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1471 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:22.555093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-04156d57-90ee-4e9d-89b4-0f6b703501fb tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:22.556290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-04156d57-90ee-4e9d-89b4-0f6b703501fb tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:22.568663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04156d57-90ee-4e9d-89b4-0f6b703501fb tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:22.569414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04156d57-90ee-4e9d-89b4-0f6b703501fb tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:22.570955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04156d57-90ee-4e9d-89b4-0f6b703501fb tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:22.573171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04156d57-90ee-4e9d-89b4-0f6b703501fb tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:22.721998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-04156d57-90ee-4e9d-89b4-0f6b703501fb tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:22.739395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-04156d57-90ee-4e9d-89b4-0f6b703501fb tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:22.759045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-04156d57-90ee-4e9d-89b4-0f6b703501fb tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:22.792484 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-04156d57-90ee-4e9d-89b4-0f6b703501fb tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1444 microversion: 2.75 time: 0.230036 Aug 03 01:50:22.794043 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 406/776] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:22 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1444 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:22.811818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-b58b5a41-fceb-4756-b857-83db68bc4fe9 req-dc6011ee-7614-401a-92ae-10400f32d130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f490eab-9c88-441e-8768-ae1e5eed8093", "name": "network-vif-plugged", "status": "completed", "tag": "9f0663d7-6a0d-4d64-8ff5-d5196b0ca3bf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:22.838019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b58b5a41-fceb-4756-b857-83db68bc4fe9 req-dc6011ee-7614-401a-92ae-10400f32d130 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:22.838564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b58b5a41-fceb-4756-b857-83db68bc4fe9 req-dc6011ee-7614-401a-92ae-10400f32d130 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:22.883239 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-b58b5a41-fceb-4756-b857-83db68bc4fe9 req-dc6011ee-7614-401a-92ae-10400f32d130 service nova] Creating event network-vif-plugged:9f0663d7-6a0d-4d64-8ff5-d5196b0ca3bf for instance 9f490eab-9c88-441e-8768-ae1e5eed8093 on n-h2-826529-8 Aug 03 01:50:22.891176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-b58b5a41-fceb-4756-b857-83db68bc4fe9 req-dc6011ee-7614-401a-92ae-10400f32d130 service nova] Instance 9f490eab-9c88-441e-8768-ae1e5eed8093 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 01:50:22.898835 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-b58b5a41-fceb-4756-b857-83db68bc4fe9 req-dc6011ee-7614-401a-92ae-10400f32d130 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101215 Aug 03 01:50:22.900039 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 407/777] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:22.908550 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f32b004d-c5a9-447e-b375-4a669eb462f3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:22.909481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f32b004d-c5a9-447e-b375-4a669eb462f3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:22.917243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f32b004d-c5a9-447e-b375-4a669eb462f3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:22.917856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f32b004d-c5a9-447e-b375-4a669eb462f3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:22.918879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f32b004d-c5a9-447e-b375-4a669eb462f3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:22.919505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f32b004d-c5a9-447e-b375-4a669eb462f3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:23.157884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f32b004d-c5a9-447e-b375-4a669eb462f3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:23.166521 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f32b004d-c5a9-447e-b375-4a669eb462f3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1504 microversion: 2.1 time: 0.265119 Aug 03 01:50:23.167900 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 408/778] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:22 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:23.179333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1bdfaa14-482d-4a72-9d19-1bae69f0022c tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:23.180329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1bdfaa14-482d-4a72-9d19-1bae69f0022c tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: 6e67dfa9-cf64-4603-9644-f7162e4e869d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:23.187776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bdfaa14-482d-4a72-9d19-1bae69f0022c tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:23.188757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bdfaa14-482d-4a72-9d19-1bae69f0022c tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:23.190307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bdfaa14-482d-4a72-9d19-1bae69f0022c tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:23.191053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bdfaa14-482d-4a72-9d19-1bae69f0022c tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:23.350147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1bdfaa14-482d-4a72-9d19-1bae69f0022c tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:23.360808 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1bdfaa14-482d-4a72-9d19-1bae69f0022c tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d" status: 200 len: 1320 microversion: 2.1 time: 0.188801 Aug 03 01:50:23.360808 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 409/779] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:23 2022] GET /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:23.365838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ace2444f-bd85-4bd5-bf8e-799447c9fe4e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:23.366715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ace2444f-bd85-4bd5-bf8e-799447c9fe4e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:23.377369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ace2444f-bd85-4bd5-bf8e-799447c9fe4e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:23.377959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ace2444f-bd85-4bd5-bf8e-799447c9fe4e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:23.378845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ace2444f-bd85-4bd5-bf8e-799447c9fe4e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:23.379590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ace2444f-bd85-4bd5-bf8e-799447c9fe4e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:23.545770 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ace2444f-bd85-4bd5-bf8e-799447c9fe4e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:23.556090 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ace2444f-bd85-4bd5-bf8e-799447c9fe4e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 200 len: 1389 microversion: 2.1 time: 0.196334 Aug 03 01:50:23.568167 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 410/780] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:23 2022] GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 1389 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:23.568167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-bf8e9841-3359-4d21-bcf5-608871e09fcf req-e81fa336-7f44-461a-8ed4-6f05c740b742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "297a1ee8-52ab-4794-9923-1c4603d93775", "tag": "290be87d-e492-4cca-9d33-ac2f3145deee"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:23.580673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bf8e9841-3359-4d21-bcf5-608871e09fcf req-e81fa336-7f44-461a-8ed4-6f05c740b742 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:23.581320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bf8e9841-3359-4d21-bcf5-608871e09fcf req-e81fa336-7f44-461a-8ed4-6f05c740b742 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:23.590559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:23.601374 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-bf8e9841-3359-4d21-bcf5-608871e09fcf req-e81fa336-7f44-461a-8ed4-6f05c740b742 service nova] Creating event network-changed:290be87d-e492-4cca-9d33-ac2f3145deee for instance 297a1ee8-52ab-4794-9923-1c4603d93775 on n-h2-826529-8 Aug 03 01:50:23.608049 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-bf8e9841-3359-4d21-bcf5-608871e09fcf req-e81fa336-7f44-461a-8ed4-6f05c740b742 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049456 Aug 03 01:50:23.608913 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 411/781] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:23.617118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-372b34d3-dde2-4cb2-a231-c77cdf233192 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:23.618426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-372b34d3-dde2-4cb2-a231-c77cdf233192 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:23.627841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-372b34d3-dde2-4cb2-a231-c77cdf233192 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:23.628667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-372b34d3-dde2-4cb2-a231-c77cdf233192 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:23.629801 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-372b34d3-dde2-4cb2-a231-c77cdf233192 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:23.630504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-372b34d3-dde2-4cb2-a231-c77cdf233192 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:24.114453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-372b34d3-dde2-4cb2-a231-c77cdf233192 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:24.123269 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-372b34d3-dde2-4cb2-a231-c77cdf233192 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1471 microversion: 2.1 time: 0.512810 Aug 03 01:50:24.123791 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 412/782] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:23 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1471 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:24.142059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03704b65-228d-401b-acc1-45f34dacf435 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:24.143236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-03704b65-228d-401b-acc1-45f34dacf435 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:24.150039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03704b65-228d-401b-acc1-45f34dacf435 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:24.150793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03704b65-228d-401b-acc1-45f34dacf435 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:24.151780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03704b65-228d-401b-acc1-45f34dacf435 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:24.152380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03704b65-228d-401b-acc1-45f34dacf435 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:24.216585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03704b65-228d-401b-acc1-45f34dacf435 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:24.217292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03704b65-228d-401b-acc1-45f34dacf435 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:24.218184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-03704b65-228d-401b-acc1-45f34dacf435 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lazy-loading 'fault' on Instance uuid 12d08110-b059-4437-bd10-c2a7ecd926f9 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:50:24.398317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03704b65-228d-401b-acc1-45f34dacf435 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:24.408457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03704b65-228d-401b-acc1-45f34dacf435 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:24.410026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03704b65-228d-401b-acc1-45f34dacf435 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32bee898d9d141bfaa0915665466a30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b583c1e5f68241e2811e543567879cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:24.415851 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03704b65-228d-401b-acc1-45f34dacf435 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 200 len: 1449 microversion: 2.75 time: 0.286258 Aug 03 01:50:24.416687 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 413/783] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:24 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 1449 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:24.423359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5c3a6d64-74ae-47ab-86ab-5d5f2d55d0ec tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:24.424223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5c3a6d64-74ae-47ab-86ab-5d5f2d55d0ec tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:24.430755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c3a6d64-74ae-47ab-86ab-5d5f2d55d0ec tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:24.431506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c3a6d64-74ae-47ab-86ab-5d5f2d55d0ec tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:24.432463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c3a6d64-74ae-47ab-86ab-5d5f2d55d0ec tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:24.433066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c3a6d64-74ae-47ab-86ab-5d5f2d55d0ec tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:25.044061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5c3a6d64-74ae-47ab-86ab-5d5f2d55d0ec tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:25.055935 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5c3a6d64-74ae-47ab-86ab-5d5f2d55d0ec tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1504 microversion: 2.1 time: 0.637896 Aug 03 01:50:25.057891 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 414/784] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:24 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1504 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:25.074807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-56aac6cf-3a53-40e7-9741-2975a2e6f976 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:25.075615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-56aac6cf-3a53-40e7-9741-2975a2e6f976 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: 6e67dfa9-cf64-4603-9644-f7162e4e869d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:25.082368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56aac6cf-3a53-40e7-9741-2975a2e6f976 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:25.083735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56aac6cf-3a53-40e7-9741-2975a2e6f976 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:25.084616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56aac6cf-3a53-40e7-9741-2975a2e6f976 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:25.085137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56aac6cf-3a53-40e7-9741-2975a2e6f976 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:25.538783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-56aac6cf-3a53-40e7-9741-2975a2e6f976 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:25.555780 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-56aac6cf-3a53-40e7-9741-2975a2e6f976 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d" status: 200 len: 1320 microversion: 2.1 time: 0.496469 Aug 03 01:50:25.556532 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a3bd7108-083e-4862-9de7-8ff352ac1686 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755/action" status: 202 len: 0 microversion: 2.25 time: 3.954922 Aug 03 01:50:25.570428 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 371/785] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 3 01:50:21 2022] POST /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755/action => generated 0 bytes in 3956 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:50:25.570428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-91d4d923-32c9-47cf-af41-17900eddcdad tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:25.570428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-91d4d923-32c9-47cf-af41-17900eddcdad tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:25.571391 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 415/786] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:25 2022] GET /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d => generated 1320 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:25.587432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-20a59a0f-09bf-4a4c-a575-b115615b2b75 req-d6a0465f-f1c6-4d1c-a8d6-6e84ea56e8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e67dfa9-cf64-4603-9644-f7162e4e869d", "name": "network-vif-plugged", "status": "completed", "tag": "0c081b64-9735-4fa7-883e-398c4753226e"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:25.595139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91d4d923-32c9-47cf-af41-17900eddcdad tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:25.595823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91d4d923-32c9-47cf-af41-17900eddcdad tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:25.597824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91d4d923-32c9-47cf-af41-17900eddcdad tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:25.598281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91d4d923-32c9-47cf-af41-17900eddcdad tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:25.604749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-20a59a0f-09bf-4a4c-a575-b115615b2b75 req-d6a0465f-f1c6-4d1c-a8d6-6e84ea56e8a6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:25.605427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-20a59a0f-09bf-4a4c-a575-b115615b2b75 req-d6a0465f-f1c6-4d1c-a8d6-6e84ea56e8a6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:25.631799 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-20a59a0f-09bf-4a4c-a575-b115615b2b75 req-d6a0465f-f1c6-4d1c-a8d6-6e84ea56e8a6 service nova] Creating event network-vif-plugged:0c081b64-9735-4fa7-883e-398c4753226e for instance 6e67dfa9-cf64-4603-9644-f7162e4e869d on n-h2-826529-8 Aug 03 01:50:25.637887 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-20a59a0f-09bf-4a4c-a575-b115615b2b75 req-d6a0465f-f1c6-4d1c-a8d6-6e84ea56e8a6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065010 Aug 03 01:50:25.639041 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 416/787] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:25.645401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e1ef2daf-49a1-4cb1-b61c-bc82d47a6e94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:25.647192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e1ef2daf-49a1-4cb1-b61c-bc82d47a6e94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:25.675311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e1ef2daf-49a1-4cb1-b61c-bc82d47a6e94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:25.676151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e1ef2daf-49a1-4cb1-b61c-bc82d47a6e94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:25.677599 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e1ef2daf-49a1-4cb1-b61c-bc82d47a6e94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:25.684833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e1ef2daf-49a1-4cb1-b61c-bc82d47a6e94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:26.315969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-91d4d923-32c9-47cf-af41-17900eddcdad tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:26.335940 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-91d4d923-32c9-47cf-af41-17900eddcdad tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 200 len: 1389 microversion: 2.1 time: 0.777370 Aug 03 01:50:26.336827 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 372/788] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:25 2022] GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 1389 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:26.353064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e0fd4778-a31a-4fe1-9392-2846420319b6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:26.354110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e0fd4778-a31a-4fe1-9392-2846420319b6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] [instance: 12d08110-b059-4437-bd10-c2a7ecd926f9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:26.368609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0fd4778-a31a-4fe1-9392-2846420319b6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:26.369067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0fd4778-a31a-4fe1-9392-2846420319b6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:26.369879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0fd4778-a31a-4fe1-9392-2846420319b6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:26.376536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0fd4778-a31a-4fe1-9392-2846420319b6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:26.406598 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-e0fd4778-a31a-4fe1-9392-2846420319b6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] HTTP exception thrown: Instance 12d08110-b059-4437-bd10-c2a7ecd926f9 could not be found. Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e0fd4778-a31a-4fe1-9392-2846420319b6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Request method failure captured: Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 HTTP/1.1 Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dQGapgdRsmzXUq7VJjk8u5EMfaE8gpylQU9bfwqnONvFkvSSfWgQpjpg_hnDsEMlAO-Kuo7-rFo1ha6y3L8qU1izbbVamKSENOBmqdvhVO61bvKkwLkWQRxgxNH68nGrlaTKzY0AAIYBUIPrePdcsq9ky5gk6iTjhBM3dx4jwUlaJ4 Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.75 Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: b583c1e5f68241e2811e543567879cc0 Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersAdmin275Test-1738261742 Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b583c1e5f68241e2811e543567879cc0", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b583c1e5f68241e2811e543567879cc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b583c1e5f68241e2811e543567879cc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b583c1e5f68241e2811e543567879cc0"}]}] Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersAdmin275Test-1738261742 Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: b583c1e5f68241e2811e543567879cc0 Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersAdmin275Test-1738261742 Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersAdmin275Test-1738261742-project Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 32bee898d9d141bfaa0915665466a30f Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersAdmin275Test-1738261742-project Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 12d08110-b059-4437-bd10-c2a7ecd926f9 could not be found. Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '12d08110-b059-4437-bd10-c2a7ecd926f9'} Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12d08110-b059-4437-bd10-c2a7ecd926f9 could not be found. Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12d08110-b059-4437-bd10-c2a7ecd926f9 could not be found. Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:26.412913 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:26.418978 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:26.418978 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:26.418978 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:26.418978 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:50:26.418978 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:50:26.418978 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12d08110-b059-4437-bd10-c2a7ecd926f9 could not be found. Aug 03 01:50:26.418978 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:26.422843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e0fd4778-a31a-4fe1-9392-2846420319b6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] Returning 404 to user: Instance 12d08110-b059-4437-bd10-c2a7ecd926f9 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:50:26.424896 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e0fd4778-a31a-4fe1-9392-2846420319b6 tempest-ServersAdmin275Test-1738261742 tempest-ServersAdmin275Test-1738261742-project] 10.222.0.67 "GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9" status: 404 len: 111 microversion: 2.75 time: 0.086084 Aug 03 01:50:26.426270 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 373/789] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:26 2022] GET /compute/v2.1/servers/12d08110-b059-4437-bd10-c2a7ecd926f9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:50:26.435717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7adfc3be-7650-4916-83d0-76621d4f4ecb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:26.437352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7adfc3be-7650-4916-83d0-76621d4f4ecb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:26.450524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7adfc3be-7650-4916-83d0-76621d4f4ecb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:26.451431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7adfc3be-7650-4916-83d0-76621d4f4ecb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:26.452442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7adfc3be-7650-4916-83d0-76621d4f4ecb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:26.452866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7adfc3be-7650-4916-83d0-76621d4f4ecb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:26.805782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e1ef2daf-49a1-4cb1-b61c-bc82d47a6e94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:26.835614 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e1ef2daf-49a1-4cb1-b61c-bc82d47a6e94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1471 microversion: 2.1 time: 1.191605 Aug 03 01:50:26.836751 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 417/790] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:25 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1471 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:26.858042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ddf77fb9-2b66-4562-aca5-2e59a00b49cc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:26.859244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ddf77fb9-2b66-4562-aca5-2e59a00b49cc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:26.869932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddf77fb9-2b66-4562-aca5-2e59a00b49cc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:26.870795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddf77fb9-2b66-4562-aca5-2e59a00b49cc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:26.872387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddf77fb9-2b66-4562-aca5-2e59a00b49cc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:26.875728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddf77fb9-2b66-4562-aca5-2e59a00b49cc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:27.369361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7adfc3be-7650-4916-83d0-76621d4f4ecb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:27.379258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7adfc3be-7650-4916-83d0-76621d4f4ecb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:27.384314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7adfc3be-7650-4916-83d0-76621d4f4ecb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:27.385630 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7adfc3be-7650-4916-83d0-76621d4f4ecb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1568 microversion: 2.25 time: 0.957995 Aug 03 01:50:27.386605 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 374/791] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:26 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1568 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:27.392670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-6ae450f3-c095-438e-b3df-6cbaace98913 req-81bad441-f0cc-4d59-854d-671f325dd39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6607345-8b9f-47e7-8686-65443ffc6cde", "name": "network-vif-unplugged", "status": "completed", "tag": "27843825-da5f-416a-883d-1724fb6835b3"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:27.412596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6ae450f3-c095-438e-b3df-6cbaace98913 req-81bad441-f0cc-4d59-854d-671f325dd39d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:27.413931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6ae450f3-c095-438e-b3df-6cbaace98913 req-81bad441-f0cc-4d59-854d-671f325dd39d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:27.414710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ddf77fb9-2b66-4562-aca5-2e59a00b49cc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:27.428454 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-6ae450f3-c095-438e-b3df-6cbaace98913 req-81bad441-f0cc-4d59-854d-671f325dd39d service nova] Creating event network-vif-unplugged:27843825-da5f-416a-883d-1724fb6835b3 for instance d6607345-8b9f-47e7-8686-65443ffc6cde on n-h2-826529-8 Aug 03 01:50:27.433365 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ddf77fb9-2b66-4562-aca5-2e59a00b49cc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1504 microversion: 2.1 time: 0.584085 Aug 03 01:50:27.434508 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-6ae450f3-c095-438e-b3df-6cbaace98913 req-81bad441-f0cc-4d59-854d-671f325dd39d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046542 Aug 03 01:50:27.435707 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 375/792] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:27.442416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c77b1b50-dfd2-48ef-883b-5b4b60f9bb65 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:27.443446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c77b1b50-dfd2-48ef-883b-5b4b60f9bb65 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: 6e67dfa9-cf64-4603-9644-f7162e4e869d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:27.449640 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 418/793] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:26 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1504 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:27.461301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c77b1b50-dfd2-48ef-883b-5b4b60f9bb65 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:27.462929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ba93451f-d554-4b80-a599-e3baaf2c82af tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:27.464110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c77b1b50-dfd2-48ef-883b-5b4b60f9bb65 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:27.465009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ba93451f-d554-4b80-a599-e3baaf2c82af tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:27.466985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c77b1b50-dfd2-48ef-883b-5b4b60f9bb65 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:27.468668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c77b1b50-dfd2-48ef-883b-5b4b60f9bb65 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:27.485974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba93451f-d554-4b80-a599-e3baaf2c82af tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:27.489417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba93451f-d554-4b80-a599-e3baaf2c82af tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:27.493388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba93451f-d554-4b80-a599-e3baaf2c82af tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:27.494134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba93451f-d554-4b80-a599-e3baaf2c82af tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:28.234609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c77b1b50-dfd2-48ef-883b-5b4b60f9bb65 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:28.246140 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c77b1b50-dfd2-48ef-883b-5b4b60f9bb65 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d" status: 200 len: 1320 microversion: 2.1 time: 0.807698 Aug 03 01:50:28.247163 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 376/794] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:27 2022] GET /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d => generated 1320 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:28.259008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-e8cb272b-73f1-405b-be11-685680fc3540 req-ab5716e9-3109-4c39-8d33-dd0e24c3d739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297a1ee8-52ab-4794-9923-1c4603d93775", "name": "network-vif-plugged", "status": "completed", "tag": "290be87d-e492-4cca-9d33-ac2f3145deee"}, {"server_uuid": "b164a45c-f12c-411c-8a2a-0680571316dc", "name": "network-vif-plugged", "status": "completed", "tag": "f87bb68d-4e20-4a65-91db-362ddfcdec29"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:28.272258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e8cb272b-73f1-405b-be11-685680fc3540 req-ab5716e9-3109-4c39-8d33-dd0e24c3d739 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:28.272802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e8cb272b-73f1-405b-be11-685680fc3540 req-ab5716e9-3109-4c39-8d33-dd0e24c3d739 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:28.287430 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e8cb272b-73f1-405b-be11-685680fc3540 req-ab5716e9-3109-4c39-8d33-dd0e24c3d739 service nova] Creating event network-vif-plugged:290be87d-e492-4cca-9d33-ac2f3145deee for instance 297a1ee8-52ab-4794-9923-1c4603d93775 on n-h2-826529-8 Aug 03 01:50:28.288383 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e8cb272b-73f1-405b-be11-685680fc3540 req-ab5716e9-3109-4c39-8d33-dd0e24c3d739 service nova] Creating event network-vif-plugged:f87bb68d-4e20-4a65-91db-362ddfcdec29 for instance b164a45c-f12c-411c-8a2a-0680571316dc on n-h1-826529-8 Aug 03 01:50:28.298600 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-e8cb272b-73f1-405b-be11-685680fc3540 req-ab5716e9-3109-4c39-8d33-dd0e24c3d739 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050066 Aug 03 01:50:28.299649 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 377/795] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:28.305630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8c82945c-768c-4345-b184-e13521030b1f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:28.306396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8c82945c-768c-4345-b184-e13521030b1f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:28.315656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c82945c-768c-4345-b184-e13521030b1f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:28.316445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c82945c-768c-4345-b184-e13521030b1f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:28.317478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c82945c-768c-4345-b184-e13521030b1f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:28.318103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c82945c-768c-4345-b184-e13521030b1f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:28.380460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ba93451f-d554-4b80-a599-e3baaf2c82af tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:28.391915 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ba93451f-d554-4b80-a599-e3baaf2c82af tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 200 len: 1389 microversion: 2.1 time: 0.940036 Aug 03 01:50:28.396322 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 419/796] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:27 2022] GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 1389 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:28.414655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-67ec18fe-6869-4687-8a51-d36fa6847f26 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:28.415841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-67ec18fe-6869-4687-8a51-d36fa6847f26 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:28.423104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67ec18fe-6869-4687-8a51-d36fa6847f26 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:28.424139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67ec18fe-6869-4687-8a51-d36fa6847f26 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:28.424939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67ec18fe-6869-4687-8a51-d36fa6847f26 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:28.425388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67ec18fe-6869-4687-8a51-d36fa6847f26 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:28.917843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8c82945c-768c-4345-b184-e13521030b1f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:28.929742 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8c82945c-768c-4345-b184-e13521030b1f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1463 microversion: 2.1 time: 0.628777 Aug 03 01:50:28.930428 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 378/797] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:28 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1463 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:28.941701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93e85d98-2eea-44e7-aebb-36ae9d813d7c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:28.942399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93e85d98-2eea-44e7-aebb-36ae9d813d7c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:28.969243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93e85d98-2eea-44e7-aebb-36ae9d813d7c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:28.969746 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93e85d98-2eea-44e7-aebb-36ae9d813d7c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:28.970951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93e85d98-2eea-44e7-aebb-36ae9d813d7c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:28.971579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93e85d98-2eea-44e7-aebb-36ae9d813d7c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:29.018481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-67ec18fe-6869-4687-8a51-d36fa6847f26 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:29.040413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-67ec18fe-6869-4687-8a51-d36fa6847f26 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:29.045909 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-67ec18fe-6869-4687-8a51-d36fa6847f26 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:29.047662 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-67ec18fe-6869-4687-8a51-d36fa6847f26 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1568 microversion: 2.25 time: 0.638869 Aug 03 01:50:29.048255 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 420/798] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:28 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1568 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:50:29.082780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d9e10978-1c13-45e3-8997-1d62550f8181 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:29.084089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d9e10978-1c13-45e3-8997-1d62550f8181 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:29.090824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9e10978-1c13-45e3-8997-1d62550f8181 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:29.091360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9e10978-1c13-45e3-8997-1d62550f8181 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:29.092513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9e10978-1c13-45e3-8997-1d62550f8181 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:29.093488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9e10978-1c13-45e3-8997-1d62550f8181 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:29.538072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-93e85d98-2eea-44e7-aebb-36ae9d813d7c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:29.549886 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93e85d98-2eea-44e7-aebb-36ae9d813d7c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1504 microversion: 2.1 time: 0.612708 Aug 03 01:50:29.557291 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 379/799] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:28 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1504 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:29.587910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d0dd8b77-11dd-4824-ab80-f4e0038299f7 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:29.595137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d0dd8b77-11dd-4824-ab80-f4e0038299f7 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: 6e67dfa9-cf64-4603-9644-f7162e4e869d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:29.602722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0dd8b77-11dd-4824-ab80-f4e0038299f7 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:29.603532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0dd8b77-11dd-4824-ab80-f4e0038299f7 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:29.604672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0dd8b77-11dd-4824-ab80-f4e0038299f7 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:29.605848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0dd8b77-11dd-4824-ab80-f4e0038299f7 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:29.833707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d9e10978-1c13-45e3-8997-1d62550f8181 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:29.863307 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d9e10978-1c13-45e3-8997-1d62550f8181 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1463 microversion: 2.1 time: 0.797395 Aug 03 01:50:29.864187 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 421/800] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:29 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1463 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:29.907049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6edace19-8f19-4924-9649-51ba62fbe944 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:29.907770 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6edace19-8f19-4924-9649-51ba62fbe944 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:29.925742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6edace19-8f19-4924-9649-51ba62fbe944 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:29.926547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6edace19-8f19-4924-9649-51ba62fbe944 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:29.927380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6edace19-8f19-4924-9649-51ba62fbe944 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:29.927777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6edace19-8f19-4924-9649-51ba62fbe944 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:29.963267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d0dd8b77-11dd-4824-ab80-f4e0038299f7 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:29.979184 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d0dd8b77-11dd-4824-ab80-f4e0038299f7 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d" status: 200 len: 1507 microversion: 2.1 time: 0.392716 Aug 03 01:50:29.980299 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 380/801] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:29 2022] GET /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d => generated 1507 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:29.999604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-81c9a9de-4314-466c-8468-25ee5566f74f req-ceb43d88-2d4e-40e0-aaa8-7bf605414887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6607345-8b9f-47e7-8686-65443ffc6cde", "tag": "27843825-da5f-416a-883d-1724fb6835b3"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:30.016554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-81c9a9de-4314-466c-8468-25ee5566f74f req-ceb43d88-2d4e-40e0-aaa8-7bf605414887 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:30.017238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-81c9a9de-4314-466c-8468-25ee5566f74f req-ceb43d88-2d4e-40e0-aaa8-7bf605414887 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:30.054544 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-81c9a9de-4314-466c-8468-25ee5566f74f req-ceb43d88-2d4e-40e0-aaa8-7bf605414887 service nova] Creating event network-changed:27843825-da5f-416a-883d-1724fb6835b3 for instance d6607345-8b9f-47e7-8686-65443ffc6cde on n-h2-826529-8 Aug 03 01:50:30.073933 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-81c9a9de-4314-466c-8468-25ee5566f74f req-ceb43d88-2d4e-40e0-aaa8-7bf605414887 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092219 Aug 03 01:50:30.075945 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 381/802] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:30.081876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dde5967d-f3cf-46dc-8eeb-8473c13a3644 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Action: 'create', calling method: .version_select at 0x7f5b13a959d0>, body: {"keypair": {"name": "tempest-keypair-1223659292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPCC5WIV62Cr4Zyc4MrHKCphUOSp/dZNiPhCmGyPQYILbp1alB8zs7HT1sUPMmwXIkZ0jsFN9i73X+iLISEEEls4EGr3t3WPa3JIeLlNRIcA+3RVZr44qFPTILDiOuw5g=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:30.149486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-dde5967d-f3cf-46dc-8eeb-8473c13a3644 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Getting quotas for project 6e247e7134ad41bfa92b6eff8111c86e. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:50:30.161992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-dde5967d-f3cf-46dc-8eeb-8473c13a3644 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Getting quotas for user 241ed53f42f84abc8efc7edb5f41f6ed and project 6e247e7134ad41bfa92b6eff8111c86e. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:50:30.236846 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dde5967d-f3cf-46dc-8eeb-8473c13a3644 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159016 Aug 03 01:50:30.237472 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 382/803] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 01:50:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:30.253042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f38bbae4-a07d-408b-8746-034c4e88a7d1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:30.254089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f38bbae4-a07d-408b-8746-034c4e88a7d1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: b164a45c-f12c-411c-8a2a-0680571316dc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:30.280426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f38bbae4-a07d-408b-8746-034c4e88a7d1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:30.281029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f38bbae4-a07d-408b-8746-034c4e88a7d1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:30.281933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f38bbae4-a07d-408b-8746-034c4e88a7d1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:30.283371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f38bbae4-a07d-408b-8746-034c4e88a7d1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:30.864511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6edace19-8f19-4924-9649-51ba62fbe944 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:30.877761 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6edace19-8f19-4924-9649-51ba62fbe944 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 200 len: 1389 microversion: 2.1 time: 0.981860 Aug 03 01:50:30.891850 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 422/804] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:29 2022] GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 1389 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:30.898244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6e33883b-f84e-41f8-9a4b-7957807bb2ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:30.898875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6e33883b-f84e-41f8-9a4b-7957807bb2ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:30.905513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e33883b-f84e-41f8-9a4b-7957807bb2ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:30.906553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e33883b-f84e-41f8-9a4b-7957807bb2ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:30.907762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e33883b-f84e-41f8-9a4b-7957807bb2ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:30.908409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e33883b-f84e-41f8-9a4b-7957807bb2ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:31.457734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=10 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:31.524485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f38bbae4-a07d-408b-8746-034c4e88a7d1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:31.540453 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f38bbae4-a07d-408b-8746-034c4e88a7d1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/b164a45c-f12c-411c-8a2a-0680571316dc" status: 200 len: 1508 microversion: 2.1 time: 1.301439 Aug 03 01:50:31.573650 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 383/805] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:30 2022] GET /compute/v2.1/servers/b164a45c-f12c-411c-8a2a-0680571316dc => generated 1508 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:31.600694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-58df7cd2-92dd-4f1c-b30f-00f8a08db05b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:31.603572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-58df7cd2-92dd-4f1c-b30f-00f8a08db05b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:31.623157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58df7cd2-92dd-4f1c-b30f-00f8a08db05b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:31.625902 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58df7cd2-92dd-4f1c-b30f-00f8a08db05b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:31.627639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58df7cd2-92dd-4f1c-b30f-00f8a08db05b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:31.629456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58df7cd2-92dd-4f1c-b30f-00f8a08db05b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:31.833312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6e33883b-f84e-41f8-9a4b-7957807bb2ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:31.844009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6e33883b-f84e-41f8-9a4b-7957807bb2ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:31.847646 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6e33883b-f84e-41f8-9a4b-7957807bb2ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:31.850608 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6e33883b-f84e-41f8-9a4b-7957807bb2ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1568 microversion: 2.25 time: 0.957657 Aug 03 01:50:31.856794 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 423/806] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:30 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1568 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:31.862747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-901c4acd-676f-4b7c-8256-ec50dc0c505d req-7960bc65-7627-4ef0-a357-c1980aba4675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb726272-286a-410e-8911-d328476b7755", "name": "network-vif-unplugged", "status": "completed", "tag": "1fa2be26-8348-4842-ada3-bc3a43cd46ee"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:31.890215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-901c4acd-676f-4b7c-8256-ec50dc0c505d req-7960bc65-7627-4ef0-a357-c1980aba4675 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:31.891561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-901c4acd-676f-4b7c-8256-ec50dc0c505d req-7960bc65-7627-4ef0-a357-c1980aba4675 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:31.912303 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-901c4acd-676f-4b7c-8256-ec50dc0c505d req-7960bc65-7627-4ef0-a357-c1980aba4675 service nova] Creating event network-vif-unplugged:1fa2be26-8348-4842-ada3-bc3a43cd46ee for instance cb726272-286a-410e-8911-d328476b7755 on n-h1-826529-8 Aug 03 01:50:31.924373 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-901c4acd-676f-4b7c-8256-ec50dc0c505d req-7960bc65-7627-4ef0-a357-c1980aba4675 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065769 Aug 03 01:50:31.928586 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 424/807] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:31.935053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1610c4d2-834c-4658-891c-51e31193562f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:31.942606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1610c4d2-834c-4658-891c-51e31193562f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: b164a45c-f12c-411c-8a2a-0680571316dc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:31.953063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1610c4d2-834c-4658-891c-51e31193562f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:31.959876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1610c4d2-834c-4658-891c-51e31193562f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:31.960925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1610c4d2-834c-4658-891c-51e31193562f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:31.964061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1610c4d2-834c-4658-891c-51e31193562f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:32.014236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1610c4d2-834c-4658-891c-51e31193562f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: b164a45c-f12c-411c-8a2a-0680571316dc] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:50:32.254307 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1610c4d2-834c-4658-891c-51e31193562f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b164a45c-f12c-411c-8a2a-0680571316dc" status: 204 len: 0 microversion: 2.1 time: 0.323836 Aug 03 01:50:32.254895 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 425/808] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:50:31 2022] DELETE /compute/v2.1/servers/b164a45c-f12c-411c-8a2a-0680571316dc => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:50:32.277946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cf6d3266-afb8-4532-b8b2-3560e9ee3294 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:32.278687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cf6d3266-afb8-4532-b8b2-3560e9ee3294 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:32.308048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf6d3266-afb8-4532-b8b2-3560e9ee3294 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:32.308519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf6d3266-afb8-4532-b8b2-3560e9ee3294 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:32.309327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf6d3266-afb8-4532-b8b2-3560e9ee3294 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:32.309836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf6d3266-afb8-4532-b8b2-3560e9ee3294 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:32.493104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-58df7cd2-92dd-4f1c-b30f-00f8a08db05b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:32.502135 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-58df7cd2-92dd-4f1c-b30f-00f8a08db05b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1504 microversion: 2.1 time: 0.926920 Aug 03 01:50:32.511482 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 384/809] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:31 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1504 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:32.516972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e0f84534-01b5-4c32-bf78-e7609bc83e24 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:32.517480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e0f84534-01b5-4c32-bf78-e7609bc83e24 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: 6e67dfa9-cf64-4603-9644-f7162e4e869d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:32.528658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0f84534-01b5-4c32-bf78-e7609bc83e24 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:32.531470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0f84534-01b5-4c32-bf78-e7609bc83e24 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:32.532417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0f84534-01b5-4c32-bf78-e7609bc83e24 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:32.535085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0f84534-01b5-4c32-bf78-e7609bc83e24 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:32.570100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e0f84534-01b5-4c32-bf78-e7609bc83e24 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: 6e67dfa9-cf64-4603-9644-f7162e4e869d] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:50:32.572574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:32.719048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cf6d3266-afb8-4532-b8b2-3560e9ee3294 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:32.728030 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cf6d3266-afb8-4532-b8b2-3560e9ee3294 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 200 len: 1588 microversion: 2.1 time: 0.468441 Aug 03 01:50:32.743103 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 426/810] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:32 2022] GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 1588 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:32.751114 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e0f84534-01b5-4c32-bf78-e7609bc83e24 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d" status: 204 len: 0 microversion: 2.1 time: 0.236940 Aug 03 01:50:32.762084 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 385/811] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:50:32 2022] DELETE /compute/v2.1/servers/6e67dfa9-cf64-4603-9644-f7162e4e869d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:50:32.762243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e87fe78a-05f8-4647-b59a-8c72e6087bb7 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:32.762532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e87fe78a-05f8-4647-b59a-8c72e6087bb7 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:32.765356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:32.777035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e87fe78a-05f8-4647-b59a-8c72e6087bb7 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:32.777546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e87fe78a-05f8-4647-b59a-8c72e6087bb7 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:32.778337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e87fe78a-05f8-4647-b59a-8c72e6087bb7 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:32.778787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e87fe78a-05f8-4647-b59a-8c72e6087bb7 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:32.886034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8439f8db-a218-4fd5-9f7f-3fad37b30e2e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:32.886854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8439f8db-a218-4fd5-9f7f-3fad37b30e2e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:32.888235 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e87fe78a-05f8-4647-b59a-8c72e6087bb7 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131753 Aug 03 01:50:32.896662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8439f8db-a218-4fd5-9f7f-3fad37b30e2e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:32.896874 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 427/812] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 01:50:32 2022] GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:32.898372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8439f8db-a218-4fd5-9f7f-3fad37b30e2e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:32.900598 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8439f8db-a218-4fd5-9f7f-3fad37b30e2e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:32.901659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8439f8db-a218-4fd5-9f7f-3fad37b30e2e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:32.916221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-856667560", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "72337701-008d-4d04-a67f-25370e2c6384"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:33.020539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] validate_networks() for [('72337701-008d-4d04-a67f-25370e2c6384', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:50:33.528777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8439f8db-a218-4fd5-9f7f-3fad37b30e2e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:33.538776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8439f8db-a218-4fd5-9f7f-3fad37b30e2e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:33.544090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8439f8db-a218-4fd5-9f7f-3fad37b30e2e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:33.545658 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8439f8db-a218-4fd5-9f7f-3fad37b30e2e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1568 microversion: 2.25 time: 0.668615 Aug 03 01:50:33.563469 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 386/813] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:32 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1568 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:50:33.722686 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-18edcb26-e9b4-4a78-bd31-a05f7cf1a56c tempest-TenantUsagesNegativeTestJSON-531056967 tempest-TenantUsagesNegativeTestJSON-531056967-project-admin] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-02T01%3A50%3A33.123146&end=2022-08-04T01%3A50%3A33.123146" status: 404 len: 112 microversion: - time: 0.157565 Aug 03 01:50:33.723628 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 387/814] 10.222.0.67 () {58 vars in 1316 bytes} [Wed Aug 3 01:50:33 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-02T01%3A50%3A33.123146&end=2022-08-04T01%3A50%3A33.123146 => generated 112 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 01:50:33.732542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c909fae8-0af3-4ea0-81da-4930c6c25787 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:33.733891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c909fae8-0af3-4ea0-81da-4930c6c25787 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:33.741210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c909fae8-0af3-4ea0-81da-4930c6c25787 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:33.742001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c909fae8-0af3-4ea0-81da-4930c6c25787 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:33.743078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c909fae8-0af3-4ea0-81da-4930c6c25787 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:33.743799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c909fae8-0af3-4ea0-81da-4930c6c25787 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:34.101943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:50:34.102465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:50:34.102787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:50:34.103398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:50:34.103826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:50:34.117526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c909fae8-0af3-4ea0-81da-4930c6c25787 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:34.129029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:34.130291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:34.145823 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c909fae8-0af3-4ea0-81da-4930c6c25787 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1504 microversion: 2.1 time: 0.406865 Aug 03 01:50:34.147487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:34.148427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:34.149581 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 388/815] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:33 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1504 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:34.163589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e560c35e-ed3c-4a5b-89f8-c6a682f0117a tempest-TenantUsagesNegativeTestJSON-531056967 tempest-TenantUsagesNegativeTestJSON-531056967-project-admin] Calling method '.version_select at 0x7f5b13f35d30>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:34.172408 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-e560c35e-ed3c-4a5b-89f8-c6a682f0117a tempest-TenantUsagesNegativeTestJSON-531056967 tempest-TenantUsagesNegativeTestJSON-531056967-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e560c35e-ed3c-4a5b-89f8-c6a682f0117a tempest-TenantUsagesNegativeTestJSON-531056967 tempest-TenantUsagesNegativeTestJSON-531056967-project-admin] Request method failure captured: Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-simple-tenant-usage/e1d39164afbd414aa3c4f56dd25fd387?start=2022-08-04T01%3A50%3A33.123146&end=2022-08-02T01%3A50%3A33.123146 HTTP/1.1 Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dRpUVNe_tLR3JWcjg_AG800ODw-n4lSMeUJdrRc8s2gMUnAP1ytAzKytgEKbKq_orCTWtAtCY8AxBv-tzaGjrToakWNJZFbVuAZ_VDQPNxLxnQpee8TYKNk2OTojZUXa3J-VGMsWw-C5KPcdbmNChpm1ZJzvi2oko8TLqVKekjAAeM Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 44eedaa1e57045d487a576117fc7196f Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-531056967 Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_44eedaa1e57045d487a576117fc7196f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/44eedaa1e57045d487a576117fc7196f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/44eedaa1e57045d487a576117fc7196f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/44eedaa1e57045d487a576117fc7196f"}]}] Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-531056967 Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 44eedaa1e57045d487a576117fc7196f Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-531056967 Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TenantUsagesNegativeTestJSON-531056967-project-admin Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 028e69b7e9664219992df003bc4615b7 Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-531056967-project-admin Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid start time. The start time cannot occur after the end time. Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'e1d39164afbd414aa3c4f56dd25fd387'} Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 03 01:50:34.174666 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:34.181231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e560c35e-ed3c-4a5b-89f8-c6a682f0117a tempest-TenantUsagesNegativeTestJSON-531056967 tempest-TenantUsagesNegativeTestJSON-531056967-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:50:34.182348 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e560c35e-ed3c-4a5b-89f8-c6a682f0117a tempest-TenantUsagesNegativeTestJSON-531056967 tempest-TenantUsagesNegativeTestJSON-531056967-project-admin] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage/e1d39164afbd414aa3c4f56dd25fd387?start=2022-08-04T01%3A50%3A33.123146&end=2022-08-02T01%3A50%3A33.123146" status: 400 len: 111 microversion: 2.1 time: 0.031724 Aug 03 01:50:34.183535 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 389/816] 10.222.0.67 () {58 vars in 1412 bytes} [Wed Aug 3 01:50:34 2022] GET /compute/v2.1/os-simple-tenant-usage/e1d39164afbd414aa3c4f56dd25fd387?start=2022-08-04T01%3A50%3A33.123146&end=2022-08-02T01%3A50%3A33.123146 => generated 111 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:50:34.189918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-5cbd9ce3-6f7d-4730-8cff-268fc6e28cdf req-c31642fb-61c0-46ee-b2b5-4335c2b0c824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb726272-286a-410e-8911-d328476b7755", "tag": "1fa2be26-8348-4842-ada3-bc3a43cd46ee"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:34.200848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:34.207418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5cbd9ce3-6f7d-4730-8cff-268fc6e28cdf req-c31642fb-61c0-46ee-b2b5-4335c2b0c824 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:34.208211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5cbd9ce3-6f7d-4730-8cff-268fc6e28cdf req-c31642fb-61c0-46ee-b2b5-4335c2b0c824 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:34.212107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Getting quotas for project 359b651cd3fd4147b171fed1c77eccb2. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:50:34.217131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Getting quotas for user 6600500765544c6188019442f54380ad and project 359b651cd3fd4147b171fed1c77eccb2. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:50:34.231460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Going to run 2 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:50:34.232633 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-5cbd9ce3-6f7d-4730-8cff-268fc6e28cdf req-c31642fb-61c0-46ee-b2b5-4335c2b0c824 service nova] Creating event network-changed:1fa2be26-8348-4842-ada3-bc3a43cd46ee for instance cb726272-286a-410e-8911-d328476b7755 on n-h1-826529-8 Aug 03 01:50:34.234526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: e4c48252-ca1c-46a8-906b-1d8f25be8898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:50:34.240566 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-5cbd9ce3-6f7d-4730-8cff-268fc6e28cdf req-c31642fb-61c0-46ee-b2b5-4335c2b0c824 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055566 Aug 03 01:50:34.241338 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 390/817] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:34.315463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=e4c48252-ca1c-46a8-906b-1d8f25be8898,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:50:34.420017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-610d74e3-eabc-4c83-b079-0d554923598e tempest-TenantUsagesNegativeTestJSON-1424192887 tempest-TenantUsagesNegativeTestJSON-1424192887-project] Calling method '.version_select at 0x7f5b13987670>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:34.425371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-610d74e3-eabc-4c83-b079-0d554923598e tempest-TenantUsagesNegativeTestJSON-1424192887 tempest-TenantUsagesNegativeTestJSON-1424192887-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '346687d935e34f738a3b68347f0ceb64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1d39164afbd414aa3c4f56dd25fd387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-610d74e3-eabc-4c83-b079-0d554923598e tempest-TenantUsagesNegativeTestJSON-1424192887 tempest-TenantUsagesNegativeTestJSON-1424192887-project] Request method failure captured: Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-02T01%3A50%3A33.123146&end=2022-08-04T01%3A50%3A33.123146&detailed=1 HTTP/1.1 Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dRnBXeQe6wUCijbr0ICQYtHCn2T28GW7pTU5uQz9OLrZtr_8vXwHXMzc5zPaMOW4WvST82aBRZnjpoSrr6HGAIdrFaNOmzPSOr3RsS1GoURlPnl4Wcz7kl8GT6jVq2kET7mrUBNoVN2hUcfXOXowGIQ4hhh_CU_bM9l6o502fhgUaw Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: e1d39164afbd414aa3c4f56dd25fd387 Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1424192887 Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e1d39164afbd414aa3c4f56dd25fd387", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e1d39164afbd414aa3c4f56dd25fd387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e1d39164afbd414aa3c4f56dd25fd387"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e1d39164afbd414aa3c4f56dd25fd387"}]}] Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1424192887 Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: e1d39164afbd414aa3c4f56dd25fd387 Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1424192887 Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TenantUsagesNegativeTestJSON-1424192887-project Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 346687d935e34f738a3b68347f0ceb64 Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1424192887-project Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: action_args: {} Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:50:34.426736 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:50:34.432515 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:50:34.432515 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 03 01:50:34.432515 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:34.432515 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:34.432515 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:34.432515 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:34.432515 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:34.432515 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:34.432515 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:50:34.432515 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:50:34.432515 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 03 01:50:34.432515 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:34.435465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-610d74e3-eabc-4c83-b079-0d554923598e tempest-TenantUsagesNegativeTestJSON-1424192887 tempest-TenantUsagesNegativeTestJSON-1424192887-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:50:34.437476 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-610d74e3-eabc-4c83-b079-0d554923598e tempest-TenantUsagesNegativeTestJSON-1424192887 tempest-TenantUsagesNegativeTestJSON-1424192887-project] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-02T01%3A50%3A33.123146&end=2022-08-04T01%3A50%3A33.123146&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.194670 Aug 03 01:50:34.438216 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 391/818] 10.222.0.67 () {58 vars in 1335 bytes} [Wed Aug 3 01:50:34 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-02T01%3A50%3A33.123146&end=2022-08-04T01%3A50%3A33.123146&detailed=1 => generated 123 bytes in 196 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:50:34.453797 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-71d97d41-acdb-4e73-b7b5-810d21f5c19e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.540183 Aug 03 01:50:34.454018 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 428/819] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:50:32 2022] POST /compute/v2.1/servers => generated 32 bytes in 1542 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 03 01:50:34.479886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-890ca487-b4c9-4277-bd59-8663474ab13e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:34.493288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-890ca487-b4c9-4277-bd59-8663474ab13e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:34.494208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-890ca487-b4c9-4277-bd59-8663474ab13e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Searching by: {'deleted': False, 'project_id': '359b651cd3fd4147b171fed1c77eccb2'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:50:34.527447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-890ca487-b4c9-4277-bd59-8663474ab13e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:34.527745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-890ca487-b4c9-4277-bd59-8663474ab13e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:34.535262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-890ca487-b4c9-4277-bd59-8663474ab13e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:34.535919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-890ca487-b4c9-4277-bd59-8663474ab13e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:34.571216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fe748f48-9275-4d58-9e38-4955040e34d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:34.572621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fe748f48-9275-4d58-9e38-4955040e34d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:34.585338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe748f48-9275-4d58-9e38-4955040e34d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:34.588176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-890ca487-b4c9-4277-bd59-8663474ab13e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:50:34.588903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe748f48-9275-4d58-9e38-4955040e34d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:34.591895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe748f48-9275-4d58-9e38-4955040e34d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:34.592711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe748f48-9275-4d58-9e38-4955040e34d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:34.645387 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-890ca487-b4c9-4277-bd59-8663474ab13e tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.171788 Aug 03 01:50:34.650954 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 392/820] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 3 01:50:34 2022] GET /compute/v2.1/servers => generated 1335 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:34.664084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f644903a-dc1a-49a9-a794-e4ab7603ab2b tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:34.664806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f644903a-dc1a-49a9-a794-e4ab7603ab2b tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:35.627006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f644903a-dc1a-49a9-a794-e4ab7603ab2b tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:35.644719 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f644903a-dc1a-49a9-a794-e4ab7603ab2b tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8" status: 200 len: 1217 microversion: 2.1 time: 0.985680 Aug 03 01:50:35.645707 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 393/821] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:34 2022] GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8 => generated 1217 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:35.657378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9d83b8df-9c16-484e-957a-1799d958f721 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:35.658234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9d83b8df-9c16-484e-957a-1799d958f721 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:35.675776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d83b8df-9c16-484e-957a-1799d958f721 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:35.676475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d83b8df-9c16-484e-957a-1799d958f721 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:35.677437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d83b8df-9c16-484e-957a-1799d958f721 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:35.677869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d83b8df-9c16-484e-957a-1799d958f721 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:36.253294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fe748f48-9275-4d58-9e38-4955040e34d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:36.285496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fe748f48-9275-4d58-9e38-4955040e34d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:36.291366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fe748f48-9275-4d58-9e38-4955040e34d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:36.298509 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fe748f48-9275-4d58-9e38-4955040e34d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1568 microversion: 2.25 time: 1.727474 Aug 03 01:50:36.299912 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 429/822] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:34 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1568 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:36.317160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9f1e5d33-ec2e-4106-bae6-ba759dac9838 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Calling method '.version_select at 0x7f5b2214fc10>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:36.324513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f1e5d33-ec2e-4106-bae6-ba759dac9838 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:36.325930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f1e5d33-ec2e-4106-bae6-ba759dac9838 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:36.335070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9d83b8df-9c16-484e-957a-1799d958f721 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:36.349446 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9d83b8df-9c16-484e-957a-1799d958f721 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1504 microversion: 2.1 time: 0.701767 Aug 03 01:50:36.351628 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 394/823] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:35 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1504 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:36.360109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-321d3eae-c876-47ce-84b0-2c51da638f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:36.366675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-321d3eae-c876-47ce-84b0-2c51da638f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:36.383060 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9f1e5d33-ec2e-4106-bae6-ba759dac9838 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.077213 Aug 03 01:50:36.384618 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 430/824] 10.222.0.67 () {58 vars in 1143 bytes} [Wed Aug 3 01:50:36 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:36.390774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-321d3eae-c876-47ce-84b0-2c51da638f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:36.392095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-321d3eae-c876-47ce-84b0-2c51da638f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:36.394844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-321d3eae-c876-47ce-84b0-2c51da638f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:36.412568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-321d3eae-c876-47ce-84b0-2c51da638f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:36.419804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-4b7e8180-70db-421b-8a11-430d7730d0de req-f8df0b68-da43-4bfa-8814-c8876ce0e10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "297a1ee8-52ab-4794-9923-1c4603d93775", "tag": "290be87d-e492-4cca-9d33-ac2f3145deee"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:36.457046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4b7e8180-70db-421b-8a11-430d7730d0de req-f8df0b68-da43-4bfa-8814-c8876ce0e10f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:36.457426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4b7e8180-70db-421b-8a11-430d7730d0de req-f8df0b68-da43-4bfa-8814-c8876ce0e10f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:36.522600 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-4b7e8180-70db-421b-8a11-430d7730d0de req-f8df0b68-da43-4bfa-8814-c8876ce0e10f service nova] Creating event network-changed:290be87d-e492-4cca-9d33-ac2f3145deee for instance 297a1ee8-52ab-4794-9923-1c4603d93775 on n-h2-826529-8 Aug 03 01:50:36.598610 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-4b7e8180-70db-421b-8a11-430d7730d0de req-f8df0b68-da43-4bfa-8814-c8876ce0e10f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209313 Aug 03 01:50:36.610521 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 431/825] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:36.646305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-425f3c8a-a0ea-4586-a096-a07ab3abbcd0 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:36.684859 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-425f3c8a-a0ea-4586-a096-a07ab3abbcd0 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.069240 Aug 03 01:50:36.689351 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 432/826] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:50:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:36.709492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8eee4e34-c986-46ff-9252-58cdbe5afec0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:36.710155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8eee4e34-c986-46ff-9252-58cdbe5afec0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:36.729810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8eee4e34-c986-46ff-9252-58cdbe5afec0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:36.730372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8eee4e34-c986-46ff-9252-58cdbe5afec0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:36.731543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8eee4e34-c986-46ff-9252-58cdbe5afec0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:36.735795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8eee4e34-c986-46ff-9252-58cdbe5afec0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:36.925010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8eee4e34-c986-46ff-9252-58cdbe5afec0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:36.933546 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8eee4e34-c986-46ff-9252-58cdbe5afec0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8" status: 200 len: 1269 microversion: 2.1 time: 0.243076 Aug 03 01:50:36.939123 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 433/827] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:36 2022] GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8 => generated 1269 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:36.950682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b03675f6-68e2-46e8-b3cb-9dd95e46eb01 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2105606702", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:36.953768 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:50:36.953768 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:50:36.993190 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b03675f6-68e2-46e8-b3cb-9dd95e46eb01 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.052698 Aug 03 01:50:37.001539 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 434/828] 10.222.0.67 () {60 vars in 1146 bytes} [Wed Aug 3 01:50:36 2022] POST /compute/v2.1/flavors => generated 499 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:37.016132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3c9321e4-b471-4299-bccd-0e390a1794d0 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:37.039087 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3c9321e4-b471-4299-bccd-0e390a1794d0 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036243 Aug 03 01:50:37.056407 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 435/829] 10.222.0.67 () {58 vars in 1182 bytes} [Wed Aug 3 01:50:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:50:37.234099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-985409913", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "dbac6da4-4561-4206-888c-2b5f33034b4a"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:37.297238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:50:37.528208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-321d3eae-c876-47ce-84b0-2c51da638f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:37.550029 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-321d3eae-c876-47ce-84b0-2c51da638f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 200 len: 1588 microversion: 2.1 time: 1.194932 Aug 03 01:50:37.551444 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 395/830] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:36 2022] GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 1588 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:37.561621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fe97bed1-849d-4654-be9d-649830c430e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:37.562867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fe97bed1-849d-4654-be9d-649830c430e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:37.574718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe97bed1-849d-4654-be9d-649830c430e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:37.575605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe97bed1-849d-4654-be9d-649830c430e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:37.577802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe97bed1-849d-4654-be9d-649830c430e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:37.578822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe97bed1-849d-4654-be9d-649830c430e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:38.432324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fe97bed1-849d-4654-be9d-649830c430e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:38.468969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fe97bed1-849d-4654-be9d-649830c430e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:38.475944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fe97bed1-849d-4654-be9d-649830c430e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:38.487219 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fe97bed1-849d-4654-be9d-649830c430e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1568 microversion: 2.25 time: 0.931045 Aug 03 01:50:38.489878 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 396/831] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:37 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1568 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:38.505458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e398f88e-6913-45be-85ac-99df53e68c51 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:38.510574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e398f88e-6913-45be-85ac-99df53e68c51 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:38.527584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:38.530257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e398f88e-6913-45be-85ac-99df53e68c51 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:38.543184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e398f88e-6913-45be-85ac-99df53e68c51 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:38.544760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e398f88e-6913-45be-85ac-99df53e68c51 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:38.545815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e398f88e-6913-45be-85ac-99df53e68c51 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:38.642728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:50:38.644089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:50:38.645023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:50:38.646051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:50:38.646730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:50:38.665822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:38.667879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:38.671569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:38.674174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:38.729743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Getting quotas for project 6e247e7134ad41bfa92b6eff8111c86e. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:50:38.736536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Getting quotas for user 241ed53f42f84abc8efc7edb5f41f6ed and project 6e247e7134ad41bfa92b6eff8111c86e. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:50:38.752308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:50:38.754922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:50:38.918860 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-936959d9-5af6-480f-8aba-7740acf306f8 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689664 Aug 03 01:50:38.919585 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 436/832] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:50:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 01:50:38.954925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-84f49718-5c2c-4838-9bb1-3f93b525d757 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:38.956116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-84f49718-5c2c-4838-9bb1-3f93b525d757 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:38.991323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84f49718-5c2c-4838-9bb1-3f93b525d757 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:38.994352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84f49718-5c2c-4838-9bb1-3f93b525d757 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:38.994947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84f49718-5c2c-4838-9bb1-3f93b525d757 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:38.995430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84f49718-5c2c-4838-9bb1-3f93b525d757 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:39.293753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e398f88e-6913-45be-85ac-99df53e68c51 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:39.300106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-84f49718-5c2c-4838-9bb1-3f93b525d757 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:39.306344 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e398f88e-6913-45be-85ac-99df53e68c51 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1504 microversion: 2.1 time: 0.812604 Aug 03 01:50:39.307622 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 397/833] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:38 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1504 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:39.323724 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-84f49718-5c2c-4838-9bb1-3f93b525d757 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8" status: 200 len: 1275 microversion: 2.1 time: 0.396446 Aug 03 01:50:39.326888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-b189824f-4413-49d6-9be2-4aad2d51efd0 req-0276187d-bd8d-4743-b107-f468a3f8828b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e67dfa9-cf64-4603-9644-f7162e4e869d", "name": "network-vif-deleted", "tag": "0c081b64-9735-4fa7-883e-398c4753226e"}, {"server_uuid": "b164a45c-f12c-411c-8a2a-0680571316dc", "name": "network-vif-deleted", "tag": "f87bb68d-4e20-4a65-91db-362ddfcdec29"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:39.340789 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 437/834] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:38 2022] GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8 => generated 1275 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:39.344113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b189824f-4413-49d6-9be2-4aad2d51efd0 req-0276187d-bd8d-4743-b107-f468a3f8828b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:39.345024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b189824f-4413-49d6-9be2-4aad2d51efd0 req-0276187d-bd8d-4743-b107-f468a3f8828b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:39.347382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f308c84c-2656-4e2a-80e9-6e4865b6fee5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:39.352914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f308c84c-2656-4e2a-80e9-6e4865b6fee5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:39.380807 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-b189824f-4413-49d6-9be2-4aad2d51efd0 req-0276187d-bd8d-4743-b107-f468a3f8828b service nova] Creating event network-vif-deleted:0c081b64-9735-4fa7-883e-398c4753226e for instance 6e67dfa9-cf64-4603-9644-f7162e4e869d on n-h2-826529-8 Aug 03 01:50:39.383703 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-b189824f-4413-49d6-9be2-4aad2d51efd0 req-0276187d-bd8d-4743-b107-f468a3f8828b service nova] Creating event network-vif-deleted:f87bb68d-4e20-4a65-91db-362ddfcdec29 for instance b164a45c-f12c-411c-8a2a-0680571316dc on n-h1-826529-8 Aug 03 01:50:39.417239 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-b189824f-4413-49d6-9be2-4aad2d51efd0 req-0276187d-bd8d-4743-b107-f468a3f8828b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.108165 Aug 03 01:50:39.419379 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 398/835] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:39.518189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f308c84c-2656-4e2a-80e9-6e4865b6fee5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:39.527618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b59add35-f3ce-4fbf-9152-08067a43ed42 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:39.528982 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b59add35-f3ce-4fbf-9152-08067a43ed42 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:39.539287 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f308c84c-2656-4e2a-80e9-6e4865b6fee5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1278 microversion: 2.1 time: 0.194825 Aug 03 01:50:39.546292 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 438/836] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:39 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1278 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:39.562755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b59add35-f3ce-4fbf-9152-08067a43ed42 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:39.564526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b59add35-f3ce-4fbf-9152-08067a43ed42 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:39.567698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b59add35-f3ce-4fbf-9152-08067a43ed42 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:39.568529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b59add35-f3ce-4fbf-9152-08067a43ed42 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:39.822031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b59add35-f3ce-4fbf-9152-08067a43ed42 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:39.832657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b59add35-f3ce-4fbf-9152-08067a43ed42 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:39.834447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b59add35-f3ce-4fbf-9152-08067a43ed42 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:39.836632 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b59add35-f3ce-4fbf-9152-08067a43ed42 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1568 microversion: 2.25 time: 0.321382 Aug 03 01:50:39.852608 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 399/837] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:39 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1568 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:50:40.335863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4e79d9bf-f556-400e-89d3-06b9e3916609 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:40.342526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4e79d9bf-f556-400e-89d3-06b9e3916609 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:40.345562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-20251906-4636-47bf-937e-4ab6da1a3923 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:40.346205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-20251906-4636-47bf-937e-4ab6da1a3923 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:40.353886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e79d9bf-f556-400e-89d3-06b9e3916609 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:40.354712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e79d9bf-f556-400e-89d3-06b9e3916609 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:40.355919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e79d9bf-f556-400e-89d3-06b9e3916609 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:40.356576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e79d9bf-f556-400e-89d3-06b9e3916609 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:40.360529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20251906-4636-47bf-937e-4ab6da1a3923 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:40.360990 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20251906-4636-47bf-937e-4ab6da1a3923 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:40.361791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20251906-4636-47bf-937e-4ab6da1a3923 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:40.362237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20251906-4636-47bf-937e-4ab6da1a3923 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:41.217455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-20251906-4636-47bf-937e-4ab6da1a3923 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:41.219248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4e79d9bf-f556-400e-89d3-06b9e3916609 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:41.227036 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4e79d9bf-f556-400e-89d3-06b9e3916609 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1504 microversion: 2.1 time: 0.901485 Aug 03 01:50:41.227613 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 439/838] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:40 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1504 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:41.236801 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-20251906-4636-47bf-937e-4ab6da1a3923 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8" status: 200 len: 1317 microversion: 2.1 time: 0.896375 Aug 03 01:50:41.241675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ad651334-8e97-4756-8ed9-5874b69fa4c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:41.242581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ad651334-8e97-4756-8ed9-5874b69fa4c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:41.243300 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 400/839] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:40 2022] GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8 => generated 1317 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:41.250428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-df80a691-9791-43f2-9c3a-002a08e647ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:41.251295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-df80a691-9791-43f2-9c3a-002a08e647ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:41.258465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df80a691-9791-43f2-9c3a-002a08e647ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:41.259187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df80a691-9791-43f2-9c3a-002a08e647ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:41.259572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad651334-8e97-4756-8ed9-5874b69fa4c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:41.260026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad651334-8e97-4756-8ed9-5874b69fa4c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:41.260516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df80a691-9791-43f2-9c3a-002a08e647ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:41.260804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad651334-8e97-4756-8ed9-5874b69fa4c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:41.260961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df80a691-9791-43f2-9c3a-002a08e647ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:41.261240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad651334-8e97-4756-8ed9-5874b69fa4c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:41.448388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ad651334-8e97-4756-8ed9-5874b69fa4c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:41.457317 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ad651334-8e97-4756-8ed9-5874b69fa4c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1336 microversion: 2.1 time: 0.220227 Aug 03 01:50:41.457909 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 440/840] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:41 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1336 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:41.721391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-df80a691-9791-43f2-9c3a-002a08e647ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:41.744530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-df80a691-9791-43f2-9c3a-002a08e647ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:41.750215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-df80a691-9791-43f2-9c3a-002a08e647ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:41.774699 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-df80a691-9791-43f2-9c3a-002a08e647ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1568 microversion: 2.25 time: 0.528372 Aug 03 01:50:41.782320 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 401/841] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:41 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1568 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:42.028312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-b663fb30-b41d-459b-a997-7eb709ac7459 req-873f3943-e13d-4612-9dff-98224b8a1ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead43f0d-1799-4bb2-832f-72d69c006cc8", "tag": "e706e69d-4b6a-481d-8d64-a782a42d4cd4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:42.070802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b663fb30-b41d-459b-a997-7eb709ac7459 req-873f3943-e13d-4612-9dff-98224b8a1ea7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:42.074567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b663fb30-b41d-459b-a997-7eb709ac7459 req-873f3943-e13d-4612-9dff-98224b8a1ea7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:42.106052 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-b663fb30-b41d-459b-a997-7eb709ac7459 req-873f3943-e13d-4612-9dff-98224b8a1ea7 service nova] Creating event network-changed:e706e69d-4b6a-481d-8d64-a782a42d4cd4 for instance ead43f0d-1799-4bb2-832f-72d69c006cc8 on n-h2-826529-8 Aug 03 01:50:42.117461 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-b663fb30-b41d-459b-a997-7eb709ac7459 req-873f3943-e13d-4612-9dff-98224b8a1ea7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093061 Aug 03 01:50:42.119266 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 441/842] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:42.248711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4558f4e2-a13d-4930-9491-35c62fb683ca tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:42.249397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4558f4e2-a13d-4930-9491-35c62fb683ca tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:42.261039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4558f4e2-a13d-4930-9491-35c62fb683ca tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:42.261489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4558f4e2-a13d-4930-9491-35c62fb683ca tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:42.262270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4558f4e2-a13d-4930-9491-35c62fb683ca tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:42.265596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0a2dc861-b81b-453c-b976-f56cc0681c31 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:42.266321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4558f4e2-a13d-4930-9491-35c62fb683ca tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:42.266450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0a2dc861-b81b-453c-b976-f56cc0681c31 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:42.286370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a2dc861-b81b-453c-b976-f56cc0681c31 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:42.287099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a2dc861-b81b-453c-b976-f56cc0681c31 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:42.289081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a2dc861-b81b-453c-b976-f56cc0681c31 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:42.289757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a2dc861-b81b-453c-b976-f56cc0681c31 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:42.736197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a2dc861-b81b-453c-b976-f56cc0681c31 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:42.745815 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0a2dc861-b81b-453c-b976-f56cc0681c31 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8" status: 200 len: 1317 microversion: 2.1 time: 0.485569 Aug 03 01:50:42.760614 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 442/843] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:42 2022] GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:50:42.766446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e009d7f4-a1d5-4e44-94a1-5c1be9df206a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:42.767425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e009d7f4-a1d5-4e44-94a1-5c1be9df206a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:42.774880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e009d7f4-a1d5-4e44-94a1-5c1be9df206a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:42.775597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e009d7f4-a1d5-4e44-94a1-5c1be9df206a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:42.776262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4558f4e2-a13d-4930-9491-35c62fb683ca tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:42.777029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e009d7f4-a1d5-4e44-94a1-5c1be9df206a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:42.777683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e009d7f4-a1d5-4e44-94a1-5c1be9df206a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:42.786608 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4558f4e2-a13d-4930-9491-35c62fb683ca tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1504 microversion: 2.1 time: 0.541628 Aug 03 01:50:42.792036 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 402/844] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:42 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1504 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:42.822689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d1f1e0b8-2f11-4c7e-a377-266c02200ac0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:42.823630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d1f1e0b8-2f11-4c7e-a377-266c02200ac0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:42.837705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1f1e0b8-2f11-4c7e-a377-266c02200ac0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:42.838588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1f1e0b8-2f11-4c7e-a377-266c02200ac0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:42.839765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1f1e0b8-2f11-4c7e-a377-266c02200ac0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:42.841001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1f1e0b8-2f11-4c7e-a377-266c02200ac0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:42.925522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e009d7f4-a1d5-4e44-94a1-5c1be9df206a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:42.937898 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e009d7f4-a1d5-4e44-94a1-5c1be9df206a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1336 microversion: 2.1 time: 0.175828 Aug 03 01:50:42.939599 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 443/845] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:42 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1336 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:43.138186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d1f1e0b8-2f11-4c7e-a377-266c02200ac0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:43.151235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d1f1e0b8-2f11-4c7e-a377-266c02200ac0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:43.161491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d1f1e0b8-2f11-4c7e-a377-266c02200ac0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:43.163169 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d1f1e0b8-2f11-4c7e-a377-266c02200ac0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1568 microversion: 2.25 time: 0.345870 Aug 03 01:50:43.167339 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 403/846] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:42 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1568 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:43.317371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0495cd90-adb7-43a4-ad9f-e068a20d009e tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:43.330121 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0495cd90-adb7-43a4-ad9f-e068a20d009e tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.257457 Aug 03 01:50:43.331287 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 444/847] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:50:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:50:43.345230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-98d9b92b-6700-4c27-a477-25d45a5043b2 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:43.384889 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-98d9b92b-6700-4c27-a477-25d45a5043b2 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors" status: 200 len: 3399 microversion: 2.1 time: 0.044410 Aug 03 01:50:43.385918 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 404/848] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 3 01:50:43 2022] GET /compute/v2.1/flavors => generated 3399 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:43.406283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ae5454d6-d98b-4c02-8d63-f26773a9fefd tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:43.416087 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ae5454d6-d98b-4c02-8d63-f26773a9fefd tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015033 Aug 03 01:50:43.416853 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 405/849] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:50:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:43.433811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4b5d36a8-ba5e-4213-a6bb-b0799fb10024 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:43.447320 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4b5d36a8-ba5e-4213-a6bb-b0799fb10024 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021145 Aug 03 01:50:43.448242 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 406/850] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:50:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:43.461932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9e02011a-7215-4119-aab5-7b9835ea9963 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:43.479496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-937299805", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "297ffbc2-8a68-402c-98a8-069cd6f5baf6"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:43.496799 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9e02011a-7215-4119-aab5-7b9835ea9963 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.040243 Aug 03 01:50:43.498139 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 407/851] 10.222.0.67 () {58 vars in 1165 bytes} [Wed Aug 3 01:50:43 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:50:43.524633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a5909d58-97ca-4353-a26d-1506475e265c tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:43.543792 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a5909d58-97ca-4353-a26d-1506475e265c tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030626 Aug 03 01:50:43.544383 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 408/852] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:50:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:50:43.559266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8a864fee-5c6c-4a5b-b050-7b3831cc5121 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:43.566811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] validate_networks() for [('297ffbc2-8a68-402c-98a8-069cd6f5baf6', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:50:43.596331 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8a864fee-5c6c-4a5b-b050-7b3831cc5121 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.041438 Aug 03 01:50:43.607644 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 409/853] 10.222.0.67 () {58 vars in 1169 bytes} [Wed Aug 3 01:50:43 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:43.619791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e87e3134-5cca-4e87-bb9f-6953a7c68e1b tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:43.648473 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e87e3134-5cca-4e87-bb9f-6953a7c68e1b tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.034815 Aug 03 01:50:43.660531 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 410/854] 10.222.0.67 () {58 vars in 1161 bytes} [Wed Aug 3 01:50:43 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:43.668562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-be1d981d-1539-4eb9-93e1-b3a8ea5d1cf8 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:43.680019 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-be1d981d-1539-4eb9-93e1-b3a8ea5d1cf8 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014419 Aug 03 01:50:43.683311 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 411/855] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:50:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:43.695450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bad746a6-e480-43d3-a26d-06bbcb5d7fda tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:43.754717 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bad746a6-e480-43d3-a26d-06bbcb5d7fda tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2989 microversion: 2.1 time: 0.063981 Aug 03 01:50:43.755729 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 412/856] 10.222.0.67 () {58 vars in 1167 bytes} [Wed Aug 3 01:50:43 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2989 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:50:43.770814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fd39acb7-dc6e-4316-aacc-53c2a32cb781 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:43.771599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fd39acb7-dc6e-4316-aacc-53c2a32cb781 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:43.778515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd39acb7-dc6e-4316-aacc-53c2a32cb781 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:43.779787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd39acb7-dc6e-4316-aacc-53c2a32cb781 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:43.780675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd39acb7-dc6e-4316-aacc-53c2a32cb781 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:43.781384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd39acb7-dc6e-4316-aacc-53c2a32cb781 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:44.111229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fd39acb7-dc6e-4316-aacc-53c2a32cb781 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:44.141130 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fd39acb7-dc6e-4316-aacc-53c2a32cb781 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8" status: 200 len: 1317 microversion: 2.1 time: 0.374708 Aug 03 01:50:44.142930 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 413/857] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:43 2022] GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8 => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:44.159718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2f2c9b2f-071b-4137-9b63-008af1ce9d46 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:44.173345 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2f2c9b2f-071b-4137-9b63-008af1ce9d46 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027643 Aug 03 01:50:44.174375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:50:44.174879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:50:44.175523 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 414/858] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:50:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:44.182703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:50:44.184457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:50:44.185876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:50:44.189137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a375e1d8-926d-40c2-ad06-567b4dac8842 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:44.190311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a375e1d8-926d-40c2-ad06-567b4dac8842 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:44.197558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a375e1d8-926d-40c2-ad06-567b4dac8842 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:44.199177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a375e1d8-926d-40c2-ad06-567b4dac8842 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:44.200595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a375e1d8-926d-40c2-ad06-567b4dac8842 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:44.201682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:44.201817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a375e1d8-926d-40c2-ad06-567b4dac8842 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:44.203904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:44.205105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:44.205780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:44.239796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Getting quotas for project 69aa4c52c59841f59db580a6dca4446b. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:50:44.245607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Getting quotas for user 4d688a22fbec41ba9067c6290d70d376 and project 69aa4c52c59841f59db580a6dca4446b. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:50:44.266346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:50:44.270429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:50:44.379634 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5f327d23-b521-425c-adca-302716c9bb89 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.011842 Aug 03 01:50:44.387189 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 445/859] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:50:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 01:50:44.393274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-553a1701-3a3c-41ab-be7f-c96525036e46 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:44.394205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-553a1701-3a3c-41ab-be7f-c96525036e46 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:44.402562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-553a1701-3a3c-41ab-be7f-c96525036e46 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:44.403266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-553a1701-3a3c-41ab-be7f-c96525036e46 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:44.404967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-553a1701-3a3c-41ab-be7f-c96525036e46 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:44.421673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-553a1701-3a3c-41ab-be7f-c96525036e46 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:44.460170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a375e1d8-926d-40c2-ad06-567b4dac8842 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:44.462451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:44.476106 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a375e1d8-926d-40c2-ad06-567b4dac8842 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1494 microversion: 2.1 time: 0.299145 Aug 03 01:50:44.482994 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 415/860] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:44 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1494 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:44.482994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fcb396d6-e0d2-4ad0-836f-3a8b19b0a7e6 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:44.527047 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fcb396d6-e0d2-4ad0-836f-3a8b19b0a7e6 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.048901 Aug 03 01:50:44.527655 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 416/861] 10.222.0.67 () {58 vars in 1144 bytes} [Wed Aug 3 01:50:44 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:44.543148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8e8ef1ed-4c4a-4daa-94a6-71e4776ac999 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:44.544582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8e8ef1ed-4c4a-4daa-94a6-71e4776ac999 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:44.557372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:44.570328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e8ef1ed-4c4a-4daa-94a6-71e4776ac999 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:44.572256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e8ef1ed-4c4a-4daa-94a6-71e4776ac999 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:44.573104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e8ef1ed-4c4a-4daa-94a6-71e4776ac999 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:44.575044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e8ef1ed-4c4a-4daa-94a6-71e4776ac999 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:44.736986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-553a1701-3a3c-41ab-be7f-c96525036e46 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:44.765254 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-553a1701-3a3c-41ab-be7f-c96525036e46 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1378 microversion: 2.1 time: 0.376601 Aug 03 01:50:44.766362 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 446/862] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:44 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1378 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:44.782016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3776bc43-e9da-4226-b3c9-30604516cb00 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:44.782729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3776bc43-e9da-4226-b3c9-30604516cb00 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:44.868701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3776bc43-e9da-4226-b3c9-30604516cb00 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:44.883029 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3776bc43-e9da-4226-b3c9-30604516cb00 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1231 microversion: 2.1 time: 0.115426 Aug 03 01:50:44.896486 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 447/863] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:44 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1231 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:44.901418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-236fb882-3e0b-4135-8edf-025d2ede0b5e tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '.version_select at 0x7f5b13352310>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:44.910179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-236fb882-3e0b-4135-8edf-025d2ede0b5e tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:44.912998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-236fb882-3e0b-4135-8edf-025d2ede0b5e tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:44.927010 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-236fb882-3e0b-4135-8edf-025d2ede0b5e tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.029165 Aug 03 01:50:44.936984 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 448/864] 10.222.0.67 () {58 vars in 1143 bytes} [Wed Aug 3 01:50:44 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:44.952858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-894c6f3d-e904-451c-9b7a-dbeeefec67c2 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:44.962495 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-894c6f3d-e904-451c-9b7a-dbeeefec67c2 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013653 Aug 03 01:50:44.963917 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 449/865] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:50:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:44.969201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5e70e7f-ccad-405f-9f1e-c2166ed1337a tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:44.970140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5e70e7f-ccad-405f-9f1e-c2166ed1337a tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:44.977683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5e70e7f-ccad-405f-9f1e-c2166ed1337a tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:44.978430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5e70e7f-ccad-405f-9f1e-c2166ed1337a tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:44.979480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5e70e7f-ccad-405f-9f1e-c2166ed1337a tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:44.980193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5e70e7f-ccad-405f-9f1e-c2166ed1337a tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:45.047522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8e8ef1ed-4c4a-4daa-94a6-71e4776ac999 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:45.058298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8e8ef1ed-4c4a-4daa-94a6-71e4776ac999 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:45.064653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8e8ef1ed-4c4a-4daa-94a6-71e4776ac999 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:45.068250 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8e8ef1ed-4c4a-4daa-94a6-71e4776ac999 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1568 microversion: 2.25 time: 0.539632 Aug 03 01:50:45.070548 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 417/866] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:44 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1568 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:45.081517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-84c70a20-dfa6-4cb8-abaf-ff0c72c4736b tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:45.132291 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-84c70a20-dfa6-4cb8-abaf-ff0c72c4736b tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.058392 Aug 03 01:50:45.144669 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 418/867] 10.222.0.67 () {58 vars in 1148 bytes} [Wed Aug 3 01:50:45 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:45.151730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-94bf07d8-5cae-423c-ae4e-0934b58189db tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:45.182408 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-94bf07d8-5cae-423c-ae4e-0934b58189db tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.036335 Aug 03 01:50:45.192708 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 419/868] 10.222.0.67 () {58 vars in 1140 bytes} [Wed Aug 3 01:50:45 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:45.193365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1c9af4e7-47ed-43c0-ae29-147ce658aabc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:45.194112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1c9af4e7-47ed-43c0-ae29-147ce658aabc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:45.201350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c9af4e7-47ed-43c0-ae29-147ce658aabc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:45.201996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c9af4e7-47ed-43c0-ae29-147ce658aabc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:45.202800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c9af4e7-47ed-43c0-ae29-147ce658aabc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:45.203328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c9af4e7-47ed-43c0-ae29-147ce658aabc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:45.406539 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5e70e7f-ccad-405f-9f1e-c2166ed1337a tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1645 microversion: 2.1 time: 0.441340 Aug 03 01:50:45.411986 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 450/869] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:44 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1645 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:45.429231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8ce1f12a-e00f-4b0c-8d1f-aa7f61660948 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:45.458484 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8ce1f12a-e00f-4b0c-8d1f-aa7f61660948 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.045362 Aug 03 01:50:45.459090 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 451/870] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:50:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:45.474762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2861e338-7978-45c3-9e8c-2b237b1b905d tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:45.558587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:45.587729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1c9af4e7-47ed-43c0-ae29-147ce658aabc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:45.601152 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2861e338-7978-45c3-9e8c-2b237b1b905d tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1618 microversion: 2.1 time: 0.130265 Aug 03 01:50:45.601669 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 452/871] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:50:45 2022] GET /compute/v2.1/flavors?marker=452 => generated 1618 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:50:45.606669 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1c9af4e7-47ed-43c0-ae29-147ce658aabc tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8" status: 200 len: 1317 microversion: 2.1 time: 0.416458 Aug 03 01:50:45.607605 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 420/872] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:45 2022] GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8 => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:45.619314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-450a8615-1aaa-4d12-9c01-ab63bb72b7a5 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:45.700214 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-450a8615-1aaa-4d12-9c01-ab63bb72b7a5 tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 6309 microversion: 2.1 time: 0.083439 Aug 03 01:50:45.700962 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 453/873] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:50:45 2022] GET /compute/v2.1/flavors/detail => generated 6309 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:45.722693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-614325104", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "8587fddf-9abd-4c52-98e3-97c18dcab027"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:45.726663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f3a8d7d7-c57f-402b-a8d0-c904023fe05c tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:45.737629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:45.744396 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f3a8d7d7-c57f-402b-a8d0-c904023fe05c tempest-FlavorsV2TestJSON-1430198074 tempest-FlavorsV2TestJSON-1430198074-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021441 Aug 03 01:50:45.745297 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 454/874] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:50:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:50:45.786079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ca89fb4f-07c0-4db5-a093-6666686d4ed2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:45.786876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ca89fb4f-07c0-4db5-a093-6666686d4ed2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:45.801141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca89fb4f-07c0-4db5-a093-6666686d4ed2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:45.801509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca89fb4f-07c0-4db5-a093-6666686d4ed2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:45.802298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca89fb4f-07c0-4db5-a093-6666686d4ed2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:45.805908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca89fb4f-07c0-4db5-a093-6666686d4ed2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:45.851438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] validate_networks() for [('8587fddf-9abd-4c52-98e3-97c18dcab027', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:50:46.369970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ca89fb4f-07c0-4db5-a093-6666686d4ed2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:46.386636 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ca89fb4f-07c0-4db5-a093-6666686d4ed2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1378 microversion: 2.1 time: 0.604236 Aug 03 01:50:46.387540 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 455/875] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:45 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1378 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:50:46.399445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9d6be83f-be9c-4d26-b484-e3c3a87a7fe5 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:46.400286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9d6be83f-be9c-4d26-b484-e3c3a87a7fe5 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:46.409157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d6be83f-be9c-4d26-b484-e3c3a87a7fe5 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:46.409758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d6be83f-be9c-4d26-b484-e3c3a87a7fe5 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:46.410394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d6be83f-be9c-4d26-b484-e3c3a87a7fe5 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:46.410825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d6be83f-be9c-4d26-b484-e3c3a87a7fe5 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:46.657105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9d6be83f-be9c-4d26-b484-e3c3a87a7fe5 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:46.671638 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9d6be83f-be9c-4d26-b484-e3c3a87a7fe5 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1301 microversion: 2.1 time: 0.282905 Aug 03 01:50:46.672944 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 456/876] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:46 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1301 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:46.677765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d85e9675-1b0b-42da-b579-9a2215cfaac8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:46.687821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d85e9675-1b0b-42da-b579-9a2215cfaac8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:46.702145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d85e9675-1b0b-42da-b579-9a2215cfaac8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:46.706796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d85e9675-1b0b-42da-b579-9a2215cfaac8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:46.707674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d85e9675-1b0b-42da-b579-9a2215cfaac8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:46.708118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d85e9675-1b0b-42da-b579-9a2215cfaac8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:47.697933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d85e9675-1b0b-42da-b579-9a2215cfaac8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:47.713806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:50:47.714764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:50:47.715391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d85e9675-1b0b-42da-b579-9a2215cfaac8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:47.715683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:50:47.716248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:50:47.717031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:50:47.718935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d85e9675-1b0b-42da-b579-9a2215cfaac8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:47.721746 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d85e9675-1b0b-42da-b579-9a2215cfaac8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1568 microversion: 2.25 time: 1.047586 Aug 03 01:50:47.733464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:47.734097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:47.735114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:47.737801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:47.741432 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 457/877] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:46 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1568 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:47.747094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c04a06fb-9d53-4de2-97b2-fc31a260d538 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:47.748544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c04a06fb-9d53-4de2-97b2-fc31a260d538 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:47.764558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c04a06fb-9d53-4de2-97b2-fc31a260d538 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:47.765022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c04a06fb-9d53-4de2-97b2-fc31a260d538 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:47.765835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c04a06fb-9d53-4de2-97b2-fc31a260d538 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:47.766374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c04a06fb-9d53-4de2-97b2-fc31a260d538 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:47.783978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Getting quotas for project 5f232cf4e61b4213b592b2a020961630. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:50:47.789671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Getting quotas for user dd2c77c8ab314584939f1f580d5a6d14 and project 5f232cf4e61b4213b592b2a020961630. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:50:47.804210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:50:47.807128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:50:47.911793 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-323a2d2a-7071-478d-9a58-b1b74cb5289a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.193082 Aug 03 01:50:47.915694 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 421/878] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:50:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:50:47.925720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-70433ffc-b532-49ab-9cdc-a2644fa4c1e9 req-6dd6793a-8f3a-4eb8-8ad6-bf5fbea8b90e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c48252-ca1c-46a8-906b-1d8f25be8898", "tag": "5441ab3c-1396-4702-8184-6c69615da0c6"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:47.938984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-70433ffc-b532-49ab-9cdc-a2644fa4c1e9 req-6dd6793a-8f3a-4eb8-8ad6-bf5fbea8b90e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:47.940790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-70433ffc-b532-49ab-9cdc-a2644fa4c1e9 req-6dd6793a-8f3a-4eb8-8ad6-bf5fbea8b90e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:47.960975 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-70433ffc-b532-49ab-9cdc-a2644fa4c1e9 req-6dd6793a-8f3a-4eb8-8ad6-bf5fbea8b90e service nova] Creating event network-changed:5441ab3c-1396-4702-8184-6c69615da0c6 for instance e4c48252-ca1c-46a8-906b-1d8f25be8898 on n-h1-826529-8 Aug 03 01:50:47.989149 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-70433ffc-b532-49ab-9cdc-a2644fa4c1e9 req-6dd6793a-8f3a-4eb8-8ad6-bf5fbea8b90e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070554 Aug 03 01:50:47.992388 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 422/879] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:48.007521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2d63d856-f193-4a31-90f1-2bb2e6308284 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:48.008612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2d63d856-f193-4a31-90f1-2bb2e6308284 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:48.023205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d63d856-f193-4a31-90f1-2bb2e6308284 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:48.023919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d63d856-f193-4a31-90f1-2bb2e6308284 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:48.024737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d63d856-f193-4a31-90f1-2bb2e6308284 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:48.026445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d63d856-f193-4a31-90f1-2bb2e6308284 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:48.240029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c04a06fb-9d53-4de2-97b2-fc31a260d538 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:48.252211 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c04a06fb-9d53-4de2-97b2-fc31a260d538 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8" status: 200 len: 1317 microversion: 2.1 time: 0.509189 Aug 03 01:50:48.268785 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 458/880] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:47 2022] GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:48.289429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-53699c5e-5f70-4966-8a61-18dd1a70eaae tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:48.291568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-53699c5e-5f70-4966-8a61-18dd1a70eaae tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:48.321911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53699c5e-5f70-4966-8a61-18dd1a70eaae tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:48.322388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53699c5e-5f70-4966-8a61-18dd1a70eaae tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:48.323231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53699c5e-5f70-4966-8a61-18dd1a70eaae tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:48.323768 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53699c5e-5f70-4966-8a61-18dd1a70eaae tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:48.339338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2d63d856-f193-4a31-90f1-2bb2e6308284 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:48.348236 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2d63d856-f193-4a31-90f1-2bb2e6308284 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1378 microversion: 2.1 time: 0.353830 Aug 03 01:50:48.350225 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 423/881] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:47 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1378 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:48.360333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bc511d5e-e55c-4210-9cc5-e477f77cfdff tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:48.360945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bc511d5e-e55c-4210-9cc5-e477f77cfdff tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:48.494856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bc511d5e-e55c-4210-9cc5-e477f77cfdff tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:48.520198 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bc511d5e-e55c-4210-9cc5-e477f77cfdff tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1210 microversion: 2.1 time: 0.166273 Aug 03 01:50:48.532577 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 424/882] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:48 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1210 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:48.548755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-980907d2-eb70-497d-821a-bb9bbfb4f8d9 req-c697d575-c078-4d96-9ac6-e579ec465d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead43f0d-1799-4bb2-832f-72d69c006cc8", "name": "network-vif-plugged", "status": "completed", "tag": "e706e69d-4b6a-481d-8d64-a782a42d4cd4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:48.575417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-980907d2-eb70-497d-821a-bb9bbfb4f8d9 req-c697d575-c078-4d96-9ac6-e579ec465d21 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:48.576049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-980907d2-eb70-497d-821a-bb9bbfb4f8d9 req-c697d575-c078-4d96-9ac6-e579ec465d21 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:48.578556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-53699c5e-5f70-4966-8a61-18dd1a70eaae tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:48.587567 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-53699c5e-5f70-4966-8a61-18dd1a70eaae tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1289 microversion: 2.1 time: 0.317248 Aug 03 01:50:48.595390 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-980907d2-eb70-497d-821a-bb9bbfb4f8d9 req-c697d575-c078-4d96-9ac6-e579ec465d21 service nova] Creating event network-vif-plugged:e706e69d-4b6a-481d-8d64-a782a42d4cd4 for instance ead43f0d-1799-4bb2-832f-72d69c006cc8 on n-h2-826529-8 Aug 03 01:50:48.601557 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-980907d2-eb70-497d-821a-bb9bbfb4f8d9 req-c697d575-c078-4d96-9ac6-e579ec465d21 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067397 Aug 03 01:50:48.602672 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 425/883] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:48.606094 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 459/884] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:48 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1289 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:48.752897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6d6a420f-0a69-4e09-b0ce-969f73a20605 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:48.755124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6d6a420f-0a69-4e09-b0ce-969f73a20605 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:48.776564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d6a420f-0a69-4e09-b0ce-969f73a20605 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:48.777339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d6a420f-0a69-4e09-b0ce-969f73a20605 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:48.782450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d6a420f-0a69-4e09-b0ce-969f73a20605 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:48.783622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d6a420f-0a69-4e09-b0ce-969f73a20605 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:49.024682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6d6a420f-0a69-4e09-b0ce-969f73a20605 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:49.038971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6d6a420f-0a69-4e09-b0ce-969f73a20605 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:49.042594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6d6a420f-0a69-4e09-b0ce-969f73a20605 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:49.044106 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6d6a420f-0a69-4e09-b0ce-969f73a20605 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1568 microversion: 2.25 time: 0.300225 Aug 03 01:50:49.055090 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 426/885] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:48 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1568 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:49.286577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1b50c487-cdd5-4c01-b92d-9038169eeabd tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:49.287969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1b50c487-cdd5-4c01-b92d-9038169eeabd tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:49.308327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b50c487-cdd5-4c01-b92d-9038169eeabd tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:49.308758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b50c487-cdd5-4c01-b92d-9038169eeabd tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:49.309834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b50c487-cdd5-4c01-b92d-9038169eeabd tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:49.310880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b50c487-cdd5-4c01-b92d-9038169eeabd tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:49.366631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:49.380762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6fb3c16f-ce82-48bc-a68f-2b16d55a0ae0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:49.381409 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6fb3c16f-ce82-48bc-a68f-2b16d55a0ae0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:49.398195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fb3c16f-ce82-48bc-a68f-2b16d55a0ae0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:49.398752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fb3c16f-ce82-48bc-a68f-2b16d55a0ae0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:49.399777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fb3c16f-ce82-48bc-a68f-2b16d55a0ae0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:49.400271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fb3c16f-ce82-48bc-a68f-2b16d55a0ae0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:49.624704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1b50c487-cdd5-4c01-b92d-9038169eeabd tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:49.639548 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1b50c487-cdd5-4c01-b92d-9038169eeabd tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8" status: 200 len: 1317 microversion: 2.1 time: 0.358061 Aug 03 01:50:49.641218 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 460/886] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:49 2022] GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:49.649762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6fb3c16f-ce82-48bc-a68f-2b16d55a0ae0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:49.658742 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6fb3c16f-ce82-48bc-a68f-2b16d55a0ae0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1378 microversion: 2.1 time: 0.288330 Aug 03 01:50:49.659492 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 427/887] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:49 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1378 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:49.664127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-77d1967e-161d-4f93-a872-df72575e3f22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:49.665030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-77d1967e-161d-4f93-a872-df72575e3f22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:49.672691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77d1967e-161d-4f93-a872-df72575e3f22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:49.673418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77d1967e-161d-4f93-a872-df72575e3f22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:49.674304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77d1967e-161d-4f93-a872-df72575e3f22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:49.674834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77d1967e-161d-4f93-a872-df72575e3f22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:49.805253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-77d1967e-161d-4f93-a872-df72575e3f22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:49.814533 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-77d1967e-161d-4f93-a872-df72575e3f22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1206 microversion: 2.1 time: 0.153912 Aug 03 01:50:49.818581 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 428/888] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:49 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1206 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:49.829873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-90fc5245-4516-4cb6-8b84-cc05187339a6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:49.830764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-90fc5245-4516-4cb6-8b84-cc05187339a6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:49.853186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90fc5245-4516-4cb6-8b84-cc05187339a6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:49.855512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90fc5245-4516-4cb6-8b84-cc05187339a6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:49.864884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90fc5245-4516-4cb6-8b84-cc05187339a6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:49.865419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90fc5245-4516-4cb6-8b84-cc05187339a6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:49.901200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-19375001-5dba-4f58-a749-cd601dea1553 tempest-FlavorsV2NegativeTest-784175407 tempest-FlavorsV2NegativeTest-784175407-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:49.919246 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-19375001-5dba-4f58-a749-cd601dea1553 tempest-FlavorsV2NegativeTest-784175407 tempest-FlavorsV2NegativeTest-784175407-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.275368 Aug 03 01:50:49.921550 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 461/889] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:50:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:49.965452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-90fc5245-4516-4cb6-8b84-cc05187339a6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:49.978997 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-90fc5245-4516-4cb6-8b84-cc05187339a6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1289 microversion: 2.1 time: 0.159057 Aug 03 01:50:49.980322 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 429/890] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:49 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1289 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:50.036460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-7ee40b64-0e83-46f9-97cc-1e20732f72f5 req-39b77eb7-abe7-49be-84c1-6bc713038d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2ce9d3-8e0c-4981-951e-3d23d58de2c2", "tag": "aee6f3d7-e3c0-4569-9c1b-2cfe18a9f997"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:50.049313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7ee40b64-0e83-46f9-97cc-1e20732f72f5 req-39b77eb7-abe7-49be-84c1-6bc713038d19 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:50.049929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7ee40b64-0e83-46f9-97cc-1e20732f72f5 req-39b77eb7-abe7-49be-84c1-6bc713038d19 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:50.062409 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-7ee40b64-0e83-46f9-97cc-1e20732f72f5 req-39b77eb7-abe7-49be-84c1-6bc713038d19 service nova] Creating event network-changed:aee6f3d7-e3c0-4569-9c1b-2cfe18a9f997 for instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 on n-h1-826529-8 Aug 03 01:50:50.068375 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-7ee40b64-0e83-46f9-97cc-1e20732f72f5 req-39b77eb7-abe7-49be-84c1-6bc713038d19 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035595 Aug 03 01:50:50.069588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-62916629-8f7d-4761-aca9-91b293a4aee2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:50.069850 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 462/891] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:50.070200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-62916629-8f7d-4761-aca9-91b293a4aee2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:50.083534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62916629-8f7d-4761-aca9-91b293a4aee2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:50.084393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62916629-8f7d-4761-aca9-91b293a4aee2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:50.085730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62916629-8f7d-4761-aca9-91b293a4aee2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:50.086471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62916629-8f7d-4761-aca9-91b293a4aee2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:50.282925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-62916629-8f7d-4761-aca9-91b293a4aee2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:50.294705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-62916629-8f7d-4761-aca9-91b293a4aee2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:50.296503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-62916629-8f7d-4761-aca9-91b293a4aee2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:50.297701 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-62916629-8f7d-4761-aca9-91b293a4aee2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1558 microversion: 2.25 time: 0.232179 Aug 03 01:50:50.298269 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 430/892] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:50 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1558 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:50.321834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f28838cc-fb36-43d6-89e9-0f381dc6aa20 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '.version_select at 0x7f5b13c31280>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:50.327058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f28838cc-fb36-43d6-89e9-0f381dc6aa20 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:50.327811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f28838cc-fb36-43d6-89e9-0f381dc6aa20 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:50.338494 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f28838cc-fb36-43d6-89e9-0f381dc6aa20 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.021308 Aug 03 01:50:50.348957 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 463/893] 10.222.0.67 () {60 vars in 1184 bytes} [Wed Aug 3 01:50:50 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:50.355067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bb0d9af4-07e2-4787-9b07-560747e117ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:50.355831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bb0d9af4-07e2-4787-9b07-560747e117ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:50.363273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bb0d9af4-07e2-4787-9b07-560747e117ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:50.363992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bb0d9af4-07e2-4787-9b07-560747e117ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:50.367258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bb0d9af4-07e2-4787-9b07-560747e117ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:50.368102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bb0d9af4-07e2-4787-9b07-560747e117ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:50.538282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-bb0d9af4-07e2-4787-9b07-560747e117ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'services' on Instance uuid cb726272-286a-410e-8911-d328476b7755 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:50:50.585670 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bb0d9af4-07e2-4787-9b07-560747e117ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 2051 microversion: 2.25 time: 0.232341 Aug 03 01:50:50.589735 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 431/894] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:50 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 2051 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:50:50.662585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc33d06f-614c-420e-a96e-90e56a9e51b5 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:50.663636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fc33d06f-614c-420e-a96e-90e56a9e51b5 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:50.681296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e9659f92-7f99-4b9e-b62c-50c7236f4b48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:50.681933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e9659f92-7f99-4b9e-b62c-50c7236f4b48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:50.692644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc33d06f-614c-420e-a96e-90e56a9e51b5 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:50.694278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc33d06f-614c-420e-a96e-90e56a9e51b5 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:50.696491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc33d06f-614c-420e-a96e-90e56a9e51b5 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:50.699709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9659f92-7f99-4b9e-b62c-50c7236f4b48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:50.700176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9659f92-7f99-4b9e-b62c-50c7236f4b48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:50.701129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc33d06f-614c-420e-a96e-90e56a9e51b5 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:50.714438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9659f92-7f99-4b9e-b62c-50c7236f4b48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:50.717952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9659f92-7f99-4b9e-b62c-50c7236f4b48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:51.371650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fc33d06f-614c-420e-a96e-90e56a9e51b5 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:51.386084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e9659f92-7f99-4b9e-b62c-50c7236f4b48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:51.388915 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fc33d06f-614c-420e-a96e-90e56a9e51b5 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8" status: 200 len: 1505 microversion: 2.1 time: 0.730353 Aug 03 01:50:51.389777 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 464/895] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:50 2022] GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8 => generated 1505 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:51.398416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-98974e41-e240-4261-97d7-b959217ce455 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:51.399649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-98974e41-e240-4261-97d7-b959217ce455 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:51.410204 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e9659f92-7f99-4b9e-b62c-50c7236f4b48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1378 microversion: 2.1 time: 0.733330 Aug 03 01:50:51.410975 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 432/896] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:50 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1378 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:51.420954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1520446454", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "db14d09c-b745-4579-af9f-767661c49472"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:51.430986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98974e41-e240-4261-97d7-b959217ce455 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:51.431441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98974e41-e240-4261-97d7-b959217ce455 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:51.432218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98974e41-e240-4261-97d7-b959217ce455 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:51.432849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98974e41-e240-4261-97d7-b959217ce455 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:51.520154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] validate_networks() for [('db14d09c-b745-4579-af9f-767661c49472', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:50:51.538077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-98974e41-e240-4261-97d7-b959217ce455 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:51.549222 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-98974e41-e240-4261-97d7-b959217ce455 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1268 microversion: 2.1 time: 0.158165 Aug 03 01:50:51.550502 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 465/897] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:51 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:51.564959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-40d8f5fc-e13a-4449-981c-8d3fade01d8f tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:51.566047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-40d8f5fc-e13a-4449-981c-8d3fade01d8f tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:51.574215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40d8f5fc-e13a-4449-981c-8d3fade01d8f tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:51.575132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40d8f5fc-e13a-4449-981c-8d3fade01d8f tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:51.577309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40d8f5fc-e13a-4449-981c-8d3fade01d8f tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:51.579044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40d8f5fc-e13a-4449-981c-8d3fade01d8f tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:51.895452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-40d8f5fc-e13a-4449-981c-8d3fade01d8f tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:51.908026 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-40d8f5fc-e13a-4449-981c-8d3fade01d8f tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1331 microversion: 2.1 time: 0.355641 Aug 03 01:50:51.908737 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 466/898] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:51 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1331 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:51.927193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a8258602-7154-41e9-9650-1b464c432855 tempest-FlavorsV2NegativeTest-784175407 tempest-FlavorsV2NegativeTest-784175407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-732866101", "imageRef": "fb5f6d59-8d5e-41a7-b7b6-c764b4e761f8", "flavorRef": "452"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:52.066631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-a8258602-7154-41e9-9650-1b464c432855 tempest-FlavorsV2NegativeTest-784175407 tempest-FlavorsV2NegativeTest-784175407-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:50:52.686371 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-a8258602-7154-41e9-9650-1b464c432855 tempest-FlavorsV2NegativeTest-784175407 tempest-FlavorsV2NegativeTest-784175407-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a8258602-7154-41e9-9650-1b464c432855 tempest-FlavorsV2NegativeTest-784175407 tempest-FlavorsV2NegativeTest-784175407-project] Request method failure captured: Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 142 Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dR53WQv1HXVfvh-NFOzIfq9zbIEJAgfewEWm9ldM3QOE3L9edFnF5sSCOEpc4ePIyellvU4JLPGwpgkV7spp-A6HaAdbGpSpNzcVBUKe8e9CuCCLs3wA1IU9diLZxhEK1eEQ7Jwy11BjjCldZGrcRQUKaWYVfm4mExiQCluLrLqOi0 Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 2e291a123d064b79947fa2e696d13f95 Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FlavorsV2NegativeTest-784175407 Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2e291a123d064b79947fa2e696d13f95", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e291a123d064b79947fa2e696d13f95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2e291a123d064b79947fa2e696d13f95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2e291a123d064b79947fa2e696d13f95"}]}] Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FlavorsV2NegativeTest-784175407 Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 2e291a123d064b79947fa2e696d13f95 Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-784175407 Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FlavorsV2NegativeTest-784175407-project Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 9124309999de44da806106f536d0d974 Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FlavorsV2NegativeTest-784175407-project Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-732866101", "imageRef": "fb5f6d59-8d5e-41a7-b7b6-c764b4e761f8", "flavorRef": "452"}} Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: exception: Flavor's memory is too small for requested image. Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-732866101', 'imageRef': 'fb5f6d59-8d5e-41a7-b7b6-c764b4e761f8', 'flavorRef': '452'}}} Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:50:52.688269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a8258602-7154-41e9-9650-1b464c432855 tempest-FlavorsV2NegativeTest-784175407 tempest-FlavorsV2NegativeTest-784175407-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a8258602-7154-41e9-9650-1b464c432855 tempest-FlavorsV2NegativeTest-784175407 tempest-FlavorsV2NegativeTest-784175407-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.766543 Aug 03 01:50:52.693421 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 467/899] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:50:51 2022] POST /compute/v2.1/servers => generated 93 bytes in 781 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 01:50:52.702500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d1c9070b-ddbb-4427-986a-8ce9aab3e018 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:52.703155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d1c9070b-ddbb-4427-986a-8ce9aab3e018 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: e4c48252-ca1c-46a8-906b-1d8f25be8898] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:52.722761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1c9070b-ddbb-4427-986a-8ce9aab3e018 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:52.723206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1c9070b-ddbb-4427-986a-8ce9aab3e018 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:52.724469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1c9070b-ddbb-4427-986a-8ce9aab3e018 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:52.724919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1c9070b-ddbb-4427-986a-8ce9aab3e018 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:52.782169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:50:52.782709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:50:52.783887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:50:52.784723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:50:52.785250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:50:52.806518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:52.806996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:52.807812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:52.808252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:52.854988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Getting quotas for project 162addf8f6634e7fa0a1f9c6004258d1. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:50:52.875776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Getting quotas for user 4cb821820bbb4d3a8c999e1dec6a06a4 and project 162addf8f6634e7fa0a1f9c6004258d1. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:50:52.911701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:50:52.917264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:50:52.963021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:53.020344 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93c03cc6-dde7-4fbc-82dc-2f8f5835e4d3 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.608423 Aug 03 01:50:53.021147 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 433/900] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 01:50:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 01:50:53.036425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-972f1be4-f499-424a-9bf3-c287dcad0faa tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:53.037081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-972f1be4-f499-424a-9bf3-c287dcad0faa tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:53.047380 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-972f1be4-f499-424a-9bf3-c287dcad0faa tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:53.047834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-972f1be4-f499-424a-9bf3-c287dcad0faa tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:53.048647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-972f1be4-f499-424a-9bf3-c287dcad0faa tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:53.049078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-972f1be4-f499-424a-9bf3-c287dcad0faa tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:53.356667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d1c9070b-ddbb-4427-986a-8ce9aab3e018 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:53.371199 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d1c9070b-ddbb-4427-986a-8ce9aab3e018 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898" status: 200 len: 1317 microversion: 2.1 time: 0.676119 Aug 03 01:50:53.371854 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 468/901] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:52 2022] GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898 => generated 1317 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:53.394611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2082b808-ef8f-4f38-9b18-9750d5c4b11e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:53.400465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2082b808-ef8f-4f38-9b18-9750d5c4b11e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:53.411546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2082b808-ef8f-4f38-9b18-9750d5c4b11e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:53.412005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2082b808-ef8f-4f38-9b18-9750d5c4b11e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:53.412809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2082b808-ef8f-4f38-9b18-9750d5c4b11e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:53.414682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2082b808-ef8f-4f38-9b18-9750d5c4b11e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:54.117519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-972f1be4-f499-424a-9bf3-c287dcad0faa tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:54.131773 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-972f1be4-f499-424a-9bf3-c287dcad0faa tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1378 microversion: 2.1 time: 1.108290 Aug 03 01:50:54.132376 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 434/902] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:53 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1378 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:54.158160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6b73162a-a897-45d5-91a6-49cac057c7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:54.162349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6b73162a-a897-45d5-91a6-49cac057c7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:54.176106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b73162a-a897-45d5-91a6-49cac057c7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:54.176623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b73162a-a897-45d5-91a6-49cac057c7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:54.177440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b73162a-a897-45d5-91a6-49cac057c7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:54.177933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b73162a-a897-45d5-91a6-49cac057c7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:54.217130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2082b808-ef8f-4f38-9b18-9750d5c4b11e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:54.238029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:54.249074 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2082b808-ef8f-4f38-9b18-9750d5c4b11e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1310 microversion: 2.1 time: 0.859060 Aug 03 01:50:54.262609 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 469/903] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:53 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1310 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:54.672098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6b73162a-a897-45d5-91a6-49cac057c7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:54.682471 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6b73162a-a897-45d5-91a6-49cac057c7d7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1331 microversion: 2.1 time: 0.535357 Aug 03 01:50:54.697425 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 435/904] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:54 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1331 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:54.705078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9dd032fb-388a-41f8-9125-f297253427be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:54.705706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9dd032fb-388a-41f8-9125-f297253427be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:54.723777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9dd032fb-388a-41f8-9125-f297253427be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:54.724226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9dd032fb-388a-41f8-9125-f297253427be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:54.733878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9dd032fb-388a-41f8-9125-f297253427be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:54.734570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9dd032fb-388a-41f8-9125-f297253427be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:54.812906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37b4c15a-5942-49b6-85e1-dda686c2cd4d tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Action: 'create', calling method: .version_select at 0x7f5b224db3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-766235016", "description": "tempest-description-966359981"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:54.873678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=22 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:54.889260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9dd032fb-388a-41f8-9125-f297253427be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:54.900001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9dd032fb-388a-41f8-9125-f297253427be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:54.901861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9dd032fb-388a-41f8-9125-f297253427be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:54.903450 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9dd032fb-388a-41f8-9125-f297253427be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1314 microversion: 2.25 time: 0.204960 Aug 03 01:50:54.904370 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 436/905] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:54 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:54.927990 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-72ab592b-afa3-42f5-9210-ecb3584d9097 req-f0fb7052-94ad-4ed1-956b-aa0ca591d0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b647860c-e2e2-4a77-bb70-d396616839cf", "tag": "b440c03b-e6d3-40bf-97c1-ca18782b6c46"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:54.947733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-72ab592b-afa3-42f5-9210-ecb3584d9097 req-f0fb7052-94ad-4ed1-956b-aa0ca591d0f1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:54.948540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-72ab592b-afa3-42f5-9210-ecb3584d9097 req-f0fb7052-94ad-4ed1-956b-aa0ca591d0f1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:54.965346 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-72ab592b-afa3-42f5-9210-ecb3584d9097 req-f0fb7052-94ad-4ed1-956b-aa0ca591d0f1 service nova] Creating event network-changed:b440c03b-e6d3-40bf-97c1-ca18782b6c46 for instance b647860c-e2e2-4a77-bb70-d396616839cf on n-h2-826529-8 Aug 03 01:50:54.972458 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-72ab592b-afa3-42f5-9210-ecb3584d9097 req-f0fb7052-94ad-4ed1-956b-aa0ca591d0f1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049990 Aug 03 01:50:54.973579 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 437/906] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:54.983219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-def8e678-b039-449f-9e0d-3aa0b7a242bb tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:54.984220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-def8e678-b039-449f-9e0d-3aa0b7a242bb tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: e4c48252-ca1c-46a8-906b-1d8f25be8898] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:54.993862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-def8e678-b039-449f-9e0d-3aa0b7a242bb tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:54.994280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-def8e678-b039-449f-9e0d-3aa0b7a242bb tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:54.995512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-def8e678-b039-449f-9e0d-3aa0b7a242bb tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:54.996072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-def8e678-b039-449f-9e0d-3aa0b7a242bb tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:55.315476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-def8e678-b039-449f-9e0d-3aa0b7a242bb tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:55.329081 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-def8e678-b039-449f-9e0d-3aa0b7a242bb tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898" status: 200 len: 1317 microversion: 2.1 time: 0.353542 Aug 03 01:50:55.329759 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 438/907] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:54 2022] GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:55.334283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-f0bd1ac4-98eb-4c77-8f91-cf6229b54474 req-e97dde0c-34e2-4b6e-84a7-400adb635778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6c9f9b-e708-44b8-8c72-49704bda21aa", "tag": "fed8a343-ec69-468a-9a29-db2e061934b3"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:55.337529 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-37b4c15a-5942-49b6-85e1-dda686c2cd4d tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.083553 Aug 03 01:50:55.338413 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 470/908] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:50:54 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:55.343126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-627d9fb3-7305-4018-9576-3e8d7876d20d req-94672a17-8422-405f-adee-e9c20852a24b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c48252-ca1c-46a8-906b-1d8f25be8898", "name": "network-vif-plugged", "status": "completed", "tag": "5441ab3c-1396-4702-8184-6c69615da0c6"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:55.362233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-627d9fb3-7305-4018-9576-3e8d7876d20d req-94672a17-8422-405f-adee-e9c20852a24b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:55.362674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-627d9fb3-7305-4018-9576-3e8d7876d20d req-94672a17-8422-405f-adee-e9c20852a24b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:55.370525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f0bd1ac4-98eb-4c77-8f91-cf6229b54474 req-e97dde0c-34e2-4b6e-84a7-400adb635778 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:55.370995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f0bd1ac4-98eb-4c77-8f91-cf6229b54474 req-e97dde0c-34e2-4b6e-84a7-400adb635778 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:55.383048 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-627d9fb3-7305-4018-9576-3e8d7876d20d req-94672a17-8422-405f-adee-e9c20852a24b service nova] Creating event network-vif-plugged:5441ab3c-1396-4702-8184-6c69615da0c6 for instance e4c48252-ca1c-46a8-906b-1d8f25be8898 on n-h1-826529-8 Aug 03 01:50:55.383345 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-f0bd1ac4-98eb-4c77-8f91-cf6229b54474 req-e97dde0c-34e2-4b6e-84a7-400adb635778 service nova] Creating event network-changed:fed8a343-ec69-468a-9a29-db2e061934b3 for instance ee6c9f9b-e708-44b8-8c72-49704bda21aa on n-h2-826529-8 Aug 03 01:50:55.389001 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-f0bd1ac4-98eb-4c77-8f91-cf6229b54474 req-e97dde0c-34e2-4b6e-84a7-400adb635778 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057293 Aug 03 01:50:55.389843 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 439/909] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:55.394919 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-627d9fb3-7305-4018-9576-3e8d7876d20d req-94672a17-8422-405f-adee-e9c20852a24b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052553 Aug 03 01:50:55.396078 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 471/910] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:55.399271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d66dbcf-002d-4510-a7a5-917773ab1282 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:55.399969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8d66dbcf-002d-4510-a7a5-917773ab1282 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:55.406557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a25c6c7d-00a5-4f24-a565-12a60cf5bd58 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:55.406705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d66dbcf-002d-4510-a7a5-917773ab1282 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:55.407341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d66dbcf-002d-4510-a7a5-917773ab1282 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:55.408040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a25c6c7d-00a5-4f24-a565-12a60cf5bd58 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:55.408181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d66dbcf-002d-4510-a7a5-917773ab1282 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:55.408546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d66dbcf-002d-4510-a7a5-917773ab1282 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:55.413910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:55.428530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a25c6c7d-00a5-4f24-a565-12a60cf5bd58 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:55.429013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a25c6c7d-00a5-4f24-a565-12a60cf5bd58 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:55.429866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a25c6c7d-00a5-4f24-a565-12a60cf5bd58 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:55.433476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a25c6c7d-00a5-4f24-a565-12a60cf5bd58 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:55.648492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8d66dbcf-002d-4510-a7a5-917773ab1282 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:55.657188 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8d66dbcf-002d-4510-a7a5-917773ab1282 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1378 microversion: 2.1 time: 0.262581 Aug 03 01:50:55.662206 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 440/911] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:55 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1378 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:55.679714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-85fa71ca-c347-4da4-bb33-06bf0a46d095 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Action: 'create', calling method: .version_select at 0x7f5b13a23550>, body: {"security_group_rule": {"parent_group_id": "cc3e8f36-225a-41fc-a374-06f3fb7e9c5b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:55.716429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a25c6c7d-00a5-4f24-a565-12a60cf5bd58 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:55.732596 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a25c6c7d-00a5-4f24-a565-12a60cf5bd58 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1310 microversion: 2.1 time: 0.334675 Aug 03 01:50:55.735800 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 472/912] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:55 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1310 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:55.741858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-35e1e3f8-5594-436c-a34e-60821c3cdcf7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:55.742704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-35e1e3f8-5594-436c-a34e-60821c3cdcf7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:55.751036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35e1e3f8-5594-436c-a34e-60821c3cdcf7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:55.751725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35e1e3f8-5594-436c-a34e-60821c3cdcf7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:55.752661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35e1e3f8-5594-436c-a34e-60821c3cdcf7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:55.753262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35e1e3f8-5594-436c-a34e-60821c3cdcf7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:55.958158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-35e1e3f8-5594-436c-a34e-60821c3cdcf7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:55.982575 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-35e1e3f8-5594-436c-a34e-60821c3cdcf7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1331 microversion: 2.1 time: 0.234882 Aug 03 01:50:55.983885 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 473/913] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:55 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1331 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:55.994780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-210b9f48-0e2d-4aa8-b773-90039543d67a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:55.995865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-210b9f48-0e2d-4aa8-b773-90039543d67a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:56.008189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-210b9f48-0e2d-4aa8-b773-90039543d67a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:56.009023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-210b9f48-0e2d-4aa8-b773-90039543d67a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:56.010114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-210b9f48-0e2d-4aa8-b773-90039543d67a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:56.010968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-210b9f48-0e2d-4aa8-b773-90039543d67a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:56.148918 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-85fa71ca-c347-4da4-bb33-06bf0a46d095 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.485425 Aug 03 01:50:56.149482 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 441/914] 10.222.0.67 () {60 vars in 1195 bytes} [Wed Aug 3 01:50:55 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:56.164682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f32889c4-7114-4a73-8e4b-b76b87364995 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Action: 'create', calling method: .version_select at 0x7f5b135a90d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1079693640", "description": "tempest-description-406548080"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:56.175924 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-210b9f48-0e2d-4aa8-b773-90039543d67a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:56.185126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-210b9f48-0e2d-4aa8-b773-90039543d67a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:56.186784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-210b9f48-0e2d-4aa8-b773-90039543d67a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:56.187972 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-210b9f48-0e2d-4aa8-b773-90039543d67a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1320 microversion: 2.25 time: 0.202821 Aug 03 01:50:56.192020 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 474/915] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:55 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1320 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:56.468363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e182e19b-1601-4769-bfb3-b1509f8b1bfc tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Calling method '.version_select at 0x7f5b135b3670>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:56.507940 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-e182e19b-1601-4769-bfb3-b1509f8b1bfc tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] HTTP exception thrown: Image not found. Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e182e19b-1601-4769-bfb3-b1509f8b1bfc tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Request method failure captured: Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/images/a157c496-c22c-487c-9d26-35089b46ae07/metadata/os_distro HTTP/1.1 Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dSAL68DbkLrrsUyhcBQzg2ceqDdkiPRowjwNgD4Tm4gkR5ldwSli-ulRpKuqfF0wIqrMAT9McLrFGQyrEFYvVQbYaQmlzPWJxb19-YwdG-9IuGry3H6qEfSATLGhG05Bz7LGhKYQ_Y7UlnD95aM31wUfAuZCcD7HU8bmDz5khVWoAk Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 0e1763d41db7455698229f293a29c1e4 Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0e1763d41db7455698229f293a29c1e4", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0e1763d41db7455698229f293a29c1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0e1763d41db7455698229f293a29c1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0e1763d41db7455698229f293a29c1e4"}]}] Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 0e1763d41db7455698229f293a29c1e4 Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesMetadataNegativeTestJSON-713962220-project Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5ba9fe17c2b14451a6031eb9e7c62711 Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-713962220-project Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: exception: Image not found. Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'image_id': 'a157c496-c22c-487c-9d26-35089b46ae07', 'id': 'os_distro'} Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a157c496-c22c-487c-9d26-35089b46ae07 Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 01:50:56.510859 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a157c496-c22c-487c-9d26-35089b46ae07 could not be found. Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e182e19b-1601-4769-bfb3-b1509f8b1bfc tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Returning 404 to user: Image not found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e182e19b-1601-4769-bfb3-b1509f8b1bfc tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] 10.222.0.67 "DELETE /compute/v2.1/images/a157c496-c22c-487c-9d26-35089b46ae07/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.297418 Aug 03 01:50:56.515629 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 475/916] 10.222.0.67 () {58 vars in 1293 bytes} [Wed Aug 3 01:50:56 2022] DELETE /compute/v2.1/images/a157c496-c22c-487c-9d26-35089b46ae07/metadata/os_distro => generated 62 bytes in 300 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:50:56.522418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ab781c50-4eac-41f7-9bf0-8e44b8e0da64 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:56.523378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ab781c50-4eac-41f7-9bf0-8e44b8e0da64 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: e4c48252-ca1c-46a8-906b-1d8f25be8898] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:56.542119 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f32889c4-7114-4a73-8e4b-b76b87364995 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.382053 Aug 03 01:50:56.543672 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 442/917] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:50:56 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:56.548080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab781c50-4eac-41f7-9bf0-8e44b8e0da64 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:56.548781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab781c50-4eac-41f7-9bf0-8e44b8e0da64 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:56.554735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5343d391-aed0-4b97-bfec-83d527278391 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Calling method '.version_select at 0x7f5b135bcd30>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:56.561445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab781c50-4eac-41f7-9bf0-8e44b8e0da64 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:56.562494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab781c50-4eac-41f7-9bf0-8e44b8e0da64 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:56.591321 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-5343d391-aed0-4b97-bfec-83d527278391 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] HTTP exception thrown: Image not found. Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5343d391-aed0-4b97-bfec-83d527278391 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Request method failure captured: Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/images/23da57fe-5d5b-467a-ab3e-069d45e4148d/metadata/os_version HTTP/1.1 Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dSAL68DbkLrrsUyhcBQzg2ceqDdkiPRowjwNgD4Tm4gkR5ldwSli-ulRpKuqfF0wIqrMAT9McLrFGQyrEFYvVQbYaQmlzPWJxb19-YwdG-9IuGry3H6qEfSATLGhG05Bz7LGhKYQ_Y7UlnD95aM31wUfAuZCcD7HU8bmDz5khVWoAk Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 0e1763d41db7455698229f293a29c1e4 Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0e1763d41db7455698229f293a29c1e4", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0e1763d41db7455698229f293a29c1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0e1763d41db7455698229f293a29c1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0e1763d41db7455698229f293a29c1e4"}]}] Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 0e1763d41db7455698229f293a29c1e4 Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesMetadataNegativeTestJSON-713962220-project Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 5ba9fe17c2b14451a6031eb9e7c62711 Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-713962220-project Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: exception: Image not found. Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'image_id': '23da57fe-5d5b-467a-ab3e-069d45e4148d', 'id': 'os_version'} Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 23da57fe-5d5b-467a-ab3e-069d45e4148d Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 01:50:56.597348 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 23da57fe-5d5b-467a-ab3e-069d45e4148d could not be found. Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:50:56.603461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.611917 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5343d391-aed0-4b97-bfec-83d527278391 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Returning 404 to user: Image not found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:50:56.611917 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5343d391-aed0-4b97-bfec-83d527278391 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] 10.222.0.67 "GET /compute/v2.1/images/23da57fe-5d5b-467a-ab3e-069d45e4148d/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.062539 Aug 03 01:50:56.611917 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 443/918] 10.222.0.67 () {58 vars in 1293 bytes} [Wed Aug 3 01:50:56 2022] GET /compute/v2.1/images/23da57fe-5d5b-467a-ab3e-069d45e4148d/metadata/os_version => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:50:56.619096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3395b85f-7c69-491a-a77f-96a81d10cf62 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Action: 'create', calling method: .version_select at 0x7f5b135a9f70>, body: {"security_group_rule": {"parent_group_id": "43f86a6f-2f30-47d2-b8c4-c0eaf8ea992b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:56.891208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ab781c50-4eac-41f7-9bf0-8e44b8e0da64 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:56.906017 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ab781c50-4eac-41f7-9bf0-8e44b8e0da64 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898" status: 200 len: 1317 microversion: 2.1 time: 0.387294 Aug 03 01:50:56.907669 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 476/919] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:56 2022] GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:56.919492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4433a109-84bd-4e6e-8a5d-6b65b6205c99 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Calling method '.version_select at 0x7f5b136043a0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:56.954759 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-4433a109-84bd-4e6e-8a5d-6b65b6205c99 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] HTTP exception thrown: Image not found. Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4433a109-84bd-4e6e-8a5d-6b65b6205c99 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Request method failure captured: Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/images/9624b80a-c83a-4883-a968-8ea7c4141d69/metadata HTTP/1.1 Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dSAL68DbkLrrsUyhcBQzg2ceqDdkiPRowjwNgD4Tm4gkR5ldwSli-ulRpKuqfF0wIqrMAT9McLrFGQyrEFYvVQbYaQmlzPWJxb19-YwdG-9IuGry3H6qEfSATLGhG05Bz7LGhKYQ_Y7UlnD95aM31wUfAuZCcD7HU8bmDz5khVWoAk Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 0e1763d41db7455698229f293a29c1e4 Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0e1763d41db7455698229f293a29c1e4", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0e1763d41db7455698229f293a29c1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0e1763d41db7455698229f293a29c1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0e1763d41db7455698229f293a29c1e4"}]}] Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 0e1763d41db7455698229f293a29c1e4 Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesMetadataNegativeTestJSON-713962220-project Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5ba9fe17c2b14451a6031eb9e7c62711 Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-713962220-project Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: exception: Image not found. Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'image_id': '9624b80a-c83a-4883-a968-8ea7c4141d69'} Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9624b80a-c83a-4883-a968-8ea7c4141d69 Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 01:50:56.959932 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9624b80a-c83a-4883-a968-8ea7c4141d69 could not be found. Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:50:56.965502 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:56.974240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4433a109-84bd-4e6e-8a5d-6b65b6205c99 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Returning 404 to user: Image not found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:50:56.976568 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4433a109-84bd-4e6e-8a5d-6b65b6205c99 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] 10.222.0.67 "GET /compute/v2.1/images/9624b80a-c83a-4883-a968-8ea7c4141d69/metadata" status: 404 len: 62 microversion: 2.1 time: 0.066303 Aug 03 01:50:56.977936 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 477/920] 10.222.0.67 () {58 vars in 1260 bytes} [Wed Aug 3 01:50:56 2022] GET /compute/v2.1/images/9624b80a-c83a-4883-a968-8ea7c4141d69/metadata => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:50:56.987504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e952b7c-873f-475f-b925-e89843588e95 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:56.988691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3e952b7c-873f-475f-b925-e89843588e95 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:57.001348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e952b7c-873f-475f-b925-e89843588e95 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:57.002125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e952b7c-873f-475f-b925-e89843588e95 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:57.004355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e952b7c-873f-475f-b925-e89843588e95 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:57.005232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e952b7c-873f-475f-b925-e89843588e95 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:57.056408 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3395b85f-7c69-491a-a77f-96a81d10cf62 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.440053 Aug 03 01:50:57.058136 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 444/921] 10.222.0.67 () {60 vars in 1195 bytes} [Wed Aug 3 01:50:56 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:57.069992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-16830592-ba15-4436-992a-20ff12a80d96 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:57.070626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-16830592-ba15-4436-992a-20ff12a80d96 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:57.085767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16830592-ba15-4436-992a-20ff12a80d96 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:57.092459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16830592-ba15-4436-992a-20ff12a80d96 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:57.093575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16830592-ba15-4436-992a-20ff12a80d96 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:57.094216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16830592-ba15-4436-992a-20ff12a80d96 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:57.572027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3e952b7c-873f-475f-b925-e89843588e95 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:57.581213 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e952b7c-873f-475f-b925-e89843588e95 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1378 microversion: 2.1 time: 0.601743 Aug 03 01:50:57.582031 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 478/922] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:56 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1378 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:57.587122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31571337-2a69-498b-be61-22a798f0418d tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Action: 'update_all', calling method: .version_select at 0x7f5b135f3670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:57.612628 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-31571337-2a69-498b-be61-22a798f0418d tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] HTTP exception thrown: Image not found. Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31571337-2a69-498b-be61-22a798f0418d tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Request method failure captured: Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: request: PUT /compute/v2.1/images/c726e51b-2a97-4707-bb0c-776b34b35f32/metadata HTTP/1.1 Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 57 Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dSAL68DbkLrrsUyhcBQzg2ceqDdkiPRowjwNgD4Tm4gkR5ldwSli-ulRpKuqfF0wIqrMAT9McLrFGQyrEFYvVQbYaQmlzPWJxb19-YwdG-9IuGry3H6qEfSATLGhG05Bz7LGhKYQ_Y7UlnD95aM31wUfAuZCcD7HU8bmDz5khVWoAk Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 0e1763d41db7455698229f293a29c1e4 Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0e1763d41db7455698229f293a29c1e4", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0e1763d41db7455698229f293a29c1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0e1763d41db7455698229f293a29c1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0e1763d41db7455698229f293a29c1e4"}]}] Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 0e1763d41db7455698229f293a29c1e4 Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesMetadataNegativeTestJSON-713962220-project Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5ba9fe17c2b14451a6031eb9e7c62711 Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-713962220-project Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: exception: Image not found. Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'image_id': 'c726e51b-2a97-4707-bb0c-776b34b35f32', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c726e51b-2a97-4707-bb0c-776b34b35f32 Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 01:50:57.614937 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c726e51b-2a97-4707-bb0c-776b34b35f32 could not be found. Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:50:57.619338 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:57.625966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31571337-2a69-498b-be61-22a798f0418d tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Returning 404 to user: Image not found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:50:57.625966 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-31571337-2a69-498b-be61-22a798f0418d tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] 10.222.0.67 "PUT /compute/v2.1/images/c726e51b-2a97-4707-bb0c-776b34b35f32/metadata" status: 404 len: 62 microversion: 2.1 time: 0.041596 Aug 03 01:50:57.625966 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 479/923] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 01:50:57 2022] PUT /compute/v2.1/images/c726e51b-2a97-4707-bb0c-776b34b35f32/metadata => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:50:57.632915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-02cdcc34-63ed-42b5-b3d5-abfc25597e66 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:57.633533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-02cdcc34-63ed-42b5-b3d5-abfc25597e66 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:57.644281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02cdcc34-63ed-42b5-b3d5-abfc25597e66 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:57.644701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-16830592-ba15-4436-992a-20ff12a80d96 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:57.645193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02cdcc34-63ed-42b5-b3d5-abfc25597e66 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:57.645555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02cdcc34-63ed-42b5-b3d5-abfc25597e66 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:57.645999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02cdcc34-63ed-42b5-b3d5-abfc25597e66 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:57.659991 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-16830592-ba15-4436-992a-20ff12a80d96 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1310 microversion: 2.1 time: 0.600762 Aug 03 01:50:57.660581 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 445/924] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:57 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1310 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:57.671742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4f13ffb0-dca2-4df0-a53d-5b8e44061006 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Action: 'create', calling method: .version_select at 0x7f5b139de1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-974973965", "description": "tempest-description-103778660"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:57.877771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-02cdcc34-63ed-42b5-b3d5-abfc25597e66 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:57.886721 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-02cdcc34-63ed-42b5-b3d5-abfc25597e66 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1331 microversion: 2.1 time: 0.259529 Aug 03 01:50:57.887339 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 480/925] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:57 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1331 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:57.897962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-96da5ff6-fd2e-4f11-99bb-94bb4410effb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:57.898569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-96da5ff6-fd2e-4f11-99bb-94bb4410effb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:57.914489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96da5ff6-fd2e-4f11-99bb-94bb4410effb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:57.915208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96da5ff6-fd2e-4f11-99bb-94bb4410effb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:57.916166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96da5ff6-fd2e-4f11-99bb-94bb4410effb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:57.916861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96da5ff6-fd2e-4f11-99bb-94bb4410effb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:57.966955 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4f13ffb0-dca2-4df0-a53d-5b8e44061006 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.302000 Aug 03 01:50:57.967798 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 446/926] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:50:57 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:57.984273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-58bc2be5-7883-45f2-a5e0-26a08c8c3cb5 req-1afb3621-f5c8-4d65-9a14-2a0923163c6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2ce9d3-8e0c-4981-951e-3d23d58de2c2", "name": "network-vif-plugged", "status": "completed", "tag": "aee6f3d7-e3c0-4569-9c1b-2cfe18a9f997"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:58.003203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-58bc2be5-7883-45f2-a5e0-26a08c8c3cb5 req-1afb3621-f5c8-4d65-9a14-2a0923163c6e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:58.003790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-58bc2be5-7883-45f2-a5e0-26a08c8c3cb5 req-1afb3621-f5c8-4d65-9a14-2a0923163c6e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:58.016629 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-58bc2be5-7883-45f2-a5e0-26a08c8c3cb5 req-1afb3621-f5c8-4d65-9a14-2a0923163c6e service nova] Creating event network-vif-plugged:aee6f3d7-e3c0-4569-9c1b-2cfe18a9f997 for instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 on n-h1-826529-8 Aug 03 01:50:58.022375 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-58bc2be5-7883-45f2-a5e0-26a08c8c3cb5 req-1afb3621-f5c8-4d65-9a14-2a0923163c6e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044702 Aug 03 01:50:58.024305 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 447/927] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:58.032356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bb0e1b29-5049-4c2c-99c1-44d18324da36 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Action: 'update', calling method: .version_select at 0x7f5b1355ef70>, body: {"meta": {"os_distro": "alt"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:58.070742 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-bb0e1b29-5049-4c2c-99c1-44d18324da36 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] HTTP exception thrown: Image not found. Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bb0e1b29-5049-4c2c-99c1-44d18324da36 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Request method failure captured: Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: request: PUT /compute/v2.1/images/331fe465-67da-446e-8988-ebcaf0f7fbd0/metadata/os_distro HTTP/1.1 Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 30 Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dSAL68DbkLrrsUyhcBQzg2ceqDdkiPRowjwNgD4Tm4gkR5ldwSli-ulRpKuqfF0wIqrMAT9McLrFGQyrEFYvVQbYaQmlzPWJxb19-YwdG-9IuGry3H6qEfSATLGhG05Bz7LGhKYQ_Y7UlnD95aM31wUfAuZCcD7HU8bmDz5khVWoAk Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 0e1763d41db7455698229f293a29c1e4 Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0e1763d41db7455698229f293a29c1e4", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0e1763d41db7455698229f293a29c1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0e1763d41db7455698229f293a29c1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0e1763d41db7455698229f293a29c1e4"}]}] Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 0e1763d41db7455698229f293a29c1e4 Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesMetadataNegativeTestJSON-713962220-project Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 5ba9fe17c2b14451a6031eb9e7c62711 Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-713962220-project Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: {"meta": {"os_distro": "alt"}} Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: exception: Image not found. Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'image_id': '331fe465-67da-446e-8988-ebcaf0f7fbd0', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 331fe465-67da-446e-8988-ebcaf0f7fbd0 Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 01:50:58.073162 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 331fe465-67da-446e-8988-ebcaf0f7fbd0 could not be found. Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:50:58.078634 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:50:58.086719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bb0e1b29-5049-4c2c-99c1-44d18324da36 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Returning 404 to user: Image not found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:50:58.087845 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bb0e1b29-5049-4c2c-99c1-44d18324da36 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] 10.222.0.67 "PUT /compute/v2.1/images/331fe465-67da-446e-8988-ebcaf0f7fbd0/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.062158 Aug 03 01:50:58.089005 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 448/928] 10.222.0.67 () {60 vars in 1310 bytes} [Wed Aug 3 01:50:58 2022] PUT /compute/v2.1/images/331fe465-67da-446e-8988-ebcaf0f7fbd0/metadata/os_distro => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:50:58.106593 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-96da5ff6-fd2e-4f11-99bb-94bb4410effb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:58.111886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-6d53572c-2306-4220-af95-a7eb0032e95a req-f4dd7b81-9fc5-4557-b4cb-510a205167fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1025ec9b-6b5d-445a-8c05-ae537d3273cc", "tag": "db8c88b5-548a-478f-bd6f-7ccdcd714cf9"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:58.119400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-96da5ff6-fd2e-4f11-99bb-94bb4410effb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:58.121180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-96da5ff6-fd2e-4f11-99bb-94bb4410effb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:58.122327 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-96da5ff6-fd2e-4f11-99bb-94bb4410effb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1362 microversion: 2.25 time: 0.233960 Aug 03 01:50:58.126952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6d53572c-2306-4220-af95-a7eb0032e95a req-f4dd7b81-9fc5-4557-b4cb-510a205167fa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:58.128742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6d53572c-2306-4220-af95-a7eb0032e95a req-f4dd7b81-9fc5-4557-b4cb-510a205167fa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:58.143492 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-6d53572c-2306-4220-af95-a7eb0032e95a req-f4dd7b81-9fc5-4557-b4cb-510a205167fa service nova] Creating event network-changed:db8c88b5-548a-478f-bd6f-7ccdcd714cf9 for instance 1025ec9b-6b5d-445a-8c05-ae537d3273cc on n-h1-826529-8 Aug 03 01:50:58.149043 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 481/929] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:57 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:58.151331 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-6d53572c-2306-4220-af95-a7eb0032e95a req-f4dd7b81-9fc5-4557-b4cb-510a205167fa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059951 Aug 03 01:50:58.154849 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 449/930] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:58.159232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-860b3587-a42a-4d16-9bb6-5aa08bdecf15 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:58.159867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-860b3587-a42a-4d16-9bb6-5aa08bdecf15 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: e4c48252-ca1c-46a8-906b-1d8f25be8898] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:58.161579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-076fd81d-76db-424c-a443-1c8feccd6e4b tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Action: 'create', calling method: .version_select at 0x7f5b1355edc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-960443939", "description": "tempest-description-604326882"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:58.177708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-860b3587-a42a-4d16-9bb6-5aa08bdecf15 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:58.178546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-860b3587-a42a-4d16-9bb6-5aa08bdecf15 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:58.179590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-860b3587-a42a-4d16-9bb6-5aa08bdecf15 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:58.180314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-860b3587-a42a-4d16-9bb6-5aa08bdecf15 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:58.491461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-860b3587-a42a-4d16-9bb6-5aa08bdecf15 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:58.499202 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-860b3587-a42a-4d16-9bb6-5aa08bdecf15 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898" status: 200 len: 1504 microversion: 2.1 time: 0.348655 Aug 03 01:50:58.499631 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 482/931] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:58 2022] GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898 => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:58.504793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1f1f9fe6-6885-4afc-b5f2-29c08d315515 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Action: 'create', calling method: .version_select at 0x7f5b13611160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:58.531896 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-1f1f9fe6-6885-4afc-b5f2-29c08d315515 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] HTTP exception thrown: Image not found. Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1f1f9fe6-6885-4afc-b5f2-29c08d315515 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Request method failure captured: Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/images/e58de83c-ba7c-4624-9242-75fa7e2e8296/metadata HTTP/1.1 Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 57 Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dSAL68DbkLrrsUyhcBQzg2ceqDdkiPRowjwNgD4Tm4gkR5ldwSli-ulRpKuqfF0wIqrMAT9McLrFGQyrEFYvVQbYaQmlzPWJxb19-YwdG-9IuGry3H6qEfSATLGhG05Bz7LGhKYQ_Y7UlnD95aM31wUfAuZCcD7HU8bmDz5khVWoAk Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 0e1763d41db7455698229f293a29c1e4 Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0e1763d41db7455698229f293a29c1e4", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0e1763d41db7455698229f293a29c1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0e1763d41db7455698229f293a29c1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0e1763d41db7455698229f293a29c1e4"}]}] Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 0e1763d41db7455698229f293a29c1e4 Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-713962220 Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesMetadataNegativeTestJSON-713962220-project Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5ba9fe17c2b14451a6031eb9e7c62711 Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-713962220-project Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: exception: Image not found. Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'image_id': 'e58de83c-ba7c-4624-9242-75fa7e2e8296', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e58de83c-ba7c-4624-9242-75fa7e2e8296 Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 01:50:58.534007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e58de83c-ba7c-4624-9242-75fa7e2e8296 could not be found. Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1f1f9fe6-6885-4afc-b5f2-29c08d315515 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] Returning 404 to user: Image not found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1f1f9fe6-6885-4afc-b5f2-29c08d315515 tempest-ImagesMetadataNegativeTestJSON-713962220 tempest-ImagesMetadataNegativeTestJSON-713962220-project] 10.222.0.67 "POST /compute/v2.1/images/e58de83c-ba7c-4624-9242-75fa7e2e8296/metadata" status: 404 len: 62 microversion: 2.1 time: 0.034831 Aug 03 01:50:58.541458 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 483/932] 10.222.0.67 () {60 vars in 1281 bytes} [Wed Aug 3 01:50:58 2022] POST /compute/v2.1/images/e58de83c-ba7c-4624-9242-75fa7e2e8296/metadata => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:50:58.548475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4f7f173f-a661-48c1-adcc-d9649cec4ac1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:58.548475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4f7f173f-a661-48c1-adcc-d9649cec4ac1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: e4c48252-ca1c-46a8-906b-1d8f25be8898] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:58.557850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f7f173f-a661-48c1-adcc-d9649cec4ac1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:58.558310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f7f173f-a661-48c1-adcc-d9649cec4ac1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:58.559133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f7f173f-a661-48c1-adcc-d9649cec4ac1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:58.559579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f7f173f-a661-48c1-adcc-d9649cec4ac1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:58.583576 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-076fd81d-76db-424c-a443-1c8feccd6e4b tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.427192 Aug 03 01:50:58.584482 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 450/933] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:50:58 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:58.596881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-30aa6f87-39af-4da1-bb10-898201d4b41e tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Action: 'create', calling method: .version_select at 0x7f5b1352a430>, body: {"security_group_rule": {"parent_group_id": "c7776d44-7674-4a84-ae2b-573c0d0ecc89", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "01a8f78d-6cfc-4458-9a0d-a43dce2b1d0e"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:58.597087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4f7f173f-a661-48c1-adcc-d9649cec4ac1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: e4c48252-ca1c-46a8-906b-1d8f25be8898] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:50:58.667837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:50:58.714248 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4f7f173f-a661-48c1-adcc-d9649cec4ac1 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898" status: 204 len: 0 microversion: 2.1 time: 0.176907 Aug 03 01:50:58.715071 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 484/934] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:50:58 2022] DELETE /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:50:58.731551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-47a911e1-64ef-451b-b7b0-7f862a7d8e00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:58.732811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-47a911e1-64ef-451b-b7b0-7f862a7d8e00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:58.740156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-47a911e1-64ef-451b-b7b0-7f862a7d8e00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:58.748061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-47a911e1-64ef-451b-b7b0-7f862a7d8e00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:58.750074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-47a911e1-64ef-451b-b7b0-7f862a7d8e00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:58.750839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-47a911e1-64ef-451b-b7b0-7f862a7d8e00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:59.095310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-47a911e1-64ef-451b-b7b0-7f862a7d8e00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:59.113800 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-47a911e1-64ef-451b-b7b0-7f862a7d8e00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1378 microversion: 2.1 time: 0.391156 Aug 03 01:50:59.116360 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 485/935] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:58 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1378 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:59.124739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-76d4814f-de72-45be-94fd-1b27c16d11b1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:59.125577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-76d4814f-de72-45be-94fd-1b27c16d11b1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:59.136578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76d4814f-de72-45be-94fd-1b27c16d11b1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:59.137043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76d4814f-de72-45be-94fd-1b27c16d11b1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:59.139627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76d4814f-de72-45be-94fd-1b27c16d11b1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:59.140087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76d4814f-de72-45be-94fd-1b27c16d11b1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:59.342889 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-30aa6f87-39af-4da1-bb10-898201d4b41e tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.749513 Aug 03 01:50:59.343514 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 451/936] 10.222.0.67 () {60 vars in 1195 bytes} [Wed Aug 3 01:50:58 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:50:59.357778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93cb6e0c-ed92-4128-9158-0e5e6d344cf0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:59.358423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93cb6e0c-ed92-4128-9158-0e5e6d344cf0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:59.370002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93cb6e0c-ed92-4128-9158-0e5e6d344cf0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:59.370501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93cb6e0c-ed92-4128-9158-0e5e6d344cf0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:59.371311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93cb6e0c-ed92-4128-9158-0e5e6d344cf0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:59.371748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93cb6e0c-ed92-4128-9158-0e5e6d344cf0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:59.399762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93cb6e0c-ed92-4128-9158-0e5e6d344cf0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:50:59.458160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-76d4814f-de72-45be-94fd-1b27c16d11b1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:59.467571 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-76d4814f-de72-45be-94fd-1b27c16d11b1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1310 microversion: 2.1 time: 0.349581 Aug 03 01:50:59.479228 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 486/937] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:59 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1310 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:59.479228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3b79eb7b-ec51-468a-80c0-f9f050c835cb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:59.479228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3b79eb7b-ec51-468a-80c0-f9f050c835cb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:59.480287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b79eb7b-ec51-468a-80c0-f9f050c835cb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:59.480762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b79eb7b-ec51-468a-80c0-f9f050c835cb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:59.481581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b79eb7b-ec51-468a-80c0-f9f050c835cb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:59.482324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b79eb7b-ec51-468a-80c0-f9f050c835cb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:59.534777 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93cb6e0c-ed92-4128-9158-0e5e6d344cf0 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8" status: 204 len: 0 microversion: 2.1 time: 0.181358 Aug 03 01:50:59.535710 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 452/938] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:50:59 2022] DELETE /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:50:59.543858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5a950648-aca9-4e5c-9489-a9559bb493de tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:59.544571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5a950648-aca9-4e5c-9489-a9559bb493de tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:59.551581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a950648-aca9-4e5c-9489-a9559bb493de tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:59.552179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a950648-aca9-4e5c-9489-a9559bb493de tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:59.553132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a950648-aca9-4e5c-9489-a9559bb493de tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:59.553571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a950648-aca9-4e5c-9489-a9559bb493de tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:59.741452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3b79eb7b-ec51-468a-80c0-f9f050c835cb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:59.755523 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3b79eb7b-ec51-468a-80c0-f9f050c835cb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1331 microversion: 2.1 time: 0.286140 Aug 03 01:50:59.756115 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 487/939] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:59 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1331 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:50:59.761194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0556a3c8-754e-4109-aa0b-e49d6d435fb4 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Action: 'create', calling method: .version_select at 0x7f5b13c31a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1256465972", "description": "tempest-description-674314664"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:50:59.788026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5a950648-aca9-4e5c-9489-a9559bb493de tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:59.800855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5a950648-aca9-4e5c-9489-a9559bb493de tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:59.803038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5a950648-aca9-4e5c-9489-a9559bb493de tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:50:59.804341 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5a950648-aca9-4e5c-9489-a9559bb493de tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1362 microversion: 2.25 time: 0.267497 Aug 03 01:50:59.804838 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 453/940] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:50:59 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:50:59.812084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c232acc9-027e-46c0-ae23-c2cf8157810f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:50:59.812718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c232acc9-027e-46c0-ae23-c2cf8157810f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: e4c48252-ca1c-46a8-906b-1d8f25be8898] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:50:59.819352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c232acc9-027e-46c0-ae23-c2cf8157810f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:59.820152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c232acc9-027e-46c0-ae23-c2cf8157810f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:50:59.821271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c232acc9-027e-46c0-ae23-c2cf8157810f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:50:59.821905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c232acc9-027e-46c0-ae23-c2cf8157810f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:00.006105 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0556a3c8-754e-4109-aa0b-e49d6d435fb4 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.248768 Aug 03 01:51:00.007828 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 488/941] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:50:59 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:00.020009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-82ef998b-b558-420d-987e-e290e27cadd0 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Action: 'create', calling method: .version_select at 0x7f5b13352940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1604457244", "description": "tempest-description-90349605"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:00.078363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c232acc9-027e-46c0-ae23-c2cf8157810f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:00.090776 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c232acc9-027e-46c0-ae23-c2cf8157810f tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898" status: 200 len: 1510 microversion: 2.1 time: 0.284881 Aug 03 01:51:00.092340 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 454/942] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:50:59 2022] GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:00.142919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e770294d-9e97-4e73-93d9-67427c8c8bba tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:00.143642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e770294d-9e97-4e73-93d9-67427c8c8bba tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:00.157378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e770294d-9e97-4e73-93d9-67427c8c8bba tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:00.157839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e770294d-9e97-4e73-93d9-67427c8c8bba tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:00.158643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e770294d-9e97-4e73-93d9-67427c8c8bba tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:00.159111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e770294d-9e97-4e73-93d9-67427c8c8bba tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:00.282055 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-82ef998b-b558-420d-987e-e290e27cadd0 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.265705 Aug 03 01:51:00.282956 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 489/943] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:51:00 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:51:00.302960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1a6e933d-a9b1-41da-83bb-b6bc3c563953 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Action: 'create', calling method: .version_select at 0x7f5b1335d310>, body: {"security_group_rule": {"parent_group_id": "42286c66-3719-4c5b-a912-65ba34b0c68d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d78a4fb3-c65c-480d-b348-95e4370c1e4c"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:00.402096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e770294d-9e97-4e73-93d9-67427c8c8bba tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:00.411086 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e770294d-9e97-4e73-93d9-67427c8c8bba tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1378 microversion: 2.1 time: 0.275508 Aug 03 01:51:00.412489 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 455/944] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:00 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1378 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:51:00.426144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-4cdd3656-1d7c-4c4f-b9e8-c6285f0bcbec req-d86d7612-7b03-494f-81ef-9ed40f5aea53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b647860c-e2e2-4a77-bb70-d396616839cf", "name": "network-vif-plugged", "status": "completed", "tag": "b440c03b-e6d3-40bf-97c1-ca18782b6c46"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:00.457810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4cdd3656-1d7c-4c4f-b9e8-c6285f0bcbec req-d86d7612-7b03-494f-81ef-9ed40f5aea53 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:00.458344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4cdd3656-1d7c-4c4f-b9e8-c6285f0bcbec req-d86d7612-7b03-494f-81ef-9ed40f5aea53 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:00.476150 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-4cdd3656-1d7c-4c4f-b9e8-c6285f0bcbec req-d86d7612-7b03-494f-81ef-9ed40f5aea53 service nova] Creating event network-vif-plugged:b440c03b-e6d3-40bf-97c1-ca18782b6c46 for instance b647860c-e2e2-4a77-bb70-d396616839cf on n-h2-826529-8 Aug 03 01:51:00.483202 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-4cdd3656-1d7c-4c4f-b9e8-c6285f0bcbec req-d86d7612-7b03-494f-81ef-9ed40f5aea53 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068124 Aug 03 01:51:00.486486 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 456/945] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:00.493769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-204fb08d-0601-40e7-aa53-bca299ce5f81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:00.494504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-204fb08d-0601-40e7-aa53-bca299ce5f81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:00.502763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-204fb08d-0601-40e7-aa53-bca299ce5f81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:00.503251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-204fb08d-0601-40e7-aa53-bca299ce5f81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:00.504047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-204fb08d-0601-40e7-aa53-bca299ce5f81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:00.504487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-204fb08d-0601-40e7-aa53-bca299ce5f81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:00.687174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-204fb08d-0601-40e7-aa53-bca299ce5f81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:00.690217 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1a6e933d-a9b1-41da-83bb-b6bc3c563953 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.398480 Aug 03 01:51:00.690857 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 490/946] 10.222.0.67 () {60 vars in 1195 bytes} [Wed Aug 3 01:51:00 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:00.695829 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-204fb08d-0601-40e7-aa53-bca299ce5f81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1310 microversion: 2.1 time: 0.207703 Aug 03 01:51:00.696758 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 457/947] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:00 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1310 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:00.702111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-614c4a0f-5fe0-46f0-80e6-79b1a1985028 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Calling method '.version_select at 0x7f5b13c89820>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:00.828991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cacf5d72-bbf1-4024-ab38-886e28d4832f tempest-ListImagesTestJSON-730599258 tempest-ListImagesTestJSON-730599258-project] Calling method '.version_select at 0x7f5b135b38b0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:00.877965 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cacf5d72-bbf1-4024-ab38-886e28d4832f tempest-ListImagesTestJSON-730599258 tempest-ListImagesTestJSON-730599258-project] 10.222.0.67 "GET /compute/v2.1/images/b851b45e-5c09-4153-a051-b8cb3fbe48b3" status: 200 len: 784 microversion: 2.1 time: 0.186016 Aug 03 01:51:00.883352 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 491/948] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:51:00 2022] GET /compute/v2.1/images/b851b45e-5c09-4153-a051-b8cb3fbe48b3 => generated 784 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:00.891700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9bc6ccd0-8f10-4946-82a4-1c4d11c9568c tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:00.894362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9bc6ccd0-8f10-4946-82a4-1c4d11c9568c tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:00.902365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bc6ccd0-8f10-4946-82a4-1c4d11c9568c tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:00.903011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bc6ccd0-8f10-4946-82a4-1c4d11c9568c tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:00.904212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bc6ccd0-8f10-4946-82a4-1c4d11c9568c tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:00.904894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bc6ccd0-8f10-4946-82a4-1c4d11c9568c tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:00.916683 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-614c4a0f-5fe0-46f0-80e6-79b1a1985028 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/d78a4fb3-c65c-480d-b348-95e4370c1e4c" status: 202 len: 0 microversion: 2.1 time: 0.218120 Aug 03 01:51:00.922092 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 458/949] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:51:00 2022] DELETE /compute/v2.1/os-security-groups/d78a4fb3-c65c-480d-b348-95e4370c1e4c => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 01:51:00.940218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-047c3f0a-5e44-42f8-a761-d0cb7fa6f80f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:00.940965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-047c3f0a-5e44-42f8-a761-d0cb7fa6f80f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:00.953342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-047c3f0a-5e44-42f8-a761-d0cb7fa6f80f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:00.953980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-047c3f0a-5e44-42f8-a761-d0cb7fa6f80f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:00.955929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-047c3f0a-5e44-42f8-a761-d0cb7fa6f80f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:00.956819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-047c3f0a-5e44-42f8-a761-d0cb7fa6f80f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:01.092964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9bc6ccd0-8f10-4946-82a4-1c4d11c9568c tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:01.101795 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9bc6ccd0-8f10-4946-82a4-1c4d11c9568c tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1331 microversion: 2.1 time: 0.217071 Aug 03 01:51:01.102362 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 492/950] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:00 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1331 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:01.108775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed14b1bc-6837-4b8a-a2f8-686abb83b86a tempest-ListImagesTestJSON-730599258 tempest-ListImagesTestJSON-730599258-project] Calling method '.version_select at 0x7f5b135b33a0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:01.152169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-047c3f0a-5e44-42f8-a761-d0cb7fa6f80f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:01.162709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-047c3f0a-5e44-42f8-a761-d0cb7fa6f80f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:01.164653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-047c3f0a-5e44-42f8-a761-d0cb7fa6f80f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:01.166215 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-047c3f0a-5e44-42f8-a761-d0cb7fa6f80f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1362 microversion: 2.25 time: 0.242800 Aug 03 01:51:01.166853 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 459/951] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:00 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:01.173249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bd04a114-0a4b-4bc3-998e-7ba9550ef930 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Calling method '.version_select at 0x7f5b1361b3a0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:01.193859 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed14b1bc-6837-4b8a-a2f8-686abb83b86a tempest-ListImagesTestJSON-730599258 tempest-ListImagesTestJSON-730599258-project] 10.222.0.67 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.090465 Aug 03 01:51:01.194435 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 493/952] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 01:51:01 2022] GET /compute/v2.1/images => generated 445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:01.212003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-42a0dc99-6fc7-473f-833f-6135d79c4802 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:01.212719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-42a0dc99-6fc7-473f-833f-6135d79c4802 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: e4c48252-ca1c-46a8-906b-1d8f25be8898] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:01.223834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42a0dc99-6fc7-473f-833f-6135d79c4802 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:01.224671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42a0dc99-6fc7-473f-833f-6135d79c4802 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:01.225859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42a0dc99-6fc7-473f-833f-6135d79c4802 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:01.226297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42a0dc99-6fc7-473f-833f-6135d79c4802 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:01.229363 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bd04a114-0a4b-4bc3-998e-7ba9550ef930 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/42286c66-3719-4c5b-a912-65ba34b0c68d" status: 200 len: 247 microversion: 2.1 time: 0.061006 Aug 03 01:51:01.229940 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 460/953] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 01:51:01 2022] GET /compute/v2.1/os-security-groups/42286c66-3719-4c5b-a912-65ba34b0c68d => generated 247 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:01.239129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9be80cda-208c-4256-8aa3-3ca3859bae44 tempest-ListImagesTestJSON-730599258 tempest-ListImagesTestJSON-730599258-project] Calling method '.version_select at 0x7f5b135c2940>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:01.307393 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9be80cda-208c-4256-8aa3-3ca3859bae44 tempest-ListImagesTestJSON-730599258 tempest-ListImagesTestJSON-730599258-project] 10.222.0.67 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.076124 Aug 03 01:51:01.307974 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 461/954] 10.222.0.67 () {58 vars in 1143 bytes} [Wed Aug 3 01:51:01 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:01.313429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3dee982a-c85a-4963-b813-9afe96d6ac3a tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Action: 'create', calling method: .version_select at 0x7f5b13520f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-450382730", "description": "tempest-description-1868897229"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:01.430708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-42a0dc99-6fc7-473f-833f-6135d79c4802 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:01.445303 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-42a0dc99-6fc7-473f-833f-6135d79c4802 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898" status: 200 len: 1510 microversion: 2.1 time: 0.249499 Aug 03 01:51:01.446677 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 494/955] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:01 2022] GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898 => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:01.470801 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ffe868c6-e73e-45df-bc8b-7cd32a4735e0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:01.471583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ffe868c6-e73e-45df-bc8b-7cd32a4735e0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:01.479954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ffe868c6-e73e-45df-bc8b-7cd32a4735e0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:01.480480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ffe868c6-e73e-45df-bc8b-7cd32a4735e0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:01.482187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ffe868c6-e73e-45df-bc8b-7cd32a4735e0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:01.482828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ffe868c6-e73e-45df-bc8b-7cd32a4735e0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:01.576978 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3dee982a-c85a-4963-b813-9afe96d6ac3a tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.266322 Aug 03 01:51:01.577728 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 462/956] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:51:01 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:01.593895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-233c6c75-3ed4-4058-abac-67251ec2cf0d tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Action: 'create', calling method: .version_select at 0x7f5b1352aca0>, body: {"security_group_rule": {"parent_group_id": "2bfa7452-f84b-462a-aed8-dd5968dbd655", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:01.696328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ffe868c6-e73e-45df-bc8b-7cd32a4735e0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:01.705321 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ffe868c6-e73e-45df-bc8b-7cd32a4735e0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1528 microversion: 2.1 time: 0.243793 Aug 03 01:51:01.706526 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 495/957] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:01 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1528 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:01.717121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-668449b7-5f86-4405-b3c8-a44527aa9bea tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:01.718077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-668449b7-5f86-4405-b3c8-a44527aa9bea tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:01.725148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-668449b7-5f86-4405-b3c8-a44527aa9bea tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:01.725937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-668449b7-5f86-4405-b3c8-a44527aa9bea tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:01.726988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-668449b7-5f86-4405-b3c8-a44527aa9bea tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:01.727638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-668449b7-5f86-4405-b3c8-a44527aa9bea tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:01.994730 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-233c6c75-3ed4-4058-abac-67251ec2cf0d tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.407834 Aug 03 01:51:01.996144 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 463/958] 10.222.0.67 () {60 vars in 1195 bytes} [Wed Aug 3 01:51:01 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:02.002649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6d092abc-d9a8-4cec-834e-8ad830c375d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:02.002649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6d092abc-d9a8-4cec-834e-8ad830c375d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:02.005055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-668449b7-5f86-4405-b3c8-a44527aa9bea tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:02.013544 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-668449b7-5f86-4405-b3c8-a44527aa9bea tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1310 microversion: 2.1 time: 0.300125 Aug 03 01:51:02.014268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d092abc-d9a8-4cec-834e-8ad830c375d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:02.014721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d092abc-d9a8-4cec-834e-8ad830c375d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:02.014870 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 496/959] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:01 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1310 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:02.016372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d092abc-d9a8-4cec-834e-8ad830c375d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:02.016815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d092abc-d9a8-4cec-834e-8ad830c375d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:02.033511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a49806e5-ca92-4075-8934-48ce2b92a3b1 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Action: 'create', calling method: .version_select at 0x7f5b13352430>, body: {"security_group_rule": {"parent_group_id": "2bfa7452-f84b-462a-aed8-dd5968dbd655", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:02.236502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6d092abc-d9a8-4cec-834e-8ad830c375d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:02.244995 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6d092abc-d9a8-4cec-834e-8ad830c375d2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1528 microversion: 2.1 time: 0.247792 Aug 03 01:51:02.246142 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 464/960] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:01 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1528 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:02.251451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b4f93478-bde3-4691-97f4-5e54599a6b0b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:02.252368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b4f93478-bde3-4691-97f4-5e54599a6b0b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:02.266805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4f93478-bde3-4691-97f4-5e54599a6b0b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:02.267700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4f93478-bde3-4691-97f4-5e54599a6b0b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:02.268744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4f93478-bde3-4691-97f4-5e54599a6b0b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:02.271568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4f93478-bde3-4691-97f4-5e54599a6b0b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:02.469591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b4f93478-bde3-4691-97f4-5e54599a6b0b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:02.479930 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b4f93478-bde3-4691-97f4-5e54599a6b0b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1331 microversion: 2.1 time: 0.231673 Aug 03 01:51:02.481317 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 465/961] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:02 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1331 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:02.504305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6d3951a9-2b7d-4556-800e-aa42de4eae38 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:02.505243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6d3951a9-2b7d-4556-800e-aa42de4eae38 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:02.515749 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a49806e5-ca92-4075-8934-48ce2b92a3b1 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.499464 Aug 03 01:51:02.519411 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 497/962] 10.222.0.67 () {60 vars in 1195 bytes} [Wed Aug 3 01:51:02 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:02.519699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d3951a9-2b7d-4556-800e-aa42de4eae38 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:02.520384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d3951a9-2b7d-4556-800e-aa42de4eae38 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:02.521702 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d3951a9-2b7d-4556-800e-aa42de4eae38 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:02.522591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d3951a9-2b7d-4556-800e-aa42de4eae38 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:02.536997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5aaf7ac-6f28-4f63-9892-e924e8bcf1a0 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:02.537919 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:51:02.537919 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:51:02.590032 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5aaf7ac-6f28-4f63-9892-e924e8bcf1a0 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/dbac6da4-4561-4206-888c-2b5f33034b4a" status: 202 len: 0 microversion: 2.1 time: 0.056517 Aug 03 01:51:02.591425 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 498/963] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:51:02 2022] DELETE /compute/v2.1/flavors/dbac6da4-4561-4206-888c-2b5f33034b4a => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:02.599378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7e6dc254-fe39-4bd4-897b-f19c3bcb5bad tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:02.600073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7e6dc254-fe39-4bd4-897b-f19c3bcb5bad tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: e4c48252-ca1c-46a8-906b-1d8f25be8898] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:02.607096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e6dc254-fe39-4bd4-897b-f19c3bcb5bad tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:02.608456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e6dc254-fe39-4bd4-897b-f19c3bcb5bad tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:02.609833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e6dc254-fe39-4bd4-897b-f19c3bcb5bad tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:02.610457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e6dc254-fe39-4bd4-897b-f19c3bcb5bad tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:02.818294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7e6dc254-fe39-4bd4-897b-f19c3bcb5bad tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:02.831843 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7e6dc254-fe39-4bd4-897b-f19c3bcb5bad tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898" status: 200 len: 1468 microversion: 2.1 time: 0.238304 Aug 03 01:51:02.833432 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 499/964] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:02 2022] GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898 => generated 1468 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:02.842364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:02.856667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c8d14265-3fe8-46eb-b0d5-cb220a41fdb3 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Calling method '.version_select at 0x7f5b135f3670>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:02.895470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=14 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:03.041892 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c8d14265-3fe8-46eb-b0d5-cb220a41fdb3 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/2bfa7452-f84b-462a-aed8-dd5968dbd655" status: 200 len: 664 microversion: 2.1 time: 0.208254 Aug 03 01:51:03.047073 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 500/965] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 01:51:02 2022] GET /compute/v2.1/os-security-groups/2bfa7452-f84b-462a-aed8-dd5968dbd655 => generated 664 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:03.050641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-773bf71d-4b64-4593-b4e7-00522d60c1d2 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:03.065239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6d3951a9-2b7d-4556-800e-aa42de4eae38 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:03.082609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6d3951a9-2b7d-4556-800e-aa42de4eae38 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:03.085181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6d3951a9-2b7d-4556-800e-aa42de4eae38 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:03.087275 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6d3951a9-2b7d-4556-800e-aa42de4eae38 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1362 microversion: 2.25 time: 0.589359 Aug 03 01:51:03.088610 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 466/966] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:02 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1362 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:03.091724 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-773bf71d-4b64-4593-b4e7-00522d60c1d2 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.046465 Aug 03 01:51:03.092637 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 501/967] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:51:03 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:03.094607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-e785bba9-dec0-49e5-909e-749a53596e7f req-a72a291c-636a-447a-bdcf-6e185dad4dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c48252-ca1c-46a8-906b-1d8f25be8898", "name": "network-vif-deleted", "tag": "5441ab3c-1396-4702-8184-6c69615da0c6"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:03.112452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e785bba9-dec0-49e5-909e-749a53596e7f req-a72a291c-636a-447a-bdcf-6e185dad4dda service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:03.113542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e785bba9-dec0-49e5-909e-749a53596e7f req-a72a291c-636a-447a-bdcf-6e185dad4dda service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:03.123365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2e017c56-2853-49c0-b25b-1aec3bcde4d7 req-4a1b9c4b-7b86-4007-96f4-32c618a1dac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6c9f9b-e708-44b8-8c72-49704bda21aa", "name": "network-vif-plugged", "status": "completed", "tag": "fed8a343-ec69-468a-9a29-db2e061934b3"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:03.129576 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e785bba9-dec0-49e5-909e-749a53596e7f req-a72a291c-636a-447a-bdcf-6e185dad4dda service nova] Creating event network-vif-deleted:5441ab3c-1396-4702-8184-6c69615da0c6 for instance e4c48252-ca1c-46a8-906b-1d8f25be8898 on n-h1-826529-8 Aug 03 01:51:03.133438 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2e017c56-2853-49c0-b25b-1aec3bcde4d7 req-4a1b9c4b-7b86-4007-96f4-32c618a1dac6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:03.134370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2e017c56-2853-49c0-b25b-1aec3bcde4d7 req-4a1b9c4b-7b86-4007-96f4-32c618a1dac6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:03.136267 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-e785bba9-dec0-49e5-909e-749a53596e7f req-a72a291c-636a-447a-bdcf-6e185dad4dda service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046186 Aug 03 01:51:03.137439 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 467/968] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:03.145531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5c2435f6-4101-4f74-acac-2a480d8c1f6d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:03.147112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5c2435f6-4101-4f74-acac-2a480d8c1f6d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:03.156724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c2435f6-4101-4f74-acac-2a480d8c1f6d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:03.157761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c2435f6-4101-4f74-acac-2a480d8c1f6d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:03.159297 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2e017c56-2853-49c0-b25b-1aec3bcde4d7 req-4a1b9c4b-7b86-4007-96f4-32c618a1dac6 service nova] Creating event network-vif-plugged:fed8a343-ec69-468a-9a29-db2e061934b3 for instance ee6c9f9b-e708-44b8-8c72-49704bda21aa on n-h2-826529-8 Aug 03 01:51:03.169903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c2435f6-4101-4f74-acac-2a480d8c1f6d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:03.170933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c2435f6-4101-4f74-acac-2a480d8c1f6d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:03.171860 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2e017c56-2853-49c0-b25b-1aec3bcde4d7 req-4a1b9c4b-7b86-4007-96f4-32c618a1dac6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060272 Aug 03 01:51:03.172772 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 502/969] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:03.182641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-599ec37e-b9b5-4cb6-87a6-f90d07621111 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Calling method '.version_select at 0x7f5b13352e50>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:03.510731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5c2435f6-4101-4f74-acac-2a480d8c1f6d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:03.521383 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5c2435f6-4101-4f74-acac-2a480d8c1f6d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1310 microversion: 2.1 time: 0.379711 Aug 03 01:51:03.531506 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 468/970] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:03 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1310 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:03.531506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-74cf91eb-d39d-4e07-b4bb-65f6d681be73 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:03.533453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-74cf91eb-d39d-4e07-b4bb-65f6d681be73 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:03.549162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74cf91eb-d39d-4e07-b4bb-65f6d681be73 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:03.549624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74cf91eb-d39d-4e07-b4bb-65f6d681be73 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:03.551049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74cf91eb-d39d-4e07-b4bb-65f6d681be73 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:03.551704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74cf91eb-d39d-4e07-b4bb-65f6d681be73 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:03.588606 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-599ec37e-b9b5-4cb6-87a6-f90d07621111 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-group-rules/5a679952-e69c-46d4-a954-6d3283d63627" status: 202 len: 0 microversion: 2.1 time: 0.414618 Aug 03 01:51:03.589200 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 503/971] 10.222.0.67 () {58 vars in 1287 bytes} [Wed Aug 3 01:51:03 2022] DELETE /compute/v2.1/os-security-group-rules/5a679952-e69c-46d4-a954-6d3283d63627 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:03.595000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6424356e-9257-4d16-a807-60a0e2fd5f2a tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:03.595943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6424356e-9257-4d16-a807-60a0e2fd5f2a tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:03.609921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6424356e-9257-4d16-a807-60a0e2fd5f2a tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:03.610603 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6424356e-9257-4d16-a807-60a0e2fd5f2a tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:03.611795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6424356e-9257-4d16-a807-60a0e2fd5f2a tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:03.622743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6424356e-9257-4d16-a807-60a0e2fd5f2a tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:03.657919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-74cf91eb-d39d-4e07-b4bb-65f6d681be73 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:03.665595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-74cf91eb-d39d-4e07-b4bb-65f6d681be73 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Old instance type tempest-test_resize_flavor_-2105606702, new instance type m1.heat {{(pid=125942) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 01:51:03.679277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-74cf91eb-d39d-4e07-b4bb-65f6d681be73 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:51:03.679968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-74cf91eb-d39d-4e07-b4bb-65f6d681be73 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:51:03.680644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-74cf91eb-d39d-4e07-b4bb-65f6d681be73 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:51:03.681271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-74cf91eb-d39d-4e07-b4bb-65f6d681be73 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:51:03.681907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-74cf91eb-d39d-4e07-b4bb-65f6d681be73 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:51:03.831926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:03.874749 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-74cf91eb-d39d-4e07-b4bb-65f6d681be73 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "POST /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2/action" status: 202 len: 0 microversion: 2.1 time: 0.350667 Aug 03 01:51:03.879946 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 469/972] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:51:03 2022] POST /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:03.885300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1780b54f-758f-4cf3-900d-4b1df281903c tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Calling method '.version_select at 0x7f5b13c6d160>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:03.888891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6424356e-9257-4d16-a807-60a0e2fd5f2a tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:03.897083 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6424356e-9257-4d16-a807-60a0e2fd5f2a tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1331 microversion: 2.1 time: 0.306656 Aug 03 01:51:03.897671 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 504/973] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:03 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1331 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:03.912268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-5c193ca0-27d2-46a7-83f2-2ac3e693515f req-cd32077c-963f-4f00-ad15-0f6bc40711dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead43f0d-1799-4bb2-832f-72d69c006cc8", "name": "network-vif-deleted", "tag": "e706e69d-4b6a-481d-8d64-a782a42d4cd4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:03.923512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5c193ca0-27d2-46a7-83f2-2ac3e693515f req-cd32077c-963f-4f00-ad15-0f6bc40711dc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:03.924232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5c193ca0-27d2-46a7-83f2-2ac3e693515f req-cd32077c-963f-4f00-ad15-0f6bc40711dc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:03.937328 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-5c193ca0-27d2-46a7-83f2-2ac3e693515f req-cd32077c-963f-4f00-ad15-0f6bc40711dc service nova] Creating event network-vif-deleted:e706e69d-4b6a-481d-8d64-a782a42d4cd4 for instance ead43f0d-1799-4bb2-832f-72d69c006cc8 on n-h2-826529-8 Aug 03 01:51:03.943194 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-5c193ca0-27d2-46a7-83f2-2ac3e693515f req-cd32077c-963f-4f00-ad15-0f6bc40711dc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038991 Aug 03 01:51:03.944510 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 505/974] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:03.950572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4aea91b4-c82e-4b0f-8164-cdbc617bc0c3 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:03.952028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4aea91b4-c82e-4b0f-8164-cdbc617bc0c3 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: e4c48252-ca1c-46a8-906b-1d8f25be8898] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:03.959239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4aea91b4-c82e-4b0f-8164-cdbc617bc0c3 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:03.959848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4aea91b4-c82e-4b0f-8164-cdbc617bc0c3 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:03.960671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4aea91b4-c82e-4b0f-8164-cdbc617bc0c3 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:03.961165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4aea91b4-c82e-4b0f-8164-cdbc617bc0c3 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:03.975579 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-4aea91b4-c82e-4b0f-8164-cdbc617bc0c3 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] HTTP exception thrown: Instance e4c48252-ca1c-46a8-906b-1d8f25be8898 could not be found. Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4aea91b4-c82e-4b0f-8164-cdbc617bc0c3 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Request method failure captured: Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898 HTTP/1.1 Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dRRgHxUs9HliJBeyVw0RMzrITgCLsm4i3Yf46BBpwDxAtVhEWm3yF6avTbC3gwP44WZqflYcXJGXX_xrTlvsDpIK1ydQiTkYDjckbT9V17L0Fq9Jtq0mFMTqA-HqED0xk03TnfUQSAV-dPZQeHXPH_o4iLhxN2UTP6zVS3Cmh-KYqc Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 359b651cd3fd4147b171fed1c77eccb2 Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-MultipleCreateTestJSON-1161887913 Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_359b651cd3fd4147b171fed1c77eccb2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/359b651cd3fd4147b171fed1c77eccb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/359b651cd3fd4147b171fed1c77eccb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/359b651cd3fd4147b171fed1c77eccb2"}]}] Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-MultipleCreateTestJSON-1161887913 Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 359b651cd3fd4147b171fed1c77eccb2 Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1161887913 Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-MultipleCreateTestJSON-1161887913-project Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 6600500765544c6188019442f54380ad Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-MultipleCreateTestJSON-1161887913-project Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance e4c48252-ca1c-46a8-906b-1d8f25be8898 could not be found. Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'e4c48252-ca1c-46a8-906b-1d8f25be8898'} Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c48252-ca1c-46a8-906b-1d8f25be8898 could not be found. Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c48252-ca1c-46a8-906b-1d8f25be8898 could not be found. Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:03.977325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:03.983663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:03.983663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:03.983663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:03.983663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:03.983663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:03.983663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c48252-ca1c-46a8-906b-1d8f25be8898 could not be found. Aug 03 01:51:03.983663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:03.983663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4aea91b4-c82e-4b0f-8164-cdbc617bc0c3 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Returning 404 to user: Instance e4c48252-ca1c-46a8-906b-1d8f25be8898 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:03.983663 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4aea91b4-c82e-4b0f-8164-cdbc617bc0c3 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898" status: 404 len: 111 microversion: 2.1 time: 0.032885 Aug 03 01:51:03.983663 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 506/975] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:03 2022] GET /compute/v2.1/servers/e4c48252-ca1c-46a8-906b-1d8f25be8898 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:51:03.988961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9d467ee6-c877-4ff5-8231-be7b3addd542 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:03.989520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9d467ee6-c877-4ff5-8231-be7b3addd542 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:03.995697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d467ee6-c877-4ff5-8231-be7b3addd542 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:03.996154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d467ee6-c877-4ff5-8231-be7b3addd542 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:03.997576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d467ee6-c877-4ff5-8231-be7b3addd542 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:03.997944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d467ee6-c877-4ff5-8231-be7b3addd542 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:04.198102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9d467ee6-c877-4ff5-8231-be7b3addd542 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:04.218071 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9d467ee6-c877-4ff5-8231-be7b3addd542 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1537 microversion: 2.1 time: 0.233223 Aug 03 01:51:04.219009 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 507/976] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:03 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1537 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:04.243023 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1780b54f-758f-4cf3-900d-4b1df281903c tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/2bfa7452-f84b-462a-aed8-dd5968dbd655" status: 202 len: 0 microversion: 2.1 time: 0.361360 Aug 03 01:51:04.244373 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 470/977] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:51:03 2022] DELETE /compute/v2.1/os-security-groups/2bfa7452-f84b-462a-aed8-dd5968dbd655 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:04.250113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cc82985d-1dc3-491c-ab14-5375ed4dc7ac tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:04.251053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cc82985d-1dc3-491c-ab14-5375ed4dc7ac tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:04.258636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cc82985d-1dc3-491c-ab14-5375ed4dc7ac tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:04.259148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cc82985d-1dc3-491c-ab14-5375ed4dc7ac tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:04.260311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cc82985d-1dc3-491c-ab14-5375ed4dc7ac tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:04.260764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cc82985d-1dc3-491c-ab14-5375ed4dc7ac tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:04.347104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cc82985d-1dc3-491c-ab14-5375ed4dc7ac tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:04.357465 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cc82985d-1dc3-491c-ab14-5375ed4dc7ac tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8" status: 200 len: 1469 microversion: 2.1 time: 0.111031 Aug 03 01:51:04.358528 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 471/978] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:04 2022] GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8 => generated 1469 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:04.364383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9d32d597-72ab-440e-a9cf-5c6a184b7ed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:04.365543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9d32d597-72ab-440e-a9cf-5c6a184b7ed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:04.391713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d32d597-72ab-440e-a9cf-5c6a184b7ed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:04.392594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d32d597-72ab-440e-a9cf-5c6a184b7ed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:04.393732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d32d597-72ab-440e-a9cf-5c6a184b7ed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:04.394369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d32d597-72ab-440e-a9cf-5c6a184b7ed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:04.416137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-830ea874-3252-48cb-a6a1-5e52f3e0683a tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Action: 'create', calling method: .version_select at 0x7f5b1342fc10>, body: {"keypair": {"name": "tempest-keypair-2009634013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObTgdyiENQcM6GwVSLxmK9scnNByZAdAIHRCgVRT0l3rwYJQWkddv/m8yzyhOmHp5k5F1e+HPf1XdKMvjj7Uw72a3vvcRn+ZSOfGi368Wk3PNQITf+8Lgw/Y4DcmeZdzA=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:04.446780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-830ea874-3252-48cb-a6a1-5e52f3e0683a tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:04.461645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-830ea874-3252-48cb-a6a1-5e52f3e0683a tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for user 1d4a47687b894dfdb6f0cf7bc09d28c0 and project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:04.464559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:04.493193 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-830ea874-3252-48cb-a6a1-5e52f3e0683a tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.272702 Aug 03 01:51:04.493797 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 508/979] 10.222.0.67 () {62 vars in 1199 bytes} [Wed Aug 3 01:51:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 274 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 03 01:51:04.500240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cde0cfff-aa92-4f0c-9ce6-a66ebf1130aa tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Calling method '.version_select at 0x7f5b135b3670>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:04.567157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG neutronclient.v2_0.client [None req-cde0cfff-aa92-4f0c-9ce6-a66ebf1130aa tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d78a4fb3-c65c-480d-b348-95e4370c1e4c does not exist", "detail": ""}} {{(pid=125941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:51:04.568784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.security_group_api [None req-cde0cfff-aa92-4f0c-9ce6-a66ebf1130aa tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Neutron security group d78a4fb3-c65c-480d-b348-95e4370c1e4c not found {{(pid=125941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 01:51:04.569326 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-cde0cfff-aa92-4f0c-9ce6-a66ebf1130aa tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] HTTP exception thrown: Security group d78a4fb3-c65c-480d-b348-95e4370c1e4c does not exist Aug 03 01:51:04.569326 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-efbc9ecd-bbdc-4f53-851a-9e44d4f18ef8'] Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cde0cfff-aa92-4f0c-9ce6-a66ebf1130aa tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Request method failure captured: Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/os-security-groups/d78a4fb3-c65c-480d-b348-95e4370c1e4c HTTP/1.1 Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dR8HatLgXbzVruesr6W6-5JEmVRce302rL_p-E2jurvtocNZcF2vfZ9_qNfauYKriRxT8vlKK0dYaRTp4-U32WZIO1VHF1xR-gKM11p5VT7NcDYAiNpxqLAisdBFJEKtF8IVX5Y9Rqew_VGfSfp1LgeqXvW3bZmW8tELWH5UNEYFLE Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 4da319132d6349af93a651327a8219ea Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-27851499 Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4da319132d6349af93a651327a8219ea", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4da319132d6349af93a651327a8219ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4da319132d6349af93a651327a8219ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4da319132d6349af93a651327a8219ea"}]}] Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupRulesTestJSON-27851499 Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 4da319132d6349af93a651327a8219ea Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-27851499 Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupRulesTestJSON-27851499-project Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e25f055ae3264c82a2a8cf818c7bad5e Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupRulesTestJSON-27851499-project Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: exception: Security group d78a4fb3-c65c-480d-b348-95e4370c1e4c does not exist Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-efbc9ecd-bbdc-4f53-851a-9e44d4f18ef8'] Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'd78a4fb3-c65c-480d-b348-95e4370c1e4c'} Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:51:04.571886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d78a4fb3-c65c-480d-b348-95e4370c1e4c does not exist Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efbc9ecd-bbdc-4f53-851a-9e44d4f18ef8'] Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d78a4fb3-c65c-480d-b348-95e4370c1e4c does not exist Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efbc9ecd-bbdc-4f53-851a-9e44d4f18ef8'] Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d78a4fb3-c65c-480d-b348-95e4370c1e4c does not exist Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efbc9ecd-bbdc-4f53-851a-9e44d4f18ef8'] Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d78a4fb3-c65c-480d-b348-95e4370c1e4c does not exist Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efbc9ecd-bbdc-4f53-851a-9e44d4f18ef8'] Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cde0cfff-aa92-4f0c-9ce6-a66ebf1130aa tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Returning 404 to user: Security group d78a4fb3-c65c-480d-b348-95e4370c1e4c does not exist Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-efbc9ecd-bbdc-4f53-851a-9e44d4f18ef8'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:04.577677 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cde0cfff-aa92-4f0c-9ce6-a66ebf1130aa tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/d78a4fb3-c65c-480d-b348-95e4370c1e4c" status: 404 len: 194 microversion: 2.1 time: 0.077532 Aug 03 01:51:04.582801 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 509/980] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:51:04 2022] DELETE /compute/v2.1/os-security-groups/d78a4fb3-c65c-480d-b348-95e4370c1e4c => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:51:04.598996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed906371-9b2d-4d46-9fe4-9a95936be830 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Calling method '.version_select at 0x7f5b1336d700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:04.618996 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed906371-9b2d-4d46-9fe4-9a95936be830 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs/tempest-keypair-2009634013" status: 200 len: 512 microversion: 2.2 time: 0.035396 Aug 03 01:51:04.620493 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 510/981] 10.222.0.67 () {60 vars in 1258 bytes} [Wed Aug 3 01:51:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2009634013 => generated 512 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:04.627364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0e54b013-5c94-46b8-ad16-316c2a93e3bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:04.627989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0e54b013-5c94-46b8-ad16-316c2a93e3bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:04.632539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9d32d597-72ab-440e-a9cf-5c6a184b7ed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:04.642210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9d32d597-72ab-440e-a9cf-5c6a184b7ed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:04.643677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e54b013-5c94-46b8-ad16-316c2a93e3bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:04.643952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9d32d597-72ab-440e-a9cf-5c6a184b7ed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:04.644126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e54b013-5c94-46b8-ad16-316c2a93e3bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:04.645049 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9d32d597-72ab-440e-a9cf-5c6a184b7ed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1362 microversion: 2.25 time: 0.285136 Aug 03 01:51:04.645393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e54b013-5c94-46b8-ad16-316c2a93e3bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:04.645748 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 472/982] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:04 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:04.651215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e54b013-5c94-46b8-ad16-316c2a93e3bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:04.658553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ce64be27-3b53-415c-910e-185d4f8ec721 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Calling method '.version_select at 0x7f5b134c1d30>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:04.843960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0e54b013-5c94-46b8-ad16-316c2a93e3bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:04.851576 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0e54b013-5c94-46b8-ad16-316c2a93e3bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1310 microversion: 2.1 time: 0.229941 Aug 03 01:51:04.852147 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 511/983] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:04 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1310 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:04.857125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dc45bd9b-933e-4985-bf9b-a527bc2d875b tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Calling method '.version_select at 0x7f5b133529d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:04.879935 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dc45bd9b-933e-4985-bf9b-a527bc2d875b tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2009634013" status: 204 len: 0 microversion: 2.2 time: 0.026346 Aug 03 01:51:04.880520 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 512/984] 10.222.0.67 () {60 vars in 1261 bytes} [Wed Aug 3 01:51:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2009634013 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:51:04.894192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e226eff3-ad80-42d0-a045-78f657a790b5 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Action: 'create', calling method: .version_select at 0x7f5b135b3790>, body: {"keypair": {"name": "tempest-keypair-507509192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7XZHqAIWguYaifL8U8g990fTBYXl4M/s+eYDwWmXZwqk2n6oGysWBcAMJP/jZIrZxVkJzzDdXewC3KPYkZsaLaN+R/OQrkHq6QXD9knFE+7VsDXBWesu89kw/nWQEmTQ=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:04.910455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-e226eff3-ad80-42d0-a045-78f657a790b5 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:04.916845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-e226eff3-ad80-42d0-a045-78f657a790b5 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for user 1d4a47687b894dfdb6f0cf7bc09d28c0 and project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:04.949437 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ce64be27-3b53-415c-910e-185d4f8ec721 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/42286c66-3719-4c5b-a912-65ba34b0c68d" status: 202 len: 0 microversion: 2.1 time: 0.302194 Aug 03 01:51:04.951704 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 473/985] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:51:04 2022] DELETE /compute/v2.1/os-security-groups/42286c66-3719-4c5b-a912-65ba34b0c68d => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:04.952280 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e226eff3-ad80-42d0-a045-78f657a790b5 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.062727 Aug 03 01:51:04.953052 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 513/986] 10.222.0.67 () {62 vars in 1199 bytes} [Wed Aug 3 01:51:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 03 01:51:04.958077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-df1d0c9c-3782-4f3b-9789-fc962a5d0189 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:04.958944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-df1d0c9c-3782-4f3b-9789-fc962a5d0189 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:04.965767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df1d0c9c-3782-4f3b-9789-fc962a5d0189 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:04.966637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df1d0c9c-3782-4f3b-9789-fc962a5d0189 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:04.967791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df1d0c9c-3782-4f3b-9789-fc962a5d0189 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:04.968396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df1d0c9c-3782-4f3b-9789-fc962a5d0189 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:04.976760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a5920c24-1e13-4a49-a8bf-f82f37b467ca tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Calling method '.version_select at 0x7f5b132c24c0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:05.168744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-df1d0c9c-3782-4f3b-9789-fc962a5d0189 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:05.177706 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-df1d0c9c-3782-4f3b-9789-fc962a5d0189 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1534 microversion: 2.1 time: 0.224068 Aug 03 01:51:05.178673 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 474/987] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:04 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1534 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:05.184105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-88b5bc1d-5020-4274-a935-b81a66a4f32e tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Calling method '.version_select at 0x7f5b134c1550>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:05.207028 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-88b5bc1d-5020-4274-a935-b81a66a4f32e tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-507509192" status: 204 len: 0 microversion: 2.2 time: 0.027055 Aug 03 01:51:05.207621 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 475/988] 10.222.0.67 () {60 vars in 1258 bytes} [Wed Aug 3 01:51:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-507509192 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:51:05.213629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-57eb8fbb-cd14-4c54-bdcc-be2ca6a4c661 req-33f378d7-3108-4fca-bb3c-c9dee40968a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1025ec9b-6b5d-445a-8c05-ae537d3273cc", "name": "network-vif-plugged", "status": "completed", "tag": "db8c88b5-548a-478f-bd6f-7ccdcd714cf9"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:05.223465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-57eb8fbb-cd14-4c54-bdcc-be2ca6a4c661 req-33f378d7-3108-4fca-bb3c-c9dee40968a1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:05.223967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-57eb8fbb-cd14-4c54-bdcc-be2ca6a4c661 req-33f378d7-3108-4fca-bb3c-c9dee40968a1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:05.237929 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-57eb8fbb-cd14-4c54-bdcc-be2ca6a4c661 req-33f378d7-3108-4fca-bb3c-c9dee40968a1 service nova] Creating event network-vif-plugged:db8c88b5-548a-478f-bd6f-7ccdcd714cf9 for instance 1025ec9b-6b5d-445a-8c05-ae537d3273cc on n-h1-826529-8 Aug 03 01:51:05.243389 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-57eb8fbb-cd14-4c54-bdcc-be2ca6a4c661 req-33f378d7-3108-4fca-bb3c-c9dee40968a1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034582 Aug 03 01:51:05.243987 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 476/989] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:05.249722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1015104f-8785-497a-b7eb-93cc4b0071d8 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Action: 'create', calling method: .version_select at 0x7f5b135a4a60>, body: {"pool": "b7ba8541-4926-46e2-babc-3b914e46eef0"} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:05.413667 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a5920c24-1e13-4a49-a8bf-f82f37b467ca tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/01a8f78d-6cfc-4458-9a0d-a43dce2b1d0e" status: 202 len: 0 microversion: 2.1 time: 0.447914 Aug 03 01:51:05.414351 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 514/990] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:51:04 2022] DELETE /compute/v2.1/os-security-groups/01a8f78d-6cfc-4458-9a0d-a43dce2b1d0e => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:05.420363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fa250bd4-6fd1-4a08-a4fb-8e729eb66135 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Action: 'create', calling method: .version_select at 0x7f5b13c31c10>, body: {"keypair": {"name": "tempest-keypair-980622490", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:05.443193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-fa250bd4-6fd1-4a08-a4fb-8e729eb66135 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:05.449725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-fa250bd4-6fd1-4a08-a4fb-8e729eb66135 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for user 1d4a47687b894dfdb6f0cf7bc09d28c0 and project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:05.473442 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fa250bd4-6fd1-4a08-a4fb-8e729eb66135 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.057817 Aug 03 01:51:05.474050 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 515/991] 10.222.0.67 () {62 vars in 1199 bytes} [Wed Aug 3 01:51:05 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 03 01:51:05.480264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eac21d36-2f79-48b4-b2f0-d94f96127e3f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:05.480882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eac21d36-2f79-48b4-b2f0-d94f96127e3f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:05.489090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eac21d36-2f79-48b4-b2f0-d94f96127e3f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:05.489460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eac21d36-2f79-48b4-b2f0-d94f96127e3f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:05.491039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eac21d36-2f79-48b4-b2f0-d94f96127e3f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:05.491645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eac21d36-2f79-48b4-b2f0-d94f96127e3f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:05.731325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-eac21d36-2f79-48b4-b2f0-d94f96127e3f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:05.748989 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eac21d36-2f79-48b4-b2f0-d94f96127e3f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1537 microversion: 2.1 time: 0.273208 Aug 03 01:51:05.749823 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 516/992] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:05 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1537 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:05.755979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3079d5f2-dbae-416b-9878-008c8a66a093 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:05.756988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3079d5f2-dbae-416b-9878-008c8a66a093 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:05.766206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3079d5f2-dbae-416b-9878-008c8a66a093 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:05.766699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3079d5f2-dbae-416b-9878-008c8a66a093 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:05.767652 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3079d5f2-dbae-416b-9878-008c8a66a093 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:05.768105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3079d5f2-dbae-416b-9878-008c8a66a093 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:05.803480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3079d5f2-dbae-416b-9878-008c8a66a093 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:05.803933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3079d5f2-dbae-416b-9878-008c8a66a093 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:05.804390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-3079d5f2-dbae-416b-9878-008c8a66a093 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lazy-loading 'fault' on Instance uuid ead43f0d-1799-4bb2-832f-72d69c006cc8 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:51:05.862402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3079d5f2-dbae-416b-9878-008c8a66a093 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6600500765544c6188019442f54380ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '359b651cd3fd4147b171fed1c77eccb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:05.870382 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3079d5f2-dbae-416b-9878-008c8a66a093 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8" status: 200 len: 1307 microversion: 2.1 time: 0.118663 Aug 03 01:51:05.870976 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 517/993] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:05 2022] GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8 => generated 1307 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:05.880145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-62217e55-0f7f-493a-ac07-0e1a8a3cc96b tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Calling method '.version_select at 0x7f5b138965e0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:06.480385 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-62217e55-0f7f-493a-ac07-0e1a8a3cc96b tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/c7776d44-7674-4a84-ae2b-573c0d0ecc89" status: 202 len: 0 microversion: 2.1 time: 0.608279 Aug 03 01:51:06.481156 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 518/994] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:51:05 2022] DELETE /compute/v2.1/os-security-groups/c7776d44-7674-4a84-ae2b-573c0d0ecc89 => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:06.487282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-71281cd2-527c-47ca-8f2f-df64e26daba8 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Calling method '.version_select at 0x7f5b1336d430>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:06.512008 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-71281cd2-527c-47ca-8f2f-df64e26daba8 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-980622490" status: 204 len: 0 microversion: 2.2 time: 0.029124 Aug 03 01:51:06.520831 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 519/995] 10.222.0.67 () {60 vars in 1258 bytes} [Wed Aug 3 01:51:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-980622490 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:51:06.533166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b93f5842-bd97-4c20-88b6-eb4dead8f3d8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:06.533833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b93f5842-bd97-4c20-88b6-eb4dead8f3d8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:06.550332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b93f5842-bd97-4c20-88b6-eb4dead8f3d8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:06.551007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b93f5842-bd97-4c20-88b6-eb4dead8f3d8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:06.552137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b93f5842-bd97-4c20-88b6-eb4dead8f3d8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:06.552572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b93f5842-bd97-4c20-88b6-eb4dead8f3d8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:06.781300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b93f5842-bd97-4c20-88b6-eb4dead8f3d8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:06.789516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b93f5842-bd97-4c20-88b6-eb4dead8f3d8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:06.791513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b93f5842-bd97-4c20-88b6-eb4dead8f3d8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:06.792159 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b93f5842-bd97-4c20-88b6-eb4dead8f3d8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1362 microversion: 2.25 time: 0.270082 Aug 03 01:51:06.792719 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 520/996] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:06 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:06.797415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f1194f12-9673-4977-adf0-e1316ee99f1d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:06.798014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f1194f12-9673-4977-adf0-e1316ee99f1d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:06.804069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1194f12-9673-4977-adf0-e1316ee99f1d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:06.804523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1194f12-9673-4977-adf0-e1316ee99f1d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:06.805282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1194f12-9673-4977-adf0-e1316ee99f1d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:06.805887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1194f12-9673-4977-adf0-e1316ee99f1d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:07.070324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f1194f12-9673-4977-adf0-e1316ee99f1d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:07.074804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:07.081061 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f1194f12-9673-4977-adf0-e1316ee99f1d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1493 microversion: 2.1 time: 0.287338 Aug 03 01:51:07.081842 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 521/997] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:06 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1493 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:07.098845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1babb6a8-cd8c-4cb6-8d88-a24f5463e789 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Calling method '.version_select at 0x7f5b132c2dc0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:07.220311 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1015104f-8785-497a-b7eb-93cc4b0071d8 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.975056 Aug 03 01:51:07.220908 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 477/998] 10.222.0.67 () {60 vars in 1170 bytes} [Wed Aug 3 01:51:05 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:07.229459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-34f760d1-4be8-40d3-8dea-4bb9f84f3392 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Action: 'create', calling method: .version_select at 0x7f5b1352aca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1403189913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjOJe/6+f9Z1V7jDx4m4JZS5Dv83AlP0AnBgspb/xzV4DgfZ0scM2LCGQnside4GNzGKW0ehawgxwGO+gL7YRLPqT3UZ4vyuvQxas3Do1EWqcBa7CEMZmSVNb5OdCfs6A=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:07.247542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-34f760d1-4be8-40d3-8dea-4bb9f84f3392 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:07.251930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-34f760d1-4be8-40d3-8dea-4bb9f84f3392 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for user 1d4a47687b894dfdb6f0cf7bc09d28c0 and project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:07.280846 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-34f760d1-4be8-40d3-8dea-4bb9f84f3392 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.055228 Aug 03 01:51:07.281767 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 478/999] 10.222.0.67 () {62 vars in 1199 bytes} [Wed Aug 3 01:51:07 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 03 01:51:07.286483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d3e93584-bf3c-4edb-af42-982ce0f7ba00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:07.287238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d3e93584-bf3c-4edb-af42-982ce0f7ba00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:07.294526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d3e93584-bf3c-4edb-af42-982ce0f7ba00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:07.295022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d3e93584-bf3c-4edb-af42-982ce0f7ba00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:07.295811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d3e93584-bf3c-4edb-af42-982ce0f7ba00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:07.296254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d3e93584-bf3c-4edb-af42-982ce0f7ba00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:07.377689 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1babb6a8-cd8c-4cb6-8d88-a24f5463e789 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/43f86a6f-2f30-47d2-b8c4-c0eaf8ea992b" status: 202 len: 0 microversion: 2.1 time: 0.294695 Aug 03 01:51:07.378284 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 522/1000] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:51:07 2022] DELETE /compute/v2.1/os-security-groups/43f86a6f-2f30-47d2-b8c4-c0eaf8ea992b => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:07.383222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-556c45eb-e1c4-4b06-af2b-508dd9467614 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:07.383842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-556c45eb-e1c4-4b06-af2b-508dd9467614 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] [instance: ead43f0d-1799-4bb2-832f-72d69c006cc8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:07.390820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-556c45eb-e1c4-4b06-af2b-508dd9467614 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:07.391313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-556c45eb-e1c4-4b06-af2b-508dd9467614 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:07.392103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-556c45eb-e1c4-4b06-af2b-508dd9467614 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:07.392550 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-556c45eb-e1c4-4b06-af2b-508dd9467614 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:07.408417 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-556c45eb-e1c4-4b06-af2b-508dd9467614 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] HTTP exception thrown: Instance ead43f0d-1799-4bb2-832f-72d69c006cc8 could not be found. Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-556c45eb-e1c4-4b06-af2b-508dd9467614 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Request method failure captured: Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8 HTTP/1.1 Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dRRgHxUs9HliJBeyVw0RMzrITgCLsm4i3Yf46BBpwDxAtVhEWm3yF6avTbC3gwP44WZqflYcXJGXX_xrTlvsDpIK1ydQiTkYDjckbT9V17L0Fq9Jtq0mFMTqA-HqED0xk03TnfUQSAV-dPZQeHXPH_o4iLhxN2UTP6zVS3Cmh-KYqc Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 359b651cd3fd4147b171fed1c77eccb2 Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-MultipleCreateTestJSON-1161887913 Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_359b651cd3fd4147b171fed1c77eccb2", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/359b651cd3fd4147b171fed1c77eccb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/359b651cd3fd4147b171fed1c77eccb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/359b651cd3fd4147b171fed1c77eccb2"}]}] Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-MultipleCreateTestJSON-1161887913 Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 359b651cd3fd4147b171fed1c77eccb2 Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1161887913 Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-MultipleCreateTestJSON-1161887913-project Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 6600500765544c6188019442f54380ad Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-MultipleCreateTestJSON-1161887913-project Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance ead43f0d-1799-4bb2-832f-72d69c006cc8 could not be found. Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'ead43f0d-1799-4bb2-832f-72d69c006cc8'} Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead43f0d-1799-4bb2-832f-72d69c006cc8 could not be found. Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead43f0d-1799-4bb2-832f-72d69c006cc8 could not be found. Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:07.409987 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:07.414186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:07.414186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:07.414186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:07.414186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:07.414186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:07.414186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead43f0d-1799-4bb2-832f-72d69c006cc8 could not be found. Aug 03 01:51:07.414186 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:07.414186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-556c45eb-e1c4-4b06-af2b-508dd9467614 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] Returning 404 to user: Instance ead43f0d-1799-4bb2-832f-72d69c006cc8 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:07.414186 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-556c45eb-e1c4-4b06-af2b-508dd9467614 tempest-MultipleCreateTestJSON-1161887913 tempest-MultipleCreateTestJSON-1161887913-project] 10.222.0.67 "GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8" status: 404 len: 111 microversion: 2.1 time: 0.032132 Aug 03 01:51:07.414186 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 523/1001] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:07 2022] GET /compute/v2.1/servers/ead43f0d-1799-4bb2-832f-72d69c006cc8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:51:07.416898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cbf51f99-d38d-4293-ac62-e011fe13ed43 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:07.417684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cbf51f99-d38d-4293-ac62-e011fe13ed43 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:07.424903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbf51f99-d38d-4293-ac62-e011fe13ed43 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:07.425363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbf51f99-d38d-4293-ac62-e011fe13ed43 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:07.426162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbf51f99-d38d-4293-ac62-e011fe13ed43 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:07.426613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbf51f99-d38d-4293-ac62-e011fe13ed43 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:07.560478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d3e93584-bf3c-4edb-af42-982ce0f7ba00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:07.568054 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d3e93584-bf3c-4edb-af42-982ce0f7ba00 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1542 microversion: 2.1 time: 0.285280 Aug 03 01:51:07.568619 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 479/1002] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:07 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1542 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:07.573444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0b644f05-85b1-4714-8fcc-63d905323f67 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Action: 'action', calling method: .version_select at 0x7f5b220c2ee0>, body: {"addFloatingIp": {"address": "172.25.1.95"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:07.576016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0b644f05-85b1-4714-8fcc-63d905323f67 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:07.581887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b644f05-85b1-4714-8fcc-63d905323f67 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:07.582546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b644f05-85b1-4714-8fcc-63d905323f67 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:07.583520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b644f05-85b1-4714-8fcc-63d905323f67 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:07.583962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b644f05-85b1-4714-8fcc-63d905323f67 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:07.634659 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cbf51f99-d38d-4293-ac62-e011fe13ed43 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1644 microversion: 2.1 time: 0.221548 Aug 03 01:51:07.637055 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 524/1003] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:07 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1644 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:07.642162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-44c17cdb-b90c-4ffd-80f0-d8c49ce8a7ed tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Action: 'create', calling method: .version_select at 0x7f5b135b3790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1048189003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHWfH1kvBNo/SuWkEZxnUxzTxBMFe6ET5BOCX2/8Nha+twag3Kt88oJNoO/Wqf13eppHDzCuZrGVlanFyAFLLbP1qr8qpvhlkHmMHhhuKQJDHI4VjCgVYfhsgyAMFoTqw=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:07.651420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b644f05-85b1-4714-8fcc-63d905323f67 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Acquired lock "refresh_cache-b647860c-e2e2-4a77-bb70-d396616839cf" {{(pid=125942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 01:51:07.661920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-44c17cdb-b90c-4ffd-80f0-d8c49ce8a7ed tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:07.666705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-44c17cdb-b90c-4ffd-80f0-d8c49ce8a7ed tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for user 1d4a47687b894dfdb6f0cf7bc09d28c0 and project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:07.692165 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-44c17cdb-b90c-4ffd-80f0-d8c49ce8a7ed tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.055178 Aug 03 01:51:07.692783 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 525/1004] 10.222.0.67 () {62 vars in 1199 bytes} [Wed Aug 3 01:51:07 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 03 01:51:07.698294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e2a9cb0c-15e9-48e2-b5d9-8865b0cc6230 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] Calling method '.version_select at 0x7f5b1336de50>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:08.422949 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e2a9cb0c-15e9-48e2-b5d9-8865b0cc6230 tempest-SecurityGroupRulesTestJSON-27851499 tempest-SecurityGroupRulesTestJSON-27851499-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/cc3e8f36-225a-41fc-a374-06f3fb7e9c5b" status: 202 len: 0 microversion: 2.1 time: 0.728916 Aug 03 01:51:08.423537 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 526/1005] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:51:07 2022] DELETE /compute/v2.1/os-security-groups/cc3e8f36-225a-41fc-a374-06f3fb7e9c5b => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:08.427875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-279f0685-e227-4ac0-89b8-ef7699a92473 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:08.428483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-279f0685-e227-4ac0-89b8-ef7699a92473 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:08.434862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-279f0685-e227-4ac0-89b8-ef7699a92473 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:08.435538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-279f0685-e227-4ac0-89b8-ef7699a92473 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:08.436321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-279f0685-e227-4ac0-89b8-ef7699a92473 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:08.436756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-279f0685-e227-4ac0-89b8-ef7699a92473 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:08.814715 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-279f0685-e227-4ac0-89b8-ef7699a92473 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1644 microversion: 2.1 time: 0.390112 Aug 03 01:51:08.815505 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 527/1006] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:08 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1644 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:08.820594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-89d2ad86-f24b-44e5-af96-864621302f7d tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Action: 'create', calling method: .version_select at 0x7f5b132c21f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1962288169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHyRX05/3CodS/d7rfdb0AssY7+5+5REhaCwitCKTaLth1hkw9KpdA0LjIDy+DWXb1qiNMAosIpIkXfB+CHHYVzE/cRYfWz3XMt3bvRDVWrRrAc6hUULaA1KYyxy0aHEw=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:08.837283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-89d2ad86-f24b-44e5-af96-864621302f7d tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:08.845197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-89d2ad86-f24b-44e5-af96-864621302f7d tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for user 1d4a47687b894dfdb6f0cf7bc09d28c0 and project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:08.871335 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-89d2ad86-f24b-44e5-af96-864621302f7d tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.054381 Aug 03 01:51:08.872811 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 528/1007] 10.222.0.67 () {62 vars in 1199 bytes} [Wed Aug 3 01:51:08 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 03 01:51:08.883804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-db50f202-ba52-4346-99e2-999fc94a87ba tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:08.884411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-db50f202-ba52-4346-99e2-999fc94a87ba tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:08.893728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-db50f202-ba52-4346-99e2-999fc94a87ba tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:08.894475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-db50f202-ba52-4346-99e2-999fc94a87ba tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:08.895579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-db50f202-ba52-4346-99e2-999fc94a87ba tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:08.896184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-db50f202-ba52-4346-99e2-999fc94a87ba tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:09.247505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-db50f202-ba52-4346-99e2-999fc94a87ba tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:09.255629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-db50f202-ba52-4346-99e2-999fc94a87ba tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:09.257069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-db50f202-ba52-4346-99e2-999fc94a87ba tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:09.258230 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-db50f202-ba52-4346-99e2-999fc94a87ba tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1559 microversion: 2.25 time: 0.384159 Aug 03 01:51:09.259011 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 529/1008] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:08 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1559 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:09.263869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-457939d5-f6ab-4ef4-aad0-8aa9304c3a04 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:09.264449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-457939d5-f6ab-4ef4-aad0-8aa9304c3a04 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:09.271255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-457939d5-f6ab-4ef4-aad0-8aa9304c3a04 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:09.271709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-457939d5-f6ab-4ef4-aad0-8aa9304c3a04 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:09.272498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-457939d5-f6ab-4ef4-aad0-8aa9304c3a04 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:09.272965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-457939d5-f6ab-4ef4-aad0-8aa9304c3a04 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:09.865359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-457939d5-f6ab-4ef4-aad0-8aa9304c3a04 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:09.873786 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-457939d5-f6ab-4ef4-aad0-8aa9304c3a04 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1542 microversion: 2.1 time: 0.613870 Aug 03 01:51:09.888796 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 530/1009] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:09 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1542 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:09.893800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6167509c-0482-43dc-95a1-2c18ddefccf9 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:09.896466 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:51:09.896466 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:51:09.897839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6167509c-0482-43dc-95a1-2c18ddefccf9 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:09.898291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6167509c-0482-43dc-95a1-2c18ddefccf9 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:09.899330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6167509c-0482-43dc-95a1-2c18ddefccf9 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:09.899942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6167509c-0482-43dc-95a1-2c18ddefccf9 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:09.926780 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6167509c-0482-43dc-95a1-2c18ddefccf9 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036798 Aug 03 01:51:09.927429 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 531/1010] 10.222.0.67 () {58 vars in 1176 bytes} [Wed Aug 3 01:51:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:09.932165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-98ac2233-424f-4dbf-b379-c3f547301088 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Calling method '.version_select at 0x7f5b1336d670>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:09.936748 n-d-826529-8 devstack@n-api.service[125941]: WARNING oslo_db.sqlalchemy.utils [None req-98ac2233-424f-4dbf-b379-c3f547301088 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 03 01:51:09.944269 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-98ac2233-424f-4dbf-b379-c3f547301088 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.015498 Aug 03 01:51:09.945097 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 532/1011] 10.222.0.67 () {60 vars in 1177 bytes} [Wed Aug 3 01:51:09 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:09.950785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a304a409-d8e9-4b24-8af4-adba9b4a2f1c tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:09.951718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a304a409-d8e9-4b24-8af4-adba9b4a2f1c tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:09.960205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a304a409-d8e9-4b24-8af4-adba9b4a2f1c tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:09.960993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a304a409-d8e9-4b24-8af4-adba9b4a2f1c tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:09.962019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a304a409-d8e9-4b24-8af4-adba9b4a2f1c tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:09.962681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a304a409-d8e9-4b24-8af4-adba9b4a2f1c tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:10.416584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-a304a409-d8e9-4b24-8af4-adba9b4a2f1c tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'services' on Instance uuid 1025ec9b-6b5d-445a-8c05-ae537d3273cc {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:51:10.432960 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a304a409-d8e9-4b24-8af4-adba9b4a2f1c tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 2052 microversion: 2.25 time: 0.486565 Aug 03 01:51:10.433894 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 533/1012] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:09 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 2052 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:10.439213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bfb24069-964a-44a5-b307-278de3fdbbe2 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:10.439756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bfb24069-964a-44a5-b307-278de3fdbbe2 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:10.448920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfb24069-964a-44a5-b307-278de3fdbbe2 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:10.449378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfb24069-964a-44a5-b307-278de3fdbbe2 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:10.452898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfb24069-964a-44a5-b307-278de3fdbbe2 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:10.453354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfb24069-964a-44a5-b307-278de3fdbbe2 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:10.469820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-0b644f05-85b1-4714-8fcc-63d905323f67 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Building network info cache for instance {{(pid=125942) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 01:51:10.579800 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bfb24069-964a-44a5-b307-278de3fdbbe2 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa/action" status: 202 len: 0 microversion: 2.1 time: 0.143928 Aug 03 01:51:10.584882 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 534/1013] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:51:10 2022] POST /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:10.605130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-207e9f16-7a8c-48b9-b4d9-1186ae83cac6 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Calling method '.version_select at 0x7f5b135f3550>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:10.641669 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-207e9f16-7a8c-48b9-b4d9-1186ae83cac6 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1962288169" status: 204 len: 0 microversion: 2.2 time: 0.054195 Aug 03 01:51:10.645672 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 535/1014] 10.222.0.67 () {60 vars in 1321 bytes} [Wed Aug 3 01:51:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1962288169 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:51:10.649249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d167875-a25b-4e6c-b3cf-99060d4425af tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:10.650699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6d167875-a25b-4e6c-b3cf-99060d4425af tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:10.654884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:10.661686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d167875-a25b-4e6c-b3cf-99060d4425af tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:10.662158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d167875-a25b-4e6c-b3cf-99060d4425af tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:10.663008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d167875-a25b-4e6c-b3cf-99060d4425af tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:10.663681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d167875-a25b-4e6c-b3cf-99060d4425af tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:11.154492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-6d167875-a25b-4e6c-b3cf-99060d4425af tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'services' on Instance uuid 1025ec9b-6b5d-445a-8c05-ae537d3273cc {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:51:11.169279 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6d167875-a25b-4e6c-b3cf-99060d4425af tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 2052 microversion: 2.25 time: 0.525000 Aug 03 01:51:11.171473 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 536/1015] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:10 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 2052 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:11.178460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-12834396-612f-4b63-b3e1-684cc387d693 req-2a12a679-f1fa-4662-9ffc-82a32e110cde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b647860c-e2e2-4a77-bb70-d396616839cf", "tag": "b440c03b-e6d3-40bf-97c1-ca18782b6c46"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:11.192299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-12834396-612f-4b63-b3e1-684cc387d693 req-2a12a679-f1fa-4662-9ffc-82a32e110cde service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:11.192984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-12834396-612f-4b63-b3e1-684cc387d693 req-2a12a679-f1fa-4662-9ffc-82a32e110cde service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:11.207847 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-12834396-612f-4b63-b3e1-684cc387d693 req-2a12a679-f1fa-4662-9ffc-82a32e110cde service nova] Creating event network-changed:b440c03b-e6d3-40bf-97c1-ca18782b6c46 for instance b647860c-e2e2-4a77-bb70-d396616839cf on n-h2-826529-8 Aug 03 01:51:11.212949 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-12834396-612f-4b63-b3e1-684cc387d693 req-2a12a679-f1fa-4662-9ffc-82a32e110cde service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038916 Aug 03 01:51:11.213870 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 537/1016] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:11.219632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-02bff51c-00dc-4dad-ace7-d6663ec2b89a tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:11.220632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-02bff51c-00dc-4dad-ace7-d6663ec2b89a tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:11.240193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02bff51c-00dc-4dad-ace7-d6663ec2b89a tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:11.241656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02bff51c-00dc-4dad-ace7-d6663ec2b89a tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:11.242592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02bff51c-00dc-4dad-ace7-d6663ec2b89a tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:11.243158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02bff51c-00dc-4dad-ace7-d6663ec2b89a tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:11.676317 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-02bff51c-00dc-4dad-ace7-d6663ec2b89a tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1629 microversion: 2.1 time: 0.461300 Aug 03 01:51:11.677020 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 538/1017] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:11 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1629 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:11.691628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cb2abc72-da29-4797-9dd2-7a2bdc6927e5 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Calling method '.version_select at 0x7f5b132c2790>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:11.719847 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cb2abc72-da29-4797-9dd2-7a2bdc6927e5 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1048189003" status: 204 len: 0 microversion: 2.2 time: 0.031794 Aug 03 01:51:11.720517 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 539/1018] 10.222.0.67 () {60 vars in 1321 bytes} [Wed Aug 3 01:51:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1048189003 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:51:11.726241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c00ff0cf-df02-4c7f-9457-68b16b481f98 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:11.727184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c00ff0cf-df02-4c7f-9457-68b16b481f98 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:11.734056 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c00ff0cf-df02-4c7f-9457-68b16b481f98 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:11.734511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c00ff0cf-df02-4c7f-9457-68b16b481f98 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:11.735341 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c00ff0cf-df02-4c7f-9457-68b16b481f98 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:11.735789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c00ff0cf-df02-4c7f-9457-68b16b481f98 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:12.392714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-0b644f05-85b1-4714-8fcc-63d905323f67 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Updating instance_info_cache with network_info: [{"id": "b440c03b-e6d3-40bf-97c1-ca18782b6c46", "address": "fa:16:3e:01:53:29", "network": {"id": "297ffbc2-8a68-402c-98a8-069cd6f5baf6", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-942505919-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "69aa4c52c59841f59db580a6dca4446b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb440c03b-e6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125942) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 01:51:12.406351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c00ff0cf-df02-4c7f-9457-68b16b481f98 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:12.417101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b644f05-85b1-4714-8fcc-63d905323f67 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Releasing lock "refresh_cache-b647860c-e2e2-4a77-bb70-d396616839cf" {{(pid=125942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 01:51:12.418205 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c00ff0cf-df02-4c7f-9457-68b16b481f98 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1542 microversion: 2.1 time: 0.696850 Aug 03 01:51:12.434023 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0b644f05-85b1-4714-8fcc-63d905323f67 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action" status: 202 len: 0 microversion: 2.1 time: 4.864320 Aug 03 01:51:12.434827 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 540/1019] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:11 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1542 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:12.439468 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 480/1020] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:51:07 2022] POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action => generated 0 bytes in 4870 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 01:51:12.446026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0802db7b-a4d4-4002-aef4-133907996f52 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:12.447412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b5412b45-78a2-4c06-8f0a-779e0bf3dbb5 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-826529-8", "block_migration": true, "disk_over_commit": false}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:12.450180 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:51:12.450180 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:51:12.454536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0802db7b-a4d4-4002-aef4-133907996f52 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:12.455882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b5412b45-78a2-4c06-8f0a-779e0bf3dbb5 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:12.468683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0802db7b-a4d4-4002-aef4-133907996f52 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:12.469815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0802db7b-a4d4-4002-aef4-133907996f52 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:12.470265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0802db7b-a4d4-4002-aef4-133907996f52 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:12.484269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5412b45-78a2-4c06-8f0a-779e0bf3dbb5 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:12.484955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5412b45-78a2-4c06-8f0a-779e0bf3dbb5 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:12.486548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5412b45-78a2-4c06-8f0a-779e0bf3dbb5 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:12.487872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5412b45-78a2-4c06-8f0a-779e0bf3dbb5 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:12.535251 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0802db7b-a4d4-4002-aef4-133907996f52 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.098852 Aug 03 01:51:12.538497 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 541/1021] 10.222.0.67 () {60 vars in 1217 bytes} [Wed Aug 3 01:51:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:51:12.544521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-92b0058b-897c-4239-9abd-c73294018289 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Calling method '.version_select at 0x7f5b1335dd30>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:12.549956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-b5412b45-78a2-4c06-8f0a-779e0bf3dbb5 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lazy-loading 'flavor' on Instance uuid ee6c9f9b-e708-44b8-8c72-49704bda21aa {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:51:12.582927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b5412b45-78a2-4c06-8f0a-779e0bf3dbb5 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Going to try to live migrate instance to n-h1-826529-8 {{(pid=125942) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 01:51:12.602402 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-92b0058b-897c-4239-9abd-c73294018289 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1403189913" status: 204 len: 0 microversion: 2.2 time: 0.062585 Aug 03 01:51:12.610605 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 542/1022] 10.222.0.67 () {60 vars in 1321 bytes} [Wed Aug 3 01:51:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1403189913 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:51:12.617280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6c3b8c10-34b6-4b6b-8bbc-21d10cc14bb7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Action: 'create', calling method: .version_select at 0x7f5b132c2310>, body: {"pool": "b7ba8541-4926-46e2-babc-3b914e46eef0"} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:14.199486 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b5412b45-78a2-4c06-8f0a-779e0bf3dbb5 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa/action" status: 202 len: 0 microversion: 2.1 time: 1.758697 Aug 03 01:51:14.204458 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 481/1023] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:51:12 2022] POST /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa/action => generated 0 bytes in 1764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:14.209739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-09af7059-99ff-402a-8ac7-81c97a0b79bb tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:14.210550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-09af7059-99ff-402a-8ac7-81c97a0b79bb tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:14.228956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09af7059-99ff-402a-8ac7-81c97a0b79bb tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:14.229412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09af7059-99ff-402a-8ac7-81c97a0b79bb tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:14.230492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09af7059-99ff-402a-8ac7-81c97a0b79bb tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:14.232018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09af7059-99ff-402a-8ac7-81c97a0b79bb tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:14.364583 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-09af7059-99ff-402a-8ac7-81c97a0b79bb tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc/action" status: 202 len: 0 microversion: 2.25 time: 0.158514 Aug 03 01:51:14.367055 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 482/1024] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 3 01:51:14 2022] POST /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:51:14.380984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4309d73b-9fa6-43d3-8642-90203fea6573 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Action: 'create', calling method: .version_select at 0x7f5b135a4820>, body: {"keypair": {"name": "tempest-keypair-2084025487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs3m9dNIInQh0hDhaLUDw4GFVKRCp/4V0bWn9EzbLgTjFp4exl6r5JnIWOL6RXUeRg9c0AmWJ0XXspG5r6+cxNsqO2t2cj5D34f5tqbsVBU+Y3oaYlcuT5rhrUAZAbDCw=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:14.413193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-4309d73b-9fa6-43d3-8642-90203fea6573 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:14.420541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-4309d73b-9fa6-43d3-8642-90203fea6573 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for user 1d4a47687b894dfdb6f0cf7bc09d28c0 and project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:14.426721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:14.474096 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4309d73b-9fa6-43d3-8642-90203fea6573 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.103707 Aug 03 01:51:14.475749 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 483/1025] 10.222.0.67 () {62 vars in 1199 bytes} [Wed Aug 3 01:51:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 03 01:51:14.486500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-85de9a85-a812-4ad4-aab9-84c954d77a6d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:14.487991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-85de9a85-a812-4ad4-aab9-84c954d77a6d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:14.499331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85de9a85-a812-4ad4-aab9-84c954d77a6d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:14.500396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85de9a85-a812-4ad4-aab9-84c954d77a6d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:14.501436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85de9a85-a812-4ad4-aab9-84c954d77a6d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:14.502030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85de9a85-a812-4ad4-aab9-84c954d77a6d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:14.884829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-85de9a85-a812-4ad4-aab9-84c954d77a6d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:14.894752 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-85de9a85-a812-4ad4-aab9-84c954d77a6d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1542 microversion: 2.1 time: 0.417909 Aug 03 01:51:14.895928 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 484/1026] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:14 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1542 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:14.900987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-06f83771-89c3-42d5-b61b-2eac3ca78180 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:14.901789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-06f83771-89c3-42d5-b61b-2eac3ca78180 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:14.912721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06f83771-89c3-42d5-b61b-2eac3ca78180 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:14.913277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06f83771-89c3-42d5-b61b-2eac3ca78180 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:14.914138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06f83771-89c3-42d5-b61b-2eac3ca78180 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:14.915472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06f83771-89c3-42d5-b61b-2eac3ca78180 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:15.335255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-06f83771-89c3-42d5-b61b-2eac3ca78180 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:15.349691 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-06f83771-89c3-42d5-b61b-2eac3ca78180 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1503 microversion: 2.1 time: 0.451727 Aug 03 01:51:15.350729 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 485/1027] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:14 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1503 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:15.357518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-03fa1db1-258c-41fc-aebb-97bab4a9cdc2 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:15.358585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-03fa1db1-258c-41fc-aebb-97bab4a9cdc2 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:15.368137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03fa1db1-258c-41fc-aebb-97bab4a9cdc2 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:15.368942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03fa1db1-258c-41fc-aebb-97bab4a9cdc2 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:15.370056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03fa1db1-258c-41fc-aebb-97bab4a9cdc2 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:15.370776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03fa1db1-258c-41fc-aebb-97bab4a9cdc2 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:15.517322 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6c3b8c10-34b6-4b6b-8bbc-21d10cc14bb7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.905033 Aug 03 01:51:15.518948 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 543/1028] 10.222.0.67 () {60 vars in 1170 bytes} [Wed Aug 3 01:51:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:15.526213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-29b272b9-8cc9-4e05-a895-191a07fa7f30 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Calling method '.version_select at 0x7f5b132c2700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:15.539668 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-29b272b9-8cc9-4e05-a895-191a07fa7f30 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs/tempest-keypair-2084025487" status: 200 len: 513 microversion: 2.2 time: 0.019389 Aug 03 01:51:15.550772 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 544/1029] 10.222.0.67 () {60 vars in 1258 bytes} [Wed Aug 3 01:51:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2084025487 => generated 513 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:15.556134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b3db39ae-82f5-40e4-8e4c-9fe1feeb7f54 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Action: 'action', calling method: .version_select at 0x7f5b21f08c10>, body: {"addFloatingIp": {"address": "172.25.1.236"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:15.558762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b3db39ae-82f5-40e4-8e4c-9fe1feeb7f54 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:15.566579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3db39ae-82f5-40e4-8e4c-9fe1feeb7f54 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:15.567317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3db39ae-82f5-40e4-8e4c-9fe1feeb7f54 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:15.568497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3db39ae-82f5-40e4-8e4c-9fe1feeb7f54 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:15.569179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3db39ae-82f5-40e4-8e4c-9fe1feeb7f54 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:15.595985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-03fa1db1-258c-41fc-aebb-97bab4a9cdc2 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'services' on Instance uuid 1025ec9b-6b5d-445a-8c05-ae537d3273cc {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:51:15.612109 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-03fa1db1-258c-41fc-aebb-97bab4a9cdc2 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 2037 microversion: 2.25 time: 0.259879 Aug 03 01:51:15.613452 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 486/1030] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:15 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 2037 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:15.620418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e8f6872f-783b-403a-9ebd-eb3f8aff60c9 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Calling method '.version_select at 0x7f5b133ad700>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:15.624929 n-d-826529-8 devstack@n-api.service[125942]: WARNING oslo_db.sqlalchemy.utils [None req-e8f6872f-783b-403a-9ebd-eb3f8aff60c9 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 03 01:51:15.630307 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e8f6872f-783b-403a-9ebd-eb3f8aff60c9 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.015687 Aug 03 01:51:15.631450 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 487/1031] 10.222.0.67 () {60 vars in 1177 bytes} [Wed Aug 3 01:51:15 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:15.643558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ac860edc-08f4-435d-8620-2b8ee4a8c11e tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826529-8", "block_migration": "auto"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:15.645944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ac860edc-08f4-435d-8620-2b8ee4a8c11e tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:15.657435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac860edc-08f4-435d-8620-2b8ee4a8c11e tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:15.658134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac860edc-08f4-435d-8620-2b8ee4a8c11e tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:15.659699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac860edc-08f4-435d-8620-2b8ee4a8c11e tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:15.660308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac860edc-08f4-435d-8620-2b8ee4a8c11e tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:15.666590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3db39ae-82f5-40e4-8e4c-9fe1feeb7f54 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Acquired lock "refresh_cache-b647860c-e2e2-4a77-bb70-d396616839cf" {{(pid=125941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 01:51:15.691598 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-ac860edc-08f4-435d-8620-2b8ee4a8c11e tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'flavor' on Instance uuid 1025ec9b-6b5d-445a-8c05-ae537d3273cc {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:51:15.710601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ac860edc-08f4-435d-8620-2b8ee4a8c11e tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Going to try to live migrate instance to n-h2-826529-8 {{(pid=125942) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 01:51:15.747357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:16.190670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG neutronclient.v2_0.client [None req-b3db39ae-82f5-40e4-8e4c-9fe1feeb7f54 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.1.236 (194e3a24-8b94-41d0-bd10-e6519d0b1d68) with port b440c03b-e6d3-40bf-97c1-ca18782b6c46 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b7ba8541-4926-46e2-babc-3b914e46eef0.", "detail": ""}} {{(pid=125941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:51:16.191291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3db39ae-82f5-40e4-8e4c-9fe1feeb7f54 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Releasing lock "refresh_cache-b647860c-e2e2-4a77-bb70-d396616839cf" {{(pid=125941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 01:51:16.191880 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-b3db39ae-82f5-40e4-8e4c-9fe1feeb7f54 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] HTTP exception thrown: Cannot associate floating IP 172.25.1.236 (194e3a24-8b94-41d0-bd10-e6519d0b1d68) with port b440c03b-e6d3-40bf-97c1-ca18782b6c46 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b7ba8541-4926-46e2-babc-3b914e46eef0. Aug 03 01:51:16.191880 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-8329c588-531b-4dc9-928f-095a354a7c81'] Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b3db39ae-82f5-40e4-8e4c-9fe1feeb7f54 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Request method failure captured: Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action HTTP/1.1 Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 46 Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dRz78VBKzllSUkqvBKhoknY1OgqA1DedTCWuujue2GuhXAACp2kfXi6q9FjqOO4rSXwDJnxfOrMkddNu1bvZGTUQiS4mIAmS0EpcasX8ADztS1Z8Ey8u-kDPG4inuRmPEhcBcUMMjcrfz11f4jzOeb3UoN6e48EqI3ShIZwdTBowbo Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 69aa4c52c59841f59db580a6dca4446b Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_69aa4c52c59841f59db580a6dca4446b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69aa4c52c59841f59db580a6dca4446b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/69aa4c52c59841f59db580a6dca4446b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69aa4c52c59841f59db580a6dca4446b"}]}] Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 69aa4c52c59841f59db580a6dca4446b Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4d688a22fbec41ba9067c6290d70d376 Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: {"addFloatingIp": {"address": "172.25.1.236"}} Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: exception: Cannot associate floating IP 172.25.1.236 (194e3a24-8b94-41d0-bd10-e6519d0b1d68) with port b440c03b-e6d3-40bf-97c1-ca18782b6c46 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b7ba8541-4926-46e2-babc-3b914e46eef0. Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-8329c588-531b-4dc9-928f-095a354a7c81'] Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'b647860c-e2e2-4a77-bb70-d396616839cf', 'body': {'addFloatingIp': {'address': '172.25.1.236'}}} Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:51:16.194692 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.1.236 (194e3a24-8b94-41d0-bd10-e6519d0b1d68) with port b440c03b-e6d3-40bf-97c1-ca18782b6c46 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b7ba8541-4926-46e2-babc-3b914e46eef0. Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8329c588-531b-4dc9-928f-095a354a7c81'] Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.1.236 (194e3a24-8b94-41d0-bd10-e6519d0b1d68) with port b440c03b-e6d3-40bf-97c1-ca18782b6c46 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b7ba8541-4926-46e2-babc-3b914e46eef0. Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8329c588-531b-4dc9-928f-095a354a7c81'] Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.1.236 (194e3a24-8b94-41d0-bd10-e6519d0b1d68) with port b440c03b-e6d3-40bf-97c1-ca18782b6c46 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b7ba8541-4926-46e2-babc-3b914e46eef0. Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8329c588-531b-4dc9-928f-095a354a7c81'] Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.1.236 (194e3a24-8b94-41d0-bd10-e6519d0b1d68) with port b440c03b-e6d3-40bf-97c1-ca18782b6c46 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b7ba8541-4926-46e2-babc-3b914e46eef0. Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8329c588-531b-4dc9-928f-095a354a7c81'] Aug 03 01:51:16.199306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:16.205547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b3db39ae-82f5-40e4-8e4c-9fe1feeb7f54 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Returning 400 to user: Cannot associate floating IP 172.25.1.236 (194e3a24-8b94-41d0-bd10-e6519d0b1d68) with port b440c03b-e6d3-40bf-97c1-ca18782b6c46 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b7ba8541-4926-46e2-babc-3b914e46eef0. Aug 03 01:51:16.205547 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-8329c588-531b-4dc9-928f-095a354a7c81'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:16.205547 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b3db39ae-82f5-40e4-8e4c-9fe1feeb7f54 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action" status: 400 len: 381 microversion: 2.1 time: 0.643858 Aug 03 01:51:16.205547 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 545/1032] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:51:15 2022] POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action => generated 381 bytes in 646 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:51:16.205547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5eadb00c-102b-4b58-a50f-a07dc1007a86 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Calling method '.version_select at 0x7f5b13c08700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:16.228355 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5eadb00c-102b-4b58-a50f-a07dc1007a86 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084025487" status: 204 len: 0 microversion: 2.2 time: 0.030204 Aug 03 01:51:16.229267 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 546/1033] 10.222.0.67 () {60 vars in 1261 bytes} [Wed Aug 3 01:51:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084025487 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:51:16.235213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8c14b67c-3764-4832-b364-651b72cfcfc1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:16.235836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8c14b67c-3764-4832-b364-651b72cfcfc1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:16.243517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c14b67c-3764-4832-b364-651b72cfcfc1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:16.244372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c14b67c-3764-4832-b364-651b72cfcfc1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:16.245338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c14b67c-3764-4832-b364-651b72cfcfc1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:16.246030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c14b67c-3764-4832-b364-651b72cfcfc1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:16.545516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8c14b67c-3764-4832-b364-651b72cfcfc1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:16.554444 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8c14b67c-3764-4832-b364-651b72cfcfc1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1542 microversion: 2.1 time: 0.323934 Aug 03 01:51:16.570480 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 547/1034] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:16 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1542 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:16.575586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31414cdd-fb35-42b1-90d8-272c38e4365f tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '.version_select at 0x7f5b132c2af0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:18.207259 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ac860edc-08f4-435d-8620-2b8ee4a8c11e tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc/action" status: 202 len: 0 microversion: 2.25 time: 2.569851 Aug 03 01:51:18.209861 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 488/1035] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 3 01:51:15 2022] POST /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc/action => generated 0 bytes in 2573 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 03 01:51:18.219688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-bb8c6176-be9e-4b61-8a95-67de9344fef1 req-ac1976ca-7a9d-4855-8a19-2bbf06916a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6c9f9b-e708-44b8-8c72-49704bda21aa", "name": "network-vif-unplugged", "status": "completed", "tag": "fed8a343-ec69-468a-9a29-db2e061934b3"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:18.254126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bb8c6176-be9e-4b61-8a95-67de9344fef1 req-ac1976ca-7a9d-4855-8a19-2bbf06916a67 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:18.256498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bb8c6176-be9e-4b61-8a95-67de9344fef1 req-ac1976ca-7a9d-4855-8a19-2bbf06916a67 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:18.288397 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-bb8c6176-be9e-4b61-8a95-67de9344fef1 req-ac1976ca-7a9d-4855-8a19-2bbf06916a67 service nova] Creating event network-vif-unplugged:fed8a343-ec69-468a-9a29-db2e061934b3 for instance ee6c9f9b-e708-44b8-8c72-49704bda21aa on n-h2-826529-8 Aug 03 01:51:18.300618 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-bb8c6176-be9e-4b61-8a95-67de9344fef1 req-ac1976ca-7a9d-4855-8a19-2bbf06916a67 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084997 Aug 03 01:51:18.303329 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 489/1036] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:18.325163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dff43e2f-51b8-478e-b5a3-b5b376b0988f tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Action: 'create', calling method: .version_select at 0x7f5b133fd790>, body: {"keypair": {"name": "tempest-keypair-36504240", "type": "x509"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:18.381832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-dff43e2f-51b8-478e-b5a3-b5b376b0988f tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:18.388459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-dff43e2f-51b8-478e-b5a3-b5b376b0988f tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for user 1d4a47687b894dfdb6f0cf7bc09d28c0 and project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:18.424821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.processutils [None req-dff43e2f-51b8-478e-b5a3-b5b376b0988f tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpy_f8b3mr/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpy_f8b3mr/temp.key -subj /CN=1d4a47687b894dfdb6f0cf7bc09d28c0 -extensions v3_req_client {{(pid=125942) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 03 01:51:18.545003 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-31414cdd-fb35-42b1-90d8-272c38e4365f tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/194e3a24-8b94-41d0-bd10-e6519d0b1d68" status: 202 len: 0 microversion: 2.1 time: 1.971341 Aug 03 01:51:18.545601 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 548/1037] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 01:51:16 2022] DELETE /compute/v2.1/os-floating-ips/194e3a24-8b94-41d0-bd10-e6519d0b1d68 => generated 0 bytes in 1974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:18.556370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4480e3e-8e73-43f0-9469-98fcdd673cf8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:18.557491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f4480e3e-8e73-43f0-9469-98fcdd673cf8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:18.579220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4480e3e-8e73-43f0-9469-98fcdd673cf8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:18.579856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4480e3e-8e73-43f0-9469-98fcdd673cf8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:18.581898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4480e3e-8e73-43f0-9469-98fcdd673cf8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:18.586079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4480e3e-8e73-43f0-9469-98fcdd673cf8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:18.854740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=20 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:18.857527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.processutils [None req-dff43e2f-51b8-478e-b5a3-b5b376b0988f tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpy_f8b3mr/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpy_f8b3mr/temp.key -subj /CN=1d4a47687b894dfdb6f0cf7bc09d28c0 -extensions v3_req_client" returned: 0 in 0.432s {{(pid=125942) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 03 01:51:18.859842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.processutils [None req-dff43e2f-51b8-478e-b5a3-b5b376b0988f tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpy_f8b3mr/temp.key -password pass: {{(pid=125942) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 03 01:51:18.872304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f4480e3e-8e73-43f0-9469-98fcdd673cf8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:18.880821 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f4480e3e-8e73-43f0-9469-98fcdd673cf8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1503 microversion: 2.1 time: 0.330033 Aug 03 01:51:18.882204 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 549/1038] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:18 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1503 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:18.889608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-08088a3c-4251-4843-89bf-c783b5509731 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:18.890462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-08088a3c-4251-4843-89bf-c783b5509731 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:18.896864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08088a3c-4251-4843-89bf-c783b5509731 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:18.897581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08088a3c-4251-4843-89bf-c783b5509731 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:18.898578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08088a3c-4251-4843-89bf-c783b5509731 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:18.899282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08088a3c-4251-4843-89bf-c783b5509731 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:18.925573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.processutils [None req-dff43e2f-51b8-478e-b5a3-b5b376b0988f tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpy_f8b3mr/temp.key -password pass:" returned: 0 in 0.065s {{(pid=125942) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 03 01:51:19.000008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-dff43e2f-51b8-478e-b5a3-b5b376b0988f tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:19.006012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-dff43e2f-51b8-478e-b5a3-b5b376b0988f tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Getting quotas for user 1d4a47687b894dfdb6f0cf7bc09d28c0 and project a398f712a44043759790e8179b452179. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:19.036651 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dff43e2f-51b8-478e-b5a3-b5b376b0988f tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 4691 microversion: 2.2 time: 0.730481 Aug 03 01:51:19.043083 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 490/1039] 10.222.0.67 () {62 vars in 1198 bytes} [Wed Aug 3 01:51:18 2022] POST /compute/v2.1/os-keypairs => generated 4691 bytes in 739 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:51:19.060989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-43ae4faf-67d2-4d5a-9543-871747e6f983 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:19.062485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-43ae4faf-67d2-4d5a-9543-871747e6f983 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:19.095037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43ae4faf-67d2-4d5a-9543-871747e6f983 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:19.096952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43ae4faf-67d2-4d5a-9543-871747e6f983 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:19.099098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43ae4faf-67d2-4d5a-9543-871747e6f983 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:19.099556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43ae4faf-67d2-4d5a-9543-871747e6f983 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:19.103494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-08088a3c-4251-4843-89bf-c783b5509731 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:19.120621 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-08088a3c-4251-4843-89bf-c783b5509731 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1542 microversion: 2.1 time: 0.236634 Aug 03 01:51:19.123512 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 550/1040] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:18 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1542 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:19.150415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e35a165e-06b2-43a0-9371-9e3d1a6644bd tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Action: 'action', calling method: .version_select at 0x7f5b21f08b80>, body: {"removeFloatingIp": {"address": "172.25.1.95"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:19.465876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e35a165e-06b2-43a0-9371-9e3d1a6644bd tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:19.474025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e35a165e-06b2-43a0-9371-9e3d1a6644bd tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:19.474501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e35a165e-06b2-43a0-9371-9e3d1a6644bd tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:19.476006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e35a165e-06b2-43a0-9371-9e3d1a6644bd tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:19.476698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e35a165e-06b2-43a0-9371-9e3d1a6644bd tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:19.652016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-43ae4faf-67d2-4d5a-9543-871747e6f983 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:19.664689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-43ae4faf-67d2-4d5a-9543-871747e6f983 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:19.669658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-43ae4faf-67d2-4d5a-9543-871747e6f983 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:19.674248 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-43ae4faf-67d2-4d5a-9543-871747e6f983 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1569 microversion: 2.25 time: 0.628057 Aug 03 01:51:19.689134 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 491/1041] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:19 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1569 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:19.702268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-147b8d72-05e2-4aec-ad11-60be44ae5ce7 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Calling method '.version_select at 0x7f5b13389160>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:19.714929 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-147b8d72-05e2-4aec-ad11-60be44ae5ce7 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs/tempest-keypair-36504240" status: 200 len: 1532 microversion: 2.2 time: 0.024195 Aug 03 01:51:19.717849 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 492/1042] 10.222.0.67 () {60 vars in 1252 bytes} [Wed Aug 3 01:51:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-36504240 => generated 1532 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:19.736980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2383a706-0790-44ae-b6cf-920d604b6191 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Calling method '.version_select at 0x7f5b1343ef70>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:19.749539 n-d-826529-8 devstack@n-api.service[125942]: WARNING oslo_db.sqlalchemy.utils [None req-2383a706-0790-44ae-b6cf-920d604b6191 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 03 01:51:19.755856 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2383a706-0790-44ae-b6cf-920d604b6191 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs" status: 200 len: 1389 microversion: 2.2 time: 0.030808 Aug 03 01:51:19.757101 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 493/1043] 10.222.0.67 () {60 vars in 1177 bytes} [Wed Aug 3 01:51:19 2022] GET /compute/v2.1/os-keypairs => generated 1389 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:19.768860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-23225366-e4be-461c-b663-9f6b81638639 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] Calling method '.version_select at 0x7f5b13383940>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:19.826515 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-23225366-e4be-461c-b663-9f6b81638639 tempest-KeyPairsV22TestJSON-2080088342 tempest-KeyPairsV22TestJSON-2080088342-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-36504240" status: 204 len: 0 microversion: 2.2 time: 0.062364 Aug 03 01:51:19.833776 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 494/1044] 10.222.0.67 () {60 vars in 1255 bytes} [Wed Aug 3 01:51:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-36504240 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 01:51:19.906668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-401367a8-1526-40c2-87d7-daa4abcc6d16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:19.907319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-401367a8-1526-40c2-87d7-daa4abcc6d16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:19.916331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-401367a8-1526-40c2-87d7-daa4abcc6d16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:19.916776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-401367a8-1526-40c2-87d7-daa4abcc6d16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:19.922052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-401367a8-1526-40c2-87d7-daa4abcc6d16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:19.922817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-401367a8-1526-40c2-87d7-daa4abcc6d16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:19.992193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e35a165e-06b2-43a0-9371-9e3d1a6644bd tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Acquired lock "refresh_cache-b647860c-e2e2-4a77-bb70-d396616839cf" {{(pid=125941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 01:51:20.367256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-401367a8-1526-40c2-87d7-daa4abcc6d16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:20.380412 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-401367a8-1526-40c2-87d7-daa4abcc6d16 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1503 microversion: 2.1 time: 0.476880 Aug 03 01:51:20.382984 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 495/1045] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:19 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1503 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:51:20.390342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1c4a64c7-80d6-4b0e-b695-fa4785ca1424 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:20.391242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1c4a64c7-80d6-4b0e-b695-fa4785ca1424 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:20.412458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c4a64c7-80d6-4b0e-b695-fa4785ca1424 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:20.412733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c4a64c7-80d6-4b0e-b695-fa4785ca1424 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:20.413601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c4a64c7-80d6-4b0e-b695-fa4785ca1424 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:20.416065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c4a64c7-80d6-4b0e-b695-fa4785ca1424 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:21.488492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1c4a64c7-80d6-4b0e-b695-fa4785ca1424 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:21.499039 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1c4a64c7-80d6-4b0e-b695-fa4785ca1424 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1542 microversion: 2.1 time: 1.114172 Aug 03 01:51:21.514951 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 496/1046] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:20 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1542 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:21.514951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3de67d17-20c0-4b06-bd65-51eb59706a3b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:21.514951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3de67d17-20c0-4b06-bd65-51eb59706a3b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:21.529400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3de67d17-20c0-4b06-bd65-51eb59706a3b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:21.531102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3de67d17-20c0-4b06-bd65-51eb59706a3b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:21.536363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3de67d17-20c0-4b06-bd65-51eb59706a3b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:21.536942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3de67d17-20c0-4b06-bd65-51eb59706a3b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:22.046823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3de67d17-20c0-4b06-bd65-51eb59706a3b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:22.061587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3de67d17-20c0-4b06-bd65-51eb59706a3b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:22.063808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3de67d17-20c0-4b06-bd65-51eb59706a3b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:22.065729 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3de67d17-20c0-4b06-bd65-51eb59706a3b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1569 microversion: 2.25 time: 0.561099 Aug 03 01:51:22.066605 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 497/1047] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:21 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1569 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:22.075581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d061748a-a7c4-4f32-b8b5-7fde47a93dc7 req-4c48ff2c-a369-480d-884c-6a5d3e4a135c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6c9f9b-e708-44b8-8c72-49704bda21aa", "tag": "fed8a343-ec69-468a-9a29-db2e061934b3"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:22.088718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d061748a-a7c4-4f32-b8b5-7fde47a93dc7 req-4c48ff2c-a369-480d-884c-6a5d3e4a135c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:22.089388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d061748a-a7c4-4f32-b8b5-7fde47a93dc7 req-4c48ff2c-a369-480d-884c-6a5d3e4a135c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:22.110610 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d061748a-a7c4-4f32-b8b5-7fde47a93dc7 req-4c48ff2c-a369-480d-884c-6a5d3e4a135c service nova] Creating event network-changed:fed8a343-ec69-468a-9a29-db2e061934b3 for instance ee6c9f9b-e708-44b8-8c72-49704bda21aa on n-h2-826529-8 Aug 03 01:51:22.134641 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d061748a-a7c4-4f32-b8b5-7fde47a93dc7 req-4c48ff2c-a369-480d-884c-6a5d3e4a135c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065711 Aug 03 01:51:22.138017 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 498/1048] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:22.160867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0dd51b6-44c0-4bae-89e8-3f4f13a0e1b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:22.164710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0dd51b6-44c0-4bae-89e8-3f4f13a0e1b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:22.184354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0dd51b6-44c0-4bae-89e8-3f4f13a0e1b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:22.184999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0dd51b6-44c0-4bae-89e8-3f4f13a0e1b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:22.185821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0dd51b6-44c0-4bae-89e8-3f4f13a0e1b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:22.186264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0dd51b6-44c0-4bae-89e8-3f4f13a0e1b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:22.492373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:22.945521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0dd51b6-44c0-4bae-89e8-3f4f13a0e1b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:22.962776 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0dd51b6-44c0-4bae-89e8-3f4f13a0e1b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1503 microversion: 2.1 time: 0.820159 Aug 03 01:51:22.964189 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 499/1049] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:22 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1503 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:22.997655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a63c866f-000e-453e-8db3-f5b32b8f4376 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:23.003935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a63c866f-000e-453e-8db3-f5b32b8f4376 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:23.029152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a63c866f-000e-453e-8db3-f5b32b8f4376 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:23.029893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a63c866f-000e-453e-8db3-f5b32b8f4376 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:23.031347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a63c866f-000e-453e-8db3-f5b32b8f4376 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:23.040187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a63c866f-000e-453e-8db3-f5b32b8f4376 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:23.680311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-e35a165e-06b2-43a0-9371-9e3d1a6644bd tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Building network info cache for instance {{(pid=125941) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 01:51:23.688637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:23.838599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a63c866f-000e-453e-8db3-f5b32b8f4376 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:23.853645 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a63c866f-000e-453e-8db3-f5b32b8f4376 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1542 microversion: 2.1 time: 0.887598 Aug 03 01:51:23.854594 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 500/1050] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:22 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1542 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:23.866018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4c3b0690-91bc-434c-974d-937d83ccad51 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:23.880907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4c3b0690-91bc-434c-974d-937d83ccad51 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:23.897133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c3b0690-91bc-434c-974d-937d83ccad51 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:23.898474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c3b0690-91bc-434c-974d-937d83ccad51 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:23.899789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c3b0690-91bc-434c-974d-937d83ccad51 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:23.900463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c3b0690-91bc-434c-974d-937d83ccad51 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:24.270083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4c3b0690-91bc-434c-974d-937d83ccad51 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:24.303523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4c3b0690-91bc-434c-974d-937d83ccad51 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:24.310091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4c3b0690-91bc-434c-974d-937d83ccad51 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:24.313609 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4c3b0690-91bc-434c-974d-937d83ccad51 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1569 microversion: 2.25 time: 0.456390 Aug 03 01:51:24.313922 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 501/1051] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:23 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1569 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:24.327536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ab9884b9-0418-43f3-a245-bcef8b3cc29b req-916e059f-f590-4677-ace4-b4eccf450eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b647860c-e2e2-4a77-bb70-d396616839cf", "tag": "b440c03b-e6d3-40bf-97c1-ca18782b6c46"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:24.359957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ab9884b9-0418-43f3-a245-bcef8b3cc29b req-916e059f-f590-4677-ace4-b4eccf450eee service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:24.368673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ab9884b9-0418-43f3-a245-bcef8b3cc29b req-916e059f-f590-4677-ace4-b4eccf450eee service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:24.417337 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ab9884b9-0418-43f3-a245-bcef8b3cc29b req-916e059f-f590-4677-ace4-b4eccf450eee service nova] Creating event network-changed:b440c03b-e6d3-40bf-97c1-ca18782b6c46 for instance b647860c-e2e2-4a77-bb70-d396616839cf on n-h2-826529-8 Aug 03 01:51:24.430232 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ab9884b9-0418-43f3-a245-bcef8b3cc29b req-916e059f-f590-4677-ace4-b4eccf450eee service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114183 Aug 03 01:51:24.434076 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 502/1052] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:24.458089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d6bc2061-4ae0-4138-a931-cf0aa2fa2b22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:24.464737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d6bc2061-4ae0-4138-a931-cf0aa2fa2b22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:24.474870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6bc2061-4ae0-4138-a931-cf0aa2fa2b22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:24.475481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6bc2061-4ae0-4138-a931-cf0aa2fa2b22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:24.476448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6bc2061-4ae0-4138-a931-cf0aa2fa2b22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:24.477018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6bc2061-4ae0-4138-a931-cf0aa2fa2b22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:25.160792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d6bc2061-4ae0-4138-a931-cf0aa2fa2b22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:25.170805 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d6bc2061-4ae0-4138-a931-cf0aa2fa2b22 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1503 microversion: 2.1 time: 0.735178 Aug 03 01:51:25.192282 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 503/1053] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:24 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1503 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:25.198829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-c5342d10-644a-4dc2-b473-182d6c76899a req-81dcc153-6fb2-4044-b305-ec11b6b04541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1025ec9b-6b5d-445a-8c05-ae537d3273cc", "name": "network-vif-unplugged", "status": "completed", "tag": "db8c88b5-548a-478f-bd6f-7ccdcd714cf9"}, {"name": "network-changed", "server_uuid": "1025ec9b-6b5d-445a-8c05-ae537d3273cc", "tag": "db8c88b5-548a-478f-bd6f-7ccdcd714cf9"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:25.210409 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c5342d10-644a-4dc2-b473-182d6c76899a req-81dcc153-6fb2-4044-b305-ec11b6b04541 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:25.211116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c5342d10-644a-4dc2-b473-182d6c76899a req-81dcc153-6fb2-4044-b305-ec11b6b04541 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:25.223903 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c5342d10-644a-4dc2-b473-182d6c76899a req-81dcc153-6fb2-4044-b305-ec11b6b04541 service nova] Creating event network-vif-unplugged:db8c88b5-548a-478f-bd6f-7ccdcd714cf9 for instance 1025ec9b-6b5d-445a-8c05-ae537d3273cc on n-h1-826529-8 Aug 03 01:51:25.224708 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c5342d10-644a-4dc2-b473-182d6c76899a req-81dcc153-6fb2-4044-b305-ec11b6b04541 service nova] Creating event network-changed:db8c88b5-548a-478f-bd6f-7ccdcd714cf9 for instance 1025ec9b-6b5d-445a-8c05-ae537d3273cc on n-h1-826529-8 Aug 03 01:51:25.231138 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-c5342d10-644a-4dc2-b473-182d6c76899a req-81dcc153-6fb2-4044-b305-ec11b6b04541 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.036772 Aug 03 01:51:25.232385 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 504/1054] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:25.237947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a2da3cc9-d849-401f-80df-9241d891462d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:25.239430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a2da3cc9-d849-401f-80df-9241d891462d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:25.248844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2da3cc9-d849-401f-80df-9241d891462d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:25.249554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2da3cc9-d849-401f-80df-9241d891462d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:25.250546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2da3cc9-d849-401f-80df-9241d891462d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:25.251250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2da3cc9-d849-401f-80df-9241d891462d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:25.917806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a2da3cc9-d849-401f-80df-9241d891462d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:25.932722 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a2da3cc9-d849-401f-80df-9241d891462d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1542 microversion: 2.1 time: 0.698743 Aug 03 01:51:25.934290 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 505/1055] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:25 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1542 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:25.954135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-e35a165e-06b2-43a0-9371-9e3d1a6644bd tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Updating instance_info_cache with network_info: [{"id": "b440c03b-e6d3-40bf-97c1-ca18782b6c46", "address": "fa:16:3e:01:53:29", "network": {"id": "297ffbc2-8a68-402c-98a8-069cd6f5baf6", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-942505919-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "69aa4c52c59841f59db580a6dca4446b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb440c03b-e6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125941) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 01:51:25.985434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e35a165e-06b2-43a0-9371-9e3d1a6644bd tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Releasing lock "refresh_cache-b647860c-e2e2-4a77-bb70-d396616839cf" {{(pid=125941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 01:51:25.987339 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e35a165e-06b2-43a0-9371-9e3d1a6644bd tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action" status: 202 len: 0 microversion: 2.1 time: 6.862087 Aug 03 01:51:25.992614 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 551/1056] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:51:19 2022] POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action => generated 0 bytes in 6868 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 01:51:25.999828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ca3e0c97-b291-49ab-9d31-6bb93f16feed tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:26.000892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ca3e0c97-b291-49ab-9d31-6bb93f16feed tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:26.028538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca3e0c97-b291-49ab-9d31-6bb93f16feed tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:26.030091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca3e0c97-b291-49ab-9d31-6bb93f16feed tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:26.031289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca3e0c97-b291-49ab-9d31-6bb93f16feed tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:26.032063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca3e0c97-b291-49ab-9d31-6bb93f16feed tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:26.224806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-471002bf-2d59-46e3-be56-ff041c01da8c tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'create', calling method: .version_select at 0x7f5b1352ad30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1214760722", "description": "tempest-description-894825002"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:26.858812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ca3e0c97-b291-49ab-9d31-6bb93f16feed tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:26.882330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ca3e0c97-b291-49ab-9d31-6bb93f16feed tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:26.885255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ca3e0c97-b291-49ab-9d31-6bb93f16feed tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:26.897246 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ca3e0c97-b291-49ab-9d31-6bb93f16feed tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1569 microversion: 2.25 time: 0.902256 Aug 03 01:51:26.907351 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 552/1057] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:25 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1569 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:26.926224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e5a6cd27-84c9-4c39-a09d-0bb4ed9bd6e6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '.version_select at 0x7f5b1336d430>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:27.393324 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-471002bf-2d59-46e3-be56-ff041c01da8c tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.450811 Aug 03 01:51:27.394015 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 506/1058] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:51:25 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:27.422467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-29e12818-a18d-4a47-b39d-753c6c1cf1b5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:27.423129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-29e12818-a18d-4a47-b39d-753c6c1cf1b5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:27.470730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29e12818-a18d-4a47-b39d-753c6c1cf1b5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:27.477494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29e12818-a18d-4a47-b39d-753c6c1cf1b5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:27.479050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29e12818-a18d-4a47-b39d-753c6c1cf1b5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:27.479659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29e12818-a18d-4a47-b39d-753c6c1cf1b5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:28.121100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-29e12818-a18d-4a47-b39d-753c6c1cf1b5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:28.148146 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-29e12818-a18d-4a47-b39d-753c6c1cf1b5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1478 microversion: 2.1 time: 0.751081 Aug 03 01:51:28.152028 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 507/1059] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:27 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1478 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:28.165970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c32ce9fe-c215-4d9c-9b46-398bab2ac691 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:28.173031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c32ce9fe-c215-4d9c-9b46-398bab2ac691 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:28.200050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c32ce9fe-c215-4d9c-9b46-398bab2ac691 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:28.201733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c32ce9fe-c215-4d9c-9b46-398bab2ac691 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:28.203952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c32ce9fe-c215-4d9c-9b46-398bab2ac691 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:28.205139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c32ce9fe-c215-4d9c-9b46-398bab2ac691 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:29.015087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c32ce9fe-c215-4d9c-9b46-398bab2ac691 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:29.018721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=16 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:29.025822 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c32ce9fe-c215-4d9c-9b46-398bab2ac691 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1542 microversion: 2.1 time: 0.869858 Aug 03 01:51:29.049847 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 508/1060] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:28 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1542 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:29.054974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bc0ae01f-aa2e-483d-8767-6ce72e0db90f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'create', calling method: .version_select at 0x7f5b1355eaf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1688441035", "description": "tempest-description-133857739"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:29.212044 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e5a6cd27-84c9-4c39-a09d-0bb4ed9bd6e6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/5d4e25b9-bb5c-4a49-97fe-7b3d824305cf" status: 202 len: 0 microversion: 2.1 time: 2.302047 Aug 03 01:51:29.213114 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 553/1061] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 01:51:26 2022] DELETE /compute/v2.1/os-floating-ips/5d4e25b9-bb5c-4a49-97fe-7b3d824305cf => generated 0 bytes in 2304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:29.221175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc2f744e-5612-4a12-bb2f-2b34c7f64735 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:29.222002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fc2f744e-5612-4a12-bb2f-2b34c7f64735 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:29.239285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2f744e-5612-4a12-bb2f-2b34c7f64735 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:29.239757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2f744e-5612-4a12-bb2f-2b34c7f64735 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:29.240559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2f744e-5612-4a12-bb2f-2b34c7f64735 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:29.241004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2f744e-5612-4a12-bb2f-2b34c7f64735 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:29.678665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fc2f744e-5612-4a12-bb2f-2b34c7f64735 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:29.714233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fc2f744e-5612-4a12-bb2f-2b34c7f64735 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:29.719248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fc2f744e-5612-4a12-bb2f-2b34c7f64735 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:29.720849 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fc2f744e-5612-4a12-bb2f-2b34c7f64735 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1569 microversion: 2.25 time: 0.506714 Aug 03 01:51:29.722305 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 554/1062] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:29 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1569 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:29.728492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9c0d5539-2cd9-4c28-8523-dd89d3a88a7c tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '.version_select at 0x7f5b132be9d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:29.739302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c0d5539-2cd9-4c28-8523-dd89d3a88a7c tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:29.740483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c0d5539-2cd9-4c28-8523-dd89d3a88a7c tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:29.759462 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bc0ae01f-aa2e-483d-8767-6ce72e0db90f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.708346 Aug 03 01:51:29.760183 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 509/1063] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:51:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:29.766203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b56c5f07-3712-46c0-a89d-2edab60a5bc7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b56c5f07-3712-46c0-a89d-2edab60a5bc7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Request method failure captured: Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action HTTP/1.1 Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 34 Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dRz78VBKzllSUkqvBKhoknY1OgqA1DedTCWuujue2GuhXAACp2kfXi6q9FjqOO4rSXwDJnxfOrMkddNu1bvZGTUQiS4mIAmS0EpcasX8ADztS1Z8Ey8u-kDPG4inuRmPEhcBcUMMjcrfz11f4jzOeb3UoN6e48EqI3ShIZwdTBowbo Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 69aa4c52c59841f59db580a6dca4446b Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_69aa4c52c59841f59db580a6dca4446b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69aa4c52c59841f59db580a6dca4446b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/69aa4c52c59841f59db580a6dca4446b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69aa4c52c59841f59db580a6dca4446b"}]}] Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 69aa4c52c59841f59db580a6dca4446b Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4d688a22fbec41ba9067c6290d70d376 Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: {"addFloatingIp": {"address": ""}} Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'b647860c-e2e2-4a77-bb70-d396616839cf', 'body': {'addFloatingIp': {'address': ''}}} Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi '' Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 01:51:29.771569 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 01:51:29.776086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 01:51:29.776086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 03 01:51:29.776086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:29.776086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:29.776086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:29.776086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:29.776086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:29.776086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:29.776086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 01:51:29.776086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 01:51:29.776086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 03 01:51:29.776086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:29.776086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b56c5f07-3712-46c0-a89d-2edab60a5bc7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:29.793624 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b56c5f07-3712-46c0-a89d-2edab60a5bc7 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action" status: 400 len: 142 microversion: 2.1 time: 0.028119 Aug 03 01:51:29.794693 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 510/1064] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:51:29 2022] POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action => generated 142 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:51:29.797292 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9c0d5539-2cd9-4c28-8523-dd89d3a88a7c tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 2729 microversion: 2.1 time: 0.072584 Aug 03 01:51:29.798997 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 555/1065] 10.222.0.67 () {58 vars in 1143 bytes} [Wed Aug 3 01:51:29 2022] GET /compute/v2.1/os-migrations => generated 2729 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:29.847678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b6046d54-cf74-4f1d-94cb-5d01e13b3dd6 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:29.849530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-637e44e4-615f-4362-a526-65a23430f3e9 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:29.854267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-637e44e4-615f-4362-a526-65a23430f3e9 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:29.855582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b6046d54-cf74-4f1d-94cb-5d01e13b3dd6 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:29.869339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-637e44e4-615f-4362-a526-65a23430f3e9 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:29.869801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-637e44e4-615f-4362-a526-65a23430f3e9 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:29.880474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6046d54-cf74-4f1d-94cb-5d01e13b3dd6 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:29.881503 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6046d54-cf74-4f1d-94cb-5d01e13b3dd6 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:29.884589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-637e44e4-615f-4362-a526-65a23430f3e9 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:29.886032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-637e44e4-615f-4362-a526-65a23430f3e9 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:29.887128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6046d54-cf74-4f1d-94cb-5d01e13b3dd6 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:29.887892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6046d54-cf74-4f1d-94cb-5d01e13b3dd6 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:30.021315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-637e44e4-615f-4362-a526-65a23430f3e9 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Acquired lock "refresh_cache-b647860c-e2e2-4a77-bb70-d396616839cf" {{(pid=125942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 01:51:30.267426 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b6046d54-cf74-4f1d-94cb-5d01e13b3dd6 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1629 microversion: 2.1 time: 0.425543 Aug 03 01:51:30.274241 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 556/1066] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:29 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1629 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:30.290719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-431242657", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "84fd0ebd-8e9e-4c11-8d48-582bb1762e87"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:30.346975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-637e44e4-615f-4362-a526-65a23430f3e9 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Releasing lock "refresh_cache-b647860c-e2e2-4a77-bb70-d396616839cf" {{(pid=125942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 01:51:30.347577 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-637e44e4-615f-4362-a526-65a23430f3e9 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] HTTP exception thrown: floating IP not found Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-637e44e4-615f-4362-a526-65a23430f3e9 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Request method failure captured: Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action HTTP/1.1 Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 41 Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dRz78VBKzllSUkqvBKhoknY1OgqA1DedTCWuujue2GuhXAACp2kfXi6q9FjqOO4rSXwDJnxfOrMkddNu1bvZGTUQiS4mIAmS0EpcasX8ADztS1Z8Ey8u-kDPG4inuRmPEhcBcUMMjcrfz11f4jzOeb3UoN6e48EqI3ShIZwdTBowbo Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 69aa4c52c59841f59db580a6dca4446b Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_69aa4c52c59841f59db580a6dca4446b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69aa4c52c59841f59db580a6dca4446b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/69aa4c52c59841f59db580a6dca4446b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69aa4c52c59841f59db580a6dca4446b"}]}] Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 69aa4c52c59841f59db580a6dca4446b Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4d688a22fbec41ba9067c6290d70d376 Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: exception: floating IP not found Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'b647860c-e2e2-4a77-bb70-d396616839cf', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 03 01:51:30.349193 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:30.353415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:30.353415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:30.353415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:30.353415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:30.353415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:30.353415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:30.353415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:30.353415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 03 01:51:30.353415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:30.353415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-637e44e4-615f-4362-a526-65a23430f3e9 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Returning 404 to user: floating IP not found {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:30.353415 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-637e44e4-615f-4362-a526-65a23430f3e9 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action" status: 404 len: 67 microversion: 2.1 time: 0.526686 Aug 03 01:51:30.358244 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 511/1067] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:51:29 2022] POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action => generated 67 bytes in 536 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:51:30.364372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-daad72cf-0d66-43f5-aa7a-8c6831e810c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:30.365010 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-daad72cf-0d66-43f5-aa7a-8c6831e810c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:30.383064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-daad72cf-0d66-43f5-aa7a-8c6831e810c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:30.383994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-daad72cf-0d66-43f5-aa7a-8c6831e810c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:30.384846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-daad72cf-0d66-43f5-aa7a-8c6831e810c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:30.385242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-daad72cf-0d66-43f5-aa7a-8c6831e810c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:30.397475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] validate_networks() for [('84fd0ebd-8e9e-4c11-8d48-582bb1762e87', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:51:30.861452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-daad72cf-0d66-43f5-aa7a-8c6831e810c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:30.869261 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-daad72cf-0d66-43f5-aa7a-8c6831e810c2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1542 microversion: 2.1 time: 0.509870 Aug 03 01:51:30.870028 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 512/1068] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:30 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1542 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:30.877257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4eaea951-f8e8-4a75-a4df-1b3f9191669f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Action: 'create', calling method: .version_select at 0x7f5b13389ca0>, body: {"keypair": {"name": "tempest-keypair-122785629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQl/ZmTfp5VIKcDO0QRz/z7+HJXLz6M6cNsTT0pSqNM+dQqskXjh38RnXdEK1C0/W/TLJ775YwTZ0vUjCzFwCpm1Nj+K7wonZ7Rl+skKuTX7J9AN08MIIqTz7Ln0vTIjQ=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:30.893527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-4eaea951-f8e8-4a75-a4df-1b3f9191669f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Getting quotas for project 5f232cf4e61b4213b592b2a020961630. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:30.897797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-4eaea951-f8e8-4a75-a4df-1b3f9191669f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Getting quotas for user dd2c77c8ab314584939f1f580d5a6d14 and project 5f232cf4e61b4213b592b2a020961630. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:30.922842 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4eaea951-f8e8-4a75-a4df-1b3f9191669f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050502 Aug 03 01:51:30.923805 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 513/1069] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 01:51:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:30.929029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fbf19d30-0917-4a18-8ee9-4b896a21081d tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Action: 'action', calling method: .version_select at 0x7f5b22191f70>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:31.022986 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-fbf19d30-0917-4a18-8ee9-4b896a21081d tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fbf19d30-0917-4a18-8ee9-4b896a21081d tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Request method failure captured: Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action HTTP/1.1 Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 44 Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dRz78VBKzllSUkqvBKhoknY1OgqA1DedTCWuujue2GuhXAACp2kfXi6q9FjqOO4rSXwDJnxfOrMkddNu1bvZGTUQiS4mIAmS0EpcasX8ADztS1Z8Ey8u-kDPG4inuRmPEhcBcUMMjcrfz11f4jzOeb3UoN6e48EqI3ShIZwdTBowbo Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 69aa4c52c59841f59db580a6dca4446b Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_69aa4c52c59841f59db580a6dca4446b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69aa4c52c59841f59db580a6dca4446b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/69aa4c52c59841f59db580a6dca4446b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69aa4c52c59841f59db580a6dca4446b"}]}] Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 69aa4c52c59841f59db580a6dca4446b Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4d688a22fbec41ba9067c6290d70d376 Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: exception: Floating IP not found for address 0.0.0.0. Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'b647860c-e2e2-4a77-bb70-d396616839cf', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 03 01:51:31.025489 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 03 01:51:31.030498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 03 01:51:31.030498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:31.030498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:31.030498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:31.030498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:31.030498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:31.030498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:31.030498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:31.030498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:31.030498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 03 01:51:31.030498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:31.030498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fbf19d30-0917-4a18-8ee9-4b896a21081d tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:31.030498 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fbf19d30-0917-4a18-8ee9-4b896a21081d tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action" status: 404 len: 88 microversion: 2.1 time: 0.102053 Aug 03 01:51:31.033928 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 514/1070] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:51:30 2022] POST /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf/action => generated 88 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:51:31.040007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-27c50566-ec49-4942-b4d0-8d138628e40e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:31.040624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-27c50566-ec49-4942-b4d0-8d138628e40e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:31.048608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27c50566-ec49-4942-b4d0-8d138628e40e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:31.049207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27c50566-ec49-4942-b4d0-8d138628e40e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:31.051439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27c50566-ec49-4942-b4d0-8d138628e40e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:31.051893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27c50566-ec49-4942-b4d0-8d138628e40e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:31.298875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:51:31.299410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:51:31.299822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:51:31.300225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:51:31.300651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:51:31.317715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:31.318167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:31.319017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:31.319460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:31.361656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Getting quotas for project e4c5a2a2419749f393d08ce2e3dd3f8a. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:31.369244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Getting quotas for user 20aac1f6cabe41e28254f4ebe0c96218 and project e4c5a2a2419749f393d08ce2e3dd3f8a. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:31.400156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:51:31.403929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:51:31.408680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-27c50566-ec49-4942-b4d0-8d138628e40e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:31.423304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-27c50566-ec49-4942-b4d0-8d138628e40e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:31.431596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-27c50566-ec49-4942-b4d0-8d138628e40e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:31.437164 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-27c50566-ec49-4942-b4d0-8d138628e40e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1569 microversion: 2.25 time: 0.401247 Aug 03 01:51:31.437766 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 515/1071] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:31 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1569 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:31.453274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-66551c6e-5613-46b9-96d7-fb91a69052e6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:31.453887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-66551c6e-5613-46b9-96d7-fb91a69052e6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:31.468727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66551c6e-5613-46b9-96d7-fb91a69052e6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:31.469503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66551c6e-5613-46b9-96d7-fb91a69052e6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:31.470518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66551c6e-5613-46b9-96d7-fb91a69052e6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:31.471629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66551c6e-5613-46b9-96d7-fb91a69052e6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:31.515120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:31.519871 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-31ef7df7-0b0e-4805-a0b2-b888d463f361 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.238045 Aug 03 01:51:31.525378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-66551c6e-5613-46b9-96d7-fb91a69052e6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:51:31.550671 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 557/1072] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:51:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:51:31.562012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8de91897-0385-41f0-ae34-fae3a99d1ed8 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:31.563132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8de91897-0385-41f0-ae34-fae3a99d1ed8 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:31.664943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8de91897-0385-41f0-ae34-fae3a99d1ed8 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:31.675798 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8de91897-0385-41f0-ae34-fae3a99d1ed8 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 200 len: 1215 microversion: 2.1 time: 0.117834 Aug 03 01:51:31.678762 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 558/1073] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:31 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:51:31.702563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:31.746809 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-66551c6e-5613-46b9-96d7-fb91a69052e6 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 204 len: 0 microversion: 2.1 time: 0.305302 Aug 03 01:51:31.750735 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 516/1074] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:51:31 2022] DELETE /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:51:31.756442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5943b7db-a775-4ebb-a2d8-09daff84db4b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:31.757315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5943b7db-a775-4ebb-a2d8-09daff84db4b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:31.764909 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5943b7db-a775-4ebb-a2d8-09daff84db4b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:31.765865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5943b7db-a775-4ebb-a2d8-09daff84db4b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:31.767219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5943b7db-a775-4ebb-a2d8-09daff84db4b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:31.767819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5943b7db-a775-4ebb-a2d8-09daff84db4b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:31.897357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f6d23e82-ef50-4b51-a50f-68639eeabc79 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:31.898331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f6d23e82-ef50-4b51-a50f-68639eeabc79 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:31.929249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6d23e82-ef50-4b51-a50f-68639eeabc79 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:31.930591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6d23e82-ef50-4b51-a50f-68639eeabc79 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:31.935760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6d23e82-ef50-4b51-a50f-68639eeabc79 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:31.936869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6d23e82-ef50-4b51-a50f-68639eeabc79 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:32.009508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5943b7db-a775-4ebb-a2d8-09daff84db4b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:32.019548 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5943b7db-a775-4ebb-a2d8-09daff84db4b tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1540 microversion: 2.1 time: 0.267684 Aug 03 01:51:32.020612 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 559/1075] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:31 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1540 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:51:32.273172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f6d23e82-ef50-4b51-a50f-68639eeabc79 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:32.285538 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f6d23e82-ef50-4b51-a50f-68639eeabc79 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1542 microversion: 2.1 time: 0.395900 Aug 03 01:51:32.286114 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 517/1076] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:31 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1542 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:32.462685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7221db7c-7a07-47ff-b179-d986ccdf22cd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:32.463329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7221db7c-7a07-47ff-b179-d986ccdf22cd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:32.471637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7221db7c-7a07-47ff-b179-d986ccdf22cd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:32.472084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7221db7c-7a07-47ff-b179-d986ccdf22cd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:32.472923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7221db7c-7a07-47ff-b179-d986ccdf22cd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:32.474131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7221db7c-7a07-47ff-b179-d986ccdf22cd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:32.639166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bbffb1d8-fec3-43ab-a0c4-cc460cb23595 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Action: 'create', calling method: .version_select at 0x7f5b13389160>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1935686852", "policies": ["affinity"]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:32.664889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-bbffb1d8-fec3-43ab-a0c4-cc460cb23595 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:32.671518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-bbffb1d8-fec3-43ab-a0c4-cc460cb23595 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for user 7bee3c23fe964688bdb2ee2280ad0a58 and project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:32.766597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-bbffb1d8-fec3-43ab-a0c4-cc460cb23595 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:32.772901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-bbffb1d8-fec3-43ab-a0c4-cc460cb23595 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for user 7bee3c23fe964688bdb2ee2280ad0a58 and project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:32.788255 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bbffb1d8-fec3-43ab-a0c4-cc460cb23595 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.214794 Aug 03 01:51:32.795695 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 518/1077] 10.222.0.67 () {60 vars in 1174 bytes} [Wed Aug 3 01:51:32 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:51:32.801446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-555fd916-0416-4111-bf49-23a5aedc079a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:32.802432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-555fd916-0416-4111-bf49-23a5aedc079a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:32.810429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-555fd916-0416-4111-bf49-23a5aedc079a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:32.811313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-555fd916-0416-4111-bf49-23a5aedc079a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:32.812522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-555fd916-0416-4111-bf49-23a5aedc079a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:32.813260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-555fd916-0416-4111-bf49-23a5aedc079a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:33.049142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-555fd916-0416-4111-bf49-23a5aedc079a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:33.063821 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-555fd916-0416-4111-bf49-23a5aedc079a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 200 len: 1219 microversion: 2.1 time: 0.266531 Aug 03 01:51:33.064418 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 519/1078] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:32 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 1219 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:33.081845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c106f800-56a7-48ca-aeb4-846a7cee0de3 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:33.082550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c106f800-56a7-48ca-aeb4-846a7cee0de3 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:33.098847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c106f800-56a7-48ca-aeb4-846a7cee0de3 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:33.099985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c106f800-56a7-48ca-aeb4-846a7cee0de3 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:33.102458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c106f800-56a7-48ca-aeb4-846a7cee0de3 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:33.103648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c106f800-56a7-48ca-aeb4-846a7cee0de3 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:33.144176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c106f800-56a7-48ca-aeb4-846a7cee0de3 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:51:33.194842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7221db7c-7a07-47ff-b179-d986ccdf22cd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:33.205486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7221db7c-7a07-47ff-b179-d986ccdf22cd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:33.214173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7221db7c-7a07-47ff-b179-d986ccdf22cd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:33.215755 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7221db7c-7a07-47ff-b179-d986ccdf22cd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1569 microversion: 2.25 time: 0.757674 Aug 03 01:51:33.217032 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 560/1079] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:32 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1569 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:33.221768 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-98f3ec4d-2163-475c-9d01-498eaa1ed89a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Action: 'create', calling method: .version_select at 0x7f5b132739d0>, body: {"server_group": {"name": "tempest-server-group-2041489951", "policies": ["affinity"]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:33.298169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-98f3ec4d-2163-475c-9d01-498eaa1ed89a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:33.311224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-98f3ec4d-2163-475c-9d01-498eaa1ed89a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for user 7bee3c23fe964688bdb2ee2280ad0a58 and project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:33.346271 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c106f800-56a7-48ca-aeb4-846a7cee0de3 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "DELETE /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 204 len: 0 microversion: 2.1 time: 0.275057 Aug 03 01:51:33.347926 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 520/1080] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:51:33 2022] DELETE /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:51:33.358130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-44936f25-d86f-4ba8-a585-59be87049f98 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:33.359509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-44936f25-d86f-4ba8-a585-59be87049f98 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:33.380998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44936f25-d86f-4ba8-a585-59be87049f98 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:33.382109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44936f25-d86f-4ba8-a585-59be87049f98 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:33.383726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44936f25-d86f-4ba8-a585-59be87049f98 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:33.384374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44936f25-d86f-4ba8-a585-59be87049f98 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:33.452708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-98f3ec4d-2163-475c-9d01-498eaa1ed89a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:33.459571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-98f3ec4d-2163-475c-9d01-498eaa1ed89a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for user 7bee3c23fe964688bdb2ee2280ad0a58 and project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:33.481855 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-98f3ec4d-2163-475c-9d01-498eaa1ed89a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.261023 Aug 03 01:51:33.489961 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 561/1081] 10.222.0.67 () {60 vars in 1173 bytes} [Wed Aug 3 01:51:33 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:33.501261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ef936973-ec67-485c-bcb6-7b917cc321f7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:33.502572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ef936973-ec67-485c-bcb6-7b917cc321f7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:33.513226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef936973-ec67-485c-bcb6-7b917cc321f7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:33.514054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef936973-ec67-485c-bcb6-7b917cc321f7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:33.515147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef936973-ec67-485c-bcb6-7b917cc321f7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:33.515927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef936973-ec67-485c-bcb6-7b917cc321f7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:33.877611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-44936f25-d86f-4ba8-a585-59be87049f98 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:33.884787 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-44936f25-d86f-4ba8-a585-59be87049f98 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1540 microversion: 2.1 time: 0.535089 Aug 03 01:51:33.885742 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 521/1082] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:33 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1540 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:33.898408 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-60bec4fd-9d1b-4405-a8ae-05f192a81886 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:33.899566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-60bec4fd-9d1b-4405-a8ae-05f192a81886 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:33.919404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60bec4fd-9d1b-4405-a8ae-05f192a81886 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:33.919888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60bec4fd-9d1b-4405-a8ae-05f192a81886 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:33.920961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60bec4fd-9d1b-4405-a8ae-05f192a81886 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:33.921122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60bec4fd-9d1b-4405-a8ae-05f192a81886 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:33.974818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ef936973-ec67-485c-bcb6-7b917cc321f7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:33.984254 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ef936973-ec67-485c-bcb6-7b917cc321f7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1542 microversion: 2.1 time: 0.492635 Aug 03 01:51:33.984852 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 562/1083] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:33 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1542 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:33.994515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9f3952da-ebb4-44d7-a4ee-6dbce7557270 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Action: 'create', calling method: .version_select at 0x7f5b132c2ca0>, body: {"server_group": {"name": "tempest-server-group-2041489951", "policies": ["affinity"]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:34.037625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-9f3952da-ebb4-44d7-a4ee-6dbce7557270 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:34.045907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=5 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:34.047577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-9f3952da-ebb4-44d7-a4ee-6dbce7557270 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for user 7bee3c23fe964688bdb2ee2280ad0a58 and project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:34.137929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-9f3952da-ebb4-44d7-a4ee-6dbce7557270 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:34.148711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-9f3952da-ebb4-44d7-a4ee-6dbce7557270 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for user 7bee3c23fe964688bdb2ee2280ad0a58 and project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:34.177852 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9f3952da-ebb4-44d7-a4ee-6dbce7557270 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.189437 Aug 03 01:51:34.179055 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 563/1084] 10.222.0.67 () {60 vars in 1173 bytes} [Wed Aug 3 01:51:33 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:34.183939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eeb332bc-9ebb-4608-b90d-4a5f48fad803 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:34.191981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eeb332bc-9ebb-4608-b90d-4a5f48fad803 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:34.201653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeb332bc-9ebb-4608-b90d-4a5f48fad803 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:34.205076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeb332bc-9ebb-4608-b90d-4a5f48fad803 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:34.209038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeb332bc-9ebb-4608-b90d-4a5f48fad803 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:34.209685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeb332bc-9ebb-4608-b90d-4a5f48fad803 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:34.370836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-eeb332bc-9ebb-4608-b90d-4a5f48fad803 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:34.385590 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eeb332bc-9ebb-4608-b90d-4a5f48fad803 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 200 len: 1211 microversion: 2.1 time: 0.205124 Aug 03 01:51:34.386186 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 564/1085] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:34 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 1211 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:34.405926 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c87df707-2c11-4391-9742-0734579472c4 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:34.478777 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c87df707-2c11-4391-9742-0734579472c4 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/0d66a556-d0ba-48b3-98b4-8a5edcf3894a" status: 204 len: 0 microversion: 2.1 time: 0.078954 Aug 03 01:51:34.480651 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 565/1086] 10.222.0.67 () {58 vars in 1266 bytes} [Wed Aug 3 01:51:34 2022] DELETE /compute/v2.1/os-server-groups/0d66a556-d0ba-48b3-98b4-8a5edcf3894a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:51:34.488811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b783b66b-3be7-49b8-96eb-26b8dfd4f9b1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:34.490123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b783b66b-3be7-49b8-96eb-26b8dfd4f9b1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:34.497177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-60bec4fd-9d1b-4405-a8ae-05f192a81886 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:34.501876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b783b66b-3be7-49b8-96eb-26b8dfd4f9b1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:34.502760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b783b66b-3be7-49b8-96eb-26b8dfd4f9b1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:34.507194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b783b66b-3be7-49b8-96eb-26b8dfd4f9b1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:34.508218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b783b66b-3be7-49b8-96eb-26b8dfd4f9b1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:34.511795 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-60bec4fd-9d1b-4405-a8ae-05f192a81886 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 200 len: 1712 microversion: 2.1 time: 0.615505 Aug 03 01:51:34.518965 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 522/1087] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:33 2022] GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 1712 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:34.521589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d7c5b5a6-cb7e-4a74-b108-6b0f07994403 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:34.557231 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d7c5b5a6-cb7e-4a74-b108-6b0f07994403 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.040811 Aug 03 01:51:34.570166 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 523/1088] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:51:34 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:34.583567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93d4d509-6a3b-42e6-a05e-ba6f1cf0bf20 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:34.689534 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93d4d509-6a3b-42e6-a05e-ba6f1cf0bf20 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/d4f67f9d-7fd3-4648-8213-aa4dc490dd3c" status: 204 len: 0 microversion: 2.1 time: 0.117362 Aug 03 01:51:34.690388 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 524/1089] 10.222.0.67 () {58 vars in 1266 bytes} [Wed Aug 3 01:51:34 2022] DELETE /compute/v2.1/os-server-groups/d4f67f9d-7fd3-4648-8213-aa4dc490dd3c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:51:34.698453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-012255db-023c-4a1b-861f-2342c9ca2091 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:34.710072 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-012255db-023c-4a1b-861f-2342c9ca2091 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.015416 Aug 03 01:51:34.710813 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 525/1090] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:51:34 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:51:34.756985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eaa89c4b-4a59-4ddb-81b7-3c600310b60a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Action: 'create', calling method: .version_select at 0x7f5b200bbf70>, body: {"server_group": {"name": "tempest-server-group-302359141", "policies": ["affinity"]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:34.793163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-eaa89c4b-4a59-4ddb-81b7-3c600310b60a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:34.797925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-eaa89c4b-4a59-4ddb-81b7-3c600310b60a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for user 7bee3c23fe964688bdb2ee2280ad0a58 and project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:34.877739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-eaa89c4b-4a59-4ddb-81b7-3c600310b60a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:34.897351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-eaa89c4b-4a59-4ddb-81b7-3c600310b60a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for user 7bee3c23fe964688bdb2ee2280ad0a58 and project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:34.913666 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eaa89c4b-4a59-4ddb-81b7-3c600310b60a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.192388 Aug 03 01:51:34.920320 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 526/1091] 10.222.0.67 () {60 vars in 1173 bytes} [Wed Aug 3 01:51:34 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:34.925274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d2e40290-af93-4319-a2e2-7f5c4422edfc tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:34.926009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d2e40290-af93-4319-a2e2-7f5c4422edfc tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:34.937899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2e40290-af93-4319-a2e2-7f5c4422edfc tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:34.937899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2e40290-af93-4319-a2e2-7f5c4422edfc tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:34.937899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2e40290-af93-4319-a2e2-7f5c4422edfc tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:34.937899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2e40290-af93-4319-a2e2-7f5c4422edfc tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:34.993684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b783b66b-3be7-49b8-96eb-26b8dfd4f9b1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:35.004306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b783b66b-3be7-49b8-96eb-26b8dfd4f9b1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:35.006336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b783b66b-3be7-49b8-96eb-26b8dfd4f9b1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:35.008445 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b783b66b-3be7-49b8-96eb-26b8dfd4f9b1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1569 microversion: 2.25 time: 0.526507 Aug 03 01:51:35.009682 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 566/1092] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:34 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1569 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:35.015644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a13f73a6-7516-404d-a989-128a6f45b64f tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:35.067867 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a13f73a6-7516-404d-a989-128a6f45b64f tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/c483dec9-07ee-4139-a8d2-09d086b17ffe" status: 204 len: 0 microversion: 2.1 time: 0.056884 Aug 03 01:51:35.072388 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 567/1093] 10.222.0.67 () {58 vars in 1266 bytes} [Wed Aug 3 01:51:35 2022] DELETE /compute/v2.1/os-server-groups/c483dec9-07ee-4139-a8d2-09d086b17ffe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:51:35.079686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1820424586", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "8587fddf-9abd-4c52-98e3-97c18dcab027"}], "security_groups": [{"name": "tempest-securitygroup--2012911481"}], "key_name": "tempest-keypair-122785629", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:35.300168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d2e40290-af93-4319-a2e2-7f5c4422edfc tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:35.311885 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d2e40290-af93-4319-a2e2-7f5c4422edfc tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1540 microversion: 2.1 time: 0.390375 Aug 03 01:51:35.325700 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 527/1094] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:34 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1540 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:35.335059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cdd0b4b1-489b-417d-8c3f-733eb9c5ada1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:35.343434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cdd0b4b1-489b-417d-8c3f-733eb9c5ada1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:35.357032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cdd0b4b1-489b-417d-8c3f-733eb9c5ada1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:35.357731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cdd0b4b1-489b-417d-8c3f-733eb9c5ada1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:35.358712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cdd0b4b1-489b-417d-8c3f-733eb9c5ada1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:35.359359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cdd0b4b1-489b-417d-8c3f-733eb9c5ada1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:35.625592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] validate_networks() for [('8587fddf-9abd-4c52-98e3-97c18dcab027', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:51:36.365519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cdd0b4b1-489b-417d-8c3f-733eb9c5ada1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:36.388505 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cdd0b4b1-489b-417d-8c3f-733eb9c5ada1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1541 microversion: 2.1 time: 1.061551 Aug 03 01:51:36.389584 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 528/1095] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:35 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1541 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:36.397168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aa4b67af-c109-4443-a323-5c4c197dfab8 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:36.410387 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aa4b67af-c109-4443-a323-5c4c197dfab8 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.019354 Aug 03 01:51:36.411201 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 529/1096] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:51:36 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:36.416236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ff51efd6-f828-41f2-bf97-a2a80db4b8db tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:36.417162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ff51efd6-f828-41f2-bf97-a2a80db4b8db tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:36.424685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff51efd6-f828-41f2-bf97-a2a80db4b8db tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:36.425378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff51efd6-f828-41f2-bf97-a2a80db4b8db tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:36.426193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff51efd6-f828-41f2-bf97-a2a80db4b8db tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:36.426624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff51efd6-f828-41f2-bf97-a2a80db4b8db tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:36.568227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ff51efd6-f828-41f2-bf97-a2a80db4b8db tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:36.581791 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ff51efd6-f828-41f2-bf97-a2a80db4b8db tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 200 len: 1273 microversion: 2.1 time: 0.169278 Aug 03 01:51:36.582950 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 530/1097] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:36 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 1273 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:36.587837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-af728b5d-882c-4991-a6f2-e79572ae7325 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:36.588790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-af728b5d-882c-4991-a6f2-e79572ae7325 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:36.601972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af728b5d-882c-4991-a6f2-e79572ae7325 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:36.604716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af728b5d-882c-4991-a6f2-e79572ae7325 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:36.608317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af728b5d-882c-4991-a6f2-e79572ae7325 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:36.608775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af728b5d-882c-4991-a6f2-e79572ae7325 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:37.423213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-af728b5d-882c-4991-a6f2-e79572ae7325 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '141f8784088448cdafee6cee8955dc71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d6080e5d14fb3906ecf8c339478d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:37.434861 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-af728b5d-882c-4991-a6f2-e79572ae7325 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 200 len: 1712 microversion: 2.1 time: 0.850487 Aug 03 01:51:37.452729 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 531/1098] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:36 2022] GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 1712 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:37.460047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e225e065-b8bf-4b15-9572-3c4bbcd121ac tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:37.460928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e225e065-b8bf-4b15-9572-3c4bbcd121ac tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:37.475186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e225e065-b8bf-4b15-9572-3c4bbcd121ac tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:37.475839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e225e065-b8bf-4b15-9572-3c4bbcd121ac tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:37.476823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e225e065-b8bf-4b15-9572-3c4bbcd121ac tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:37.477997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e225e065-b8bf-4b15-9572-3c4bbcd121ac tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:37.490334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:51:37.491132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:51:37.491798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:51:37.492303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:51:37.492913 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:51:37.513153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:37.515363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:37.517370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:37.518590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:37.587605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Getting quotas for project 5f232cf4e61b4213b592b2a020961630. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:37.601670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Getting quotas for user dd2c77c8ab314584939f1f580d5a6d14 and project 5f232cf4e61b4213b592b2a020961630. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:37.642673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:51:37.650179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:51:37.791857 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-78d11151-cbb1-4b46-9331-db8a19c73077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.716823 Aug 03 01:51:37.804373 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 568/1099] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:51:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 2730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:51:37.813992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4e7573c8-b750-422c-9f19-776edc23816e tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:37.819993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4e7573c8-b750-422c-9f19-776edc23816e tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:37.843673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e7573c8-b750-422c-9f19-776edc23816e tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:37.844774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e7573c8-b750-422c-9f19-776edc23816e tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:37.846425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e7573c8-b750-422c-9f19-776edc23816e tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:37.848667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e7573c8-b750-422c-9f19-776edc23816e tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:38.039875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4e7573c8-b750-422c-9f19-776edc23816e tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d688a22fbec41ba9067c6290d70d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69aa4c52c59841f59db580a6dca4446b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:38.056518 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4e7573c8-b750-422c-9f19-776edc23816e tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 200 len: 1316 microversion: 2.1 time: 0.248841 Aug 03 01:51:38.060125 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 569/1100] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:37 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:38.071332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dba63510-bf3e-4ab4-ac1d-a41516c43b3a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Action: 'create', calling method: .version_select at 0x7f5b132bec10>, body: {"server_group": {"name": "tempest-server-group-2071481563", "policies": ["anti-affinity"]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:38.121053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-dba63510-bf3e-4ab4-ac1d-a41516c43b3a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:38.141703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-dba63510-bf3e-4ab4-ac1d-a41516c43b3a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for user 7bee3c23fe964688bdb2ee2280ad0a58 and project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:38.282784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-dba63510-bf3e-4ab4-ac1d-a41516c43b3a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:38.304544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-dba63510-bf3e-4ab4-ac1d-a41516c43b3a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for user 7bee3c23fe964688bdb2ee2280ad0a58 and project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:38.352612 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dba63510-bf3e-4ab4-ac1d-a41516c43b3a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.290999 Aug 03 01:51:38.358717 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 570/1101] 10.222.0.67 () {60 vars in 1173 bytes} [Wed Aug 3 01:51:38 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:38.381427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-da1bca5e-5b6a-4077-8caf-036844228fcd tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:38.382061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-da1bca5e-5b6a-4077-8caf-036844228fcd tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:38.396260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da1bca5e-5b6a-4077-8caf-036844228fcd tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:38.413350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da1bca5e-5b6a-4077-8caf-036844228fcd tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:38.414216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da1bca5e-5b6a-4077-8caf-036844228fcd tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:38.414653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da1bca5e-5b6a-4077-8caf-036844228fcd tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:38.802154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-da1bca5e-5b6a-4077-8caf-036844228fcd tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:38.812113 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-da1bca5e-5b6a-4077-8caf-036844228fcd tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1473 microversion: 2.1 time: 0.449469 Aug 03 01:51:38.825081 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 571/1102] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:38 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1473 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:38.828719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e225e065-b8bf-4b15-9572-3c4bbcd121ac tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:38.831023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c69e6513-beb3-4760-a628-d19c0e138123 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:38.831664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c69e6513-beb3-4760-a628-d19c0e138123 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:38.842442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e225e065-b8bf-4b15-9572-3c4bbcd121ac tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:38.844524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e225e065-b8bf-4b15-9572-3c4bbcd121ac tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:38.850609 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e225e065-b8bf-4b15-9572-3c4bbcd121ac tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1544 microversion: 2.25 time: 1.394559 Aug 03 01:51:38.857146 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 532/1103] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:37 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1544 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:38.858759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c69e6513-beb3-4760-a628-d19c0e138123 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:38.861336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c69e6513-beb3-4760-a628-d19c0e138123 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:38.863907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c69e6513-beb3-4760-a628-d19c0e138123 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:38.867733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b3ff211c-2eb3-49c8-afca-0ff757ea6e31 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:38.869148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c69e6513-beb3-4760-a628-d19c0e138123 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:38.872206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b3ff211c-2eb3-49c8-afca-0ff757ea6e31 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:38.919587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3ff211c-2eb3-49c8-afca-0ff757ea6e31 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:38.920064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3ff211c-2eb3-49c8-afca-0ff757ea6e31 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:38.920932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3ff211c-2eb3-49c8-afca-0ff757ea6e31 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:38.921378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3ff211c-2eb3-49c8-afca-0ff757ea6e31 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:39.128047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b3ff211c-2eb3-49c8-afca-0ff757ea6e31 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:39.141350 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b3ff211c-2eb3-49c8-afca-0ff757ea6e31 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1230 microversion: 2.1 time: 0.281566 Aug 03 01:51:39.152283 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 533/1104] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:38 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1230 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:39.161779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d33181d8-a71d-4cfb-b0d6-213aaa9b3972 req-d2056bd8-befa-4aac-9081-d05f038b3621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b647860c-e2e2-4a77-bb70-d396616839cf", "name": "network-vif-deleted", "tag": "b440c03b-e6d3-40bf-97c1-ca18782b6c46"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:39.194857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:39.200350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c69e6513-beb3-4760-a628-d19c0e138123 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:39.209222 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c69e6513-beb3-4760-a628-d19c0e138123 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 200 len: 1315 microversion: 2.1 time: 0.384494 Aug 03 01:51:39.212066 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 572/1105] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:38 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:39.217209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-68e67b4f-7ec5-4c3d-8b78-abcbe1979ecf req-a597ec98-6a70-46a7-9dca-5243543fa826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297a1ee8-52ab-4794-9923-1c4603d93775", "name": "network-vif-deleted", "tag": "290be87d-e492-4cca-9d33-ac2f3145deee"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:39.224619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d33181d8-a71d-4cfb-b0d6-213aaa9b3972 req-d2056bd8-befa-4aac-9081-d05f038b3621 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:39.228561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d33181d8-a71d-4cfb-b0d6-213aaa9b3972 req-d2056bd8-befa-4aac-9081-d05f038b3621 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:39.243170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-68e67b4f-7ec5-4c3d-8b78-abcbe1979ecf req-a597ec98-6a70-46a7-9dca-5243543fa826 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:39.243607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-68e67b4f-7ec5-4c3d-8b78-abcbe1979ecf req-a597ec98-6a70-46a7-9dca-5243543fa826 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:39.271633 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-68e67b4f-7ec5-4c3d-8b78-abcbe1979ecf req-a597ec98-6a70-46a7-9dca-5243543fa826 service nova] Creating event network-vif-deleted:290be87d-e492-4cca-9d33-ac2f3145deee for instance 297a1ee8-52ab-4794-9923-1c4603d93775 on n-h2-826529-8 Aug 03 01:51:39.283796 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d33181d8-a71d-4cfb-b0d6-213aaa9b3972 req-d2056bd8-befa-4aac-9081-d05f038b3621 service nova] Creating event network-vif-deleted:b440c03b-e6d3-40bf-97c1-ca18782b6c46 for instance b647860c-e2e2-4a77-bb70-d396616839cf on n-h2-826529-8 Aug 03 01:51:39.287343 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-68e67b4f-7ec5-4c3d-8b78-abcbe1979ecf req-a597ec98-6a70-46a7-9dca-5243543fa826 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073892 Aug 03 01:51:39.288347 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 573/1106] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:39.303623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3eafb4e9-7751-4831-978a-f052b570d418 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:39.306980 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d33181d8-a71d-4cfb-b0d6-213aaa9b3972 req-d2056bd8-befa-4aac-9081-d05f038b3621 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150978 Aug 03 01:51:39.307612 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 534/1107] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:39.329095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:DELETE=7 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:39.341447 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3eafb4e9-7751-4831-978a-f052b570d418 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/6ebc7b96-aacb-4483-a3af-0e2310ff85c5" status: 204 len: 0 microversion: 2.1 time: 0.051731 Aug 03 01:51:39.341684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c41aeac2-fbe5-456d-8e55-737735f74792 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:39.342410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c41aeac2-fbe5-456d-8e55-737735f74792 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:39.343377 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 574/1108] 10.222.0.67 () {58 vars in 1266 bytes} [Wed Aug 3 01:51:39 2022] DELETE /compute/v2.1/os-server-groups/6ebc7b96-aacb-4483-a3af-0e2310ff85c5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:51:39.349604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1f5e2948-5383-443f-bab3-996d894945e3 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '.version_select at 0x7f5b1336d670>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:39.356580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f5e2948-5383-443f-bab3-996d894945e3 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:39.357531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f5e2948-5383-443f-bab3-996d894945e3 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:39.358344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c41aeac2-fbe5-456d-8e55-737735f74792 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:39.359053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c41aeac2-fbe5-456d-8e55-737735f74792 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:39.360783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c41aeac2-fbe5-456d-8e55-737735f74792 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:39.361445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c41aeac2-fbe5-456d-8e55-737735f74792 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:39.377006 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1f5e2948-5383-443f-bab3-996d894945e3 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 2961 microversion: 2.25 time: 0.032188 Aug 03 01:51:39.378935 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 575/1109] 10.222.0.67 () {60 vars in 1184 bytes} [Wed Aug 3 01:51:39 2022] GET /compute/v2.1/os-migrations => generated 2961 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:39.383892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b3fb4a12-061b-4492-87bd-f1c2172ca1fb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:39.384854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b3fb4a12-061b-4492-87bd-f1c2172ca1fb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] [instance: b647860c-e2e2-4a77-bb70-d396616839cf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:39.392140 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-c41aeac2-fbe5-456d-8e55-737735f74792 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] HTTP exception thrown: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. Aug 03 01:51:39.394366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3fb4a12-061b-4492-87bd-f1c2172ca1fb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:39.395052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3fb4a12-061b-4492-87bd-f1c2172ca1fb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:39.396068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3fb4a12-061b-4492-87bd-f1c2172ca1fb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:39.396699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3fb4a12-061b-4492-87bd-f1c2172ca1fb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c41aeac2-fbe5-456d-8e55-737735f74792 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Request method failure captured: Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 HTTP/1.1 Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dP2qUBeVmqmR1c1GAKEjhPVGRtegIxHQ21HS9VqGWNozAqHbaqk56TPuhxahFJvRNcJeuAafbf0dSwUQItmXS3RGZdsNx3F3_6tvqMDIVI5qOy6hOtEkHTUma0Uqhm0Vi-aT2KwEI82okUPw7_yT9kKOEFioo_1wIwgnvgu9ADZxvs Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 631d6080e5d14fb3906ecf8c339478d7 Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_631d6080e5d14fb3906ecf8c339478d7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/631d6080e5d14fb3906ecf8c339478d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/631d6080e5d14fb3906ecf8c339478d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/631d6080e5d14fb3906ecf8c339478d7"}]}] Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 631d6080e5d14fb3906ecf8c339478d7 Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersWithSpecificFlavorTestJSON-630379633-project Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 141f8784088448cdafee6cee8955dc71 Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633-project Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '297a1ee8-52ab-4794-9923-1c4603d93775'} Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.400106 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:39.405460 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.405460 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:39.405460 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:39.405460 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:39.405460 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:39.405460 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:39.405460 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. Aug 03 01:51:39.405460 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.405460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c41aeac2-fbe5-456d-8e55-737735f74792 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Returning 404 to user: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:39.406145 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c41aeac2-fbe5-456d-8e55-737735f74792 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 404 len: 111 microversion: 2.1 time: 0.091638 Aug 03 01:51:39.406145 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 535/1110] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:39 2022] GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:51:39.419193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-db1c7f7a-b953-4adf-bea5-3ad2abf3c52c req-d7559bc9-640b-4d9c-9578-a34f271d6a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2ce9d3-8e0c-4981-951e-3d23d58de2c2", "name": "network-vif-unplugged", "status": "completed", "tag": "aee6f3d7-e3c0-4569-9c1b-2cfe18a9f997"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:39.428480 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-b3fb4a12-061b-4492-87bd-f1c2172ca1fb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] HTTP exception thrown: Instance b647860c-e2e2-4a77-bb70-d396616839cf could not be found. Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b3fb4a12-061b-4492-87bd-f1c2172ca1fb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Request method failure captured: Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf HTTP/1.1 Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dRz78VBKzllSUkqvBKhoknY1OgqA1DedTCWuujue2GuhXAACp2kfXi6q9FjqOO4rSXwDJnxfOrMkddNu1bvZGTUQiS4mIAmS0EpcasX8ADztS1Z8Ey8u-kDPG4inuRmPEhcBcUMMjcrfz11f4jzOeb3UoN6e48EqI3ShIZwdTBowbo Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 69aa4c52c59841f59db580a6dca4446b Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_69aa4c52c59841f59db580a6dca4446b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69aa4c52c59841f59db580a6dca4446b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/69aa4c52c59841f59db580a6dca4446b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/69aa4c52c59841f59db580a6dca4446b"}]}] Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 69aa4c52c59841f59db580a6dca4446b Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4d688a22fbec41ba9067c6290d70d376 Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance b647860c-e2e2-4a77-bb70-d396616839cf could not be found. Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'b647860c-e2e2-4a77-bb70-d396616839cf'} Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b647860c-e2e2-4a77-bb70-d396616839cf could not be found. Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b647860c-e2e2-4a77-bb70-d396616839cf could not be found. Aug 03 01:51:39.430444 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.438744 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:39.438744 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.438744 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:39.438744 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:39.438744 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:39.438744 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:39.438744 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:39.438744 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b647860c-e2e2-4a77-bb70-d396616839cf could not be found. Aug 03 01:51:39.438744 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.438744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b3fb4a12-061b-4492-87bd-f1c2172ca1fb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] Returning 404 to user: Instance b647860c-e2e2-4a77-bb70-d396616839cf could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:39.438744 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b3fb4a12-061b-4492-87bd-f1c2172ca1fb tempest-FloatingIPsAssociationNegativeTestJSON-1806857080 tempest-FloatingIPsAssociationNegativeTestJSON-1806857080-project] 10.222.0.67 "GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf" status: 404 len: 111 microversion: 2.1 time: 0.051721 Aug 03 01:51:39.438744 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 576/1111] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:39 2022] GET /compute/v2.1/servers/b647860c-e2e2-4a77-bb70-d396616839cf => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:51:39.441096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-db1c7f7a-b953-4adf-bea5-3ad2abf3c52c req-d7559bc9-640b-4d9c-9578-a34f271d6a44 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:39.441096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-db1c7f7a-b953-4adf-bea5-3ad2abf3c52c req-d7559bc9-640b-4d9c-9578-a34f271d6a44 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:39.453602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ae861fb1-4ed9-4f7f-aefa-a16455120fa9 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:39.465138 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-db1c7f7a-b953-4adf-bea5-3ad2abf3c52c req-d7559bc9-640b-4d9c-9578-a34f271d6a44 service nova] Creating event network-vif-unplugged:aee6f3d7-e3c0-4569-9c1b-2cfe18a9f997 for instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 on n-h1-826529-8 Aug 03 01:51:39.472829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-db1c7f7a-b953-4adf-bea5-3ad2abf3c52c req-d7559bc9-640b-4d9c-9578-a34f271d6a44 service nova] Instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 01:51:39.481438 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-db1c7f7a-b953-4adf-bea5-3ad2abf3c52c req-d7559bc9-640b-4d9c-9578-a34f271d6a44 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072785 Aug 03 01:51:39.483441 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 536/1112] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:39.490012 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ae861fb1-4ed9-4f7f-aefa-a16455120fa9 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.055787 Aug 03 01:51:39.490885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bfe4aa16-8b65-43fd-ad0c-b12e6187fc01 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:39.491962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bfe4aa16-8b65-43fd-ad0c-b12e6187fc01 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:39.495662 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 577/1113] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:51:39 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:39.503036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfe4aa16-8b65-43fd-ad0c-b12e6187fc01 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:39.503885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfe4aa16-8b65-43fd-ad0c-b12e6187fc01 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:39.505619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfe4aa16-8b65-43fd-ad0c-b12e6187fc01 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:39.506278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfe4aa16-8b65-43fd-ad0c-b12e6187fc01 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:39.509681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f670f172-453d-46ec-8219-61788d84c340 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:39.510576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f670f172-453d-46ec-8219-61788d84c340 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:39.531813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:39.535782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f670f172-453d-46ec-8219-61788d84c340 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:39.537561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f670f172-453d-46ec-8219-61788d84c340 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:39.538409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f670f172-453d-46ec-8219-61788d84c340 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:39.538850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f670f172-453d-46ec-8219-61788d84c340 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:39.614484 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-f670f172-453d-46ec-8219-61788d84c340 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] HTTP exception thrown: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f670f172-453d-46ec-8219-61788d84c340 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Request method failure captured: Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 HTTP/1.1 Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dP2qUBeVmqmR1c1GAKEjhPVGRtegIxHQ21HS9VqGWNozAqHbaqk56TPuhxahFJvRNcJeuAafbf0dSwUQItmXS3RGZdsNx3F3_6tvqMDIVI5qOy6hOtEkHTUma0Uqhm0Vi-aT2KwEI82okUPw7_yT9kKOEFioo_1wIwgnvgu9ADZxvs Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 631d6080e5d14fb3906ecf8c339478d7 Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_631d6080e5d14fb3906ecf8c339478d7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/631d6080e5d14fb3906ecf8c339478d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/631d6080e5d14fb3906ecf8c339478d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/631d6080e5d14fb3906ecf8c339478d7"}]}] Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 631d6080e5d14fb3906ecf8c339478d7 Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersWithSpecificFlavorTestJSON-630379633-project Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 141f8784088448cdafee6cee8955dc71 Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633-project Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'c171ccf7-988b-441b-acb8-7332e481ec09'} Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:51:39.616158 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:51:39.620313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:39.620313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.620313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:39.620313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.620313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:39.620313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:39.620313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:39.620313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:39.620313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:39.620313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:39.620313 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.623561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f670f172-453d-46ec-8219-61788d84c340 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Returning 404 to user: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:39.631151 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f670f172-453d-46ec-8219-61788d84c340 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 404 len: 111 microversion: 2.1 time: 0.133991 Aug 03 01:51:39.632535 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 578/1114] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:51:39 2022] DELETE /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:51:39.642330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-383709296", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "d65528c1-0fae-4ad1-9eaa-3abf5accd419"}]}, "os:scheduler_hints": {"group": "8d56a411-aec0-465d-ba7e-2b8cdc67143d"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:39.760657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] validate_networks() for [('d65528c1-0fae-4ad1-9eaa-3abf5accd419', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:51:39.796403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-bfe4aa16-8b65-43fd-ad0c-b12e6187fc01 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'services' on Instance uuid 1025ec9b-6b5d-445a-8c05-ae537d3273cc {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:51:39.844645 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bfe4aa16-8b65-43fd-ad0c-b12e6187fc01 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 2037 microversion: 2.25 time: 0.347666 Aug 03 01:51:39.846013 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 537/1115] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:39 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 2037 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:39.850934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3aaa706d-3d95-4da4-a9de-cd4519a0404e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:39.851620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3aaa706d-3d95-4da4-a9de-cd4519a0404e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:39.864252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3aaa706d-3d95-4da4-a9de-cd4519a0404e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:39.865052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3aaa706d-3d95-4da4-a9de-cd4519a0404e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:39.872093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3aaa706d-3d95-4da4-a9de-cd4519a0404e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:39.873144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3aaa706d-3d95-4da4-a9de-cd4519a0404e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:39.913628 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-3aaa706d-3d95-4da4-a9de-cd4519a0404e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] HTTP exception thrown: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3aaa706d-3d95-4da4-a9de-cd4519a0404e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Request method failure captured: Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 HTTP/1.1 Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dP2qUBeVmqmR1c1GAKEjhPVGRtegIxHQ21HS9VqGWNozAqHbaqk56TPuhxahFJvRNcJeuAafbf0dSwUQItmXS3RGZdsNx3F3_6tvqMDIVI5qOy6hOtEkHTUma0Uqhm0Vi-aT2KwEI82okUPw7_yT9kKOEFioo_1wIwgnvgu9ADZxvs Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 631d6080e5d14fb3906ecf8c339478d7 Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_631d6080e5d14fb3906ecf8c339478d7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/631d6080e5d14fb3906ecf8c339478d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/631d6080e5d14fb3906ecf8c339478d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/631d6080e5d14fb3906ecf8c339478d7"}]}] Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 631d6080e5d14fb3906ecf8c339478d7 Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersWithSpecificFlavorTestJSON-630379633-project Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 141f8784088448cdafee6cee8955dc71 Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633-project Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'c171ccf7-988b-441b-acb8-7332e481ec09'} Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.915929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:39.920577 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.920577 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:39.920577 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:39.920577 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:39.920577 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:39.920577 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:39.920577 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:39.920577 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:39.922977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3aaa706d-3d95-4da4-a9de-cd4519a0404e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Returning 404 to user: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:39.924086 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3aaa706d-3d95-4da4-a9de-cd4519a0404e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 404 len: 111 microversion: 2.1 time: 0.076953 Aug 03 01:51:39.924888 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 538/1116] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:39 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:51:40.016302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-54268e5e-626e-4900-8345-9c753247c1cc tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Action: 'create', calling method: .version_select at 0x7f5b13323ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2128991910", "description": "tempest-description-1960229631"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:40.648913 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-54268e5e-626e-4900-8345-9c753247c1cc tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.719854 Aug 03 01:51:40.649536 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 539/1117] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:51:39 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:40.664160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a6ee77d1-fc6e-4186-9841-42b83c1a1392 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:40.664414 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a6ee77d1-fc6e-4186-9841-42b83c1a1392 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:40.673131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6ee77d1-fc6e-4186-9841-42b83c1a1392 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:40.673657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6ee77d1-fc6e-4186-9841-42b83c1a1392 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:40.675328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6ee77d1-fc6e-4186-9841-42b83c1a1392 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:40.675452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6ee77d1-fc6e-4186-9841-42b83c1a1392 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:40.820407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:51:40.820961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:51:40.822058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:51:40.822594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:51:40.823054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:51:40.870183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:40.870977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:40.878404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:40.879228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:40.925432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:40.936369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for user 7bee3c23fe964688bdb2ee2280ad0a58 and project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:40.969803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:51:40.972214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:51:41.073469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a6ee77d1-fc6e-4186-9841-42b83c1a1392 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:41.078430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=125941) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 03 01:51:41.083054 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a6ee77d1-fc6e-4186-9841-42b83c1a1392 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1470 microversion: 2.1 time: 0.423525 Aug 03 01:51:41.087657 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 540/1118] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:40 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1470 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:41.108287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c03ee6b0-b95e-4c4e-a0c2-336e11d571ee tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Action: 'create', calling method: .version_select at 0x7f5b13323700>, body: {"keypair": {"name": "tempest-keypair-1478450462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMjBZY8HI9kICpzOZf5a1oEozaeQfENzOnoA6AfarHq8j9Sh8GIDXgvpM/MgjZ6BO4drj1eAVWwPMS3npzGpXFrKZdRJsHE7FziMleRVttYbmJ4HB6PCcVdod0fOZPzmA=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:41.118023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_group_members'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:41.124240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for user 7bee3c23fe964688bdb2ee2280ad0a58 and project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_group_members'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:41.141246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-c03ee6b0-b95e-4c4e-a0c2-336e11d571ee tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Getting quotas for project 162addf8f6634e7fa0a1f9c6004258d1. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:41.150131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-c03ee6b0-b95e-4c4e-a0c2-336e11d571ee tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Getting quotas for user 4cb821820bbb4d3a8c999e1dec6a06a4 and project 162addf8f6634e7fa0a1f9c6004258d1. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:41.188330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_group_members'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:41.193899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Getting quotas for user 7bee3c23fe964688bdb2ee2280ad0a58 and project 67bb34c427144dcca5d1d145d1a85c39. Resources: {'server_group_members'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:41.212149 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c03ee6b0-b95e-4c4e-a0c2-336e11d571ee tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.122981 Aug 03 01:51:41.212929 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 541/1119] 10.222.0.67 () {62 vars in 1200 bytes} [Wed Aug 3 01:51:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 01:51:41.220055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7d778034-63f2-4afd-bf9f-ac5c91df6435 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '.version_select at 0x7f5b132fbd30>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:41.253468 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1b6012b8-4aad-441e-a31e-19b65c7a628a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.617470 Aug 03 01:51:41.254802 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 579/1120] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:51:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:51:41.263970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dda1defd-c678-409f-9c21-94a742f11def tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:41.264928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dda1defd-c678-409f-9c21-94a742f11def tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:41.271110 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7d778034-63f2-4afd-bf9f-ac5c91df6435 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119800332" status: 202 len: 0 microversion: 2.1 time: 0.056112 Aug 03 01:51:41.272478 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 542/1121] 10.222.0.67 () {58 vars in 1221 bytes} [Wed Aug 3 01:51:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119800332 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:41.277346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dda1defd-c678-409f-9c21-94a742f11def tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:41.278015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dda1defd-c678-409f-9c21-94a742f11def tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:41.278233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4eb097f8-4df5-4090-abdc-5eec9c5249df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:41.278989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4eb097f8-4df5-4090-abdc-5eec9c5249df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:41.279740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dda1defd-c678-409f-9c21-94a742f11def tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:41.280449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dda1defd-c678-409f-9c21-94a742f11def tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:41.304046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eb097f8-4df5-4090-abdc-5eec9c5249df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:41.304392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eb097f8-4df5-4090-abdc-5eec9c5249df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:41.305392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eb097f8-4df5-4090-abdc-5eec9c5249df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:41.306006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eb097f8-4df5-4090-abdc-5eec9c5249df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:41.398966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dda1defd-c678-409f-9c21-94a742f11def tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:41.414533 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dda1defd-c678-409f-9c21-94a742f11def tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1292 microversion: 2.1 time: 0.157805 Aug 03 01:51:41.430109 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 580/1122] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:41 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1292 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:41.431188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d731225-866c-400c-8c62-830411a9f34d tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Action: 'create', calling method: .version_select at 0x7f5b1323d0d0>, body: {"security_group_rule": {"parent_group_id": "c4166ed8-6aef-4c6c-ae84-25b98ba847f5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:41.868103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4eb097f8-4df5-4090-abdc-5eec9c5249df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:41.877344 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4eb097f8-4df5-4090-abdc-5eec9c5249df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 200 len: 1315 microversion: 2.1 time: 0.603602 Aug 03 01:51:41.899609 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 543/1123] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:41 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 1315 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:41.930130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dbbcc0c2-2481-4212-a626-7ed4a61e13ec tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:41.930987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dbbcc0c2-2481-4212-a626-7ed4a61e13ec tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:41.946608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbbcc0c2-2481-4212-a626-7ed4a61e13ec tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:41.951818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbbcc0c2-2481-4212-a626-7ed4a61e13ec tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:41.952852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbbcc0c2-2481-4212-a626-7ed4a61e13ec tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:41.953531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbbcc0c2-2481-4212-a626-7ed4a61e13ec tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:42.038732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbbcc0c2-2481-4212-a626-7ed4a61e13ec tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:42.039249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbbcc0c2-2481-4212-a626-7ed4a61e13ec tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:42.040318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbbcc0c2-2481-4212-a626-7ed4a61e13ec tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:42.040996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbbcc0c2-2481-4212-a626-7ed4a61e13ec tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:42.104531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-dbbcc0c2-2481-4212-a626-7ed4a61e13ec tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Getting quotas for project 6e247e7134ad41bfa92b6eff8111c86e. Resources: {'cores', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:42.109553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-dbbcc0c2-2481-4212-a626-7ed4a61e13ec tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Getting quotas for user 241ed53f42f84abc8efc7edb5f41f6ed and project 6e247e7134ad41bfa92b6eff8111c86e. Resources: {'cores', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:42.306343 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dbbcc0c2-2481-4212-a626-7ed4a61e13ec tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "POST /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2/action" status: 202 len: 0 microversion: 2.1 time: 0.403815 Aug 03 01:51:42.312668 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 544/1124] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:51:41 2022] POST /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:42.321160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fe7f4398-cdf6-495b-b22a-665e3f084c47 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:42.322232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fe7f4398-cdf6-495b-b22a-665e3f084c47 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:42.332321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe7f4398-cdf6-495b-b22a-665e3f084c47 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:42.333969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe7f4398-cdf6-495b-b22a-665e3f084c47 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:42.355779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe7f4398-cdf6-495b-b22a-665e3f084c47 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:42.356549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe7f4398-cdf6-495b-b22a-665e3f084c47 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:42.596084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fe7f4398-cdf6-495b-b22a-665e3f084c47 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee3c23fe964688bdb2ee2280ad0a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67bb34c427144dcca5d1d145d1a85c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:42.606927 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fe7f4398-cdf6-495b-b22a-665e3f084c47 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 200 len: 1216 microversion: 2.1 time: 0.290903 Aug 03 01:51:42.614211 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6d731225-866c-400c-8c62-830411a9f34d tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.193926 Aug 03 01:51:42.614833 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 545/1125] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:42 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 1216 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:42.624963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-6951dbaa-f683-4c9b-9f5d-244bde7abb7f req-9015ae7e-42c4-4541-807c-4361810fa8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01b31b62-ac13-47d2-af5f-fb68852ca81b", "tag": "c05623b0-a20e-4d6a-b404-b4d7edd6104a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:42.635763 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 581/1126] 10.222.0.67 () {60 vars in 1195 bytes} [Wed Aug 3 01:51:41 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:42.644885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6951dbaa-f683-4c9b-9f5d-244bde7abb7f req-9015ae7e-42c4-4541-807c-4361810fa8b9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:42.645327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6951dbaa-f683-4c9b-9f5d-244bde7abb7f req-9015ae7e-42c4-4541-807c-4361810fa8b9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:42.653765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c70c15ec-d8b7-4100-a36b-82b30dd77d48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:42.668214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c70c15ec-d8b7-4100-a36b-82b30dd77d48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:42.675694 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-6951dbaa-f683-4c9b-9f5d-244bde7abb7f req-9015ae7e-42c4-4541-807c-4361810fa8b9 service nova] Creating event network-changed:c05623b0-a20e-4d6a-b404-b4d7edd6104a for instance 01b31b62-ac13-47d2-af5f-fb68852ca81b on n-h2-826529-8 Aug 03 01:51:42.689064 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-6951dbaa-f683-4c9b-9f5d-244bde7abb7f req-9015ae7e-42c4-4541-807c-4361810fa8b9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071785 Aug 03 01:51:42.691565 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 546/1127] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:42.705661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d2c56ace-c4e8-4ea7-92c5-412618e3ba65 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:42.707281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d2c56ace-c4e8-4ea7-92c5-412618e3ba65 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:42.713255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c70c15ec-d8b7-4100-a36b-82b30dd77d48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:42.715576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c70c15ec-d8b7-4100-a36b-82b30dd77d48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:42.717246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c70c15ec-d8b7-4100-a36b-82b30dd77d48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:42.717791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c70c15ec-d8b7-4100-a36b-82b30dd77d48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:42.734265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2c56ace-c4e8-4ea7-92c5-412618e3ba65 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:42.734744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2c56ace-c4e8-4ea7-92c5-412618e3ba65 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:42.740123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2c56ace-c4e8-4ea7-92c5-412618e3ba65 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:42.757270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2c56ace-c4e8-4ea7-92c5-412618e3ba65 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:43.298234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d2c56ace-c4e8-4ea7-92c5-412618e3ba65 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:43.307256 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d2c56ace-c4e8-4ea7-92c5-412618e3ba65 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1360 microversion: 2.1 time: 0.614389 Aug 03 01:51:43.319787 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 547/1128] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:42 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1360 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:43.330640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fcab0359-85b2-4180-9502-47eb0f671000 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Action: 'create', calling method: .version_select at 0x7f5b13323790>, body: {"security_group_rule": {"parent_group_id": "c4166ed8-6aef-4c6c-ae84-25b98ba847f5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:43.462446 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-fcab0359-85b2-4180-9502-47eb0f671000 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] HTTP exception thrown: This rule already exists in group c4166ed8-6aef-4c6c-ae84-25b98ba847f5 Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fcab0359-85b2-4180-9502-47eb0f671000 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Request method failure captured: Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 138 Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dSr481l4NnWGnchwmEcMcifinqsQT2eI0TI37TekBG2wpfNr2sawzIWfe8bSkwLqMVFyfalA9wzjEZ_QtnUhdEbTBAALX4LX9o80iduI6fh7RaLz-nCV0XUOcyANbBgF7nzUdPBTEIX3hIqbzsOzm4T8exM4E60MaRawZIDRGK2VYY Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a6c931d0167a4426bf97affb9cd0ec1e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}] Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: be8003bebd41425dbdfe6c7cb47307fb Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: {"security_group_rule": {"parent_group_id": "c4166ed8-6aef-4c6c-ae84-25b98ba847f5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: exception: This rule already exists in group c4166ed8-6aef-4c6c-ae84-25b98ba847f5 Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c4166ed8-6aef-4c6c-ae84-25b98ba847f5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group c4166ed8-6aef-4c6c-ae84-25b98ba847f5 Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group c4166ed8-6aef-4c6c-ae84-25b98ba847f5 Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:43.466188 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:43.471080 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:43.471080 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:43.471080 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group c4166ed8-6aef-4c6c-ae84-25b98ba847f5 Aug 03 01:51:43.471080 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:43.471080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fcab0359-85b2-4180-9502-47eb0f671000 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Returning 400 to user: This rule already exists in group c4166ed8-6aef-4c6c-ae84-25b98ba847f5 {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:43.471080 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fcab0359-85b2-4180-9502-47eb0f671000 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.143677 Aug 03 01:51:43.472160 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 548/1129] 10.222.0.67 () {60 vars in 1195 bytes} [Wed Aug 3 01:51:43 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:51:43.481352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-81f03795-fd68-4b2e-b449-994e69035186 req-8e1ea3be-3adf-4250-984f-cab20740f925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2ce9d3-8e0c-4981-951e-3d23d58de2c2", "name": "network-vif-plugged", "status": "completed", "tag": "aee6f3d7-e3c0-4569-9c1b-2cfe18a9f997"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:43.510412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-81f03795-fd68-4b2e-b449-994e69035186 req-8e1ea3be-3adf-4250-984f-cab20740f925 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:43.511762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-81f03795-fd68-4b2e-b449-994e69035186 req-8e1ea3be-3adf-4250-984f-cab20740f925 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:43.534046 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-81f03795-fd68-4b2e-b449-994e69035186 req-8e1ea3be-3adf-4250-984f-cab20740f925 service nova] Creating event network-vif-plugged:aee6f3d7-e3c0-4569-9c1b-2cfe18a9f997 for instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 on n-h1-826529-8 Aug 03 01:51:43.548299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-81f03795-fd68-4b2e-b449-994e69035186 req-8e1ea3be-3adf-4250-984f-cab20740f925 service nova] Instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 01:51:43.563187 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-81f03795-fd68-4b2e-b449-994e69035186 req-8e1ea3be-3adf-4250-984f-cab20740f925 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089655 Aug 03 01:51:43.563802 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 549/1130] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:43.576280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5b0fc897-ab78-4266-8a4a-c7c048c87f35 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:43.577003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5b0fc897-ab78-4266-8a4a-c7c048c87f35 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:43.595580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b0fc897-ab78-4266-8a4a-c7c048c87f35 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:43.596043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b0fc897-ab78-4266-8a4a-c7c048c87f35 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:43.596849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b0fc897-ab78-4266-8a4a-c7c048c87f35 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:43.597295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b0fc897-ab78-4266-8a4a-c7c048c87f35 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:43.672073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c70c15ec-d8b7-4100-a36b-82b30dd77d48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:43.681607 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c70c15ec-d8b7-4100-a36b-82b30dd77d48 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1469 microversion: 2.1 time: 1.042089 Aug 03 01:51:43.682209 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 582/1131] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:42 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1469 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:43.697961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9704346f-7602-4e45-bdb5-6f5c3d14cc0f tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Calling method '.version_select at 0x7f5b1323d9d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:44.181287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5b0fc897-ab78-4266-8a4a-c7c048c87f35 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:44.191661 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5b0fc897-ab78-4266-8a4a-c7c048c87f35 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 200 len: 1315 microversion: 2.1 time: 0.624730 Aug 03 01:51:44.192469 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 550/1132] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:43 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:44.199186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b45b1462-d31b-4c13-b5ba-ecd91bd26da7 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:44.200532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b45b1462-d31b-4c13-b5ba-ecd91bd26da7 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:44.209222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b45b1462-d31b-4c13-b5ba-ecd91bd26da7 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:44.210087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b45b1462-d31b-4c13-b5ba-ecd91bd26da7 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:44.211953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b45b1462-d31b-4c13-b5ba-ecd91bd26da7 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:44.212604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b45b1462-d31b-4c13-b5ba-ecd91bd26da7 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:44.755375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b45b1462-d31b-4c13-b5ba-ecd91bd26da7 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee3c23fe964688bdb2ee2280ad0a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67bb34c427144dcca5d1d145d1a85c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:44.768531 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b45b1462-d31b-4c13-b5ba-ecd91bd26da7 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 200 len: 1270 microversion: 2.1 time: 0.574532 Aug 03 01:51:44.769418 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 551/1133] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:44 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 1270 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:44.774401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-372eb600-9a3a-4b91-a129-425e83eb9a04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:44.775169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-372eb600-9a3a-4b91-a129-425e83eb9a04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:44.783803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-372eb600-9a3a-4b91-a129-425e83eb9a04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:44.784256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-372eb600-9a3a-4b91-a129-425e83eb9a04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:44.785044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-372eb600-9a3a-4b91-a129-425e83eb9a04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:44.785483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-372eb600-9a3a-4b91-a129-425e83eb9a04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:44.973448 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9704346f-7602-4e45-bdb5-6f5c3d14cc0f tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-group-rules/ec5c4867-6424-4aa6-9869-11bd465af380" status: 202 len: 0 microversion: 2.1 time: 1.289575 Aug 03 01:51:44.974313 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 583/1134] 10.222.0.67 () {58 vars in 1287 bytes} [Wed Aug 3 01:51:43 2022] DELETE /compute/v2.1/os-security-group-rules/ec5c4867-6424-4aa6-9869-11bd465af380 => generated 0 bytes in 1291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:44.978722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2d7167b9-1ffe-4422-a652-ff74e465bd50 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:44.979374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2d7167b9-1ffe-4422-a652-ff74e465bd50 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:44.993487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d7167b9-1ffe-4422-a652-ff74e465bd50 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:44.993956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d7167b9-1ffe-4422-a652-ff74e465bd50 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:44.994754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d7167b9-1ffe-4422-a652-ff74e465bd50 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:44.995427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d7167b9-1ffe-4422-a652-ff74e465bd50 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:45.005359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:45.200478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-372eb600-9a3a-4b91-a129-425e83eb9a04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:45.220237 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-372eb600-9a3a-4b91-a129-425e83eb9a04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1360 microversion: 2.1 time: 0.449314 Aug 03 01:51:45.221892 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 552/1135] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:44 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1360 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:45.228808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5f9ea56b-b924-42c0-aea8-33637bc4f2eb tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:45.230376 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:51:45.230376 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:51:45.251646 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5f9ea56b-b924-42c0-aea8-33637bc4f2eb tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1056396905" status: 202 len: 0 microversion: 2.1 time: 0.027791 Aug 03 01:51:45.253542 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 553/1136] 10.222.0.67 () {58 vars in 1161 bytes} [Wed Aug 3 01:51:45 2022] DELETE /compute/v2.1/flavors/1056396905 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:45.272614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bdfd05b5-1cfe-4d70-a088-f0ff05be1136 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Action: 'create', calling method: .version_select at 0x7f5b13323940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-632374588", "description": "tempest-description-263824958"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:45.471293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2d7167b9-1ffe-4422-a652-ff74e465bd50 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:45.491340 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2d7167b9-1ffe-4422-a652-ff74e465bd50 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1469 microversion: 2.1 time: 0.515832 Aug 03 01:51:45.492356 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 584/1137] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:44 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1469 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:45.498646 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cf432930-26bc-4e4d-954f-6fb3501d7e40 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:45.499631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cf432930-26bc-4e4d-954f-6fb3501d7e40 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:45.506878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf432930-26bc-4e4d-954f-6fb3501d7e40 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:45.507816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf432930-26bc-4e4d-954f-6fb3501d7e40 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:45.509669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf432930-26bc-4e4d-954f-6fb3501d7e40 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:45.510873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf432930-26bc-4e4d-954f-6fb3501d7e40 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:45.853442 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bdfd05b5-1cfe-4d70-a088-f0ff05be1136 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.598384 Aug 03 01:51:45.854295 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 554/1138] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:51:45 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:45.859609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-68a9e685-bbb8-43b4-8f2e-485c5de8a341 tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:45.900630 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-68a9e685-bbb8-43b4-8f2e-485c5de8a341 tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.044218 Aug 03 01:51:45.906895 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 555/1139] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:51:45 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:45.919640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9fd622fe-590b-4c9d-9ddc-5e97b9988cb5 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:45.921376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9fd622fe-590b-4c9d-9ddc-5e97b9988cb5 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:45.940289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fd622fe-590b-4c9d-9ddc-5e97b9988cb5 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:45.940830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fd622fe-590b-4c9d-9ddc-5e97b9988cb5 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:45.945379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fd622fe-590b-4c9d-9ddc-5e97b9988cb5 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:45.946163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fd622fe-590b-4c9d-9ddc-5e97b9988cb5 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:46.026141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cf432930-26bc-4e4d-954f-6fb3501d7e40 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:46.036110 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cf432930-26bc-4e4d-954f-6fb3501d7e40 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 200 len: 1315 microversion: 2.1 time: 0.542330 Aug 03 01:51:46.040283 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 585/1140] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:45 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:46.045691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dbc90cc7-7ce5-4729-9b65-4d8d363c97c2 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Action: 'create', calling method: .version_select at 0x7f5b1323db80>, body: {"security_group_rule": {"parent_group_id": "653db827-93ec-4a8a-9b71-cfc435caaff9", "ip_protocol": "tcp", "from_port": 1530165006, "to_port": 22}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:46.282676 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-dbc90cc7-7ce5-4729-9b65-4d8d363c97c2 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] HTTP exception thrown: Invalid port range 1530165006:22. Former value cannot be greater than the later Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dbc90cc7-7ce5-4729-9b65-4d8d363c97c2 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Request method failure captured: Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 146 Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dSr481l4NnWGnchwmEcMcifinqsQT2eI0TI37TekBG2wpfNr2sawzIWfe8bSkwLqMVFyfalA9wzjEZ_QtnUhdEbTBAALX4LX9o80iduI6fh7RaLz-nCV0XUOcyANbBgF7nzUdPBTEIX3hIqbzsOzm4T8exM4E60MaRawZIDRGK2VYY Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a6c931d0167a4426bf97affb9cd0ec1e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}] Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: be8003bebd41425dbdfe6c7cb47307fb Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: {"security_group_rule": {"parent_group_id": "653db827-93ec-4a8a-9b71-cfc435caaff9", "ip_protocol": "tcp", "from_port": 1530165006, "to_port": 22}} Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid port range 1530165006:22. Former value cannot be greater than the later Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'security_group_rule': {'parent_group_id': '653db827-93ec-4a8a-9b71-cfc435caaff9', 'ip_protocol': 'tcp', 'from_port': 1530165006, 'to_port': 22}}} Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1530165006:22. Former value cannot be greater than the later Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1530165006:22. Former value cannot be greater than the later Aug 03 01:51:46.286266 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:46.291779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:46.291779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:46.291779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:46.291779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:46.291779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:46.291779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:46.291779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:46.291779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1530165006:22. Former value cannot be greater than the later Aug 03 01:51:46.291779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:46.297651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dbc90cc7-7ce5-4729-9b65-4d8d363c97c2 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Returning 400 to user: Invalid port range 1530165006:22. Former value cannot be greater than the later {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:46.312413 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dbc90cc7-7ce5-4729-9b65-4d8d363c97c2 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.270961 Aug 03 01:51:46.313034 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 586/1141] 10.222.0.67 () {60 vars in 1195 bytes} [Wed Aug 3 01:51:46 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 272 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:51:46.320858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-04d08df9-c292-4860-b62f-bd88a3dac048 tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:46.322524 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:51:46.322524 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:51:46.350154 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-04d08df9-c292-4860-b62f-bd88a3dac048 tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/1364948124" status: 202 len: 0 microversion: 2.1 time: 0.033250 Aug 03 01:51:46.351669 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 587/1142] 10.222.0.67 () {58 vars in 1161 bytes} [Wed Aug 3 01:51:46 2022] DELETE /compute/v2.1/flavors/1364948124 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:46.359849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eed9da0d-406a-4206-8a7b-09326dc44409 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:46.361306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eed9da0d-406a-4206-8a7b-09326dc44409 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:46.373069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed9da0d-406a-4206-8a7b-09326dc44409 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:46.373874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed9da0d-406a-4206-8a7b-09326dc44409 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:46.375274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed9da0d-406a-4206-8a7b-09326dc44409 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:46.377586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed9da0d-406a-4206-8a7b-09326dc44409 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:46.391675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9fd622fe-590b-4c9d-9ddc-5e97b9988cb5 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee3c23fe964688bdb2ee2280ad0a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67bb34c427144dcca5d1d145d1a85c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:46.401085 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9fd622fe-590b-4c9d-9ddc-5e97b9988cb5 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 200 len: 1312 microversion: 2.1 time: 0.492785 Aug 03 01:51:46.416557 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 556/1143] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:45 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 1312 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:46.429816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-560f4169-90c4-43f4-b7ba-133e613ec987 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Action: 'create', calling method: .version_select at 0x7f5b132e10d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-321933601", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:46.433572 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-560f4169-90c4-43f4-b7ba-133e613ec987 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] HTTP exception thrown: Security group id should be uuid Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-560f4169-90c4-43f4-b7ba-133e613ec987 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Request method failure captured: Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 130 Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dSr481l4NnWGnchwmEcMcifinqsQT2eI0TI37TekBG2wpfNr2sawzIWfe8bSkwLqMVFyfalA9wzjEZ_QtnUhdEbTBAALX4LX9o80iduI6fh7RaLz-nCV0XUOcyANbBgF7nzUdPBTEIX3hIqbzsOzm4T8exM4E60MaRawZIDRGK2VYY Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a6c931d0167a4426bf97affb9cd0ec1e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}] Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: be8003bebd41425dbdfe6c7cb47307fb Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-321933601", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: exception: Security group id should be uuid Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-321933601', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:46.435910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:46.440555 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 03 01:51:46.440555 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:46.443431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-560f4169-90c4-43f4-b7ba-133e613ec987 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Returning 400 to user: Security group id should be uuid {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:46.444568 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-560f4169-90c4-43f4-b7ba-133e613ec987 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.025959 Aug 03 01:51:46.446297 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 557/1144] 10.222.0.67 () {60 vars in 1195 bytes} [Wed Aug 3 01:51:46 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 01:51:46.453316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cf71909f-e1c9-49f7-91f9-3606b7b89f15 tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:46.500887 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cf71909f-e1c9-49f7-91f9-3606b7b89f15 tempest-ServersWithSpecificFlavorTestJSON-371692649 tempest-ServersWithSpecificFlavorTestJSON-371692649-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052182 Aug 03 01:51:46.512792 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 558/1145] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:51:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:46.529552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-eb288f70-9d05-4150-8055-88a8e05de2ed req-160b9905-bbd9-45e5-9720-928db2a0d531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be0bf271-225a-4ad9-baf8-c7dad07593c7", "tag": "099d436b-29db-46ff-b84a-deb5403a674f"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:46.546606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-eb288f70-9d05-4150-8055-88a8e05de2ed req-160b9905-bbd9-45e5-9720-928db2a0d531 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:46.548359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-eb288f70-9d05-4150-8055-88a8e05de2ed req-160b9905-bbd9-45e5-9720-928db2a0d531 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:46.563398 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-eb288f70-9d05-4150-8055-88a8e05de2ed req-160b9905-bbd9-45e5-9720-928db2a0d531 service nova] Creating event network-changed:099d436b-29db-46ff-b84a-deb5403a674f for instance be0bf271-225a-4ad9-baf8-c7dad07593c7 on n-h1-826529-8 Aug 03 01:51:46.570380 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-eb288f70-9d05-4150-8055-88a8e05de2ed req-160b9905-bbd9-45e5-9720-928db2a0d531 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047487 Aug 03 01:51:46.573140 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 559/1146] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:46.579624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6e2e8b99-cab3-43ce-a051-3574711e839a tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Action: 'create', calling method: .version_select at 0x7f5b132d1f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1672361637", "description": "tempest-description-1827752246"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:46.808590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-eed9da0d-406a-4206-8a7b-09326dc44409 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:46.820669 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eed9da0d-406a-4206-8a7b-09326dc44409 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1360 microversion: 2.1 time: 0.465400 Aug 03 01:51:46.826622 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 588/1147] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:46 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1360 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:46.832028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4b3b391b-9d29-4014-bbb4-91f86eec9be0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:46.838014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4b3b391b-9d29-4014-bbb4-91f86eec9be0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:46.850529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b3b391b-9d29-4014-bbb4-91f86eec9be0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:46.856471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b3b391b-9d29-4014-bbb4-91f86eec9be0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:46.857788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b3b391b-9d29-4014-bbb4-91f86eec9be0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:46.858475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b3b391b-9d29-4014-bbb4-91f86eec9be0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:47.119309 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6e2e8b99-cab3-43ce-a051-3574711e839a tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.544104 Aug 03 01:51:47.120830 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 560/1148] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:51:46 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:47.125647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fe77c957-5a71-4391-af6b-365fe5d87f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:47.126449 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fe77c957-5a71-4391-af6b-365fe5d87f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:47.146793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe77c957-5a71-4391-af6b-365fe5d87f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:47.147334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe77c957-5a71-4391-af6b-365fe5d87f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:47.148172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe77c957-5a71-4391-af6b-365fe5d87f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:47.148851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe77c957-5a71-4391-af6b-365fe5d87f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:47.180048 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-fe77c957-5a71-4391-af6b-365fe5d87f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] HTTP exception thrown: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fe77c957-5a71-4391-af6b-365fe5d87f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Request method failure captured: Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 HTTP/1.1 Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dP2qUBeVmqmR1c1GAKEjhPVGRtegIxHQ21HS9VqGWNozAqHbaqk56TPuhxahFJvRNcJeuAafbf0dSwUQItmXS3RGZdsNx3F3_6tvqMDIVI5qOy6hOtEkHTUma0Uqhm0Vi-aT2KwEI82okUPw7_yT9kKOEFioo_1wIwgnvgu9ADZxvs Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 631d6080e5d14fb3906ecf8c339478d7 Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_631d6080e5d14fb3906ecf8c339478d7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/631d6080e5d14fb3906ecf8c339478d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/631d6080e5d14fb3906ecf8c339478d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/631d6080e5d14fb3906ecf8c339478d7"}]}] Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 631d6080e5d14fb3906ecf8c339478d7 Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersWithSpecificFlavorTestJSON-630379633-project Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 141f8784088448cdafee6cee8955dc71 Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633-project Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '297a1ee8-52ab-4794-9923-1c4603d93775'} Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:51:47.182353 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:51:47.187233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. Aug 03 01:51:47.187233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:47.187233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:47.187233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:47.187233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:47.187233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:47.187233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:47.187233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:47.187233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:47.187233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. Aug 03 01:51:47.187233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:47.190082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fe77c957-5a71-4391-af6b-365fe5d87f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Returning 404 to user: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:47.191529 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fe77c957-5a71-4391-af6b-365fe5d87f92 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "DELETE /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 404 len: 111 microversion: 2.1 time: 0.069547 Aug 03 01:51:47.192863 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 561/1149] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:51:47 2022] DELETE /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:51:47.199612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-91a4238e-1de4-490a-9471-0f8e9f89444a req-d374e0ad-175d-4d04-ad37-45019cfa85f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b31b62-ac13-47d2-af5f-fb68852ca81b", "name": "network-vif-plugged", "status": "completed", "tag": "c05623b0-a20e-4d6a-b404-b4d7edd6104a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:47.213320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-91a4238e-1de4-490a-9471-0f8e9f89444a req-d374e0ad-175d-4d04-ad37-45019cfa85f9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:47.214719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-91a4238e-1de4-490a-9471-0f8e9f89444a req-d374e0ad-175d-4d04-ad37-45019cfa85f9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:47.235183 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-91a4238e-1de4-490a-9471-0f8e9f89444a req-d374e0ad-175d-4d04-ad37-45019cfa85f9 service nova] Creating event network-vif-plugged:c05623b0-a20e-4d6a-b404-b4d7edd6104a for instance 01b31b62-ac13-47d2-af5f-fb68852ca81b on n-h2-826529-8 Aug 03 01:51:47.244006 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-91a4238e-1de4-490a-9471-0f8e9f89444a req-d374e0ad-175d-4d04-ad37-45019cfa85f9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047487 Aug 03 01:51:47.244855 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 562/1150] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:47.257722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4b3b391b-9d29-4014-bbb4-91f86eec9be0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:47.271858 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4b3b391b-9d29-4014-bbb4-91f86eec9be0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1469 microversion: 2.1 time: 0.443572 Aug 03 01:51:47.272588 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 589/1151] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:46 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1469 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:47.275234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-02fce376-b8f1-4968-8118-9d0fcdb2e653 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:47.276201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-02fce376-b8f1-4968-8118-9d0fcdb2e653 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:47.278034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7041f94e-0c02-439d-b570-e493e1e33344 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Action: 'create', calling method: .version_select at 0x7f5b135b3310>, body: {"security_group_rule": {"parent_group_id": "71191f4f-6be7-4490-961a-5345a375dafe", "ip_protocol": "tempest-999-1268112401", "from_port": 22, "to_port": 22}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:47.303295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02fce376-b8f1-4968-8118-9d0fcdb2e653 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:47.303760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02fce376-b8f1-4968-8118-9d0fcdb2e653 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:47.304709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02fce376-b8f1-4968-8118-9d0fcdb2e653 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:47.305158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02fce376-b8f1-4968-8118-9d0fcdb2e653 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:47.517665 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-7041f94e-0c02-439d-b570-e493e1e33344 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] HTTP exception thrown: Invalid IP protocol tempest-999-1268112401. Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7041f94e-0c02-439d-b570-e493e1e33344 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Request method failure captured: Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 157 Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dSr481l4NnWGnchwmEcMcifinqsQT2eI0TI37TekBG2wpfNr2sawzIWfe8bSkwLqMVFyfalA9wzjEZ_QtnUhdEbTBAALX4LX9o80iduI6fh7RaLz-nCV0XUOcyANbBgF7nzUdPBTEIX3hIqbzsOzm4T8exM4E60MaRawZIDRGK2VYY Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a6c931d0167a4426bf97affb9cd0ec1e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}] Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: be8003bebd41425dbdfe6c7cb47307fb Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: {"security_group_rule": {"parent_group_id": "71191f4f-6be7-4490-961a-5345a375dafe", "ip_protocol": "tempest-999-1268112401", "from_port": 22, "to_port": 22}} Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid IP protocol tempest-999-1268112401. Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'security_group_rule': {'parent_group_id': '71191f4f-6be7-4490-961a-5345a375dafe', 'ip_protocol': 'tempest-999-1268112401', 'from_port': 22, 'to_port': 22}}} Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1268112401. Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1268112401. Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:47.519549 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:47.524223 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:47.524223 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:47.524223 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:47.524223 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:47.524223 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:47.524223 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:47.524223 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1268112401. Aug 03 01:51:47.524223 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:47.524223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7041f94e-0c02-439d-b570-e493e1e33344 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Returning 400 to user: Invalid IP protocol tempest-999-1268112401. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:47.524223 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7041f94e-0c02-439d-b570-e493e1e33344 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.247427 Aug 03 01:51:47.528946 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 590/1152] 10.222.0.67 () {60 vars in 1195 bytes} [Wed Aug 3 01:51:47 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 256 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 01:51:47.533797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ffbeaa6d-08c8-4046-8541-bbf00b376909 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:47.534421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ffbeaa6d-08c8-4046-8541-bbf00b376909 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: 297a1ee8-52ab-4794-9923-1c4603d93775] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:47.555597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ffbeaa6d-08c8-4046-8541-bbf00b376909 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:47.556320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ffbeaa6d-08c8-4046-8541-bbf00b376909 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:47.557347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ffbeaa6d-08c8-4046-8541-bbf00b376909 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:47.558644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ffbeaa6d-08c8-4046-8541-bbf00b376909 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:47.585429 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-ffbeaa6d-08c8-4046-8541-bbf00b376909 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] HTTP exception thrown: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ffbeaa6d-08c8-4046-8541-bbf00b376909 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Request method failure captured: Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 HTTP/1.1 Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dP2qUBeVmqmR1c1GAKEjhPVGRtegIxHQ21HS9VqGWNozAqHbaqk56TPuhxahFJvRNcJeuAafbf0dSwUQItmXS3RGZdsNx3F3_6tvqMDIVI5qOy6hOtEkHTUma0Uqhm0Vi-aT2KwEI82okUPw7_yT9kKOEFioo_1wIwgnvgu9ADZxvs Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 631d6080e5d14fb3906ecf8c339478d7 Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_631d6080e5d14fb3906ecf8c339478d7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/631d6080e5d14fb3906ecf8c339478d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/631d6080e5d14fb3906ecf8c339478d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/631d6080e5d14fb3906ecf8c339478d7"}]}] Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 631d6080e5d14fb3906ecf8c339478d7 Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersWithSpecificFlavorTestJSON-630379633-project Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 141f8784088448cdafee6cee8955dc71 Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633-project Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '297a1ee8-52ab-4794-9923-1c4603d93775'} Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:47.587400 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:47.593497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:47.593497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:47.593497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:47.593497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:47.593497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:47.593497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:47.593497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. Aug 03 01:51:47.593497 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:47.593497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ffbeaa6d-08c8-4046-8541-bbf00b376909 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Returning 404 to user: Instance 297a1ee8-52ab-4794-9923-1c4603d93775 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:47.593497 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ffbeaa6d-08c8-4046-8541-bbf00b376909 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775" status: 404 len: 111 microversion: 2.1 time: 0.058916 Aug 03 01:51:47.593497 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 591/1153] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:47 2022] GET /compute/v2.1/servers/297a1ee8-52ab-4794-9923-1c4603d93775 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:51:47.597832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7bf40d55-7d72-420b-80c3-333b38a041cd tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:47.598450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7bf40d55-7d72-420b-80c3-333b38a041cd tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:47.604751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bf40d55-7d72-420b-80c3-333b38a041cd tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:47.605270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bf40d55-7d72-420b-80c3-333b38a041cd tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:47.606250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bf40d55-7d72-420b-80c3-333b38a041cd tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:47.606992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bf40d55-7d72-420b-80c3-333b38a041cd tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:47.792756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-02fce376-b8f1-4968-8118-9d0fcdb2e653 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:47.805518 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-02fce376-b8f1-4968-8118-9d0fcdb2e653 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 200 len: 1315 microversion: 2.1 time: 0.549766 Aug 03 01:51:47.820587 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 563/1154] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:47 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:47.831012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-255b476c-ca48-4ae1-bd6f-c57d17072ed7 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Action: 'create', calling method: .version_select at 0x7f5b132fbdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-142172175", "description": "tempest-description-2126324771"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:48.054875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7bf40d55-7d72-420b-80c3-333b38a041cd tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee3c23fe964688bdb2ee2280ad0a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67bb34c427144dcca5d1d145d1a85c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:48.069560 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7bf40d55-7d72-420b-80c3-333b38a041cd tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 200 len: 1312 microversion: 2.1 time: 0.475253 Aug 03 01:51:48.086517 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 592/1155] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:47 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 1312 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:48.093256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bac0c714-45a5-4725-8242-b9e79967622e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:48.095041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bac0c714-45a5-4725-8242-b9e79967622e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:48.101293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bac0c714-45a5-4725-8242-b9e79967622e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:48.101979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bac0c714-45a5-4725-8242-b9e79967622e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:48.102841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bac0c714-45a5-4725-8242-b9e79967622e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:48.103523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bac0c714-45a5-4725-8242-b9e79967622e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-bac0c714-45a5-4725-8242-b9e79967622e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] HTTP exception thrown: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bac0c714-45a5-4725-8242-b9e79967622e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Request method failure captured: Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 HTTP/1.1 Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dP2qUBeVmqmR1c1GAKEjhPVGRtegIxHQ21HS9VqGWNozAqHbaqk56TPuhxahFJvRNcJeuAafbf0dSwUQItmXS3RGZdsNx3F3_6tvqMDIVI5qOy6hOtEkHTUma0Uqhm0Vi-aT2KwEI82okUPw7_yT9kKOEFioo_1wIwgnvgu9ADZxvs Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 631d6080e5d14fb3906ecf8c339478d7 Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_631d6080e5d14fb3906ecf8c339478d7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/631d6080e5d14fb3906ecf8c339478d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/631d6080e5d14fb3906ecf8c339478d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/631d6080e5d14fb3906ecf8c339478d7"}]}] Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 631d6080e5d14fb3906ecf8c339478d7 Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersWithSpecificFlavorTestJSON-630379633-project Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 141f8784088448cdafee6cee8955dc71 Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633-project Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'c171ccf7-988b-441b-acb8-7332e481ec09'} Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 01:51:48.135398 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bac0c714-45a5-4725-8242-b9e79967622e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Returning 404 to user: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bac0c714-45a5-4725-8242-b9e79967622e tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 404 len: 111 microversion: 2.1 time: 0.047537 Aug 03 01:51:48.148004 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 593/1156] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:51:48 2022] DELETE /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:51:48.163450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-72f9caef-5c01-40f3-88ba-f7ca75ecfe94 req-75af2464-6954-46d1-bb0b-cfd3d70ee707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d94f59-5658-4a4b-81d4-92bf506424c5", "tag": "7d5bec19-f1ac-4023-a120-3f706b1116dc"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:48.163685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-72f9caef-5c01-40f3-88ba-f7ca75ecfe94 req-75af2464-6954-46d1-bb0b-cfd3d70ee707 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:48.164238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-72f9caef-5c01-40f3-88ba-f7ca75ecfe94 req-75af2464-6954-46d1-bb0b-cfd3d70ee707 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:48.180208 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-72f9caef-5c01-40f3-88ba-f7ca75ecfe94 req-75af2464-6954-46d1-bb0b-cfd3d70ee707 service nova] Creating event network-changed:7d5bec19-f1ac-4023-a120-3f706b1116dc for instance 04d94f59-5658-4a4b-81d4-92bf506424c5 on n-h2-826529-8 Aug 03 01:51:48.187809 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-72f9caef-5c01-40f3-88ba-f7ca75ecfe94 req-75af2464-6954-46d1-bb0b-cfd3d70ee707 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042270 Aug 03 01:51:48.189055 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 594/1157] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:48.196557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5d344f73-2cf2-4043-a24d-3a4acf4c024b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:48.197359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5d344f73-2cf2-4043-a24d-3a4acf4c024b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:48.216970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d344f73-2cf2-4043-a24d-3a4acf4c024b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:48.217804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d344f73-2cf2-4043-a24d-3a4acf4c024b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:48.218564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d344f73-2cf2-4043-a24d-3a4acf4c024b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:48.219100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d344f73-2cf2-4043-a24d-3a4acf4c024b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:48.256152 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-255b476c-ca48-4ae1-bd6f-c57d17072ed7 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.433639 Aug 03 01:51:48.256757 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 564/1158] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:51:47 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:48.267155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aa512d98-ef46-4ca5-849a-6484391d14e6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:48.267778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-aa512d98-ef46-4ca5-849a-6484391d14e6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] [instance: c171ccf7-988b-441b-acb8-7332e481ec09] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:48.274502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa512d98-ef46-4ca5-849a-6484391d14e6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:48.275296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa512d98-ef46-4ca5-849a-6484391d14e6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:48.277475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa512d98-ef46-4ca5-849a-6484391d14e6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:48.278105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa512d98-ef46-4ca5-849a-6484391d14e6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:48.302704 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-aa512d98-ef46-4ca5-849a-6484391d14e6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] HTTP exception thrown: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aa512d98-ef46-4ca5-849a-6484391d14e6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Request method failure captured: Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 HTTP/1.1 Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dP2qUBeVmqmR1c1GAKEjhPVGRtegIxHQ21HS9VqGWNozAqHbaqk56TPuhxahFJvRNcJeuAafbf0dSwUQItmXS3RGZdsNx3F3_6tvqMDIVI5qOy6hOtEkHTUma0Uqhm0Vi-aT2KwEI82okUPw7_yT9kKOEFioo_1wIwgnvgu9ADZxvs Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 631d6080e5d14fb3906ecf8c339478d7 Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_631d6080e5d14fb3906ecf8c339478d7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/631d6080e5d14fb3906ecf8c339478d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/631d6080e5d14fb3906ecf8c339478d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/631d6080e5d14fb3906ecf8c339478d7"}]}] Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 631d6080e5d14fb3906ecf8c339478d7 Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633 Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersWithSpecificFlavorTestJSON-630379633-project Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 141f8784088448cdafee6cee8955dc71 Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-630379633-project Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'c171ccf7-988b-441b-acb8-7332e481ec09'} Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:48.310181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:48.314339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:48.314339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:48.314339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:48.314339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:48.314339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:48.314339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:48.314339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. Aug 03 01:51:48.314339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:48.318048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aa512d98-ef46-4ca5-849a-6484391d14e6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] Returning 404 to user: Instance c171ccf7-988b-441b-acb8-7332e481ec09 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:48.319171 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aa512d98-ef46-4ca5-849a-6484391d14e6 tempest-ServersWithSpecificFlavorTestJSON-630379633 tempest-ServersWithSpecificFlavorTestJSON-630379633-project] 10.222.0.67 "GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09" status: 404 len: 111 microversion: 2.1 time: 0.061387 Aug 03 01:51:48.323006 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 565/1159] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:48 2022] GET /compute/v2.1/servers/c171ccf7-988b-441b-acb8-7332e481ec09 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:51:48.326724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8726eda8-2c60-4b39-a12f-c56d7873b483 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Action: 'create', calling method: .version_select at 0x7f5b132c4820>, body: {"security_group_rule": {"parent_group_id": "247cfd47-f67d-466a-a22a-b94a0cc73d0f", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:48.413727 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-8726eda8-2c60-4b39-a12f-c56d7873b483 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8726eda8-2c60-4b39-a12f-c56d7873b483 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Request method failure captured: Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 138 Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dSr481l4NnWGnchwmEcMcifinqsQT2eI0TI37TekBG2wpfNr2sawzIWfe8bSkwLqMVFyfalA9wzjEZ_QtnUhdEbTBAALX4LX9o80iduI6fh7RaLz-nCV0XUOcyANbBgF7nzUdPBTEIX3hIqbzsOzm4T8exM4E60MaRawZIDRGK2VYY Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a6c931d0167a4426bf97affb9cd0ec1e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}] Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: be8003bebd41425dbdfe6c7cb47307fb Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: {"security_group_rule": {"parent_group_id": "247cfd47-f67d-466a-a22a-b94a0cc73d0f", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'security_group_rule': {'parent_group_id': '247cfd47-f67d-466a-a22a-b94a0cc73d0f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 03 01:51:48.418945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:48.423520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:48.423520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:48.423520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:48.423520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:48.423520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:48.423520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:48.423520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:48.423520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 03 01:51:48.423520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:48.425102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8726eda8-2c60-4b39-a12f-c56d7873b483 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:48.426311 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8726eda8-2c60-4b39-a12f-c56d7873b483 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.105297 Aug 03 01:51:48.427071 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 566/1160] 10.222.0.67 () {60 vars in 1195 bytes} [Wed Aug 3 01:51:48 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:51:48.436008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-40aeb473-3f04-48ee-a024-809e9fe9836c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:48.437597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-40aeb473-3f04-48ee-a024-809e9fe9836c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:48.454732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40aeb473-3f04-48ee-a024-809e9fe9836c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:48.455232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40aeb473-3f04-48ee-a024-809e9fe9836c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:48.456033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40aeb473-3f04-48ee-a024-809e9fe9836c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:48.456481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40aeb473-3f04-48ee-a024-809e9fe9836c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:48.460178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:48.490186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5d344f73-2cf2-4043-a24d-3a4acf4c024b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:48.501986 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5d344f73-2cf2-4043-a24d-3a4acf4c024b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1360 microversion: 2.1 time: 0.311495 Aug 03 01:51:48.502879 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 595/1161] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:48 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1360 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:48.522776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1683473943", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "db14d09c-b745-4579-af9f-767661c49472"}], "security_groups": [{"name": "tempest-securitygroup--689011375"}], "key_name": "tempest-keypair-1478450462", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:48.704885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] validate_networks() for [('db14d09c-b745-4579-af9f-767661c49472', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:51:48.712269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-40aeb473-3f04-48ee-a024-809e9fe9836c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:48.732509 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-40aeb473-3f04-48ee-a024-809e9fe9836c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1535 microversion: 2.1 time: 0.303987 Aug 03 01:51:48.759257 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 567/1162] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:48 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1535 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:48.770889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b28aaf4c-8733-41b0-8a9a-716b43191805 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Action: 'create', calling method: .version_select at 0x7f5b132c4ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-559188252", "description": "tempest-description-249856431"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:49.170405 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b28aaf4c-8733-41b0-8a9a-716b43191805 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.409973 Aug 03 01:51:49.171043 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 568/1163] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:51:48 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:49.187202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a178059d-12ab-4923-b518-e3607a8a4fba tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:49.188838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a178059d-12ab-4923-b518-e3607a8a4fba tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:49.204609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a178059d-12ab-4923-b518-e3607a8a4fba tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:49.205949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a178059d-12ab-4923-b518-e3607a8a4fba tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:49.207394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a178059d-12ab-4923-b518-e3607a8a4fba tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:49.208780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a178059d-12ab-4923-b518-e3607a8a4fba tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:49.853297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a178059d-12ab-4923-b518-e3607a8a4fba tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:49.863487 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a178059d-12ab-4923-b518-e3607a8a4fba tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 200 len: 1503 microversion: 2.1 time: 0.687107 Aug 03 01:51:49.864016 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 569/1164] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:49 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 1503 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:49.868602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:51:49.869160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:51:49.869838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:51:49.870170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c8fd5131-b61e-4e60-a5ef-38c90c1f84b4 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:49.870991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:51:49.871309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:51:49.871970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c8fd5131-b61e-4e60-a5ef-38c90c1f84b4 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:49.878928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8fd5131-b61e-4e60-a5ef-38c90c1f84b4 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:49.879933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8fd5131-b61e-4e60-a5ef-38c90c1f84b4 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:49.880731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8fd5131-b61e-4e60-a5ef-38c90c1f84b4 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:49.881174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8fd5131-b61e-4e60-a5ef-38c90c1f84b4 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:49.882295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:49.882855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:49.883979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:49.884525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:49.908464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Getting quotas for project 162addf8f6634e7fa0a1f9c6004258d1. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:49.912977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Getting quotas for user 4cb821820bbb4d3a8c999e1dec6a06a4 and project 162addf8f6634e7fa0a1f9c6004258d1. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:49.925309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:51:49.928044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:51:49.992648 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c7661377-dc39-44c1-bd0f-8404ba54198a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.476886 Aug 03 01:51:49.993623 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 596/1165] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 01:51:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 01:51:50.004375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-803847dd-6d7d-46c0-a346-79014b648c13 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Action: 'create', calling method: .version_select at 0x7f5b131e5790>, body: {"security_group_rule": {"parent_group_id": "05b53c0f-3a16-4741-93d7-f1f61a6c0814", "ip_protocol": "tcp", "from_port": 22, "to_port": 1418753490}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:50.105679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c8fd5131-b61e-4e60-a5ef-38c90c1f84b4 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee3c23fe964688bdb2ee2280ad0a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67bb34c427144dcca5d1d145d1a85c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:50.108022 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-803847dd-6d7d-46c0-a346-79014b648c13 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] HTTP exception thrown: Invalid port range 22:1418753490. Valid TCP ports should be between 1-65535 Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-803847dd-6d7d-46c0-a346-79014b648c13 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Request method failure captured: Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 146 Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dSr481l4NnWGnchwmEcMcifinqsQT2eI0TI37TekBG2wpfNr2sawzIWfe8bSkwLqMVFyfalA9wzjEZ_QtnUhdEbTBAALX4LX9o80iduI6fh7RaLz-nCV0XUOcyANbBgF7nzUdPBTEIX3hIqbzsOzm4T8exM4E60MaRawZIDRGK2VYY Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a6c931d0167a4426bf97affb9cd0ec1e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}] Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: be8003bebd41425dbdfe6c7cb47307fb Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: {"security_group_rule": {"parent_group_id": "05b53c0f-3a16-4741-93d7-f1f61a6c0814", "ip_protocol": "tcp", "from_port": 22, "to_port": 1418753490}} Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid port range 22:1418753490. Valid TCP ports should be between 1-65535 Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'security_group_rule': {'parent_group_id': '05b53c0f-3a16-4741-93d7-f1f61a6c0814', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1418753490}}} Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1418753490. Valid TCP ports should be between 1-65535 Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1418753490. Valid TCP ports should be between 1-65535 Aug 03 01:51:50.109880 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.116014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:50.116014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.116014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.116014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:50.116014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:50.116014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:50.116014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:50.116014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1418753490. Valid TCP ports should be between 1-65535 Aug 03 01:51:50.116014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.116014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-803847dd-6d7d-46c0-a346-79014b648c13 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Returning 400 to user: Invalid port range 22:1418753490. Valid TCP ports should be between 1-65535 {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:50.116014 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-803847dd-6d7d-46c0-a346-79014b648c13 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.117340 Aug 03 01:51:50.116014 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 597/1166] 10.222.0.67 () {60 vars in 1195 bytes} [Wed Aug 3 01:51:49 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:51:50.122851 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c8fd5131-b61e-4e60-a5ef-38c90c1f84b4 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 200 len: 1312 microversion: 2.1 time: 0.256555 Aug 03 01:51:50.123430 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 570/1167] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:49 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 1312 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:50.142996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9e48a789-ef02-465e-b43d-3343d51829c5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:50.144157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9e48a789-ef02-465e-b43d-3343d51829c5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:50.155546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e48a789-ef02-465e-b43d-3343d51829c5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:50.156376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e48a789-ef02-465e-b43d-3343d51829c5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:50.157354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e48a789-ef02-465e-b43d-3343d51829c5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:50.159164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e48a789-ef02-465e-b43d-3343d51829c5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:50.272345 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b2508b47-f24d-4a52-9eb1-d0a57c8ecf0a tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] 10.222.0.67 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.157741 Aug 03 01:51:50.273335 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 598/1168] 10.222.0.67 () {58 vars in 1128 bytes} [Wed Aug 3 01:51:50 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 01:51:50.280701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cca36696-b37c-4ff6-9ec3-c609c3b374c0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:50.281849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cca36696-b37c-4ff6-9ec3-c609c3b374c0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:50.285596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:50.300700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cca36696-b37c-4ff6-9ec3-c609c3b374c0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:50.301163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cca36696-b37c-4ff6-9ec3-c609c3b374c0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:50.302559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cca36696-b37c-4ff6-9ec3-c609c3b374c0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:50.303207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cca36696-b37c-4ff6-9ec3-c609c3b374c0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:50.358378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9e48a789-ef02-465e-b43d-3343d51829c5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:50.373829 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9e48a789-ef02-465e-b43d-3343d51829c5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1360 microversion: 2.1 time: 0.234415 Aug 03 01:51:50.387935 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 571/1169] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:50 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1360 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:50.394604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d1391e2d-bc8a-4432-b461-a6a831d3993f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1214760722"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:50.395991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d1391e2d-bc8a-4432-b461-a6a831d3993f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:50.404804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1391e2d-bc8a-4432-b461-a6a831d3993f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:50.405437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1391e2d-bc8a-4432-b461-a6a831d3993f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:50.406222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1391e2d-bc8a-4432-b461-a6a831d3993f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:50.406815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1391e2d-bc8a-4432-b461-a6a831d3993f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:50.517655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cca36696-b37c-4ff6-9ec3-c609c3b374c0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:50.527065 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cca36696-b37c-4ff6-9ec3-c609c3b374c0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1535 microversion: 2.1 time: 0.251815 Aug 03 01:51:50.547439 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 599/1170] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:50 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1535 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:50.552288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-deca0b9f-71a9-4c0a-b6c4-e924bd1ed20b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:50.552942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-deca0b9f-71a9-4c0a-b6c4-e924bd1ed20b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:50.600860 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.network.security_group_api [None req-d1391e2d-bc8a-4432-b461-a6a831d3993f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Adding security group 78ec86ac-259d-4a80-95a5-181313c21ada to port c05623b0-a20e-4d6a-b404-b4d7edd6104a Aug 03 01:51:50.712304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-deca0b9f-71a9-4c0a-b6c4-e924bd1ed20b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:50.723767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-deca0b9f-71a9-4c0a-b6c4-e924bd1ed20b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:50.725287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-deca0b9f-71a9-4c0a-b6c4-e924bd1ed20b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:50.729048 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-deca0b9f-71a9-4c0a-b6c4-e924bd1ed20b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1286 microversion: 2.25 time: 0.180793 Aug 03 01:51:50.730802 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 600/1171] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:50 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1286 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:50.738236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-22824969-2926-4b65-be54-097f7f0fdced tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Action: 'create', calling method: .version_select at 0x7f5b1323dd30>, body: {"security_group_rule": {"parent_group_id": "9d3346d6-b76b-43d4-9bb8-f3b79091ef39", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:50.768238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG neutronclient.v2_0.client [None req-22824969-2926-4b65-be54-097f7f0fdced tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d3346d6-b76b-43d4-9bb8-f3b79091ef39 does not exist", "detail": ""}} {{(pid=125941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:51:50.768841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.security_group_api [None req-22824969-2926-4b65-be54-097f7f0fdced tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Neutron security group 9d3346d6-b76b-43d4-9bb8-f3b79091ef39 not found {{(pid=125941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 01:51:50.769364 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-22824969-2926-4b65-be54-097f7f0fdced tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] HTTP exception thrown: Security group 9d3346d6-b76b-43d4-9bb8-f3b79091ef39 does not exist Aug 03 01:51:50.769364 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-758f32ae-e3bd-440e-a7ab-203f49b7b54e'] Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-22824969-2926-4b65-be54-097f7f0fdced tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Request method failure captured: Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 138 Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dSr481l4NnWGnchwmEcMcifinqsQT2eI0TI37TekBG2wpfNr2sawzIWfe8bSkwLqMVFyfalA9wzjEZ_QtnUhdEbTBAALX4LX9o80iduI6fh7RaLz-nCV0XUOcyANbBgF7nzUdPBTEIX3hIqbzsOzm4T8exM4E60MaRawZIDRGK2VYY Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a6c931d0167a4426bf97affb9cd0ec1e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}] Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: be8003bebd41425dbdfe6c7cb47307fb Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: {"security_group_rule": {"parent_group_id": "9d3346d6-b76b-43d4-9bb8-f3b79091ef39", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: exception: Security group 9d3346d6-b76b-43d4-9bb8-f3b79091ef39 does not exist Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-758f32ae-e3bd-440e-a7ab-203f49b7b54e'] Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9d3346d6-b76b-43d4-9bb8-f3b79091ef39', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:51:50.771364 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d3346d6-b76b-43d4-9bb8-f3b79091ef39 does not exist Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-758f32ae-e3bd-440e-a7ab-203f49b7b54e'] Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d3346d6-b76b-43d4-9bb8-f3b79091ef39 does not exist Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-758f32ae-e3bd-440e-a7ab-203f49b7b54e'] Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d3346d6-b76b-43d4-9bb8-f3b79091ef39 does not exist Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-758f32ae-e3bd-440e-a7ab-203f49b7b54e'] Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d3346d6-b76b-43d4-9bb8-f3b79091ef39 does not exist Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-758f32ae-e3bd-440e-a7ab-203f49b7b54e'] Aug 03 01:51:50.777133 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.789173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-22824969-2926-4b65-be54-097f7f0fdced tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Returning 404 to user: Security group 9d3346d6-b76b-43d4-9bb8-f3b79091ef39 does not exist Aug 03 01:51:50.789173 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-758f32ae-e3bd-440e-a7ab-203f49b7b54e'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:50.791081 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-22824969-2926-4b65-be54-097f7f0fdced tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.056820 Aug 03 01:51:50.794746 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 601/1172] 10.222.0.67 () {60 vars in 1195 bytes} [Wed Aug 3 01:51:50 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:51:50.807977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ebd89e06-9dd2-498c-a6d4-b2ea4f36e801 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] Calling method '.version_select at 0x7f5b132c25e0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:50.852529 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-ebd89e06-9dd2-498c-a6d4-b2ea4f36e801 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] HTTP exception thrown: Image not found. Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ebd89e06-9dd2-498c-a6d4-b2ea4f36e801 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] Request method failure captured: Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dS1KyVjoYBKDFIlYHMYm07kMsNjx6J3uSUEifZCUJERcAQWw9NspLW_kOQVtb8B0EH2PdcqmIuJTGU4FYAZprO90Q8FXHurjpDNlsva10ttcI9itd9PXw0GXEMsF8Q63Y9Fhyu8jLwT5rwsuW7XiUWBF4yw-DCuaQlpyd6IWGuOx_w Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: fd6af13f0f5449da9e3dc2e8867cbc77 Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1162648329 Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fd6af13f0f5449da9e3dc2e8867cbc77", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fd6af13f0f5449da9e3dc2e8867cbc77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fd6af13f0f5449da9e3dc2e8867cbc77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fd6af13f0f5449da9e3dc2e8867cbc77"}]}] Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1162648329 Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: fd6af13f0f5449da9e3dc2e8867cbc77 Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1162648329 Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesDeleteNegativeTestJSON-1162648329-project Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 296ca6ae1874481d85d8599f4d964cdc Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1162648329-project Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: exception: Image not found. Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '-1'} Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.855482 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:51:50.859928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.863556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ebd89e06-9dd2-498c-a6d4-b2ea4f36e801 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] Returning 404 to user: Image not found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:50.864915 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ebd89e06-9dd2-498c-a6d4-b2ea4f36e801 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] 10.222.0.67 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.068985 Aug 03 01:51:50.865640 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 602/1173] 10.222.0.67 () {58 vars in 1134 bytes} [Wed Aug 3 01:51:50 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:51:50.875190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-02c2ed96-4964-43f6-96cf-f2de1a269e06 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Calling method '.version_select at 0x7f5b13c31c10>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:50.917022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG neutronclient.v2_0.client [None req-02c2ed96-4964-43f6-96cf-f2de1a269e06 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule a8901c48-5f22-42a9-8220-94290fd75d73 does not exist", "detail": ""}} {{(pid=125941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:51:50.917845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.security_group_api [None req-02c2ed96-4964-43f6-96cf-f2de1a269e06 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Neutron security group rule a8901c48-5f22-42a9-8220-94290fd75d73 not found {{(pid=125941) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 03 01:51:50.918553 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-02c2ed96-4964-43f6-96cf-f2de1a269e06 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] HTTP exception thrown: Security group rule a8901c48-5f22-42a9-8220-94290fd75d73 does not exist Aug 03 01:51:50.918553 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-79a9e000-4094-4e32-a723-015f4aa92241'] Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-02c2ed96-4964-43f6-96cf-f2de1a269e06 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Request method failure captured: Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/os-security-group-rules/a8901c48-5f22-42a9-8220-94290fd75d73 HTTP/1.1 Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dSr481l4NnWGnchwmEcMcifinqsQT2eI0TI37TekBG2wpfNr2sawzIWfe8bSkwLqMVFyfalA9wzjEZ_QtnUhdEbTBAALX4LX9o80iduI6fh7RaLz-nCV0XUOcyANbBgF7nzUdPBTEIX3hIqbzsOzm4T8exM4E60MaRawZIDRGK2VYY Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a6c931d0167a4426bf97affb9cd0ec1e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a6c931d0167a4426bf97affb9cd0ec1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a6c931d0167a4426bf97affb9cd0ec1e"}]}] Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a6c931d0167a4426bf97affb9cd0ec1e Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200 Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: be8003bebd41425dbdfe6c7cb47307fb Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: exception: Security group rule a8901c48-5f22-42a9-8220-94290fd75d73 does not exist Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-79a9e000-4094-4e32-a723-015f4aa92241'] Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'a8901c48-5f22-42a9-8220-94290fd75d73'} Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:51:50.920716 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule a8901c48-5f22-42a9-8220-94290fd75d73 does not exist Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79a9e000-4094-4e32-a723-015f4aa92241'] Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule a8901c48-5f22-42a9-8220-94290fd75d73 does not exist Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79a9e000-4094-4e32-a723-015f4aa92241'] Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule a8901c48-5f22-42a9-8220-94290fd75d73 does not exist Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79a9e000-4094-4e32-a723-015f4aa92241'] Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule a8901c48-5f22-42a9-8220-94290fd75d73 does not exist Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79a9e000-4094-4e32-a723-015f4aa92241'] Aug 03 01:51:50.925191 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.935833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-02c2ed96-4964-43f6-96cf-f2de1a269e06 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Returning 404 to user: Security group rule a8901c48-5f22-42a9-8220-94290fd75d73 does not exist Aug 03 01:51:50.935833 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-79a9e000-4094-4e32-a723-015f4aa92241'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:50.935833 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-02c2ed96-4964-43f6-96cf-f2de1a269e06 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-group-rules/a8901c48-5f22-42a9-8220-94290fd75d73" status: 404 len: 199 microversion: 2.1 time: 0.062990 Aug 03 01:51:50.936663 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 603/1174] 10.222.0.67 () {58 vars in 1287 bytes} [Wed Aug 3 01:51:50 2022] DELETE /compute/v2.1/os-security-group-rules/a8901c48-5f22-42a9-8220-94290fd75d73 => generated 199 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:51:50.943230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d15dca62-7c78-45a1-bd60-5a54abe33be4 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] Calling method '.version_select at 0x7f5b13f9e3a0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:50.987590 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-d15dca62-7c78-45a1-bd60-5a54abe33be4 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] HTTP exception thrown: Image not found. Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d15dca62-7c78-45a1-bd60-5a54abe33be4 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] Request method failure captured: Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/images/75da96ee-5ee5-4488-9b20-5cd021fa03ej HTTP/1.1 Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dS1KyVjoYBKDFIlYHMYm07kMsNjx6J3uSUEifZCUJERcAQWw9NspLW_kOQVtb8B0EH2PdcqmIuJTGU4FYAZprO90Q8FXHurjpDNlsva10ttcI9itd9PXw0GXEMsF8Q63Y9Fhyu8jLwT5rwsuW7XiUWBF4yw-DCuaQlpyd6IWGuOx_w Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: fd6af13f0f5449da9e3dc2e8867cbc77 Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1162648329 Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fd6af13f0f5449da9e3dc2e8867cbc77", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fd6af13f0f5449da9e3dc2e8867cbc77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fd6af13f0f5449da9e3dc2e8867cbc77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fd6af13f0f5449da9e3dc2e8867cbc77"}]}] Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1162648329 Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: fd6af13f0f5449da9e3dc2e8867cbc77 Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1162648329 Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesDeleteNegativeTestJSON-1162648329-project Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 296ca6ae1874481d85d8599f4d964cdc Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1162648329-project Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: exception: Image not found. Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '75da96ee-5ee5-4488-9b20-5cd021fa03ej'} Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 75da96ee-5ee5-4488-9b20-5cd021fa03ej to delete Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 75da96ee-5ee5-4488-9b20-5cd021fa03ej could not be found. Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:50.990216 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d15dca62-7c78-45a1-bd60-5a54abe33be4 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] Returning 404 to user: Image not found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d15dca62-7c78-45a1-bd60-5a54abe33be4 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] 10.222.0.67 "DELETE /compute/v2.1/images/75da96ee-5ee5-4488-9b20-5cd021fa03ej" status: 404 len: 62 microversion: 2.1 time: 0.054506 Aug 03 01:51:50.995375 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 604/1175] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:50 2022] DELETE /compute/v2.1/images/75da96ee-5ee5-4488-9b20-5cd021fa03ej => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:51:51.006210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f8bdc6c8-a7fa-48b9-9c57-690fbcb2f22a req-a230e1b4-2ac3-45ea-84f1-cafeee6d45a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2ce9d3-8e0c-4981-951e-3d23d58de2c2", "name": "network-vif-unplugged", "status": "completed", "tag": "aee6f3d7-e3c0-4569-9c1b-2cfe18a9f997"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:51.021214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f8bdc6c8-a7fa-48b9-9c57-690fbcb2f22a req-a230e1b4-2ac3-45ea-84f1-cafeee6d45a9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:51.021798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f8bdc6c8-a7fa-48b9-9c57-690fbcb2f22a req-a230e1b4-2ac3-45ea-84f1-cafeee6d45a9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:51.042833 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f8bdc6c8-a7fa-48b9-9c57-690fbcb2f22a req-a230e1b4-2ac3-45ea-84f1-cafeee6d45a9 service nova] Creating event network-vif-unplugged:aee6f3d7-e3c0-4569-9c1b-2cfe18a9f997 for instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 on n-h1-826529-8 Aug 03 01:51:51.056018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-f8bdc6c8-a7fa-48b9-9c57-690fbcb2f22a req-a230e1b4-2ac3-45ea-84f1-cafeee6d45a9 service nova] Instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 01:51:51.064068 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f8bdc6c8-a7fa-48b9-9c57-690fbcb2f22a req-a230e1b4-2ac3-45ea-84f1-cafeee6d45a9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069344 Aug 03 01:51:51.064785 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 605/1176] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:51.070846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b13b5615-708e-407b-8e05-0771c1db0ebb tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Calling method '.version_select at 0x7f5b1336d790>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:51.169133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=24 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:51.656827 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b13b5615-708e-407b-8e05-0771c1db0ebb tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/05b53c0f-3a16-4741-93d7-f1f61a6c0814" status: 202 len: 0 microversion: 2.1 time: 0.590533 Aug 03 01:51:51.659150 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 606/1177] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:51:51 2022] DELETE /compute/v2.1/os-security-groups/05b53c0f-3a16-4741-93d7-f1f61a6c0814 => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:51.667604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-35cb813f-ea51-42f8-abeb-4162943675fe tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] Calling method '.version_select at 0x7f5b131e5160>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:51.692507 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d1391e2d-bc8a-4432-b461-a6a831d3993f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b/action" status: 202 len: 0 microversion: 2.1 time: 1.303049 Aug 03 01:51:51.693647 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 572/1178] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:51:50 2022] POST /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b/action => generated 0 bytes in 1305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:51.704286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c8ee141a-ef9a-482c-ace1-f21d2e0c80bb tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:51.709446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c8ee141a-ef9a-482c-ace1-f21d2e0c80bb tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:51.734231 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-35cb813f-ea51-42f8-abeb-4162943675fe tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] HTTP exception thrown: Image not found. Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-35cb813f-ea51-42f8-abeb-4162943675fe tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] Request method failure captured: Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/images/7abda645-cb16-4b76-84cd-3d80314df5351 HTTP/1.1 Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dS1KyVjoYBKDFIlYHMYm07kMsNjx6J3uSUEifZCUJERcAQWw9NspLW_kOQVtb8B0EH2PdcqmIuJTGU4FYAZprO90Q8FXHurjpDNlsva10ttcI9itd9PXw0GXEMsF8Q63Y9Fhyu8jLwT5rwsuW7XiUWBF4yw-DCuaQlpyd6IWGuOx_w Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: fd6af13f0f5449da9e3dc2e8867cbc77 Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1162648329 Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fd6af13f0f5449da9e3dc2e8867cbc77", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fd6af13f0f5449da9e3dc2e8867cbc77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fd6af13f0f5449da9e3dc2e8867cbc77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fd6af13f0f5449da9e3dc2e8867cbc77"}]}] Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1162648329 Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: fd6af13f0f5449da9e3dc2e8867cbc77 Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1162648329 Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesDeleteNegativeTestJSON-1162648329-project Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 296ca6ae1874481d85d8599f4d964cdc Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1162648329-project Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: exception: Image not found. Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '7abda645-cb16-4b76-84cd-3d80314df5351'} Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7abda645-cb16-4b76-84cd-3d80314df5351 to delete Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7abda645-cb16-4b76-84cd-3d80314df5351 could not be found. Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:51.736106 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-35cb813f-ea51-42f8-abeb-4162943675fe tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] Returning 404 to user: Image not found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:51.740433 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-35cb813f-ea51-42f8-abeb-4162943675fe tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] 10.222.0.67 "DELETE /compute/v2.1/images/7abda645-cb16-4b76-84cd-3d80314df5351" status: 404 len: 62 microversion: 2.1 time: 0.077292 Aug 03 01:51:51.742751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8ee141a-ef9a-482c-ace1-f21d2e0c80bb tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:51.742751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8ee141a-ef9a-482c-ace1-f21d2e0c80bb tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:51.743433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8ee141a-ef9a-482c-ace1-f21d2e0c80bb tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:51.744344 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 607/1179] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:51:51 2022] DELETE /compute/v2.1/images/7abda645-cb16-4b76-84cd-3d80314df5351 => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:51:51.747429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8ee141a-ef9a-482c-ace1-f21d2e0c80bb tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:51.756599 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2d6dfec1-f2be-41b8-b0af-be2163fa0e81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:51.756995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2d6dfec1-f2be-41b8-b0af-be2163fa0e81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:51.776173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d6dfec1-f2be-41b8-b0af-be2163fa0e81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:51.779621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d6dfec1-f2be-41b8-b0af-be2163fa0e81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:51.780727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d6dfec1-f2be-41b8-b0af-be2163fa0e81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:51.783370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d6dfec1-f2be-41b8-b0af-be2163fa0e81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:52.062840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:52.302985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2d6dfec1-f2be-41b8-b0af-be2163fa0e81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:52.314007 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2d6dfec1-f2be-41b8-b0af-be2163fa0e81 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1360 microversion: 2.1 time: 0.568333 Aug 03 01:51:52.314749 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 608/1180] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:51 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1360 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:52.319505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-753f562e-510b-4447-a38b-6443608f2898 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:52.321896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c8ee141a-ef9a-482c-ace1-f21d2e0c80bb tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee3c23fe964688bdb2ee2280ad0a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67bb34c427144dcca5d1d145d1a85c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:52.330051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-753f562e-510b-4447-a38b-6443608f2898 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:52.335207 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c8ee141a-ef9a-482c-ace1-f21d2e0c80bb tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 200 len: 1312 microversion: 2.1 time: 0.640000 Aug 03 01:51:52.335799 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 573/1181] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:51 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 1312 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:52.345459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dfcdbd64-c41d-45b8-8b37-53e4230ff93d tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Calling method '.version_select at 0x7f5b132c41f0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:52.352664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-753f562e-510b-4447-a38b-6443608f2898 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:52.353372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-753f562e-510b-4447-a38b-6443608f2898 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:52.354721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-753f562e-510b-4447-a38b-6443608f2898 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:52.355519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-753f562e-510b-4447-a38b-6443608f2898 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:52.676670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-753f562e-510b-4447-a38b-6443608f2898 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:52.688672 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-753f562e-510b-4447-a38b-6443608f2898 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1528 microversion: 2.1 time: 0.372705 Aug 03 01:51:52.700988 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dfcdbd64-c41d-45b8-8b37-53e4230ff93d tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/247cfd47-f67d-466a-a22a-b94a0cc73d0f" status: 202 len: 0 microversion: 2.1 time: 0.363942 Aug 03 01:51:52.701780 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 574/1182] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:51:52 2022] DELETE /compute/v2.1/os-security-groups/247cfd47-f67d-466a-a22a-b94a0cc73d0f => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:52.707659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2f62f1fc-7220-4433-91ba-7fd79db82cbc tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1688441035"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:52.708545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2f62f1fc-7220-4433-91ba-7fd79db82cbc tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:52.710661 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 609/1183] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:52 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1528 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:52.716935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-5927ea17-91e0-47cc-8904-e7f5ccea00a2 req-2faaf602-4cf2-44e3-b305-b5f976b50fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01b31b62-ac13-47d2-af5f-fb68852ca81b", "tag": "c05623b0-a20e-4d6a-b404-b4d7edd6104a"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:52.718641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f62f1fc-7220-4433-91ba-7fd79db82cbc tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:52.719299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f62f1fc-7220-4433-91ba-7fd79db82cbc tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:52.733128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5927ea17-91e0-47cc-8904-e7f5ccea00a2 req-2faaf602-4cf2-44e3-b305-b5f976b50fc9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:52.735279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5927ea17-91e0-47cc-8904-e7f5ccea00a2 req-2faaf602-4cf2-44e3-b305-b5f976b50fc9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:52.738737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f62f1fc-7220-4433-91ba-7fd79db82cbc tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:52.739595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f62f1fc-7220-4433-91ba-7fd79db82cbc tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:52.752183 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-5927ea17-91e0-47cc-8904-e7f5ccea00a2 req-2faaf602-4cf2-44e3-b305-b5f976b50fc9 service nova] Creating event network-changed:c05623b0-a20e-4d6a-b404-b4d7edd6104a for instance 01b31b62-ac13-47d2-af5f-fb68852ca81b on n-h2-826529-8 Aug 03 01:51:52.758084 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-5927ea17-91e0-47cc-8904-e7f5ccea00a2 req-2faaf602-4cf2-44e3-b305-b5f976b50fc9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046140 Aug 03 01:51:52.759638 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 610/1184] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:52.766894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6edd6611-c0c3-436a-a573-ec49a7a1f087 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] Calling method '.version_select at 0x7f5b1342fc10>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:52.795898 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-6edd6611-c0c3-436a-a573-ec49a7a1f087 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] HTTP exception thrown: Image not found. Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6edd6611-c0c3-436a-a573-ec49a7a1f087 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] Request method failure captured: Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/images/tempest-invalid-1853593584 HTTP/1.1 Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dS1KyVjoYBKDFIlYHMYm07kMsNjx6J3uSUEifZCUJERcAQWw9NspLW_kOQVtb8B0EH2PdcqmIuJTGU4FYAZprO90Q8FXHurjpDNlsva10ttcI9itd9PXw0GXEMsF8Q63Y9Fhyu8jLwT5rwsuW7XiUWBF4yw-DCuaQlpyd6IWGuOx_w Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: fd6af13f0f5449da9e3dc2e8867cbc77 Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1162648329 Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fd6af13f0f5449da9e3dc2e8867cbc77", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fd6af13f0f5449da9e3dc2e8867cbc77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fd6af13f0f5449da9e3dc2e8867cbc77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fd6af13f0f5449da9e3dc2e8867cbc77"}]}] Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1162648329 Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: fd6af13f0f5449da9e3dc2e8867cbc77 Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1162648329 Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesDeleteNegativeTestJSON-1162648329-project Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 296ca6ae1874481d85d8599f4d964cdc Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1162648329-project Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: exception: Image not found. Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'tempest-invalid-1853593584'} Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1853593584 to delete Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1853593584 could not be found. Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:52.797984 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6edd6611-c0c3-436a-a573-ec49a7a1f087 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] Returning 404 to user: Image not found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6edd6611-c0c3-436a-a573-ec49a7a1f087 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] 10.222.0.67 "DELETE /compute/v2.1/images/tempest-invalid-1853593584" status: 404 len: 62 microversion: 2.1 time: 0.039665 Aug 03 01:51:52.802980 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 611/1185] 10.222.0.67 () {58 vars in 1206 bytes} [Wed Aug 3 01:51:52 2022] DELETE /compute/v2.1/images/tempest-invalid-1853593584 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:51:52.814718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03a280a4-effa-4895-8225-0fcd5f7adb10 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:52.815772 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-03a280a4-effa-4895-8225-0fcd5f7adb10 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:52.828388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03a280a4-effa-4895-8225-0fcd5f7adb10 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:52.829223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03a280a4-effa-4895-8225-0fcd5f7adb10 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:52.830175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03a280a4-effa-4895-8225-0fcd5f7adb10 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:52.831587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03a280a4-effa-4895-8225-0fcd5f7adb10 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:52.943113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03a280a4-effa-4895-8225-0fcd5f7adb10 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:52.958392 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.network.security_group_api [None req-2f62f1fc-7220-4433-91ba-7fd79db82cbc tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Adding security group f4b557b4-237a-451c-a914-9d554d7378d8 to port c05623b0-a20e-4d6a-b404-b4d7edd6104a Aug 03 01:51:52.959804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03a280a4-effa-4895-8225-0fcd5f7adb10 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:52.961950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03a280a4-effa-4895-8225-0fcd5f7adb10 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:52.965133 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03a280a4-effa-4895-8225-0fcd5f7adb10 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1344 microversion: 2.25 time: 0.155942 Aug 03 01:51:52.966642 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 612/1186] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:52 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1344 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:52.973739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f06b51ed-d96c-4d6a-bdcd-fbb1d22392f5 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Calling method '.version_select at 0x7f5b1336dd30>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:53.412324 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f06b51ed-d96c-4d6a-bdcd-fbb1d22392f5 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/71191f4f-6be7-4490-961a-5345a375dafe" status: 202 len: 0 microversion: 2.1 time: 0.444195 Aug 03 01:51:53.415981 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 613/1187] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:51:52 2022] DELETE /compute/v2.1/os-security-groups/71191f4f-6be7-4490-961a-5345a375dafe => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:53.418779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c0b9cd2a-bc09-4f19-af0b-e01112c7c08f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:53.419419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c0b9cd2a-bc09-4f19-af0b-e01112c7c08f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:53.431289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0b9cd2a-bc09-4f19-af0b-e01112c7c08f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:53.431702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0b9cd2a-bc09-4f19-af0b-e01112c7c08f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:53.434722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0b9cd2a-bc09-4f19-af0b-e01112c7c08f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:53.435207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0b9cd2a-bc09-4f19-af0b-e01112c7c08f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:53.650467 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2f62f1fc-7220-4433-91ba-7fd79db82cbc tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b/action" status: 202 len: 0 microversion: 2.1 time: 0.947003 Aug 03 01:51:53.653755 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 575/1188] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:51:52 2022] POST /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b/action => generated 0 bytes in 951 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:53.665389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-32369a09-619c-4b44-acf6-135a835908c6 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] Calling method '.version_select at 0x7f5b132e15e0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:53.718536 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-32369a09-619c-4b44-acf6-135a835908c6 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] HTTP exception thrown: Image not found. Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-32369a09-619c-4b44-acf6-135a835908c6 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] Request method failure captured: Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/images/281a3b83-a69f-4e6b-ace1-055f725f98a8 HTTP/1.1 Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dS1KyVjoYBKDFIlYHMYm07kMsNjx6J3uSUEifZCUJERcAQWw9NspLW_kOQVtb8B0EH2PdcqmIuJTGU4FYAZprO90Q8FXHurjpDNlsva10ttcI9itd9PXw0GXEMsF8Q63Y9Fhyu8jLwT5rwsuW7XiUWBF4yw-DCuaQlpyd6IWGuOx_w Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: fd6af13f0f5449da9e3dc2e8867cbc77 Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1162648329 Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fd6af13f0f5449da9e3dc2e8867cbc77", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fd6af13f0f5449da9e3dc2e8867cbc77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fd6af13f0f5449da9e3dc2e8867cbc77"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fd6af13f0f5449da9e3dc2e8867cbc77"}]}] Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1162648329 Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: fd6af13f0f5449da9e3dc2e8867cbc77 Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1162648329 Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesDeleteNegativeTestJSON-1162648329-project Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 296ca6ae1874481d85d8599f4d964cdc Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1162648329-project Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: exception: Image not found. Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '281a3b83-a69f-4e6b-ace1-055f725f98a8'} Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 281a3b83-a69f-4e6b-ace1-055f725f98a8 to delete Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 281a3b83-a69f-4e6b-ace1-055f725f98a8 could not be found. Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:53.722446 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:51:53.728052 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:53.731907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-32369a09-619c-4b44-acf6-135a835908c6 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] Returning 404 to user: Image not found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:53.732789 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-32369a09-619c-4b44-acf6-135a835908c6 tempest-ImagesDeleteNegativeTestJSON-1162648329 tempest-ImagesDeleteNegativeTestJSON-1162648329-project] 10.222.0.67 "DELETE /compute/v2.1/images/281a3b83-a69f-4e6b-ace1-055f725f98a8" status: 404 len: 62 microversion: 2.1 time: 0.077869 Aug 03 01:51:53.733656 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 576/1189] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:53 2022] DELETE /compute/v2.1/images/281a3b83-a69f-4e6b-ace1-055f725f98a8 => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:51:53.738836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-efd41253-69e8-43ee-9e67-c025636d3b85 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:53.739721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-efd41253-69e8-43ee-9e67-c025636d3b85 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:53.758081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-efd41253-69e8-43ee-9e67-c025636d3b85 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:53.758741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-efd41253-69e8-43ee-9e67-c025636d3b85 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:53.763562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-efd41253-69e8-43ee-9e67-c025636d3b85 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:53.764258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-efd41253-69e8-43ee-9e67-c025636d3b85 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:53.796387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c0b9cd2a-bc09-4f19-af0b-e01112c7c08f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:53.813360 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c0b9cd2a-bc09-4f19-af0b-e01112c7c08f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1528 microversion: 2.1 time: 0.398806 Aug 03 01:51:53.813972 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 614/1190] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:53 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1528 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:53.840245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0cabc7ba-938b-4ce0-8891-1ac9c61e109e tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:53.841210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0cabc7ba-938b-4ce0-8891-1ac9c61e109e tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:53.866526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cabc7ba-938b-4ce0-8891-1ac9c61e109e tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:53.867258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cabc7ba-938b-4ce0-8891-1ac9c61e109e tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:53.868888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cabc7ba-938b-4ce0-8891-1ac9c61e109e tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:53.869579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cabc7ba-938b-4ce0-8891-1ac9c61e109e tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:54.017733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-efd41253-69e8-43ee-9e67-c025636d3b85 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:54.034363 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-efd41253-69e8-43ee-9e67-c025636d3b85 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1360 microversion: 2.1 time: 0.299456 Aug 03 01:51:54.035124 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 577/1191] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:53 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1360 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:54.046896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2221a092-94e4-4f75-9917-aa31e6cd6f3e tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Calling method '.version_select at 0x7f5b132e13a0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:54.187765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0cabc7ba-938b-4ce0-8891-1ac9c61e109e tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee3c23fe964688bdb2ee2280ad0a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67bb34c427144dcca5d1d145d1a85c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:54.196792 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0cabc7ba-938b-4ce0-8891-1ac9c61e109e tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 200 len: 1312 microversion: 2.1 time: 0.369516 Aug 03 01:51:54.199100 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 615/1192] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:53 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 1312 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:54.209691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-86b96cd6-8665-404c-8ec3-b0fbba01371e req-0a0c4224-263a-4c4a-8276-57d8912f845b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be0bf271-225a-4ad9-baf8-c7dad07593c7", "name": "network-vif-plugged", "status": "completed", "tag": "099d436b-29db-46ff-b84a-deb5403a674f"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:54.226450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-86b96cd6-8665-404c-8ec3-b0fbba01371e req-0a0c4224-263a-4c4a-8276-57d8912f845b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:54.234065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-86b96cd6-8665-404c-8ec3-b0fbba01371e req-0a0c4224-263a-4c4a-8276-57d8912f845b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:54.267392 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-86b96cd6-8665-404c-8ec3-b0fbba01371e req-0a0c4224-263a-4c4a-8276-57d8912f845b service nova] Creating event network-vif-plugged:099d436b-29db-46ff-b84a-deb5403a674f for instance be0bf271-225a-4ad9-baf8-c7dad07593c7 on n-h1-826529-8 Aug 03 01:51:54.272972 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-86b96cd6-8665-404c-8ec3-b0fbba01371e req-0a0c4224-263a-4c4a-8276-57d8912f845b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071956 Aug 03 01:51:54.274656 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 616/1193] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:54.282056 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd199ef6-d172-4578-9c13-6bdda84b011b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:54.286642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cd199ef6-d172-4578-9c13-6bdda84b011b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:54.293881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd199ef6-d172-4578-9c13-6bdda84b011b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:54.294333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd199ef6-d172-4578-9c13-6bdda84b011b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:54.295160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd199ef6-d172-4578-9c13-6bdda84b011b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:54.296300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd199ef6-d172-4578-9c13-6bdda84b011b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:54.537417 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2221a092-94e4-4f75-9917-aa31e6cd6f3e tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/653db827-93ec-4a8a-9b71-cfc435caaff9" status: 202 len: 0 microversion: 2.1 time: 0.501018 Aug 03 01:51:54.538002 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 578/1194] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:51:54 2022] DELETE /compute/v2.1/os-security-groups/653db827-93ec-4a8a-9b71-cfc435caaff9 => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:54.544838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ea7cc477-1db0-4033-bc88-b17a227d2257 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:54.545687 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:51:54.545687 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:51:54.561819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:54.563480 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-ea7cc477-1db0-4033-bc88-b17a227d2257 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] HTTP exception thrown: Flavor dbac6da4-4561-4206-888c-2b5f33034b4a could not be found. Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ea7cc477-1db0-4033-bc88-b17a227d2257 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Request method failure captured: Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/flavors/dbac6da4-4561-4206-888c-2b5f33034b4a HTTP/1.1 Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPGPDcyxaY3AR6t9DgcNF1uVnCaL-pgI3SrUEQdeEnEs-aZz56SmT_G3UJLeKLqP8NFCb9mAIMdaClinnAKZCWLnIqJtZGuBqNJwBdYSlYVRLojTFs_phMalkQyWrd58K3Px3PylX2TzGjiwhfl6g4lv554_Gth6f9zKRxLxc1amQU Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 2ec87c17d7564edaab4c66b4594bcdc8 Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-MigrationsAdminTest-107199060 Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2ec87c17d7564edaab4c66b4594bcdc8", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2ec87c17d7564edaab4c66b4594bcdc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2ec87c17d7564edaab4c66b4594bcdc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2ec87c17d7564edaab4c66b4594bcdc8"}]}] Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-MigrationsAdminTest-107199060 Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 2ec87c17d7564edaab4c66b4594bcdc8 Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-MigrationsAdminTest-107199060 Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-MigrationsAdminTest-107199060-project-admin Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 796d645eef7a420699fcbe3db3a689da Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-MigrationsAdminTest-107199060-project-admin Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: exception: Flavor dbac6da4-4561-4206-888c-2b5f33034b4a could not be found. Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'dbac6da4-4561-4206-888c-2b5f33034b4a'} Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor dbac6da4-4561-4206-888c-2b5f33034b4a could not be found. Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor dbac6da4-4561-4206-888c-2b5f33034b4a could not be found. Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:54.575322 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:54.580465 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:54.580465 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:54.580465 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:54.580465 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:54.580465 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:54.580465 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:54.580465 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor dbac6da4-4561-4206-888c-2b5f33034b4a could not be found. Aug 03 01:51:54.580465 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:51:54.580465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ea7cc477-1db0-4033-bc88-b17a227d2257 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Returning 404 to user: Flavor dbac6da4-4561-4206-888c-2b5f33034b4a could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:54.587370 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ea7cc477-1db0-4033-bc88-b17a227d2257 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/dbac6da4-4561-4206-888c-2b5f33034b4a" status: 404 len: 109 microversion: 2.1 time: 0.041878 Aug 03 01:51:54.587370 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 579/1195] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:51:54 2022] DELETE /compute/v2.1/flavors/dbac6da4-4561-4206-888c-2b5f33034b4a => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:51:54.595753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e45f0326-288d-4294-a523-aca53c2d54df tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:54.595753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e45f0326-288d-4294-a523-aca53c2d54df tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:54.605329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e45f0326-288d-4294-a523-aca53c2d54df tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:54.615564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e45f0326-288d-4294-a523-aca53c2d54df tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:54.616612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e45f0326-288d-4294-a523-aca53c2d54df tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:54.617326 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e45f0326-288d-4294-a523-aca53c2d54df tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:54.873285 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cd199ef6-d172-4578-9c13-6bdda84b011b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.592980 Aug 03 01:51:54.886212 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 617/1196] 10.222.0.67 () {58 vars in 1293 bytes} [Wed Aug 3 01:51:54 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b/os-security-groups => generated 1157 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:54.892466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8091524a-0996-4845-a8e7-b206f6b474f6 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] Calling method '.version_select at 0x7f5b13208670>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:54.968284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e45f0326-288d-4294-a523-aca53c2d54df tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:54.977752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e45f0326-288d-4294-a523-aca53c2d54df tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:54.980143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e45f0326-288d-4294-a523-aca53c2d54df tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:54.981561 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e45f0326-288d-4294-a523-aca53c2d54df tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1411 microversion: 2.25 time: 0.393953 Aug 03 01:51:54.982390 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 580/1197] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:54 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1411 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:55.003945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-da0c3f2b-d91e-4372-ab98-d3c847e0c348 req-7f866c01-b2e7-497b-922b-0671c163e694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01b31b62-ac13-47d2-af5f-fb68852ca81b", "tag": "c05623b0-a20e-4d6a-b404-b4d7edd6104a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:55.017001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-da0c3f2b-d91e-4372-ab98-d3c847e0c348 req-7f866c01-b2e7-497b-922b-0671c163e694 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:55.017531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-da0c3f2b-d91e-4372-ab98-d3c847e0c348 req-7f866c01-b2e7-497b-922b-0671c163e694 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:55.031539 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-da0c3f2b-d91e-4372-ab98-d3c847e0c348 req-7f866c01-b2e7-497b-922b-0671c163e694 service nova] Creating event network-changed:c05623b0-a20e-4d6a-b404-b4d7edd6104a for instance 01b31b62-ac13-47d2-af5f-fb68852ca81b on n-h2-826529-8 Aug 03 01:51:55.037108 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-da0c3f2b-d91e-4372-ab98-d3c847e0c348 req-7f866c01-b2e7-497b-922b-0671c163e694 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039092 Aug 03 01:51:55.038055 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 581/1198] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:55.044630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1585014166", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:55.105799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:51:55.302244 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8091524a-0996-4845-a8e7-b206f6b474f6 tempest-SecurityGroupRulesNegativeTestJSON-1428048200 tempest-SecurityGroupRulesNegativeTestJSON-1428048200-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/c4166ed8-6aef-4c6c-ae84-25b98ba847f5" status: 202 len: 0 microversion: 2.1 time: 0.414220 Aug 03 01:51:55.303232 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 618/1199] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:51:54 2022] DELETE /compute/v2.1/os-security-groups/c4166ed8-6aef-4c6c-ae84-25b98ba847f5 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:55.309387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c90377ab-5cc4-4b25-898c-f8599165ea5c tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'create', calling method: .version_select at 0x7f5b131e50d0>, body: {"security_group": {"name": " tempest-securitygroup -130436189 ", "description": "tempest-description-1760570500"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:55.569584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:51:55.570026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:51:55.570544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:51:55.571314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:51:55.571934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:51:55.596173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:55.600736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:55.603859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:55.605697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:55.633657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Getting quotas for project 6e247e7134ad41bfa92b6eff8111c86e. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:51:55.643144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Getting quotas for user 241ed53f42f84abc8efc7edb5f41f6ed and project 6e247e7134ad41bfa92b6eff8111c86e. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:51:55.661807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:51:55.668511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:51:55.734196 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c82f8691-1611-4ead-ab43-b4b41c9abda4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.694644 Aug 03 01:51:55.739073 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 582/1200] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:51:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:51:55.751852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-114c7bbc-e98d-4a99-b5fc-3d16b176c8c8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:55.755951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-114c7bbc-e98d-4a99-b5fc-3d16b176c8c8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:55.770626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-114c7bbc-e98d-4a99-b5fc-3d16b176c8c8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:55.775411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-114c7bbc-e98d-4a99-b5fc-3d16b176c8c8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:55.777053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-114c7bbc-e98d-4a99-b5fc-3d16b176c8c8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:55.780390 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-114c7bbc-e98d-4a99-b5fc-3d16b176c8c8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:56.251236 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c90377ab-5cc4-4b25-898c-f8599165ea5c tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.946551 Aug 03 01:51:56.252031 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 619/1201] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:51:55 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:56.256392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-52e84707-336c-427e-a087-f635a2e46033 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:56.257140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-52e84707-336c-427e-a087-f635a2e46033 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:56.268914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52e84707-336c-427e-a087-f635a2e46033 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:56.269216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52e84707-336c-427e-a087-f635a2e46033 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:56.271993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52e84707-336c-427e-a087-f635a2e46033 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:56.273839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52e84707-336c-427e-a087-f635a2e46033 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:56.612048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-114c7bbc-e98d-4a99-b5fc-3d16b176c8c8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:56.624129 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-114c7bbc-e98d-4a99-b5fc-3d16b176c8c8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1360 microversion: 2.1 time: 0.876232 Aug 03 01:51:56.633642 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 583/1202] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:55 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1360 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:56.650324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ca2d4931-2f13-48ed-b832-1ffdeaa7bab3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:56.653691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ca2d4931-2f13-48ed-b832-1ffdeaa7bab3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:56.671818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca2d4931-2f13-48ed-b832-1ffdeaa7bab3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:56.672279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca2d4931-2f13-48ed-b832-1ffdeaa7bab3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:56.673081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca2d4931-2f13-48ed-b832-1ffdeaa7bab3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:56.674238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca2d4931-2f13-48ed-b832-1ffdeaa7bab3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:56.779182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-52e84707-336c-427e-a087-f635a2e46033 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee3c23fe964688bdb2ee2280ad0a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67bb34c427144dcca5d1d145d1a85c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:56.792453 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-52e84707-336c-427e-a087-f635a2e46033 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 200 len: 1312 microversion: 2.1 time: 0.538335 Aug 03 01:51:56.810421 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 620/1203] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:56 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 1312 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:56.824051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1a8e6dc5-9f63-47f3-8b79-140d89358cf4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:56.824758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1a8e6dc5-9f63-47f3-8b79-140d89358cf4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:56.841312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a8e6dc5-9f63-47f3-8b79-140d89358cf4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:56.841883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a8e6dc5-9f63-47f3-8b79-140d89358cf4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:56.842475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a8e6dc5-9f63-47f3-8b79-140d89358cf4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:56.850453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a8e6dc5-9f63-47f3-8b79-140d89358cf4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:56.892699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:51:56.909766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ca2d4931-2f13-48ed-b832-1ffdeaa7bab3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:56.924901 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ca2d4931-2f13-48ed-b832-1ffdeaa7bab3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1209 microversion: 2.1 time: 0.290003 Aug 03 01:51:56.926312 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 584/1204] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:56 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1209 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:56.944234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-21907535-e670-4b39-9246-370699db3c44 req-7366fbf3-c1fa-407e-a98e-377019e5d54e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47752419-6bf3-468f-b3a4-e212358b9e66", "tag": "5ed2445c-012d-4ab5-960d-36a1cd1a2eed"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:56.960937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-21907535-e670-4b39-9246-370699db3c44 req-7366fbf3-c1fa-407e-a98e-377019e5d54e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:56.961623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-21907535-e670-4b39-9246-370699db3c44 req-7366fbf3-c1fa-407e-a98e-377019e5d54e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:56.978828 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-21907535-e670-4b39-9246-370699db3c44 req-7366fbf3-c1fa-407e-a98e-377019e5d54e service nova] Creating event network-changed:5ed2445c-012d-4ab5-960d-36a1cd1a2eed for instance 47752419-6bf3-468f-b3a4-e212358b9e66 on n-h1-826529-8 Aug 03 01:51:56.985451 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-21907535-e670-4b39-9246-370699db3c44 req-7366fbf3-c1fa-407e-a98e-377019e5d54e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057066 Aug 03 01:51:56.986668 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 585/1205] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:56.996156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-98a2e9fc-59af-4da4-aa5d-c7f80a45b6f8 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b134735e0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:57.176684 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-98a2e9fc-59af-4da4-aa5d-c7f80a45b6f8 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/a1acad7f-ccdb-4bc9-90ee-d338343621d3" status: 200 len: 223 microversion: 2.1 time: 0.187526 Aug 03 01:51:57.177291 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 586/1206] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 01:51:56 2022] GET /compute/v2.1/os-security-groups/a1acad7f-ccdb-4bc9-90ee-d338343621d3 => generated 223 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:57.183878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d4ce7100-c508-4abf-80a2-77d7318dd417 req-9193f449-7fb4-4955-ac39-8343057ba2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d94f59-5658-4a4b-81d4-92bf506424c5", "name": "network-vif-plugged", "status": "completed", "tag": "7d5bec19-f1ac-4023-a120-3f706b1116dc"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:57.207774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d4ce7100-c508-4abf-80a2-77d7318dd417 req-9193f449-7fb4-4955-ac39-8343057ba2e2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:57.208238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d4ce7100-c508-4abf-80a2-77d7318dd417 req-9193f449-7fb4-4955-ac39-8343057ba2e2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:57.233950 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d4ce7100-c508-4abf-80a2-77d7318dd417 req-9193f449-7fb4-4955-ac39-8343057ba2e2 service nova] Creating event network-vif-plugged:7d5bec19-f1ac-4023-a120-3f706b1116dc for instance 04d94f59-5658-4a4b-81d4-92bf506424c5 on n-h2-826529-8 Aug 03 01:51:57.242306 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d4ce7100-c508-4abf-80a2-77d7318dd417 req-9193f449-7fb4-4955-ac39-8343057ba2e2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061535 Aug 03 01:51:57.260018 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 587/1207] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:57.296362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8fcf296e-ef4b-4074-a02b-ede018cfe112 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b132a3c10>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:57.435419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1a8e6dc5-9f63-47f3-8b79-140d89358cf4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:57.450619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1a8e6dc5-9f63-47f3-8b79-140d89358cf4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:57.453304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1a8e6dc5-9f63-47f3-8b79-140d89358cf4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:57.457943 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1a8e6dc5-9f63-47f3-8b79-140d89358cf4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1411 microversion: 2.25 time: 0.645376 Aug 03 01:51:57.458542 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 621/1208] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:56 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1411 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:57.646584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2ef8ee77-b40b-4d46-9dbb-29c1bbdf8f29 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:57.647532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2ef8ee77-b40b-4d46-9dbb-29c1bbdf8f29 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:57.656789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ef8ee77-b40b-4d46-9dbb-29c1bbdf8f29 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:57.657443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ef8ee77-b40b-4d46-9dbb-29c1bbdf8f29 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:57.658634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ef8ee77-b40b-4d46-9dbb-29c1bbdf8f29 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:57.659848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ef8ee77-b40b-4d46-9dbb-29c1bbdf8f29 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:57.892116 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8fcf296e-ef4b-4074-a02b-ede018cfe112 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/a1acad7f-ccdb-4bc9-90ee-d338343621d3" status: 202 len: 0 microversion: 2.1 time: 0.628079 Aug 03 01:51:57.893310 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 588/1209] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:51:57 2022] DELETE /compute/v2.1/os-security-groups/a1acad7f-ccdb-4bc9-90ee-d338343621d3 => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:51:57.900068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-384d20db-1f88-4d04-a611-b717e1f8032c tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:57.900933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-384d20db-1f88-4d04-a611-b717e1f8032c tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:57.908639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-384d20db-1f88-4d04-a611-b717e1f8032c tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:57.909463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-384d20db-1f88-4d04-a611-b717e1f8032c tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:57.910308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-384d20db-1f88-4d04-a611-b717e1f8032c tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:57.910752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-384d20db-1f88-4d04-a611-b717e1f8032c tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:57.919667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2ef8ee77-b40b-4d46-9dbb-29c1bbdf8f29 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:57.945545 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2ef8ee77-b40b-4d46-9dbb-29c1bbdf8f29 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1544 microversion: 2.1 time: 0.302766 Aug 03 01:51:57.959785 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 622/1210] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:57 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1544 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:57.973264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c134f9ca-8ed9-46d5-9ae4-fb5f2a95c327 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b13273820>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:58.326315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG neutronclient.v2_0.client [None req-c134f9ca-8ed9-46d5-9ae4-fb5f2a95c327 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist", "detail": ""}} {{(pid=125941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:51:58.328182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.security_group_api [None req-c134f9ca-8ed9-46d5-9ae4-fb5f2a95c327 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Neutron security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 not found {{(pid=125941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 01:51:58.328828 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-c134f9ca-8ed9-46d5-9ae4-fb5f2a95c327 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist Aug 03 01:51:58.328828 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-5eed2a8a-6bb6-48c0-bcc3-90eb72a8310e'] Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c134f9ca-8ed9-46d5-9ae4-fb5f2a95c327 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-security-groups/a1acad7f-ccdb-4bc9-90ee-d338343621d3 HTTP/1.1 Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: exception: Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-5eed2a8a-6bb6-48c0-bcc3-90eb72a8310e'] Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'a1acad7f-ccdb-4bc9-90ee-d338343621d3'} Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:51:58.331560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5eed2a8a-6bb6-48c0-bcc3-90eb72a8310e'] Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5eed2a8a-6bb6-48c0-bcc3-90eb72a8310e'] Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5eed2a8a-6bb6-48c0-bcc3-90eb72a8310e'] Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5eed2a8a-6bb6-48c0-bcc3-90eb72a8310e'] Aug 03 01:51:58.335825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:51:58.339497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c134f9ca-8ed9-46d5-9ae4-fb5f2a95c327 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 404 to user: Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist Aug 03 01:51:58.339497 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-5eed2a8a-6bb6-48c0-bcc3-90eb72a8310e'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:51:58.340651 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c134f9ca-8ed9-46d5-9ae4-fb5f2a95c327 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/a1acad7f-ccdb-4bc9-90ee-d338343621d3" status: 404 len: 194 microversion: 2.1 time: 0.379584 Aug 03 01:51:58.341905 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 623/1211] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 01:51:57 2022] GET /compute/v2.1/os-security-groups/a1acad7f-ccdb-4bc9-90ee-d338343621d3 => generated 194 bytes in 381 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:51:58.348544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7220afc1-e12c-409d-99bd-f410c2ee8dbc tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:58.351317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7220afc1-e12c-409d-99bd-f410c2ee8dbc tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:58.365017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7220afc1-e12c-409d-99bd-f410c2ee8dbc tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:58.365740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7220afc1-e12c-409d-99bd-f410c2ee8dbc tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:58.368118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7220afc1-e12c-409d-99bd-f410c2ee8dbc tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:58.369186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7220afc1-e12c-409d-99bd-f410c2ee8dbc tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:58.451475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-384d20db-1f88-4d04-a611-b717e1f8032c tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee3c23fe964688bdb2ee2280ad0a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67bb34c427144dcca5d1d145d1a85c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:58.459273 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-384d20db-1f88-4d04-a611-b717e1f8032c tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 200 len: 1312 microversion: 2.1 time: 0.564641 Aug 03 01:51:58.471510 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 589/1212] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:57 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 1312 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:58.473436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7220afc1-e12c-409d-99bd-f410c2ee8dbc tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:58.482144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-94db4eba-58cd-4f7f-9a0b-e391a27794d1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:58.482731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-94db4eba-58cd-4f7f-9a0b-e391a27794d1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:58.489865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94db4eba-58cd-4f7f-9a0b-e391a27794d1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:58.490356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94db4eba-58cd-4f7f-9a0b-e391a27794d1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:58.491192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94db4eba-58cd-4f7f-9a0b-e391a27794d1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:58.491631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94db4eba-58cd-4f7f-9a0b-e391a27794d1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:58.492229 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7220afc1-e12c-409d-99bd-f410c2ee8dbc tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1271 microversion: 2.1 time: 0.144508 Aug 03 01:51:58.494135 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 624/1213] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:58 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:51:58.510827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-70f702d7-f846-4ec1-9b52-9aa4134407d8 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'create', calling method: .version_select at 0x7f5b1323d040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1477487890", "description": "tempest-description-1610138452"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:58.665095 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-94db4eba-58cd-4f7f-9a0b-e391a27794d1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.190421 Aug 03 01:51:58.666352 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 590/1214] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 01:51:58 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:58.677411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-45b40634-8777-4dcd-a72b-955aeec4d121 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:58.678308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-45b40634-8777-4dcd-a72b-955aeec4d121 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:58.692514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45b40634-8777-4dcd-a72b-955aeec4d121 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:58.693095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45b40634-8777-4dcd-a72b-955aeec4d121 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:58.695671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45b40634-8777-4dcd-a72b-955aeec4d121 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:58.696517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45b40634-8777-4dcd-a72b-955aeec4d121 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:59.153135 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-70f702d7-f846-4ec1-9b52-9aa4134407d8 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.657029 Aug 03 01:51:59.161020 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 625/1215] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:51:58 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:59.167082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d11d4f54-f141-4f7e-9774-e2960bc01535 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'create', calling method: .version_select at 0x7f5b1323d8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-481553968", "description": "tempest-description-98318109"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:59.265100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-45b40634-8777-4dcd-a72b-955aeec4d121 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:59.283073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-45b40634-8777-4dcd-a72b-955aeec4d121 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:59.286644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-45b40634-8777-4dcd-a72b-955aeec4d121 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:59.289867 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-45b40634-8777-4dcd-a72b-955aeec4d121 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1411 microversion: 2.25 time: 0.620844 Aug 03 01:51:59.291123 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 591/1216] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:51:58 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1411 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:51:59.304722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-0df71cc9-7b45-4f3c-8458-be9c717b91f9 req-cde07eb2-4927-4c5e-b7a3-945222384dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2ce9d3-8e0c-4981-951e-3d23d58de2c2", "name": "network-vif-plugged", "status": "completed", "tag": "aee6f3d7-e3c0-4569-9c1b-2cfe18a9f997"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:59.321881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0df71cc9-7b45-4f3c-8458-be9c717b91f9 req-cde07eb2-4927-4c5e-b7a3-945222384dc4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:59.323355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0df71cc9-7b45-4f3c-8458-be9c717b91f9 req-cde07eb2-4927-4c5e-b7a3-945222384dc4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:59.338948 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-0df71cc9-7b45-4f3c-8458-be9c717b91f9 req-cde07eb2-4927-4c5e-b7a3-945222384dc4 service nova] Creating event network-vif-plugged:aee6f3d7-e3c0-4569-9c1b-2cfe18a9f997 for instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 on n-h1-826529-8 Aug 03 01:51:59.344512 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-0df71cc9-7b45-4f3c-8458-be9c717b91f9 req-cde07eb2-4927-4c5e-b7a3-945222384dc4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052114 Aug 03 01:51:59.345508 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 592/1217] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:51:59.485828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b2c8edd5-2a63-4c43-818e-865a413162cc tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:59.487790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b2c8edd5-2a63-4c43-818e-865a413162cc tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:59.498334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2c8edd5-2a63-4c43-818e-865a413162cc tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:59.499207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2c8edd5-2a63-4c43-818e-865a413162cc tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:59.500231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2c8edd5-2a63-4c43-818e-865a413162cc tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:59.500954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2c8edd5-2a63-4c43-818e-865a413162cc tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:59.841397 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d11d4f54-f141-4f7e-9774-e2960bc01535 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.678673 Aug 03 01:51:59.843318 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 626/1218] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:51:59 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:51:59.854939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-852558fc-8765-47cd-8069-4f6e10470e17 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:51:59.856313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-852558fc-8765-47cd-8069-4f6e10470e17 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:51:59.867651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-852558fc-8765-47cd-8069-4f6e10470e17 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:59.868917 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-852558fc-8765-47cd-8069-4f6e10470e17 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:59.873002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-852558fc-8765-47cd-8069-4f6e10470e17 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:51:59.874920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-852558fc-8765-47cd-8069-4f6e10470e17 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:51:59.897733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b2c8edd5-2a63-4c43-818e-865a413162cc tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee3c23fe964688bdb2ee2280ad0a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67bb34c427144dcca5d1d145d1a85c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:51:59.910740 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b2c8edd5-2a63-4c43-818e-865a413162cc tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 200 len: 1496 microversion: 2.1 time: 0.430334 Aug 03 01:51:59.916808 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 593/1219] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:59 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 1496 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:51:59.926189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0ae40b95-9d7c-424d-9f22-12a2b7ca2551 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'create', calling method: .version_select at 0x7f5b132fda60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1182297604", "description": "tempest-description-1690667944"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:51:59.938590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:00.324409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-852558fc-8765-47cd-8069-4f6e10470e17 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:00.332834 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-852558fc-8765-47cd-8069-4f6e10470e17 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1313 microversion: 2.1 time: 0.488137 Aug 03 01:52:00.343822 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 627/1220] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:51:59 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1313 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:00.361408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ad40f312-a2fe-462d-a63a-a40234110454 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:00.391370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.compute.server_groups [None req-ad40f312-a2fe-462d-a63a-a40234110454 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Querying cell 812a442e-24ba-4152-b2b0-f99907b19272(cell1) for 1 instances {{(pid=125941) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 03 01:52:00.393862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad40f312-a2fe-462d-a63a-a40234110454 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:00.394488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad40f312-a2fe-462d-a63a-a40234110454 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:00.472071 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ad40f312-a2fe-462d-a63a-a40234110454 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups/8d56a411-aec0-465d-ba7e-2b8cdc67143d" status: 200 len: 222 microversion: 2.1 time: 0.126799 Aug 03 01:52:00.472653 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 628/1221] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 01:52:00 2022] GET /compute/v2.1/os-server-groups/8d56a411-aec0-465d-ba7e-2b8cdc67143d => generated 222 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:00.478208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ad88bd13-6f1f-4937-b3ac-88eac49f3b4d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:00.478208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ad88bd13-6f1f-4937-b3ac-88eac49f3b4d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:00.501238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad88bd13-6f1f-4937-b3ac-88eac49f3b4d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:00.501710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad88bd13-6f1f-4937-b3ac-88eac49f3b4d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:00.502513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad88bd13-6f1f-4937-b3ac-88eac49f3b4d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:00.502981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad88bd13-6f1f-4937-b3ac-88eac49f3b4d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:00.718691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=60 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:00.783834 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0ae40b95-9d7c-424d-9f22-12a2b7ca2551 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.864896 Aug 03 01:52:00.784440 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 594/1222] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:51:59 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:00.789082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3dadb51d-4b18-486e-89d2-a479b3694913 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:00.791128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3dadb51d-4b18-486e-89d2-a479b3694913 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:00.812240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3dadb51d-4b18-486e-89d2-a479b3694913 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:00.812956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3dadb51d-4b18-486e-89d2-a479b3694913 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:00.813941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3dadb51d-4b18-486e-89d2-a479b3694913 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:00.814533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3dadb51d-4b18-486e-89d2-a479b3694913 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:00.863866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3dadb51d-4b18-486e-89d2-a479b3694913 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:52:00.904292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:01.020266 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3dadb51d-4b18-486e-89d2-a479b3694913 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "DELETE /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 204 len: 0 microversion: 2.1 time: 0.234587 Aug 03 01:52:01.020858 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 595/1223] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:52:00 2022] DELETE /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:52:01.041361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e8d35d51-3abc-4dc8-bf96-4932206eef0b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b133adb80>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:01.173551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ad88bd13-6f1f-4937-b3ac-88eac49f3b4d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:01.184199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ad88bd13-6f1f-4937-b3ac-88eac49f3b4d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:01.186021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ad88bd13-6f1f-4937-b3ac-88eac49f3b4d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:01.187423 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ad88bd13-6f1f-4937-b3ac-88eac49f3b4d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1411 microversion: 2.25 time: 0.713828 Aug 03 01:52:01.203676 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 629/1224] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:52:00 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1411 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:52:01.210762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0a3cf46e-8a37-481d-b1bd-9d68783c942f tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:01.211662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0a3cf46e-8a37-481d-b1bd-9d68783c942f tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:01.220345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a3cf46e-8a37-481d-b1bd-9d68783c942f tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:01.221312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a3cf46e-8a37-481d-b1bd-9d68783c942f tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:01.222541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a3cf46e-8a37-481d-b1bd-9d68783c942f tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:01.223278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a3cf46e-8a37-481d-b1bd-9d68783c942f tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:02.162704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a3cf46e-8a37-481d-b1bd-9d68783c942f tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee3c23fe964688bdb2ee2280ad0a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67bb34c427144dcca5d1d145d1a85c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:02.180693 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0a3cf46e-8a37-481d-b1bd-9d68783c942f tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 200 len: 1502 microversion: 2.1 time: 0.974852 Aug 03 01:52:02.184038 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 630/1225] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:01 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 1502 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:02.207688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-789905dc-dd63-4f4e-982d-76d056f18062 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:02.208698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-789905dc-dd63-4f4e-982d-76d056f18062 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:02.232748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-789905dc-dd63-4f4e-982d-76d056f18062 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:02.234000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-789905dc-dd63-4f4e-982d-76d056f18062 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:02.235722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-789905dc-dd63-4f4e-982d-76d056f18062 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:02.239228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-789905dc-dd63-4f4e-982d-76d056f18062 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:02.348616 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e8d35d51-3abc-4dc8-bf96-4932206eef0b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 1.322640 Aug 03 01:52:02.349799 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 596/1226] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 01:52:01 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:02.369170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ce13b685-bdff-430a-b9cd-cdf0ea09e88a req-e63b10a4-ea24-44c1-b635-6f76c9c92b67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be0bf271-225a-4ad9-baf8-c7dad07593c7", "tag": "099d436b-29db-46ff-b84a-deb5403a674f"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:02.386126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ce13b685-bdff-430a-b9cd-cdf0ea09e88a req-e63b10a4-ea24-44c1-b635-6f76c9c92b67 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:02.402397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ce13b685-bdff-430a-b9cd-cdf0ea09e88a req-e63b10a4-ea24-44c1-b635-6f76c9c92b67 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:02.437088 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ce13b685-bdff-430a-b9cd-cdf0ea09e88a req-e63b10a4-ea24-44c1-b635-6f76c9c92b67 service nova] Creating event network-changed:099d436b-29db-46ff-b84a-deb5403a674f for instance be0bf271-225a-4ad9-baf8-c7dad07593c7 on n-h1-826529-8 Aug 03 01:52:02.452866 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ce13b685-bdff-430a-b9cd-cdf0ea09e88a req-e63b10a4-ea24-44c1-b635-6f76c9c92b67 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101503 Aug 03 01:52:02.454033 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 597/1227] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:02.468435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8f62dc8-ae3d-457e-9a22-d819923113b6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:02.469334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b8f62dc8-ae3d-457e-9a22-d819923113b6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:02.476228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8f62dc8-ae3d-457e-9a22-d819923113b6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:02.476959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8f62dc8-ae3d-457e-9a22-d819923113b6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:02.477922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8f62dc8-ae3d-457e-9a22-d819923113b6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:02.478522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8f62dc8-ae3d-457e-9a22-d819923113b6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:02.830180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-789905dc-dd63-4f4e-982d-76d056f18062 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:02.839836 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-789905dc-dd63-4f4e-982d-76d056f18062 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1313 microversion: 2.1 time: 0.654123 Aug 03 01:52:02.840411 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 631/1228] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:02 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:02.850948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cec07986-858b-4d33-859f-d3b16898cbae tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b13208e50>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:02.929761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b8f62dc8-ae3d-457e-9a22-d819923113b6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:02.939839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b8f62dc8-ae3d-457e-9a22-d819923113b6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:02.942008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b8f62dc8-ae3d-457e-9a22-d819923113b6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:02.944428 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b8f62dc8-ae3d-457e-9a22-d819923113b6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1411 microversion: 2.25 time: 0.488360 Aug 03 01:52:02.945248 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 598/1229] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:52:02 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1411 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:52:02.953445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-7c9d3747-ca83-46a9-97ef-f6fe6da953a4 req-11fc80c1-5436-4f91-954a-e9d0547a1c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72330b06-28da-4653-aae1-004aa59d88b4", "tag": "91766d4e-1d4f-4c67-8adf-edbd715310e0"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:02.977296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7c9d3747-ca83-46a9-97ef-f6fe6da953a4 req-11fc80c1-5436-4f91-954a-e9d0547a1c24 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:02.980801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7c9d3747-ca83-46a9-97ef-f6fe6da953a4 req-11fc80c1-5436-4f91-954a-e9d0547a1c24 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:03.005436 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-7c9d3747-ca83-46a9-97ef-f6fe6da953a4 req-11fc80c1-5436-4f91-954a-e9d0547a1c24 service nova] Creating event network-changed:91766d4e-1d4f-4c67-8adf-edbd715310e0 for instance 72330b06-28da-4653-aae1-004aa59d88b4 on n-h2-826529-8 Aug 03 01:52:03.015781 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-7c9d3747-ca83-46a9-97ef-f6fe6da953a4 req-11fc80c1-5436-4f91-954a-e9d0547a1c24 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068907 Aug 03 01:52:03.016961 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 599/1230] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:03.211578 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-02f74757-d8e8-4f96-9daf-c358a207583a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:03.212287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-02f74757-d8e8-4f96-9daf-c358a207583a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:03.224067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02f74757-d8e8-4f96-9daf-c358a207583a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:03.236343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02f74757-d8e8-4f96-9daf-c358a207583a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:03.237490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02f74757-d8e8-4f96-9daf-c358a207583a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:03.238724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02f74757-d8e8-4f96-9daf-c358a207583a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:03.454550 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cec07986-858b-4d33-859f-d3b16898cbae tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/8bd76933-a8ce-417f-a989-4e7c8b8bb095" status: 202 len: 0 microversion: 2.1 time: 0.607266 Aug 03 01:52:03.456312 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 632/1231] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:52:02 2022] DELETE /compute/v2.1/os-security-groups/8bd76933-a8ce-417f-a989-4e7c8b8bb095 => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:52:03.464592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-447e81c2-642b-40f9-9791-89a5bd43f869 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b131e5790>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:03.639317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG neutronclient.v2_0.client [None req-447e81c2-642b-40f9-9791-89a5bd43f869 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist", "detail": ""}} {{(pid=125941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:52:03.640175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.security_group_api [None req-447e81c2-642b-40f9-9791-89a5bd43f869 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Neutron security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 not found {{(pid=125941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 01:52:03.640984 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-447e81c2-642b-40f9-9791-89a5bd43f869 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist Aug 03 01:52:03.640984 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-6410b788-ff57-47f8-947a-a5d10d65883f'] Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-447e81c2-642b-40f9-9791-89a5bd43f869 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-security-groups/8bd76933-a8ce-417f-a989-4e7c8b8bb095 HTTP/1.1 Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: exception: Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-6410b788-ff57-47f8-947a-a5d10d65883f'] Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '8bd76933-a8ce-417f-a989-4e7c8b8bb095'} Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:52:03.644708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6410b788-ff57-47f8-947a-a5d10d65883f'] Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6410b788-ff57-47f8-947a-a5d10d65883f'] Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6410b788-ff57-47f8-947a-a5d10d65883f'] Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6410b788-ff57-47f8-947a-a5d10d65883f'] Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-447e81c2-642b-40f9-9791-89a5bd43f869 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 404 to user: Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-6410b788-ff57-47f8-947a-a5d10d65883f'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-447e81c2-642b-40f9-9791-89a5bd43f869 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/8bd76933-a8ce-417f-a989-4e7c8b8bb095" status: 404 len: 194 microversion: 2.1 time: 0.185431 Aug 03 01:52:03.650365 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 633/1232] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 01:52:03 2022] GET /compute/v2.1/os-security-groups/8bd76933-a8ce-417f-a989-4e7c8b8bb095 => generated 194 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 01:52:03.660369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0fb12b53-6ec1-44c0-8e43-f37e8539aa40 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b1323d700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:03.835113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-02f74757-d8e8-4f96-9daf-c358a207583a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee3c23fe964688bdb2ee2280ad0a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67bb34c427144dcca5d1d145d1a85c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:03.844850 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-02f74757-d8e8-4f96-9daf-c358a207583a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 200 len: 1502 microversion: 2.1 time: 0.637972 Aug 03 01:52:03.850942 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 600/1233] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:03 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 1502 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:03.865797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5c207758-1e02-4a6c-9ef4-d77f1ddbb0a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:03.866821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5c207758-1e02-4a6c-9ef4-d77f1ddbb0a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:03.878678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c207758-1e02-4a6c-9ef4-d77f1ddbb0a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:03.879578 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c207758-1e02-4a6c-9ef4-d77f1ddbb0a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:03.880643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c207758-1e02-4a6c-9ef4-d77f1ddbb0a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:03.883604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c207758-1e02-4a6c-9ef4-d77f1ddbb0a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:04.414497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5c207758-1e02-4a6c-9ef4-d77f1ddbb0a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:04.437609 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5c207758-1e02-4a6c-9ef4-d77f1ddbb0a1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1313 microversion: 2.1 time: 0.575833 Aug 03 01:52:04.452230 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 601/1234] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:03 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:04.457378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-38ecc48e-f834-43ef-9941-c756d5964574 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:04.457985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-38ecc48e-f834-43ef-9941-c756d5964574 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:04.477845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38ecc48e-f834-43ef-9941-c756d5964574 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:04.479303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38ecc48e-f834-43ef-9941-c756d5964574 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:04.480714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38ecc48e-f834-43ef-9941-c756d5964574 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:04.481939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38ecc48e-f834-43ef-9941-c756d5964574 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:04.725605 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0fb12b53-6ec1-44c0-8e43-f37e8539aa40 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/71cf155f-2119-4be9-8730-8be56ce042ce" status: 202 len: 0 microversion: 2.1 time: 1.069616 Aug 03 01:52:04.726966 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 634/1235] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:52:03 2022] DELETE /compute/v2.1/os-security-groups/71cf155f-2119-4be9-8730-8be56ce042ce => generated 0 bytes in 1073 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 01:52:04.739906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-32f483f8-9202-415f-accb-8ed015bea4e3 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b131e5790>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:04.834607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG neutronclient.v2_0.client [None req-32f483f8-9202-415f-accb-8ed015bea4e3 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist", "detail": ""}} {{(pid=125941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:52:04.835513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.security_group_api [None req-32f483f8-9202-415f-accb-8ed015bea4e3 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Neutron security group 71cf155f-2119-4be9-8730-8be56ce042ce not found {{(pid=125941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 01:52:04.838668 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-32f483f8-9202-415f-accb-8ed015bea4e3 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist Aug 03 01:52:04.838668 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-12ea1367-5c70-43d8-985b-357c90ee7ff8'] Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-32f483f8-9202-415f-accb-8ed015bea4e3 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-security-groups/71cf155f-2119-4be9-8730-8be56ce042ce HTTP/1.1 Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: exception: Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-12ea1367-5c70-43d8-985b-357c90ee7ff8'] Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '71cf155f-2119-4be9-8730-8be56ce042ce'} Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:52:04.844529 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12ea1367-5c70-43d8-985b-357c90ee7ff8'] Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12ea1367-5c70-43d8-985b-357c90ee7ff8'] Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12ea1367-5c70-43d8-985b-357c90ee7ff8'] Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12ea1367-5c70-43d8-985b-357c90ee7ff8'] Aug 03 01:52:04.848676 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:04.855696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-32f483f8-9202-415f-accb-8ed015bea4e3 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 404 to user: Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist Aug 03 01:52:04.855696 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-12ea1367-5c70-43d8-985b-357c90ee7ff8'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:04.859060 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-32f483f8-9202-415f-accb-8ed015bea4e3 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/71cf155f-2119-4be9-8730-8be56ce042ce" status: 404 len: 194 microversion: 2.1 time: 0.126229 Aug 03 01:52:04.860658 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 635/1236] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 01:52:04 2022] GET /compute/v2.1/os-security-groups/71cf155f-2119-4be9-8730-8be56ce042ce => generated 194 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:04.870290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5e63f02a-f70d-4dc6-b608-effd7372ae1f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b13c08700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:04.939929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-38ecc48e-f834-43ef-9941-c756d5964574 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:04.949183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-38ecc48e-f834-43ef-9941-c756d5964574 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:04.954572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-38ecc48e-f834-43ef-9941-c756d5964574 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:04.959292 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-38ecc48e-f834-43ef-9941-c756d5964574 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1411 microversion: 2.25 time: 0.505814 Aug 03 01:52:04.960020 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 602/1237] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:52:04 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1411 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:52:04.977782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-09293e12-7c90-4412-b688-322489e9223a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:04.978505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-09293e12-7c90-4412-b688-322489e9223a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:04.991623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09293e12-7c90-4412-b688-322489e9223a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:04.992256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09293e12-7c90-4412-b688-322489e9223a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:04.993264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09293e12-7c90-4412-b688-322489e9223a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:04.994122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09293e12-7c90-4412-b688-322489e9223a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:05.401691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-09293e12-7c90-4412-b688-322489e9223a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee3c23fe964688bdb2ee2280ad0a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67bb34c427144dcca5d1d145d1a85c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:05.414480 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-09293e12-7c90-4412-b688-322489e9223a tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 200 len: 1502 microversion: 2.1 time: 0.453290 Aug 03 01:52:05.415260 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 603/1238] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:04 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 1502 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:05.427144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-58990d4e-c01b-46ce-8c5f-fea749a7c945 req-f75afb06-0f35-4fab-9546-8199df8d02f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47752419-6bf3-468f-b3a4-e212358b9e66", "name": "network-vif-plugged", "status": "completed", "tag": "5ed2445c-012d-4ab5-960d-36a1cd1a2eed"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:05.458501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-58990d4e-c01b-46ce-8c5f-fea749a7c945 req-f75afb06-0f35-4fab-9546-8199df8d02f6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:05.459251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-58990d4e-c01b-46ce-8c5f-fea749a7c945 req-f75afb06-0f35-4fab-9546-8199df8d02f6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:05.512751 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-58990d4e-c01b-46ce-8c5f-fea749a7c945 req-f75afb06-0f35-4fab-9546-8199df8d02f6 service nova] Creating event network-vif-plugged:5ed2445c-012d-4ab5-960d-36a1cd1a2eed for instance 47752419-6bf3-468f-b3a4-e212358b9e66 on n-h1-826529-8 Aug 03 01:52:05.541586 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-58990d4e-c01b-46ce-8c5f-fea749a7c945 req-f75afb06-0f35-4fab-9546-8199df8d02f6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123315 Aug 03 01:52:05.542611 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 604/1239] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:05.548736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d9c01fbf-3311-40a2-b2b1-0fd4e614e810 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:05.549797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d9c01fbf-3311-40a2-b2b1-0fd4e614e810 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:05.557988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9c01fbf-3311-40a2-b2b1-0fd4e614e810 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:05.558762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9c01fbf-3311-40a2-b2b1-0fd4e614e810 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:05.560091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9c01fbf-3311-40a2-b2b1-0fd4e614e810 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:05.560685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9c01fbf-3311-40a2-b2b1-0fd4e614e810 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:05.627488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:05.654071 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5e63f02a-f70d-4dc6-b608-effd7372ae1f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/d0369026-0cf3-4637-bb58-f158e59b3a3f" status: 202 len: 0 microversion: 2.1 time: 0.788164 Aug 03 01:52:05.657839 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 636/1240] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:52:04 2022] DELETE /compute/v2.1/os-security-groups/d0369026-0cf3-4637-bb58-f158e59b3a3f => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:52:05.669287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f3ae61e2-3eef-4f79-b66a-7013bbe7e699 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b1323d160>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:05.688786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:05.784081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG neutronclient.v2_0.client [None req-f3ae61e2-3eef-4f79-b66a-7013bbe7e699 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist", "detail": ""}} {{(pid=125941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:52:05.784624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.security_group_api [None req-f3ae61e2-3eef-4f79-b66a-7013bbe7e699 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Neutron security group d0369026-0cf3-4637-bb58-f158e59b3a3f not found {{(pid=125941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 01:52:05.785209 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-f3ae61e2-3eef-4f79-b66a-7013bbe7e699 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist Aug 03 01:52:05.785209 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-2316f64b-94b2-4bb7-8073-b98d150de20e'] Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f3ae61e2-3eef-4f79-b66a-7013bbe7e699 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-security-groups/d0369026-0cf3-4637-bb58-f158e59b3a3f HTTP/1.1 Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: exception: Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-2316f64b-94b2-4bb7-8073-b98d150de20e'] Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'd0369026-0cf3-4637-bb58-f158e59b3a3f'} Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:52:05.790208 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2316f64b-94b2-4bb7-8073-b98d150de20e'] Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2316f64b-94b2-4bb7-8073-b98d150de20e'] Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2316f64b-94b2-4bb7-8073-b98d150de20e'] Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2316f64b-94b2-4bb7-8073-b98d150de20e'] Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f3ae61e2-3eef-4f79-b66a-7013bbe7e699 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 404 to user: Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-2316f64b-94b2-4bb7-8073-b98d150de20e'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f3ae61e2-3eef-4f79-b66a-7013bbe7e699 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/d0369026-0cf3-4637-bb58-f158e59b3a3f" status: 404 len: 194 microversion: 2.1 time: 0.130616 Aug 03 01:52:05.795650 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 637/1241] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 01:52:05 2022] GET /compute/v2.1/os-security-groups/d0369026-0cf3-4637-bb58-f158e59b3a3f => generated 194 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:05.803840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ae0048fe-f975-48f6-a4c4-f5c24c81f143 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b13acbca0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:06.637137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d9c01fbf-3311-40a2-b2b1-0fd4e614e810 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:06.653233 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d9c01fbf-3311-40a2-b2b1-0fd4e614e810 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1313 microversion: 2.1 time: 1.108262 Aug 03 01:52:06.654658 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 605/1242] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:05 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1313 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:06.662068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1e388f3f-fc17-41cf-a4ad-6a7909afd182 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:06.663678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1e388f3f-fc17-41cf-a4ad-6a7909afd182 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:06.675806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e388f3f-fc17-41cf-a4ad-6a7909afd182 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:06.676634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e388f3f-fc17-41cf-a4ad-6a7909afd182 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:06.678039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e388f3f-fc17-41cf-a4ad-6a7909afd182 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:06.679111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e388f3f-fc17-41cf-a4ad-6a7909afd182 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:07.041519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1e388f3f-fc17-41cf-a4ad-6a7909afd182 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:07.061056 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ae0048fe-f975-48f6-a4c4-f5c24c81f143 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.262133 Aug 03 01:52:07.062060 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 638/1243] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 01:52:05 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:07.064533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1e388f3f-fc17-41cf-a4ad-6a7909afd182 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:07.066863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-9960e0d7-9ea0-4f05-a642-4b832f16e349 req-5c59527e-8bfa-433a-9164-d24fec31afb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d94f59-5658-4a4b-81d4-92bf506424c5", "name": "network-vif-deleted", "tag": "7d5bec19-f1ac-4023-a120-3f706b1116dc"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:07.068343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1e388f3f-fc17-41cf-a4ad-6a7909afd182 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:07.069952 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1e388f3f-fc17-41cf-a4ad-6a7909afd182 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1411 microversion: 2.25 time: 0.413882 Aug 03 01:52:07.070782 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 606/1244] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:52:06 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1411 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:52:07.093843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9960e0d7-9ea0-4f05-a642-4b832f16e349 req-5c59527e-8bfa-433a-9164-d24fec31afb9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:07.094299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9960e0d7-9ea0-4f05-a642-4b832f16e349 req-5c59527e-8bfa-433a-9164-d24fec31afb9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:07.094438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f808e11e-fb1c-456b-bf13-ace531a0ff01 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:07.095076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f808e11e-fb1c-456b-bf13-ace531a0ff01 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:07.103021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f808e11e-fb1c-456b-bf13-ace531a0ff01 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:07.105419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f808e11e-fb1c-456b-bf13-ace531a0ff01 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:07.106694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f808e11e-fb1c-456b-bf13-ace531a0ff01 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:07.107433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f808e11e-fb1c-456b-bf13-ace531a0ff01 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:07.123944 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-9960e0d7-9ea0-4f05-a642-4b832f16e349 req-5c59527e-8bfa-433a-9164-d24fec31afb9 service nova] Creating event network-vif-deleted:7d5bec19-f1ac-4023-a120-3f706b1116dc for instance 04d94f59-5658-4a4b-81d4-92bf506424c5 on n-h2-826529-8 Aug 03 01:52:07.138402 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-9960e0d7-9ea0-4f05-a642-4b832f16e349 req-5c59527e-8bfa-433a-9164-d24fec31afb9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074910 Aug 03 01:52:07.139360 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 639/1245] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:07.144609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1c926621-79b1-4a2d-9d7d-bcdd481377f0 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'create', calling method: .version_select at 0x7f5b1336d700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1060569561", "description": "tempest-description-218480396"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:07.152172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f808e11e-fb1c-456b-bf13-ace531a0ff01 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:07.152994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f808e11e-fb1c-456b-bf13-ace531a0ff01 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:07.153750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-f808e11e-fb1c-456b-bf13-ace531a0ff01 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lazy-loading 'fault' on Instance uuid 04d94f59-5658-4a4b-81d4-92bf506424c5 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:52:07.242435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f808e11e-fb1c-456b-bf13-ace531a0ff01 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee3c23fe964688bdb2ee2280ad0a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67bb34c427144dcca5d1d145d1a85c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:07.258423 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f808e11e-fb1c-456b-bf13-ace531a0ff01 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 200 len: 1302 microversion: 2.1 time: 0.174457 Aug 03 01:52:07.261143 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 607/1246] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:07 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 1302 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:07.601821 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1c926621-79b1-4a2d-9d7d-bcdd481377f0 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.461040 Aug 03 01:52:07.602422 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 640/1247] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:52:07 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:07.616542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d76a65f-a42d-4dff-a680-2d800d2f6b6c tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'create', calling method: .version_select at 0x7f5b13271e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-174049585", "description": "tempest-description-1279024364"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:07.674829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fbb9f02e-10b9-4960-a8ce-917e4c0f442e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:07.676324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fbb9f02e-10b9-4960-a8ce-917e4c0f442e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:07.693267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbb9f02e-10b9-4960-a8ce-917e4c0f442e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:07.693716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbb9f02e-10b9-4960-a8ce-917e4c0f442e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:07.694510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbb9f02e-10b9-4960-a8ce-917e4c0f442e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:07.695024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbb9f02e-10b9-4960-a8ce-917e4c0f442e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:08.223554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fbb9f02e-10b9-4960-a8ce-917e4c0f442e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:08.240507 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fbb9f02e-10b9-4960-a8ce-917e4c0f442e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1313 microversion: 2.1 time: 0.568364 Aug 03 01:52:08.242992 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 641/1248] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:07 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1313 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:08.253724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4a140346-8612-4366-b18e-5dbce9ed3d90 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:08.254525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4a140346-8612-4366-b18e-5dbce9ed3d90 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:08.256296 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8d76a65f-a42d-4dff-a680-2d800d2f6b6c tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.645193 Aug 03 01:52:08.257242 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 608/1249] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:52:07 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:08.268913 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a140346-8612-4366-b18e-5dbce9ed3d90 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:08.269849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a140346-8612-4366-b18e-5dbce9ed3d90 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:08.270824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a140346-8612-4366-b18e-5dbce9ed3d90 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:08.271637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a140346-8612-4366-b18e-5dbce9ed3d90 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:08.281842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2d329a32-b37b-4c03-8159-72e0807fc52b tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:08.282467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2d329a32-b37b-4c03-8159-72e0807fc52b tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:08.295900 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d329a32-b37b-4c03-8159-72e0807fc52b tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:08.296363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d329a32-b37b-4c03-8159-72e0807fc52b tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:08.297172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d329a32-b37b-4c03-8159-72e0807fc52b tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:08.297617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d329a32-b37b-4c03-8159-72e0807fc52b tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:08.348437 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-2d329a32-b37b-4c03-8159-72e0807fc52b tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] HTTP exception thrown: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2d329a32-b37b-4c03-8159-72e0807fc52b tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Request method failure captured: Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 HTTP/1.1 Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dSkfDiBs3tksFeW1l0GVkPmp9dWFZy3cO_S5NyLDlx1SRG2KWA42Ue45IzMrozQBfcVTt1filOM64Y5W-V3xohhMdQU7TZP8A3MmVmRwcIxZrMaAz4xf9Ke1mUyIzct2IWrb-4lfPLH73B3FmIV9hN3NpsImaUEmv5NQ8CWzLNhtTs Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 67bb34c427144dcca5d1d145d1a85c39 Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_67bb34c427144dcca5d1d145d1a85c39", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67bb34c427144dcca5d1d145d1a85c39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/67bb34c427144dcca5d1d145d1a85c39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67bb34c427144dcca5d1d145d1a85c39"}]}] Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 67bb34c427144dcca5d1d145d1a85c39 Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerGroupTestJSON-1523810702-project Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7bee3c23fe964688bdb2ee2280ad0a58 Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerGroupTestJSON-1523810702-project Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '04d94f59-5658-4a4b-81d4-92bf506424c5'} Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:08.350157 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:08.355972 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:08.355972 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:08.355972 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:08.355972 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:08.355972 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:08.355972 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. Aug 03 01:52:08.355972 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:08.355972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2d329a32-b37b-4c03-8159-72e0807fc52b tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Returning 404 to user: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:08.356597 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2d329a32-b37b-4c03-8159-72e0807fc52b tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 404 len: 111 microversion: 2.1 time: 0.078275 Aug 03 01:52:08.357474 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 609/1250] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:08 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 01:52:08.377438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d20cc0d9-bf5b-47a4-b0c3-e41588afbe23 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:08.407802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.compute.server_groups [None req-d20cc0d9-bf5b-47a4-b0c3-e41588afbe23 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Querying cell 812a442e-24ba-4152-b2b0-f99907b19272(cell1) for 1 instances {{(pid=125942) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 03 01:52:08.409060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d20cc0d9-bf5b-47a4-b0c3-e41588afbe23 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:08.409700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d20cc0d9-bf5b-47a4-b0c3-e41588afbe23 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:08.438160 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d20cc0d9-bf5b-47a4-b0c3-e41588afbe23 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.072826 Aug 03 01:52:08.442032 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 610/1251] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:52:08 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:08.452429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-578105881", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "84fd0ebd-8e9e-4c11-8d48-582bb1762e87"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:08.532862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] validate_networks() for [('84fd0ebd-8e9e-4c11-8d48-582bb1762e87', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:52:08.985814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4a140346-8612-4366-b18e-5dbce9ed3d90 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:09.002285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4a140346-8612-4366-b18e-5dbce9ed3d90 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:09.004618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4a140346-8612-4366-b18e-5dbce9ed3d90 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:09.007724 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4a140346-8612-4366-b18e-5dbce9ed3d90 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1607 microversion: 2.25 time: 0.760153 Aug 03 01:52:09.021458 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 642/1252] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:52:08 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1607 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:52:09.037541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2320d443-c356-4a12-a806-43609b43dbe9 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:09.055524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.compute.server_groups [None req-2320d443-c356-4a12-a806-43609b43dbe9 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Querying cell 812a442e-24ba-4152-b2b0-f99907b19272(cell1) for 1 instances {{(pid=125941) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 03 01:52:09.056610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2320d443-c356-4a12-a806-43609b43dbe9 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:09.057823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2320d443-c356-4a12-a806-43609b43dbe9 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:09.087008 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2320d443-c356-4a12-a806-43609b43dbe9 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups/8d56a411-aec0-465d-ba7e-2b8cdc67143d" status: 200 len: 184 microversion: 2.1 time: 0.054525 Aug 03 01:52:09.088421 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 643/1253] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 01:52:09 2022] GET /compute/v2.1/os-server-groups/8d56a411-aec0-465d-ba7e-2b8cdc67143d => generated 184 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:09.095262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eab2f302-49c4-4c3f-8957-f4dfa0b5df03 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:09.096168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eab2f302-49c4-4c3f-8957-f4dfa0b5df03 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:09.120557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eab2f302-49c4-4c3f-8957-f4dfa0b5df03 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:09.121482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eab2f302-49c4-4c3f-8957-f4dfa0b5df03 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:09.122883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eab2f302-49c4-4c3f-8957-f4dfa0b5df03 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:09.123652 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eab2f302-49c4-4c3f-8957-f4dfa0b5df03 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:09.279497 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eab2f302-49c4-4c3f-8957-f4dfa0b5df03 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.189609 Aug 03 01:52:09.280876 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 644/1254] 10.222.0.67 () {60 vars in 1316 bytes} [Wed Aug 3 01:52:09 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:52:09.290513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0db86659-151b-4f52-bea7-5c450549bb48 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:09.292984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0db86659-151b-4f52-bea7-5c450549bb48 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:09.300005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0db86659-151b-4f52-bea7-5c450549bb48 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:09.302848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0db86659-151b-4f52-bea7-5c450549bb48 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:09.303907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0db86659-151b-4f52-bea7-5c450549bb48 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:09.304579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0db86659-151b-4f52-bea7-5c450549bb48 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:09.351137 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-0db86659-151b-4f52-bea7-5c450549bb48 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] HTTP exception thrown: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0db86659-151b-4f52-bea7-5c450549bb48 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Request method failure captured: Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 HTTP/1.1 Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dSkfDiBs3tksFeW1l0GVkPmp9dWFZy3cO_S5NyLDlx1SRG2KWA42Ue45IzMrozQBfcVTt1filOM64Y5W-V3xohhMdQU7TZP8A3MmVmRwcIxZrMaAz4xf9Ke1mUyIzct2IWrb-4lfPLH73B3FmIV9hN3NpsImaUEmv5NQ8CWzLNhtTs Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 67bb34c427144dcca5d1d145d1a85c39 Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_67bb34c427144dcca5d1d145d1a85c39", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67bb34c427144dcca5d1d145d1a85c39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/67bb34c427144dcca5d1d145d1a85c39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67bb34c427144dcca5d1d145d1a85c39"}]}] Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 67bb34c427144dcca5d1d145d1a85c39 Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerGroupTestJSON-1523810702-project Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7bee3c23fe964688bdb2ee2280ad0a58 Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerGroupTestJSON-1523810702-project Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '04d94f59-5658-4a4b-81d4-92bf506424c5'} Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:52:09.361295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:09.365973 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. Aug 03 01:52:09.365973 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:09.365973 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:09.365973 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:09.365973 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:09.365973 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:09.365973 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:09.365973 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:09.365973 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:09.365973 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. Aug 03 01:52:09.365973 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:09.373026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0db86659-151b-4f52-bea7-5c450549bb48 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Returning 404 to user: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:09.375996 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0db86659-151b-4f52-bea7-5c450549bb48 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "DELETE /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 404 len: 111 microversion: 2.1 time: 0.092417 Aug 03 01:52:09.377285 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 645/1255] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:52:09 2022] DELETE /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:09.406636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c6272262-cda0-459a-bbb4-4cf90700f44e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:09.411653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c6272262-cda0-459a-bbb4-4cf90700f44e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:09.433275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6272262-cda0-459a-bbb4-4cf90700f44e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:09.433796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6272262-cda0-459a-bbb4-4cf90700f44e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:09.435767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6272262-cda0-459a-bbb4-4cf90700f44e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:09.438581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6272262-cda0-459a-bbb4-4cf90700f44e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:09.904255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:52:09.904710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:52:09.905166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:52:09.905589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:52:09.906013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:52:09.922252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:09.922724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:09.923604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:09.924049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:09.977524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c6272262-cda0-459a-bbb4-4cf90700f44e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:09.977755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Getting quotas for project e4c5a2a2419749f393d08ce2e3dd3f8a. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:52:09.999516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Getting quotas for user 20aac1f6cabe41e28254f4ebe0c96218 and project e4c5a2a2419749f393d08ce2e3dd3f8a. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:52:10.000132 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c6272262-cda0-459a-bbb4-4cf90700f44e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1313 microversion: 2.1 time: 0.613584 Aug 03 01:52:10.000777 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 646/1256] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:09 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1313 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:10.010631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f890261c-dd8a-42ea-bc34-188ce9630165 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:10.022471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f890261c-dd8a-42ea-bc34-188ce9630165 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] [instance: 04d94f59-5658-4a4b-81d4-92bf506424c5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:10.029781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:52:10.030331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f890261c-dd8a-42ea-bc34-188ce9630165 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:10.030803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f890261c-dd8a-42ea-bc34-188ce9630165 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:10.031633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f890261c-dd8a-42ea-bc34-188ce9630165 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:10.034998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f890261c-dd8a-42ea-bc34-188ce9630165 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:10.037008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:52:10.075852 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-f890261c-dd8a-42ea-bc34-188ce9630165 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] HTTP exception thrown: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f890261c-dd8a-42ea-bc34-188ce9630165 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Request method failure captured: Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 HTTP/1.1 Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dSkfDiBs3tksFeW1l0GVkPmp9dWFZy3cO_S5NyLDlx1SRG2KWA42Ue45IzMrozQBfcVTt1filOM64Y5W-V3xohhMdQU7TZP8A3MmVmRwcIxZrMaAz4xf9Ke1mUyIzct2IWrb-4lfPLH73B3FmIV9hN3NpsImaUEmv5NQ8CWzLNhtTs Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 67bb34c427144dcca5d1d145d1a85c39 Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_67bb34c427144dcca5d1d145d1a85c39", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67bb34c427144dcca5d1d145d1a85c39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/67bb34c427144dcca5d1d145d1a85c39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67bb34c427144dcca5d1d145d1a85c39"}]}] Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 67bb34c427144dcca5d1d145d1a85c39 Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerGroupTestJSON-1523810702-project Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7bee3c23fe964688bdb2ee2280ad0a58 Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerGroupTestJSON-1523810702-project Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '04d94f59-5658-4a4b-81d4-92bf506424c5'} Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:10.078135 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.084330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:10.084330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:10.084330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:10.084330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:10.084330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:10.084330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. Aug 03 01:52:10.084330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.084330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f890261c-dd8a-42ea-bc34-188ce9630165 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Returning 404 to user: Instance 04d94f59-5658-4a4b-81d4-92bf506424c5 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:10.084330 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f890261c-dd8a-42ea-bc34-188ce9630165 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5" status: 404 len: 111 microversion: 2.1 time: 0.076902 Aug 03 01:52:10.084330 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 647/1257] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:10 2022] GET /compute/v2.1/servers/04d94f59-5658-4a4b-81d4-92bf506424c5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:10.089837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1d7a3720-0714-40d1-98f2-d2bda69c448d tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:10.097674 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-1d7a3720-0714-40d1-98f2-d2bda69c448d tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] HTTP exception thrown: Instance group 6ebc7b96-aacb-4483-a3af-0e2310ff85c5 could not be found. Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1d7a3720-0714-40d1-98f2-d2bda69c448d tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Request method failure captured: Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/os-server-groups/6ebc7b96-aacb-4483-a3af-0e2310ff85c5 HTTP/1.1 Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dSkfDiBs3tksFeW1l0GVkPmp9dWFZy3cO_S5NyLDlx1SRG2KWA42Ue45IzMrozQBfcVTt1filOM64Y5W-V3xohhMdQU7TZP8A3MmVmRwcIxZrMaAz4xf9Ke1mUyIzct2IWrb-4lfPLH73B3FmIV9hN3NpsImaUEmv5NQ8CWzLNhtTs Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 67bb34c427144dcca5d1d145d1a85c39 Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_67bb34c427144dcca5d1d145d1a85c39", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67bb34c427144dcca5d1d145d1a85c39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/67bb34c427144dcca5d1d145d1a85c39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67bb34c427144dcca5d1d145d1a85c39"}]}] Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 67bb34c427144dcca5d1d145d1a85c39 Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerGroupTestJSON-1523810702-project Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7bee3c23fe964688bdb2ee2280ad0a58 Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerGroupTestJSON-1523810702-project Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance group 6ebc7b96-aacb-4483-a3af-0e2310ff85c5 could not be found. Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '6ebc7b96-aacb-4483-a3af-0e2310ff85c5'} Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6ebc7b96-aacb-4483-a3af-0e2310ff85c5 could not be found. Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6ebc7b96-aacb-4483-a3af-0e2310ff85c5 could not be found. Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.099798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:10.103884 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:10.103884 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:10.103884 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:10.103884 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:10.103884 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6ebc7b96-aacb-4483-a3af-0e2310ff85c5 could not be found. Aug 03 01:52:10.103884 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.103884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1d7a3720-0714-40d1-98f2-d2bda69c448d tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Returning 404 to user: Instance group 6ebc7b96-aacb-4483-a3af-0e2310ff85c5 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:10.103884 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1d7a3720-0714-40d1-98f2-d2bda69c448d tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/6ebc7b96-aacb-4483-a3af-0e2310ff85c5" status: 404 len: 117 microversion: 2.1 time: 0.016491 Aug 03 01:52:10.103884 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 648/1258] 10.222.0.67 () {58 vars in 1266 bytes} [Wed Aug 3 01:52:10 2022] DELETE /compute/v2.1/os-server-groups/6ebc7b96-aacb-4483-a3af-0e2310ff85c5 => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 01:52:10.116276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b16ee5e8-26e1-422e-bf06-80efc1e21c37 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:10.125798 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c5858bfa-8407-4417-809c-892fbc3645c1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.682351 Aug 03 01:52:10.126325 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-b16ee5e8-26e1-422e-bf06-80efc1e21c37 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] HTTP exception thrown: Instance group c483dec9-07ee-4139-a8d2-09d086b17ffe could not be found. Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b16ee5e8-26e1-422e-bf06-80efc1e21c37 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Request method failure captured: Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/os-server-groups/c483dec9-07ee-4139-a8d2-09d086b17ffe HTTP/1.1 Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dSkfDiBs3tksFeW1l0GVkPmp9dWFZy3cO_S5NyLDlx1SRG2KWA42Ue45IzMrozQBfcVTt1filOM64Y5W-V3xohhMdQU7TZP8A3MmVmRwcIxZrMaAz4xf9Ke1mUyIzct2IWrb-4lfPLH73B3FmIV9hN3NpsImaUEmv5NQ8CWzLNhtTs Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 67bb34c427144dcca5d1d145d1a85c39 Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_67bb34c427144dcca5d1d145d1a85c39", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67bb34c427144dcca5d1d145d1a85c39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/67bb34c427144dcca5d1d145d1a85c39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67bb34c427144dcca5d1d145d1a85c39"}]}] Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 67bb34c427144dcca5d1d145d1a85c39 Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerGroupTestJSON-1523810702-project Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7bee3c23fe964688bdb2ee2280ad0a58 Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerGroupTestJSON-1523810702-project Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance group c483dec9-07ee-4139-a8d2-09d086b17ffe could not be found. Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'c483dec9-07ee-4139-a8d2-09d086b17ffe'} Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c483dec9-07ee-4139-a8d2-09d086b17ffe could not be found. Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c483dec9-07ee-4139-a8d2-09d086b17ffe could not be found. Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.128358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:10.133320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:10.133320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:10.133320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:10.133320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:10.133320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c483dec9-07ee-4139-a8d2-09d086b17ffe could not be found. Aug 03 01:52:10.133320 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.133320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b16ee5e8-26e1-422e-bf06-80efc1e21c37 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Returning 404 to user: Instance group c483dec9-07ee-4139-a8d2-09d086b17ffe could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:10.133320 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b16ee5e8-26e1-422e-bf06-80efc1e21c37 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/c483dec9-07ee-4139-a8d2-09d086b17ffe" status: 404 len: 117 microversion: 2.1 time: 0.018106 Aug 03 01:52:10.133942 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 649/1259] 10.222.0.67 () {58 vars in 1266 bytes} [Wed Aug 3 01:52:10 2022] DELETE /compute/v2.1/os-server-groups/c483dec9-07ee-4139-a8d2-09d086b17ffe => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 01:52:10.137424 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 611/1260] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:52:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:52:10.139795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ecf21b3c-2c34-41eb-b903-8269086ba790 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:10.147792 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-ecf21b3c-2c34-41eb-b903-8269086ba790 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] HTTP exception thrown: Instance group d4f67f9d-7fd3-4648-8213-aa4dc490dd3c could not be found. Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ecf21b3c-2c34-41eb-b903-8269086ba790 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Request method failure captured: Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/os-server-groups/d4f67f9d-7fd3-4648-8213-aa4dc490dd3c HTTP/1.1 Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dSkfDiBs3tksFeW1l0GVkPmp9dWFZy3cO_S5NyLDlx1SRG2KWA42Ue45IzMrozQBfcVTt1filOM64Y5W-V3xohhMdQU7TZP8A3MmVmRwcIxZrMaAz4xf9Ke1mUyIzct2IWrb-4lfPLH73B3FmIV9hN3NpsImaUEmv5NQ8CWzLNhtTs Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 67bb34c427144dcca5d1d145d1a85c39 Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_67bb34c427144dcca5d1d145d1a85c39", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67bb34c427144dcca5d1d145d1a85c39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/67bb34c427144dcca5d1d145d1a85c39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67bb34c427144dcca5d1d145d1a85c39"}]}] Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 67bb34c427144dcca5d1d145d1a85c39 Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerGroupTestJSON-1523810702-project Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7bee3c23fe964688bdb2ee2280ad0a58 Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerGroupTestJSON-1523810702-project Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance group d4f67f9d-7fd3-4648-8213-aa4dc490dd3c could not be found. Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'd4f67f9d-7fd3-4648-8213-aa4dc490dd3c'} Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d4f67f9d-7fd3-4648-8213-aa4dc490dd3c could not be found. Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d4f67f9d-7fd3-4648-8213-aa4dc490dd3c could not be found. Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.149409 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:10.154205 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:10.154205 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:10.154205 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:10.154205 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:10.154205 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d4f67f9d-7fd3-4648-8213-aa4dc490dd3c could not be found. Aug 03 01:52:10.154205 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.154205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ecf21b3c-2c34-41eb-b903-8269086ba790 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Returning 404 to user: Instance group d4f67f9d-7fd3-4648-8213-aa4dc490dd3c could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:10.154691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-caee472d-4fa3-46a2-860e-872e2f570890 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:10.154777 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ecf21b3c-2c34-41eb-b903-8269086ba790 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/d4f67f9d-7fd3-4648-8213-aa4dc490dd3c" status: 404 len: 117 microversion: 2.1 time: 0.016369 Aug 03 01:52:10.154865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-caee472d-4fa3-46a2-860e-872e2f570890 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:10.165700 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 650/1261] 10.222.0.67 () {58 vars in 1266 bytes} [Wed Aug 3 01:52:10 2022] DELETE /compute/v2.1/os-server-groups/d4f67f9d-7fd3-4648-8213-aa4dc490dd3c => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:10.190331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-84cc1d16-37f8-47c4-b87c-56f89cb15a56 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:10.198782 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-84cc1d16-37f8-47c4-b87c-56f89cb15a56 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] HTTP exception thrown: Instance group 0d66a556-d0ba-48b3-98b4-8a5edcf3894a could not be found. Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-84cc1d16-37f8-47c4-b87c-56f89cb15a56 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Request method failure captured: Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/os-server-groups/0d66a556-d0ba-48b3-98b4-8a5edcf3894a HTTP/1.1 Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dSkfDiBs3tksFeW1l0GVkPmp9dWFZy3cO_S5NyLDlx1SRG2KWA42Ue45IzMrozQBfcVTt1filOM64Y5W-V3xohhMdQU7TZP8A3MmVmRwcIxZrMaAz4xf9Ke1mUyIzct2IWrb-4lfPLH73B3FmIV9hN3NpsImaUEmv5NQ8CWzLNhtTs Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 67bb34c427144dcca5d1d145d1a85c39 Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_67bb34c427144dcca5d1d145d1a85c39", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67bb34c427144dcca5d1d145d1a85c39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/67bb34c427144dcca5d1d145d1a85c39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67bb34c427144dcca5d1d145d1a85c39"}]}] Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 67bb34c427144dcca5d1d145d1a85c39 Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerGroupTestJSON-1523810702 Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerGroupTestJSON-1523810702-project Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7bee3c23fe964688bdb2ee2280ad0a58 Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerGroupTestJSON-1523810702-project Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance group 0d66a556-d0ba-48b3-98b4-8a5edcf3894a could not be found. Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '0d66a556-d0ba-48b3-98b4-8a5edcf3894a'} Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0d66a556-d0ba-48b3-98b4-8a5edcf3894a could not be found. Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0d66a556-d0ba-48b3-98b4-8a5edcf3894a could not be found. Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.200421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:10.205365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:10.205365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:10.205365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:10.205365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:10.205365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0d66a556-d0ba-48b3-98b4-8a5edcf3894a could not be found. Aug 03 01:52:10.205365 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:10.205365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-84cc1d16-37f8-47c4-b87c-56f89cb15a56 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Returning 404 to user: Instance group 0d66a556-d0ba-48b3-98b4-8a5edcf3894a could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:10.205365 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-84cc1d16-37f8-47c4-b87c-56f89cb15a56 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/0d66a556-d0ba-48b3-98b4-8a5edcf3894a" status: 404 len: 117 microversion: 2.1 time: 0.018260 Aug 03 01:52:10.206087 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 651/1262] 10.222.0.67 () {58 vars in 1266 bytes} [Wed Aug 3 01:52:10 2022] DELETE /compute/v2.1/os-server-groups/0d66a556-d0ba-48b3-98b4-8a5edcf3894a => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:10.210897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ec13cbd2-ac5a-4a6a-9fc5-e5a4781ee7b3 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:10.247007 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ec13cbd2-ac5a-4a6a-9fc5-e5a4781ee7b3 tempest-ServerGroupTestJSON-1523810702 tempest-ServerGroupTestJSON-1523810702-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/8d56a411-aec0-465d-ba7e-2b8cdc67143d" status: 204 len: 0 microversion: 2.1 time: 0.038143 Aug 03 01:52:10.247942 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 652/1263] 10.222.0.67 () {58 vars in 1266 bytes} [Wed Aug 3 01:52:10 2022] DELETE /compute/v2.1/os-server-groups/8d56a411-aec0-465d-ba7e-2b8cdc67143d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:52:10.345868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-caee472d-4fa3-46a2-860e-872e2f570890 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:10.359102 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-caee472d-4fa3-46a2-860e-872e2f570890 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1215 microversion: 2.1 time: 0.217682 Aug 03 01:52:10.360695 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 612/1264] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:10 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1215 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:10.853796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-d2907b39-45b7-4d30-9e3a-e9319b7499db req-39ca67a3-ffbd-4b79-8495-e256133ba272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72330b06-28da-4653-aae1-004aa59d88b4", "name": "network-vif-plugged", "status": "completed", "tag": "91766d4e-1d4f-4c67-8adf-edbd715310e0"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:10.891295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d2907b39-45b7-4d30-9e3a-e9319b7499db req-39ca67a3-ffbd-4b79-8495-e256133ba272 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:10.894044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d2907b39-45b7-4d30-9e3a-e9319b7499db req-39ca67a3-ffbd-4b79-8495-e256133ba272 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:10.924326 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-d2907b39-45b7-4d30-9e3a-e9319b7499db req-39ca67a3-ffbd-4b79-8495-e256133ba272 service nova] Creating event network-vif-plugged:91766d4e-1d4f-4c67-8adf-edbd715310e0 for instance 72330b06-28da-4653-aae1-004aa59d88b4 on n-h2-826529-8 Aug 03 01:52:10.937538 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-d2907b39-45b7-4d30-9e3a-e9319b7499db req-39ca67a3-ffbd-4b79-8495-e256133ba272 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084135 Aug 03 01:52:10.938760 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 653/1265] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:11.021374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e6eb6ac0-6e19-4870-89be-8707d4b83fae tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:11.022002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e6eb6ac0-6e19-4870-89be-8707d4b83fae tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:11.035717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6eb6ac0-6e19-4870-89be-8707d4b83fae tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:11.038669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6eb6ac0-6e19-4870-89be-8707d4b83fae tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:11.039917 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6eb6ac0-6e19-4870-89be-8707d4b83fae tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:11.041461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6eb6ac0-6e19-4870-89be-8707d4b83fae tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:11.382178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-87931433-805b-4fc0-83fb-99df2c61c018 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:11.383134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-87931433-805b-4fc0-83fb-99df2c61c018 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:11.391446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87931433-805b-4fc0-83fb-99df2c61c018 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:11.392254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87931433-805b-4fc0-83fb-99df2c61c018 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:11.393759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87931433-805b-4fc0-83fb-99df2c61c018 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:11.394461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87931433-805b-4fc0-83fb-99df2c61c018 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:11.553470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-87931433-805b-4fc0-83fb-99df2c61c018 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:11.574677 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-87931433-805b-4fc0-83fb-99df2c61c018 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1267 microversion: 2.1 time: 0.196603 Aug 03 01:52:11.578783 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 654/1266] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:11 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:11.635202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-6865a87a-ac4c-4a02-be75-e25f523ec5ad req-39259671-cf80-4c07-82b8-27274b2ec0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47752419-6bf3-468f-b3a4-e212358b9e66", "tag": "5ed2445c-012d-4ab5-960d-36a1cd1a2eed"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:11.647185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6865a87a-ac4c-4a02-be75-e25f523ec5ad req-39259671-cf80-4c07-82b8-27274b2ec0d0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:11.648299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6865a87a-ac4c-4a02-be75-e25f523ec5ad req-39259671-cf80-4c07-82b8-27274b2ec0d0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:11.661699 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-6865a87a-ac4c-4a02-be75-e25f523ec5ad req-39259671-cf80-4c07-82b8-27274b2ec0d0 service nova] Creating event network-changed:5ed2445c-012d-4ab5-960d-36a1cd1a2eed for instance 47752419-6bf3-468f-b3a4-e212358b9e66 on n-h1-826529-8 Aug 03 01:52:11.667650 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-6865a87a-ac4c-4a02-be75-e25f523ec5ad req-39259671-cf80-4c07-82b8-27274b2ec0d0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037188 Aug 03 01:52:11.669365 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 655/1267] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:52:12.054655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e6eb6ac0-6e19-4870-89be-8707d4b83fae tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:12.073675 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e6eb6ac0-6e19-4870-89be-8707d4b83fae tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1313 microversion: 2.1 time: 1.056240 Aug 03 01:52:12.075643 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 613/1268] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:11 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1313 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:12.596945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b1e93588-9138-42d2-a704-fd99ca128fd2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:12.597801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b1e93588-9138-42d2-a704-fd99ca128fd2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:12.601214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:12.614589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1e93588-9138-42d2-a704-fd99ca128fd2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:12.615431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1e93588-9138-42d2-a704-fd99ca128fd2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:12.623631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1e93588-9138-42d2-a704-fd99ca128fd2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:12.624409 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1e93588-9138-42d2-a704-fd99ca128fd2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:12.831192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b1e93588-9138-42d2-a704-fd99ca128fd2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:12.841717 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b1e93588-9138-42d2-a704-fd99ca128fd2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1273 microversion: 2.1 time: 0.248720 Aug 03 01:52:12.848397 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 614/1269] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:12 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1273 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:13.098990 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-872a7396-df31-4c95-bb67-8d1855c1dad7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:13.101673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-872a7396-df31-4c95-bb67-8d1855c1dad7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:13.118307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-872a7396-df31-4c95-bb67-8d1855c1dad7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:13.121752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-872a7396-df31-4c95-bb67-8d1855c1dad7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:13.124953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-872a7396-df31-4c95-bb67-8d1855c1dad7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:13.125890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-872a7396-df31-4c95-bb67-8d1855c1dad7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:13.148430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-198530759", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "f3fed330-cdee-4bee-8aa1-5102e117e525"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:13.247619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] validate_networks() for [('f3fed330-cdee-4bee-8aa1-5102e117e525', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:52:13.802265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-872a7396-df31-4c95-bb67-8d1855c1dad7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:13.815597 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-872a7396-df31-4c95-bb67-8d1855c1dad7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1463 microversion: 2.1 time: 0.721745 Aug 03 01:52:13.816824 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 615/1270] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:13 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1463 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:52:13.840777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d77fabde-c602-4681-85a5-313f6f7f2ebc tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:13.843394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d77fabde-c602-4681-85a5-313f6f7f2ebc tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:13.865482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d77fabde-c602-4681-85a5-313f6f7f2ebc tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:13.872831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d77fabde-c602-4681-85a5-313f6f7f2ebc tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:13.874974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d77fabde-c602-4681-85a5-313f6f7f2ebc tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:13.876019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d77fabde-c602-4681-85a5-313f6f7f2ebc tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:14.499807 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d77fabde-c602-4681-85a5-313f6f7f2ebc tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1614 microversion: 2.1 time: 0.662800 Aug 03 01:52:14.501476 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 616/1271] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:13 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1614 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:14.518884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b6194831-4ce8-4eb8-b845-e49104c0a0eb tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:14.519817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b6194831-4ce8-4eb8-b845-e49104c0a0eb tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:14.529195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6194831-4ce8-4eb8-b845-e49104c0a0eb tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:14.533493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6194831-4ce8-4eb8-b845-e49104c0a0eb tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:14.536548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6194831-4ce8-4eb8-b845-e49104c0a0eb tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:14.545453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6194831-4ce8-4eb8-b845-e49104c0a0eb tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:15.052119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b6194831-4ce8-4eb8-b845-e49104c0a0eb tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:15.070579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:15.083700 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b6194831-4ce8-4eb8-b845-e49104c0a0eb tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1315 microversion: 2.1 time: 0.580097 Aug 03 01:52:15.089300 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 617/1272] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:14 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:15.369073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:52:15.370587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:52:15.371302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:52:15.371942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:52:15.372559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:52:15.388306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:15.391397 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:15.392544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:15.393198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:15.403021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-078e80cc-8945-43a5-88da-002e4b47abc7 tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-703460865", "ram": 512, "vcpus": 1, "disk": 10, "id": 455034894, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:15.406222 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:52:15.406222 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:52:15.422428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Getting quotas for project 214847079c8c4a749467c006295134d6. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:52:15.432849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Getting quotas for user 65845e9e08fb48ffb1c8cb0aff44dcbe and project 214847079c8c4a749467c006295134d6. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:52:15.445542 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-078e80cc-8945-43a5-88da-002e4b47abc7 tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.350703 Aug 03 01:52:15.446205 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 618/1273] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:52:15 2022] POST /compute/v2.1/flavors => generated 412 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:15.453899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:52:15.458366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6ff96a6b-6e25-47dc-9c0c-b2252af3b923 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:15.459377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:52:15.462952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6ff96a6b-6e25-47dc-9c0c-b2252af3b923 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:15.481100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ff96a6b-6e25-47dc-9c0c-b2252af3b923 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:15.481454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ff96a6b-6e25-47dc-9c0c-b2252af3b923 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:15.486058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ff96a6b-6e25-47dc-9c0c-b2252af3b923 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:15.487553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ff96a6b-6e25-47dc-9c0c-b2252af3b923 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:15.563822 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b37fe1f3-fa33-4f53-a496-85fa52a6488f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.982700 Aug 03 01:52:15.565405 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 656/1274] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:52:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:52:15.576313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d1719c2a-f4ff-4b64-8ccc-905ec11c543e tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:15.598762 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:52:15.598762 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:52:15.610782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:15.692269 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d1719c2a-f4ff-4b64-8ccc-905ec11c543e tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/455034894/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.125419 Aug 03 01:52:15.693655 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 657/1275] 10.222.0.67 () {60 vars in 1221 bytes} [Wed Aug 3 01:52:15 2022] POST /compute/v2.1/flavors/455034894/os-extra_specs => generated 66 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:52:15.702631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-38d47249-1daf-42ce-9ee7-bd044fc0d4ad tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:15.703737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-38d47249-1daf-42ce-9ee7-bd044fc0d4ad tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:15.769885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6ff96a6b-6e25-47dc-9c0c-b2252af3b923 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '796d645eef7a420699fcbe3db3a689da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ec87c17d7564edaab4c66b4594bcdc8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:15.777223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6ff96a6b-6e25-47dc-9c0c-b2252af3b923 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] flavor_id is None. Assuming migration. {{(pid=125942) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 03 01:52:15.777733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6ff96a6b-6e25-47dc-9c0c-b2252af3b923 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125942) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 01:52:16.660781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-38d47249-1daf-42ce-9ee7-bd044fc0d4ad tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65845e9e08fb48ffb1c8cb0aff44dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214847079c8c4a749467c006295134d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:16.688536 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-38d47249-1daf-42ce-9ee7-bd044fc0d4ad tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 200 len: 1215 microversion: 2.1 time: 0.990495 Aug 03 01:52:16.706278 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 658/1276] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:15 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 1215 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:16.756257 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6ff96a6b-6e25-47dc-9c0c-b2252af3b923 tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4/action" status: 202 len: 0 microversion: 2.1 time: 1.306509 Aug 03 01:52:16.758355 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 619/1277] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:52:15 2022] POST /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4/action => generated 0 bytes in 1311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:52:16.784393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-acbf8980-853a-4752-a322-9dc15e0a1ad2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:16.784393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-acbf8980-853a-4752-a322-9dc15e0a1ad2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:16.801758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acbf8980-853a-4752-a322-9dc15e0a1ad2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:16.802208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acbf8980-853a-4752-a322-9dc15e0a1ad2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:16.806833 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acbf8980-853a-4752-a322-9dc15e0a1ad2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:16.807411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acbf8980-853a-4752-a322-9dc15e0a1ad2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:16.979421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-67f92799-f78b-491b-84e7-0e466097d6ab tempest-FlavorsExtraSpecsTestJSON-1255585066 tempest-FlavorsExtraSpecsTestJSON-1255585066-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:17.005720 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-67f92799-f78b-491b-84e7-0e466097d6ab tempest-FlavorsExtraSpecsTestJSON-1255585066 tempest-FlavorsExtraSpecsTestJSON-1255585066-project] 10.222.0.67 "GET /compute/v2.1/flavors/455034894/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.295523 Aug 03 01:52:17.007666 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 659/1278] 10.222.0.67 () {58 vars in 1200 bytes} [Wed Aug 3 01:52:16 2022] GET /compute/v2.1/flavors/455034894/os-extra_specs => generated 66 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:52:17.029295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-1965db7b-c17c-480a-a2e9-90c6746f67b4 req-89564e67-b106-4231-a1d2-d44a2bdb4f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dabe69a-9513-4eee-afda-f3bda4a5c743", "tag": "68f18961-f100-488a-a34b-411aa3693cf3"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:17.042969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1965db7b-c17c-480a-a2e9-90c6746f67b4 req-89564e67-b106-4231-a1d2-d44a2bdb4f1f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:17.043656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1965db7b-c17c-480a-a2e9-90c6746f67b4 req-89564e67-b106-4231-a1d2-d44a2bdb4f1f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:17.057558 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-1965db7b-c17c-480a-a2e9-90c6746f67b4 req-89564e67-b106-4231-a1d2-d44a2bdb4f1f service nova] Creating event network-changed:68f18961-f100-488a-a34b-411aa3693cf3 for instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 on n-h2-826529-8 Aug 03 01:52:17.065031 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-1965db7b-c17c-480a-a2e9-90c6746f67b4 req-89564e67-b106-4231-a1d2-d44a2bdb4f1f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049261 Aug 03 01:52:17.066639 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 660/1279] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:17.092408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d479b7d8-f37f-443b-8b52-07713c0904e7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:17.094582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d479b7d8-f37f-443b-8b52-07713c0904e7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:17.116215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d479b7d8-f37f-443b-8b52-07713c0904e7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:17.117467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d479b7d8-f37f-443b-8b52-07713c0904e7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:17.120060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d479b7d8-f37f-443b-8b52-07713c0904e7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:17.121808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d479b7d8-f37f-443b-8b52-07713c0904e7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:17.435338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-acbf8980-853a-4752-a322-9dc15e0a1ad2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:17.443889 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-acbf8980-853a-4752-a322-9dc15e0a1ad2 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1315 microversion: 2.1 time: 0.682650 Aug 03 01:52:17.449536 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 620/1280] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:16 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:17.486132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ea828a8-9cf4-411e-9172-6115ecaf5a86 tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:17.490555 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:52:17.490555 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:52:17.555705 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2ea828a8-9cf4-411e-9172-6115ecaf5a86 tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/455034894/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.102284 Aug 03 01:52:17.561738 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 621/1281] 10.222.0.67 () {60 vars in 1221 bytes} [Wed Aug 3 01:52:17 2022] POST /compute/v2.1/flavors/455034894/os-extra_specs => generated 66 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:52:17.575506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a3898b04-3aac-4333-9d81-b29bdc044433 tempest-FlavorsExtraSpecsTestJSON-1255585066 tempest-FlavorsExtraSpecsTestJSON-1255585066-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:17.605151 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a3898b04-3aac-4333-9d81-b29bdc044433 tempest-FlavorsExtraSpecsTestJSON-1255585066 tempest-FlavorsExtraSpecsTestJSON-1255585066-project] 10.222.0.67 "GET /compute/v2.1/flavors/455034894/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.035543 Aug 03 01:52:17.606115 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 622/1282] 10.222.0.67 () {58 vars in 1242 bytes} [Wed Aug 3 01:52:17 2022] GET /compute/v2.1/flavors/455034894/os-extra_specs/hw:numa_nodes => generated 22 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:52:17.624432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-27224684-7536-4281-8f77-603b4f935f0a tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:17.729538 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-27224684-7536-4281-8f77-603b4f935f0a tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors/455034894/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.115837 Aug 03 01:52:17.735889 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 623/1283] 10.222.0.67 () {60 vars in 1221 bytes} [Wed Aug 3 01:52:17 2022] POST /compute/v2.1/flavors/455034894/os-extra_specs => generated 66 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:52:17.757200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5706a472-719d-45e7-bd44-171a70038816 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:17.758463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5706a472-719d-45e7-bd44-171a70038816 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:17.787529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5706a472-719d-45e7-bd44-171a70038816 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:17.788830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5706a472-719d-45e7-bd44-171a70038816 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:17.793653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5706a472-719d-45e7-bd44-171a70038816 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:17.794172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5706a472-719d-45e7-bd44-171a70038816 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:17.856888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d479b7d8-f37f-443b-8b52-07713c0904e7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:17.879538 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d479b7d8-f37f-443b-8b52-07713c0904e7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1472 microversion: 2.1 time: 0.808334 Aug 03 01:52:17.885188 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 661/1284] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:17 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1472 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:17.913385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a2ea5d29-e27a-4c9c-b378-4f52601302cc tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:17.956983 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a2ea5d29-e27a-4c9c-b378-4f52601302cc tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/455034894/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.070334 Aug 03 01:52:17.957599 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 662/1285] 10.222.0.67 () {58 vars in 1200 bytes} [Wed Aug 3 01:52:17 2022] GET /compute/v2.1/flavors/455034894/os-extra_specs => generated 66 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:52:17.996836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-237ed83b-8f5e-48ab-9af4-1e16d4a29389 tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:18.005670 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:52:18.005670 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:52:18.095182 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-237ed83b-8f5e-48ab-9af4-1e16d4a29389 tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] 10.222.0.67 "PUT /compute/v2.1/flavors/455034894/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.126567 Aug 03 01:52:18.097131 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 663/1286] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 3 01:52:17 2022] PUT /compute/v2.1/flavors/455034894/os-extra_specs/hw:numa_nodes => generated 22 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:52:18.121024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cca26248-b512-4605-bc57-fa4df14a40de tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:18.133770 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cca26248-b512-4605-bc57-fa4df14a40de tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/455034894/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030397 Aug 03 01:52:18.135799 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 664/1287] 10.222.0.67 () {58 vars in 1200 bytes} [Wed Aug 3 01:52:18 2022] GET /compute/v2.1/flavors/455034894/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:52:18.145000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5706a472-719d-45e7-bd44-171a70038816 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65845e9e08fb48ffb1c8cb0aff44dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214847079c8c4a749467c006295134d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:18.170701 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5706a472-719d-45e7-bd44-171a70038816 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 200 len: 1285 microversion: 2.1 time: 0.427260 Aug 03 01:52:18.174463 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 624/1288] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:17 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 1285 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:18.177351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-128b93bd-5e2a-4b47-ba11-4ccf4ca70da2 tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:18.178379 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:52:18.178379 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:52:18.258258 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-128b93bd-5e2a-4b47-ba11-4ccf4ca70da2 tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/455034894/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.105439 Aug 03 01:52:18.261001 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 665/1289] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 01:52:18 2022] DELETE /compute/v2.1/flavors/455034894/os-extra_specs/hw:numa_nodes => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:52:18.274333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-59fcef55-2841-42de-a041-e4688724bad2 tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:18.277071 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:52:18.277071 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:52:18.311228 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-59fcef55-2841-42de-a041-e4688724bad2 tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/455034894/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.043593 Aug 03 01:52:18.312957 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 625/1290] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 01:52:18 2022] DELETE /compute/v2.1/flavors/455034894/os-extra_specs/hw:cpu_policy => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 01:52:18.321677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2ec27996-c975-45a4-a7c2-3a0c6be38198 tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:18.345769 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2ec27996-c975-45a4-a7c2-3a0c6be38198 tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/455034894/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028954 Aug 03 01:52:18.346778 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 666/1291] 10.222.0.67 () {58 vars in 1200 bytes} [Wed Aug 3 01:52:18 2022] GET /compute/v2.1/flavors/455034894/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:52:18.363555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6dce4057-39d4-44d4-9829-72574d300037 tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:18.365431 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:52:18.365431 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:52:18.399612 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6dce4057-39d4-44d4-9829-72574d300037 tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/455034894" status: 202 len: 0 microversion: 2.1 time: 0.042087 Aug 03 01:52:18.405403 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 626/1292] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 01:52:18 2022] DELETE /compute/v2.1/flavors/455034894 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:52:18.410475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9c8b79b2-50ca-4377-b535-ac7649b980eb tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:18.440957 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9c8b79b2-50ca-4377-b535-ac7649b980eb tempest-FlavorsExtraSpecsTestJSON-1766212465 tempest-FlavorsExtraSpecsTestJSON-1766212465-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035215 Aug 03 01:52:18.442450 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 667/1293] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:52:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:52:18.472847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8e3bb87-d05d-4399-aceb-34a19023be2f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:18.473681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b8e3bb87-d05d-4399-aceb-34a19023be2f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:18.482040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8e3bb87-d05d-4399-aceb-34a19023be2f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:18.482989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8e3bb87-d05d-4399-aceb-34a19023be2f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:18.486386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8e3bb87-d05d-4399-aceb-34a19023be2f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:18.487145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8e3bb87-d05d-4399-aceb-34a19023be2f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:18.782851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b8e3bb87-d05d-4399-aceb-34a19023be2f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:18.795171 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b8e3bb87-d05d-4399-aceb-34a19023be2f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1315 microversion: 2.1 time: 0.324982 Aug 03 01:52:18.812070 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 627/1294] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:18 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:18.907395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-355a9f8c-0760-458c-ae00-38e2f4725a67 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:18.908762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-355a9f8c-0760-458c-ae00-38e2f4725a67 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:18.919491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-355a9f8c-0760-458c-ae00-38e2f4725a67 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:18.920732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-355a9f8c-0760-458c-ae00-38e2f4725a67 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:18.922008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-355a9f8c-0760-458c-ae00-38e2f4725a67 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:18.923176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-355a9f8c-0760-458c-ae00-38e2f4725a67 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:19.201015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8a223811-0ac6-4a35-bb8b-342767676597 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:19.201749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8a223811-0ac6-4a35-bb8b-342767676597 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:19.209996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8a223811-0ac6-4a35-bb8b-342767676597 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:19.210723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8a223811-0ac6-4a35-bb8b-342767676597 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:19.211718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8a223811-0ac6-4a35-bb8b-342767676597 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:19.212297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8a223811-0ac6-4a35-bb8b-342767676597 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:19.338717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8a223811-0ac6-4a35-bb8b-342767676597 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65845e9e08fb48ffb1c8cb0aff44dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214847079c8c4a749467c006295134d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:19.346650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-355a9f8c-0760-458c-ae00-38e2f4725a67 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:19.355945 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8a223811-0ac6-4a35-bb8b-342767676597 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 200 len: 1273 microversion: 2.1 time: 0.157015 Aug 03 01:52:19.357164 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 628/1295] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:19 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:19.358496 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-355a9f8c-0760-458c-ae00-38e2f4725a67 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1472 microversion: 2.1 time: 0.456976 Aug 03 01:52:19.375120 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 668/1296] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:18 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1472 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:19.820397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cda86539-07c3-4587-be8e-151585a5ecea tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:19.821682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cda86539-07c3-4587-be8e-151585a5ecea tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:19.845564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cda86539-07c3-4587-be8e-151585a5ecea tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:19.846268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cda86539-07c3-4587-be8e-151585a5ecea tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:19.847495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cda86539-07c3-4587-be8e-151585a5ecea tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:19.848421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cda86539-07c3-4587-be8e-151585a5ecea tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:19.950415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:20.280272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cda86539-07c3-4587-be8e-151585a5ecea tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:20.310183 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cda86539-07c3-4587-be8e-151585a5ecea tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1315 microversion: 2.1 time: 0.489307 Aug 03 01:52:20.315497 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 629/1297] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:19 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:52:20.383401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ee94ffa1-78dd-484a-af4e-0969fc31eb10 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:20.384167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ee94ffa1-78dd-484a-af4e-0969fc31eb10 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:20.389693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9570f885-d850-4bce-858b-6273f9fa3aca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:20.391446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9570f885-d850-4bce-858b-6273f9fa3aca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:20.394858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:20.407771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9570f885-d850-4bce-858b-6273f9fa3aca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:20.409050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9570f885-d850-4bce-858b-6273f9fa3aca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:20.411411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9570f885-d850-4bce-858b-6273f9fa3aca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:20.411610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee94ffa1-78dd-484a-af4e-0969fc31eb10 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:20.412088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee94ffa1-78dd-484a-af4e-0969fc31eb10 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:20.413123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee94ffa1-78dd-484a-af4e-0969fc31eb10 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:20.413737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee94ffa1-78dd-484a-af4e-0969fc31eb10 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:20.414300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9570f885-d850-4bce-858b-6273f9fa3aca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:20.417876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:21.167892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ee94ffa1-78dd-484a-af4e-0969fc31eb10 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65845e9e08fb48ffb1c8cb0aff44dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214847079c8c4a749467c006295134d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:21.183631 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ee94ffa1-78dd-484a-af4e-0969fc31eb10 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 200 len: 1315 microversion: 2.1 time: 0.800383 Aug 03 01:52:21.189191 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 669/1298] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:20 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:21.293880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9570f885-d850-4bce-858b-6273f9fa3aca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:21.316371 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9570f885-d850-4bce-858b-6273f9fa3aca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1472 microversion: 2.1 time: 0.936078 Aug 03 01:52:21.318986 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 630/1299] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:20 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1472 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:52:21.341344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4e240092-76a8-4fd7-95e2-84b913b88d6d tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:21.341977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4e240092-76a8-4fd7-95e2-84b913b88d6d tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:21.358129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e240092-76a8-4fd7-95e2-84b913b88d6d tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:21.358747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e240092-76a8-4fd7-95e2-84b913b88d6d tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:21.359589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e240092-76a8-4fd7-95e2-84b913b88d6d tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:21.361452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e240092-76a8-4fd7-95e2-84b913b88d6d tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:21.653308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-34db9cc8-c2fa-4c3f-b9c0-c0b2d0c17232 req-3a719f8a-4816-4562-a9af-682fa40bb490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc37c4b2-3a5c-4b5a-af95-e531b4189c14", "tag": "c812e9e3-6174-45e3-8be9-fb30c589602c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:21.679731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-34db9cc8-c2fa-4c3f-b9c0-c0b2d0c17232 req-3a719f8a-4816-4562-a9af-682fa40bb490 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:21.680426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-34db9cc8-c2fa-4c3f-b9c0-c0b2d0c17232 req-3a719f8a-4816-4562-a9af-682fa40bb490 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:21.701883 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-34db9cc8-c2fa-4c3f-b9c0-c0b2d0c17232 req-3a719f8a-4816-4562-a9af-682fa40bb490 service nova] Creating event network-changed:c812e9e3-6174-45e3-8be9-fb30c589602c for instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 on n-h1-826529-8 Aug 03 01:52:21.711747 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-34db9cc8-c2fa-4c3f-b9c0-c0b2d0c17232 req-3a719f8a-4816-4562-a9af-682fa40bb490 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064238 Aug 03 01:52:21.717229 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 631/1300] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:52:21.864511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4e240092-76a8-4fd7-95e2-84b913b88d6d tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:21.896666 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4e240092-76a8-4fd7-95e2-84b913b88d6d tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1315 microversion: 2.1 time: 0.560704 Aug 03 01:52:21.912115 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 670/1301] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:21 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:22.212979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-54f4effd-486d-4685-9b99-d4a8dfb6cc9f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:22.213860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-54f4effd-486d-4685-9b99-d4a8dfb6cc9f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:22.226274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-54f4effd-486d-4685-9b99-d4a8dfb6cc9f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:22.226793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-54f4effd-486d-4685-9b99-d4a8dfb6cc9f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:22.228533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-54f4effd-486d-4685-9b99-d4a8dfb6cc9f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:22.234264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-54f4effd-486d-4685-9b99-d4a8dfb6cc9f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:22.349118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-951d12c5-5851-46d2-b767-cc8b73478820 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:22.350226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-951d12c5-5851-46d2-b767-cc8b73478820 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:22.363743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-951d12c5-5851-46d2-b767-cc8b73478820 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:22.364594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-951d12c5-5851-46d2-b767-cc8b73478820 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:22.365843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-951d12c5-5851-46d2-b767-cc8b73478820 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:22.366775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-951d12c5-5851-46d2-b767-cc8b73478820 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:22.987577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-951d12c5-5851-46d2-b767-cc8b73478820 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:23.001431 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-951d12c5-5851-46d2-b767-cc8b73478820 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.659451 Aug 03 01:52:23.002026 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 671/1302] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:22 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:23.019610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-646e0e6e-b755-4b12-9b80-7ca36d3e6985 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:23.020305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-54f4effd-486d-4685-9b99-d4a8dfb6cc9f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65845e9e08fb48ffb1c8cb0aff44dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214847079c8c4a749467c006295134d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:23.020905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-646e0e6e-b755-4b12-9b80-7ca36d3e6985 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:23.029295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-646e0e6e-b755-4b12-9b80-7ca36d3e6985 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:23.031714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-646e0e6e-b755-4b12-9b80-7ca36d3e6985 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:23.039119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-646e0e6e-b755-4b12-9b80-7ca36d3e6985 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:23.039835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-646e0e6e-b755-4b12-9b80-7ca36d3e6985 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:23.041170 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-54f4effd-486d-4685-9b99-d4a8dfb6cc9f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 200 len: 1315 microversion: 2.1 time: 0.834534 Aug 03 01:52:23.044543 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 632/1303] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:22 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 1315 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:23.365158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-5745b424-c131-49e5-86e5-3a973c312a10 req-cf4e3219-2921-4712-bc2f-71e3609d89ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dabe69a-9513-4eee-afda-f3bda4a5c743", "name": "network-vif-plugged", "status": "completed", "tag": "68f18961-f100-488a-a34b-411aa3693cf3"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:23.400550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5745b424-c131-49e5-86e5-3a973c312a10 req-cf4e3219-2921-4712-bc2f-71e3609d89ef service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:23.410793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5745b424-c131-49e5-86e5-3a973c312a10 req-cf4e3219-2921-4712-bc2f-71e3609d89ef service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:23.436304 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-5745b424-c131-49e5-86e5-3a973c312a10 req-cf4e3219-2921-4712-bc2f-71e3609d89ef service nova] Creating event network-vif-plugged:68f18961-f100-488a-a34b-411aa3693cf3 for instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 on n-h2-826529-8 Aug 03 01:52:23.444994 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-5745b424-c131-49e5-86e5-3a973c312a10 req-cf4e3219-2921-4712-bc2f-71e3609d89ef service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084174 Aug 03 01:52:23.446654 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 633/1304] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:24.031948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1c507f7a-0779-4ccc-b657-9e47f4041a80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:24.032896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1c507f7a-0779-4ccc-b657-9e47f4041a80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:24.046407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c507f7a-0779-4ccc-b657-9e47f4041a80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:24.047872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c507f7a-0779-4ccc-b657-9e47f4041a80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:24.049629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c507f7a-0779-4ccc-b657-9e47f4041a80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:24.052570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c507f7a-0779-4ccc-b657-9e47f4041a80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:24.173969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-646e0e6e-b755-4b12-9b80-7ca36d3e6985 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:24.182928 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-646e0e6e-b755-4b12-9b80-7ca36d3e6985 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1315 microversion: 2.1 time: 1.179597 Aug 03 01:52:24.183994 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 672/1305] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:23 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1315 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:24.189127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8b19197-fda7-4122-90e8-8ccdc448b5b1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:24.190015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8b19197-fda7-4122-90e8-8ccdc448b5b1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:24.198389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8b19197-fda7-4122-90e8-8ccdc448b5b1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:24.199291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8b19197-fda7-4122-90e8-8ccdc448b5b1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:24.202500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8b19197-fda7-4122-90e8-8ccdc448b5b1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:24.203258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8b19197-fda7-4122-90e8-8ccdc448b5b1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:24.421340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1c507f7a-0779-4ccc-b657-9e47f4041a80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:24.434480 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1c507f7a-0779-4ccc-b657-9e47f4041a80 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.413191 Aug 03 01:52:24.447973 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 634/1306] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:24 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:24.601115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8b19197-fda7-4122-90e8-8ccdc448b5b1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65845e9e08fb48ffb1c8cb0aff44dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214847079c8c4a749467c006295134d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:24.610043 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8b19197-fda7-4122-90e8-8ccdc448b5b1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 200 len: 1315 microversion: 2.1 time: 0.424677 Aug 03 01:52:24.611107 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 673/1307] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:24 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:24.797758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1059349544", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:24.892722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:52:25.207771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-40b12e74-41ff-4e78-b031-36032fe23549 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:25.208939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-40b12e74-41ff-4e78-b031-36032fe23549 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:25.217006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40b12e74-41ff-4e78-b031-36032fe23549 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:25.217668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40b12e74-41ff-4e78-b031-36032fe23549 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:25.218810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40b12e74-41ff-4e78-b031-36032fe23549 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:25.219435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40b12e74-41ff-4e78-b031-36032fe23549 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:25.358505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:52:25.359771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:52:25.360435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:52:25.361032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:52:25.361729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:52:25.385949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:25.386687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:25.387916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:25.388378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:25.407062 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:25.420799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Getting quotas for project 67cb5febd8a7475096d9e537054a6af9. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:52:25.440727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Getting quotas for user 4b53226d24c0401b8cd7d83b1264acf1 and project 67cb5febd8a7475096d9e537054a6af9. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:52:25.466404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:52:25.470456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:52:25.543839 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d8ef32a1-f059-4881-b8a6-834cdcfa12b7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942928 Aug 03 01:52:25.545119 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 635/1308] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:52:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:52:25.550090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eff31958-9fc1-49b4-aa7a-e25facd73438 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:25.551323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eff31958-9fc1-49b4-aa7a-e25facd73438 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:25.560685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eff31958-9fc1-49b4-aa7a-e25facd73438 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:25.561376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eff31958-9fc1-49b4-aa7a-e25facd73438 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:25.562285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eff31958-9fc1-49b4-aa7a-e25facd73438 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:25.563062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eff31958-9fc1-49b4-aa7a-e25facd73438 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:25.782950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-40b12e74-41ff-4e78-b031-36032fe23549 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:25.784605 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-40b12e74-41ff-4e78-b031-36032fe23549 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1315 microversion: 2.1 time: 0.578544 Aug 03 01:52:25.798943 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 674/1309] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:25 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:52:25.798943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-939c59aa-6bff-46f8-873d-458c84fc907b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:25.798943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-939c59aa-6bff-46f8-873d-458c84fc907b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:25.919622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-939c59aa-6bff-46f8-873d-458c84fc907b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:25.928899 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-939c59aa-6bff-46f8-873d-458c84fc907b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1219 microversion: 2.1 time: 0.141368 Aug 03 01:52:25.930627 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 675/1310] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:25 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1219 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:25.939631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4605055b-5b94-410a-b1bf-4b00055944cb tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:25.941097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4605055b-5b94-410a-b1bf-4b00055944cb tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:25.950960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4605055b-5b94-410a-b1bf-4b00055944cb tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:25.953352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4605055b-5b94-410a-b1bf-4b00055944cb tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:25.954635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4605055b-5b94-410a-b1bf-4b00055944cb tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:25.955545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4605055b-5b94-410a-b1bf-4b00055944cb tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:26.094415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eff31958-9fc1-49b4-aa7a-e25facd73438 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:26.103664 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eff31958-9fc1-49b4-aa7a-e25facd73438 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.556944 Aug 03 01:52:26.105111 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 636/1311] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:25 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:26.455462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4605055b-5b94-410a-b1bf-4b00055944cb tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65845e9e08fb48ffb1c8cb0aff44dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214847079c8c4a749467c006295134d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:26.465389 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4605055b-5b94-410a-b1bf-4b00055944cb tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 200 len: 1315 microversion: 2.1 time: 0.532058 Aug 03 01:52:26.479233 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 676/1312] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:25 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:26.790196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1990479242", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "7ed7c0f7-f664-4da2-8163-bf73c9c54bc7"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:26.806375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2fa5c7b2-4996-47a2-b36a-ed7748c7897e tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:26.807687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2fa5c7b2-4996-47a2-b36a-ed7748c7897e tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:26.818930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fa5c7b2-4996-47a2-b36a-ed7748c7897e tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:26.819484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fa5c7b2-4996-47a2-b36a-ed7748c7897e tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:26.820330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fa5c7b2-4996-47a2-b36a-ed7748c7897e tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:26.820773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fa5c7b2-4996-47a2-b36a-ed7748c7897e tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:26.934145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] validate_networks() for [('7ed7c0f7-f664-4da2-8163-bf73c9c54bc7', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:52:28.458407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2fa5c7b2-4996-47a2-b36a-ed7748c7897e tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:28.482833 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2fa5c7b2-4996-47a2-b36a-ed7748c7897e tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1503 microversion: 2.1 time: 1.680113 Aug 03 01:52:28.484689 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 677/1313] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:26 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1503 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:52:28.509619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a7690a41-7721-4edc-ad96-c5acd37cddbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:28.510566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a7690a41-7721-4edc-ad96-c5acd37cddbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:28.523613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a7690a41-7721-4edc-ad96-c5acd37cddbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:28.524364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a7690a41-7721-4edc-ad96-c5acd37cddbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:28.526079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a7690a41-7721-4edc-ad96-c5acd37cddbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:28.526695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a7690a41-7721-4edc-ad96-c5acd37cddbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:28.686584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a7690a41-7721-4edc-ad96-c5acd37cddbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:28.706289 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a7690a41-7721-4edc-ad96-c5acd37cddbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1277 microversion: 2.1 time: 0.219925 Aug 03 01:52:28.729341 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 678/1314] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:28 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1277 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:28.739444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f947676d-6de6-4ed4-9200-8109afdfea53 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:28.740507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f947676d-6de6-4ed4-9200-8109afdfea53 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:28.748008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f947676d-6de6-4ed4-9200-8109afdfea53 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:28.748969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f947676d-6de6-4ed4-9200-8109afdfea53 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:28.750537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f947676d-6de6-4ed4-9200-8109afdfea53 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:28.751237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f947676d-6de6-4ed4-9200-8109afdfea53 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:29.330037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f947676d-6de6-4ed4-9200-8109afdfea53 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:29.338533 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f947676d-6de6-4ed4-9200-8109afdfea53 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.607495 Aug 03 01:52:29.351491 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 679/1315] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:28 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:29.363670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7d410ed0-abe0-486f-9a5c-81ad078a491f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:29.364518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7d410ed0-abe0-486f-9a5c-81ad078a491f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:29.377894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d410ed0-abe0-486f-9a5c-81ad078a491f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:29.380127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d410ed0-abe0-486f-9a5c-81ad078a491f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:29.381718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d410ed0-abe0-486f-9a5c-81ad078a491f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:29.382386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d410ed0-abe0-486f-9a5c-81ad078a491f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:29.700943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:52:29.701650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:52:29.701846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:52:29.702438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:52:29.704281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:52:29.732151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:29.732764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:29.733596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:29.734248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:29.762334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Getting quotas for project c5b6cc7a4be94f7489c0f749f1b26276. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:52:29.772737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Getting quotas for user 5054cb049a374f2c8e26e6d62637f7cc and project c5b6cc7a4be94f7489c0f749f1b26276. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:52:29.790049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:29.795885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Going to run 3 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:52:29.798327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: e4222150-6354-462f-9144-fb034666c245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:52:29.849236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: 845f5c3f-62a6-4189-abbd-b2a17ba55f38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=e4222150-6354-462f-9144-fb034666c245,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:52:29.877372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7d410ed0-abe0-486f-9a5c-81ad078a491f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65845e9e08fb48ffb1c8cb0aff44dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214847079c8c4a749467c006295134d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:29.900804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=845f5c3f-62a6-4189-abbd-b2a17ba55f38,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:52:29.906588 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7d410ed0-abe0-486f-9a5c-81ad078a491f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 200 len: 1315 microversion: 2.1 time: 0.547809 Aug 03 01:52:29.907257 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 680/1316] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:29 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:29.925462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d75f57d3-6358-4957-bd27-7c242a74f1df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1060569561"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:29.926864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d75f57d3-6358-4957-bd27-7c242a74f1df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:29.943719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d75f57d3-6358-4957-bd27-7c242a74f1df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:29.947929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d75f57d3-6358-4957-bd27-7c242a74f1df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:29.951314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d75f57d3-6358-4957-bd27-7c242a74f1df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:29.952009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d75f57d3-6358-4957-bd27-7c242a74f1df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:30.010569 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-77720f09-017f-462f-8371-6af55c07b47b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.303361 Aug 03 01:52:30.011643 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 637/1317] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:52:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 01:52:30.017692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-5dea74c6-6f1f-4cad-a2a0-8a30f478595d req-03ae8c55-5300-4c6a-9349-5997ab259560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc37c4b2-3a5c-4b5a-af95-e531b4189c14", "name": "network-vif-plugged", "status": "completed", "tag": "c812e9e3-6174-45e3-8be9-fb30c589602c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:30.030456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5dea74c6-6f1f-4cad-a2a0-8a30f478595d req-03ae8c55-5300-4c6a-9349-5997ab259560 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:30.031039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5dea74c6-6f1f-4cad-a2a0-8a30f478595d req-03ae8c55-5300-4c6a-9349-5997ab259560 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:30.045862 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-5dea74c6-6f1f-4cad-a2a0-8a30f478595d req-03ae8c55-5300-4c6a-9349-5997ab259560 service nova] Creating event network-vif-plugged:c812e9e3-6174-45e3-8be9-fb30c589602c for instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 on n-h1-826529-8 Aug 03 01:52:30.053955 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-5dea74c6-6f1f-4cad-a2a0-8a30f478595d req-03ae8c55-5300-4c6a-9349-5997ab259560 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041096 Aug 03 01:52:30.054559 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 638/1318] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:30.061309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-16a2e2d5-8fdb-4be7-aca0-5fadc500ee6d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:30.062017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-16a2e2d5-8fdb-4be7-aca0-5fadc500ee6d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:30.068763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16a2e2d5-8fdb-4be7-aca0-5fadc500ee6d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:30.069202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16a2e2d5-8fdb-4be7-aca0-5fadc500ee6d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:30.070036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16a2e2d5-8fdb-4be7-aca0-5fadc500ee6d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:30.070478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16a2e2d5-8fdb-4be7-aca0-5fadc500ee6d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:30.219773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-16a2e2d5-8fdb-4be7-aca0-5fadc500ee6d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:30.236053 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-16a2e2d5-8fdb-4be7-aca0-5fadc500ee6d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1277 microversion: 2.1 time: 0.178167 Aug 03 01:52:30.238842 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 639/1319] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:30 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:30.248901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f9aa8b1e-6f82-421c-a553-5429e517c935 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:30.256070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f9aa8b1e-6f82-421c-a553-5429e517c935 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:30.257356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f9aa8b1e-6f82-421c-a553-5429e517c935 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Searching by: {'deleted': False, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:52:30.290718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9aa8b1e-6f82-421c-a553-5429e517c935 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:30.291316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9aa8b1e-6f82-421c-a553-5429e517c935 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:30.292798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9aa8b1e-6f82-421c-a553-5429e517c935 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:30.293252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9aa8b1e-6f82-421c-a553-5429e517c935 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:30.316834 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f9aa8b1e-6f82-421c-a553-5429e517c935 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.076763 Aug 03 01:52:30.317612 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 640/1320] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 3 01:52:30 2022] GET /compute/v2.1/servers => generated 1018 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:30.329614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-832dd217-e55f-4032-9b77-6b172793f07c tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:30.330056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-832dd217-e55f-4032-9b77-6b172793f07c tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:30.440140 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.network.security_group_api [None req-d75f57d3-6358-4957-bd27-7c242a74f1df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Adding security group 515f28c4-655d-487d-a086-8ddd8ea692c1 to port 68f18961-f100-488a-a34b-411aa3693cf3 Aug 03 01:52:30.461211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-832dd217-e55f-4032-9b77-6b172793f07c tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:30.472732 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-832dd217-e55f-4032-9b77-6b172793f07c tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 200 len: 1223 microversion: 2.1 time: 0.146326 Aug 03 01:52:30.474825 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 641/1321] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:30 2022] GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 1223 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:52:30.481349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e5044540-7a89-464b-8249-01dc012f8b94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:30.482101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e5044540-7a89-464b-8249-01dc012f8b94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:30.501271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5044540-7a89-464b-8249-01dc012f8b94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:30.501760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5044540-7a89-464b-8249-01dc012f8b94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:30.502795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5044540-7a89-464b-8249-01dc012f8b94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:30.503509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5044540-7a89-464b-8249-01dc012f8b94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:30.814528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e5044540-7a89-464b-8249-01dc012f8b94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:30.826759 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e5044540-7a89-464b-8249-01dc012f8b94 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.349456 Aug 03 01:52:30.827900 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 642/1322] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:30 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:30.933205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-de0071bc-67e2-418c-9ce0-191c9d9d1bc3 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:30.934534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-de0071bc-67e2-418c-9ce0-191c9d9d1bc3 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:30.941826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de0071bc-67e2-418c-9ce0-191c9d9d1bc3 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:30.942664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de0071bc-67e2-418c-9ce0-191c9d9d1bc3 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:30.943762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de0071bc-67e2-418c-9ce0-191c9d9d1bc3 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:30.944395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de0071bc-67e2-418c-9ce0-191c9d9d1bc3 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:31.404653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-de0071bc-67e2-418c-9ce0-191c9d9d1bc3 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65845e9e08fb48ffb1c8cb0aff44dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214847079c8c4a749467c006295134d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:31.407301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:31.415116 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-de0071bc-67e2-418c-9ce0-191c9d9d1bc3 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 200 len: 1315 microversion: 2.1 time: 0.486423 Aug 03 01:52:31.416913 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 643/1323] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:30 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:31.424343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ab3b6fd6-44e0-4464-9923-d5a1386b33a2 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:31.425379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ab3b6fd6-44e0-4464-9923-d5a1386b33a2 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:31.443168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab3b6fd6-44e0-4464-9923-d5a1386b33a2 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:31.443931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab3b6fd6-44e0-4464-9923-d5a1386b33a2 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:31.445078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab3b6fd6-44e0-4464-9923-d5a1386b33a2 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:31.447628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab3b6fd6-44e0-4464-9923-d5a1386b33a2 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:31.531146 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d75f57d3-6358-4957-bd27-7c242a74f1df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743/action" status: 202 len: 0 microversion: 2.1 time: 1.620366 Aug 03 01:52:31.531763 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 681/1324] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:52:29 2022] POST /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743/action => generated 0 bytes in 1622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:52:31.537655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7ff46e53-a40b-434d-b20c-055a6a6fd8f1 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:31.538279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7ff46e53-a40b-434d-b20c-055a6a6fd8f1 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:31.552110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ff46e53-a40b-434d-b20c-055a6a6fd8f1 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:31.554718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ff46e53-a40b-434d-b20c-055a6a6fd8f1 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:31.555777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ff46e53-a40b-434d-b20c-055a6a6fd8f1 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:31.556458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ff46e53-a40b-434d-b20c-055a6a6fd8f1 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:31.697222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7ff46e53-a40b-434d-b20c-055a6a6fd8f1 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:31.709888 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7ff46e53-a40b-434d-b20c-055a6a6fd8f1 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 200 len: 1275 microversion: 2.1 time: 0.177022 Aug 03 01:52:31.710483 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 682/1325] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:31 2022] GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 1275 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:31.728906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f1c8bb1c-263f-4c41-aa56-e409683d9149 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b132be160>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:31.876886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ab3b6fd6-44e0-4464-9923-d5a1386b33a2 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:31.891413 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ab3b6fd6-44e0-4464-9923-d5a1386b33a2 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1319 microversion: 2.1 time: 0.473029 Aug 03 01:52:31.892055 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 644/1326] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:31 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1319 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:31.896746 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-32ef99d5-b639-4321-aedc-1ffc2a1099b8 req-c38d1d97-e65b-45bb-8f96-9598de01a144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dabe69a-9513-4eee-afda-f3bda4a5c743", "tag": "68f18961-f100-488a-a34b-411aa3693cf3"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:31.924305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-32ef99d5-b639-4321-aedc-1ffc2a1099b8 req-c38d1d97-e65b-45bb-8f96-9598de01a144 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:31.924895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-32ef99d5-b639-4321-aedc-1ffc2a1099b8 req-c38d1d97-e65b-45bb-8f96-9598de01a144 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:31.948133 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-32ef99d5-b639-4321-aedc-1ffc2a1099b8 req-c38d1d97-e65b-45bb-8f96-9598de01a144 service nova] Creating event network-changed:68f18961-f100-488a-a34b-411aa3693cf3 for instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 on n-h2-826529-8 Aug 03 01:52:31.963978 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-32ef99d5-b639-4321-aedc-1ffc2a1099b8 req-c38d1d97-e65b-45bb-8f96-9598de01a144 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070566 Aug 03 01:52:31.965417 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 645/1327] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:31.978171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d8ba716-9980-4a6f-9157-f5381c482a61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:31.981977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8d8ba716-9980-4a6f-9157-f5381c482a61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:31.996478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d8ba716-9980-4a6f-9157-f5381c482a61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:31.996940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d8ba716-9980-4a6f-9157-f5381c482a61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:31.997741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d8ba716-9980-4a6f-9157-f5381c482a61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:31.998410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d8ba716-9980-4a6f-9157-f5381c482a61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:32.785081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG neutronclient.v2_0.client [None req-f1c8bb1c-263f-4c41-aa56-e409683d9149 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 515f28c4-655d-487d-a086-8ddd8ea692c1 in use.", "detail": ""}} {{(pid=125941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:52:32.787572 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-f1c8bb1c-263f-4c41-aa56-e409683d9149 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Security Group 515f28c4-655d-487d-a086-8ddd8ea692c1 in use. Aug 03 01:52:32.787572 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-e1e52c5e-7fbb-4254-b8f3-f4a4db1eb816'] Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f1c8bb1c-263f-4c41-aa56-e409683d9149 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/os-security-groups/515f28c4-655d-487d-a086-8ddd8ea692c1 HTTP/1.1 Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: exception: Security Group 515f28c4-655d-487d-a086-8ddd8ea692c1 in use. Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-e1e52c5e-7fbb-4254-b8f3-f4a4db1eb816'] Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '515f28c4-655d-487d-a086-8ddd8ea692c1'} Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:52:32.790009 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 515f28c4-655d-487d-a086-8ddd8ea692c1 in use. Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1e52c5e-7fbb-4254-b8f3-f4a4db1eb816'] Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 515f28c4-655d-487d-a086-8ddd8ea692c1 in use. Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1e52c5e-7fbb-4254-b8f3-f4a4db1eb816'] Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 515f28c4-655d-487d-a086-8ddd8ea692c1 in use. Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1e52c5e-7fbb-4254-b8f3-f4a4db1eb816'] Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 515f28c4-655d-487d-a086-8ddd8ea692c1 in use. Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1e52c5e-7fbb-4254-b8f3-f4a4db1eb816'] Aug 03 01:52:32.795374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:32.799965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f1c8bb1c-263f-4c41-aa56-e409683d9149 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 400 to user: Security Group 515f28c4-655d-487d-a086-8ddd8ea692c1 in use. Aug 03 01:52:32.799965 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-e1e52c5e-7fbb-4254-b8f3-f4a4db1eb816'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:32.801288 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f1c8bb1c-263f-4c41-aa56-e409683d9149 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/515f28c4-655d-487d-a086-8ddd8ea692c1" status: 400 len: 185 microversion: 2.1 time: 1.089704 Aug 03 01:52:32.802233 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 683/1328] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:52:31 2022] DELETE /compute/v2.1/os-security-groups/515f28c4-655d-487d-a086-8ddd8ea692c1 => generated 185 bytes in 1091 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:52:32.811995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0e464755-ebaa-4085-916f-a22b6f4855a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:32.812996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0e464755-ebaa-4085-916f-a22b6f4855a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:32.823032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e464755-ebaa-4085-916f-a22b6f4855a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:32.823857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e464755-ebaa-4085-916f-a22b6f4855a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:32.824914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e464755-ebaa-4085-916f-a22b6f4855a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:32.825551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e464755-ebaa-4085-916f-a22b6f4855a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:33.125727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8d8ba716-9980-4a6f-9157-f5381c482a61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:33.144567 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8d8ba716-9980-4a6f-9157-f5381c482a61 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 1.176699 Aug 03 01:52:33.147013 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 646/1329] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:31 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:33.158536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3126d7b5-5992-4760-b0ee-794e6be04613 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:33.159899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3126d7b5-5992-4760-b0ee-794e6be04613 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:33.169241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3126d7b5-5992-4760-b0ee-794e6be04613 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:33.170118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3126d7b5-5992-4760-b0ee-794e6be04613 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:33.170978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3126d7b5-5992-4760-b0ee-794e6be04613 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:33.171687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3126d7b5-5992-4760-b0ee-794e6be04613 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:33.200997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0e464755-ebaa-4085-916f-a22b6f4855a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65845e9e08fb48ffb1c8cb0aff44dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214847079c8c4a749467c006295134d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:33.216015 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0e464755-ebaa-4085-916f-a22b6f4855a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 200 len: 1503 microversion: 2.1 time: 0.412331 Aug 03 01:52:33.216730 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 684/1330] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:32 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 1503 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:33.235363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-82506c3d-4dcb-4e14-981a-93ac4edade53 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:33.238480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-82506c3d-4dcb-4e14-981a-93ac4edade53 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:33.251445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82506c3d-4dcb-4e14-981a-93ac4edade53 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:33.252273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82506c3d-4dcb-4e14-981a-93ac4edade53 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:33.253235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82506c3d-4dcb-4e14-981a-93ac4edade53 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:33.253839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82506c3d-4dcb-4e14-981a-93ac4edade53 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:33.366396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3126d7b5-5992-4760-b0ee-794e6be04613 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:33.377742 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3126d7b5-5992-4760-b0ee-794e6be04613 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 200 len: 1281 microversion: 2.1 time: 0.228849 Aug 03 01:52:33.380631 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 647/1331] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:33 2022] GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 1281 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:33.388621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9058c2a7-50af-4161-b2d6-e1bbb477aba5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:33.391600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9058c2a7-50af-4161-b2d6-e1bbb477aba5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:33.396519 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-82506c3d-4dcb-4e14-981a-93ac4edade53 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743/action" status: 202 len: 0 microversion: 2.1 time: 0.178215 Aug 03 01:52:33.397465 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 685/1332] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:52:33 2022] POST /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:52:33.413034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9058c2a7-50af-4161-b2d6-e1bbb477aba5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:33.413483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9058c2a7-50af-4161-b2d6-e1bbb477aba5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:33.414057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7abc0798-d295-4575-8d5b-b93e494d8fb1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:33.414756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7abc0798-d295-4575-8d5b-b93e494d8fb1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:33.419100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9058c2a7-50af-4161-b2d6-e1bbb477aba5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:33.419514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9058c2a7-50af-4161-b2d6-e1bbb477aba5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:33.435338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7abc0798-d295-4575-8d5b-b93e494d8fb1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:33.436289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7abc0798-d295-4575-8d5b-b93e494d8fb1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:33.437105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7abc0798-d295-4575-8d5b-b93e494d8fb1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:33.437727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7abc0798-d295-4575-8d5b-b93e494d8fb1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:33.468558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7abc0798-d295-4575-8d5b-b93e494d8fb1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:52:33.512028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:33.607230 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7abc0798-d295-4575-8d5b-b93e494d8fb1 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 204 len: 0 microversion: 2.1 time: 0.207560 Aug 03 01:52:33.608580 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 686/1333] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:52:33 2022] DELETE /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:52:33.616867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e40922d-5381-4c0b-abd9-af20a68ec739 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:33.617847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3e40922d-5381-4c0b-abd9-af20a68ec739 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:33.626137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e40922d-5381-4c0b-abd9-af20a68ec739 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:33.626773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e40922d-5381-4c0b-abd9-af20a68ec739 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:33.627782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e40922d-5381-4c0b-abd9-af20a68ec739 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:33.628379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e40922d-5381-4c0b-abd9-af20a68ec739 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:33.809917 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9058c2a7-50af-4161-b2d6-e1bbb477aba5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:33.817757 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9058c2a7-50af-4161-b2d6-e1bbb477aba5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1319 microversion: 2.1 time: 0.435705 Aug 03 01:52:33.830963 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 648/1334] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:33 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:33.836626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93d47da0-5774-4994-86bb-8770f44805bc tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:33.837050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93d47da0-5774-4994-86bb-8770f44805bc tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:33.844217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d47da0-5774-4994-86bb-8770f44805bc tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:33.845873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d47da0-5774-4994-86bb-8770f44805bc tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:33.847196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d47da0-5774-4994-86bb-8770f44805bc tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:33.847837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d47da0-5774-4994-86bb-8770f44805bc tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:34.028754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3e40922d-5381-4c0b-abd9-af20a68ec739 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:34.036796 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e40922d-5381-4c0b-abd9-af20a68ec739 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1574 microversion: 2.1 time: 0.426766 Aug 03 01:52:34.043574 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 687/1335] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:33 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1574 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:34.118787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-ca2839dd-7365-4f5f-a331-a1d5bd69c159 req-230f8058-29ab-4113-9941-5d8e285c39bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf0a0ec2-f2fb-49be-97ad-48bde7053e9a", "tag": "a180f2da-fc64-4024-9832-25e1d3488fcb"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:34.145403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ca2839dd-7365-4f5f-a331-a1d5bd69c159 req-230f8058-29ab-4113-9941-5d8e285c39bd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:34.146217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ca2839dd-7365-4f5f-a331-a1d5bd69c159 req-230f8058-29ab-4113-9941-5d8e285c39bd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:34.163950 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-ca2839dd-7365-4f5f-a331-a1d5bd69c159 req-230f8058-29ab-4113-9941-5d8e285c39bd service nova] Creating event network-changed:a180f2da-fc64-4024-9832-25e1d3488fcb for instance cf0a0ec2-f2fb-49be-97ad-48bde7053e9a on n-h1-826529-8 Aug 03 01:52:34.179038 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-ca2839dd-7365-4f5f-a331-a1d5bd69c159 req-230f8058-29ab-4113-9941-5d8e285c39bd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063920 Aug 03 01:52:34.180381 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 688/1336] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:52:34.186842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1c03f4ec-f424-4e34-8d4b-6f079d4b78a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:34.187594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1c03f4ec-f424-4e34-8d4b-6f079d4b78a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:34.190871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=85,nova_api:SAVEPOINT=5,nova_api:INSERT=2,nova_api:RELEASE=5,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:34.207006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-93d47da0-5774-4994-86bb-8770f44805bc tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65845e9e08fb48ffb1c8cb0aff44dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214847079c8c4a749467c006295134d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:34.211630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c03f4ec-f424-4e34-8d4b-6f079d4b78a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:34.212847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c03f4ec-f424-4e34-8d4b-6f079d4b78a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:34.213710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c03f4ec-f424-4e34-8d4b-6f079d4b78a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:34.214161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c03f4ec-f424-4e34-8d4b-6f079d4b78a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:34.219570 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93d47da0-5774-4994-86bb-8770f44805bc tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 200 len: 1509 microversion: 2.1 time: 0.399559 Aug 03 01:52:34.220574 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 649/1337] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:33 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 1509 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:34.404422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0f73fa10-715e-4713-878c-de9acfed0c6d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:34.405241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0f73fa10-715e-4713-878c-de9acfed0c6d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:34.414385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f73fa10-715e-4713-878c-de9acfed0c6d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:34.416077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f73fa10-715e-4713-878c-de9acfed0c6d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:34.416944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f73fa10-715e-4713-878c-de9acfed0c6d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:34.417397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f73fa10-715e-4713-878c-de9acfed0c6d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:34.432506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1c03f4ec-f424-4e34-8d4b-6f079d4b78a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:34.441150 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1c03f4ec-f424-4e34-8d4b-6f079d4b78a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.259030 Aug 03 01:52:34.442079 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 689/1338] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:34 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:34.496668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0f73fa10-715e-4713-878c-de9acfed0c6d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:34.511926 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0f73fa10-715e-4713-878c-de9acfed0c6d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 200 len: 1281 microversion: 2.1 time: 0.114189 Aug 03 01:52:34.512984 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 650/1339] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:34 2022] GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 1281 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:34.845083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b2f2db10-f092-4e58-85f9-3692304e72ee tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:34.846229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b2f2db10-f092-4e58-85f9-3692304e72ee tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:34.854037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2f2db10-f092-4e58-85f9-3692304e72ee tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:34.854492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2f2db10-f092-4e58-85f9-3692304e72ee tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:34.856332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2f2db10-f092-4e58-85f9-3692304e72ee tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:34.856989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2f2db10-f092-4e58-85f9-3692304e72ee tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:35.081457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6660b0cb-0fcd-43be-a479-f6f541d0d506 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:35.082816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6660b0cb-0fcd-43be-a479-f6f541d0d506 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:35.083454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b2f2db10-f092-4e58-85f9-3692304e72ee tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:35.095047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6660b0cb-0fcd-43be-a479-f6f541d0d506 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:35.096064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6660b0cb-0fcd-43be-a479-f6f541d0d506 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:35.098372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6660b0cb-0fcd-43be-a479-f6f541d0d506 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:35.099120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6660b0cb-0fcd-43be-a479-f6f541d0d506 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:35.119487 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b2f2db10-f092-4e58-85f9-3692304e72ee tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1319 microversion: 2.1 time: 0.276344 Aug 03 01:52:35.120240 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 690/1340] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:34 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:52:35.242084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b9191a4e-1f5a-4750-8ec2-f882454820a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:35.242701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b9191a4e-1f5a-4750-8ec2-f882454820a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:35.250285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9191a4e-1f5a-4750-8ec2-f882454820a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:35.250746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9191a4e-1f5a-4750-8ec2-f882454820a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:35.251629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9191a4e-1f5a-4750-8ec2-f882454820a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:35.252067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9191a4e-1f5a-4750-8ec2-f882454820a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:35.395469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6660b0cb-0fcd-43be-a479-f6f541d0d506 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:35.413765 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6660b0cb-0fcd-43be-a479-f6f541d0d506 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1574 microversion: 2.1 time: 0.333317 Aug 03 01:52:35.414839 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 651/1341] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:35 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1574 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:35.465378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d2b98ee-1382-4c37-bd58-ee2f104a96c3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:35.466129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8d2b98ee-1382-4c37-bd58-ee2f104a96c3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:35.476986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d2b98ee-1382-4c37-bd58-ee2f104a96c3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:35.477591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d2b98ee-1382-4c37-bd58-ee2f104a96c3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:35.483516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d2b98ee-1382-4c37-bd58-ee2f104a96c3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:35.483993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d2b98ee-1382-4c37-bd58-ee2f104a96c3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:35.487490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b9191a4e-1f5a-4750-8ec2-f882454820a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65845e9e08fb48ffb1c8cb0aff44dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214847079c8c4a749467c006295134d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:35.498801 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b9191a4e-1f5a-4750-8ec2-f882454820a2 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 200 len: 1509 microversion: 2.1 time: 0.261401 Aug 03 01:52:35.501088 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 691/1342] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:35 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:52:35.534183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2b5b847c-85cc-4d6e-be3e-b138720b2e8d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:35.535420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2b5b847c-85cc-4d6e-be3e-b138720b2e8d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:35.543344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b5b847c-85cc-4d6e-be3e-b138720b2e8d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:35.544213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b5b847c-85cc-4d6e-be3e-b138720b2e8d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:35.545223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b5b847c-85cc-4d6e-be3e-b138720b2e8d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:35.545749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b5b847c-85cc-4d6e-be3e-b138720b2e8d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:35.920675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8d2b98ee-1382-4c37-bd58-ee2f104a96c3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:35.927591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=10 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:35.929039 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8d2b98ee-1382-4c37-bd58-ee2f104a96c3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.469083 Aug 03 01:52:35.934444 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 652/1343] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:35 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:35.945855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2b5b847c-85cc-4d6e-be3e-b138720b2e8d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:35.958470 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2b5b847c-85cc-4d6e-be3e-b138720b2e8d tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 200 len: 1323 microversion: 2.1 time: 0.428088 Aug 03 01:52:35.960153 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 692/1344] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:35 2022] GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 1323 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:36.140980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-629f5e5f-0a25-461b-a997-2c6fdfc886be tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:36.142058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-629f5e5f-0a25-461b-a997-2c6fdfc886be tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:36.151831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-629f5e5f-0a25-461b-a997-2c6fdfc886be tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:36.152535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-629f5e5f-0a25-461b-a997-2c6fdfc886be tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:36.153566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-629f5e5f-0a25-461b-a997-2c6fdfc886be tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:36.154186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-629f5e5f-0a25-461b-a997-2c6fdfc886be tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:36.440834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3f4258dc-f095-4786-9045-1a9b6bc58f36 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:36.441938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3f4258dc-f095-4786-9045-1a9b6bc58f36 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:36.453035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f4258dc-f095-4786-9045-1a9b6bc58f36 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:36.454048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f4258dc-f095-4786-9045-1a9b6bc58f36 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:36.455714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f4258dc-f095-4786-9045-1a9b6bc58f36 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:36.456507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f4258dc-f095-4786-9045-1a9b6bc58f36 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:36.541099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-629f5e5f-0a25-461b-a997-2c6fdfc886be tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:36.552898 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-629f5e5f-0a25-461b-a997-2c6fdfc886be tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1319 microversion: 2.1 time: 0.414384 Aug 03 01:52:36.567759 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 653/1345] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:36 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1319 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:36.573335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c04fe05f-60d1-4849-970e-ceebd03688db tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:36.575135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c04fe05f-60d1-4849-970e-ceebd03688db tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:36.583880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c04fe05f-60d1-4849-970e-ceebd03688db tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:36.584980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c04fe05f-60d1-4849-970e-ceebd03688db tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:36.588115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c04fe05f-60d1-4849-970e-ceebd03688db tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:36.589044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c04fe05f-60d1-4849-970e-ceebd03688db tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:37.023088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c04fe05f-60d1-4849-970e-ceebd03688db tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65845e9e08fb48ffb1c8cb0aff44dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214847079c8c4a749467c006295134d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:37.038188 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c04fe05f-60d1-4849-970e-ceebd03688db tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 200 len: 1509 microversion: 2.1 time: 0.468810 Aug 03 01:52:37.040038 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 654/1346] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:36 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 1509 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:37.046016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7250c262-b911-4c35-8b0c-ce3578b0c94d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:37.046833 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7250c262-b911-4c35-8b0c-ce3578b0c94d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:37.059710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7250c262-b911-4c35-8b0c-ce3578b0c94d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:37.060323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7250c262-b911-4c35-8b0c-ce3578b0c94d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:37.062164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7250c262-b911-4c35-8b0c-ce3578b0c94d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:37.063399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7250c262-b911-4c35-8b0c-ce3578b0c94d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:37.068364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3f4258dc-f095-4786-9045-1a9b6bc58f36 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:37.080932 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3f4258dc-f095-4786-9045-1a9b6bc58f36 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1574 microversion: 2.1 time: 0.648575 Aug 03 01:52:37.081544 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 693/1347] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:36 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1574 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:52:37.091896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e4408e1a-b86a-4212-bb12-a395e684e820 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:37.091896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e4408e1a-b86a-4212-bb12-a395e684e820 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:37.101778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4408e1a-b86a-4212-bb12-a395e684e820 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:37.102616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4408e1a-b86a-4212-bb12-a395e684e820 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:37.103541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4408e1a-b86a-4212-bb12-a395e684e820 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:37.103991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4408e1a-b86a-4212-bb12-a395e684e820 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:37.404535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7250c262-b911-4c35-8b0c-ce3578b0c94d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:37.412391 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7250c262-b911-4c35-8b0c-ce3578b0c94d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.370769 Aug 03 01:52:37.417658 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 655/1348] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:37 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:37.438710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e4408e1a-b86a-4212-bb12-a395e684e820 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:37.452605 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e4408e1a-b86a-4212-bb12-a395e684e820 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 200 len: 1323 microversion: 2.1 time: 0.367864 Aug 03 01:52:37.453520 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 694/1349] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:37 2022] GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 1323 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:37.541862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1b5fc872-7b05-43d1-902e-ecc9418de26f tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:37.542484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1b5fc872-7b05-43d1-902e-ecc9418de26f tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:37.548894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b5fc872-7b05-43d1-902e-ecc9418de26f tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:37.549359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b5fc872-7b05-43d1-902e-ecc9418de26f tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:37.550487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b5fc872-7b05-43d1-902e-ecc9418de26f tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:37.550959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b5fc872-7b05-43d1-902e-ecc9418de26f tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:37.578492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03752641-aef2-4007-a972-54f5a1dc1d34 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:37.579575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-03752641-aef2-4007-a972-54f5a1dc1d34 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:37.588815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03752641-aef2-4007-a972-54f5a1dc1d34 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:37.590601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03752641-aef2-4007-a972-54f5a1dc1d34 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:37.592507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03752641-aef2-4007-a972-54f5a1dc1d34 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:37.593123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03752641-aef2-4007-a972-54f5a1dc1d34 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:37.903288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03752641-aef2-4007-a972-54f5a1dc1d34 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:37.933833 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03752641-aef2-4007-a972-54f5a1dc1d34 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1319 microversion: 2.1 time: 0.352046 Aug 03 01:52:37.935395 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 695/1350] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:37 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:37.952145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-24ec132a-f53c-462a-93e2-100fa0d6972a req-8366dad1-b5fd-4552-a56a-4c704796cbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc37c4b2-3a5c-4b5a-af95-e531b4189c14", "name": "network-vif-deleted", "tag": "c812e9e3-6174-45e3-8be9-fb30c589602c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:37.966196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-24ec132a-f53c-462a-93e2-100fa0d6972a req-8366dad1-b5fd-4552-a56a-4c704796cbe5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:37.966637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-24ec132a-f53c-462a-93e2-100fa0d6972a req-8366dad1-b5fd-4552-a56a-4c704796cbe5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:37.983132 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-24ec132a-f53c-462a-93e2-100fa0d6972a req-8366dad1-b5fd-4552-a56a-4c704796cbe5 service nova] Creating event network-vif-deleted:c812e9e3-6174-45e3-8be9-fb30c589602c for instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 on n-h1-826529-8 Aug 03 01:52:37.989377 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-24ec132a-f53c-462a-93e2-100fa0d6972a req-8366dad1-b5fd-4552-a56a-4c704796cbe5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050497 Aug 03 01:52:37.997260 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 696/1351] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:38.006226 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1b5fc872-7b05-43d1-902e-ecc9418de26f tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1814 microversion: 2.1 time: 0.465647 Aug 03 01:52:38.007914 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 656/1352] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:37 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1814 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:38.029478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-661b93db-e4de-46a3-bea4-c34da7998598 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:38.032080 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:52:38.032080 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:52:38.033617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-661b93db-e4de-46a3-bea4-c34da7998598 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:38.034088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-661b93db-e4de-46a3-bea4-c34da7998598 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:38.034918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-661b93db-e4de-46a3-bea4-c34da7998598 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:38.035951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-661b93db-e4de-46a3-bea4-c34da7998598 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:38.114923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-16632626", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:38.242049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] validate_networks() for [('50acd5e9-f476-4abd-a942-40fd931a4eb0', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:52:38.299501 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-661b93db-e4de-46a3-bea4-c34da7998598 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.274024 Aug 03 01:52:38.308155 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 657/1353] 10.222.0.67 () {58 vars in 1176 bytes} [Wed Aug 3 01:52:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:52:38.313385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-33340863-2f66-4f5e-a105-162cd195acac tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:38.314004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-33340863-2f66-4f5e-a105-162cd195acac tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:38.320756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33340863-2f66-4f5e-a105-162cd195acac tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:38.321358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33340863-2f66-4f5e-a105-162cd195acac tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:38.322152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33340863-2f66-4f5e-a105-162cd195acac tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:38.322591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33340863-2f66-4f5e-a105-162cd195acac tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:38.525649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-33340863-2f66-4f5e-a105-162cd195acac tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65845e9e08fb48ffb1c8cb0aff44dcbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214847079c8c4a749467c006295134d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:38.538015 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-33340863-2f66-4f5e-a105-162cd195acac tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 200 len: 1467 microversion: 2.1 time: 0.228523 Aug 03 01:52:38.554943 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 658/1354] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:38 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 1467 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:38.554943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-803f0f72-808b-45e5-b605-5d5249bbb9df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:38.554943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-803f0f72-808b-45e5-b605-5d5249bbb9df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:38.568264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-803f0f72-808b-45e5-b605-5d5249bbb9df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:38.568883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-803f0f72-808b-45e5-b605-5d5249bbb9df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:38.569710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-803f0f72-808b-45e5-b605-5d5249bbb9df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:38.570159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-803f0f72-808b-45e5-b605-5d5249bbb9df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:39.046340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-803f0f72-808b-45e5-b605-5d5249bbb9df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:39.059098 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-803f0f72-808b-45e5-b605-5d5249bbb9df tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1572 microversion: 2.1 time: 0.511250 Aug 03 01:52:39.060658 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 659/1355] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:38 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1572 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:39.074885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-56cc5f4c-ddfc-4b8d-90c4-017d1f305bea tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:39.077658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-56cc5f4c-ddfc-4b8d-90c4-017d1f305bea tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:39.098276 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56cc5f4c-ddfc-4b8d-90c4-017d1f305bea tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:39.099611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56cc5f4c-ddfc-4b8d-90c4-017d1f305bea tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:39.102398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56cc5f4c-ddfc-4b8d-90c4-017d1f305bea tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:39.103721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56cc5f4c-ddfc-4b8d-90c4-017d1f305bea tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:39.838285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:52:39.838809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:52:39.839417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:52:39.840220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:52:39.840851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:52:39.845932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-56cc5f4c-ddfc-4b8d-90c4-017d1f305bea tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:39.854659 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-56cc5f4c-ddfc-4b8d-90c4-017d1f305bea tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.792899 Aug 03 01:52:39.855774 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 660/1356] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:39 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:39.861656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6f45d452-14c0-4001-be12-0a818b4f13ac tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:39.862267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6f45d452-14c0-4001-be12-0a818b4f13ac tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:39.871367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f45d452-14c0-4001-be12-0a818b4f13ac tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:39.871829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f45d452-14c0-4001-be12-0a818b4f13ac tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:39.872627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f45d452-14c0-4001-be12-0a818b4f13ac tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:39.873077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f45d452-14c0-4001-be12-0a818b4f13ac tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:39.916003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:39.921486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:39.924178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:39.924629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:39.949434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Getting quotas for project c183e2fc6dbb419fbd8fa81c90163adf. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:52:39.958965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Getting quotas for user 0b99d344c16b4221bcccfe37d32bb69e and project c183e2fc6dbb419fbd8fa81c90163adf. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:52:39.983904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:52:39.994836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:52:40.048391 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-76150065-9f7e-4734-a31e-5e3f412f10ed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.044309 Aug 03 01:52:40.049788 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 697/1357] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:52:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:52:40.056472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a46e059b-bd39-4199-beb1-e4d659f34d4b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:40.057328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a46e059b-bd39-4199-beb1-e4d659f34d4b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:40.067836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a46e059b-bd39-4199-beb1-e4d659f34d4b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:40.068586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a46e059b-bd39-4199-beb1-e4d659f34d4b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:40.069382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a46e059b-bd39-4199-beb1-e4d659f34d4b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:40.069982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a46e059b-bd39-4199-beb1-e4d659f34d4b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:40.090215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6f45d452-14c0-4001-be12-0a818b4f13ac tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:40.092728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:40.101022 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6f45d452-14c0-4001-be12-0a818b4f13ac tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 200 len: 1323 microversion: 2.1 time: 0.244005 Aug 03 01:52:40.102837 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 661/1358] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:39 2022] GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 1323 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:40.124812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-66ccab78-318f-4f04-9d15-a76fc09d8986 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-174049585"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:40.128743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-66ccab78-318f-4f04-9d15-a76fc09d8986 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:40.137435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66ccab78-318f-4f04-9d15-a76fc09d8986 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:40.138174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66ccab78-318f-4f04-9d15-a76fc09d8986 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:40.139199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66ccab78-318f-4f04-9d15-a76fc09d8986 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:40.140252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66ccab78-318f-4f04-9d15-a76fc09d8986 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:40.414772 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.network.security_group_api [None req-66ccab78-318f-4f04-9d15-a76fc09d8986 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Adding security group 0e81b5c3-1530-4b77-b907-2d71efdaae38 to port 68f18961-f100-488a-a34b-411aa3693cf3 Aug 03 01:52:40.454494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a46e059b-bd39-4199-beb1-e4d659f34d4b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:40.465493 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a46e059b-bd39-4199-beb1-e4d659f34d4b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1319 microversion: 2.1 time: 0.414279 Aug 03 01:52:40.466186 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 698/1359] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:40 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:40.471189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=14 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:40.489023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8864d927-816c-45ba-893f-baeff1b49506 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:40.489777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8864d927-816c-45ba-893f-baeff1b49506 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:40.512165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8864d927-816c-45ba-893f-baeff1b49506 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:40.512991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8864d927-816c-45ba-893f-baeff1b49506 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:40.514307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8864d927-816c-45ba-893f-baeff1b49506 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:40.515108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8864d927-816c-45ba-893f-baeff1b49506 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:40.533644 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-8864d927-816c-45ba-893f-baeff1b49506 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] HTTP exception thrown: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8864d927-816c-45ba-893f-baeff1b49506 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Request method failure captured: Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 HTTP/1.1 Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dTMGJkFbvvq0n59HmBTiKDw-uqwxw18ZgJkZthGl8n8gZwliamPB7lJam3lfDlYeQB-CIoz0zW8v4r_bF7mwoRG95sEG4I3PsEbqRF3T4UndlanZfB7-0uAcAXh_cw87kOBlJ5AU0SEt9NtOGlKzzEcg2zMDMrt0sVcLh3KT5n1QP8 Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 214847079c8c4a749467c006295134d6 Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_214847079c8c4a749467c006295134d6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/214847079c8c4a749467c006295134d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/214847079c8c4a749467c006295134d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/214847079c8c4a749467c006295134d6"}]}] Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 214847079c8c4a749467c006295134d6 Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesNegativeTestJSON-1551841932-project Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 65845e9e08fb48ffb1c8cb0aff44dcbe Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesNegativeTestJSON-1551841932-project Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'bc37c4b2-3a5c-4b5a-af95-e531b4189c14'} Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:40.538329 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:40.544970 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:40.544970 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:40.544970 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:40.544970 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:40.544970 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:40.544970 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:40.544970 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:40.550195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8864d927-816c-45ba-893f-baeff1b49506 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Returning 404 to user: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:40.550987 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8864d927-816c-45ba-893f-baeff1b49506 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 404 len: 111 microversion: 2.1 time: 0.065759 Aug 03 01:52:40.552107 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 699/1360] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:40 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:40.557878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-80fdde6a-ce63-43a2-9c04-659157d79578 req-c3db168b-2d98-42c7-a5a2-158de3938ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "845f5c3f-62a6-4189-abbd-b2a17ba55f38", "tag": "8aff25ff-979c-4a9b-9b62-32c97b9a15e5"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:40.571765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-80fdde6a-ce63-43a2-9c04-659157d79578 req-c3db168b-2d98-42c7-a5a2-158de3938ec9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:40.572229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-80fdde6a-ce63-43a2-9c04-659157d79578 req-c3db168b-2d98-42c7-a5a2-158de3938ec9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:40.584693 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-80fdde6a-ce63-43a2-9c04-659157d79578 req-c3db168b-2d98-42c7-a5a2-158de3938ec9 service nova] Creating event network-changed:8aff25ff-979c-4a9b-9b62-32c97b9a15e5 for instance 845f5c3f-62a6-4189-abbd-b2a17ba55f38 on n-h2-826529-8 Aug 03 01:52:40.592127 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-80fdde6a-ce63-43a2-9c04-659157d79578 req-c3db168b-2d98-42c7-a5a2-158de3938ec9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038118 Aug 03 01:52:40.593409 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 700/1361] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:40.601470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-84ae37b8-f57e-4be9-b901-4e793eb3072e req-89b9ef5c-3769-4344-8d17-87ea1d4a5295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4222150-6354-462f-9144-fb034666c245", "tag": "36b9e373-873b-4320-8a0b-48a7bbd3f55d"}, {"name": "network-changed", "server_uuid": "ec36c462-8671-411f-837a-0c22e607522f", "tag": "94f25114-4a83-4024-9d63-a3813c3d54b3"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:40.627331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-84ae37b8-f57e-4be9-b901-4e793eb3072e req-89b9ef5c-3769-4344-8d17-87ea1d4a5295 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:40.627331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-84ae37b8-f57e-4be9-b901-4e793eb3072e req-89b9ef5c-3769-4344-8d17-87ea1d4a5295 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:40.636120 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-84ae37b8-f57e-4be9-b901-4e793eb3072e req-89b9ef5c-3769-4344-8d17-87ea1d4a5295 service nova] Creating event network-changed:36b9e373-873b-4320-8a0b-48a7bbd3f55d for instance e4222150-6354-462f-9144-fb034666c245 on n-h2-826529-8 Aug 03 01:52:40.637236 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-84ae37b8-f57e-4be9-b901-4e793eb3072e req-89b9ef5c-3769-4344-8d17-87ea1d4a5295 service nova] Creating event network-changed:94f25114-4a83-4024-9d63-a3813c3d54b3 for instance ec36c462-8671-411f-837a-0c22e607522f on n-h1-826529-8 Aug 03 01:52:40.652894 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-84ae37b8-f57e-4be9-b901-4e793eb3072e req-89b9ef5c-3769-4344-8d17-87ea1d4a5295 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.056723 Aug 03 01:52:40.654541 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 701/1362] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:40.665225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4a3670a6-ef1d-487d-872b-6ccb531dd6dc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:40.666445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4a3670a6-ef1d-487d-872b-6ccb531dd6dc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:40.798816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4a3670a6-ef1d-487d-872b-6ccb531dd6dc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:40.812984 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4a3670a6-ef1d-487d-872b-6ccb531dd6dc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1220 microversion: 2.1 time: 0.154511 Aug 03 01:52:40.815152 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 702/1363] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:40 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1220 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:40.832759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-72fbb081-cfa3-42f3-8267-4e463f609d9c tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1932261755", "metadata": {"image_type": "test"}}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:40.861965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-72fbb081-cfa3-42f3-8267-4e463f609d9c tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:40.895470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72fbb081-cfa3-42f3-8267-4e463f609d9c tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:40.899445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72fbb081-cfa3-42f3-8267-4e463f609d9c tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:40.901235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72fbb081-cfa3-42f3-8267-4e463f609d9c tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:40.905166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72fbb081-cfa3-42f3-8267-4e463f609d9c tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:40.951411 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-72fbb081-cfa3-42f3-8267-4e463f609d9c tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] HTTP exception thrown: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-72fbb081-cfa3-42f3-8267-4e463f609d9c tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Request method failure captured: Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14/action HTTP/1.1 Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 112 Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dTMGJkFbvvq0n59HmBTiKDw-uqwxw18ZgJkZthGl8n8gZwliamPB7lJam3lfDlYeQB-CIoz0zW8v4r_bF7mwoRG95sEG4I3PsEbqRF3T4UndlanZfB7-0uAcAXh_cw87kOBlJ5AU0SEt9NtOGlKzzEcg2zMDMrt0sVcLh3KT5n1QP8 Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 214847079c8c4a749467c006295134d6 Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_214847079c8c4a749467c006295134d6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/214847079c8c4a749467c006295134d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/214847079c8c4a749467c006295134d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/214847079c8c4a749467c006295134d6"}]}] Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 214847079c8c4a749467c006295134d6 Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesNegativeTestJSON-1551841932-project Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 65845e9e08fb48ffb1c8cb0aff44dcbe Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesNegativeTestJSON-1551841932-project Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1932261755", "metadata": {"image_type": "test"}}} Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'bc37c4b2-3a5c-4b5a-af95-e531b4189c14', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1932261755', 'metadata': {'image_type': 'test'}}}} Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 03 01:52:40.953870 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 01:52:40.959342 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:52:40.959342 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:52:40.959342 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:52:40.959342 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:40.959342 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:40.959342 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:40.959342 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:40.959342 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:40.959342 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:40.959342 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:40.959342 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:40.959342 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:40.959342 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:40.959342 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:40.959342 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:40.962605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-72fbb081-cfa3-42f3-8267-4e463f609d9c tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Returning 404 to user: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:40.963985 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-72fbb081-cfa3-42f3-8267-4e463f609d9c tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "POST /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14/action" status: 404 len: 111 microversion: 2.1 time: 0.147597 Aug 03 01:52:40.970038 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 703/1364] 10.222.0.67 () {60 vars in 1279 bytes} [Wed Aug 3 01:52:40 2022] POST /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14/action => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:40.976919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9489786b-da93-4865-8821-b67ed1095e57 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:40.978403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9489786b-da93-4865-8821-b67ed1095e57 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:40.986773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9489786b-da93-4865-8821-b67ed1095e57 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:40.987823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9489786b-da93-4865-8821-b67ed1095e57 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:40.988831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9489786b-da93-4865-8821-b67ed1095e57 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:40.989500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9489786b-da93-4865-8821-b67ed1095e57 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:41.641376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9489786b-da93-4865-8821-b67ed1095e57 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:41.653320 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9489786b-da93-4865-8821-b67ed1095e57 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.680845 Aug 03 01:52:41.655283 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 704/1365] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:40 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:41.678625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1067255436", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:41.777858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] validate_networks() for [('50acd5e9-f476-4abd-a942-40fd931a4eb0', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:52:42.292667 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-66ccab78-318f-4f04-9d15-a76fc09d8986 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743/action" status: 202 len: 0 microversion: 2.1 time: 2.188176 Aug 03 01:52:42.293855 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 662/1366] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:52:40 2022] POST /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743/action => generated 0 bytes in 2190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:52:42.304842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d85a3de0-6ac5-4095-b513-61fadcb46c54 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1361007607", "metadata": {"image_type": "test"}}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:42.323978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d85a3de0-6ac5-4095-b513-61fadcb46c54 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Failed to fetch instance by id tempest-invalid-42919810 {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 03 01:52:42.324514 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-d85a3de0-6ac5-4095-b513-61fadcb46c54 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] HTTP exception thrown: Instance tempest-invalid-42919810 could not be found. Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d85a3de0-6ac5-4095-b513-61fadcb46c54 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Request method failure captured: Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/tempest-invalid-42919810/action HTTP/1.1 Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 112 Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTMGJkFbvvq0n59HmBTiKDw-uqwxw18ZgJkZthGl8n8gZwliamPB7lJam3lfDlYeQB-CIoz0zW8v4r_bF7mwoRG95sEG4I3PsEbqRF3T4UndlanZfB7-0uAcAXh_cw87kOBlJ5AU0SEt9NtOGlKzzEcg2zMDMrt0sVcLh3KT5n1QP8 Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 214847079c8c4a749467c006295134d6 Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_214847079c8c4a749467c006295134d6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/214847079c8c4a749467c006295134d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/214847079c8c4a749467c006295134d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/214847079c8c4a749467c006295134d6"}]}] Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 214847079c8c4a749467c006295134d6 Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesNegativeTestJSON-1551841932-project Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 65845e9e08fb48ffb1c8cb0aff44dcbe Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesNegativeTestJSON-1551841932-project Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1361007607", "metadata": {"image_type": "test"}}} Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance tempest-invalid-42919810 could not be found. Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'tempest-invalid-42919810', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1361007607', 'metadata': {'image_type': 'test'}}}} Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-42919810 could not be found. Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:42.332670 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-42919810 could not be found. Aug 03 01:52:42.340583 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:42.340583 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:42.340583 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:42.340583 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:42.340583 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:42.340583 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:42.340583 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:42.340583 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:42.340583 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-42919810 could not be found. Aug 03 01:52:42.340583 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:42.340583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d85a3de0-6ac5-4095-b513-61fadcb46c54 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Returning 404 to user: Instance tempest-invalid-42919810 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:42.340583 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d85a3de0-6ac5-4095-b513-61fadcb46c54 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "POST /compute/v2.1/servers/tempest-invalid-42919810/action" status: 404 len: 99 microversion: 2.1 time: 0.039040 Aug 03 01:52:42.340583 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 663/1367] 10.222.0.67 () {60 vars in 1243 bytes} [Wed Aug 3 01:52:42 2022] POST /compute/v2.1/servers/tempest-invalid-42919810/action => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:52:42.364347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5ed6e18c-7ccb-4287-a746-3b1add0fdd3b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:42.365262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5ed6e18c-7ccb-4287-a746-3b1add0fdd3b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:42.373467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ed6e18c-7ccb-4287-a746-3b1add0fdd3b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:42.374451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ed6e18c-7ccb-4287-a746-3b1add0fdd3b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:42.375481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ed6e18c-7ccb-4287-a746-3b1add0fdd3b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:42.376084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ed6e18c-7ccb-4287-a746-3b1add0fdd3b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:42.560072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:52:42.561641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:52:42.574547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:52:42.575733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:52:42.576651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:52:42.594309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5ed6e18c-7ccb-4287-a746-3b1add0fdd3b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:42.603005 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5ed6e18c-7ccb-4287-a746-3b1add0fdd3b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 200 len: 1323 microversion: 2.1 time: 0.263908 Aug 03 01:52:42.606478 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 664/1368] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:42 2022] GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 1323 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:42.613648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:42.614385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:42.616291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:42.616724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:42.624730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8ae3de07-0e09-44e3-8a48-5dcb4095ca6a tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:42.625119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8ae3de07-0e09-44e3-8a48-5dcb4095ca6a tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:42.637821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8ae3de07-0e09-44e3-8a48-5dcb4095ca6a tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:42.638278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8ae3de07-0e09-44e3-8a48-5dcb4095ca6a tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:42.641024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8ae3de07-0e09-44e3-8a48-5dcb4095ca6a tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:42.643498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8ae3de07-0e09-44e3-8a48-5dcb4095ca6a tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:42.648223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Getting quotas for project c183e2fc6dbb419fbd8fa81c90163adf. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:52:42.654756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Getting quotas for user 0b99d344c16b4221bcccfe37d32bb69e and project c183e2fc6dbb419fbd8fa81c90163adf. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:52:42.673932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:52:42.676823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:52:42.736131 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-46b355e7-40cd-43e8-9df3-415de17e8f66 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.079425 Aug 03 01:52:42.737087 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 705/1369] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:52:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:52:42.744759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ae489ca4-baff-41c0-87dc-429333323b20 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b132be160>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:42.973925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG neutronclient.v2_0.client [None req-ae489ca4-baff-41c0-87dc-429333323b20 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0e81b5c3-1530-4b77-b907-2d71efdaae38 in use.", "detail": ""}} {{(pid=125941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:52:42.975463 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-ae489ca4-baff-41c0-87dc-429333323b20 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Security Group 0e81b5c3-1530-4b77-b907-2d71efdaae38 in use. Aug 03 01:52:42.975463 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-23f21b5e-fa87-4073-a1fc-58ece33e27dc'] Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ae489ca4-baff-41c0-87dc-429333323b20 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/os-security-groups/0e81b5c3-1530-4b77-b907-2d71efdaae38 HTTP/1.1 Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: exception: Security Group 0e81b5c3-1530-4b77-b907-2d71efdaae38 in use. Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-23f21b5e-fa87-4073-a1fc-58ece33e27dc'] Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '0e81b5c3-1530-4b77-b907-2d71efdaae38'} Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:52:42.980713 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 0e81b5c3-1530-4b77-b907-2d71efdaae38 in use. Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23f21b5e-fa87-4073-a1fc-58ece33e27dc'] Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 0e81b5c3-1530-4b77-b907-2d71efdaae38 in use. Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23f21b5e-fa87-4073-a1fc-58ece33e27dc'] Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 0e81b5c3-1530-4b77-b907-2d71efdaae38 in use. Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23f21b5e-fa87-4073-a1fc-58ece33e27dc'] Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 0e81b5c3-1530-4b77-b907-2d71efdaae38 in use. Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23f21b5e-fa87-4073-a1fc-58ece33e27dc'] Aug 03 01:52:42.985499 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:42.991374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ae489ca4-baff-41c0-87dc-429333323b20 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 400 to user: Security Group 0e81b5c3-1530-4b77-b907-2d71efdaae38 in use. Aug 03 01:52:42.991374 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-23f21b5e-fa87-4073-a1fc-58ece33e27dc'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:42.994462 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ae489ca4-baff-41c0-87dc-429333323b20 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/0e81b5c3-1530-4b77-b907-2d71efdaae38" status: 400 len: 185 microversion: 2.1 time: 0.255134 Aug 03 01:52:42.995428 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 706/1370] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:52:42 2022] DELETE /compute/v2.1/os-security-groups/0e81b5c3-1530-4b77-b907-2d71efdaae38 => generated 185 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:52:43.006583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a496304f-34c4-40ad-ac2b-5e6197cda7cf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1278175266"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:43.012089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a496304f-34c4-40ad-ac2b-5e6197cda7cf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 03 01:52:43.015366 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-a496304f-34c4-40ad-ac2b-5e6197cda7cf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 01:52:43.016003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8ae3de07-0e09-44e3-8a48-5dcb4095ca6a tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a496304f-34c4-40ad-ac2b-5e6197cda7cf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Request method failure captured: Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 57 Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dTMGJkFbvvq0n59HmBTiKDw-uqwxw18ZgJkZthGl8n8gZwliamPB7lJam3lfDlYeQB-CIoz0zW8v4r_bF7mwoRG95sEG4I3PsEbqRF3T4UndlanZfB7-0uAcAXh_cw87kOBlJ5AU0SEt9NtOGlKzzEcg2zMDMrt0sVcLh3KT5n1QP8 Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 214847079c8c4a749467c006295134d6 Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_214847079c8c4a749467c006295134d6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/214847079c8c4a749467c006295134d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/214847079c8c4a749467c006295134d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/214847079c8c4a749467c006295134d6"}]}] Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 214847079c8c4a749467c006295134d6 Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesNegativeTestJSON-1551841932-project Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 65845e9e08fb48ffb1c8cb0aff44dcbe Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesNegativeTestJSON-1551841932-project Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: {"createImage": {"name": "tempest-test-snap-1278175266"}} Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1278175266'}}} Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 01:52:43.017331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:43.023121 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:43.023121 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:43.023121 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:43.023121 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:43.023121 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:43.023121 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:43.023121 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:43.023121 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 01:52:43.023121 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:43.023121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a496304f-34c4-40ad-ac2b-5e6197cda7cf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:43.023121 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a496304f-34c4-40ad-ac2b-5e6197cda7cf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.019035 Aug 03 01:52:43.027179 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 707/1371] 10.222.0.67 () {60 vars in 1275 bytes} [Wed Aug 3 01:52:42 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:43.029396 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8ae3de07-0e09-44e3-8a48-5dcb4095ca6a tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1319 microversion: 2.1 time: 0.420471 Aug 03 01:52:43.035578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-34519aff-232f-410b-87f0-032c35afc1b9 req-80d74967-a81c-4300-bf05-ee0b34c69091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dabe69a-9513-4eee-afda-f3bda4a5c743", "tag": "68f18961-f100-488a-a34b-411aa3693cf3"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:43.035802 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 665/1372] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:42 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:43.039276 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dfa36954-ecab-47a7-98e2-bfda8c8636a0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:43.040733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-34519aff-232f-410b-87f0-032c35afc1b9 req-80d74967-a81c-4300-bf05-ee0b34c69091 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:43.041440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-34519aff-232f-410b-87f0-032c35afc1b9 req-80d74967-a81c-4300-bf05-ee0b34c69091 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:43.043688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dfa36954-ecab-47a7-98e2-bfda8c8636a0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:43.056341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dfa36954-ecab-47a7-98e2-bfda8c8636a0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:43.056806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dfa36954-ecab-47a7-98e2-bfda8c8636a0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:43.057808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dfa36954-ecab-47a7-98e2-bfda8c8636a0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:43.058327 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-34519aff-232f-410b-87f0-032c35afc1b9 req-80d74967-a81c-4300-bf05-ee0b34c69091 service nova] Creating event network-changed:68f18961-f100-488a-a34b-411aa3693cf3 for instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 on n-h2-826529-8 Aug 03 01:52:43.060131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dfa36954-ecab-47a7-98e2-bfda8c8636a0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:43.063920 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-34519aff-232f-410b-87f0-032c35afc1b9 req-80d74967-a81c-4300-bf05-ee0b34c69091 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037297 Aug 03 01:52:43.066133 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 708/1373] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:43.073024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1362b28d-40c2-4a0e-ad94-48cff49b71a0 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:43.074015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1362b28d-40c2-4a0e-ad94-48cff49b71a0 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:43.146760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1362b28d-40c2-4a0e-ad94-48cff49b71a0 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:43.167778 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1362b28d-40c2-4a0e-ad94-48cff49b71a0 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1222 microversion: 2.1 time: 0.088523 Aug 03 01:52:43.170372 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 709/1374] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:43 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:43.184513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d34926f6-54b2-47ad-b13e-1e688be78498 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c4ce6d6-5dc0-43c0-8686-9df5cff6aca9", "device": "/dev/xvdb"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:43.192663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d34926f6-54b2-47ad-b13e-1e688be78498 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:43.204209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d34926f6-54b2-47ad-b13e-1e688be78498 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:43.205197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d34926f6-54b2-47ad-b13e-1e688be78498 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:43.206776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d34926f6-54b2-47ad-b13e-1e688be78498 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:43.207461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d34926f6-54b2-47ad-b13e-1e688be78498 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:43.484633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dfa36954-ecab-47a7-98e2-bfda8c8636a0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:43.523204 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dfa36954-ecab-47a7-98e2-bfda8c8636a0 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.491063 Aug 03 01:52:43.532106 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 666/1375] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:43 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:43.575896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-00d9fe09-f7e6-4eef-8cf6-5c42f11854a1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:43.576950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-00d9fe09-f7e6-4eef-8cf6-5c42f11854a1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:43.590804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00d9fe09-f7e6-4eef-8cf6-5c42f11854a1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:43.592282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00d9fe09-f7e6-4eef-8cf6-5c42f11854a1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:43.596464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00d9fe09-f7e6-4eef-8cf6-5c42f11854a1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:43.598109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00d9fe09-f7e6-4eef-8cf6-5c42f11854a1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:43.717800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-00d9fe09-f7e6-4eef-8cf6-5c42f11854a1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:52:43.997504 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-00d9fe09-f7e6-4eef-8cf6-5c42f11854a1 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 204 len: 0 microversion: 2.1 time: 0.450728 Aug 03 01:52:43.998727 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 667/1376] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:52:43 2022] DELETE /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:52:44.004822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-948d0775-d825-40a9-8423-4d75d0a58d3f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-658881354"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:44.007308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-948d0775-d825-40a9-8423-4d75d0a58d3f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 03 01:52:44.007867 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-948d0775-d825-40a9-8423-4d75d0a58d3f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-948d0775-d825-40a9-8423-4d75d0a58d3f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Request method failure captured: Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 56 Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTMGJkFbvvq0n59HmBTiKDw-uqwxw18ZgJkZthGl8n8gZwliamPB7lJam3lfDlYeQB-CIoz0zW8v4r_bF7mwoRG95sEG4I3PsEbqRF3T4UndlanZfB7-0uAcAXh_cw87kOBlJ5AU0SEt9NtOGlKzzEcg2zMDMrt0sVcLh3KT5n1QP8 Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 214847079c8c4a749467c006295134d6 Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_214847079c8c4a749467c006295134d6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/214847079c8c4a749467c006295134d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/214847079c8c4a749467c006295134d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/214847079c8c4a749467c006295134d6"}]}] Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 214847079c8c4a749467c006295134d6 Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesNegativeTestJSON-1551841932-project Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 65845e9e08fb48ffb1c8cb0aff44dcbe Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesNegativeTestJSON-1551841932-project Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: {"createImage": {"name": "tempest-test-snap-658881354"}} Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-658881354'}}} Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 01:52:44.020261 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:44.036945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:44.036945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:44.036945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:44.036945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:44.036945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:44.036945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:44.036945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:44.036945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 01:52:44.036945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:44.036945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-948d0775-d825-40a9-8423-4d75d0a58d3f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:44.036945 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-948d0775-d825-40a9-8423-4d75d0a58d3f tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.021803 Aug 03 01:52:44.036945 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 668/1377] 10.222.0.67 () {60 vars in 1281 bytes} [Wed Aug 3 01:52:43 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:44.037765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:44.038306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0678a2be-3abc-4003-a4d3-48c83c7cf381 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:44.038306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0678a2be-3abc-4003-a4d3-48c83c7cf381 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:44.050099 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d34926f6-54b2-47ad-b13e-1e688be78498 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "POST /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.877348 Aug 03 01:52:44.053102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0678a2be-3abc-4003-a4d3-48c83c7cf381 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:44.053580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0678a2be-3abc-4003-a4d3-48c83c7cf381 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:44.054473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0678a2be-3abc-4003-a4d3-48c83c7cf381 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:44.056133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0678a2be-3abc-4003-a4d3-48c83c7cf381 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:44.067936 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 710/1378] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 01:52:43 2022] POST /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments => generated 194 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:44.078400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9d0eba9b-98b7-464d-b9ec-de4463300daa tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:44.079393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9d0eba9b-98b7-464d-b9ec-de4463300daa tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:44.088290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d0eba9b-98b7-464d-b9ec-de4463300daa tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:44.088830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d0eba9b-98b7-464d-b9ec-de4463300daa tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:44.089776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d0eba9b-98b7-464d-b9ec-de4463300daa tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:44.090225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d0eba9b-98b7-464d-b9ec-de4463300daa tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:44.394383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0678a2be-3abc-4003-a4d3-48c83c7cf381 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:44.407826 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0678a2be-3abc-4003-a4d3-48c83c7cf381 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 200 len: 1323 microversion: 2.1 time: 0.378815 Aug 03 01:52:44.411300 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 669/1379] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:44 2022] GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 1323 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:44.424217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9d0eba9b-98b7-464d-b9ec-de4463300daa tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:44.424631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f02f616a-4fd2-4e38-b42f-ee724fc08ddf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:44.425341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f02f616a-4fd2-4e38-b42f-ee724fc08ddf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:44.435596 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9d0eba9b-98b7-464d-b9ec-de4463300daa tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1646 microversion: 2.1 time: 0.365604 Aug 03 01:52:44.436968 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 711/1380] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:44 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1646 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:44.442797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f02f616a-4fd2-4e38-b42f-ee724fc08ddf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:44.443542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f02f616a-4fd2-4e38-b42f-ee724fc08ddf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:44.444119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-afde081f-2002-40c0-8b82-ea74b553f843 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:44.444714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f02f616a-4fd2-4e38-b42f-ee724fc08ddf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:44.444958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-afde081f-2002-40c0-8b82-ea74b553f843 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:44.445504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f02f616a-4fd2-4e38-b42f-ee724fc08ddf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:44.457485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-afde081f-2002-40c0-8b82-ea74b553f843 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:44.458046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-afde081f-2002-40c0-8b82-ea74b553f843 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:44.459492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-afde081f-2002-40c0-8b82-ea74b553f843 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:44.462714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-afde081f-2002-40c0-8b82-ea74b553f843 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:44.475477 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-f02f616a-4fd2-4e38-b42f-ee724fc08ddf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] HTTP exception thrown: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f02f616a-4fd2-4e38-b42f-ee724fc08ddf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Request method failure captured: Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 HTTP/1.1 Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTMGJkFbvvq0n59HmBTiKDw-uqwxw18ZgJkZthGl8n8gZwliamPB7lJam3lfDlYeQB-CIoz0zW8v4r_bF7mwoRG95sEG4I3PsEbqRF3T4UndlanZfB7-0uAcAXh_cw87kOBlJ5AU0SEt9NtOGlKzzEcg2zMDMrt0sVcLh3KT5n1QP8 Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 214847079c8c4a749467c006295134d6 Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_214847079c8c4a749467c006295134d6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/214847079c8c4a749467c006295134d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/214847079c8c4a749467c006295134d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/214847079c8c4a749467c006295134d6"}]}] Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 214847079c8c4a749467c006295134d6 Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesNegativeTestJSON-1551841932-project Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 65845e9e08fb48ffb1c8cb0aff44dcbe Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesNegativeTestJSON-1551841932-project Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'bc37c4b2-3a5c-4b5a-af95-e531b4189c14'} Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:52:44.479243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:44.486057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:44.486057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:44.486057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:44.486057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:44.486057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:44.486057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:44.486057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:44.486057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:44.486057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:44.486057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:44.486057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:44.488743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f02f616a-4fd2-4e38-b42f-ee724fc08ddf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Returning 404 to user: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:44.490582 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f02f616a-4fd2-4e38-b42f-ee724fc08ddf tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 404 len: 111 microversion: 2.1 time: 0.078209 Aug 03 01:52:44.491473 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 670/1381] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:52:44 2022] DELETE /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:44.499302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-37487dff-33f5-4d11-a645-e6d5134480cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:44.500177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-37487dff-33f5-4d11-a645-e6d5134480cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:44.507327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37487dff-33f5-4d11-a645-e6d5134480cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:44.509977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37487dff-33f5-4d11-a645-e6d5134480cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:44.511166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37487dff-33f5-4d11-a645-e6d5134480cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:44.511822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37487dff-33f5-4d11-a645-e6d5134480cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:44.665499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-37487dff-33f5-4d11-a645-e6d5134480cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:44.673227 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-37487dff-33f5-4d11-a645-e6d5134480cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1218 microversion: 2.1 time: 0.180277 Aug 03 01:52:44.673937 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 671/1382] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:44 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1218 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:44.685351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-4c4947e7-8b93-44d5-b3b2-5720422c22dd req-cf650325-57d5-4d4b-9013-1c0591f3f67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf0a0ec2-f2fb-49be-97ad-48bde7053e9a", "name": "network-vif-plugged", "status": "completed", "tag": "a180f2da-fc64-4024-9832-25e1d3488fcb"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:44.719141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4c4947e7-8b93-44d5-b3b2-5720422c22dd req-cf650325-57d5-4d4b-9013-1c0591f3f67c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:44.719859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4c4947e7-8b93-44d5-b3b2-5720422c22dd req-cf650325-57d5-4d4b-9013-1c0591f3f67c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:44.762989 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-4c4947e7-8b93-44d5-b3b2-5720422c22dd req-cf650325-57d5-4d4b-9013-1c0591f3f67c service nova] Creating event network-vif-plugged:a180f2da-fc64-4024-9832-25e1d3488fcb for instance cf0a0ec2-f2fb-49be-97ad-48bde7053e9a on n-h1-826529-8 Aug 03 01:52:44.778255 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-4c4947e7-8b93-44d5-b3b2-5720422c22dd req-cf650325-57d5-4d4b-9013-1c0591f3f67c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103046 Aug 03 01:52:44.779360 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 672/1383] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:44.780303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-afde081f-2002-40c0-8b82-ea74b553f843 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:44.795263 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-afde081f-2002-40c0-8b82-ea74b553f843 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1319 microversion: 2.1 time: 0.354775 Aug 03 01:52:44.798652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-005d68a2-031c-4e7f-a65c-3bd85a6b1594 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:44.800728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-005d68a2-031c-4e7f-a65c-3bd85a6b1594 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] [instance: bc37c4b2-3a5c-4b5a-af95-e531b4189c14] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:44.802389 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 712/1384] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:44 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:44.808490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-57ae068e-772b-497e-a716-989de025d962 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:44.809110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-57ae068e-772b-497e-a716-989de025d962 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:44.811908 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-005d68a2-031c-4e7f-a65c-3bd85a6b1594 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:44.815307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-005d68a2-031c-4e7f-a65c-3bd85a6b1594 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:44.816802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-005d68a2-031c-4e7f-a65c-3bd85a6b1594 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:44.822591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-005d68a2-031c-4e7f-a65c-3bd85a6b1594 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:44.832162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57ae068e-772b-497e-a716-989de025d962 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:44.832614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57ae068e-772b-497e-a716-989de025d962 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:44.833419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57ae068e-772b-497e-a716-989de025d962 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:44.835948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57ae068e-772b-497e-a716-989de025d962 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:44.858685 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-005d68a2-031c-4e7f-a65c-3bd85a6b1594 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] HTTP exception thrown: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-005d68a2-031c-4e7f-a65c-3bd85a6b1594 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Request method failure captured: Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 HTTP/1.1 Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTMGJkFbvvq0n59HmBTiKDw-uqwxw18ZgJkZthGl8n8gZwliamPB7lJam3lfDlYeQB-CIoz0zW8v4r_bF7mwoRG95sEG4I3PsEbqRF3T4UndlanZfB7-0uAcAXh_cw87kOBlJ5AU0SEt9NtOGlKzzEcg2zMDMrt0sVcLh3KT5n1QP8 Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 214847079c8c4a749467c006295134d6 Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_214847079c8c4a749467c006295134d6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/214847079c8c4a749467c006295134d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/214847079c8c4a749467c006295134d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/214847079c8c4a749467c006295134d6"}]}] Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 214847079c8c4a749467c006295134d6 Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1551841932 Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesNegativeTestJSON-1551841932-project Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 65845e9e08fb48ffb1c8cb0aff44dcbe Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesNegativeTestJSON-1551841932-project Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'bc37c4b2-3a5c-4b5a-af95-e531b4189c14'} Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:44.860930 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:44.865543 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:44.865543 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:44.865543 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:44.865543 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:44.865543 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:44.865543 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. Aug 03 01:52:44.865543 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:44.869396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-005d68a2-031c-4e7f-a65c-3bd85a6b1594 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] Returning 404 to user: Instance bc37c4b2-3a5c-4b5a-af95-e531b4189c14 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:44.871014 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-005d68a2-031c-4e7f-a65c-3bd85a6b1594 tempest-ImagesNegativeTestJSON-1551841932 tempest-ImagesNegativeTestJSON-1551841932-project] 10.222.0.67 "GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14" status: 404 len: 111 microversion: 2.1 time: 0.089704 Aug 03 01:52:44.872668 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 673/1385] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:44 2022] GET /compute/v2.1/servers/bc37c4b2-3a5c-4b5a-af95-e531b4189c14 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:45.173913 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-78247b27-5854-4225-bce8-a72ba0991892 req-40d70e8a-6bc4-4acc-98dd-9f0f6ca02ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8397a8e-08c7-4844-90eb-80949ac27e92", "tag": "163a242a-344a-4765-b50c-fff46a880c74"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:45.192766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-78247b27-5854-4225-bce8-a72ba0991892 req-40d70e8a-6bc4-4acc-98dd-9f0f6ca02ece service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:45.194040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-78247b27-5854-4225-bce8-a72ba0991892 req-40d70e8a-6bc4-4acc-98dd-9f0f6ca02ece service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:45.218209 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-78247b27-5854-4225-bce8-a72ba0991892 req-40d70e8a-6bc4-4acc-98dd-9f0f6ca02ece service nova] Creating event network-changed:163a242a-344a-4765-b50c-fff46a880c74 for instance c8397a8e-08c7-4844-90eb-80949ac27e92 on n-h1-826529-8 Aug 03 01:52:45.227854 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-78247b27-5854-4225-bce8-a72ba0991892 req-40d70e8a-6bc4-4acc-98dd-9f0f6ca02ece service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060671 Aug 03 01:52:45.229781 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 674/1386] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:45.258225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-57ae068e-772b-497e-a716-989de025d962 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:45.267498 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-57ae068e-772b-497e-a716-989de025d962 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.463948 Aug 03 01:52:45.288353 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 713/1387] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:44 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:45.434013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f8a03900-3f14-47cb-abca-6751495bf319 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:45.434970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f8a03900-3f14-47cb-abca-6751495bf319 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:45.450870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8a03900-3f14-47cb-abca-6751495bf319 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:45.451358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8a03900-3f14-47cb-abca-6751495bf319 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:45.452163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8a03900-3f14-47cb-abca-6751495bf319 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:45.459059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7c3ef9a7-6d47-4860-91ff-afe394874d99 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:45.459686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7c3ef9a7-6d47-4860-91ff-afe394874d99 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:45.463635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8a03900-3f14-47cb-abca-6751495bf319 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:45.470553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c3ef9a7-6d47-4860-91ff-afe394874d99 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:45.471035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c3ef9a7-6d47-4860-91ff-afe394874d99 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:45.471820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c3ef9a7-6d47-4860-91ff-afe394874d99 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:45.475155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c3ef9a7-6d47-4860-91ff-afe394874d99 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:46.415212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f8a03900-3f14-47cb-abca-6751495bf319 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:46.441791 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f8a03900-3f14-47cb-abca-6751495bf319 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 200 len: 1323 microversion: 2.1 time: 1.001602 Aug 03 01:52:46.457590 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 675/1388] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:45 2022] GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 1323 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:46.468426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a03e004f-6874-4013-9654-78aa7069afd9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:46.469930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a03e004f-6874-4013-9654-78aa7069afd9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:46.513737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a03e004f-6874-4013-9654-78aa7069afd9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:46.517466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a03e004f-6874-4013-9654-78aa7069afd9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:46.521161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a03e004f-6874-4013-9654-78aa7069afd9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:46.523091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a03e004f-6874-4013-9654-78aa7069afd9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:46.695245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a03e004f-6874-4013-9654-78aa7069afd9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:46.712308 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a03e004f-6874-4013-9654-78aa7069afd9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1280 microversion: 2.1 time: 0.252879 Aug 03 01:52:46.713522 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 676/1389] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:46 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1280 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:46.723693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d93026d-afc4-4bf0-909e-472bad1bf00f tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:46.729457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8d93026d-afc4-4bf0-909e-472bad1bf00f tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:46.750543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d93026d-afc4-4bf0-909e-472bad1bf00f tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:46.752900 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d93026d-afc4-4bf0-909e-472bad1bf00f tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:46.756549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d93026d-afc4-4bf0-909e-472bad1bf00f tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:46.760086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d93026d-afc4-4bf0-909e-472bad1bf00f tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:47.016035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7c3ef9a7-6d47-4860-91ff-afe394874d99 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:47.025557 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7c3ef9a7-6d47-4860-91ff-afe394874d99 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1646 microversion: 2.1 time: 1.571700 Aug 03 01:52:47.026145 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 714/1390] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:45 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1646 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:47.045359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c1d62680-cb8e-4496-8b4c-d26551e5b8b2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:47.046701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c1d62680-cb8e-4496-8b4c-d26551e5b8b2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:47.054186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d62680-cb8e-4496-8b4c-d26551e5b8b2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:47.055741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d62680-cb8e-4496-8b4c-d26551e5b8b2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:47.056782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d62680-cb8e-4496-8b4c-d26551e5b8b2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:47.057415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d62680-cb8e-4496-8b4c-d26551e5b8b2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:47.437734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8d93026d-afc4-4bf0-909e-472bad1bf00f tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:47.455628 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8d93026d-afc4-4bf0-909e-472bad1bf00f tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1468 microversion: 2.1 time: 0.735914 Aug 03 01:52:47.456452 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 677/1391] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:46 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1468 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:47.460969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-35b9858f-7da2-4dd1-a3b3-bb446705e0f1 req-73eb9442-9fca-4e00-974a-656956c05c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4222150-6354-462f-9144-fb034666c245", "name": "network-vif-plugged", "status": "completed", "tag": "36b9e373-873b-4320-8a0b-48a7bbd3f55d"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:47.477819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:47.494984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-35b9858f-7da2-4dd1-a3b3-bb446705e0f1 req-73eb9442-9fca-4e00-974a-656956c05c97 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:47.495712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-35b9858f-7da2-4dd1-a3b3-bb446705e0f1 req-73eb9442-9fca-4e00-974a-656956c05c97 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:47.524960 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-35b9858f-7da2-4dd1-a3b3-bb446705e0f1 req-73eb9442-9fca-4e00-974a-656956c05c97 service nova] Creating event network-vif-plugged:36b9e373-873b-4320-8a0b-48a7bbd3f55d for instance e4222150-6354-462f-9144-fb034666c245 on n-h2-826529-8 Aug 03 01:52:47.531175 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-35b9858f-7da2-4dd1-a3b3-bb446705e0f1 req-73eb9442-9fca-4e00-974a-656956c05c97 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073367 Aug 03 01:52:47.532399 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 678/1392] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:47.538893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e6a4619a-3575-4152-94cc-3a3f867bb668 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:47.540912 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e6a4619a-3575-4152-94cc-3a3f867bb668 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:47.556019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6a4619a-3575-4152-94cc-3a3f867bb668 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:47.556524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6a4619a-3575-4152-94cc-3a3f867bb668 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:47.557346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6a4619a-3575-4152-94cc-3a3f867bb668 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:47.557780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6a4619a-3575-4152-94cc-3a3f867bb668 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:47.577251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c1d62680-cb8e-4496-8b4c-d26551e5b8b2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:47.586519 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c1d62680-cb8e-4496-8b4c-d26551e5b8b2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.544866 Aug 03 01:52:47.606927 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 715/1393] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:47 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:47.710846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5bf53644-b3ff-48fa-8c09-abeb54dec98d tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2021367484", "block_migration": true, "disk_over_commit": false}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:47.715943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5bf53644-b3ff-48fa-8c09-abeb54dec98d tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:47.739375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bf53644-b3ff-48fa-8c09-abeb54dec98d tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:47.741068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bf53644-b3ff-48fa-8c09-abeb54dec98d tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:47.743809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bf53644-b3ff-48fa-8c09-abeb54dec98d tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:47.744331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bf53644-b3ff-48fa-8c09-abeb54dec98d tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:47.904867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-5bf53644-b3ff-48fa-8c09-abeb54dec98d tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lazy-loading 'flavor' on Instance uuid cf0a0ec2-f2fb-49be-97ad-48bde7053e9a {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:52:47.927567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5bf53644-b3ff-48fa-8c09-abeb54dec98d tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Going to try to live migrate instance to tempest-host-2021367484 {{(pid=125941) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 01:52:47.937263 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-5bf53644-b3ff-48fa-8c09-abeb54dec98d tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] HTTP exception thrown: Compute host tempest-host-2021367484 could not be found. Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5bf53644-b3ff-48fa-8c09-abeb54dec98d tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Request method failure captured: Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a/action HTTP/1.1 Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 107 Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dTYnGT7mErWP2s6-xrnthh2kJGbm5wEOjuBKwu3317CDMFTNhs6dooVQYxUp14RuKS58RzXq-1LWBFqCxV0FTZP08PwqpOjT9-xpOVsve-HnYN2M1gzmq8jRdeLeX-wtFJHjazAfRmo7UDFYEwzZhXhF9JG5Jeh7se4xQootIUWXzA Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: b844ffef04fd4c56af782897c40cc8ba Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-LiveMigrationNegativeTest-1949630935 Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b844ffef04fd4c56af782897c40cc8ba", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b844ffef04fd4c56af782897c40cc8ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b844ffef04fd4c56af782897c40cc8ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b844ffef04fd4c56af782897c40cc8ba"}]}] Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-LiveMigrationNegativeTest-1949630935 Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: b844ffef04fd4c56af782897c40cc8ba Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1949630935 Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-LiveMigrationNegativeTest-1949630935-project-admin Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: d66203d14b4149ebb999dc061c7d099a Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-LiveMigrationNegativeTest-1949630935-project-admin Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: {"os-migrateLive": {"host": "tempest-host-2021367484", "block_migration": true, "disk_over_commit": false}} Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: exception: Compute host tempest-host-2021367484 could not be found. Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'cf0a0ec2-f2fb-49be-97ad-48bde7053e9a', 'body': {'os-migrateLive': {'host': 'tempest-host-2021367484', 'block_migration': True, 'disk_over_commit': False}}} Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5436, in live_migrate Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 03 01:52:47.941296 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-2021367484 could not be found. Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-2021367484 could not be found. Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-2021367484 could not be found. Aug 03 01:52:47.947521 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:47.954235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5bf53644-b3ff-48fa-8c09-abeb54dec98d tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Returning 400 to user: Compute host tempest-host-2021367484 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:47.955733 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5bf53644-b3ff-48fa-8c09-abeb54dec98d tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a/action" status: 400 len: 100 microversion: 2.1 time: 0.359074 Aug 03 01:52:47.962484 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 716/1394] 10.222.0.67 () {60 vars in 1279 bytes} [Wed Aug 3 01:52:47 2022] POST /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a/action => generated 100 bytes in 366 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:52:47.977799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-263dd045-6316-419c-a05b-f4c07302e62a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:47.978714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-263dd045-6316-419c-a05b-f4c07302e62a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:47.994420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-263dd045-6316-419c-a05b-f4c07302e62a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:47.994876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-263dd045-6316-419c-a05b-f4c07302e62a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:48.019692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-263dd045-6316-419c-a05b-f4c07302e62a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:48.020386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-263dd045-6316-419c-a05b-f4c07302e62a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:48.042888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:48.152657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-263dd045-6316-419c-a05b-f4c07302e62a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:48.175288 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-263dd045-6316-419c-a05b-f4c07302e62a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1280 microversion: 2.1 time: 0.211292 Aug 03 01:52:48.178958 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 717/1395] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:47 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1280 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:48.191622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-706d0ad3-f7d9-4280-bb1f-9634952cd1b7 req-3800beed-1b1c-47bc-aa30-9ff69170778f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dabe69a-9513-4eee-afda-f3bda4a5c743", "name": "network-vif-deleted", "tag": "68f18961-f100-488a-a34b-411aa3693cf3"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:48.206824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-706d0ad3-f7d9-4280-bb1f-9634952cd1b7 req-3800beed-1b1c-47bc-aa30-9ff69170778f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:48.207571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-706d0ad3-f7d9-4280-bb1f-9634952cd1b7 req-3800beed-1b1c-47bc-aa30-9ff69170778f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:48.236479 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-706d0ad3-f7d9-4280-bb1f-9634952cd1b7 req-3800beed-1b1c-47bc-aa30-9ff69170778f service nova] Creating event network-vif-deleted:68f18961-f100-488a-a34b-411aa3693cf3 for instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 on n-h2-826529-8 Aug 03 01:52:48.252604 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-706d0ad3-f7d9-4280-bb1f-9634952cd1b7 req-3800beed-1b1c-47bc-aa30-9ff69170778f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068477 Aug 03 01:52:48.253372 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 718/1396] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:48.280023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d149bd5d-bf31-4251-b3f7-65853218b88b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:48.286200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d149bd5d-bf31-4251-b3f7-65853218b88b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:48.313744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d149bd5d-bf31-4251-b3f7-65853218b88b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:48.314494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d149bd5d-bf31-4251-b3f7-65853218b88b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:48.315386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d149bd5d-bf31-4251-b3f7-65853218b88b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:48.315837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d149bd5d-bf31-4251-b3f7-65853218b88b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:48.373235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e6a4619a-3575-4152-94cc-3a3f867bb668 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:48.385325 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e6a4619a-3575-4152-94cc-3a3f867bb668 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 200 len: 1323 microversion: 2.1 time: 0.851426 Aug 03 01:52:48.398472 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 679/1397] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:47 2022] GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 1323 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:48.404640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dd2db0fd-80bc-45ba-8990-5534b3e3c25a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:48.405497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dd2db0fd-80bc-45ba-8990-5534b3e3c25a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:48.412211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd2db0fd-80bc-45ba-8990-5534b3e3c25a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:48.412921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd2db0fd-80bc-45ba-8990-5534b3e3c25a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:48.414057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd2db0fd-80bc-45ba-8990-5534b3e3c25a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:48.415516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd2db0fd-80bc-45ba-8990-5534b3e3c25a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:48.453966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd2db0fd-80bc-45ba-8990-5534b3e3c25a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:48.455147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd2db0fd-80bc-45ba-8990-5534b3e3c25a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:48.455765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-dd2db0fd-80bc-45ba-8990-5534b3e3c25a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lazy-loading 'fault' on Instance uuid 6dabe69a-9513-4eee-afda-f3bda4a5c743 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:52:48.666008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dd2db0fd-80bc-45ba-8990-5534b3e3c25a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:48.677528 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dd2db0fd-80bc-45ba-8990-5534b3e3c25a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 200 len: 1305 microversion: 2.1 time: 0.276374 Aug 03 01:52:48.679038 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 680/1398] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:48 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 1305 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:48.685733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7a0a5984-76e8-44a6-9ab5-fde55a64aaee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:48.686759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7a0a5984-76e8-44a6-9ab5-fde55a64aaee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:48.694059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a0a5984-76e8-44a6-9ab5-fde55a64aaee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:48.694855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a0a5984-76e8-44a6-9ab5-fde55a64aaee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:48.696792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a0a5984-76e8-44a6-9ab5-fde55a64aaee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:48.698493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a0a5984-76e8-44a6-9ab5-fde55a64aaee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:48.898372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d149bd5d-bf31-4251-b3f7-65853218b88b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:48.909619 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d149bd5d-bf31-4251-b3f7-65853218b88b tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1468 microversion: 2.1 time: 0.654933 Aug 03 01:52:48.910430 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 719/1399] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:48 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1468 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:48.978756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1359311658", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:49.066187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:52:49.186741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7a0a5984-76e8-44a6-9ab5-fde55a64aaee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:49.216492 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7a0a5984-76e8-44a6-9ab5-fde55a64aaee tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.534144 Aug 03 01:52:49.218635 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 681/1400] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:48 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:49.240440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-41c906df-0cd7-4784-a0f0-837e5bf0c88d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:49.247227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-41c906df-0cd7-4784-a0f0-837e5bf0c88d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:49.264661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41c906df-0cd7-4784-a0f0-837e5bf0c88d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:49.265720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41c906df-0cd7-4784-a0f0-837e5bf0c88d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:49.266806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41c906df-0cd7-4784-a0f0-837e5bf0c88d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:49.267646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41c906df-0cd7-4784-a0f0-837e5bf0c88d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:49.275830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:49.803879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:52:49.804439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:52:49.805563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:52:49.806118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:52:49.806742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:52:49.814607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-41c906df-0cd7-4784-a0f0-837e5bf0c88d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:49.819066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:49.821714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:49.822837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:49.823498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:49.825824 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-41c906df-0cd7-4784-a0f0-837e5bf0c88d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1322 microversion: 2.1 time: 0.604948 Aug 03 01:52:49.838941 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 682/1401] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:49 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1322 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:49.844305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a2e4bb48-f462-487c-aaaf-4fea2c4e6ed6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:49.845014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a2e4bb48-f462-487c-aaaf-4fea2c4e6ed6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:49.864009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2e4bb48-f462-487c-aaaf-4fea2c4e6ed6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:49.864482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2e4bb48-f462-487c-aaaf-4fea2c4e6ed6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:49.865313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2e4bb48-f462-487c-aaaf-4fea2c4e6ed6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:49.870088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2e4bb48-f462-487c-aaaf-4fea2c4e6ed6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:49.893113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Getting quotas for project 67cb5febd8a7475096d9e537054a6af9. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:52:49.907357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Getting quotas for user 4b53226d24c0401b8cd7d83b1264acf1 and project 67cb5febd8a7475096d9e537054a6af9. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:52:49.929385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:49.937169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:52:49.940144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:52:50.036914 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bba6be23-1eda-4e03-908e-8a172db5637c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.062943 Aug 03 01:52:50.044295 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 720/1402] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:52:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 01:52:50.053704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-32089ee3-1b11-4376-a119-d3813315e00c req-3e0c46a1-8ce6-48ea-a02a-1d5aefeff85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec36c462-8671-411f-837a-0c22e607522f", "name": "network-vif-plugged", "status": "completed", "tag": "94f25114-4a83-4024-9d63-a3813c3d54b3"}, {"server_uuid": "845f5c3f-62a6-4189-abbd-b2a17ba55f38", "name": "network-vif-plugged", "status": "completed", "tag": "8aff25ff-979c-4a9b-9b62-32c97b9a15e5"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:50.093574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-32089ee3-1b11-4376-a119-d3813315e00c req-3e0c46a1-8ce6-48ea-a02a-1d5aefeff85e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:50.095423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-32089ee3-1b11-4376-a119-d3813315e00c req-3e0c46a1-8ce6-48ea-a02a-1d5aefeff85e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:50.124354 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-32089ee3-1b11-4376-a119-d3813315e00c req-3e0c46a1-8ce6-48ea-a02a-1d5aefeff85e service nova] Creating event network-vif-plugged:94f25114-4a83-4024-9d63-a3813c3d54b3 for instance ec36c462-8671-411f-837a-0c22e607522f on n-h1-826529-8 Aug 03 01:52:50.127558 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-32089ee3-1b11-4376-a119-d3813315e00c req-3e0c46a1-8ce6-48ea-a02a-1d5aefeff85e service nova] Creating event network-vif-plugged:8aff25ff-979c-4a9b-9b62-32c97b9a15e5 for instance 845f5c3f-62a6-4189-abbd-b2a17ba55f38 on n-h2-826529-8 Aug 03 01:52:50.148820 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-32089ee3-1b11-4376-a119-d3813315e00c req-3e0c46a1-8ce6-48ea-a02a-1d5aefeff85e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.101161 Aug 03 01:52:50.154764 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 721/1403] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:50.168621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ea575409-e5e5-4e62-8d95-5e62c1e303bd tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:50.169758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ea575409-e5e5-4e62-8d95-5e62c1e303bd tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:50.185104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea575409-e5e5-4e62-8d95-5e62c1e303bd tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:50.196382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea575409-e5e5-4e62-8d95-5e62c1e303bd tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:50.197668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea575409-e5e5-4e62-8d95-5e62c1e303bd tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:50.198336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea575409-e5e5-4e62-8d95-5e62c1e303bd tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:50.223679 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-ea575409-e5e5-4e62-8d95-5e62c1e303bd tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ea575409-e5e5-4e62-8d95-5e62c1e303bd tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 HTTP/1.1 Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '6dabe69a-9513-4eee-afda-f3bda4a5c743'} Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:50.228145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:50.232374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:50.232374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:50.232374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:50.232374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:50.232374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:50.232374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. Aug 03 01:52:50.232374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:50.235842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ea575409-e5e5-4e62-8d95-5e62c1e303bd tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 404 to user: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:50.240290 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ea575409-e5e5-4e62-8d95-5e62c1e303bd tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 404 len: 111 microversion: 2.1 time: 0.083770 Aug 03 01:52:50.245516 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 722/1404] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:50 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:50.253959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e63f0bc2-dc45-4ed4-bd3a-1567c6a6b9f1 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:50.260463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e63f0bc2-dc45-4ed4-bd3a-1567c6a6b9f1 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:50.302619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a2e4bb48-f462-487c-aaaf-4fea2c4e6ed6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:50.318369 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a2e4bb48-f462-487c-aaaf-4fea2c4e6ed6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 200 len: 1323 microversion: 2.1 time: 0.489308 Aug 03 01:52:50.319003 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 683/1405] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:49 2022] GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 1323 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:50.337416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-46151971-cf44-4e8e-b5c4-a0186e151605 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:50.338179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-46151971-cf44-4e8e-b5c4-a0186e151605 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:50.355579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46151971-cf44-4e8e-b5c4-a0186e151605 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:50.358343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46151971-cf44-4e8e-b5c4-a0186e151605 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:50.362068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46151971-cf44-4e8e-b5c4-a0186e151605 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:50.363068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46151971-cf44-4e8e-b5c4-a0186e151605 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:50.440086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e63f0bc2-dc45-4ed4-bd3a-1567c6a6b9f1 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:50.452584 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e63f0bc2-dc45-4ed4-bd3a-1567c6a6b9f1 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1219 microversion: 2.1 time: 0.204313 Aug 03 01:52:50.454061 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 723/1406] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:50 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1219 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:50.469527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-32c557bc-f0aa-4655-b66a-b24507ca0d60 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b24540f70>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:51.280639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-46151971-cf44-4e8e-b5c4-a0186e151605 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:51.290380 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-46151971-cf44-4e8e-b5c4-a0186e151605 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.970269 Aug 03 01:52:51.304079 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 684/1407] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:50 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:51.309960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-922f59da-58a8-4529-8cd8-72bc41d30cd1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:51.310939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-922f59da-58a8-4529-8cd8-72bc41d30cd1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:51.329016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-922f59da-58a8-4529-8cd8-72bc41d30cd1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:51.329787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-922f59da-58a8-4529-8cd8-72bc41d30cd1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:51.330800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-922f59da-58a8-4529-8cd8-72bc41d30cd1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:51.331455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-922f59da-58a8-4529-8cd8-72bc41d30cd1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:51.979104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-922f59da-58a8-4529-8cd8-72bc41d30cd1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:51.988039 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-922f59da-58a8-4529-8cd8-72bc41d30cd1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1322 microversion: 2.1 time: 0.681695 Aug 03 01:52:51.988632 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 685/1408] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:51 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1322 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:52.004904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2dd71b45-4c41-4752-b352-bcb8b8935577 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:52.005599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2dd71b45-4c41-4752-b352-bcb8b8935577 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:52.021780 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-32c557bc-f0aa-4655-b66a-b24507ca0d60 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/515f28c4-655d-487d-a086-8ddd8ea692c1" status: 202 len: 0 microversion: 2.1 time: 1.564058 Aug 03 01:52:52.041918 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 724/1409] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:52:50 2022] DELETE /compute/v2.1/os-security-groups/515f28c4-655d-487d-a086-8ddd8ea692c1 => generated 0 bytes in 1585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:52:52.044244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2dd71b45-4c41-4752-b352-bcb8b8935577 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:52.044711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2dd71b45-4c41-4752-b352-bcb8b8935577 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:52.045525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2dd71b45-4c41-4752-b352-bcb8b8935577 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:52.045972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2dd71b45-4c41-4752-b352-bcb8b8935577 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:52.059919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-639c80c0-0792-4f36-b181-771cb96d29a8 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:52.068231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-639c80c0-0792-4f36-b181-771cb96d29a8 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:52.098788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-639c80c0-0792-4f36-b181-771cb96d29a8 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:52.102422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-639c80c0-0792-4f36-b181-771cb96d29a8 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:52.102422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-639c80c0-0792-4f36-b181-771cb96d29a8 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:52.107703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-639c80c0-0792-4f36-b181-771cb96d29a8 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:52.313302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-639c80c0-0792-4f36-b181-771cb96d29a8 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:52.329417 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-639c80c0-0792-4f36-b181-771cb96d29a8 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1271 microversion: 2.1 time: 0.285586 Aug 03 01:52:52.330008 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 725/1410] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:52 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1271 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:52.343675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-4330a6c1-6854-4267-b51e-37539cc26780 req-500eef0b-389b-4c91-87a4-c808add20c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56094624-65e4-48bb-8337-280213fb3238", "tag": "5b6b43c2-2954-468c-ab30-27bff1ffac6c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:52.389938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4330a6c1-6854-4267-b51e-37539cc26780 req-500eef0b-389b-4c91-87a4-c808add20c68 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:52.390721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4330a6c1-6854-4267-b51e-37539cc26780 req-500eef0b-389b-4c91-87a4-c808add20c68 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:52.449675 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-4330a6c1-6854-4267-b51e-37539cc26780 req-500eef0b-389b-4c91-87a4-c808add20c68 service nova] Creating event network-changed:5b6b43c2-2954-468c-ab30-27bff1ffac6c for instance 56094624-65e4-48bb-8337-280213fb3238 on n-h2-826529-8 Aug 03 01:52:52.464510 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-4330a6c1-6854-4267-b51e-37539cc26780 req-500eef0b-389b-4c91-87a4-c808add20c68 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129694 Aug 03 01:52:52.465162 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 726/1411] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:52.490192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3a835310-eb3e-4773-8bd9-7a2e8b1adf99 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b244b31f0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:52.589646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2dd71b45-4c41-4752-b352-bcb8b8935577 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:52.602770 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2dd71b45-4c41-4752-b352-bcb8b8935577 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 200 len: 1323 microversion: 2.1 time: 0.613054 Aug 03 01:52:52.606390 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 686/1412] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:51 2022] GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 1323 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:52.835258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-12b304f5-7200-4755-a029-982d42884cf7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:52.836991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-12b304f5-7200-4755-a029-982d42884cf7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:52.850539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12b304f5-7200-4755-a029-982d42884cf7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:52.851275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12b304f5-7200-4755-a029-982d42884cf7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:52.852959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12b304f5-7200-4755-a029-982d42884cf7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:52.854055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12b304f5-7200-4755-a029-982d42884cf7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:52.923258 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3a835310-eb3e-4773-8bd9-7a2e8b1adf99 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/0e81b5c3-1530-4b77-b907-2d71efdaae38" status: 202 len: 0 microversion: 2.1 time: 0.451826 Aug 03 01:52:52.926116 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 727/1413] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:52:52 2022] DELETE /compute/v2.1/os-security-groups/0e81b5c3-1530-4b77-b907-2d71efdaae38 => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:52:52.942178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-74f94742-debd-4691-aa5e-cbbf92b897a5 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'create', calling method: .version_select at 0x7f5b2455c820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-540728394", "description": "tempest-description-43915927"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:53.151574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-12b304f5-7200-4755-a029-982d42884cf7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:53.161869 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-12b304f5-7200-4755-a029-982d42884cf7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.553890 Aug 03 01:52:53.166190 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 687/1414] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:52 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:53.171327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8e4de210-5a87-4e55-8646-6c5b01e893ef tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:53.173618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8e4de210-5a87-4e55-8646-6c5b01e893ef tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:53.183086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e4de210-5a87-4e55-8646-6c5b01e893ef tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:53.183799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e4de210-5a87-4e55-8646-6c5b01e893ef tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:53.195991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e4de210-5a87-4e55-8646-6c5b01e893ef tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:53.196471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e4de210-5a87-4e55-8646-6c5b01e893ef tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:53.221067 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-74f94742-debd-4691-aa5e-cbbf92b897a5 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.284104 Aug 03 01:52:53.230492 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 728/1415] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:52:52 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:53.238838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-97ff693d-bd31-4a6f-be96-d62669f841f7 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Action: 'update', calling method: .version_select at 0x7f5b24513790>, body: {"security_group": {"name": "tempest-sg-hth-1856253972", "description": "tempest-description-hth-1889393720"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:53.513131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8e4de210-5a87-4e55-8646-6c5b01e893ef tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:53.527143 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8e4de210-5a87-4e55-8646-6c5b01e893ef tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1322 microversion: 2.1 time: 0.357369 Aug 03 01:52:53.529285 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 688/1416] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:53 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:53.537089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7069820c-5d1a-4383-84ff-a77b39f557a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:53.538579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7069820c-5d1a-4383-84ff-a77b39f557a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:53.551287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7069820c-5d1a-4383-84ff-a77b39f557a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:53.552276 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7069820c-5d1a-4383-84ff-a77b39f557a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:53.557136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7069820c-5d1a-4383-84ff-a77b39f557a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:53.558702 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7069820c-5d1a-4383-84ff-a77b39f557a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:53.584409 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-97ff693d-bd31-4a6f-be96-d62669f841f7 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "PUT /compute/v2.1/os-security-groups/10b5ed08-fe89-44ac-894e-6dc2db905880" status: 200 len: 218 microversion: 2.1 time: 0.352168 Aug 03 01:52:53.587074 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 729/1417] 10.222.0.67 () {60 vars in 1290 bytes} [Wed Aug 3 01:52:53 2022] PUT /compute/v2.1/os-security-groups/10b5ed08-fe89-44ac-894e-6dc2db905880 => generated 218 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:53.599633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-218b67a8-b50f-4bee-98ad-9cdf4768b346 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b24513430>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:53.669719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7069820c-5d1a-4383-84ff-a77b39f557a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:53.678567 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7069820c-5d1a-4383-84ff-a77b39f557a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1279 microversion: 2.1 time: 0.147693 Aug 03 01:52:53.679776 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 689/1418] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:53 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1279 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:53.685688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-486abe94-a2dd-4bda-b456-114ed65770bd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:53.686711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-486abe94-a2dd-4bda-b456-114ed65770bd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:53.694160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-486abe94-a2dd-4bda-b456-114ed65770bd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:53.694472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-486abe94-a2dd-4bda-b456-114ed65770bd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:53.695407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-486abe94-a2dd-4bda-b456-114ed65770bd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:53.695906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-486abe94-a2dd-4bda-b456-114ed65770bd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:53.703384 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-218b67a8-b50f-4bee-98ad-9cdf4768b346 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/10b5ed08-fe89-44ac-894e-6dc2db905880" status: 200 len: 218 microversion: 2.1 time: 0.107638 Aug 03 01:52:53.704294 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 730/1419] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 01:52:53 2022] GET /compute/v2.1/os-security-groups/10b5ed08-fe89-44ac-894e-6dc2db905880 => generated 218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:52:53.717991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c6beff55-0d4d-49a2-8aa5-0952f3e53386 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b245215e0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:53.905035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-486abe94-a2dd-4bda-b456-114ed65770bd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:53.914875 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-486abe94-a2dd-4bda-b456-114ed65770bd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 200 len: 1515 microversion: 2.1 time: 0.233921 Aug 03 01:52:53.926927 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 690/1420] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:53 2022] GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:53.938534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1c5e54c5-6159-4594-87ae-2a5f07826cbe tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:53.939204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1c5e54c5-6159-4594-87ae-2a5f07826cbe tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: 845f5c3f-62a6-4189-abbd-b2a17ba55f38] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:53.946240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c5e54c5-6159-4594-87ae-2a5f07826cbe tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:53.946787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c5e54c5-6159-4594-87ae-2a5f07826cbe tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:53.947624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c5e54c5-6159-4594-87ae-2a5f07826cbe tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:53.948069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c5e54c5-6159-4594-87ae-2a5f07826cbe tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:54.034339 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c6beff55-0d4d-49a2-8aa5-0952f3e53386 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/10b5ed08-fe89-44ac-894e-6dc2db905880" status: 202 len: 0 microversion: 2.1 time: 0.320474 Aug 03 01:52:54.035578 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 731/1421] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:52:53 2022] DELETE /compute/v2.1/os-security-groups/10b5ed08-fe89-44ac-894e-6dc2db905880 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:52:54.044086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3ec77620-16e7-40a3-ba76-4b86db5b8f38 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:54.044711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3ec77620-16e7-40a3-ba76-4b86db5b8f38 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:54.051653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ec77620-16e7-40a3-ba76-4b86db5b8f38 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:54.052553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ec77620-16e7-40a3-ba76-4b86db5b8f38 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:54.053518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ec77620-16e7-40a3-ba76-4b86db5b8f38 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:54.054484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ec77620-16e7-40a3-ba76-4b86db5b8f38 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:54.073883 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-3ec77620-16e7-40a3-ba76-4b86db5b8f38 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3ec77620-16e7-40a3-ba76-4b86db5b8f38 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 HTTP/1.1 Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '6dabe69a-9513-4eee-afda-f3bda4a5c743'} Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:52:54.076668 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:54.081316 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. Aug 03 01:52:54.081316 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.081316 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:54.081316 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.081316 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:54.081316 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:54.081316 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:54.081316 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:54.081316 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:54.081316 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. Aug 03 01:52:54.081316 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.083555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3ec77620-16e7-40a3-ba76-4b86db5b8f38 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 404 to user: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:54.084911 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3ec77620-16e7-40a3-ba76-4b86db5b8f38 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 404 len: 111 microversion: 2.1 time: 0.044991 Aug 03 01:52:54.086961 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 732/1422] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:52:54 2022] DELETE /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 01:52:54.096656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-222fa607-5d36-488b-8025-3fac68f4acbe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:54.097392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-222fa607-5d36-488b-8025-3fac68f4acbe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 6dabe69a-9513-4eee-afda-f3bda4a5c743] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:54.106709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-222fa607-5d36-488b-8025-3fac68f4acbe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:54.107519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-222fa607-5d36-488b-8025-3fac68f4acbe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:54.108545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-222fa607-5d36-488b-8025-3fac68f4acbe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:54.109283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-222fa607-5d36-488b-8025-3fac68f4acbe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:54.127562 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-222fa607-5d36-488b-8025-3fac68f4acbe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-222fa607-5d36-488b-8025-3fac68f4acbe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 HTTP/1.1 Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '6dabe69a-9513-4eee-afda-f3bda4a5c743'} Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:54.129368 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.135233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:54.135233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:54.135233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:54.135233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:54.135233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:54.135233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. Aug 03 01:52:54.135233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.137726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-222fa607-5d36-488b-8025-3fac68f4acbe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 404 to user: Instance 6dabe69a-9513-4eee-afda-f3bda4a5c743 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:54.139106 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-222fa607-5d36-488b-8025-3fac68f4acbe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743" status: 404 len: 111 microversion: 2.1 time: 0.048397 Aug 03 01:52:54.140614 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 733/1423] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:54 2022] GET /compute/v2.1/servers/6dabe69a-9513-4eee-afda-f3bda4a5c743 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 01:52:54.152012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d2c8a641-7a31-4c70-a6c3-fe884b527abe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b245213a0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:54.229585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG neutronclient.v2_0.client [None req-d2c8a641-7a31-4c70-a6c3-fe884b527abe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0e81b5c3-1530-4b77-b907-2d71efdaae38 does not exist", "detail": ""}} {{(pid=125941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:52:54.231055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.security_group_api [None req-d2c8a641-7a31-4c70-a6c3-fe884b527abe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Neutron security group 0e81b5c3-1530-4b77-b907-2d71efdaae38 not found {{(pid=125941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 01:52:54.231763 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-d2c8a641-7a31-4c70-a6c3-fe884b527abe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Security group 0e81b5c3-1530-4b77-b907-2d71efdaae38 does not exist Aug 03 01:52:54.231763 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-8c0c9609-032e-41fa-bc4b-ac1ab1a89948'] Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d2c8a641-7a31-4c70-a6c3-fe884b527abe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/os-security-groups/0e81b5c3-1530-4b77-b907-2d71efdaae38 HTTP/1.1 Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: exception: Security group 0e81b5c3-1530-4b77-b907-2d71efdaae38 does not exist Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-8c0c9609-032e-41fa-bc4b-ac1ab1a89948'] Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '0e81b5c3-1530-4b77-b907-2d71efdaae38'} Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:52:54.234000 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0e81b5c3-1530-4b77-b907-2d71efdaae38 does not exist Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c0c9609-032e-41fa-bc4b-ac1ab1a89948'] Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0e81b5c3-1530-4b77-b907-2d71efdaae38 does not exist Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c0c9609-032e-41fa-bc4b-ac1ab1a89948'] Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0e81b5c3-1530-4b77-b907-2d71efdaae38 does not exist Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c0c9609-032e-41fa-bc4b-ac1ab1a89948'] Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0e81b5c3-1530-4b77-b907-2d71efdaae38 does not exist Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c0c9609-032e-41fa-bc4b-ac1ab1a89948'] Aug 03 01:52:54.238550 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.243114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d2c8a641-7a31-4c70-a6c3-fe884b527abe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 404 to user: Security group 0e81b5c3-1530-4b77-b907-2d71efdaae38 does not exist Aug 03 01:52:54.243114 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-8c0c9609-032e-41fa-bc4b-ac1ab1a89948'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:54.244271 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d2c8a641-7a31-4c70-a6c3-fe884b527abe tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/0e81b5c3-1530-4b77-b907-2d71efdaae38" status: 404 len: 194 microversion: 2.1 time: 0.097332 Aug 03 01:52:54.244987 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 734/1424] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:52:54 2022] DELETE /compute/v2.1/os-security-groups/0e81b5c3-1530-4b77-b907-2d71efdaae38 => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:54.253927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3db9bb63-71e9-4172-8207-e1d89167c299 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:54.254605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3db9bb63-71e9-4172-8207-e1d89167c299 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:54.254730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1c5e54c5-6159-4594-87ae-2a5f07826cbe tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:54.270695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3db9bb63-71e9-4172-8207-e1d89167c299 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:54.271235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3db9bb63-71e9-4172-8207-e1d89167c299 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:54.271377 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1c5e54c5-6159-4594-87ae-2a5f07826cbe tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38" status: 200 len: 1515 microversion: 2.1 time: 0.336821 Aug 03 01:52:54.272037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3db9bb63-71e9-4172-8207-e1d89167c299 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:54.274961 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 691/1425] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:53 2022] GET /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38 => generated 1515 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:52:54.275389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3db9bb63-71e9-4172-8207-e1d89167c299 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:54.300149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fd2a5acc-9f0b-4745-a628-bd9702b01ae1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:54.302631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fd2a5acc-9f0b-4745-a628-bd9702b01ae1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:54.320778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd2a5acc-9f0b-4745-a628-bd9702b01ae1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:54.320778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd2a5acc-9f0b-4745-a628-bd9702b01ae1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:54.322509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd2a5acc-9f0b-4745-a628-bd9702b01ae1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:54.323289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd2a5acc-9f0b-4745-a628-bd9702b01ae1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:54.653920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3db9bb63-71e9-4172-8207-e1d89167c299 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:54.665276 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3db9bb63-71e9-4172-8207-e1d89167c299 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1477 microversion: 2.1 time: 0.418067 Aug 03 01:52:54.667881 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 735/1426] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:54 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1477 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:54.668176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-fd2a5acc-9f0b-4745-a628-bd9702b01ae1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'services' on Instance uuid 47752419-6bf3-468f-b3a4-e212358b9e66 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:52:54.680258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-66f6c7a9-9dd5-4f6b-822d-2c48c305d93b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b24521a60>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:54.688600 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fd2a5acc-9f0b-4745-a628-bd9702b01ae1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 2345 microversion: 2.25 time: 0.412306 Aug 03 01:52:54.690135 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 692/1427] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:52:54 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 2345 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:52:54.697529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c56a8c92-4b49-4320-a013-eb23704e910b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:54.698769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c56a8c92-4b49-4320-a013-eb23704e910b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: e4222150-6354-462f-9144-fb034666c245] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:54.708640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c56a8c92-4b49-4320-a013-eb23704e910b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:54.709229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c56a8c92-4b49-4320-a013-eb23704e910b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:54.710203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c56a8c92-4b49-4320-a013-eb23704e910b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:54.711436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c56a8c92-4b49-4320-a013-eb23704e910b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:54.717175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG neutronclient.v2_0.client [None req-66f6c7a9-9dd5-4f6b-822d-2c48c305d93b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 515f28c4-655d-487d-a086-8ddd8ea692c1 does not exist", "detail": ""}} {{(pid=125941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:52:54.718023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.security_group_api [None req-66f6c7a9-9dd5-4f6b-822d-2c48c305d93b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Neutron security group 515f28c4-655d-487d-a086-8ddd8ea692c1 not found {{(pid=125941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 01:52:54.718409 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-66f6c7a9-9dd5-4f6b-822d-2c48c305d93b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Security group 515f28c4-655d-487d-a086-8ddd8ea692c1 does not exist Aug 03 01:52:54.718409 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-e319a89b-f2a2-4248-a78a-965c03ff8bdc'] Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-66f6c7a9-9dd5-4f6b-822d-2c48c305d93b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/os-security-groups/515f28c4-655d-487d-a086-8ddd8ea692c1 HTTP/1.1 Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: exception: Security group 515f28c4-655d-487d-a086-8ddd8ea692c1 does not exist Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-e319a89b-f2a2-4248-a78a-965c03ff8bdc'] Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '515f28c4-655d-487d-a086-8ddd8ea692c1'} Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:52:54.720382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 515f28c4-655d-487d-a086-8ddd8ea692c1 does not exist Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e319a89b-f2a2-4248-a78a-965c03ff8bdc'] Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 515f28c4-655d-487d-a086-8ddd8ea692c1 does not exist Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e319a89b-f2a2-4248-a78a-965c03ff8bdc'] Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 515f28c4-655d-487d-a086-8ddd8ea692c1 does not exist Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e319a89b-f2a2-4248-a78a-965c03ff8bdc'] Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 515f28c4-655d-487d-a086-8ddd8ea692c1 does not exist Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e319a89b-f2a2-4248-a78a-965c03ff8bdc'] Aug 03 01:52:54.724567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:54.730750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-66f6c7a9-9dd5-4f6b-822d-2c48c305d93b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 404 to user: Security group 515f28c4-655d-487d-a086-8ddd8ea692c1 does not exist Aug 03 01:52:54.730750 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-e319a89b-f2a2-4248-a78a-965c03ff8bdc'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:54.731977 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-66f6c7a9-9dd5-4f6b-822d-2c48c305d93b tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/515f28c4-655d-487d-a086-8ddd8ea692c1" status: 404 len: 194 microversion: 2.1 time: 0.062515 Aug 03 01:52:54.732748 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 736/1428] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:52:54 2022] DELETE /compute/v2.1/os-security-groups/515f28c4-655d-487d-a086-8ddd8ea692c1 => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:54.738267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7d6c2676-241d-47d9-9608-0859658b9cf1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:54.738920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7d6c2676-241d-47d9-9608-0859658b9cf1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:54.748163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d6c2676-241d-47d9-9608-0859658b9cf1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:54.748629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d6c2676-241d-47d9-9608-0859658b9cf1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:54.749785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d6c2676-241d-47d9-9608-0859658b9cf1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:54.750392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d6c2676-241d-47d9-9608-0859658b9cf1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.010306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7d6c2676-241d-47d9-9608-0859658b9cf1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:55.021979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c56a8c92-4b49-4320-a013-eb23704e910b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:55.025950 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7d6c2676-241d-47d9-9608-0859658b9cf1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1322 microversion: 2.1 time: 0.291958 Aug 03 01:52:55.029351 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 737/1429] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:54 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:55.047698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-58d8010d-24a0-4c1b-9e55-7b761067abbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:55.066156 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c56a8c92-4b49-4320-a013-eb23704e910b tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245" status: 200 len: 1516 microversion: 2.1 time: 0.374706 Aug 03 01:52:55.066752 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 693/1430] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:54 2022] GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245 => generated 1516 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:55.072734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-58d8010d-24a0-4c1b-9e55-7b761067abbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:55.084342 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58d8010d-24a0-4c1b-9e55-7b761067abbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.087838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-946353b2-0832-4967-a0b1-f67941d36b28 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:55.088518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58d8010d-24a0-4c1b-9e55-7b761067abbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.090004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58d8010d-24a0-4c1b-9e55-7b761067abbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.090458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58d8010d-24a0-4c1b-9e55-7b761067abbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.097059 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:52:55.097059 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:52:55.100841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-946353b2-0832-4967-a0b1-f67941d36b28 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.105679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-946353b2-0832-4967-a0b1-f67941d36b28 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.108215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-946353b2-0832-4967-a0b1-f67941d36b28 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.108674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-946353b2-0832-4967-a0b1-f67941d36b28 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.159983 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-946353b2-0832-4967-a0b1-f67941d36b28 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.081020 Aug 03 01:52:55.161168 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 694/1431] 10.222.0.67 () {60 vars in 1217 bytes} [Wed Aug 3 01:52:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:52:55.166792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-72081189-36b2-46f7-a7ec-720332a1af73 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b1343e1f0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:55.222593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG neutronclient.v2_0.client [None req-72081189-36b2-46f7-a7ec-720332a1af73 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist", "detail": ""}} {{(pid=125942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:52:55.223816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.security_group_api [None req-72081189-36b2-46f7-a7ec-720332a1af73 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Neutron security group d0369026-0cf3-4637-bb58-f158e59b3a3f not found {{(pid=125942) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 01:52:55.224858 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-72081189-36b2-46f7-a7ec-720332a1af73 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist Aug 03 01:52:55.224858 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-b26cdd78-db4e-4e91-9c64-2ad1d0672e5b'] Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-72081189-36b2-46f7-a7ec-720332a1af73 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/os-security-groups/d0369026-0cf3-4637-bb58-f158e59b3a3f HTTP/1.1 Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: exception: Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-b26cdd78-db4e-4e91-9c64-2ad1d0672e5b'] Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'd0369026-0cf3-4637-bb58-f158e59b3a3f'} Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:52:55.228305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b26cdd78-db4e-4e91-9c64-2ad1d0672e5b'] Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b26cdd78-db4e-4e91-9c64-2ad1d0672e5b'] Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b26cdd78-db4e-4e91-9c64-2ad1d0672e5b'] Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b26cdd78-db4e-4e91-9c64-2ad1d0672e5b'] Aug 03 01:52:55.232443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.235979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-72081189-36b2-46f7-a7ec-720332a1af73 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 404 to user: Security group d0369026-0cf3-4637-bb58-f158e59b3a3f does not exist Aug 03 01:52:55.235979 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-b26cdd78-db4e-4e91-9c64-2ad1d0672e5b'] {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:55.237138 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-72081189-36b2-46f7-a7ec-720332a1af73 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/d0369026-0cf3-4637-bb58-f158e59b3a3f" status: 404 len: 194 microversion: 2.1 time: 0.074598 Aug 03 01:52:55.237969 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 695/1432] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:52:55 2022] DELETE /compute/v2.1/os-security-groups/d0369026-0cf3-4637-bb58-f158e59b3a3f => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:55.301021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-58d8010d-24a0-4c1b-9e55-7b761067abbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:55.310471 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-58d8010d-24a0-4c1b-9e55-7b761067abbf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1319 microversion: 2.1 time: 0.279168 Aug 03 01:52:55.311702 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 738/1433] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:55 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:55.316749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f370faea-c067-404f-b839-14a9dd6c100a req-045a5afa-34ac-4b51-813c-32c3c1a23f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8397a8e-08c7-4844-90eb-80949ac27e92", "name": "network-vif-plugged", "status": "completed", "tag": "163a242a-344a-4765-b50c-fff46a880c74"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:55.327711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f370faea-c067-404f-b839-14a9dd6c100a req-045a5afa-34ac-4b51-813c-32c3c1a23f31 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.328455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f370faea-c067-404f-b839-14a9dd6c100a req-045a5afa-34ac-4b51-813c-32c3c1a23f31 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.343757 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f370faea-c067-404f-b839-14a9dd6c100a req-045a5afa-34ac-4b51-813c-32c3c1a23f31 service nova] Creating event network-vif-plugged:163a242a-344a-4765-b50c-fff46a880c74 for instance c8397a8e-08c7-4844-90eb-80949ac27e92 on n-h1-826529-8 Aug 03 01:52:55.349537 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f370faea-c067-404f-b839-14a9dd6c100a req-045a5afa-34ac-4b51-813c-32c3c1a23f31 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036344 Aug 03 01:52:55.350627 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 739/1434] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:55.357865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20fa1606-61af-4853-b2d4-4f8c38a4851e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:55.358929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-20fa1606-61af-4853-b2d4-4f8c38a4851e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: e4222150-6354-462f-9144-fb034666c245] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:55.366076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20fa1606-61af-4853-b2d4-4f8c38a4851e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.366572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20fa1606-61af-4853-b2d4-4f8c38a4851e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.367889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20fa1606-61af-4853-b2d4-4f8c38a4851e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.368669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20fa1606-61af-4853-b2d4-4f8c38a4851e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.398169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-20fa1606-61af-4853-b2d4-4f8c38a4851e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: e4222150-6354-462f-9144-fb034666c245] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:52:55.434351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-81dd180d-f7a0-4b76-9ba7-9a9d8dc563fa tempest-AbsoluteLimitsTestJSON-1075082755 tempest-AbsoluteLimitsTestJSON-1075082755-project] Calling method '.version_select at 0x7f5b1333a0d0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:55.444627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:55.458012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81dd180d-f7a0-4b76-9ba7-9a9d8dc563fa tempest-AbsoluteLimitsTestJSON-1075082755 tempest-AbsoluteLimitsTestJSON-1075082755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.458481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81dd180d-f7a0-4b76-9ba7-9a9d8dc563fa tempest-AbsoluteLimitsTestJSON-1075082755 tempest-AbsoluteLimitsTestJSON-1075082755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.461798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81dd180d-f7a0-4b76-9ba7-9a9d8dc563fa tempest-AbsoluteLimitsTestJSON-1075082755 tempest-AbsoluteLimitsTestJSON-1075082755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.462360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81dd180d-f7a0-4b76-9ba7-9a9d8dc563fa tempest-AbsoluteLimitsTestJSON-1075082755 tempest-AbsoluteLimitsTestJSON-1075082755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.495428 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-81dd180d-f7a0-4b76-9ba7-9a9d8dc563fa tempest-AbsoluteLimitsTestJSON-1075082755 tempest-AbsoluteLimitsTestJSON-1075082755-project] 10.222.0.67 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.256088 Aug 03 01:52:55.497324 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 696/1435] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 01:52:55 2022] GET /compute/v2.1/limits => generated 511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:55.502621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-61d3fd35-ce31-43c1-8f81-4aef8f0c30e0 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b132a2940>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:55.529022 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-20fa1606-61af-4853-b2d4-4f8c38a4851e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245" status: 204 len: 0 microversion: 2.1 time: 0.175778 Aug 03 01:52:55.531442 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 740/1436] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:52:55 2022] DELETE /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:52:55.531829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG neutronclient.v2_0.client [None req-61d3fd35-ce31-43c1-8f81-4aef8f0c30e0 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist", "detail": ""}} {{(pid=125942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:52:55.532778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.security_group_api [None req-61d3fd35-ce31-43c1-8f81-4aef8f0c30e0 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Neutron security group 71cf155f-2119-4be9-8730-8be56ce042ce not found {{(pid=125942) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 01:52:55.533554 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-61d3fd35-ce31-43c1-8f81-4aef8f0c30e0 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist Aug 03 01:52:55.533554 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-952fae07-442e-49f2-a3d8-0c82b4e5dc5e'] Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-61d3fd35-ce31-43c1-8f81-4aef8f0c30e0 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/os-security-groups/71cf155f-2119-4be9-8730-8be56ce042ce HTTP/1.1 Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: exception: Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-952fae07-442e-49f2-a3d8-0c82b4e5dc5e'] Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '71cf155f-2119-4be9-8730-8be56ce042ce'} Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:52:55.536039 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-952fae07-442e-49f2-a3d8-0c82b4e5dc5e'] Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-952fae07-442e-49f2-a3d8-0c82b4e5dc5e'] Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-952fae07-442e-49f2-a3d8-0c82b4e5dc5e'] Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-952fae07-442e-49f2-a3d8-0c82b4e5dc5e'] Aug 03 01:52:55.540860 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.545323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-61d3fd35-ce31-43c1-8f81-4aef8f0c30e0 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 404 to user: Security group 71cf155f-2119-4be9-8730-8be56ce042ce does not exist Aug 03 01:52:55.545323 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-952fae07-442e-49f2-a3d8-0c82b4e5dc5e'] {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:55.547424 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-61d3fd35-ce31-43c1-8f81-4aef8f0c30e0 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/71cf155f-2119-4be9-8730-8be56ce042ce" status: 404 len: 194 microversion: 2.1 time: 0.049287 Aug 03 01:52:55.547547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3af5668f-d403-4c33-a19b-69a73f6a6d61 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:55.548469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3af5668f-d403-4c33-a19b-69a73f6a6d61 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: e4222150-6354-462f-9144-fb034666c245] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:55.552271 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 697/1437] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:52:55 2022] DELETE /compute/v2.1/os-security-groups/71cf155f-2119-4be9-8730-8be56ce042ce => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:55.556333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3af5668f-d403-4c33-a19b-69a73f6a6d61 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.557551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3af5668f-d403-4c33-a19b-69a73f6a6d61 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.558757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3af5668f-d403-4c33-a19b-69a73f6a6d61 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.559295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3af5668f-d403-4c33-a19b-69a73f6a6d61 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.560561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-230bbe33-ba6f-4f39-bf2a-7a1976478ada tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b130c54c0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:55.586734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG neutronclient.v2_0.client [None req-230bbe33-ba6f-4f39-bf2a-7a1976478ada tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist", "detail": ""}} {{(pid=125942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:52:55.587664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.security_group_api [None req-230bbe33-ba6f-4f39-bf2a-7a1976478ada tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Neutron security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 not found {{(pid=125942) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 01:52:55.588296 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-230bbe33-ba6f-4f39-bf2a-7a1976478ada tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist Aug 03 01:52:55.588296 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-9aefff09-4f2b-4ebe-95bb-856c69ac2091'] Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-230bbe33-ba6f-4f39-bf2a-7a1976478ada tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/os-security-groups/8bd76933-a8ce-417f-a989-4e7c8b8bb095 HTTP/1.1 Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: exception: Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-9aefff09-4f2b-4ebe-95bb-856c69ac2091'] Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '8bd76933-a8ce-417f-a989-4e7c8b8bb095'} Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:52:55.591592 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9aefff09-4f2b-4ebe-95bb-856c69ac2091'] Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9aefff09-4f2b-4ebe-95bb-856c69ac2091'] Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9aefff09-4f2b-4ebe-95bb-856c69ac2091'] Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9aefff09-4f2b-4ebe-95bb-856c69ac2091'] Aug 03 01:52:55.596140 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.599872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-230bbe33-ba6f-4f39-bf2a-7a1976478ada tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 404 to user: Security group 8bd76933-a8ce-417f-a989-4e7c8b8bb095 does not exist Aug 03 01:52:55.599872 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-9aefff09-4f2b-4ebe-95bb-856c69ac2091'] {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:55.600745 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-230bbe33-ba6f-4f39-bf2a-7a1976478ada tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/8bd76933-a8ce-417f-a989-4e7c8b8bb095" status: 404 len: 194 microversion: 2.1 time: 0.047106 Aug 03 01:52:55.606206 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 698/1438] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:52:55 2022] DELETE /compute/v2.1/os-security-groups/8bd76933-a8ce-417f-a989-4e7c8b8bb095 => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:55.624809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-809d0442-0f83-43e2-bb69-9542ecca9695 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b132a2940>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:55.671058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG neutronclient.v2_0.client [None req-809d0442-0f83-43e2-bb69-9542ecca9695 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist", "detail": ""}} {{(pid=125942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 01:52:55.671763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.security_group_api [None req-809d0442-0f83-43e2-bb69-9542ecca9695 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Neutron security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 not found {{(pid=125942) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 01:52:55.672297 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-809d0442-0f83-43e2-bb69-9542ecca9695 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist Aug 03 01:52:55.672297 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-2e730d3b-7bd6-422b-97e2-4ff4f66c1820'] Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-809d0442-0f83-43e2-bb69-9542ecca9695 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/os-security-groups/a1acad7f-ccdb-4bc9-90ee-d338343621d3 HTTP/1.1 Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: exception: Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-2e730d3b-7bd6-422b-97e2-4ff4f66c1820'] Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'a1acad7f-ccdb-4bc9-90ee-d338343621d3'} Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 01:52:55.674151 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e730d3b-7bd6-422b-97e2-4ff4f66c1820'] Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e730d3b-7bd6-422b-97e2-4ff4f66c1820'] Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e730d3b-7bd6-422b-97e2-4ff4f66c1820'] Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e730d3b-7bd6-422b-97e2-4ff4f66c1820'] Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-809d0442-0f83-43e2-bb69-9542ecca9695 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 404 to user: Security group a1acad7f-ccdb-4bc9-90ee-d338343621d3 does not exist Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-2e730d3b-7bd6-422b-97e2-4ff4f66c1820'] {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-809d0442-0f83-43e2-bb69-9542ecca9695 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/a1acad7f-ccdb-4bc9-90ee-d338343621d3" status: 404 len: 194 microversion: 2.1 time: 0.067998 Aug 03 01:52:55.678719 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 699/1439] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:52:55 2022] DELETE /compute/v2.1/os-security-groups/a1acad7f-ccdb-4bc9-90ee-d338343621d3 => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:52:55.688493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5f64aa8c-bca0-4686-9b7a-2a017c0b30a5 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:55.688493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5f64aa8c-bca0-4686-9b7a-2a017c0b30a5 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:55.702100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f64aa8c-bca0-4686-9b7a-2a017c0b30a5 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.703046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f64aa8c-bca0-4686-9b7a-2a017c0b30a5 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.704433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f64aa8c-bca0-4686-9b7a-2a017c0b30a5 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.705472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f64aa8c-bca0-4686-9b7a-2a017c0b30a5 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.755227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5f64aa8c-bca0-4686-9b7a-2a017c0b30a5 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:52:55.795420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3af5668f-d403-4c33-a19b-69a73f6a6d61 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:55.803863 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3af5668f-d403-4c33-a19b-69a73f6a6d61 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245" status: 200 len: 1522 microversion: 2.1 time: 0.268119 Aug 03 01:52:55.819981 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 741/1440] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:55 2022] GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:55.828725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-191f97b0-1f28-476a-bafc-820d1664fd63 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:55.829663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-191f97b0-1f28-476a-bafc-820d1664fd63 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:55.836529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-191f97b0-1f28-476a-bafc-820d1664fd63 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.837061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-191f97b0-1f28-476a-bafc-820d1664fd63 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.837948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-191f97b0-1f28-476a-bafc-820d1664fd63 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.838462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-191f97b0-1f28-476a-bafc-820d1664fd63 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.864414 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5f64aa8c-bca0-4686-9b7a-2a017c0b30a5 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 204 len: 0 microversion: 2.1 time: 0.182868 Aug 03 01:52:55.866114 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 700/1441] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:52:55 2022] DELETE /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:52:55.876522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f9130586-0dfd-4f8f-abbd-85a1ec2d2b74 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:55.877337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f9130586-0dfd-4f8f-abbd-85a1ec2d2b74 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:55.885383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9130586-0dfd-4f8f-abbd-85a1ec2d2b74 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.885994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9130586-0dfd-4f8f-abbd-85a1ec2d2b74 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:55.887052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9130586-0dfd-4f8f-abbd-85a1ec2d2b74 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:55.887574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9130586-0dfd-4f8f-abbd-85a1ec2d2b74 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:56.180501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-191f97b0-1f28-476a-bafc-820d1664fd63 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:56.192324 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-191f97b0-1f28-476a-bafc-820d1664fd63 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1476 microversion: 2.1 time: 0.370297 Aug 03 01:52:56.196680 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 742/1442] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:55 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1476 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:56.201637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-80c5537a-3b7f-48e1-a0e6-c66d154c89e8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:56.202283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-80c5537a-3b7f-48e1-a0e6-c66d154c89e8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:56.222400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80c5537a-3b7f-48e1-a0e6-c66d154c89e8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:56.222860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80c5537a-3b7f-48e1-a0e6-c66d154c89e8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:56.224020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80c5537a-3b7f-48e1-a0e6-c66d154c89e8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:56.224628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80c5537a-3b7f-48e1-a0e6-c66d154c89e8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:56.315089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f9130586-0dfd-4f8f-abbd-85a1ec2d2b74 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:56.325101 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f9130586-0dfd-4f8f-abbd-85a1ec2d2b74 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 200 len: 1647 microversion: 2.1 time: 0.453852 Aug 03 01:52:56.326649 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 701/1443] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:55 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 1647 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:56.343320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c6d71fc7-f5dd-4a86-8b99-fce3d2788abf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:56.344881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c6d71fc7-f5dd-4a86-8b99-fce3d2788abf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:56.356563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c6d71fc7-f5dd-4a86-8b99-fce3d2788abf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:56.357020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c6d71fc7-f5dd-4a86-8b99-fce3d2788abf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:56.358937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c6d71fc7-f5dd-4a86-8b99-fce3d2788abf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:56.359593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c6d71fc7-f5dd-4a86-8b99-fce3d2788abf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:56.366191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:56.506529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-80c5537a-3b7f-48e1-a0e6-c66d154c89e8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:56.521024 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-80c5537a-3b7f-48e1-a0e6-c66d154c89e8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1322 microversion: 2.1 time: 0.323182 Aug 03 01:52:56.521799 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 743/1444] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:56 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:56.632337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c6d71fc7-f5dd-4a86-8b99-fce3d2788abf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:56.641813 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c6d71fc7-f5dd-4a86-8b99-fce3d2788abf tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1319 microversion: 2.1 time: 0.309111 Aug 03 01:52:56.643778 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 702/1445] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:56 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:56.840731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6b1108b1-3be6-474c-b417-0cd8217d7eeb tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:56.841350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6b1108b1-3be6-474c-b417-0cd8217d7eeb tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: e4222150-6354-462f-9144-fb034666c245] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:56.849011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b1108b1-3be6-474c-b417-0cd8217d7eeb tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:56.849457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b1108b1-3be6-474c-b417-0cd8217d7eeb tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:56.850431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b1108b1-3be6-474c-b417-0cd8217d7eeb tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:56.851158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b1108b1-3be6-474c-b417-0cd8217d7eeb tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:57.092059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6b1108b1-3be6-474c-b417-0cd8217d7eeb tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:57.104585 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6b1108b1-3be6-474c-b417-0cd8217d7eeb tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245" status: 200 len: 1522 microversion: 2.1 time: 0.267324 Aug 03 01:52:57.105100 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 744/1446] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:56 2022] GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:57.217313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3f10fe88-2e27-43f1-a58a-7e1bbad704ca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:57.218076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3f10fe88-2e27-43f1-a58a-7e1bbad704ca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:57.224955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f10fe88-2e27-43f1-a58a-7e1bbad704ca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:57.225835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f10fe88-2e27-43f1-a58a-7e1bbad704ca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:57.227238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f10fe88-2e27-43f1-a58a-7e1bbad704ca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:57.227942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f10fe88-2e27-43f1-a58a-7e1bbad704ca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:57.430711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-15d52073-54e5-4e0f-acf9-2e17af6464ca req-0e0109d7-3a13-4d53-b50d-133bf51200ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72330b06-28da-4653-aae1-004aa59d88b4", "name": "network-vif-unplugged", "status": "completed", "tag": "91766d4e-1d4f-4c67-8adf-edbd715310e0"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:57.432353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3f10fe88-2e27-43f1-a58a-7e1bbad704ca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:57.443053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-15d52073-54e5-4e0f-acf9-2e17af6464ca req-0e0109d7-3a13-4d53-b50d-133bf51200ab service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:57.443511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-15d52073-54e5-4e0f-acf9-2e17af6464ca req-0e0109d7-3a13-4d53-b50d-133bf51200ab service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:57.446458 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3f10fe88-2e27-43f1-a58a-7e1bbad704ca tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1476 microversion: 2.1 time: 0.232130 Aug 03 01:52:57.458951 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 745/1447] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:57 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1476 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:52:57.458951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-32e8e7ba-5963-4912-9cf1-dc65b92674b9 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:57.458951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-32e8e7ba-5963-4912-9cf1-dc65b92674b9 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:57.462161 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-15d52073-54e5-4e0f-acf9-2e17af6464ca req-0e0109d7-3a13-4d53-b50d-133bf51200ab service nova] Creating event network-vif-unplugged:91766d4e-1d4f-4c67-8adf-edbd715310e0 for instance 72330b06-28da-4653-aae1-004aa59d88b4 on n-h1-826529-8 Aug 03 01:52:57.466261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-32e8e7ba-5963-4912-9cf1-dc65b92674b9 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:57.466728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-32e8e7ba-5963-4912-9cf1-dc65b92674b9 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:57.467067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-15d52073-54e5-4e0f-acf9-2e17af6464ca req-0e0109d7-3a13-4d53-b50d-133bf51200ab service nova] Instance 72330b06-28da-4653-aae1-004aa59d88b4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 01:52:57.467901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-32e8e7ba-5963-4912-9cf1-dc65b92674b9 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:57.468355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-32e8e7ba-5963-4912-9cf1-dc65b92674b9 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:57.479005 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-15d52073-54e5-4e0f-acf9-2e17af6464ca req-0e0109d7-3a13-4d53-b50d-133bf51200ab service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.368212 Aug 03 01:52:57.479968 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 703/1448] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:57.548444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4724b702-9b16-4708-8413-57838a046c17 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:57.549186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4724b702-9b16-4708-8413-57838a046c17 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:57.556830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4724b702-9b16-4708-8413-57838a046c17 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:57.557459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4724b702-9b16-4708-8413-57838a046c17 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:57.558280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4724b702-9b16-4708-8413-57838a046c17 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:57.558724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4724b702-9b16-4708-8413-57838a046c17 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:57.761377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-32e8e7ba-5963-4912-9cf1-dc65b92674b9 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:57.772568 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-32e8e7ba-5963-4912-9cf1-dc65b92674b9 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 200 len: 1647 microversion: 2.1 time: 0.323046 Aug 03 01:52:57.773940 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 746/1449] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:57 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 1647 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:57.787791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d8ec599c-9df6-45d2-a298-bc7076358536 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:57.787791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d8ec599c-9df6-45d2-a298-bc7076358536 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:57.788260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8ec599c-9df6-45d2-a298-bc7076358536 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:57.788498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8ec599c-9df6-45d2-a298-bc7076358536 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:57.790381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8ec599c-9df6-45d2-a298-bc7076358536 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:57.791206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8ec599c-9df6-45d2-a298-bc7076358536 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:57.816721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4724b702-9b16-4708-8413-57838a046c17 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:57.825910 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4724b702-9b16-4708-8413-57838a046c17 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1322 microversion: 2.1 time: 0.282415 Aug 03 01:52:57.826888 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 704/1450] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:57 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:52:57.954592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d8ec599c-9df6-45d2-a298-bc7076358536 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:57.962509 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d8ec599c-9df6-45d2-a298-bc7076358536 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1319 microversion: 2.1 time: 0.187237 Aug 03 01:52:57.963119 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 747/1451] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:57 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:58.137280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a5fe9269-170f-4a92-9e77-514deb1fd757 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:58.140420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a5fe9269-170f-4a92-9e77-514deb1fd757 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: e4222150-6354-462f-9144-fb034666c245] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:58.154203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5fe9269-170f-4a92-9e77-514deb1fd757 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:58.155048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5fe9269-170f-4a92-9e77-514deb1fd757 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:58.156776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5fe9269-170f-4a92-9e77-514deb1fd757 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:58.157492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5fe9269-170f-4a92-9e77-514deb1fd757 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:58.169246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-63194a01-e77f-4f14-bc1b-b81bf1dc2af9 tempest-AbsoluteLimitsNegativeTestJSON-183187210 tempest-AbsoluteLimitsNegativeTestJSON-183187210-project] Calling method '.version_select at 0x7f5b132fb310>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:58.194158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63194a01-e77f-4f14-bc1b-b81bf1dc2af9 tempest-AbsoluteLimitsNegativeTestJSON-183187210 tempest-AbsoluteLimitsNegativeTestJSON-183187210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:58.196050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63194a01-e77f-4f14-bc1b-b81bf1dc2af9 tempest-AbsoluteLimitsNegativeTestJSON-183187210 tempest-AbsoluteLimitsNegativeTestJSON-183187210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:58.198326 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63194a01-e77f-4f14-bc1b-b81bf1dc2af9 tempest-AbsoluteLimitsNegativeTestJSON-183187210 tempest-AbsoluteLimitsNegativeTestJSON-183187210-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:58.199858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63194a01-e77f-4f14-bc1b-b81bf1dc2af9 tempest-AbsoluteLimitsNegativeTestJSON-183187210 tempest-AbsoluteLimitsNegativeTestJSON-183187210-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:58.241302 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-63194a01-e77f-4f14-bc1b-b81bf1dc2af9 tempest-AbsoluteLimitsNegativeTestJSON-183187210 tempest-AbsoluteLimitsNegativeTestJSON-183187210-project] 10.222.0.67 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.232322 Aug 03 01:52:58.261942 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 705/1452] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Aug 3 01:52:58 2022] GET /compute/v2.1/limits => generated 511 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:52:58.270817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5e7e7405-d346-423c-873d-6c22c1feece7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34e930c8-ca38-4499-9834-8159f8d52447", "device": "/dev/xvdb"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:58.276658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5e7e7405-d346-423c-873d-6c22c1feece7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:58.287703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e7e7405-d346-423c-873d-6c22c1feece7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:58.289532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e7e7405-d346-423c-873d-6c22c1feece7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:58.291335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e7e7405-d346-423c-873d-6c22c1feece7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:58.292394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e7e7405-d346-423c-873d-6c22c1feece7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:58.409162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a5fe9269-170f-4a92-9e77-514deb1fd757 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:58.422049 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a5fe9269-170f-4a92-9e77-514deb1fd757 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245" status: 200 len: 1522 microversion: 2.1 time: 0.295926 Aug 03 01:52:58.423149 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 748/1453] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:58 2022] GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:52:58.431779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-968eb003-b84e-4a84-a0c0-e449e9d72ac5 tempest-AbsoluteLimitsNegativeTestJSON-183187210 tempest-AbsoluteLimitsNegativeTestJSON-183187210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-666346586", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:52:58.534052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-968eb003-b84e-4a84-a0c0-e449e9d72ac5 tempest-AbsoluteLimitsNegativeTestJSON-183187210 tempest-AbsoluteLimitsNegativeTestJSON-183187210-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:52:58.764400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-968eb003-b84e-4a84-a0c0-e449e9d72ac5 tempest-AbsoluteLimitsNegativeTestJSON-183187210 tempest-AbsoluteLimitsNegativeTestJSON-183187210-project] Getting quotas for project 4962921e1bca41baa62243691263bf41. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:52:58.768947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-968eb003-b84e-4a84-a0c0-e449e9d72ac5 tempest-AbsoluteLimitsNegativeTestJSON-183187210 tempest-AbsoluteLimitsNegativeTestJSON-183187210-project] Getting quotas for user ec19dc5bb20d4710939501c0a3d29afe and project 4962921e1bca41baa62243691263bf41. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:52:58.783053 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-968eb003-b84e-4a84-a0c0-e449e9d72ac5 tempest-AbsoluteLimitsNegativeTestJSON-183187210 tempest-AbsoluteLimitsNegativeTestJSON-183187210-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-968eb003-b84e-4a84-a0c0-e449e9d72ac5 tempest-AbsoluteLimitsNegativeTestJSON-183187210 tempest-AbsoluteLimitsNegativeTestJSON-183187210-project] Request method failure captured: Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 1751 Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dT5HBh6_9JDHCkbmNeLC953B3WHv5Ehf66U9gHva04f97n-DN7sgRoCU2ftNzZpBMLT2JxxXKm2L5or3xbuq7GGi6gOQxSFZ9xKchhuSy1nbUU9APuxRzKdb9N84yEtGGPjOHjQ80MgnNREgvO6zlNECHPQR0L-99M00SrIBpx8C9Q Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 4962921e1bca41baa62243691263bf41 Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-183187210 Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4962921e1bca41baa62243691263bf41", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4962921e1bca41baa62243691263bf41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4962921e1bca41baa62243691263bf41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4962921e1bca41baa62243691263bf41"}]}] Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-183187210 Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 4962921e1bca41baa62243691263bf41 Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-183187210 Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-183187210-project Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: ec19dc5bb20d4710939501c0a3d29afe Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-183187210-project Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-666346586", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:52:58.788130 n-d-826529-8 devstack@n-api.service[125941]: exception: Maximum number of metadata items exceeds 128 Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-666346586', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:52:58.791233 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-968eb003-b84e-4a84-a0c0-e449e9d72ac5 tempest-AbsoluteLimitsNegativeTestJSON-183187210 tempest-AbsoluteLimitsNegativeTestJSON-183187210-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-968eb003-b84e-4a84-a0c0-e449e9d72ac5 tempest-AbsoluteLimitsNegativeTestJSON-183187210 tempest-AbsoluteLimitsNegativeTestJSON-183187210-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.367283 Aug 03 01:52:58.795161 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 749/1454] 10.222.0.67 () {60 vars in 1148 bytes} [Wed Aug 3 01:52:58 2022] POST /compute/v2.1/servers => generated 87 bytes in 369 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:52:58.802520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fd43fc21-d328-48e2-bf32-8bb4ccf7d90d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:58.803169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fd43fc21-d328-48e2-bf32-8bb4ccf7d90d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:58.815542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd43fc21-d328-48e2-bf32-8bb4ccf7d90d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:58.816315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd43fc21-d328-48e2-bf32-8bb4ccf7d90d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:58.817947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd43fc21-d328-48e2-bf32-8bb4ccf7d90d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:58.818623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd43fc21-d328-48e2-bf32-8bb4ccf7d90d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:59.033939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fd43fc21-d328-48e2-bf32-8bb4ccf7d90d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:59.044200 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fd43fc21-d328-48e2-bf32-8bb4ccf7d90d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1476 microversion: 2.1 time: 0.249577 Aug 03 01:52:59.045493 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 750/1455] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:58 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:59.050815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-01dcf68e-8362-4976-bdd0-4b8910585339 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:59.051699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-01dcf68e-8362-4976-bdd0-4b8910585339 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:59.058653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01dcf68e-8362-4976-bdd0-4b8910585339 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:59.059570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01dcf68e-8362-4976-bdd0-4b8910585339 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:59.061177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01dcf68e-8362-4976-bdd0-4b8910585339 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:59.061999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01dcf68e-8362-4976-bdd0-4b8910585339 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:59.308439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-01dcf68e-8362-4976-bdd0-4b8910585339 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:59.319614 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-01dcf68e-8362-4976-bdd0-4b8910585339 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 200 len: 1647 microversion: 2.1 time: 0.272330 Aug 03 01:52:59.321132 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 751/1456] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:59 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 1647 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:59.334999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ccc7c951-3dba-486c-91b4-473e0b806f63 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:59.336950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ccc7c951-3dba-486c-91b4-473e0b806f63 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:59.345997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccc7c951-3dba-486c-91b4-473e0b806f63 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:59.346895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccc7c951-3dba-486c-91b4-473e0b806f63 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:59.348202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccc7c951-3dba-486c-91b4-473e0b806f63 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:59.348855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccc7c951-3dba-486c-91b4-473e0b806f63 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:59.548850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ccc7c951-3dba-486c-91b4-473e0b806f63 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:59.558480 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ccc7c951-3dba-486c-91b4-473e0b806f63 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1322 microversion: 2.1 time: 0.235793 Aug 03 01:52:59.559097 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 752/1457] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:59 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:59.563751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4d7315f5-f539-4df9-aff6-6f6c36872548 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:59.564521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4d7315f5-f539-4df9-aff6-6f6c36872548 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:59.572822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d7315f5-f539-4df9-aff6-6f6c36872548 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:59.573038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d7315f5-f539-4df9-aff6-6f6c36872548 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:59.573738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d7315f5-f539-4df9-aff6-6f6c36872548 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:59.574282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d7315f5-f539-4df9-aff6-6f6c36872548 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:59.871053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:52:59.905430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4d7315f5-f539-4df9-aff6-6f6c36872548 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:52:59.913525 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4d7315f5-f539-4df9-aff6-6f6c36872548 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1319 microversion: 2.1 time: 0.353372 Aug 03 01:52:59.914952 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 753/1458] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:59 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:52:59.919764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2f7fda61-be2d-4c27-bdf1-1dba5b93a724 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:52:59.920897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2f7fda61-be2d-4c27-bdf1-1dba5b93a724 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: e4222150-6354-462f-9144-fb034666c245] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:52:59.926746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f7fda61-be2d-4c27-bdf1-1dba5b93a724 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:59.927924 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f7fda61-be2d-4c27-bdf1-1dba5b93a724 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:52:59.928175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f7fda61-be2d-4c27-bdf1-1dba5b93a724 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:52:59.928588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f7fda61-be2d-4c27-bdf1-1dba5b93a724 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:00.238662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2f7fda61-be2d-4c27-bdf1-1dba5b93a724 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:00.254563 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2f7fda61-be2d-4c27-bdf1-1dba5b93a724 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245" status: 200 len: 1522 microversion: 2.1 time: 0.338411 Aug 03 01:53:00.267368 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 754/1459] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:52:59 2022] GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:00.296935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-bf3a3484-8533-411f-8053-c5fc768cd17d req-6e114b35-9487-42b5-ae63-a945819160ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdf7e153-fecb-4313-833e-5f17c0676fe8", "tag": "bd263e94-2840-4e82-9a94-ab1484dea7f6"}, {"name": "network-changed", "server_uuid": "72330b06-28da-4653-aae1-004aa59d88b4", "tag": "91766d4e-1d4f-4c67-8adf-edbd715310e0"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:00.330868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bf3a3484-8533-411f-8053-c5fc768cd17d req-6e114b35-9487-42b5-ae63-a945819160ca service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:00.331950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bf3a3484-8533-411f-8053-c5fc768cd17d req-6e114b35-9487-42b5-ae63-a945819160ca service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:00.379525 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-bf3a3484-8533-411f-8053-c5fc768cd17d req-6e114b35-9487-42b5-ae63-a945819160ca service nova] Creating event network-changed:bd263e94-2840-4e82-9a94-ab1484dea7f6 for instance fdf7e153-fecb-4313-833e-5f17c0676fe8 on n-h2-826529-8 Aug 03 01:53:00.380904 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-bf3a3484-8533-411f-8053-c5fc768cd17d req-6e114b35-9487-42b5-ae63-a945819160ca service nova] Creating event network-changed:91766d4e-1d4f-4c67-8adf-edbd715310e0 for instance 72330b06-28da-4653-aae1-004aa59d88b4 on n-h1-826529-8 Aug 03 01:53:00.412913 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-bf3a3484-8533-411f-8053-c5fc768cd17d req-6e114b35-9487-42b5-ae63-a945819160ca service nova] Instance 72330b06-28da-4653-aae1-004aa59d88b4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 01:53:00.439380 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-bf3a3484-8533-411f-8053-c5fc768cd17d req-6e114b35-9487-42b5-ae63-a945819160ca service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.168193 Aug 03 01:53:00.441269 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 755/1460] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:00.448360 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5e7e7405-d346-423c-873d-6c22c1feece7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "POST /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 2.176526 Aug 03 01:53:00.451559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-111a3ddf-65d8-4378-96d3-d534af1f4df4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:00.452524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-111a3ddf-65d8-4378-96d3-d534af1f4df4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:00.462045 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 706/1461] 10.222.0.67 () {62 vars in 1364 bytes} [Wed Aug 3 01:52:58 2022] POST /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-volume_attachments => generated 194 bytes in 2199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:53:00.487194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f1189aa2-4786-4d16-b45f-f6fb03d9f0e7 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:00.488202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f1189aa2-4786-4d16-b45f-f6fb03d9f0e7 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:00.498572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-111a3ddf-65d8-4378-96d3-d534af1f4df4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:00.499477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-111a3ddf-65d8-4378-96d3-d534af1f4df4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:00.500875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-111a3ddf-65d8-4378-96d3-d534af1f4df4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:00.508294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-111a3ddf-65d8-4378-96d3-d534af1f4df4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:00.521451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1189aa2-4786-4d16-b45f-f6fb03d9f0e7 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:00.521910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1189aa2-4786-4d16-b45f-f6fb03d9f0e7 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:00.522777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1189aa2-4786-4d16-b45f-f6fb03d9f0e7 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:00.524036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1189aa2-4786-4d16-b45f-f6fb03d9f0e7 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:01.145273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f1189aa2-4786-4d16-b45f-f6fb03d9f0e7 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:01.151053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-111a3ddf-65d8-4378-96d3-d534af1f4df4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:01.162681 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-111a3ddf-65d8-4378-96d3-d534af1f4df4 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1476 microversion: 2.1 time: 0.719007 Aug 03 01:53:01.163921 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 756/1462] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:00 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1476 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:01.168383 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f1189aa2-4786-4d16-b45f-f6fb03d9f0e7 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 200 len: 1647 microversion: 2.1 time: 0.704489 Aug 03 01:53:01.171355 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 707/1463] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:00 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 1647 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:01.178621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-94c72eaa-baff-4bed-bce8-97c484e0922f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:01.179848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f091e0a9-f991-425e-94ac-f63b5a15f75c req-3ae1abaa-10c4-4856-9667-4bd0da0d0b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56094624-65e4-48bb-8337-280213fb3238", "name": "network-vif-plugged", "status": "completed", "tag": "5b6b43c2-2954-468c-ab30-27bff1ffac6c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:01.201105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-94c72eaa-baff-4bed-bce8-97c484e0922f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:01.220035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f091e0a9-f991-425e-94ac-f63b5a15f75c req-3ae1abaa-10c4-4856-9667-4bd0da0d0b43 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:01.220568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f091e0a9-f991-425e-94ac-f63b5a15f75c req-3ae1abaa-10c4-4856-9667-4bd0da0d0b43 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:01.229754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94c72eaa-baff-4bed-bce8-97c484e0922f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:01.230544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94c72eaa-baff-4bed-bce8-97c484e0922f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:01.231598 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94c72eaa-baff-4bed-bce8-97c484e0922f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:01.232283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94c72eaa-baff-4bed-bce8-97c484e0922f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:01.256037 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f091e0a9-f991-425e-94ac-f63b5a15f75c req-3ae1abaa-10c4-4856-9667-4bd0da0d0b43 service nova] Creating event network-vif-plugged:5b6b43c2-2954-468c-ab30-27bff1ffac6c for instance 56094624-65e4-48bb-8337-280213fb3238 on n-h2-826529-8 Aug 03 01:53:01.270641 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f091e0a9-f991-425e-94ac-f63b5a15f75c req-3ae1abaa-10c4-4856-9667-4bd0da0d0b43 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105109 Aug 03 01:53:01.271799 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 757/1464] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:01.571943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-94c72eaa-baff-4bed-bce8-97c484e0922f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:01.586668 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-94c72eaa-baff-4bed-bce8-97c484e0922f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1322 microversion: 2.1 time: 0.413756 Aug 03 01:53:01.588579 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 708/1465] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:01 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:01.596490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0cc50e4b-a2fe-4961-bd5b-8f76aed04970 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:01.597422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0cc50e4b-a2fe-4961-bd5b-8f76aed04970 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:01.611417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cc50e4b-a2fe-4961-bd5b-8f76aed04970 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:01.612172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cc50e4b-a2fe-4961-bd5b-8f76aed04970 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:01.613684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cc50e4b-a2fe-4961-bd5b-8f76aed04970 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:01.615326 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cc50e4b-a2fe-4961-bd5b-8f76aed04970 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.006388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2b124ba5-5900-4c49-8d39-8bc808638129 req-b8f3efe5-7018-44ac-805b-f8770875ce9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4222150-6354-462f-9144-fb034666c245", "name": "network-vif-deleted", "tag": "36b9e373-873b-4320-8a0b-48a7bbd3f55d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:02.028965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2b124ba5-5900-4c49-8d39-8bc808638129 req-b8f3efe5-7018-44ac-805b-f8770875ce9b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.029422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2b124ba5-5900-4c49-8d39-8bc808638129 req-b8f3efe5-7018-44ac-805b-f8770875ce9b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.057262 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2b124ba5-5900-4c49-8d39-8bc808638129 req-b8f3efe5-7018-44ac-805b-f8770875ce9b service nova] Creating event network-vif-deleted:36b9e373-873b-4320-8a0b-48a7bbd3f55d for instance e4222150-6354-462f-9144-fb034666c245 on n-h2-826529-8 Aug 03 01:53:02.067301 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2b124ba5-5900-4c49-8d39-8bc808638129 req-b8f3efe5-7018-44ac-805b-f8770875ce9b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.790568 Aug 03 01:53:02.068558 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 758/1466] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:02.074936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c035e9c8-8644-4e24-ac43-27b0cf94b44c tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:02.075904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c035e9c8-8644-4e24-ac43-27b0cf94b44c tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:02.083356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c035e9c8-8644-4e24-ac43-27b0cf94b44c tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.084097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c035e9c8-8644-4e24-ac43-27b0cf94b44c tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.085079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c035e9c8-8644-4e24-ac43-27b0cf94b44c tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.086329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c035e9c8-8644-4e24-ac43-27b0cf94b44c tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.091148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:02.274294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0cc50e4b-a2fe-4961-bd5b-8f76aed04970 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:02.283980 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0cc50e4b-a2fe-4961-bd5b-8f76aed04970 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1319 microversion: 2.1 time: 0.693680 Aug 03 01:53:02.291745 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 709/1467] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:01 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1319 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:02.298510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c46acd01-655a-4460-89c8-708a26a844c6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:02.299423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c46acd01-655a-4460-89c8-708a26a844c6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: e4222150-6354-462f-9144-fb034666c245] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:02.317065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c46acd01-655a-4460-89c8-708a26a844c6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.317616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c46acd01-655a-4460-89c8-708a26a844c6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.318625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c46acd01-655a-4460-89c8-708a26a844c6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.319191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c46acd01-655a-4460-89c8-708a26a844c6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.358107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c46acd01-655a-4460-89c8-708a26a844c6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.361001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c46acd01-655a-4460-89c8-708a26a844c6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.363193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-c46acd01-655a-4460-89c8-708a26a844c6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lazy-loading 'fault' on Instance uuid e4222150-6354-462f-9144-fb034666c245 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:53:02.375287 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c035e9c8-8644-4e24-ac43-27b0cf94b44c tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1860 microversion: 2.1 time: 0.305262 Aug 03 01:53:02.375886 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 759/1468] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:02 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1860 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:02.397321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31cfd456-5b15-4243-b8f0-9293c698feb6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:02.400013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-31cfd456-5b15-4243-b8f0-9293c698feb6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:02.406174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31cfd456-5b15-4243-b8f0-9293c698feb6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.406632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31cfd456-5b15-4243-b8f0-9293c698feb6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.407451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31cfd456-5b15-4243-b8f0-9293c698feb6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.407886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31cfd456-5b15-4243-b8f0-9293c698feb6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.414496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c46acd01-655a-4460-89c8-708a26a844c6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:02.423119 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c46acd01-655a-4460-89c8-708a26a844c6 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245" status: 200 len: 1313 microversion: 2.1 time: 0.129965 Aug 03 01:53:02.424011 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 710/1469] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:02 2022] GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245 => generated 1313 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:02.428936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-781bf1e5-4072-4721-984c-7e20fde2d10f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:02.430336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-781bf1e5-4072-4721-984c-7e20fde2d10f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:02.443063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-781bf1e5-4072-4721-984c-7e20fde2d10f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.443962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-781bf1e5-4072-4721-984c-7e20fde2d10f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.445422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-781bf1e5-4072-4721-984c-7e20fde2d10f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.446574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-781bf1e5-4072-4721-984c-7e20fde2d10f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.506263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-781bf1e5-4072-4721-984c-7e20fde2d10f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.506940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-781bf1e5-4072-4721-984c-7e20fde2d10f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.508384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-781bf1e5-4072-4721-984c-7e20fde2d10f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lazy-loading 'fault' on Instance uuid 01b31b62-ac13-47d2-af5f-fb68852ca81b {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:53:02.590225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-781bf1e5-4072-4721-984c-7e20fde2d10f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20aac1f6cabe41e28254f4ebe0c96218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c5a2a2419749f393d08ce2e3dd3f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:02.600582 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-781bf1e5-4072-4721-984c-7e20fde2d10f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 200 len: 1305 microversion: 2.1 time: 0.175174 Aug 03 01:53:02.613272 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 711/1470] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:02 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 1305 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:02.620739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3928d662-e0e2-4119-b65a-158215bf62b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826529-8", "block_migration": true, "disk_over_commit": false}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:02.624796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3928d662-e0e2-4119-b65a-158215bf62b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:02.637150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3928d662-e0e2-4119-b65a-158215bf62b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.638118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3928d662-e0e2-4119-b65a-158215bf62b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.639705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3928d662-e0e2-4119-b65a-158215bf62b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.640212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3928d662-e0e2-4119-b65a-158215bf62b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.669869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-31cfd456-5b15-4243-b8f0-9293c698feb6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:02.675583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-3928d662-e0e2-4119-b65a-158215bf62b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lazy-loading 'flavor' on Instance uuid be0bf271-225a-4ad9-baf8-c7dad07593c7 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:53:02.678398 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-31cfd456-5b15-4243-b8f0-9293c698feb6 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1474 microversion: 2.1 time: 0.285644 Aug 03 01:53:02.681009 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 760/1471] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:02 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1474 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:02.692280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3928d662-e0e2-4119-b65a-158215bf62b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Going to try to live migrate instance to n-h2-826529-8 {{(pid=125942) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 01:53:02.693546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-899e90b3-6cfb-4fb0-ab6b-d2ba3e05a9a0 req-a06cd0c9-6b57-4618-994b-870bbc345528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b31b62-ac13-47d2-af5f-fb68852ca81b", "name": "network-vif-deleted", "tag": "c05623b0-a20e-4d6a-b404-b4d7edd6104a"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:02.704711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-899e90b3-6cfb-4fb0-ab6b-d2ba3e05a9a0 req-a06cd0c9-6b57-4618-994b-870bbc345528 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.705409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-899e90b3-6cfb-4fb0-ab6b-d2ba3e05a9a0 req-a06cd0c9-6b57-4618-994b-870bbc345528 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.718415 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-899e90b3-6cfb-4fb0-ab6b-d2ba3e05a9a0 req-a06cd0c9-6b57-4618-994b-870bbc345528 service nova] Creating event network-vif-deleted:c05623b0-a20e-4d6a-b404-b4d7edd6104a for instance 01b31b62-ac13-47d2-af5f-fb68852ca81b on n-h2-826529-8 Aug 03 01:53:02.729723 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-899e90b3-6cfb-4fb0-ab6b-d2ba3e05a9a0 req-a06cd0c9-6b57-4618-994b-870bbc345528 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047438 Aug 03 01:53:02.730590 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 761/1472] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:02.744214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7e103bd4-5b4d-4963-aaf4-73b7fc26a23f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:02.745328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7e103bd4-5b4d-4963-aaf4-73b7fc26a23f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:02.760652 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e103bd4-5b4d-4963-aaf4-73b7fc26a23f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.761361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e103bd4-5b4d-4963-aaf4-73b7fc26a23f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:02.762328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e103bd4-5b4d-4963-aaf4-73b7fc26a23f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:02.763652 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e103bd4-5b4d-4963-aaf4-73b7fc26a23f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:03.022330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7e103bd4-5b4d-4963-aaf4-73b7fc26a23f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:03.036400 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7e103bd4-5b4d-4963-aaf4-73b7fc26a23f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1322 microversion: 2.1 time: 0.304448 Aug 03 01:53:03.037642 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 762/1473] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:02 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:03.317002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1bef5e46-88fa-4dc7-83c7-ecf708f9373d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:03.317284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1bef5e46-88fa-4dc7-83c7-ecf708f9373d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:03.346031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bef5e46-88fa-4dc7-83c7-ecf708f9373d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:03.349570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bef5e46-88fa-4dc7-83c7-ecf708f9373d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:03.354508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bef5e46-88fa-4dc7-83c7-ecf708f9373d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:03.355285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bef5e46-88fa-4dc7-83c7-ecf708f9373d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:04.301211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1bef5e46-88fa-4dc7-83c7-ecf708f9373d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:04.313371 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1bef5e46-88fa-4dc7-83c7-ecf708f9373d tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1319 microversion: 2.1 time: 1.002007 Aug 03 01:53:04.315167 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 763/1474] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:03 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1319 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:04.342546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-305d0258-c3df-4a03-ae80-2be0983bdb06 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:04.344893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-305d0258-c3df-4a03-ae80-2be0983bdb06 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: e4222150-6354-462f-9144-fb034666c245] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:04.361499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-305d0258-c3df-4a03-ae80-2be0983bdb06 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:04.363176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-305d0258-c3df-4a03-ae80-2be0983bdb06 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:04.367318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-305d0258-c3df-4a03-ae80-2be0983bdb06 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:04.369246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-305d0258-c3df-4a03-ae80-2be0983bdb06 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:04.405269 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-305d0258-c3df-4a03-ae80-2be0983bdb06 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] HTTP exception thrown: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-305d0258-c3df-4a03-ae80-2be0983bdb06 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Request method failure captured: Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245 HTTP/1.1 Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dTasCpicNUmy0l5wGshmTLAXs1TGKP24QtjgXEt1pfUM0Fz9OSCOGeM1Vm2kiXZrIwc3GlE8Q9buzy_vqnSglLvgS66oHsTLUBwBpzy5s-DMQAApHnTJ_tFXjZJGVif1xjIqetRgGDqqnx0G7OHz6gyC0I-RcrAfksrKvFL5bOm0m8 Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c5b6cc7a4be94f7489c0f749f1b26276", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}] Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5054cb049a374f2c8e26e6d62637f7cc Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'e4222150-6354-462f-9144-fb034666c245'} Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:04.411873 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:04.417805 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:04.417805 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:04.417805 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:04.417805 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:04.417805 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:53:04.417805 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:53:04.417805 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. Aug 03 01:53:04.417805 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:04.420255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-305d0258-c3df-4a03-ae80-2be0983bdb06 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Returning 404 to user: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:04.422660 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-305d0258-c3df-4a03-ae80-2be0983bdb06 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245" status: 404 len: 111 microversion: 2.1 time: 0.092258 Aug 03 01:53:04.426821 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 764/1475] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:04 2022] GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:53:04.439265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2f002b9c-6639-4c41-acf9-53a9e020f86f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:04.440422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2f002b9c-6639-4c41-acf9-53a9e020f86f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] [instance: 01b31b62-ac13-47d2-af5f-fb68852ca81b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:04.457208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f002b9c-6639-4c41-acf9-53a9e020f86f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:04.459654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f002b9c-6639-4c41-acf9-53a9e020f86f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:04.462277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f002b9c-6639-4c41-acf9-53a9e020f86f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:04.463524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f002b9c-6639-4c41-acf9-53a9e020f86f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:04.517832 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-2f002b9c-6639-4c41-acf9-53a9e020f86f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] HTTP exception thrown: Instance 01b31b62-ac13-47d2-af5f-fb68852ca81b could not be found. Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2f002b9c-6639-4c41-acf9-53a9e020f86f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Request method failure captured: Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b HTTP/1.1 Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dScLsBjo4HCLdto7cKwijnJS1UhZq2OT5mAmJsPkoAaczGOmEZe5xa-tI7hWTLSfCT7JvqEsNaAG2Hc47aRT_RrjUSHZz9VNAtYKhCB2WyBqfgdJ3NMuC4dkXCZDQtOGPOT7TuTnDT3vR-7nFCvb73WKXq_uzLAo1q1V7NqOKrHx7Q Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e4c5a2a2419749f393d08ce2e3dd3f8a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e4c5a2a2419749f393d08ce2e3dd3f8a"}]}] Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: e4c5a2a2419749f393d08ce2e3dd3f8a Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1888378356 Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 20aac1f6cabe41e28254f4ebe0c96218 Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupsTestJSON-1888378356-project Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 01b31b62-ac13-47d2-af5f-fb68852ca81b could not be found. Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '01b31b62-ac13-47d2-af5f-fb68852ca81b'} Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01b31b62-ac13-47d2-af5f-fb68852ca81b could not be found. Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01b31b62-ac13-47d2-af5f-fb68852ca81b could not be found. Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:04.523024 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:04.528445 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:04.528445 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:04.528445 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:04.528445 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:53:04.528445 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:53:04.528445 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01b31b62-ac13-47d2-af5f-fb68852ca81b could not be found. Aug 03 01:53:04.528445 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:04.530052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2f002b9c-6639-4c41-acf9-53a9e020f86f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Returning 404 to user: Instance 01b31b62-ac13-47d2-af5f-fb68852ca81b could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:04.531173 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2f002b9c-6639-4c41-acf9-53a9e020f86f tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b" status: 404 len: 111 microversion: 2.1 time: 0.102985 Aug 03 01:53:04.532413 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 765/1476] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:04 2022] GET /compute/v2.1/servers/01b31b62-ac13-47d2-af5f-fb68852ca81b => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:53:04.537409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cba21d43-ea43-4143-84cb-cea5b767b32d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:04.538288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cba21d43-ea43-4143-84cb-cea5b767b32d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:04.545883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cba21d43-ea43-4143-84cb-cea5b767b32d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:04.546623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cba21d43-ea43-4143-84cb-cea5b767b32d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:04.547991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cba21d43-ea43-4143-84cb-cea5b767b32d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:04.548748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cba21d43-ea43-4143-84cb-cea5b767b32d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:05.059255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cba21d43-ea43-4143-84cb-cea5b767b32d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:05.072080 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cba21d43-ea43-4143-84cb-cea5b767b32d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1471 microversion: 2.1 time: 0.538383 Aug 03 01:53:05.074133 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 766/1477] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:04 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1471 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:05.086894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f313d57f-6fb5-4ee0-8f45-cb47f810e46d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:05.087630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f313d57f-6fb5-4ee0-8f45-cb47f810e46d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:05.111197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f313d57f-6fb5-4ee0-8f45-cb47f810e46d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:05.135318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f313d57f-6fb5-4ee0-8f45-cb47f810e46d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:05.136371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f313d57f-6fb5-4ee0-8f45-cb47f810e46d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:05.137144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f313d57f-6fb5-4ee0-8f45-cb47f810e46d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:05.779639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f313d57f-6fb5-4ee0-8f45-cb47f810e46d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:05.790622 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f313d57f-6fb5-4ee0-8f45-cb47f810e46d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1515 microversion: 2.1 time: 0.709376 Aug 03 01:53:05.803305 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 767/1478] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:05 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1515 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:05.803305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1cceba10-e782-4d6a-973a-95a5d0f1adfd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:05.824446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1cceba10-e782-4d6a-973a-95a5d0f1adfd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:05.825579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1cceba10-e782-4d6a-973a-95a5d0f1adfd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:53:05.829787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:05.855753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1cceba10-e782-4d6a-973a-95a5d0f1adfd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:05.856207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1cceba10-e782-4d6a-973a-95a5d0f1adfd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:05.859069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1cceba10-e782-4d6a-973a-95a5d0f1adfd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:05.859517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1cceba10-e782-4d6a-973a-95a5d0f1adfd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:05.938591 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3928d662-e0e2-4119-b65a-158215bf62b0 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/action" status: 202 len: 0 microversion: 2.1 time: 3.323504 Aug 03 01:53:05.940762 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 712/1479] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:53:02 2022] POST /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/action => generated 0 bytes in 3327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:53:05.948524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eae05442-a58f-41ad-b33a-aa6d1a034a56 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b136d9b80>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:06.017181 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1cceba10-e782-4d6a-973a-95a5d0f1adfd tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.220768 Aug 03 01:53:06.020902 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 768/1480] 10.222.0.67 () {58 vars in 1230 bytes} [Wed Aug 3 01:53:05 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:53:06.056673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-69e0fb37-a65f-4f18-96e2-16c83cab25c7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:06.057434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-69e0fb37-a65f-4f18-96e2-16c83cab25c7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:06.066280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69e0fb37-a65f-4f18-96e2-16c83cab25c7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:06.067074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69e0fb37-a65f-4f18-96e2-16c83cab25c7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:06.068162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69e0fb37-a65f-4f18-96e2-16c83cab25c7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:06.068770 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69e0fb37-a65f-4f18-96e2-16c83cab25c7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:06.292182 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-69e0fb37-a65f-4f18-96e2-16c83cab25c7 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "POST /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4/action" status: 202 len: 0 microversion: 2.1 time: 0.269520 Aug 03 01:53:06.293177 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 769/1481] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:53:06 2022] POST /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:53:06.313478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c8bf59de-ec42-486a-9198-7583eb427684 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:06.314195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c8bf59de-ec42-486a-9198-7583eb427684 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:06.327694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c8bf59de-ec42-486a-9198-7583eb427684 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:06.334050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c8bf59de-ec42-486a-9198-7583eb427684 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:06.335571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c8bf59de-ec42-486a-9198-7583eb427684 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:06.335816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c8bf59de-ec42-486a-9198-7583eb427684 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:06.691841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c8bf59de-ec42-486a-9198-7583eb427684 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:06.708009 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c8bf59de-ec42-486a-9198-7583eb427684 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1319 microversion: 2.1 time: 0.406880 Aug 03 01:53:06.722923 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 770/1482] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:06 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:06.729615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-06f64fa6-aa2f-402a-9289-ff2543938e35 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:06.749553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-06f64fa6-aa2f-402a-9289-ff2543938e35 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:06.766526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06f64fa6-aa2f-402a-9289-ff2543938e35 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:06.772394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06f64fa6-aa2f-402a-9289-ff2543938e35 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:06.774915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06f64fa6-aa2f-402a-9289-ff2543938e35 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:06.776543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06f64fa6-aa2f-402a-9289-ff2543938e35 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:06.831796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-06f64fa6-aa2f-402a-9289-ff2543938e35 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lazy-loading 'flavor' on Instance uuid 56094624-65e4-48bb-8337-280213fb3238 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:53:07.019074 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-06f64fa6-aa2f-402a-9289-ff2543938e35 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238/action" status: 200 len: 32 microversion: 2.1 time: 0.292419 Aug 03 01:53:07.021831 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 771/1483] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:53:06 2022] POST /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238/action => generated 32 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:53:07.035561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0a8ce451-4c9e-44e5-bf92-a16f19b15d4a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:07.036284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0a8ce451-4c9e-44e5-bf92-a16f19b15d4a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:07.043218 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eae05442-a58f-41ad-b33a-aa6d1a034a56 tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/f4b557b4-237a-451c-a914-9d554d7378d8" status: 202 len: 0 microversion: 2.1 time: 1.101022 Aug 03 01:53:07.047027 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 713/1484] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:53:05 2022] DELETE /compute/v2.1/os-security-groups/f4b557b4-237a-451c-a914-9d554d7378d8 => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:53:07.049144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-483c0bd9-033a-4f91-b660-92d7bc2c712e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:07.051338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a8ce451-4c9e-44e5-bf92-a16f19b15d4a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:07.051338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a8ce451-4c9e-44e5-bf92-a16f19b15d4a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:07.052115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a8ce451-4c9e-44e5-bf92-a16f19b15d4a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:07.052553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a8ce451-4c9e-44e5-bf92-a16f19b15d4a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-483c0bd9-033a-4f91-b660-92d7bc2c712e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Request method failure captured: Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTasCpicNUmy0l5wGshmTLAXs1TGKP24QtjgXEt1pfUM0Fz9OSCOGeM1Vm2kiXZrIwc3GlE8Q9buzy_vqnSglLvgS66oHsTLUBwBpzy5s-DMQAApHnTJ_tFXjZJGVif1xjIqetRgGDqqnx0G7OHz6gyC0I-RcrAfksrKvFL5bOm0m8 Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c5b6cc7a4be94f7489c0f749f1b26276", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}] Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 5054cb049a374f2c8e26e6d62637f7cc Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: action_args: {} Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 03 01:53:07.059056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 01:53:07.064684 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 01:53:07.064684 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 01:53:07.064684 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 01:53:07.064684 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 03 01:53:07.064684 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:07.064684 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:07.064684 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:07.064684 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:07.064684 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:07.064684 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:07.064684 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 01:53:07.064684 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 01:53:07.064684 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 03 01:53:07.064684 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:07.068626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-483c0bd9-033a-4f91-b660-92d7bc2c712e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:07.069990 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-483c0bd9-033a-4f91-b660-92d7bc2c712e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.024613 Aug 03 01:53:07.071055 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 714/1485] 10.222.0.67 () {58 vars in 1182 bytes} [Wed Aug 3 01:53:07 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:53:07.077052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-842b27b3-3461-4944-a218-3bfa3ffa6b03 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:07.078014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-842b27b3-3461-4944-a218-3bfa3ffa6b03 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:07.087544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-842b27b3-3461-4944-a218-3bfa3ffa6b03 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:07.088408 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-842b27b3-3461-4944-a218-3bfa3ffa6b03 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:07.089523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-842b27b3-3461-4944-a218-3bfa3ffa6b03 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:07.090183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-842b27b3-3461-4944-a218-3bfa3ffa6b03 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:07.511707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a8ce451-4c9e-44e5-bf92-a16f19b15d4a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:07.533155 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0a8ce451-4c9e-44e5-bf92-a16f19b15d4a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.508643 Aug 03 01:53:07.535137 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 772/1486] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:07 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:07.642655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-842b27b3-3461-4944-a218-3bfa3ffa6b03 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:07.655964 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-842b27b3-3461-4944-a218-3bfa3ffa6b03 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1470 microversion: 2.1 time: 0.582643 Aug 03 01:53:07.656610 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 715/1487] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:07 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1470 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:07.670182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1e211f94-4f19-41c1-9409-a17554ce55e4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:07.677546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1e211f94-4f19-41c1-9409-a17554ce55e4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:07.688142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e211f94-4f19-41c1-9409-a17554ce55e4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:07.691110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e211f94-4f19-41c1-9409-a17554ce55e4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:07.694194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e211f94-4f19-41c1-9409-a17554ce55e4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:07.696479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e211f94-4f19-41c1-9409-a17554ce55e4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:07.805680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-4cd4545a-ce45-4266-b437-d4c5148d27aa req-0648f6f3-ae1a-44d2-b316-a37ee3cf8c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf7e153-fecb-4313-833e-5f17c0676fe8", "name": "network-vif-plugged", "status": "completed", "tag": "bd263e94-2840-4e82-9a94-ab1484dea7f6"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:07.833164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4cd4545a-ce45-4266-b437-d4c5148d27aa req-0648f6f3-ae1a-44d2-b316-a37ee3cf8c37 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:07.833795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4cd4545a-ce45-4266-b437-d4c5148d27aa req-0648f6f3-ae1a-44d2-b316-a37ee3cf8c37 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:07.860342 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-4cd4545a-ce45-4266-b437-d4c5148d27aa req-0648f6f3-ae1a-44d2-b316-a37ee3cf8c37 service nova] Creating event network-vif-plugged:bd263e94-2840-4e82-9a94-ab1484dea7f6 for instance fdf7e153-fecb-4313-833e-5f17c0676fe8 on n-h2-826529-8 Aug 03 01:53:07.889189 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-4cd4545a-ce45-4266-b437-d4c5148d27aa req-0648f6f3-ae1a-44d2-b316-a37ee3cf8c37 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.348186 Aug 03 01:53:07.912316 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 773/1488] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:07.924653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f635a4e7-d51c-4b80-b232-79604f62028a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] Calling method '.version_select at 0x7f5b243dcaf0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:08.125344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1e211f94-4f19-41c1-9409-a17554ce55e4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:08.137219 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1e211f94-4f19-41c1-9409-a17554ce55e4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.471626 Aug 03 01:53:08.152513 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 716/1489] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:07 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:08.157737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-94503181-e456-4625-a53b-a015dc2a8de0 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:08.163787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-94503181-e456-4625-a53b-a015dc2a8de0 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:08.165799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-94503181-e456-4625-a53b-a015dc2a8de0 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Searching by: {'deleted': False, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:53:08.172935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94503181-e456-4625-a53b-a015dc2a8de0 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:08.173667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94503181-e456-4625-a53b-a015dc2a8de0 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:08.174683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94503181-e456-4625-a53b-a015dc2a8de0 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:08.175324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94503181-e456-4625-a53b-a015dc2a8de0 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:08.204600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:08.208817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-94503181-e456-4625-a53b-a015dc2a8de0 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:53:08.252480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:08.255182 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-94503181-e456-4625-a53b-a015dc2a8de0 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.101235 Aug 03 01:53:08.256294 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 717/1490] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 3 01:53:08 2022] GET /compute/v2.1/servers => generated 683 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:08.262209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-68501e5e-e964-4cc6-bb9f-5e6f6aeef39e tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:08.263173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-68501e5e-e964-4cc6-bb9f-5e6f6aeef39e tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:08.271302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68501e5e-e964-4cc6-bb9f-5e6f6aeef39e tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:08.272005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68501e5e-e964-4cc6-bb9f-5e6f6aeef39e tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:08.273084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68501e5e-e964-4cc6-bb9f-5e6f6aeef39e tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:08.274047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68501e5e-e964-4cc6-bb9f-5e6f6aeef39e tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:08.759398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-68501e5e-e964-4cc6-bb9f-5e6f6aeef39e tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:08.771951 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-68501e5e-e964-4cc6-bb9f-5e6f6aeef39e tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1319 microversion: 2.1 time: 0.514206 Aug 03 01:53:08.773302 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 718/1491] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:08 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:08.778258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=28 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:08.781096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69094f1e-2871-4e7d-9c98-101e75a8afc5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:08.789577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-69094f1e-2871-4e7d-9c98-101e75a8afc5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:08.790566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.compute.servers [None req-69094f1e-2871-4e7d-9c98-101e75a8afc5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Removing options 'limit' from query {{(pid=125942) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 03 01:53:08.791745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-69094f1e-2871-4e7d-9c98-101e75a8afc5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Searching by: {'deleted': False, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:53:08.802596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69094f1e-2871-4e7d-9c98-101e75a8afc5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:08.802596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69094f1e-2871-4e7d-9c98-101e75a8afc5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:08.804729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69094f1e-2871-4e7d-9c98-101e75a8afc5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:08.805607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69094f1e-2871-4e7d-9c98-101e75a8afc5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:08.879714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-69094f1e-2871-4e7d-9c98-101e75a8afc5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:53:08.920299 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f635a4e7-d51c-4b80-b232-79604f62028a tempest-SecurityGroupsTestJSON-1888378356 tempest-SecurityGroupsTestJSON-1888378356-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/78ec86ac-259d-4a80-95a5-181313c21ada" status: 202 len: 0 microversion: 2.1 time: 1.005732 Aug 03 01:53:08.921397 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 774/1492] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:53:07 2022] DELETE /compute/v2.1/os-security-groups/78ec86ac-259d-4a80-95a5-181313c21ada => generated 0 bytes in 1008 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:53:08.927707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9adb7dc7-421d-46cd-a12b-bb9780338e1f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:08.928411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9adb7dc7-421d-46cd-a12b-bb9780338e1f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:08.943283 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-69094f1e-2871-4e7d-9c98-101e75a8afc5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.168023 Aug 03 01:53:08.944274 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 719/1493] 10.222.0.67 () {58 vars in 1144 bytes} [Wed Aug 3 01:53:08 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:08.949304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9adb7dc7-421d-46cd-a12b-bb9780338e1f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:08.949944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9adb7dc7-421d-46cd-a12b-bb9780338e1f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:08.953786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-959fda5b-266b-4d1d-b5f9-dd881781b2a3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:08.954585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-959fda5b-266b-4d1d-b5f9-dd881781b2a3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:08.955896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9adb7dc7-421d-46cd-a12b-bb9780338e1f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:08.962519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9adb7dc7-421d-46cd-a12b-bb9780338e1f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:08.964456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-959fda5b-266b-4d1d-b5f9-dd881781b2a3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:08.965051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-959fda5b-266b-4d1d-b5f9-dd881781b2a3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:08.965967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-959fda5b-266b-4d1d-b5f9-dd881781b2a3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:08.966769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-959fda5b-266b-4d1d-b5f9-dd881781b2a3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:09.784858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-959fda5b-266b-4d1d-b5f9-dd881781b2a3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:09.801811 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-959fda5b-266b-4d1d-b5f9-dd881781b2a3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1470 microversion: 2.1 time: 0.856085 Aug 03 01:53:09.802898 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 720/1494] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:08 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1470 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:09.830154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-21b11a53-b09a-4cfa-a40d-8fa6b9b93c81 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-21b11a53-b09a-4cfa-a40d-8fa6b9b93c81 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Request method failure captured: Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTasCpicNUmy0l5wGshmTLAXs1TGKP24QtjgXEt1pfUM0Fz9OSCOGeM1Vm2kiXZrIwc3GlE8Q9buzy_vqnSglLvgS66oHsTLUBwBpzy5s-DMQAApHnTJ_tFXjZJGVif1xjIqetRgGDqqnx0G7OHz6gyC0I-RcrAfksrKvFL5bOm0m8 Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c5b6cc7a4be94f7489c0f749f1b26276", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}] Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 5054cb049a374f2c8e26e6d62637f7cc Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: action_args: {} Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi '-1' Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 03 01:53:09.837704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-21b11a53-b09a-4cfa-a40d-8fa6b9b93c81 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-21b11a53-b09a-4cfa-a40d-8fa6b9b93c81 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.023481 Aug 03 01:53:09.852346 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 721/1495] 10.222.0.67 () {58 vars in 1142 bytes} [Wed Aug 3 01:53:09 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:53:09.881627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-38b60937-806a-4a48-a392-e10084793ac5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:09.882494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-38b60937-806a-4a48-a392-e10084793ac5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:09.892636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38b60937-806a-4a48-a392-e10084793ac5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:09.893206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38b60937-806a-4a48-a392-e10084793ac5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:09.894474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38b60937-806a-4a48-a392-e10084793ac5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:09.896529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38b60937-806a-4a48-a392-e10084793ac5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:10.136376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9adb7dc7-421d-46cd-a12b-bb9780338e1f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:10.160722 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9adb7dc7-421d-46cd-a12b-bb9780338e1f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 1.237854 Aug 03 01:53:10.162156 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 775/1496] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:08 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:10.180449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-85b50ac2-d40b-4cc8-8af9-472672acf577 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:10.181354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-85b50ac2-d40b-4cc8-8af9-472672acf577 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:10.196491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85b50ac2-d40b-4cc8-8af9-472672acf577 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:10.197106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85b50ac2-d40b-4cc8-8af9-472672acf577 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:10.200022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85b50ac2-d40b-4cc8-8af9-472672acf577 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:10.200681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85b50ac2-d40b-4cc8-8af9-472672acf577 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:10.305234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:10.541916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-38b60937-806a-4a48-a392-e10084793ac5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:10.564447 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-38b60937-806a-4a48-a392-e10084793ac5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.708632 Aug 03 01:53:10.565748 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 722/1497] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:09 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:10.580711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-819c2a9d-1b28-4c3b-bc39-bb4e32f3eb68 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-819c2a9d-1b28-4c3b-bc39-bb4e32f3eb68 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Request method failure captured: Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTasCpicNUmy0l5wGshmTLAXs1TGKP24QtjgXEt1pfUM0Fz9OSCOGeM1Vm2kiXZrIwc3GlE8Q9buzy_vqnSglLvgS66oHsTLUBwBpzy5s-DMQAApHnTJ_tFXjZJGVif1xjIqetRgGDqqnx0G7OHz6gyC0I-RcrAfksrKvFL5bOm0m8 Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c5b6cc7a4be94f7489c0f749f1b26276", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}] Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 5054cb049a374f2c8e26e6d62637f7cc Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: action_args: {} Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'testing' Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 03 01:53:10.591647 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 03 01:53:10.598029 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 01:53:10.598029 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 01:53:10.598029 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 01:53:10.598029 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 01:53:10.598029 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 03 01:53:10.598029 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:10.598029 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:10.598029 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:10.598029 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:10.598029 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:10.598029 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:10.598029 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 01:53:10.598029 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 01:53:10.598029 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 03 01:53:10.598029 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:10.601467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-819c2a9d-1b28-4c3b-bc39-bb4e32f3eb68 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:10.602734 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-819c2a9d-1b28-4c3b-bc39-bb4e32f3eb68 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.033187 Aug 03 01:53:10.603955 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 723/1498] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 01:53:10 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:53:10.609067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-96152b2d-4054-4d18-82a1-dc5c0e460fcf req-aa1b298b-0a26-479a-95c5-47686082570b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72330b06-28da-4653-aae1-004aa59d88b4", "name": "network-vif-plugged", "status": "completed", "tag": "91766d4e-1d4f-4c67-8adf-edbd715310e0"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:10.630332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:10.646051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-96152b2d-4054-4d18-82a1-dc5c0e460fcf req-aa1b298b-0a26-479a-95c5-47686082570b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:10.646723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-96152b2d-4054-4d18-82a1-dc5c0e460fcf req-aa1b298b-0a26-479a-95c5-47686082570b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:10.669650 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-96152b2d-4054-4d18-82a1-dc5c0e460fcf req-aa1b298b-0a26-479a-95c5-47686082570b service nova] Creating event network-vif-plugged:91766d4e-1d4f-4c67-8adf-edbd715310e0 for instance 72330b06-28da-4653-aae1-004aa59d88b4 on n-h1-826529-8 Aug 03 01:53:10.699938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-96152b2d-4054-4d18-82a1-dc5c0e460fcf req-aa1b298b-0a26-479a-95c5-47686082570b service nova] Instance 72330b06-28da-4653-aae1-004aa59d88b4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 01:53:10.741712 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-96152b2d-4054-4d18-82a1-dc5c0e460fcf req-aa1b298b-0a26-479a-95c5-47686082570b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133868 Aug 03 01:53:10.744031 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 724/1499] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:10.758302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fa98621b-7939-4463-80b2-4fda535496e9 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:10.774867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fa98621b-7939-4463-80b2-4fda535496e9 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:10.778497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fa98621b-7939-4463-80b2-4fda535496e9 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:53:10.799274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-85b50ac2-d40b-4cc8-8af9-472672acf577 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:10.807519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.compute.servers [None req-fa98621b-7939-4463-80b2-4fda535496e9 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Flavor 'non_existing_flavor' could not be found {{(pid=125942) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 03 01:53:10.816277 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fa98621b-7939-4463-80b2-4fda535496e9 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.065898 Aug 03 01:53:10.829193 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 725/1500] 10.222.0.67 () {58 vars in 1178 bytes} [Wed Aug 3 01:53:10 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:53:10.837842 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-85b50ac2-d40b-4cc8-8af9-472672acf577 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1469 microversion: 2.1 time: 0.668435 Aug 03 01:53:10.839505 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 776/1501] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:10 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1469 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:10.847879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5fbe863f-3db3-4505-b8e2-35f4ac4e1fb4 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:10.858279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-60c1f196-a587-497a-be0f-0d1cf457aff5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:10.860896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-60c1f196-a587-497a-be0f-0d1cf457aff5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:10.872149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5fbe863f-3db3-4505-b8e2-35f4ac4e1fb4 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:10.873144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5fbe863f-3db3-4505-b8e2-35f4ac4e1fb4 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:53:10.876866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60c1f196-a587-497a-be0f-0d1cf457aff5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:10.879765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60c1f196-a587-497a-be0f-0d1cf457aff5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:10.880791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60c1f196-a587-497a-be0f-0d1cf457aff5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:10.881401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60c1f196-a587-497a-be0f-0d1cf457aff5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:10.884218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fbe863f-3db3-4505-b8e2-35f4ac4e1fb4 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:10.888527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fbe863f-3db3-4505-b8e2-35f4ac4e1fb4 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:10.892133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fbe863f-3db3-4505-b8e2-35f4ac4e1fb4 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:10.892718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fbe863f-3db3-4505-b8e2-35f4ac4e1fb4 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:11.003994 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5fbe863f-3db3-4505-b8e2-35f4ac4e1fb4 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.172277 Aug 03 01:53:11.013802 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 726/1502] 10.222.0.67 () {58 vars in 1174 bytes} [Wed Aug 3 01:53:10 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:53:11.013802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-76585d77-152f-4b1b-b9fc-4283105d5430 tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:11.013802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-76585d77-152f-4b1b-b9fc-4283105d5430 tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:11.021459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76585d77-152f-4b1b-b9fc-4283105d5430 tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:11.022786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76585d77-152f-4b1b-b9fc-4283105d5430 tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:11.024149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76585d77-152f-4b1b-b9fc-4283105d5430 tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:11.024707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76585d77-152f-4b1b-b9fc-4283105d5430 tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:11.076046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-76585d77-152f-4b1b-b9fc-4283105d5430 tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lazy-loading 'flavor' on Instance uuid fdf7e153-fecb-4313-833e-5f17c0676fe8 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:53:11.176881 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-76585d77-152f-4b1b-b9fc-4283105d5430 tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8/action" status: 202 len: 0 microversion: 2.1 time: 0.169799 Aug 03 01:53:11.178324 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 727/1503] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:53:11 2022] POST /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:53:11.202727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9dc53f53-0af1-46c5-babc-d974011270f2 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:11.213379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9dc53f53-0af1-46c5-babc-d974011270f2 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:11.214581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9dc53f53-0af1-46c5-babc-d974011270f2 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:53:11.240225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9dc53f53-0af1-46c5-babc-d974011270f2 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:11.240912 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9dc53f53-0af1-46c5-babc-d974011270f2 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:11.243192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9dc53f53-0af1-46c5-babc-d974011270f2 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:11.244811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9dc53f53-0af1-46c5-babc-d974011270f2 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:11.309236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-60c1f196-a587-497a-be0f-0d1cf457aff5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:11.318536 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-60c1f196-a587-497a-be0f-0d1cf457aff5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1470 microversion: 2.1 time: 0.476571 Aug 03 01:53:11.319167 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 777/1504] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:10 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1470 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:11.342777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a95cc5d7-12a9-4cfd-b48a-238d80e491d5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:11.356876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a95cc5d7-12a9-4cfd-b48a-238d80e491d5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:11.370790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a95cc5d7-12a9-4cfd-b48a-238d80e491d5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:11.373624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a95cc5d7-12a9-4cfd-b48a-238d80e491d5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:11.375284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a95cc5d7-12a9-4cfd-b48a-238d80e491d5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:11.377633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a95cc5d7-12a9-4cfd-b48a-238d80e491d5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:11.559505 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9dc53f53-0af1-46c5-babc-d974011270f2 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.371414 Aug 03 01:53:11.560763 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 728/1505] 10.222.0.67 () {58 vars in 1184 bytes} [Wed Aug 3 01:53:11 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:53:11.565870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ff5f1dcd-0a30-4bba-98d3-6d3dd877700e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:11.568539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ff5f1dcd-0a30-4bba-98d3-6d3dd877700e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:11.587953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff5f1dcd-0a30-4bba-98d3-6d3dd877700e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:11.588508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff5f1dcd-0a30-4bba-98d3-6d3dd877700e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:11.594931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff5f1dcd-0a30-4bba-98d3-6d3dd877700e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:11.596030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff5f1dcd-0a30-4bba-98d3-6d3dd877700e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:12.167344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a95cc5d7-12a9-4cfd-b48a-238d80e491d5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:12.184564 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a95cc5d7-12a9-4cfd-b48a-238d80e491d5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1477 microversion: 2.1 time: 0.845092 Aug 03 01:53:12.196566 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 778/1506] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:11 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1477 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:12.203504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ff5f1dcd-0a30-4bba-98d3-6d3dd877700e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:12.206513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ddbf53e2-2653-4f83-8d38-d1d4378f3295 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:12.214094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ddbf53e2-2653-4f83-8d38-d1d4378f3295 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:12.215531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ddbf53e2-2653-4f83-8d38-d1d4378f3295 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Searching by: {'deleted': False, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:53:12.222469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddbf53e2-2653-4f83-8d38-d1d4378f3295 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:12.223167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddbf53e2-2653-4f83-8d38-d1d4378f3295 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:12.224334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddbf53e2-2653-4f83-8d38-d1d4378f3295 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:12.225135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddbf53e2-2653-4f83-8d38-d1d4378f3295 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:12.235062 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ff5f1dcd-0a30-4bba-98d3-6d3dd877700e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.672139 Aug 03 01:53:12.239857 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 729/1507] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:11 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:12.265153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9f7465f1-35f0-4939-8c88-ef58677ff5a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:12.266294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9f7465f1-35f0-4939-8c88-ef58677ff5a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:12.290709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f7465f1-35f0-4939-8c88-ef58677ff5a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:12.291224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f7465f1-35f0-4939-8c88-ef58677ff5a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:12.296732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f7465f1-35f0-4939-8c88-ef58677ff5a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:12.298059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f7465f1-35f0-4939-8c88-ef58677ff5a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:12.514233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-ddbf53e2-2653-4f83-8d38-d1d4378f3295 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:53:12.907829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9f7465f1-35f0-4939-8c88-ef58677ff5a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:12.930525 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9f7465f1-35f0-4939-8c88-ef58677ff5a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.687669 Aug 03 01:53:12.932350 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 730/1508] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:12 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:12.947963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2d1c5b88-5f30-4e86-ab58-b0b3f497e3c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:12.948601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2d1c5b88-5f30-4e86-ab58-b0b3f497e3c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:12.968502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d1c5b88-5f30-4e86-ab58-b0b3f497e3c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:12.968960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d1c5b88-5f30-4e86-ab58-b0b3f497e3c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:12.985866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d1c5b88-5f30-4e86-ab58-b0b3f497e3c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:12.985866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d1c5b88-5f30-4e86-ab58-b0b3f497e3c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:13.196989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ddbf53e2-2653-4f83-8d38-d1d4378f3295 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:13.207214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddbf53e2-2653-4f83-8d38-d1d4378f3295 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:13.208571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddbf53e2-2653-4f83-8d38-d1d4378f3295 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:13.414752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2d1c5b88-5f30-4e86-ab58-b0b3f497e3c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:13.432029 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2d1c5b88-5f30-4e86-ab58-b0b3f497e3c1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1470 microversion: 2.1 time: 0.498652 Aug 03 01:53:13.443524 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 731/1509] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:12 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1470 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:13.588963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ee6d5b39-28eb-43ef-8a81-d5469586371c tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Action: 'create', calling method: .version_select at 0x7f5b136d9040>, body: {"keypair": {"name": "tempest-keypair-513889001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK03KWvB33dDE7yttb1/55QzaJsyNz4IaZ4i4u2wlhbvpYtKL2DfE/6/4ET5xxrMSJX5gOkv3ABLXSv7dTq7mqTIQMVf+tN2TielpARYq3IiI+pJ2M6GQRvKn49QMTSrA=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:13.613069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ee6d5b39-28eb-43ef-8a81-d5469586371c tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Getting quotas for project ded04be454a64ab6af04963fd0570f91. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:53:13.618620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ee6d5b39-28eb-43ef-8a81-d5469586371c tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Getting quotas for user e9e4f9c30311452c8500bdcd2165d1b9 and project ded04be454a64ab6af04963fd0570f91. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:53:13.678133 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ee6d5b39-28eb-43ef-8a81-d5469586371c tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.231397 Aug 03 01:53:13.679350 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 732/1510] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 01:53:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:13.686882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b0c0005c-2335-4e2b-b755-d674339be5a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:13.694765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b0c0005c-2335-4e2b-b755-d674339be5a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:13.716725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0c0005c-2335-4e2b-b755-d674339be5a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:13.717309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0c0005c-2335-4e2b-b755-d674339be5a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:13.718147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0c0005c-2335-4e2b-b755-d674339be5a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:13.721874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0c0005c-2335-4e2b-b755-d674339be5a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:13.771567 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ddbf53e2-2653-4f83-8d38-d1d4378f3295 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 1.572698 Aug 03 01:53:13.772218 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 779/1511] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:53:12 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:13.780734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-05d27506-ee4c-479f-9e01-957c851390dc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:13.782522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-05d27506-ee4c-479f-9e01-957c851390dc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:13.815173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05d27506-ee4c-479f-9e01-957c851390dc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:13.815173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05d27506-ee4c-479f-9e01-957c851390dc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:13.815173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05d27506-ee4c-479f-9e01-957c851390dc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:13.815173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05d27506-ee4c-479f-9e01-957c851390dc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:14.456861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b0c0005c-2335-4e2b-b755-d674339be5a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:14.475730 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b0c0005c-2335-4e2b-b755-d674339be5a5 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1460 microversion: 2.1 time: 0.794102 Aug 03 01:53:14.476621 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 733/1512] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:13 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1460 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:14.494046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-1c0a23a2-41cf-4d92-bc4b-0d79574e7e1c req-fc11662d-ef65-4953-afac-83d93849e1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72330b06-28da-4653-aae1-004aa59d88b4", "name": "network-vif-unplugged", "status": "completed", "tag": "91766d4e-1d4f-4c67-8adf-edbd715310e0"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:14.500239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-05d27506-ee4c-479f-9e01-957c851390dc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:14.518434 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-05d27506-ee4c-479f-9e01-957c851390dc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.744427 Aug 03 01:53:14.519772 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 780/1513] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:13 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:14.520689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1c0a23a2-41cf-4d92-bc4b-0d79574e7e1c req-fc11662d-ef65-4953-afac-83d93849e1f5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:14.521162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1c0a23a2-41cf-4d92-bc4b-0d79574e7e1c req-fc11662d-ef65-4953-afac-83d93849e1f5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:14.527534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ab8af1aa-198c-4e7e-87a5-7964fcdcf3bb tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:14.536779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ab8af1aa-198c-4e7e-87a5-7964fcdcf3bb tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:14.538399 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ab8af1aa-198c-4e7e-87a5-7964fcdcf3bb tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.017245 Aug 03 01:53:14.539511 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 781/1514] 10.222.0.67 () {58 vars in 1178 bytes} [Wed Aug 3 01:53:14 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:53:14.557381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31d1e071-aa72-485b-af28-fcd829a9efab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:14.558105 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-1c0a23a2-41cf-4d92-bc4b-0d79574e7e1c req-fc11662d-ef65-4953-afac-83d93849e1f5 service nova] Creating event network-vif-unplugged:91766d4e-1d4f-4c67-8adf-edbd715310e0 for instance 72330b06-28da-4653-aae1-004aa59d88b4 on n-h2-826529-8 Aug 03 01:53:14.558508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-31d1e071-aa72-485b-af28-fcd829a9efab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:14.567534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31d1e071-aa72-485b-af28-fcd829a9efab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:14.568365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31d1e071-aa72-485b-af28-fcd829a9efab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:14.570308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31d1e071-aa72-485b-af28-fcd829a9efab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:14.571673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31d1e071-aa72-485b-af28-fcd829a9efab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:14.574652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-1c0a23a2-41cf-4d92-bc4b-0d79574e7e1c req-fc11662d-ef65-4953-afac-83d93849e1f5 service nova] Instance 72330b06-28da-4653-aae1-004aa59d88b4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 01:53:14.603343 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-1c0a23a2-41cf-4d92-bc4b-0d79574e7e1c req-fc11662d-ef65-4953-afac-83d93849e1f5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125027 Aug 03 01:53:14.605732 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 734/1515] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:14.615640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8ced359-15a0-4cee-9c78-24503c6692a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:14.617975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b8ced359-15a0-4cee-9c78-24503c6692a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:14.635488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8ced359-15a0-4cee-9c78-24503c6692a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:14.643354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8ced359-15a0-4cee-9c78-24503c6692a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:14.644708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8ced359-15a0-4cee-9c78-24503c6692a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:14.645523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8ced359-15a0-4cee-9c78-24503c6692a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:15.536680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b8ced359-15a0-4cee-9c78-24503c6692a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:15.546275 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b8ced359-15a0-4cee-9c78-24503c6692a5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1470 microversion: 2.1 time: 0.939094 Aug 03 01:53:15.560225 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 735/1516] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:14 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1470 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:15.560731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-31d1e071-aa72-485b-af28-fcd829a9efab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:15.567537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-61ec48b8-7ac9-456c-90a4-bdc442b901ad tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:15.568173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-61ec48b8-7ac9-456c-90a4-bdc442b901ad tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:15.575882 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-31d1e071-aa72-485b-af28-fcd829a9efab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 1.024637 Aug 03 01:53:15.576795 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 782/1517] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:14 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:15.581395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6a7d16f3-9fd0-4030-a2c0-cf6dc5a6f4e5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:15.596839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61ec48b8-7ac9-456c-90a4-bdc442b901ad tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:15.597307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61ec48b8-7ac9-456c-90a4-bdc442b901ad tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:15.598170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61ec48b8-7ac9-456c-90a4-bdc442b901ad tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:15.598572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61ec48b8-7ac9-456c-90a4-bdc442b901ad tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:15.605825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6a7d16f3-9fd0-4030-a2c0-cf6dc5a6f4e5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:15.606522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6a7d16f3-9fd0-4030-a2c0-cf6dc5a6f4e5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Searching by: {'deleted': False, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:53:15.624740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a7d16f3-9fd0-4030-a2c0-cf6dc5a6f4e5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:15.625214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a7d16f3-9fd0-4030-a2c0-cf6dc5a6f4e5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:15.626052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a7d16f3-9fd0-4030-a2c0-cf6dc5a6f4e5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:15.626508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a7d16f3-9fd0-4030-a2c0-cf6dc5a6f4e5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:15.829833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-6a7d16f3-9fd0-4030-a2c0-cf6dc5a6f4e5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:53:15.935516 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6a7d16f3-9fd0-4030-a2c0-cf6dc5a6f4e5 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.357582 Aug 03 01:53:15.936912 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 783/1518] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 3 01:53:15 2022] GET /compute/v2.1/servers => generated 683 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:15.943272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e3d704b-494a-4b38-9957-ba289947c793 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:15.945515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3e3d704b-494a-4b38-9957-ba289947c793 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:15.953430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e3d704b-494a-4b38-9957-ba289947c793 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:15.954108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e3d704b-494a-4b38-9957-ba289947c793 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:15.955492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e3d704b-494a-4b38-9957-ba289947c793 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:15.956182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e3d704b-494a-4b38-9957-ba289947c793 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:16.447107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3e3d704b-494a-4b38-9957-ba289947c793 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:16.462753 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e3d704b-494a-4b38-9957-ba289947c793 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.524217 Aug 03 01:53:16.465338 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 784/1519] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:15 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:16.477292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d250e3a2-ae78-44be-a9de-255e5494b63e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:16.477878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d250e3a2-ae78-44be-a9de-255e5494b63e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: e4222150-6354-462f-9144-fb034666c245] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:16.489373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d250e3a2-ae78-44be-a9de-255e5494b63e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:16.491474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d250e3a2-ae78-44be-a9de-255e5494b63e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:16.496959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d250e3a2-ae78-44be-a9de-255e5494b63e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:16.499406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d250e3a2-ae78-44be-a9de-255e5494b63e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:16.529255 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-d250e3a2-ae78-44be-a9de-255e5494b63e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] HTTP exception thrown: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d250e3a2-ae78-44be-a9de-255e5494b63e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Request method failure captured: Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245 HTTP/1.1 Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dTasCpicNUmy0l5wGshmTLAXs1TGKP24QtjgXEt1pfUM0Fz9OSCOGeM1Vm2kiXZrIwc3GlE8Q9buzy_vqnSglLvgS66oHsTLUBwBpzy5s-DMQAApHnTJ_tFXjZJGVif1xjIqetRgGDqqnx0G7OHz6gyC0I-RcrAfksrKvFL5bOm0m8 Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c5b6cc7a4be94f7489c0f749f1b26276", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}] Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5054cb049a374f2c8e26e6d62637f7cc Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'e4222150-6354-462f-9144-fb034666c245'} Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:53:16.535396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:53:16.540643 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. Aug 03 01:53:16.540643 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:16.540643 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:16.540643 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:16.540643 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:16.540643 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:16.540643 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:16.540643 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:53:16.540643 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:53:16.540643 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. Aug 03 01:53:16.540643 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:16.540643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d250e3a2-ae78-44be-a9de-255e5494b63e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Returning 404 to user: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:16.540643 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d250e3a2-ae78-44be-a9de-255e5494b63e tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245" status: 404 len: 111 microversion: 2.1 time: 0.071985 Aug 03 01:53:16.545518 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 785/1520] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:53:16 2022] DELETE /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:53:16.554416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-113890388", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "003342db-8314-44c4-b4f2-621b467a9a6c"}], "security_groups": [{"name": "tempest-securitygroup--168081490"}], "key_name": "tempest-keypair-513889001", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:16.655106 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-61ec48b8-7ac9-456c-90a4-bdc442b901ad tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1611 microversion: 2.1 time: 1.103213 Aug 03 01:53:16.664881 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 736/1521] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:15 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1611 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:16.671608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-90d944d1-3230-458b-8ff2-6240df52c255 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:16.684054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-90d944d1-3230-458b-8ff2-6240df52c255 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:16.704654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90d944d1-3230-458b-8ff2-6240df52c255 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:16.705052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90d944d1-3230-458b-8ff2-6240df52c255 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:16.705871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90d944d1-3230-458b-8ff2-6240df52c255 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:16.706323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90d944d1-3230-458b-8ff2-6240df52c255 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:16.893583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] validate_networks() for [('003342db-8314-44c4-b4f2-621b467a9a6c', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:53:17.094429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-90d944d1-3230-458b-8ff2-6240df52c255 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'services' on Instance uuid 47752419-6bf3-468f-b3a4-e212358b9e66 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:53:17.121732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:17.130347 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-90d944d1-3230-458b-8ff2-6240df52c255 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 2423 microversion: 2.25 time: 0.463408 Aug 03 01:53:17.131503 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 737/1522] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:16 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 2423 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:17.139464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-181922b2-f25e-49d3-a3a4-133d41f82779 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:17.140233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-181922b2-f25e-49d3-a3a4-133d41f82779 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: 845f5c3f-62a6-4189-abbd-b2a17ba55f38] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:17.157921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-181922b2-f25e-49d3-a3a4-133d41f82779 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:17.158609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-181922b2-f25e-49d3-a3a4-133d41f82779 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:17.160154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-181922b2-f25e-49d3-a3a4-133d41f82779 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:17.160830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-181922b2-f25e-49d3-a3a4-133d41f82779 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:17.198003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-181922b2-f25e-49d3-a3a4-133d41f82779 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: 845f5c3f-62a6-4189-abbd-b2a17ba55f38] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:53:17.327177 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-181922b2-f25e-49d3-a3a4-133d41f82779 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "DELETE /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38" status: 204 len: 0 microversion: 2.1 time: 0.193344 Aug 03 01:53:17.328049 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 738/1523] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:53:17 2022] DELETE /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:53:17.336947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5155387c-5bc4-4b31-bdf7-e72077b05f59 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:17.337812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5155387c-5bc4-4b31-bdf7-e72077b05f59 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:17.351485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5155387c-5bc4-4b31-bdf7-e72077b05f59 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:17.353589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5155387c-5bc4-4b31-bdf7-e72077b05f59 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:17.354775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5155387c-5bc4-4b31-bdf7-e72077b05f59 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:17.355434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5155387c-5bc4-4b31-bdf7-e72077b05f59 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:17.620430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5155387c-5bc4-4b31-bdf7-e72077b05f59 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:17.633314 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5155387c-5bc4-4b31-bdf7-e72077b05f59 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1470 microversion: 2.1 time: 0.304026 Aug 03 01:53:17.644903 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 739/1524] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:17 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1470 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:17.654248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0b62d50e-cb2d-4cc6-9c39-1c00b1d6feb8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:17.654836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0b62d50e-cb2d-4cc6-9c39-1c00b1d6feb8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:17.661111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b62d50e-cb2d-4cc6-9c39-1c00b1d6feb8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:17.662355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b62d50e-cb2d-4cc6-9c39-1c00b1d6feb8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:17.664221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b62d50e-cb2d-4cc6-9c39-1c00b1d6feb8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:17.664998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b62d50e-cb2d-4cc6-9c39-1c00b1d6feb8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:17.678732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Getting quotas for project ded04be454a64ab6af04963fd0570f91. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:53:17.687545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Getting quotas for user e9e4f9c30311452c8500bdcd2165d1b9 and project ded04be454a64ab6af04963fd0570f91. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:53:17.703459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:53:17.704264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:53:17.705280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:53:17.705983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:53:17.707197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:53:17.719188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:17.720040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:17.730621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:17.731521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:17.758583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Getting quotas for project ded04be454a64ab6af04963fd0570f91. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:53:17.763665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Getting quotas for user e9e4f9c30311452c8500bdcd2165d1b9 and project ded04be454a64ab6af04963fd0570f91. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:53:17.778847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:53:17.781696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:53:17.858533 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2c4679ef-c925-4ad2-82e8-faed2f8a37a6 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.308674 Aug 03 01:53:17.859852 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 786/1525] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:53:16 2022] POST /compute/v2.1/servers => generated 408 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:53:17.865540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-8d2c120c-c22e-460d-8676-c38933f23931 req-604c8e09-5076-4231-b20e-2512abb1b2cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72330b06-28da-4653-aae1-004aa59d88b4", "tag": "91766d4e-1d4f-4c67-8adf-edbd715310e0"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:17.878083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8d2c120c-c22e-460d-8676-c38933f23931 req-604c8e09-5076-4231-b20e-2512abb1b2cc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:17.878946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8d2c120c-c22e-460d-8676-c38933f23931 req-604c8e09-5076-4231-b20e-2512abb1b2cc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:17.886037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0b62d50e-cb2d-4cc6-9c39-1c00b1d6feb8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:17.899320 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0b62d50e-cb2d-4cc6-9c39-1c00b1d6feb8 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.251737 Aug 03 01:53:17.900590 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 740/1526] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:17 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:17.907488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-21359036-45a8-4274-a50c-a4154782e214 tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:17.911123 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:53:17.911123 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:53:17.912961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21359036-45a8-4274-a50c-a4154782e214 tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:17.913950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21359036-45a8-4274-a50c-a4154782e214 tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:17.915686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21359036-45a8-4274-a50c-a4154782e214 tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:17.916313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21359036-45a8-4274-a50c-a4154782e214 tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:17.923513 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-8d2c120c-c22e-460d-8676-c38933f23931 req-604c8e09-5076-4231-b20e-2512abb1b2cc service nova] Creating event network-changed:91766d4e-1d4f-4c67-8adf-edbd715310e0 for instance 72330b06-28da-4653-aae1-004aa59d88b4 on n-h2-826529-8 Aug 03 01:53:17.936122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-8d2c120c-c22e-460d-8676-c38933f23931 req-604c8e09-5076-4231-b20e-2512abb1b2cc service nova] Instance 72330b06-28da-4653-aae1-004aa59d88b4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 01:53:17.963502 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-8d2c120c-c22e-460d-8676-c38933f23931 req-604c8e09-5076-4231-b20e-2512abb1b2cc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102327 Aug 03 01:53:17.965146 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 787/1527] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:17.976305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ce10d37e-de5d-4f0b-b8b2-73f3c63e5f47 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826529-8", "block_migration": "auto"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:17.979340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ce10d37e-de5d-4f0b-b8b2-73f3c63e5f47 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:18.019368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce10d37e-de5d-4f0b-b8b2-73f3c63e5f47 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:18.019958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce10d37e-de5d-4f0b-b8b2-73f3c63e5f47 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:18.020901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce10d37e-de5d-4f0b-b8b2-73f3c63e5f47 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:18.021394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce10d37e-de5d-4f0b-b8b2-73f3c63e5f47 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:18.026529 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-21359036-45a8-4274-a50c-a4154782e214 tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.118394 Aug 03 01:53:18.039329 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 741/1528] 10.222.0.67 () {58 vars in 1176 bytes} [Wed Aug 3 01:53:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:18.048067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-68075a15-ecbd-448f-8b13-f7b04597cdaa tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:18.049393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-68075a15-ecbd-448f-8b13-f7b04597cdaa tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:18.059636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68075a15-ecbd-448f-8b13-f7b04597cdaa tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:18.060353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68075a15-ecbd-448f-8b13-f7b04597cdaa tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:18.066377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68075a15-ecbd-448f-8b13-f7b04597cdaa tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:18.076373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68075a15-ecbd-448f-8b13-f7b04597cdaa tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:18.110468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-ce10d37e-de5d-4f0b-b8b2-73f3c63e5f47 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'flavor' on Instance uuid 47752419-6bf3-468f-b3a4-e212358b9e66 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:53:18.125480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-68075a15-ecbd-448f-8b13-f7b04597cdaa tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:53:18.137885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ce10d37e-de5d-4f0b-b8b2-73f3c63e5f47 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Going to try to live migrate instance to n-h2-826529-8 {{(pid=125941) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 01:53:18.358190 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-68075a15-ecbd-448f-8b13-f7b04597cdaa tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 204 len: 0 microversion: 2.1 time: 0.317397 Aug 03 01:53:18.363924 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 742/1529] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:53:18 2022] DELETE /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:53:18.375211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-367e895c-796f-460c-86b5-8ee58a40d458 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:18.376932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-367e895c-796f-460c-86b5-8ee58a40d458 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:18.400148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-367e895c-796f-460c-86b5-8ee58a40d458 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:18.401649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-367e895c-796f-460c-86b5-8ee58a40d458 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:18.402721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-367e895c-796f-460c-86b5-8ee58a40d458 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:18.403437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-367e895c-796f-460c-86b5-8ee58a40d458 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:18.745941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-367e895c-796f-460c-86b5-8ee58a40d458 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:18.759665 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-367e895c-796f-460c-86b5-8ee58a40d458 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.392023 Aug 03 01:53:18.765202 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 743/1530] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:18 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:18.779662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93db8fd3-4ebd-43c5-b0b3-c5b255a5706f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:18.780934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93db8fd3-4ebd-43c5-b0b3-c5b255a5706f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:18.814497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93db8fd3-4ebd-43c5-b0b3-c5b255a5706f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:18.815035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93db8fd3-4ebd-43c5-b0b3-c5b255a5706f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:18.816769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93db8fd3-4ebd-43c5-b0b3-c5b255a5706f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:18.817237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93db8fd3-4ebd-43c5-b0b3-c5b255a5706f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:18.963199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-93db8fd3-4ebd-43c5-b0b3-c5b255a5706f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:18.986303 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93db8fd3-4ebd-43c5-b0b3-c5b255a5706f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1280 microversion: 2.1 time: 0.216246 Aug 03 01:53:18.988964 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 744/1531] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:18 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1280 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:18.998138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-44a0cf72-49ec-4e23-a272-9e4aab10d7ef tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-826529-8", "block_migration": true, "disk_over_commit": false}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:19.010399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-44a0cf72-49ec-4e23-a272-9e4aab10d7ef tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:19.026399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44a0cf72-49ec-4e23-a272-9e4aab10d7ef tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:19.027959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44a0cf72-49ec-4e23-a272-9e4aab10d7ef tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:19.029379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44a0cf72-49ec-4e23-a272-9e4aab10d7ef tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:19.031172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44a0cf72-49ec-4e23-a272-9e4aab10d7ef tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:19.068371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-44a0cf72-49ec-4e23-a272-9e4aab10d7ef tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Lazy-loading 'flavor' on Instance uuid fdf7e153-fecb-4313-833e-5f17c0676fe8 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:53:19.086975 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-44a0cf72-49ec-4e23-a272-9e4aab10d7ef tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance fdf7e153-fecb-4313-833e-5f17c0676fe8 while it is in vm_state suspended Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-44a0cf72-49ec-4e23-a272-9e4aab10d7ef tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Request method failure captured: Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8/action HTTP/1.1 Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 97 Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTYnGT7mErWP2s6-xrnthh2kJGbm5wEOjuBKwu3317CDMFTNhs6dooVQYxUp14RuKS58RzXq-1LWBFqCxV0FTZP08PwqpOjT9-xpOVsve-HnYN2M1gzmq8jRdeLeX-wtFJHjazAfRmo7UDFYEwzZhXhF9JG5Jeh7se4xQootIUWXzA Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: b844ffef04fd4c56af782897c40cc8ba Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-LiveMigrationNegativeTest-1949630935 Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b844ffef04fd4c56af782897c40cc8ba", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b844ffef04fd4c56af782897c40cc8ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b844ffef04fd4c56af782897c40cc8ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b844ffef04fd4c56af782897c40cc8ba"}]}] Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-LiveMigrationNegativeTest-1949630935 Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: b844ffef04fd4c56af782897c40cc8ba Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1949630935 Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-LiveMigrationNegativeTest-1949630935-project-admin Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: d66203d14b4149ebb999dc061c7d099a Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-LiveMigrationNegativeTest-1949630935-project-admin Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: {"os-migrateLive": {"host": "n-h1-826529-8", "block_migration": true, "disk_over_commit": false}} Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: exception: Cannot 'os-migrateLive' instance fdf7e153-fecb-4313-833e-5f17c0676fe8 while it is in vm_state suspended Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'fdf7e153-fecb-4313-833e-5f17c0676fe8', 'body': {'os-migrateLive': {'host': 'n-h1-826529-8', 'block_migration': True, 'disk_over_commit': False}}} Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fdf7e153-fecb-4313-833e-5f17c0676fe8 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:19.089950 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance fdf7e153-fecb-4313-833e-5f17c0676fe8 while it is in vm_state suspended Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance fdf7e153-fecb-4313-833e-5f17c0676fe8 while it is in vm_state suspended Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-44a0cf72-49ec-4e23-a272-9e4aab10d7ef tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance fdf7e153-fecb-4313-833e-5f17c0676fe8 while it is in vm_state suspended {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:19.095937 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-44a0cf72-49ec-4e23-a272-9e4aab10d7ef tempest-LiveMigrationNegativeTest-1949630935 tempest-LiveMigrationNegativeTest-1949630935-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8/action" status: 409 len: 155 microversion: 2.1 time: 0.099886 Aug 03 01:53:19.104497 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 745/1532] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:53:18 2022] POST /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8/action => generated 155 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:53:19.110533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9921d56b-4b01-4489-8c95-905e3df5adb3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:19.112685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9921d56b-4b01-4489-8c95-905e3df5adb3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: e4222150-6354-462f-9144-fb034666c245] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:19.122362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9921d56b-4b01-4489-8c95-905e3df5adb3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:19.123058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9921d56b-4b01-4489-8c95-905e3df5adb3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:19.124780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9921d56b-4b01-4489-8c95-905e3df5adb3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:19.125477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9921d56b-4b01-4489-8c95-905e3df5adb3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:19.149851 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-9921d56b-4b01-4489-8c95-905e3df5adb3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] HTTP exception thrown: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9921d56b-4b01-4489-8c95-905e3df5adb3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Request method failure captured: Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245 HTTP/1.1 Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTasCpicNUmy0l5wGshmTLAXs1TGKP24QtjgXEt1pfUM0Fz9OSCOGeM1Vm2kiXZrIwc3GlE8Q9buzy_vqnSglLvgS66oHsTLUBwBpzy5s-DMQAApHnTJ_tFXjZJGVif1xjIqetRgGDqqnx0G7OHz6gyC0I-RcrAfksrKvFL5bOm0m8 Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c5b6cc7a4be94f7489c0f749f1b26276", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}] Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 5054cb049a374f2c8e26e6d62637f7cc Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'e4222150-6354-462f-9144-fb034666c245'} Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:19.161582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:19.166494 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:19.166494 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:19.166494 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:19.166494 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:19.166494 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:53:19.166494 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:53:19.166494 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. Aug 03 01:53:19.166494 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:19.166494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9921d56b-4b01-4489-8c95-905e3df5adb3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Returning 404 to user: Instance e4222150-6354-462f-9144-fb034666c245 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:19.166494 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9921d56b-4b01-4489-8c95-905e3df5adb3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245" status: 404 len: 111 microversion: 2.1 time: 0.057235 Aug 03 01:53:19.166494 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 746/1533] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:19 2022] GET /compute/v2.1/servers/e4222150-6354-462f-9144-fb034666c245 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:53:19.168893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fba74363-d73c-4907-99c4-017276c08494 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:19.169491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fba74363-d73c-4907-99c4-017276c08494 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:19.181215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fba74363-d73c-4907-99c4-017276c08494 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:19.182007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fba74363-d73c-4907-99c4-017276c08494 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:19.183102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fba74363-d73c-4907-99c4-017276c08494 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:19.184175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fba74363-d73c-4907-99c4-017276c08494 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:19.399852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fba74363-d73c-4907-99c4-017276c08494 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:19.409165 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fba74363-d73c-4907-99c4-017276c08494 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1470 microversion: 2.1 time: 0.243736 Aug 03 01:53:19.410142 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 747/1534] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:19 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1470 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:19.420373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a3723c4c-f292-4f7b-8d1b-288b766fb8cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:19.421194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a3723c4c-f292-4f7b-8d1b-288b766fb8cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:19.429167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3723c4c-f292-4f7b-8d1b-288b766fb8cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:19.429808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3723c4c-f292-4f7b-8d1b-288b766fb8cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:19.430615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3723c4c-f292-4f7b-8d1b-288b766fb8cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:19.431101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3723c4c-f292-4f7b-8d1b-288b766fb8cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:19.634797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a3723c4c-f292-4f7b-8d1b-288b766fb8cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:19.643334 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a3723c4c-f292-4f7b-8d1b-288b766fb8cb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.232192 Aug 03 01:53:19.644281 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 748/1535] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:19 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:19.651517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b024e92e-4b24-443a-8648-bb3ef3ce8e44 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:19.652124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b024e92e-4b24-443a-8648-bb3ef3ce8e44 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:19.658703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b024e92e-4b24-443a-8648-bb3ef3ce8e44 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:19.659340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b024e92e-4b24-443a-8648-bb3ef3ce8e44 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:19.660328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b024e92e-4b24-443a-8648-bb3ef3ce8e44 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:19.660768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b024e92e-4b24-443a-8648-bb3ef3ce8e44 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:19.688983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b024e92e-4b24-443a-8648-bb3ef3ce8e44 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:53:19.808122 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b024e92e-4b24-443a-8648-bb3ef3ce8e44 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 204 len: 0 microversion: 2.1 time: 0.161587 Aug 03 01:53:19.809547 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 749/1536] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:53:19 2022] DELETE /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:53:19.815657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9642885e-225c-449b-99b9-e0ac193235f3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:19.816364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9642885e-225c-449b-99b9-e0ac193235f3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: 845f5c3f-62a6-4189-abbd-b2a17ba55f38] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:19.823973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9642885e-225c-449b-99b9-e0ac193235f3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:19.824562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9642885e-225c-449b-99b9-e0ac193235f3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:19.825354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9642885e-225c-449b-99b9-e0ac193235f3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:19.826017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9642885e-225c-449b-99b9-e0ac193235f3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:19.987455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9642885e-225c-449b-99b9-e0ac193235f3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:19.990335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:20.000603 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9642885e-225c-449b-99b9-e0ac193235f3 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38" status: 200 len: 1521 microversion: 2.1 time: 0.189679 Aug 03 01:53:20.002276 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 750/1537] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:19 2022] GET /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:20.008378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8d99f62-2e91-40f0-b800-09d6d6a6f9f5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:20.009151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b8d99f62-2e91-40f0-b800-09d6d6a6f9f5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:20.016473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8d99f62-2e91-40f0-b800-09d6d6a6f9f5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:20.016932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8d99f62-2e91-40f0-b800-09d6d6a6f9f5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:20.017855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8d99f62-2e91-40f0-b800-09d6d6a6f9f5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:20.018305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8d99f62-2e91-40f0-b800-09d6d6a6f9f5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:20.191773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b8d99f62-2e91-40f0-b800-09d6d6a6f9f5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:20.201149 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b8d99f62-2e91-40f0-b800-09d6d6a6f9f5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.197650 Aug 03 01:53:20.201722 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 751/1538] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:20 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:20.206355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-087c8e47-822d-479c-8f3b-ca6b7bfdd3c7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:20.207172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-087c8e47-822d-479c-8f3b-ca6b7bfdd3c7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:20.213506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-087c8e47-822d-479c-8f3b-ca6b7bfdd3c7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:20.213968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-087c8e47-822d-479c-8f3b-ca6b7bfdd3c7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:20.214758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-087c8e47-822d-479c-8f3b-ca6b7bfdd3c7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:20.215235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-087c8e47-822d-479c-8f3b-ca6b7bfdd3c7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:20.374575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-087c8e47-822d-479c-8f3b-ca6b7bfdd3c7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:20.382853 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-087c8e47-822d-479c-8f3b-ca6b7bfdd3c7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1466 microversion: 2.1 time: 0.179903 Aug 03 01:53:20.383465 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 752/1539] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:20 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1466 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:20.388861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3a6c4ade-824e-4d2b-afc7-06938f30974b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:20.389691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3a6c4ade-824e-4d2b-afc7-06938f30974b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:20.396563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a6c4ade-824e-4d2b-afc7-06938f30974b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:20.397029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a6c4ade-824e-4d2b-afc7-06938f30974b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:20.397984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a6c4ade-824e-4d2b-afc7-06938f30974b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:20.398449 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a6c4ade-824e-4d2b-afc7-06938f30974b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:20.466366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3a6c4ade-824e-4d2b-afc7-06938f30974b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:20.474224 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3a6c4ade-824e-4d2b-afc7-06938f30974b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1280 microversion: 2.1 time: 0.089725 Aug 03 01:53:20.475137 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 753/1540] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:20 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:20.480595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f8a2d684-1e23-4506-9c36-ba526a86ffce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:20.481399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f8a2d684-1e23-4506-9c36-ba526a86ffce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:20.488256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8a2d684-1e23-4506-9c36-ba526a86ffce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:20.488938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8a2d684-1e23-4506-9c36-ba526a86ffce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:20.489737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8a2d684-1e23-4506-9c36-ba526a86ffce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:20.490237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8a2d684-1e23-4506-9c36-ba526a86ffce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:20.693084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f8a2d684-1e23-4506-9c36-ba526a86ffce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:20.706365 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f8a2d684-1e23-4506-9c36-ba526a86ffce tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1470 microversion: 2.1 time: 0.226368 Aug 03 01:53:20.707329 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 754/1541] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:20 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1470 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:20.718660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2a8548c4-d66a-44df-93e2-654077f0dcdf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:20.719546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2a8548c4-d66a-44df-93e2-654077f0dcdf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:20.741965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a8548c4-d66a-44df-93e2-654077f0dcdf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:20.742517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a8548c4-d66a-44df-93e2-654077f0dcdf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:20.743384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a8548c4-d66a-44df-93e2-654077f0dcdf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:20.743853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a8548c4-d66a-44df-93e2-654077f0dcdf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:21.022839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2a8548c4-d66a-44df-93e2-654077f0dcdf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:21.036669 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2a8548c4-d66a-44df-93e2-654077f0dcdf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.321535 Aug 03 01:53:21.038756 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 755/1542] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:20 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:21.104921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8b615f6b-e74f-47cf-857f-82f23cf71d73 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:21.106868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8b615f6b-e74f-47cf-857f-82f23cf71d73 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: 845f5c3f-62a6-4189-abbd-b2a17ba55f38] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:21.137627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8b615f6b-e74f-47cf-857f-82f23cf71d73 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:21.139836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8b615f6b-e74f-47cf-857f-82f23cf71d73 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:21.145978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8b615f6b-e74f-47cf-857f-82f23cf71d73 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:21.148813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8b615f6b-e74f-47cf-857f-82f23cf71d73 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:21.479856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8b615f6b-e74f-47cf-857f-82f23cf71d73 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:21.497858 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8b615f6b-e74f-47cf-857f-82f23cf71d73 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38" status: 200 len: 1521 microversion: 2.1 time: 0.457286 Aug 03 01:53:21.498967 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 756/1543] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:21 2022] GET /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38 => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:21.504427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aac94948-e59c-43c3-803b-a5f1943bd765 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:21.505193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-aac94948-e59c-43c3-803b-a5f1943bd765 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:21.517512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aac94948-e59c-43c3-803b-a5f1943bd765 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:21.519249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aac94948-e59c-43c3-803b-a5f1943bd765 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:21.520716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aac94948-e59c-43c3-803b-a5f1943bd765 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:21.521419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aac94948-e59c-43c3-803b-a5f1943bd765 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:21.757366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-aac94948-e59c-43c3-803b-a5f1943bd765 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:21.769456 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aac94948-e59c-43c3-803b-a5f1943bd765 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.268795 Aug 03 01:53:21.769841 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 757/1544] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:21 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:21.775535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-078cd083-d79f-4213-95ff-6501ef9b8157 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:21.776309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-078cd083-d79f-4213-95ff-6501ef9b8157 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:21.783802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-078cd083-d79f-4213-95ff-6501ef9b8157 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:21.785112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-078cd083-d79f-4213-95ff-6501ef9b8157 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:21.786644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-078cd083-d79f-4213-95ff-6501ef9b8157 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:21.787554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-078cd083-d79f-4213-95ff-6501ef9b8157 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:21.931107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-078cd083-d79f-4213-95ff-6501ef9b8157 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:21.939379 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-078cd083-d79f-4213-95ff-6501ef9b8157 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1466 microversion: 2.1 time: 0.168351 Aug 03 01:53:21.939975 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 758/1545] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:21 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1466 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:21.944937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-9919e0c5-9f41-480a-b20d-b3808fb144df req-ca1442f8-9ce0-4365-a02b-bb239f9d6621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec36c462-8671-411f-837a-0c22e607522f", "name": "network-vif-deleted", "tag": "94f25114-4a83-4024-9d63-a3813c3d54b3"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:21.951360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:21.956223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9919e0c5-9f41-480a-b20d-b3808fb144df req-ca1442f8-9ce0-4365-a02b-bb239f9d6621 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:21.956675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9919e0c5-9f41-480a-b20d-b3808fb144df req-ca1442f8-9ce0-4365-a02b-bb239f9d6621 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:21.970261 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-9919e0c5-9f41-480a-b20d-b3808fb144df req-ca1442f8-9ce0-4365-a02b-bb239f9d6621 service nova] Creating event network-vif-deleted:94f25114-4a83-4024-9d63-a3813c3d54b3 for instance ec36c462-8671-411f-837a-0c22e607522f on n-h1-826529-8 Aug 03 01:53:21.976329 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-9919e0c5-9f41-480a-b20d-b3808fb144df req-ca1442f8-9ce0-4365-a02b-bb239f9d6621 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034126 Aug 03 01:53:21.976989 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 759/1546] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:21.982758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eefe9d52-acff-4862-aa43-8a4e04405242 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:21.983669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eefe9d52-acff-4862-aa43-8a4e04405242 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:21.992039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eefe9d52-acff-4862-aa43-8a4e04405242 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:21.992682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eefe9d52-acff-4862-aa43-8a4e04405242 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:21.993605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eefe9d52-acff-4862-aa43-8a4e04405242 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:21.993939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eefe9d52-acff-4862-aa43-8a4e04405242 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:22.088776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eefe9d52-acff-4862-aa43-8a4e04405242 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:22.099164 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eefe9d52-acff-4862-aa43-8a4e04405242 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1328 microversion: 2.1 time: 0.120831 Aug 03 01:53:22.125644 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 760/1547] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:21 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1328 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:22.137174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-68f05c01-0e82-4396-bf05-34fea51db0f3 req-fb73b562-3d7d-4de3-862e-b879ac4be3fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72330b06-28da-4653-aae1-004aa59d88b4", "name": "network-vif-plugged", "status": "completed", "tag": "91766d4e-1d4f-4c67-8adf-edbd715310e0"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:22.159194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-68f05c01-0e82-4396-bf05-34fea51db0f3 req-fb73b562-3d7d-4de3-862e-b879ac4be3fb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:22.160161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-68f05c01-0e82-4396-bf05-34fea51db0f3 req-fb73b562-3d7d-4de3-862e-b879ac4be3fb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:22.180081 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-68f05c01-0e82-4396-bf05-34fea51db0f3 req-fb73b562-3d7d-4de3-862e-b879ac4be3fb service nova] Creating event network-vif-plugged:91766d4e-1d4f-4c67-8adf-edbd715310e0 for instance 72330b06-28da-4653-aae1-004aa59d88b4 on n-h2-826529-8 Aug 03 01:53:22.186534 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-68f05c01-0e82-4396-bf05-34fea51db0f3 req-fb73b562-3d7d-4de3-862e-b879ac4be3fb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057405 Aug 03 01:53:22.187608 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 761/1548] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:22.193102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e8885c8e-54d7-411a-b520-6cc4440451e2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:22.194254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e8885c8e-54d7-411a-b520-6cc4440451e2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:22.202724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8885c8e-54d7-411a-b520-6cc4440451e2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:22.203200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8885c8e-54d7-411a-b520-6cc4440451e2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:22.204022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8885c8e-54d7-411a-b520-6cc4440451e2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:22.204466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8885c8e-54d7-411a-b520-6cc4440451e2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:22.567328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e8885c8e-54d7-411a-b520-6cc4440451e2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:22.577963 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e8885c8e-54d7-411a-b520-6cc4440451e2 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1463 microversion: 2.1 time: 0.388963 Aug 03 01:53:22.579499 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 762/1549] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:22 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1463 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:22.585414 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5c352e37-9627-4f0e-b228-f113a453169f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:22.586121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5c352e37-9627-4f0e-b228-f113a453169f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:22.592609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c352e37-9627-4f0e-b228-f113a453169f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:22.593434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c352e37-9627-4f0e-b228-f113a453169f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:22.594452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c352e37-9627-4f0e-b228-f113a453169f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:22.595117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c352e37-9627-4f0e-b228-f113a453169f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:22.830961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5c352e37-9627-4f0e-b228-f113a453169f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:22.838855 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5c352e37-9627-4f0e-b228-f113a453169f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.258058 Aug 03 01:53:22.839752 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 763/1550] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:22 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:22.844862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3bf7e963-08b6-4460-8aa6-4f83859e8751 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:22.845699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3bf7e963-08b6-4460-8aa6-4f83859e8751 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: 845f5c3f-62a6-4189-abbd-b2a17ba55f38] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:22.852818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3bf7e963-08b6-4460-8aa6-4f83859e8751 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:22.853558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3bf7e963-08b6-4460-8aa6-4f83859e8751 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:22.854361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3bf7e963-08b6-4460-8aa6-4f83859e8751 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:22.855021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3bf7e963-08b6-4460-8aa6-4f83859e8751 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:23.147122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3bf7e963-08b6-4460-8aa6-4f83859e8751 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:23.156892 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3bf7e963-08b6-4460-8aa6-4f83859e8751 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38" status: 200 len: 1521 microversion: 2.1 time: 0.315892 Aug 03 01:53:23.157499 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 764/1551] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:22 2022] GET /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:23.393953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ca03e5e3-e1f4-423c-9322-ddf499aad2db tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:23.394730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ca03e5e3-e1f4-423c-9322-ddf499aad2db tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:23.402395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca03e5e3-e1f4-423c-9322-ddf499aad2db tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:23.402868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca03e5e3-e1f4-423c-9322-ddf499aad2db tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:23.403716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca03e5e3-e1f4-423c-9322-ddf499aad2db tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:23.404164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca03e5e3-e1f4-423c-9322-ddf499aad2db tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:23.632777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:23.930060 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ca03e5e3-e1f4-423c-9322-ddf499aad2db tempest-MigrationsAdminTest-107199060 tempest-MigrationsAdminTest-107199060-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1614 microversion: 2.1 time: 0.771437 Aug 03 01:53:23.942933 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 765/1552] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:23 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1614 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:23.942933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7dad77a7-b9e6-468f-9f71-7952084eb4a3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:23.943255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7dad77a7-b9e6-468f-9f71-7952084eb4a3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:23.967682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7dad77a7-b9e6-468f-9f71-7952084eb4a3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:23.968216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7dad77a7-b9e6-468f-9f71-7952084eb4a3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:23.969018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7dad77a7-b9e6-468f-9f71-7952084eb4a3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:23.969456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7dad77a7-b9e6-468f-9f71-7952084eb4a3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:24.237746 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7dad77a7-b9e6-468f-9f71-7952084eb4a3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:24.247668 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7dad77a7-b9e6-468f-9f71-7952084eb4a3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.313109 Aug 03 01:53:24.263778 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 766/1553] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:23 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:24.271980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d822203d-7028-43fd-813e-69d0bb08feb0 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:24.274062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d822203d-7028-43fd-813e-69d0bb08feb0 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:24.281693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d822203d-7028-43fd-813e-69d0bb08feb0 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:24.282160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d822203d-7028-43fd-813e-69d0bb08feb0 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:24.282993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d822203d-7028-43fd-813e-69d0bb08feb0 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:24.283878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d822203d-7028-43fd-813e-69d0bb08feb0 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:24.553759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d822203d-7028-43fd-813e-69d0bb08feb0 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:24.578857 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d822203d-7028-43fd-813e-69d0bb08feb0 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1466 microversion: 2.1 time: 0.313438 Aug 03 01:53:24.584172 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 767/1554] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:24 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1466 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:24.594267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bf2d8813-3223-4adb-bd7c-92b239c5c06c tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:24.596168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bf2d8813-3223-4adb-bd7c-92b239c5c06c tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:24.613819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf2d8813-3223-4adb-bd7c-92b239c5c06c tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:24.614608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf2d8813-3223-4adb-bd7c-92b239c5c06c tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:24.618643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf2d8813-3223-4adb-bd7c-92b239c5c06c tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:24.621327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf2d8813-3223-4adb-bd7c-92b239c5c06c tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:24.714451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bf2d8813-3223-4adb-bd7c-92b239c5c06c tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:24.716861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:24.726566 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bf2d8813-3223-4adb-bd7c-92b239c5c06c tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1328 microversion: 2.1 time: 0.139301 Aug 03 01:53:24.728191 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 768/1555] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:24 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1328 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:24.745589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6824ec48-6790-4aee-9e15-8bdbf05e470b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:24.746223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6824ec48-6790-4aee-9e15-8bdbf05e470b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:24.754144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6824ec48-6790-4aee-9e15-8bdbf05e470b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:24.754463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6824ec48-6790-4aee-9e15-8bdbf05e470b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:24.755348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6824ec48-6790-4aee-9e15-8bdbf05e470b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:24.755761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6824ec48-6790-4aee-9e15-8bdbf05e470b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:24.971253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6824ec48-6790-4aee-9e15-8bdbf05e470b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:24.980238 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6824ec48-6790-4aee-9e15-8bdbf05e470b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.250859 Aug 03 01:53:24.981617 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 769/1556] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:24 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:24.986819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5fb1c03f-f66a-474b-97e5-72460ce1e705 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:24.987627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5fb1c03f-f66a-474b-97e5-72460ce1e705 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:24.994423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fb1c03f-f66a-474b-97e5-72460ce1e705 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:24.994883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fb1c03f-f66a-474b-97e5-72460ce1e705 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:24.995737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fb1c03f-f66a-474b-97e5-72460ce1e705 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:24.996285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fb1c03f-f66a-474b-97e5-72460ce1e705 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:25.040507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5fb1c03f-f66a-474b-97e5-72460ce1e705 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:53:25.135068 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5fb1c03f-f66a-474b-97e5-72460ce1e705 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "DELETE /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 204 len: 0 microversion: 2.1 time: 0.152087 Aug 03 01:53:25.135921 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 770/1557] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:53:24 2022] DELETE /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:53:25.143184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f72d535e-3fd7-46b4-90e4-ff6055c002f8 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:25.143891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f72d535e-3fd7-46b4-90e4-ff6055c002f8 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: 845f5c3f-62a6-4189-abbd-b2a17ba55f38] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:25.152430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f72d535e-3fd7-46b4-90e4-ff6055c002f8 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:25.153348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f72d535e-3fd7-46b4-90e4-ff6055c002f8 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:25.153787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f72d535e-3fd7-46b4-90e4-ff6055c002f8 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:25.154222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f72d535e-3fd7-46b4-90e4-ff6055c002f8 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:25.233634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f72d535e-3fd7-46b4-90e4-ff6055c002f8 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:25.242669 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f72d535e-3fd7-46b4-90e4-ff6055c002f8 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38" status: 200 len: 1479 microversion: 2.1 time: 0.105318 Aug 03 01:53:25.248759 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 771/1558] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:25 2022] GET /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38 => generated 1479 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:25.248759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-93a29b3b-2956-4404-9863-96d2d9944608 req-5ab707ec-168a-4ea6-9b0b-1a8f0250c4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "845f5c3f-62a6-4189-abbd-b2a17ba55f38", "name": "network-vif-deleted", "tag": "8aff25ff-979c-4a9b-9b62-32c97b9a15e5"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:25.258183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-93a29b3b-2956-4404-9863-96d2d9944608 req-5ab707ec-168a-4ea6-9b0b-1a8f0250c4e3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:25.258631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-93a29b3b-2956-4404-9863-96d2d9944608 req-5ab707ec-168a-4ea6-9b0b-1a8f0250c4e3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:25.270691 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-93a29b3b-2956-4404-9863-96d2d9944608 req-5ab707ec-168a-4ea6-9b0b-1a8f0250c4e3 service nova] Creating event network-vif-deleted:8aff25ff-979c-4a9b-9b62-32c97b9a15e5 for instance 845f5c3f-62a6-4189-abbd-b2a17ba55f38 on n-h2-826529-8 Aug 03 01:53:25.276765 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-93a29b3b-2956-4404-9863-96d2d9944608 req-5ab707ec-168a-4ea6-9b0b-1a8f0250c4e3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031881 Aug 03 01:53:25.277435 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 772/1559] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:25.282658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d5b8362f-5e41-4544-a1b0-cdac8297056a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:25.283330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d5b8362f-5e41-4544-a1b0-cdac8297056a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:25.290368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5b8362f-5e41-4544-a1b0-cdac8297056a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:25.291083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5b8362f-5e41-4544-a1b0-cdac8297056a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:25.291937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5b8362f-5e41-4544-a1b0-cdac8297056a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:25.292363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5b8362f-5e41-4544-a1b0-cdac8297056a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:25.715066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d5b8362f-5e41-4544-a1b0-cdac8297056a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:25.723734 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d5b8362f-5e41-4544-a1b0-cdac8297056a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1469 microversion: 2.1 time: 0.445077 Aug 03 01:53:25.735534 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 773/1560] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:25 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1469 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:25.744514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e0b3a539-56d8-466a-9c47-169bbb8cb1dd tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:25.745230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e0b3a539-56d8-466a-9c47-169bbb8cb1dd tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:25.751691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0b3a539-56d8-466a-9c47-169bbb8cb1dd tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:25.752149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0b3a539-56d8-466a-9c47-169bbb8cb1dd tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:25.752984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0b3a539-56d8-466a-9c47-169bbb8cb1dd tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:25.753426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0b3a539-56d8-466a-9c47-169bbb8cb1dd tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:26.092068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e0b3a539-56d8-466a-9c47-169bbb8cb1dd tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:26.103058 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e0b3a539-56d8-466a-9c47-169bbb8cb1dd tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.366381 Aug 03 01:53:26.103967 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 774/1561] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:25 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:26.110338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0358e2e6-6f74-484e-9433-b8df48fd5506 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:26.111356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0358e2e6-6f74-484e-9433-b8df48fd5506 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:26.120580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0358e2e6-6f74-484e-9433-b8df48fd5506 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:26.121499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0358e2e6-6f74-484e-9433-b8df48fd5506 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:26.122885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0358e2e6-6f74-484e-9433-b8df48fd5506 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:26.123687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0358e2e6-6f74-484e-9433-b8df48fd5506 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:26.227402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0358e2e6-6f74-484e-9433-b8df48fd5506 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:26.238148 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0358e2e6-6f74-484e-9433-b8df48fd5506 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1424 microversion: 2.1 time: 0.132591 Aug 03 01:53:26.238951 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 775/1562] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:26 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1424 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:26.262464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a28b0412-8b5d-4df1-91db-fed181119cdf tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:26.263179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a28b0412-8b5d-4df1-91db-fed181119cdf tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:26.269220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a28b0412-8b5d-4df1-91db-fed181119cdf tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:26.269688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a28b0412-8b5d-4df1-91db-fed181119cdf tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:26.270523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a28b0412-8b5d-4df1-91db-fed181119cdf tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:26.271082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a28b0412-8b5d-4df1-91db-fed181119cdf tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:26.276409 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ce10d37e-de5d-4f0b-b8b2-73f3c63e5f47 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/action" status: 202 len: 0 microversion: 2.25 time: 8.309947 Aug 03 01:53:26.277975 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 788/1563] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 3 01:53:17 2022] POST /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/action => generated 0 bytes in 8312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:53:26.283265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-22eb924a-7a20-4d22-aa32-a13af562677a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:26.285694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-22eb924a-7a20-4d22-aa32-a13af562677a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:26.310598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22eb924a-7a20-4d22-aa32-a13af562677a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:26.311396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22eb924a-7a20-4d22-aa32-a13af562677a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:26.315133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22eb924a-7a20-4d22-aa32-a13af562677a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:26.316329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22eb924a-7a20-4d22-aa32-a13af562677a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:26.415275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a28b0412-8b5d-4df1-91db-fed181119cdf tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:26.423782 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a28b0412-8b5d-4df1-91db-fed181119cdf tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1336 microversion: 2.1 time: 0.171355 Aug 03 01:53:26.424642 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 776/1564] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:26 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1336 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:26.431600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a6325f03-078e-4561-a2d1-186e4eb49211 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:26.432335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a6325f03-078e-4561-a2d1-186e4eb49211 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: 845f5c3f-62a6-4189-abbd-b2a17ba55f38] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:26.439157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6325f03-078e-4561-a2d1-186e4eb49211 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:26.439628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6325f03-078e-4561-a2d1-186e4eb49211 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:26.441036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6325f03-078e-4561-a2d1-186e4eb49211 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:26.441496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6325f03-078e-4561-a2d1-186e4eb49211 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:26.549965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a6325f03-078e-4561-a2d1-186e4eb49211 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5054cb049a374f2c8e26e6d62637f7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b6cc7a4be94f7489c0f749f1b26276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:26.559849 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a6325f03-078e-4561-a2d1-186e4eb49211 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38" status: 200 len: 1308 microversion: 2.1 time: 0.133702 Aug 03 01:53:26.571441 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 777/1565] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:26 2022] GET /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38 => generated 1308 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:26.580671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-05accc5a-968d-40ea-92d5-9cc527b4d6e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:26.580899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-05accc5a-968d-40ea-92d5-9cc527b4d6e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:26.587722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05accc5a-968d-40ea-92d5-9cc527b4d6e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:26.588242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05accc5a-968d-40ea-92d5-9cc527b4d6e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:26.589480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05accc5a-968d-40ea-92d5-9cc527b4d6e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:26.589689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05accc5a-968d-40ea-92d5-9cc527b4d6e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:26.625833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-22eb924a-7a20-4d22-aa32-a13af562677a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:26.641377 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-22eb924a-7a20-4d22-aa32-a13af562677a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.361919 Aug 03 01:53:26.642649 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 789/1566] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:26 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:26.750330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d1b21b5e-e226-40fa-b199-cd2a16400134 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:26.750452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d1b21b5e-e226-40fa-b199-cd2a16400134 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:26.757319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1b21b5e-e226-40fa-b199-cd2a16400134 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:26.758368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1b21b5e-e226-40fa-b199-cd2a16400134 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:26.760627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1b21b5e-e226-40fa-b199-cd2a16400134 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:26.761689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1b21b5e-e226-40fa-b199-cd2a16400134 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:26.928847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-05accc5a-968d-40ea-92d5-9cc527b4d6e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:26.956696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-05accc5a-968d-40ea-92d5-9cc527b4d6e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:26.958096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-05accc5a-968d-40ea-92d5-9cc527b4d6e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:26.960362 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-05accc5a-968d-40ea-92d5-9cc527b4d6e6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.386978 Aug 03 01:53:26.967795 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 778/1567] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:26 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:27.074297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d1b21b5e-e226-40fa-b199-cd2a16400134 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:27.089381 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d1b21b5e-e226-40fa-b199-cd2a16400134 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1469 microversion: 2.1 time: 0.343297 Aug 03 01:53:27.090267 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 790/1568] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:26 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1469 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:53:27.128928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-230967dd-8d21-4215-b25e-a1ccb6347637 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:27.129662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-230967dd-8d21-4215-b25e-a1ccb6347637 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:27.139448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-230967dd-8d21-4215-b25e-a1ccb6347637 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:27.140212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-230967dd-8d21-4215-b25e-a1ccb6347637 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:27.141301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-230967dd-8d21-4215-b25e-a1ccb6347637 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:27.141910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-230967dd-8d21-4215-b25e-a1ccb6347637 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:27.268466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b9dcf717-f0f1-4e61-85a1-c8e41e81e85c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:27.269138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b9dcf717-f0f1-4e61-85a1-c8e41e81e85c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:27.291117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9dcf717-f0f1-4e61-85a1-c8e41e81e85c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:27.291686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9dcf717-f0f1-4e61-85a1-c8e41e81e85c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:27.292365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9dcf717-f0f1-4e61-85a1-c8e41e81e85c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:27.296448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9dcf717-f0f1-4e61-85a1-c8e41e81e85c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:27.748053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:27.772289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=12 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:27.948674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=16 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:27.994683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b9dcf717-f0f1-4e61-85a1-c8e41e81e85c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:28.002813 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b9dcf717-f0f1-4e61-85a1-c8e41e81e85c tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 200 len: 1295 microversion: 2.1 time: 0.741822 Aug 03 01:53:28.009964 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 791/1569] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:27 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 1295 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:53:28.015431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-98528071-195c-442d-b1c7-a81b484ecf68 req-133ea0e2-594c-4a65-9787-9e3aac9c64bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf7e153-fecb-4313-833e-5f17c0676fe8", "name": "network-vif-deleted", "tag": "bd263e94-2840-4e82-9a94-ab1484dea7f6"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:28.028818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-98528071-195c-442d-b1c7-a81b484ecf68 req-133ea0e2-594c-4a65-9787-9e3aac9c64bd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:28.029588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-98528071-195c-442d-b1c7-a81b484ecf68 req-133ea0e2-594c-4a65-9787-9e3aac9c64bd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:28.059518 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-98528071-195c-442d-b1c7-a81b484ecf68 req-133ea0e2-594c-4a65-9787-9e3aac9c64bd service nova] Creating event network-vif-deleted:bd263e94-2840-4e82-9a94-ab1484dea7f6 for instance fdf7e153-fecb-4313-833e-5f17c0676fe8 on n-h2-826529-8 Aug 03 01:53:28.072051 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-98528071-195c-442d-b1c7-a81b484ecf68 req-133ea0e2-594c-4a65-9787-9e3aac9c64bd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060409 Aug 03 01:53:28.073065 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 792/1570] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:28.090409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9f5ffc4f-bfb0-4ed9-a1a8-bf8a2164e181 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:28.091168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9f5ffc4f-bfb0-4ed9-a1a8-bf8a2164e181 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:28.103028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f5ffc4f-bfb0-4ed9-a1a8-bf8a2164e181 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:28.103510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f5ffc4f-bfb0-4ed9-a1a8-bf8a2164e181 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:28.104358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f5ffc4f-bfb0-4ed9-a1a8-bf8a2164e181 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:28.105071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f5ffc4f-bfb0-4ed9-a1a8-bf8a2164e181 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:28.112820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:28.317273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9f5ffc4f-bfb0-4ed9-a1a8-bf8a2164e181 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:28.328540 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9f5ffc4f-bfb0-4ed9-a1a8-bf8a2164e181 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1334 microversion: 2.1 time: 0.254191 Aug 03 01:53:28.329150 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 793/1571] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:28 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1334 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:28.342784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8f08e3c-ba04-4775-b9de-4bc0f7f813f7 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:28.343913 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8f08e3c-ba04-4775-b9de-4bc0f7f813f7 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: 845f5c3f-62a6-4189-abbd-b2a17ba55f38] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:28.359070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8f08e3c-ba04-4775-b9de-4bc0f7f813f7 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:28.359492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8f08e3c-ba04-4775-b9de-4bc0f7f813f7 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:28.360132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8f08e3c-ba04-4775-b9de-4bc0f7f813f7 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:28.369400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8f08e3c-ba04-4775-b9de-4bc0f7f813f7 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:28.392843 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-e8f08e3c-ba04-4775-b9de-4bc0f7f813f7 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] HTTP exception thrown: Instance 845f5c3f-62a6-4189-abbd-b2a17ba55f38 could not be found. Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8f08e3c-ba04-4775-b9de-4bc0f7f813f7 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Request method failure captured: Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38 HTTP/1.1 Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dTasCpicNUmy0l5wGshmTLAXs1TGKP24QtjgXEt1pfUM0Fz9OSCOGeM1Vm2kiXZrIwc3GlE8Q9buzy_vqnSglLvgS66oHsTLUBwBpzy5s-DMQAApHnTJ_tFXjZJGVif1xjIqetRgGDqqnx0G7OHz6gyC0I-RcrAfksrKvFL5bOm0m8 Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c5b6cc7a4be94f7489c0f749f1b26276", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}] Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5054cb049a374f2c8e26e6d62637f7cc Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 845f5c3f-62a6-4189-abbd-b2a17ba55f38 could not be found. Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '845f5c3f-62a6-4189-abbd-b2a17ba55f38'} Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 845f5c3f-62a6-4189-abbd-b2a17ba55f38 could not be found. Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 845f5c3f-62a6-4189-abbd-b2a17ba55f38 could not be found. Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:28.394866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:28.402068 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:28.402068 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:28.402068 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:28.402068 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:28.402068 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:53:28.402068 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:53:28.402068 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 845f5c3f-62a6-4189-abbd-b2a17ba55f38 could not be found. Aug 03 01:53:28.402068 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:28.402068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8f08e3c-ba04-4775-b9de-4bc0f7f813f7 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Returning 404 to user: Instance 845f5c3f-62a6-4189-abbd-b2a17ba55f38 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:28.404053 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8f08e3c-ba04-4775-b9de-4bc0f7f813f7 tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38" status: 404 len: 111 microversion: 2.1 time: 0.072151 Aug 03 01:53:28.404811 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 794/1572] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:28 2022] GET /compute/v2.1/servers/845f5c3f-62a6-4189-abbd-b2a17ba55f38 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:53:28.409998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5ebea7b3-6974-4373-bd53-c15bf42f1083 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:28.410633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5ebea7b3-6974-4373-bd53-c15bf42f1083 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:28.419384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ebea7b3-6974-4373-bd53-c15bf42f1083 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:28.419965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ebea7b3-6974-4373-bd53-c15bf42f1083 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:28.420774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ebea7b3-6974-4373-bd53-c15bf42f1083 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:28.421223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ebea7b3-6974-4373-bd53-c15bf42f1083 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:28.517890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-230967dd-8d21-4215-b25e-a1ccb6347637 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:28.533821 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-230967dd-8d21-4215-b25e-a1ccb6347637 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 1.408505 Aug 03 01:53:28.538851 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 779/1573] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:27 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:53:28.576775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-089db49e-df3b-4e2c-bf61-6f2bf8724493 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:28.583246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-089db49e-df3b-4e2c-bf61-6f2bf8724493 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:28.592545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-089db49e-df3b-4e2c-bf61-6f2bf8724493 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:28.593025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-089db49e-df3b-4e2c-bf61-6f2bf8724493 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:28.593838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-089db49e-df3b-4e2c-bf61-6f2bf8724493 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:28.594287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-089db49e-df3b-4e2c-bf61-6f2bf8724493 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:29.033806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ebea7b3-6974-4373-bd53-c15bf42f1083 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:29.045206 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5ebea7b3-6974-4373-bd53-c15bf42f1083 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.638881 Aug 03 01:53:29.046451 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 795/1574] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:28 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:29.060762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-de85236d-b527-4950-954e-7d194c641c13 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:29.061703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-de85236d-b527-4950-954e-7d194c641c13 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:29.069247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de85236d-b527-4950-954e-7d194c641c13 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:29.070531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de85236d-b527-4950-954e-7d194c641c13 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:29.071635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de85236d-b527-4950-954e-7d194c641c13 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:29.072424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de85236d-b527-4950-954e-7d194c641c13 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:29.129527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-089db49e-df3b-4e2c-bf61-6f2bf8724493 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:29.143839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-089db49e-df3b-4e2c-bf61-6f2bf8724493 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:29.145911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-089db49e-df3b-4e2c-bf61-6f2bf8724493 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:29.149136 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-089db49e-df3b-4e2c-bf61-6f2bf8724493 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.608866 Aug 03 01:53:29.151191 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 780/1575] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:28 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:29.156525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6299df25-650d-4cc3-90d2-ae202f85b48c tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:29.159096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6299df25-650d-4cc3-90d2-ae202f85b48c tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] [instance: ec36c462-8671-411f-837a-0c22e607522f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:29.170142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6299df25-650d-4cc3-90d2-ae202f85b48c tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:29.170889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6299df25-650d-4cc3-90d2-ae202f85b48c tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:29.171916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6299df25-650d-4cc3-90d2-ae202f85b48c tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:29.172355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6299df25-650d-4cc3-90d2-ae202f85b48c tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:29.200259 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-6299df25-650d-4cc3-90d2-ae202f85b48c tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] HTTP exception thrown: Instance ec36c462-8671-411f-837a-0c22e607522f could not be found. Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6299df25-650d-4cc3-90d2-ae202f85b48c tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Request method failure captured: Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f HTTP/1.1 Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTasCpicNUmy0l5wGshmTLAXs1TGKP24QtjgXEt1pfUM0Fz9OSCOGeM1Vm2kiXZrIwc3GlE8Q9buzy_vqnSglLvgS66oHsTLUBwBpzy5s-DMQAApHnTJ_tFXjZJGVif1xjIqetRgGDqqnx0G7OHz6gyC0I-RcrAfksrKvFL5bOm0m8 Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c5b6cc7a4be94f7489c0f749f1b26276", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c5b6cc7a4be94f7489c0f749f1b26276"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c5b6cc7a4be94f7489c0f749f1b26276"}]}] Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c5b6cc7a4be94f7489c0f749f1b26276 Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-382764074 Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 5054cb049a374f2c8e26e6d62637f7cc Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ListServersNegativeTestJSON-382764074-project Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance ec36c462-8671-411f-837a-0c22e607522f could not be found. Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'ec36c462-8671-411f-837a-0c22e607522f'} Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec36c462-8671-411f-837a-0c22e607522f could not be found. Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec36c462-8671-411f-837a-0c22e607522f could not be found. Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:29.202305 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:29.208655 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:29.208655 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:29.208655 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:29.208655 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:29.208655 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:53:29.208655 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:53:29.208655 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec36c462-8671-411f-837a-0c22e607522f could not be found. Aug 03 01:53:29.208655 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:29.212460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6299df25-650d-4cc3-90d2-ae202f85b48c tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] Returning 404 to user: Instance ec36c462-8671-411f-837a-0c22e607522f could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:29.214136 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6299df25-650d-4cc3-90d2-ae202f85b48c tempest-ListServersNegativeTestJSON-382764074 tempest-ListServersNegativeTestJSON-382764074-project] 10.222.0.67 "GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f" status: 404 len: 111 microversion: 2.1 time: 0.061794 Aug 03 01:53:29.215843 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 781/1576] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:29 2022] GET /compute/v2.1/servers/ec36c462-8671-411f-837a-0c22e607522f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:53:29.221961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c9c8958a-2bc8-4388-823a-d4cd3af52884 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:29.222818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c9c8958a-2bc8-4388-823a-d4cd3af52884 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: fdf7e153-fecb-4313-833e-5f17c0676fe8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:29.236762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9c8958a-2bc8-4388-823a-d4cd3af52884 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:29.237514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9c8958a-2bc8-4388-823a-d4cd3af52884 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:29.238311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9c8958a-2bc8-4388-823a-d4cd3af52884 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:29.238750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9c8958a-2bc8-4388-823a-d4cd3af52884 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:29.254639 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-c9c8958a-2bc8-4388-823a-d4cd3af52884 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] HTTP exception thrown: Instance fdf7e153-fecb-4313-833e-5f17c0676fe8 could not be found. Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c9c8958a-2bc8-4388-823a-d4cd3af52884 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Request method failure captured: Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 HTTP/1.1 Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTXf2qWjV0LqpkXf9i-Po5vcC0kVtXx1TarLCOsy4UhEgXjPMI6haMsaP2_Aqt32_Y0ab_86BXEwGoTYyBLV8xRjvkA96dDkG_koBNNjYU0mw9ZagCohJIW25jwyNlEnnORaHrpzoEGsPRvY-z-XWmUs9t8syLaOSfvnvOlJ8Omw4w Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 67cb5febd8a7475096d9e537054a6af9 Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-LiveMigrationNegativeTest-841795993 Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_67cb5febd8a7475096d9e537054a6af9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67cb5febd8a7475096d9e537054a6af9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/67cb5febd8a7475096d9e537054a6af9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67cb5febd8a7475096d9e537054a6af9"}]}] Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-LiveMigrationNegativeTest-841795993 Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 67cb5febd8a7475096d9e537054a6af9 Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-841795993 Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-LiveMigrationNegativeTest-841795993-project Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4b53226d24c0401b8cd7d83b1264acf1 Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-LiveMigrationNegativeTest-841795993-project Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance fdf7e153-fecb-4313-833e-5f17c0676fe8 could not be found. Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'fdf7e153-fecb-4313-833e-5f17c0676fe8'} Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdf7e153-fecb-4313-833e-5f17c0676fe8 could not be found. Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdf7e153-fecb-4313-833e-5f17c0676fe8 could not be found. Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:29.257160 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:29.262594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:29.262594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:29.262594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:29.262594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:53:29.262594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:53:29.262594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdf7e153-fecb-4313-833e-5f17c0676fe8 could not be found. Aug 03 01:53:29.262594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:29.262594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c9c8958a-2bc8-4388-823a-d4cd3af52884 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Returning 404 to user: Instance fdf7e153-fecb-4313-833e-5f17c0676fe8 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:29.262594 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c9c8958a-2bc8-4388-823a-d4cd3af52884 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8" status: 404 len: 111 microversion: 2.1 time: 0.041565 Aug 03 01:53:29.262594 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 782/1577] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:29 2022] GET /compute/v2.1/servers/fdf7e153-fecb-4313-833e-5f17c0676fe8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:53:29.267775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-77154f4c-3406-4e81-9a2c-374f13492ef4 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:29.268290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-77154f4c-3406-4e81-9a2c-374f13492ef4 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:29.279202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77154f4c-3406-4e81-9a2c-374f13492ef4 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:29.280383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77154f4c-3406-4e81-9a2c-374f13492ef4 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:29.281300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77154f4c-3406-4e81-9a2c-374f13492ef4 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:29.282338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77154f4c-3406-4e81-9a2c-374f13492ef4 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:29.322771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-77154f4c-3406-4e81-9a2c-374f13492ef4 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:53:29.458708 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-77154f4c-3406-4e81-9a2c-374f13492ef4 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 204 len: 0 microversion: 2.1 time: 0.194103 Aug 03 01:53:29.460168 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 783/1578] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:53:29 2022] DELETE /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:53:29.469214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-54d8507b-f2dc-4c9d-9621-e3cd4953de9f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:29.470359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-54d8507b-f2dc-4c9d-9621-e3cd4953de9f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:29.481140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-54d8507b-f2dc-4c9d-9621-e3cd4953de9f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:29.482198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-54d8507b-f2dc-4c9d-9621-e3cd4953de9f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:29.485376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-54d8507b-f2dc-4c9d-9621-e3cd4953de9f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:29.486672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-54d8507b-f2dc-4c9d-9621-e3cd4953de9f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:29.533812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:29.634704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-de85236d-b527-4950-954e-7d194c641c13 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:29.651639 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-de85236d-b527-4950-954e-7d194c641c13 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1469 microversion: 2.1 time: 0.602876 Aug 03 01:53:29.653747 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 796/1579] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:29 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1469 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:29.662234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-74e9a5f3-5ce3-4bc6-a4b9-25cfee00fb54 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:29.665112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-74e9a5f3-5ce3-4bc6-a4b9-25cfee00fb54 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:29.677843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74e9a5f3-5ce3-4bc6-a4b9-25cfee00fb54 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:29.678877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74e9a5f3-5ce3-4bc6-a4b9-25cfee00fb54 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:29.680299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74e9a5f3-5ce3-4bc6-a4b9-25cfee00fb54 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:29.680993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74e9a5f3-5ce3-4bc6-a4b9-25cfee00fb54 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:30.106930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-54d8507b-f2dc-4c9d-9621-e3cd4953de9f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:30.121957 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-54d8507b-f2dc-4c9d-9621-e3cd4953de9f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1401 microversion: 2.1 time: 0.659701 Aug 03 01:53:30.123394 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 784/1580] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:29 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1401 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:30.131388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-87320272-4f7d-4122-a6ba-84965de59c30 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:30.134723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-87320272-4f7d-4122-a6ba-84965de59c30 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:30.151487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-87320272-4f7d-4122-a6ba-84965de59c30 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:30.153533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-87320272-4f7d-4122-a6ba-84965de59c30 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:30.154699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-87320272-4f7d-4122-a6ba-84965de59c30 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:30.157832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-87320272-4f7d-4122-a6ba-84965de59c30 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:30.194729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-74e9a5f3-5ce3-4bc6-a4b9-25cfee00fb54 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:30.213583 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-74e9a5f3-5ce3-4bc6-a4b9-25cfee00fb54 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1474 microversion: 2.1 time: 0.557142 Aug 03 01:53:30.218522 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 797/1581] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:29 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1474 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:30.238557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-39e7e308-4c31-47e8-9b92-4b9b2cca6827 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:30.251719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-39e7e308-4c31-47e8-9b92-4b9b2cca6827 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:30.280355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39e7e308-4c31-47e8-9b92-4b9b2cca6827 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:30.291408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39e7e308-4c31-47e8-9b92-4b9b2cca6827 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:30.292298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39e7e308-4c31-47e8-9b92-4b9b2cca6827 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:30.292782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39e7e308-4c31-47e8-9b92-4b9b2cca6827 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:30.793034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-39e7e308-4c31-47e8-9b92-4b9b2cca6827 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:30.812363 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-39e7e308-4c31-47e8-9b92-4b9b2cca6827 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.590995 Aug 03 01:53:30.813020 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 798/1582] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:30 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:30.832331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-87320272-4f7d-4122-a6ba-84965de59c30 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:30.833835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-faab8999-182a-488d-821c-c64fd595f672 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:30.835639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-faab8999-182a-488d-821c-c64fd595f672 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:30.844590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faab8999-182a-488d-821c-c64fd595f672 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:30.845307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faab8999-182a-488d-821c-c64fd595f672 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:30.846275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faab8999-182a-488d-821c-c64fd595f672 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:30.846892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faab8999-182a-488d-821c-c64fd595f672 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:30.868430 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-87320272-4f7d-4122-a6ba-84965de59c30 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.742530 Aug 03 01:53:30.870857 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 785/1583] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:30 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:30.900659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-20dd640f-c234-4041-89f6-5828427b8653 req-59053ae9-5053-4ae8-8ecd-6c5e6748353a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be0bf271-225a-4ad9-baf8-c7dad07593c7", "name": "network-vif-unplugged", "status": "completed", "tag": "099d436b-29db-46ff-b84a-deb5403a674f"}, {"name": "network-changed", "server_uuid": "be0bf271-225a-4ad9-baf8-c7dad07593c7", "tag": "099d436b-29db-46ff-b84a-deb5403a674f"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:30.920448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-20dd640f-c234-4041-89f6-5828427b8653 req-59053ae9-5053-4ae8-8ecd-6c5e6748353a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:30.920910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-20dd640f-c234-4041-89f6-5828427b8653 req-59053ae9-5053-4ae8-8ecd-6c5e6748353a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:30.940534 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-20dd640f-c234-4041-89f6-5828427b8653 req-59053ae9-5053-4ae8-8ecd-6c5e6748353a service nova] Creating event network-vif-unplugged:099d436b-29db-46ff-b84a-deb5403a674f for instance be0bf271-225a-4ad9-baf8-c7dad07593c7 on n-h1-826529-8 Aug 03 01:53:30.941336 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-20dd640f-c234-4041-89f6-5828427b8653 req-59053ae9-5053-4ae8-8ecd-6c5e6748353a service nova] Creating event network-changed:099d436b-29db-46ff-b84a-deb5403a674f for instance be0bf271-225a-4ad9-baf8-c7dad07593c7 on n-h1-826529-8 Aug 03 01:53:30.947328 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-20dd640f-c234-4041-89f6-5828427b8653 req-59053ae9-5053-4ae8-8ecd-6c5e6748353a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.057696 Aug 03 01:53:30.948479 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 786/1584] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:30.956141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-c5cd4637-b33a-4db9-b5fb-1755761dec92 req-7259091a-decc-4061-99f9-5e4c23d15666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72330b06-28da-4653-aae1-004aa59d88b4", "name": "network-vif-deleted", "tag": "91766d4e-1d4f-4c67-8adf-edbd715310e0"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:30.979302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c5cd4637-b33a-4db9-b5fb-1755761dec92 req-7259091a-decc-4061-99f9-5e4c23d15666 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:30.980142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c5cd4637-b33a-4db9-b5fb-1755761dec92 req-7259091a-decc-4061-99f9-5e4c23d15666 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:30.994885 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c5cd4637-b33a-4db9-b5fb-1755761dec92 req-7259091a-decc-4061-99f9-5e4c23d15666 service nova] Creating event network-vif-deleted:91766d4e-1d4f-4c67-8adf-edbd715310e0 for instance 72330b06-28da-4653-aae1-004aa59d88b4 on n-h2-826529-8 Aug 03 01:53:31.000406 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-c5cd4637-b33a-4db9-b5fb-1755761dec92 req-7259091a-decc-4061-99f9-5e4c23d15666 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050432 Aug 03 01:53:31.001141 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 787/1585] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:31.050946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-faab8999-182a-488d-821c-c64fd595f672 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:31.065607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-faab8999-182a-488d-821c-c64fd595f672 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:31.067442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-faab8999-182a-488d-821c-c64fd595f672 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:31.069558 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-faab8999-182a-488d-821c-c64fd595f672 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.239515 Aug 03 01:53:31.070701 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 799/1586] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:30 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:31.095310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-315b15d4-ddb2-425c-a2b8-9276459201cf tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:31.097405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-315b15d4-ddb2-425c-a2b8-9276459201cf tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:31.109891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-315b15d4-ddb2-425c-a2b8-9276459201cf tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:31.110620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-315b15d4-ddb2-425c-a2b8-9276459201cf tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:31.111677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-315b15d4-ddb2-425c-a2b8-9276459201cf tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:31.112630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-315b15d4-ddb2-425c-a2b8-9276459201cf tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:31.115059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-68a12963-0a8c-4f8c-9c48-eb58905ac9d3 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Action: 'create', calling method: .version_select at 0x7f5b13323af0>, body: {"keypair": {"name": "tempest-keypair-1011187560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJL86r30+dvqr+pn1NZwbKkm3ZBF672kqJEIK7mPODcMgNYWLq/Qavo74/OKNCqKjtgCnY4ezVF9tzSH3lU/evFZb/lZzbIMLvQxkGmPbbq5R6gD4LC012TVzHrv4UOI9w=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:31.152907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-68a12963-0a8c-4f8c-9c48-eb58905ac9d3 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Getting quotas for project 44fdaa2efc844407aea6dbd1493ad387. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:53:31.154208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-315b15d4-ddb2-425c-a2b8-9276459201cf tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:31.154774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-315b15d4-ddb2-425c-a2b8-9276459201cf tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:31.155871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-315b15d4-ddb2-425c-a2b8-9276459201cf tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lazy-loading 'fault' on Instance uuid 72330b06-28da-4653-aae1-004aa59d88b4 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:53:31.162336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-68a12963-0a8c-4f8c-9c48-eb58905ac9d3 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Getting quotas for user bf02f5fbbc4c4b9f8cefeb12bb44f91c and project 44fdaa2efc844407aea6dbd1493ad387. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:53:31.204496 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-68a12963-0a8c-4f8c-9c48-eb58905ac9d3 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.200992 Aug 03 01:53:31.205978 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 788/1587] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 01:53:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:31.211101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-315b15d4-ddb2-425c-a2b8-9276459201cf tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:31.212551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0de6ccfa-0af8-42f5-902f-68120340cbbc tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:31.213307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0de6ccfa-0af8-42f5-902f-68120340cbbc tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:31.221434 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-315b15d4-ddb2-425c-a2b8-9276459201cf tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 200 len: 1303 microversion: 2.1 time: 0.149413 Aug 03 01:53:31.236137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0de6ccfa-0af8-42f5-902f-68120340cbbc tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:31.236604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0de6ccfa-0af8-42f5-902f-68120340cbbc tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:31.239108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0de6ccfa-0af8-42f5-902f-68120340cbbc tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:31.239974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0de6ccfa-0af8-42f5-902f-68120340cbbc tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:31.243794 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 800/1588] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:31 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 1303 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:31.251513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8bb6e499-38d5-4832-a24e-b12846c28ba7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:31.252828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8bb6e499-38d5-4832-a24e-b12846c28ba7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:31.262767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8bb6e499-38d5-4832-a24e-b12846c28ba7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:31.263284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8bb6e499-38d5-4832-a24e-b12846c28ba7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:31.264461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8bb6e499-38d5-4832-a24e-b12846c28ba7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:31.265895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8bb6e499-38d5-4832-a24e-b12846c28ba7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:31.650169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0de6ccfa-0af8-42f5-902f-68120340cbbc tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:31.658994 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0de6ccfa-0af8-42f5-902f-68120340cbbc tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1401 microversion: 2.1 time: 0.451605 Aug 03 01:53:31.665316 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 789/1589] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:31 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1401 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:31.710275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8bb6e499-38d5-4832-a24e-b12846c28ba7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:31.718638 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8bb6e499-38d5-4832-a24e-b12846c28ba7 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1474 microversion: 2.1 time: 0.473094 Aug 03 01:53:31.720005 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 801/1590] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:31 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1474 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:31.838495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-be524e4c-eb4d-46a0-b7f6-aedd4d9a2af9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:31.839695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-be524e4c-eb4d-46a0-b7f6-aedd4d9a2af9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:31.853003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be524e4c-eb4d-46a0-b7f6-aedd4d9a2af9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:31.854502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be524e4c-eb4d-46a0-b7f6-aedd4d9a2af9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:31.856172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be524e4c-eb4d-46a0-b7f6-aedd4d9a2af9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:31.857087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be524e4c-eb4d-46a0-b7f6-aedd4d9a2af9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:31.898929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4e941d8a-6e49-4924-843b-bfb0c33db813 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:31.900320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4e941d8a-6e49-4924-843b-bfb0c33db813 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:31.916096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e941d8a-6e49-4924-843b-bfb0c33db813 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:31.917947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e941d8a-6e49-4924-843b-bfb0c33db813 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:31.920571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e941d8a-6e49-4924-843b-bfb0c33db813 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:31.928206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e941d8a-6e49-4924-843b-bfb0c33db813 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:32.130559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-be524e4c-eb4d-46a0-b7f6-aedd4d9a2af9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:32.152084 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-be524e4c-eb4d-46a0-b7f6-aedd4d9a2af9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.321906 Aug 03 01:53:32.169327 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 790/1591] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:31 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:32.176947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-47f0345c-4619-413e-b67c-abbb4ed26f68 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:32.179657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-47f0345c-4619-413e-b67c-abbb4ed26f68 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:32.188279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4e941d8a-6e49-4924-843b-bfb0c33db813 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:32.191392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47f0345c-4619-413e-b67c-abbb4ed26f68 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:32.191849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47f0345c-4619-413e-b67c-abbb4ed26f68 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:32.192649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47f0345c-4619-413e-b67c-abbb4ed26f68 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:32.193094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47f0345c-4619-413e-b67c-abbb4ed26f68 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:32.205878 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4e941d8a-6e49-4924-843b-bfb0c33db813 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.314651 Aug 03 01:53:32.207228 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 802/1592] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:31 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:32.249825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c7023ff2-2891-4988-9f26-2ba0a1ad6d01 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:32.251170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c7023ff2-2891-4988-9f26-2ba0a1ad6d01 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 72330b06-28da-4653-aae1-004aa59d88b4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:32.257654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:32.260133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7023ff2-2891-4988-9f26-2ba0a1ad6d01 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:32.260819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7023ff2-2891-4988-9f26-2ba0a1ad6d01 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:32.262891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7023ff2-2891-4988-9f26-2ba0a1ad6d01 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:32.263380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7023ff2-2891-4988-9f26-2ba0a1ad6d01 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:32.283068 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-c7023ff2-2891-4988-9f26-2ba0a1ad6d01 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] HTTP exception thrown: Instance 72330b06-28da-4653-aae1-004aa59d88b4 could not be found. Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c7023ff2-2891-4988-9f26-2ba0a1ad6d01 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Request method failure captured: Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 HTTP/1.1 Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPERBxqrO9R956wMTUjk9HLLpGWbtar7oeyd6fk93vdhxjMXyIjCkuKpbBRNmCOhFI6X3mQxH7GWBwAjLCmRe7vkKke_QPmbGz1nlBFV9T05D6nGZobBQUs9izvpdLHdnrMqr-_Q-zHRIBKd6zpqVuqaq8QyGElqpu65_FMQP444xs Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 6e247e7134ad41bfa92b6eff8111c86e Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-MigrationsAdminTest-1978759951 Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6e247e7134ad41bfa92b6eff8111c86e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e247e7134ad41bfa92b6eff8111c86e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6e247e7134ad41bfa92b6eff8111c86e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e247e7134ad41bfa92b6eff8111c86e"}]}] Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-MigrationsAdminTest-1978759951 Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 6e247e7134ad41bfa92b6eff8111c86e Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-MigrationsAdminTest-1978759951 Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-MigrationsAdminTest-1978759951-project Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 241ed53f42f84abc8efc7edb5f41f6ed Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-MigrationsAdminTest-1978759951-project Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 72330b06-28da-4653-aae1-004aa59d88b4 could not be found. Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '72330b06-28da-4653-aae1-004aa59d88b4'} Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72330b06-28da-4653-aae1-004aa59d88b4 could not be found. Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72330b06-28da-4653-aae1-004aa59d88b4 could not be found. Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:32.285395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:32.290823 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:32.290823 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:32.290823 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:32.290823 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:53:32.290823 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:53:32.290823 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72330b06-28da-4653-aae1-004aa59d88b4 could not be found. Aug 03 01:53:32.290823 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:32.294660 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c7023ff2-2891-4988-9f26-2ba0a1ad6d01 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Returning 404 to user: Instance 72330b06-28da-4653-aae1-004aa59d88b4 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:32.295787 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c7023ff2-2891-4988-9f26-2ba0a1ad6d01 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4" status: 404 len: 111 microversion: 2.1 time: 0.050387 Aug 03 01:53:32.300377 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 803/1593] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:32 2022] GET /compute/v2.1/servers/72330b06-28da-4653-aae1-004aa59d88b4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 01:53:32.307498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e4f57e15-3a56-4e0b-9b30-f8e7905f054e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:32.308275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e4f57e15-3a56-4e0b-9b30-f8e7905f054e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:32.316616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4f57e15-3a56-4e0b-9b30-f8e7905f054e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:32.317363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4f57e15-3a56-4e0b-9b30-f8e7905f054e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:32.318324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4f57e15-3a56-4e0b-9b30-f8e7905f054e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:32.319497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4f57e15-3a56-4e0b-9b30-f8e7905f054e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:32.358031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e4f57e15-3a56-4e0b-9b30-f8e7905f054e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:53:32.377395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-47f0345c-4619-413e-b67c-abbb4ed26f68 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:32.406786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-47f0345c-4619-413e-b67c-abbb4ed26f68 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:32.430407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-47f0345c-4619-413e-b67c-abbb4ed26f68 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:32.431840 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-47f0345c-4619-413e-b67c-abbb4ed26f68 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.260270 Aug 03 01:53:32.432503 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 791/1594] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:32 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:32.496466 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e4f57e15-3a56-4e0b-9b30-f8e7905f054e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 204 len: 0 microversion: 2.1 time: 0.194517 Aug 03 01:53:32.497675 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 804/1595] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:53:32 2022] DELETE /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:53:32.508013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-987ffe18-2741-4ea5-99c8-43c22b7782f3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:32.509673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-987ffe18-2741-4ea5-99c8-43c22b7782f3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:32.518875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-987ffe18-2741-4ea5-99c8-43c22b7782f3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:32.519847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-987ffe18-2741-4ea5-99c8-43c22b7782f3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:32.522477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-987ffe18-2741-4ea5-99c8-43c22b7782f3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:32.523826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-987ffe18-2741-4ea5-99c8-43c22b7782f3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:32.690234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-987ffe18-2741-4ea5-99c8-43c22b7782f3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:32.690522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f7376533-91f4-429c-87ff-34d878176385 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:32.691310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f7376533-91f4-429c-87ff-34d878176385 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:32.698954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7376533-91f4-429c-87ff-34d878176385 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:32.699990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7376533-91f4-429c-87ff-34d878176385 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:32.700127 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-987ffe18-2741-4ea5-99c8-43c22b7782f3 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1534 microversion: 2.1 time: 0.197857 Aug 03 01:53:32.700691 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 792/1596] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:32 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1534 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:53:32.714098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7376533-91f4-429c-87ff-34d878176385 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:32.714098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7376533-91f4-429c-87ff-34d878176385 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:32.752935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2e8a3fe2-28e1-46cb-a001-ee61c3638885 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:32.754109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2e8a3fe2-28e1-46cb-a001-ee61c3638885 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:32.762701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e8a3fe2-28e1-46cb-a001-ee61c3638885 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:32.763699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e8a3fe2-28e1-46cb-a001-ee61c3638885 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:32.764765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e8a3fe2-28e1-46cb-a001-ee61c3638885 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:32.765413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e8a3fe2-28e1-46cb-a001-ee61c3638885 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:33.296175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f7376533-91f4-429c-87ff-34d878176385 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:33.308881 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f7376533-91f4-429c-87ff-34d878176385 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1401 microversion: 2.1 time: 0.623137 Aug 03 01:53:33.310601 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 805/1597] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:32 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1401 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:53:33.317729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-af0d6012-9b70-43c8-94ed-27c16f58ace1 req-c6b27b5c-23d5-4468-a6e7-e75107bbc42c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff067a14-b579-4fcf-8a28-291d9c7a0f2b", "tag": "fc62d70a-5703-41fb-b29d-ab8369f459c2"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:33.320827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2e8a3fe2-28e1-46cb-a001-ee61c3638885 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:33.329550 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2e8a3fe2-28e1-46cb-a001-ee61c3638885 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1474 microversion: 2.1 time: 0.589890 Aug 03 01:53:33.332979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-af0d6012-9b70-43c8-94ed-27c16f58ace1 req-c6b27b5c-23d5-4468-a6e7-e75107bbc42c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:33.333575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-af0d6012-9b70-43c8-94ed-27c16f58ace1 req-c6b27b5c-23d5-4468-a6e7-e75107bbc42c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:33.343473 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 793/1598] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:32 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1474 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:33.349508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4a9b9beb-8ea7-4f6a-abb4-474fec530008 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:33.351202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4a9b9beb-8ea7-4f6a-abb4-474fec530008 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:33.355125 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-af0d6012-9b70-43c8-94ed-27c16f58ace1 req-c6b27b5c-23d5-4468-a6e7-e75107bbc42c service nova] Creating event network-changed:fc62d70a-5703-41fb-b29d-ab8369f459c2 for instance ff067a14-b579-4fcf-8a28-291d9c7a0f2b on n-h2-826529-8 Aug 03 01:53:33.357990 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a9b9beb-8ea7-4f6a-abb4-474fec530008 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:33.359227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a9b9beb-8ea7-4f6a-abb4-474fec530008 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:33.360218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a9b9beb-8ea7-4f6a-abb4-474fec530008 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:33.360833 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a9b9beb-8ea7-4f6a-abb4-474fec530008 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:33.365181 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-af0d6012-9b70-43c8-94ed-27c16f58ace1 req-c6b27b5c-23d5-4468-a6e7-e75107bbc42c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051529 Aug 03 01:53:33.368877 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 806/1599] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:33.392983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1d88075c-b37d-4d10-bc8d-8a7de6460521 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:33.393700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1d88075c-b37d-4d10-bc8d-8a7de6460521 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:33.407940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d88075c-b37d-4d10-bc8d-8a7de6460521 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:33.408395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d88075c-b37d-4d10-bc8d-8a7de6460521 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:33.409657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d88075c-b37d-4d10-bc8d-8a7de6460521 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:33.409657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d88075c-b37d-4d10-bc8d-8a7de6460521 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:33.675923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4a9b9beb-8ea7-4f6a-abb4-474fec530008 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:33.697537 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4a9b9beb-8ea7-4f6a-abb4-474fec530008 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.352226 Aug 03 01:53:33.698920 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 794/1600] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:33 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:33.705786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c2c4ff34-fa65-4619-ae86-ec76a6035d6d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:33.706622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1d88075c-b37d-4d10-bc8d-8a7de6460521 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:33.706833 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c2c4ff34-fa65-4619-ae86-ec76a6035d6d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:33.717003 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1d88075c-b37d-4d10-bc8d-8a7de6460521 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.346466 Aug 03 01:53:33.724791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2c4ff34-fa65-4619-ae86-ec76a6035d6d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:33.729863 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 807/1601] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:33 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:33.731329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2c4ff34-fa65-4619-ae86-ec76a6035d6d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:33.732191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2c4ff34-fa65-4619-ae86-ec76a6035d6d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:33.732641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2c4ff34-fa65-4619-ae86-ec76a6035d6d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:33.752639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c900051e-0890-4a53-9f7b-fb7a5259019e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:33.753637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c900051e-0890-4a53-9f7b-fb7a5259019e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:33.763596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c900051e-0890-4a53-9f7b-fb7a5259019e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:33.770984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c900051e-0890-4a53-9f7b-fb7a5259019e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:33.773283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c900051e-0890-4a53-9f7b-fb7a5259019e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:33.774861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c900051e-0890-4a53-9f7b-fb7a5259019e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:34.037070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c2c4ff34-fa65-4619-ae86-ec76a6035d6d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:34.042949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c900051e-0890-4a53-9f7b-fb7a5259019e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:34.057712 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c900051e-0890-4a53-9f7b-fb7a5259019e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1534 microversion: 2.1 time: 0.314525 Aug 03 01:53:34.059994 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 808/1602] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:33 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1534 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:34.068402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c2c4ff34-fa65-4619-ae86-ec76a6035d6d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:34.071090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c2c4ff34-fa65-4619-ae86-ec76a6035d6d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:34.073041 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c2c4ff34-fa65-4619-ae86-ec76a6035d6d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.372930 Aug 03 01:53:34.074032 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 795/1603] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:33 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:34.333644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-94815227-a854-452b-ad3c-190ab0e59213 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:34.334829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-94815227-a854-452b-ad3c-190ab0e59213 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:34.341128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94815227-a854-452b-ad3c-190ab0e59213 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:34.341587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94815227-a854-452b-ad3c-190ab0e59213 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:34.342377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94815227-a854-452b-ad3c-190ab0e59213 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:34.342823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94815227-a854-452b-ad3c-190ab0e59213 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:34.355458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0b0e554d-d7b2-4d10-8381-58b3c1b67dbb tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:34.356104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0b0e554d-d7b2-4d10-8381-58b3c1b67dbb tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:34.363028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b0e554d-d7b2-4d10-8381-58b3c1b67dbb tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:34.363491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b0e554d-d7b2-4d10-8381-58b3c1b67dbb tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:34.364278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b0e554d-d7b2-4d10-8381-58b3c1b67dbb tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:34.364723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b0e554d-d7b2-4d10-8381-58b3c1b67dbb tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:34.468812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0b0e554d-d7b2-4d10-8381-58b3c1b67dbb tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b53226d24c0401b8cd7d83b1264acf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67cb5febd8a7475096d9e537054a6af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:34.483529 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0b0e554d-d7b2-4d10-8381-58b3c1b67dbb tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 200 len: 1432 microversion: 2.1 time: 0.131673 Aug 03 01:53:34.484589 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 796/1604] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:34 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 1432 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:34.544815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-94815227-a854-452b-ad3c-190ab0e59213 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:34.548807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:34.555781 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-94815227-a854-452b-ad3c-190ab0e59213 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1401 microversion: 2.1 time: 0.225925 Aug 03 01:53:34.556377 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 809/1605] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:34 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1401 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:34.720087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-922d5113-bde5-40ca-a940-9c3b465f6cac tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:34.721513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-922d5113-bde5-40ca-a940-9c3b465f6cac tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:34.729576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-922d5113-bde5-40ca-a940-9c3b465f6cac tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:34.730120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-922d5113-bde5-40ca-a940-9c3b465f6cac tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:34.731216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-922d5113-bde5-40ca-a940-9c3b465f6cac tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:34.731740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-922d5113-bde5-40ca-a940-9c3b465f6cac tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:34.757404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-361b9d97-5c75-4550-83e5-ee50f7592728 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:34.758293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-361b9d97-5c75-4550-83e5-ee50f7592728 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:34.767520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-361b9d97-5c75-4550-83e5-ee50f7592728 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:34.768238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-361b9d97-5c75-4550-83e5-ee50f7592728 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:34.769211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-361b9d97-5c75-4550-83e5-ee50f7592728 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:34.769659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-361b9d97-5c75-4550-83e5-ee50f7592728 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:34.957100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-361b9d97-5c75-4550-83e5-ee50f7592728 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:34.957980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-922d5113-bde5-40ca-a940-9c3b465f6cac tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:34.965734 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-361b9d97-5c75-4550-83e5-ee50f7592728 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.213967 Aug 03 01:53:34.971496 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-922d5113-bde5-40ca-a940-9c3b465f6cac tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.255330 Aug 03 01:53:34.979935 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 810/1606] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:34 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:34.989122 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 797/1607] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:34 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:35.080782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8b155f7-53ac-41a3-9e4a-37126f3e4ae1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:35.081492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8b155f7-53ac-41a3-9e4a-37126f3e4ae1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:35.088824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8b155f7-53ac-41a3-9e4a-37126f3e4ae1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:35.089368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8b155f7-53ac-41a3-9e4a-37126f3e4ae1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:35.092732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8b155f7-53ac-41a3-9e4a-37126f3e4ae1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:35.092732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8b155f7-53ac-41a3-9e4a-37126f3e4ae1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:35.098604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f2714501-bba7-4e84-9f21-3d43807aeb75 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:35.101516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f2714501-bba7-4e84-9f21-3d43807aeb75 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:35.109320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:35.124108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2714501-bba7-4e84-9f21-3d43807aeb75 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:35.125058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2714501-bba7-4e84-9f21-3d43807aeb75 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:35.125884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2714501-bba7-4e84-9f21-3d43807aeb75 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:35.127103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2714501-bba7-4e84-9f21-3d43807aeb75 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:35.336904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8b155f7-53ac-41a3-9e4a-37126f3e4ae1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:35.341432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f2714501-bba7-4e84-9f21-3d43807aeb75 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:35.348756 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8b155f7-53ac-41a3-9e4a-37126f3e4ae1 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1534 microversion: 2.1 time: 0.271853 Aug 03 01:53:35.362928 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 811/1608] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:35 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1534 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:35.363180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f2714501-bba7-4e84-9f21-3d43807aeb75 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:35.363180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f2714501-bba7-4e84-9f21-3d43807aeb75 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:35.363180 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f2714501-bba7-4e84-9f21-3d43807aeb75 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.266191 Aug 03 01:53:35.363180 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 798/1609] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:35 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:35.402019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-420398db-622a-4347-b998-ee2ca31ca259 req-228d2111-1504-47f2-8a80-8acd4288a9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf0a0ec2-f2fb-49be-97ad-48bde7053e9a", "name": "network-vif-deleted", "tag": "a180f2da-fc64-4024-9832-25e1d3488fcb"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:35.417267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-420398db-622a-4347-b998-ee2ca31ca259 req-228d2111-1504-47f2-8a80-8acd4288a9ed service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:35.417980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-420398db-622a-4347-b998-ee2ca31ca259 req-228d2111-1504-47f2-8a80-8acd4288a9ed service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:35.444153 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-420398db-622a-4347-b998-ee2ca31ca259 req-228d2111-1504-47f2-8a80-8acd4288a9ed service nova] Creating event network-vif-deleted:a180f2da-fc64-4024-9832-25e1d3488fcb for instance cf0a0ec2-f2fb-49be-97ad-48bde7053e9a on n-h1-826529-8 Aug 03 01:53:35.452825 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-420398db-622a-4347-b998-ee2ca31ca259 req-228d2111-1504-47f2-8a80-8acd4288a9ed service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054743 Aug 03 01:53:35.454099 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 812/1610] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:35.539502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7978f4dc-cb6c-49a3-90e4-9a25b9ae6d48 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:35.545687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7978f4dc-cb6c-49a3-90e4-9a25b9ae6d48 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] [instance: cf0a0ec2-f2fb-49be-97ad-48bde7053e9a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:35.557734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7978f4dc-cb6c-49a3-90e4-9a25b9ae6d48 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:35.558676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7978f4dc-cb6c-49a3-90e4-9a25b9ae6d48 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:35.560138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7978f4dc-cb6c-49a3-90e4-9a25b9ae6d48 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:35.561424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7978f4dc-cb6c-49a3-90e4-9a25b9ae6d48 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:35.582781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-712286bd-d388-4f58-b606-bee71d9f6e82 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:35.585309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-712286bd-d388-4f58-b606-bee71d9f6e82 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:35.589035 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-7978f4dc-cb6c-49a3-90e4-9a25b9ae6d48 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] HTTP exception thrown: Instance cf0a0ec2-f2fb-49be-97ad-48bde7053e9a could not be found. Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7978f4dc-cb6c-49a3-90e4-9a25b9ae6d48 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Request method failure captured: Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a HTTP/1.1 Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTXf2qWjV0LqpkXf9i-Po5vcC0kVtXx1TarLCOsy4UhEgXjPMI6haMsaP2_Aqt32_Y0ab_86BXEwGoTYyBLV8xRjvkA96dDkG_koBNNjYU0mw9ZagCohJIW25jwyNlEnnORaHrpzoEGsPRvY-z-XWmUs9t8syLaOSfvnvOlJ8Omw4w Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 67cb5febd8a7475096d9e537054a6af9 Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-LiveMigrationNegativeTest-841795993 Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_67cb5febd8a7475096d9e537054a6af9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67cb5febd8a7475096d9e537054a6af9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/67cb5febd8a7475096d9e537054a6af9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/67cb5febd8a7475096d9e537054a6af9"}]}] Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-LiveMigrationNegativeTest-841795993 Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 67cb5febd8a7475096d9e537054a6af9 Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-841795993 Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-LiveMigrationNegativeTest-841795993-project Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4b53226d24c0401b8cd7d83b1264acf1 Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-LiveMigrationNegativeTest-841795993-project Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance cf0a0ec2-f2fb-49be-97ad-48bde7053e9a could not be found. Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'cf0a0ec2-f2fb-49be-97ad-48bde7053e9a'} Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf0a0ec2-f2fb-49be-97ad-48bde7053e9a could not be found. Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf0a0ec2-f2fb-49be-97ad-48bde7053e9a could not be found. Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:35.590940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:35.597688 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:35.597688 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:35.597688 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:35.597688 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:53:35.597688 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:53:35.597688 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf0a0ec2-f2fb-49be-97ad-48bde7053e9a could not be found. Aug 03 01:53:35.597688 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:35.597688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7978f4dc-cb6c-49a3-90e4-9a25b9ae6d48 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] Returning 404 to user: Instance cf0a0ec2-f2fb-49be-97ad-48bde7053e9a could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:35.597688 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7978f4dc-cb6c-49a3-90e4-9a25b9ae6d48 tempest-LiveMigrationNegativeTest-841795993 tempest-LiveMigrationNegativeTest-841795993-project] 10.222.0.67 "GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a" status: 404 len: 111 microversion: 2.1 time: 0.089358 Aug 03 01:53:35.603182 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 799/1611] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:35 2022] GET /compute/v2.1/servers/cf0a0ec2-f2fb-49be-97ad-48bde7053e9a => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:53:35.607398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-712286bd-d388-4f58-b606-bee71d9f6e82 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:35.608048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-712286bd-d388-4f58-b606-bee71d9f6e82 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:35.609440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-712286bd-d388-4f58-b606-bee71d9f6e82 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:35.610054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-712286bd-d388-4f58-b606-bee71d9f6e82 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:35.931561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-712286bd-d388-4f58-b606-bee71d9f6e82 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:35.943448 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-712286bd-d388-4f58-b606-bee71d9f6e82 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1401 microversion: 2.1 time: 0.370621 Aug 03 01:53:35.944762 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 813/1612] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:35 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1401 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:53:35.997540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-55f4931e-da9c-415f-bc43-9cc6e516e17a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:35.998159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-55f4931e-da9c-415f-bc43-9cc6e516e17a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:36.004068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c9b864b6-b908-4d79-92ba-4771ff8b22cf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:36.004988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c9b864b6-b908-4d79-92ba-4771ff8b22cf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:36.014097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55f4931e-da9c-415f-bc43-9cc6e516e17a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:36.016765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55f4931e-da9c-415f-bc43-9cc6e516e17a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:36.020381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55f4931e-da9c-415f-bc43-9cc6e516e17a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:36.022985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55f4931e-da9c-415f-bc43-9cc6e516e17a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:36.027495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9b864b6-b908-4d79-92ba-4771ff8b22cf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:36.028370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9b864b6-b908-4d79-92ba-4771ff8b22cf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:36.038871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9b864b6-b908-4d79-92ba-4771ff8b22cf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:36.039655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9b864b6-b908-4d79-92ba-4771ff8b22cf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:36.545014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-55f4931e-da9c-415f-bc43-9cc6e516e17a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:36.561898 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-55f4931e-da9c-415f-bc43-9cc6e516e17a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.564032 Aug 03 01:53:36.562632 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 814/1613] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:35 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:36.578069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a8f38b8c-751c-4c81-9d63-e1e108ba7b9c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:36.578069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a8f38b8c-751c-4c81-9d63-e1e108ba7b9c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:36.578069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8f38b8c-751c-4c81-9d63-e1e108ba7b9c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:36.578069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8f38b8c-751c-4c81-9d63-e1e108ba7b9c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:36.578069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8f38b8c-751c-4c81-9d63-e1e108ba7b9c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:36.578069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8f38b8c-751c-4c81-9d63-e1e108ba7b9c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:36.656916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8f38b8c-751c-4c81-9d63-e1e108ba7b9c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:36.658402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8f38b8c-751c-4c81-9d63-e1e108ba7b9c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:36.658930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-a8f38b8c-751c-4c81-9d63-e1e108ba7b9c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lazy-loading 'fault' on Instance uuid 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:53:36.813573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c9b864b6-b908-4d79-92ba-4771ff8b22cf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:36.823618 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c9b864b6-b908-4d79-92ba-4771ff8b22cf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.839769 Aug 03 01:53:36.824854 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 800/1614] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:35 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:36.831485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-097c4b87-6c50-467c-890f-ab86c5fac246 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:36.832588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-097c4b87-6c50-467c-890f-ab86c5fac246 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:36.840966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a8f38b8c-751c-4c81-9d63-e1e108ba7b9c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:36.846704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-097c4b87-6c50-467c-890f-ab86c5fac246 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:36.847478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-097c4b87-6c50-467c-890f-ab86c5fac246 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:36.848892 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a8f38b8c-751c-4c81-9d63-e1e108ba7b9c tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 200 len: 1368 microversion: 2.1 time: 0.285071 Aug 03 01:53:36.849074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-097c4b87-6c50-467c-890f-ab86c5fac246 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:36.850750 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 815/1615] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:36 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 1368 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:36.850894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-097c4b87-6c50-467c-890f-ab86c5fac246 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:36.981645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed831e35-2f1b-44ba-bfa6-15470e174fe5 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:36.982304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ed831e35-2f1b-44ba-bfa6-15470e174fe5 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:36.993389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed831e35-2f1b-44ba-bfa6-15470e174fe5 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:36.994246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed831e35-2f1b-44ba-bfa6-15470e174fe5 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:36.995375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed831e35-2f1b-44ba-bfa6-15470e174fe5 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:36.996151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed831e35-2f1b-44ba-bfa6-15470e174fe5 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:37.297489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-097c4b87-6c50-467c-890f-ab86c5fac246 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:37.309793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-097c4b87-6c50-467c-890f-ab86c5fac246 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:37.311695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-097c4b87-6c50-467c-890f-ab86c5fac246 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:37.313436 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-097c4b87-6c50-467c-890f-ab86c5fac246 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.486966 Aug 03 01:53:37.315046 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 801/1616] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:36 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:37.403195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ed831e35-2f1b-44ba-bfa6-15470e174fe5 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:37.418162 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed831e35-2f1b-44ba-bfa6-15470e174fe5 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1401 microversion: 2.1 time: 0.442146 Aug 03 01:53:37.431492 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 816/1617] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:36 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1401 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:37.471434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-8e5cbd23-e90c-4091-9953-00bf43a169fc req-3a067836-0fe0-4fd0-a599-7231e17d0e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2ce9d3-8e0c-4981-951e-3d23d58de2c2", "name": "network-vif-deleted", "tag": "aee6f3d7-e3c0-4569-9c1b-2cfe18a9f997"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:37.511323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8e5cbd23-e90c-4091-9953-00bf43a169fc req-3a067836-0fe0-4fd0-a599-7231e17d0e06 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:37.512017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8e5cbd23-e90c-4091-9953-00bf43a169fc req-3a067836-0fe0-4fd0-a599-7231e17d0e06 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:37.567302 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-8e5cbd23-e90c-4091-9953-00bf43a169fc req-3a067836-0fe0-4fd0-a599-7231e17d0e06 service nova] Creating event network-vif-deleted:aee6f3d7-e3c0-4569-9c1b-2cfe18a9f997 for instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 on n-h1-826529-8 Aug 03 01:53:37.577775 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-8e5cbd23-e90c-4091-9953-00bf43a169fc req-3a067836-0fe0-4fd0-a599-7231e17d0e06 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110364 Aug 03 01:53:37.582680 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 802/1618] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:37.587850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0c69401e-93a9-4c8c-a523-b6ce5c13d63d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:37.589059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0c69401e-93a9-4c8c-a523-b6ce5c13d63d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:37.601998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c69401e-93a9-4c8c-a523-b6ce5c13d63d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:37.603268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c69401e-93a9-4c8c-a523-b6ce5c13d63d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:37.604320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c69401e-93a9-4c8c-a523-b6ce5c13d63d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:37.605118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c69401e-93a9-4c8c-a523-b6ce5c13d63d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:37.853076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7195b41c-7936-404f-90ab-f489fe3663e3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:37.853958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7195b41c-7936-404f-90ab-f489fe3663e3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:37.870367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7195b41c-7936-404f-90ab-f489fe3663e3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:37.870873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7195b41c-7936-404f-90ab-f489fe3663e3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:37.874546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7195b41c-7936-404f-90ab-f489fe3663e3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:37.875090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7195b41c-7936-404f-90ab-f489fe3663e3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:38.090008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0c69401e-93a9-4c8c-a523-b6ce5c13d63d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:38.098532 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0c69401e-93a9-4c8c-a523-b6ce5c13d63d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.516782 Aug 03 01:53:38.102514 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 817/1619] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:37 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:53:38.107441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9873f325-4904-4dc5-b311-8e18fe129a4f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:38.108060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9873f325-4904-4dc5-b311-8e18fe129a4f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:38.130430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9873f325-4904-4dc5-b311-8e18fe129a4f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:38.131699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9873f325-4904-4dc5-b311-8e18fe129a4f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:38.132890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9873f325-4904-4dc5-b311-8e18fe129a4f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:38.133527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9873f325-4904-4dc5-b311-8e18fe129a4f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:38.151289 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-9873f325-4904-4dc5-b311-8e18fe129a4f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] HTTP exception thrown: Instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 could not be found. Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9873f325-4904-4dc5-b311-8e18fe129a4f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Request method failure captured: Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 HTTP/1.1 Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPERBxqrO9R956wMTUjk9HLLpGWbtar7oeyd6fk93vdhxjMXyIjCkuKpbBRNmCOhFI6X3mQxH7GWBwAjLCmRe7vkKke_QPmbGz1nlBFV9T05D6nGZobBQUs9izvpdLHdnrMqr-_Q-zHRIBKd6zpqVuqaq8QyGElqpu65_FMQP444xs Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 6e247e7134ad41bfa92b6eff8111c86e Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-MigrationsAdminTest-1978759951 Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6e247e7134ad41bfa92b6eff8111c86e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e247e7134ad41bfa92b6eff8111c86e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6e247e7134ad41bfa92b6eff8111c86e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e247e7134ad41bfa92b6eff8111c86e"}]}] Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-MigrationsAdminTest-1978759951 Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 6e247e7134ad41bfa92b6eff8111c86e Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-MigrationsAdminTest-1978759951 Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-MigrationsAdminTest-1978759951-project Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 241ed53f42f84abc8efc7edb5f41f6ed Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-MigrationsAdminTest-1978759951-project Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 could not be found. Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '1b2ce9d3-8e0c-4981-951e-3d23d58de2c2'} Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 could not be found. Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 could not be found. Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:38.153447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:38.158295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:38.158295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:38.158295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:38.158295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:53:38.158295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:53:38.158295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 could not be found. Aug 03 01:53:38.158295 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:38.160201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9873f325-4904-4dc5-b311-8e18fe129a4f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Returning 404 to user: Instance 1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:38.161318 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9873f325-4904-4dc5-b311-8e18fe129a4f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2" status: 404 len: 111 microversion: 2.1 time: 0.057736 Aug 03 01:53:38.162333 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 818/1620] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:38 2022] GET /compute/v2.1/servers/1b2ce9d3-8e0c-4981-951e-3d23d58de2c2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:53:38.173104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-22b34f62-ee94-4f75-b44a-f1f681aefc7a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '.version_select at 0x7f5b244b35e0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:38.206556 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-22b34f62-ee94-4f75-b44a-f1f681aefc7a tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1223659292" status: 202 len: 0 microversion: 2.1 time: 0.038769 Aug 03 01:53:38.207615 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 819/1621] 10.222.0.67 () {58 vars in 1221 bytes} [Wed Aug 3 01:53:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1223659292 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:53:38.343049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c619089d-006b-4a7d-8cbe-f8ae031eb577 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:38.343965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c619089d-006b-4a7d-8cbe-f8ae031eb577 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:38.356649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c619089d-006b-4a7d-8cbe-f8ae031eb577 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:38.357763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c619089d-006b-4a7d-8cbe-f8ae031eb577 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:38.358785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c619089d-006b-4a7d-8cbe-f8ae031eb577 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:38.359425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c619089d-006b-4a7d-8cbe-f8ae031eb577 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:38.469117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7195b41c-7936-404f-90ab-f489fe3663e3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:38.489828 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7195b41c-7936-404f-90ab-f489fe3663e3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.642080 Aug 03 01:53:38.507977 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 803/1622] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:37 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:53:38.517830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f16d5435-5619-4019-add6-e34fff28332f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:38.523295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f16d5435-5619-4019-add6-e34fff28332f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:38.552151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f16d5435-5619-4019-add6-e34fff28332f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:38.553901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f16d5435-5619-4019-add6-e34fff28332f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:38.564704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f16d5435-5619-4019-add6-e34fff28332f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:38.565233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f16d5435-5619-4019-add6-e34fff28332f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:38.596515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:38.746677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c619089d-006b-4a7d-8cbe-f8ae031eb577 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:38.755981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c619089d-006b-4a7d-8cbe-f8ae031eb577 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:38.763337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c619089d-006b-4a7d-8cbe-f8ae031eb577 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:38.765558 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c619089d-006b-4a7d-8cbe-f8ae031eb577 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.426701 Aug 03 01:53:38.767029 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 820/1623] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:38 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:38.946476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f16d5435-5619-4019-add6-e34fff28332f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:38.957224 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f16d5435-5619-4019-add6-e34fff28332f tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1401 microversion: 2.1 time: 0.445163 Aug 03 01:53:38.957682 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 804/1624] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:38 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1401 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:39.122485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-11043691-766e-4e42-ad86-41493d12338e tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:39.124235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-11043691-766e-4e42-ad86-41493d12338e tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:39.140698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11043691-766e-4e42-ad86-41493d12338e tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:39.144866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11043691-766e-4e42-ad86-41493d12338e tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:39.148007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11043691-766e-4e42-ad86-41493d12338e tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:39.151207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11043691-766e-4e42-ad86-41493d12338e tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:39.514178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3d796d31-f0d7-4b69-9da5-eb974c871607 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:39.515112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3d796d31-f0d7-4b69-9da5-eb974c871607 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:39.546551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d796d31-f0d7-4b69-9da5-eb974c871607 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:39.550213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d796d31-f0d7-4b69-9da5-eb974c871607 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:39.553800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d796d31-f0d7-4b69-9da5-eb974c871607 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:39.558401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d796d31-f0d7-4b69-9da5-eb974c871607 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:39.573419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-11043691-766e-4e42-ad86-41493d12338e tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:39.586353 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-11043691-766e-4e42-ad86-41493d12338e tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.469648 Aug 03 01:53:39.587368 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 821/1625] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:39 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:39.603875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3959302b-9d3e-43cb-bf1a-6f67a738c8de tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:39.604838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3959302b-9d3e-43cb-bf1a-6f67a738c8de tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:39.616661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3959302b-9d3e-43cb-bf1a-6f67a738c8de tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:39.617691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3959302b-9d3e-43cb-bf1a-6f67a738c8de tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:39.618956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3959302b-9d3e-43cb-bf1a-6f67a738c8de tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:39.620279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3959302b-9d3e-43cb-bf1a-6f67a738c8de tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:39.743740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3959302b-9d3e-43cb-bf1a-6f67a738c8de tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:53:39.963731 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3959302b-9d3e-43cb-bf1a-6f67a738c8de tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 204 len: 0 microversion: 2.1 time: 0.373003 Aug 03 01:53:39.966427 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 822/1626] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:53:39 2022] DELETE /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:53:39.977708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6885779f-309a-480c-8c2f-a6f3e0b3b2af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:39.978873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6885779f-309a-480c-8c2f-a6f3e0b3b2af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:40.000542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6885779f-309a-480c-8c2f-a6f3e0b3b2af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:40.002664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6885779f-309a-480c-8c2f-a6f3e0b3b2af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:40.005242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6885779f-309a-480c-8c2f-a6f3e0b3b2af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:40.006785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6885779f-309a-480c-8c2f-a6f3e0b3b2af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:40.243966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3d796d31-f0d7-4b69-9da5-eb974c871607 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:40.261557 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3d796d31-f0d7-4b69-9da5-eb974c871607 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.752887 Aug 03 01:53:40.265622 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 805/1627] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:39 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:53:40.278457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-997a6cb0-3855-40a1-aead-c68eb5f21b32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:40.284703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-997a6cb0-3855-40a1-aead-c68eb5f21b32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:40.300411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-997a6cb0-3855-40a1-aead-c68eb5f21b32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:40.305843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-997a6cb0-3855-40a1-aead-c68eb5f21b32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:40.307983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-997a6cb0-3855-40a1-aead-c68eb5f21b32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:40.315400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-997a6cb0-3855-40a1-aead-c68eb5f21b32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:40.846868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-997a6cb0-3855-40a1-aead-c68eb5f21b32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:40.857344 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-997a6cb0-3855-40a1-aead-c68eb5f21b32 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1469 microversion: 2.1 time: 0.590384 Aug 03 01:53:40.863431 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 806/1628] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:40 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1469 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:40.870339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6885779f-309a-480c-8c2f-a6f3e0b3b2af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:40.880174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6885779f-309a-480c-8c2f-a6f3e0b3b2af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:40.883121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6885779f-309a-480c-8c2f-a6f3e0b3b2af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:40.885372 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6885779f-309a-480c-8c2f-a6f3e0b3b2af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.915540 Aug 03 01:53:40.886245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f250ce9d-557a-4d74-ba9a-1e8c234d1144 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:40.886889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f250ce9d-557a-4d74-ba9a-1e8c234d1144 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:40.888977 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 823/1629] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:39 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:40.900370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d1dd020d-ef66-463d-908d-bc056202e7de tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:40.901813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d1dd020d-ef66-463d-908d-bc056202e7de tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:40.914608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f250ce9d-557a-4d74-ba9a-1e8c234d1144 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:40.915959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f250ce9d-557a-4d74-ba9a-1e8c234d1144 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:40.918003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f250ce9d-557a-4d74-ba9a-1e8c234d1144 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:40.920895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f250ce9d-557a-4d74-ba9a-1e8c234d1144 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:40.921602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1dd020d-ef66-463d-908d-bc056202e7de tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:40.922347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1dd020d-ef66-463d-908d-bc056202e7de tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:40.923866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1dd020d-ef66-463d-908d-bc056202e7de tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:40.924541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1dd020d-ef66-463d-908d-bc056202e7de tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:41.174529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:41.208669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d1dd020d-ef66-463d-908d-bc056202e7de tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:41.220735 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d1dd020d-ef66-463d-908d-bc056202e7de tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.327294 Aug 03 01:53:41.223475 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 824/1630] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:40 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:41.229720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-ec192d36-1b8e-4aad-9fff-f4c86d4cfb6e req-eb474c87-3b88-45ae-a774-94d049d30a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff067a14-b579-4fcf-8a28-291d9c7a0f2b", "name": "network-vif-plugged", "status": "completed", "tag": "fc62d70a-5703-41fb-b29d-ab8369f459c2"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:41.241381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ec192d36-1b8e-4aad-9fff-f4c86d4cfb6e req-eb474c87-3b88-45ae-a774-94d049d30a25 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:41.242260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ec192d36-1b8e-4aad-9fff-f4c86d4cfb6e req-eb474c87-3b88-45ae-a774-94d049d30a25 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:41.257111 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-ec192d36-1b8e-4aad-9fff-f4c86d4cfb6e req-eb474c87-3b88-45ae-a774-94d049d30a25 service nova] Creating event network-vif-plugged:fc62d70a-5703-41fb-b29d-ab8369f459c2 for instance ff067a14-b579-4fcf-8a28-291d9c7a0f2b on n-h2-826529-8 Aug 03 01:53:41.262804 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-ec192d36-1b8e-4aad-9fff-f4c86d4cfb6e req-eb474c87-3b88-45ae-a774-94d049d30a25 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037889 Aug 03 01:53:41.263742 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 825/1631] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:41.293520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5be99a8e-1cb9-445b-81f8-9d19acab9125 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:41.294460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5be99a8e-1cb9-445b-81f8-9d19acab9125 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:41.303717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5be99a8e-1cb9-445b-81f8-9d19acab9125 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:41.304598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5be99a8e-1cb9-445b-81f8-9d19acab9125 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:41.305743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5be99a8e-1cb9-445b-81f8-9d19acab9125 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:41.306465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5be99a8e-1cb9-445b-81f8-9d19acab9125 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:41.328235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f250ce9d-557a-4d74-ba9a-1e8c234d1144 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:41.355185 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f250ce9d-557a-4d74-ba9a-1e8c234d1144 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1401 microversion: 2.1 time: 0.487591 Aug 03 01:53:41.355185 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 807/1632] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:40 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1401 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:41.685779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5be99a8e-1cb9-445b-81f8-9d19acab9125 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:41.699246 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5be99a8e-1cb9-445b-81f8-9d19acab9125 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.410523 Aug 03 01:53:41.702470 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 826/1633] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:41 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:41.884323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d2a6351-c5a7-42ac-a3e6-2cac7f8b7eb5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:41.885858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6d2a6351-c5a7-42ac-a3e6-2cac7f8b7eb5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:41.898033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d2a6351-c5a7-42ac-a3e6-2cac7f8b7eb5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:41.899160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d2a6351-c5a7-42ac-a3e6-2cac7f8b7eb5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:41.900399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d2a6351-c5a7-42ac-a3e6-2cac7f8b7eb5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:41.901296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d2a6351-c5a7-42ac-a3e6-2cac7f8b7eb5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:41.944507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:41.978939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-064f45db-40b0-46e1-8b64-180d13ca254d tempest-NetworksTest-1678944069 tempest-NetworksTest-1678944069-project-admin] Calling method '.version_select at 0x7f5b13038160>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:42.252851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6d2a6351-c5a7-42ac-a3e6-2cac7f8b7eb5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:42.262754 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6d2a6351-c5a7-42ac-a3e6-2cac7f8b7eb5 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1469 microversion: 2.1 time: 0.386198 Aug 03 01:53:42.267011 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 827/1634] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:41 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1469 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:42.273614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2747873f-b97c-4aa3-ae1c-9d36bb503b62 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:42.280246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2747873f-b97c-4aa3-ae1c-9d36bb503b62 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:42.292931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2747873f-b97c-4aa3-ae1c-9d36bb503b62 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:42.293377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2747873f-b97c-4aa3-ae1c-9d36bb503b62 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:42.294453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2747873f-b97c-4aa3-ae1c-9d36bb503b62 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:42.295100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2747873f-b97c-4aa3-ae1c-9d36bb503b62 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:42.328073 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-064f45db-40b0-46e1-8b64-180d13ca254d tempest-NetworksTest-1678944069 tempest-NetworksTest-1678944069-project-admin] 10.222.0.67 "GET /compute/v2.1/os-networks" status: 200 len: 6737 microversion: 2.1 time: 0.528890 Aug 03 01:53:42.331978 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 808/1635] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:53:41 2022] GET /compute/v2.1/os-networks => generated 6737 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:42.334017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7fb6de36-4d3c-4794-8e61-5c8c28fc8ced tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:42.334628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7fb6de36-4d3c-4794-8e61-5c8c28fc8ced tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:42.346885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fb6de36-4d3c-4794-8e61-5c8c28fc8ced tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:42.347387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fb6de36-4d3c-4794-8e61-5c8c28fc8ced tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:42.348402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fb6de36-4d3c-4794-8e61-5c8c28fc8ced tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:42.349189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fb6de36-4d3c-4794-8e61-5c8c28fc8ced tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:42.733703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2747873f-b97c-4aa3-ae1c-9d36bb503b62 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:42.751490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2747873f-b97c-4aa3-ae1c-9d36bb503b62 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:42.753371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2747873f-b97c-4aa3-ae1c-9d36bb503b62 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:42.760252 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2747873f-b97c-4aa3-ae1c-9d36bb503b62 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.491199 Aug 03 01:53:42.761167 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 828/1636] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:42 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:42.769657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-78108773-5568-476e-a2f0-158b466c10ef tempest-NetworksTest-1678944069 tempest-NetworksTest-1678944069-project-admin] Calling method '.version_select at 0x7f5b12a99a60>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:42.843970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7fb6de36-4d3c-4794-8e61-5c8c28fc8ced tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:42.854998 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7fb6de36-4d3c-4794-8e61-5c8c28fc8ced tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.525074 Aug 03 01:53:42.858963 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 809/1637] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:42 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:42.864667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-673fb36c-1a33-40a1-880a-0c10fe10e881 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:42.869395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-673fb36c-1a33-40a1-880a-0c10fe10e881 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:42.884736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-673fb36c-1a33-40a1-880a-0c10fe10e881 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:42.891868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-673fb36c-1a33-40a1-880a-0c10fe10e881 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:42.892959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-673fb36c-1a33-40a1-880a-0c10fe10e881 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:42.893711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-673fb36c-1a33-40a1-880a-0c10fe10e881 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:43.430347 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-78108773-5568-476e-a2f0-158b466c10ef tempest-NetworksTest-1678944069 tempest-NetworksTest-1678944069-project-admin] 10.222.0.67 "GET /compute/v2.1/os-networks/b7ba8541-4926-46e2-babc-3b914e46eef0" status: 200 len: 652 microversion: 2.1 time: 0.667922 Aug 03 01:53:43.435422 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 829/1638] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 01:53:42 2022] GET /compute/v2.1/os-networks/b7ba8541-4926-46e2-babc-3b914e46eef0 => generated 652 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:43.442247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7bd9bf67-c054-4083-a931-d8467a8db250 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:43.443032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7bd9bf67-c054-4083-a931-d8467a8db250 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:43.452390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bd9bf67-c054-4083-a931-d8467a8db250 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:43.452843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bd9bf67-c054-4083-a931-d8467a8db250 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:43.453955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bd9bf67-c054-4083-a931-d8467a8db250 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:43.454406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bd9bf67-c054-4083-a931-d8467a8db250 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:43.531176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-673fb36c-1a33-40a1-880a-0c10fe10e881 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:43.540732 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-673fb36c-1a33-40a1-880a-0c10fe10e881 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1401 microversion: 2.1 time: 0.679930 Aug 03 01:53:43.554405 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 810/1639] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:42 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1401 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:43.678927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2a200e96-6a32-4b98-b9fe-287ef05b4d65 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-376820618", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": "none"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:43.760094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7bd9bf67-c054-4083-a931-d8467a8db250 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:43.769135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2a200e96-6a32-4b98-b9fe-287ef05b4d65 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:53:43.769663 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7bd9bf67-c054-4083-a931-d8467a8db250 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.336947 Aug 03 01:53:43.770077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2a200e96-6a32-4b98-b9fe-287ef05b4d65 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:53:43.770684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2a200e96-6a32-4b98-b9fe-287ef05b4d65 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:53:43.772451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2a200e96-6a32-4b98-b9fe-287ef05b4d65 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:53:43.773878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2a200e96-6a32-4b98-b9fe-287ef05b4d65 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:53:43.775004 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 830/1640] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:43 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:43.779956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-747d9570-20b7-486e-8f6d-95e064d10597 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:43.780896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-747d9570-20b7-486e-8f6d-95e064d10597 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:43.788580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a200e96-6a32-4b98-b9fe-287ef05b4d65 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:43.789171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a200e96-6a32-4b98-b9fe-287ef05b4d65 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:43.789718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-747d9570-20b7-486e-8f6d-95e064d10597 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:43.790179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a200e96-6a32-4b98-b9fe-287ef05b4d65 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:43.790714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a200e96-6a32-4b98-b9fe-287ef05b4d65 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:43.791411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-747d9570-20b7-486e-8f6d-95e064d10597 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:43.793049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-747d9570-20b7-486e-8f6d-95e064d10597 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:43.796388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-747d9570-20b7-486e-8f6d-95e064d10597 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:43.856356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-2a200e96-6a32-4b98-b9fe-287ef05b4d65 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Getting quotas for project 1768a01b5c334a8d9a378e0def798052. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:53:43.867834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-2a200e96-6a32-4b98-b9fe-287ef05b4d65 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Getting quotas for user bb9b98b1ea8c4f6c9f56e282a58b626b and project 1768a01b5c334a8d9a378e0def798052. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:53:43.904291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2a200e96-6a32-4b98-b9fe-287ef05b4d65 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:53:43.909797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2a200e96-6a32-4b98-b9fe-287ef05b4d65 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:53:43.946558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-747d9570-20b7-486e-8f6d-95e064d10597 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:43.969843 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-747d9570-20b7-486e-8f6d-95e064d10597 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1427 microversion: 2.1 time: 0.190336 Aug 03 01:53:43.971256 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 831/1641] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:43 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1427 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:43.985643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-776cff35-1ea2-4f48-9cca-06ac7302cb48 tempest-NetworksTest-1678944069 tempest-NetworksTest-1678944069-project-admin] Calling method '.version_select at 0x7f5b13620c10>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:44.029383 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2a200e96-6a32-4b98-b9fe-287ef05b4d65 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.486401 Aug 03 01:53:44.035572 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 811/1642] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 01:53:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 01:53:44.047577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e84a7ce0-5840-4c25-8f13-df0bb5c6eed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:44.048952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e84a7ce0-5840-4c25-8f13-df0bb5c6eed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:44.057266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e84a7ce0-5840-4c25-8f13-df0bb5c6eed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:44.057727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e84a7ce0-5840-4c25-8f13-df0bb5c6eed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:44.058518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e84a7ce0-5840-4c25-8f13-df0bb5c6eed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:44.059220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e84a7ce0-5840-4c25-8f13-df0bb5c6eed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:44.486438 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-776cff35-1ea2-4f48-9cca-06ac7302cb48 tempest-NetworksTest-1678944069 tempest-NetworksTest-1678944069-project-admin] 10.222.0.67 "GET /compute/v2.1/os-networks" status: 200 len: 6737 microversion: 2.1 time: 0.513489 Aug 03 01:53:44.488720 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 832/1643] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:53:43 2022] GET /compute/v2.1/os-networks => generated 6737 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:44.509795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-12f8e1c1-71df-433b-8f28-ddab0b8d07e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:44.511160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-12f8e1c1-71df-433b-8f28-ddab0b8d07e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:44.528809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-12f8e1c1-71df-433b-8f28-ddab0b8d07e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:44.531183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-12f8e1c1-71df-433b-8f28-ddab0b8d07e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:44.532641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-12f8e1c1-71df-433b-8f28-ddab0b8d07e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:44.533817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-12f8e1c1-71df-433b-8f28-ddab0b8d07e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:44.539503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e84a7ce0-5840-4c25-8f13-df0bb5c6eed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:44.556960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e84a7ce0-5840-4c25-8f13-df0bb5c6eed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:44.561794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e84a7ce0-5840-4c25-8f13-df0bb5c6eed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:44.563965 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e84a7ce0-5840-4c25-8f13-df0bb5c6eed0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.527258 Aug 03 01:53:44.569417 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 812/1644] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:44 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:44.583713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5249fdec-116e-4eec-a59c-ed9f5a789dfa tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:44.584673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5249fdec-116e-4eec-a59c-ed9f5a789dfa tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:44.694607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5249fdec-116e-4eec-a59c-ed9f5a789dfa tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:44.720221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5249fdec-116e-4eec-a59c-ed9f5a789dfa tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:44.722767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5249fdec-116e-4eec-a59c-ed9f5a789dfa tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:44.724412 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5249fdec-116e-4eec-a59c-ed9f5a789dfa tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 200 len: 1280 microversion: 2.47 time: 0.152848 Aug 03 01:53:44.726503 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 813/1645] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:44 2022] GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 1280 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:44.732307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-bf1c8b7c-15b2-46a9-aca5-af2102aaab5d req-32305485-249a-427c-a4ef-618129461a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f490eab-9c88-441e-8768-ae1e5eed8093", "name": "network-vif-deleted", "tag": "9f0663d7-6a0d-4d64-8ff5-d5196b0ca3bf"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:44.750519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bf1c8b7c-15b2-46a9-aca5-af2102aaab5d req-32305485-249a-427c-a4ef-618129461a8b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:44.751213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bf1c8b7c-15b2-46a9-aca5-af2102aaab5d req-32305485-249a-427c-a4ef-618129461a8b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:44.766500 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-bf1c8b7c-15b2-46a9-aca5-af2102aaab5d req-32305485-249a-427c-a4ef-618129461a8b service nova] Creating event network-vif-deleted:9f0663d7-6a0d-4d64-8ff5-d5196b0ca3bf for instance 9f490eab-9c88-441e-8768-ae1e5eed8093 on n-h2-826529-8 Aug 03 01:53:44.773746 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-bf1c8b7c-15b2-46a9-aca5-af2102aaab5d req-32305485-249a-427c-a4ef-618129461a8b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045076 Aug 03 01:53:44.775172 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 814/1646] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:44.800415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9666d9af-3403-4b25-9122-405674082779 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:44.800415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9666d9af-3403-4b25-9122-405674082779 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:44.800872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-12f8e1c1-71df-433b-8f28-ddab0b8d07e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:44.809465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9666d9af-3403-4b25-9122-405674082779 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:44.809942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9666d9af-3403-4b25-9122-405674082779 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:44.810771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9666d9af-3403-4b25-9122-405674082779 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:44.811324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9666d9af-3403-4b25-9122-405674082779 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:44.813978 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-12f8e1c1-71df-433b-8f28-ddab0b8d07e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1521 microversion: 2.1 time: 0.323620 Aug 03 01:53:44.815124 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 833/1647] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:44 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:44.830938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7210ac1c-47e6-4a4e-85d1-cb82cf251e3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:44.831604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7210ac1c-47e6-4a4e-85d1-cb82cf251e3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:44.840867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7210ac1c-47e6-4a4e-85d1-cb82cf251e3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:44.841318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7210ac1c-47e6-4a4e-85d1-cb82cf251e3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:44.842125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7210ac1c-47e6-4a4e-85d1-cb82cf251e3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:44.842571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7210ac1c-47e6-4a4e-85d1-cb82cf251e3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:45.162530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7210ac1c-47e6-4a4e-85d1-cb82cf251e3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:45.175279 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7210ac1c-47e6-4a4e-85d1-cb82cf251e3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1719 microversion: 2.1 time: 0.357781 Aug 03 01:53:45.176743 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 834/1648] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:44 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1719 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:45.184232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4e6b2abb-d5a2-4ac4-942e-061b5cf65e5f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:45.185678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4e6b2abb-d5a2-4ac4-942e-061b5cf65e5f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:45.193232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e6b2abb-d5a2-4ac4-942e-061b5cf65e5f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:45.194034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e6b2abb-d5a2-4ac4-942e-061b5cf65e5f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:45.195248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e6b2abb-d5a2-4ac4-942e-061b5cf65e5f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:45.196114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e6b2abb-d5a2-4ac4-942e-061b5cf65e5f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:45.250943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e6b2abb-d5a2-4ac4-942e-061b5cf65e5f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:45.251715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e6b2abb-d5a2-4ac4-942e-061b5cf65e5f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:45.252352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-4e6b2abb-d5a2-4ac4-942e-061b5cf65e5f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lazy-loading 'fault' on Instance uuid 9f490eab-9c88-441e-8768-ae1e5eed8093 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:53:45.357167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4e6b2abb-d5a2-4ac4-942e-061b5cf65e5f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:45.371830 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4e6b2abb-d5a2-4ac4-942e-061b5cf65e5f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 200 len: 1303 microversion: 2.1 time: 0.191816 Aug 03 01:53:45.373345 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 835/1649] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:45 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 1303 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:45.390300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9666d9af-3403-4b25-9122-405674082779 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:45.404356 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9666d9af-3403-4b25-9122-405674082779 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1587 microversion: 2.1 time: 0.627231 Aug 03 01:53:45.405041 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 815/1650] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:44 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1587 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:45.448367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-46994adc-b368-428d-b235-6b851e4b15bf tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:45.449315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-46994adc-b368-428d-b235-6b851e4b15bf tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:45.476832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46994adc-b368-428d-b235-6b851e4b15bf tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:45.479845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46994adc-b368-428d-b235-6b851e4b15bf tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:45.485306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46994adc-b368-428d-b235-6b851e4b15bf tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:45.489156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46994adc-b368-428d-b235-6b851e4b15bf tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:45.600169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e7411c7b-0634-418b-9225-0abc42554081 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:45.601133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e7411c7b-0634-418b-9225-0abc42554081 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:45.608349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7411c7b-0634-418b-9225-0abc42554081 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:45.609174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7411c7b-0634-418b-9225-0abc42554081 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:45.609988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7411c7b-0634-418b-9225-0abc42554081 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:45.610820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7411c7b-0634-418b-9225-0abc42554081 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:45.685165 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-46994adc-b368-428d-b235-6b851e4b15bf tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.247095 Aug 03 01:53:45.687056 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 836/1651] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 01:53:45 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b/os-interface => generated 284 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:45.757578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-517c5507-2fba-471c-b611-e9fb51fbae61 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:45.759376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-517c5507-2fba-471c-b611-e9fb51fbae61 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:45.772425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-517c5507-2fba-471c-b611-e9fb51fbae61 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:45.773560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-517c5507-2fba-471c-b611-e9fb51fbae61 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:45.776578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-517c5507-2fba-471c-b611-e9fb51fbae61 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:45.777047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-517c5507-2fba-471c-b611-e9fb51fbae61 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:45.975717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-517c5507-2fba-471c-b611-e9fb51fbae61 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:45.991904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-517c5507-2fba-471c-b611-e9fb51fbae61 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:45.998559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-517c5507-2fba-471c-b611-e9fb51fbae61 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:46.013826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e7411c7b-0634-418b-9225-0abc42554081 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:46.014643 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-517c5507-2fba-471c-b611-e9fb51fbae61 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 200 len: 1338 microversion: 2.47 time: 0.266706 Aug 03 01:53:46.018917 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 837/1652] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:45 2022] GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 1338 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:53:46.026836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e7411c7b-0634-418b-9225-0abc42554081 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:46.029599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e7411c7b-0634-418b-9225-0abc42554081 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:46.031959 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e7411c7b-0634-418b-9225-0abc42554081 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.439345 Aug 03 01:53:46.033738 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 816/1653] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:45 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:53:46.038130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dba18918-a3a6-4b09-a8c1-e44f38abd55d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:46.038863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dba18918-a3a6-4b09-a8c1-e44f38abd55d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:46.048458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dba18918-a3a6-4b09-a8c1-e44f38abd55d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:46.049000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dba18918-a3a6-4b09-a8c1-e44f38abd55d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:46.049902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dba18918-a3a6-4b09-a8c1-e44f38abd55d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:46.050442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dba18918-a3a6-4b09-a8c1-e44f38abd55d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:46.199201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-547facb5-2d88-455a-829e-db2b39b51037 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:46.199841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-547facb5-2d88-455a-829e-db2b39b51037 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:46.213384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-547facb5-2d88-455a-829e-db2b39b51037 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:46.214128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-547facb5-2d88-455a-829e-db2b39b51037 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:46.216624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-547facb5-2d88-455a-829e-db2b39b51037 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:46.217080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-547facb5-2d88-455a-829e-db2b39b51037 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:46.475392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dba18918-a3a6-4b09-a8c1-e44f38abd55d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:46.500533 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dba18918-a3a6-4b09-a8c1-e44f38abd55d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1501 microversion: 2.1 time: 0.478159 Aug 03 01:53:46.504218 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 838/1654] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:46 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1501 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:46.529748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-547facb5-2d88-455a-829e-db2b39b51037 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:46.532562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-69ef6ff6-86f0-4070-9596-7a4a2cce0395 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:46.533506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-69ef6ff6-86f0-4070-9596-7a4a2cce0395 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 9f490eab-9c88-441e-8768-ae1e5eed8093] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:46.545009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69ef6ff6-86f0-4070-9596-7a4a2cce0395 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:46.545281 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-547facb5-2d88-455a-829e-db2b39b51037 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1709 microversion: 2.1 time: 0.350385 Aug 03 01:53:46.545560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69ef6ff6-86f0-4070-9596-7a4a2cce0395 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:46.545730 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 817/1655] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:46 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1709 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:46.546688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69ef6ff6-86f0-4070-9596-7a4a2cce0395 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:46.547246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69ef6ff6-86f0-4070-9596-7a4a2cce0395 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:46.562578 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-69ef6ff6-86f0-4070-9596-7a4a2cce0395 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] HTTP exception thrown: Instance 9f490eab-9c88-441e-8768-ae1e5eed8093 could not be found. Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-69ef6ff6-86f0-4070-9596-7a4a2cce0395 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Request method failure captured: Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 HTTP/1.1 Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dPERBxqrO9R956wMTUjk9HLLpGWbtar7oeyd6fk93vdhxjMXyIjCkuKpbBRNmCOhFI6X3mQxH7GWBwAjLCmRe7vkKke_QPmbGz1nlBFV9T05D6nGZobBQUs9izvpdLHdnrMqr-_Q-zHRIBKd6zpqVuqaq8QyGElqpu65_FMQP444xs Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 6e247e7134ad41bfa92b6eff8111c86e Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-MigrationsAdminTest-1978759951 Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6e247e7134ad41bfa92b6eff8111c86e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e247e7134ad41bfa92b6eff8111c86e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6e247e7134ad41bfa92b6eff8111c86e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e247e7134ad41bfa92b6eff8111c86e"}]}] Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-MigrationsAdminTest-1978759951 Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 6e247e7134ad41bfa92b6eff8111c86e Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-MigrationsAdminTest-1978759951 Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-MigrationsAdminTest-1978759951-project Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 241ed53f42f84abc8efc7edb5f41f6ed Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-MigrationsAdminTest-1978759951-project Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 9f490eab-9c88-441e-8768-ae1e5eed8093 could not be found. Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '9f490eab-9c88-441e-8768-ae1e5eed8093'} Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f490eab-9c88-441e-8768-ae1e5eed8093 could not be found. Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f490eab-9c88-441e-8768-ae1e5eed8093 could not be found. Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:46.564475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:46.572136 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:46.572136 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:46.572136 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:46.572136 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:53:46.572136 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:53:46.572136 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f490eab-9c88-441e-8768-ae1e5eed8093 could not be found. Aug 03 01:53:46.572136 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:46.572136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-69ef6ff6-86f0-4070-9596-7a4a2cce0395 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Returning 404 to user: Instance 9f490eab-9c88-441e-8768-ae1e5eed8093 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:46.572136 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-69ef6ff6-86f0-4070-9596-7a4a2cce0395 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093" status: 404 len: 111 microversion: 2.1 time: 0.060487 Aug 03 01:53:46.572136 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 839/1656] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:46 2022] GET /compute/v2.1/servers/9f490eab-9c88-441e-8768-ae1e5eed8093 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:53:46.574151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3d612992-b832-4ac1-8421-4f97a52e0daf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:46.574151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3d612992-b832-4ac1-8421-4f97a52e0daf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:46.576715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c0b1d080-1a8f-4e8c-9a51-f44b50b6bf64 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '.version_select at 0x7f5b24423ee0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:46.579469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d612992-b832-4ac1-8421-4f97a52e0daf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:46.579469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d612992-b832-4ac1-8421-4f97a52e0daf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:46.581080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0b1d080-1a8f-4e8c-9a51-f44b50b6bf64 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:46.581288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d612992-b832-4ac1-8421-4f97a52e0daf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:46.582562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d612992-b832-4ac1-8421-4f97a52e0daf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:46.582767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0b1d080-1a8f-4e8c-9a51-f44b50b6bf64 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:46.596503 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c0b1d080-1a8f-4e8c-9a51-f44b50b6bf64 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 2709 microversion: 2.1 time: 0.023948 Aug 03 01:53:46.597675 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 840/1657] 10.222.0.67 () {58 vars in 1143 bytes} [Wed Aug 3 01:53:46 2022] GET /compute/v2.1/os-migrations => generated 2709 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:46.604666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d05dcc28-bb03-4906-b132-e64e8c38e08e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:46.605410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d05dcc28-bb03-4906-b132-e64e8c38e08e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:46.613786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d05dcc28-bb03-4906-b132-e64e8c38e08e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:46.614597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d05dcc28-bb03-4906-b132-e64e8c38e08e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:46.616624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d05dcc28-bb03-4906-b132-e64e8c38e08e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:46.617319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d05dcc28-bb03-4906-b132-e64e8c38e08e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:46.648481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d05dcc28-bb03-4906-b132-e64e8c38e08e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:53:46.764763 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d05dcc28-bb03-4906-b132-e64e8c38e08e tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 204 len: 0 microversion: 2.1 time: 0.164717 Aug 03 01:53:46.765672 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 841/1658] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:53:46 2022] DELETE /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:53:46.773540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e0c0532-d12e-4d8e-a6a1-e965092a6093 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:46.773540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3e0c0532-d12e-4d8e-a6a1-e965092a6093 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:46.780924 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e0c0532-d12e-4d8e-a6a1-e965092a6093 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:46.781509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e0c0532-d12e-4d8e-a6a1-e965092a6093 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:46.782737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e0c0532-d12e-4d8e-a6a1-e965092a6093 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:46.783292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e0c0532-d12e-4d8e-a6a1-e965092a6093 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:46.795343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3d612992-b832-4ac1-8421-4f97a52e0daf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:46.825267 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3d612992-b832-4ac1-8421-4f97a52e0daf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1514 microversion: 2.1 time: 0.264291 Aug 03 01:53:46.828465 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 818/1659] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:46 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1514 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:46.844838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1bbe0aa2-ede8-4da0-b053-42c5f5950834 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:46.846184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1bbe0aa2-ede8-4da0-b053-42c5f5950834 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:46.857883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1bbe0aa2-ede8-4da0-b053-42c5f5950834 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:46.858449 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1bbe0aa2-ede8-4da0-b053-42c5f5950834 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:46.859568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1bbe0aa2-ede8-4da0-b053-42c5f5950834 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:46.861161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1bbe0aa2-ede8-4da0-b053-42c5f5950834 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:46.956080 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e0c0532-d12e-4d8e-a6a1-e965092a6093 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1860 microversion: 2.1 time: 0.188919 Aug 03 01:53:46.958196 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 842/1660] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:46 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1860 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:46.971250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20f7876c-64fb-41ec-8e1b-aa122a66977f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:46.978352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-20f7876c-64fb-41ec-8e1b-aa122a66977f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: b9c1efa1-b102-4d91-add5-f4b7a4ad4ef7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:46.986020 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-20f7876c-64fb-41ec-8e1b-aa122a66977f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] HTTP exception thrown: Instance b9c1efa1-b102-4d91-add5-f4b7a4ad4ef7 could not be found. Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20f7876c-64fb-41ec-8e1b-aa122a66977f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Request method failure captured: Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/b9c1efa1-b102-4d91-add5-f4b7a4ad4ef7/action HTTP/1.1 Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 14 Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dTll7VklSXVKPY7IA1_5ob-tKVm2Z_7z42qGXzDSvTdwVAzc-uu26I_RdtLVhoAwHCuPbYMUDNABwS67wYISa8yagl02RQzcDUh0SQ8u7p5lboe4i0RQPeTExpnFXWWBwbJADXBFZ5wGYauWv3NNIL4oxW8HVYZDtaGv8yUqCCibqo Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c183e2fc6dbb419fbd8fa81c90163adf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}] Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0b99d344c16b4221bcccfe37d32bb69e Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: {"rescue": {}} Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance b9c1efa1-b102-4d91-add5-f4b7a4ad4ef7 could not be found. Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'b9c1efa1-b102-4d91-add5-f4b7a4ad4ef7', 'body': {'rescue': {}}} Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9c1efa1-b102-4d91-add5-f4b7a4ad4ef7 could not be found. Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9c1efa1-b102-4d91-add5-f4b7a4ad4ef7 could not be found. Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:46.988527 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:46.996198 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:46.996198 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:46.996198 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:53:46.996198 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:53:46.996198 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9c1efa1-b102-4d91-add5-f4b7a4ad4ef7 could not be found. Aug 03 01:53:46.996198 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:46.998510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20f7876c-64fb-41ec-8e1b-aa122a66977f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Returning 404 to user: Instance b9c1efa1-b102-4d91-add5-f4b7a4ad4ef7 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:46.999676 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-20f7876c-64fb-41ec-8e1b-aa122a66977f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers/b9c1efa1-b102-4d91-add5-f4b7a4ad4ef7/action" status: 404 len: 111 microversion: 2.1 time: 0.037352 Aug 03 01:53:47.000485 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 843/1661] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:53:46 2022] POST /compute/v2.1/servers/b9c1efa1-b102-4d91-add5-f4b7a4ad4ef7/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:53:47.006212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-912b24a9-79fb-4df8-93ef-5864fe3555aa tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:47.007389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-912b24a9-79fb-4df8-93ef-5864fe3555aa tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:47.010792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:47.016076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-912b24a9-79fb-4df8-93ef-5864fe3555aa tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:47.016443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-912b24a9-79fb-4df8-93ef-5864fe3555aa tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:47.017306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-912b24a9-79fb-4df8-93ef-5864fe3555aa tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:47.017972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-912b24a9-79fb-4df8-93ef-5864fe3555aa tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:47.123056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1bbe0aa2-ede8-4da0-b053-42c5f5950834 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:47.136416 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1bbe0aa2-ede8-4da0-b053-42c5f5950834 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1467 microversion: 2.1 time: 0.305867 Aug 03 01:53:47.139224 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 819/1662] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:46 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1467 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:47.149883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d63b697c-4a6a-4144-8d0a-2c98dadc9377 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:47.150714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d63b697c-4a6a-4144-8d0a-2c98dadc9377 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:47.159979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d63b697c-4a6a-4144-8d0a-2c98dadc9377 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:47.160865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d63b697c-4a6a-4144-8d0a-2c98dadc9377 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:47.162259 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d63b697c-4a6a-4144-8d0a-2c98dadc9377 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:47.163014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d63b697c-4a6a-4144-8d0a-2c98dadc9377 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:47.259271 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-912b24a9-79fb-4df8-93ef-5864fe3555aa tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1860 microversion: 2.1 time: 0.257307 Aug 03 01:53:47.260493 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 844/1663] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:47 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1860 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:47.265568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e3c099d3-3c80-4ac2-af5c-5e022a85ec8b tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:47.266185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e3c099d3-3c80-4ac2-af5c-5e022a85ec8b tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:47.273974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3c099d3-3c80-4ac2-af5c-5e022a85ec8b tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:47.274435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3c099d3-3c80-4ac2-af5c-5e022a85ec8b tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:47.275259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3c099d3-3c80-4ac2-af5c-5e022a85ec8b tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:47.275972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3c099d3-3c80-4ac2-af5c-5e022a85ec8b tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:47.301902 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d63b697c-4a6a-4144-8d0a-2c98dadc9377 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92/action" status: 202 len: 0 microversion: 2.1 time: 0.160910 Aug 03 01:53:47.304117 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 820/1664] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:53:47 2022] POST /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:53:47.322712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f893aa78-2b4f-48c7-a12d-0a54c300d705 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:47.324858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f893aa78-2b4f-48c7-a12d-0a54c300d705 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:47.336475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f893aa78-2b4f-48c7-a12d-0a54c300d705 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:47.337450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f893aa78-2b4f-48c7-a12d-0a54c300d705 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:47.338556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f893aa78-2b4f-48c7-a12d-0a54c300d705 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:47.339837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f893aa78-2b4f-48c7-a12d-0a54c300d705 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:47.383836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3c099d3-3c80-4ac2-af5c-5e022a85ec8b tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:47.401615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3c099d3-3c80-4ac2-af5c-5e022a85ec8b tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:47.408750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3c099d3-3c80-4ac2-af5c-5e022a85ec8b tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:47.409317 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e3c099d3-3c80-4ac2-af5c-5e022a85ec8b tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 200 len: 1338 microversion: 2.47 time: 0.147259 Aug 03 01:53:47.415967 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 845/1665] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:47 2022] GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 1338 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:47.432307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6b22b51a-fe47-46e7-a4e7-4b1acd9e61ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:47.434277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6b22b51a-fe47-46e7-a4e7-4b1acd9e61ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:47.452431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b22b51a-fe47-46e7-a4e7-4b1acd9e61ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:47.454564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b22b51a-fe47-46e7-a4e7-4b1acd9e61ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:47.458278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b22b51a-fe47-46e7-a4e7-4b1acd9e61ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:47.460406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b22b51a-fe47-46e7-a4e7-4b1acd9e61ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:47.655419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f893aa78-2b4f-48c7-a12d-0a54c300d705 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:47.668594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f893aa78-2b4f-48c7-a12d-0a54c300d705 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:47.670117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f893aa78-2b4f-48c7-a12d-0a54c300d705 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:47.671331 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f893aa78-2b4f-48c7-a12d-0a54c300d705 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.365740 Aug 03 01:53:47.672550 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 821/1666] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:47 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:47.684990 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bf52fc14-8eb8-4c02-8df0-3c013ae73246 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:47.686650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bf52fc14-8eb8-4c02-8df0-3c013ae73246 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:47.694631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf52fc14-8eb8-4c02-8df0-3c013ae73246 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:47.695453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf52fc14-8eb8-4c02-8df0-3c013ae73246 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:47.696494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf52fc14-8eb8-4c02-8df0-3c013ae73246 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:47.697133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf52fc14-8eb8-4c02-8df0-3c013ae73246 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:47.738182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6b22b51a-fe47-46e7-a4e7-4b1acd9e61ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:47.746467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:47.749010 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6b22b51a-fe47-46e7-a4e7-4b1acd9e61ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1519 microversion: 2.1 time: 0.329112 Aug 03 01:53:47.750083 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 846/1667] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:47 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1519 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:47.756262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3c0dec4a-22ea-4398-b659-a6059b0c2b62 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:47.756897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3c0dec4a-22ea-4398-b659-a6059b0c2b62 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:47.767084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3c0dec4a-22ea-4398-b659-a6059b0c2b62 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:47.767084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3c0dec4a-22ea-4398-b659-a6059b0c2b62 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:47.767084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3c0dec4a-22ea-4398-b659-a6059b0c2b62 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:47.767084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3c0dec4a-22ea-4398-b659-a6059b0c2b62 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:47.910645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-bf52fc14-8eb8-4c02-8df0-3c013ae73246 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lazy-loading 'services' on Instance uuid be0bf271-225a-4ad9-baf8-c7dad07593c7 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:53:47.994857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3c0dec4a-22ea-4398-b659-a6059b0c2b62 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:48.003274 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3c0dec4a-22ea-4398-b659-a6059b0c2b62 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1587 microversion: 2.1 time: 0.251678 Aug 03 01:53:48.019335 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 847/1668] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:47 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1587 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:48.032845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-774c129a-a2de-49cb-b057-376b1151d4cc req-640c7e75-6c4e-4ecb-97dd-5fe840f69e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff067a14-b579-4fcf-8a28-291d9c7a0f2b", "tag": "fc62d70a-5703-41fb-b29d-ab8369f459c2"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:48.053766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-774c129a-a2de-49cb-b057-376b1151d4cc req-640c7e75-6c4e-4ecb-97dd-5fe840f69e7e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:48.057848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-774c129a-a2de-49cb-b057-376b1151d4cc req-640c7e75-6c4e-4ecb-97dd-5fe840f69e7e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:48.072772 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-774c129a-a2de-49cb-b057-376b1151d4cc req-640c7e75-6c4e-4ecb-97dd-5fe840f69e7e service nova] Creating event network-changed:fc62d70a-5703-41fb-b29d-ab8369f459c2 for instance ff067a14-b579-4fcf-8a28-291d9c7a0f2b on n-h2-826529-8 Aug 03 01:53:48.079440 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-774c129a-a2de-49cb-b057-376b1151d4cc req-640c7e75-6c4e-4ecb-97dd-5fe840f69e7e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058387 Aug 03 01:53:48.080954 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 848/1669] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:48.146996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:48.163162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4602e706-d49e-43bd-acda-65897f58d070 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:48.165401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4602e706-d49e-43bd-acda-65897f58d070 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:48.168454 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bf52fc14-8eb8-4c02-8df0-3c013ae73246 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "DELETE /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments/3c4ce6d6-5dc0-43c0-8686-9df5cff6aca9" status: 202 len: 0 microversion: 2.1 time: 0.486657 Aug 03 01:53:48.174096 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 822/1670] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 01:53:47 2022] DELETE /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments/3c4ce6d6-5dc0-43c0-8686-9df5cff6aca9 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:53:48.184704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9282d889-a34c-4eb4-8ef8-e831b05d90f0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:48.194468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9282d889-a34c-4eb4-8ef8-e831b05d90f0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:48.202093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4602e706-d49e-43bd-acda-65897f58d070 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:48.203358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4602e706-d49e-43bd-acda-65897f58d070 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:48.203759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9282d889-a34c-4eb4-8ef8-e831b05d90f0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:48.204402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9282d889-a34c-4eb4-8ef8-e831b05d90f0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:48.204866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4602e706-d49e-43bd-acda-65897f58d070 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:48.205310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4602e706-d49e-43bd-acda-65897f58d070 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:48.205881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9282d889-a34c-4eb4-8ef8-e831b05d90f0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:48.206490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9282d889-a34c-4eb4-8ef8-e831b05d90f0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:48.338155 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9282d889-a34c-4eb4-8ef8-e831b05d90f0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161803 Aug 03 01:53:48.342007 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 823/1671] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 01:53:48 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:48.443507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e011224a-f4c2-4745-adad-d76464ad2e11 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:48.444267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e011224a-f4c2-4745-adad-d76464ad2e11 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:48.454487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e011224a-f4c2-4745-adad-d76464ad2e11 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:48.454962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e011224a-f4c2-4745-adad-d76464ad2e11 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:48.455763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e011224a-f4c2-4745-adad-d76464ad2e11 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:48.456198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e011224a-f4c2-4745-adad-d76464ad2e11 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:48.531173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4602e706-d49e-43bd-acda-65897f58d070 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:48.540035 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4602e706-d49e-43bd-acda-65897f58d070 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1467 microversion: 2.1 time: 0.383324 Aug 03 01:53:48.552425 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 849/1672] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:48 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1467 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:48.660564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e011224a-f4c2-4745-adad-d76464ad2e11 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:48.670505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e011224a-f4c2-4745-adad-d76464ad2e11 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:48.672280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e011224a-f4c2-4745-adad-d76464ad2e11 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:48.673528 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e011224a-f4c2-4745-adad-d76464ad2e11 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 200 len: 1338 microversion: 2.47 time: 0.234573 Aug 03 01:53:48.674406 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 824/1673] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:48 2022] GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 1338 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:48.704048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-def0dc65-4561-412a-9af9-b60cb950ee1d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:48.705003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-def0dc65-4561-412a-9af9-b60cb950ee1d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:48.716189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-def0dc65-4561-412a-9af9-b60cb950ee1d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:48.718349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-def0dc65-4561-412a-9af9-b60cb950ee1d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:48.723490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-def0dc65-4561-412a-9af9-b60cb950ee1d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:48.724069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-def0dc65-4561-412a-9af9-b60cb950ee1d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:48.776468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-00dcc75b-0729-44ae-9e91-7dbcb2067b57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:48.777118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-00dcc75b-0729-44ae-9e91-7dbcb2067b57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:48.785520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00dcc75b-0729-44ae-9e91-7dbcb2067b57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:48.785999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00dcc75b-0729-44ae-9e91-7dbcb2067b57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:48.788026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00dcc75b-0729-44ae-9e91-7dbcb2067b57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:48.788546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00dcc75b-0729-44ae-9e91-7dbcb2067b57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:49.222891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-def0dc65-4561-412a-9af9-b60cb950ee1d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:49.245517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-def0dc65-4561-412a-9af9-b60cb950ee1d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:49.248868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-def0dc65-4561-412a-9af9-b60cb950ee1d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:49.250424 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-def0dc65-4561-412a-9af9-b60cb950ee1d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.553529 Aug 03 01:53:49.251781 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 850/1674] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:48 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:49.351259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f5c1df9c-4e74-476b-ac4c-fbc69771abda tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:49.355532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f5c1df9c-4e74-476b-ac4c-fbc69771abda tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:49.369316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5c1df9c-4e74-476b-ac4c-fbc69771abda tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:49.370135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5c1df9c-4e74-476b-ac4c-fbc69771abda tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:49.372069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5c1df9c-4e74-476b-ac4c-fbc69771abda tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:49.373217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5c1df9c-4e74-476b-ac4c-fbc69771abda tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:49.468582 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f5c1df9c-4e74-476b-ac4c-fbc69771abda tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122418 Aug 03 01:53:49.470059 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 851/1675] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 01:53:49 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:49.477125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-00dcc75b-0729-44ae-9e91-7dbcb2067b57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:49.489053 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-00dcc75b-0729-44ae-9e91-7dbcb2067b57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1519 microversion: 2.1 time: 0.718176 Aug 03 01:53:49.492135 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 825/1676] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:48 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1519 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:53:49.561448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fe4e9ba3-a9c6-4b92-99f4-205221ccf77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:49.563155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fe4e9ba3-a9c6-4b92-99f4-205221ccf77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:49.572962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe4e9ba3-a9c6-4b92-99f4-205221ccf77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:49.573564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe4e9ba3-a9c6-4b92-99f4-205221ccf77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:49.574424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe4e9ba3-a9c6-4b92-99f4-205221ccf77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:49.574939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe4e9ba3-a9c6-4b92-99f4-205221ccf77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:49.716962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1e54fe15-15ab-41de-8ccb-de7f0c338223 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:49.717587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1e54fe15-15ab-41de-8ccb-de7f0c338223 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:49.750464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e54fe15-15ab-41de-8ccb-de7f0c338223 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:49.751355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e54fe15-15ab-41de-8ccb-de7f0c338223 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:49.752345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e54fe15-15ab-41de-8ccb-de7f0c338223 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:49.752954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e54fe15-15ab-41de-8ccb-de7f0c338223 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:49.841291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1e54fe15-15ab-41de-8ccb-de7f0c338223 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:49.843505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fe4e9ba3-a9c6-4b92-99f4-205221ccf77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:49.853651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1e54fe15-15ab-41de-8ccb-de7f0c338223 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:49.854640 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fe4e9ba3-a9c6-4b92-99f4-205221ccf77f tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1467 microversion: 2.1 time: 0.297253 Aug 03 01:53:49.867423 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 852/1677] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:49 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1467 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:53:49.868190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1e54fe15-15ab-41de-8ccb-de7f0c338223 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:49.868190 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1e54fe15-15ab-41de-8ccb-de7f0c338223 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 200 len: 1338 microversion: 2.47 time: 0.144914 Aug 03 01:53:49.868190 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 826/1678] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:49 2022] GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 1338 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:50.001601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-50019036-5f41-4e26-b3d1-7fb080f7f08f tempest-QuotaClassesAdmin257Test-260704003 tempest-QuotaClassesAdmin257Test-260704003-project-admin] Calling method '.version_select at 0x7f5b244b3af0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:50.003649 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:53:50.003649 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:53:50.027485 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-50019036-5f41-4e26-b3d1-7fb080f7f08f tempest-QuotaClassesAdmin257Test-260704003 tempest-QuotaClassesAdmin257Test-260704003-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.169816 Aug 03 01:53:50.027485 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 853/1679] 10.222.0.67 () {60 vars in 1226 bytes} [Wed Aug 3 01:53:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:53:50.038721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4a3bb25b-7bd7-4f61-8eb6-8a6131aa7236 tempest-QuotaClassesAdmin257Test-260704003 tempest-QuotaClassesAdmin257Test-260704003-project-admin] Action: 'update', calling method: .version_select at 0x7f5b130394c0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:50.042231 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:53:50.042231 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:53:50.281773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ecc64de4-9c96-4de5-b69c-b872f67d5eda tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:50.282402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ecc64de4-9c96-4de5-b69c-b872f67d5eda tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:50.300268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecc64de4-9c96-4de5-b69c-b872f67d5eda tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:50.301585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecc64de4-9c96-4de5-b69c-b872f67d5eda tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:50.303938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecc64de4-9c96-4de5-b69c-b872f67d5eda tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:50.305361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecc64de4-9c96-4de5-b69c-b872f67d5eda tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:50.374666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9,nova_api:UPDATE=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:50.445028 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4a3bb25b-7bd7-4f61-8eb6-8a6131aa7236 tempest-QuotaClassesAdmin257Test-260704003 tempest-QuotaClassesAdmin257Test-260704003-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.411234 Aug 03 01:53:50.446007 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 827/1680] 10.222.0.67 () {62 vars in 1247 bytes} [Wed Aug 3 01:53:50 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:53:50.457859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6b9ce555-cbb8-4784-a7dc-50c8021a1e0d tempest-QuotaClassesAdmin257Test-260704003 tempest-QuotaClassesAdmin257Test-260704003-project-admin] Calling method '.version_select at 0x7f5b245c4670>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:50.461603 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:53:50.461603 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:53:50.482671 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6b9ce555-cbb8-4784-a7dc-50c8021a1e0d tempest-QuotaClassesAdmin257Test-260704003 tempest-QuotaClassesAdmin257Test-260704003-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.029519 Aug 03 01:53:50.489076 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 828/1681] 10.222.0.67 () {60 vars in 1226 bytes} [Wed Aug 3 01:53:50 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 01:53:50.498411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-98f9227f-5707-4222-9b57-e225572e2ded tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:50.501920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-98f9227f-5707-4222-9b57-e225572e2ded tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:50.512983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98f9227f-5707-4222-9b57-e225572e2ded tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:50.514042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98f9227f-5707-4222-9b57-e225572e2ded tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:50.515514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98f9227f-5707-4222-9b57-e225572e2ded tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:50.516448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98f9227f-5707-4222-9b57-e225572e2ded tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:50.530370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ecc64de4-9c96-4de5-b69c-b872f67d5eda tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:50.553211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ecc64de4-9c96-4de5-b69c-b872f67d5eda tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:50.556662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ecc64de4-9c96-4de5-b69c-b872f67d5eda tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:50.559129 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ecc64de4-9c96-4de5-b69c-b872f67d5eda tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.283490 Aug 03 01:53:50.560076 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 854/1682] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:50 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:50.578602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-45749ade-e4e1-42a2-9b43-704849da5b6f tempest-QuotaClassesAdmin257Test-260704003 tempest-QuotaClassesAdmin257Test-260704003-project-admin] Action: 'update', calling method: .version_select at 0x7f5b12a2cdc0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:50.587993 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-98f9227f-5707-4222-9b57-e225572e2ded tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095939 Aug 03 01:53:50.588509 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:53:50.588509 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:53:50.596253 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 829/1683] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 01:53:50 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:50.611731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1d11585b-c1ae-412d-914b-084dd48b4aed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:50.618745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1d11585b-c1ae-412d-914b-084dd48b4aed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:50.642445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d11585b-c1ae-412d-914b-084dd48b4aed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:50.643060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d11585b-c1ae-412d-914b-084dd48b4aed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:50.643977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d11585b-c1ae-412d-914b-084dd48b4aed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:50.647267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d11585b-c1ae-412d-914b-084dd48b4aed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:50.730127 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-45749ade-e4e1-42a2-9b43-704849da5b6f tempest-QuotaClassesAdmin257Test-260704003 tempest-QuotaClassesAdmin257Test-260704003-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.168845 Aug 03 01:53:50.732927 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 855/1684] 10.222.0.67 () {62 vars in 1247 bytes} [Wed Aug 3 01:53:50 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:53:50.881661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fdf75484-c901-459c-bfd9-b325917a3c4d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:50.882366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fdf75484-c901-459c-bfd9-b325917a3c4d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:50.906862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fdf75484-c901-459c-bfd9-b325917a3c4d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:50.907585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fdf75484-c901-459c-bfd9-b325917a3c4d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:50.908522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fdf75484-c901-459c-bfd9-b325917a3c4d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:50.909036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fdf75484-c901-459c-bfd9-b325917a3c4d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:51.544181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fdf75484-c901-459c-bfd9-b325917a3c4d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241ed53f42f84abc8efc7edb5f41f6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e247e7134ad41bfa92b6eff8111c86e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:51.568914 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fdf75484-c901-459c-bfd9-b325917a3c4d tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 200 len: 1425 microversion: 2.1 time: 0.691606 Aug 03 01:53:51.569980 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 856/1685] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:50 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 1425 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:53:51.602677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-33f2d603-6b23-4202-bcd6-28c44a3b9ad6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:51.603875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-33f2d603-6b23-4202-bcd6-28c44a3b9ad6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:51.623642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-33f2d603-6b23-4202-bcd6-28c44a3b9ad6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:51.623954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-33f2d603-6b23-4202-bcd6-28c44a3b9ad6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:51.630836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-33f2d603-6b23-4202-bcd6-28c44a3b9ad6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:51.638487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-33f2d603-6b23-4202-bcd6-28c44a3b9ad6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:51.718199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1d11585b-c1ae-412d-914b-084dd48b4aed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:51.782358 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1d11585b-c1ae-412d-914b-084dd48b4aed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1499 microversion: 2.1 time: 1.182404 Aug 03 01:53:51.805659 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 830/1686] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:50 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1499 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:51.847879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d9a0699c-56ec-429f-a3a0-e3deaabf21fe req-a9db63c6-80b4-4d2e-a8af-90b2217ca6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dacc86a-058f-479b-b490-1866c660048b", "name": "network-vif-deleted", "tag": "088945bb-f722-4c0a-8dfe-6f40991b1450"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:51.894025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d9a0699c-56ec-429f-a3a0-e3deaabf21fe req-a9db63c6-80b4-4d2e-a8af-90b2217ca6e9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:51.906522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d9a0699c-56ec-429f-a3a0-e3deaabf21fe req-a9db63c6-80b4-4d2e-a8af-90b2217ca6e9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:51.949972 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d9a0699c-56ec-429f-a3a0-e3deaabf21fe req-a9db63c6-80b4-4d2e-a8af-90b2217ca6e9 service nova] Creating event network-vif-deleted:088945bb-f722-4c0a-8dfe-6f40991b1450 for instance 7dacc86a-058f-479b-b490-1866c660048b on n-h1-826529-8 Aug 03 01:53:51.972722 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d9a0699c-56ec-429f-a3a0-e3deaabf21fe req-a9db63c6-80b4-4d2e-a8af-90b2217ca6e9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156743 Aug 03 01:53:51.974838 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 831/1687] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:51.995227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-33f2d603-6b23-4202-bcd6-28c44a3b9ad6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:52.004432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8e148408-601f-45f5-b112-6a7574c7a0fb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:52.008378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8e148408-601f-45f5-b112-6a7574c7a0fb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:52.011545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-33f2d603-6b23-4202-bcd6-28c44a3b9ad6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:52.018251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-33f2d603-6b23-4202-bcd6-28c44a3b9ad6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:52.022369 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-33f2d603-6b23-4202-bcd6-28c44a3b9ad6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 200 len: 1359 microversion: 2.47 time: 0.450987 Aug 03 01:53:52.035165 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 857/1688] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:51 2022] GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 1359 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:52.045441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ff125270-8a6e-4c9f-9d16-7dd53ae48aac tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:52.053904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ff125270-8a6e-4c9f-9d16-7dd53ae48aac tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:52.074669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e148408-601f-45f5-b112-6a7574c7a0fb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.075152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e148408-601f-45f5-b112-6a7574c7a0fb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.075961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff125270-8a6e-4c9f-9d16-7dd53ae48aac tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.076546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff125270-8a6e-4c9f-9d16-7dd53ae48aac tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.077374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff125270-8a6e-4c9f-9d16-7dd53ae48aac tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.079024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff125270-8a6e-4c9f-9d16-7dd53ae48aac tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.090824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e148408-601f-45f5-b112-6a7574c7a0fb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.091434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e148408-601f-45f5-b112-6a7574c7a0fb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.146624 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ff125270-8a6e-4c9f-9d16-7dd53ae48aac tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118691 Aug 03 01:53:52.148051 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 858/1689] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 01:53:52 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:52.170352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4734766c-73bc-4181-af5c-96cc346f1224 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:52.179098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4734766c-73bc-4181-af5c-96cc346f1224 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:52.197759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4734766c-73bc-4181-af5c-96cc346f1224 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.199429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4734766c-73bc-4181-af5c-96cc346f1224 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.202204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4734766c-73bc-4181-af5c-96cc346f1224 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.204559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4734766c-73bc-4181-af5c-96cc346f1224 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.258368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-4734766c-73bc-4181-af5c-96cc346f1224 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lazy-loading 'flavor' on Instance uuid c8397a8e-08c7-4844-90eb-80949ac27e92 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:53:52.296644 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-4734766c-73bc-4181-af5c-96cc346f1224 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] HTTP exception thrown: Cannot 'rescue' instance c8397a8e-08c7-4844-90eb-80949ac27e92 while it is in vm_state paused Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4734766c-73bc-4181-af5c-96cc346f1224 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Request method failure captured: Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92/action HTTP/1.1 Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 14 Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dTll7VklSXVKPY7IA1_5ob-tKVm2Z_7z42qGXzDSvTdwVAzc-uu26I_RdtLVhoAwHCuPbYMUDNABwS67wYISa8yagl02RQzcDUh0SQ8u7p5lboe4i0RQPeTExpnFXWWBwbJADXBFZ5wGYauWv3NNIL4oxW8HVYZDtaGv8yUqCCibqo Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c183e2fc6dbb419fbd8fa81c90163adf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}] Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0b99d344c16b4221bcccfe37d32bb69e Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: {"rescue": {}} Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: exception: Cannot 'rescue' instance c8397a8e-08c7-4844-90eb-80949ac27e92 while it is in vm_state paused Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'c8397a8e-08c7-4844-90eb-80949ac27e92', 'body': {'rescue': {}}} Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c8397a8e-08c7-4844-90eb-80949ac27e92 in vm_state paused. Cannot rescue while the instance is in this state. Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance c8397a8e-08c7-4844-90eb-80949ac27e92 while it is in vm_state paused Aug 03 01:53:52.299701 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:52.305907 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:52.305907 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:52.305907 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:52.305907 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:52.305907 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:52.305907 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:53:52.305907 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:53:52.305907 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance c8397a8e-08c7-4844-90eb-80949ac27e92 while it is in vm_state paused Aug 03 01:53:52.305907 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:53:52.311809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4734766c-73bc-4181-af5c-96cc346f1224 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Returning 409 to user: Cannot 'rescue' instance c8397a8e-08c7-4844-90eb-80949ac27e92 while it is in vm_state paused {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:52.312955 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4734766c-73bc-4181-af5c-96cc346f1224 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92/action" status: 409 len: 144 microversion: 2.1 time: 0.163655 Aug 03 01:53:52.315570 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 859/1690] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:53:52 2022] POST /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92/action => generated 144 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:53:52.325728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1343df60-94a2-4c53-883b-60f5af18e9c6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1326222454"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:52.332570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1343df60-94a2-4c53-883b-60f5af18e9c6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:52.342866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1343df60-94a2-4c53-883b-60f5af18e9c6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.343611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1343df60-94a2-4c53-883b-60f5af18e9c6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.345253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1343df60-94a2-4c53-883b-60f5af18e9c6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.345920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1343df60-94a2-4c53-883b-60f5af18e9c6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.461955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8e148408-601f-45f5-b112-6a7574c7a0fb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:52.480722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8e148408-601f-45f5-b112-6a7574c7a0fb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:52.486792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8e148408-601f-45f5-b112-6a7574c7a0fb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:52.488327 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8e148408-601f-45f5-b112-6a7574c7a0fb tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.508136 Aug 03 01:53:52.504360 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 832/1691] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:51 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:52.511128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-202a3b8f-2a8a-42cd-8e4e-656950e1036f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:52.511128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-202a3b8f-2a8a-42cd-8e4e-656950e1036f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:52.526532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-202a3b8f-2a8a-42cd-8e4e-656950e1036f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.529231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-202a3b8f-2a8a-42cd-8e4e-656950e1036f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.530388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-202a3b8f-2a8a-42cd-8e4e-656950e1036f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.531962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-202a3b8f-2a8a-42cd-8e4e-656950e1036f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.722591 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-202a3b8f-2a8a-42cd-8e4e-656950e1036f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92/action" status: 202 len: 0 microversion: 2.1 time: 0.226448 Aug 03 01:53:52.723750 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 833/1692] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:53:52 2022] POST /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:53:52.732293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-769db6e2-01cb-45f2-8907-6ad3e38b0a55 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:52.733622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-769db6e2-01cb-45f2-8907-6ad3e38b0a55 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] [instance: 7dacc86a-058f-479b-b490-1866c660048b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:52.753493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-769db6e2-01cb-45f2-8907-6ad3e38b0a55 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.754331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-769db6e2-01cb-45f2-8907-6ad3e38b0a55 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.756181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-769db6e2-01cb-45f2-8907-6ad3e38b0a55 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.756916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-769db6e2-01cb-45f2-8907-6ad3e38b0a55 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.776432 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-769db6e2-01cb-45f2-8907-6ad3e38b0a55 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] HTTP exception thrown: Instance 7dacc86a-058f-479b-b490-1866c660048b could not be found. Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-769db6e2-01cb-45f2-8907-6ad3e38b0a55 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Request method failure captured: Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b HTTP/1.1 Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dPERBxqrO9R956wMTUjk9HLLpGWbtar7oeyd6fk93vdhxjMXyIjCkuKpbBRNmCOhFI6X3mQxH7GWBwAjLCmRe7vkKke_QPmbGz1nlBFV9T05D6nGZobBQUs9izvpdLHdnrMqr-_Q-zHRIBKd6zpqVuqaq8QyGElqpu65_FMQP444xs Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 6e247e7134ad41bfa92b6eff8111c86e Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-MigrationsAdminTest-1978759951 Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6e247e7134ad41bfa92b6eff8111c86e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e247e7134ad41bfa92b6eff8111c86e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6e247e7134ad41bfa92b6eff8111c86e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e247e7134ad41bfa92b6eff8111c86e"}]}] Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-MigrationsAdminTest-1978759951 Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 6e247e7134ad41bfa92b6eff8111c86e Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-MigrationsAdminTest-1978759951 Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-MigrationsAdminTest-1978759951-project Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 241ed53f42f84abc8efc7edb5f41f6ed Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-MigrationsAdminTest-1978759951-project Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 7dacc86a-058f-479b-b490-1866c660048b could not be found. Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '7dacc86a-058f-479b-b490-1866c660048b'} Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dacc86a-058f-479b-b490-1866c660048b could not be found. Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dacc86a-058f-479b-b490-1866c660048b could not be found. Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:53:52.778887 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:52.783383 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:53:52.783383 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:53:52.783383 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:53:52.783383 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:53:52.783383 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:53:52.783383 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dacc86a-058f-479b-b490-1866c660048b could not be found. Aug 03 01:53:52.783383 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:53:52.786035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-769db6e2-01cb-45f2-8907-6ad3e38b0a55 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] Returning 404 to user: Instance 7dacc86a-058f-479b-b490-1866c660048b could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:53:52.789662 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-769db6e2-01cb-45f2-8907-6ad3e38b0a55 tempest-MigrationsAdminTest-1978759951 tempest-MigrationsAdminTest-1978759951-project] 10.222.0.67 "GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b" status: 404 len: 111 microversion: 2.1 time: 0.063490 Aug 03 01:53:52.793852 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 834/1693] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:52 2022] GET /compute/v2.1/servers/7dacc86a-058f-479b-b490-1866c660048b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:53:52.800827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a48d5ec2-4a8d-4ac1-a06a-b9e8dce80c4d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:52.801736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a48d5ec2-4a8d-4ac1-a06a-b9e8dce80c4d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:52.812708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a48d5ec2-4a8d-4ac1-a06a-b9e8dce80c4d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.813903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a48d5ec2-4a8d-4ac1-a06a-b9e8dce80c4d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.816033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a48d5ec2-4a8d-4ac1-a06a-b9e8dce80c4d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.816528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a48d5ec2-4a8d-4ac1-a06a-b9e8dce80c4d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.846264 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1343df60-94a2-4c53-883b-60f5af18e9c6 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "POST /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109/action" status: 202 len: 52 microversion: 2.47 time: 0.527513 Aug 03 01:53:52.848243 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 860/1694] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 3 01:53:52 2022] POST /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109/action => generated 52 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 03 01:53:52.865475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4b14ceaa-a108-4b03-a197-41443b890c8f tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:52.867208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4b14ceaa-a108-4b03-a197-41443b890c8f tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:52.886547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b14ceaa-a108-4b03-a197-41443b890c8f tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.888581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b14ceaa-a108-4b03-a197-41443b890c8f tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.891179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b14ceaa-a108-4b03-a197-41443b890c8f tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:52.891828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b14ceaa-a108-4b03-a197-41443b890c8f tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:52.957166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4b14ceaa-a108-4b03-a197-41443b890c8f tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:53:52.983210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a48d5ec2-4a8d-4ac1-a06a-b9e8dce80c4d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:52.997171 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a48d5ec2-4a8d-4ac1-a06a-b9e8dce80c4d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1506 microversion: 2.1 time: 0.201856 Aug 03 01:53:52.998048 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 835/1695] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:52 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:53.088980 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4b14ceaa-a108-4b03-a197-41443b890c8f tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "DELETE /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 204 len: 0 microversion: 2.47 time: 0.232836 Aug 03 01:53:53.089811 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 861/1696] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 01:53:52 2022] DELETE /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:53:53.099980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c328726f-f6df-432c-a918-5f5bea1174d8 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:53.102353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c328726f-f6df-432c-a918-5f5bea1174d8 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:53.117021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c328726f-f6df-432c-a918-5f5bea1174d8 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:53.117622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c328726f-f6df-432c-a918-5f5bea1174d8 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:53.118568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c328726f-f6df-432c-a918-5f5bea1174d8 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:53.119045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c328726f-f6df-432c-a918-5f5bea1174d8 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:53.160233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-653a413f-858b-4755-8b49-82544999182c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:53.162853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-653a413f-858b-4755-8b49-82544999182c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:53.177580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-653a413f-858b-4755-8b49-82544999182c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:53.178044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-653a413f-858b-4755-8b49-82544999182c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:53.178841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-653a413f-858b-4755-8b49-82544999182c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:53.187757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-653a413f-858b-4755-8b49-82544999182c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:53.261486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c328726f-f6df-432c-a918-5f5bea1174d8 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:53.276011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c328726f-f6df-432c-a918-5f5bea1174d8 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:53.279716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c328726f-f6df-432c-a918-5f5bea1174d8 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:53.285293 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c328726f-f6df-432c-a918-5f5bea1174d8 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 200 len: 1365 microversion: 2.47 time: 0.188330 Aug 03 01:53:53.287012 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 836/1697] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:53 2022] GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:53.287248 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-653a413f-858b-4755-8b49-82544999182c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129586 Aug 03 01:53:53.288224 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 862/1698] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 01:53:53 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:53:53.518936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-56397c03-6b18-4142-8204-9ad2d64a3851 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:53.519885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-56397c03-6b18-4142-8204-9ad2d64a3851 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:53.534884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56397c03-6b18-4142-8204-9ad2d64a3851 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:53.538150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56397c03-6b18-4142-8204-9ad2d64a3851 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:53.541254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56397c03-6b18-4142-8204-9ad2d64a3851 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:53.544686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56397c03-6b18-4142-8204-9ad2d64a3851 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:53.825173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:53.858153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-56397c03-6b18-4142-8204-9ad2d64a3851 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:53.871922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-56397c03-6b18-4142-8204-9ad2d64a3851 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:53.874055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-56397c03-6b18-4142-8204-9ad2d64a3851 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:53.878051 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-56397c03-6b18-4142-8204-9ad2d64a3851 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.362956 Aug 03 01:53:53.879089 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 837/1699] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:53 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:54.020671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ae4b3985-bfb3-46f7-9a18-9c99c47ed7bf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:54.023131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ae4b3985-bfb3-46f7-9a18-9c99c47ed7bf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:54.044914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae4b3985-bfb3-46f7-9a18-9c99c47ed7bf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:54.047538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae4b3985-bfb3-46f7-9a18-9c99c47ed7bf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:54.049014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae4b3985-bfb3-46f7-9a18-9c99c47ed7bf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:54.051120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae4b3985-bfb3-46f7-9a18-9c99c47ed7bf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:54.068853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:54.302479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-12e6a017-4b8e-420b-9bb1-c10a3940a4cf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:54.305653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-12e6a017-4b8e-420b-9bb1-c10a3940a4cf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:54.318403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12e6a017-4b8e-420b-9bb1-c10a3940a4cf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:54.322440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ae4b3985-bfb3-46f7-9a18-9c99c47ed7bf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:54.323767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12e6a017-4b8e-420b-9bb1-c10a3940a4cf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:54.324840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12e6a017-4b8e-420b-9bb1-c10a3940a4cf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:54.325486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12e6a017-4b8e-420b-9bb1-c10a3940a4cf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:54.338241 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ae4b3985-bfb3-46f7-9a18-9c99c47ed7bf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1506 microversion: 2.1 time: 0.321826 Aug 03 01:53:54.339155 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 863/1700] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:54 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:54.349468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6bb75dd3-f84c-4e62-a55b-6cf2abc0393d tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:54.350633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6bb75dd3-f84c-4e62-a55b-6cf2abc0393d tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:54.367486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bb75dd3-f84c-4e62-a55b-6cf2abc0393d tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:54.373545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bb75dd3-f84c-4e62-a55b-6cf2abc0393d tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:54.377552 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bb75dd3-f84c-4e62-a55b-6cf2abc0393d tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:54.378777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bb75dd3-f84c-4e62-a55b-6cf2abc0393d tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:54.398235 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-12e6a017-4b8e-420b-9bb1-c10a3940a4cf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101376 Aug 03 01:53:54.401577 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 838/1701] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 01:53:54 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:54.553256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6bb75dd3-f84c-4e62-a55b-6cf2abc0393d tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:54.576222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6bb75dd3-f84c-4e62-a55b-6cf2abc0393d tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:54.581105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6bb75dd3-f84c-4e62-a55b-6cf2abc0393d tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:54.583849 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6bb75dd3-f84c-4e62-a55b-6cf2abc0393d tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 200 len: 1365 microversion: 2.47 time: 0.242945 Aug 03 01:53:54.586087 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 864/1702] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:54 2022] GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:54.904295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-702325ba-5787-483f-8de1-07c4930920e1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:54.905107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-702325ba-5787-483f-8de1-07c4930920e1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:54.928561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-702325ba-5787-483f-8de1-07c4930920e1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:54.937086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-702325ba-5787-483f-8de1-07c4930920e1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:54.938955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-702325ba-5787-483f-8de1-07c4930920e1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:54.939734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-702325ba-5787-483f-8de1-07c4930920e1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:55.170187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-702325ba-5787-483f-8de1-07c4930920e1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:55.188951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-702325ba-5787-483f-8de1-07c4930920e1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:55.191735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-702325ba-5787-483f-8de1-07c4930920e1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:55.194007 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-702325ba-5787-483f-8de1-07c4930920e1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.295223 Aug 03 01:53:55.194872 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 839/1703] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:54 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:55.361667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-195fd98a-b351-4499-b639-34703cbe1ac4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:55.362493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-195fd98a-b351-4499-b639-34703cbe1ac4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:55.377678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-195fd98a-b351-4499-b639-34703cbe1ac4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:55.378096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-195fd98a-b351-4499-b639-34703cbe1ac4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:55.378892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-195fd98a-b351-4499-b639-34703cbe1ac4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:55.383692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-195fd98a-b351-4499-b639-34703cbe1ac4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:55.410292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-87361c40-a043-4515-a345-7f75d281fe7f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:55.414291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-87361c40-a043-4515-a345-7f75d281fe7f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:55.437516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-87361c40-a043-4515-a345-7f75d281fe7f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:55.438177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-87361c40-a043-4515-a345-7f75d281fe7f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:55.443745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-87361c40-a043-4515-a345-7f75d281fe7f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:55.444375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-87361c40-a043-4515-a345-7f75d281fe7f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:55.494770 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-87361c40-a043-4515-a345-7f75d281fe7f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088920 Aug 03 01:53:55.496047 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 840/1704] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 01:53:55 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:53:55.618953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7d18bad3-1e3d-4593-bfe4-73be936dca31 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:55.619579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7d18bad3-1e3d-4593-bfe4-73be936dca31 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:55.629866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d18bad3-1e3d-4593-bfe4-73be936dca31 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:55.632299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d18bad3-1e3d-4593-bfe4-73be936dca31 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:55.635166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d18bad3-1e3d-4593-bfe4-73be936dca31 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:55.637402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d18bad3-1e3d-4593-bfe4-73be936dca31 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:55.684052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-195fd98a-b351-4499-b639-34703cbe1ac4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:55.698580 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-195fd98a-b351-4499-b639-34703cbe1ac4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1506 microversion: 2.1 time: 0.340539 Aug 03 01:53:55.702934 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 865/1705] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:55 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:53:55.764939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7d18bad3-1e3d-4593-bfe4-73be936dca31 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:55.767686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:53:55.779125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7d18bad3-1e3d-4593-bfe4-73be936dca31 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:55.784559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7d18bad3-1e3d-4593-bfe4-73be936dca31 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:55.785778 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7d18bad3-1e3d-4593-bfe4-73be936dca31 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 200 len: 1365 microversion: 2.47 time: 0.171772 Aug 03 01:53:55.790655 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 841/1706] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:55 2022] GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:53:56.231628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-27f10ca0-6af3-4634-8b77-a5f33a89f9a7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:56.232586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-27f10ca0-6af3-4634-8b77-a5f33a89f9a7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:56.255945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27f10ca0-6af3-4634-8b77-a5f33a89f9a7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:56.315403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27f10ca0-6af3-4634-8b77-a5f33a89f9a7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:56.349601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27f10ca0-6af3-4634-8b77-a5f33a89f9a7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:56.349601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27f10ca0-6af3-4634-8b77-a5f33a89f9a7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:56.508655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-21a4d543-fe1a-40ab-ac96-7241b3002228 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:56.510770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-21a4d543-fe1a-40ab-ac96-7241b3002228 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:56.533848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21a4d543-fe1a-40ab-ac96-7241b3002228 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:56.534292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21a4d543-fe1a-40ab-ac96-7241b3002228 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:56.535162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21a4d543-fe1a-40ab-ac96-7241b3002228 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:56.535626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21a4d543-fe1a-40ab-ac96-7241b3002228 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:56.544735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-27f10ca0-6af3-4634-8b77-a5f33a89f9a7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:56.559738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-27f10ca0-6af3-4634-8b77-a5f33a89f9a7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:56.563143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-27f10ca0-6af3-4634-8b77-a5f33a89f9a7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:56.565273 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-27f10ca0-6af3-4634-8b77-a5f33a89f9a7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.346644 Aug 03 01:53:56.566712 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 866/1707] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:56 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:56.588085 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-21a4d543-fe1a-40ab-ac96-7241b3002228 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084683 Aug 03 01:53:56.588838 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 842/1708] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 01:53:56 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 01:53:56.722782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1fa95de1-5e6c-4107-9041-44896b25256b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:56.723965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1fa95de1-5e6c-4107-9041-44896b25256b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:56.731658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fa95de1-5e6c-4107-9041-44896b25256b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:56.733843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fa95de1-5e6c-4107-9041-44896b25256b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:56.735614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fa95de1-5e6c-4107-9041-44896b25256b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:56.737202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fa95de1-5e6c-4107-9041-44896b25256b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:56.837505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-49bcd834-7019-448a-b16e-6d857eb5cdc7 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Action: 'update', calling method: .version_select at 0x7f5b12c3aca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:57.063935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1fa95de1-5e6c-4107-9041-44896b25256b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:57.074117 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1fa95de1-5e6c-4107-9041-44896b25256b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1506 microversion: 2.1 time: 0.355023 Aug 03 01:53:57.076977 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 843/1709] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:56 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:53:57.089096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d235bdae-d7da-4b50-9698-4b5cce43dc00 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:57.090316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d235bdae-d7da-4b50-9698-4b5cce43dc00 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:57.112277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d235bdae-d7da-4b50-9698-4b5cce43dc00 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:57.116163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d235bdae-d7da-4b50-9698-4b5cce43dc00 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:57.117283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d235bdae-d7da-4b50-9698-4b5cce43dc00 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:57.118210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d235bdae-d7da-4b50-9698-4b5cce43dc00 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:57.305135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d235bdae-d7da-4b50-9698-4b5cce43dc00 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:57.322725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d235bdae-d7da-4b50-9698-4b5cce43dc00 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:57.324593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d235bdae-d7da-4b50-9698-4b5cce43dc00 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:57.325967 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d235bdae-d7da-4b50-9698-4b5cce43dc00 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 200 len: 1365 microversion: 2.47 time: 0.247644 Aug 03 01:53:57.327030 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 844/1710] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:57 2022] GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:57.412270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49bcd834-7019-448a-b16e-6d857eb5cdc7 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:57.413303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49bcd834-7019-448a-b16e-6d857eb5cdc7 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:57.415647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49bcd834-7019-448a-b16e-6d857eb5cdc7 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:57.416117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49bcd834-7019-448a-b16e-6d857eb5cdc7 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:57.552544 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-49bcd834-7019-448a-b16e-6d857eb5cdc7 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/6bf052c527b2499aac0c015a3586964e" status: 200 len: 148 microversion: 2.57 time: 0.932745 Aug 03 01:53:57.554591 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 867/1711] 10.222.0.67 () {62 vars in 1303 bytes} [Wed Aug 3 01:53:56 2022] PUT /compute/v2.1/os-quota-sets/6bf052c527b2499aac0c015a3586964e => generated 148 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:53:57.568678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bc83570e-68e2-4daa-8a9e-c4b3e935915d tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Calling method '.version_select at 0x7f5b244cd8b0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:57.591405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a2c10ecc-fff4-4a48-8f1f-759adf52e230 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:57.592038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a2c10ecc-fff4-4a48-8f1f-759adf52e230 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:57.601824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2c10ecc-fff4-4a48-8f1f-759adf52e230 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:57.602949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2c10ecc-fff4-4a48-8f1f-759adf52e230 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:57.606455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2c10ecc-fff4-4a48-8f1f-759adf52e230 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:57.607923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2c10ecc-fff4-4a48-8f1f-759adf52e230 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:57.888003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a2c10ecc-fff4-4a48-8f1f-759adf52e230 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:57.899075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a2c10ecc-fff4-4a48-8f1f-759adf52e230 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:57.900890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a2c10ecc-fff4-4a48-8f1f-759adf52e230 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:57.902271 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a2c10ecc-fff4-4a48-8f1f-759adf52e230 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.315579 Aug 03 01:53:57.903410 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 868/1712] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:57 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:57.967649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc83570e-68e2-4daa-8a9e-c4b3e935915d tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:57.968097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc83570e-68e2-4daa-8a9e-c4b3e935915d tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:57.968948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc83570e-68e2-4daa-8a9e-c4b3e935915d tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:57.969325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc83570e-68e2-4daa-8a9e-c4b3e935915d tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:58.009451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-73074440", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:58.015453 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bc83570e-68e2-4daa-8a9e-c4b3e935915d tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/6bf052c527b2499aac0c015a3586964e/detail" status: 200 len: 463 microversion: 2.57 time: 0.450731 Aug 03 01:53:58.016079 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 845/1713] 10.222.0.67 () {60 vars in 1304 bytes} [Wed Aug 3 01:53:57 2022] GET /compute/v2.1/os-quota-sets/6bf052c527b2499aac0c015a3586964e/detail => generated 463 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:53:58.102080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1665a07f-839b-4c6d-b6c4-2776ca4c4819 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:58.102697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1665a07f-839b-4c6d-b6c4-2776ca4c4819 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:58.118960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1665a07f-839b-4c6d-b6c4-2776ca4c4819 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:58.119412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1665a07f-839b-4c6d-b6c4-2776ca4c4819 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:58.119712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:53:58.120138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1665a07f-839b-4c6d-b6c4-2776ca4c4819 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:58.120652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1665a07f-839b-4c6d-b6c4-2776ca4c4819 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:58.390482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1665a07f-839b-4c6d-b6c4-2776ca4c4819 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:58.400558 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1665a07f-839b-4c6d-b6c4-2776ca4c4819 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1506 microversion: 2.1 time: 0.303532 Aug 03 01:53:58.404434 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 846/1714] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:58 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:53:58.411689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f080007b-fdac-4440-882b-90c1d39a18d9 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Action: 'update', calling method: .version_select at 0x7f5b244b9790>, body: {"quota_set": {"ram": "2048"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:58.544652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f080007b-fdac-4440-882b-90c1d39a18d9 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:58.547038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f080007b-fdac-4440-882b-90c1d39a18d9 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:58.548348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f080007b-fdac-4440-882b-90c1d39a18d9 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:58.550354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f080007b-fdac-4440-882b-90c1d39a18d9 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:58.639005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f080007b-fdac-4440-882b-90c1d39a18d9 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:58.640534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f080007b-fdac-4440-882b-90c1d39a18d9 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:58.647908 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f080007b-fdac-4440-882b-90c1d39a18d9 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:58.649076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f080007b-fdac-4440-882b-90c1d39a18d9 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:58.782932 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f080007b-fdac-4440-882b-90c1d39a18d9 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-sets/6bf052c527b2499aac0c015a3586964e?user_id=e0cf0f54cb8b4566a96c4d973a75385e" status: 200 len: 148 microversion: 2.57 time: 0.376274 Aug 03 01:53:58.783856 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 847/1715] 10.222.0.67 () {62 vars in 1384 bytes} [Wed Aug 3 01:53:58 2022] PUT /compute/v2.1/os-quota-sets/6bf052c527b2499aac0c015a3586964e?user_id=e0cf0f54cb8b4566a96c4d973a75385e => generated 148 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:53:58.789113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f18e3d1d-594d-419f-a94c-11eb82c70bbe tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:58.790064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f18e3d1d-594d-419f-a94c-11eb82c70bbe tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:58.797500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f18e3d1d-594d-419f-a94c-11eb82c70bbe tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:58.798274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f18e3d1d-594d-419f-a94c-11eb82c70bbe tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:58.799865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f18e3d1d-594d-419f-a94c-11eb82c70bbe tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:58.800490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f18e3d1d-594d-419f-a94c-11eb82c70bbe tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:58.941995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:53:58.944845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:53:58.945567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:53:58.946219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:53:58.946861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:53:58.963129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f18e3d1d-594d-419f-a94c-11eb82c70bbe tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:58.963766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:58.964605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:58.965670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:58.966339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:58.979920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f18e3d1d-594d-419f-a94c-11eb82c70bbe tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:58.983169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f18e3d1d-594d-419f-a94c-11eb82c70bbe tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:58.984392 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f18e3d1d-594d-419f-a94c-11eb82c70bbe tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 200 len: 1365 microversion: 2.47 time: 0.199394 Aug 03 01:53:58.998944 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 848/1716] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:58 2022] GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:58.998944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1b3f9a8c-9e2f-480d-ad28-6c1f60f17ad1 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] Calling method '.version_select at 0x7f5b244f99d0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:59.001054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Getting quotas for project 655a411b3b2542f7b62d41257e7bf806. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:53:59.010121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Getting quotas for user d5950dd979ef4fa4a26acdd6a50c75a5 and project 655a411b3b2542f7b62d41257e7bf806. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:53:59.045885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:53:59.073067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:53:59.182020 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1b3f9a8c-9e2f-480d-ad28-6c1f60f17ad1 tempest-QuotasAdminTestV257-1747356447 tempest-QuotasAdminTestV257-1747356447-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/6bf052c527b2499aac0c015a3586964e?user_id=e0cf0f54cb8b4566a96c4d973a75385e" status: 200 len: 190 microversion: 2.57 time: 0.188421 Aug 03 01:53:59.182619 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 849/1717] 10.222.0.67 () {60 vars in 1364 bytes} [Wed Aug 3 01:53:58 2022] GET /compute/v2.1/os-quota-sets/6bf052c527b2499aac0c015a3586964e?user_id=e0cf0f54cb8b4566a96c4d973a75385e => generated 190 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:53:59.205440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e9836221-621d-418a-90d1-687bd17a3a16 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:59.206072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e9836221-621d-418a-90d1-687bd17a3a16 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:59.210351 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6b16c689-de51-4ffd-aefb-9a190e69e87b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.305660 Aug 03 01:53:59.224021 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 869/1718] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:53:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:53:59.224154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9836221-621d-418a-90d1-687bd17a3a16 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:59.224154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9836221-621d-418a-90d1-687bd17a3a16 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:59.224154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9836221-621d-418a-90d1-687bd17a3a16 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:59.224154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9836221-621d-418a-90d1-687bd17a3a16 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:59.387324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-596453604", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:53:59.535874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:53:59.775909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e9836221-621d-418a-90d1-687bd17a3a16 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:59.792325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e9836221-621d-418a-90d1-687bd17a3a16 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:59.799320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e9836221-621d-418a-90d1-687bd17a3a16 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:53:59.800899 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e9836221-621d-418a-90d1-687bd17a3a16 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.607105 Aug 03 01:53:59.803330 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 850/1719] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:53:59 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:53:59.815095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-08cf146a-f317-4db7-a6e3-fd080ebaba57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:53:59.817583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-08cf146a-f317-4db7-a6e3-fd080ebaba57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:53:59.831890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08cf146a-f317-4db7-a6e3-fd080ebaba57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:59.832372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08cf146a-f317-4db7-a6e3-fd080ebaba57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:53:59.833649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08cf146a-f317-4db7-a6e3-fd080ebaba57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:53:59.834247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08cf146a-f317-4db7-a6e3-fd080ebaba57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:00.171977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-08cf146a-f317-4db7-a6e3-fd080ebaba57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:00.182822 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-08cf146a-f317-4db7-a6e3-fd080ebaba57 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1514 microversion: 2.1 time: 0.376940 Aug 03 01:54:00.195493 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 851/1720] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:53:59 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1514 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:00.201049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-60978f81-094d-436d-9194-509902e22815 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:00.201681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-60978f81-094d-436d-9194-509902e22815 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:00.221581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:54:00.222153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:54:00.222497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:54:00.224123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:54:00.224809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:54:00.230323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=8,nova_api:INSERT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:00.233160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60978f81-094d-436d-9194-509902e22815 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:00.234298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60978f81-094d-436d-9194-509902e22815 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:00.237430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60978f81-094d-436d-9194-509902e22815 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:00.238099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60978f81-094d-436d-9194-509902e22815 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:00.243132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:00.243895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:00.245044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:00.246113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:00.276807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Getting quotas for project 655a411b3b2542f7b62d41257e7bf806. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:54:00.283983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Getting quotas for user d5950dd979ef4fa4a26acdd6a50c75a5 and project 655a411b3b2542f7b62d41257e7bf806. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:54:00.319824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:54:00.322893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:54:00.388603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-60978f81-094d-436d-9194-509902e22815 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:00.400658 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3f76680a-b614-45c5-8c4c-510912e30416 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.014629 Aug 03 01:54:00.405525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-60978f81-094d-436d-9194-509902e22815 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:00.408284 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 870/1721] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:53:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 01:54:00.414171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-60978f81-094d-436d-9194-509902e22815 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:00.419137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b3622257-94b5-478d-a52b-d1eac14b7876 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:00.419368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b3622257-94b5-478d-a52b-d1eac14b7876 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:00.420448 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-60978f81-094d-436d-9194-509902e22815 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 200 len: 1365 microversion: 2.47 time: 0.223666 Aug 03 01:54:00.435504 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 852/1722] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:00 2022] GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:00.567099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b3622257-94b5-478d-a52b-d1eac14b7876 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:00.590291 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b3622257-94b5-478d-a52b-d1eac14b7876 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1213 microversion: 2.1 time: 0.175867 Aug 03 01:54:00.593208 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 871/1723] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:00 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1213 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:00.832178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e4713ab8-46a8-45b7-a441-1959fd615c60 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:00.832938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e4713ab8-46a8-45b7-a441-1959fd615c60 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:00.854718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4713ab8-46a8-45b7-a441-1959fd615c60 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:00.857569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4713ab8-46a8-45b7-a441-1959fd615c60 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:00.860131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4713ab8-46a8-45b7-a441-1959fd615c60 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:00.862647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4713ab8-46a8-45b7-a441-1959fd615c60 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:01.297560 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e4713ab8-46a8-45b7-a441-1959fd615c60 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:01.316253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e4713ab8-46a8-45b7-a441-1959fd615c60 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:01.319920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e4713ab8-46a8-45b7-a441-1959fd615c60 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:01.321241 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e4713ab8-46a8-45b7-a441-1959fd615c60 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.493803 Aug 03 01:54:01.338937 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 853/1724] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:00 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:01.453969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1328d18b-c163-484c-9d9c-12255fa31cb0 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:01.454464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1328d18b-c163-484c-9d9c-12255fa31cb0 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:01.469837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1328d18b-c163-484c-9d9c-12255fa31cb0 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:01.470316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1328d18b-c163-484c-9d9c-12255fa31cb0 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:01.471173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1328d18b-c163-484c-9d9c-12255fa31cb0 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:01.471621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1328d18b-c163-484c-9d9c-12255fa31cb0 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:01.635485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7752bf32-db65-4512-982b-0408521cbdfd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:01.636565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7752bf32-db65-4512-982b-0408521cbdfd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:01.662072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7752bf32-db65-4512-982b-0408521cbdfd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:01.663209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7752bf32-db65-4512-982b-0408521cbdfd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:01.670993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7752bf32-db65-4512-982b-0408521cbdfd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:01.671745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7752bf32-db65-4512-982b-0408521cbdfd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:01.680847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1328d18b-c163-484c-9d9c-12255fa31cb0 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:01.699281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1328d18b-c163-484c-9d9c-12255fa31cb0 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:01.705778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1328d18b-c163-484c-9d9c-12255fa31cb0 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:01.709440 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1328d18b-c163-484c-9d9c-12255fa31cb0 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 200 len: 1365 microversion: 2.47 time: 0.260259 Aug 03 01:54:01.713020 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 872/1725] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:01 2022] GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:02.013273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7752bf32-db65-4512-982b-0408521cbdfd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:02.024995 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7752bf32-db65-4512-982b-0408521cbdfd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1217 microversion: 2.1 time: 0.398750 Aug 03 01:54:02.031479 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 854/1726] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:01 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1217 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:02.357903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2e4266eb-ca55-4561-819a-eca4cbbca80d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:02.360138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2e4266eb-ca55-4561-819a-eca4cbbca80d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:02.381785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e4266eb-ca55-4561-819a-eca4cbbca80d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:02.385204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e4266eb-ca55-4561-819a-eca4cbbca80d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:02.387193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e4266eb-ca55-4561-819a-eca4cbbca80d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:02.393142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e4266eb-ca55-4561-819a-eca4cbbca80d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:02.736575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-72820be1-8314-4a72-937c-41366c7d1858 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:02.737608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-72820be1-8314-4a72-937c-41366c7d1858 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:02.767656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-72820be1-8314-4a72-937c-41366c7d1858 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:02.768661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-72820be1-8314-4a72-937c-41366c7d1858 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:02.769911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-72820be1-8314-4a72-937c-41366c7d1858 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:02.770997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-72820be1-8314-4a72-937c-41366c7d1858 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:02.957266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-72820be1-8314-4a72-937c-41366c7d1858 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:02.959612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2e4266eb-ca55-4561-819a-eca4cbbca80d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:02.976601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2e4266eb-ca55-4561-819a-eca4cbbca80d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:02.980712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-72820be1-8314-4a72-937c-41366c7d1858 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:02.984177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2e4266eb-ca55-4561-819a-eca4cbbca80d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:02.985202 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2e4266eb-ca55-4561-819a-eca4cbbca80d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.632538 Aug 03 01:54:02.986209 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 873/1727] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:02 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:02.990187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-72820be1-8314-4a72-937c-41366c7d1858 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb9b98b1ea8c4f6c9f56e282a58b626b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1768a01b5c334a8d9a378e0def798052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:02.998452 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-72820be1-8314-4a72-937c-41366c7d1858 tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 200 len: 1365 microversion: 2.47 time: 0.266184 Aug 03 01:54:03.001300 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 855/1728] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:02 2022] GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:54:03.055242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bd09b380-96c3-4cd2-9004-68358a8cedec tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:03.055874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bd09b380-96c3-4cd2-9004-68358a8cedec tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:03.078130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd09b380-96c3-4cd2-9004-68358a8cedec tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:03.079461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd09b380-96c3-4cd2-9004-68358a8cedec tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:03.080513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd09b380-96c3-4cd2-9004-68358a8cedec tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:03.081138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd09b380-96c3-4cd2-9004-68358a8cedec tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:03.358532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bd09b380-96c3-4cd2-9004-68358a8cedec tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:03.371104 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bd09b380-96c3-4cd2-9004-68358a8cedec tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1273 microversion: 2.1 time: 0.320968 Aug 03 01:54:03.374636 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 874/1729] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:03 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1273 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:03.423331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7691c078-35a0-4be3-b8ef-ebec29c2a8b7 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:03.439809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7691c078-35a0-4be3-b8ef-ebec29c2a8b7 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:03.469541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7691c078-35a0-4be3-b8ef-ebec29c2a8b7 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:03.478319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7691c078-35a0-4be3-b8ef-ebec29c2a8b7 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:03.483941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7691c078-35a0-4be3-b8ef-ebec29c2a8b7 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:03.487812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7691c078-35a0-4be3-b8ef-ebec29c2a8b7 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:03.637876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-7691c078-35a0-4be3-b8ef-ebec29c2a8b7 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lazy-loading 'flavor' on Instance uuid c8397a8e-08c7-4844-90eb-80949ac27e92 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:54:03.924731 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7691c078-35a0-4be3-b8ef-ebec29c2a8b7 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92/action" status: 200 len: 32 microversion: 2.1 time: 0.506174 Aug 03 01:54:03.932012 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 856/1730] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:54:03 2022] POST /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92/action => generated 32 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 01:54:03.977718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-91f863f6-0073-46bf-b2d7-951d5c1bed34 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:03.978449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-91f863f6-0073-46bf-b2d7-951d5c1bed34 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:04.013067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-65e36e6e-0ac7-4c37-a1ae-1b430747b2b8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:04.014754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-65e36e6e-0ac7-4c37-a1ae-1b430747b2b8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:04.038138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91f863f6-0073-46bf-b2d7-951d5c1bed34 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:04.040250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91f863f6-0073-46bf-b2d7-951d5c1bed34 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:04.044328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-65e36e6e-0ac7-4c37-a1ae-1b430747b2b8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:04.048383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91f863f6-0073-46bf-b2d7-951d5c1bed34 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:04.053028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91f863f6-0073-46bf-b2d7-951d5c1bed34 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:04.064691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-65e36e6e-0ac7-4c37-a1ae-1b430747b2b8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:04.068167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-65e36e6e-0ac7-4c37-a1ae-1b430747b2b8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:04.070182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-65e36e6e-0ac7-4c37-a1ae-1b430747b2b8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:04.522789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-65e36e6e-0ac7-4c37-a1ae-1b430747b2b8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:04.535630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-65e36e6e-0ac7-4c37-a1ae-1b430747b2b8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:04.549000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-65e36e6e-0ac7-4c37-a1ae-1b430747b2b8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:04.552340 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-65e36e6e-0ac7-4c37-a1ae-1b430747b2b8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.544614 Aug 03 01:54:04.568666 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 857/1731] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:04 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:54:04.576538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fae116a0-0c41-41a6-926b-ab58af557fea tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:04.577597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fae116a0-0c41-41a6-926b-ab58af557fea tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] [instance: 842d1c7f-53c8-465e-ad50-56bdbbc35109] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:04.584335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fae116a0-0c41-41a6-926b-ab58af557fea tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:04.585127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fae116a0-0c41-41a6-926b-ab58af557fea tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:04.586223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fae116a0-0c41-41a6-926b-ab58af557fea tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:04.586839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fae116a0-0c41-41a6-926b-ab58af557fea tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:04.592907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:04.605907 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-fae116a0-0c41-41a6-926b-ab58af557fea tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] HTTP exception thrown: Instance 842d1c7f-53c8-465e-ad50-56bdbbc35109 could not be found. Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fae116a0-0c41-41a6-926b-ab58af557fea tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Request method failure captured: Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 HTTP/1.1 Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dUmPIhS2TwnyOkOVzNGbOtgJWtgdbjLtD-9fqoCQcGrHtcpygcUS11XEGBTlstnqMiRx5W7Xi0ryFug-OYeXONXm-gq9UYtVzbFdv_cRLWxqXjfPg47yqj0_ck4IDTkdbsfeDyDMt5wDaNx17z1rR9_wVqWgujZdAbL6Ao932ESJOY Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.47 Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 1768a01b5c334a8d9a378e0def798052 Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersAaction247Test-1427983123 Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1768a01b5c334a8d9a378e0def798052", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1768a01b5c334a8d9a378e0def798052"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1768a01b5c334a8d9a378e0def798052"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1768a01b5c334a8d9a378e0def798052"}]}] Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersAaction247Test-1427983123 Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 1768a01b5c334a8d9a378e0def798052 Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersAaction247Test-1427983123 Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersAaction247Test-1427983123-project Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: bb9b98b1ea8c4f6c9f56e282a58b626b Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersAaction247Test-1427983123-project Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 842d1c7f-53c8-465e-ad50-56bdbbc35109 could not be found. Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '842d1c7f-53c8-465e-ad50-56bdbbc35109'} Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 842d1c7f-53c8-465e-ad50-56bdbbc35109 could not be found. Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 842d1c7f-53c8-465e-ad50-56bdbbc35109 could not be found. Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:54:04.608024 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:54:04.616216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:54:04.616216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:54:04.616216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:54:04.616216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:54:04.616216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:54:04.616216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:54:04.616216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 842d1c7f-53c8-465e-ad50-56bdbbc35109 could not be found. Aug 03 01:54:04.616216 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:54:04.618495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fae116a0-0c41-41a6-926b-ab58af557fea tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] Returning 404 to user: Instance 842d1c7f-53c8-465e-ad50-56bdbbc35109 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:54:04.619691 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fae116a0-0c41-41a6-926b-ab58af557fea tempest-ServersAaction247Test-1427983123 tempest-ServersAaction247Test-1427983123-project] 10.222.0.67 "GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109" status: 404 len: 111 microversion: 2.47 time: 0.049798 Aug 03 01:54:04.620472 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 858/1732] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:04 2022] GET /compute/v2.1/servers/842d1c7f-53c8-465e-ad50-56bdbbc35109 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:54:04.630450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-561a1159-d14c-47b5-8716-72e0efa86fbf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:04.631673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-561a1159-d14c-47b5-8716-72e0efa86fbf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:04.640356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:04.643263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-561a1159-d14c-47b5-8716-72e0efa86fbf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:04.644936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-561a1159-d14c-47b5-8716-72e0efa86fbf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:04.646214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-561a1159-d14c-47b5-8716-72e0efa86fbf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:04.647045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-561a1159-d14c-47b5-8716-72e0efa86fbf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:04.815515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-561a1159-d14c-47b5-8716-72e0efa86fbf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:04.829433 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-561a1159-d14c-47b5-8716-72e0efa86fbf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1271 microversion: 2.1 time: 0.205848 Aug 03 01:54:04.838717 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 859/1733] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:04 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:04.953511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-91f863f6-0073-46bf-b2d7-951d5c1bed34 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:04.964256 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-91f863f6-0073-46bf-b2d7-951d5c1bed34 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1520 microversion: 2.1 time: 1.023400 Aug 03 01:54:04.975248 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 875/1734] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:03 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1520 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:05.584527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-965f5b3e-d5c8-426d-b0a2-713aaec8a2b7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:05.586413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-965f5b3e-d5c8-426d-b0a2-713aaec8a2b7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:05.623283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-965f5b3e-d5c8-426d-b0a2-713aaec8a2b7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:05.624639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-965f5b3e-d5c8-426d-b0a2-713aaec8a2b7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:05.626034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-965f5b3e-d5c8-426d-b0a2-713aaec8a2b7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:05.626720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-965f5b3e-d5c8-426d-b0a2-713aaec8a2b7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:05.857153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d410c0bb-2567-42c7-8ccb-e352ff873e72 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:05.858232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d410c0bb-2567-42c7-8ccb-e352ff873e72 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:05.885022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d410c0bb-2567-42c7-8ccb-e352ff873e72 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:05.889438 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d410c0bb-2567-42c7-8ccb-e352ff873e72 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:05.891893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d410c0bb-2567-42c7-8ccb-e352ff873e72 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:05.893598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d410c0bb-2567-42c7-8ccb-e352ff873e72 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:06.167395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-965f5b3e-d5c8-426d-b0a2-713aaec8a2b7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:06.187090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-965f5b3e-d5c8-426d-b0a2-713aaec8a2b7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:06.190119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-965f5b3e-d5c8-426d-b0a2-713aaec8a2b7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:06.193713 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-965f5b3e-d5c8-426d-b0a2-713aaec8a2b7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.615390 Aug 03 01:54:06.196851 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 860/1735] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:05 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:06.203654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d7106af-f33d-464c-b0e5-18a5b5366069 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:06.204549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8d7106af-f33d-464c-b0e5-18a5b5366069 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:06.234449 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d7106af-f33d-464c-b0e5-18a5b5366069 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:06.237331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d7106af-f33d-464c-b0e5-18a5b5366069 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:06.240243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d7106af-f33d-464c-b0e5-18a5b5366069 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:06.241459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d7106af-f33d-464c-b0e5-18a5b5366069 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:06.261060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d410c0bb-2567-42c7-8ccb-e352ff873e72 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:06.284475 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d410c0bb-2567-42c7-8ccb-e352ff873e72 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1313 microversion: 2.1 time: 0.431754 Aug 03 01:54:06.288946 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 876/1736] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:05 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:54:06.452217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8d7106af-f33d-464c-b0e5-18a5b5366069 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:06.462507 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8d7106af-f33d-464c-b0e5-18a5b5366069 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1520 microversion: 2.1 time: 0.264260 Aug 03 01:54:06.463734 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 861/1737] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:06 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:07.221636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6ba5b651-36ac-4954-97f1-c7f0a12dd6af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:07.222259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6ba5b651-36ac-4954-97f1-c7f0a12dd6af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:07.238189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ba5b651-36ac-4954-97f1-c7f0a12dd6af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:07.239979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ba5b651-36ac-4954-97f1-c7f0a12dd6af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:07.242362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ba5b651-36ac-4954-97f1-c7f0a12dd6af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:07.242830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ba5b651-36ac-4954-97f1-c7f0a12dd6af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:07.313446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-487335d7-97b2-4177-a7d7-c1012076bb2f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:07.314177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-487335d7-97b2-4177-a7d7-c1012076bb2f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:07.327556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-487335d7-97b2-4177-a7d7-c1012076bb2f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:07.328193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-487335d7-97b2-4177-a7d7-c1012076bb2f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:07.329092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-487335d7-97b2-4177-a7d7-c1012076bb2f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:07.329610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-487335d7-97b2-4177-a7d7-c1012076bb2f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:07.608901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-487335d7-97b2-4177-a7d7-c1012076bb2f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:07.623644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6ba5b651-36ac-4954-97f1-c7f0a12dd6af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:07.624399 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-487335d7-97b2-4177-a7d7-c1012076bb2f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1313 microversion: 2.1 time: 0.315829 Aug 03 01:54:07.625596 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 862/1738] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:07 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:07.640164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6ba5b651-36ac-4954-97f1-c7f0a12dd6af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:07.641788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-74144886-b31a-44d2-989e-cd35771e7598 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:07.641920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6ba5b651-36ac-4954-97f1-c7f0a12dd6af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:07.642784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-74144886-b31a-44d2-989e-cd35771e7598 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:07.643753 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6ba5b651-36ac-4954-97f1-c7f0a12dd6af tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.426437 Aug 03 01:54:07.646125 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 877/1739] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:07 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:07.652883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74144886-b31a-44d2-989e-cd35771e7598 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:07.653916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74144886-b31a-44d2-989e-cd35771e7598 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:07.654954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74144886-b31a-44d2-989e-cd35771e7598 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:07.656536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74144886-b31a-44d2-989e-cd35771e7598 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:07.878048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-74144886-b31a-44d2-989e-cd35771e7598 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:07.889611 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-74144886-b31a-44d2-989e-cd35771e7598 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1520 microversion: 2.1 time: 0.262663 Aug 03 01:54:07.890969 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 863/1740] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:07 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:08.008327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-844973307", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "5754a7b0-4303-40db-9fea-4563cd9eb0d6"}], "security_groups": [{"name": "tempest-securitygroup--347598039"}], "key_name": "tempest-keypair-1011187560", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "21a7effc-a6a9-478f-8558-326fdcb28299", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:08.205254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] validate_networks() for [('5754a7b0-4303-40db-9fea-4563cd9eb0d6', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:54:08.581536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-02af2752-db78-4be6-95c4-a7b8ea5329e1 req-b67d640e-5ba9-49b5-bf51-61f1a40ed56c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "058c9df7-48a2-4acc-8a43-6f25e86cf9a2", "tag": "84a59355-6b06-4c67-84d4-df2ade0771df"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:08.619805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-02af2752-db78-4be6-95c4-a7b8ea5329e1 req-b67d640e-5ba9-49b5-bf51-61f1a40ed56c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:08.620675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-02af2752-db78-4be6-95c4-a7b8ea5329e1 req-b67d640e-5ba9-49b5-bf51-61f1a40ed56c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:08.639239 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-02af2752-db78-4be6-95c4-a7b8ea5329e1 req-b67d640e-5ba9-49b5-bf51-61f1a40ed56c service nova] Creating event network-changed:84a59355-6b06-4c67-84d4-df2ade0771df for instance 058c9df7-48a2-4acc-8a43-6f25e86cf9a2 on n-h1-826529-8 Aug 03 01:54:08.648221 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-02af2752-db78-4be6-95c4-a7b8ea5329e1 req-b67d640e-5ba9-49b5-bf51-61f1a40ed56c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072750 Aug 03 01:54:08.649504 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 864/1741] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:54:08.656323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-373d89a7-ade0-4042-8071-0a0a67f5b50a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:08.657370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-373d89a7-ade0-4042-8071-0a0a67f5b50a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:08.668571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-373d89a7-ade0-4042-8071-0a0a67f5b50a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:08.669519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-373d89a7-ade0-4042-8071-0a0a67f5b50a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:08.670798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-373d89a7-ade0-4042-8071-0a0a67f5b50a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:08.671594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-373d89a7-ade0-4042-8071-0a0a67f5b50a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:08.672464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=7 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:09.023064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Getting quotas for project 44fdaa2efc844407aea6dbd1493ad387. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:54:09.032408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Getting quotas for user bf02f5fbbc4c4b9f8cefeb12bb44f91c and project 44fdaa2efc844407aea6dbd1493ad387. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:54:09.047616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-373d89a7-ade0-4042-8071-0a0a67f5b50a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:09.057061 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-373d89a7-ade0-4042-8071-0a0a67f5b50a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1313 microversion: 2.1 time: 0.406037 Aug 03 01:54:09.062158 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 865/1742] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:08 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:09.072258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-db2d3ae9-32ec-4e1b-aea8-1c820042cb25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:09.073675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-db2d3ae9-32ec-4e1b-aea8-1c820042cb25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:09.077098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:54:09.079547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:54:09.080409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:54:09.081303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:54:09.081976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:54:09.102133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db2d3ae9-32ec-4e1b-aea8-1c820042cb25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:09.107378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:09.107624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db2d3ae9-32ec-4e1b-aea8-1c820042cb25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:09.109412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:09.109975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db2d3ae9-32ec-4e1b-aea8-1c820042cb25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:09.110470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db2d3ae9-32ec-4e1b-aea8-1c820042cb25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:09.115918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:09.139189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:09.167991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=51,nova_cell0:UPDATE=7 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:09.219499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Getting quotas for project 44fdaa2efc844407aea6dbd1493ad387. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:54:09.241170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Getting quotas for user bf02f5fbbc4c4b9f8cefeb12bb44f91c and project 44fdaa2efc844407aea6dbd1493ad387. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:54:09.360909 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:54:09.363355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='21a7effc-a6a9-478f-8558-326fdcb28299',volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:54:09.441548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-db2d3ae9-32ec-4e1b-aea8-1c820042cb25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:09.455632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-db2d3ae9-32ec-4e1b-aea8-1c820042cb25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:09.460960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-db2d3ae9-32ec-4e1b-aea8-1c820042cb25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:09.465104 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-db2d3ae9-32ec-4e1b-aea8-1c820042cb25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.399409 Aug 03 01:54:09.466255 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 866/1743] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:09 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:09.474652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-358268ef-a310-4a79-92fe-d5740d733275 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:09.476645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-358268ef-a310-4a79-92fe-d5740d733275 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:09.490863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-358268ef-a310-4a79-92fe-d5740d733275 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:09.491887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-358268ef-a310-4a79-92fe-d5740d733275 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:09.492955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-358268ef-a310-4a79-92fe-d5740d733275 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:09.493614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-358268ef-a310-4a79-92fe-d5740d733275 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:09.737306 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6aa60665-ede1-45a2-964b-9c1f55fcc437 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.732968 Aug 03 01:54:09.739699 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 878/1744] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:54:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:54:09.749875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-358268ef-a310-4a79-92fe-d5740d733275 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:09.758704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-77e90bca-7464-4148-949a-992837f328f1 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:09.759833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-77e90bca-7464-4148-949a-992837f328f1 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:09.760514 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-358268ef-a310-4a79-92fe-d5740d733275 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1520 microversion: 2.1 time: 0.291183 Aug 03 01:54:09.761479 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 867/1745] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:09 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:09.978415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-77e90bca-7464-4148-949a-992837f328f1 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:09.987104 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-77e90bca-7464-4148-949a-992837f328f1 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1121 microversion: 2.1 time: 0.235040 Aug 03 01:54:09.994299 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 879/1746] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:09 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1121 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:10.110417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-31ee3a4d-1102-423a-97cf-f9f86fc352cb tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:10.111311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-31ee3a4d-1102-423a-97cf-f9f86fc352cb tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:10.147295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31ee3a4d-1102-423a-97cf-f9f86fc352cb tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:10.148002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31ee3a4d-1102-423a-97cf-f9f86fc352cb tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:10.150194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31ee3a4d-1102-423a-97cf-f9f86fc352cb tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:10.158977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31ee3a4d-1102-423a-97cf-f9f86fc352cb tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:10.495346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c255df3b-3f51-45cb-81cc-c60ff914721b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:10.496634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c255df3b-3f51-45cb-81cc-c60ff914721b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:10.510959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c255df3b-3f51-45cb-81cc-c60ff914721b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:10.511422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c255df3b-3f51-45cb-81cc-c60ff914721b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:10.517267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c255df3b-3f51-45cb-81cc-c60ff914721b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:10.519387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c255df3b-3f51-45cb-81cc-c60ff914721b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:10.535640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-31ee3a4d-1102-423a-97cf-f9f86fc352cb tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:10.547467 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-31ee3a4d-1102-423a-97cf-f9f86fc352cb tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1313 microversion: 2.1 time: 0.441412 Aug 03 01:54:10.565128 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 868/1747] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:10 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:10.753422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-cfc62b37-babf-46b9-94bf-cf5aeef57e6c req-54c00658-6667-4bd5-880d-ad4c73d3b236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb30620-408d-468e-b706-277ce080a2f6", "tag": "9762e114-938b-48d4-8d92-0fae9855c76e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:10.786141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-cfc62b37-babf-46b9-94bf-cf5aeef57e6c req-54c00658-6667-4bd5-880d-ad4c73d3b236 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:10.786141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-cfc62b37-babf-46b9-94bf-cf5aeef57e6c req-54c00658-6667-4bd5-880d-ad4c73d3b236 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:10.819561 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-cfc62b37-babf-46b9-94bf-cf5aeef57e6c req-54c00658-6667-4bd5-880d-ad4c73d3b236 service nova] Creating event network-changed:9762e114-938b-48d4-8d92-0fae9855c76e for instance 0eb30620-408d-468e-b706-277ce080a2f6 on n-h1-826529-8 Aug 03 01:54:10.833782 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-cfc62b37-babf-46b9-94bf-cf5aeef57e6c req-54c00658-6667-4bd5-880d-ad4c73d3b236 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078739 Aug 03 01:54:10.834852 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 869/1748] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:54:10.842945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c7c397a1-633c-4d30-9009-a2cd1e645058 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:10.852725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c7c397a1-633c-4d30-9009-a2cd1e645058 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:10.875238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7c397a1-633c-4d30-9009-a2cd1e645058 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:10.877544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7c397a1-633c-4d30-9009-a2cd1e645058 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:10.880916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7c397a1-633c-4d30-9009-a2cd1e645058 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:10.882507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7c397a1-633c-4d30-9009-a2cd1e645058 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:11.157344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c255df3b-3f51-45cb-81cc-c60ff914721b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:11.182445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c255df3b-3f51-45cb-81cc-c60ff914721b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:11.197985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c255df3b-3f51-45cb-81cc-c60ff914721b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:11.203255 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c255df3b-3f51-45cb-81cc-c60ff914721b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.711110 Aug 03 01:54:11.204190 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 880/1749] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:10 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:11.217008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-dddda82d-72a1-48ab-8ea7-147d7237adec req-bd8fd4ae-6af9-4d1a-af6c-ef24b94931f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47752419-6bf3-468f-b3a4-e212358b9e66", "name": "network-vif-unplugged", "status": "completed", "tag": "5ed2445c-012d-4ab5-960d-36a1cd1a2eed"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:11.327164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-dddda82d-72a1-48ab-8ea7-147d7237adec req-bd8fd4ae-6af9-4d1a-af6c-ef24b94931f5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:11.332264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-dddda82d-72a1-48ab-8ea7-147d7237adec req-bd8fd4ae-6af9-4d1a-af6c-ef24b94931f5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:11.373652 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-dddda82d-72a1-48ab-8ea7-147d7237adec req-bd8fd4ae-6af9-4d1a-af6c-ef24b94931f5 service nova] Creating event network-vif-unplugged:5ed2445c-012d-4ab5-960d-36a1cd1a2eed for instance 47752419-6bf3-468f-b3a4-e212358b9e66 on n-h1-826529-8 Aug 03 01:54:11.407528 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-dddda82d-72a1-48ab-8ea7-147d7237adec req-bd8fd4ae-6af9-4d1a-af6c-ef24b94931f5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.194301 Aug 03 01:54:11.408787 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 881/1750] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:11.422437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c7c397a1-633c-4d30-9009-a2cd1e645058 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:11.430873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-693b9ee9-1df8-49f6-b40e-f9f89518dbbf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:11.432498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-693b9ee9-1df8-49f6-b40e-f9f89518dbbf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:11.434087 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c7c397a1-633c-4d30-9009-a2cd1e645058 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1520 microversion: 2.1 time: 0.597829 Aug 03 01:54:11.442636 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 870/1751] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:10 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1520 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:11.451479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-693b9ee9-1df8-49f6-b40e-f9f89518dbbf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:11.453051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-693b9ee9-1df8-49f6-b40e-f9f89518dbbf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:11.454831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-693b9ee9-1df8-49f6-b40e-f9f89518dbbf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:11.459957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-693b9ee9-1df8-49f6-b40e-f9f89518dbbf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:11.584902 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-290ba084-5d40-43c1-ac6f-e193e85be5e4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:11.585933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-290ba084-5d40-43c1-ac6f-e193e85be5e4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:11.596488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-290ba084-5d40-43c1-ac6f-e193e85be5e4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:11.598829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-290ba084-5d40-43c1-ac6f-e193e85be5e4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:11.606668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-290ba084-5d40-43c1-ac6f-e193e85be5e4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:11.607915 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-290ba084-5d40-43c1-ac6f-e193e85be5e4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:11.630237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-693b9ee9-1df8-49f6-b40e-f9f89518dbbf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:11.640019 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-693b9ee9-1df8-49f6-b40e-f9f89518dbbf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1219 microversion: 2.1 time: 0.228718 Aug 03 01:54:11.671060 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 882/1752] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:11 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1219 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:12.227818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-58a9c8a4-2c79-4aad-9984-99ca743b9dcf tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:12.228490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-58a9c8a4-2c79-4aad-9984-99ca743b9dcf tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:12.241923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58a9c8a4-2c79-4aad-9984-99ca743b9dcf tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:12.242381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58a9c8a4-2c79-4aad-9984-99ca743b9dcf tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:12.243274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58a9c8a4-2c79-4aad-9984-99ca743b9dcf tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:12.243708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58a9c8a4-2c79-4aad-9984-99ca743b9dcf tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:12.323895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-290ba084-5d40-43c1-ac6f-e193e85be5e4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:12.336279 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-290ba084-5d40-43c1-ac6f-e193e85be5e4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1313 microversion: 2.1 time: 0.755975 Aug 03 01:54:12.337949 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 871/1753] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:11 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1313 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:54:12.478623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-139fe00f-a0a6-4789-8a51-f74e6c929e54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:12.479660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-139fe00f-a0a6-4789-8a51-f74e6c929e54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:12.489534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-139fe00f-a0a6-4789-8a51-f74e6c929e54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:12.490306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-139fe00f-a0a6-4789-8a51-f74e6c929e54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:12.493038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-139fe00f-a0a6-4789-8a51-f74e6c929e54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:12.500790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-139fe00f-a0a6-4789-8a51-f74e6c929e54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:13.911689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-58a9c8a4-2c79-4aad-9984-99ca743b9dcf tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:13.924053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-58a9c8a4-2c79-4aad-9984-99ca743b9dcf tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:13.934196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-58a9c8a4-2c79-4aad-9984-99ca743b9dcf tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:13.935712 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-58a9c8a4-2c79-4aad-9984-99ca743b9dcf tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 1.712084 Aug 03 01:54:13.936270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-139fe00f-a0a6-4789-8a51-f74e6c929e54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:13.953405 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-139fe00f-a0a6-4789-8a51-f74e6c929e54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1520 microversion: 2.1 time: 1.476655 Aug 03 01:54:13.955196 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 883/1754] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:12 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:54:13.956481 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 872/1755] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:12 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1520 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:13.963319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bbad810a-271f-47c2-ac48-950547912d03 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:13.963947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bbad810a-271f-47c2-ac48-950547912d03 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:13.969013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-13627beb-0652-4f33-8f2a-2e8ecd0dd5d3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:13.980752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbad810a-271f-47c2-ac48-950547912d03 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:13.981217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbad810a-271f-47c2-ac48-950547912d03 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:13.982032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbad810a-271f-47c2-ac48-950547912d03 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:13.982482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbad810a-271f-47c2-ac48-950547912d03 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:13.982893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-13627beb-0652-4f33-8f2a-2e8ecd0dd5d3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:14.007342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13627beb-0652-4f33-8f2a-2e8ecd0dd5d3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:14.011349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13627beb-0652-4f33-8f2a-2e8ecd0dd5d3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:14.012832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13627beb-0652-4f33-8f2a-2e8ecd0dd5d3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:14.015707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13627beb-0652-4f33-8f2a-2e8ecd0dd5d3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:14.234829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bbad810a-271f-47c2-ac48-950547912d03 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:14.256166 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bbad810a-271f-47c2-ac48-950547912d03 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1237 microversion: 2.1 time: 0.299277 Aug 03 01:54:14.259791 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 884/1756] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:13 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1237 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:14.280244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-8c5f6094-890a-4fce-b17c-8ad0a7d4137e req-e52eebc1-d5b4-4ca2-8087-84b3a3f87c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47752419-6bf3-468f-b3a4-e212358b9e66", "tag": "5ed2445c-012d-4ab5-960d-36a1cd1a2eed"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:14.310581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8c5f6094-890a-4fce-b17c-8ad0a7d4137e req-e52eebc1-d5b4-4ca2-8087-84b3a3f87c86 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:14.315631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8c5f6094-890a-4fce-b17c-8ad0a7d4137e req-e52eebc1-d5b4-4ca2-8087-84b3a3f87c86 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:14.329135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:14.333390 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-8c5f6094-890a-4fce-b17c-8ad0a7d4137e req-e52eebc1-d5b4-4ca2-8087-84b3a3f87c86 service nova] Creating event network-changed:5ed2445c-012d-4ab5-960d-36a1cd1a2eed for instance 47752419-6bf3-468f-b3a4-e212358b9e66 on n-h1-826529-8 Aug 03 01:54:14.341529 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-8c5f6094-890a-4fce-b17c-8ad0a7d4137e req-e52eebc1-d5b4-4ca2-8087-84b3a3f87c86 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078019 Aug 03 01:54:14.362395 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 885/1757] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:14.634233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-13627beb-0652-4f33-8f2a-2e8ecd0dd5d3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:14.647420 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-13627beb-0652-4f33-8f2a-2e8ecd0dd5d3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1313 microversion: 2.1 time: 0.689518 Aug 03 01:54:14.648289 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 873/1758] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:13 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1313 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:14.962657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fe557eee-03f3-44c9-b27c-210b604f8133 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:14.963579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fe557eee-03f3-44c9-b27c-210b604f8133 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:14.977795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe557eee-03f3-44c9-b27c-210b604f8133 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:14.981656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bbeccb61-a0bf-42b2-8539-5ade23b824b1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:14.983664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bbeccb61-a0bf-42b2-8539-5ade23b824b1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:14.984637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe557eee-03f3-44c9-b27c-210b604f8133 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:14.985508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe557eee-03f3-44c9-b27c-210b604f8133 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:14.986031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe557eee-03f3-44c9-b27c-210b604f8133 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:15.006218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bbeccb61-a0bf-42b2-8539-5ade23b824b1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:15.010810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bbeccb61-a0bf-42b2-8539-5ade23b824b1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:15.012042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bbeccb61-a0bf-42b2-8539-5ade23b824b1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:15.014078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bbeccb61-a0bf-42b2-8539-5ade23b824b1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:15.732901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bbeccb61-a0bf-42b2-8539-5ade23b824b1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:15.757101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fe557eee-03f3-44c9-b27c-210b604f8133 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:15.761001 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bbeccb61-a0bf-42b2-8539-5ade23b824b1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1520 microversion: 2.1 time: 0.787707 Aug 03 01:54:15.772050 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 874/1759] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:14 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1520 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:15.774925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fe557eee-03f3-44c9-b27c-210b604f8133 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:15.777952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-52a97411-dde8-4031-84fb-354e7b667f4d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:15.778268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fe557eee-03f3-44c9-b27c-210b604f8133 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:15.779094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-52a97411-dde8-4031-84fb-354e7b667f4d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:15.780443 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fe557eee-03f3-44c9-b27c-210b604f8133 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.822078 Aug 03 01:54:15.792943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52a97411-dde8-4031-84fb-354e7b667f4d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:15.793689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52a97411-dde8-4031-84fb-354e7b667f4d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:15.794665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52a97411-dde8-4031-84fb-354e7b667f4d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:15.795314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52a97411-dde8-4031-84fb-354e7b667f4d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:15.808996 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 886/1760] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:14 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:15.828306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d520eae2-4782-4f9a-9c8b-1c2e67a1a1ab tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:15.835317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d520eae2-4782-4f9a-9c8b-1c2e67a1a1ab tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:15.853578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d520eae2-4782-4f9a-9c8b-1c2e67a1a1ab tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:15.854343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d520eae2-4782-4f9a-9c8b-1c2e67a1a1ab tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:15.855306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d520eae2-4782-4f9a-9c8b-1c2e67a1a1ab tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:15.857186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d520eae2-4782-4f9a-9c8b-1c2e67a1a1ab tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:16.172335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-52a97411-dde8-4031-84fb-354e7b667f4d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:16.183281 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-52a97411-dde8-4031-84fb-354e7b667f4d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1237 microversion: 2.1 time: 0.409784 Aug 03 01:54:16.183876 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 875/1761] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:15 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1237 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:16.293762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d520eae2-4782-4f9a-9c8b-1c2e67a1a1ab tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:16.307889 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d520eae2-4782-4f9a-9c8b-1c2e67a1a1ab tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1313 microversion: 2.1 time: 0.497675 Aug 03 01:54:16.322682 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 887/1762] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:15 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:16.792394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5a798ef8-1df5-47b2-87aa-d0f56eb1fd98 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:16.793019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5a798ef8-1df5-47b2-87aa-d0f56eb1fd98 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:16.808147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a798ef8-1df5-47b2-87aa-d0f56eb1fd98 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:16.808892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a798ef8-1df5-47b2-87aa-d0f56eb1fd98 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:16.809914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a798ef8-1df5-47b2-87aa-d0f56eb1fd98 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:16.810537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a798ef8-1df5-47b2-87aa-d0f56eb1fd98 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:16.814730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-314b045f-4c2e-40f4-b7c7-d169d1b74ff7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:16.815411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-314b045f-4c2e-40f4-b7c7-d169d1b74ff7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:16.827343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-314b045f-4c2e-40f4-b7c7-d169d1b74ff7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:16.829998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-314b045f-4c2e-40f4-b7c7-d169d1b74ff7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:16.831053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-314b045f-4c2e-40f4-b7c7-d169d1b74ff7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:16.831668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-314b045f-4c2e-40f4-b7c7-d169d1b74ff7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:17.317400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5a798ef8-1df5-47b2-87aa-d0f56eb1fd98 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:17.324433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:17.328782 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5a798ef8-1df5-47b2-87aa-d0f56eb1fd98 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1520 microversion: 2.1 time: 0.540174 Aug 03 01:54:17.339305 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 876/1763] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:16 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1520 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:17.344270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-e251f906-a8b1-44a9-bbad-315b1201c3dc req-64f01a2c-b9ad-4f61-9801-e1ce3101ad86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058c9df7-48a2-4acc-8a43-6f25e86cf9a2", "name": "network-vif-plugged", "status": "completed", "tag": "84a59355-6b06-4c67-84d4-df2ade0771df"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:17.368527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e251f906-a8b1-44a9-bbad-315b1201c3dc req-64f01a2c-b9ad-4f61-9801-e1ce3101ad86 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:17.368979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e251f906-a8b1-44a9-bbad-315b1201c3dc req-64f01a2c-b9ad-4f61-9801-e1ce3101ad86 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:17.394119 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e251f906-a8b1-44a9-bbad-315b1201c3dc req-64f01a2c-b9ad-4f61-9801-e1ce3101ad86 service nova] Creating event network-vif-plugged:84a59355-6b06-4c67-84d4-df2ade0771df for instance 058c9df7-48a2-4acc-8a43-6f25e86cf9a2 on n-h1-826529-8 Aug 03 01:54:17.413527 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-e251f906-a8b1-44a9-bbad-315b1201c3dc req-64f01a2c-b9ad-4f61-9801-e1ce3101ad86 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072640 Aug 03 01:54:17.414512 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 877/1764] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:17.429051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9a93398d-9723-4f44-bd97-7c9985a262f8 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:17.430777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9a93398d-9723-4f44-bd97-7c9985a262f8 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:17.451056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a93398d-9723-4f44-bd97-7c9985a262f8 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:17.452381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-314b045f-4c2e-40f4-b7c7-d169d1b74ff7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:17.452895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a93398d-9723-4f44-bd97-7c9985a262f8 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:17.455269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a93398d-9723-4f44-bd97-7c9985a262f8 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:17.456665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a93398d-9723-4f44-bd97-7c9985a262f8 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:17.462590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-314b045f-4c2e-40f4-b7c7-d169d1b74ff7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:17.467038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-314b045f-4c2e-40f4-b7c7-d169d1b74ff7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:17.470402 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-314b045f-4c2e-40f4-b7c7-d169d1b74ff7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.661951 Aug 03 01:54:17.473879 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 888/1765] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:16 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:54:17.482877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f3671fbd-8342-478b-a5fc-f53250a36c3d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:17.486098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f3671fbd-8342-478b-a5fc-f53250a36c3d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:17.500303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f3671fbd-8342-478b-a5fc-f53250a36c3d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:17.507218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f3671fbd-8342-478b-a5fc-f53250a36c3d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:17.508375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f3671fbd-8342-478b-a5fc-f53250a36c3d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:17.508993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f3671fbd-8342-478b-a5fc-f53250a36c3d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:17.982045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9a93398d-9723-4f44-bd97-7c9985a262f8 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:17.994442 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9a93398d-9723-4f44-bd97-7c9985a262f8 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1304 microversion: 2.1 time: 0.578268 Aug 03 01:54:18.012246 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 878/1766] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:17 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1304 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:18.081379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f3671fbd-8342-478b-a5fc-f53250a36c3d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:18.091988 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f3671fbd-8342-478b-a5fc-f53250a36c3d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1313 microversion: 2.1 time: 0.616472 Aug 03 01:54:18.093236 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 889/1767] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:17 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1313 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:18.357242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a3a6a914-1dc3-495e-8bf0-c5000b71268c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:18.359467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a3a6a914-1dc3-495e-8bf0-c5000b71268c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:18.394077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3a6a914-1dc3-495e-8bf0-c5000b71268c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:18.398645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3a6a914-1dc3-495e-8bf0-c5000b71268c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:18.401450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3a6a914-1dc3-495e-8bf0-c5000b71268c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:18.407748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3a6a914-1dc3-495e-8bf0-c5000b71268c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:18.516021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-85cc97eb-06a4-4515-9ea6-b4ffca49cd25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:18.516864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-85cc97eb-06a4-4515-9ea6-b4ffca49cd25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:18.545682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85cc97eb-06a4-4515-9ea6-b4ffca49cd25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:18.546148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85cc97eb-06a4-4515-9ea6-b4ffca49cd25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:18.551926 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85cc97eb-06a4-4515-9ea6-b4ffca49cd25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:18.552466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85cc97eb-06a4-4515-9ea6-b4ffca49cd25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:19.189813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:19.373309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a3a6a914-1dc3-495e-8bf0-c5000b71268c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:19.389618 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a3a6a914-1dc3-495e-8bf0-c5000b71268c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1520 microversion: 2.1 time: 1.036904 Aug 03 01:54:19.396725 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 879/1768] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:18 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1520 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:19.407117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-31dd3295-56c5-4acf-82c8-5e4fb32efa39 req-ecf952b7-94ca-457d-a00a-c3831fa20d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d342ed3e-ca89-47e4-8421-3e0e26e2812b", "tag": "a51da6f5-db5e-46eb-88ed-439bce78ecf4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:19.463394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-31dd3295-56c5-4acf-82c8-5e4fb32efa39 req-ecf952b7-94ca-457d-a00a-c3831fa20d47 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:19.467564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-31dd3295-56c5-4acf-82c8-5e4fb32efa39 req-ecf952b7-94ca-457d-a00a-c3831fa20d47 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:19.540836 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-31dd3295-56c5-4acf-82c8-5e4fb32efa39 req-ecf952b7-94ca-457d-a00a-c3831fa20d47 service nova] Creating event network-changed:a51da6f5-db5e-46eb-88ed-439bce78ecf4 for instance d342ed3e-ca89-47e4-8421-3e0e26e2812b on n-h2-826529-8 Aug 03 01:54:19.556762 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-31dd3295-56c5-4acf-82c8-5e4fb32efa39 req-ecf952b7-94ca-457d-a00a-c3831fa20d47 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154978 Aug 03 01:54:19.558270 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 880/1769] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:19.571948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-128b1545-4954-49eb-85a7-c5ab74083638 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:19.574968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-128b1545-4954-49eb-85a7-c5ab74083638 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:19.592031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-128b1545-4954-49eb-85a7-c5ab74083638 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:19.594238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-128b1545-4954-49eb-85a7-c5ab74083638 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:19.598792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-128b1545-4954-49eb-85a7-c5ab74083638 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:19.599521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-128b1545-4954-49eb-85a7-c5ab74083638 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:19.712719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-85cc97eb-06a4-4515-9ea6-b4ffca49cd25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:19.733032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-85cc97eb-06a4-4515-9ea6-b4ffca49cd25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:19.735221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-85cc97eb-06a4-4515-9ea6-b4ffca49cd25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:19.744520 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-85cc97eb-06a4-4515-9ea6-b4ffca49cd25 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 1.235011 Aug 03 01:54:19.745545 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 890/1770] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:18 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:19.759931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-58e8d693-c58e-4af2-8a2d-3d010481c264 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:19.761129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-58e8d693-c58e-4af2-8a2d-3d010481c264 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:19.781020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58e8d693-c58e-4af2-8a2d-3d010481c264 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:19.781898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58e8d693-c58e-4af2-8a2d-3d010481c264 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:19.787445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58e8d693-c58e-4af2-8a2d-3d010481c264 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:19.790304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58e8d693-c58e-4af2-8a2d-3d010481c264 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:19.985708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=38 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:20.120791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-128b1545-4954-49eb-85a7-c5ab74083638 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:20.135910 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-128b1545-4954-49eb-85a7-c5ab74083638 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1304 microversion: 2.1 time: 0.574930 Aug 03 01:54:20.138671 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 881/1771] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:19 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1304 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:20.311351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-58e8d693-c58e-4af2-8a2d-3d010481c264 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:20.385842 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-58e8d693-c58e-4af2-8a2d-3d010481c264 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1313 microversion: 2.1 time: 0.633592 Aug 03 01:54:20.389942 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 891/1772] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:19 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:20.421104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f1c706a7-9949-4954-b7ad-71d5f5030fa2 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:20.422590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f1c706a7-9949-4954-b7ad-71d5f5030fa2 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:20.462829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1c706a7-9949-4954-b7ad-71d5f5030fa2 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:20.465828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1c706a7-9949-4954-b7ad-71d5f5030fa2 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:20.475892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1c706a7-9949-4954-b7ad-71d5f5030fa2 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:20.476453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1c706a7-9949-4954-b7ad-71d5f5030fa2 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:20.781346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4cceb36e-f840-43a8-a6f5-3d3c4c8a1aff tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:20.782937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4cceb36e-f840-43a8-a6f5-3d3c4c8a1aff tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:20.828860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4cceb36e-f840-43a8-a6f5-3d3c4c8a1aff tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:20.837162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4cceb36e-f840-43a8-a6f5-3d3c4c8a1aff tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:20.842157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4cceb36e-f840-43a8-a6f5-3d3c4c8a1aff tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:20.845727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4cceb36e-f840-43a8-a6f5-3d3c4c8a1aff tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:22.084989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f1c706a7-9949-4954-b7ad-71d5f5030fa2 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:22.121963 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f1c706a7-9949-4954-b7ad-71d5f5030fa2 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1520 microversion: 2.1 time: 1.706399 Aug 03 01:54:22.134769 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 882/1773] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:20 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1520 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:22.143530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-33c89465-1050-4f0b-9ff9-a4834a554f4f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:22.155762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-33c89465-1050-4f0b-9ff9-a4834a554f4f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:22.199674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33c89465-1050-4f0b-9ff9-a4834a554f4f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:22.200483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33c89465-1050-4f0b-9ff9-a4834a554f4f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:22.201946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33c89465-1050-4f0b-9ff9-a4834a554f4f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:22.220940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33c89465-1050-4f0b-9ff9-a4834a554f4f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:22.340374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4cceb36e-f840-43a8-a6f5-3d3c4c8a1aff tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:22.396776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4cceb36e-f840-43a8-a6f5-3d3c4c8a1aff tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:22.409929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4cceb36e-f840-43a8-a6f5-3d3c4c8a1aff tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:22.409929 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4cceb36e-f840-43a8-a6f5-3d3c4c8a1aff tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 1.633246 Aug 03 01:54:22.410433 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 892/1774] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:20 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:54:22.422401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f74ba280-5a42-438e-9093-10c861e0a205 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:22.425302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f74ba280-5a42-438e-9093-10c861e0a205 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:22.447424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f74ba280-5a42-438e-9093-10c861e0a205 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:22.448324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f74ba280-5a42-438e-9093-10c861e0a205 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:22.449390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f74ba280-5a42-438e-9093-10c861e0a205 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:22.450015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f74ba280-5a42-438e-9093-10c861e0a205 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:23.219434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f74ba280-5a42-438e-9093-10c861e0a205 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:23.233856 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f74ba280-5a42-438e-9093-10c861e0a205 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1463 microversion: 2.1 time: 0.822214 Aug 03 01:54:23.247256 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 893/1775] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:22 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1463 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:23.247256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2010f688-ff01-48f5-b66d-ea291e58f2b5 req-762f5b53-eac9-4d67-ae65-773ff0c33085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb30620-408d-468e-b706-277ce080a2f6", "name": "network-vif-plugged", "status": "completed", "tag": "9762e114-938b-48d4-8d92-0fae9855c76e"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:23.248034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-33c89465-1050-4f0b-9ff9-a4834a554f4f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:23.277426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2010f688-ff01-48f5-b66d-ea291e58f2b5 req-762f5b53-eac9-4d67-ae65-773ff0c33085 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:23.278137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2010f688-ff01-48f5-b66d-ea291e58f2b5 req-762f5b53-eac9-4d67-ae65-773ff0c33085 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:23.281481 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-33c89465-1050-4f0b-9ff9-a4834a554f4f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1304 microversion: 2.1 time: 1.139101 Aug 03 01:54:23.286099 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 883/1776] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:22 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1304 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:23.299494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2834cb2c-68d1-4276-8180-06d2eaa7cffa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:23.301664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2834cb2c-68d1-4276-8180-06d2eaa7cffa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:23.305337 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2010f688-ff01-48f5-b66d-ea291e58f2b5 req-762f5b53-eac9-4d67-ae65-773ff0c33085 service nova] Creating event network-vif-plugged:9762e114-938b-48d4-8d92-0fae9855c76e for instance 0eb30620-408d-468e-b706-277ce080a2f6 on n-h1-826529-8 Aug 03 01:54:23.315988 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2010f688-ff01-48f5-b66d-ea291e58f2b5 req-762f5b53-eac9-4d67-ae65-773ff0c33085 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079781 Aug 03 01:54:23.323970 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 894/1777] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:23.334401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c1f75475-2194-43b5-a30f-c2424719f45c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:23.340944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2834cb2c-68d1-4276-8180-06d2eaa7cffa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:23.341621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2834cb2c-68d1-4276-8180-06d2eaa7cffa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:23.342136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c1f75475-2194-43b5-a30f-c2424719f45c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:23.342628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2834cb2c-68d1-4276-8180-06d2eaa7cffa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:23.342980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2834cb2c-68d1-4276-8180-06d2eaa7cffa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:23.362421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1f75475-2194-43b5-a30f-c2424719f45c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:23.363981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1f75475-2194-43b5-a30f-c2424719f45c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:23.365066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1f75475-2194-43b5-a30f-c2424719f45c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:23.369640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1f75475-2194-43b5-a30f-c2424719f45c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:24.003577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2834cb2c-68d1-4276-8180-06d2eaa7cffa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:24.027010 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2834cb2c-68d1-4276-8180-06d2eaa7cffa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1500 microversion: 2.1 time: 0.738635 Aug 03 01:54:24.030181 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 884/1778] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:23 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1500 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:24.036075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e4af1ff0-a02b-4214-88c2-4d2332c7bf2a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:24.036401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e4af1ff0-a02b-4214-88c2-4d2332c7bf2a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:24.073794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4af1ff0-a02b-4214-88c2-4d2332c7bf2a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:24.074271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4af1ff0-a02b-4214-88c2-4d2332c7bf2a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:24.087217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4af1ff0-a02b-4214-88c2-4d2332c7bf2a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:24.088623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4af1ff0-a02b-4214-88c2-4d2332c7bf2a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:24.209734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c1f75475-2194-43b5-a30f-c2424719f45c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:24.225568 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c1f75475-2194-43b5-a30f-c2424719f45c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1312 microversion: 2.1 time: 0.898319 Aug 03 01:54:24.231849 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 895/1779] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:23 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1312 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:24.253636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-47bf61a7-8455-47e2-afa7-99c34ab3b02d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26bb0c23-a799-4c12-ba4a-b8040d254cf2"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:24.257137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-47bf61a7-8455-47e2-afa7-99c34ab3b02d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:24.268612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-47bf61a7-8455-47e2-afa7-99c34ab3b02d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:24.270671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-47bf61a7-8455-47e2-afa7-99c34ab3b02d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:24.272603 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-47bf61a7-8455-47e2-afa7-99c34ab3b02d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:24.273615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-47bf61a7-8455-47e2-afa7-99c34ab3b02d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:24.331094 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-47bf61a7-8455-47e2-afa7-99c34ab3b02d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] HTTP exception thrown: Cannot 'attach_volume' instance c8397a8e-08c7-4844-90eb-80949ac27e92 while it is in vm_state rescued Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-47bf61a7-8455-47e2-afa7-99c34ab3b02d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Request method failure captured: Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92/os-volume_attachments HTTP/1.1 Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 74 Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dTll7VklSXVKPY7IA1_5ob-tKVm2Z_7z42qGXzDSvTdwVAzc-uu26I_RdtLVhoAwHCuPbYMUDNABwS67wYISa8yagl02RQzcDUh0SQ8u7p5lboe4i0RQPeTExpnFXWWBwbJADXBFZ5wGYauWv3NNIL4oxW8HVYZDtaGv8yUqCCibqo Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c183e2fc6dbb419fbd8fa81c90163adf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}] Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0b99d344c16b4221bcccfe37d32bb69e Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: {"volumeAttachment": {"volumeId": "26bb0c23-a799-4c12-ba4a-b8040d254cf2"}} Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: exception: Cannot 'attach_volume' instance c8397a8e-08c7-4844-90eb-80949ac27e92 while it is in vm_state rescued Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'server_id': 'c8397a8e-08c7-4844-90eb-80949ac27e92', 'body': {'volumeAttachment': {'volumeId': '26bb0c23-a799-4c12-ba4a-b8040d254cf2'}}} Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c8397a8e-08c7-4844-90eb-80949ac27e92 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 03 01:54:24.352625 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 01:54:24.362387 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 01:54:24.362387 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 01:54:24.362387 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c8397a8e-08c7-4844-90eb-80949ac27e92 while it is in vm_state rescued Aug 03 01:54:24.362387 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:54:24.362387 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:54:24.362387 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:54:24.362387 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:54:24.362387 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:54:24.362387 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:54:24.362387 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:54:24.362387 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:54:24.362387 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c8397a8e-08c7-4844-90eb-80949ac27e92 while it is in vm_state rescued Aug 03 01:54:24.362387 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:54:24.368978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-47bf61a7-8455-47e2-afa7-99c34ab3b02d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Returning 409 to user: Cannot 'attach_volume' instance c8397a8e-08c7-4844-90eb-80949ac27e92 while it is in vm_state rescued {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:54:24.368978 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-47bf61a7-8455-47e2-afa7-99c34ab3b02d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.127588 Aug 03 01:54:24.369811 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 896/1780] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 01:54:24 2022] POST /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92/os-volume_attachments => generated 152 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:54:24.375833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e115bcad-76ea-40da-ba83-0e1219593ed2 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:24.376974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e115bcad-76ea-40da-ba83-0e1219593ed2 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:24.391315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e115bcad-76ea-40da-ba83-0e1219593ed2 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:24.396171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e115bcad-76ea-40da-ba83-0e1219593ed2 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:24.399404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e115bcad-76ea-40da-ba83-0e1219593ed2 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:24.400212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e115bcad-76ea-40da-ba83-0e1219593ed2 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:24.532175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e4af1ff0-a02b-4214-88c2-4d2332c7bf2a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:24.568505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e4af1ff0-a02b-4214-88c2-4d2332c7bf2a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:24.576394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e4af1ff0-a02b-4214-88c2-4d2332c7bf2a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:24.584711 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e4af1ff0-a02b-4214-88c2-4d2332c7bf2a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.553147 Aug 03 01:54:24.587499 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 885/1781] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:24 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:24.602674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7303bf32-a085-4b91-81b4-bde0e6179a93 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:24.603639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7303bf32-a085-4b91-81b4-bde0e6179a93 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:24.621006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7303bf32-a085-4b91-81b4-bde0e6179a93 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:24.624606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7303bf32-a085-4b91-81b4-bde0e6179a93 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:24.630049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7303bf32-a085-4b91-81b4-bde0e6179a93 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:24.634717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7303bf32-a085-4b91-81b4-bde0e6179a93 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:24.877006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e115bcad-76ea-40da-ba83-0e1219593ed2 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:24.891637 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7303bf32-a085-4b91-81b4-bde0e6179a93 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92/action" status: 202 len: 0 microversion: 2.1 time: 0.301825 Aug 03 01:54:24.898380 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 886/1782] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:54:24 2022] POST /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:54:24.903800 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e115bcad-76ea-40da-ba83-0e1219593ed2 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1292 microversion: 2.1 time: 0.532351 Aug 03 01:54:24.904414 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 897/1783] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:24 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1292 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:24.925553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-83796e67-067a-4608-8e2c-746633e97c0f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:24.928676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-83796e67-067a-4608-8e2c-746633e97c0f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:24.945633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83796e67-067a-4608-8e2c-746633e97c0f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:24.947300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83796e67-067a-4608-8e2c-746633e97c0f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:24.950516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83796e67-067a-4608-8e2c-746633e97c0f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:24.951218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83796e67-067a-4608-8e2c-746633e97c0f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:25.253169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3ba5f5a4-2094-42b9-a0cb-b430d1d576d8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:25.254690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3ba5f5a4-2094-42b9-a0cb-b430d1d576d8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:25.267803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ba5f5a4-2094-42b9-a0cb-b430d1d576d8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:25.271868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ba5f5a4-2094-42b9-a0cb-b430d1d576d8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:25.280755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ba5f5a4-2094-42b9-a0cb-b430d1d576d8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:25.280755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ba5f5a4-2094-42b9-a0cb-b430d1d576d8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:25.795516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-83796e67-067a-4608-8e2c-746633e97c0f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:25.817056 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-83796e67-067a-4608-8e2c-746633e97c0f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1508 microversion: 2.1 time: 0.915830 Aug 03 01:54:25.818112 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 887/1784] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:24 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1508 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:25.839026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0d78f5ba-2611-4d67-bb38-c8c053cb05ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:25.839677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0d78f5ba-2611-4d67-bb38-c8c053cb05ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:25.861116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d78f5ba-2611-4d67-bb38-c8c053cb05ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:25.869025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d78f5ba-2611-4d67-bb38-c8c053cb05ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:25.869903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d78f5ba-2611-4d67-bb38-c8c053cb05ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:25.870354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d78f5ba-2611-4d67-bb38-c8c053cb05ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:25.950620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3ba5f5a4-2094-42b9-a0cb-b430d1d576d8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:25.967545 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3ba5f5a4-2094-42b9-a0cb-b430d1d576d8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1312 microversion: 2.1 time: 0.720286 Aug 03 01:54:25.968214 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 898/1785] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:25 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1312 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:54:25.982422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-58e13e9b-4da0-45b8-b377-b27e1fd8b0cf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:25.983396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-58e13e9b-4da0-45b8-b377-b27e1fd8b0cf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:26.004842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58e13e9b-4da0-45b8-b377-b27e1fd8b0cf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:26.007952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58e13e9b-4da0-45b8-b377-b27e1fd8b0cf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:26.009211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58e13e9b-4da0-45b8-b377-b27e1fd8b0cf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:26.014432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58e13e9b-4da0-45b8-b377-b27e1fd8b0cf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:26.551174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-58e13e9b-4da0-45b8-b377-b27e1fd8b0cf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:26.568086 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-58e13e9b-4da0-45b8-b377-b27e1fd8b0cf tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1292 microversion: 2.1 time: 0.595835 Aug 03 01:54:26.569044 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 899/1786] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:25 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1292 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:26.665814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0d78f5ba-2611-4d67-bb38-c8c053cb05ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:26.682870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0d78f5ba-2611-4d67-bb38-c8c053cb05ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:26.688527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0d78f5ba-2611-4d67-bb38-c8c053cb05ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:26.690382 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0d78f5ba-2611-4d67-bb38-c8c053cb05ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.870683 Aug 03 01:54:26.693399 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 888/1787] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:25 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:26.842280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9eb3161e-78c8-4f53-9188-9fdd0e0dfa54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:26.844054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9eb3161e-78c8-4f53-9188-9fdd0e0dfa54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:26.857633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9eb3161e-78c8-4f53-9188-9fdd0e0dfa54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:26.859568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9eb3161e-78c8-4f53-9188-9fdd0e0dfa54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:26.862386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9eb3161e-78c8-4f53-9188-9fdd0e0dfa54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:26.865808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9eb3161e-78c8-4f53-9188-9fdd0e0dfa54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:26.966937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1929129356", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "53d4fe2c-f615-4656-9157-a036740f9e27"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:27.005416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:27.107434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] validate_networks() for [('53d4fe2c-f615-4656-9157-a036740f9e27', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:54:27.987388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:54:27.989613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:54:27.990693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:54:27.991688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:54:27.992666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:54:28.021532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9eb3161e-78c8-4f53-9188-9fdd0e0dfa54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:28.039640 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9eb3161e-78c8-4f53-9188-9fdd0e0dfa54 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1508 microversion: 2.1 time: 1.202004 Aug 03 01:54:28.040261 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 889/1788] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:26 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1508 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:28.059348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:28.060133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:28.061727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:28.061926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fe7b52c3-e31f-4984-8dda-39c17af170f4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:28.062562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fe7b52c3-e31f-4984-8dda-39c17af170f4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:28.063303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:28.098232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe7b52c3-e31f-4984-8dda-39c17af170f4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:28.103380 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe7b52c3-e31f-4984-8dda-39c17af170f4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:28.104901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Getting quotas for project 6bf2395335564acdaf819f2175dbd3bc. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:54:28.106992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe7b52c3-e31f-4984-8dda-39c17af170f4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:28.112031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe7b52c3-e31f-4984-8dda-39c17af170f4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:28.134242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Getting quotas for user 47e6a189229d4f8ab3aa4ca416d84594 and project 6bf2395335564acdaf819f2175dbd3bc. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:54:28.180209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:54:28.187315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:54:28.313383 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4dc26ac4-5857-4e99-84d3-7d8047728ccc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.737276 Aug 03 01:54:28.325943 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 900/1789] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:54:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:54:28.465568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1868254869", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "8e537b82-50a4-41ed-8349-a0fff0c27c7a"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:28.484901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fe7b52c3-e31f-4984-8dda-39c17af170f4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:28.501223 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fe7b52c3-e31f-4984-8dda-39c17af170f4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1460 microversion: 2.1 time: 0.448567 Aug 03 01:54:28.502062 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 890/1790] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:28 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1460 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:28.551144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9de38eb0-3bb5-4bcb-9449-10ecfa16f4aa tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:28.557592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9de38eb0-3bb5-4bcb-9449-10ecfa16f4aa tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:28.574578 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9de38eb0-3bb5-4bcb-9449-10ecfa16f4aa tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:28.575077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9de38eb0-3bb5-4bcb-9449-10ecfa16f4aa tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:28.577073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] validate_networks() for [('8e537b82-50a4-41ed-8349-a0fff0c27c7a', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:54:28.592063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9de38eb0-3bb5-4bcb-9449-10ecfa16f4aa tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:28.592063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9de38eb0-3bb5-4bcb-9449-10ecfa16f4aa tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:29.179143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9de38eb0-3bb5-4bcb-9449-10ecfa16f4aa tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:29.218269 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9de38eb0-3bb5-4bcb-9449-10ecfa16f4aa tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1292 microversion: 2.1 time: 0.694077 Aug 03 01:54:29.221028 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 891/1791] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:28 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1292 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:29.257660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0a2344c0-1341-402f-b0eb-811fcd0a7c47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:29.258998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0a2344c0-1341-402f-b0eb-811fcd0a7c47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:29.281530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a2344c0-1341-402f-b0eb-811fcd0a7c47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:29.305506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a2344c0-1341-402f-b0eb-811fcd0a7c47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:29.320322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a2344c0-1341-402f-b0eb-811fcd0a7c47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:29.321126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a2344c0-1341-402f-b0eb-811fcd0a7c47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:29.973795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0a2344c0-1341-402f-b0eb-811fcd0a7c47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:29.998047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0a2344c0-1341-402f-b0eb-811fcd0a7c47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:30.008536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0a2344c0-1341-402f-b0eb-811fcd0a7c47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:30.017455 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0a2344c0-1341-402f-b0eb-811fcd0a7c47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.786928 Aug 03 01:54:30.019175 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 892/1792] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:29 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:30.032842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cd549fcf-9395-4e25-a184-c4564c5f84af tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:30.033914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cd549fcf-9395-4e25-a184-c4564c5f84af tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:30.059285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:54:30.060538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:54:30.061548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:54:30.062218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:54:30.062895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:54:30.072410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd549fcf-9395-4e25-a184-c4564c5f84af tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:30.074706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd549fcf-9395-4e25-a184-c4564c5f84af tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:30.077077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd549fcf-9395-4e25-a184-c4564c5f84af tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:30.077801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd549fcf-9395-4e25-a184-c4564c5f84af tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:30.088171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:30.089034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:30.091225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:30.095362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:30.149447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Getting quotas for project b8e505cc680d45e7821ddecfcdd83f61. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:54:30.162483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Getting quotas for user 42139a78ef8e475cbef24afd7751abf8 and project b8e505cc680d45e7821ddecfcdd83f61. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:54:30.215627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:54:30.218279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:54:30.239839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cd549fcf-9395-4e25-a184-c4564c5f84af tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:30.243720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:30.249867 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cd549fcf-9395-4e25-a184-c4564c5f84af tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784" status: 200 len: 1260 microversion: 2.1 time: 0.228471 Aug 03 01:54:30.254693 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 893/1793] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:30 2022] GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:30.264149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1619409827", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "0eb30620-408d-468e-b706-277ce080a2f6"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:30.338213 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-44c28a9d-6736-4a21-89cb-caccae8b26ce tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.009772 Aug 03 01:54:30.347975 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 901/1794] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:54:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:54:30.356507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b28585b5-89d0-4f48-be9f-d8b1869d326d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:30.357472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b28585b5-89d0-4f48-be9f-d8b1869d326d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:30.359014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:54:30.367268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b28585b5-89d0-4f48-be9f-d8b1869d326d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:30.368161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b28585b5-89d0-4f48-be9f-d8b1869d326d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:30.369230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b28585b5-89d0-4f48-be9f-d8b1869d326d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:30.370584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b28585b5-89d0-4f48-be9f-d8b1869d326d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:31.633364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b28585b5-89d0-4f48-be9f-d8b1869d326d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:31.648733 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b28585b5-89d0-4f48-be9f-d8b1869d326d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1514 microversion: 2.1 time: 1.299551 Aug 03 01:54:31.655606 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 902/1795] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:30 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1514 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:31.686112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ddcb6f47-3ef8-48a8-8721-e33e29227e0c tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:31.686927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ddcb6f47-3ef8-48a8-8721-e33e29227e0c tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:31.698562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddcb6f47-3ef8-48a8-8721-e33e29227e0c tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:31.699536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddcb6f47-3ef8-48a8-8721-e33e29227e0c tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:31.700544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddcb6f47-3ef8-48a8-8721-e33e29227e0c tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:31.701261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddcb6f47-3ef8-48a8-8721-e33e29227e0c tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:32.035091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:54:32.047231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:54:32.051674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:54:32.053908 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:54:32.054806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:54:32.090405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:32.090939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:32.095138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:32.100199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:32.214559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Getting quotas for project 655a411b3b2542f7b62d41257e7bf806. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:54:32.260033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Getting quotas for user d5950dd979ef4fa4a26acdd6a50c75a5 and project 655a411b3b2542f7b62d41257e7bf806. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:54:32.328996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:54:32.334811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:54:32.490869 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-44313e40-e5ba-4a81-9226-1e13ee69aab3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.234227 Aug 03 01:54:32.492238 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 894/1796] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:54:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:54:32.497822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-120b821a-d21f-450e-bf79-fd8a85353e01 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:32.498760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-120b821a-d21f-450e-bf79-fd8a85353e01 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:32.510485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-120b821a-d21f-450e-bf79-fd8a85353e01 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:32.511475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-120b821a-d21f-450e-bf79-fd8a85353e01 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:32.512625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-120b821a-d21f-450e-bf79-fd8a85353e01 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:32.513532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-120b821a-d21f-450e-bf79-fd8a85353e01 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:33.154743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ddcb6f47-3ef8-48a8-8721-e33e29227e0c tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:33.170125 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ddcb6f47-3ef8-48a8-8721-e33e29227e0c tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1292 microversion: 2.1 time: 1.501087 Aug 03 01:54:33.172705 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 903/1797] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:31 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1292 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:33.190156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1f32e9e8-2a4d-4291-8d94-1fd7276d76e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:33.191318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1f32e9e8-2a4d-4291-8d94-1fd7276d76e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:33.214059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f32e9e8-2a4d-4291-8d94-1fd7276d76e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:33.217447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f32e9e8-2a4d-4291-8d94-1fd7276d76e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:33.220804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f32e9e8-2a4d-4291-8d94-1fd7276d76e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:33.221482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f32e9e8-2a4d-4291-8d94-1fd7276d76e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:33.328723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-120b821a-d21f-450e-bf79-fd8a85353e01 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42139a78ef8e475cbef24afd7751abf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e505cc680d45e7821ddecfcdd83f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:33.338540 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-120b821a-d21f-450e-bf79-fd8a85353e01 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b" status: 200 len: 1276 microversion: 2.1 time: 0.844967 Aug 03 01:54:33.345075 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 895/1798] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:32 2022] GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b => generated 1276 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:33.365624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3d7fbfd9-fdb8-4564-80f1-133b29162a26 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:33.368592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3d7fbfd9-fdb8-4564-80f1-133b29162a26 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:33.395605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d7fbfd9-fdb8-4564-80f1-133b29162a26 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:33.403412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d7fbfd9-fdb8-4564-80f1-133b29162a26 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:33.406453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d7fbfd9-fdb8-4564-80f1-133b29162a26 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:33.407505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d7fbfd9-fdb8-4564-80f1-133b29162a26 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:34.101685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3d7fbfd9-fdb8-4564-80f1-133b29162a26 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:34.127156 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3d7fbfd9-fdb8-4564-80f1-133b29162a26 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784" status: 200 len: 1308 microversion: 2.1 time: 0.780234 Aug 03 01:54:34.140249 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 896/1799] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:33 2022] GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 => generated 1308 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:34.164062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a4e4a2d5-3e3c-4046-826a-0b3451d4f293 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:34.164640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a4e4a2d5-3e3c-4046-826a-0b3451d4f293 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:34.169427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1f32e9e8-2a4d-4291-8d94-1fd7276d76e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:34.177551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4e4a2d5-3e3c-4046-826a-0b3451d4f293 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:34.178947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:34.181270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4e4a2d5-3e3c-4046-826a-0b3451d4f293 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:34.184855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4e4a2d5-3e3c-4046-826a-0b3451d4f293 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:34.185489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4e4a2d5-3e3c-4046-826a-0b3451d4f293 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:34.194169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1f32e9e8-2a4d-4291-8d94-1fd7276d76e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:34.199998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1f32e9e8-2a4d-4291-8d94-1fd7276d76e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:34.207171 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1f32e9e8-2a4d-4291-8d94-1fd7276d76e2 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 1.032810 Aug 03 01:54:34.222943 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 904/1800] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:33 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:34.224292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c10ded73-c7d8-45ff-9e18-e730ea81609a tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:34.233733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c10ded73-c7d8-45ff-9e18-e730ea81609a tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:34.265276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c10ded73-c7d8-45ff-9e18-e730ea81609a tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:34.267402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c10ded73-c7d8-45ff-9e18-e730ea81609a tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:34.268732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c10ded73-c7d8-45ff-9e18-e730ea81609a tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:34.269748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c10ded73-c7d8-45ff-9e18-e730ea81609a tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:34.516627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a4e4a2d5-3e3c-4046-826a-0b3451d4f293 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:34.535039 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a4e4a2d5-3e3c-4046-826a-0b3451d4f293 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 200 len: 1266 microversion: 2.1 time: 0.384407 Aug 03 01:54:34.535801 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 897/1801] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:34 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:34.561309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-57dedc35-33f0-4c6d-a281-17e96e30a119 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:34.561950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-57dedc35-33f0-4c6d-a281-17e96e30a119 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:34.587454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57dedc35-33f0-4c6d-a281-17e96e30a119 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:34.587951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57dedc35-33f0-4c6d-a281-17e96e30a119 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:34.591732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57dedc35-33f0-4c6d-a281-17e96e30a119 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:34.592199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57dedc35-33f0-4c6d-a281-17e96e30a119 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:34.746841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c10ded73-c7d8-45ff-9e18-e730ea81609a tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:34.781623 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c10ded73-c7d8-45ff-9e18-e730ea81609a tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1292 microversion: 2.1 time: 0.570338 Aug 03 01:54:34.782499 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 905/1802] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:34 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1292 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:34.800807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1081689976", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "8587fddf-9abd-4c52-98e3-97c18dcab027"}], "block_device_mapping_v2": [{"uuid": "cc7745f1-be48-49a9-8540-3f0606c1dcc7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:34.877243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-57dedc35-33f0-4c6d-a281-17e96e30a119 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42139a78ef8e475cbef24afd7751abf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e505cc680d45e7821ddecfcdd83f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:34.887362 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-57dedc35-33f0-4c6d-a281-17e96e30a119 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b" status: 200 len: 1274 microversion: 2.1 time: 0.344817 Aug 03 01:54:34.900955 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 898/1803] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:34 2022] GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b => generated 1274 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:34.909196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a1d26235-7199-4230-9656-31f86278ac99 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'create', calling method: .version_select at 0x7f5b244e4670>, body: {"keypair": {"name": "tempest-keypair-57918381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6bsy/jXlyB4mDSBmEhf3Nd+IJwaSHgRwpJ6kQeE1W5KUkhZ6tPk7k6BK6RSo1oW7k8hU7wLPaPFJsdeLmWblEkjOQirEYo//4K6BRZ2ZKmbymnF80bhpXPtcJL0uGenQ=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:34.911987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] validate_networks() for [('8587fddf-9abd-4c52-98e3-97c18dcab027', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:54:34.918257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:34.928784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-a1d26235-7199-4230-9656-31f86278ac99 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Getting quotas for project c183e2fc6dbb419fbd8fa81c90163adf. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:54:34.933930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-a1d26235-7199-4230-9656-31f86278ac99 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Getting quotas for user 0b99d344c16b4221bcccfe37d32bb69e and project c183e2fc6dbb419fbd8fa81c90163adf. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:54:34.981860 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a1d26235-7199-4230-9656-31f86278ac99 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.079562 Aug 03 01:54:34.983327 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 899/1804] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 01:54:34 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:34.993792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-89e212d6-260c-4c10-b62b-bc1b9713261c req-ad42c718-8108-4697-bb4d-7c176390d114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d342ed3e-ca89-47e4-8421-3e0e26e2812b", "name": "network-vif-plugged", "status": "completed", "tag": "a51da6f5-db5e-46eb-88ed-439bce78ecf4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:35.014443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-89e212d6-260c-4c10-b62b-bc1b9713261c req-ad42c718-8108-4697-bb4d-7c176390d114 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:35.015547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-89e212d6-260c-4c10-b62b-bc1b9713261c req-ad42c718-8108-4697-bb4d-7c176390d114 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:35.029948 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-89e212d6-260c-4c10-b62b-bc1b9713261c req-ad42c718-8108-4697-bb4d-7c176390d114 service nova] Creating event network-vif-plugged:a51da6f5-db5e-46eb-88ed-439bce78ecf4 for instance d342ed3e-ca89-47e4-8421-3e0e26e2812b on n-h2-826529-8 Aug 03 01:54:35.037398 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-89e212d6-260c-4c10-b62b-bc1b9713261c req-ad42c718-8108-4697-bb4d-7c176390d114 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052340 Aug 03 01:54:35.038023 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 900/1805] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:35.153181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-842d9acf-f5b3-4c42-83b6-926cdec9efdc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:35.153887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-842d9acf-f5b3-4c42-83b6-926cdec9efdc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:35.165166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-842d9acf-f5b3-4c42-83b6-926cdec9efdc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:35.165627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-842d9acf-f5b3-4c42-83b6-926cdec9efdc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:35.167344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-842d9acf-f5b3-4c42-83b6-926cdec9efdc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:35.168014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-842d9acf-f5b3-4c42-83b6-926cdec9efdc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:35.659347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-842d9acf-f5b3-4c42-83b6-926cdec9efdc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:35.678420 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-842d9acf-f5b3-4c42-83b6-926cdec9efdc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784" status: 200 len: 1308 microversion: 2.1 time: 0.527616 Aug 03 01:54:35.679686 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 901/1806] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:35 2022] GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 => generated 1308 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:35.688006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e2e00ca8-ca59-4362-9dc6-7479e50a3742 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:35.689682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e2e00ca8-ca59-4362-9dc6-7479e50a3742 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:35.699530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2e00ca8-ca59-4362-9dc6-7479e50a3742 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:35.701010 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2e00ca8-ca59-4362-9dc6-7479e50a3742 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:35.701010 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2e00ca8-ca59-4362-9dc6-7479e50a3742 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:35.701308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2e00ca8-ca59-4362-9dc6-7479e50a3742 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:36.030737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e2e00ca8-ca59-4362-9dc6-7479e50a3742 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:36.041600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e2e00ca8-ca59-4362-9dc6-7479e50a3742 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:36.043186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e2e00ca8-ca59-4362-9dc6-7479e50a3742 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:36.044382 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e2e00ca8-ca59-4362-9dc6-7479e50a3742 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1814 microversion: 2.25 time: 0.363089 Aug 03 01:54:36.044949 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 902/1807] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:35 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1814 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:36.051215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:54:36.051837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:54:36.052330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:54:36.052750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:54:36.053171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:54:36.057911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-86e05942-8ac7-4f75-a107-9170f2c70e0f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:36.059573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-86e05942-8ac7-4f75-a107-9170f2c70e0f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:36.068527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:36.069038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:36.069539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86e05942-8ac7-4f75-a107-9170f2c70e0f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:36.070126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:36.070862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86e05942-8ac7-4f75-a107-9170f2c70e0f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:36.071090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:36.071893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86e05942-8ac7-4f75-a107-9170f2c70e0f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:36.072406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86e05942-8ac7-4f75-a107-9170f2c70e0f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:36.105922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Getting quotas for project 5f232cf4e61b4213b592b2a020961630. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:54:36.114481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Getting quotas for user dd2c77c8ab314584939f1f580d5a6d14 and project 5f232cf4e61b4213b592b2a020961630. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:54:36.187163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-86e05942-8ac7-4f75-a107-9170f2c70e0f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:36.196103 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-86e05942-8ac7-4f75-a107-9170f2c70e0f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 200 len: 1272 microversion: 2.1 time: 0.144493 Aug 03 01:54:36.202810 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 903/1808] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:36 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:36.208289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:54:36.218495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc7745f1-be48-49a9-8540-3f0606c1dcc7',volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:54:36.220118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-936c00d5-90d6-4d18-a608-a82c7bc08460 req-313fab81-ae83-4206-88c9-9e6b1f72b0cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e79bb51-ff27-4ccf-b55a-b7eed7f8a784", "tag": "af3cfa3a-3bec-4ec8-94d2-c7b32c593e70"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:36.230580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-936c00d5-90d6-4d18-a608-a82c7bc08460 req-313fab81-ae83-4206-88c9-9e6b1f72b0cb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:36.231462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-936c00d5-90d6-4d18-a608-a82c7bc08460 req-313fab81-ae83-4206-88c9-9e6b1f72b0cb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:36.245801 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-936c00d5-90d6-4d18-a608-a82c7bc08460 req-313fab81-ae83-4206-88c9-9e6b1f72b0cb service nova] Creating event network-changed:af3cfa3a-3bec-4ec8-94d2-c7b32c593e70 for instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 on n-h1-826529-8 Aug 03 01:54:36.255526 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-936c00d5-90d6-4d18-a608-a82c7bc08460 req-313fab81-ae83-4206-88c9-9e6b1f72b0cb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051296 Aug 03 01:54:36.258041 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 904/1809] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:36.264913 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cc1b36ed-3db7-4c6c-a1ef-91e282220dc9 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:36.265876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cc1b36ed-3db7-4c6c-a1ef-91e282220dc9 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:36.281230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cc1b36ed-3db7-4c6c-a1ef-91e282220dc9 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:36.282191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cc1b36ed-3db7-4c6c-a1ef-91e282220dc9 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:36.286272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cc1b36ed-3db7-4c6c-a1ef-91e282220dc9 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:36.286923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cc1b36ed-3db7-4c6c-a1ef-91e282220dc9 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:36.433516 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-27f604e1-5030-4819-9510-803303061234 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.646113 Aug 03 01:54:36.434541 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 906/1810] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:54:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:54:36.448867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-344587fd-524a-4c4a-abed-4820cd30d354 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:36.449763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-344587fd-524a-4c4a-abed-4820cd30d354 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:36.462137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-344587fd-524a-4c4a-abed-4820cd30d354 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:36.463119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-344587fd-524a-4c4a-abed-4820cd30d354 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:36.464145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-344587fd-524a-4c4a-abed-4820cd30d354 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:36.464773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-344587fd-524a-4c4a-abed-4820cd30d354 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:36.731285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cc1b36ed-3db7-4c6c-a1ef-91e282220dc9 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:36.744472 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cc1b36ed-3db7-4c6c-a1ef-91e282220dc9 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1292 microversion: 2.1 time: 0.484967 Aug 03 01:54:36.751869 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 905/1811] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:36 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1292 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:36.764018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b37cf9f5-5871-42e4-acd0-24743a7e48e4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:36.767579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b37cf9f5-5871-42e4-acd0-24743a7e48e4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:36.908407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b37cf9f5-5871-42e4-acd0-24743a7e48e4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:36.918394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-344587fd-524a-4c4a-abed-4820cd30d354 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42139a78ef8e475cbef24afd7751abf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e505cc680d45e7821ddecfcdd83f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:36.927175 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b37cf9f5-5871-42e4-acd0-24743a7e48e4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1053 microversion: 2.1 time: 0.173850 Aug 03 01:54:36.930232 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 906/1812] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:36 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1053 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:36.934504 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-344587fd-524a-4c4a-abed-4820cd30d354 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b" status: 200 len: 1316 microversion: 2.1 time: 0.490788 Aug 03 01:54:36.937614 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 907/1813] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:36 2022] GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:36.956226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-deec46f3-cb62-43c7-b738-a9d8844433b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:36.958722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-deec46f3-cb62-43c7-b738-a9d8844433b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:36.977841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-deec46f3-cb62-43c7-b738-a9d8844433b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:36.989689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-deec46f3-cb62-43c7-b738-a9d8844433b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:36.993997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-deec46f3-cb62-43c7-b738-a9d8844433b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:36.995822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-deec46f3-cb62-43c7-b738-a9d8844433b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:37.073700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bd74fa44-648a-4c1d-9cdd-97d0e80ef380 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:37.075069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bd74fa44-648a-4c1d-9cdd-97d0e80ef380 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:37.101303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd74fa44-648a-4c1d-9cdd-97d0e80ef380 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:37.102503 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd74fa44-648a-4c1d-9cdd-97d0e80ef380 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:37.103825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd74fa44-648a-4c1d-9cdd-97d0e80ef380 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:37.104687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd74fa44-648a-4c1d-9cdd-97d0e80ef380 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:37.321002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-deec46f3-cb62-43c7-b738-a9d8844433b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:37.342498 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-deec46f3-cb62-43c7-b738-a9d8844433b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784" status: 200 len: 1308 microversion: 2.1 time: 0.410879 Aug 03 01:54:37.342892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bd74fa44-648a-4c1d-9cdd-97d0e80ef380 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:37.345985 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 907/1814] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:36 2022] GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 => generated 1308 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:37.353939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7e6f6231-b7e9-411e-ad3b-ff0bf429d922 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:37.359478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7e6f6231-b7e9-411e-ad3b-ff0bf429d922 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:37.361119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bd74fa44-648a-4c1d-9cdd-97d0e80ef380 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:37.364413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bd74fa44-648a-4c1d-9cdd-97d0e80ef380 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:37.366569 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bd74fa44-648a-4c1d-9cdd-97d0e80ef380 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1804 microversion: 2.25 time: 0.301980 Aug 03 01:54:37.367468 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 908/1815] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:37 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1804 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:37.368738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e6f6231-b7e9-411e-ad3b-ff0bf429d922 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:37.369237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e6f6231-b7e9-411e-ad3b-ff0bf429d922 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:37.370029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e6f6231-b7e9-411e-ad3b-ff0bf429d922 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:37.370471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e6f6231-b7e9-411e-ad3b-ff0bf429d922 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:37.389529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b7663e85-df6f-429e-956d-57f1712a1184 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '.version_select at 0x7f5b12940160>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:37.393509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7663e85-df6f-429e-956d-57f1712a1184 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:37.394999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7663e85-df6f-429e-956d-57f1712a1184 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:37.406823 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b7663e85-df6f-429e-956d-57f1712a1184 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 2783 microversion: 2.25 time: 0.020898 Aug 03 01:54:37.417795 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 909/1816] 10.222.0.67 () {60 vars in 1184 bytes} [Wed Aug 3 01:54:37 2022] GET /compute/v2.1/os-migrations => generated 2783 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:54:37.425772 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aadd3b66-7bf6-4717-9716-bfb661d616a1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:37.426819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-aadd3b66-7bf6-4717-9716-bfb661d616a1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:37.434063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aadd3b66-7bf6-4717-9716-bfb661d616a1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:37.434760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aadd3b66-7bf6-4717-9716-bfb661d616a1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:37.435610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aadd3b66-7bf6-4717-9716-bfb661d616a1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:37.436108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aadd3b66-7bf6-4717-9716-bfb661d616a1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:37.618765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7e6f6231-b7e9-411e-ad3b-ff0bf429d922 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:37.623264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-aadd3b66-7bf6-4717-9716-bfb661d616a1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'services' on Instance uuid 47752419-6bf3-468f-b3a4-e212358b9e66 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:54:37.638553 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-aadd3b66-7bf6-4717-9716-bfb661d616a1 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 2423 microversion: 2.25 time: 0.218797 Aug 03 01:54:37.639174 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 910/1817] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:37 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 2423 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:54:37.645467 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7e6f6231-b7e9-411e-ad3b-ff0bf429d922 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 200 len: 1314 microversion: 2.1 time: 0.297366 Aug 03 01:54:37.648271 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 908/1818] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:37 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:37.664289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-136afe0c-7d47-408f-9104-062ef2765c2f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:37.664906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-136afe0c-7d47-408f-9104-062ef2765c2f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:37.671755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-136afe0c-7d47-408f-9104-062ef2765c2f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:37.672211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-136afe0c-7d47-408f-9104-062ef2765c2f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:37.673212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-136afe0c-7d47-408f-9104-062ef2765c2f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:37.675370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-136afe0c-7d47-408f-9104-062ef2765c2f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:37.773352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6ac199a0-ed37-4354-a42b-092c164c36ca tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:37.774968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6ac199a0-ed37-4354-a42b-092c164c36ca tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:37.780969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ac199a0-ed37-4354-a42b-092c164c36ca tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:37.781413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ac199a0-ed37-4354-a42b-092c164c36ca tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:37.782559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ac199a0-ed37-4354-a42b-092c164c36ca tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:37.783060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ac199a0-ed37-4354-a42b-092c164c36ca tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:37.816734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-136afe0c-7d47-408f-9104-062ef2765c2f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'services' on Instance uuid 47752419-6bf3-468f-b3a4-e212358b9e66 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:54:37.833601 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-136afe0c-7d47-408f-9104-062ef2765c2f tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 2423 microversion: 2.25 time: 0.173494 Aug 03 01:54:37.835542 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 911/1819] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:54:37 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 2423 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:54:37.933646 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dd1db7ee-36df-4975-b3ae-43a501156d47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:37.934299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dd1db7ee-36df-4975-b3ae-43a501156d47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:37.941730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd1db7ee-36df-4975-b3ae-43a501156d47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:37.942553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd1db7ee-36df-4975-b3ae-43a501156d47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:37.943353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd1db7ee-36df-4975-b3ae-43a501156d47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:37.944036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd1db7ee-36df-4975-b3ae-43a501156d47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:37.946487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6ac199a0-ed37-4354-a42b-092c164c36ca tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:37.955698 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6ac199a0-ed37-4354-a42b-092c164c36ca tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1483 microversion: 2.1 time: 0.187298 Aug 03 01:54:37.956679 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 909/1820] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:37 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1483 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:54:37.961796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4c239d35-b380-443c-aa15-103bb8d87740 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:37.962809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4c239d35-b380-443c-aa15-103bb8d87740 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:37.970203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c239d35-b380-443c-aa15-103bb8d87740 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:37.971014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c239d35-b380-443c-aa15-103bb8d87740 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:37.972471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c239d35-b380-443c-aa15-103bb8d87740 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:37.973156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c239d35-b380-443c-aa15-103bb8d87740 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:38.047427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4c239d35-b380-443c-aa15-103bb8d87740 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:38.055804 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4c239d35-b380-443c-aa15-103bb8d87740 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1151 microversion: 2.1 time: 0.097730 Aug 03 01:54:38.067249 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 910/1821] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:37 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1151 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:38.075431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-647ca247-27b7-4070-b544-567319e2d6bc tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:38.076166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-647ca247-27b7-4070-b544-567319e2d6bc tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:38.082615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-647ca247-27b7-4070-b544-567319e2d6bc tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:38.083324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-647ca247-27b7-4070-b544-567319e2d6bc tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:38.084176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-647ca247-27b7-4070-b544-567319e2d6bc tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:38.084486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-dd1db7ee-36df-4975-b3ae-43a501156d47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lazy-loading 'services' on Instance uuid 47752419-6bf3-468f-b3a4-e212358b9e66 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:54:38.084951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-647ca247-27b7-4070-b544-567319e2d6bc tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:38.217566 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dd1db7ee-36df-4975-b3ae-43a501156d47 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "DELETE /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-volume_attachments/34e930c8-ca38-4499-9834-8159f8d52447" status: 202 len: 0 microversion: 2.25 time: 0.287728 Aug 03 01:54:38.218165 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 912/1822] 10.222.0.67 () {60 vars in 1457 bytes} [Wed Aug 3 01:54:37 2022] DELETE /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-volume_attachments/34e930c8-ca38-4499-9834-8159f8d52447 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:54:38.225011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a63061b1-3c4d-4c10-a47f-d52023bae88f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:38.225598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a63061b1-3c4d-4c10-a47f-d52023bae88f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:38.233180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a63061b1-3c4d-4c10-a47f-d52023bae88f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:38.233897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a63061b1-3c4d-4c10-a47f-d52023bae88f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:38.234861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a63061b1-3c4d-4c10-a47f-d52023bae88f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:38.235536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a63061b1-3c4d-4c10-a47f-d52023bae88f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:38.235934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-647ca247-27b7-4070-b544-567319e2d6bc tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42139a78ef8e475cbef24afd7751abf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e505cc680d45e7821ddecfcdd83f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:38.245217 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-647ca247-27b7-4070-b544-567319e2d6bc tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b" status: 200 len: 1316 microversion: 2.1 time: 0.176616 Aug 03 01:54:38.245806 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 911/1823] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:38 2022] GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:38.251095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1314781047", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50acd5e9-f476-4abd-a942-40fd931a4eb0"}], "security_groups": [{"name": "tempest-securitygroup--754651024"}], "key_name": "tempest-keypair-57918381", "user_data": "}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:38.329060 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a63061b1-3c4d-4c10-a47f-d52023bae88f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109675 Aug 03 01:54:38.329727 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 913/1824] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 01:54:38 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:38.336721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dd8b7044-e5f2-4d33-91d8-fbae57023e87 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:38.339889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dd8b7044-e5f2-4d33-91d8-fbae57023e87 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:38.350648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd8b7044-e5f2-4d33-91d8-fbae57023e87 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:38.351376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd8b7044-e5f2-4d33-91d8-fbae57023e87 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:38.353179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd8b7044-e5f2-4d33-91d8-fbae57023e87 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:38.353840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd8b7044-e5f2-4d33-91d8-fbae57023e87 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:38.396460 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dd8b7044-e5f2-4d33-91d8-fbae57023e87 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.065305 Aug 03 01:54:38.397657 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 914/1825] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 01:54:38 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:54:38.403470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-584f9326-9353-492b-bc14-3d99ff2fabba req-051404fb-84e0-4f6c-83df-40710d845f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "070aea90-6175-49fc-8d44-78f4df1b760b", "tag": "bd9d9b26-b178-4329-92e7-0cde6f06594a"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:38.416350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-584f9326-9353-492b-bc14-3d99ff2fabba req-051404fb-84e0-4f6c-83df-40710d845f44 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:38.416714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-584f9326-9353-492b-bc14-3d99ff2fabba req-051404fb-84e0-4f6c-83df-40710d845f44 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:38.430923 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-584f9326-9353-492b-bc14-3d99ff2fabba req-051404fb-84e0-4f6c-83df-40710d845f44 service nova] Creating event network-changed:bd9d9b26-b178-4329-92e7-0cde6f06594a for instance 070aea90-6175-49fc-8d44-78f4df1b760b on n-h1-826529-8 Aug 03 01:54:38.436340 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-584f9326-9353-492b-bc14-3d99ff2fabba req-051404fb-84e0-4f6c-83df-40710d845f44 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037348 Aug 03 01:54:38.437520 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 915/1826] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:38.443519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f374d1c9-24b6-44b7-8ee0-c53b54ba1996 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:38.444930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f374d1c9-24b6-44b7-8ee0-c53b54ba1996 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:38.451873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f374d1c9-24b6-44b7-8ee0-c53b54ba1996 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:38.452855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f374d1c9-24b6-44b7-8ee0-c53b54ba1996 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:38.453831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f374d1c9-24b6-44b7-8ee0-c53b54ba1996 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:38.454501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f374d1c9-24b6-44b7-8ee0-c53b54ba1996 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:38.624866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] validate_networks() for [('50acd5e9-f476-4abd-a942-40fd931a4eb0', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:54:39.239508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f374d1c9-24b6-44b7-8ee0-c53b54ba1996 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:39.255742 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f374d1c9-24b6-44b7-8ee0-c53b54ba1996 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784" status: 200 len: 1308 microversion: 2.1 time: 0.813468 Aug 03 01:54:39.258047 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 916/1827] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:38 2022] GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 => generated 1308 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:39.265489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cc467374-d406-459a-bb65-a972c444fc5d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:39.266235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cc467374-d406-459a-bb65-a972c444fc5d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:39.283725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc467374-d406-459a-bb65-a972c444fc5d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:39.284387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc467374-d406-459a-bb65-a972c444fc5d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:39.286723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc467374-d406-459a-bb65-a972c444fc5d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:39.290420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc467374-d406-459a-bb65-a972c444fc5d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:39.825179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cc467374-d406-459a-bb65-a972c444fc5d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:39.836160 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cc467374-d406-459a-bb65-a972c444fc5d tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 200 len: 1314 microversion: 2.1 time: 0.576879 Aug 03 01:54:39.850166 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 917/1828] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:39 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:39.861451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-063bcc3f-fa90-4bc8-866f-46c63321dcd2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:39.864308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-063bcc3f-fa90-4bc8-866f-46c63321dcd2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:39.877597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-063bcc3f-fa90-4bc8-866f-46c63321dcd2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:39.879353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-063bcc3f-fa90-4bc8-866f-46c63321dcd2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:39.880201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-063bcc3f-fa90-4bc8-866f-46c63321dcd2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:39.883908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-063bcc3f-fa90-4bc8-866f-46c63321dcd2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:40.079008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-063bcc3f-fa90-4bc8-866f-46c63321dcd2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:40.092117 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-063bcc3f-fa90-4bc8-866f-46c63321dcd2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1169 microversion: 2.1 time: 0.239013 Aug 03 01:54:40.093250 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 918/1829] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:39 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1169 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:40.103690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5ac30350-ae2b-4d4f-b5a9-02b65f5c94e5 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:40.104609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5ac30350-ae2b-4d4f-b5a9-02b65f5c94e5 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:40.116001 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ac30350-ae2b-4d4f-b5a9-02b65f5c94e5 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:40.116958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ac30350-ae2b-4d4f-b5a9-02b65f5c94e5 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:40.118266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ac30350-ae2b-4d4f-b5a9-02b65f5c94e5 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:40.119700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ac30350-ae2b-4d4f-b5a9-02b65f5c94e5 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:40.611584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:54:40.612959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:54:40.614300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:54:40.615159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:54:40.615754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:54:40.616666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ac30350-ae2b-4d4f-b5a9-02b65f5c94e5 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42139a78ef8e475cbef24afd7751abf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e505cc680d45e7821ddecfcdd83f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:40.634509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:40.635367 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5ac30350-ae2b-4d4f-b5a9-02b65f5c94e5 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b" status: 200 len: 1316 microversion: 2.1 time: 0.540363 Aug 03 01:54:40.635953 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 919/1830] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:40 2022] GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b => generated 1316 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:40.640942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1b452a48-bfda-43bb-b016-b138ea1dce8f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:40.643456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1b452a48-bfda-43bb-b016-b138ea1dce8f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:40.651476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:40.654017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:40.655341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:40.663701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b452a48-bfda-43bb-b016-b138ea1dce8f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:40.664168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b452a48-bfda-43bb-b016-b138ea1dce8f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:40.665027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b452a48-bfda-43bb-b016-b138ea1dce8f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:40.665406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b452a48-bfda-43bb-b016-b138ea1dce8f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:40.689319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Getting quotas for project c183e2fc6dbb419fbd8fa81c90163adf. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:54:40.700214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Getting quotas for user 0b99d344c16b4221bcccfe37d32bb69e and project c183e2fc6dbb419fbd8fa81c90163adf. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:54:40.720668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:54:40.725354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:54:40.739360 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1b452a48-bfda-43bb-b016-b138ea1dce8f tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.102099 Aug 03 01:54:40.740245 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 920/1831] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 01:54:40 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:54:40.757435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-016456b5-4485-4e1b-85e7-efa374eb7329 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:40.765174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-016456b5-4485-4e1b-85e7-efa374eb7329 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:40.775304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-016456b5-4485-4e1b-85e7-efa374eb7329 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:40.776396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-016456b5-4485-4e1b-85e7-efa374eb7329 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:40.779085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-016456b5-4485-4e1b-85e7-efa374eb7329 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:40.779718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-016456b5-4485-4e1b-85e7-efa374eb7329 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:40.879204 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-18082277-a3b4-4bb5-9e61-683660d67e75 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.629836 Aug 03 01:54:40.880411 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 912/1832] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:54:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 2634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:54:40.891041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eb0df3ba-ecd0-4ba7-8613-1dae0b9268f6 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:40.891995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eb0df3ba-ecd0-4ba7-8613-1dae0b9268f6 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:40.903211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb0df3ba-ecd0-4ba7-8613-1dae0b9268f6 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:40.904412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb0df3ba-ecd0-4ba7-8613-1dae0b9268f6 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:40.905378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb0df3ba-ecd0-4ba7-8613-1dae0b9268f6 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:40.905984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb0df3ba-ecd0-4ba7-8613-1dae0b9268f6 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:41.475358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-016456b5-4485-4e1b-85e7-efa374eb7329 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:41.490453 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-016456b5-4485-4e1b-85e7-efa374eb7329 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784" status: 200 len: 1308 microversion: 2.1 time: 0.746243 Aug 03 01:54:41.494562 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 921/1833] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:40 2022] GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 => generated 1308 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:41.503953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a697e885-c46d-450c-ac99-4c7ae0559a9c req-0abad2cf-7f74-42ec-9474-b408a44e2d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d342ed3e-ca89-47e4-8421-3e0e26e2812b", "tag": "a51da6f5-db5e-46eb-88ed-439bce78ecf4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:41.532113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a697e885-c46d-450c-ac99-4c7ae0559a9c req-0abad2cf-7f74-42ec-9474-b408a44e2d11 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:41.544203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a697e885-c46d-450c-ac99-4c7ae0559a9c req-0abad2cf-7f74-42ec-9474-b408a44e2d11 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:41.582193 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a697e885-c46d-450c-ac99-4c7ae0559a9c req-0abad2cf-7f74-42ec-9474-b408a44e2d11 service nova] Creating event network-changed:a51da6f5-db5e-46eb-88ed-439bce78ecf4 for instance d342ed3e-ca89-47e4-8421-3e0e26e2812b on n-h2-826529-8 Aug 03 01:54:41.601896 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a697e885-c46d-450c-ac99-4c7ae0559a9c req-0abad2cf-7f74-42ec-9474-b408a44e2d11 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105568 Aug 03 01:54:41.602702 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 922/1834] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:41.607882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-3b25d624-4329-4e0e-a701-52ed69a048bb req-5d8598ae-72ed-49ff-b8e8-5512794766a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91461a32-2670-4138-bdbc-793503ed4ca4", "tag": "330a51c1-6429-4043-8673-217255e0885d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:41.652322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3b25d624-4329-4e0e-a701-52ed69a048bb req-5d8598ae-72ed-49ff-b8e8-5512794766a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:41.653679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3b25d624-4329-4e0e-a701-52ed69a048bb req-5d8598ae-72ed-49ff-b8e8-5512794766a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:41.659068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:41.676897 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-3b25d624-4329-4e0e-a701-52ed69a048bb req-5d8598ae-72ed-49ff-b8e8-5512794766a7 service nova] Creating event network-changed:330a51c1-6429-4043-8673-217255e0885d for instance 91461a32-2670-4138-bdbc-793503ed4ca4 on n-h1-826529-8 Aug 03 01:54:41.696024 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-3b25d624-4329-4e0e-a701-52ed69a048bb req-5d8598ae-72ed-49ff-b8e8-5512794766a7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091840 Aug 03 01:54:41.696662 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 923/1835] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:41.713882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2b6a488-701a-4c91-a627-5c3108d01b3a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:41.715119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c2b6a488-701a-4c91-a627-5c3108d01b3a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:41.726539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2b6a488-701a-4c91-a627-5c3108d01b3a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:41.727404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2b6a488-701a-4c91-a627-5c3108d01b3a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:41.728396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2b6a488-701a-4c91-a627-5c3108d01b3a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:41.733231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2b6a488-701a-4c91-a627-5c3108d01b3a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:41.863660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eb0df3ba-ecd0-4ba7-8613-1dae0b9268f6 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:41.872911 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eb0df3ba-ecd0-4ba7-8613-1dae0b9268f6 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1483 microversion: 2.1 time: 0.990773 Aug 03 01:54:41.875386 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 913/1836] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:40 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1483 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:41.887645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8eb1cc20-960b-4143-b8bf-0aefc7d2b4ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:41.888745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8eb1cc20-960b-4143-b8bf-0aefc7d2b4ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:41.906262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8eb1cc20-960b-4143-b8bf-0aefc7d2b4ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:41.908100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8eb1cc20-960b-4143-b8bf-0aefc7d2b4ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:41.911053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8eb1cc20-960b-4143-b8bf-0aefc7d2b4ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:41.911752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8eb1cc20-960b-4143-b8bf-0aefc7d2b4ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:42.163224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8eb1cc20-960b-4143-b8bf-0aefc7d2b4ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:42.183429 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8eb1cc20-960b-4143-b8bf-0aefc7d2b4ec tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1240 microversion: 2.1 time: 0.302675 Aug 03 01:54:42.189456 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 914/1837] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:41 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1240 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:42.206188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-13129948-e97e-44fc-920e-8c23103d396e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:42.207518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-13129948-e97e-44fc-920e-8c23103d396e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:42.214333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13129948-e97e-44fc-920e-8c23103d396e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:42.215170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13129948-e97e-44fc-920e-8c23103d396e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:42.216211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13129948-e97e-44fc-920e-8c23103d396e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:42.216896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13129948-e97e-44fc-920e-8c23103d396e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:42.222134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:42.380372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c2b6a488-701a-4c91-a627-5c3108d01b3a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:42.392071 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c2b6a488-701a-4c91-a627-5c3108d01b3a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 200 len: 1314 microversion: 2.1 time: 0.693607 Aug 03 01:54:42.393370 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 924/1838] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:41 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:42.399288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3857972e-5f97-4a12-a42b-cba0fb9fcfdd tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:42.400172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3857972e-5f97-4a12-a42b-cba0fb9fcfdd tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:42.413530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3857972e-5f97-4a12-a42b-cba0fb9fcfdd tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:42.414338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3857972e-5f97-4a12-a42b-cba0fb9fcfdd tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:42.415267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3857972e-5f97-4a12-a42b-cba0fb9fcfdd tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:42.416018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3857972e-5f97-4a12-a42b-cba0fb9fcfdd tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:42.720621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-13129948-e97e-44fc-920e-8c23103d396e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:42.739694 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-13129948-e97e-44fc-920e-8c23103d396e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1211 microversion: 2.1 time: 0.546477 Aug 03 01:54:42.758154 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 915/1839] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:42 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1211 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:42.763606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-63fa530c-7f51-40ae-94cb-c21dcab3a091 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:42.766511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-63fa530c-7f51-40ae-94cb-c21dcab3a091 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:42.773738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63fa530c-7f51-40ae-94cb-c21dcab3a091 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:42.774650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63fa530c-7f51-40ae-94cb-c21dcab3a091 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:42.776119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63fa530c-7f51-40ae-94cb-c21dcab3a091 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:42.776935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63fa530c-7f51-40ae-94cb-c21dcab3a091 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:42.819120 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-63fa530c-7f51-40ae-94cb-c21dcab3a091 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.059335 Aug 03 01:54:42.820587 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 916/1840] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 01:54:42 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:54:42.827148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-485a20cf-604f-46e8-8e76-33d92fe2032f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:42.828062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-485a20cf-604f-46e8-8e76-33d92fe2032f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:42.836632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-485a20cf-604f-46e8-8e76-33d92fe2032f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:42.837656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-485a20cf-604f-46e8-8e76-33d92fe2032f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:42.838775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-485a20cf-604f-46e8-8e76-33d92fe2032f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:42.839460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-485a20cf-604f-46e8-8e76-33d92fe2032f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:42.848981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3857972e-5f97-4a12-a42b-cba0fb9fcfdd tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42139a78ef8e475cbef24afd7751abf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e505cc680d45e7821ddecfcdd83f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:42.867475 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3857972e-5f97-4a12-a42b-cba0fb9fcfdd tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b" status: 200 len: 1316 microversion: 2.1 time: 0.472053 Aug 03 01:54:42.880914 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 925/1841] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:42 2022] GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b => generated 1316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:43.132460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-485a20cf-604f-46e8-8e76-33d92fe2032f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:43.145565 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-485a20cf-604f-46e8-8e76-33d92fe2032f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784" status: 200 len: 1308 microversion: 2.1 time: 0.323337 Aug 03 01:54:43.146472 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 917/1842] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:42 2022] GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 => generated 1308 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:43.211605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-02c780ef-0e6b-46f4-aa9b-9014044c85a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:43.212265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-02c780ef-0e6b-46f4-aa9b-9014044c85a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:43.230161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02c780ef-0e6b-46f4-aa9b-9014044c85a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:43.230629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02c780ef-0e6b-46f4-aa9b-9014044c85a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:43.233709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02c780ef-0e6b-46f4-aa9b-9014044c85a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:43.234181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02c780ef-0e6b-46f4-aa9b-9014044c85a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:43.365294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-02c780ef-0e6b-46f4-aa9b-9014044c85a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:43.373081 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-02c780ef-0e6b-46f4-aa9b-9014044c85a4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1302 microversion: 2.1 time: 0.167586 Aug 03 01:54:43.377671 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 926/1843] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:43 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1302 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:43.393777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d91fda34-af1c-481f-bc65-ffd3e0a5d1da req-f5e63d85-be7a-4b4c-b688-bb94874723fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e79bb51-ff27-4ccf-b55a-b7eed7f8a784", "name": "network-vif-plugged", "status": "completed", "tag": "af3cfa3a-3bec-4ec8-94d2-c7b32c593e70"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:43.416258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d91fda34-af1c-481f-bc65-ffd3e0a5d1da req-f5e63d85-be7a-4b4c-b688-bb94874723fc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:43.417924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d91fda34-af1c-481f-bc65-ffd3e0a5d1da req-f5e63d85-be7a-4b4c-b688-bb94874723fc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:43.419161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6b660c88-52ef-488b-b4a1-c059ea0a8c1a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:43.419966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6b660c88-52ef-488b-b4a1-c059ea0a8c1a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:43.428625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b660c88-52ef-488b-b4a1-c059ea0a8c1a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:43.429273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b660c88-52ef-488b-b4a1-c059ea0a8c1a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:43.430252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b660c88-52ef-488b-b4a1-c059ea0a8c1a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:43.431752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b660c88-52ef-488b-b4a1-c059ea0a8c1a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:43.467612 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d91fda34-af1c-481f-bc65-ffd3e0a5d1da req-f5e63d85-be7a-4b4c-b688-bb94874723fc service nova] Creating event network-vif-plugged:af3cfa3a-3bec-4ec8-94d2-c7b32c593e70 for instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 on n-h1-826529-8 Aug 03 01:54:43.473856 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d91fda34-af1c-481f-bc65-ffd3e0a5d1da req-f5e63d85-be7a-4b4c-b688-bb94874723fc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083863 Aug 03 01:54:43.474649 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 918/1844] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:43.765583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-589dbcb7-5846-4aaa-b88a-09ff50dfc964 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:43.766543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-589dbcb7-5846-4aaa-b88a-09ff50dfc964 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:43.775879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-589dbcb7-5846-4aaa-b88a-09ff50dfc964 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:43.777113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-589dbcb7-5846-4aaa-b88a-09ff50dfc964 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:43.778242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-589dbcb7-5846-4aaa-b88a-09ff50dfc964 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:43.778850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-589dbcb7-5846-4aaa-b88a-09ff50dfc964 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:43.837197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6b660c88-52ef-488b-b4a1-c059ea0a8c1a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:43.847710 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6b660c88-52ef-488b-b4a1-c059ea0a8c1a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 200 len: 1314 microversion: 2.1 time: 0.436012 Aug 03 01:54:43.851157 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 927/1845] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:43 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:43.864627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-18648df1-9d8e-4816-9197-23212ae4c6b4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:43.884906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-18648df1-9d8e-4816-9197-23212ae4c6b4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:43.893457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18648df1-9d8e-4816-9197-23212ae4c6b4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:43.901482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18648df1-9d8e-4816-9197-23212ae4c6b4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:43.902645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18648df1-9d8e-4816-9197-23212ae4c6b4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:43.904060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18648df1-9d8e-4816-9197-23212ae4c6b4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:43.982066 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-18648df1-9d8e-4816-9197-23212ae4c6b4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.128044 Aug 03 01:54:43.983357 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 928/1846] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 01:54:43 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:54:43.999706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7a54aecd-5c20-4797-89eb-dd798913ac06 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:44.000516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7a54aecd-5c20-4797-89eb-dd798913ac06 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:44.008819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a54aecd-5c20-4797-89eb-dd798913ac06 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:44.010450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a54aecd-5c20-4797-89eb-dd798913ac06 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:44.011897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a54aecd-5c20-4797-89eb-dd798913ac06 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:44.013114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a54aecd-5c20-4797-89eb-dd798913ac06 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:44.702964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-589dbcb7-5846-4aaa-b88a-09ff50dfc964 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:44.720132 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-589dbcb7-5846-4aaa-b88a-09ff50dfc964 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1211 microversion: 2.1 time: 0.957055 Aug 03 01:54:44.733858 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 919/1847] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:43 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1211 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:54:44.742588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e7deca01-5656-433c-955a-eded0fee8fa9 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:44.749889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e7deca01-5656-433c-955a-eded0fee8fa9 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:44.750913 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e7deca01-5656-433c-955a-eded0fee8fa9 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Searching by: {'deleted': False, 'project_id': 'ded04be454a64ab6af04963fd0570f91'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:54:44.757680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7deca01-5656-433c-955a-eded0fee8fa9 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:44.758328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7deca01-5656-433c-955a-eded0fee8fa9 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:44.759375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7deca01-5656-433c-955a-eded0fee8fa9 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:44.760501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7deca01-5656-433c-955a-eded0fee8fa9 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:44.770426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7a54aecd-5c20-4797-89eb-dd798913ac06 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42139a78ef8e475cbef24afd7751abf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e505cc680d45e7821ddecfcdd83f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:44.783152 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7a54aecd-5c20-4797-89eb-dd798913ac06 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b" status: 200 len: 1316 microversion: 2.1 time: 0.798290 Aug 03 01:54:44.784078 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 929/1848] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:43 2022] GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b => generated 1316 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:44.789832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-561f8f24-77e3-4d40-9e28-aad914d6b78f req-848715e0-61da-48c6-8160-0fc5e8306394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b54bdd1-d224-4a35-9487-66a77cd76c71", "tag": "54039f8b-300c-447b-a43c-cb4dd1e17902"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:44.812065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:44.814351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-561f8f24-77e3-4d40-9e28-aad914d6b78f req-848715e0-61da-48c6-8160-0fc5e8306394 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:44.815415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-561f8f24-77e3-4d40-9e28-aad914d6b78f req-848715e0-61da-48c6-8160-0fc5e8306394 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:44.823705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-e7deca01-5656-433c-955a-eded0fee8fa9 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:54:44.845539 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-561f8f24-77e3-4d40-9e28-aad914d6b78f req-848715e0-61da-48c6-8160-0fc5e8306394 service nova] Creating event network-changed:54039f8b-300c-447b-a43c-cb4dd1e17902 for instance 0b54bdd1-d224-4a35-9487-66a77cd76c71 on n-h2-826529-8 Aug 03 01:54:44.855602 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-561f8f24-77e3-4d40-9e28-aad914d6b78f req-848715e0-61da-48c6-8160-0fc5e8306394 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069180 Aug 03 01:54:44.860831 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 930/1849] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:44.876680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4200b52e-2a48-43e1-a91a-b167ac870a17 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:44.877716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4200b52e-2a48-43e1-a91a-b167ac870a17 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:44.882654 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e7deca01-5656-433c-955a-eded0fee8fa9 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.145400 Aug 03 01:54:44.885744 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 920/1850] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 3 01:54:44 2022] GET /compute/v2.1/servers => generated 339 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:44.901981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4200b52e-2a48-43e1-a91a-b167ac870a17 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:44.902968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4200b52e-2a48-43e1-a91a-b167ac870a17 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:44.905457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c16846b1-b625-4572-be87-70dcce31c898 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:44.906040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4200b52e-2a48-43e1-a91a-b167ac870a17 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:44.907356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c16846b1-b625-4572-be87-70dcce31c898 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:44.907588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4200b52e-2a48-43e1-a91a-b167ac870a17 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:44.923708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c16846b1-b625-4572-be87-70dcce31c898 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:44.924482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c16846b1-b625-4572-be87-70dcce31c898 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:44.925814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c16846b1-b625-4572-be87-70dcce31c898 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:44.927506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c16846b1-b625-4572-be87-70dcce31c898 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:45.277736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4200b52e-2a48-43e1-a91a-b167ac870a17 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:45.288895 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4200b52e-2a48-43e1-a91a-b167ac870a17 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784" status: 200 len: 1308 microversion: 2.1 time: 0.426512 Aug 03 01:54:45.290729 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 931/1851] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:44 2022] GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:45.303752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d7bef4d-dff9-46ac-877d-d8136e36d8b2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:45.303752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6d7bef4d-dff9-46ac-877d-d8136e36d8b2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:45.320324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c16846b1-b625-4572-be87-70dcce31c898 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:45.325298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d7bef4d-dff9-46ac-877d-d8136e36d8b2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:45.325757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d7bef4d-dff9-46ac-877d-d8136e36d8b2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:45.326586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d7bef4d-dff9-46ac-877d-d8136e36d8b2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:45.327053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d7bef4d-dff9-46ac-877d-d8136e36d8b2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:45.336309 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c16846b1-b625-4572-be87-70dcce31c898 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1369 microversion: 2.1 time: 0.440164 Aug 03 01:54:45.336876 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 921/1852] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:44 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1369 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:45.351120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-493e49b7-2448-4e7d-b40f-d89502b9ea8b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:45.372536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-493e49b7-2448-4e7d-b40f-d89502b9ea8b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:45.373371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-493e49b7-2448-4e7d-b40f-d89502b9ea8b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Searching by: {'deleted': False, 'project_id': 'ded04be454a64ab6af04963fd0570f91'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:54:45.385282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-493e49b7-2448-4e7d-b40f-d89502b9ea8b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:45.385734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-493e49b7-2448-4e7d-b40f-d89502b9ea8b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:45.386640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-493e49b7-2448-4e7d-b40f-d89502b9ea8b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:45.387109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-493e49b7-2448-4e7d-b40f-d89502b9ea8b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:45.607798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-493e49b7-2448-4e7d-b40f-d89502b9ea8b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:54:45.689704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-493e49b7-2448-4e7d-b40f-d89502b9ea8b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:45.697259 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-493e49b7-2448-4e7d-b40f-d89502b9ea8b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:45.698021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-493e49b7-2448-4e7d-b40f-d89502b9ea8b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:45.826659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6d7bef4d-dff9-46ac-877d-d8136e36d8b2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:45.844568 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6d7bef4d-dff9-46ac-877d-d8136e36d8b2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 200 len: 1314 microversion: 2.1 time: 0.551207 Aug 03 01:54:45.846720 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 932/1853] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:45 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:45.857970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-40c54fef-3ea4-4a16-a4a7-524a5c149db1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:45.864204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-40c54fef-3ea4-4a16-a4a7-524a5c149db1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:45.876791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40c54fef-3ea4-4a16-a4a7-524a5c149db1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:45.878232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40c54fef-3ea4-4a16-a4a7-524a5c149db1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:45.879948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40c54fef-3ea4-4a16-a4a7-524a5c149db1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:45.881908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40c54fef-3ea4-4a16-a4a7-524a5c149db1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:45.973834 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-40c54fef-3ea4-4a16-a4a7-524a5c149db1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.123909 Aug 03 01:54:45.982062 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 933/1854] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 01:54:45 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:45.985928 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-493e49b7-2448-4e7d-b40f-d89502b9ea8b tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.647967 Aug 03 01:54:45.993922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2b8cc6bb-c45b-4346-a048-03822193e26f req-42282f0d-72c8-4f15-a057-f238d5c32a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d537dd36-d584-48d0-9458-81075e06b366", "tag": "02b87219-959c-40f7-baa4-183c4ffd1862"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:46.003444 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 922/1855] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:54:45 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:46.011077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-43d95f6b-e03a-457c-8774-e5b147873fe0 req-d7536a00-4d63-4642-8112-3ae81888ad44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "070aea90-6175-49fc-8d44-78f4df1b760b", "name": "network-vif-plugged", "status": "completed", "tag": "bd9d9b26-b178-4329-92e7-0cde6f06594a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:46.021232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2b8cc6bb-c45b-4346-a048-03822193e26f req-42282f0d-72c8-4f15-a057-f238d5c32a41 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:46.021232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2b8cc6bb-c45b-4346-a048-03822193e26f req-42282f0d-72c8-4f15-a057-f238d5c32a41 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:46.042661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-43d95f6b-e03a-457c-8774-e5b147873fe0 req-d7536a00-4d63-4642-8112-3ae81888ad44 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:46.044098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-43d95f6b-e03a-457c-8774-e5b147873fe0 req-d7536a00-4d63-4642-8112-3ae81888ad44 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:46.046143 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2b8cc6bb-c45b-4346-a048-03822193e26f req-42282f0d-72c8-4f15-a057-f238d5c32a41 service nova] Creating event network-changed:02b87219-959c-40f7-baa4-183c4ffd1862 for instance d537dd36-d584-48d0-9458-81075e06b366 on n-h2-826529-8 Aug 03 01:54:46.056247 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2b8cc6bb-c45b-4346-a048-03822193e26f req-42282f0d-72c8-4f15-a057-f238d5c32a41 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069489 Aug 03 01:54:46.057413 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 934/1856] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:46.086496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:46.095226 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-43d95f6b-e03a-457c-8774-e5b147873fe0 req-d7536a00-4d63-4642-8112-3ae81888ad44 service nova] Creating event network-vif-plugged:bd9d9b26-b178-4329-92e7-0cde6f06594a for instance 070aea90-6175-49fc-8d44-78f4df1b760b on n-h1-826529-8 Aug 03 01:54:46.129813 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-43d95f6b-e03a-457c-8774-e5b147873fe0 req-d7536a00-4d63-4642-8112-3ae81888ad44 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119843 Aug 03 01:54:46.141764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=18 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:46.142682 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 923/1857] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:46.182883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fefdc484-f2a3-4cb7-92a9-5148de673aac tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:46.195042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fefdc484-f2a3-4cb7-92a9-5148de673aac tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:46.218577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fefdc484-f2a3-4cb7-92a9-5148de673aac tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:46.225253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fefdc484-f2a3-4cb7-92a9-5148de673aac tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:46.226414 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fefdc484-f2a3-4cb7-92a9-5148de673aac tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:46.226877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fefdc484-f2a3-4cb7-92a9-5148de673aac tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:46.462952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aa5cbbbf-3e4a-490a-b982-21ddd4542efc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:46.465328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-aa5cbbbf-3e4a-490a-b982-21ddd4542efc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:46.500066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa5cbbbf-3e4a-490a-b982-21ddd4542efc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:46.502779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa5cbbbf-3e4a-490a-b982-21ddd4542efc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:46.511460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa5cbbbf-3e4a-490a-b982-21ddd4542efc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:46.513146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa5cbbbf-3e4a-490a-b982-21ddd4542efc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:46.563672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fefdc484-f2a3-4cb7-92a9-5148de673aac tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42139a78ef8e475cbef24afd7751abf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e505cc680d45e7821ddecfcdd83f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:46.576255 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fefdc484-f2a3-4cb7-92a9-5148de673aac tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b" status: 200 len: 1316 microversion: 2.1 time: 0.429636 Aug 03 01:54:46.577506 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 924/1858] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:46 2022] GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:46.584473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a912e4c6-c500-4b3f-9f64-61e28736d6ca tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:46.598221 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a912e4c6-c500-4b3f-9f64-61e28736d6ca tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019112 Aug 03 01:54:46.599412 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 925/1859] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:54:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:46.610052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ebd96261-0147-484f-a104-9312b672e43a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:46.611584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ebd96261-0147-484f-a104-9312b672e43a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:46.619977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebd96261-0147-484f-a104-9312b672e43a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:46.620438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebd96261-0147-484f-a104-9312b672e43a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:46.621216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebd96261-0147-484f-a104-9312b672e43a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:46.621723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebd96261-0147-484f-a104-9312b672e43a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:46.771997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-aa5cbbbf-3e4a-490a-b982-21ddd4542efc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:46.781176 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-aa5cbbbf-3e4a-490a-b982-21ddd4542efc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1211 microversion: 2.1 time: 0.720048 Aug 03 01:54:46.782121 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 935/1860] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:46 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1211 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:46.789869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-625e6145-54ea-45ca-9e38-c013dd52beab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:46.791259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-625e6145-54ea-45ca-9e38-c013dd52beab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:46.798510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-625e6145-54ea-45ca-9e38-c013dd52beab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:46.799021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-625e6145-54ea-45ca-9e38-c013dd52beab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:46.799806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-625e6145-54ea-45ca-9e38-c013dd52beab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:46.800786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-625e6145-54ea-45ca-9e38-c013dd52beab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:46.841263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ebd96261-0147-484f-a104-9312b672e43a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:46.850375 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ebd96261-0147-484f-a104-9312b672e43a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784" status: 200 len: 1488 microversion: 2.1 time: 0.249133 Aug 03 01:54:46.850988 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 926/1861] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:46 2022] GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 => generated 1488 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:46.868224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-746afe54-1001-4de7-a9ff-a5f29a913e88 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:46.868854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-746afe54-1001-4de7-a9ff-a5f29a913e88 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:46.875811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-746afe54-1001-4de7-a9ff-a5f29a913e88 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:46.876309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-746afe54-1001-4de7-a9ff-a5f29a913e88 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:46.877135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-746afe54-1001-4de7-a9ff-a5f29a913e88 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:46.877615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-746afe54-1001-4de7-a9ff-a5f29a913e88 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:47.035776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-625e6145-54ea-45ca-9e38-c013dd52beab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:47.047193 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-625e6145-54ea-45ca-9e38-c013dd52beab tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1369 microversion: 2.1 time: 0.261799 Aug 03 01:54:47.047798 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 936/1862] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:46 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1369 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:47.062811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-43bb51ee-81de-4042-9152-86d8f5a7fcd2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:47.063379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-43bb51ee-81de-4042-9152-86d8f5a7fcd2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:47.073905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43bb51ee-81de-4042-9152-86d8f5a7fcd2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:47.074410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43bb51ee-81de-4042-9152-86d8f5a7fcd2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:47.075250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43bb51ee-81de-4042-9152-86d8f5a7fcd2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:47.075880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43bb51ee-81de-4042-9152-86d8f5a7fcd2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:47.092969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-746afe54-1001-4de7-a9ff-a5f29a913e88 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:47.103749 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-746afe54-1001-4de7-a9ff-a5f29a913e88 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 200 len: 1314 microversion: 2.1 time: 0.241251 Aug 03 01:54:47.118656 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 927/1863] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:46 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:47.118656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2a1be10d-d587-4c25-9480-7ceb72c712ca tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:47.118656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2a1be10d-d587-4c25-9480-7ceb72c712ca tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:47.121169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a1be10d-d587-4c25-9480-7ceb72c712ca tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:47.121766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a1be10d-d587-4c25-9480-7ceb72c712ca tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:47.122843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a1be10d-d587-4c25-9480-7ceb72c712ca tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:47.123435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a1be10d-d587-4c25-9480-7ceb72c712ca tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:47.166265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2a1be10d-d587-4c25-9480-7ceb72c712ca tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:54:47.197927 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-43bb51ee-81de-4042-9152-86d8f5a7fcd2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "POST /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784/action" status: 202 len: 0 microversion: 2.1 time: 0.148603 Aug 03 01:54:47.201758 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 937/1864] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:54:47 2022] POST /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:54:47.210538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7b5435cc-e89d-4607-9d5e-3523f49b54bf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:47.211536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7b5435cc-e89d-4607-9d5e-3523f49b54bf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:47.220444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b5435cc-e89d-4607-9d5e-3523f49b54bf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:47.220991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b5435cc-e89d-4607-9d5e-3523f49b54bf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:47.222831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b5435cc-e89d-4607-9d5e-3523f49b54bf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:47.223382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b5435cc-e89d-4607-9d5e-3523f49b54bf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:47.297555 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2a1be10d-d587-4c25-9480-7ceb72c712ca tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 204 len: 0 microversion: 2.1 time: 0.190607 Aug 03 01:54:47.298445 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 928/1865] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:54:47 2022] DELETE /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:54:47.321181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-40101b3f-a6f7-4851-ba69-36e2eaa68ff3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:47.322216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-40101b3f-a6f7-4851-ba69-36e2eaa68ff3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:47.340893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40101b3f-a6f7-4851-ba69-36e2eaa68ff3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:47.341560 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40101b3f-a6f7-4851-ba69-36e2eaa68ff3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:47.342567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40101b3f-a6f7-4851-ba69-36e2eaa68ff3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:47.343230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40101b3f-a6f7-4851-ba69-36e2eaa68ff3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:47.464076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7b5435cc-e89d-4607-9d5e-3523f49b54bf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:47.475571 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7b5435cc-e89d-4607-9d5e-3523f49b54bf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784" status: 200 len: 1493 microversion: 2.1 time: 0.270619 Aug 03 01:54:47.476825 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 938/1866] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:47 2022] GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 => generated 1493 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:47.572078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-40101b3f-a6f7-4851-ba69-36e2eaa68ff3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:47.582713 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-40101b3f-a6f7-4851-ba69-36e2eaa68ff3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1712 microversion: 2.1 time: 0.278409 Aug 03 01:54:47.586281 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 929/1867] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:47 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1712 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:47.600888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-25859709-d58a-409a-b025-6fcbabb530c3 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:47.602488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-25859709-d58a-409a-b025-6fcbabb530c3 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:47.610611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-25859709-d58a-409a-b025-6fcbabb530c3 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:47.611215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-25859709-d58a-409a-b025-6fcbabb530c3 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:47.612005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-25859709-d58a-409a-b025-6fcbabb530c3 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:47.613697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-25859709-d58a-409a-b025-6fcbabb530c3 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:47.783994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-25859709-d58a-409a-b025-6fcbabb530c3 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42139a78ef8e475cbef24afd7751abf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e505cc680d45e7821ddecfcdd83f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:47.792817 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-25859709-d58a-409a-b025-6fcbabb530c3 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b" status: 200 len: 1316 microversion: 2.1 time: 0.197230 Aug 03 01:54:47.793624 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 939/1868] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:47 2022] GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:47.805522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-31c34eea-be73-40a3-89a0-d70a041297e4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:47.806360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-31c34eea-be73-40a3-89a0-d70a041297e4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:47.813465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31c34eea-be73-40a3-89a0-d70a041297e4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:47.813928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31c34eea-be73-40a3-89a0-d70a041297e4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:47.814745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31c34eea-be73-40a3-89a0-d70a041297e4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:47.815420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31c34eea-be73-40a3-89a0-d70a041297e4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:48.070592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-978d8d28-1db1-4793-8aef-268e902bd658 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:48.071866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-978d8d28-1db1-4793-8aef-268e902bd658 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:48.078274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-978d8d28-1db1-4793-8aef-268e902bd658 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:48.079261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-978d8d28-1db1-4793-8aef-268e902bd658 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:48.080504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-978d8d28-1db1-4793-8aef-268e902bd658 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:48.081130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-978d8d28-1db1-4793-8aef-268e902bd658 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:48.091698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-31c34eea-be73-40a3-89a0-d70a041297e4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:48.104874 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-31c34eea-be73-40a3-89a0-d70a041297e4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1211 microversion: 2.1 time: 0.304306 Aug 03 01:54:48.107140 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 930/1869] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:47 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1211 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:48.136254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5098fea0-af7f-4531-90b2-0f711e4ac9c1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:48.137529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5098fea0-af7f-4531-90b2-0f711e4ac9c1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:48.143813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:48.151628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5098fea0-af7f-4531-90b2-0f711e4ac9c1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:48.152352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5098fea0-af7f-4531-90b2-0f711e4ac9c1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:48.153674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5098fea0-af7f-4531-90b2-0f711e4ac9c1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:48.154286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5098fea0-af7f-4531-90b2-0f711e4ac9c1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:48.181264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:48.307834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-978d8d28-1db1-4793-8aef-268e902bd658 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:48.311849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:48.317955 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-978d8d28-1db1-4793-8aef-268e902bd658 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1369 microversion: 2.1 time: 0.251402 Aug 03 01:54:48.331888 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 940/1870] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:48 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1369 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:54:48.338579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-fd3d3ec6-fc73-4951-87d4-5590309daf57 req-b9517e4a-0eaa-4e8d-bcef-4be596f04b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91461a32-2670-4138-bdbc-793503ed4ca4", "name": "network-vif-plugged", "status": "completed", "tag": "330a51c1-6429-4043-8673-217255e0885d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:48.351174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-fd3d3ec6-fc73-4951-87d4-5590309daf57 req-b9517e4a-0eaa-4e8d-bcef-4be596f04b98 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:48.352007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-fd3d3ec6-fc73-4951-87d4-5590309daf57 req-b9517e4a-0eaa-4e8d-bcef-4be596f04b98 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:48.366312 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-fd3d3ec6-fc73-4951-87d4-5590309daf57 req-b9517e4a-0eaa-4e8d-bcef-4be596f04b98 service nova] Creating event network-vif-plugged:330a51c1-6429-4043-8673-217255e0885d for instance 91461a32-2670-4138-bdbc-793503ed4ca4 on n-h1-826529-8 Aug 03 01:54:48.372161 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-fd3d3ec6-fc73-4951-87d4-5590309daf57 req-b9517e4a-0eaa-4e8d-bcef-4be596f04b98 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037398 Aug 03 01:54:48.373564 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 941/1871] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:48.375034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5098fea0-af7f-4531-90b2-0f711e4ac9c1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:48.383300 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5098fea0-af7f-4531-90b2-0f711e4ac9c1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 200 len: 1314 microversion: 2.1 time: 0.261366 Aug 03 01:54:48.391393 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 931/1872] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:48 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:54:48.498086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0da94564-e3be-4162-a0fa-2d9f89d36371 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:48.498953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0da94564-e3be-4162-a0fa-2d9f89d36371 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:48.507041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0da94564-e3be-4162-a0fa-2d9f89d36371 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:48.507707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0da94564-e3be-4162-a0fa-2d9f89d36371 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:48.508589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0da94564-e3be-4162-a0fa-2d9f89d36371 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:48.509110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0da94564-e3be-4162-a0fa-2d9f89d36371 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:48.610549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-945c6d58-eae3-4260-a829-4cae74cfda6d tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:48.612525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-945c6d58-eae3-4260-a829-4cae74cfda6d tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:48.620719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-945c6d58-eae3-4260-a829-4cae74cfda6d tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:48.621424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-945c6d58-eae3-4260-a829-4cae74cfda6d tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:48.624512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-945c6d58-eae3-4260-a829-4cae74cfda6d tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:48.625024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-945c6d58-eae3-4260-a829-4cae74cfda6d tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:48.680434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0da94564-e3be-4162-a0fa-2d9f89d36371 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:48.695429 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0da94564-e3be-4162-a0fa-2d9f89d36371 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784" status: 200 len: 1473 microversion: 2.1 time: 0.201410 Aug 03 01:54:48.711647 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 942/1873] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:48 2022] GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 => generated 1473 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:48.717712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7f0a25c7-0331-4a6f-9f41-c94251232922 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-962359222"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:48.720400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7f0a25c7-0331-4a6f-9f41-c94251232922 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:48.728012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f0a25c7-0331-4a6f-9f41-c94251232922 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:48.728467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f0a25c7-0331-4a6f-9f41-c94251232922 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:48.729408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f0a25c7-0331-4a6f-9f41-c94251232922 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:48.729854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f0a25c7-0331-4a6f-9f41-c94251232922 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:48.811472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-945c6d58-eae3-4260-a829-4cae74cfda6d tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:48.822742 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-945c6d58-eae3-4260-a829-4cae74cfda6d tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1712 microversion: 2.1 time: 0.216952 Aug 03 01:54:48.823960 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 932/1874] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:48 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1712 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:54:48.828720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8790c3a7-b1c0-488e-905e-ba134b1e2b2f tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:48.829352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8790c3a7-b1c0-488e-905e-ba134b1e2b2f tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:48.836260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8790c3a7-b1c0-488e-905e-ba134b1e2b2f tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:48.836718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8790c3a7-b1c0-488e-905e-ba134b1e2b2f tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:48.837499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8790c3a7-b1c0-488e-905e-ba134b1e2b2f tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:48.837941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8790c3a7-b1c0-488e-905e-ba134b1e2b2f tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:48.967847 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7f0a25c7-0331-4a6f-9f41-c94251232922 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "POST /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784/action" status: 202 len: 0 microversion: 2.1 time: 0.253763 Aug 03 01:54:48.969191 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 943/1875] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:54:48 2022] POST /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 01:54:48.989462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a2a9648b-0611-4c1c-b1c5-1f2ef11937b0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b129a4040>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:48.994975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8790c3a7-b1c0-488e-905e-ba134b1e2b2f tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42139a78ef8e475cbef24afd7751abf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e505cc680d45e7821ddecfcdd83f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:49.003834 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8790c3a7-b1c0-488e-905e-ba134b1e2b2f tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b" status: 200 len: 1504 microversion: 2.1 time: 0.178274 Aug 03 01:54:49.004760 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 933/1876] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:48 2022] GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:49.027308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c0d08251-1cca-40fe-8c49-7d1ae2c0fd57 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:49.027845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c0d08251-1cca-40fe-8c49-7d1ae2c0fd57 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:49.034391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0d08251-1cca-40fe-8c49-7d1ae2c0fd57 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.035080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0d08251-1cca-40fe-8c49-7d1ae2c0fd57 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:49.035737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0d08251-1cca-40fe-8c49-7d1ae2c0fd57 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.036350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0d08251-1cca-40fe-8c49-7d1ae2c0fd57 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:49.063022 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a2a9648b-0611-4c1c-b1c5-1f2ef11937b0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1413 microversion: 2.1 time: 0.081802 Aug 03 01:54:49.064280 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 944/1877] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:54:48 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:49.129511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-737dbd6b-64fe-47e8-9ffd-685488fae343 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:49.131755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-737dbd6b-64fe-47e8-9ffd-685488fae343 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:49.144820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-737dbd6b-64fe-47e8-9ffd-685488fae343 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.145568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-737dbd6b-64fe-47e8-9ffd-685488fae343 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:49.146404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-737dbd6b-64fe-47e8-9ffd-685488fae343 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.146858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-737dbd6b-64fe-47e8-9ffd-685488fae343 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:49.154045 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c0d08251-1cca-40fe-8c49-7d1ae2c0fd57 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "DELETE /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.131375 Aug 03 01:54:49.154776 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 934/1878] 10.222.0.67 () {58 vars in 1296 bytes} [Wed Aug 3 01:54:49 2022] DELETE /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b/os-server-password => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 01:54:49.164199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ff520a5e-2c29-4e8e-ad3b-071d5f8af9d5 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:49.164792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ff520a5e-2c29-4e8e-ad3b-071d5f8af9d5 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:49.177196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff520a5e-2c29-4e8e-ad3b-071d5f8af9d5 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.177655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff520a5e-2c29-4e8e-ad3b-071d5f8af9d5 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:49.178450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff520a5e-2c29-4e8e-ad3b-071d5f8af9d5 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.179079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff520a5e-2c29-4e8e-ad3b-071d5f8af9d5 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:49.213939 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ff520a5e-2c29-4e8e-ad3b-071d5f8af9d5 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.053629 Aug 03 01:54:49.219485 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 935/1879] 10.222.0.67 () {58 vars in 1293 bytes} [Wed Aug 3 01:54:49 2022] GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b/os-server-password => generated 16 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 01:54:49.226593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-37ebe4d5-3c7d-4d90-809a-0c08d2731935 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:49.227265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-37ebe4d5-3c7d-4d90-809a-0c08d2731935 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:49.234650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37ebe4d5-3c7d-4d90-809a-0c08d2731935 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.235219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37ebe4d5-3c7d-4d90-809a-0c08d2731935 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:49.236407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37ebe4d5-3c7d-4d90-809a-0c08d2731935 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.237016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37ebe4d5-3c7d-4d90-809a-0c08d2731935 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:49.276187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-37ebe4d5-3c7d-4d90-809a-0c08d2731935 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:54:49.348580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-737dbd6b-64fe-47e8-9ffd-685488fae343 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:49.357132 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-737dbd6b-64fe-47e8-9ffd-685488fae343 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1211 microversion: 2.1 time: 0.232872 Aug 03 01:54:49.358455 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 945/1880] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:49 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1211 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:49.370954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b9072ff1-4e98-4d5b-880f-7bb325172112 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:49.372101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b9072ff1-4e98-4d5b-880f-7bb325172112 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:49.380891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9072ff1-4e98-4d5b-880f-7bb325172112 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.381725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9072ff1-4e98-4d5b-880f-7bb325172112 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:49.383013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9072ff1-4e98-4d5b-880f-7bb325172112 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.386343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9072ff1-4e98-4d5b-880f-7bb325172112 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:49.428460 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-37ebe4d5-3c7d-4d90-809a-0c08d2731935 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "DELETE /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b" status: 204 len: 0 microversion: 2.1 time: 0.206703 Aug 03 01:54:49.429398 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 936/1881] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:54:49 2022] DELETE /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:54:49.437885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ed149d97-97af-434a-995c-02f640652e78 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:49.439679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ed149d97-97af-434a-995c-02f640652e78 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:49.449229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed149d97-97af-434a-995c-02f640652e78 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.449686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed149d97-97af-434a-995c-02f640652e78 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:49.450488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed149d97-97af-434a-995c-02f640652e78 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.450933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed149d97-97af-434a-995c-02f640652e78 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:49.763228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b9072ff1-4e98-4d5b-880f-7bb325172112 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:49.771502 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b9072ff1-4e98-4d5b-880f-7bb325172112 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1369 microversion: 2.1 time: 0.412668 Aug 03 01:54:49.784580 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 946/1882] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:49 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1369 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:49.784580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a3e30a82-3650-431e-89fd-b0f80d8a59a6 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:49.784580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a3e30a82-3650-431e-89fd-b0f80d8a59a6 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:49.792452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3e30a82-3650-431e-89fd-b0f80d8a59a6 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.792921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3e30a82-3650-431e-89fd-b0f80d8a59a6 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:49.793726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3e30a82-3650-431e-89fd-b0f80d8a59a6 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.794194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3e30a82-3650-431e-89fd-b0f80d8a59a6 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:49.899012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ed149d97-97af-434a-995c-02f640652e78 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:49.906891 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ed149d97-97af-434a-995c-02f640652e78 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 200 len: 1314 microversion: 2.1 time: 0.472889 Aug 03 01:54:49.913358 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 937/1883] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:49 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:49.924081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7d7d4ef7-ae29-46f0-a947-83c16d6561e3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:49.924762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7d7d4ef7-ae29-46f0-a947-83c16d6561e3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:49.936923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d7d4ef7-ae29-46f0-a947-83c16d6561e3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.937860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d7d4ef7-ae29-46f0-a947-83c16d6561e3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:49.939647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d7d4ef7-ae29-46f0-a947-83c16d6561e3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:49.941031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d7d4ef7-ae29-46f0-a947-83c16d6561e3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:50.395836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a3e30a82-3650-431e-89fd-b0f80d8a59a6 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42139a78ef8e475cbef24afd7751abf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e505cc680d45e7821ddecfcdd83f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:50.404851 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a3e30a82-3650-431e-89fd-b0f80d8a59a6 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b" status: 200 len: 1510 microversion: 2.1 time: 0.631734 Aug 03 01:54:50.407585 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 947/1884] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:49 2022] GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b => generated 1510 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:50.417012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5fbdd03d-9807-4eeb-af5d-9f9d9ebb5317 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b129fe700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:50.434744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7d7d4ef7-ae29-46f0-a947-83c16d6561e3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:50.453912 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7d7d4ef7-ae29-46f0-a947-83c16d6561e3 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1712 microversion: 2.1 time: 0.533111 Aug 03 01:54:50.466936 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 938/1885] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:49 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1712 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:50.466936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4b0482cd-7a9c-4b5d-bfd8-a5a7faae833e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:50.466936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4b0482cd-7a9c-4b5d-bfd8-a5a7faae833e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:50.484271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b0482cd-7a9c-4b5d-bfd8-a5a7faae833e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:50.486077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b0482cd-7a9c-4b5d-bfd8-a5a7faae833e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:50.492054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b0482cd-7a9c-4b5d-bfd8-a5a7faae833e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:50.492637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b0482cd-7a9c-4b5d-bfd8-a5a7faae833e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:50.501177 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5fbdd03d-9807-4eeb-af5d-9f9d9ebb5317 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1413 microversion: 2.1 time: 0.092274 Aug 03 01:54:50.502051 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 948/1886] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:54:50 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:50.757850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4b0482cd-7a9c-4b5d-bfd8-a5a7faae833e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:50.767290 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4b0482cd-7a9c-4b5d-bfd8-a5a7faae833e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1211 microversion: 2.1 time: 0.311084 Aug 03 01:54:50.768695 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 939/1887] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:50 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1211 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:50.794116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8c9767d9-cdbf-4fb1-9fec-87b05e5719a5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:50.795039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8c9767d9-cdbf-4fb1-9fec-87b05e5719a5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:50.808082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c9767d9-cdbf-4fb1-9fec-87b05e5719a5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:50.810967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c9767d9-cdbf-4fb1-9fec-87b05e5719a5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:50.811898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c9767d9-cdbf-4fb1-9fec-87b05e5719a5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:50.813059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c9767d9-cdbf-4fb1-9fec-87b05e5719a5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:50.933927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-578e85c2-67e5-403b-a931-8648e2c7bd6f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:50.938819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-578e85c2-67e5-403b-a931-8648e2c7bd6f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:50.946306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-578e85c2-67e5-403b-a931-8648e2c7bd6f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:50.949166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-578e85c2-67e5-403b-a931-8648e2c7bd6f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:50.959612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-578e85c2-67e5-403b-a931-8648e2c7bd6f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:50.960400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-578e85c2-67e5-403b-a931-8648e2c7bd6f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:51.171660 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8c9767d9-cdbf-4fb1-9fec-87b05e5719a5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:51.182375 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8c9767d9-cdbf-4fb1-9fec-87b05e5719a5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1369 microversion: 2.1 time: 0.392726 Aug 03 01:54:51.188994 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 949/1888] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:50 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1369 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:51.359194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-578e85c2-67e5-403b-a931-8648e2c7bd6f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:51.372341 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-578e85c2-67e5-403b-a931-8648e2c7bd6f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 200 len: 1314 microversion: 2.1 time: 0.442882 Aug 03 01:54:51.376891 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 940/1889] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:50 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:54:51.439024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3246dd84-0c2e-4e5e-a377-7dd4c6bc16cb tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:51.440742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3246dd84-0c2e-4e5e-a377-7dd4c6bc16cb tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:51.464822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3246dd84-0c2e-4e5e-a377-7dd4c6bc16cb tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:51.465337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3246dd84-0c2e-4e5e-a377-7dd4c6bc16cb tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:51.466143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3246dd84-0c2e-4e5e-a377-7dd4c6bc16cb tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:51.466643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3246dd84-0c2e-4e5e-a377-7dd4c6bc16cb tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:51.484209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-333c58be-9b66-41ba-a4c6-651f29375b11 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:51.485977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-333c58be-9b66-41ba-a4c6-651f29375b11 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:51.500161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-333c58be-9b66-41ba-a4c6-651f29375b11 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:51.505024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-333c58be-9b66-41ba-a4c6-651f29375b11 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:51.505883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-333c58be-9b66-41ba-a4c6-651f29375b11 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:51.506332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-333c58be-9b66-41ba-a4c6-651f29375b11 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:51.695391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-333c58be-9b66-41ba-a4c6-651f29375b11 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9e4f9c30311452c8500bdcd2165d1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded04be454a64ab6af04963fd0570f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:51.717298 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-333c58be-9b66-41ba-a4c6-651f29375b11 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 200 len: 1645 microversion: 2.1 time: 0.241797 Aug 03 01:54:51.719219 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 941/1890] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:51 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 1645 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:54:51.734254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dfecb9f1-63af-4959-9a3d-b74975e52767 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b2450cd30>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:51.876806 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dfecb9f1-63af-4959-9a3d-b74975e52767 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1413 microversion: 2.1 time: 0.156299 Aug 03 01:54:51.883582 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 942/1891] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:54:51 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1413 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:51.893245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-5fe203bd-2387-4cb7-94c6-22eb60de9d9c req-542f1b95-97a0-443f-a8eb-080eac6087c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff067a14-b579-4fcf-8a28-291d9c7a0f2b", "name": "network-vif-deleted", "tag": "fc62d70a-5703-41fb-b29d-ab8369f459c2"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:51.921822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5fe203bd-2387-4cb7-94c6-22eb60de9d9c req-542f1b95-97a0-443f-a8eb-080eac6087c5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:51.926344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5fe203bd-2387-4cb7-94c6-22eb60de9d9c req-542f1b95-97a0-443f-a8eb-080eac6087c5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:51.949249 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-5fe203bd-2387-4cb7-94c6-22eb60de9d9c req-542f1b95-97a0-443f-a8eb-080eac6087c5 service nova] Creating event network-vif-deleted:fc62d70a-5703-41fb-b29d-ab8369f459c2 for instance ff067a14-b579-4fcf-8a28-291d9c7a0f2b on n-h2-826529-8 Aug 03 01:54:51.953308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3246dd84-0c2e-4e5e-a377-7dd4c6bc16cb tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42139a78ef8e475cbef24afd7751abf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e505cc680d45e7821ddecfcdd83f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:51.957189 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-5fe203bd-2387-4cb7-94c6-22eb60de9d9c req-542f1b95-97a0-443f-a8eb-080eac6087c5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071112 Aug 03 01:54:51.958510 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 943/1892] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:51.964842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6227f418-18ef-4027-b792-97ea1e1fbc0d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:51.966737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6227f418-18ef-4027-b792-97ea1e1fbc0d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:51.970429 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3246dd84-0c2e-4e5e-a377-7dd4c6bc16cb tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b" status: 200 len: 1510 microversion: 2.1 time: 0.536638 Aug 03 01:54:51.972263 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 950/1893] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:51 2022] GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b => generated 1510 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:51.979493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6227f418-18ef-4027-b792-97ea1e1fbc0d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:51.980480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6227f418-18ef-4027-b792-97ea1e1fbc0d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:51.981530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6227f418-18ef-4027-b792-97ea1e1fbc0d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:51.982197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6227f418-18ef-4027-b792-97ea1e1fbc0d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:52.205883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0b91db97-620c-4b99-a16a-f71052557f09 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:52.206671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0b91db97-620c-4b99-a16a-f71052557f09 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:52.219072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b91db97-620c-4b99-a16a-f71052557f09 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:52.219534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b91db97-620c-4b99-a16a-f71052557f09 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:52.225203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b91db97-620c-4b99-a16a-f71052557f09 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:52.226170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b91db97-620c-4b99-a16a-f71052557f09 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:52.275808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6227f418-18ef-4027-b792-97ea1e1fbc0d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:52.295412 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6227f418-18ef-4027-b792-97ea1e1fbc0d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1199 microversion: 2.1 time: 0.335025 Aug 03 01:54:52.297198 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 944/1894] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:51 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1199 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:52.407727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3867a0dc-0907-4dee-9d77-482ca7dec677 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:52.408626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3867a0dc-0907-4dee-9d77-482ca7dec677 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:52.436815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3867a0dc-0907-4dee-9d77-482ca7dec677 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:52.437451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3867a0dc-0907-4dee-9d77-482ca7dec677 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:52.449790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3867a0dc-0907-4dee-9d77-482ca7dec677 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:52.450459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3867a0dc-0907-4dee-9d77-482ca7dec677 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:52.557380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0b91db97-620c-4b99-a16a-f71052557f09 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:52.572556 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0b91db97-620c-4b99-a16a-f71052557f09 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1369 microversion: 2.1 time: 0.369379 Aug 03 01:54:52.588477 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 951/1895] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:52 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1369 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:52.704405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-d24732ef-2727-4482-b74b-62da411dbff8 req-5f00968d-e636-4418-b3dd-c859167ffe3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "070aea90-6175-49fc-8d44-78f4df1b760b", "name": "network-vif-deleted", "tag": "bd9d9b26-b178-4329-92e7-0cde6f06594a"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:52.746338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d24732ef-2727-4482-b74b-62da411dbff8 req-5f00968d-e636-4418-b3dd-c859167ffe3e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:52.750251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d24732ef-2727-4482-b74b-62da411dbff8 req-5f00968d-e636-4418-b3dd-c859167ffe3e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:52.781478 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-d24732ef-2727-4482-b74b-62da411dbff8 req-5f00968d-e636-4418-b3dd-c859167ffe3e service nova] Creating event network-vif-deleted:bd9d9b26-b178-4329-92e7-0cde6f06594a for instance 070aea90-6175-49fc-8d44-78f4df1b760b on n-h1-826529-8 Aug 03 01:54:52.791368 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-d24732ef-2727-4482-b74b-62da411dbff8 req-5f00968d-e636-4418-b3dd-c859167ffe3e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091079 Aug 03 01:54:52.792595 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 952/1896] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:54:52.804818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9f29afee-acf0-4954-87d0-a06e83dda175 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:52.809372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9f29afee-acf0-4954-87d0-a06e83dda175 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] [instance: ff067a14-b579-4fcf-8a28-291d9c7a0f2b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:52.824810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f29afee-acf0-4954-87d0-a06e83dda175 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:52.826922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f29afee-acf0-4954-87d0-a06e83dda175 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:52.828055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f29afee-acf0-4954-87d0-a06e83dda175 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:52.836165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f29afee-acf0-4954-87d0-a06e83dda175 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:52.847207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3867a0dc-0907-4dee-9d77-482ca7dec677 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:52.857676 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3867a0dc-0907-4dee-9d77-482ca7dec677 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 200 len: 1464 microversion: 2.1 time: 0.462386 Aug 03 01:54:52.859192 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 945/1897] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:52 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 1464 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:54:52.881345 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-9f29afee-acf0-4954-87d0-a06e83dda175 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] HTTP exception thrown: Instance ff067a14-b579-4fcf-8a28-291d9c7a0f2b could not be found. Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9f29afee-acf0-4954-87d0-a06e83dda175 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Request method failure captured: Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b HTTP/1.1 Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dUIcS35X2VGxU6GQUlTUTkLrtCmdHNfq2wmN3C_icAFrIqyHIMKTcqKOwZ_NZImEZ2nL7L0DKYGOFUBE7FLRcXh8jh1wC14ZcQRKMTghET3CFjXAcjZkmJM_uIyUqNGzDSUAPEYZ-4cN29d3tmwydPK3-xJycUbUttfGvAv0lnpPac Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: ded04be454a64ab6af04963fd0570f91 Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersTestManualDisk-450292045 Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ded04be454a64ab6af04963fd0570f91", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ded04be454a64ab6af04963fd0570f91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ded04be454a64ab6af04963fd0570f91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ded04be454a64ab6af04963fd0570f91"}]}] Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersTestManualDisk-450292045 Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: ded04be454a64ab6af04963fd0570f91 Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersTestManualDisk-450292045 Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersTestManualDisk-450292045-project Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e9e4f9c30311452c8500bdcd2165d1b9 Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersTestManualDisk-450292045-project Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance ff067a14-b579-4fcf-8a28-291d9c7a0f2b could not be found. Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'ff067a14-b579-4fcf-8a28-291d9c7a0f2b'} Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff067a14-b579-4fcf-8a28-291d9c7a0f2b could not be found. Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff067a14-b579-4fcf-8a28-291d9c7a0f2b could not be found. Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:54:52.887412 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:54:52.894473 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:54:52.894473 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:54:52.894473 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:54:52.894473 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:54:52.894473 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:54:52.894473 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff067a14-b579-4fcf-8a28-291d9c7a0f2b could not be found. Aug 03 01:54:52.894473 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:54:52.898292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9f29afee-acf0-4954-87d0-a06e83dda175 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Returning 404 to user: Instance ff067a14-b579-4fcf-8a28-291d9c7a0f2b could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:54:52.899754 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9f29afee-acf0-4954-87d0-a06e83dda175 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b" status: 404 len: 111 microversion: 2.1 time: 0.105427 Aug 03 01:54:52.900893 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 953/1898] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:52 2022] GET /compute/v2.1/servers/ff067a14-b579-4fcf-8a28-291d9c7a0f2b => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:54:52.908323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-40e8734a-af58-4534-be11-f4d6713e93fe tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b12892d30>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:52.999044 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-40e8734a-af58-4534-be11-f4d6713e93fe tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1413 microversion: 2.1 time: 0.096808 Aug 03 01:54:52.999848 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 954/1899] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:54:52 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:53.008150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-09808f86-f346-40ae-a9c3-ad745f4b5e69 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] Calling method '.version_select at 0x7f5b128a81f0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:53.047435 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-09808f86-f346-40ae-a9c3-ad745f4b5e69 tempest-ServersTestManualDisk-450292045 tempest-ServersTestManualDisk-450292045-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-513889001" status: 202 len: 0 microversion: 2.1 time: 0.044384 Aug 03 01:54:53.053456 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 955/1900] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 3 01:54:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-513889001 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:54:53.062108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9806672e-ebfd-4f27-ba7a-3757bdeff5f2 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:53.062726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9806672e-ebfd-4f27-ba7a-3757bdeff5f2 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:53.087046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9806672e-ebfd-4f27-ba7a-3757bdeff5f2 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:53.087945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9806672e-ebfd-4f27-ba7a-3757bdeff5f2 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:53.088754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9806672e-ebfd-4f27-ba7a-3757bdeff5f2 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:53.091291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9806672e-ebfd-4f27-ba7a-3757bdeff5f2 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:53.164801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7419977a-3b22-4b09-af8d-ffb45e93d0b7 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:53.170948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7419977a-3b22-4b09-af8d-ffb45e93d0b7 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Searching by: {'deleted': False, 'project_id': 'f6c0dd85a7544c13bb64dcf6b19218f5'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:54:53.182269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9806672e-ebfd-4f27-ba7a-3757bdeff5f2 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:53.182887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9806672e-ebfd-4f27-ba7a-3757bdeff5f2 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:53.183536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-9806672e-ebfd-4f27-ba7a-3757bdeff5f2 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lazy-loading 'fault' on Instance uuid 070aea90-6175-49fc-8d44-78f4df1b760b {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:54:53.185185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7419977a-3b22-4b09-af8d-ffb45e93d0b7 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:53.186402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7419977a-3b22-4b09-af8d-ffb45e93d0b7 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:53.190061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7419977a-3b22-4b09-af8d-ffb45e93d0b7 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:53.190538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7419977a-3b22-4b09-af8d-ffb45e93d0b7 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:53.263889 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7419977a-3b22-4b09-af8d-ffb45e93d0b7 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.382876 Aug 03 01:54:53.280517 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 946/1901] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:54:52 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:54:53.288402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9806672e-ebfd-4f27-ba7a-3757bdeff5f2 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42139a78ef8e475cbef24afd7751abf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e505cc680d45e7821ddecfcdd83f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:53.288701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-c7a49dce-28d9-474b-9024-0f0221915870 req-2f4a54a9-6719-44bd-8743-a24f6091c8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d537dd36-d584-48d0-9458-81075e06b366", "name": "network-vif-plugged", "status": "completed", "tag": "02b87219-959c-40f7-baa4-183c4ffd1862"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:53.300143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c7a49dce-28d9-474b-9024-0f0221915870 req-2f4a54a9-6719-44bd-8743-a24f6091c8d5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:53.307341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c7a49dce-28d9-474b-9024-0f0221915870 req-2f4a54a9-6719-44bd-8743-a24f6091c8d5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:53.308887 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9806672e-ebfd-4f27-ba7a-3757bdeff5f2 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b" status: 200 len: 1306 microversion: 2.1 time: 0.250735 Aug 03 01:54:53.310159 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 956/1902] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:53 2022] GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b => generated 1306 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:53.320890 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c7a49dce-28d9-474b-9024-0f0221915870 req-2f4a54a9-6719-44bd-8743-a24f6091c8d5 service nova] Creating event network-vif-plugged:02b87219-959c-40f7-baa4-183c4ffd1862 for instance d537dd36-d584-48d0-9458-81075e06b366 on n-h2-826529-8 Aug 03 01:54:53.326774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-67a27d88-5680-48e9-9316-aee22d94f417 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:53.328757 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-c7a49dce-28d9-474b-9024-0f0221915870 req-2f4a54a9-6719-44bd-8743-a24f6091c8d5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046523 Aug 03 01:54:53.329579 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 947/1903] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:53.338826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-67a27d88-5680-48e9-9316-aee22d94f417 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Searching by: {'deleted': False} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:54:53.352689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ba9db119-3d27-4d6b-b759-70d98f9319d8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:53.357308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ba9db119-3d27-4d6b-b759-70d98f9319d8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:53.357582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67a27d88-5680-48e9-9316-aee22d94f417 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:53.357993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67a27d88-5680-48e9-9316-aee22d94f417 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:53.359085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67a27d88-5680-48e9-9316-aee22d94f417 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:53.359540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67a27d88-5680-48e9-9316-aee22d94f417 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:53.375519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba9db119-3d27-4d6b-b759-70d98f9319d8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:53.376801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba9db119-3d27-4d6b-b759-70d98f9319d8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:53.382224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba9db119-3d27-4d6b-b759-70d98f9319d8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:53.382756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba9db119-3d27-4d6b-b759-70d98f9319d8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:53.420816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:53.564493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-67a27d88-5680-48e9-9316-aee22d94f417 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Listed batch of 15 results from cell out of 1000 limit. Returned 15 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:54:53.666427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67a27d88-5680-48e9-9316-aee22d94f417 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:53.667328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67a27d88-5680-48e9-9316-aee22d94f417 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:54.266060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ba9db119-3d27-4d6b-b759-70d98f9319d8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:54.277744 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ba9db119-3d27-4d6b-b759-70d98f9319d8 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1199 microversion: 2.1 time: 0.946793 Aug 03 01:54:54.278340 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 948/1904] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:53 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1199 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:54.295577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a2cd187c-b212-4b68-b36b-3b62399869d0 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:54.296360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a2cd187c-b212-4b68-b36b-3b62399869d0 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:54.304942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2cd187c-b212-4b68-b36b-3b62399869d0 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:54.305403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2cd187c-b212-4b68-b36b-3b62399869d0 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:54.306295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2cd187c-b212-4b68-b36b-3b62399869d0 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:54.306868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2cd187c-b212-4b68-b36b-3b62399869d0 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:54.601337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a2cd187c-b212-4b68-b36b-3b62399869d0 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:54.609252 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a2cd187c-b212-4b68-b36b-3b62399869d0 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1369 microversion: 2.1 time: 0.329623 Aug 03 01:54:54.610141 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 949/1905] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:54 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1369 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:54.617960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6b2be6c5-d3b9-4d6d-a1b5-b9c74ede295b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b12a04280>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:54.678126 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6b2be6c5-d3b9-4d6d-a1b5-b9c74ede295b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1413 microversion: 2.1 time: 0.066697 Aug 03 01:54:54.679081 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 950/1906] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:54:54 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1413 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:54.683928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-850ed2d4-ccf9-4800-a4d7-3ee53b2865b0 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:54.684683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-850ed2d4-ccf9-4800-a4d7-3ee53b2865b0 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] [instance: 070aea90-6175-49fc-8d44-78f4df1b760b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:54.691870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-850ed2d4-ccf9-4800-a4d7-3ee53b2865b0 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:54.692649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-850ed2d4-ccf9-4800-a4d7-3ee53b2865b0 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:54.693617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-850ed2d4-ccf9-4800-a4d7-3ee53b2865b0 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:54.694580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-850ed2d4-ccf9-4800-a4d7-3ee53b2865b0 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:54.714413 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-850ed2d4-ccf9-4800-a4d7-3ee53b2865b0 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] HTTP exception thrown: Instance 070aea90-6175-49fc-8d44-78f4df1b760b could not be found. Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-850ed2d4-ccf9-4800-a4d7-3ee53b2865b0 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Request method failure captured: Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b HTTP/1.1 Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dVT0t-Qxd6a0kszX9-OBtxtVfKcfT08LyMKeWd6YnGEgQa0Xr3Xm6n2embKu7OOeYeF79nZlkER3Gx2i2qBG8vNxbdCZ2hSkNYIkdGgma_fUnpXI1mX43RxFXkDbfmd0ya4gbv7q68gFNNx_FBibbgL_tTYp2K_VD_AY54rLAYsYGw Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: b8e505cc680d45e7821ddecfcdd83f61 Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerPasswordTestJSON-251551957 Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b8e505cc680d45e7821ddecfcdd83f61", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8e505cc680d45e7821ddecfcdd83f61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b8e505cc680d45e7821ddecfcdd83f61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b8e505cc680d45e7821ddecfcdd83f61"}]}] Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerPasswordTestJSON-251551957 Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: b8e505cc680d45e7821ddecfcdd83f61 Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerPasswordTestJSON-251551957 Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerPasswordTestJSON-251551957-project Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 42139a78ef8e475cbef24afd7751abf8 Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerPasswordTestJSON-251551957-project Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 070aea90-6175-49fc-8d44-78f4df1b760b could not be found. Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '070aea90-6175-49fc-8d44-78f4df1b760b'} Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 070aea90-6175-49fc-8d44-78f4df1b760b could not be found. Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 070aea90-6175-49fc-8d44-78f4df1b760b could not be found. Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:54:54.716402 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:54:54.724745 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:54:54.724745 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:54:54.724745 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:54:54.724745 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:54:54.724745 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:54:54.724745 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 070aea90-6175-49fc-8d44-78f4df1b760b could not be found. Aug 03 01:54:54.724745 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:54:54.724745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-850ed2d4-ccf9-4800-a4d7-3ee53b2865b0 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] Returning 404 to user: Instance 070aea90-6175-49fc-8d44-78f4df1b760b could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:54:54.729887 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-850ed2d4-ccf9-4800-a4d7-3ee53b2865b0 tempest-ServerPasswordTestJSON-251551957 tempest-ServerPasswordTestJSON-251551957-project] 10.222.0.67 "GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b" status: 404 len: 111 microversion: 2.1 time: 0.040586 Aug 03 01:54:54.731681 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 951/1907] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:54 2022] GET /compute/v2.1/servers/070aea90-6175-49fc-8d44-78f4df1b760b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:54:54.796019 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-67a27d88-5680-48e9-9316-aee22d94f417 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 24540 microversion: 2.1 time: 1.484767 Aug 03 01:54:54.796637 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 957/1908] 10.222.0.67 () {58 vars in 1171 bytes} [Wed Aug 3 01:54:53 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 24540 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:54:54.843434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d7372dee-417c-4a28-9bc9-2e38f16f4ae8 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:54.849665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d7372dee-417c-4a28-9bc9-2e38f16f4ae8 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Searching by: {'deleted': False, 'project_id': 'f6c0dd85a7544c13bb64dcf6b19218f5'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:54:54.857648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d7372dee-417c-4a28-9bc9-2e38f16f4ae8 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:54.858393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d7372dee-417c-4a28-9bc9-2e38f16f4ae8 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:54.859620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d7372dee-417c-4a28-9bc9-2e38f16f4ae8 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:54.860337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d7372dee-417c-4a28-9bc9-2e38f16f4ae8 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:55.162387 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d7372dee-417c-4a28-9bc9-2e38f16f4ae8 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail?tenant_id=655a411b3b2542f7b62d41257e7bf806" status: 200 len: 15 microversion: 2.1 time: 0.322774 Aug 03 01:54:55.163815 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 952/1909] 10.222.0.67 () {58 vars in 1231 bytes} [Wed Aug 3 01:54:54 2022] GET /compute/v2.1/servers/detail?tenant_id=655a411b3b2542f7b62d41257e7bf806 => generated 15 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:54:55.185162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-298b18da-1cc7-4a83-a949-97710972d6e9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:55.191811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-298b18da-1cc7-4a83-a949-97710972d6e9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Searching by: {'tenant_id': '655a411b3b2542f7b62d41257e7bf806', 'deleted': False} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:54:55.200030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-298b18da-1cc7-4a83-a949-97710972d6e9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:55.200961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-298b18da-1cc7-4a83-a949-97710972d6e9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:55.202365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-298b18da-1cc7-4a83-a949-97710972d6e9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:55.203154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-298b18da-1cc7-4a83-a949-97710972d6e9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:55.241260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-298b18da-1cc7-4a83-a949-97710972d6e9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:54:55.303496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2bae549e-04f0-4d47-ba24-77f93c2ee077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:55.304959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2bae549e-04f0-4d47-ba24-77f93c2ee077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:55.313889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-298b18da-1cc7-4a83-a949-97710972d6e9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:55.315101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-298b18da-1cc7-4a83-a949-97710972d6e9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:55.319462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2bae549e-04f0-4d47-ba24-77f93c2ee077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:55.320458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2bae549e-04f0-4d47-ba24-77f93c2ee077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:55.322733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2bae549e-04f0-4d47-ba24-77f93c2ee077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:55.323657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2bae549e-04f0-4d47-ba24-77f93c2ee077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:55.686692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=20 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:55.756886 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-298b18da-1cc7-4a83-a949-97710972d6e9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=655a411b3b2542f7b62d41257e7bf806" status: 200 len: 4823 microversion: 2.1 time: 0.576148 Aug 03 01:54:55.777989 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 958/1910] 10.222.0.67 () {58 vars in 1257 bytes} [Wed Aug 3 01:54:55 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=655a411b3b2542f7b62d41257e7bf806 => generated 4823 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:55.784267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2baca80e-9e05-4b13-b91c-45a60014102f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:55.785041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2baca80e-9e05-4b13-b91c-45a60014102f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:55.802342 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2baca80e-9e05-4b13-b91c-45a60014102f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:55.819019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2baca80e-9e05-4b13-b91c-45a60014102f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:55.820903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2baca80e-9e05-4b13-b91c-45a60014102f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:55.821356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2baca80e-9e05-4b13-b91c-45a60014102f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:55.937262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2bae549e-04f0-4d47-ba24-77f93c2ee077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:55.964400 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2bae549e-04f0-4d47-ba24-77f93c2ee077 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1199 microversion: 2.1 time: 0.668436 Aug 03 01:54:55.973676 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 953/1911] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:55 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1199 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:55.989626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a3c42b0e-6d9a-4291-b3ec-028b746976aa tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b12a22670>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:56.188776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2baca80e-9e05-4b13-b91c-45a60014102f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:56.200248 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2baca80e-9e05-4b13-b91c-45a60014102f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1369 microversion: 2.1 time: 0.421479 Aug 03 01:54:56.200844 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 959/1912] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:55 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1369 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:56.244824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6ceb5538-50e1-4724-a3fb-2d0f73c0c386 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:56.300905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6ceb5538-50e1-4724-a3fb-2d0f73c0c386 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Searching by: {'tenant_id': 'f6c0dd85a7544c13bb64dcf6b19218f5', 'deleted': False} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:54:56.346537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ceb5538-50e1-4724-a3fb-2d0f73c0c386 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:56.356983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ceb5538-50e1-4724-a3fb-2d0f73c0c386 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:56.366942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ceb5538-50e1-4724-a3fb-2d0f73c0c386 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:56.367465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ceb5538-50e1-4724-a3fb-2d0f73c0c386 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:56.443311 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6ceb5538-50e1-4724-a3fb-2d0f73c0c386 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f6c0dd85a7544c13bb64dcf6b19218f5" status: 200 len: 15 microversion: 2.1 time: 0.230359 Aug 03 01:54:56.461752 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 960/1913] 10.222.0.67 () {58 vars in 1257 bytes} [Wed Aug 3 01:54:56 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f6c0dd85a7544c13bb64dcf6b19218f5 => generated 15 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:54:56.471561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d9bad574-efd2-432a-8cc5-8af89c293e34 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:56.479224 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d9bad574-efd2-432a-8cc5-8af89c293e34 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.014160 Aug 03 01:54:56.498762 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 961/1914] 10.222.0.67 () {58 vars in 1189 bytes} [Wed Aug 3 01:54:56 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:54:56.505208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ca392927-f782-4d8c-a5e5-eb847b507498 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:56.507494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ca392927-f782-4d8c-a5e5-eb847b507498 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:56.514522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca392927-f782-4d8c-a5e5-eb847b507498 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:56.515020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca392927-f782-4d8c-a5e5-eb847b507498 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:56.515853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca392927-f782-4d8c-a5e5-eb847b507498 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:56.516300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca392927-f782-4d8c-a5e5-eb847b507498 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:56.522511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:54:56.679047 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ca392927-f782-4d8c-a5e5-eb847b507498 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6/action" status: 202 len: 0 microversion: 2.1 time: 0.178730 Aug 03 01:54:56.684102 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 962/1915] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:54:56 2022] POST /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 01:54:56.691772 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b5252571-e836-4eee-a8b7-3677c46ca309 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:56.698354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b5252571-e836-4eee-a8b7-3677c46ca309 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:56.699441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b5252571-e836-4eee-a8b7-3677c46ca309 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '655a411b3b2542f7b62d41257e7bf806'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:54:56.706985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5252571-e836-4eee-a8b7-3677c46ca309 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:56.708738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5252571-e836-4eee-a8b7-3677c46ca309 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:56.710140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5252571-e836-4eee-a8b7-3677c46ca309 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:56.710817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5252571-e836-4eee-a8b7-3677c46ca309 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:56.827721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-b5252571-e836-4eee-a8b7-3677c46ca309 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:54:56.921767 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b5252571-e836-4eee-a8b7-3677c46ca309 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers?status=error" status: 200 len: 337 microversion: 2.1 time: 0.235215 Aug 03 01:54:56.929298 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 963/1916] 10.222.0.67 () {58 vars in 1150 bytes} [Wed Aug 3 01:54:56 2022] GET /compute/v2.1/servers?status=error => generated 337 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:54:56.935286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9370b3d2-582a-4466-a480-9f8411089760 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:56.938606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9370b3d2-582a-4466-a480-9f8411089760 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:56.949451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9370b3d2-582a-4466-a480-9f8411089760 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:56.950255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9370b3d2-582a-4466-a480-9f8411089760 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:56.951474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9370b3d2-582a-4466-a480-9f8411089760 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:56.952156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9370b3d2-582a-4466-a480-9f8411089760 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:57.145348 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9370b3d2-582a-4466-a480-9f8411089760 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6/action" status: 202 len: 0 microversion: 2.1 time: 0.213606 Aug 03 01:54:57.149172 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 964/1917] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:54:56 2022] POST /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:54:57.158189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3c440f70-c7e8-42e3-a0b8-1a27cc13f021 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:57.158842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3c440f70-c7e8-42e3-a0b8-1a27cc13f021 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:57.174924 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3c440f70-c7e8-42e3-a0b8-1a27cc13f021 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:57.175908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3c440f70-c7e8-42e3-a0b8-1a27cc13f021 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:57.177829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3c440f70-c7e8-42e3-a0b8-1a27cc13f021 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:57.178474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3c440f70-c7e8-42e3-a0b8-1a27cc13f021 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:57.715569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3c440f70-c7e8-42e3-a0b8-1a27cc13f021 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:57.731488 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3c440f70-c7e8-42e3-a0b8-1a27cc13f021 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1199 microversion: 2.1 time: 0.583523 Aug 03 01:54:57.732358 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 965/1918] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:57 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1199 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:57.736704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2b957d4f-c274-4b7c-8dbf-9bc26aed2565 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:57.737314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2b957d4f-c274-4b7c-8dbf-9bc26aed2565 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:57.755677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b957d4f-c274-4b7c-8dbf-9bc26aed2565 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:57.756132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b957d4f-c274-4b7c-8dbf-9bc26aed2565 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:57.756958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b957d4f-c274-4b7c-8dbf-9bc26aed2565 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:57.757396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b957d4f-c274-4b7c-8dbf-9bc26aed2565 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:58.325026 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2b957d4f-c274-4b7c-8dbf-9bc26aed2565 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1611 microversion: 2.1 time: 0.591581 Aug 03 01:54:58.346227 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 966/1919] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:57 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1611 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:58.362174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b99b8a0c-d0e2-44ea-ae41-c1764cea5b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:54:58.363685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b99b8a0c-d0e2-44ea-ae41-c1764cea5b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:54:58.418558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b99b8a0c-d0e2-44ea-ae41-c1764cea5b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:58.425517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b99b8a0c-d0e2-44ea-ae41-c1764cea5b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:58.426747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b99b8a0c-d0e2-44ea-ae41-c1764cea5b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:58.427414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b99b8a0c-d0e2-44ea-ae41-c1764cea5b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:54:59.915105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b99b8a0c-d0e2-44ea-ae41-c1764cea5b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:54:59.928326 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b99b8a0c-d0e2-44ea-ae41-c1764cea5b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1563 microversion: 2.1 time: 1.580863 Aug 03 01:54:59.929736 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 967/1920] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:54:58 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1563 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:54:59.939536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-800a1ec5-13c4-468d-8bbc-31f5c3c809e4 req-a0cd5100-d8c7-421c-8b01-4e03e20ca850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e79bb51-ff27-4ccf-b55a-b7eed7f8a784", "name": "network-vif-plugged", "status": "completed", "tag": "af3cfa3a-3bec-4ec8-94d2-c7b32c593e70"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:54:59.964554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-800a1ec5-13c4-468d-8bbc-31f5c3c809e4 req-a0cd5100-d8c7-421c-8b01-4e03e20ca850 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:54:59.967451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-800a1ec5-13c4-468d-8bbc-31f5c3c809e4 req-a0cd5100-d8c7-421c-8b01-4e03e20ca850 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:00.008704 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-800a1ec5-13c4-468d-8bbc-31f5c3c809e4 req-a0cd5100-d8c7-421c-8b01-4e03e20ca850 service nova] Creating event network-vif-plugged:af3cfa3a-3bec-4ec8-94d2-c7b32c593e70 for instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 on n-h1-826529-8 Aug 03 01:55:00.018800 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-800a1ec5-13c4-468d-8bbc-31f5c3c809e4 req-a0cd5100-d8c7-421c-8b01-4e03e20ca850 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087398 Aug 03 01:55:00.025487 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 968/1921] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:00.038737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8908dba-5c69-45b4-aef0-27290342bf95 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:00.039522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8908dba-5c69-45b4-aef0-27290342bf95 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:00.056199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8908dba-5c69-45b4-aef0-27290342bf95 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:00.056664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8908dba-5c69-45b4-aef0-27290342bf95 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:00.057466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8908dba-5c69-45b4-aef0-27290342bf95 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:00.057914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8908dba-5c69-45b4-aef0-27290342bf95 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:00.465487 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8908dba-5c69-45b4-aef0-27290342bf95 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1611 microversion: 2.1 time: 0.438446 Aug 03 01:55:00.473611 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 969/1922] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:00 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1611 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:00.504795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d79187bc-8479-4605-b758-27b7fe664267 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:00.521486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d79187bc-8479-4605-b758-27b7fe664267 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:00.541198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d79187bc-8479-4605-b758-27b7fe664267 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:00.543180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d79187bc-8479-4605-b758-27b7fe664267 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:00.547161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d79187bc-8479-4605-b758-27b7fe664267 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:00.547829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d79187bc-8479-4605-b758-27b7fe664267 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:01.039804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d79187bc-8479-4605-b758-27b7fe664267 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:01.059385 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d79187bc-8479-4605-b758-27b7fe664267 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1199 microversion: 2.1 time: 0.581793 Aug 03 01:55:01.060677 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 970/1923] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:00 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1199 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:01.068511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f7c8f082-883c-49d3-978c-4690c3d68dd5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:01.069352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f7c8f082-883c-49d3-978c-4690c3d68dd5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:01.077559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7c8f082-883c-49d3-978c-4690c3d68dd5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:01.078497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7c8f082-883c-49d3-978c-4690c3d68dd5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:01.079580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7c8f082-883c-49d3-978c-4690c3d68dd5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:01.080201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7c8f082-883c-49d3-978c-4690c3d68dd5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:01.208934 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f7c8f082-883c-49d3-978c-4690c3d68dd5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146781 Aug 03 01:55:01.210095 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 971/1924] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 01:55:01 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:01.214351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-145383df-9464-4695-8d86-53ea5f1a50b9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:01.231871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-145383df-9464-4695-8d86-53ea5f1a50b9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Searching by: {'host': 'n-h1-826529-8', 'deleted': False} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:55:01.251666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-145383df-9464-4695-8d86-53ea5f1a50b9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:01.252135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-145383df-9464-4695-8d86-53ea5f1a50b9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:01.256296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-145383df-9464-4695-8d86-53ea5f1a50b9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:01.256519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-145383df-9464-4695-8d86-53ea5f1a50b9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:01.590015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-145383df-9464-4695-8d86-53ea5f1a50b9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:55:01.793668 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-145383df-9464-4695-8d86-53ea5f1a50b9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "GET /compute/v2.1/servers?host=n-h1-826529-8&all_tenants=1" status: 200 len: 2285 microversion: 2.1 time: 0.582846 Aug 03 01:55:01.794281 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 972/1925] 10.222.0.67 () {58 vars in 1190 bytes} [Wed Aug 3 01:55:01 2022] GET /compute/v2.1/servers?host=n-h1-826529-8&all_tenants=1 => generated 2285 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:01.807840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5de7822a-ff39-438b-8a92-9c7781738feb tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:01.825407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5de7822a-ff39-438b-8a92-9c7781738feb tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:55:01.830400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5de7822a-ff39-438b-8a92-9c7781738feb tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:01.838780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5de7822a-ff39-438b-8a92-9c7781738feb tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:01.839834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5de7822a-ff39-438b-8a92-9c7781738feb tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:01.841031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5de7822a-ff39-438b-8a92-9c7781738feb tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:01.886222 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5de7822a-ff39-438b-8a92-9c7781738feb tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.081917 Aug 03 01:55:01.897132 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 973/1926] 10.222.0.67 () {58 vars in 1196 bytes} [Wed Aug 3 01:55:01 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 01:55:01.903161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e9791fc6-1398-4b62-8f5a-2ead63765b9c tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:01.905764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e9791fc6-1398-4b62-8f5a-2ead63765b9c tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:01.914010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9791fc6-1398-4b62-8f5a-2ead63765b9c tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:01.914470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9791fc6-1398-4b62-8f5a-2ead63765b9c tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:01.915456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9791fc6-1398-4b62-8f5a-2ead63765b9c tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:01.915916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9791fc6-1398-4b62-8f5a-2ead63765b9c tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:02.062499 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e9791fc6-1398-4b62-8f5a-2ead63765b9c tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6/action" status: 202 len: 0 microversion: 2.1 time: 0.162038 Aug 03 01:55:02.067461 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 974/1927] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:55:01 2022] POST /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:55:02.075960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:02.078514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:02.099099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:02.099632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:02.100617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:02.102459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:02.134812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:04.867473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=12 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:05.283659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:05.304119 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a3c42b0e-6d9a-4291-b3ec-028b746976aa tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1413 microversion: 2.1 time: 9.327078 Aug 03 01:55:05.307009 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 954/1928] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:54:55 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1413 bytes in 9332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:05.314791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-31847fce-ccb9-4d34-874c-9ed38a8e477e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:05.316099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-31847fce-ccb9-4d34-874c-9ed38a8e477e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:05.321877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:05.333130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:55:05.333558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:55:05.334049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:55:05.334466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:55:05.335027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:55:05.340787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31847fce-ccb9-4d34-874c-9ed38a8e477e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:05.342368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31847fce-ccb9-4d34-874c-9ed38a8e477e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:05.345811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31847fce-ccb9-4d34-874c-9ed38a8e477e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:05.350229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31847fce-ccb9-4d34-874c-9ed38a8e477e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:05.483370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:05.500296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:05.501603 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:05.502689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:05.503594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:05.540990 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7144d82f-d82b-4816-b88b-0261ec98c384 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "POST /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6/action" status: 202 len: 1064 microversion: 2.1 time: 3.472204 Aug 03 01:55:05.542118 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 975/1929] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:55:02 2022] POST /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6/action => generated 1064 bytes in 3474 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 03 01:55:05.547353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-1e39564f-3143-4eb8-a0bb-6a71bc91f83b req-b5cd28d1-973b-4045-896b-5aeb39fdca7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b54bdd1-d224-4a35-9487-66a77cd76c71", "name": "network-vif-plugged", "status": "completed", "tag": "54039f8b-300c-447b-a43c-cb4dd1e17902"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:05.559860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1e39564f-3143-4eb8-a0bb-6a71bc91f83b req-b5cd28d1-973b-4045-896b-5aeb39fdca7d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:05.561034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1e39564f-3143-4eb8-a0bb-6a71bc91f83b req-b5cd28d1-973b-4045-896b-5aeb39fdca7d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:05.574406 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-1e39564f-3143-4eb8-a0bb-6a71bc91f83b req-b5cd28d1-973b-4045-896b-5aeb39fdca7d service nova] Creating event network-vif-plugged:54039f8b-300c-447b-a43c-cb4dd1e17902 for instance 0b54bdd1-d224-4a35-9487-66a77cd76c71 on n-h2-826529-8 Aug 03 01:55:05.580598 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-1e39564f-3143-4eb8-a0bb-6a71bc91f83b req-b5cd28d1-973b-4045-896b-5aeb39fdca7d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036982 Aug 03 01:55:05.583675 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 976/1930] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:05.592249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a819ddc6-6d1b-4fe1-a5f0-f9740b83a8be req-2acd3330-b1fa-4c09-9e7e-014e035dcb0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d537dd36-d584-48d0-9458-81075e06b366", "tag": "02b87219-959c-40f7-baa4-183c4ffd1862"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:05.600384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:05.605488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a819ddc6-6d1b-4fe1-a5f0-f9740b83a8be req-2acd3330-b1fa-4c09-9e7e-014e035dcb0c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:05.606270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a819ddc6-6d1b-4fe1-a5f0-f9740b83a8be req-2acd3330-b1fa-4c09-9e7e-014e035dcb0c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:05.623807 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a819ddc6-6d1b-4fe1-a5f0-f9740b83a8be req-2acd3330-b1fa-4c09-9e7e-014e035dcb0c service nova] Creating event network-changed:02b87219-959c-40f7-baa4-183c4ffd1862 for instance d537dd36-d584-48d0-9458-81075e06b366 on n-h2-826529-8 Aug 03 01:55:05.647372 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a819ddc6-6d1b-4fe1-a5f0-f9740b83a8be req-2acd3330-b1fa-4c09-9e7e-014e035dcb0c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061071 Aug 03 01:55:05.650022 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 977/1931] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:05.668335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-683e9b94-bbb7-4709-a8fe-59d5ec99106a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:05.675670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-683e9b94-bbb7-4709-a8fe-59d5ec99106a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:05.688929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-683e9b94-bbb7-4709-a8fe-59d5ec99106a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:05.689601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-683e9b94-bbb7-4709-a8fe-59d5ec99106a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:05.691267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-683e9b94-bbb7-4709-a8fe-59d5ec99106a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:05.692137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-683e9b94-bbb7-4709-a8fe-59d5ec99106a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:05.828795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-31847fce-ccb9-4d34-874c-9ed38a8e477e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:05.837332 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-31847fce-ccb9-4d34-874c-9ed38a8e477e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1199 microversion: 2.1 time: 0.528968 Aug 03 01:55:05.851889 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 955/1932] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:05 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1199 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:06.323521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bf34d461-f656-4ee6-8c23-8677fc1ca3fb tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b12a22160>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:06.412553 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bf34d461-f656-4ee6-8c23-8677fc1ca3fb tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1413 microversion: 2.1 time: 0.094238 Aug 03 01:55:06.414950 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 956/1933] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:55:06 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:06.502990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-683e9b94-bbb7-4709-a8fe-59d5ec99106a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:06.521378 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-683e9b94-bbb7-4709-a8fe-59d5ec99106a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.869023 Aug 03 01:55:06.521990 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 978/1934] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:05 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:06.711584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8910b921-26e4-4ba1-9b10-1def44017df7 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1595639522", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": "none"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:06.813524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-8910b921-26e4-4ba1-9b10-1def44017df7 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:55:06.813994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-8910b921-26e4-4ba1-9b10-1def44017df7 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:55:06.815121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-8910b921-26e4-4ba1-9b10-1def44017df7 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:55:06.815544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-8910b921-26e4-4ba1-9b10-1def44017df7 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:55:06.818620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-8910b921-26e4-4ba1-9b10-1def44017df7 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:55:06.845673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8910b921-26e4-4ba1-9b10-1def44017df7 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:06.846433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8910b921-26e4-4ba1-9b10-1def44017df7 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:06.851544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8910b921-26e4-4ba1-9b10-1def44017df7 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:06.854208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8910b921-26e4-4ba1-9b10-1def44017df7 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:06.863823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d29a5cc8-bc4c-44c0-a4c5-342f48374b38 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:06.864929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d29a5cc8-bc4c-44c0-a4c5-342f48374b38 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:06.882473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d29a5cc8-bc4c-44c0-a4c5-342f48374b38 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:06.886372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d29a5cc8-bc4c-44c0-a4c5-342f48374b38 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:06.887567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d29a5cc8-bc4c-44c0-a4c5-342f48374b38 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:06.888850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d29a5cc8-bc4c-44c0-a4c5-342f48374b38 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:06.924046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-8910b921-26e4-4ba1-9b10-1def44017df7 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Getting quotas for project 6068cf446fa244b29de74230a5add9eb. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:55:06.938356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-8910b921-26e4-4ba1-9b10-1def44017df7 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Getting quotas for user 938d59e603744bb5aafa6c57c8f1e516 and project 6068cf446fa244b29de74230a5add9eb. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:55:06.965962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8910b921-26e4-4ba1-9b10-1def44017df7 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:55:06.971165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8910b921-26e4-4ba1-9b10-1def44017df7 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 3b2c8651-b723-4185-9b8c-0e4f48a248ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:55:07.062357 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8910b921-26e4-4ba1-9b10-1def44017df7 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.644127 Aug 03 01:55:07.064150 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 957/1935] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 01:55:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 01:55:07.082869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a7198f42-46b6-4233-aaf0-47fdc2476fef tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:07.083676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a7198f42-46b6-4233-aaf0-47fdc2476fef tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 3b2c8651-b723-4185-9b8c-0e4f48a248ea] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:07.224014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a7198f42-46b6-4233-aaf0-47fdc2476fef tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:07.242780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d29a5cc8-bc4c-44c0-a4c5-342f48374b38 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:07.247471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a7198f42-46b6-4233-aaf0-47fdc2476fef tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:07.251524 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d29a5cc8-bc4c-44c0-a4c5-342f48374b38 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1199 microversion: 2.1 time: 0.392905 Aug 03 01:55:07.253588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a7198f42-46b6-4233-aaf0-47fdc2476fef tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:07.255752 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 979/1936] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:06 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1199 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:07.259220 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a7198f42-46b6-4233-aaf0-47fdc2476fef tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/3b2c8651-b723-4185-9b8c-0e4f48a248ea" status: 200 len: 1278 microversion: 2.47 time: 0.186129 Aug 03 01:55:07.278958 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 958/1937] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:07 2022] GET /compute/v2.1/servers/3b2c8651-b723-4185-9b8c-0e4f48a248ea => generated 1278 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:07.335207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-df07b511-3caa-466e-af51-d017633e1a8c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-244626648", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": "none"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:07.434091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-df07b511-3caa-466e-af51-d017633e1a8c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:55:07.436268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e959e13b-9ed9-4160-9634-893395a568ef tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b24407670>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:07.449837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-df07b511-3caa-466e-af51-d017633e1a8c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:55:07.455677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-df07b511-3caa-466e-af51-d017633e1a8c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:55:07.459223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-df07b511-3caa-466e-af51-d017633e1a8c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:55:07.460062 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-df07b511-3caa-466e-af51-d017633e1a8c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:55:07.474975 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df07b511-3caa-466e-af51-d017633e1a8c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:07.475947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df07b511-3caa-466e-af51-d017633e1a8c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:07.477108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df07b511-3caa-466e-af51-d017633e1a8c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:07.477824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df07b511-3caa-466e-af51-d017633e1a8c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:07.505408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-df07b511-3caa-466e-af51-d017633e1a8c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Getting quotas for project 6068cf446fa244b29de74230a5add9eb. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:55:07.524846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-df07b511-3caa-466e-af51-d017633e1a8c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Getting quotas for user 938d59e603744bb5aafa6c57c8f1e516 and project 6068cf446fa244b29de74230a5add9eb. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:55:07.548505 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e959e13b-9ed9-4160-9634-893395a568ef tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1413 microversion: 2.1 time: 0.123578 Aug 03 01:55:07.549174 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 959/1938] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:55:07 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1413 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:07.561731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-373815f9-c205-4bb8-b68f-d5a719cac080 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:07.562638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-373815f9-c205-4bb8-b68f-d5a719cac080 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:07.576642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-df07b511-3caa-466e-af51-d017633e1a8c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:55:07.580166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-df07b511-3caa-466e-af51-d017633e1a8c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:55:07.593875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-373815f9-c205-4bb8-b68f-d5a719cac080 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:07.596151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-373815f9-c205-4bb8-b68f-d5a719cac080 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:07.604111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-373815f9-c205-4bb8-b68f-d5a719cac080 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:07.608709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-373815f9-c205-4bb8-b68f-d5a719cac080 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:07.705011 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-df07b511-3caa-466e-af51-d017633e1a8c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.372147 Aug 03 01:55:07.713125 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 980/1939] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 01:55:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 03 01:55:07.718535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed0f59b3-d59d-4ec0-a9b6-9a512b81323b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:07.721270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ed0f59b3-d59d-4ec0-a9b6-9a512b81323b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:07.786014 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed0f59b3-d59d-4ec0-a9b6-9a512b81323b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "PUT /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 991 microversion: 2.47 time: 0.071357 Aug 03 01:55:07.795574 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 981/1940] 10.222.0.67 () {62 vars in 1297 bytes} [Wed Aug 3 01:55:07 2022] PUT /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:55:07.821585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4164ab06-777a-468a-8341-9ae6c87dc6a1 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:07.822623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4164ab06-777a-468a-8341-9ae6c87dc6a1 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:08.015845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4164ab06-777a-468a-8341-9ae6c87dc6a1 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:08.028650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4164ab06-777a-468a-8341-9ae6c87dc6a1 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:08.032547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4164ab06-777a-468a-8341-9ae6c87dc6a1 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:08.038744 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4164ab06-777a-468a-8341-9ae6c87dc6a1 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1277 microversion: 2.47 time: 0.221299 Aug 03 01:55:08.051965 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 982/1941] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:07 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1277 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:55:08.179857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-373815f9-c205-4bb8-b68f-d5a719cac080 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:08.192475 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-373815f9-c205-4bb8-b68f-d5a719cac080 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.641769 Aug 03 01:55:08.200440 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 960/1942] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:07 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:08.277962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fbdbbc16-c7d5-4785-8822-b6f4b6591ab1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:08.279130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fbdbbc16-c7d5-4785-8822-b6f4b6591ab1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:08.303470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbdbbc16-c7d5-4785-8822-b6f4b6591ab1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:08.305130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbdbbc16-c7d5-4785-8822-b6f4b6591ab1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:08.307284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbdbbc16-c7d5-4785-8822-b6f4b6591ab1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:08.315682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbdbbc16-c7d5-4785-8822-b6f4b6591ab1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:08.571145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-07a24caa-b6f2-424f-b082-4227d1f167d9 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b12a72940>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:08.673494 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-07a24caa-b6f2-424f-b082-4227d1f167d9 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1413 microversion: 2.1 time: 0.109222 Aug 03 01:55:08.674516 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 961/1943] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:55:08 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:08.783421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fbdbbc16-c7d5-4785-8822-b6f4b6591ab1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:08.798227 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fbdbbc16-c7d5-4785-8822-b6f4b6591ab1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1382 microversion: 2.1 time: 0.524134 Aug 03 01:55:08.799767 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 983/1944] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:08 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1382 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:09.069579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1d376d9-9a85-4ef9-a4d9-abf4074e72b9 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:09.071356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b1d376d9-9a85-4ef9-a4d9-abf4074e72b9 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:09.079712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aae68d52-9f7b-4adb-94ee-4f4570b45319 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:09.080475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-aae68d52-9f7b-4adb-94ee-4f4570b45319 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:09.096612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1d376d9-9a85-4ef9-a4d9-abf4074e72b9 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:09.097983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1d376d9-9a85-4ef9-a4d9-abf4074e72b9 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:09.098818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1d376d9-9a85-4ef9-a4d9-abf4074e72b9 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:09.099387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1d376d9-9a85-4ef9-a4d9-abf4074e72b9 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:09.107187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aae68d52-9f7b-4adb-94ee-4f4570b45319 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:09.108735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aae68d52-9f7b-4adb-94ee-4f4570b45319 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:09.109622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aae68d52-9f7b-4adb-94ee-4f4570b45319 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:09.111266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aae68d52-9f7b-4adb-94ee-4f4570b45319 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:09.189755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b1d376d9-9a85-4ef9-a4d9-abf4074e72b9 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:09.201708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b1d376d9-9a85-4ef9-a4d9-abf4074e72b9 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:09.203760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b1d376d9-9a85-4ef9-a4d9-abf4074e72b9 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:09.208307 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b1d376d9-9a85-4ef9-a4d9-abf4074e72b9 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1273 microversion: 2.47 time: 0.145118 Aug 03 01:55:09.209486 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 984/1945] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:09 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:09.223947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-af132f84-b496-4c5f-8946-93c031e5df57 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:09.224650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-af132f84-b496-4c5f-8946-93c031e5df57 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:09.244487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af132f84-b496-4c5f-8946-93c031e5df57 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:09.244951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af132f84-b496-4c5f-8946-93c031e5df57 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:09.245807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af132f84-b496-4c5f-8946-93c031e5df57 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:09.246297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af132f84-b496-4c5f-8946-93c031e5df57 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:09.395615 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aae68d52-9f7b-4adb-94ee-4f4570b45319 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1533 microversion: 2.1 time: 0.577333 Aug 03 01:55:09.396545 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 962/1946] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:08 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1533 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:09.420914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-47406452-c3d5-4cd4-9a1f-869ed36bd7c4 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:09.421769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-47406452-c3d5-4cd4-9a1f-869ed36bd7c4 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:09.441682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47406452-c3d5-4cd4-9a1f-869ed36bd7c4 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:09.446165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47406452-c3d5-4cd4-9a1f-869ed36bd7c4 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:09.451358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47406452-c3d5-4cd4-9a1f-869ed36bd7c4 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:09.452119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47406452-c3d5-4cd4-9a1f-869ed36bd7c4 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:09.555066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-af132f84-b496-4c5f-8946-93c031e5df57 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:09.571819 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-af132f84-b496-4c5f-8946-93c031e5df57 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.351680 Aug 03 01:55:09.575279 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 985/1947] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:09 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:09.692081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-864db309-9ace-4af5-870b-4ca2e2788c61 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b1267e430>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:09.767332 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-47406452-c3d5-4cd4-9a1f-869ed36bd7c4 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1533 microversion: 2.1 time: 0.351764 Aug 03 01:55:09.768901 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 963/1948] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:09 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1533 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:09.801863 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-864db309-9ace-4af5-870b-4ca2e2788c61 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1413 microversion: 2.1 time: 0.109732 Aug 03 01:55:09.801863 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 986/1949] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:55:09 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:09.813882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5d9d95b8-8731-425b-9294-073247f58318 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:09.820264 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:55:09.820264 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:55:09.822250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d9d95b8-8731-425b-9294-073247f58318 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:09.822978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d9d95b8-8731-425b-9294-073247f58318 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:09.824384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d9d95b8-8731-425b-9294-073247f58318 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:09.824999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d9d95b8-8731-425b-9294-073247f58318 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:09.858987 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5d9d95b8-8731-425b-9294-073247f58318 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.067441 Aug 03 01:55:09.860341 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 964/1950] 10.222.0.67 () {58 vars in 1176 bytes} [Wed Aug 3 01:55:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:09.873539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7778927d-2f15-4ac4-adb9-79c93ed94ec7 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-826529-8", "block_migration": false, "disk_over_commit": false}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:09.876129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7778927d-2f15-4ac4-adb9-79c93ed94ec7 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:09.885117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7778927d-2f15-4ac4-adb9-79c93ed94ec7 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:09.885871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7778927d-2f15-4ac4-adb9-79c93ed94ec7 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:09.887079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7778927d-2f15-4ac4-adb9-79c93ed94ec7 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:09.887696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7778927d-2f15-4ac4-adb9-79c93ed94ec7 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:09.941612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-7778927d-2f15-4ac4-adb9-79c93ed94ec7 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lazy-loading 'flavor' on Instance uuid 0b54bdd1-d224-4a35-9487-66a77cd76c71 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:55:09.960959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7778927d-2f15-4ac4-adb9-79c93ed94ec7 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Going to try to live migrate instance to n-h1-826529-8 {{(pid=125941) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 01:55:10.234720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e3b0b905-181e-458f-87f1-fc15927a6e1d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:10.238432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e3b0b905-181e-458f-87f1-fc15927a6e1d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:10.251318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3b0b905-181e-458f-87f1-fc15927a6e1d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:10.252325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3b0b905-181e-458f-87f1-fc15927a6e1d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:10.253356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3b0b905-181e-458f-87f1-fc15927a6e1d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:10.266648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3b0b905-181e-458f-87f1-fc15927a6e1d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:10.421288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e3b0b905-181e-458f-87f1-fc15927a6e1d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:10.433338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e3b0b905-181e-458f-87f1-fc15927a6e1d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:10.434932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e3b0b905-181e-458f-87f1-fc15927a6e1d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:10.440604 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e3b0b905-181e-458f-87f1-fc15927a6e1d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1337 microversion: 2.47 time: 0.207091 Aug 03 01:55:10.441782 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 965/1951] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:10 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1337 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:10.601277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0d99b87b-a7c8-49d5-bb6e-193b44d5ed8e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:10.603225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0d99b87b-a7c8-49d5-bb6e-193b44d5ed8e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:10.618244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d99b87b-a7c8-49d5-bb6e-193b44d5ed8e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:10.618632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d99b87b-a7c8-49d5-bb6e-193b44d5ed8e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:10.631821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d99b87b-a7c8-49d5-bb6e-193b44d5ed8e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:10.632294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d99b87b-a7c8-49d5-bb6e-193b44d5ed8e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:10.933885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0d99b87b-a7c8-49d5-bb6e-193b44d5ed8e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:10.963855 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0d99b87b-a7c8-49d5-bb6e-193b44d5ed8e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.366158 Aug 03 01:55:10.982409 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 966/1952] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:10 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:10.992100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ee446407-cc37-46ce-90d5-88d19b567e76 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b243fd790>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:11.125957 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ee446407-cc37-46ce-90d5-88d19b567e76 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1413 microversion: 2.1 time: 0.141122 Aug 03 01:55:11.127475 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 967/1953] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:55:10 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1413 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:11.469798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2602424a-14e0-4a38-b8fa-e17ba3c492f5 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:11.470584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2602424a-14e0-4a38-b8fa-e17ba3c492f5 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:11.482587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2602424a-14e0-4a38-b8fa-e17ba3c492f5 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:11.485979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2602424a-14e0-4a38-b8fa-e17ba3c492f5 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:11.492314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2602424a-14e0-4a38-b8fa-e17ba3c492f5 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:11.492786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2602424a-14e0-4a38-b8fa-e17ba3c492f5 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:11.635128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2602424a-14e0-4a38-b8fa-e17ba3c492f5 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:11.650653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2602424a-14e0-4a38-b8fa-e17ba3c492f5 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:11.652589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2602424a-14e0-4a38-b8fa-e17ba3c492f5 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:11.654121 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2602424a-14e0-4a38-b8fa-e17ba3c492f5 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1335 microversion: 2.47 time: 0.188435 Aug 03 01:55:11.658086 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 968/1954] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:11 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1335 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:11.991710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-acb18059-474d-455a-b040-9ca84983eebd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:11.992387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-acb18059-474d-455a-b040-9ca84983eebd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:12.005490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acb18059-474d-455a-b040-9ca84983eebd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:12.006321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acb18059-474d-455a-b040-9ca84983eebd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:12.008120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acb18059-474d-455a-b040-9ca84983eebd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:12.008814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acb18059-474d-455a-b040-9ca84983eebd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:12.704467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-acb18059-474d-455a-b040-9ca84983eebd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:12.713341 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-acb18059-474d-455a-b040-9ca84983eebd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.727599 Aug 03 01:55:12.717295 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 969/1955] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:11 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:12.739595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4b11473d-430a-4e8e-9cc5-2af010e6bb02 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b12a5a280>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:12.848436 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4b11473d-430a-4e8e-9cc5-2af010e6bb02 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1413 microversion: 2.1 time: 0.129727 Aug 03 01:55:12.849327 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 970/1956] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:55:12 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1413 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:12.868214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f51fdf27-c549-42d3-aaba-3c2f1cfe171e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:12.868973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f51fdf27-c549-42d3-aaba-3c2f1cfe171e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:12.891127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f51fdf27-c549-42d3-aaba-3c2f1cfe171e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:12.902116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f51fdf27-c549-42d3-aaba-3c2f1cfe171e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:12.905739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f51fdf27-c549-42d3-aaba-3c2f1cfe171e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:12.906575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f51fdf27-c549-42d3-aaba-3c2f1cfe171e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:13.108464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f51fdf27-c549-42d3-aaba-3c2f1cfe171e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:13.129121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f51fdf27-c549-42d3-aaba-3c2f1cfe171e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:13.136552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f51fdf27-c549-42d3-aaba-3c2f1cfe171e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:13.137781 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f51fdf27-c549-42d3-aaba-3c2f1cfe171e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1335 microversion: 2.47 time: 0.276630 Aug 03 01:55:13.138491 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 971/1957] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:12 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1335 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:13.756720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dc7ff191-e958-4264-a14b-93e38cc80731 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:13.758455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dc7ff191-e958-4264-a14b-93e38cc80731 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:13.790657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc7ff191-e958-4264-a14b-93e38cc80731 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:13.791388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc7ff191-e958-4264-a14b-93e38cc80731 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:13.792594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc7ff191-e958-4264-a14b-93e38cc80731 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:13.793285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc7ff191-e958-4264-a14b-93e38cc80731 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:14.446544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dc7ff191-e958-4264-a14b-93e38cc80731 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:14.461416 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dc7ff191-e958-4264-a14b-93e38cc80731 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.725360 Aug 03 01:55:14.465532 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 972/1958] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:13 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:14.470868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6b4401fc-94ae-4a98-97af-32aa40fc0ce3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b243fd550>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:14.556490 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6b4401fc-94ae-4a98-97af-32aa40fc0ce3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1413 microversion: 2.1 time: 0.088955 Aug 03 01:55:14.557590 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 973/1959] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:55:14 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:14.576872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a5abc351-9235-4a30-bee7-a17e2524184f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:14.577736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a5abc351-9235-4a30-bee7-a17e2524184f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:14.595992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5abc351-9235-4a30-bee7-a17e2524184f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:14.596766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5abc351-9235-4a30-bee7-a17e2524184f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:14.598326 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5abc351-9235-4a30-bee7-a17e2524184f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:14.599449 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5abc351-9235-4a30-bee7-a17e2524184f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:14.779534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a5abc351-9235-4a30-bee7-a17e2524184f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:14.819397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a5abc351-9235-4a30-bee7-a17e2524184f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:14.823280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a5abc351-9235-4a30-bee7-a17e2524184f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:14.825452 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a5abc351-9235-4a30-bee7-a17e2524184f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1335 microversion: 2.47 time: 0.262746 Aug 03 01:55:14.828861 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 974/1960] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:14 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1335 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:15.184071 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1339781805", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:15.260246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] validate_networks() for [('0fa315af-cf7c-44e3-85d0-00b33819492e', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:55:16.148061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:55:16.149286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:55:16.149956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:55:16.150561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:55:16.152626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:55:16.179952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:16.180404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:16.181219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:16.185733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:16.219412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Getting quotas for project 5afa51a97bca4402b44c445a5382e23e. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:55:16.226230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Getting quotas for user 1849063489bf44fabc0785643c0c28e2 and project 5afa51a97bca4402b44c445a5382e23e. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:55:16.242555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:55:16.245300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:55:16.334275 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ff19ea7c-199a-49a4-94d3-cbeff52d8515 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.236658 Aug 03 01:55:16.341239 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 975/1961] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:55:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:55:16.351774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ee10b829-c081-4c52-8ec7-fbfae6b3c181 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:16.352418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ee10b829-c081-4c52-8ec7-fbfae6b3c181 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:16.375320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee10b829-c081-4c52-8ec7-fbfae6b3c181 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:16.375780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee10b829-c081-4c52-8ec7-fbfae6b3c181 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:16.376624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee10b829-c081-4c52-8ec7-fbfae6b3c181 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:16.377077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee10b829-c081-4c52-8ec7-fbfae6b3c181 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:16.640348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ee10b829-c081-4c52-8ec7-fbfae6b3c181 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:16.669788 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ee10b829-c081-4c52-8ec7-fbfae6b3c181 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.327833 Aug 03 01:55:16.673636 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 976/1962] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:16 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:16.684402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f2f10a5c-9d97-4850-afc6-52c57d93f1c3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b24417b80>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:16.758670 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f2f10a5c-9d97-4850-afc6-52c57d93f1c3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1413 microversion: 2.1 time: 0.080462 Aug 03 01:55:16.759711 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 977/1963] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:55:16 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:16.773060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0aae857-8c3a-42e3-818a-6f8869a8e59a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:16.774109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0aae857-8c3a-42e3-818a-6f8869a8e59a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:16.782637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0aae857-8c3a-42e3-818a-6f8869a8e59a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:16.783717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0aae857-8c3a-42e3-818a-6f8869a8e59a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:16.787370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0aae857-8c3a-42e3-818a-6f8869a8e59a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:16.788084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0aae857-8c3a-42e3-818a-6f8869a8e59a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:16.828689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:16.872376 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7778927d-2f15-4ac4-adb9-79c93ed94ec7 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71/action" status: 202 len: 0 microversion: 2.1 time: 7.002836 Aug 03 01:55:16.880277 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 987/1964] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:55:09 2022] POST /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71/action => generated 0 bytes in 7008 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:55:16.889274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b888e623-37a1-4a8f-9a0e-81959d34e0c7 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:16.889911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b888e623-37a1-4a8f-9a0e-81959d34e0c7 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:17.027080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0aae857-8c3a-42e3-818a-6f8869a8e59a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:17.051433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0aae857-8c3a-42e3-818a-6f8869a8e59a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:17.054659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0aae857-8c3a-42e3-818a-6f8869a8e59a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:17.067482 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0aae857-8c3a-42e3-818a-6f8869a8e59a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1356 microversion: 2.47 time: 0.305144 Aug 03 01:55:17.086931 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 978/1965] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:16 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1356 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:17.095734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6fef9ea4-5df4-444b-bed3-eea7efae86e1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:17.096748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6fef9ea4-5df4-444b-bed3-eea7efae86e1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:17.104147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b888e623-37a1-4a8f-9a0e-81959d34e0c7 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:17.114632 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b888e623-37a1-4a8f-9a0e-81959d34e0c7 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1214 microversion: 2.1 time: 0.234445 Aug 03 01:55:17.115486 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 988/1966] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:16 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1214 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:17.124092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:17.127217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:17.130921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fef9ea4-5df4-444b-bed3-eea7efae86e1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:17.131499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fef9ea4-5df4-444b-bed3-eea7efae86e1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:17.133062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fef9ea4-5df4-444b-bed3-eea7efae86e1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:17.137448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:17.138218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:17.139317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:17.141378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:17.143219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fef9ea4-5df4-444b-bed3-eea7efae86e1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:17.370260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:55:17.370763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:55:17.371333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:55:17.372460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:55:17.372957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:55:17.477545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6fef9ea4-5df4-444b-bed3-eea7efae86e1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:17.488679 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6fef9ea4-5df4-444b-bed3-eea7efae86e1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.407237 Aug 03 01:55:17.502956 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 979/1967] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:17 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:17.502956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-467136606", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "db14d09c-b745-4579-af9f-767661c49472"}], "block_device_mapping_v2": [{"uuid": "39e0ede2-f635-41a8-b278-a19948ac3238", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:17.508466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:17.526553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=14 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:17.548561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:17.549429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:17.552327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:17.553937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:17.630776 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5854a64-a84a-4fd7-b57f-b48b7ff14766 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "POST /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1/action" status: 202 len: 1078 microversion: 2.47 time: 0.513119 Aug 03 01:55:17.632227 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 989/1968] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 3 01:55:17 2022] POST /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1/action => generated 1078 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 03 01:55:17.658889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b4936507-299e-48bc-9bc7-3d46ed0f1510 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:17.660651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b4936507-299e-48bc-9bc7-3d46ed0f1510 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:17.669141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4936507-299e-48bc-9bc7-3d46ed0f1510 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:17.670035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4936507-299e-48bc-9bc7-3d46ed0f1510 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:17.671280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4936507-299e-48bc-9bc7-3d46ed0f1510 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:17.671781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4936507-299e-48bc-9bc7-3d46ed0f1510 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:17.672641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] validate_networks() for [('db14d09c-b745-4579-af9f-767661c49472', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:55:17.952294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b4936507-299e-48bc-9bc7-3d46ed0f1510 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:17.979450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b4936507-299e-48bc-9bc7-3d46ed0f1510 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:17.988033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b4936507-299e-48bc-9bc7-3d46ed0f1510 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:17.993771 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b4936507-299e-48bc-9bc7-3d46ed0f1510 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.340066 Aug 03 01:55:17.995467 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 990/1969] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:17 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:55:18.011223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-317220b5-fc7f-4c00-9735-61250c58f8bc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:18.011862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-317220b5-fc7f-4c00-9735-61250c58f8bc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:18.025621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-317220b5-fc7f-4c00-9735-61250c58f8bc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:18.026929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-317220b5-fc7f-4c00-9735-61250c58f8bc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:18.027933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-317220b5-fc7f-4c00-9735-61250c58f8bc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:18.029119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-317220b5-fc7f-4c00-9735-61250c58f8bc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:18.336648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-317220b5-fc7f-4c00-9735-61250c58f8bc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:18.344598 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-317220b5-fc7f-4c00-9735-61250c58f8bc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.346525 Aug 03 01:55:18.345134 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 991/1970] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:17 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:18.377395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a5a9861d-ecb4-40ba-9084-e0ab070720c0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b1263e4c0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:18.474779 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a5a9861d-ecb4-40ba-9084-e0ab070720c0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1422 microversion: 2.1 time: 0.110462 Aug 03 01:55:18.475880 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 992/1971] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:55:18 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1422 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:18.488088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-821c8faf-0316-4cd4-bb27-57047d439128 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:18.490431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-821c8faf-0316-4cd4-bb27-57047d439128 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:18.507723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-821c8faf-0316-4cd4-bb27-57047d439128 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:18.508327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-821c8faf-0316-4cd4-bb27-57047d439128 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:18.509224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-821c8faf-0316-4cd4-bb27-57047d439128 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:18.509786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-821c8faf-0316-4cd4-bb27-57047d439128 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:18.522890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:18.669899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-821c8faf-0316-4cd4-bb27-57047d439128 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:18.687674 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-821c8faf-0316-4cd4-bb27-57047d439128 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1274 microversion: 2.1 time: 0.204409 Aug 03 01:55:18.699015 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 993/1972] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:18 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1274 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:18.699015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-72f0bf36-3611-4174-9e65-78ca7fd6d870 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b1273eca0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:18.767073 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-72f0bf36-3611-4174-9e65-78ca7fd6d870 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 200 len: 1422 microversion: 2.1 time: 0.075820 Aug 03 01:55:18.768611 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 994/1973] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:55:18 2022] GET /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 1422 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:18.778726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c8d783d2-6a5a-4a04-af46-8032ca426e77 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:18.780219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c8d783d2-6a5a-4a04-af46-8032ca426e77 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:18.789454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c8d783d2-6a5a-4a04-af46-8032ca426e77 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:18.790415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c8d783d2-6a5a-4a04-af46-8032ca426e77 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:18.803456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c8d783d2-6a5a-4a04-af46-8032ca426e77 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:18.807751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c8d783d2-6a5a-4a04-af46-8032ca426e77 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:18.878098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:55:18.879890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:55:18.880590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:55:18.881067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:55:18.881562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:55:18.908510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:18.908969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:18.911528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:18.912186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:18.935922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Getting quotas for project 162addf8f6634e7fa0a1f9c6004258d1. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:55:18.942173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Getting quotas for user 4cb821820bbb4d3a8c999e1dec6a06a4 and project 162addf8f6634e7fa0a1f9c6004258d1. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:55:19.045468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:55:19.055686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39e0ede2-f635-41a8-b278-a19948ac3238',volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:55:19.173321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c8d783d2-6a5a-4a04-af46-8032ca426e77 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:19.184458 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c8d783d2-6a5a-4a04-af46-8032ca426e77 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.413171 Aug 03 01:55:19.186578 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 995/1974] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:18 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:19.198576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eb944b5b-d694-4d08-80cc-79fd9ce6c72a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b125d2e50>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:19.303215 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-120ae542-e0e3-49bf-98d9-b3bef7432648 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.809541 Aug 03 01:55:19.308361 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 980/1975] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 01:55:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 01:55:19.320191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f5f76747-2873-4c54-88ab-dc44fad70d57 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:19.348621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f5f76747-2873-4c54-88ab-dc44fad70d57 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:19.358861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5f76747-2873-4c54-88ab-dc44fad70d57 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:19.359424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5f76747-2873-4c54-88ab-dc44fad70d57 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:19.360353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5f76747-2873-4c54-88ab-dc44fad70d57 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:19.360808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5f76747-2873-4c54-88ab-dc44fad70d57 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:19.504465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f5f76747-2873-4c54-88ab-dc44fad70d57 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:19.519981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f5f76747-2873-4c54-88ab-dc44fad70d57 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:19.526429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f5f76747-2873-4c54-88ab-dc44fad70d57 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:19.528249 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f5f76747-2873-4c54-88ab-dc44fad70d57 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.217164 Aug 03 01:55:19.530470 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 981/1976] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:19 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:19.543611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e0f7aed0-a9c0-4ec0-b1e9-22eb8ea726b9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:19.547182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e0f7aed0-a9c0-4ec0-b1e9-22eb8ea726b9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:19.739079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e0f7aed0-a9c0-4ec0-b1e9-22eb8ea726b9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:19.767467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e0f7aed0-a9c0-4ec0-b1e9-22eb8ea726b9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:19.770961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e0f7aed0-a9c0-4ec0-b1e9-22eb8ea726b9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:19.772892 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e0f7aed0-a9c0-4ec0-b1e9-22eb8ea726b9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1103 microversion: 2.25 time: 0.240071 Aug 03 01:55:19.774652 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 982/1977] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:19 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1103 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:19.781539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ca12d124-f7fa-44a2-8941-82b17753331f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:19.782923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ca12d124-f7fa-44a2-8941-82b17753331f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:19.814277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca12d124-f7fa-44a2-8941-82b17753331f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:19.815102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca12d124-f7fa-44a2-8941-82b17753331f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:19.816991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca12d124-f7fa-44a2-8941-82b17753331f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:19.817721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca12d124-f7fa-44a2-8941-82b17753331f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:20.337436 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eb944b5b-d694-4d08-80cc-79fd9ce6c72a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 204 len: 0 microversion: 2.1 time: 1.147453 Aug 03 01:55:20.338346 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 996/1978] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:19 2022] DELETE /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 0 bytes in 1149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:55:20.345897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-34101e3f-bcd8-49fc-b4d0-78dd3c83e69f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:20.348664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-34101e3f-bcd8-49fc-b4d0-78dd3c83e69f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:20.367928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34101e3f-bcd8-49fc-b4d0-78dd3c83e69f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:20.369453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34101e3f-bcd8-49fc-b4d0-78dd3c83e69f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:20.372612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34101e3f-bcd8-49fc-b4d0-78dd3c83e69f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:20.374349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34101e3f-bcd8-49fc-b4d0-78dd3c83e69f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:20.440489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ca12d124-f7fa-44a2-8941-82b17753331f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:20.455141 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ca12d124-f7fa-44a2-8941-82b17753331f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.678469 Aug 03 01:55:20.457635 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 983/1979] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:19 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:20.469898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d43d154c-593e-462d-bf6a-118517aa6ba4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:20.470964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d43d154c-593e-462d-bf6a-118517aa6ba4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:20.490929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d43d154c-593e-462d-bf6a-118517aa6ba4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:20.491545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d43d154c-593e-462d-bf6a-118517aa6ba4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:20.492523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d43d154c-593e-462d-bf6a-118517aa6ba4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:20.493318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d43d154c-593e-462d-bf6a-118517aa6ba4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:20.858387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-34101e3f-bcd8-49fc-b4d0-78dd3c83e69f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:20.869967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d43d154c-593e-462d-bf6a-118517aa6ba4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:20.875998 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-34101e3f-bcd8-49fc-b4d0-78dd3c83e69f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1314 microversion: 2.1 time: 0.535196 Aug 03 01:55:20.876924 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 997/1980] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:20 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:20.883597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1cefa4a0-0acf-474b-9066-74aa09bca01a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:20.884179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1cefa4a0-0acf-474b-9066-74aa09bca01a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:20.891626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1cefa4a0-0acf-474b-9066-74aa09bca01a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:20.892279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1cefa4a0-0acf-474b-9066-74aa09bca01a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:20.893253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1cefa4a0-0acf-474b-9066-74aa09bca01a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:20.895313 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d43d154c-593e-462d-bf6a-118517aa6ba4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.436482 Aug 03 01:55:20.895752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1cefa4a0-0acf-474b-9066-74aa09bca01a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:20.912322 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 984/1981] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:20 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:20.917803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-398f4535-1912-4988-9410-aeee0cc9b664 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:20.918785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-398f4535-1912-4988-9410-aeee0cc9b664 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:20.937291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-398f4535-1912-4988-9410-aeee0cc9b664 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:20.937847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-398f4535-1912-4988-9410-aeee0cc9b664 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:20.938779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-398f4535-1912-4988-9410-aeee0cc9b664 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:20.939351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-398f4535-1912-4988-9410-aeee0cc9b664 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:20.941951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1cefa4a0-0acf-474b-9066-74aa09bca01a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:55:21.096247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-398f4535-1912-4988-9410-aeee0cc9b664 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:21.112017 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1cefa4a0-0acf-474b-9066-74aa09bca01a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784" status: 204 len: 0 microversion: 2.1 time: 0.233507 Aug 03 01:55:21.115674 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 998/1982] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:55:20 2022] DELETE /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:55:21.124135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-398f4535-1912-4988-9410-aeee0cc9b664 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:21.137115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-686a7676-a7ab-43d3-b7bb-6933d34df278 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:21.137707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-398f4535-1912-4988-9410-aeee0cc9b664 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:21.139320 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-398f4535-1912-4988-9410-aeee0cc9b664 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.225424 Aug 03 01:55:21.141161 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 985/1983] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:20 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:21.141479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-686a7676-a7ab-43d3-b7bb-6933d34df278 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:21.149972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-686a7676-a7ab-43d3-b7bb-6933d34df278 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:21.150720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-686a7676-a7ab-43d3-b7bb-6933d34df278 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:21.152010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-686a7676-a7ab-43d3-b7bb-6933d34df278 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:21.152701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-686a7676-a7ab-43d3-b7bb-6933d34df278 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:21.263888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-686a7676-a7ab-43d3-b7bb-6933d34df278 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:21.274302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-686a7676-a7ab-43d3-b7bb-6933d34df278 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:21.276112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-686a7676-a7ab-43d3-b7bb-6933d34df278 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:21.277490 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-686a7676-a7ab-43d3-b7bb-6933d34df278 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1232 microversion: 2.25 time: 0.159867 Aug 03 01:55:21.278262 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 999/1984] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:21 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1232 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:21.307163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-503250996", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "53d4fe2c-f615-4656-9157-a036740f9e27"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:21.373381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] validate_networks() for [('53d4fe2c-f615-4656-9157-a036740f9e27', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:55:21.480804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3ef92aa8-5d7d-49d9-a28f-cc7b1d370c8b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:21.482883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3ef92aa8-5d7d-49d9-a28f-cc7b1d370c8b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:21.494182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ef92aa8-5d7d-49d9-a28f-cc7b1d370c8b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:21.495248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ef92aa8-5d7d-49d9-a28f-cc7b1d370c8b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:21.496912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ef92aa8-5d7d-49d9-a28f-cc7b1d370c8b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:21.497503 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ef92aa8-5d7d-49d9-a28f-cc7b1d370c8b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:21.778339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3ef92aa8-5d7d-49d9-a28f-cc7b1d370c8b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:21.790397 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3ef92aa8-5d7d-49d9-a28f-cc7b1d370c8b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.315717 Aug 03 01:55:21.791505 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1000/1985] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:21 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:21.899302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0acea459-aa6b-4b00-b7d8-e0af47c5032a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:21.900174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0acea459-aa6b-4b00-b7d8-e0af47c5032a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:21.908472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0acea459-aa6b-4b00-b7d8-e0af47c5032a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:21.909022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0acea459-aa6b-4b00-b7d8-e0af47c5032a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:21.911082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0acea459-aa6b-4b00-b7d8-e0af47c5032a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:21.911786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0acea459-aa6b-4b00-b7d8-e0af47c5032a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:22.392988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:55:22.395124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:55:22.396073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:55:22.397484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:55:22.397964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:55:22.402175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:22.414114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0acea459-aa6b-4b00-b7d8-e0af47c5032a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:22.419519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:22.420166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:22.421150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:22.421592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:22.425711 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0acea459-aa6b-4b00-b7d8-e0af47c5032a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1314 microversion: 2.1 time: 0.530843 Aug 03 01:55:22.426345 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1001/1986] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:21 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:22.432769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2c57f042-1814-43e6-8e06-450166c5eedc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:22.433716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2c57f042-1814-43e6-8e06-450166c5eedc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:22.445317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Getting quotas for project 6bf2395335564acdaf819f2175dbd3bc. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:55:22.447465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c57f042-1814-43e6-8e06-450166c5eedc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:22.448367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c57f042-1814-43e6-8e06-450166c5eedc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:22.449447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c57f042-1814-43e6-8e06-450166c5eedc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:22.450320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c57f042-1814-43e6-8e06-450166c5eedc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:22.451940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Getting quotas for user 47e6a189229d4f8ab3aa4ca416d84594 and project 6bf2395335564acdaf819f2175dbd3bc. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:55:22.470154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:55:22.473070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:55:22.533556 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-292e9bec-c1ed-486b-b629-1ff7a8dfa70d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230153 Aug 03 01:55:22.537894 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 986/1987] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:55:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:55:22.544181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-4e625cec-7487-4622-8a47-646d653a35cd req-a60a12bc-e8af-40c1-87e0-3bbd5f703edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072d2dbc-29dd-41c9-ac28-a9961d858bf0", "tag": "b1dc1187-e8b5-4240-b07e-e49126145f1b"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:22.561307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4e625cec-7487-4622-8a47-646d653a35cd req-a60a12bc-e8af-40c1-87e0-3bbd5f703edf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:22.561972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4e625cec-7487-4622-8a47-646d653a35cd req-a60a12bc-e8af-40c1-87e0-3bbd5f703edf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:22.579636 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-4e625cec-7487-4622-8a47-646d653a35cd req-a60a12bc-e8af-40c1-87e0-3bbd5f703edf service nova] Creating event network-changed:b1dc1187-e8b5-4240-b07e-e49126145f1b for instance 072d2dbc-29dd-41c9-ac28-a9961d858bf0 on n-h2-826529-8 Aug 03 01:55:22.586502 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-4e625cec-7487-4622-8a47-646d653a35cd req-a60a12bc-e8af-40c1-87e0-3bbd5f703edf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046732 Aug 03 01:55:22.587597 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 987/1988] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:22.593642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4b0677a4-0ac8-41f4-b64b-a1980c983d23 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:22.594661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4b0677a4-0ac8-41f4-b64b-a1980c983d23 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:22.603433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b0677a4-0ac8-41f4-b64b-a1980c983d23 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:22.604139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b0677a4-0ac8-41f4-b64b-a1980c983d23 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:22.605787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b0677a4-0ac8-41f4-b64b-a1980c983d23 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:22.606596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b0677a4-0ac8-41f4-b64b-a1980c983d23 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:23.054954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4b0677a4-0ac8-41f4-b64b-a1980c983d23 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:23.068522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4b0677a4-0ac8-41f4-b64b-a1980c983d23 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:23.071073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4b0677a4-0ac8-41f4-b64b-a1980c983d23 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:23.072641 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4b0677a4-0ac8-41f4-b64b-a1980c983d23 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.483852 Aug 03 01:55:23.073768 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 988/1989] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:22 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:23.082448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c649d910-da62-4e75-85f0-e6dd388df1ea tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:23.083512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c649d910-da62-4e75-85f0-e6dd388df1ea tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:23.085270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2c57f042-1814-43e6-8e06-450166c5eedc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:23.093193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c649d910-da62-4e75-85f0-e6dd388df1ea tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:23.093786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c649d910-da62-4e75-85f0-e6dd388df1ea tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:23.094525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c649d910-da62-4e75-85f0-e6dd388df1ea tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:23.095395 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2c57f042-1814-43e6-8e06-450166c5eedc tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.666841 Aug 03 01:55:23.095550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c649d910-da62-4e75-85f0-e6dd388df1ea tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:23.096035 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1002/1990] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:22 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:23.119613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b9940cfb-d4aa-48af-8b1b-ab7de9232881 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:23.120372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b9940cfb-d4aa-48af-8b1b-ab7de9232881 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:23.127306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9940cfb-d4aa-48af-8b1b-ab7de9232881 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:23.127755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9940cfb-d4aa-48af-8b1b-ab7de9232881 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:23.129837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9940cfb-d4aa-48af-8b1b-ab7de9232881 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:23.130733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9940cfb-d4aa-48af-8b1b-ab7de9232881 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:23.255309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c649d910-da62-4e75-85f0-e6dd388df1ea tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:23.257537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b9940cfb-d4aa-48af-8b1b-ab7de9232881 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:23.267083 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b9940cfb-d4aa-48af-8b1b-ab7de9232881 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1211 microversion: 2.1 time: 0.151685 Aug 03 01:55:23.267678 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1003/1991] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:23 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1211 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:23.284985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c649d910-da62-4e75-85f0-e6dd388df1ea tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:23.286631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-87156d30-76d4-4b14-a1b8-dfbb955c090e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:23.287324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-87156d30-76d4-4b14-a1b8-dfbb955c090e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:23.287476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c649d910-da62-4e75-85f0-e6dd388df1ea tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:23.288811 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c649d910-da62-4e75-85f0-e6dd388df1ea tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1240 microversion: 2.25 time: 0.213670 Aug 03 01:55:23.299109 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 989/1992] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:23 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1240 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:23.303029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87156d30-76d4-4b14-a1b8-dfbb955c090e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:23.303029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87156d30-76d4-4b14-a1b8-dfbb955c090e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:23.305618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87156d30-76d4-4b14-a1b8-dfbb955c090e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:23.305618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87156d30-76d4-4b14-a1b8-dfbb955c090e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:23.447844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d76d8a50-b17f-4dc2-9525-77e7cfd9d6ba tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:23.449231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d76d8a50-b17f-4dc2-9525-77e7cfd9d6ba tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:23.455851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d76d8a50-b17f-4dc2-9525-77e7cfd9d6ba tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:23.457157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d76d8a50-b17f-4dc2-9525-77e7cfd9d6ba tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:23.458406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d76d8a50-b17f-4dc2-9525-77e7cfd9d6ba tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:23.459135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d76d8a50-b17f-4dc2-9525-77e7cfd9d6ba tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:23.464474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-87156d30-76d4-4b14-a1b8-dfbb955c090e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:23.474676 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-87156d30-76d4-4b14-a1b8-dfbb955c090e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.205667 Aug 03 01:55:23.475294 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1004/1993] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:23 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:23.520119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-d0f4237f-5402-44b9-a54c-10482439ccff req-c64aa91d-8ee0-43ec-9202-13212440701f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e79bb51-ff27-4ccf-b55a-b7eed7f8a784", "name": "network-vif-unplugged", "status": "completed", "tag": "af3cfa3a-3bec-4ec8-94d2-c7b32c593e70"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:23.537257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d0f4237f-5402-44b9-a54c-10482439ccff req-c64aa91d-8ee0-43ec-9202-13212440701f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:23.539540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d0f4237f-5402-44b9-a54c-10482439ccff req-c64aa91d-8ee0-43ec-9202-13212440701f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:23.556612 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-d0f4237f-5402-44b9-a54c-10482439ccff req-c64aa91d-8ee0-43ec-9202-13212440701f service nova] Creating event network-vif-unplugged:af3cfa3a-3bec-4ec8-94d2-c7b32c593e70 for instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 on n-h1-826529-8 Aug 03 01:55:23.570096 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-d0f4237f-5402-44b9-a54c-10482439ccff req-c64aa91d-8ee0-43ec-9202-13212440701f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049047 Aug 03 01:55:23.571465 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1005/1994] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:55:23.630782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d76d8a50-b17f-4dc2-9525-77e7cfd9d6ba tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:23.639347 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d76d8a50-b17f-4dc2-9525-77e7cfd9d6ba tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1314 microversion: 2.1 time: 0.195197 Aug 03 01:55:23.639848 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 990/1995] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:23 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:24.099628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f61b280f-1d83-482c-9946-e0e2057cdeed tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:24.100335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f61b280f-1d83-482c-9946-e0e2057cdeed tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:24.106863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f61b280f-1d83-482c-9946-e0e2057cdeed tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:24.107353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f61b280f-1d83-482c-9946-e0e2057cdeed tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:24.108145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f61b280f-1d83-482c-9946-e0e2057cdeed tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:24.108588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f61b280f-1d83-482c-9946-e0e2057cdeed tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:24.121602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dc1d6922-4812-4cac-986a-1140b6aef04a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:24.122233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dc1d6922-4812-4cac-986a-1140b6aef04a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:24.131391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc1d6922-4812-4cac-986a-1140b6aef04a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:24.131855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc1d6922-4812-4cac-986a-1140b6aef04a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:24.132669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc1d6922-4812-4cac-986a-1140b6aef04a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:24.133308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc1d6922-4812-4cac-986a-1140b6aef04a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:24.235625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f61b280f-1d83-482c-9946-e0e2057cdeed tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:24.247213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f61b280f-1d83-482c-9946-e0e2057cdeed tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:24.248769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f61b280f-1d83-482c-9946-e0e2057cdeed tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:24.249974 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f61b280f-1d83-482c-9946-e0e2057cdeed tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.155968 Aug 03 01:55:24.250953 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1006/1996] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:24 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:24.291914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-391a93db-ba27-4b4e-b1aa-d481f161d496 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:24.292637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-391a93db-ba27-4b4e-b1aa-d481f161d496 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:24.299117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-391a93db-ba27-4b4e-b1aa-d481f161d496 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:24.299707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-391a93db-ba27-4b4e-b1aa-d481f161d496 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:24.301303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-391a93db-ba27-4b4e-b1aa-d481f161d496 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:24.301812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-391a93db-ba27-4b4e-b1aa-d481f161d496 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:24.434236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dc1d6922-4812-4cac-986a-1140b6aef04a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:24.435038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-391a93db-ba27-4b4e-b1aa-d481f161d496 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:24.447165 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-391a93db-ba27-4b4e-b1aa-d481f161d496 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1259 microversion: 2.1 time: 0.159257 Aug 03 01:55:24.447842 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dc1d6922-4812-4cac-986a-1140b6aef04a tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.329463 Aug 03 01:55:24.448433 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1007/1997] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:24 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:24.451099 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 991/1998] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:24 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:24.453001 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1c0ba462-f4a0-497a-ae01-fc9f8a5f8688 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:24.453606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1c0ba462-f4a0-497a-ae01-fc9f8a5f8688 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:24.471432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c0ba462-f4a0-497a-ae01-fc9f8a5f8688 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:24.472341 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c0ba462-f4a0-497a-ae01-fc9f8a5f8688 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:24.473526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c0ba462-f4a0-497a-ae01-fc9f8a5f8688 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:24.474174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c0ba462-f4a0-497a-ae01-fc9f8a5f8688 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:24.498593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-628de298-967b-4ff0-a737-38304fb2de35 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:24.499466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-628de298-967b-4ff0-a737-38304fb2de35 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:24.515439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-628de298-967b-4ff0-a737-38304fb2de35 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:24.515907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-628de298-967b-4ff0-a737-38304fb2de35 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:24.516708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-628de298-967b-4ff0-a737-38304fb2de35 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:24.517152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-628de298-967b-4ff0-a737-38304fb2de35 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:24.615751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1c0ba462-f4a0-497a-ae01-fc9f8a5f8688 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:24.625411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1c0ba462-f4a0-497a-ae01-fc9f8a5f8688 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:24.627360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1c0ba462-f4a0-497a-ae01-fc9f8a5f8688 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:24.629292 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1c0ba462-f4a0-497a-ae01-fc9f8a5f8688 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1250 microversion: 2.25 time: 0.179716 Aug 03 01:55:24.630479 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1008/1999] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:24 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1250 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:24.665791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-33ca480f-fa5f-45fe-942b-3fc2d8c19adf tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:24.667447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-33ca480f-fa5f-45fe-942b-3fc2d8c19adf tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:24.681843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-33ca480f-fa5f-45fe-942b-3fc2d8c19adf tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:24.683139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-33ca480f-fa5f-45fe-942b-3fc2d8c19adf tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:24.684296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-33ca480f-fa5f-45fe-942b-3fc2d8c19adf tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:24.685455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-33ca480f-fa5f-45fe-942b-3fc2d8c19adf tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:25.004973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-628de298-967b-4ff0-a737-38304fb2de35 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:25.009980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-33ca480f-fa5f-45fe-942b-3fc2d8c19adf tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:25.018254 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-628de298-967b-4ff0-a737-38304fb2de35 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.523514 Aug 03 01:55:25.022516 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-33ca480f-fa5f-45fe-942b-3fc2d8c19adf tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1314 microversion: 2.1 time: 0.363764 Aug 03 01:55:25.024827 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1009/2001] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:24 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:25.027921 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 992/2001] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:24 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:25.277655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ec7671da-4344-4eec-b578-4a305ef4f265 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:25.278416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ec7671da-4344-4eec-b578-4a305ef4f265 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:25.311560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec7671da-4344-4eec-b578-4a305ef4f265 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:25.312844 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec7671da-4344-4eec-b578-4a305ef4f265 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:25.313885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec7671da-4344-4eec-b578-4a305ef4f265 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:25.314762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec7671da-4344-4eec-b578-4a305ef4f265 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:25.364284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-88d7dd29-2e34-4041-89a4-73e8f4846a3b req-99f4ad69-9015-4241-8a9e-20752e839a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e79bb51-ff27-4ccf-b55a-b7eed7f8a784", "name": "network-vif-deleted", "tag": "af3cfa3a-3bec-4ec8-94d2-c7b32c593e70"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:25.392914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-88d7dd29-2e34-4041-89a4-73e8f4846a3b req-99f4ad69-9015-4241-8a9e-20752e839a15 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:25.395136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-88d7dd29-2e34-4041-89a4-73e8f4846a3b req-99f4ad69-9015-4241-8a9e-20752e839a15 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:25.421629 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-88d7dd29-2e34-4041-89a4-73e8f4846a3b req-99f4ad69-9015-4241-8a9e-20752e839a15 service nova] Creating event network-vif-deleted:af3cfa3a-3bec-4ec8-94d2-c7b32c593e70 for instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 on n-h1-826529-8 Aug 03 01:55:25.433923 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-88d7dd29-2e34-4041-89a4-73e8f4846a3b req-99f4ad69-9015-4241-8a9e-20752e839a15 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073503 Aug 03 01:55:25.437330 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 993/2002] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:55:25.469730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9cdf2b32-5611-43dc-bf84-5752d63b8ee1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:25.470424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9cdf2b32-5611-43dc-bf84-5752d63b8ee1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:25.492068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9cdf2b32-5611-43dc-bf84-5752d63b8ee1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:25.492543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9cdf2b32-5611-43dc-bf84-5752d63b8ee1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:25.495205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9cdf2b32-5611-43dc-bf84-5752d63b8ee1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:25.496920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9cdf2b32-5611-43dc-bf84-5752d63b8ee1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:25.547002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ec7671da-4344-4eec-b578-4a305ef4f265 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:25.555202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:25.575373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ec7671da-4344-4eec-b578-4a305ef4f265 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:25.577433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ec7671da-4344-4eec-b578-4a305ef4f265 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:25.587052 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ec7671da-4344-4eec-b578-4a305ef4f265 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.316026 Aug 03 01:55:25.588029 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1010/2003] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:25 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:25.604305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ebd5f6ba-b159-4332-983e-c19fc5ebf37d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:25.605299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ebd5f6ba-b159-4332-983e-c19fc5ebf37d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:25.632331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebd5f6ba-b159-4332-983e-c19fc5ebf37d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:25.635207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebd5f6ba-b159-4332-983e-c19fc5ebf37d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:25.636266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebd5f6ba-b159-4332-983e-c19fc5ebf37d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:25.640903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebd5f6ba-b159-4332-983e-c19fc5ebf37d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:25.856346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9cdf2b32-5611-43dc-bf84-5752d63b8ee1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:25.870529 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9cdf2b32-5611-43dc-bf84-5752d63b8ee1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1267 microversion: 2.1 time: 0.405097 Aug 03 01:55:25.887258 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 994/2004] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:25 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1267 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:25.898664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f3bcba5d-4a48-4dc5-bfea-66e5485ad0f8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:25.899391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f3bcba5d-4a48-4dc5-bfea-66e5485ad0f8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:25.905865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3bcba5d-4a48-4dc5-bfea-66e5485ad0f8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:25.906658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3bcba5d-4a48-4dc5-bfea-66e5485ad0f8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:25.907952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3bcba5d-4a48-4dc5-bfea-66e5485ad0f8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:25.908633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3bcba5d-4a48-4dc5-bfea-66e5485ad0f8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:26.199511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ebd5f6ba-b159-4332-983e-c19fc5ebf37d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:26.209057 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ebd5f6ba-b159-4332-983e-c19fc5ebf37d tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.619582 Aug 03 01:55:26.223272 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1011/2005] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:25 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:26.230369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7c052c79-49dc-42a1-afa7-16c1f3d285ba tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:26.230968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7c052c79-49dc-42a1-afa7-16c1f3d285ba tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:26.241995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c052c79-49dc-42a1-afa7-16c1f3d285ba tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:26.242453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c052c79-49dc-42a1-afa7-16c1f3d285ba tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:26.243264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c052c79-49dc-42a1-afa7-16c1f3d285ba tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:26.243705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c052c79-49dc-42a1-afa7-16c1f3d285ba tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:26.438935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f3bcba5d-4a48-4dc5-bfea-66e5485ad0f8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:26.462054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f3bcba5d-4a48-4dc5-bfea-66e5485ad0f8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:26.468733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f3bcba5d-4a48-4dc5-bfea-66e5485ad0f8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:26.474130 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f3bcba5d-4a48-4dc5-bfea-66e5485ad0f8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1292 microversion: 2.25 time: 0.585411 Aug 03 01:55:26.490130 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 995/2006] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:25 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1292 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:26.509657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-12d90e8a-c6d0-4a12-9a6a-0938ec402351 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:26.510297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-12d90e8a-c6d0-4a12-9a6a-0938ec402351 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:26.538033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12d90e8a-c6d0-4a12-9a6a-0938ec402351 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:26.538498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12d90e8a-c6d0-4a12-9a6a-0938ec402351 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:26.539423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12d90e8a-c6d0-4a12-9a6a-0938ec402351 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:26.539899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12d90e8a-c6d0-4a12-9a6a-0938ec402351 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:26.729923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7c052c79-49dc-42a1-afa7-16c1f3d285ba tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:26.739575 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7c052c79-49dc-42a1-afa7-16c1f3d285ba tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.513911 Aug 03 01:55:26.740316 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1012/2007] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:26 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:26.754953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b04d7c54-fbee-405e-9302-bc657cd53f3c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:26.755584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b04d7c54-fbee-405e-9302-bc657cd53f3c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:26.758547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:26.771106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b04d7c54-fbee-405e-9302-bc657cd53f3c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:26.771900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b04d7c54-fbee-405e-9302-bc657cd53f3c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:26.772966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b04d7c54-fbee-405e-9302-bc657cd53f3c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:26.773506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b04d7c54-fbee-405e-9302-bc657cd53f3c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:26.877151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b04d7c54-fbee-405e-9302-bc657cd53f3c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:26.890343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b04d7c54-fbee-405e-9302-bc657cd53f3c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:26.893211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b04d7c54-fbee-405e-9302-bc657cd53f3c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:26.896189 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b04d7c54-fbee-405e-9302-bc657cd53f3c tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.154467 Aug 03 01:55:26.897268 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1013/2008] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:26 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:26.903311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-cb38dd3d-c47c-43c7-93b3-c7e253afb8ef req-1d4eb909-d310-45ea-b4fb-f87459a0ef06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a9c0c8-5bf1-435f-8c6b-74a0b447f966", "tag": "626f469b-7020-4d02-a4c0-f2e58ccd1315"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:26.919107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-cb38dd3d-c47c-43c7-93b3-c7e253afb8ef req-1d4eb909-d310-45ea-b4fb-f87459a0ef06 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:26.919549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-cb38dd3d-c47c-43c7-93b3-c7e253afb8ef req-1d4eb909-d310-45ea-b4fb-f87459a0ef06 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:26.932300 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-cb38dd3d-c47c-43c7-93b3-c7e253afb8ef req-1d4eb909-d310-45ea-b4fb-f87459a0ef06 service nova] Creating event network-changed:626f469b-7020-4d02-a4c0-f2e58ccd1315 for instance e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 on n-h1-826529-8 Aug 03 01:55:26.937966 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-cb38dd3d-c47c-43c7-93b3-c7e253afb8ef req-1d4eb909-d310-45ea-b4fb-f87459a0ef06 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039001 Aug 03 01:55:26.938928 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1014/2009] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:26.950449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b8924c51-5bea-438d-aab3-f5ce1fee8d3d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:26.951515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b8924c51-5bea-438d-aab3-f5ce1fee8d3d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:26.960684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8924c51-5bea-438d-aab3-f5ce1fee8d3d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:26.961502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8924c51-5bea-438d-aab3-f5ce1fee8d3d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:26.962679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8924c51-5bea-438d-aab3-f5ce1fee8d3d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:26.963372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8924c51-5bea-438d-aab3-f5ce1fee8d3d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:26.984259 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-12d90e8a-c6d0-4a12-9a6a-0938ec402351 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:26.999733 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-12d90e8a-c6d0-4a12-9a6a-0938ec402351 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1314 microversion: 2.1 time: 0.511516 Aug 03 01:55:27.000342 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 996/2010] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:26 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:27.084918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b8924c51-5bea-438d-aab3-f5ce1fee8d3d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:27.099003 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b8924c51-5bea-438d-aab3-f5ce1fee8d3d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1265 microversion: 2.1 time: 0.152755 Aug 03 01:55:27.102397 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1015/2011] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:26 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:27.233999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4145d56b-058e-48c3-9971-5fc7fb2c06da tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:27.236003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4145d56b-058e-48c3-9971-5fc7fb2c06da tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:27.248804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4145d56b-058e-48c3-9971-5fc7fb2c06da tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:27.251816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4145d56b-058e-48c3-9971-5fc7fb2c06da tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:27.252812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4145d56b-058e-48c3-9971-5fc7fb2c06da tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:27.254364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4145d56b-058e-48c3-9971-5fc7fb2c06da tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:27.498753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=10 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:27.507610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-714c00e5-ecde-4aea-9224-1d825da76c97 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:27.509185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-714c00e5-ecde-4aea-9224-1d825da76c97 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:27.525552 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-714c00e5-ecde-4aea-9224-1d825da76c97 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:27.526011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-714c00e5-ecde-4aea-9224-1d825da76c97 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:27.529431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-714c00e5-ecde-4aea-9224-1d825da76c97 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:27.530048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-714c00e5-ecde-4aea-9224-1d825da76c97 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:27.595127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4145d56b-058e-48c3-9971-5fc7fb2c06da tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:27.625651 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4145d56b-058e-48c3-9971-5fc7fb2c06da tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.395610 Aug 03 01:55:27.655591 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 997/2012] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:27 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:27.767007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ff260e4e-8019-45d5-ab0f-a78e5889e9de tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:27.767714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ff260e4e-8019-45d5-ab0f-a78e5889e9de tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:27.777754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff260e4e-8019-45d5-ab0f-a78e5889e9de tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:27.778398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff260e4e-8019-45d5-ab0f-a78e5889e9de tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:27.780331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff260e4e-8019-45d5-ab0f-a78e5889e9de tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:27.781011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff260e4e-8019-45d5-ab0f-a78e5889e9de tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:27.969475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-714c00e5-ecde-4aea-9224-1d825da76c97 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:27.980065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-714c00e5-ecde-4aea-9224-1d825da76c97 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:27.981769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-714c00e5-ecde-4aea-9224-1d825da76c97 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:27.983806 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-714c00e5-ecde-4aea-9224-1d825da76c97 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1292 microversion: 2.25 time: 0.485541 Aug 03 01:55:27.984044 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1016/2013] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:27 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1292 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:28.007336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-99e0d808-8f69-47fb-ba2a-cf7d9d739e00 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:28.009116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-99e0d808-8f69-47fb-ba2a-cf7d9d739e00 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:28.023179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99e0d808-8f69-47fb-ba2a-cf7d9d739e00 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:28.023637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99e0d808-8f69-47fb-ba2a-cf7d9d739e00 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:28.025065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99e0d808-8f69-47fb-ba2a-cf7d9d739e00 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:28.025521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99e0d808-8f69-47fb-ba2a-cf7d9d739e00 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:28.115732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ff260e4e-8019-45d5-ab0f-a78e5889e9de tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:28.122067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:28.130368 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ff260e4e-8019-45d5-ab0f-a78e5889e9de tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.367786 Aug 03 01:55:28.144388 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 998/2014] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:27 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:28.152896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-de4c8eb8-5711-4fb3-a8fe-fb7a0a3d9b50 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:28.154469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-de4c8eb8-5711-4fb3-a8fe-fb7a0a3d9b50 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:28.161903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de4c8eb8-5711-4fb3-a8fe-fb7a0a3d9b50 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:28.162661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de4c8eb8-5711-4fb3-a8fe-fb7a0a3d9b50 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:28.164641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de4c8eb8-5711-4fb3-a8fe-fb7a0a3d9b50 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:28.165275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de4c8eb8-5711-4fb3-a8fe-fb7a0a3d9b50 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:28.178683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-99e0d808-8f69-47fb-ba2a-cf7d9d739e00 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:28.189394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-99e0d808-8f69-47fb-ba2a-cf7d9d739e00 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:28.191187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-99e0d808-8f69-47fb-ba2a-cf7d9d739e00 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:28.192541 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-99e0d808-8f69-47fb-ba2a-cf7d9d739e00 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.207297 Aug 03 01:55:28.208735 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1017/2015] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:27 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:28.208735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ae8590ef-ce95-414c-946c-5309e577964e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:28.208735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ae8590ef-ce95-414c-946c-5309e577964e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:28.223887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae8590ef-ce95-414c-946c-5309e577964e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:28.224654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae8590ef-ce95-414c-946c-5309e577964e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:28.226300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae8590ef-ce95-414c-946c-5309e577964e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:28.227626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae8590ef-ce95-414c-946c-5309e577964e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:28.539721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-de4c8eb8-5711-4fb3-a8fe-fb7a0a3d9b50 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:28.543749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ae8590ef-ce95-414c-946c-5309e577964e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:28.551931 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-de4c8eb8-5711-4fb3-a8fe-fb7a0a3d9b50 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1314 microversion: 2.1 time: 0.404397 Aug 03 01:55:28.553138 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 999/2016] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:28 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:28.554820 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ae8590ef-ce95-414c-946c-5309e577964e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1307 microversion: 2.1 time: 0.358833 Aug 03 01:55:28.555024 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1018/2017] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:28 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1307 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:28.671205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-944e86a2-3c49-46ae-bffc-0159a43f51d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:28.673040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-944e86a2-3c49-46ae-bffc-0159a43f51d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:28.690120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-944e86a2-3c49-46ae-bffc-0159a43f51d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:28.691026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-944e86a2-3c49-46ae-bffc-0159a43f51d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:28.692629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-944e86a2-3c49-46ae-bffc-0159a43f51d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:28.693096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-944e86a2-3c49-46ae-bffc-0159a43f51d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:28.912452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-944e86a2-3c49-46ae-bffc-0159a43f51d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:28.927116 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-944e86a2-3c49-46ae-bffc-0159a43f51d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.260991 Aug 03 01:55:28.946618 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1000/2018] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:28 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:28.950162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-6fa409dc-fa7c-4f60-a51c-9f8d19a0f2a2 req-60bec6a1-6246-40ce-8173-3dbd9649974b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f92c67e8-bc6b-44c4-b012-63b940619b6d", "tag": "ed823989-d5aa-4d9a-9d30-87acf254629c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:28.979245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-1611a388-82f8-4167-8168-dedb8b4d6282 req-b6b9d79d-67c5-44e6-9cd8-5eabb6e1d94e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072d2dbc-29dd-41c9-ac28-a9961d858bf0", "name": "network-vif-plugged", "status": "completed", "tag": "b1dc1187-e8b5-4240-b07e-e49126145f1b"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:28.980662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6fa409dc-fa7c-4f60-a51c-9f8d19a0f2a2 req-60bec6a1-6246-40ce-8173-3dbd9649974b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:28.981150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6fa409dc-fa7c-4f60-a51c-9f8d19a0f2a2 req-60bec6a1-6246-40ce-8173-3dbd9649974b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:29.000067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1611a388-82f8-4167-8168-dedb8b4d6282 req-b6b9d79d-67c5-44e6-9cd8-5eabb6e1d94e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:29.000387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1611a388-82f8-4167-8168-dedb8b4d6282 req-b6b9d79d-67c5-44e6-9cd8-5eabb6e1d94e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:29.007546 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-6fa409dc-fa7c-4f60-a51c-9f8d19a0f2a2 req-60bec6a1-6246-40ce-8173-3dbd9649974b service nova] Creating event network-changed:ed823989-d5aa-4d9a-9d30-87acf254629c for instance f92c67e8-bc6b-44c4-b012-63b940619b6d on n-h2-826529-8 Aug 03 01:55:29.016876 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-1611a388-82f8-4167-8168-dedb8b4d6282 req-b6b9d79d-67c5-44e6-9cd8-5eabb6e1d94e service nova] Creating event network-vif-plugged:b1dc1187-e8b5-4240-b07e-e49126145f1b for instance 072d2dbc-29dd-41c9-ac28-a9961d858bf0 on n-h2-826529-8 Aug 03 01:55:29.020221 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-6fa409dc-fa7c-4f60-a51c-9f8d19a0f2a2 req-60bec6a1-6246-40ce-8173-3dbd9649974b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082386 Aug 03 01:55:29.023284 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-1611a388-82f8-4167-8168-dedb8b4d6282 req-b6b9d79d-67c5-44e6-9cd8-5eabb6e1d94e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049779 Aug 03 01:55:29.024182 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1001/2019] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:29.024549 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1019/2020] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:29.029478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69d146f1-da77-4753-813f-3320198480ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:29.030360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-69d146f1-da77-4753-813f-3320198480ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:29.037724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69d146f1-da77-4753-813f-3320198480ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:29.038198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69d146f1-da77-4753-813f-3320198480ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:29.039012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69d146f1-da77-4753-813f-3320198480ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:29.039460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69d146f1-da77-4753-813f-3320198480ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:29.156054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7f488313-b9ba-4778-b7f3-c9ad63c2ed69 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:29.157012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7f488313-b9ba-4778-b7f3-c9ad63c2ed69 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:29.164567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f488313-b9ba-4778-b7f3-c9ad63c2ed69 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:29.165110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f488313-b9ba-4778-b7f3-c9ad63c2ed69 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:29.165980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f488313-b9ba-4778-b7f3-c9ad63c2ed69 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:29.166608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f488313-b9ba-4778-b7f3-c9ad63c2ed69 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:29.469280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-69d146f1-da77-4753-813f-3320198480ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:29.480519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-69d146f1-da77-4753-813f-3320198480ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:29.482293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-69d146f1-da77-4753-813f-3320198480ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:29.483944 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-69d146f1-da77-4753-813f-3320198480ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1292 microversion: 2.25 time: 0.458578 Aug 03 01:55:29.484522 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1002/2021] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:29 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1292 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:29.489701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7f488313-b9ba-4778-b7f3-c9ad63c2ed69 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:29.490022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5aa87955-a282-46c0-a9d4-19483f11f822 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:29.490662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5aa87955-a282-46c0-a9d4-19483f11f822 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:29.497049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5aa87955-a282-46c0-a9d4-19483f11f822 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:29.497754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5aa87955-a282-46c0-a9d4-19483f11f822 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:29.498726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5aa87955-a282-46c0-a9d4-19483f11f822 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:29.499160 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7f488313-b9ba-4778-b7f3-c9ad63c2ed69 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.347211 Aug 03 01:55:29.499379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5aa87955-a282-46c0-a9d4-19483f11f822 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:29.509195 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1020/2022] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:29 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:29.573834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5aa87955-a282-46c0-a9d4-19483f11f822 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:29.574031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-81a7b052-52dd-4c20-b8c9-832966ff93b7 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:29.574688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-81a7b052-52dd-4c20-b8c9-832966ff93b7 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:29.585177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5aa87955-a282-46c0-a9d4-19483f11f822 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:29.586726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5aa87955-a282-46c0-a9d4-19483f11f822 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:29.587787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81a7b052-52dd-4c20-b8c9-832966ff93b7 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:29.587998 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5aa87955-a282-46c0-a9d4-19483f11f822 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.102509 Aug 03 01:55:29.588241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81a7b052-52dd-4c20-b8c9-832966ff93b7 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:29.588723 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1003/2023] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:29 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:29.594549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b6b4786b-3864-4a26-abb3-191813161758 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:29.595206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b6b4786b-3864-4a26-abb3-191813161758 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:29.604262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81a7b052-52dd-4c20-b8c9-832966ff93b7 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:29.604732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81a7b052-52dd-4c20-b8c9-832966ff93b7 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:29.611093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6b4786b-3864-4a26-abb3-191813161758 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:29.611093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6b4786b-3864-4a26-abb3-191813161758 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:29.611093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6b4786b-3864-4a26-abb3-191813161758 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:29.611093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6b4786b-3864-4a26-abb3-191813161758 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:29.959085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b6b4786b-3864-4a26-abb3-191813161758 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:29.968996 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b6b4786b-3864-4a26-abb3-191813161758 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1307 microversion: 2.1 time: 0.379110 Aug 03 01:55:29.975784 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1004/2024] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:29 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1307 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:29.976329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-004ebe87-373f-4add-b956-d6946406f612 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:29.977355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-004ebe87-373f-4add-b956-d6946406f612 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:29.985011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-004ebe87-373f-4add-b956-d6946406f612 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:29.986073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-004ebe87-373f-4add-b956-d6946406f612 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:29.987296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-004ebe87-373f-4add-b956-d6946406f612 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:29.988534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-004ebe87-373f-4add-b956-d6946406f612 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:30.038332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-81a7b052-52dd-4c20-b8c9-832966ff93b7 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:30.058131 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-81a7b052-52dd-4c20-b8c9-832966ff93b7 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1314 microversion: 2.1 time: 0.488355 Aug 03 01:55:30.059906 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1021/2025] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:29 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:30.197774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-004ebe87-373f-4add-b956-d6946406f612 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:30.206759 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-004ebe87-373f-4add-b956-d6946406f612 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.235356 Aug 03 01:55:30.207488 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1005/2026] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:29 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:30.506783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e67c1592-50f3-42c5-bdba-b9f6e76e6d86 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:30.507707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e67c1592-50f3-42c5-bdba-b9f6e76e6d86 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:30.519498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e67c1592-50f3-42c5-bdba-b9f6e76e6d86 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:30.519956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e67c1592-50f3-42c5-bdba-b9f6e76e6d86 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:30.520760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e67c1592-50f3-42c5-bdba-b9f6e76e6d86 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:30.521201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e67c1592-50f3-42c5-bdba-b9f6e76e6d86 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:30.537459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-305c9b6f-15eb-4786-8e1e-5ef2f913463e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:30.538237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-305c9b6f-15eb-4786-8e1e-5ef2f913463e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:30.549089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-305c9b6f-15eb-4786-8e1e-5ef2f913463e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:30.549815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-305c9b6f-15eb-4786-8e1e-5ef2f913463e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:30.551252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-305c9b6f-15eb-4786-8e1e-5ef2f913463e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:30.551742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-305c9b6f-15eb-4786-8e1e-5ef2f913463e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:31.131641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e67c1592-50f3-42c5-bdba-b9f6e76e6d86 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:31.141328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e67c1592-50f3-42c5-bdba-b9f6e76e6d86 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:31.143276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e67c1592-50f3-42c5-bdba-b9f6e76e6d86 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:31.145073 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e67c1592-50f3-42c5-bdba-b9f6e76e6d86 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1292 microversion: 2.25 time: 0.643290 Aug 03 01:55:31.146133 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1022/2027] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:30 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1292 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:31.149041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-305c9b6f-15eb-4786-8e1e-5ef2f913463e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:31.152108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d71b131c-1e13-4804-a951-f1165dff0273 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:31.152962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d71b131c-1e13-4804-a951-f1165dff0273 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:31.160108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d71b131c-1e13-4804-a951-f1165dff0273 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:31.160987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d71b131c-1e13-4804-a951-f1165dff0273 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:31.161915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d71b131c-1e13-4804-a951-f1165dff0273 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:31.162418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d71b131c-1e13-4804-a951-f1165dff0273 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:31.163613 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-305c9b6f-15eb-4786-8e1e-5ef2f913463e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.642730 Aug 03 01:55:31.171011 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1006/2028] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:30 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:31.172187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-18f00da8-16e6-49f8-96e7-771aa7517915 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:31.172815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-18f00da8-16e6-49f8-96e7-771aa7517915 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:31.180640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18f00da8-16e6-49f8-96e7-771aa7517915 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:31.180977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18f00da8-16e6-49f8-96e7-771aa7517915 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:31.181723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18f00da8-16e6-49f8-96e7-771aa7517915 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:31.182171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18f00da8-16e6-49f8-96e7-771aa7517915 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:31.252518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d71b131c-1e13-4804-a951-f1165dff0273 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:31.262236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d71b131c-1e13-4804-a951-f1165dff0273 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:31.264014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d71b131c-1e13-4804-a951-f1165dff0273 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:31.265523 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d71b131c-1e13-4804-a951-f1165dff0273 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.118057 Aug 03 01:55:31.266289 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1023/2029] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:31 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:31.273186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-97abfd12-4d3f-4ee0-86e2-c56b7cc85d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:31.273186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-97abfd12-4d3f-4ee0-86e2-c56b7cc85d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:31.282541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97abfd12-4d3f-4ee0-86e2-c56b7cc85d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:31.282771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97abfd12-4d3f-4ee0-86e2-c56b7cc85d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:31.284098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97abfd12-4d3f-4ee0-86e2-c56b7cc85d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:31.284258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97abfd12-4d3f-4ee0-86e2-c56b7cc85d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:31.396016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-18f00da8-16e6-49f8-96e7-771aa7517915 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:31.404207 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-18f00da8-16e6-49f8-96e7-771aa7517915 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1307 microversion: 2.1 time: 0.238137 Aug 03 01:55:31.404821 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1007/2030] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:31 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1307 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:31.410433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e54611ac-78e3-4444-b62a-88d42601d32c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:31.412257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e54611ac-78e3-4444-b62a-88d42601d32c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:31.418014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e54611ac-78e3-4444-b62a-88d42601d32c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:31.418463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e54611ac-78e3-4444-b62a-88d42601d32c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:31.419433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e54611ac-78e3-4444-b62a-88d42601d32c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:31.419751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e54611ac-78e3-4444-b62a-88d42601d32c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:31.448159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-97abfd12-4d3f-4ee0-86e2-c56b7cc85d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:31.456145 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-97abfd12-4d3f-4ee0-86e2-c56b7cc85d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1500 microversion: 2.1 time: 0.188538 Aug 03 01:55:31.457443 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1024/2031] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:31 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1500 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:31.478999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-872421b4-1fe5-4f78-adc8-a0788eadf3c9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:31.481396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-872421b4-1fe5-4f78-adc8-a0788eadf3c9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:31.489365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-872421b4-1fe5-4f78-adc8-a0788eadf3c9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:31.489831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-872421b4-1fe5-4f78-adc8-a0788eadf3c9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:31.490638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-872421b4-1fe5-4f78-adc8-a0788eadf3c9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:31.491113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-872421b4-1fe5-4f78-adc8-a0788eadf3c9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:31.515578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-872421b4-1fe5-4f78-adc8-a0788eadf3c9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lazy-loading 'flavor' on Instance uuid 072d2dbc-29dd-41c9-ac28-a9961d858bf0 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:55:31.562741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e54611ac-78e3-4444-b62a-88d42601d32c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:31.570606 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e54611ac-78e3-4444-b62a-88d42601d32c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.164699 Aug 03 01:55:31.571288 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1008/2032] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:31 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:31.599869 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-872421b4-1fe5-4f78-adc8-a0788eadf3c9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "POST /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0/action" status: 200 len: 32 microversion: 2.1 time: 0.124896 Aug 03 01:55:31.600489 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1025/2033] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:55:31 2022] POST /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0/action => generated 32 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 01:55:31.610060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-877ce5bf-994f-40b8-a96f-41e7257e3435 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:31.610700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-877ce5bf-994f-40b8-a96f-41e7257e3435 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:31.618142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-877ce5bf-994f-40b8-a96f-41e7257e3435 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:31.618590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-877ce5bf-994f-40b8-a96f-41e7257e3435 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:31.619403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-877ce5bf-994f-40b8-a96f-41e7257e3435 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:31.619838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-877ce5bf-994f-40b8-a96f-41e7257e3435 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:31.763251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-877ce5bf-994f-40b8-a96f-41e7257e3435 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:31.771833 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-877ce5bf-994f-40b8-a96f-41e7257e3435 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.165677 Aug 03 01:55:31.772429 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1009/2034] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:31 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:32.169082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0a8f1387-2436-4d1a-a7a3-2277138fe43b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:32.169822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0a8f1387-2436-4d1a-a7a3-2277138fe43b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:32.177409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a8f1387-2436-4d1a-a7a3-2277138fe43b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:32.177829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a8f1387-2436-4d1a-a7a3-2277138fe43b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:32.178724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a8f1387-2436-4d1a-a7a3-2277138fe43b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:32.179091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a8f1387-2436-4d1a-a7a3-2277138fe43b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:32.188865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5f2159d5-4984-4ef7-9b3a-e602ec1f0b06 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:32.189606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5f2159d5-4984-4ef7-9b3a-e602ec1f0b06 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:32.198677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f2159d5-4984-4ef7-9b3a-e602ec1f0b06 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:32.199163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f2159d5-4984-4ef7-9b3a-e602ec1f0b06 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:32.199948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f2159d5-4984-4ef7-9b3a-e602ec1f0b06 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:32.200386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f2159d5-4984-4ef7-9b3a-e602ec1f0b06 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:32.376696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a8f1387-2436-4d1a-a7a3-2277138fe43b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:32.380051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:32.388425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a8f1387-2436-4d1a-a7a3-2277138fe43b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:32.390041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a8f1387-2436-4d1a-a7a3-2277138fe43b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:32.391225 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0a8f1387-2436-4d1a-a7a3-2277138fe43b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1280 microversion: 2.25 time: 0.226492 Aug 03 01:55:32.391798 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1026/2035] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:32 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1280 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:32.397007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4911f9db-2cc1-4ea9-89e9-8acddc2e8b3e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:32.397622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4911f9db-2cc1-4ea9-89e9-8acddc2e8b3e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:32.402758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5f2159d5-4984-4ef7-9b3a-e602ec1f0b06 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:32.405089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4911f9db-2cc1-4ea9-89e9-8acddc2e8b3e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:32.405549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4911f9db-2cc1-4ea9-89e9-8acddc2e8b3e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:32.406695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4911f9db-2cc1-4ea9-89e9-8acddc2e8b3e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:32.407176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4911f9db-2cc1-4ea9-89e9-8acddc2e8b3e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:32.415511 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5f2159d5-4984-4ef7-9b3a-e602ec1f0b06 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.231580 Aug 03 01:55:32.416098 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1010/2036] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:32 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:32.427808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c5254a7a-bc6c-4f4a-abae-09bbbd550951 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:32.428821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c5254a7a-bc6c-4f4a-abae-09bbbd550951 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:32.434866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=10 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:32.437153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5254a7a-bc6c-4f4a-abae-09bbbd550951 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:32.437614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5254a7a-bc6c-4f4a-abae-09bbbd550951 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:32.438408 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5254a7a-bc6c-4f4a-abae-09bbbd550951 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:32.438860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5254a7a-bc6c-4f4a-abae-09bbbd550951 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:32.463216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=28 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:32.481965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4911f9db-2cc1-4ea9-89e9-8acddc2e8b3e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:32.490949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4911f9db-2cc1-4ea9-89e9-8acddc2e8b3e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:32.492686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4911f9db-2cc1-4ea9-89e9-8acddc2e8b3e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:32.493884 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4911f9db-2cc1-4ea9-89e9-8acddc2e8b3e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.101163 Aug 03 01:55:32.494434 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1027/2037] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:32 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:32.579563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c5254a7a-bc6c-4f4a-abae-09bbbd550951 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:32.588695 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c5254a7a-bc6c-4f4a-abae-09bbbd550951 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1307 microversion: 2.1 time: 0.164717 Aug 03 01:55:32.599880 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1011/2038] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:32 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1307 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:32.600104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-568d8189-b2f2-47d9-8f13-d3e6eea28bdf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:32.600104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-568d8189-b2f2-47d9-8f13-d3e6eea28bdf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:32.602075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-568d8189-b2f2-47d9-8f13-d3e6eea28bdf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:32.602605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-568d8189-b2f2-47d9-8f13-d3e6eea28bdf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:32.603507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-568d8189-b2f2-47d9-8f13-d3e6eea28bdf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:32.604019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-568d8189-b2f2-47d9-8f13-d3e6eea28bdf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:32.748447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-568d8189-b2f2-47d9-8f13-d3e6eea28bdf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:32.756394 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-568d8189-b2f2-47d9-8f13-d3e6eea28bdf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.166613 Aug 03 01:55:32.756980 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1028/2039] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:32 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:32.793394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-46c271a0-c245-4d34-a666-e84c5c1de481 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:32.794015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-46c271a0-c245-4d34-a666-e84c5c1de481 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:32.800398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46c271a0-c245-4d34-a666-e84c5c1de481 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:32.800751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46c271a0-c245-4d34-a666-e84c5c1de481 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:32.801736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46c271a0-c245-4d34-a666-e84c5c1de481 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:32.802177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46c271a0-c245-4d34-a666-e84c5c1de481 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:32.945676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-46c271a0-c245-4d34-a666-e84c5c1de481 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:32.955072 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-46c271a0-c245-4d34-a666-e84c5c1de481 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.165615 Aug 03 01:55:32.955679 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1012/2040] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:32 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:33.421067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0a7be796-a62c-43db-a45b-a3da2acff056 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:33.422396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0a7be796-a62c-43db-a45b-a3da2acff056 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:33.440384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cf7adf15-c5fe-430d-98bc-124e6c67df3f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:33.442376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cf7adf15-c5fe-430d-98bc-124e6c67df3f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:33.452278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a7be796-a62c-43db-a45b-a3da2acff056 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:33.453051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a7be796-a62c-43db-a45b-a3da2acff056 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:33.454477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a7be796-a62c-43db-a45b-a3da2acff056 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:33.455665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a7be796-a62c-43db-a45b-a3da2acff056 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:33.458991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf7adf15-c5fe-430d-98bc-124e6c67df3f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:33.459883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf7adf15-c5fe-430d-98bc-124e6c67df3f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:33.461160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf7adf15-c5fe-430d-98bc-124e6c67df3f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:33.462109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf7adf15-c5fe-430d-98bc-124e6c67df3f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:33.829144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a7be796-a62c-43db-a45b-a3da2acff056 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:33.833265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cf7adf15-c5fe-430d-98bc-124e6c67df3f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:33.838509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a7be796-a62c-43db-a45b-a3da2acff056 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:33.840086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a7be796-a62c-43db-a45b-a3da2acff056 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:33.841225 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0a7be796-a62c-43db-a45b-a3da2acff056 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1280 microversion: 2.25 time: 0.427117 Aug 03 01:55:33.841739 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1029/2041] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:33 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1280 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:33.845100 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cf7adf15-c5fe-430d-98bc-124e6c67df3f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1468 microversion: 2.1 time: 0.411042 Aug 03 01:55:33.851219 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1013/2042] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:33 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1468 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:33.851418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-75b37122-5e72-443b-802c-b466d772a39f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:33.851418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-75b37122-5e72-443b-802c-b466d772a39f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:33.851667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b6be4e7d-4a95-4425-9047-da13ed152c58 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:33.851667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b6be4e7d-4a95-4425-9047-da13ed152c58 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:33.857154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75b37122-5e72-443b-802c-b466d772a39f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:33.858122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6be4e7d-4a95-4425-9047-da13ed152c58 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:33.858579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6be4e7d-4a95-4425-9047-da13ed152c58 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:33.858983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75b37122-5e72-443b-802c-b466d772a39f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:33.859397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6be4e7d-4a95-4425-9047-da13ed152c58 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:33.859833 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6be4e7d-4a95-4425-9047-da13ed152c58 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:33.860411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75b37122-5e72-443b-802c-b466d772a39f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:33.861054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75b37122-5e72-443b-802c-b466d772a39f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:33.953048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-75b37122-5e72-443b-802c-b466d772a39f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:33.963332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-75b37122-5e72-443b-802c-b466d772a39f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:33.965156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-75b37122-5e72-443b-802c-b466d772a39f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:33.966803 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-75b37122-5e72-443b-802c-b466d772a39f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.123930 Aug 03 01:55:33.967482 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1030/2043] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:33 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:33.972337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-67fb8c0b-13bf-41f9-a39d-dd708395784e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:33.972976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-67fb8c0b-13bf-41f9-a39d-dd708395784e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:33.982169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67fb8c0b-13bf-41f9-a39d-dd708395784e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:33.982626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67fb8c0b-13bf-41f9-a39d-dd708395784e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:33.983458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67fb8c0b-13bf-41f9-a39d-dd708395784e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:33.983902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67fb8c0b-13bf-41f9-a39d-dd708395784e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:34.040338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b6be4e7d-4a95-4425-9047-da13ed152c58 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:34.048842 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b6be4e7d-4a95-4425-9047-da13ed152c58 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1307 microversion: 2.1 time: 0.201751 Aug 03 01:55:34.049630 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1014/2044] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:33 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:34.058205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eacc1c38-7364-48a2-a675-fd460af0213e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:34.059480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eacc1c38-7364-48a2-a675-fd460af0213e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:34.069536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eacc1c38-7364-48a2-a675-fd460af0213e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:34.069993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eacc1c38-7364-48a2-a675-fd460af0213e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:34.070788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eacc1c38-7364-48a2-a675-fd460af0213e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:34.071261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eacc1c38-7364-48a2-a675-fd460af0213e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:34.396005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-67fb8c0b-13bf-41f9-a39d-dd708395784e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:34.404632 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-67fb8c0b-13bf-41f9-a39d-dd708395784e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.436067 Aug 03 01:55:34.405252 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1031/2045] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:33 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:34.454494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eacc1c38-7364-48a2-a675-fd460af0213e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:34.462984 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eacc1c38-7364-48a2-a675-fd460af0213e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.409917 Aug 03 01:55:34.463570 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1015/2046] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:34 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:34.869611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e67b8cfc-1d7c-4d48-9fec-4aa8cc4a8257 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:34.870117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6362b878-7340-41cd-a28f-d69748910343 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:34.870624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e67b8cfc-1d7c-4d48-9fec-4aa8cc4a8257 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:34.871724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6362b878-7340-41cd-a28f-d69748910343 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:34.879387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e67b8cfc-1d7c-4d48-9fec-4aa8cc4a8257 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:34.880134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e67b8cfc-1d7c-4d48-9fec-4aa8cc4a8257 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:34.881326 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e67b8cfc-1d7c-4d48-9fec-4aa8cc4a8257 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:34.882296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e67b8cfc-1d7c-4d48-9fec-4aa8cc4a8257 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:34.882527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6362b878-7340-41cd-a28f-d69748910343 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:34.882792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6362b878-7340-41cd-a28f-d69748910343 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:34.884319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6362b878-7340-41cd-a28f-d69748910343 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:34.885043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6362b878-7340-41cd-a28f-d69748910343 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:34.909630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:35.105628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e67b8cfc-1d7c-4d48-9fec-4aa8cc4a8257 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:35.114971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e67b8cfc-1d7c-4d48-9fec-4aa8cc4a8257 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:35.116626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e67b8cfc-1d7c-4d48-9fec-4aa8cc4a8257 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:35.118167 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e67b8cfc-1d7c-4d48-9fec-4aa8cc4a8257 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1280 microversion: 2.25 time: 0.252721 Aug 03 01:55:35.118582 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1016/2047] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:34 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1280 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:35.121308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6362b878-7340-41cd-a28f-d69748910343 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:35.123570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0869209c-b18d-4c26-9fe4-dd51c1733af3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:35.124250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0869209c-b18d-4c26-9fe4-dd51c1733af3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:35.130863 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6362b878-7340-41cd-a28f-d69748910343 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1486 microversion: 2.1 time: 0.267645 Aug 03 01:55:35.131574 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1032/2048] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:34 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1486 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:35.132171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0869209c-b18d-4c26-9fe4-dd51c1733af3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:35.133000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0869209c-b18d-4c26-9fe4-dd51c1733af3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:35.134096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0869209c-b18d-4c26-9fe4-dd51c1733af3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:35.134784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0869209c-b18d-4c26-9fe4-dd51c1733af3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:35.138345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-788c6982-7d7d-4096-bf65-b31b99beb923 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:35.139084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-788c6982-7d7d-4096-bf65-b31b99beb923 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:35.146508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-788c6982-7d7d-4096-bf65-b31b99beb923 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:35.147077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-788c6982-7d7d-4096-bf65-b31b99beb923 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:35.147928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-788c6982-7d7d-4096-bf65-b31b99beb923 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:35.148363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-788c6982-7d7d-4096-bf65-b31b99beb923 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:35.212413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0869209c-b18d-4c26-9fe4-dd51c1733af3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:35.221141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0869209c-b18d-4c26-9fe4-dd51c1733af3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:35.223340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0869209c-b18d-4c26-9fe4-dd51c1733af3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:35.224569 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0869209c-b18d-4c26-9fe4-dd51c1733af3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.104899 Aug 03 01:55:35.225145 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1017/2049] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:35 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:35.306467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-788c6982-7d7d-4096-bf65-b31b99beb923 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:35.314255 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-788c6982-7d7d-4096-bf65-b31b99beb923 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1307 microversion: 2.1 time: 0.180198 Aug 03 01:55:35.314833 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1033/2050] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:35 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1307 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:35.429110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b5d5bff7-a614-4268-a9bc-66d168d413e9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:35.429845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b5d5bff7-a614-4268-a9bc-66d168d413e9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:35.435956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5d5bff7-a614-4268-a9bc-66d168d413e9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:35.436410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5d5bff7-a614-4268-a9bc-66d168d413e9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:35.437244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5d5bff7-a614-4268-a9bc-66d168d413e9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:35.437712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5d5bff7-a614-4268-a9bc-66d168d413e9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:35.485011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-826059a7-0aaf-4120-a799-15a6cee0aa36 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:35.485638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-826059a7-0aaf-4120-a799-15a6cee0aa36 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:35.496040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-826059a7-0aaf-4120-a799-15a6cee0aa36 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:35.496851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-826059a7-0aaf-4120-a799-15a6cee0aa36 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:35.498100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-826059a7-0aaf-4120-a799-15a6cee0aa36 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:35.498848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-826059a7-0aaf-4120-a799-15a6cee0aa36 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:35.629098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b5d5bff7-a614-4268-a9bc-66d168d413e9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:35.646111 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b5d5bff7-a614-4268-a9bc-66d168d413e9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.221940 Aug 03 01:55:35.660349 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1018/2051] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:35 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:35.681883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-826059a7-0aaf-4120-a799-15a6cee0aa36 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:35.689892 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-826059a7-0aaf-4120-a799-15a6cee0aa36 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.208782 Aug 03 01:55:35.700013 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1034/2052] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:35 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:35.804102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ff7dca0a-7163-4eb1-9793-4d7f1c1e83ae req-18485f1b-ea2a-4b73-bf16-f269ef7e06eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b54bdd1-d224-4a35-9487-66a77cd76c71", "name": "network-vif-unplugged", "status": "completed", "tag": "54039f8b-300c-447b-a43c-cb4dd1e17902"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:35.814291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ff7dca0a-7163-4eb1-9793-4d7f1c1e83ae req-18485f1b-ea2a-4b73-bf16-f269ef7e06eb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:35.814833 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ff7dca0a-7163-4eb1-9793-4d7f1c1e83ae req-18485f1b-ea2a-4b73-bf16-f269ef7e06eb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:35.827205 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ff7dca0a-7163-4eb1-9793-4d7f1c1e83ae req-18485f1b-ea2a-4b73-bf16-f269ef7e06eb service nova] Creating event network-vif-unplugged:54039f8b-300c-447b-a43c-cb4dd1e17902 for instance 0b54bdd1-d224-4a35-9487-66a77cd76c71 on n-h2-826529-8 Aug 03 01:55:35.833334 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ff7dca0a-7163-4eb1-9793-4d7f1c1e83ae req-18485f1b-ea2a-4b73-bf16-f269ef7e06eb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033019 Aug 03 01:55:35.833999 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1019/2053] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:36.141816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b4973235-28d5-49f9-9c14-048d7c4d8fc0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:36.142567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b4973235-28d5-49f9-9c14-048d7c4d8fc0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:36.150989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4973235-28d5-49f9-9c14-048d7c4d8fc0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:36.151454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4973235-28d5-49f9-9c14-048d7c4d8fc0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:36.152249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4973235-28d5-49f9-9c14-048d7c4d8fc0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:36.152696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4973235-28d5-49f9-9c14-048d7c4d8fc0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:36.156390 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8580d7f1-4539-4f15-be47-a9dea814d59a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:36.157309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8580d7f1-4539-4f15-be47-a9dea814d59a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:36.164521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8580d7f1-4539-4f15-be47-a9dea814d59a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:36.165112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8580d7f1-4539-4f15-be47-a9dea814d59a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:36.165987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8580d7f1-4539-4f15-be47-a9dea814d59a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:36.166561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8580d7f1-4539-4f15-be47-a9dea814d59a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:36.373227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b4973235-28d5-49f9-9c14-048d7c4d8fc0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:36.381959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8580d7f1-4539-4f15-be47-a9dea814d59a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:36.382761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b4973235-28d5-49f9-9c14-048d7c4d8fc0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:36.385225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b4973235-28d5-49f9-9c14-048d7c4d8fc0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:36.391130 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8580d7f1-4539-4f15-be47-a9dea814d59a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1474 microversion: 2.1 time: 0.240555 Aug 03 01:55:36.391801 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b4973235-28d5-49f9-9c14-048d7c4d8fc0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1280 microversion: 2.25 time: 0.252913 Aug 03 01:55:36.393226 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1035/2054] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:36 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1280 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:36.399295 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1020/2055] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:36 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1474 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:36.409472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fe16f0f1-8edc-4390-9109-924a43ec0817 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:36.411115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fe16f0f1-8edc-4390-9109-924a43ec0817 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:36.411773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-89fee6b7-2c77-45d4-ac64-09cdcf457d55 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:36.412465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-89fee6b7-2c77-45d4-ac64-09cdcf457d55 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:36.419894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89fee6b7-2c77-45d4-ac64-09cdcf457d55 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:36.420697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89fee6b7-2c77-45d4-ac64-09cdcf457d55 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:36.421976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89fee6b7-2c77-45d4-ac64-09cdcf457d55 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:36.422206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe16f0f1-8edc-4390-9109-924a43ec0817 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:36.422737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe16f0f1-8edc-4390-9109-924a43ec0817 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:36.423103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89fee6b7-2c77-45d4-ac64-09cdcf457d55 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:36.423639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe16f0f1-8edc-4390-9109-924a43ec0817 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:36.426019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe16f0f1-8edc-4390-9109-924a43ec0817 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:36.537836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fe16f0f1-8edc-4390-9109-924a43ec0817 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:36.547064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fe16f0f1-8edc-4390-9109-924a43ec0817 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:36.548667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fe16f0f1-8edc-4390-9109-924a43ec0817 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:36.549880 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fe16f0f1-8edc-4390-9109-924a43ec0817 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.155298 Aug 03 01:55:36.566572 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1036/2056] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:36 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:36.620253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-89fee6b7-2c77-45d4-ac64-09cdcf457d55 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:36.630324 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-89fee6b7-2c77-45d4-ac64-09cdcf457d55 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1307 microversion: 2.1 time: 0.229289 Aug 03 01:55:36.631072 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1021/2057] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:36 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1307 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:36.669161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d36c577-5bf9-4457-a56b-f5afb2ce5268 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:36.669964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6d36c577-5bf9-4457-a56b-f5afb2ce5268 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:36.676890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d36c577-5bf9-4457-a56b-f5afb2ce5268 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:36.677349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d36c577-5bf9-4457-a56b-f5afb2ce5268 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:36.678140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d36c577-5bf9-4457-a56b-f5afb2ce5268 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:36.678583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d36c577-5bf9-4457-a56b-f5afb2ce5268 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:36.713497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-56759efb-df98-4fd3-8dd8-18b441777040 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:36.714129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-56759efb-df98-4fd3-8dd8-18b441777040 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:36.721610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56759efb-df98-4fd3-8dd8-18b441777040 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:36.722525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56759efb-df98-4fd3-8dd8-18b441777040 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:36.723398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56759efb-df98-4fd3-8dd8-18b441777040 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:36.723851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56759efb-df98-4fd3-8dd8-18b441777040 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:36.900054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6d36c577-5bf9-4457-a56b-f5afb2ce5268 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:36.912074 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6d36c577-5bf9-4457-a56b-f5afb2ce5268 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.246804 Aug 03 01:55:36.925370 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1037/2058] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:36 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:36.944526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-56759efb-df98-4fd3-8dd8-18b441777040 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:36.952931 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-56759efb-df98-4fd3-8dd8-18b441777040 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.244415 Aug 03 01:55:36.954981 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1022/2059] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:36 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:37.154126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-34bae94e-08ed-495a-ab45-0571164e11ca req-0bcfb22f-0110-41fa-b407-7c5a702ddbf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92c67e8-bc6b-44c4-b012-63b940619b6d", "name": "network-vif-plugged", "status": "completed", "tag": "ed823989-d5aa-4d9a-9d30-87acf254629c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:37.168152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-34bae94e-08ed-495a-ab45-0571164e11ca req-0bcfb22f-0110-41fa-b407-7c5a702ddbf5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:37.168657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-34bae94e-08ed-495a-ab45-0571164e11ca req-0bcfb22f-0110-41fa-b407-7c5a702ddbf5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:37.182055 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-34bae94e-08ed-495a-ab45-0571164e11ca req-0bcfb22f-0110-41fa-b407-7c5a702ddbf5 service nova] Creating event network-vif-plugged:ed823989-d5aa-4d9a-9d30-87acf254629c for instance f92c67e8-bc6b-44c4-b012-63b940619b6d on n-h2-826529-8 Aug 03 01:55:37.187344 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-34bae94e-08ed-495a-ab45-0571164e11ca req-0bcfb22f-0110-41fa-b407-7c5a702ddbf5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036934 Aug 03 01:55:37.188147 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1038/2060] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:37.416846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-38b2614c-ad11-48d4-a33d-7a84a25e14d7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:37.417646 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-90ba282d-81a6-48f4-ac65-386c49985c18 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:37.418326 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-38b2614c-ad11-48d4-a33d-7a84a25e14d7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:37.418464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-90ba282d-81a6-48f4-ac65-386c49985c18 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:37.426078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90ba282d-81a6-48f4-ac65-386c49985c18 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:37.426571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90ba282d-81a6-48f4-ac65-386c49985c18 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:37.426756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38b2614c-ad11-48d4-a33d-7a84a25e14d7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:37.427270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38b2614c-ad11-48d4-a33d-7a84a25e14d7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:37.427639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90ba282d-81a6-48f4-ac65-386c49985c18 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:37.428061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38b2614c-ad11-48d4-a33d-7a84a25e14d7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:37.428201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90ba282d-81a6-48f4-ac65-386c49985c18 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:37.428507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38b2614c-ad11-48d4-a33d-7a84a25e14d7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:37.639679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-90ba282d-81a6-48f4-ac65-386c49985c18 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:37.642713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-38b2614c-ad11-48d4-a33d-7a84a25e14d7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:37.650501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-90ba282d-81a6-48f4-ac65-386c49985c18 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:37.652047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-90ba282d-81a6-48f4-ac65-386c49985c18 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:37.653064 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-38b2614c-ad11-48d4-a33d-7a84a25e14d7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1474 microversion: 2.1 time: 0.243985 Aug 03 01:55:37.653377 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-90ba282d-81a6-48f4-ac65-386c49985c18 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1280 microversion: 2.25 time: 0.240016 Aug 03 01:55:37.653787 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1023/2061] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:37 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1474 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:37.659290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2277bcec-2474-40d6-a90a-f474c279a84e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:37.660770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2277bcec-2474-40d6-a90a-f474c279a84e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:37.667210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2277bcec-2474-40d6-a90a-f474c279a84e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:37.667373 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1039/2062] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:37 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1280 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:55:37.667638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2277bcec-2474-40d6-a90a-f474c279a84e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:37.668432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2277bcec-2474-40d6-a90a-f474c279a84e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:37.668881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2277bcec-2474-40d6-a90a-f474c279a84e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:37.672515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b7be9579-b944-4847-8f14-2ca0ef06e754 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:37.673137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b7be9579-b944-4847-8f14-2ca0ef06e754 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:37.680681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7be9579-b944-4847-8f14-2ca0ef06e754 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:37.681194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7be9579-b944-4847-8f14-2ca0ef06e754 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:37.681934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7be9579-b944-4847-8f14-2ca0ef06e754 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:37.682366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7be9579-b944-4847-8f14-2ca0ef06e754 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:37.748184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2277bcec-2474-40d6-a90a-f474c279a84e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:37.757633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2277bcec-2474-40d6-a90a-f474c279a84e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:37.759184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2277bcec-2474-40d6-a90a-f474c279a84e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:37.760377 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2277bcec-2474-40d6-a90a-f474c279a84e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.105173 Aug 03 01:55:37.761045 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1024/2063] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:37 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:37.843277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b7be9579-b944-4847-8f14-2ca0ef06e754 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:37.853297 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b7be9579-b944-4847-8f14-2ca0ef06e754 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1307 microversion: 2.1 time: 0.184764 Aug 03 01:55:37.853881 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1040/2064] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:37 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1307 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:37.865273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-b1a6c8a5-6532-4641-b95f-39138716f720 req-57bc7d22-d320-4305-8ceb-86ac67b4f311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b54bdd1-d224-4a35-9487-66a77cd76c71", "tag": "54039f8b-300c-447b-a43c-cb4dd1e17902"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:37.875793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b1a6c8a5-6532-4641-b95f-39138716f720 req-57bc7d22-d320-4305-8ceb-86ac67b4f311 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:37.876283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b1a6c8a5-6532-4641-b95f-39138716f720 req-57bc7d22-d320-4305-8ceb-86ac67b4f311 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:37.888792 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-b1a6c8a5-6532-4641-b95f-39138716f720 req-57bc7d22-d320-4305-8ceb-86ac67b4f311 service nova] Creating event network-changed:54039f8b-300c-447b-a43c-cb4dd1e17902 for instance 0b54bdd1-d224-4a35-9487-66a77cd76c71 on n-h2-826529-8 Aug 03 01:55:37.894416 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-b1a6c8a5-6532-4641-b95f-39138716f720 req-57bc7d22-d320-4305-8ceb-86ac67b4f311 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032824 Aug 03 01:55:37.895210 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1025/2065] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:37.937009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e3eda9c9-bb68-43e9-bb73-84575a406649 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:37.937629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e3eda9c9-bb68-43e9-bb73-84575a406649 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:37.944682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3eda9c9-bb68-43e9-bb73-84575a406649 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:37.945133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3eda9c9-bb68-43e9-bb73-84575a406649 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:37.946011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3eda9c9-bb68-43e9-bb73-84575a406649 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:37.946458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3eda9c9-bb68-43e9-bb73-84575a406649 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:37.976673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5de9e93c-cd87-4da5-996c-9276f246983c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:37.977386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5de9e93c-cd87-4da5-996c-9276f246983c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:37.983898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5de9e93c-cd87-4da5-996c-9276f246983c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:37.984350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5de9e93c-cd87-4da5-996c-9276f246983c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:37.985132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5de9e93c-cd87-4da5-996c-9276f246983c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:37.985706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5de9e93c-cd87-4da5-996c-9276f246983c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:38.140789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3eda9c9-bb68-43e9-bb73-84575a406649 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:38.149724 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e3eda9c9-bb68-43e9-bb73-84575a406649 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.216588 Aug 03 01:55:38.150481 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1041/2066] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:37 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:38.169440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5de9e93c-cd87-4da5-996c-9276f246983c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:38.177568 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5de9e93c-cd87-4da5-996c-9276f246983c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.205932 Aug 03 01:55:38.178182 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1026/2067] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:37 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:38.678101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c365c129-d241-4001-8b73-ac952d4843cc tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:38.678886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c365c129-d241-4001-8b73-ac952d4843cc tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:38.680520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0cc6042f-1547-49e5-8e1c-d79ed09297e1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:38.681156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0cc6042f-1547-49e5-8e1c-d79ed09297e1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:38.686678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c365c129-d241-4001-8b73-ac952d4843cc tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:38.687263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c365c129-d241-4001-8b73-ac952d4843cc tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:38.687489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cc6042f-1547-49e5-8e1c-d79ed09297e1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:38.687957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cc6042f-1547-49e5-8e1c-d79ed09297e1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:38.688216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c365c129-d241-4001-8b73-ac952d4843cc tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:38.688661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c365c129-d241-4001-8b73-ac952d4843cc tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:38.688791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cc6042f-1547-49e5-8e1c-d79ed09297e1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:38.689185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cc6042f-1547-49e5-8e1c-d79ed09297e1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:38.911357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c365c129-d241-4001-8b73-ac952d4843cc tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:38.921126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c365c129-d241-4001-8b73-ac952d4843cc tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:38.921489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0cc6042f-1547-49e5-8e1c-d79ed09297e1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:38.922636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c365c129-d241-4001-8b73-ac952d4843cc tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:38.923804 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c365c129-d241-4001-8b73-ac952d4843cc tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1280 microversion: 2.25 time: 0.250560 Aug 03 01:55:38.924394 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1042/2068] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:38 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1280 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:38.930209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3bf13682-2419-44c2-b2d9-44d86721ab64 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:38.930744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3bf13682-2419-44c2-b2d9-44d86721ab64 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:38.947273 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0cc6042f-1547-49e5-8e1c-d79ed09297e1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1474 microversion: 2.1 time: 0.271993 Aug 03 01:55:38.948192 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1027/2069] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:38 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1474 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:38.948784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3bf13682-2419-44c2-b2d9-44d86721ab64 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:38.949297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3bf13682-2419-44c2-b2d9-44d86721ab64 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:38.950235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3bf13682-2419-44c2-b2d9-44d86721ab64 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:38.950686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3bf13682-2419-44c2-b2d9-44d86721ab64 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:38.955243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e06c66ca-1dd1-465c-9a59-4cbc1814af49 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:38.955949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e06c66ca-1dd1-465c-9a59-4cbc1814af49 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:38.963540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e06c66ca-1dd1-465c-9a59-4cbc1814af49 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:38.963991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e06c66ca-1dd1-465c-9a59-4cbc1814af49 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:38.964918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e06c66ca-1dd1-465c-9a59-4cbc1814af49 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:38.965358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e06c66ca-1dd1-465c-9a59-4cbc1814af49 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:39.034214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3bf13682-2419-44c2-b2d9-44d86721ab64 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:39.044560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3bf13682-2419-44c2-b2d9-44d86721ab64 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:39.046069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3bf13682-2419-44c2-b2d9-44d86721ab64 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:39.047264 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3bf13682-2419-44c2-b2d9-44d86721ab64 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.121919 Aug 03 01:55:39.047956 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1043/2070] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:38 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:39.164225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e06c66ca-1dd1-465c-9a59-4cbc1814af49 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:39.172149 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e06c66ca-1dd1-465c-9a59-4cbc1814af49 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1307 microversion: 2.1 time: 0.222492 Aug 03 01:55:39.172733 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1028/2071] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:38 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1307 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:39.173743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6f7774ae-8d80-45a8-b4c7-edddbf705801 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:39.174384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6f7774ae-8d80-45a8-b4c7-edddbf705801 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:39.181396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f7774ae-8d80-45a8-b4c7-edddbf705801 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:39.181773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f7774ae-8d80-45a8-b4c7-edddbf705801 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:39.182548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f7774ae-8d80-45a8-b4c7-edddbf705801 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:39.183008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f7774ae-8d80-45a8-b4c7-edddbf705801 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:39.185763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:39.200779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-727a8b92-0fc3-49c9-b2cb-bd36f831b281 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:39.201407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-727a8b92-0fc3-49c9-b2cb-bd36f831b281 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:39.207974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-727a8b92-0fc3-49c9-b2cb-bd36f831b281 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:39.208450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-727a8b92-0fc3-49c9-b2cb-bd36f831b281 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:39.209258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-727a8b92-0fc3-49c9-b2cb-bd36f831b281 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:39.209705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-727a8b92-0fc3-49c9-b2cb-bd36f831b281 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:39.807793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6f7774ae-8d80-45a8-b4c7-edddbf705801 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:39.819191 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6f7774ae-8d80-45a8-b4c7-edddbf705801 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.649374 Aug 03 01:55:39.820090 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1044/2072] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:39 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:39.828910 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-3fb12e07-beca-4d91-80e1-c561d19e3ec5 req-91f6d9e3-7906-43d2-a8b2-6b375953651f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb30620-408d-468e-b706-277ce080a2f6", "name": "network-vif-unplugged", "status": "completed", "tag": "9762e114-938b-48d4-8d92-0fae9855c76e"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:39.841158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3fb12e07-beca-4d91-80e1-c561d19e3ec5 req-91f6d9e3-7906-43d2-a8b2-6b375953651f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:39.841736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3fb12e07-beca-4d91-80e1-c561d19e3ec5 req-91f6d9e3-7906-43d2-a8b2-6b375953651f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:39.855070 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-3fb12e07-beca-4d91-80e1-c561d19e3ec5 req-91f6d9e3-7906-43d2-a8b2-6b375953651f service nova] Creating event network-vif-unplugged:9762e114-938b-48d4-8d92-0fae9855c76e for instance 0eb30620-408d-468e-b706-277ce080a2f6 on n-h1-826529-8 Aug 03 01:55:39.860940 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-3fb12e07-beca-4d91-80e1-c561d19e3ec5 req-91f6d9e3-7906-43d2-a8b2-6b375953651f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036555 Aug 03 01:55:39.861930 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1045/2073] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:39.870109 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6c5e2bbc-e92b-4ea2-853e-3e50b5e141e0 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:39.875616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6c5e2bbc-e92b-4ea2-853e-3e50b5e141e0 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:39.876446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6c5e2bbc-e92b-4ea2-853e-3e50b5e141e0 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Searching by: {'deleted': False, 'project_id': '44fdaa2efc844407aea6dbd1493ad387'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:55:39.881950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-727a8b92-0fc3-49c9-b2cb-bd36f831b281 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:39.887857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c5e2bbc-e92b-4ea2-853e-3e50b5e141e0 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:39.891446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c5e2bbc-e92b-4ea2-853e-3e50b5e141e0 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:39.892471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c5e2bbc-e92b-4ea2-853e-3e50b5e141e0 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:39.893024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c5e2bbc-e92b-4ea2-853e-3e50b5e141e0 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:39.896490 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-727a8b92-0fc3-49c9-b2cb-bd36f831b281 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.700148 Aug 03 01:55:39.898024 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1029/2074] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:39 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:39.928103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-6c5e2bbc-e92b-4ea2-853e-3e50b5e141e0 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:55:39.962732 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6c5e2bbc-e92b-4ea2-853e-3e50b5e141e0 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.098508 Aug 03 01:55:39.963833 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1046/2075] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 3 01:55:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:39.966334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-33dff1ba-cc79-49c6-ab6e-99795f29dab9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:39.966975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-33dff1ba-cc79-49c6-ab6e-99795f29dab9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:39.972312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e17e937-9942-4185-be99-8c176eccbc14 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:39.973081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3e17e937-9942-4185-be99-8c176eccbc14 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:39.974576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:39.976616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33dff1ba-cc79-49c6-ab6e-99795f29dab9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:39.977397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33dff1ba-cc79-49c6-ab6e-99795f29dab9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:39.978942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33dff1ba-cc79-49c6-ab6e-99795f29dab9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:39.979421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33dff1ba-cc79-49c6-ab6e-99795f29dab9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:39.982055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e17e937-9942-4185-be99-8c176eccbc14 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:39.982524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e17e937-9942-4185-be99-8c176eccbc14 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:39.983558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e17e937-9942-4185-be99-8c176eccbc14 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:39.984096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e17e937-9942-4185-be99-8c176eccbc14 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:40.269549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-33dff1ba-cc79-49c6-ab6e-99795f29dab9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:40.278102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-33dff1ba-cc79-49c6-ab6e-99795f29dab9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:40.279818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-33dff1ba-cc79-49c6-ab6e-99795f29dab9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:40.281057 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-33dff1ba-cc79-49c6-ab6e-99795f29dab9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1280 microversion: 2.25 time: 0.319236 Aug 03 01:55:40.281710 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1030/2076] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:39 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1280 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:55:40.288392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c45059aa-fc36-44b6-bf8c-1b607a06c272 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:40.290744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3e17e937-9942-4185-be99-8c176eccbc14 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:40.294784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c45059aa-fc36-44b6-bf8c-1b607a06c272 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:40.295742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c45059aa-fc36-44b6-bf8c-1b607a06c272 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Searching by: {'deleted': False, 'project_id': '44fdaa2efc844407aea6dbd1493ad387'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:55:40.299523 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e17e937-9942-4185-be99-8c176eccbc14 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1474 microversion: 2.1 time: 0.331224 Aug 03 01:55:40.300131 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1047/2077] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:39 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1474 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:40.301264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c45059aa-fc36-44b6-bf8c-1b607a06c272 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:40.301727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c45059aa-fc36-44b6-bf8c-1b607a06c272 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:40.302548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c45059aa-fc36-44b6-bf8c-1b607a06c272 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:40.303017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c45059aa-fc36-44b6-bf8c-1b607a06c272 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:40.305090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-abb3c058-bb96-4764-a894-2c9a286c8e4b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:40.306532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-abb3c058-bb96-4764-a894-2c9a286c8e4b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:40.313907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-abb3c058-bb96-4764-a894-2c9a286c8e4b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:40.314446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-abb3c058-bb96-4764-a894-2c9a286c8e4b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:40.315358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-abb3c058-bb96-4764-a894-2c9a286c8e4b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:40.315799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-abb3c058-bb96-4764-a894-2c9a286c8e4b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:40.334413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-c45059aa-fc36-44b6-bf8c-1b607a06c272 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:55:40.374216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c45059aa-fc36-44b6-bf8c-1b607a06c272 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:40.381950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c45059aa-fc36-44b6-bf8c-1b607a06c272 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:40.382485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c45059aa-fc36-44b6-bf8c-1b607a06c272 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:40.411999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-abb3c058-bb96-4764-a894-2c9a286c8e4b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:40.421145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-abb3c058-bb96-4764-a894-2c9a286c8e4b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:40.422800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-abb3c058-bb96-4764-a894-2c9a286c8e4b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:40.424018 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-abb3c058-bb96-4764-a894-2c9a286c8e4b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.122836 Aug 03 01:55:40.424582 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1048/2078] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:40 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:40.429518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-92e06301-c5de-4217-9bac-d56c7b38548f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:40.430124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-92e06301-c5de-4217-9bac-d56c7b38548f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:40.436507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92e06301-c5de-4217-9bac-d56c7b38548f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:40.436956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92e06301-c5de-4217-9bac-d56c7b38548f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:40.437733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92e06301-c5de-4217-9bac-d56c7b38548f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:40.438169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92e06301-c5de-4217-9bac-d56c7b38548f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:40.602034 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c45059aa-fc36-44b6-bf8c-1b607a06c272 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.319091 Aug 03 01:55:40.615158 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1031/2079] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:55:40 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:40.626600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c30c3c08-055c-453f-8cf0-c257e11a135f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:40.637733 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c30c3c08-055c-453f-8cf0-c257e11a135f tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014947 Aug 03 01:55:40.638467 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1032/2080] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 01:55:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:40.649048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-92e06301-c5de-4217-9bac-d56c7b38548f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:40.657398 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-92e06301-c5de-4217-9bac-d56c7b38548f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1487 microversion: 2.1 time: 0.231583 Aug 03 01:55:40.657972 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1049/2081] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:40 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1487 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:40.680398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b5827369-271d-452a-9984-6eec61eead44 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:40.687884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5827369-271d-452a-9984-6eec61eead44 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:40.688334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5827369-271d-452a-9984-6eec61eead44 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:40.765754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b5827369-271d-452a-9984-6eec61eead44 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Going to try to stop instance {{(pid=125942) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 01:55:40.795861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:40.815775 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b5827369-271d-452a-9984-6eec61eead44 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "POST /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d/action" status: 202 len: 0 microversion: 2.1 time: 0.139704 Aug 03 01:55:40.817108 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1033/2082] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:55:40 2022] POST /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:55:40.826989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b93b630-08fc-4261-bf95-26822571c68d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:40.827616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8b93b630-08fc-4261-bf95-26822571c68d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:40.837133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b93b630-08fc-4261-bf95-26822571c68d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:40.837592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b93b630-08fc-4261-bf95-26822571c68d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:40.838391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b93b630-08fc-4261-bf95-26822571c68d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:40.838832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b93b630-08fc-4261-bf95-26822571c68d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:40.848553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1ea59786-bc59-4d46-9293-6a193463422b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:40.849310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1ea59786-bc59-4d46-9293-6a193463422b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:40.860955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ea59786-bc59-4d46-9293-6a193463422b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:40.861423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ea59786-bc59-4d46-9293-6a193463422b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:40.862230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ea59786-bc59-4d46-9293-6a193463422b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:40.862679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ea59786-bc59-4d46-9293-6a193463422b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:41.073735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8b93b630-08fc-4261-bf95-26822571c68d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:41.082341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1ea59786-bc59-4d46-9293-6a193463422b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:41.083185 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8b93b630-08fc-4261-bf95-26822571c68d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.260677 Aug 03 01:55:41.083953 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1050/2083] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:40 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:41.089857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cf770383-1368-4544-af35-be7fad162814 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:41.090571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cf770383-1368-4544-af35-be7fad162814 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:41.098996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf770383-1368-4544-af35-be7fad162814 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:41.099496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf770383-1368-4544-af35-be7fad162814 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:41.100317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf770383-1368-4544-af35-be7fad162814 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:41.101031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf770383-1368-4544-af35-be7fad162814 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:41.105712 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1ea59786-bc59-4d46-9293-6a193463422b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.263005 Aug 03 01:55:41.106290 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1034/2084] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:40 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:41.248080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cf770383-1368-4544-af35-be7fad162814 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:41.256574 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cf770383-1368-4544-af35-be7fad162814 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.171472 Aug 03 01:55:41.257175 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1051/2085] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:41 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:41.306263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d742f232-9a2b-49e8-9a76-735b34adc361 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:41.307164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d742f232-9a2b-49e8-9a76-735b34adc361 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:41.315216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d742f232-9a2b-49e8-9a76-735b34adc361 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:41.315827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d742f232-9a2b-49e8-9a76-735b34adc361 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:41.316640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d742f232-9a2b-49e8-9a76-735b34adc361 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:41.317083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d742f232-9a2b-49e8-9a76-735b34adc361 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:41.335784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-da740ca4-eaa0-44f4-9b1f-2768269a1127 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:41.336441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-da740ca4-eaa0-44f4-9b1f-2768269a1127 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:41.342742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da740ca4-eaa0-44f4-9b1f-2768269a1127 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:41.343250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da740ca4-eaa0-44f4-9b1f-2768269a1127 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:41.344072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da740ca4-eaa0-44f4-9b1f-2768269a1127 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:41.344512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da740ca4-eaa0-44f4-9b1f-2768269a1127 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:41.558691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d742f232-9a2b-49e8-9a76-735b34adc361 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:41.566239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-da740ca4-eaa0-44f4-9b1f-2768269a1127 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:41.567928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d742f232-9a2b-49e8-9a76-735b34adc361 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:41.569620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d742f232-9a2b-49e8-9a76-735b34adc361 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:41.570957 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d742f232-9a2b-49e8-9a76-735b34adc361 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1280 microversion: 2.25 time: 0.268673 Aug 03 01:55:41.571933 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1035/2086] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:41 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1280 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:55:41.575492 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-da740ca4-eaa0-44f4-9b1f-2768269a1127 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1474 microversion: 2.1 time: 0.257284 Aug 03 01:55:41.584708 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1052/2087] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:41 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1474 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:41.585514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-13f4eb97-cb2a-4ed1-9af8-7bb39a8b2d17 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:41.585514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-13f4eb97-cb2a-4ed1-9af8-7bb39a8b2d17 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:41.585729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dc74af4c-c7a8-407e-b429-f19c09fcbb92 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:41.585729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dc74af4c-c7a8-407e-b429-f19c09fcbb92 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:41.585944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13f4eb97-cb2a-4ed1-9af8-7bb39a8b2d17 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:41.585944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13f4eb97-cb2a-4ed1-9af8-7bb39a8b2d17 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:41.587547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13f4eb97-cb2a-4ed1-9af8-7bb39a8b2d17 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:41.587847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13f4eb97-cb2a-4ed1-9af8-7bb39a8b2d17 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:41.592563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc74af4c-c7a8-407e-b429-f19c09fcbb92 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:41.593264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc74af4c-c7a8-407e-b429-f19c09fcbb92 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:41.594065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc74af4c-c7a8-407e-b429-f19c09fcbb92 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:41.594510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc74af4c-c7a8-407e-b429-f19c09fcbb92 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:41.619744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-13f4eb97-cb2a-4ed1-9af8-7bb39a8b2d17 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:55:41.678334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dc74af4c-c7a8-407e-b429-f19c09fcbb92 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:41.687535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dc74af4c-c7a8-407e-b429-f19c09fcbb92 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:41.689270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dc74af4c-c7a8-407e-b429-f19c09fcbb92 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:41.690719 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dc74af4c-c7a8-407e-b429-f19c09fcbb92 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.112885 Aug 03 01:55:41.691840 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1053/2088] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:41 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:41.725079 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-13f4eb97-cb2a-4ed1-9af8-7bb39a8b2d17 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 204 len: 0 microversion: 2.1 time: 0.151513 Aug 03 01:55:41.725987 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1036/2089] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:55:41 2022] DELETE /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:55:41.735749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7db126ae-c243-4a49-a21f-082181dee34d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:41.736392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7db126ae-c243-4a49-a21f-082181dee34d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:41.744574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7db126ae-c243-4a49-a21f-082181dee34d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:41.745149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7db126ae-c243-4a49-a21f-082181dee34d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:41.746360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7db126ae-c243-4a49-a21f-082181dee34d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:41.746818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7db126ae-c243-4a49-a21f-082181dee34d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:41.891260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7db126ae-c243-4a49-a21f-082181dee34d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:41.900697 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7db126ae-c243-4a49-a21f-082181dee34d tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1608 microversion: 2.1 time: 0.169295 Aug 03 01:55:41.901284 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1054/2090] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:41 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1608 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:42.106624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bb1f1510-9fa0-4dcb-b01e-bb9f0c30ccb5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:42.107535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bb1f1510-9fa0-4dcb-b01e-bb9f0c30ccb5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:42.114514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bb1f1510-9fa0-4dcb-b01e-bb9f0c30ccb5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:42.115011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bb1f1510-9fa0-4dcb-b01e-bb9f0c30ccb5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:42.115825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bb1f1510-9fa0-4dcb-b01e-bb9f0c30ccb5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:42.116276 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bb1f1510-9fa0-4dcb-b01e-bb9f0c30ccb5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:42.129249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3ee29066-69a8-40d9-b97e-a0a4b4865a64 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:42.129807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3ee29066-69a8-40d9-b97e-a0a4b4865a64 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:42.137045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ee29066-69a8-40d9-b97e-a0a4b4865a64 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:42.138079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ee29066-69a8-40d9-b97e-a0a4b4865a64 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:42.138877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ee29066-69a8-40d9-b97e-a0a4b4865a64 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:42.139360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ee29066-69a8-40d9-b97e-a0a4b4865a64 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:42.335846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bb1f1510-9fa0-4dcb-b01e-bb9f0c30ccb5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:42.344649 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bb1f1510-9fa0-4dcb-b01e-bb9f0c30ccb5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.242207 Aug 03 01:55:42.345182 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1037/2091] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:42 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:42.355245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-1294d353-b35b-4852-a952-1e53c317c6af req-70d22f53-88b7-445c-8a10-26a3cbbbc1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb30620-408d-468e-b706-277ce080a2f6", "name": "network-vif-plugged", "status": "completed", "tag": "9762e114-938b-48d4-8d92-0fae9855c76e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:42.361058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1294d353-b35b-4852-a952-1e53c317c6af req-70d22f53-88b7-445c-8a10-26a3cbbbc1ed service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:42.361517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1294d353-b35b-4852-a952-1e53c317c6af req-70d22f53-88b7-445c-8a10-26a3cbbbc1ed service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:42.369528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3ee29066-69a8-40d9-b97e-a0a4b4865a64 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:42.380407 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-1294d353-b35b-4852-a952-1e53c317c6af req-70d22f53-88b7-445c-8a10-26a3cbbbc1ed service nova] Creating event network-vif-plugged:9762e114-938b-48d4-8d92-0fae9855c76e for instance 0eb30620-408d-468e-b706-277ce080a2f6 on n-h1-826529-8 Aug 03 01:55:42.386785 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-1294d353-b35b-4852-a952-1e53c317c6af req-70d22f53-88b7-445c-8a10-26a3cbbbc1ed service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040389 Aug 03 01:55:42.389538 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3ee29066-69a8-40d9-b97e-a0a4b4865a64 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.265242 Aug 03 01:55:42.390077 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1055/2092] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:42 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:42.391539 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1038/2093] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:42.396602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5e8f314d-13dd-45ea-b9bc-3fee1552f68c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:42.397495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5e8f314d-13dd-45ea-b9bc-3fee1552f68c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:42.404681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e8f314d-13dd-45ea-b9bc-3fee1552f68c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:42.406213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e8f314d-13dd-45ea-b9bc-3fee1552f68c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:42.407494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e8f314d-13dd-45ea-b9bc-3fee1552f68c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:42.407943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e8f314d-13dd-45ea-b9bc-3fee1552f68c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:42.564210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5e8f314d-13dd-45ea-b9bc-3fee1552f68c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:42.572583 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5e8f314d-13dd-45ea-b9bc-3fee1552f68c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.180581 Aug 03 01:55:42.573164 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1056/2094] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:42 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:42.599393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bbac76f0-5a5b-41f4-bcaf-cf2863a7e588 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:42.600114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bbac76f0-5a5b-41f4-bcaf-cf2863a7e588 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:42.600838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc2e6f0b-b4e1-4e08-958a-3216ee05b6e6 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:42.601774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fc2e6f0b-b4e1-4e08-958a-3216ee05b6e6 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:42.606613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bbac76f0-5a5b-41f4-bcaf-cf2863a7e588 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:42.607122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bbac76f0-5a5b-41f4-bcaf-cf2863a7e588 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:42.607916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bbac76f0-5a5b-41f4-bcaf-cf2863a7e588 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:42.608358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bbac76f0-5a5b-41f4-bcaf-cf2863a7e588 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:42.608580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2e6f0b-b4e1-4e08-958a-3216ee05b6e6 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:42.609009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2e6f0b-b4e1-4e08-958a-3216ee05b6e6 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:42.609816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2e6f0b-b4e1-4e08-958a-3216ee05b6e6 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:42.610258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2e6f0b-b4e1-4e08-958a-3216ee05b6e6 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:42.828388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bbac76f0-5a5b-41f4-bcaf-cf2863a7e588 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:42.832757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fc2e6f0b-b4e1-4e08-958a-3216ee05b6e6 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:42.838583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bbac76f0-5a5b-41f4-bcaf-cf2863a7e588 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:42.840314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bbac76f0-5a5b-41f4-bcaf-cf2863a7e588 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:42.840845 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fc2e6f0b-b4e1-4e08-958a-3216ee05b6e6 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1474 microversion: 2.1 time: 0.244780 Aug 03 01:55:42.841421 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1057/2095] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:42 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1474 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:42.841552 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bbac76f0-5a5b-41f4-bcaf-cf2863a7e588 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1280 microversion: 2.25 time: 0.248092 Aug 03 01:55:42.845559 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1039/2096] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:42 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1280 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:55:42.845927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d9f5f453-370a-46ce-81a4-94c8772256bb tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:42.846546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d9f5f453-370a-46ce-81a4-94c8772256bb tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:42.852909 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9f5f453-370a-46ce-81a4-94c8772256bb tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:42.853352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9f5f453-370a-46ce-81a4-94c8772256bb tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:42.854132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9f5f453-370a-46ce-81a4-94c8772256bb tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:42.854572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9f5f453-370a-46ce-81a4-94c8772256bb tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:42.922413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d9f5f453-370a-46ce-81a4-94c8772256bb tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:42.929981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c67bc7ea-f567-4c18-affe-27cb23f09230 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:42.930701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c67bc7ea-f567-4c18-affe-27cb23f09230 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:42.931236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d9f5f453-370a-46ce-81a4-94c8772256bb tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:42.932751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d9f5f453-370a-46ce-81a4-94c8772256bb tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:42.933930 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d9f5f453-370a-46ce-81a4-94c8772256bb tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.091584 Aug 03 01:55:42.938388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c67bc7ea-f567-4c18-affe-27cb23f09230 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:42.938950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c67bc7ea-f567-4c18-affe-27cb23f09230 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:42.939333 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1058/2097] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:42 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:42.939894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c67bc7ea-f567-4c18-affe-27cb23f09230 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:42.940430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c67bc7ea-f567-4c18-affe-27cb23f09230 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:43.089328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c67bc7ea-f567-4c18-affe-27cb23f09230 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:43.097220 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c67bc7ea-f567-4c18-affe-27cb23f09230 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1608 microversion: 2.1 time: 0.172079 Aug 03 01:55:43.097869 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1040/2098] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:42 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1608 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:43.369282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-61145586-d3a7-4c5e-aeb9-8fa08737f17e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:43.369910 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-61145586-d3a7-4c5e-aeb9-8fa08737f17e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:43.376068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61145586-d3a7-4c5e-aeb9-8fa08737f17e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:43.376517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61145586-d3a7-4c5e-aeb9-8fa08737f17e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:43.377288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61145586-d3a7-4c5e-aeb9-8fa08737f17e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:43.377718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61145586-d3a7-4c5e-aeb9-8fa08737f17e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:43.412723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93a14e33-36cf-4c9f-bfe2-4834711177e5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:43.413380 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93a14e33-36cf-4c9f-bfe2-4834711177e5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:43.419753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93a14e33-36cf-4c9f-bfe2-4834711177e5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:43.420209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93a14e33-36cf-4c9f-bfe2-4834711177e5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:43.421001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93a14e33-36cf-4c9f-bfe2-4834711177e5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:43.421442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93a14e33-36cf-4c9f-bfe2-4834711177e5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:43.580400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-61145586-d3a7-4c5e-aeb9-8fa08737f17e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:43.588627 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-61145586-d3a7-4c5e-aeb9-8fa08737f17e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.223207 Aug 03 01:55:43.589209 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1059/2099] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:43 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:43.606063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-93a14e33-36cf-4c9f-bfe2-4834711177e5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:43.607863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-74e40040-af34-4763-b4f2-0cedd56c7508 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:43.608508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-74e40040-af34-4763-b4f2-0cedd56c7508 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:43.616460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74e40040-af34-4763-b4f2-0cedd56c7508 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:43.616744 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93a14e33-36cf-4c9f-bfe2-4834711177e5 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.209053 Aug 03 01:55:43.616914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74e40040-af34-4763-b4f2-0cedd56c7508 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:43.617351 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1041/2100] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:43 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:43.617701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74e40040-af34-4763-b4f2-0cedd56c7508 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:43.618142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74e40040-af34-4763-b4f2-0cedd56c7508 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:43.758493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-74e40040-af34-4763-b4f2-0cedd56c7508 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:43.766144 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-74e40040-af34-4763-b4f2-0cedd56c7508 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.162045 Aug 03 01:55:43.766718 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1060/2101] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:43 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:43.862306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-33acd488-14b5-434a-8e2a-de380c8599f5 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:43.863553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-33acd488-14b5-434a-8e2a-de380c8599f5 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:43.870083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-efd10d27-1201-477b-b71f-4de50076a6c9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:43.870769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-efd10d27-1201-477b-b71f-4de50076a6c9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:43.872238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33acd488-14b5-434a-8e2a-de380c8599f5 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:43.872709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33acd488-14b5-434a-8e2a-de380c8599f5 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:43.873520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33acd488-14b5-434a-8e2a-de380c8599f5 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:43.873966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33acd488-14b5-434a-8e2a-de380c8599f5 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:43.877262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-efd10d27-1201-477b-b71f-4de50076a6c9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:43.877811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-efd10d27-1201-477b-b71f-4de50076a6c9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:43.880196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-efd10d27-1201-477b-b71f-4de50076a6c9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:43.880196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-efd10d27-1201-477b-b71f-4de50076a6c9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:43.884492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:44.085539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-33acd488-14b5-434a-8e2a-de380c8599f5 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:44.091463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-efd10d27-1201-477b-b71f-4de50076a6c9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:44.094504 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-33acd488-14b5-434a-8e2a-de380c8599f5 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1474 microversion: 2.1 time: 0.236666 Aug 03 01:55:44.095526 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1042/2102] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:43 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1474 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:44.101130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-80543360-ff62-4b55-bbb4-97169016b0a3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:44.101989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-efd10d27-1201-477b-b71f-4de50076a6c9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:44.102171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-80543360-ff62-4b55-bbb4-97169016b0a3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:44.103534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-efd10d27-1201-477b-b71f-4de50076a6c9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:44.104669 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-efd10d27-1201-477b-b71f-4de50076a6c9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1280 microversion: 2.25 time: 0.239110 Aug 03 01:55:44.105557 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1061/2103] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:43 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1280 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:44.108224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80543360-ff62-4b55-bbb4-97169016b0a3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:44.108921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80543360-ff62-4b55-bbb4-97169016b0a3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:44.109701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80543360-ff62-4b55-bbb4-97169016b0a3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:44.110143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80543360-ff62-4b55-bbb4-97169016b0a3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:44.124142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-583e88a6-b13b-40c2-a1a6-3c424c75eb93 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:44.124911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-583e88a6-b13b-40c2-a1a6-3c424c75eb93 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:44.132596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-583e88a6-b13b-40c2-a1a6-3c424c75eb93 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:44.133058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-583e88a6-b13b-40c2-a1a6-3c424c75eb93 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:44.133942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-583e88a6-b13b-40c2-a1a6-3c424c75eb93 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:44.134300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-583e88a6-b13b-40c2-a1a6-3c424c75eb93 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:44.181271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-80543360-ff62-4b55-bbb4-97169016b0a3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:44.193219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-80543360-ff62-4b55-bbb4-97169016b0a3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:44.194816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-80543360-ff62-4b55-bbb4-97169016b0a3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:44.196048 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-80543360-ff62-4b55-bbb4-97169016b0a3 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.099266 Aug 03 01:55:44.196612 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1043/2104] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:44 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:44.288293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-583e88a6-b13b-40c2-a1a6-3c424c75eb93 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:44.296427 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-583e88a6-b13b-40c2-a1a6-3c424c75eb93 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1608 microversion: 2.1 time: 0.176008 Aug 03 01:55:44.298983 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1062/2105] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:44 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1608 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:44.616444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-05d4bcc0-672b-465b-8bd7-a013e34f87ea tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:44.617199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-05d4bcc0-672b-465b-8bd7-a013e34f87ea tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:44.627924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05d4bcc0-672b-465b-8bd7-a013e34f87ea tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:44.629107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05d4bcc0-672b-465b-8bd7-a013e34f87ea tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:44.630384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05d4bcc0-672b-465b-8bd7-a013e34f87ea tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:44.630836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05d4bcc0-672b-465b-8bd7-a013e34f87ea tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:44.637782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3361a59e-9b2e-4070-b467-4979c372c07e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:44.639012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3361a59e-9b2e-4070-b467-4979c372c07e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:44.649221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:44.651743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3361a59e-9b2e-4070-b467-4979c372c07e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:44.652192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3361a59e-9b2e-4070-b467-4979c372c07e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:44.653316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3361a59e-9b2e-4070-b467-4979c372c07e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:44.653451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3361a59e-9b2e-4070-b467-4979c372c07e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:45.013867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3361a59e-9b2e-4070-b467-4979c372c07e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:45.023859 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3361a59e-9b2e-4070-b467-4979c372c07e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.390101 Aug 03 01:55:45.024453 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1063/2106] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:44 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:45.042937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-568412f6-d8a2-4148-a5d2-bdc9e29038c0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:45.043620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-568412f6-d8a2-4148-a5d2-bdc9e29038c0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:45.048591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-05d4bcc0-672b-465b-8bd7-a013e34f87ea tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:45.051940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-568412f6-d8a2-4148-a5d2-bdc9e29038c0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:45.052612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-568412f6-d8a2-4148-a5d2-bdc9e29038c0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:45.056274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-568412f6-d8a2-4148-a5d2-bdc9e29038c0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:45.056932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-568412f6-d8a2-4148-a5d2-bdc9e29038c0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:45.074620 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-05d4bcc0-672b-465b-8bd7-a013e34f87ea tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.462767 Aug 03 01:55:45.092934 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1044/2107] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:44 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:45.119813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d145ed18-883f-4cfc-bcf0-3a23f3f61c9b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:45.120484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d145ed18-883f-4cfc-bcf0-3a23f3f61c9b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:45.133452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d145ed18-883f-4cfc-bcf0-3a23f3f61c9b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:45.134249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d145ed18-883f-4cfc-bcf0-3a23f3f61c9b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:45.135504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d145ed18-883f-4cfc-bcf0-3a23f3f61c9b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:45.136542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d145ed18-883f-4cfc-bcf0-3a23f3f61c9b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:45.348902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-568412f6-d8a2-4148-a5d2-bdc9e29038c0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:45.357832 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-568412f6-d8a2-4148-a5d2-bdc9e29038c0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.318606 Aug 03 01:55:45.358638 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1064/2108] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:45 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:45.366635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1f6fd79-02e2-4a42-92c3-39c2d5292875 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:45.368034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b1f6fd79-02e2-4a42-92c3-39c2d5292875 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:45.375918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1f6fd79-02e2-4a42-92c3-39c2d5292875 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:45.376497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1f6fd79-02e2-4a42-92c3-39c2d5292875 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:45.377549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1f6fd79-02e2-4a42-92c3-39c2d5292875 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:45.378088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1f6fd79-02e2-4a42-92c3-39c2d5292875 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:45.389522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d145ed18-883f-4cfc-bcf0-3a23f3f61c9b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:45.400647 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d145ed18-883f-4cfc-bcf0-3a23f3f61c9b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1460 microversion: 2.1 time: 0.288081 Aug 03 01:55:45.409216 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1045/2109] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:45 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1460 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:45.414848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c15439c2-2fe6-4275-87ee-0f2d2472aa83 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:45.415795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c15439c2-2fe6-4275-87ee-0f2d2472aa83 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:45.431808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c15439c2-2fe6-4275-87ee-0f2d2472aa83 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:45.432457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c15439c2-2fe6-4275-87ee-0f2d2472aa83 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:45.434772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c15439c2-2fe6-4275-87ee-0f2d2472aa83 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:45.435349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c15439c2-2fe6-4275-87ee-0f2d2472aa83 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:45.546307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c15439c2-2fe6-4275-87ee-0f2d2472aa83 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:45.557672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c15439c2-2fe6-4275-87ee-0f2d2472aa83 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:45.559618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c15439c2-2fe6-4275-87ee-0f2d2472aa83 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:45.560971 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c15439c2-2fe6-4275-87ee-0f2d2472aa83 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.150031 Aug 03 01:55:45.561860 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1046/2110] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:45 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:45.566599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8007fde4-b7da-46e0-acba-7de167a89328 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:45.567353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8007fde4-b7da-46e0-acba-7de167a89328 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:45.574555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8007fde4-b7da-46e0-acba-7de167a89328 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:45.575128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8007fde4-b7da-46e0-acba-7de167a89328 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:45.575926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8007fde4-b7da-46e0-acba-7de167a89328 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:45.576363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8007fde4-b7da-46e0-acba-7de167a89328 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:45.676574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8007fde4-b7da-46e0-acba-7de167a89328 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:45.685887 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8007fde4-b7da-46e0-acba-7de167a89328 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1541 microversion: 2.1 time: 0.123114 Aug 03 01:55:45.700528 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1047/2111] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:45 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1541 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:45.700528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9935fb3e-00bd-4170-8470-9de7b9980135 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:45.700528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9935fb3e-00bd-4170-8470-9de7b9980135 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:45.702727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9935fb3e-00bd-4170-8470-9de7b9980135 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:45.703466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9935fb3e-00bd-4170-8470-9de7b9980135 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:45.705045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9935fb3e-00bd-4170-8470-9de7b9980135 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:45.705805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9935fb3e-00bd-4170-8470-9de7b9980135 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:45.725651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b1f6fd79-02e2-4a42-92c3-39c2d5292875 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:45.749070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b1f6fd79-02e2-4a42-92c3-39c2d5292875 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:45.750622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b1f6fd79-02e2-4a42-92c3-39c2d5292875 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:45.751868 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b1f6fd79-02e2-4a42-92c3-39c2d5292875 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1280 microversion: 2.25 time: 0.391528 Aug 03 01:55:45.752757 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1065/2112] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:45 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1280 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:46.005583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9935fb3e-00bd-4170-8470-9de7b9980135 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:46.012209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-9a42ec95-4059-4f0a-936a-9fd7e519b335 req-a69142c4-f75b-4c7a-b94e-2275431374f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d342ed3e-ca89-47e4-8421-3e0e26e2812b", "name": "network-vif-deleted", "tag": "a51da6f5-db5e-46eb-88ed-439bce78ecf4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:46.022655 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9935fb3e-00bd-4170-8470-9de7b9980135 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1460 microversion: 2.1 time: 0.334373 Aug 03 01:55:46.024485 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1048/2113] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:45 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1460 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:46.037429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9a42ec95-4059-4f0a-936a-9fd7e519b335 req-a69142c4-f75b-4c7a-b94e-2275431374f5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:46.039291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9a42ec95-4059-4f0a-936a-9fd7e519b335 req-a69142c4-f75b-4c7a-b94e-2275431374f5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:46.051709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3aa8888f-3823-4ff9-b3d4-5867742c02e2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:46.052606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3aa8888f-3823-4ff9-b3d4-5867742c02e2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:46.061443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3aa8888f-3823-4ff9-b3d4-5867742c02e2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:46.061737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3aa8888f-3823-4ff9-b3d4-5867742c02e2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:46.062749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3aa8888f-3823-4ff9-b3d4-5867742c02e2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:46.063215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3aa8888f-3823-4ff9-b3d4-5867742c02e2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:46.070786 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-9a42ec95-4059-4f0a-936a-9fd7e519b335 req-a69142c4-f75b-4c7a-b94e-2275431374f5 service nova] Creating event network-vif-deleted:a51da6f5-db5e-46eb-88ed-439bce78ecf4 for instance d342ed3e-ca89-47e4-8421-3e0e26e2812b on n-h2-826529-8 Aug 03 01:55:46.085214 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-9a42ec95-4059-4f0a-936a-9fd7e519b335 req-a69142c4-f75b-4c7a-b94e-2275431374f5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086549 Aug 03 01:55:46.086066 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1066/2114] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:55:46.089049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:46.091072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:46.093858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:46.125808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:46.126631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:46.127634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:46.129036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:46.257870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3aa8888f-3823-4ff9-b3d4-5867742c02e2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:46.268797 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3aa8888f-3823-4ff9-b3d4-5867742c02e2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.226922 Aug 03 01:55:46.270353 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1049/2115] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:46 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:46.275548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cf5414da-5f94-4519-ad58-ee81c45fbb2b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:46.276344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cf5414da-5f94-4519-ad58-ee81c45fbb2b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:46.283427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf5414da-5f94-4519-ad58-ee81c45fbb2b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:46.284418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf5414da-5f94-4519-ad58-ee81c45fbb2b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:46.285803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf5414da-5f94-4519-ad58-ee81c45fbb2b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:46.286388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf5414da-5f94-4519-ad58-ee81c45fbb2b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:46.518265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cf5414da-5f94-4519-ad58-ee81c45fbb2b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:46.536985 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cf5414da-5f94-4519-ad58-ee81c45fbb2b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.260817 Aug 03 01:55:46.537751 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1050/2116] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:46 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:46.542459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8bcec94-b828-4461-8563-c86aa3ecb6a0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:46.543117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b8bcec94-b828-4461-8563-c86aa3ecb6a0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:46.562024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8bcec94-b828-4461-8563-c86aa3ecb6a0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:46.562980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8bcec94-b828-4461-8563-c86aa3ecb6a0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:46.564190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8bcec94-b828-4461-8563-c86aa3ecb6a0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:46.564894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8bcec94-b828-4461-8563-c86aa3ecb6a0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:46.627506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:55:46.631496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:55:46.632416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:55:46.633229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:55:46.633895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:55:46.731488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:46.747122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:46.751352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:46.752998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:46.753171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:46.816719 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e9fdbb45-afd9-4459-a74e-6d84e9ed8748 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "POST /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6/action" status: 202 len: 1064 microversion: 2.1 time: 0.729436 Aug 03 01:55:46.829203 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1067/2117] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:55:46 2022] POST /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6/action => generated 1064 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 03 01:55:46.829203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e89d8b7c-5ac7-4021-8c3c-ee3380e434b4 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:46.830333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e89d8b7c-5ac7-4021-8c3c-ee3380e434b4 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:46.846742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e89d8b7c-5ac7-4021-8c3c-ee3380e434b4 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:46.851703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e89d8b7c-5ac7-4021-8c3c-ee3380e434b4 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:46.852227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e89d8b7c-5ac7-4021-8c3c-ee3380e434b4 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:46.852698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e89d8b7c-5ac7-4021-8c3c-ee3380e434b4 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:46.876443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b8bcec94-b828-4461-8563-c86aa3ecb6a0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:46.889926 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b8bcec94-b828-4461-8563-c86aa3ecb6a0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.351008 Aug 03 01:55:46.891287 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1051/2118] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:46 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:46.907943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a267760c-773e-4454-a4f5-6215cf157bc5 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:46.909234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a267760c-773e-4454-a4f5-6215cf157bc5 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:46.937654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a267760c-773e-4454-a4f5-6215cf157bc5 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:46.939937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a267760c-773e-4454-a4f5-6215cf157bc5 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:46.943605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a267760c-773e-4454-a4f5-6215cf157bc5 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:46.943767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a267760c-773e-4454-a4f5-6215cf157bc5 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:47.057717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e89d8b7c-5ac7-4021-8c3c-ee3380e434b4 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:47.068831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e89d8b7c-5ac7-4021-8c3c-ee3380e434b4 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:47.070954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e89d8b7c-5ac7-4021-8c3c-ee3380e434b4 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:47.072910 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e89d8b7c-5ac7-4021-8c3c-ee3380e434b4 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.254205 Aug 03 01:55:47.073718 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1068/2119] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:46 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:47.080474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-eb56dab5-259f-4954-8186-4bc0cb6b748a req-61a2bf0e-8066-46b8-a8f4-9116734797da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a9c0c8-5bf1-435f-8c6b-74a0b447f966", "name": "network-vif-plugged", "status": "completed", "tag": "626f469b-7020-4d02-a4c0-f2e58ccd1315"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:47.095459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a267760c-773e-4454-a4f5-6215cf157bc5 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:47.097971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-eb56dab5-259f-4954-8186-4bc0cb6b748a req-61a2bf0e-8066-46b8-a8f4-9116734797da service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:47.099382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-eb56dab5-259f-4954-8186-4bc0cb6b748a req-61a2bf0e-8066-46b8-a8f4-9116734797da service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:47.109937 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a267760c-773e-4454-a4f5-6215cf157bc5 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1252 microversion: 2.1 time: 0.215008 Aug 03 01:55:47.113956 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1052/2120] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:46 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1252 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:47.120209 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-eb56dab5-259f-4954-8186-4bc0cb6b748a req-61a2bf0e-8066-46b8-a8f4-9116734797da service nova] Creating event network-vif-plugged:626f469b-7020-4d02-a4c0-f2e58ccd1315 for instance e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 on n-h1-826529-8 Aug 03 01:55:47.129152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1bd2e061-10d0-4346-95cc-e8a92e7dfe70 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:47.130621 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-eb56dab5-259f-4954-8186-4bc0cb6b748a req-61a2bf0e-8066-46b8-a8f4-9116734797da service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052539 Aug 03 01:55:47.132459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1bd2e061-10d0-4346-95cc-e8a92e7dfe70 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:47.138251 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1069/2121] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:47.146085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-245af73e-d3a1-45a9-a71e-320aad47edff tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:47.147367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-245af73e-d3a1-45a9-a71e-320aad47edff tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:47.149646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1bd2e061-10d0-4346-95cc-e8a92e7dfe70 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:47.150274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1bd2e061-10d0-4346-95cc-e8a92e7dfe70 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:47.151193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1bd2e061-10d0-4346-95cc-e8a92e7dfe70 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:47.151648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1bd2e061-10d0-4346-95cc-e8a92e7dfe70 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:47.157121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-245af73e-d3a1-45a9-a71e-320aad47edff tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:47.157941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-245af73e-d3a1-45a9-a71e-320aad47edff tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:47.160089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-245af73e-d3a1-45a9-a71e-320aad47edff tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:47.161086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-245af73e-d3a1-45a9-a71e-320aad47edff tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:47.495723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1bd2e061-10d0-4346-95cc-e8a92e7dfe70 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:47.504617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-245af73e-d3a1-45a9-a71e-320aad47edff tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:47.512332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1bd2e061-10d0-4346-95cc-e8a92e7dfe70 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:47.512837 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-245af73e-d3a1-45a9-a71e-320aad47edff tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.372733 Aug 03 01:55:47.513670 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1070/2122] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:47 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:47.515758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1bd2e061-10d0-4346-95cc-e8a92e7dfe70 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:47.517283 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1bd2e061-10d0-4346-95cc-e8a92e7dfe70 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1280 microversion: 2.25 time: 0.401557 Aug 03 01:55:47.517986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7130b086-cb04-459f-a887-b633a5fe21d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:47.518601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7130b086-cb04-459f-a887-b633a5fe21d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:47.534305 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1053/2123] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:47 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1280 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:47.543805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7130b086-cb04-459f-a887-b633a5fe21d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:47.544196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7130b086-cb04-459f-a887-b633a5fe21d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:47.545018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7130b086-cb04-459f-a887-b633a5fe21d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:47.545434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7130b086-cb04-459f-a887-b633a5fe21d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:47.562839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-78b45933-3f75-488f-840c-02fc40b37d28 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:47.565341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-78b45933-3f75-488f-840c-02fc40b37d28 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:47.574735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78b45933-3f75-488f-840c-02fc40b37d28 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:47.575237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78b45933-3f75-488f-840c-02fc40b37d28 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:47.576046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78b45933-3f75-488f-840c-02fc40b37d28 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:47.576652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78b45933-3f75-488f-840c-02fc40b37d28 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:48.226229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7130b086-cb04-459f-a887-b633a5fe21d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:48.237386 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7130b086-cb04-459f-a887-b633a5fe21d6 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.722808 Aug 03 01:55:48.238665 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1071/2124] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:47 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:48.245102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03f3e66d-5892-4dc9-a7da-40b94438a574 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:48.249653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-78b45933-3f75-488f-840c-02fc40b37d28 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:48.263084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-03f3e66d-5892-4dc9-a7da-40b94438a574 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:48.270853 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-78b45933-3f75-488f-840c-02fc40b37d28 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.710439 Aug 03 01:55:48.279404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03f3e66d-5892-4dc9-a7da-40b94438a574 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:48.279864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03f3e66d-5892-4dc9-a7da-40b94438a574 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:48.280737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03f3e66d-5892-4dc9-a7da-40b94438a574 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:48.281181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03f3e66d-5892-4dc9-a7da-40b94438a574 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:48.288149 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1054/2125] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:47 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:48.297558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d9f026b9-76a4-45cf-8f7b-17e0f2b164ff tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:48.298192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d9f026b9-76a4-45cf-8f7b-17e0f2b164ff tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:48.305961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9f026b9-76a4-45cf-8f7b-17e0f2b164ff tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:48.306456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9f026b9-76a4-45cf-8f7b-17e0f2b164ff tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:48.307576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9f026b9-76a4-45cf-8f7b-17e0f2b164ff tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:48.308028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9f026b9-76a4-45cf-8f7b-17e0f2b164ff tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:48.396004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d9f026b9-76a4-45cf-8f7b-17e0f2b164ff tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:48.405650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d9f026b9-76a4-45cf-8f7b-17e0f2b164ff tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:48.407324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d9f026b9-76a4-45cf-8f7b-17e0f2b164ff tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:48.408633 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d9f026b9-76a4-45cf-8f7b-17e0f2b164ff tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.116031 Aug 03 01:55:48.409205 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1055/2126] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:48 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:48.415087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-697d9f6c-1705-4ca5-aadf-2018d1fc4b32 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:48.415965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-697d9f6c-1705-4ca5-aadf-2018d1fc4b32 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:48.423288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-697d9f6c-1705-4ca5-aadf-2018d1fc4b32 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:48.425393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-697d9f6c-1705-4ca5-aadf-2018d1fc4b32 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:48.425393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-697d9f6c-1705-4ca5-aadf-2018d1fc4b32 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:48.425393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-697d9f6c-1705-4ca5-aadf-2018d1fc4b32 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:48.495985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03f3e66d-5892-4dc9-a7da-40b94438a574 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:48.504500 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03f3e66d-5892-4dc9-a7da-40b94438a574 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.263906 Aug 03 01:55:48.505331 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1072/2127] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:48 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:48.514439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-697d9f6c-1705-4ca5-aadf-2018d1fc4b32 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:48.523649 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-697d9f6c-1705-4ca5-aadf-2018d1fc4b32 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1252 microversion: 2.1 time: 0.112396 Aug 03 01:55:48.524301 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1056/2128] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:48 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1252 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:48.536367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-77aa32c6-1dc4-4ca5-960a-c7cb19ac09a0 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:48.537102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-77aa32c6-1dc4-4ca5-960a-c7cb19ac09a0 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:48.545232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-33a405de-93a4-459b-9deb-31546497ef92 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:48.546383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-33a405de-93a4-459b-9deb-31546497ef92 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:48.547170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77aa32c6-1dc4-4ca5-960a-c7cb19ac09a0 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:48.548062 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77aa32c6-1dc4-4ca5-960a-c7cb19ac09a0 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:48.549175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77aa32c6-1dc4-4ca5-960a-c7cb19ac09a0 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:48.549787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77aa32c6-1dc4-4ca5-960a-c7cb19ac09a0 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:48.556035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33a405de-93a4-459b-9deb-31546497ef92 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:48.556634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33a405de-93a4-459b-9deb-31546497ef92 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:48.557547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33a405de-93a4-459b-9deb-31546497ef92 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:48.558205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33a405de-93a4-459b-9deb-31546497ef92 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:48.767571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-77aa32c6-1dc4-4ca5-960a-c7cb19ac09a0 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:48.771372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-33a405de-93a4-459b-9deb-31546497ef92 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:48.775842 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-77aa32c6-1dc4-4ca5-960a-c7cb19ac09a0 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.244262 Aug 03 01:55:48.776640 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1073/2129] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:48 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:48.780541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-33a405de-93a4-459b-9deb-31546497ef92 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:48.782176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-33a405de-93a4-459b-9deb-31546497ef92 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:48.783582 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-33a405de-93a4-459b-9deb-31546497ef92 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1280 microversion: 2.25 time: 0.242087 Aug 03 01:55:48.786635 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1057/2130] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:48 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:48.804449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0e7b07db-e590-4aef-8088-f8ffb257f7be tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "163a1498-fa8e-4aed-beef-bfb6d313c4d7"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:48.807178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0e7b07db-e590-4aef-8088-f8ffb257f7be tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:48.814119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e7b07db-e590-4aef-8088-f8ffb257f7be tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:48.814572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e7b07db-e590-4aef-8088-f8ffb257f7be tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:48.815605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e7b07db-e590-4aef-8088-f8ffb257f7be tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:48.816188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e7b07db-e590-4aef-8088-f8ffb257f7be tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:49.098341 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0e7b07db-e590-4aef-8088-f8ffb257f7be tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297866 Aug 03 01:55:49.099617 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1074/2131] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 01:55:48 2022] POST /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:49.262889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bfc7bb3c-637e-4144-9e96-3e4d6d2b55a4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:49.264906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bfc7bb3c-637e-4144-9e96-3e4d6d2b55a4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:49.273033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfc7bb3c-637e-4144-9e96-3e4d6d2b55a4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:49.273809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfc7bb3c-637e-4144-9e96-3e4d6d2b55a4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:49.274822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfc7bb3c-637e-4144-9e96-3e4d6d2b55a4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:49.275533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfc7bb3c-637e-4144-9e96-3e4d6d2b55a4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:49.297644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1c6f42fd-f2a3-4466-8f01-4a1250ad8696 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:49.299386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1c6f42fd-f2a3-4466-8f01-4a1250ad8696 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:49.325786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c6f42fd-f2a3-4466-8f01-4a1250ad8696 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:49.326697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c6f42fd-f2a3-4466-8f01-4a1250ad8696 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:49.327567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c6f42fd-f2a3-4466-8f01-4a1250ad8696 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:49.328082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c6f42fd-f2a3-4466-8f01-4a1250ad8696 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:49.516901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bfc7bb3c-637e-4144-9e96-3e4d6d2b55a4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:49.531353 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bfc7bb3c-637e-4144-9e96-3e4d6d2b55a4 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.271892 Aug 03 01:55:49.533713 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1058/2132] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:49 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:49.545238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-42a868a8-6c32-4cb8-8dc6-5d83dc94e481 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:49.546277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-42a868a8-6c32-4cb8-8dc6-5d83dc94e481 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:49.561181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42a868a8-6c32-4cb8-8dc6-5d83dc94e481 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:49.561718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42a868a8-6c32-4cb8-8dc6-5d83dc94e481 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:49.563265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42a868a8-6c32-4cb8-8dc6-5d83dc94e481 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:49.563790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42a868a8-6c32-4cb8-8dc6-5d83dc94e481 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:49.622359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1c6f42fd-f2a3-4466-8f01-4a1250ad8696 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:49.630266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:49.638694 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1c6f42fd-f2a3-4466-8f01-4a1250ad8696 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.346965 Aug 03 01:55:49.652395 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1075/2133] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:49 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:49.664878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-52686b8b-613b-48e4-807d-11aa5a02718a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:49.665998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-52686b8b-613b-48e4-807d-11aa5a02718a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:49.674742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52686b8b-613b-48e4-807d-11aa5a02718a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:49.675654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52686b8b-613b-48e4-807d-11aa5a02718a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:49.676810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52686b8b-613b-48e4-807d-11aa5a02718a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:49.677485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52686b8b-613b-48e4-807d-11aa5a02718a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:49.711683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-42a868a8-6c32-4cb8-8dc6-5d83dc94e481 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:49.724160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-42a868a8-6c32-4cb8-8dc6-5d83dc94e481 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:49.730104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-42a868a8-6c32-4cb8-8dc6-5d83dc94e481 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:49.731396 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-42a868a8-6c32-4cb8-8dc6-5d83dc94e481 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.196375 Aug 03 01:55:49.732016 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1059/2134] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:49 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:49.762207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7696dd00-26ba-4d1d-9201-fe3a9fde2169 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:49.764882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7696dd00-26ba-4d1d-9201-fe3a9fde2169 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:49.783085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7696dd00-26ba-4d1d-9201-fe3a9fde2169 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:49.783648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7696dd00-26ba-4d1d-9201-fe3a9fde2169 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:49.784506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7696dd00-26ba-4d1d-9201-fe3a9fde2169 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:49.785748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7696dd00-26ba-4d1d-9201-fe3a9fde2169 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:49.845906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-52686b8b-613b-48e4-807d-11aa5a02718a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:49.854400 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-52686b8b-613b-48e4-807d-11aa5a02718a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.200238 Aug 03 01:55:49.854998 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1076/2135] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:49 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:49.868021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-24996148-c2eb-4fe1-9760-afa516ee812f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:49.868653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-24996148-c2eb-4fe1-9760-afa516ee812f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:49.875112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24996148-c2eb-4fe1-9760-afa516ee812f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:49.875578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24996148-c2eb-4fe1-9760-afa516ee812f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:49.876374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24996148-c2eb-4fe1-9760-afa516ee812f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:49.876820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24996148-c2eb-4fe1-9760-afa516ee812f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:49.902988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:49.911420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7696dd00-26ba-4d1d-9201-fe3a9fde2169 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:49.921903 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7696dd00-26ba-4d1d-9201-fe3a9fde2169 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1252 microversion: 2.1 time: 0.163938 Aug 03 01:55:49.926426 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1060/2136] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:49 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1252 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:49.931291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2a28b414-4a83-4460-9b88-6fe1bdad3149 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:49.931921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2a28b414-4a83-4460-9b88-6fe1bdad3149 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:49.949690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a28b414-4a83-4460-9b88-6fe1bdad3149 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:49.950149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a28b414-4a83-4460-9b88-6fe1bdad3149 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:49.950987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a28b414-4a83-4460-9b88-6fe1bdad3149 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:49.951942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a28b414-4a83-4460-9b88-6fe1bdad3149 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:50.132787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-24996148-c2eb-4fe1-9760-afa516ee812f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:50.150311 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-24996148-c2eb-4fe1-9760-afa516ee812f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.294239 Aug 03 01:55:50.150962 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1077/2137] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:49 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:50.178633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2a28b414-4a83-4460-9b88-6fe1bdad3149 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:50.189100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2a28b414-4a83-4460-9b88-6fe1bdad3149 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:50.191329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2a28b414-4a83-4460-9b88-6fe1bdad3149 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:50.192911 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2a28b414-4a83-4460-9b88-6fe1bdad3149 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1476 microversion: 2.25 time: 0.265292 Aug 03 01:55:50.203055 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1061/2138] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:49 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1476 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:50.344651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c18877eb-1c05-409d-9055-a64e121fc5eb tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:50.345266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c18877eb-1c05-409d-9055-a64e121fc5eb tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:50.353076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c18877eb-1c05-409d-9055-a64e121fc5eb tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:50.353511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c18877eb-1c05-409d-9055-a64e121fc5eb tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:50.354293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c18877eb-1c05-409d-9055-a64e121fc5eb tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:50.354733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c18877eb-1c05-409d-9055-a64e121fc5eb tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:50.502269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-c18877eb-1c05-409d-9055-a64e121fc5eb tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'services' on Instance uuid e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:55:50.520269 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c18877eb-1c05-409d-9055-a64e121fc5eb tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1968 microversion: 2.25 time: 0.308238 Aug 03 01:55:50.520830 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1078/2139] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:50 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1968 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:50.542845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9a8f9302-f23d-463e-96c3-70d5f9f0b9b8 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:50.544568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9a8f9302-f23d-463e-96c3-70d5f9f0b9b8 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:50.552724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:50.554209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:50.556932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a8f9302-f23d-463e-96c3-70d5f9f0b9b8 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:50.558211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a8f9302-f23d-463e-96c3-70d5f9f0b9b8 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:50.558357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c11f009a-ea34-46b5-bcec-7f7ea87e120e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:50.559095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c11f009a-ea34-46b5-bcec-7f7ea87e120e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:50.559663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a8f9302-f23d-463e-96c3-70d5f9f0b9b8 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:50.560313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a8f9302-f23d-463e-96c3-70d5f9f0b9b8 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:50.569019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c11f009a-ea34-46b5-bcec-7f7ea87e120e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:50.569650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c11f009a-ea34-46b5-bcec-7f7ea87e120e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:50.570764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c11f009a-ea34-46b5-bcec-7f7ea87e120e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:50.571917 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c11f009a-ea34-46b5-bcec-7f7ea87e120e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:50.801518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c11f009a-ea34-46b5-bcec-7f7ea87e120e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:50.821757 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c11f009a-ea34-46b5-bcec-7f7ea87e120e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1392 microversion: 2.1 time: 0.269541 Aug 03 01:55:50.822626 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1079/2140] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:50 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1392 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:50.836301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e7a37d7d-e720-4486-b337-da33e3d54925 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:50.839146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e7a37d7d-e720-4486-b337-da33e3d54925 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:50.839864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-9a8f9302-f23d-463e-96c3-70d5f9f0b9b8 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'services' on Instance uuid e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:55:50.845828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7a37d7d-e720-4486-b337-da33e3d54925 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:50.846574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7a37d7d-e720-4486-b337-da33e3d54925 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:50.847947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7a37d7d-e720-4486-b337-da33e3d54925 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:50.848236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7a37d7d-e720-4486-b337-da33e3d54925 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:50.885511 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9a8f9302-f23d-463e-96c3-70d5f9f0b9b8 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1968 microversion: 2.25 time: 0.346354 Aug 03 01:55:50.887050 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1062/2141] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:50 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1968 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:50.892347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ac59ab81-6206-4fb3-978c-e5bb1e4441e2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:50.894133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ac59ab81-6206-4fb3-978c-e5bb1e4441e2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:50.901429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac59ab81-6206-4fb3-978c-e5bb1e4441e2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:50.902248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac59ab81-6206-4fb3-978c-e5bb1e4441e2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:50.903620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac59ab81-6206-4fb3-978c-e5bb1e4441e2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:50.904296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac59ab81-6206-4fb3-978c-e5bb1e4441e2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:51.018286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ac59ab81-6206-4fb3-978c-e5bb1e4441e2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:51.033864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ac59ab81-6206-4fb3-978c-e5bb1e4441e2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:51.037185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ac59ab81-6206-4fb3-978c-e5bb1e4441e2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:51.038411 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ac59ab81-6206-4fb3-978c-e5bb1e4441e2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.150114 Aug 03 01:55:51.039324 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1063/2142] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:50 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:51.045196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-346cb7b4-be19-42bb-895e-331c99980f37 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:51.045874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-346cb7b4-be19-42bb-895e-331c99980f37 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:51.054777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-346cb7b4-be19-42bb-895e-331c99980f37 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:51.055267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-346cb7b4-be19-42bb-895e-331c99980f37 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:51.056064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-346cb7b4-be19-42bb-895e-331c99980f37 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:51.056503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-346cb7b4-be19-42bb-895e-331c99980f37 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:51.140506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e7a37d7d-e720-4486-b337-da33e3d54925 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:51.151589 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e7a37d7d-e720-4486-b337-da33e3d54925 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.326892 Aug 03 01:55:51.152949 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1080/2143] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:50 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:51.158546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1887e855-61a3-4941-9302-03226fa7177c tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:51.161541 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:55:51.161541 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:55:51.163262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1887e855-61a3-4941-9302-03226fa7177c tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:51.164333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1887e855-61a3-4941-9302-03226fa7177c tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:51.164714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1887e855-61a3-4941-9302-03226fa7177c tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:51.171353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1887e855-61a3-4941-9302-03226fa7177c tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:51.205673 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1887e855-61a3-4941-9302-03226fa7177c tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.051574 Aug 03 01:55:51.206947 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1081/2144] 10.222.0.67 () {60 vars in 1217 bytes} [Wed Aug 3 01:55:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:55:51.211565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0df58e56-7ff3-4173-9a16-d7fd67847c46 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:51.212272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0df58e56-7ff3-4173-9a16-d7fd67847c46 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:51.218632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0df58e56-7ff3-4173-9a16-d7fd67847c46 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:51.219228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0df58e56-7ff3-4173-9a16-d7fd67847c46 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:51.220153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0df58e56-7ff3-4173-9a16-d7fd67847c46 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:51.220610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0df58e56-7ff3-4173-9a16-d7fd67847c46 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:51.250219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-346cb7b4-be19-42bb-895e-331c99980f37 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:51.260063 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-346cb7b4-be19-42bb-895e-331c99980f37 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.219526 Aug 03 01:55:51.261200 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1064/2145] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:51 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:51.266853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6b339edc-4fc0-4569-aea3-9d6057547192 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:51.267500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6b339edc-4fc0-4569-aea3-9d6057547192 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:51.276850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b339edc-4fc0-4569-aea3-9d6057547192 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:51.277316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b339edc-4fc0-4569-aea3-9d6057547192 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:51.278122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b339edc-4fc0-4569-aea3-9d6057547192 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:51.278639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b339edc-4fc0-4569-aea3-9d6057547192 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:51.294026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0df58e56-7ff3-4173-9a16-d7fd67847c46 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf02f5fbbc4c4b9f8cefeb12bb44f91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fdaa2efc844407aea6dbd1493ad387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:51.304851 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0df58e56-7ff3-4173-9a16-d7fd67847c46 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 200 len: 1252 microversion: 2.1 time: 0.096714 Aug 03 01:55:51.305897 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1082/2146] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:51 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 1252 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:51.308708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:51.312396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bac68fe9-c581-49df-a019-7fe7dd3821ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826529-8", "block_migration": "auto"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:51.315573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bac68fe9-c581-49df-a019-7fe7dd3821ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:51.325350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bac68fe9-c581-49df-a019-7fe7dd3821ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:51.325906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bac68fe9-c581-49df-a019-7fe7dd3821ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:51.326773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bac68fe9-c581-49df-a019-7fe7dd3821ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:51.327304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bac68fe9-c581-49df-a019-7fe7dd3821ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:51.376152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-bac68fe9-c581-49df-a019-7fe7dd3821ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'flavor' on Instance uuid e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:55:51.389791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bac68fe9-c581-49df-a019-7fe7dd3821ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Going to try to live migrate instance to n-h2-826529-8 {{(pid=125941) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 01:55:51.459835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6b339edc-4fc0-4569-aea3-9d6057547192 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:51.469264 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6b339edc-4fc0-4569-aea3-9d6057547192 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.206831 Aug 03 01:55:51.470317 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1065/2147] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:51 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:51.843370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-76165dfa-e6ea-4b78-b267-91c180ca028e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:51.844005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-76165dfa-e6ea-4b78-b267-91c180ca028e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:51.852094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76165dfa-e6ea-4b78-b267-91c180ca028e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:51.852779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76165dfa-e6ea-4b78-b267-91c180ca028e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:51.853776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76165dfa-e6ea-4b78-b267-91c180ca028e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:51.854428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76165dfa-e6ea-4b78-b267-91c180ca028e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:52.083912 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-76165dfa-e6ea-4b78-b267-91c180ca028e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:52.097172 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-76165dfa-e6ea-4b78-b267-91c180ca028e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1382 microversion: 2.1 time: 0.257217 Aug 03 01:55:52.097525 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1066/2148] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:51 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1382 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:52.103757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a14cadbd-99c3-4667-9af2-08ff2b11706f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:52.104381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a14cadbd-99c3-4667-9af2-08ff2b11706f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:52.111317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a14cadbd-99c3-4667-9af2-08ff2b11706f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:52.111890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a14cadbd-99c3-4667-9af2-08ff2b11706f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:52.113484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a14cadbd-99c3-4667-9af2-08ff2b11706f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:52.114011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a14cadbd-99c3-4667-9af2-08ff2b11706f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:52.195047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a14cadbd-99c3-4667-9af2-08ff2b11706f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:52.205115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a14cadbd-99c3-4667-9af2-08ff2b11706f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:52.207645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a14cadbd-99c3-4667-9af2-08ff2b11706f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:52.208988 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a14cadbd-99c3-4667-9af2-08ff2b11706f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.109866 Aug 03 01:55:52.217549 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1067/2149] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:52 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:52.217549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6c01d10e-5aef-4503-86f3-337b1b5b75a6 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '.version_select at 0x7f5b245c4820>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:52.218419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c01d10e-5aef-4503-86f3-337b1b5b75a6 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:52.219662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c01d10e-5aef-4503-86f3-337b1b5b75a6 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:52.243010 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6c01d10e-5aef-4503-86f3-337b1b5b75a6 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 3044 microversion: 2.1 time: 0.031650 Aug 03 01:55:52.255847 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1068/2150] 10.222.0.67 () {58 vars in 1143 bytes} [Wed Aug 3 01:55:52 2022] GET /compute/v2.1/os-migrations => generated 3044 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:52.255847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-51cbe559-d240-4dd2-b3e9-291f6a75350b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:52.255847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-51cbe559-d240-4dd2-b3e9-291f6a75350b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:52.267532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51cbe559-d240-4dd2-b3e9-291f6a75350b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:52.268019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51cbe559-d240-4dd2-b3e9-291f6a75350b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:52.270593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51cbe559-d240-4dd2-b3e9-291f6a75350b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:52.272771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51cbe559-d240-4dd2-b3e9-291f6a75350b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:52.432132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-51cbe559-d240-4dd2-b3e9-291f6a75350b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:52.443280 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-51cbe559-d240-4dd2-b3e9-291f6a75350b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.196896 Aug 03 01:55:52.443995 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1069/2151] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:52 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:52.449619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aea4864c-8a15-4e1f-93f9-a15f04d9ee24 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:52.450567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-aea4864c-8a15-4e1f-93f9-a15f04d9ee24 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:52.460314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aea4864c-8a15-4e1f-93f9-a15f04d9ee24 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:52.460888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aea4864c-8a15-4e1f-93f9-a15f04d9ee24 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:52.461919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aea4864c-8a15-4e1f-93f9-a15f04d9ee24 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:52.465254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aea4864c-8a15-4e1f-93f9-a15f04d9ee24 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:52.662895 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aea4864c-8a15-4e1f-93f9-a15f04d9ee24 tempest-LiveMigrationTest-1588806735 tempest-LiveMigrationTest-1588806735-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1533 microversion: 2.1 time: 0.217601 Aug 03 01:55:52.672123 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1070/2152] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:52 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1533 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:52.672123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1ad3c861-63fd-4985-8d02-20fd0bef81e4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:52.672123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1ad3c861-63fd-4985-8d02-20fd0bef81e4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:52.686316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ad3c861-63fd-4985-8d02-20fd0bef81e4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:52.686783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ad3c861-63fd-4985-8d02-20fd0bef81e4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:52.687634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ad3c861-63fd-4985-8d02-20fd0bef81e4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:52.691366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ad3c861-63fd-4985-8d02-20fd0bef81e4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:52.857912 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1ad3c861-63fd-4985-8d02-20fd0bef81e4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:52.869888 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1ad3c861-63fd-4985-8d02-20fd0bef81e4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.205023 Aug 03 01:55:52.870958 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1071/2153] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:52 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:52.876043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fbf19133-fac3-40d9-80a6-504962dd1a57 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:52.876906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fbf19133-fac3-40d9-80a6-504962dd1a57 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] [instance: d342ed3e-ca89-47e4-8421-3e0e26e2812b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:52.884932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbf19133-fac3-40d9-80a6-504962dd1a57 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:52.885629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbf19133-fac3-40d9-80a6-504962dd1a57 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:52.886755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbf19133-fac3-40d9-80a6-504962dd1a57 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:52.887453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbf19133-fac3-40d9-80a6-504962dd1a57 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:52.905858 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-fbf19133-fac3-40d9-80a6-504962dd1a57 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] HTTP exception thrown: Instance d342ed3e-ca89-47e4-8421-3e0e26e2812b could not be found. Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fbf19133-fac3-40d9-80a6-504962dd1a57 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Request method failure captured: Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b HTTP/1.1 Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dUaUvbjz8WNBiV3HaaR1GY4VFcwzXUbwTCiwxIP3pGwGOv_zrniLXI520O2fZ4EYFBWO2TWLzc2HfrpNBdpaLE067U8SYppuEoysrmS7sTl6hHLR5DnhHA1FpHdXOFtIvoWqEr7iYQnQKLTBNrPzmWBxA67eOQwojMWgUdLtcMy6hg Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 44fdaa2efc844407aea6dbd1493ad387 Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestBootFromVolume-1488646382 Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_44fdaa2efc844407aea6dbd1493ad387", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/44fdaa2efc844407aea6dbd1493ad387"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/44fdaa2efc844407aea6dbd1493ad387"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/44fdaa2efc844407aea6dbd1493ad387"}]}] Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestBootFromVolume-1488646382 Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 44fdaa2efc844407aea6dbd1493ad387 Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1488646382 Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestBootFromVolume-1488646382-project Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: bf02f5fbbc4c4b9f8cefeb12bb44f91c Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestBootFromVolume-1488646382-project Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance d342ed3e-ca89-47e4-8421-3e0e26e2812b could not be found. Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'd342ed3e-ca89-47e4-8421-3e0e26e2812b'} Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d342ed3e-ca89-47e4-8421-3e0e26e2812b could not be found. Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d342ed3e-ca89-47e4-8421-3e0e26e2812b could not be found. Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:55:52.907881 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:55:52.921936 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:55:52.921936 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:55:52.921936 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:55:52.921936 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:55:52.921936 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:55:52.921936 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d342ed3e-ca89-47e4-8421-3e0e26e2812b could not be found. Aug 03 01:55:52.921936 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:55:52.921936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fbf19133-fac3-40d9-80a6-504962dd1a57 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Returning 404 to user: Instance d342ed3e-ca89-47e4-8421-3e0e26e2812b could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:55:52.921936 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fbf19133-fac3-40d9-80a6-504962dd1a57 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b" status: 404 len: 111 microversion: 2.1 time: 0.037559 Aug 03 01:55:52.921936 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1072/2154] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:52 2022] GET /compute/v2.1/servers/d342ed3e-ca89-47e4-8421-3e0e26e2812b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:55:52.921936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f303d4bb-af8e-44f8-9d7a-9a5826c9a155 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:52.921936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f303d4bb-af8e-44f8-9d7a-9a5826c9a155 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:52.925693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f303d4bb-af8e-44f8-9d7a-9a5826c9a155 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:52.925693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f303d4bb-af8e-44f8-9d7a-9a5826c9a155 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:52.926357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f303d4bb-af8e-44f8-9d7a-9a5826c9a155 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:52.926800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f303d4bb-af8e-44f8-9d7a-9a5826c9a155 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:53.098567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f303d4bb-af8e-44f8-9d7a-9a5826c9a155 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:53.107291 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f303d4bb-af8e-44f8-9d7a-9a5826c9a155 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.195200 Aug 03 01:55:53.108564 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1073/2155] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:52 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:53.112387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4628d20e-5303-4266-aef7-3c76a855e0c7 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:53.113863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4628d20e-5303-4266-aef7-3c76a855e0c7 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:53.120355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4628d20e-5303-4266-aef7-3c76a855e0c7 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:53.120810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4628d20e-5303-4266-aef7-3c76a855e0c7 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:53.121591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4628d20e-5303-4266-aef7-3c76a855e0c7 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:53.122215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4628d20e-5303-4266-aef7-3c76a855e0c7 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:53.153342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4628d20e-5303-4266-aef7-3c76a855e0c7 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:55:53.153666 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bac68fe9-c581-49df-a019-7fe7dd3821ad tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966/action" status: 202 len: 0 microversion: 2.25 time: 1.846506 Aug 03 01:55:53.154297 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1083/2156] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 3 01:55:51 2022] POST /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966/action => generated 0 bytes in 1848 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:55:53.161597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-373c9132-c044-460c-89fe-47e1a2ac75f9 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] Calling method '.version_select at 0x7f5b127221f0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:53.191500 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-373c9132-c044-460c-89fe-47e1a2ac75f9 tempest-ServersTestBootFromVolume-1488646382 tempest-ServersTestBootFromVolume-1488646382-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011187560" status: 202 len: 0 microversion: 2.1 time: 0.035359 Aug 03 01:55:53.192518 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1084/2157] 10.222.0.67 () {58 vars in 1221 bytes} [Wed Aug 3 01:55:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011187560 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:55:53.203661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c0af5992-b1f1-4935-87a4-ada2d66659ee tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:53.205432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c0af5992-b1f1-4935-87a4-ada2d66659ee tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:53.231450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0af5992-b1f1-4935-87a4-ada2d66659ee tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:53.232246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0af5992-b1f1-4935-87a4-ada2d66659ee tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:53.237238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0af5992-b1f1-4935-87a4-ada2d66659ee tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:53.240312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0af5992-b1f1-4935-87a4-ada2d66659ee tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:53.300445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:53.306325 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4628d20e-5303-4266-aef7-3c76a855e0c7 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 204 len: 0 microversion: 2.1 time: 0.197203 Aug 03 01:55:53.307493 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1074/2158] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:55:53 2022] DELETE /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:55:53.316323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a8dd90ae-e209-4bb3-8345-225bd80d6fbf tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:53.317336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a8dd90ae-e209-4bb3-8345-225bd80d6fbf tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:53.327999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8dd90ae-e209-4bb3-8345-225bd80d6fbf tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:53.328671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8dd90ae-e209-4bb3-8345-225bd80d6fbf tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:53.329574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8dd90ae-e209-4bb3-8345-225bd80d6fbf tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:53.330097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8dd90ae-e209-4bb3-8345-225bd80d6fbf tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:53.441765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a8dd90ae-e209-4bb3-8345-225bd80d6fbf tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:53.468883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a8dd90ae-e209-4bb3-8345-225bd80d6fbf tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:53.471675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a8dd90ae-e209-4bb3-8345-225bd80d6fbf tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:53.476404 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a8dd90ae-e209-4bb3-8345-225bd80d6fbf tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.166268 Aug 03 01:55:53.478217 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1075/2159] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:53 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:53.483621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f6624956-9ac0-4e7a-87b5-5a85ea0595f2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:53.484705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f6624956-9ac0-4e7a-87b5-5a85ea0595f2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:53.497746 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6624956-9ac0-4e7a-87b5-5a85ea0595f2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:53.498349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6624956-9ac0-4e7a-87b5-5a85ea0595f2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:53.499733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6624956-9ac0-4e7a-87b5-5a85ea0595f2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:53.501895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6624956-9ac0-4e7a-87b5-5a85ea0595f2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:53.586849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c0af5992-b1f1-4935-87a4-ada2d66659ee tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:53.598024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c0af5992-b1f1-4935-87a4-ada2d66659ee tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:53.599607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c0af5992-b1f1-4935-87a4-ada2d66659ee tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:53.600807 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c0af5992-b1f1-4935-87a4-ada2d66659ee tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.403043 Aug 03 01:55:53.611239 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1085/2160] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:53 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:53.624022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1d5e25dd-5b24-4b45-ad3f-53800caab8b7 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:53.625096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1d5e25dd-5b24-4b45-ad3f-53800caab8b7 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:53.638078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d5e25dd-5b24-4b45-ad3f-53800caab8b7 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:53.638578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d5e25dd-5b24-4b45-ad3f-53800caab8b7 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:53.639658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d5e25dd-5b24-4b45-ad3f-53800caab8b7 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:53.642343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d5e25dd-5b24-4b45-ad3f-53800caab8b7 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:53.845634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f6624956-9ac0-4e7a-87b5-5a85ea0595f2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:53.854867 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f6624956-9ac0-4e7a-87b5-5a85ea0595f2 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1388 microversion: 2.1 time: 0.375545 Aug 03 01:55:53.857960 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1076/2161] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:53 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1388 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:53.894949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d24987a2-33bf-4054-8517-ff14fc7b92a9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:53.895717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d24987a2-33bf-4054-8517-ff14fc7b92a9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:53.903295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d24987a2-33bf-4054-8517-ff14fc7b92a9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:53.904034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d24987a2-33bf-4054-8517-ff14fc7b92a9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:53.905051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d24987a2-33bf-4054-8517-ff14fc7b92a9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:53.905591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d24987a2-33bf-4054-8517-ff14fc7b92a9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:53.921117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1d5e25dd-5b24-4b45-ad3f-53800caab8b7 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:53.930373 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1d5e25dd-5b24-4b45-ad3f-53800caab8b7 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.317761 Aug 03 01:55:53.933289 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1086/2162] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:53 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:54.131382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5ea4d027-fc95-47b5-b986-6d59839fb733 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:54.133039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5ea4d027-fc95-47b5-b986-6d59839fb733 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:54.156203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ea4d027-fc95-47b5-b986-6d59839fb733 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:54.157968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ea4d027-fc95-47b5-b986-6d59839fb733 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:54.159084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ea4d027-fc95-47b5-b986-6d59839fb733 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:54.160922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ea4d027-fc95-47b5-b986-6d59839fb733 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:54.208402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d24987a2-33bf-4054-8517-ff14fc7b92a9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:54.219676 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d24987a2-33bf-4054-8517-ff14fc7b92a9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.329703 Aug 03 01:55:54.220944 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1077/2163] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:53 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:54.505045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a6e2950b-a0e7-4d48-8718-91e2aee5ca4f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:54.506437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a6e2950b-a0e7-4d48-8718-91e2aee5ca4f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:54.513952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ea4d027-fc95-47b5-b986-6d59839fb733 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:54.514243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6e2950b-a0e7-4d48-8718-91e2aee5ca4f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:54.514698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6e2950b-a0e7-4d48-8718-91e2aee5ca4f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:54.515806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6e2950b-a0e7-4d48-8718-91e2aee5ca4f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:54.516505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6e2950b-a0e7-4d48-8718-91e2aee5ca4f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:54.525035 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5ea4d027-fc95-47b5-b986-6d59839fb733 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.398144 Aug 03 01:55:54.526047 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1087/2164] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:54 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:54.632738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-acc7f170-8bed-4c1f-9ae9-3804259342ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:54.633448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-acc7f170-8bed-4c1f-9ae9-3804259342ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:54.639790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-acc7f170-8bed-4c1f-9ae9-3804259342ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:54.640605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-acc7f170-8bed-4c1f-9ae9-3804259342ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:54.641649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-acc7f170-8bed-4c1f-9ae9-3804259342ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:54.642332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-acc7f170-8bed-4c1f-9ae9-3804259342ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:54.647701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a6e2950b-a0e7-4d48-8718-91e2aee5ca4f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:54.667773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a6e2950b-a0e7-4d48-8718-91e2aee5ca4f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:54.676422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a6e2950b-a0e7-4d48-8718-91e2aee5ca4f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:54.682111 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a6e2950b-a0e7-4d48-8718-91e2aee5ca4f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.179339 Aug 03 01:55:54.682998 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1078/2165] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:54 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:54.880225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eaaebe81-a3d3-47aa-930d-e0ea0913e7b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:54.881620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eaaebe81-a3d3-47aa-930d-e0ea0913e7b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:54.896656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eaaebe81-a3d3-47aa-930d-e0ea0913e7b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:54.897511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eaaebe81-a3d3-47aa-930d-e0ea0913e7b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:54.898576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eaaebe81-a3d3-47aa-930d-e0ea0913e7b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:54.899250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eaaebe81-a3d3-47aa-930d-e0ea0913e7b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:55.062964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eaaebe81-a3d3-47aa-930d-e0ea0913e7b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:55.080818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-acc7f170-8bed-4c1f-9ae9-3804259342ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:55.082988 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eaaebe81-a3d3-47aa-930d-e0ea0913e7b0 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1346 microversion: 2.1 time: 0.198023 Aug 03 01:55:55.097699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-acc7f170-8bed-4c1f-9ae9-3804259342ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:55.100463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-acc7f170-8bed-4c1f-9ae9-3804259342ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:55.102313 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-acc7f170-8bed-4c1f-9ae9-3804259342ec tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.474194 Aug 03 01:55:55.103271 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1088/2166] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:54 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:55:55.109251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a24cebf4-f3e5-484a-8e94-2d9d7931509b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:55.109648 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1079/2167] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:54 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1346 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:55.110273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a24cebf4-f3e5-484a-8e94-2d9d7931509b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:55.116999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-79db3d89-c913-41b2-9e85-40138d4bdcab req-88ad6f31-59b2-4119-a396-58df6f9c9b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b54bdd1-d224-4a35-9487-66a77cd76c71", "name": "network-vif-deleted", "tag": "54039f8b-300c-447b-a43c-cb4dd1e17902"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:55:55.121388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a24cebf4-f3e5-484a-8e94-2d9d7931509b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:55.122894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a24cebf4-f3e5-484a-8e94-2d9d7931509b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:55.124273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a24cebf4-f3e5-484a-8e94-2d9d7931509b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:55.124896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a24cebf4-f3e5-484a-8e94-2d9d7931509b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:55.167070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-79db3d89-c913-41b2-9e85-40138d4bdcab req-88ad6f31-59b2-4119-a396-58df6f9c9b8f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:55.168177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-79db3d89-c913-41b2-9e85-40138d4bdcab req-88ad6f31-59b2-4119-a396-58df6f9c9b8f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:55.187847 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-79db3d89-c913-41b2-9e85-40138d4bdcab req-88ad6f31-59b2-4119-a396-58df6f9c9b8f service nova] Creating event network-vif-deleted:54039f8b-300c-447b-a43c-cb4dd1e17902 for instance 0b54bdd1-d224-4a35-9487-66a77cd76c71 on n-h1-826529-8 Aug 03 01:55:55.197373 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-79db3d89-c913-41b2-9e85-40138d4bdcab req-88ad6f31-59b2-4119-a396-58df6f9c9b8f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085098 Aug 03 01:55:55.198234 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1080/2168] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:55:55.243015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-198e2701-0adc-40bb-aac1-ec076dae4f79 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:55.243901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-198e2701-0adc-40bb-aac1-ec076dae4f79 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:55.256202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-198e2701-0adc-40bb-aac1-ec076dae4f79 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:55.257065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-198e2701-0adc-40bb-aac1-ec076dae4f79 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:55.258329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-198e2701-0adc-40bb-aac1-ec076dae4f79 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:55.258975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-198e2701-0adc-40bb-aac1-ec076dae4f79 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:55.431220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a24cebf4-f3e5-484a-8e94-2d9d7931509b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:55.439356 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a24cebf4-f3e5-484a-8e94-2d9d7931509b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.334797 Aug 03 01:55:55.454407 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1089/2169] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:55 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:55.550620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e3f59cb6-0a1d-44ae-83ab-b9ded30dfd0e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:55.551722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e3f59cb6-0a1d-44ae-83ab-b9ded30dfd0e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:55.558876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3f59cb6-0a1d-44ae-83ab-b9ded30dfd0e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:55.559381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3f59cb6-0a1d-44ae-83ab-b9ded30dfd0e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:55.560185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3f59cb6-0a1d-44ae-83ab-b9ded30dfd0e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:55.560636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3f59cb6-0a1d-44ae-83ab-b9ded30dfd0e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:55.589854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-198e2701-0adc-40bb-aac1-ec076dae4f79 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:55.600254 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-198e2701-0adc-40bb-aac1-ec076dae4f79 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.362815 Aug 03 01:55:55.614798 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1081/2170] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:55 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:55.708337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5ea285e3-4503-4b3b-a0be-c05ede4316ae tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:55.708987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5ea285e3-4503-4b3b-a0be-c05ede4316ae tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:55.716016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ea285e3-4503-4b3b-a0be-c05ede4316ae tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:55.716639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ea285e3-4503-4b3b-a0be-c05ede4316ae tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:55.717456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ea285e3-4503-4b3b-a0be-c05ede4316ae tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:55.717909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ea285e3-4503-4b3b-a0be-c05ede4316ae tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:55.750037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:55.871254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3f59cb6-0a1d-44ae-83ab-b9ded30dfd0e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:55.876653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5ea285e3-4503-4b3b-a0be-c05ede4316ae tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:55.891896 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e3f59cb6-0a1d-44ae-83ab-b9ded30dfd0e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.346939 Aug 03 01:55:55.893468 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1090/2171] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:55 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:55:55.893663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5ea285e3-4503-4b3b-a0be-c05ede4316ae tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:55.897347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5ea285e3-4503-4b3b-a0be-c05ede4316ae tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:55.899255 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5ea285e3-4503-4b3b-a0be-c05ede4316ae tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.197588 Aug 03 01:55:55.911352 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1082/2172] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:55 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:55:56.107681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dedd4b14-eb1e-4072-9050-c75b3e5275ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:56.108437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dedd4b14-eb1e-4072-9050-c75b3e5275ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:56.118676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dedd4b14-eb1e-4072-9050-c75b3e5275ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:56.119454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dedd4b14-eb1e-4072-9050-c75b3e5275ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:56.120336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dedd4b14-eb1e-4072-9050-c75b3e5275ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:56.120980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dedd4b14-eb1e-4072-9050-c75b3e5275ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:56.131405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3644ae00-7160-47e4-81d9-d055bc7e11be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:56.132445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3644ae00-7160-47e4-81d9-d055bc7e11be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:56.152693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3644ae00-7160-47e4-81d9-d055bc7e11be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:56.155501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3644ae00-7160-47e4-81d9-d055bc7e11be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:56.156539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3644ae00-7160-47e4-81d9-d055bc7e11be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:56.157165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3644ae00-7160-47e4-81d9-d055bc7e11be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:56.323283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dedd4b14-eb1e-4072-9050-c75b3e5275ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:56.332425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:55:56.335548 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dedd4b14-eb1e-4072-9050-c75b3e5275ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1184 microversion: 2.1 time: 0.231963 Aug 03 01:55:56.336676 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1091/2173] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:56 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1184 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:56.463496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2ad52b47-88af-4456-bdeb-fad5eaaec0a3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:56.465229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2ad52b47-88af-4456-bdeb-fad5eaaec0a3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:56.479762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ad52b47-88af-4456-bdeb-fad5eaaec0a3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:56.482560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ad52b47-88af-4456-bdeb-fad5eaaec0a3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:56.482560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ad52b47-88af-4456-bdeb-fad5eaaec0a3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:56.484775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ad52b47-88af-4456-bdeb-fad5eaaec0a3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:56.487644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3644ae00-7160-47e4-81d9-d055bc7e11be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:56.501436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3644ae00-7160-47e4-81d9-d055bc7e11be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:56.504211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3644ae00-7160-47e4-81d9-d055bc7e11be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:56.505919 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3644ae00-7160-47e4-81d9-d055bc7e11be tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.380256 Aug 03 01:55:56.507524 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1083/2174] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:56 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:55:56.622897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-046667f3-c670-4003-af98-58d31e650d3b tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:56.624550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-046667f3-c670-4003-af98-58d31e650d3b tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:56.634008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-046667f3-c670-4003-af98-58d31e650d3b tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:56.636106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-046667f3-c670-4003-af98-58d31e650d3b tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:56.637248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-046667f3-c670-4003-af98-58d31e650d3b tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:56.638012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-046667f3-c670-4003-af98-58d31e650d3b tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:57.117631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-046667f3-c670-4003-af98-58d31e650d3b tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:57.118285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2ad52b47-88af-4456-bdeb-fad5eaaec0a3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:57.131841 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2ad52b47-88af-4456-bdeb-fad5eaaec0a3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.673610 Aug 03 01:55:57.135632 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-046667f3-c670-4003-af98-58d31e650d3b tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.517484 Aug 03 01:55:57.136753 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1084/2175] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:56 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:57.141563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-67829172-342b-4fd1-b371-d346d044a316 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:57.142370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-67829172-342b-4fd1-b371-d346d044a316 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:57.163873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67829172-342b-4fd1-b371-d346d044a316 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:57.164614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67829172-342b-4fd1-b371-d346d044a316 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:57.165649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67829172-342b-4fd1-b371-d346d044a316 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:57.166292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67829172-342b-4fd1-b371-d346d044a316 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:57.167839 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1092/2176] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:56 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:57.173591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d37434a9-a1c1-46a9-ae2b-f971553f77cc tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:57.174721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d37434a9-a1c1-46a9-ae2b-f971553f77cc tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:57.184576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d37434a9-a1c1-46a9-ae2b-f971553f77cc tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:57.185304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d37434a9-a1c1-46a9-ae2b-f971553f77cc tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:57.186439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d37434a9-a1c1-46a9-ae2b-f971553f77cc tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:57.187105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d37434a9-a1c1-46a9-ae2b-f971553f77cc tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:57.333887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d37434a9-a1c1-46a9-ae2b-f971553f77cc tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:57.344180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d37434a9-a1c1-46a9-ae2b-f971553f77cc tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:57.346211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d37434a9-a1c1-46a9-ae2b-f971553f77cc tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:57.348647 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d37434a9-a1c1-46a9-ae2b-f971553f77cc tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.179484 Aug 03 01:55:57.349608 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1093/2177] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:57 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:57.370003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4d708522-0571-4b3b-9aac-4733414cbd7b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:57.371004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4d708522-0571-4b3b-9aac-4733414cbd7b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:57.382665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d708522-0571-4b3b-9aac-4733414cbd7b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:57.383157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d708522-0571-4b3b-9aac-4733414cbd7b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:57.383973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d708522-0571-4b3b-9aac-4733414cbd7b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:57.386028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d708522-0571-4b3b-9aac-4733414cbd7b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:57.435553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-67829172-342b-4fd1-b371-d346d044a316 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:57.450977 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-67829172-342b-4fd1-b371-d346d044a316 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.312037 Aug 03 01:55:57.466007 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1085/2178] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:57 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:57.536356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2a4c6977-44ab-47f2-983c-38273cea46f7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:57.537272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2a4c6977-44ab-47f2-983c-38273cea46f7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:57.548813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4d708522-0571-4b3b-9aac-4733414cbd7b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:57.563204 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4d708522-0571-4b3b-9aac-4733414cbd7b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1184 microversion: 2.1 time: 0.197699 Aug 03 01:55:57.581746 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1094/2179] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:57 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1184 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:57.583425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a4c6977-44ab-47f2-983c-38273cea46f7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:57.584193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a4c6977-44ab-47f2-983c-38273cea46f7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:57.585219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a4c6977-44ab-47f2-983c-38273cea46f7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:57.586452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a4c6977-44ab-47f2-983c-38273cea46f7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:57.818836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2a4c6977-44ab-47f2-983c-38273cea46f7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:57.828257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2a4c6977-44ab-47f2-983c-38273cea46f7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:57.835752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2a4c6977-44ab-47f2-983c-38273cea46f7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:57.838067 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2a4c6977-44ab-47f2-983c-38273cea46f7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.307940 Aug 03 01:55:57.839338 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1086/2180] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:57 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:58.180832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-02cd5dcf-a5ce-4632-8c1b-22158f5bb1e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:58.181521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-02cd5dcf-a5ce-4632-8c1b-22158f5bb1e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:58.182535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b002f706-cde3-470e-817a-ac1cc436147d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:58.183450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b002f706-cde3-470e-817a-ac1cc436147d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:58.199253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02cd5dcf-a5ce-4632-8c1b-22158f5bb1e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:58.200723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b002f706-cde3-470e-817a-ac1cc436147d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:58.201129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b002f706-cde3-470e-817a-ac1cc436147d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:58.201932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b002f706-cde3-470e-817a-ac1cc436147d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:58.202412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02cd5dcf-a5ce-4632-8c1b-22158f5bb1e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:58.203252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02cd5dcf-a5ce-4632-8c1b-22158f5bb1e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:58.207189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b002f706-cde3-470e-817a-ac1cc436147d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:58.207987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02cd5dcf-a5ce-4632-8c1b-22158f5bb1e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:58.516579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-02cd5dcf-a5ce-4632-8c1b-22158f5bb1e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:58.524974 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-02cd5dcf-a5ce-4632-8c1b-22158f5bb1e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.348101 Aug 03 01:55:58.528852 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1087/2181] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:58 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:58.535696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b002f706-cde3-470e-817a-ac1cc436147d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:58.548770 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b002f706-cde3-470e-817a-ac1cc436147d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.377481 Aug 03 01:55:58.550078 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1095/2182] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:58 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:58.552191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ebef3534-0509-474a-a073-05e7d1dc1d82 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:58.553007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ebef3534-0509-474a-a073-05e7d1dc1d82 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:58.559551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8ab7ce1a-66a6-42a1-aa2f-2c9698cd6faf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:58.560180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8ab7ce1a-66a6-42a1-aa2f-2c9698cd6faf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:58.567309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebef3534-0509-474a-a073-05e7d1dc1d82 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:58.574147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ab7ce1a-66a6-42a1-aa2f-2c9698cd6faf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:58.575132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ab7ce1a-66a6-42a1-aa2f-2c9698cd6faf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:58.576141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ab7ce1a-66a6-42a1-aa2f-2c9698cd6faf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:58.576763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ab7ce1a-66a6-42a1-aa2f-2c9698cd6faf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:58.577835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebef3534-0509-474a-a073-05e7d1dc1d82 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:58.578713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebef3534-0509-474a-a073-05e7d1dc1d82 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:58.579270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebef3534-0509-474a-a073-05e7d1dc1d82 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:58.805558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ebef3534-0509-474a-a073-05e7d1dc1d82 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:58.818329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ebef3534-0509-474a-a073-05e7d1dc1d82 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:58.823758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ebef3534-0509-474a-a073-05e7d1dc1d82 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:58.827638 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ebef3534-0509-474a-a073-05e7d1dc1d82 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.297486 Aug 03 01:55:58.843608 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1088/2183] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:58 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:58.858176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-175b06dc-e8c0-43a0-906f-77cac6a892d3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:58.858825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-175b06dc-e8c0-43a0-906f-77cac6a892d3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:58.872521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-175b06dc-e8c0-43a0-906f-77cac6a892d3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:58.872697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-175b06dc-e8c0-43a0-906f-77cac6a892d3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:58.873366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-175b06dc-e8c0-43a0-906f-77cac6a892d3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:58.873816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-175b06dc-e8c0-43a0-906f-77cac6a892d3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:58.904003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8ab7ce1a-66a6-42a1-aa2f-2c9698cd6faf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:58.920776 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8ab7ce1a-66a6-42a1-aa2f-2c9698cd6faf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.366892 Aug 03 01:55:58.921749 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1096/2184] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:58 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:58.932153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bc9f2110-1330-406a-be54-4c6e79f11585 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:58.934826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bc9f2110-1330-406a-be54-4c6e79f11585 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:58.955870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-175b06dc-e8c0-43a0-906f-77cac6a892d3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:58.960831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc9f2110-1330-406a-be54-4c6e79f11585 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:58.965937 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-175b06dc-e8c0-43a0-906f-77cac6a892d3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1184 microversion: 2.1 time: 0.121124 Aug 03 01:55:58.966672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc9f2110-1330-406a-be54-4c6e79f11585 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:58.967763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc9f2110-1330-406a-be54-4c6e79f11585 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:58.968386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc9f2110-1330-406a-be54-4c6e79f11585 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:58.984336 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1089/2185] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:58 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1184 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:59.176984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bc9f2110-1330-406a-be54-4c6e79f11585 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:59.187384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bc9f2110-1330-406a-be54-4c6e79f11585 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:59.189034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bc9f2110-1330-406a-be54-4c6e79f11585 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:59.190204 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bc9f2110-1330-406a-be54-4c6e79f11585 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.267373 Aug 03 01:55:59.192014 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1097/2186] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:58 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:55:59.555105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-562b3e33-5100-4170-82fd-e94d24253957 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:59.556392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-562b3e33-5100-4170-82fd-e94d24253957 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:59.565110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-562b3e33-5100-4170-82fd-e94d24253957 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:59.566364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-562b3e33-5100-4170-82fd-e94d24253957 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:59.568332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-562b3e33-5100-4170-82fd-e94d24253957 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:59.572443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-562b3e33-5100-4170-82fd-e94d24253957 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:59.582676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-85e82323-a8ed-4be0-8dbb-92e0fb505fd6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:59.584261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-85e82323-a8ed-4be0-8dbb-92e0fb505fd6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:59.594405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85e82323-a8ed-4be0-8dbb-92e0fb505fd6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:59.595800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85e82323-a8ed-4be0-8dbb-92e0fb505fd6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:59.603142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85e82323-a8ed-4be0-8dbb-92e0fb505fd6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:59.608876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85e82323-a8ed-4be0-8dbb-92e0fb505fd6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:59.854147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-562b3e33-5100-4170-82fd-e94d24253957 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:59.868537 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-562b3e33-5100-4170-82fd-e94d24253957 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.320571 Aug 03 01:55:59.869460 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1090/2187] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:59 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:59.878173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-33b52668-e7b6-40cf-800f-c358af8aa871 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:59.879376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-33b52668-e7b6-40cf-800f-c358af8aa871 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:59.892046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33b52668-e7b6-40cf-800f-c358af8aa871 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:59.894019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33b52668-e7b6-40cf-800f-c358af8aa871 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:59.894019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33b52668-e7b6-40cf-800f-c358af8aa871 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:59.894245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33b52668-e7b6-40cf-800f-c358af8aa871 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:59.913802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-85e82323-a8ed-4be0-8dbb-92e0fb505fd6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:55:59.923084 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-85e82323-a8ed-4be0-8dbb-92e0fb505fd6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.347822 Aug 03 01:55:59.924435 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1098/2188] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:59 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:55:59.946330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-872b5501-3a98-47f0-9590-6986b950e2ac tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:55:59.947001 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-872b5501-3a98-47f0-9590-6986b950e2ac tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:55:59.958863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-872b5501-3a98-47f0-9590-6986b950e2ac tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:59.959382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-872b5501-3a98-47f0-9590-6986b950e2ac tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:55:59.960424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-872b5501-3a98-47f0-9590-6986b950e2ac tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:55:59.962870 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-872b5501-3a98-47f0-9590-6986b950e2ac tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:00.064565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-33b52668-e7b6-40cf-800f-c358af8aa871 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:00.086018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-33b52668-e7b6-40cf-800f-c358af8aa871 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:00.087914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-33b52668-e7b6-40cf-800f-c358af8aa871 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:00.089426 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-33b52668-e7b6-40cf-800f-c358af8aa871 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1365 microversion: 2.47 time: 0.218856 Aug 03 01:56:00.108578 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1091/2189] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:55:59 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:00.117177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-47b9465a-eeb5-43df-962f-1202a6b66893 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:00.118385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-47b9465a-eeb5-43df-962f-1202a6b66893 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:00.126260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47b9465a-eeb5-43df-962f-1202a6b66893 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:00.126999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47b9465a-eeb5-43df-962f-1202a6b66893 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:00.129244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47b9465a-eeb5-43df-962f-1202a6b66893 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:00.129925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47b9465a-eeb5-43df-962f-1202a6b66893 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:00.171517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-872b5501-3a98-47f0-9590-6986b950e2ac tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:00.184277 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-872b5501-3a98-47f0-9590-6986b950e2ac tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.241705 Aug 03 01:56:00.188131 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1099/2190] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:55:59 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:00.214087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-47b9465a-eeb5-43df-962f-1202a6b66893 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:00.214938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-99d66ca2-f86f-443c-b408-a0e53993dac9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:00.216280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-99d66ca2-f86f-443c-b408-a0e53993dac9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:00.222430 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-47b9465a-eeb5-43df-962f-1202a6b66893 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1184 microversion: 2.1 time: 0.112435 Aug 03 01:56:00.223084 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1092/2191] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:00 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1184 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:00.226186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99d66ca2-f86f-443c-b408-a0e53993dac9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:00.227066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99d66ca2-f86f-443c-b408-a0e53993dac9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:00.227772 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99d66ca2-f86f-443c-b408-a0e53993dac9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:00.228393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99d66ca2-f86f-443c-b408-a0e53993dac9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:00.415921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-99d66ca2-f86f-443c-b408-a0e53993dac9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:00.424379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-99d66ca2-f86f-443c-b408-a0e53993dac9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:00.426201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-99d66ca2-f86f-443c-b408-a0e53993dac9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:00.427426 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-99d66ca2-f86f-443c-b408-a0e53993dac9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.217214 Aug 03 01:56:00.427997 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1100/2192] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:00 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:00.890872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-06619c22-bd54-450f-a600-e9d915f66007 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:00.891531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-06619c22-bd54-450f-a600-e9d915f66007 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:00.906751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06619c22-bd54-450f-a600-e9d915f66007 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:00.907462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06619c22-bd54-450f-a600-e9d915f66007 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:00.908654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06619c22-bd54-450f-a600-e9d915f66007 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:00.909012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06619c22-bd54-450f-a600-e9d915f66007 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:00.951408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f5936558-6afd-458e-9708-4d3aa6e81342 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:00.953007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f5936558-6afd-458e-9708-4d3aa6e81342 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:00.965260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5936558-6afd-458e-9708-4d3aa6e81342 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:00.966235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5936558-6afd-458e-9708-4d3aa6e81342 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:00.967515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5936558-6afd-458e-9708-4d3aa6e81342 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:00.968260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5936558-6afd-458e-9708-4d3aa6e81342 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:01.123299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-06619c22-bd54-450f-a600-e9d915f66007 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:01.142974 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-06619c22-bd54-450f-a600-e9d915f66007 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.255825 Aug 03 01:56:01.145944 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1093/2193] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:00 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:01.163158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-be65b6a0-f2b7-4193-bd03-9225ecd905f8 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:01.163921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-be65b6a0-f2b7-4193-bd03-9225ecd905f8 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:01.170702 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be65b6a0-f2b7-4193-bd03-9225ecd905f8 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:01.171264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be65b6a0-f2b7-4193-bd03-9225ecd905f8 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:01.172517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be65b6a0-f2b7-4193-bd03-9225ecd905f8 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:01.173044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be65b6a0-f2b7-4193-bd03-9225ecd905f8 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:01.175943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f5936558-6afd-458e-9708-4d3aa6e81342 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:01.186070 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f5936558-6afd-458e-9708-4d3aa6e81342 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.240591 Aug 03 01:56:01.205796 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1101/2194] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:00 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:56:01.214706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-825029ea-cfa3-462c-851c-a906c52ae326 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:01.215356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-825029ea-cfa3-462c-851c-a906c52ae326 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:01.217696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:01.226936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-825029ea-cfa3-462c-851c-a906c52ae326 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:01.227862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-825029ea-cfa3-462c-851c-a906c52ae326 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:01.228854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-825029ea-cfa3-462c-851c-a906c52ae326 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:01.229654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-825029ea-cfa3-462c-851c-a906c52ae326 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:01.253697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-be65b6a0-f2b7-4193-bd03-9225ecd905f8 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:01.264173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-be65b6a0-f2b7-4193-bd03-9225ecd905f8 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:01.266024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-be65b6a0-f2b7-4193-bd03-9225ecd905f8 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:01.267974 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-be65b6a0-f2b7-4193-bd03-9225ecd905f8 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1371 microversion: 2.47 time: 0.121062 Aug 03 01:56:01.268650 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1094/2195] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:01 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:01.274734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7f9a1efd-3e29-43e9-9138-04d0e2057890 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:01.275704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7f9a1efd-3e29-43e9-9138-04d0e2057890 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:01.286378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f9a1efd-3e29-43e9-9138-04d0e2057890 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:01.287613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f9a1efd-3e29-43e9-9138-04d0e2057890 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:01.288706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f9a1efd-3e29-43e9-9138-04d0e2057890 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:01.289279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f9a1efd-3e29-43e9-9138-04d0e2057890 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:01.396518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7f9a1efd-3e29-43e9-9138-04d0e2057890 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:01.404981 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7f9a1efd-3e29-43e9-9138-04d0e2057890 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1184 microversion: 2.1 time: 0.134220 Aug 03 01:56:01.405562 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1095/2196] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:01 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1184 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:01.440137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-825029ea-cfa3-462c-851c-a906c52ae326 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:01.451484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0c6a6dca-44f5-40a5-96e9-44bed044873c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:01.452279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0c6a6dca-44f5-40a5-96e9-44bed044873c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:01.453742 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-825029ea-cfa3-462c-851c-a906c52ae326 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.242844 Aug 03 01:56:01.454539 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1102/2197] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:01 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:01.460114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c6a6dca-44f5-40a5-96e9-44bed044873c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:01.460567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c6a6dca-44f5-40a5-96e9-44bed044873c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:01.461345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c6a6dca-44f5-40a5-96e9-44bed044873c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:01.461781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c6a6dca-44f5-40a5-96e9-44bed044873c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:01.607795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0c6a6dca-44f5-40a5-96e9-44bed044873c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:01.617508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0c6a6dca-44f5-40a5-96e9-44bed044873c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:01.619078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0c6a6dca-44f5-40a5-96e9-44bed044873c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:01.620263 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0c6a6dca-44f5-40a5-96e9-44bed044873c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.174190 Aug 03 01:56:01.620837 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1096/2198] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:01 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:02.168073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8dafd991-aa1f-470d-a59a-debe172fc0a4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:02.168858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8dafd991-aa1f-470d-a59a-debe172fc0a4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:02.177036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dafd991-aa1f-470d-a59a-debe172fc0a4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:02.177762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dafd991-aa1f-470d-a59a-debe172fc0a4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:02.178765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dafd991-aa1f-470d-a59a-debe172fc0a4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:02.179344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dafd991-aa1f-470d-a59a-debe172fc0a4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:02.209623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-568a70fa-2ae3-43a3-be3a-de0422aff909 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:02.210316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-568a70fa-2ae3-43a3-be3a-de0422aff909 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:02.225340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-568a70fa-2ae3-43a3-be3a-de0422aff909 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:02.225772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-568a70fa-2ae3-43a3-be3a-de0422aff909 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:02.229567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-568a70fa-2ae3-43a3-be3a-de0422aff909 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:02.230114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-568a70fa-2ae3-43a3-be3a-de0422aff909 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:02.482815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8dafd991-aa1f-470d-a59a-debe172fc0a4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:02.500340 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8dafd991-aa1f-470d-a59a-debe172fc0a4 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.337260 Aug 03 01:56:02.501457 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1103/2199] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:02 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:02.509601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c9aa14af-67f0-498e-9858-eafc919c2e5d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:02.510291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c9aa14af-67f0-498e-9858-eafc919c2e5d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:02.514155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-568a70fa-2ae3-43a3-be3a-de0422aff909 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:02.526592 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-568a70fa-2ae3-43a3-be3a-de0422aff909 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.321778 Aug 03 01:56:02.527065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9aa14af-67f0-498e-9858-eafc919c2e5d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:02.527678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9aa14af-67f0-498e-9858-eafc919c2e5d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:02.528553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9aa14af-67f0-498e-9858-eafc919c2e5d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:02.529249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9aa14af-67f0-498e-9858-eafc919c2e5d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:02.540334 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1097/2200] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:02 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:56:02.557440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a420bd11-230d-4b77-95d9-34ddd2371cc1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:02.558217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a420bd11-230d-4b77-95d9-34ddd2371cc1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:02.568035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a420bd11-230d-4b77-95d9-34ddd2371cc1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:02.568509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a420bd11-230d-4b77-95d9-34ddd2371cc1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:02.569401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a420bd11-230d-4b77-95d9-34ddd2371cc1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:02.569855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a420bd11-230d-4b77-95d9-34ddd2371cc1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:02.659404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c9aa14af-67f0-498e-9858-eafc919c2e5d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:02.669567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c9aa14af-67f0-498e-9858-eafc919c2e5d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:02.674597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c9aa14af-67f0-498e-9858-eafc919c2e5d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:02.677468 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c9aa14af-67f0-498e-9858-eafc919c2e5d tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1371 microversion: 2.47 time: 0.174676 Aug 03 01:56:02.678603 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1104/2201] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:02 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:02.684708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1542df9-494b-411e-8ce3-b830996d09a9 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:02.685686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b1542df9-494b-411e-8ce3-b830996d09a9 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:02.694792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1542df9-494b-411e-8ce3-b830996d09a9 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:02.695690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1542df9-494b-411e-8ce3-b830996d09a9 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:02.698949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1542df9-494b-411e-8ce3-b830996d09a9 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:02.699991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1542df9-494b-411e-8ce3-b830996d09a9 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:02.708933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a420bd11-230d-4b77-95d9-34ddd2371cc1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:02.721066 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a420bd11-230d-4b77-95d9-34ddd2371cc1 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1184 microversion: 2.1 time: 0.179433 Aug 03 01:56:02.732557 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1098/2202] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:02 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1184 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:02.749788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-01052601-b8ff-40ae-9130-e7a8f9780f59 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:02.750632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-01052601-b8ff-40ae-9130-e7a8f9780f59 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:02.770992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01052601-b8ff-40ae-9130-e7a8f9780f59 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:02.771457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01052601-b8ff-40ae-9130-e7a8f9780f59 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:02.772256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01052601-b8ff-40ae-9130-e7a8f9780f59 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:02.772694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01052601-b8ff-40ae-9130-e7a8f9780f59 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:02.785581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:02.970933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b1542df9-494b-411e-8ce3-b830996d09a9 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:02.985924 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b1542df9-494b-411e-8ce3-b830996d09a9 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.305813 Aug 03 01:56:02.986443 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1105/2203] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:02 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:03.031571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-01052601-b8ff-40ae-9130-e7a8f9780f59 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:03.044668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-01052601-b8ff-40ae-9130-e7a8f9780f59 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:03.048590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-01052601-b8ff-40ae-9130-e7a8f9780f59 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:03.052321 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-01052601-b8ff-40ae-9130-e7a8f9780f59 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.318119 Aug 03 01:56:03.053311 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1099/2204] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:02 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:03.532840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-72912679-d323-4f3d-9a99-e05442f07b10 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:03.534138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-72912679-d323-4f3d-9a99-e05442f07b10 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:03.559314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-454bf90d-3458-4397-bda1-1481bf67ed19 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:03.560767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-454bf90d-3458-4397-bda1-1481bf67ed19 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:03.586719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72912679-d323-4f3d-9a99-e05442f07b10 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:03.587655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72912679-d323-4f3d-9a99-e05442f07b10 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:03.591619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72912679-d323-4f3d-9a99-e05442f07b10 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:03.594563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72912679-d323-4f3d-9a99-e05442f07b10 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:03.603877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-454bf90d-3458-4397-bda1-1481bf67ed19 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:03.616163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-454bf90d-3458-4397-bda1-1481bf67ed19 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:03.617124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-454bf90d-3458-4397-bda1-1481bf67ed19 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:03.617581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-454bf90d-3458-4397-bda1-1481bf67ed19 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:03.953774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-454bf90d-3458-4397-bda1-1481bf67ed19 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:03.980938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-72912679-d323-4f3d-9a99-e05442f07b10 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:03.994557 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-72912679-d323-4f3d-9a99-e05442f07b10 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.472112 Aug 03 01:56:04.008157 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1106/2205] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:03 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:04.015540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2c3aac5d-fc9e-4fa8-a34c-42024cda3b59 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:04.016806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2c3aac5d-fc9e-4fa8-a34c-42024cda3b59 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:04.026403 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-454bf90d-3458-4397-bda1-1481bf67ed19 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.476092 Aug 03 01:56:04.030161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c3aac5d-fc9e-4fa8-a34c-42024cda3b59 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:04.031496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c3aac5d-fc9e-4fa8-a34c-42024cda3b59 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:04.033037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c3aac5d-fc9e-4fa8-a34c-42024cda3b59 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:04.033937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c3aac5d-fc9e-4fa8-a34c-42024cda3b59 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:04.039662 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1100/2206] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:03 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:04.044764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2891ff62-a6f7-4e8a-9e34-1a69224f26a9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:04.045763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2891ff62-a6f7-4e8a-9e34-1a69224f26a9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:04.054143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2891ff62-a6f7-4e8a-9e34-1a69224f26a9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:04.054872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2891ff62-a6f7-4e8a-9e34-1a69224f26a9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:04.055852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2891ff62-a6f7-4e8a-9e34-1a69224f26a9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:04.056462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2891ff62-a6f7-4e8a-9e34-1a69224f26a9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:04.119563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2891ff62-a6f7-4e8a-9e34-1a69224f26a9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:04.120128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2891ff62-a6f7-4e8a-9e34-1a69224f26a9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:04.120672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-2891ff62-a6f7-4e8a-9e34-1a69224f26a9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lazy-loading 'fault' on Instance uuid 0b54bdd1-d224-4a35-9487-66a77cd76c71 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:56:04.198659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2891ff62-a6f7-4e8a-9e34-1a69224f26a9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:04.213063 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2891ff62-a6f7-4e8a-9e34-1a69224f26a9 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 200 len: 1189 microversion: 2.1 time: 0.171715 Aug 03 01:56:04.214709 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1101/2207] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:04 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 1189 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:04.226987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ec80da0f-2054-4948-a460-7863507533ad tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:04.227547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ec80da0f-2054-4948-a460-7863507533ad tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:04.234841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ec80da0f-2054-4948-a460-7863507533ad tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:04.235336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ec80da0f-2054-4948-a460-7863507533ad tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:04.236146 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ec80da0f-2054-4948-a460-7863507533ad tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:04.236598 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ec80da0f-2054-4948-a460-7863507533ad tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:04.282065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2c3aac5d-fc9e-4fa8-a34c-42024cda3b59 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:04.293885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2c3aac5d-fc9e-4fa8-a34c-42024cda3b59 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:04.296815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2c3aac5d-fc9e-4fa8-a34c-42024cda3b59 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:04.298448 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2c3aac5d-fc9e-4fa8-a34c-42024cda3b59 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1371 microversion: 2.47 time: 0.287828 Aug 03 01:56:04.299804 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1107/2208] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:04 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:04.321344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fa7b0479-7031-44eb-8b4a-1c976507ac44 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:04.325165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fa7b0479-7031-44eb-8b4a-1c976507ac44 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:04.335218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:04.346875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa7b0479-7031-44eb-8b4a-1c976507ac44 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:04.350706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa7b0479-7031-44eb-8b4a-1c976507ac44 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:04.356131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa7b0479-7031-44eb-8b4a-1c976507ac44 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:04.356880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa7b0479-7031-44eb-8b4a-1c976507ac44 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:04.418585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:04.590754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ec80da0f-2054-4948-a460-7863507533ad tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:04.603155 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ec80da0f-2054-4948-a460-7863507533ad tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.387243 Aug 03 01:56:04.604204 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1102/2209] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:04 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:04.611179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-444310f4-abb2-4c21-bef5-b0b1d79583f4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:04.614695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-444310f4-abb2-4c21-bef5-b0b1d79583f4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:04.632376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-444310f4-abb2-4c21-bef5-b0b1d79583f4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:04.633089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-444310f4-abb2-4c21-bef5-b0b1d79583f4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:04.634324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-444310f4-abb2-4c21-bef5-b0b1d79583f4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:04.634976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-444310f4-abb2-4c21-bef5-b0b1d79583f4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:04.664207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fa7b0479-7031-44eb-8b4a-1c976507ac44 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:04.676997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-444310f4-abb2-4c21-bef5-b0b1d79583f4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lazy-loading 'flavor' on Instance uuid d537dd36-d584-48d0-9458-81075e06b366 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:56:04.679840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fa7b0479-7031-44eb-8b4a-1c976507ac44 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:04.683922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fa7b0479-7031-44eb-8b4a-1c976507ac44 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:04.685564 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fa7b0479-7031-44eb-8b4a-1c976507ac44 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.383678 Aug 03 01:56:04.686674 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1108/2210] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:04 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:04.860874 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-444310f4-abb2-4c21-bef5-b0b1d79583f4 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/action" status: 200 len: 32 microversion: 2.1 time: 0.254624 Aug 03 01:56:04.875295 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1103/2211] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:56:04 2022] POST /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/action => generated 32 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:56:04.885912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-edf996f8-b757-498d-9ba5-f421aa7f0bed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:04.886626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-edf996f8-b757-498d-9ba5-f421aa7f0bed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:04.905356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edf996f8-b757-498d-9ba5-f421aa7f0bed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:04.906139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edf996f8-b757-498d-9ba5-f421aa7f0bed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:04.907305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edf996f8-b757-498d-9ba5-f421aa7f0bed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:04.907935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edf996f8-b757-498d-9ba5-f421aa7f0bed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:05.018292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-91f1f07e-220e-4d4d-8ce3-426d1ad45861 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:05.019117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-91f1f07e-220e-4d4d-8ce3-426d1ad45861 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:05.030429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91f1f07e-220e-4d4d-8ce3-426d1ad45861 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:05.032592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91f1f07e-220e-4d4d-8ce3-426d1ad45861 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:05.033422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91f1f07e-220e-4d4d-8ce3-426d1ad45861 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:05.033871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91f1f07e-220e-4d4d-8ce3-426d1ad45861 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:05.303026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-edf996f8-b757-498d-9ba5-f421aa7f0bed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:05.318558 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-edf996f8-b757-498d-9ba5-f421aa7f0bed tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1734 microversion: 2.1 time: 0.437086 Aug 03 01:56:05.319217 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1109/2212] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:04 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1734 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:05.333344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9cb0fb0d-5fd7-40e8-b525-202330f589e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:05.334016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9cb0fb0d-5fd7-40e8-b525-202330f589e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:05.344994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cb0fb0d-5fd7-40e8-b525-202330f589e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:05.345453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cb0fb0d-5fd7-40e8-b525-202330f589e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:05.346245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cb0fb0d-5fd7-40e8-b525-202330f589e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:05.346690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cb0fb0d-5fd7-40e8-b525-202330f589e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:05.575288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-91f1f07e-220e-4d4d-8ce3-426d1ad45861 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:05.592415 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-91f1f07e-220e-4d4d-8ce3-426d1ad45861 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.578439 Aug 03 01:56:05.609102 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1104/2213] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:05 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:05.614758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eeb9f1e2-575f-438b-b304-abab8dc2121b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:05.615786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eeb9f1e2-575f-438b-b304-abab8dc2121b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: 0b54bdd1-d224-4a35-9487-66a77cd76c71] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:05.624022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eeb9f1e2-575f-438b-b304-abab8dc2121b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:05.624480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eeb9f1e2-575f-438b-b304-abab8dc2121b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:05.625269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eeb9f1e2-575f-438b-b304-abab8dc2121b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:05.625708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eeb9f1e2-575f-438b-b304-abab8dc2121b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:05.642680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9cb0fb0d-5fd7-40e8-b525-202330f589e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:05.652654 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9cb0fb0d-5fd7-40e8-b525-202330f589e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1497 microversion: 2.1 time: 0.332368 Aug 03 01:56:05.653254 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1110/2214] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:05 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1497 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:05.665864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2936b748-4cdc-46a4-b18a-4ddcf6c64007 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:05.666522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2936b748-4cdc-46a4-b18a-4ddcf6c64007 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:05.670610 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-eeb9f1e2-575f-438b-b304-abab8dc2121b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] HTTP exception thrown: Instance 0b54bdd1-d224-4a35-9487-66a77cd76c71 could not be found. Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eeb9f1e2-575f-438b-b304-abab8dc2121b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Request method failure captured: Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 HTTP/1.1 Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dQtfaxCugihlL0P-JuHcxaXYvSZwumECUI8oXZW8NjUnOQmnlS-UJeJWloLTa2nkib5iJcuoAKX60UHFAlj4BGPFKzJpj5_lUnKZbgP-NuaKafdXBPg4Z-YfN-tYmO7Dwn93GuQctj6Xv1TcX3wlfTLxer4AdjG_rRaIjDodC-ZS1E Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 5f232cf4e61b4213b592b2a020961630 Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-LiveMigrationTest-495141292 Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f232cf4e61b4213b592b2a020961630", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f232cf4e61b4213b592b2a020961630"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f232cf4e61b4213b592b2a020961630"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f232cf4e61b4213b592b2a020961630"}]}] Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-LiveMigrationTest-495141292 Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 5f232cf4e61b4213b592b2a020961630 Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-LiveMigrationTest-495141292 Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-LiveMigrationTest-495141292-project Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: dd2c77c8ab314584939f1f580d5a6d14 Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-LiveMigrationTest-495141292-project Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 0b54bdd1-d224-4a35-9487-66a77cd76c71 could not be found. Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '0b54bdd1-d224-4a35-9487-66a77cd76c71'} Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b54bdd1-d224-4a35-9487-66a77cd76c71 could not be found. Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b54bdd1-d224-4a35-9487-66a77cd76c71 could not be found. Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:05.672369 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:05.683002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:05.683002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:05.683002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:05.683002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:56:05.683002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:56:05.683002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b54bdd1-d224-4a35-9487-66a77cd76c71 could not be found. Aug 03 01:56:05.683002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:05.683002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eeb9f1e2-575f-438b-b304-abab8dc2121b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Returning 404 to user: Instance 0b54bdd1-d224-4a35-9487-66a77cd76c71 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:56:05.683002 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eeb9f1e2-575f-438b-b304-abab8dc2121b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71" status: 404 len: 111 microversion: 2.1 time: 0.063402 Aug 03 01:56:05.683002 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1105/2215] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:05 2022] GET /compute/v2.1/servers/0b54bdd1-d224-4a35-9487-66a77cd76c71 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:56:05.683002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eb484b7b-22fe-475c-ae0f-83aed08a5f60 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:05.684032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2936b748-4cdc-46a4-b18a-4ddcf6c64007 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:05.684192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eb484b7b-22fe-475c-ae0f-83aed08a5f60 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:05.686038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2936b748-4cdc-46a4-b18a-4ddcf6c64007 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:05.686399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2936b748-4cdc-46a4-b18a-4ddcf6c64007 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:05.686856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2936b748-4cdc-46a4-b18a-4ddcf6c64007 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:05.690383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb484b7b-22fe-475c-ae0f-83aed08a5f60 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:05.691924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb484b7b-22fe-475c-ae0f-83aed08a5f60 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:05.692480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb484b7b-22fe-475c-ae0f-83aed08a5f60 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:05.692920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb484b7b-22fe-475c-ae0f-83aed08a5f60 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:05.922707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2936b748-4cdc-46a4-b18a-4ddcf6c64007 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:05.935138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2936b748-4cdc-46a4-b18a-4ddcf6c64007 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:05.936744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2936b748-4cdc-46a4-b18a-4ddcf6c64007 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:05.937980 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2936b748-4cdc-46a4-b18a-4ddcf6c64007 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1356 microversion: 2.47 time: 0.279421 Aug 03 01:56:05.967885 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1111/2216] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:05 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1356 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:05.980030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cc6166c9-bc91-4d12-ace4-4579a66f2a2d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:05.981593 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cc6166c9-bc91-4d12-ace4-4579a66f2a2d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:06.008324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc6166c9-bc91-4d12-ace4-4579a66f2a2d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:06.010050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc6166c9-bc91-4d12-ace4-4579a66f2a2d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:06.013285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc6166c9-bc91-4d12-ace4-4579a66f2a2d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:06.014104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc6166c9-bc91-4d12-ace4-4579a66f2a2d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:06.410079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eb484b7b-22fe-475c-ae0f-83aed08a5f60 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:06.423688 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eb484b7b-22fe-475c-ae0f-83aed08a5f60 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.746503 Aug 03 01:56:06.437314 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1106/2217] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:05 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:06.437775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cc6166c9-bc91-4d12-ace4-4579a66f2a2d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:06.451470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cc6166c9-bc91-4d12-ace4-4579a66f2a2d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:06.452857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cc6166c9-bc91-4d12-ace4-4579a66f2a2d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:06.453793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f83f6e05-03a0-4ba1-8db1-78de8fdacf69 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:06.459678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f83f6e05-03a0-4ba1-8db1-78de8fdacf69 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:06.460574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f83f6e05-03a0-4ba1-8db1-78de8fdacf69 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Searching by: {'deleted': False, 'project_id': '6068cf446fa244b29de74230a5add9eb'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:56:06.462874 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cc6166c9-bc91-4d12-ace4-4579a66f2a2d tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.493362 Aug 03 01:56:06.477793 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1112/2218] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:05 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:06.482913 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e012596b-4e4a-4c82-873a-4f68dddfdacb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:06.486422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e012596b-4e4a-4c82-873a-4f68dddfdacb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:06.493331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f83f6e05-03a0-4ba1-8db1-78de8fdacf69 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:06.498038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f83f6e05-03a0-4ba1-8db1-78de8fdacf69 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:06.499468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f83f6e05-03a0-4ba1-8db1-78de8fdacf69 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:06.499946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f83f6e05-03a0-4ba1-8db1-78de8fdacf69 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:06.505707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e012596b-4e4a-4c82-873a-4f68dddfdacb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:06.506172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e012596b-4e4a-4c82-873a-4f68dddfdacb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:06.507009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e012596b-4e4a-4c82-873a-4f68dddfdacb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:06.507443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e012596b-4e4a-4c82-873a-4f68dddfdacb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:06.700738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-f83f6e05-03a0-4ba1-8db1-78de8fdacf69 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:56:06.817264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f83f6e05-03a0-4ba1-8db1-78de8fdacf69 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:06.826560 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f83f6e05-03a0-4ba1-8db1-78de8fdacf69 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:06.827280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f83f6e05-03a0-4ba1-8db1-78de8fdacf69 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:06.841130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f83f6e05-03a0-4ba1-8db1-78de8fdacf69 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:06.842789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f83f6e05-03a0-4ba1-8db1-78de8fdacf69 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:06.908980 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f83f6e05-03a0-4ba1-8db1-78de8fdacf69 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.483689 Aug 03 01:56:06.922022 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1107/2219] 10.222.0.67 () {60 vars in 1187 bytes} [Wed Aug 3 01:56:06 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:06.922022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a554097f-9744-48c5-abb5-4d8c5ddd0d7c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:06.922022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a554097f-9744-48c5-abb5-4d8c5ddd0d7c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:06.935210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e012596b-4e4a-4c82-873a-4f68dddfdacb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:06.941094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a554097f-9744-48c5-abb5-4d8c5ddd0d7c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:06.942036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a554097f-9744-48c5-abb5-4d8c5ddd0d7c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:06.942756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a554097f-9744-48c5-abb5-4d8c5ddd0d7c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:06.943424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a554097f-9744-48c5-abb5-4d8c5ddd0d7c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:06.945848 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e012596b-4e4a-4c82-873a-4f68dddfdacb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1734 microversion: 2.1 time: 0.466766 Aug 03 01:56:06.955748 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1113/2220] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:06 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1734 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:06.970408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ae2c8da4-4974-49d0-a45b-e5a2d00f00ae tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:06.971237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ae2c8da4-4974-49d0-a45b-e5a2d00f00ae tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:06.997869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae2c8da4-4974-49d0-a45b-e5a2d00f00ae tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:07.000245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae2c8da4-4974-49d0-a45b-e5a2d00f00ae tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:07.001307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae2c8da4-4974-49d0-a45b-e5a2d00f00ae tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:07.003430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae2c8da4-4974-49d0-a45b-e5a2d00f00ae tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:07.226259 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a554097f-9744-48c5-abb5-4d8c5ddd0d7c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:07.243492 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a554097f-9744-48c5-abb5-4d8c5ddd0d7c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.325642 Aug 03 01:56:07.258387 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1108/2221] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:06 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:07.268332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-470fd308-f6c3-4622-9ae0-a530e13d783b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:07.269762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-470fd308-f6c3-4622-9ae0-a530e13d783b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:07.279169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-470fd308-f6c3-4622-9ae0-a530e13d783b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:07.279639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-470fd308-f6c3-4622-9ae0-a530e13d783b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:07.280457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-470fd308-f6c3-4622-9ae0-a530e13d783b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:07.280906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-470fd308-f6c3-4622-9ae0-a530e13d783b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:07.303557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ae2c8da4-4974-49d0-a45b-e5a2d00f00ae tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:07.318265 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ae2c8da4-4974-49d0-a45b-e5a2d00f00ae tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 200 len: 1474 microversion: 2.1 time: 0.357600 Aug 03 01:56:07.318499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-470fd308-f6c3-4622-9ae0-a530e13d783b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:56:07.320583 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1114/2222] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:06 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 1474 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:07.345053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f1f4bd7d-e7b5-45d1-83e7-53b57fae7d61 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1517281541"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:07.349430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f1f4bd7d-e7b5-45d1-83e7-53b57fae7d61 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:07.364431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1f4bd7d-e7b5-45d1-83e7-53b57fae7d61 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:07.364877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1f4bd7d-e7b5-45d1-83e7-53b57fae7d61 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:07.369478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1f4bd7d-e7b5-45d1-83e7-53b57fae7d61 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:07.369935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1f4bd7d-e7b5-45d1-83e7-53b57fae7d61 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:07.464954 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-470fd308-f6c3-4622-9ae0-a530e13d783b tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 204 len: 0 microversion: 2.47 time: 0.202532 Aug 03 01:56:07.466221 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1109/2223] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 01:56:07 2022] DELETE /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:56:07.481874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e824951f-9be3-448b-aa92-d5efb6cc29b4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:07.484053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e824951f-9be3-448b-aa92-d5efb6cc29b4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:07.499161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e824951f-9be3-448b-aa92-d5efb6cc29b4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:07.502850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e824951f-9be3-448b-aa92-d5efb6cc29b4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:07.508048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e824951f-9be3-448b-aa92-d5efb6cc29b4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:07.508607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e824951f-9be3-448b-aa92-d5efb6cc29b4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:07.721068 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f1f4bd7d-e7b5-45d1-83e7-53b57fae7d61 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "POST /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d/action" status: 202 len: 0 microversion: 2.1 time: 0.381426 Aug 03 01:56:07.730156 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1115/2224] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:56:07 2022] POST /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 01:56:07.752276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d32d55ea-cfc4-4008-860a-39f5563e6a70 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:07.754616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d32d55ea-cfc4-4008-860a-39f5563e6a70 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:07.762288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d32d55ea-cfc4-4008-860a-39f5563e6a70 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:07.763132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d32d55ea-cfc4-4008-860a-39f5563e6a70 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:07.764171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d32d55ea-cfc4-4008-860a-39f5563e6a70 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:07.764826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d32d55ea-cfc4-4008-860a-39f5563e6a70 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:07.804621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e824951f-9be3-448b-aa92-d5efb6cc29b4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:07.814790 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e824951f-9be3-448b-aa92-d5efb6cc29b4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.343001 Aug 03 01:56:07.821599 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1110/2225] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:07 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:07.834014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d0184468-d280-4481-8239-d89251c5d2ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:07.835042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d0184468-d280-4481-8239-d89251c5d2ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:07.842263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0184468-d280-4481-8239-d89251c5d2ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:07.842714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0184468-d280-4481-8239-d89251c5d2ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:07.844269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0184468-d280-4481-8239-d89251c5d2ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:07.844269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0184468-d280-4481-8239-d89251c5d2ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:07.889108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d32d55ea-cfc4-4008-860a-39f5563e6a70 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:07.901690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d32d55ea-cfc4-4008-860a-39f5563e6a70 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:07.903675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d32d55ea-cfc4-4008-860a-39f5563e6a70 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:07.904906 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d32d55ea-cfc4-4008-860a-39f5563e6a70 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1362 microversion: 2.47 time: 0.173140 Aug 03 01:56:07.905841 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1116/2226] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:07 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:07.911591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d6413ec3-ac7b-4190-bc41-f2816673b906 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b12940040>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:07.993160 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d6413ec3-ac7b-4190-bc41-f2816673b906 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f" status: 200 len: 1414 microversion: 2.1 time: 0.086234 Aug 03 01:56:07.999622 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1117/2227] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:56:07 2022] GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:08.012219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5429d8c0-6109-4974-b3bb-1ff25b585faa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:08.015891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5429d8c0-6109-4974-b3bb-1ff25b585faa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:08.038040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5429d8c0-6109-4974-b3bb-1ff25b585faa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:08.045484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5429d8c0-6109-4974-b3bb-1ff25b585faa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:08.047446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5429d8c0-6109-4974-b3bb-1ff25b585faa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:08.052911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5429d8c0-6109-4974-b3bb-1ff25b585faa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:08.231628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d0184468-d280-4481-8239-d89251c5d2ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:08.237028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:08.247125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d0184468-d280-4481-8239-d89251c5d2ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:08.248682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d0184468-d280-4481-8239-d89251c5d2ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:08.250222 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d0184468-d280-4481-8239-d89251c5d2ca tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.426470 Aug 03 01:56:08.262938 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1111/2228] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:07 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:08.269852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1c94d447-03ed-4ee3-adbf-975d14759018 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:08.270877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1c94d447-03ed-4ee3-adbf-975d14759018 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:08.281586 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c94d447-03ed-4ee3-adbf-975d14759018 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:08.282226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c94d447-03ed-4ee3-adbf-975d14759018 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:08.283084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c94d447-03ed-4ee3-adbf-975d14759018 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:08.283532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c94d447-03ed-4ee3-adbf-975d14759018 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:08.293734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5429d8c0-6109-4974-b3bb-1ff25b585faa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:08.310152 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5429d8c0-6109-4974-b3bb-1ff25b585faa tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1734 microversion: 2.1 time: 0.306728 Aug 03 01:56:08.324893 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1118/2229] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:07 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1734 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:08.515187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1c94d447-03ed-4ee3-adbf-975d14759018 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:08.525823 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1c94d447-03ed-4ee3-adbf-975d14759018 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.260977 Aug 03 01:56:08.548405 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1112/2230] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:08 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:56:08.843587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c94f37f4-612c-4077-80cf-da0bd6499970 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:08.844291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c94f37f4-612c-4077-80cf-da0bd6499970 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:08.853103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c94f37f4-612c-4077-80cf-da0bd6499970 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:08.854438 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c94f37f4-612c-4077-80cf-da0bd6499970 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:08.855453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c94f37f4-612c-4077-80cf-da0bd6499970 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:08.855981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c94f37f4-612c-4077-80cf-da0bd6499970 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:08.933998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0ef3161b-9f57-49d9-9a18-737591951def tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:08.934671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0ef3161b-9f57-49d9-9a18-737591951def tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:08.942521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ef3161b-9f57-49d9-9a18-737591951def tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:08.943311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ef3161b-9f57-49d9-9a18-737591951def tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:08.944448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ef3161b-9f57-49d9-9a18-737591951def tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:08.945308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ef3161b-9f57-49d9-9a18-737591951def tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:09.134460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0ef3161b-9f57-49d9-9a18-737591951def tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:09.173169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0ef3161b-9f57-49d9-9a18-737591951def tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:09.182897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0ef3161b-9f57-49d9-9a18-737591951def tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:09.185429 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0ef3161b-9f57-49d9-9a18-737591951def tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1362 microversion: 2.47 time: 0.255821 Aug 03 01:56:09.190394 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1113/2231] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:08 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:09.207076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1b7f88e1-6cf9-456c-8aa1-9a184790bfa9 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b13a953a0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:09.209635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c94f37f4-612c-4077-80cf-da0bd6499970 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:09.223676 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c94f37f4-612c-4077-80cf-da0bd6499970 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.383734 Aug 03 01:56:09.248647 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1119/2232] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:08 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:09.275299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-34f14686-17aa-4036-9b08-d5bf347d4572 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:09.275915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-34f14686-17aa-4036-9b08-d5bf347d4572 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:09.284912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34f14686-17aa-4036-9b08-d5bf347d4572 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:09.285420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34f14686-17aa-4036-9b08-d5bf347d4572 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:09.288422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34f14686-17aa-4036-9b08-d5bf347d4572 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:09.288884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34f14686-17aa-4036-9b08-d5bf347d4572 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:09.302797 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1b7f88e1-6cf9-456c-8aa1-9a184790bfa9 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f" status: 200 len: 1414 microversion: 2.1 time: 0.109630 Aug 03 01:56:09.305496 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1114/2233] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:56:09 2022] GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:09.340274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2b584c71-45d9-42e1-a3ea-d5b6c1871fcc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:09.341370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2b584c71-45d9-42e1-a3ea-d5b6c1871fcc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:09.355203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b584c71-45d9-42e1-a3ea-d5b6c1871fcc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:09.358220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b584c71-45d9-42e1-a3ea-d5b6c1871fcc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:09.359473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b584c71-45d9-42e1-a3ea-d5b6c1871fcc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:09.360133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b584c71-45d9-42e1-a3ea-d5b6c1871fcc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:09.678245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2b584c71-45d9-42e1-a3ea-d5b6c1871fcc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:09.693023 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2b584c71-45d9-42e1-a3ea-d5b6c1871fcc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1734 microversion: 2.1 time: 0.353886 Aug 03 01:56:09.718048 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1115/2234] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:09 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1734 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:09.734039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e1c2aa98-54e5-48c1-9812-30d37b11cc85 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:09.734825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e1c2aa98-54e5-48c1-9812-30d37b11cc85 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:09.747199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1c2aa98-54e5-48c1-9812-30d37b11cc85 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:09.766246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-34f14686-17aa-4036-9b08-d5bf347d4572 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:09.771552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1c2aa98-54e5-48c1-9812-30d37b11cc85 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:09.776191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1c2aa98-54e5-48c1-9812-30d37b11cc85 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:09.777424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1c2aa98-54e5-48c1-9812-30d37b11cc85 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:09.783075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-34f14686-17aa-4036-9b08-d5bf347d4572 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:09.788120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-34f14686-17aa-4036-9b08-d5bf347d4572 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:09.793185 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-34f14686-17aa-4036-9b08-d5bf347d4572 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.521641 Aug 03 01:56:09.821834 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1120/2235] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:09 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:10.165242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e1c2aa98-54e5-48c1-9812-30d37b11cc85 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:10.173572 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e1c2aa98-54e5-48c1-9812-30d37b11cc85 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.453127 Aug 03 01:56:10.188527 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1116/2236] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:09 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:10.224647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aabaa21f-4332-4faf-9ad8-0d425d79176a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:10.225622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-aabaa21f-4332-4faf-9ad8-0d425d79176a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:10.237141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aabaa21f-4332-4faf-9ad8-0d425d79176a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:10.245226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aabaa21f-4332-4faf-9ad8-0d425d79176a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:10.246185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ac86fd22-074e-4777-bd56-1ade3fa4cf4f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:10.247065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ac86fd22-074e-4777-bd56-1ade3fa4cf4f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:10.252450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aabaa21f-4332-4faf-9ad8-0d425d79176a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:10.253662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aabaa21f-4332-4faf-9ad8-0d425d79176a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:10.256977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac86fd22-074e-4777-bd56-1ade3fa4cf4f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:10.257444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac86fd22-074e-4777-bd56-1ade3fa4cf4f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:10.258320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac86fd22-074e-4777-bd56-1ade3fa4cf4f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:10.263073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac86fd22-074e-4777-bd56-1ade3fa4cf4f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:10.514768 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-aabaa21f-4332-4faf-9ad8-0d425d79176a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:10.527574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-aabaa21f-4332-4faf-9ad8-0d425d79176a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:10.532648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-aabaa21f-4332-4faf-9ad8-0d425d79176a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:10.543901 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-aabaa21f-4332-4faf-9ad8-0d425d79176a tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1362 microversion: 2.47 time: 0.325751 Aug 03 01:56:10.570681 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1121/2237] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:10 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:10.577293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-152e9f26-c1d1-448e-baf8-28064cbaee2a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b128e0040>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:10.673093 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-152e9f26-c1d1-448e-baf8-28064cbaee2a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f" status: 200 len: 1414 microversion: 2.1 time: 0.094110 Aug 03 01:56:10.674430 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1122/2238] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:56:10 2022] GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:10.716395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ac86fd22-074e-4777-bd56-1ade3fa4cf4f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:10.719210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a008a3b5-f9b1-455f-8f91-978e5e3e6d08 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:10.720220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a008a3b5-f9b1-455f-8f91-978e5e3e6d08 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:10.736415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a008a3b5-f9b1-455f-8f91-978e5e3e6d08 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:10.738830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a008a3b5-f9b1-455f-8f91-978e5e3e6d08 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:10.739889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a008a3b5-f9b1-455f-8f91-978e5e3e6d08 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:10.742019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a008a3b5-f9b1-455f-8f91-978e5e3e6d08 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:10.757396 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ac86fd22-074e-4777-bd56-1ade3fa4cf4f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.515219 Aug 03 01:56:10.763914 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1117/2239] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:10 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:10.824899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f5cca5c1-ae5e-4d66-9a9a-869b5556a7db tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:10.827504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f5cca5c1-ae5e-4d66-9a9a-869b5556a7db tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:10.847988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5cca5c1-ae5e-4d66-9a9a-869b5556a7db tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:10.850493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5cca5c1-ae5e-4d66-9a9a-869b5556a7db tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:10.853042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5cca5c1-ae5e-4d66-9a9a-869b5556a7db tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:10.854017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5cca5c1-ae5e-4d66-9a9a-869b5556a7db tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:11.194350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f5cca5c1-ae5e-4d66-9a9a-869b5556a7db tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:11.207553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f5cca5c1-ae5e-4d66-9a9a-869b5556a7db tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:11.211491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f5cca5c1-ae5e-4d66-9a9a-869b5556a7db tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:11.217922 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f5cca5c1-ae5e-4d66-9a9a-869b5556a7db tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.398403 Aug 03 01:56:11.219375 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1118/2240] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:10 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:11.237402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9de0ea6c-c68f-4eed-851b-36a287f599ca tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:11.245796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9de0ea6c-c68f-4eed-851b-36a287f599ca tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:11.270585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9de0ea6c-c68f-4eed-851b-36a287f599ca tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:11.274550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9de0ea6c-c68f-4eed-851b-36a287f599ca tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:11.275545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9de0ea6c-c68f-4eed-851b-36a287f599ca tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:11.276012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9de0ea6c-c68f-4eed-851b-36a287f599ca tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:11.364260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a008a3b5-f9b1-455f-8f91-978e5e3e6d08 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:11.373212 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a008a3b5-f9b1-455f-8f91-978e5e3e6d08 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1734 microversion: 2.1 time: 0.659099 Aug 03 01:56:11.373813 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1123/2241] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:10 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1734 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:56:11.573881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e0c086b8-9f53-496f-91ea-4b8bb6f20b6f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:11.574833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e0c086b8-9f53-496f-91ea-4b8bb6f20b6f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:11.610128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0c086b8-9f53-496f-91ea-4b8bb6f20b6f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:11.610590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0c086b8-9f53-496f-91ea-4b8bb6f20b6f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:11.625755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0c086b8-9f53-496f-91ea-4b8bb6f20b6f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:11.626294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0c086b8-9f53-496f-91ea-4b8bb6f20b6f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:11.766354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0c086b8-9f53-496f-91ea-4b8bb6f20b6f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:11.766869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0c086b8-9f53-496f-91ea-4b8bb6f20b6f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:11.768761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-e0c086b8-9f53-496f-91ea-4b8bb6f20b6f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lazy-loading 'fault' on Instance uuid 4687cce6-5bb7-4314-b789-3d2afa350bf1 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:56:11.806075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9de0ea6c-c68f-4eed-851b-36a287f599ca tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:11.819584 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9de0ea6c-c68f-4eed-851b-36a287f599ca tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.594561 Aug 03 01:56:11.820494 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1119/2242] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:11 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:11.826525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9889529e-70b0-48aa-9b42-a8b7d77bf7df tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b130c53a0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:11.928307 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9889529e-70b0-48aa-9b42-a8b7d77bf7df tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f" status: 200 len: 1414 microversion: 2.1 time: 0.105800 Aug 03 01:56:11.937763 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1120/2243] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:56:11 2022] GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f => generated 1414 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:11.943902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e0c086b8-9f53-496f-91ea-4b8bb6f20b6f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:11.952785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e0c086b8-9f53-496f-91ea-4b8bb6f20b6f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:11.960183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e0c086b8-9f53-496f-91ea-4b8bb6f20b6f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:11.961741 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e0c086b8-9f53-496f-91ea-4b8bb6f20b6f tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 200 len: 1367 microversion: 2.47 time: 0.393588 Aug 03 01:56:11.962351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a424a35a-81c7-417a-9e53-fa4b172e0141 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:11.963547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a424a35a-81c7-417a-9e53-fa4b172e0141 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:11.967437 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1124/2244] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:11 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:11.968428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:11.974597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a424a35a-81c7-417a-9e53-fa4b172e0141 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:11.975354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a424a35a-81c7-417a-9e53-fa4b172e0141 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:11.976530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a424a35a-81c7-417a-9e53-fa4b172e0141 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:11.978263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a424a35a-81c7-417a-9e53-fa4b172e0141 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:12.200727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a424a35a-81c7-417a-9e53-fa4b172e0141 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:12.215515 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a424a35a-81c7-417a-9e53-fa4b172e0141 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.274077 Aug 03 01:56:12.219600 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1121/2245] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:11 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:12.247006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0aaac965-a073-4e68-9e33-00c0f139c4e0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:12.247981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0aaac965-a073-4e68-9e33-00c0f139c4e0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:12.261309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0aaac965-a073-4e68-9e33-00c0f139c4e0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:12.265040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0aaac965-a073-4e68-9e33-00c0f139c4e0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:12.266375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0aaac965-a073-4e68-9e33-00c0f139c4e0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:12.270880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0aaac965-a073-4e68-9e33-00c0f139c4e0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:12.334438 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:12.399633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e58f4f9a-ca16-4268-b7e2-9217aacaa83d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:12.400487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e58f4f9a-ca16-4268-b7e2-9217aacaa83d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:12.410086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e58f4f9a-ca16-4268-b7e2-9217aacaa83d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:12.417298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e58f4f9a-ca16-4268-b7e2-9217aacaa83d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:12.419495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e58f4f9a-ca16-4268-b7e2-9217aacaa83d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:12.423452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e58f4f9a-ca16-4268-b7e2-9217aacaa83d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:12.666580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0aaac965-a073-4e68-9e33-00c0f139c4e0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:12.682256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0aaac965-a073-4e68-9e33-00c0f139c4e0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:12.689135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0aaac965-a073-4e68-9e33-00c0f139c4e0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:12.696448 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0aaac965-a073-4e68-9e33-00c0f139c4e0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.449692 Aug 03 01:56:12.697688 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1125/2246] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:12 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:12.747310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c9876cfc-3fe4-4952-a6ff-4e62ac52f175 req-75d9e799-5495-4d7e-ace6-6be0852b6e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92c67e8-bc6b-44c4-b012-63b940619b6d", "name": "network-vif-plugged", "status": "completed", "tag": "ed823989-d5aa-4d9a-9d30-87acf254629c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:12.768478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c9876cfc-3fe4-4952-a6ff-4e62ac52f175 req-75d9e799-5495-4d7e-ace6-6be0852b6e38 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:12.771901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c9876cfc-3fe4-4952-a6ff-4e62ac52f175 req-75d9e799-5495-4d7e-ace6-6be0852b6e38 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:12.803932 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c9876cfc-3fe4-4952-a6ff-4e62ac52f175 req-75d9e799-5495-4d7e-ace6-6be0852b6e38 service nova] Creating event network-vif-plugged:ed823989-d5aa-4d9a-9d30-87acf254629c for instance f92c67e8-bc6b-44c4-b012-63b940619b6d on n-h2-826529-8 Aug 03 01:56:12.820856 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c9876cfc-3fe4-4952-a6ff-4e62ac52f175 req-75d9e799-5495-4d7e-ace6-6be0852b6e38 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078410 Aug 03 01:56:12.825844 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1126/2247] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:12.843881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5075ecb-4710-4593-9b29-497642e02d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:12.844993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5075ecb-4710-4593-9b29-497642e02d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:12.857499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5075ecb-4710-4593-9b29-497642e02d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:12.863971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5075ecb-4710-4593-9b29-497642e02d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:12.865517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5075ecb-4710-4593-9b29-497642e02d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:12.866183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5075ecb-4710-4593-9b29-497642e02d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:12.881265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e58f4f9a-ca16-4268-b7e2-9217aacaa83d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:12.892914 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e58f4f9a-ca16-4268-b7e2-9217aacaa83d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1734 microversion: 2.1 time: 0.497869 Aug 03 01:56:12.895551 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1122/2248] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:12 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1734 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:56:12.944809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dafa1470-ed56-48e1-9cd4-906f5fc37a0a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b133ad310>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:13.032019 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dafa1470-ed56-48e1-9cd4-906f5fc37a0a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f" status: 200 len: 1414 microversion: 2.1 time: 0.091863 Aug 03 01:56:13.051472 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1123/2249] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:56:12 2022] GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:56:13.106838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8aaf2763-d549-4826-9de2-901c0bb8bb71 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:13.120288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8aaf2763-d549-4826-9de2-901c0bb8bb71 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 4687cce6-5bb7-4314-b789-3d2afa350bf1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:13.166806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8aaf2763-d549-4826-9de2-901c0bb8bb71 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:13.167528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8aaf2763-d549-4826-9de2-901c0bb8bb71 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:13.171686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8aaf2763-d549-4826-9de2-901c0bb8bb71 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:13.175647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8aaf2763-d549-4826-9de2-901c0bb8bb71 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:13.262024 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-8aaf2763-d549-4826-9de2-901c0bb8bb71 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] HTTP exception thrown: Instance 4687cce6-5bb7-4314-b789-3d2afa350bf1 could not be found. Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8aaf2763-d549-4826-9de2-901c0bb8bb71 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Request method failure captured: Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 HTTP/1.1 Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dV6gLkChIK4kIYp64d-ZjEwa9Y7ybgK62ODQW-5yuqMz-RtKJ9Ls2Sw_ypBR67QnwzXYTA63zat_snHushsYOw0jlsSYaYwcQghLX-hecbxSawedlQ3gxQaLdpBZF2R-9MVV9uzzZOfyOeaF7N-WX_HAgSXqVjLS2jRARtiaiUjUq0 Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.47 Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 6068cf446fa244b29de74230a5add9eb Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerShowV247Test-1612967139 Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6068cf446fa244b29de74230a5add9eb", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6068cf446fa244b29de74230a5add9eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6068cf446fa244b29de74230a5add9eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6068cf446fa244b29de74230a5add9eb"}]}] Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerShowV247Test-1612967139 Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 6068cf446fa244b29de74230a5add9eb Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerShowV247Test-1612967139 Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerShowV247Test-1612967139-project Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 938d59e603744bb5aafa6c57c8f1e516 Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerShowV247Test-1612967139-project Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 4687cce6-5bb7-4314-b789-3d2afa350bf1 could not be found. Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '4687cce6-5bb7-4314-b789-3d2afa350bf1'} Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4687cce6-5bb7-4314-b789-3d2afa350bf1 could not be found. Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4687cce6-5bb7-4314-b789-3d2afa350bf1 could not be found. Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:13.272959 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:13.279119 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:13.279119 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:13.279119 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:13.279119 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:56:13.279119 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:56:13.279119 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4687cce6-5bb7-4314-b789-3d2afa350bf1 could not be found. Aug 03 01:56:13.279119 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:13.279119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8aaf2763-d549-4826-9de2-901c0bb8bb71 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Returning 404 to user: Instance 4687cce6-5bb7-4314-b789-3d2afa350bf1 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:56:13.279119 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8aaf2763-d549-4826-9de2-901c0bb8bb71 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1" status: 404 len: 111 microversion: 2.47 time: 0.210610 Aug 03 01:56:13.281608 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1124/2250] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:13 2022] GET /compute/v2.1/servers/4687cce6-5bb7-4314-b789-3d2afa350bf1 => generated 111 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:56:13.295873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0a123f5-2ca8-4554-b9c8-3dd32d39f2f3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:13.296517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0a123f5-2ca8-4554-b9c8-3dd32d39f2f3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:13.322176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0a123f5-2ca8-4554-b9c8-3dd32d39f2f3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:13.323379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0a123f5-2ca8-4554-b9c8-3dd32d39f2f3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:13.326280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0a123f5-2ca8-4554-b9c8-3dd32d39f2f3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:13.326766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0a123f5-2ca8-4554-b9c8-3dd32d39f2f3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:13.571101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c5075ecb-4710-4593-9b29-497642e02d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:13.593148 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5075ecb-4710-4593-9b29-497642e02d90 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.752465 Aug 03 01:56:13.596367 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1127/2251] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:12 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:13.618347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8ffc2175-30b1-4858-a2e5-392493c2aca2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:13.621172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8ffc2175-30b1-4858-a2e5-392493c2aca2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 3b2c8651-b723-4185-9b8c-0e4f48a248ea] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:13.651076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ffc2175-30b1-4858-a2e5-392493c2aca2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:13.653759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ffc2175-30b1-4858-a2e5-392493c2aca2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:13.661260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ffc2175-30b1-4858-a2e5-392493c2aca2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:13.661977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ffc2175-30b1-4858-a2e5-392493c2aca2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:13.787538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8ffc2175-30b1-4858-a2e5-392493c2aca2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 3b2c8651-b723-4185-9b8c-0e4f48a248ea] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:56:13.856536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0a123f5-2ca8-4554-b9c8-3dd32d39f2f3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:13.872535 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0a123f5-2ca8-4554-b9c8-3dd32d39f2f3 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.589837 Aug 03 01:56:13.883575 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1125/2252] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:13 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:13.912285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d80774a-385c-427d-aff4-619a4b8a4bbe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:13.914800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8d80774a-385c-427d-aff4-619a4b8a4bbe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:13.943076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d80774a-385c-427d-aff4-619a4b8a4bbe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:13.944888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d80774a-385c-427d-aff4-619a4b8a4bbe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:13.947714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d80774a-385c-427d-aff4-619a4b8a4bbe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:13.949338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d80774a-385c-427d-aff4-619a4b8a4bbe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:14.076279 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8ffc2175-30b1-4858-a2e5-392493c2aca2 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3b2c8651-b723-4185-9b8c-0e4f48a248ea" status: 204 len: 0 microversion: 2.47 time: 0.475760 Aug 03 01:56:14.080100 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1128/2253] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 01:56:13 2022] DELETE /compute/v2.1/servers/3b2c8651-b723-4185-9b8c-0e4f48a248ea => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:56:14.089862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8aac944a-32e2-4b79-a9b0-e9cd6f7d3191 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:14.104699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8aac944a-32e2-4b79-a9b0-e9cd6f7d3191 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:14.131809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8aac944a-32e2-4b79-a9b0-e9cd6f7d3191 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:14.139891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8aac944a-32e2-4b79-a9b0-e9cd6f7d3191 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:14.146036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8aac944a-32e2-4b79-a9b0-e9cd6f7d3191 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:14.148005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8aac944a-32e2-4b79-a9b0-e9cd6f7d3191 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:14.295684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8d80774a-385c-427d-aff4-619a4b8a4bbe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:14.314873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8d80774a-385c-427d-aff4-619a4b8a4bbe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:14.318348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8d80774a-385c-427d-aff4-619a4b8a4bbe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:14.325174 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8d80774a-385c-427d-aff4-619a4b8a4bbe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.439844 Aug 03 01:56:14.326091 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1126/2254] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:13 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:14.341827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a237dab5-d4cc-477d-b72e-816d388fc226 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b136d9430>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:14.475429 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a237dab5-d4cc-477d-b72e-816d388fc226 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f" status: 200 len: 1414 microversion: 2.1 time: 0.144385 Aug 03 01:56:14.476329 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1127/2255] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:56:14 2022] GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f => generated 1414 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:14.489931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-adcb0183-faac-4864-87e9-3fe2a7343b81 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:14.491383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-adcb0183-faac-4864-87e9-3fe2a7343b81 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 3b2c8651-b723-4185-9b8c-0e4f48a248ea] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:14.509290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adcb0183-faac-4864-87e9-3fe2a7343b81 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:14.510092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adcb0183-faac-4864-87e9-3fe2a7343b81 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:14.512100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adcb0183-faac-4864-87e9-3fe2a7343b81 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:14.514000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adcb0183-faac-4864-87e9-3fe2a7343b81 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:14.670346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-adcb0183-faac-4864-87e9-3fe2a7343b81 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:14.679953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-adcb0183-faac-4864-87e9-3fe2a7343b81 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:14.686208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-adcb0183-faac-4864-87e9-3fe2a7343b81 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:14.689514 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-adcb0183-faac-4864-87e9-3fe2a7343b81 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/3b2c8651-b723-4185-9b8c-0e4f48a248ea" status: 200 len: 1363 microversion: 2.47 time: 0.209401 Aug 03 01:56:14.700584 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1128/2256] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:14 2022] GET /compute/v2.1/servers/3b2c8651-b723-4185-9b8c-0e4f48a248ea => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:14.702106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-636e965d-8ad9-4b3f-8dc8-c44f9e996fb8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:14.708223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-636e965d-8ad9-4b3f-8dc8-c44f9e996fb8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:14.712489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8aac944a-32e2-4b79-a9b0-e9cd6f7d3191 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:14.721255 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8aac944a-32e2-4b79-a9b0-e9cd6f7d3191 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1734 microversion: 2.1 time: 0.639522 Aug 03 01:56:14.726045 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1129/2257] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:14 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1734 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:14.728605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-636e965d-8ad9-4b3f-8dc8-c44f9e996fb8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:14.728812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-636e965d-8ad9-4b3f-8dc8-c44f9e996fb8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:14.729636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-636e965d-8ad9-4b3f-8dc8-c44f9e996fb8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:14.730091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-636e965d-8ad9-4b3f-8dc8-c44f9e996fb8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:14.907599 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a76c6296-4617-43ca-986e-2d3b15467af2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:14.908225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a76c6296-4617-43ca-986e-2d3b15467af2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:14.928008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a76c6296-4617-43ca-986e-2d3b15467af2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:14.932366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a76c6296-4617-43ca-986e-2d3b15467af2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:14.935366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a76c6296-4617-43ca-986e-2d3b15467af2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:14.935828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a76c6296-4617-43ca-986e-2d3b15467af2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:15.301606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-636e965d-8ad9-4b3f-8dc8-c44f9e996fb8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:15.313716 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-636e965d-8ad9-4b3f-8dc8-c44f9e996fb8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 0.620739 Aug 03 01:56:15.314396 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1129/2258] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:14 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:15.353095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ef3729be-84e6-4859-bfa5-bc619ba3dd52 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:15.353095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ef3729be-84e6-4859-bfa5-bc619ba3dd52 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:15.373055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef3729be-84e6-4859-bfa5-bc619ba3dd52 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:15.373738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef3729be-84e6-4859-bfa5-bc619ba3dd52 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:15.375729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef3729be-84e6-4859-bfa5-bc619ba3dd52 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:15.379937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef3729be-84e6-4859-bfa5-bc619ba3dd52 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:15.436879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a76c6296-4617-43ca-986e-2d3b15467af2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:15.446585 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a76c6296-4617-43ca-986e-2d3b15467af2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.545196 Aug 03 01:56:15.447215 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1130/2259] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:14 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:15.492892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1bfea439-eaee-4c69-bbb9-40c5093d47cf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b128a8160>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:15.624470 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1bfea439-eaee-4c69-bbb9-40c5093d47cf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f" status: 200 len: 1414 microversion: 2.1 time: 0.136446 Aug 03 01:56:15.625383 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1131/2260] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:56:15 2022] GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f => generated 1414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:15.718346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9e8c5fc5-8c69-40d8-8974-94c37b53088e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:15.720075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9e8c5fc5-8c69-40d8-8974-94c37b53088e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 3b2c8651-b723-4185-9b8c-0e4f48a248ea] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:15.740815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e8c5fc5-8c69-40d8-8974-94c37b53088e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:15.741903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e8c5fc5-8c69-40d8-8974-94c37b53088e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:15.743731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e8c5fc5-8c69-40d8-8974-94c37b53088e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:15.746793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e8c5fc5-8c69-40d8-8974-94c37b53088e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:15.844219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ef3729be-84e6-4859-bfa5-bc619ba3dd52 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:15.865504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ef3729be-84e6-4859-bfa5-bc619ba3dd52 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:15.876337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ef3729be-84e6-4859-bfa5-bc619ba3dd52 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:15.897245 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ef3729be-84e6-4859-bfa5-bc619ba3dd52 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.546884 Aug 03 01:56:15.903476 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1130/2261] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:15 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:15.927966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d6d3fd4f-f8aa-4d0c-9295-963d056ebf41 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:15.934693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d6d3fd4f-f8aa-4d0c-9295-963d056ebf41 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:15.974000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6d3fd4f-f8aa-4d0c-9295-963d056ebf41 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:15.974459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6d3fd4f-f8aa-4d0c-9295-963d056ebf41 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:15.975464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6d3fd4f-f8aa-4d0c-9295-963d056ebf41 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:15.986142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6d3fd4f-f8aa-4d0c-9295-963d056ebf41 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:15.992434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9e8c5fc5-8c69-40d8-8974-94c37b53088e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:16.016238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9e8c5fc5-8c69-40d8-8974-94c37b53088e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:16.020487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9e8c5fc5-8c69-40d8-8974-94c37b53088e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:16.025682 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9e8c5fc5-8c69-40d8-8974-94c37b53088e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/3b2c8651-b723-4185-9b8c-0e4f48a248ea" status: 200 len: 1363 microversion: 2.47 time: 0.308851 Aug 03 01:56:16.030316 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1132/2262] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:15 2022] GET /compute/v2.1/servers/3b2c8651-b723-4185-9b8c-0e4f48a248ea => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:16.342114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-712e4de2-c235-4955-918e-3ee92ebc04f6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:16.346230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-712e4de2-c235-4955-918e-3ee92ebc04f6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:16.391576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-712e4de2-c235-4955-918e-3ee92ebc04f6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:16.393983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-712e4de2-c235-4955-918e-3ee92ebc04f6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:16.398287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-712e4de2-c235-4955-918e-3ee92ebc04f6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:16.399198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-712e4de2-c235-4955-918e-3ee92ebc04f6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:16.502032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d6d3fd4f-f8aa-4d0c-9295-963d056ebf41 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:16.522084 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d6d3fd4f-f8aa-4d0c-9295-963d056ebf41 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1734 microversion: 2.1 time: 0.616943 Aug 03 01:56:16.531233 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1131/2263] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:15 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1734 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:16.553492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-705c936e-ce13-46b6-b10f-2dd32ab1fdee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:16.554722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-705c936e-ce13-46b6-b10f-2dd32ab1fdee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:16.585198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:16.591616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-705c936e-ce13-46b6-b10f-2dd32ab1fdee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:16.595946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-705c936e-ce13-46b6-b10f-2dd32ab1fdee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:16.603745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-705c936e-ce13-46b6-b10f-2dd32ab1fdee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:16.607406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-705c936e-ce13-46b6-b10f-2dd32ab1fdee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:16.810262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:17.477785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-705c936e-ce13-46b6-b10f-2dd32ab1fdee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:17.496183 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-705c936e-ce13-46b6-b10f-2dd32ab1fdee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.962911 Aug 03 01:56:17.496920 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1132/2264] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:16 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:17.499552 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-712e4de2-c235-4955-918e-3ee92ebc04f6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:17.513925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-972be0cf-e30d-4627-8741-0b550bf0c7ab tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b134c1c10>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:17.522689 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-712e4de2-c235-4955-918e-3ee92ebc04f6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1506 microversion: 2.1 time: 1.181255 Aug 03 01:56:17.568614 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1133/2265] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:16 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1506 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:17.591373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d8c32b68-2237-4901-b4f9-bde5e55b00bd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:17.594325 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-972be0cf-e30d-4627-8741-0b550bf0c7ab tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f" status: 200 len: 1414 microversion: 2.1 time: 0.095586 Aug 03 01:56:17.598140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d8c32b68-2237-4901-b4f9-bde5e55b00bd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:17.604089 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1133/2266] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:56:17 2022] GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:17.617180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-39fec35c-b087-4286-900b-094b645bce34 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:17.625064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-39fec35c-b087-4286-900b-094b645bce34 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 3b2c8651-b723-4185-9b8c-0e4f48a248ea] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:17.636865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39fec35c-b087-4286-900b-094b645bce34 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:17.637615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39fec35c-b087-4286-900b-094b645bce34 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:17.638610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39fec35c-b087-4286-900b-094b645bce34 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:17.639416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39fec35c-b087-4286-900b-094b645bce34 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:17.652046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:17.661628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8c32b68-2237-4901-b4f9-bde5e55b00bd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:17.663079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8c32b68-2237-4901-b4f9-bde5e55b00bd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:17.681780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8c32b68-2237-4901-b4f9-bde5e55b00bd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:17.686829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8c32b68-2237-4901-b4f9-bde5e55b00bd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:17.994361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-39fec35c-b087-4286-900b-094b645bce34 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:18.010855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-39fec35c-b087-4286-900b-094b645bce34 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:18.022720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-39fec35c-b087-4286-900b-094b645bce34 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938d59e603744bb5aafa6c57c8f1e516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6068cf446fa244b29de74230a5add9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:18.026257 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-39fec35c-b087-4286-900b-094b645bce34 tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/3b2c8651-b723-4185-9b8c-0e4f48a248ea" status: 200 len: 1363 microversion: 2.47 time: 0.418083 Aug 03 01:56:18.027360 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1134/2267] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:17 2022] GET /compute/v2.1/servers/3b2c8651-b723-4185-9b8c-0e4f48a248ea => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:18.039782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1c6d398c-80b2-4279-95e8-5aa20977c2bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:18.040537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1c6d398c-80b2-4279-95e8-5aa20977c2bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:18.058279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c6d398c-80b2-4279-95e8-5aa20977c2bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:18.059038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c6d398c-80b2-4279-95e8-5aa20977c2bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:18.060028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c6d398c-80b2-4279-95e8-5aa20977c2bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:18.062334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c6d398c-80b2-4279-95e8-5aa20977c2bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:18.154190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1c6d398c-80b2-4279-95e8-5aa20977c2bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:56:18.187538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d8c32b68-2237-4901-b4f9-bde5e55b00bd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:18.200558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d8c32b68-2237-4901-b4f9-bde5e55b00bd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:18.208341 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d8c32b68-2237-4901-b4f9-bde5e55b00bd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:18.212015 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d8c32b68-2237-4901-b4f9-bde5e55b00bd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.640140 Aug 03 01:56:18.214486 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1134/2268] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:17 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:18.220193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d779d825-4d49-4a14-a131-4d4aa89b9980 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:18.220982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d779d825-4d49-4a14-a131-4d4aa89b9980 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:18.234430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d779d825-4d49-4a14-a131-4d4aa89b9980 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:18.235245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d779d825-4d49-4a14-a131-4d4aa89b9980 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:18.236387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d779d825-4d49-4a14-a131-4d4aa89b9980 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:18.237008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d779d825-4d49-4a14-a131-4d4aa89b9980 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:18.443594 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1c6d398c-80b2-4279-95e8-5aa20977c2bf tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "DELETE /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 204 len: 0 microversion: 2.1 time: 0.414750 Aug 03 01:56:18.445135 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1135/2269] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:56:18 2022] DELETE /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:56:18.460403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8dff46eb-bc44-465f-9945-0a320997ab3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:18.461123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8dff46eb-bc44-465f-9945-0a320997ab3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:18.489121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8dff46eb-bc44-465f-9945-0a320997ab3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:18.489611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8dff46eb-bc44-465f-9945-0a320997ab3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:18.495242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8dff46eb-bc44-465f-9945-0a320997ab3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:18.495792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8dff46eb-bc44-465f-9945-0a320997ab3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:18.703230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d779d825-4d49-4a14-a131-4d4aa89b9980 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:18.731834 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d779d825-4d49-4a14-a131-4d4aa89b9980 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1734 microversion: 2.1 time: 0.505648 Aug 03 01:56:18.761427 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1135/2270] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:18 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1734 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:18.773272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d61350a9-a666-4eb3-968b-f2e210a929fc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:18.782372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d61350a9-a666-4eb3-968b-f2e210a929fc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:18.798051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d61350a9-a666-4eb3-968b-f2e210a929fc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:18.799443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d61350a9-a666-4eb3-968b-f2e210a929fc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:18.803256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d61350a9-a666-4eb3-968b-f2e210a929fc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:18.804010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d61350a9-a666-4eb3-968b-f2e210a929fc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:18.865830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8dff46eb-bc44-465f-9945-0a320997ab3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:18.875347 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8dff46eb-bc44-465f-9945-0a320997ab3b tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1669 microversion: 2.1 time: 0.426407 Aug 03 01:56:18.884944 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1136/2271] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:18 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1669 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:18.906137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b1eba591-100b-4ed3-b767-861fe023e7d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:18.908550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b1eba591-100b-4ed3-b767-861fe023e7d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:18.934093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1eba591-100b-4ed3-b767-861fe023e7d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:18.938487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1eba591-100b-4ed3-b767-861fe023e7d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:18.939661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1eba591-100b-4ed3-b767-861fe023e7d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:18.950129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1eba591-100b-4ed3-b767-861fe023e7d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:19.365667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b1eba591-100b-4ed3-b767-861fe023e7d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:19.382357 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b1eba591-100b-4ed3-b767-861fe023e7d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1486 microversion: 2.1 time: 0.490883 Aug 03 01:56:19.394931 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1137/2272] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:18 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1486 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:19.395963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-23520d10-ec8a-445d-8d33-2892467c3470 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b13a954c0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:19.517851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d61350a9-a666-4eb3-968b-f2e210a929fc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:19.523943 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d61350a9-a666-4eb3-968b-f2e210a929fc tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.760998 Aug 03 01:56:19.525015 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1136/2273] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:18 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:19.530671 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-23520d10-ec8a-445d-8d33-2892467c3470 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f" status: 200 len: 1414 microversion: 2.1 time: 0.145882 Aug 03 01:56:19.531652 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5bdd1acb-a310-46db-a772-e346bfe77a6e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:19.532460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5bdd1acb-a310-46db-a772-e346bfe77a6e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] [instance: 3b2c8651-b723-4185-9b8c-0e4f48a248ea] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:19.535290 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1138/2274] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:56:19 2022] GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f => generated 1414 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:19.559864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2b6303cf-6b73-44d1-b06c-4991e6e26bd8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:19.563763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2b6303cf-6b73-44d1-b06c-4991e6e26bd8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:19.569593 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bdd1acb-a310-46db-a772-e346bfe77a6e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:19.570035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bdd1acb-a310-46db-a772-e346bfe77a6e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:19.570937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bdd1acb-a310-46db-a772-e346bfe77a6e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:19.580979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bdd1acb-a310-46db-a772-e346bfe77a6e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:19.590274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b6303cf-6b73-44d1-b06c-4991e6e26bd8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:19.591239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b6303cf-6b73-44d1-b06c-4991e6e26bd8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:19.592858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b6303cf-6b73-44d1-b06c-4991e6e26bd8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:19.593720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b6303cf-6b73-44d1-b06c-4991e6e26bd8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:19.650760 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-5bdd1acb-a310-46db-a772-e346bfe77a6e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] HTTP exception thrown: Instance 3b2c8651-b723-4185-9b8c-0e4f48a248ea could not be found. Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5bdd1acb-a310-46db-a772-e346bfe77a6e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Request method failure captured: Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/3b2c8651-b723-4185-9b8c-0e4f48a248ea HTTP/1.1 Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dV6gLkChIK4kIYp64d-ZjEwa9Y7ybgK62ODQW-5yuqMz-RtKJ9Ls2Sw_ypBR67QnwzXYTA63zat_snHushsYOw0jlsSYaYwcQghLX-hecbxSawedlQ3gxQaLdpBZF2R-9MVV9uzzZOfyOeaF7N-WX_HAgSXqVjLS2jRARtiaiUjUq0 Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Openstack-Nova-Api-Version: 2.47 Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 6068cf446fa244b29de74230a5add9eb Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerShowV247Test-1612967139 Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6068cf446fa244b29de74230a5add9eb", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6068cf446fa244b29de74230a5add9eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6068cf446fa244b29de74230a5add9eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6068cf446fa244b29de74230a5add9eb"}]}] Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerShowV247Test-1612967139 Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 6068cf446fa244b29de74230a5add9eb Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerShowV247Test-1612967139 Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerShowV247Test-1612967139-project Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 938d59e603744bb5aafa6c57c8f1e516 Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerShowV247Test-1612967139-project Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 3b2c8651-b723-4185-9b8c-0e4f48a248ea could not be found. Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '3b2c8651-b723-4185-9b8c-0e4f48a248ea'} Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2c8651-b723-4185-9b8c-0e4f48a248ea could not be found. Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2c8651-b723-4185-9b8c-0e4f48a248ea could not be found. Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:19.678331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:19.684257 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:19.684257 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:19.684257 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:19.684257 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:56:19.684257 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:56:19.684257 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2c8651-b723-4185-9b8c-0e4f48a248ea could not be found. Aug 03 01:56:19.684257 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:19.687496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5bdd1acb-a310-46db-a772-e346bfe77a6e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] Returning 404 to user: Instance 3b2c8651-b723-4185-9b8c-0e4f48a248ea could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:56:19.688371 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5bdd1acb-a310-46db-a772-e346bfe77a6e tempest-ServerShowV247Test-1612967139 tempest-ServerShowV247Test-1612967139-project] 10.222.0.67 "GET /compute/v2.1/servers/3b2c8651-b723-4185-9b8c-0e4f48a248ea" status: 404 len: 111 microversion: 2.47 time: 0.162082 Aug 03 01:56:19.688944 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1137/2275] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:19 2022] GET /compute/v2.1/servers/3b2c8651-b723-4185-9b8c-0e4f48a248ea => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:56:19.761929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-08842907-904f-4e86-ade1-2d4bf32d238c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:19.763299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-08842907-904f-4e86-ade1-2d4bf32d238c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:19.787904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08842907-904f-4e86-ade1-2d4bf32d238c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:19.792428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08842907-904f-4e86-ade1-2d4bf32d238c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:19.793529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08842907-904f-4e86-ade1-2d4bf32d238c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:19.794156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08842907-904f-4e86-ade1-2d4bf32d238c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:20.628366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2b6303cf-6b73-44d1-b06c-4991e6e26bd8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:20.641963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2b6303cf-6b73-44d1-b06c-4991e6e26bd8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:20.653889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2b6303cf-6b73-44d1-b06c-4991e6e26bd8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:20.655764 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2b6303cf-6b73-44d1-b06c-4991e6e26bd8 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 1.119256 Aug 03 01:56:20.672136 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1139/2276] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:19 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:20.682235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2083781152", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:20.736310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-08842907-904f-4e86-ade1-2d4bf32d238c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:20.759733 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-08842907-904f-4e86-ade1-2d4bf32d238c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1734 microversion: 2.1 time: 1.000567 Aug 03 01:56:20.761447 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1138/2277] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:19 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1734 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:20.771045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5c8b22ce-b7a2-40fe-b982-d265d7f054ab tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:20.776980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5c8b22ce-b7a2-40fe-b982-d265d7f054ab tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:20.789323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c8b22ce-b7a2-40fe-b982-d265d7f054ab tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:20.792825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c8b22ce-b7a2-40fe-b982-d265d7f054ab tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:20.793822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c8b22ce-b7a2-40fe-b982-d265d7f054ab tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:20.796686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c8b22ce-b7a2-40fe-b982-d265d7f054ab tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:20.850396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] validate_networks() for [('0fa315af-cf7c-44e3-85d0-00b33819492e', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:56:21.795645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5c8b22ce-b7a2-40fe-b982-d265d7f054ab tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:21.820769 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5c8b22ce-b7a2-40fe-b982-d265d7f054ab tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1669 microversion: 2.1 time: 1.057143 Aug 03 01:56:21.821904 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1139/2278] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:20 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1669 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:21.828759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-12e52a4c-4ca5-430b-a0e8-3f9aa8762f25 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b12abaee0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:21.915276 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-12e52a4c-4ca5-430b-a0e8-3f9aa8762f25 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f" status: 200 len: 1414 microversion: 2.1 time: 0.091780 Aug 03 01:56:21.916874 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1140/2279] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:56:21 2022] GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:21.929159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c3105a99-31fa-4067-aad2-07245f4ffbcd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:21.930329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c3105a99-31fa-4067-aad2-07245f4ffbcd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:21.938890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3105a99-31fa-4067-aad2-07245f4ffbcd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:21.939750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3105a99-31fa-4067-aad2-07245f4ffbcd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:21.941768 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3105a99-31fa-4067-aad2-07245f4ffbcd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:21.942985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3105a99-31fa-4067-aad2-07245f4ffbcd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:22.657023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c3105a99-31fa-4067-aad2-07245f4ffbcd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:22.677941 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c3105a99-31fa-4067-aad2-07245f4ffbcd tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.759921 Aug 03 01:56:22.683733 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1141/2280] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:21 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:22.691844 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-228e09be-c86f-4ad2-b71d-ff425cbbc4d5 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:22.693766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-228e09be-c86f-4ad2-b71d-ff425cbbc4d5 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:22.719774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-228e09be-c86f-4ad2-b71d-ff425cbbc4d5 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:22.733623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-228e09be-c86f-4ad2-b71d-ff425cbbc4d5 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:22.735054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-228e09be-c86f-4ad2-b71d-ff425cbbc4d5 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:22.735760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-228e09be-c86f-4ad2-b71d-ff425cbbc4d5 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:23.407916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-228e09be-c86f-4ad2-b71d-ff425cbbc4d5 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:23.423460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-228e09be-c86f-4ad2-b71d-ff425cbbc4d5 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:23.428322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-228e09be-c86f-4ad2-b71d-ff425cbbc4d5 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:23.429803 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-228e09be-c86f-4ad2-b71d-ff425cbbc4d5 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.744817 Aug 03 01:56:23.434458 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1142/2281] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:22 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:23.450132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-76becb00-cba4-4252-a3e7-e84f60952949 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:23.450759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-76becb00-cba4-4252-a3e7-e84f60952949 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:23.452636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:56:23.453137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:56:23.453547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:56:23.453969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:56:23.454394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:56:23.478968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:23.479520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:23.481806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76becb00-cba4-4252-a3e7-e84f60952949 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:23.483553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:23.483941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76becb00-cba4-4252-a3e7-e84f60952949 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:23.484786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76becb00-cba4-4252-a3e7-e84f60952949 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:23.485231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76becb00-cba4-4252-a3e7-e84f60952949 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:23.485659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:23.574713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Getting quotas for project 5afa51a97bca4402b44c445a5382e23e. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:56:23.597850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Getting quotas for user 1849063489bf44fabc0785643c0c28e2 and project 5afa51a97bca4402b44c445a5382e23e. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:56:23.633761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:56:23.637890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:56:23.745094 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f3913e00-b225-4a64-bec8-ec9d3e728a2a tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.070729 Aug 03 01:56:23.749838 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1140/2282] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:56:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 3077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:56:23.771692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4f69c149-9b9c-4124-afe4-fb1a85b8b0ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:23.776609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4f69c149-9b9c-4124-afe4-fb1a85b8b0ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:23.793205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f69c149-9b9c-4124-afe4-fb1a85b8b0ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:23.796114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f69c149-9b9c-4124-afe4-fb1a85b8b0ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:23.797821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f69c149-9b9c-4124-afe4-fb1a85b8b0ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:23.801626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f69c149-9b9c-4124-afe4-fb1a85b8b0ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:24.161870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4f69c149-9b9c-4124-afe4-fb1a85b8b0ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:24.176498 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4f69c149-9b9c-4124-afe4-fb1a85b8b0ee tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 200 len: 1601 microversion: 2.1 time: 0.422606 Aug 03 01:56:24.186970 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1141/2283] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:23 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 1601 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:24.192776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7fa163d3-1d12-4559-b68f-8f4318ef9676 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b13a23ee0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:24.213221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-76becb00-cba4-4252-a3e7-e84f60952949 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:24.250840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:24.279807 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-76becb00-cba4-4252-a3e7-e84f60952949 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1734 microversion: 2.1 time: 0.844035 Aug 03 01:56:24.281610 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1143/2284] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:23 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1734 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:24.283572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-76becb00-cba4-4252-a3e7-e84f60952949 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:24.285912 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-76becb00-cba4-4252-a3e7-e84f60952949 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002031 Aug 03 01:56:24.286832 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1144/2285] 10.222.0.67 () {56 vars in 886 bytes} [Wed Aug 3 01:56:24 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 03 01:56:24.297811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d5dbed01-2fb4-4864-80c9-3638d368ae1b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:24.298635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d5dbed01-2fb4-4864-80c9-3638d368ae1b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:24.313795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5dbed01-2fb4-4864-80c9-3638d368ae1b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:24.320528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5dbed01-2fb4-4864-80c9-3638d368ae1b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:24.322129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5dbed01-2fb4-4864-80c9-3638d368ae1b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:24.322858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5dbed01-2fb4-4864-80c9-3638d368ae1b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:24.997899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d5dbed01-2fb4-4864-80c9-3638d368ae1b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:25.008248 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d5dbed01-2fb4-4864-80c9-3638d368ae1b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.720050 Aug 03 01:56:25.014641 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1145/2286] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:24 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:25.039767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-49b3e657-1968-498c-b195-3b5487d17e20 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:25.041248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-49b3e657-1968-498c-b195-3b5487d17e20 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:25.405591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-49b3e657-1968-498c-b195-3b5487d17e20 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:25.421018 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-49b3e657-1968-498c-b195-3b5487d17e20 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1214 microversion: 2.1 time: 0.403858 Aug 03 01:56:25.425646 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1146/2287] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:25 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1214 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:25.459143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-4ba14a46-741f-4049-8a70-62f952a5da01 req-726faf10-e28f-41e0-9534-9c67118cb2dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be0bf271-225a-4ad9-baf8-c7dad07593c7", "name": "network-vif-deleted", "tag": "099d436b-29db-46ff-b84a-deb5403a674f"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:25.511027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4ba14a46-741f-4049-8a70-62f952a5da01 req-726faf10-e28f-41e0-9534-9c67118cb2dd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:25.511487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4ba14a46-741f-4049-8a70-62f952a5da01 req-726faf10-e28f-41e0-9534-9c67118cb2dd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:25.571324 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-4ba14a46-741f-4049-8a70-62f952a5da01 req-726faf10-e28f-41e0-9534-9c67118cb2dd service nova] Creating event network-vif-deleted:099d436b-29db-46ff-b84a-deb5403a674f for instance be0bf271-225a-4ad9-baf8-c7dad07593c7 on n-h2-826529-8 Aug 03 01:56:25.588435 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-4ba14a46-741f-4049-8a70-62f952a5da01 req-726faf10-e28f-41e0-9534-9c67118cb2dd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158379 Aug 03 01:56:25.597638 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1147/2288] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:25.604060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-4ba14a46-741f-4049-8a70-62f952a5da01 req-726faf10-e28f-41e0-9534-9c67118cb2dd service nova] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:25.607098 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-4ba14a46-741f-4049-8a70-62f952a5da01 req-726faf10-e28f-41e0-9534-9c67118cb2dd service nova] 10.222.0.67 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.006308 Aug 03 01:56:25.608091 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1148/2289] 10.222.0.67 () {54 vars in 1035 bytes} [Wed Aug 3 01:56:25 2022] GET /compute/v2/ => generated 379 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 03 01:56:25.626029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-88ddb580-9e5c-42e7-8071-79bb52e368aa tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:25.634782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-88ddb580-9e5c-42e7-8071-79bb52e368aa tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:25.648673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88ddb580-9e5c-42e7-8071-79bb52e368aa tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:25.649369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88ddb580-9e5c-42e7-8071-79bb52e368aa tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:25.653708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88ddb580-9e5c-42e7-8071-79bb52e368aa tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:25.656214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88ddb580-9e5c-42e7-8071-79bb52e368aa tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:26.096143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-88ddb580-9e5c-42e7-8071-79bb52e368aa tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:26.107522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-88ddb580-9e5c-42e7-8071-79bb52e368aa tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:26.111833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-88ddb580-9e5c-42e7-8071-79bb52e368aa tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:26.119672 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-88ddb580-9e5c-42e7-8071-79bb52e368aa tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.509635 Aug 03 01:56:26.125354 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1149/2290] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:25 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:26.147799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-61eca90f-c1f6-43d0-9bef-f80be9090610 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:26.157425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-61eca90f-c1f6-43d0-9bef-f80be9090610 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: be0bf271-225a-4ad9-baf8-c7dad07593c7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:26.169071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61eca90f-c1f6-43d0-9bef-f80be9090610 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:26.173615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61eca90f-c1f6-43d0-9bef-f80be9090610 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:26.175687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61eca90f-c1f6-43d0-9bef-f80be9090610 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:26.176622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61eca90f-c1f6-43d0-9bef-f80be9090610 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:26.218613 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-61eca90f-c1f6-43d0-9bef-f80be9090610 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] HTTP exception thrown: Instance be0bf271-225a-4ad9-baf8-c7dad07593c7 could not be found. Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-61eca90f-c1f6-43d0-9bef-f80be9090610 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Request method failure captured: Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 HTTP/1.1 Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dQtfaxCugihlL0P-JuHcxaXYvSZwumECUI8oXZW8NjUnOQmnlS-UJeJWloLTa2nkib5iJcuoAKX60UHFAlj4BGPFKzJpj5_lUnKZbgP-NuaKafdXBPg4Z-YfN-tYmO7Dwn93GuQctj6Xv1TcX3wlfTLxer4AdjG_rRaIjDodC-ZS1E Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 5f232cf4e61b4213b592b2a020961630 Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-LiveMigrationTest-495141292 Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f232cf4e61b4213b592b2a020961630", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f232cf4e61b4213b592b2a020961630"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f232cf4e61b4213b592b2a020961630"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f232cf4e61b4213b592b2a020961630"}]}] Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-LiveMigrationTest-495141292 Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 5f232cf4e61b4213b592b2a020961630 Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-LiveMigrationTest-495141292 Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-LiveMigrationTest-495141292-project Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: dd2c77c8ab314584939f1f580d5a6d14 Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-LiveMigrationTest-495141292-project Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance be0bf271-225a-4ad9-baf8-c7dad07593c7 could not be found. Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'be0bf271-225a-4ad9-baf8-c7dad07593c7'} Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be0bf271-225a-4ad9-baf8-c7dad07593c7 could not be found. Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be0bf271-225a-4ad9-baf8-c7dad07593c7 could not be found. Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:26.220330 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:26.229134 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:26.229134 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:26.229134 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:26.229134 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:56:26.229134 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:56:26.229134 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be0bf271-225a-4ad9-baf8-c7dad07593c7 could not be found. Aug 03 01:56:26.229134 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:26.229134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-61eca90f-c1f6-43d0-9bef-f80be9090610 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Returning 404 to user: Instance be0bf271-225a-4ad9-baf8-c7dad07593c7 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:56:26.229134 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-61eca90f-c1f6-43d0-9bef-f80be9090610 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7" status: 404 len: 111 microversion: 2.1 time: 0.093833 Aug 03 01:56:26.235452 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1150/2291] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:26 2022] GET /compute/v2.1/servers/be0bf271-225a-4ad9-baf8-c7dad07593c7 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:56:26.243231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-55650f7e-e496-431b-97a8-33608282d475 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:26.243231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-55650f7e-e496-431b-97a8-33608282d475 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:26.257045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55650f7e-e496-431b-97a8-33608282d475 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:26.264206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55650f7e-e496-431b-97a8-33608282d475 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:26.267211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55650f7e-e496-431b-97a8-33608282d475 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:26.267211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55650f7e-e496-431b-97a8-33608282d475 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:26.802071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-55650f7e-e496-431b-97a8-33608282d475 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:26.816835 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-55650f7e-e496-431b-97a8-33608282d475 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1734 microversion: 2.1 time: 0.580082 Aug 03 01:56:26.833515 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1151/2292] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:26 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1734 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:26.843967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-55650f7e-e496-431b-97a8-33608282d475 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:26.848259 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-55650f7e-e496-431b-97a8-33608282d475 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.010308 Aug 03 01:56:26.849511 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1152/2293] 10.222.0.67 () {54 vars in 1041 bytes} [Wed Aug 3 01:56:26 2022] GET /compute/v2.1/ => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:26.860208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a2ad7143-b129-46db-8ba6-5f4a7d252039 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:26.862585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a2ad7143-b129-46db-8ba6-5f4a7d252039 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:26.880171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2ad7143-b129-46db-8ba6-5f4a7d252039 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:26.880712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2ad7143-b129-46db-8ba6-5f4a7d252039 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:26.881606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2ad7143-b129-46db-8ba6-5f4a7d252039 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:26.883831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2ad7143-b129-46db-8ba6-5f4a7d252039 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:27.248962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a2ad7143-b129-46db-8ba6-5f4a7d252039 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:27.260498 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a2ad7143-b129-46db-8ba6-5f4a7d252039 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.409814 Aug 03 01:56:27.267967 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1153/2294] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:26 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:27.283434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6e822b60-4738-44ae-9c3d-e04ecbd94c63 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '.version_select at 0x7f5b12a7e9d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:27.323714 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6e822b60-4738-44ae-9c3d-e04ecbd94c63 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-122785629" status: 202 len: 0 microversion: 2.1 time: 0.053777 Aug 03 01:56:27.324619 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1154/2295] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 3 01:56:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-122785629 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:56:27.331771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7a296ef2-5b3c-4d2b-ba98-9ee1d96e36a8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:27.332931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7a296ef2-5b3c-4d2b-ba98-9ee1d96e36a8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:27.341968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a296ef2-5b3c-4d2b-ba98-9ee1d96e36a8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:27.342695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a296ef2-5b3c-4d2b-ba98-9ee1d96e36a8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:27.344236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a296ef2-5b3c-4d2b-ba98-9ee1d96e36a8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:27.344866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a296ef2-5b3c-4d2b-ba98-9ee1d96e36a8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:27.434952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7a296ef2-5b3c-4d2b-ba98-9ee1d96e36a8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:27.446930 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7a296ef2-5b3c-4d2b-ba98-9ee1d96e36a8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1284 microversion: 2.1 time: 0.120105 Aug 03 01:56:27.470947 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1155/2296] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:27 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:27.477309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7a296ef2-5b3c-4d2b-ba98-9ee1d96e36a8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:27.484074 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7a296ef2-5b3c-4d2b-ba98-9ee1d96e36a8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006364 Aug 03 01:56:27.485660 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1156/2297] 10.222.0.67 () {56 vars in 886 bytes} [Wed Aug 3 01:56:27 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 03 01:56:27.497888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1d7d4d36-75fc-4259-a1c7-680ca170c38b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:27.505351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1d7d4d36-75fc-4259-a1c7-680ca170c38b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:27.542066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d7d4d36-75fc-4259-a1c7-680ca170c38b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:27.543392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d7d4d36-75fc-4259-a1c7-680ca170c38b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:27.545089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d7d4d36-75fc-4259-a1c7-680ca170c38b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:27.548648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d7d4d36-75fc-4259-a1c7-680ca170c38b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:27.922947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1d7d4d36-75fc-4259-a1c7-680ca170c38b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:27.935894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1d7d4d36-75fc-4259-a1c7-680ca170c38b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:27.939723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1d7d4d36-75fc-4259-a1c7-680ca170c38b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:27.942766 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1d7d4d36-75fc-4259-a1c7-680ca170c38b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.455635 Aug 03 01:56:27.944010 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1157/2298] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:27 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:27.949131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-87798003-1391-4ec8-9452-11f220f2b989 req-1b1ed938-75b2-47a4-956f-768ad438db22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a9c0c8-5bf1-435f-8c6b-74a0b447f966", "name": "network-vif-unplugged", "status": "completed", "tag": "626f469b-7020-4d02-a4c0-f2e58ccd1315"}, {"name": "network-changed", "server_uuid": "e7a9c0c8-5bf1-435f-8c6b-74a0b447f966", "tag": "626f469b-7020-4d02-a4c0-f2e58ccd1315"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:27.967761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-87798003-1391-4ec8-9452-11f220f2b989 req-1b1ed938-75b2-47a4-956f-768ad438db22 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:27.968642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-87798003-1391-4ec8-9452-11f220f2b989 req-1b1ed938-75b2-47a4-956f-768ad438db22 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:27.991989 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-87798003-1391-4ec8-9452-11f220f2b989 req-1b1ed938-75b2-47a4-956f-768ad438db22 service nova] Creating event network-vif-unplugged:626f469b-7020-4d02-a4c0-f2e58ccd1315 for instance e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 on n-h1-826529-8 Aug 03 01:56:27.993796 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-87798003-1391-4ec8-9452-11f220f2b989 req-1b1ed938-75b2-47a4-956f-768ad438db22 service nova] Creating event network-changed:626f469b-7020-4d02-a4c0-f2e58ccd1315 for instance e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 on n-h1-826529-8 Aug 03 01:56:28.017437 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-87798003-1391-4ec8-9452-11f220f2b989 req-1b1ed938-75b2-47a4-956f-768ad438db22 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.071357 Aug 03 01:56:28.020979 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1158/2299] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:28.042021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-13febc83-b420-437b-b77b-6554054963e9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:28.045189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-13febc83-b420-437b-b77b-6554054963e9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:28.067423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13febc83-b420-437b-b77b-6554054963e9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:28.067905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13febc83-b420-437b-b77b-6554054963e9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:28.068710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13febc83-b420-437b-b77b-6554054963e9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:28.069156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13febc83-b420-437b-b77b-6554054963e9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:28.465667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-13febc83-b420-437b-b77b-6554054963e9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:28.487877 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-13febc83-b420-437b-b77b-6554054963e9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1714 microversion: 2.1 time: 0.464206 Aug 03 01:56:28.515977 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1159/2300] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:28 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1714 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:28.539409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a5486375-89c4-4872-883e-d1d5892ed53f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:28.543572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a5486375-89c4-4872-883e-d1d5892ed53f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:28.557667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:28.563394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5486375-89c4-4872-883e-d1d5892ed53f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:28.564404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5486375-89c4-4872-883e-d1d5892ed53f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:28.568315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5486375-89c4-4872-883e-d1d5892ed53f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:28.569900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5486375-89c4-4872-883e-d1d5892ed53f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:29.412429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a5486375-89c4-4872-883e-d1d5892ed53f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:29.423680 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a5486375-89c4-4872-883e-d1d5892ed53f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1469 microversion: 2.1 time: 0.906081 Aug 03 01:56:29.428114 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1160/2301] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:28 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1469 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:29.436264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7c1671a2-9d35-4d4e-a173-53ca059c8f4f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:29.439897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7c1671a2-9d35-4d4e-a173-53ca059c8f4f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:29.450810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c1671a2-9d35-4d4e-a173-53ca059c8f4f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:29.451803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c1671a2-9d35-4d4e-a173-53ca059c8f4f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:29.452906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c1671a2-9d35-4d4e-a173-53ca059c8f4f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:29.453897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c1671a2-9d35-4d4e-a173-53ca059c8f4f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:30.110463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7c1671a2-9d35-4d4e-a173-53ca059c8f4f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:30.125071 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7c1671a2-9d35-4d4e-a173-53ca059c8f4f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1314 microversion: 2.1 time: 0.689646 Aug 03 01:56:30.127212 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1161/2302] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:29 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:30.153819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dfd3d293-862f-4287-b769-9ebf2a42ed9c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:30.154326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dfd3d293-862f-4287-b769-9ebf2a42ed9c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:30.185664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfd3d293-862f-4287-b769-9ebf2a42ed9c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:30.195308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfd3d293-862f-4287-b769-9ebf2a42ed9c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:30.196332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfd3d293-862f-4287-b769-9ebf2a42ed9c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:30.196786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfd3d293-862f-4287-b769-9ebf2a42ed9c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:30.475637 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-dfd3d293-862f-4287-b769-9ebf2a42ed9c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] HTTP exception thrown: Cannot 'detach_volume' instance d537dd36-d584-48d0-9458-81075e06b366 while it is in vm_state rescued Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dfd3d293-862f-4287-b769-9ebf2a42ed9c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Request method failure captured: Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments/163a1498-fa8e-4aed-beef-bfb6d313c4d7 HTTP/1.1 Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dTll7VklSXVKPY7IA1_5ob-tKVm2Z_7z42qGXzDSvTdwVAzc-uu26I_RdtLVhoAwHCuPbYMUDNABwS67wYISa8yagl02RQzcDUh0SQ8u7p5lboe4i0RQPeTExpnFXWWBwbJADXBFZ5wGYauWv3NNIL4oxW8HVYZDtaGv8yUqCCibqo Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c183e2fc6dbb419fbd8fa81c90163adf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}] Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0b99d344c16b4221bcccfe37d32bb69e Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: exception: Cannot 'detach_volume' instance d537dd36-d584-48d0-9458-81075e06b366 while it is in vm_state rescued Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'server_id': 'd537dd36-d584-48d0-9458-81075e06b366', 'id': '163a1498-fa8e-4aed-beef-bfb6d313c4d7'} Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d537dd36-d584-48d0-9458-81075e06b366 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d537dd36-d584-48d0-9458-81075e06b366 while it is in vm_state rescued Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:30.479232 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:30.484559 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:30.484559 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:30.484559 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:56:30.484559 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:56:30.484559 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d537dd36-d584-48d0-9458-81075e06b366 while it is in vm_state rescued Aug 03 01:56:30.484559 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:30.494641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dfd3d293-862f-4287-b769-9ebf2a42ed9c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Returning 409 to user: Cannot 'detach_volume' instance d537dd36-d584-48d0-9458-81075e06b366 while it is in vm_state rescued {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:56:30.496095 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dfd3d293-862f-4287-b769-9ebf2a42ed9c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments/163a1498-fa8e-4aed-beef-bfb6d313c4d7" status: 409 len: 152 microversion: 2.1 time: 0.350215 Aug 03 01:56:30.498958 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1162/2303] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 01:56:30 2022] DELETE /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments/163a1498-fa8e-4aed-beef-bfb6d313c4d7 => generated 152 bytes in 371 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:56:30.524600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5cbb442e-db63-4d15-872c-de622b38271c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:30.528963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5cbb442e-db63-4d15-872c-de622b38271c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:30.594415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5cbb442e-db63-4d15-872c-de622b38271c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:30.596406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5cbb442e-db63-4d15-872c-de622b38271c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:30.600439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5cbb442e-db63-4d15-872c-de622b38271c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:30.602533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5cbb442e-db63-4d15-872c-de622b38271c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:30.978032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5cbb442e-db63-4d15-872c-de622b38271c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:30.992007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5cbb442e-db63-4d15-872c-de622b38271c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:30.997473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5cbb442e-db63-4d15-872c-de622b38271c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:31.000669 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5cbb442e-db63-4d15-872c-de622b38271c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.493469 Aug 03 01:56:31.001826 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1163/2304] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:30 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:31.019764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4e2a7d4-5218-497e-8793-69c27599670f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:31.020807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f4e2a7d4-5218-497e-8793-69c27599670f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:31.034885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4e2a7d4-5218-497e-8793-69c27599670f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:31.036454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4e2a7d4-5218-497e-8793-69c27599670f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:31.037483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4e2a7d4-5218-497e-8793-69c27599670f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:31.040982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4e2a7d4-5218-497e-8793-69c27599670f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:31.121892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f4e2a7d4-5218-497e-8793-69c27599670f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:56:31.431664 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f4e2a7d4-5218-497e-8793-69c27599670f tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 204 len: 0 microversion: 2.1 time: 0.427052 Aug 03 01:56:31.435277 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1164/2305] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:56:31 2022] DELETE /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:56:31.451982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-97cf56a3-4342-4b97-87fc-4edb398e8397 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:31.458765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-97cf56a3-4342-4b97-87fc-4edb398e8397 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:31.468170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97cf56a3-4342-4b97-87fc-4edb398e8397 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:31.468644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97cf56a3-4342-4b97-87fc-4edb398e8397 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:31.469458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97cf56a3-4342-4b97-87fc-4edb398e8397 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:31.470060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97cf56a3-4342-4b97-87fc-4edb398e8397 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:31.968929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-97cf56a3-4342-4b97-87fc-4edb398e8397 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:31.979166 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-97cf56a3-4342-4b97-87fc-4edb398e8397 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1475 microversion: 2.1 time: 0.542489 Aug 03 01:56:31.983541 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1165/2306] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:31 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1475 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:32.009827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ac279b68-04c3-4317-b9f1-bd04ada10e3d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:32.024902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ac279b68-04c3-4317-b9f1-bd04ada10e3d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:32.053211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ac279b68-04c3-4317-b9f1-bd04ada10e3d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:32.053981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ac279b68-04c3-4317-b9f1-bd04ada10e3d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:32.060018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ac279b68-04c3-4317-b9f1-bd04ada10e3d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:32.060666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ac279b68-04c3-4317-b9f1-bd04ada10e3d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:32.127779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:32.243566 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ac279b68-04c3-4317-b9f1-bd04ada10e3d tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/action" status: 202 len: 0 microversion: 2.1 time: 0.255030 Aug 03 01:56:32.258980 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1166/2307] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:56:31 2022] POST /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:56:32.288979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5b4e00a7-8ae6-421b-8faf-0ab1c68eb6a2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:32.290632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5b4e00a7-8ae6-421b-8faf-0ab1c68eb6a2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:32.302652 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b4e00a7-8ae6-421b-8faf-0ab1c68eb6a2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:32.303919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b4e00a7-8ae6-421b-8faf-0ab1c68eb6a2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:32.305410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b4e00a7-8ae6-421b-8faf-0ab1c68eb6a2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:32.306092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b4e00a7-8ae6-421b-8faf-0ab1c68eb6a2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:33.529708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:33.626091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:33.795728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:34.166142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:34.319645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5b4e00a7-8ae6-421b-8faf-0ab1c68eb6a2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:34.335281 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5b4e00a7-8ae6-421b-8faf-0ab1c68eb6a2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1314 microversion: 2.1 time: 2.070227 Aug 03 01:56:34.335947 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1167/2308] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:32 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1314 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:34.355638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f52d8f89-9b3e-4e7d-902d-30ec0c9adad3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:34.356238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f52d8f89-9b3e-4e7d-902d-30ec0c9adad3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:34.381335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f52d8f89-9b3e-4e7d-902d-30ec0c9adad3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:34.381848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f52d8f89-9b3e-4e7d-902d-30ec0c9adad3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:34.382708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f52d8f89-9b3e-4e7d-902d-30ec0c9adad3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:34.383189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f52d8f89-9b3e-4e7d-902d-30ec0c9adad3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:35.419663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:35.618015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f52d8f89-9b3e-4e7d-902d-30ec0c9adad3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:35.630561 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f52d8f89-9b3e-4e7d-902d-30ec0c9adad3 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 200 len: 1484 microversion: 2.1 time: 1.293550 Aug 03 01:56:35.638242 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1168/2309] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:34 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 1484 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:35.648849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-38af1284-51fd-43be-a3be-bbd0f995c8b0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:35.653883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-38af1284-51fd-43be-a3be-bbd0f995c8b0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:35.682953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38af1284-51fd-43be-a3be-bbd0f995c8b0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:35.683423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38af1284-51fd-43be-a3be-bbd0f995c8b0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:35.684256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38af1284-51fd-43be-a3be-bbd0f995c8b0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:35.684674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38af1284-51fd-43be-a3be-bbd0f995c8b0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:36.068631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-38af1284-51fd-43be-a3be-bbd0f995c8b0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:36.084946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-38af1284-51fd-43be-a3be-bbd0f995c8b0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:36.089173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-38af1284-51fd-43be-a3be-bbd0f995c8b0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:36.099134 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-38af1284-51fd-43be-a3be-bbd0f995c8b0 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.459258 Aug 03 01:56:36.106140 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1169/2310] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:35 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:36.118059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-d7d9be4e-8da7-4112-a920-2b424f1335cf req-1cc61b26-5d06-4066-852c-cd7e4d6fef19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c1a495-99ee-4678-bc30-798f3e08b44d", "tag": "2d526941-b201-4313-82bb-04874c53fceb"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:36.140548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d7d9be4e-8da7-4112-a920-2b424f1335cf req-1cc61b26-5d06-4066-852c-cd7e4d6fef19 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:36.141626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d7d9be4e-8da7-4112-a920-2b424f1335cf req-1cc61b26-5d06-4066-852c-cd7e4d6fef19 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:36.199002 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-d7d9be4e-8da7-4112-a920-2b424f1335cf req-1cc61b26-5d06-4066-852c-cd7e4d6fef19 service nova] Creating event network-changed:2d526941-b201-4313-82bb-04874c53fceb for instance a4c1a495-99ee-4678-bc30-798f3e08b44d on n-h2-826529-8 Aug 03 01:56:36.212713 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-d7d9be4e-8da7-4112-a920-2b424f1335cf req-1cc61b26-5d06-4066-852c-cd7e4d6fef19 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103956 Aug 03 01:56:36.219961 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1170/2311] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:36.237148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2c12cf82-5a7c-4cc6-a24c-6a6734b7f198 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:36.242036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2c12cf82-5a7c-4cc6-a24c-6a6734b7f198 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:36.262306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c12cf82-5a7c-4cc6-a24c-6a6734b7f198 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:36.263185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c12cf82-5a7c-4cc6-a24c-6a6734b7f198 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:36.264359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c12cf82-5a7c-4cc6-a24c-6a6734b7f198 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:36.265089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c12cf82-5a7c-4cc6-a24c-6a6734b7f198 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:36.732752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2c12cf82-5a7c-4cc6-a24c-6a6734b7f198 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:36.744772 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2c12cf82-5a7c-4cc6-a24c-6a6734b7f198 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1722 microversion: 2.1 time: 0.521892 Aug 03 01:56:36.751336 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1171/2312] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:36 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1722 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:36.766735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bde887a2-348a-4865-bdee-bbf8a76e49ee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:36.771647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bde887a2-348a-4865-bdee-bbf8a76e49ee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:36.795189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bde887a2-348a-4865-bdee-bbf8a76e49ee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:36.796711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bde887a2-348a-4865-bdee-bbf8a76e49ee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:36.836626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bde887a2-348a-4865-bdee-bbf8a76e49ee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:36.839747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bde887a2-348a-4865-bdee-bbf8a76e49ee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:37.720521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bde887a2-348a-4865-bdee-bbf8a76e49ee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:37.730838 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bde887a2-348a-4865-bdee-bbf8a76e49ee tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1475 microversion: 2.1 time: 0.975425 Aug 03 01:56:37.735345 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1172/2313] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:36 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1475 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:37.751388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-60374b91-7ab8-4099-a986-a569081ec75e req-1d9fcc3b-7d21-4bf2-b66d-9bfb6415d580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb30620-408d-468e-b706-277ce080a2f6", "name": "network-vif-unplugged", "status": "completed", "tag": "9762e114-938b-48d4-8d92-0fae9855c76e"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:37.777155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-60374b91-7ab8-4099-a986-a569081ec75e req-1d9fcc3b-7d21-4bf2-b66d-9bfb6415d580 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:37.777707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-60374b91-7ab8-4099-a986-a569081ec75e req-1d9fcc3b-7d21-4bf2-b66d-9bfb6415d580 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:37.792672 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-60374b91-7ab8-4099-a986-a569081ec75e req-1d9fcc3b-7d21-4bf2-b66d-9bfb6415d580 service nova] Creating event network-vif-unplugged:9762e114-938b-48d4-8d92-0fae9855c76e for instance 0eb30620-408d-468e-b706-277ce080a2f6 on n-h1-826529-8 Aug 03 01:56:37.798584 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-60374b91-7ab8-4099-a986-a569081ec75e req-1d9fcc3b-7d21-4bf2-b66d-9bfb6415d580 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061772 Aug 03 01:56:37.801332 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1173/2314] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:37.809790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b601545-d676-45d4-9aa2-de81681b3415 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:37.811199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8b601545-d676-45d4-9aa2-de81681b3415 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:37.828188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b601545-d676-45d4-9aa2-de81681b3415 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:37.828945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b601545-d676-45d4-9aa2-de81681b3415 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:37.830018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b601545-d676-45d4-9aa2-de81681b3415 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:37.830655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b601545-d676-45d4-9aa2-de81681b3415 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:38.048068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8b601545-d676-45d4-9aa2-de81681b3415 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:38.058397 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8b601545-d676-45d4-9aa2-de81681b3415 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1314 microversion: 2.1 time: 0.255350 Aug 03 01:56:38.072131 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1174/2315] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:37 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:38.091256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8d023113-8a11-4316-b8ec-01fe22dbeadb tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:38.092068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8d023113-8a11-4316-b8ec-01fe22dbeadb tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: ee6c9f9b-e708-44b8-8c72-49704bda21aa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:38.102094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d023113-8a11-4316-b8ec-01fe22dbeadb tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:38.103045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d023113-8a11-4316-b8ec-01fe22dbeadb tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:38.104234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d023113-8a11-4316-b8ec-01fe22dbeadb tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:38.104903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d023113-8a11-4316-b8ec-01fe22dbeadb tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:38.126874 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-8d023113-8a11-4316-b8ec-01fe22dbeadb tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] HTTP exception thrown: Instance ee6c9f9b-e708-44b8-8c72-49704bda21aa could not be found. Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8d023113-8a11-4316-b8ec-01fe22dbeadb tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Request method failure captured: Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa HTTP/1.1 Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dQtfaxCugihlL0P-JuHcxaXYvSZwumECUI8oXZW8NjUnOQmnlS-UJeJWloLTa2nkib5iJcuoAKX60UHFAlj4BGPFKzJpj5_lUnKZbgP-NuaKafdXBPg4Z-YfN-tYmO7Dwn93GuQctj6Xv1TcX3wlfTLxer4AdjG_rRaIjDodC-ZS1E Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 5f232cf4e61b4213b592b2a020961630 Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-LiveMigrationTest-495141292 Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f232cf4e61b4213b592b2a020961630", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f232cf4e61b4213b592b2a020961630"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f232cf4e61b4213b592b2a020961630"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f232cf4e61b4213b592b2a020961630"}]}] Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-LiveMigrationTest-495141292 Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 5f232cf4e61b4213b592b2a020961630 Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-LiveMigrationTest-495141292 Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-LiveMigrationTest-495141292-project Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: dd2c77c8ab314584939f1f580d5a6d14 Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-LiveMigrationTest-495141292-project Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance ee6c9f9b-e708-44b8-8c72-49704bda21aa could not be found. Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'ee6c9f9b-e708-44b8-8c72-49704bda21aa'} Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6c9f9b-e708-44b8-8c72-49704bda21aa could not be found. Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6c9f9b-e708-44b8-8c72-49704bda21aa could not be found. Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:38.130154 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:38.136288 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:38.136288 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:38.136288 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:38.136288 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:56:38.136288 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:56:38.136288 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6c9f9b-e708-44b8-8c72-49704bda21aa could not be found. Aug 03 01:56:38.136288 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:38.136288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8d023113-8a11-4316-b8ec-01fe22dbeadb tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Returning 404 to user: Instance ee6c9f9b-e708-44b8-8c72-49704bda21aa could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:56:38.136288 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8d023113-8a11-4316-b8ec-01fe22dbeadb tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa" status: 404 len: 111 microversion: 2.1 time: 0.052832 Aug 03 01:56:38.136288 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1175/2316] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:38 2022] GET /compute/v2.1/servers/ee6c9f9b-e708-44b8-8c72-49704bda21aa => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:56:38.140193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1140ccb8-6463-4a81-9201-bc56689d017c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:38.141030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1140ccb8-6463-4a81-9201-bc56689d017c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:38.148186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1140ccb8-6463-4a81-9201-bc56689d017c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:38.148655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1140ccb8-6463-4a81-9201-bc56689d017c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:38.149736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1140ccb8-6463-4a81-9201-bc56689d017c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:38.153036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1140ccb8-6463-4a81-9201-bc56689d017c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:38.340831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1140ccb8-6463-4a81-9201-bc56689d017c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:38.352345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1140ccb8-6463-4a81-9201-bc56689d017c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:38.353990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1140ccb8-6463-4a81-9201-bc56689d017c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:38.355563 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1140ccb8-6463-4a81-9201-bc56689d017c tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.219892 Aug 03 01:56:38.356512 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1176/2317] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:38 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:38.370458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a4621117-0e27-46e2-abab-7256169ce136 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:38.371687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a4621117-0e27-46e2-abab-7256169ce136 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:38.383389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4621117-0e27-46e2-abab-7256169ce136 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:38.384589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4621117-0e27-46e2-abab-7256169ce136 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:38.386000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4621117-0e27-46e2-abab-7256169ce136 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:38.387323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4621117-0e27-46e2-abab-7256169ce136 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:38.581651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a4621117-0e27-46e2-abab-7256169ce136 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:38.591421 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a4621117-0e27-46e2-abab-7256169ce136 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1728 microversion: 2.1 time: 0.233618 Aug 03 01:56:38.594545 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1177/2318] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:38 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1728 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:38.600659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bdc49556-967b-4e6d-abad-04962c693a82 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:38.601462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bdc49556-967b-4e6d-abad-04962c693a82 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:38.610071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdc49556-967b-4e6d-abad-04962c693a82 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:38.610882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdc49556-967b-4e6d-abad-04962c693a82 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:38.612055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdc49556-967b-4e6d-abad-04962c693a82 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:38.613345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdc49556-967b-4e6d-abad-04962c693a82 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:38.652203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bdc49556-967b-4e6d-abad-04962c693a82 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:56:38.722941 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7fa163d3-1d12-4559-b68f-8f4318ef9676 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f" status: 200 len: 1423 microversion: 2.1 time: 14.541995 Aug 03 01:56:38.723769 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1142/2319] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:56:24 2022] GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f => generated 1423 bytes in 14544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:38.729088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-cbcb3d03-131b-4f20-b55f-488588e31dfc req-07e55864-1ed4-4951-b887-eaad2fb8e3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6c9f9b-e708-44b8-8c72-49704bda21aa", "name": "network-vif-deleted", "tag": "fed8a343-ec69-468a-9a29-db2e061934b3"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:38.741239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-cbcb3d03-131b-4f20-b55f-488588e31dfc req-07e55864-1ed4-4951-b887-eaad2fb8e3b6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:38.741614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-cbcb3d03-131b-4f20-b55f-488588e31dfc req-07e55864-1ed4-4951-b887-eaad2fb8e3b6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:38.754374 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-cbcb3d03-131b-4f20-b55f-488588e31dfc req-07e55864-1ed4-4951-b887-eaad2fb8e3b6 service nova] Creating event network-vif-deleted:fed8a343-ec69-468a-9a29-db2e061934b3 for instance ee6c9f9b-e708-44b8-8c72-49704bda21aa on n-h1-826529-8 Aug 03 01:56:38.772817 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-cbcb3d03-131b-4f20-b55f-488588e31dfc req-07e55864-1ed4-4951-b887-eaad2fb8e3b6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047699 Aug 03 01:56:38.773807 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1143/2320] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:38.779947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-95cf98fc-b789-4fe2-b1a3-7eb4c2b9aadf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:38.780579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-95cf98fc-b789-4fe2-b1a3-7eb4c2b9aadf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:38.781372 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bdc49556-967b-4e6d-abad-04962c693a82 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 204 len: 0 microversion: 2.1 time: 0.185359 Aug 03 01:56:38.784967 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1178/2321] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:56:38 2022] DELETE /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:56:38.790866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95cf98fc-b789-4fe2-b1a3-7eb4c2b9aadf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:38.791352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95cf98fc-b789-4fe2-b1a3-7eb4c2b9aadf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:38.792136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95cf98fc-b789-4fe2-b1a3-7eb4c2b9aadf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:38.792370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e3808c7f-efa8-4bc6-8235-3d9aeaaeb11c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b125f5af0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:38.792571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95cf98fc-b789-4fe2-b1a3-7eb4c2b9aadf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:38.860251 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e3808c7f-efa8-4bc6-8235-3d9aeaaeb11c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f" status: 200 len: 1423 microversion: 2.1 time: 0.072800 Aug 03 01:56:38.870822 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1179/2322] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:56:38 2022] GET /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f => generated 1423 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:38.870822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-125c2980-0119-4cb1-a83b-bb50097ebb2b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:38.871887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-125c2980-0119-4cb1-a83b-bb50097ebb2b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:38.882333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-125c2980-0119-4cb1-a83b-bb50097ebb2b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:38.883065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-125c2980-0119-4cb1-a83b-bb50097ebb2b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:38.883976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-125c2980-0119-4cb1-a83b-bb50097ebb2b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:38.884496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-125c2980-0119-4cb1-a83b-bb50097ebb2b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:38.890962 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-95cf98fc-b789-4fe2-b1a3-7eb4c2b9aadf tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115570 Aug 03 01:56:38.900183 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1144/2323] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 01:56:38 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:38.900183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-70d3b27b-9055-48f3-8c73-a3249b4b053c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:38.900183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-70d3b27b-9055-48f3-8c73-a3249b4b053c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:38.920830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-70d3b27b-9055-48f3-8c73-a3249b4b053c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:38.921814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-70d3b27b-9055-48f3-8c73-a3249b4b053c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:38.922718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-70d3b27b-9055-48f3-8c73-a3249b4b053c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:38.923292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-70d3b27b-9055-48f3-8c73-a3249b4b053c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:39.334622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-125c2980-0119-4cb1-a83b-bb50097ebb2b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:39.348023 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-125c2980-0119-4cb1-a83b-bb50097ebb2b tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1475 microversion: 2.1 time: 0.481455 Aug 03 01:56:39.359575 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1180/2324] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:38 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1475 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:39.369235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c11cc2af-d75c-4927-8db1-a9225b8ab901 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b12aba700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:39.471208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-70d3b27b-9055-48f3-8c73-a3249b4b053c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:39.485747 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-70d3b27b-9055-48f3-8c73-a3249b4b053c tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1500 microversion: 2.1 time: 0.590378 Aug 03 01:56:39.486721 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1145/2325] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:38 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1500 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:39.496228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-94b22cf9-6979-4bdd-880b-b475759e4713 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:39.500604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-94b22cf9-6979-4bdd-880b-b475759e4713 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:39.525591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94b22cf9-6979-4bdd-880b-b475759e4713 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:39.528763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94b22cf9-6979-4bdd-880b-b475759e4713 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:39.533798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94b22cf9-6979-4bdd-880b-b475759e4713 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:39.535798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94b22cf9-6979-4bdd-880b-b475759e4713 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:39.835316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-94b22cf9-6979-4bdd-880b-b475759e4713 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:39.847136 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-94b22cf9-6979-4bdd-880b-b475759e4713 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1314 microversion: 2.1 time: 0.357643 Aug 03 01:56:39.848384 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1146/2326] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:39 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:39.872097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e96dbc67-6b80-41b4-bf19-6fbb32917cc7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:39.872736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e96dbc67-6b80-41b4-bf19-6fbb32917cc7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:39.886781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e96dbc67-6b80-41b4-bf19-6fbb32917cc7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:39.887346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e96dbc67-6b80-41b4-bf19-6fbb32917cc7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:39.888155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e96dbc67-6b80-41b4-bf19-6fbb32917cc7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:39.888596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e96dbc67-6b80-41b4-bf19-6fbb32917cc7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:40.419575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e96dbc67-6b80-41b4-bf19-6fbb32917cc7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:40.433577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e96dbc67-6b80-41b4-bf19-6fbb32917cc7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:40.436383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e96dbc67-6b80-41b4-bf19-6fbb32917cc7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:40.443944 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e96dbc67-6b80-41b4-bf19-6fbb32917cc7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.593565 Aug 03 01:56:40.444851 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1147/2327] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:39 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:40.454607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-97486cfc-b5b3-4ce7-a83e-24fdcaf9bd4a req-3dffc677-e4ce-4165-a5d7-6d1387e2c187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb30620-408d-468e-b706-277ce080a2f6", "name": "network-vif-plugged", "status": "completed", "tag": "9762e114-938b-48d4-8d92-0fae9855c76e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:40.475154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-97486cfc-b5b3-4ce7-a83e-24fdcaf9bd4a req-3dffc677-e4ce-4165-a5d7-6d1387e2c187 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:40.476868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-97486cfc-b5b3-4ce7-a83e-24fdcaf9bd4a req-3dffc677-e4ce-4165-a5d7-6d1387e2c187 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:40.499771 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-97486cfc-b5b3-4ce7-a83e-24fdcaf9bd4a req-3dffc677-e4ce-4165-a5d7-6d1387e2c187 service nova] Creating event network-vif-plugged:9762e114-938b-48d4-8d92-0fae9855c76e for instance 0eb30620-408d-468e-b706-277ce080a2f6 on n-h1-826529-8 Aug 03 01:56:40.506604 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-97486cfc-b5b3-4ce7-a83e-24fdcaf9bd4a req-3dffc677-e4ce-4165-a5d7-6d1387e2c187 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058034 Aug 03 01:56:40.507652 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1148/2328] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:40.518482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f443881f-cde3-4002-8cc7-ac40dc9fe3bf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:40.520030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f443881f-cde3-4002-8cc7-ac40dc9fe3bf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:40.530198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f443881f-cde3-4002-8cc7-ac40dc9fe3bf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:40.531100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f443881f-cde3-4002-8cc7-ac40dc9fe3bf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:40.532541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f443881f-cde3-4002-8cc7-ac40dc9fe3bf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:40.533753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f443881f-cde3-4002-8cc7-ac40dc9fe3bf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:40.662237 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c11cc2af-d75c-4927-8db1-a9225b8ab901 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f" status: 204 len: 0 microversion: 2.1 time: 1.301151 Aug 03 01:56:40.663644 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1181/2329] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:39 2022] DELETE /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f => generated 0 bytes in 1303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:56:40.673917 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-976b5b4b-d489-4b42-b656-28b79c28bb1e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:40.674815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-976b5b4b-d489-4b42-b656-28b79c28bb1e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:40.682884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-976b5b4b-d489-4b42-b656-28b79c28bb1e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:40.685185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-976b5b4b-d489-4b42-b656-28b79c28bb1e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:40.686206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-976b5b4b-d489-4b42-b656-28b79c28bb1e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:40.687091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-976b5b4b-d489-4b42-b656-28b79c28bb1e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:40.985636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f443881f-cde3-4002-8cc7-ac40dc9fe3bf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:40.999962 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f443881f-cde3-4002-8cc7-ac40dc9fe3bf tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1475 microversion: 2.1 time: 0.483456 Aug 03 01:56:40.999962 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1149/2330] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:40 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1475 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:41.020451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-72119751-9cd8-4268-9c4e-79e82ca70ba1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:41.021284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-72119751-9cd8-4268-9c4e-79e82ca70ba1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:41.030197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-72119751-9cd8-4268-9c4e-79e82ca70ba1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:41.031500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-72119751-9cd8-4268-9c4e-79e82ca70ba1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:41.032695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-72119751-9cd8-4268-9c4e-79e82ca70ba1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:41.033381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-72119751-9cd8-4268-9c4e-79e82ca70ba1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:41.095951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-976b5b4b-d489-4b42-b656-28b79c28bb1e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:41.101185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-72119751-9cd8-4268-9c4e-79e82ca70ba1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:56:41.106718 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-976b5b4b-d489-4b42-b656-28b79c28bb1e tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1500 microversion: 2.1 time: 0.438485 Aug 03 01:56:41.120583 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1182/2331] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:40 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1500 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:41.134850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d3d43971-d81b-4b1c-9da9-98e4376f8aa3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:41.135772 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d3d43971-d81b-4b1c-9da9-98e4376f8aa3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:41.166513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3d43971-d81b-4b1c-9da9-98e4376f8aa3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:41.167312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3d43971-d81b-4b1c-9da9-98e4376f8aa3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:41.168974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3d43971-d81b-4b1c-9da9-98e4376f8aa3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:41.169970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3d43971-d81b-4b1c-9da9-98e4376f8aa3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:41.226603 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-72119751-9cd8-4268-9c4e-79e82ca70ba1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 204 len: 0 microversion: 2.1 time: 0.225638 Aug 03 01:56:41.241415 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1150/2332] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:56:40 2022] DELETE /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:56:41.367859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-5b1636c9-49d3-4d97-9958-a503cf1ecce3 req-54b98e66-f9b0-4f51-870e-f84ca92983de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6607345-8b9f-47e7-8686-65443ffc6cde", "name": "network-vif-deleted", "tag": "27843825-da5f-416a-883d-1724fb6835b3"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:41.396834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d3d43971-d81b-4b1c-9da9-98e4376f8aa3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:41.410648 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d3d43971-d81b-4b1c-9da9-98e4376f8aa3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1314 microversion: 2.1 time: 0.286512 Aug 03 01:56:41.411817 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1183/2333] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:41 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:41.424147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5b1636c9-49d3-4d97-9958-a503cf1ecce3 req-54b98e66-f9b0-4f51-870e-f84ca92983de service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:41.424147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5b1636c9-49d3-4d97-9958-a503cf1ecce3 req-54b98e66-f9b0-4f51-870e-f84ca92983de service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:41.475469 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-5b1636c9-49d3-4d97-9958-a503cf1ecce3 req-54b98e66-f9b0-4f51-870e-f84ca92983de service nova] Creating event network-vif-deleted:27843825-da5f-416a-883d-1724fb6835b3 for instance d6607345-8b9f-47e7-8686-65443ffc6cde on n-h1-826529-8 Aug 03 01:56:41.507669 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-5b1636c9-49d3-4d97-9958-a503cf1ecce3 req-54b98e66-f9b0-4f51-870e-f84ca92983de service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146747 Aug 03 01:56:41.510294 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1151/2334] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:56:41.516678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dcc48555-dd0c-4308-a70e-ea418118c660 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:41.520351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dcc48555-dd0c-4308-a70e-ea418118c660 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:41.528499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dcc48555-dd0c-4308-a70e-ea418118c660 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:41.528939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dcc48555-dd0c-4308-a70e-ea418118c660 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:41.529974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dcc48555-dd0c-4308-a70e-ea418118c660 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:41.530430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dcc48555-dd0c-4308-a70e-ea418118c660 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:41.620170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1682005131", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "53d4fe2c-f615-4656-9157-a036740f9e27"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:41.749577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] validate_networks() for [('53d4fe2c-f615-4656-9157-a036740f9e27', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:56:41.838289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dcc48555-dd0c-4308-a70e-ea418118c660 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:41.841301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:41.859844 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dcc48555-dd0c-4308-a70e-ea418118c660 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:41.864494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dcc48555-dd0c-4308-a70e-ea418118c660 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:41.865719 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dcc48555-dd0c-4308-a70e-ea418118c660 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.389223 Aug 03 01:56:41.866552 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1184/2335] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:41 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:42.025245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5f306e0d-1344-43de-bc87-6ca7f14dde5a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:42.026497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5f306e0d-1344-43de-bc87-6ca7f14dde5a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:42.045292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f306e0d-1344-43de-bc87-6ca7f14dde5a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:42.047757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f306e0d-1344-43de-bc87-6ca7f14dde5a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:42.049609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f306e0d-1344-43de-bc87-6ca7f14dde5a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:42.052103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f306e0d-1344-43de-bc87-6ca7f14dde5a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:42.357152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5f306e0d-1344-43de-bc87-6ca7f14dde5a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:42.369794 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5f306e0d-1344-43de-bc87-6ca7f14dde5a tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1475 microversion: 2.1 time: 0.351107 Aug 03 01:56:42.370999 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1185/2336] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:42 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1475 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:42.382681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-443bf84a-49f1-4ce5-aaf5-d12c5eb25d04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:42.383588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-443bf84a-49f1-4ce5-aaf5-d12c5eb25d04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:42.398013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-443bf84a-49f1-4ce5-aaf5-d12c5eb25d04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:42.398466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-443bf84a-49f1-4ce5-aaf5-d12c5eb25d04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:42.405672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-443bf84a-49f1-4ce5-aaf5-d12c5eb25d04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:42.406128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-443bf84a-49f1-4ce5-aaf5-d12c5eb25d04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:42.505768 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-443bf84a-49f1-4ce5-aaf5-d12c5eb25d04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:42.506236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-443bf84a-49f1-4ce5-aaf5-d12c5eb25d04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:42.511833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-443bf84a-49f1-4ce5-aaf5-d12c5eb25d04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lazy-loading 'fault' on Instance uuid d6607345-8b9f-47e7-8686-65443ffc6cde {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:56:42.542767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:56:42.544059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:56:42.544798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:56:42.545459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:56:42.546118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:56:42.568657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:42.570756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:42.572009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:42.573014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:42.606232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Getting quotas for project 6bf2395335564acdaf819f2175dbd3bc. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:56:42.614928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Getting quotas for user 47e6a189229d4f8ab3aa4ca416d84594 and project 6bf2395335564acdaf819f2175dbd3bc. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:56:42.636572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-443bf84a-49f1-4ce5-aaf5-d12c5eb25d04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2c77c8ab314584939f1f580d5a6d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f232cf4e61b4213b592b2a020961630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:42.652234 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-443bf84a-49f1-4ce5-aaf5-d12c5eb25d04 tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 200 len: 1301 microversion: 2.1 time: 0.279785 Aug 03 01:56:42.656076 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1186/2337] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:42 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 1301 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:42.667595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:56:42.674067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:56:42.678555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b43a0f78-a5a0-45c3-a593-6db497d7fc84 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:42.681261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b43a0f78-a5a0-45c3-a593-6db497d7fc84 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:42.696519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b43a0f78-a5a0-45c3-a593-6db497d7fc84 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:42.696986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b43a0f78-a5a0-45c3-a593-6db497d7fc84 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:42.701286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b43a0f78-a5a0-45c3-a593-6db497d7fc84 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:42.702105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b43a0f78-a5a0-45c3-a593-6db497d7fc84 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:42.761197 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-59bd2494-524b-4e60-9a9a-c0991fd690b3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.151967 Aug 03 01:56:42.762314 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1152/2338] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:56:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:56:42.776758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-86f02bd7-5536-457f-bf14-43bef11806a9 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:42.780058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-86f02bd7-5536-457f-bf14-43bef11806a9 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:42.988646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-86f02bd7-5536-457f-bf14-43bef11806a9 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:42.996863 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-86f02bd7-5536-457f-bf14-43bef11806a9 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e" status: 200 len: 1208 microversion: 2.1 time: 0.228005 Aug 03 01:56:42.998405 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1153/2339] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:42 2022] GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e => generated 1208 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:43.011692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a32c13d3-af53-45f9-a988-bb47ad022884 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:43.011692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a32c13d3-af53-45f9-a988-bb47ad022884 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:43.042070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b43a0f78-a5a0-45c3-a593-6db497d7fc84 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:43.050424 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b43a0f78-a5a0-45c3-a593-6db497d7fc84 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1314 microversion: 2.1 time: 0.386155 Aug 03 01:56:43.051052 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1187/2340] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:42 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:43.065193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a32c13d3-af53-45f9-a988-bb47ad022884 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:43.065193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a32c13d3-af53-45f9-a988-bb47ad022884 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:43.065193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a32c13d3-af53-45f9-a988-bb47ad022884 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:43.065193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a32c13d3-af53-45f9-a988-bb47ad022884 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:43.276034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a32c13d3-af53-45f9-a988-bb47ad022884 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:43.292749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a32c13d3-af53-45f9-a988-bb47ad022884 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:43.296467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a32c13d3-af53-45f9-a988-bb47ad022884 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:43.298069 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a32c13d3-af53-45f9-a988-bb47ad022884 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1486 microversion: 2.25 time: 0.298363 Aug 03 01:56:43.299010 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1154/2341] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:42 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1486 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:43.397168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b3e3a682-bcea-47b5-bc55-c51140ed981f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:43.397830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b3e3a682-bcea-47b5-bc55-c51140ed981f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:43.405929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3e3a682-bcea-47b5-bc55-c51140ed981f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:43.406597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3e3a682-bcea-47b5-bc55-c51140ed981f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:43.407603 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3e3a682-bcea-47b5-bc55-c51140ed981f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:43.408413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3e3a682-bcea-47b5-bc55-c51140ed981f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:43.635553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-554f5c65-8113-4c91-b88a-24afdace5017 req-12672921-6894-4fd3-a65e-1c22411a57a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d537dd36-d584-48d0-9458-81075e06b366", "tag": "02b87219-959c-40f7-baa4-183c4ffd1862"}, {"name": "network-changed", "server_uuid": "d537dd36-d584-48d0-9458-81075e06b366", "tag": "02b87219-959c-40f7-baa4-183c4ffd1862"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:43.649686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-554f5c65-8113-4c91-b88a-24afdace5017 req-12672921-6894-4fd3-a65e-1c22411a57a3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:43.650342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-554f5c65-8113-4c91-b88a-24afdace5017 req-12672921-6894-4fd3-a65e-1c22411a57a3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:43.668346 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-554f5c65-8113-4c91-b88a-24afdace5017 req-12672921-6894-4fd3-a65e-1c22411a57a3 service nova] Creating event network-changed:02b87219-959c-40f7-baa4-183c4ffd1862 for instance d537dd36-d584-48d0-9458-81075e06b366 on n-h2-826529-8 Aug 03 01:56:43.669411 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-554f5c65-8113-4c91-b88a-24afdace5017 req-12672921-6894-4fd3-a65e-1c22411a57a3 service nova] Creating event network-changed:02b87219-959c-40f7-baa4-183c4ffd1862 for instance d537dd36-d584-48d0-9458-81075e06b366 on n-h2-826529-8 Aug 03 01:56:43.679728 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-554f5c65-8113-4c91-b88a-24afdace5017 req-12672921-6894-4fd3-a65e-1c22411a57a3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054046 Aug 03 01:56:43.682055 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1155/2342] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:43.701106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ac42fd69-a38e-4180-a26a-aa59a11358ba tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:43.702284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ac42fd69-a38e-4180-a26a-aa59a11358ba tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] [instance: d6607345-8b9f-47e7-8686-65443ffc6cde] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:43.705992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b3e3a682-bcea-47b5-bc55-c51140ed981f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:43.710091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac42fd69-a38e-4180-a26a-aa59a11358ba tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:43.711021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac42fd69-a38e-4180-a26a-aa59a11358ba tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:43.712209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac42fd69-a38e-4180-a26a-aa59a11358ba tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:43.713099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac42fd69-a38e-4180-a26a-aa59a11358ba tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:43.722533 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b3e3a682-bcea-47b5-bc55-c51140ed981f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1460 microversion: 2.1 time: 0.326693 Aug 03 01:56:43.724809 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1188/2343] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:43 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1460 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:43.765086 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-ac42fd69-a38e-4180-a26a-aa59a11358ba tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] HTTP exception thrown: Instance d6607345-8b9f-47e7-8686-65443ffc6cde could not be found. Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ac42fd69-a38e-4180-a26a-aa59a11358ba tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Request method failure captured: Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde HTTP/1.1 Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dQtfaxCugihlL0P-JuHcxaXYvSZwumECUI8oXZW8NjUnOQmnlS-UJeJWloLTa2nkib5iJcuoAKX60UHFAlj4BGPFKzJpj5_lUnKZbgP-NuaKafdXBPg4Z-YfN-tYmO7Dwn93GuQctj6Xv1TcX3wlfTLxer4AdjG_rRaIjDodC-ZS1E Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 5f232cf4e61b4213b592b2a020961630 Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-LiveMigrationTest-495141292 Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f232cf4e61b4213b592b2a020961630", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f232cf4e61b4213b592b2a020961630"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f232cf4e61b4213b592b2a020961630"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f232cf4e61b4213b592b2a020961630"}]}] Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-LiveMigrationTest-495141292 Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 5f232cf4e61b4213b592b2a020961630 Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-LiveMigrationTest-495141292 Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-LiveMigrationTest-495141292-project Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: dd2c77c8ab314584939f1f580d5a6d14 Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-LiveMigrationTest-495141292-project Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance d6607345-8b9f-47e7-8686-65443ffc6cde could not be found. Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'd6607345-8b9f-47e7-8686-65443ffc6cde'} Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6607345-8b9f-47e7-8686-65443ffc6cde could not be found. Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6607345-8b9f-47e7-8686-65443ffc6cde could not be found. Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:43.767168 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:43.775690 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:43.775690 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:43.775690 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:43.775690 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:56:43.775690 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:56:43.775690 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6607345-8b9f-47e7-8686-65443ffc6cde could not be found. Aug 03 01:56:43.775690 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:43.775690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ac42fd69-a38e-4180-a26a-aa59a11358ba tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] Returning 404 to user: Instance d6607345-8b9f-47e7-8686-65443ffc6cde could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:56:43.775690 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ac42fd69-a38e-4180-a26a-aa59a11358ba tempest-LiveMigrationTest-495141292 tempest-LiveMigrationTest-495141292-project] 10.222.0.67 "GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde" status: 404 len: 111 microversion: 2.1 time: 0.088722 Aug 03 01:56:43.777109 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-42dc720c-a0f0-4541-b37e-465bb934de95 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:43.777303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-42dc720c-a0f0-4541-b37e-465bb934de95 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:43.778666 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1156/2344] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:43 2022] GET /compute/v2.1/servers/d6607345-8b9f-47e7-8686-65443ffc6cde => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:56:43.787571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42dc720c-a0f0-4541-b37e-465bb934de95 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:43.788038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42dc720c-a0f0-4541-b37e-465bb934de95 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:43.788841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42dc720c-a0f0-4541-b37e-465bb934de95 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:43.789285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42dc720c-a0f0-4541-b37e-465bb934de95 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:43.929247 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-42dc720c-a0f0-4541-b37e-465bb934de95 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6/action" status: 202 len: 0 microversion: 2.1 time: 0.159325 Aug 03 01:56:43.933647 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1189/2345] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:56:43 2022] POST /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:56:43.942464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4b8e7d7d-76e4-4b55-8a01-30e13cb5c0f9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:43.947282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4b8e7d7d-76e4-4b55-8a01-30e13cb5c0f9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:43.964505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b8e7d7d-76e4-4b55-8a01-30e13cb5c0f9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:43.966710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b8e7d7d-76e4-4b55-8a01-30e13cb5c0f9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:43.967958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b8e7d7d-76e4-4b55-8a01-30e13cb5c0f9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:43.969003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b8e7d7d-76e4-4b55-8a01-30e13cb5c0f9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:44.020342 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e685f3fa-001e-4326-9466-ab9299b998de tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:44.020981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e685f3fa-001e-4326-9466-ab9299b998de tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:44.039781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e685f3fa-001e-4326-9466-ab9299b998de tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:44.098992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e685f3fa-001e-4326-9466-ab9299b998de tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:44.098992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e685f3fa-001e-4326-9466-ab9299b998de tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:44.098992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e685f3fa-001e-4326-9466-ab9299b998de tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:44.109467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b8e7d7d-76e4-4b55-8a01-30e13cb5c0f9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:44.109467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b8e7d7d-76e4-4b55-8a01-30e13cb5c0f9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:44.110190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-4b8e7d7d-76e4-4b55-8a01-30e13cb5c0f9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lazy-loading 'fault' on Instance uuid 0eb30620-408d-468e-b706-277ce080a2f6 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:56:44.305676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e685f3fa-001e-4326-9466-ab9299b998de tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:44.337514 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e685f3fa-001e-4326-9466-ab9299b998de tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e" status: 200 len: 1260 microversion: 2.1 time: 0.320355 Aug 03 01:56:44.340132 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1190/2346] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:44 2022] GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e => generated 1260 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:56:44.396934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ec861a3f-6fc0-4271-8e4b-8363058ce2d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:44.397981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ec861a3f-6fc0-4271-8e4b-8363058ce2d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:44.420455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec861a3f-6fc0-4271-8e4b-8363058ce2d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:44.422883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec861a3f-6fc0-4271-8e4b-8363058ce2d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:44.427439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec861a3f-6fc0-4271-8e4b-8363058ce2d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:44.429009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec861a3f-6fc0-4271-8e4b-8363058ce2d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:45.254230 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4b8e7d7d-76e4-4b55-8a01-30e13cb5c0f9 tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1594 microversion: 2.1 time: 1.315882 Aug 03 01:56:45.263005 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1157/2347] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:43 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1594 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:56:45.278518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25201da0-91b4-407d-a842-2d2aa1c7cdf7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:45.279257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-25201da0-91b4-407d-a842-2d2aa1c7cdf7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:45.289725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25201da0-91b4-407d-a842-2d2aa1c7cdf7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:45.290201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25201da0-91b4-407d-a842-2d2aa1c7cdf7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:45.291044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25201da0-91b4-407d-a842-2d2aa1c7cdf7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:45.291500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25201da0-91b4-407d-a842-2d2aa1c7cdf7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:45.408328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ec861a3f-6fc0-4271-8e4b-8363058ce2d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:45.418699 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ec861a3f-6fc0-4271-8e4b-8363058ce2d8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1314 microversion: 2.1 time: 1.059311 Aug 03 01:56:45.420834 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1191/2348] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:44 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1314 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:45.436876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f86e21db-c4b5-4615-bba5-860bea33cea0 req-b43914b3-d845-4107-8757-6e2f1f757d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c1a495-99ee-4678-bc30-798f3e08b44d", "name": "network-vif-plugged", "status": "completed", "tag": "2d526941-b201-4313-82bb-04874c53fceb"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:45.457751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f86e21db-c4b5-4615-bba5-860bea33cea0 req-b43914b3-d845-4107-8757-6e2f1f757d3d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:45.458593 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f86e21db-c4b5-4615-bba5-860bea33cea0 req-b43914b3-d845-4107-8757-6e2f1f757d3d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:45.489962 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f86e21db-c4b5-4615-bba5-860bea33cea0 req-b43914b3-d845-4107-8757-6e2f1f757d3d service nova] Creating event network-vif-plugged:2d526941-b201-4313-82bb-04874c53fceb for instance a4c1a495-99ee-4678-bc30-798f3e08b44d on n-h2-826529-8 Aug 03 01:56:45.500741 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f86e21db-c4b5-4615-bba5-860bea33cea0 req-b43914b3-d845-4107-8757-6e2f1f757d3d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078222 Aug 03 01:56:45.504694 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1192/2349] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:45.521149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dc3bb7d7-c325-4ee6-842f-0c8a226432cc tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:45.524747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dc3bb7d7-c325-4ee6-842f-0c8a226432cc tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:45.538212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc3bb7d7-c325-4ee6-842f-0c8a226432cc tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:45.538674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc3bb7d7-c325-4ee6-842f-0c8a226432cc tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:45.539704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc3bb7d7-c325-4ee6-842f-0c8a226432cc tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:45.540264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc3bb7d7-c325-4ee6-842f-0c8a226432cc tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:45.678012 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dc3bb7d7-c325-4ee6-842f-0c8a226432cc tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6/action" status: 202 len: 0 microversion: 2.1 time: 0.171751 Aug 03 01:56:45.678744 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1193/2350] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:56:45 2022] POST /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:56:45.691268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-75e770cd-9304-49be-8c72-168a1459dcef tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:45.691979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-75e770cd-9304-49be-8c72-168a1459dcef tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:45.705985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75e770cd-9304-49be-8c72-168a1459dcef tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:45.706680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75e770cd-9304-49be-8c72-168a1459dcef tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:45.711359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75e770cd-9304-49be-8c72-168a1459dcef tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:45.711854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75e770cd-9304-49be-8c72-168a1459dcef tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:46.188910 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-75e770cd-9304-49be-8c72-168a1459dcef tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:46.203619 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-75e770cd-9304-49be-8c72-168a1459dcef tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e" status: 200 len: 1308 microversion: 2.1 time: 0.520920 Aug 03 01:56:46.204633 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1194/2351] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:45 2022] GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e => generated 1308 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:46.220220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0e49bde6-64c4-4701-9346-67c644cde46a tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:46.221114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0e49bde6-64c4-4701-9346-67c644cde46a tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:46.235345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-25201da0-91b4-407d-a842-2d2aa1c7cdf7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:46.240779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e49bde6-64c4-4701-9346-67c644cde46a tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:46.241798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e49bde6-64c4-4701-9346-67c644cde46a tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:46.242822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e49bde6-64c4-4701-9346-67c644cde46a tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:46.243476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e49bde6-64c4-4701-9346-67c644cde46a tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:46.251999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-25201da0-91b4-407d-a842-2d2aa1c7cdf7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:46.258862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-25201da0-91b4-407d-a842-2d2aa1c7cdf7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:46.262754 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-25201da0-91b4-407d-a842-2d2aa1c7cdf7 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1476 microversion: 2.25 time: 0.997557 Aug 03 01:56:46.264073 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1158/2352] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:45 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1476 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:46.289699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-938086b6-1109-4c3e-bac3-df3c691636b4 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '.version_select at 0x7f5b132a3ca0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:46.293812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-938086b6-1109-4c3e-bac3-df3c691636b4 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:46.294343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-938086b6-1109-4c3e-bac3-df3c691636b4 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:46.337368 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-938086b6-1109-4c3e-bac3-df3c691636b4 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/os-migrations" status: 200 len: 1698 microversion: 2.25 time: 0.051193 Aug 03 01:56:46.338992 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1159/2353] 10.222.0.67 () {60 vars in 1184 bytes} [Wed Aug 3 01:56:46 2022] GET /compute/v2.1/os-migrations => generated 1698 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:56:46.355715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5f15a2b2-f21d-4fd7-b1c5-e0c3cd42ad76 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:46.356723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5f15a2b2-f21d-4fd7-b1c5-e0c3cd42ad76 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:46.365949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f15a2b2-f21d-4fd7-b1c5-e0c3cd42ad76 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:46.367854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f15a2b2-f21d-4fd7-b1c5-e0c3cd42ad76 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:46.368854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f15a2b2-f21d-4fd7-b1c5-e0c3cd42ad76 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:46.369448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f15a2b2-f21d-4fd7-b1c5-e0c3cd42ad76 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:47.078747 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0e49bde6-64c4-4701-9346-67c644cde46a tempest-ServersAdminTestJSON-422167352 tempest-ServersAdminTestJSON-422167352-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1611 microversion: 2.1 time: 0.870427 Aug 03 01:56:47.097805 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1195/2354] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:46 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1611 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:47.110714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-039145db-e0b3-4320-a04b-2eaeb1123fb1 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:47.114331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-039145db-e0b3-4320-a04b-2eaeb1123fb1 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:47.124618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-5f15a2b2-f21d-4fd7-b1c5-e0c3cd42ad76 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] Lazy-loading 'services' on Instance uuid e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:56:47.124905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-039145db-e0b3-4320-a04b-2eaeb1123fb1 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:47.125284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-039145db-e0b3-4320-a04b-2eaeb1123fb1 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:47.127680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-039145db-e0b3-4320-a04b-2eaeb1123fb1 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:47.129744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-039145db-e0b3-4320-a04b-2eaeb1123fb1 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:47.157202 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5f15a2b2-f21d-4fd7-b1c5-e0c3cd42ad76 tempest-LiveAutoBlockMigrationV225Test-1083107963 tempest-LiveAutoBlockMigrationV225Test-1083107963-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1968 microversion: 2.25 time: 0.805767 Aug 03 01:56:47.158143 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1160/2355] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:46 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1968 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:56:47.163990 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-916bee82-115b-4e86-a72e-4208ab4e74d1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:47.164500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-916bee82-115b-4e86-a72e-4208ab4e74d1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:47.192766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-916bee82-115b-4e86-a72e-4208ab4e74d1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:47.192766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-916bee82-115b-4e86-a72e-4208ab4e74d1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:47.192766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-916bee82-115b-4e86-a72e-4208ab4e74d1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:47.199297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-916bee82-115b-4e86-a72e-4208ab4e74d1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:47.259451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-916bee82-115b-4e86-a72e-4208ab4e74d1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:56:47.372392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:47.450371 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-916bee82-115b-4e86-a72e-4208ab4e74d1 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "DELETE /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 204 len: 0 microversion: 2.1 time: 0.290950 Aug 03 01:56:47.451235 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1161/2356] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:56:47 2022] DELETE /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:56:47.459691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-e784d3c6-4b28-4237-b62e-fc55108bf78e req-b4ebdba1-9c0e-44b0-b9f5-dfb7c7a6102d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f7caa5b-90d6-478e-be59-d6e0157dc11e", "tag": "279746cc-9cd6-4060-885c-cc2e2e88c9f0"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:47.483350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e784d3c6-4b28-4237-b62e-fc55108bf78e req-b4ebdba1-9c0e-44b0-b9f5-dfb7c7a6102d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:47.483727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e784d3c6-4b28-4237-b62e-fc55108bf78e req-b4ebdba1-9c0e-44b0-b9f5-dfb7c7a6102d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:47.507553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-039145db-e0b3-4320-a04b-2eaeb1123fb1 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:47.510567 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e784d3c6-4b28-4237-b62e-fc55108bf78e req-b4ebdba1-9c0e-44b0-b9f5-dfb7c7a6102d service nova] Creating event network-changed:279746cc-9cd6-4060-885c-cc2e2e88c9f0 for instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e on n-h1-826529-8 Aug 03 01:56:47.516968 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-039145db-e0b3-4320-a04b-2eaeb1123fb1 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1314 microversion: 2.1 time: 0.417817 Aug 03 01:56:47.520126 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1196/2357] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:47 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:47.524019 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-e784d3c6-4b28-4237-b62e-fc55108bf78e req-b4ebdba1-9c0e-44b0-b9f5-dfb7c7a6102d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071115 Aug 03 01:56:47.526891 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1162/2358] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:47.529529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-002827e6-8830-428b-a80a-c3dfc0d439fe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:47.532183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-002827e6-8830-428b-a80a-c3dfc0d439fe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:47.538229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-65517e90-c429-496a-bb9d-aff7e3b6bcd3 req-b71dad3b-747e-4584-8b37-139b0cc4fa1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92c67e8-bc6b-44c4-b012-63b940619b6d", "name": "network-vif-deleted", "tag": "ed823989-d5aa-4d9a-9d30-87acf254629c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:47.559780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-002827e6-8830-428b-a80a-c3dfc0d439fe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:47.560752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-65517e90-c429-496a-bb9d-aff7e3b6bcd3 req-b71dad3b-747e-4584-8b37-139b0cc4fa1a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:47.561443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-65517e90-c429-496a-bb9d-aff7e3b6bcd3 req-b71dad3b-747e-4584-8b37-139b0cc4fa1a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:47.573682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-002827e6-8830-428b-a80a-c3dfc0d439fe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:47.574742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-002827e6-8830-428b-a80a-c3dfc0d439fe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:47.575238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-002827e6-8830-428b-a80a-c3dfc0d439fe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:47.576718 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-65517e90-c429-496a-bb9d-aff7e3b6bcd3 req-b71dad3b-747e-4584-8b37-139b0cc4fa1a service nova] Creating event network-vif-deleted:ed823989-d5aa-4d9a-9d30-87acf254629c for instance f92c67e8-bc6b-44c4-b012-63b940619b6d on n-h2-826529-8 Aug 03 01:56:47.584298 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-65517e90-c429-496a-bb9d-aff7e3b6bcd3 req-b71dad3b-747e-4584-8b37-139b0cc4fa1a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055768 Aug 03 01:56:47.585114 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1163/2359] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:47.591904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f5e3c702-2007-4338-8683-2666f35b8ab5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:47.592665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f5e3c702-2007-4338-8683-2666f35b8ab5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:47.600186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5e3c702-2007-4338-8683-2666f35b8ab5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:47.600886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5e3c702-2007-4338-8683-2666f35b8ab5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:47.601840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5e3c702-2007-4338-8683-2666f35b8ab5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:47.603080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5e3c702-2007-4338-8683-2666f35b8ab5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:47.635968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-002827e6-8830-428b-a80a-c3dfc0d439fe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:56:47.693105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:47.762457 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-002827e6-8830-428b-a80a-c3dfc0d439fe tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 204 len: 0 microversion: 2.25 time: 0.240665 Aug 03 01:56:47.763873 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1197/2360] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 01:56:47 2022] DELETE /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:56:47.774045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9af2873f-b30e-46ed-84b0-c0cf24e37b62 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:47.775787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9af2873f-b30e-46ed-84b0-c0cf24e37b62 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:47.784287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9af2873f-b30e-46ed-84b0-c0cf24e37b62 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:47.785308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9af2873f-b30e-46ed-84b0-c0cf24e37b62 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:47.786513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9af2873f-b30e-46ed-84b0-c0cf24e37b62 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:47.787280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9af2873f-b30e-46ed-84b0-c0cf24e37b62 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:47.974860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f5e3c702-2007-4338-8683-2666f35b8ab5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:47.994683 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f5e3c702-2007-4338-8683-2666f35b8ab5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e" status: 200 len: 1308 microversion: 2.1 time: 0.398045 Aug 03 01:56:47.996793 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1164/2361] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:47 2022] GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e => generated 1308 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:48.004444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-cd4b34e9-5951-461b-a976-e9c14c537e8a req-19cfbf6e-707e-432c-b07b-fb6169c32d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92c67e8-bc6b-44c4-b012-63b940619b6d", "name": "network-vif-unplugged", "status": "completed", "tag": "ed823989-d5aa-4d9a-9d30-87acf254629c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:48.015074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-cd4b34e9-5951-461b-a976-e9c14c537e8a req-19cfbf6e-707e-432c-b07b-fb6169c32d6a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:48.015533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-cd4b34e9-5951-461b-a976-e9c14c537e8a req-19cfbf6e-707e-432c-b07b-fb6169c32d6a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:48.028244 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-cd4b34e9-5951-461b-a976-e9c14c537e8a req-19cfbf6e-707e-432c-b07b-fb6169c32d6a service nova] Creating event network-vif-unplugged:ed823989-d5aa-4d9a-9d30-87acf254629c for instance f92c67e8-bc6b-44c4-b012-63b940619b6d on n-h2-826529-8 Aug 03 01:56:48.033126 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-cd4b34e9-5951-461b-a976-e9c14c537e8a req-19cfbf6e-707e-432c-b07b-fb6169c32d6a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035069 Aug 03 01:56:48.034367 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1165/2362] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:48.040529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-08d3faf6-871a-46e0-8746-4d01b8c6765a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:48.041245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-08d3faf6-871a-46e0-8746-4d01b8c6765a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:48.048985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08d3faf6-871a-46e0-8746-4d01b8c6765a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:48.049417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08d3faf6-871a-46e0-8746-4d01b8c6765a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:48.050434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08d3faf6-871a-46e0-8746-4d01b8c6765a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:48.050887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08d3faf6-871a-46e0-8746-4d01b8c6765a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:48.135395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9af2873f-b30e-46ed-84b0-c0cf24e37b62 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:48.145622 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9af2873f-b30e-46ed-84b0-c0cf24e37b62 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 200 len: 1470 microversion: 2.1 time: 0.380128 Aug 03 01:56:48.146735 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1198/2363] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:47 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 1470 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:48.288547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-08d3faf6-871a-46e0-8746-4d01b8c6765a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:48.303309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-08d3faf6-871a-46e0-8746-4d01b8c6765a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:48.306040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-08d3faf6-871a-46e0-8746-4d01b8c6765a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:48.307283 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-08d3faf6-871a-46e0-8746-4d01b8c6765a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1482 microversion: 2.25 time: 0.271683 Aug 03 01:56:48.308364 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1166/2364] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:48 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1482 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:48.538973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-23f353ee-1bda-48f0-a255-77eccb37a4b0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:48.539607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-23f353ee-1bda-48f0-a255-77eccb37a4b0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:48.553265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23f353ee-1bda-48f0-a255-77eccb37a4b0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:48.553997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23f353ee-1bda-48f0-a255-77eccb37a4b0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:48.557937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23f353ee-1bda-48f0-a255-77eccb37a4b0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:48.558985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23f353ee-1bda-48f0-a255-77eccb37a4b0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:49.011123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ad43321f-eee3-4d1c-a9f5-599938f10460 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:49.013788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ad43321f-eee3-4d1c-a9f5-599938f10460 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:49.024063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-23f353ee-1bda-48f0-a255-77eccb37a4b0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:49.042867 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-23f353ee-1bda-48f0-a255-77eccb37a4b0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1500 microversion: 2.1 time: 0.508189 Aug 03 01:56:49.044859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ad43321f-eee3-4d1c-a9f5-599938f10460 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:49.045415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ad43321f-eee3-4d1c-a9f5-599938f10460 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:49.047723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ad43321f-eee3-4d1c-a9f5-599938f10460 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:49.048129 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1199/2365] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:48 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1500 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:49.048938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ad43321f-eee3-4d1c-a9f5-599938f10460 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:49.065037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4a3383ca-f4c4-4043-a245-39787ff8c8e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:49.068546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4a3383ca-f4c4-4043-a245-39787ff8c8e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:49.085112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a3383ca-f4c4-4043-a245-39787ff8c8e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:49.087603 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a3383ca-f4c4-4043-a245-39787ff8c8e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:49.088588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a3383ca-f4c4-4043-a245-39787ff8c8e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:49.089942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a3383ca-f4c4-4043-a245-39787ff8c8e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:49.123408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-4a3383ca-f4c4-4043-a245-39787ff8c8e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lazy-loading 'flavor' on Instance uuid a4c1a495-99ee-4678-bc30-798f3e08b44d {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:56:49.277220 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4a3383ca-f4c4-4043-a245-39787ff8c8e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "POST /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d/action" status: 200 len: 32 microversion: 2.1 time: 0.216696 Aug 03 01:56:49.278281 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1200/2366] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:56:49 2022] POST /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:56:49.284241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c67f4b6a-d57b-4191-bab7-4ac6f58c7c39 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:49.286952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c67f4b6a-d57b-4191-bab7-4ac6f58c7c39 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:49.306277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c67f4b6a-d57b-4191-bab7-4ac6f58c7c39 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:49.306664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c67f4b6a-d57b-4191-bab7-4ac6f58c7c39 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:49.307509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c67f4b6a-d57b-4191-bab7-4ac6f58c7c39 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:49.308118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c67f4b6a-d57b-4191-bab7-4ac6f58c7c39 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:50.370527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ad43321f-eee3-4d1c-a9f5-599938f10460 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:50.387712 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ad43321f-eee3-4d1c-a9f5-599938f10460 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e" status: 200 len: 1308 microversion: 2.1 time: 1.380691 Aug 03 01:56:50.390658 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1167/2367] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:49 2022] GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e => generated 1308 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:56:50.400309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7930be43-0730-4c79-bc24-07267156e837 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:50.401267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7930be43-0730-4c79-bc24-07267156e837 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:50.411673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7930be43-0730-4c79-bc24-07267156e837 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:50.412543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7930be43-0730-4c79-bc24-07267156e837 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:50.413530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7930be43-0730-4c79-bc24-07267156e837 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:50.414166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7930be43-0730-4c79-bc24-07267156e837 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:50.542785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c67f4b6a-d57b-4191-bab7-4ac6f58c7c39 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:50.559052 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c67f4b6a-d57b-4191-bab7-4ac6f58c7c39 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 200 len: 1470 microversion: 2.1 time: 1.279386 Aug 03 01:56:50.560451 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1201/2368] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:49 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 1470 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:50.568361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6c4ed0a8-d887-4451-b5a1-8997b6ed8bc4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:50.568989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6c4ed0a8-d887-4451-b5a1-8997b6ed8bc4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:50.578030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:50.583329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c4ed0a8-d887-4451-b5a1-8997b6ed8bc4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:50.591016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c4ed0a8-d887-4451-b5a1-8997b6ed8bc4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:50.592319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c4ed0a8-d887-4451-b5a1-8997b6ed8bc4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:50.593025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c4ed0a8-d887-4451-b5a1-8997b6ed8bc4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:50.983186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7930be43-0730-4c79-bc24-07267156e837 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:50.997182 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7930be43-0730-4c79-bc24-07267156e837 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.605011 Aug 03 01:56:51.002028 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1168/2369] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:50 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:51.236468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6c4ed0a8-d887-4451-b5a1-8997b6ed8bc4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:51.257626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6c4ed0a8-d887-4451-b5a1-8997b6ed8bc4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:51.263382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6c4ed0a8-d887-4451-b5a1-8997b6ed8bc4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:51.269260 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6c4ed0a8-d887-4451-b5a1-8997b6ed8bc4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1482 microversion: 2.25 time: 0.701905 Aug 03 01:56:51.271139 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1202/2370] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:50 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1482 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:51.424248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-79b88c55-99d9-4eb8-bb5f-7a706b13213a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:51.426154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-79b88c55-99d9-4eb8-bb5f-7a706b13213a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:51.451602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79b88c55-99d9-4eb8-bb5f-7a706b13213a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:51.455038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79b88c55-99d9-4eb8-bb5f-7a706b13213a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:51.456684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79b88c55-99d9-4eb8-bb5f-7a706b13213a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:51.459519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79b88c55-99d9-4eb8-bb5f-7a706b13213a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:51.580098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-251feb97-dc6a-4d62-83fd-20f692337a77 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:51.580740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-251feb97-dc6a-4d62-83fd-20f692337a77 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:51.591572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-251feb97-dc6a-4d62-83fd-20f692337a77 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:51.592042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-251feb97-dc6a-4d62-83fd-20f692337a77 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:51.592850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-251feb97-dc6a-4d62-83fd-20f692337a77 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:51.593310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-251feb97-dc6a-4d62-83fd-20f692337a77 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:51.930327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-251feb97-dc6a-4d62-83fd-20f692337a77 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:51.945457 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-251feb97-dc6a-4d62-83fd-20f692337a77 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 200 len: 1428 microversion: 2.1 time: 0.368905 Aug 03 01:56:51.948280 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1203/2371] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:51 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 1428 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:56:52.029703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d328fc61-46cd-4b5b-8505-8c92feb32730 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:52.030957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d328fc61-46cd-4b5b-8505-8c92feb32730 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:52.052855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d328fc61-46cd-4b5b-8505-8c92feb32730 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:52.057452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d328fc61-46cd-4b5b-8505-8c92feb32730 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:52.058475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d328fc61-46cd-4b5b-8505-8c92feb32730 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:52.060262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d328fc61-46cd-4b5b-8505-8c92feb32730 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:52.089257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-79b88c55-99d9-4eb8-bb5f-7a706b13213a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:52.100748 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-79b88c55-99d9-4eb8-bb5f-7a706b13213a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e" status: 200 len: 1308 microversion: 2.1 time: 0.688387 Aug 03 01:56:52.101744 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1169/2372] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:51 2022] GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e => generated 1308 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:52.107331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-3e49841b-e1e9-4d44-ab2a-203c2dcf0392 req-561909c9-f504-40fa-842f-966430cbce75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91461a32-2670-4138-bdbc-793503ed4ca4", "name": "network-vif-deleted", "tag": "330a51c1-6429-4043-8673-217255e0885d"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:52.126538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3e49841b-e1e9-4d44-ab2a-203c2dcf0392 req-561909c9-f504-40fa-842f-966430cbce75 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:52.131678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3e49841b-e1e9-4d44-ab2a-203c2dcf0392 req-561909c9-f504-40fa-842f-966430cbce75 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:52.177644 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-3e49841b-e1e9-4d44-ab2a-203c2dcf0392 req-561909c9-f504-40fa-842f-966430cbce75 service nova] Creating event network-vif-deleted:330a51c1-6429-4043-8673-217255e0885d for instance 91461a32-2670-4138-bdbc-793503ed4ca4 on n-h1-826529-8 Aug 03 01:56:52.186862 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-3e49841b-e1e9-4d44-ab2a-203c2dcf0392 req-561909c9-f504-40fa-842f-966430cbce75 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083691 Aug 03 01:56:52.191483 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1170/2373] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:52.295083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2341448a-d71c-43c2-ba52-364fbe721050 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:52.295835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2341448a-d71c-43c2-ba52-364fbe721050 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:52.314165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2341448a-d71c-43c2-ba52-364fbe721050 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:52.318135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2341448a-d71c-43c2-ba52-364fbe721050 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:52.320074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2341448a-d71c-43c2-ba52-364fbe721050 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:52.323374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2341448a-d71c-43c2-ba52-364fbe721050 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:52.595991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:52.664309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2341448a-d71c-43c2-ba52-364fbe721050 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:52.681194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d328fc61-46cd-4b5b-8505-8c92feb32730 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:52.683216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2341448a-d71c-43c2-ba52-364fbe721050 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:52.694097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2341448a-d71c-43c2-ba52-364fbe721050 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:52.695484 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2341448a-d71c-43c2-ba52-364fbe721050 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1440 microversion: 2.25 time: 0.405424 Aug 03 01:56:52.696086 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1171/2374] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:52 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1440 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:56:52.697127 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d328fc61-46cd-4b5b-8505-8c92feb32730 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.673463 Aug 03 01:56:52.698185 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1204/2375] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:52 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:53.050795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:53.062888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-29846431-7d5e-49cf-b20a-1995c1fd05d2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:53.073726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-29846431-7d5e-49cf-b20a-1995c1fd05d2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 91461a32-2670-4138-bdbc-793503ed4ca4] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:53.100184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29846431-7d5e-49cf-b20a-1995c1fd05d2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:53.103942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29846431-7d5e-49cf-b20a-1995c1fd05d2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:53.113887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29846431-7d5e-49cf-b20a-1995c1fd05d2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:53.114636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29846431-7d5e-49cf-b20a-1995c1fd05d2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:53.126635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b3a83d9b-48b3-48da-b42c-293be9cd058c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:53.127500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b3a83d9b-48b3-48da-b42c-293be9cd058c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:53.141896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3a83d9b-48b3-48da-b42c-293be9cd058c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:53.150243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3a83d9b-48b3-48da-b42c-293be9cd058c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:53.152284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3a83d9b-48b3-48da-b42c-293be9cd058c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:53.157546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3a83d9b-48b3-48da-b42c-293be9cd058c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:53.181068 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-29846431-7d5e-49cf-b20a-1995c1fd05d2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] HTTP exception thrown: Instance 91461a32-2670-4138-bdbc-793503ed4ca4 could not be found. Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-29846431-7d5e-49cf-b20a-1995c1fd05d2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Request method failure captured: Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 HTTP/1.1 Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dU0mSDS2vxxhhj-uUFUO4Bl252cbfD1gqVnWuOBareNdSeovzV9nf3nPE1Prr4OMG5S3wYiSAX3Skrdl-uMdeXAolvR6Tq9IQ12osaXYc5rRd_RugOQXSTIRM5PppUV2L3dn9bsKO_C3VaFo1FGacPWm0t7pOOfZc3m1NM7IEO98yE Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 655a411b3b2542f7b62d41257e7bf806 Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersAdminTestJSON-1638287595 Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_655a411b3b2542f7b62d41257e7bf806", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/655a411b3b2542f7b62d41257e7bf806"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/655a411b3b2542f7b62d41257e7bf806"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/655a411b3b2542f7b62d41257e7bf806"}]}] Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersAdminTestJSON-1638287595 Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 655a411b3b2542f7b62d41257e7bf806 Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersAdminTestJSON-1638287595 Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersAdminTestJSON-1638287595-project Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: d5950dd979ef4fa4a26acdd6a50c75a5 Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersAdminTestJSON-1638287595-project Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 91461a32-2670-4138-bdbc-793503ed4ca4 could not be found. Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '91461a32-2670-4138-bdbc-793503ed4ca4'} Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91461a32-2670-4138-bdbc-793503ed4ca4 could not be found. Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91461a32-2670-4138-bdbc-793503ed4ca4 could not be found. Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:53.182949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:53.187230 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:53.187230 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:53.187230 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:53.187230 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:56:53.187230 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:56:53.187230 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91461a32-2670-4138-bdbc-793503ed4ca4 could not be found. Aug 03 01:56:53.187230 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:56:53.198482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-29846431-7d5e-49cf-b20a-1995c1fd05d2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Returning 404 to user: Instance 91461a32-2670-4138-bdbc-793503ed4ca4 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:56:53.201520 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-29846431-7d5e-49cf-b20a-1995c1fd05d2 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4" status: 404 len: 111 microversion: 2.1 time: 0.152033 Aug 03 01:56:53.213047 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1172/2376] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:53 2022] GET /compute/v2.1/servers/91461a32-2670-4138-bdbc-793503ed4ca4 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:56:53.232879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1beaae5d-6fde-49f6-af65-d4227774dce7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:53.233761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1beaae5d-6fde-49f6-af65-d4227774dce7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:53.265247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1beaae5d-6fde-49f6-af65-d4227774dce7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:53.266248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1beaae5d-6fde-49f6-af65-d4227774dce7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:53.268171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1beaae5d-6fde-49f6-af65-d4227774dce7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:53.297472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1beaae5d-6fde-49f6-af65-d4227774dce7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:53.418242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1beaae5d-6fde-49f6-af65-d4227774dce7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:56:53.642689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b3a83d9b-48b3-48da-b42c-293be9cd058c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:53.661321 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b3a83d9b-48b3-48da-b42c-293be9cd058c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e" status: 200 len: 1308 microversion: 2.1 time: 0.538694 Aug 03 01:56:53.666553 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1205/2377] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:53 2022] GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e => generated 1308 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:56:53.732797 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1beaae5d-6fde-49f6-af65-d4227774dce7 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "DELETE /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 204 len: 0 microversion: 2.1 time: 0.517644 Aug 03 01:56:53.733527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6b7f64b7-37e0-41d4-89a5-703c65eebdd0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:53.734047 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1173/2378] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:56:53 2022] DELETE /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:56:53.738144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6b7f64b7-37e0-41d4-89a5-703c65eebdd0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:53.749615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-801014ea-582d-4a5d-b6cc-76e196bfa8ce tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:53.750359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-801014ea-582d-4a5d-b6cc-76e196bfa8ce tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:53.761338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b7f64b7-37e0-41d4-89a5-703c65eebdd0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:53.762525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b7f64b7-37e0-41d4-89a5-703c65eebdd0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:53.764079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b7f64b7-37e0-41d4-89a5-703c65eebdd0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:53.765736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b7f64b7-37e0-41d4-89a5-703c65eebdd0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:53.773285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-801014ea-582d-4a5d-b6cc-76e196bfa8ce tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:53.773809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-801014ea-582d-4a5d-b6cc-76e196bfa8ce tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:53.775047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-801014ea-582d-4a5d-b6cc-76e196bfa8ce tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:53.775839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-801014ea-582d-4a5d-b6cc-76e196bfa8ce tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:54.010181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-801014ea-582d-4a5d-b6cc-76e196bfa8ce tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:54.032184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-801014ea-582d-4a5d-b6cc-76e196bfa8ce tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:54.038026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-801014ea-582d-4a5d-b6cc-76e196bfa8ce tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:54.041626 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-801014ea-582d-4a5d-b6cc-76e196bfa8ce tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1265 microversion: 2.25 time: 0.306543 Aug 03 01:56:54.042512 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1174/2379] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:53 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:54.052044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c014fd19-1196-489d-aefd-0015529995ce tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:54.054344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c014fd19-1196-489d-aefd-0015529995ce tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:54.071151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:54.074379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c014fd19-1196-489d-aefd-0015529995ce tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:54.075243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c014fd19-1196-489d-aefd-0015529995ce tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:54.077288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c014fd19-1196-489d-aefd-0015529995ce tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:54.077906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c014fd19-1196-489d-aefd-0015529995ce tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:54.511892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c014fd19-1196-489d-aefd-0015529995ce tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:54.517459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6b7f64b7-37e0-41d4-89a5-703c65eebdd0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:54.541114 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6b7f64b7-37e0-41d4-89a5-703c65eebdd0 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.817589 Aug 03 01:56:54.541114 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1206/2380] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:53 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:54.542588 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c014fd19-1196-489d-aefd-0015529995ce tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1469 microversion: 2.1 time: 0.496350 Aug 03 01:56:54.561689 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1175/2381] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:54 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1469 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:54.570932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-646e589b-f827-45a1-ad9a-e26575adf3b1 req-05781989-ca10-4aa2-92a2-2a517db656b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a9c0c8-5bf1-435f-8c6b-74a0b447f966", "name": "network-vif-deleted", "tag": "626f469b-7020-4d02-a4c0-f2e58ccd1315"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:54.617804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-646e589b-f827-45a1-ad9a-e26575adf3b1 req-05781989-ca10-4aa2-92a2-2a517db656b2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:54.618267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-646e589b-f827-45a1-ad9a-e26575adf3b1 req-05781989-ca10-4aa2-92a2-2a517db656b2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:54.649562 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-646e589b-f827-45a1-ad9a-e26575adf3b1 req-05781989-ca10-4aa2-92a2-2a517db656b2 service nova] Creating event network-vif-deleted:626f469b-7020-4d02-a4c0-f2e58ccd1315 for instance e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 on n-h2-826529-8 Aug 03 01:56:54.663003 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-646e589b-f827-45a1-ad9a-e26575adf3b1 req-05781989-ca10-4aa2-92a2-2a517db656b2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118267 Aug 03 01:56:54.664312 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1207/2382] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:54.690048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c71ca415-f07a-4c32-a7d7-e1b000188e0c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:54.692167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c71ca415-f07a-4c32-a7d7-e1b000188e0c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:54.701187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c71ca415-f07a-4c32-a7d7-e1b000188e0c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:54.702028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c71ca415-f07a-4c32-a7d7-e1b000188e0c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:54.703727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c71ca415-f07a-4c32-a7d7-e1b000188e0c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:54.705296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c71ca415-f07a-4c32-a7d7-e1b000188e0c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:54.950000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c71ca415-f07a-4c32-a7d7-e1b000188e0c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:54.961389 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c71ca415-f07a-4c32-a7d7-e1b000188e0c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e" status: 200 len: 1308 microversion: 2.1 time: 0.277286 Aug 03 01:56:54.962531 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1176/2383] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:54 2022] GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e => generated 1308 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:55.069774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e9008ca2-e300-4791-a050-bb87f68ade3a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:55.071137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e9008ca2-e300-4791-a050-bb87f68ade3a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:55.083495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9008ca2-e300-4791-a050-bb87f68ade3a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:55.088012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9008ca2-e300-4791-a050-bb87f68ade3a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:55.092236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9008ca2-e300-4791-a050-bb87f68ade3a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:55.096274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9008ca2-e300-4791-a050-bb87f68ade3a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:55.214336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e9008ca2-e300-4791-a050-bb87f68ade3a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:55.230225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e9008ca2-e300-4791-a050-bb87f68ade3a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:55.232914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e9008ca2-e300-4791-a050-bb87f68ade3a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:55.236581 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e9008ca2-e300-4791-a050-bb87f68ade3a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1265 microversion: 2.25 time: 0.171948 Aug 03 01:56:55.257418 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1208/2384] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:55 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:55.548913 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-9906990d-47cf-4189-8cf1-47500747d731 req-72c7708d-866f-48db-bc29-29b680126818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7caa5b-90d6-478e-be59-d6e0157dc11e", "name": "network-vif-plugged", "status": "completed", "tag": "279746cc-9cd6-4060-885c-cc2e2e88c9f0"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:55.563373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fb180b88-e3f9-45c5-b8f7-ad0bc700ce61 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:55.564771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fb180b88-e3f9-45c5-b8f7-ad0bc700ce61 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:55.573669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb180b88-e3f9-45c5-b8f7-ad0bc700ce61 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:55.574703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb180b88-e3f9-45c5-b8f7-ad0bc700ce61 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:55.575799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb180b88-e3f9-45c5-b8f7-ad0bc700ce61 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:55.576642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb180b88-e3f9-45c5-b8f7-ad0bc700ce61 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:55.590758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9906990d-47cf-4189-8cf1-47500747d731 req-72c7708d-866f-48db-bc29-29b680126818 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:55.591657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9906990d-47cf-4189-8cf1-47500747d731 req-72c7708d-866f-48db-bc29-29b680126818 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:55.615412 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-9906990d-47cf-4189-8cf1-47500747d731 req-72c7708d-866f-48db-bc29-29b680126818 service nova] Creating event network-vif-plugged:279746cc-9cd6-4060-885c-cc2e2e88c9f0 for instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e on n-h1-826529-8 Aug 03 01:56:55.635242 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-9906990d-47cf-4189-8cf1-47500747d731 req-72c7708d-866f-48db-bc29-29b680126818 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089555 Aug 03 01:56:55.635838 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1177/2385] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:55.641257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7ed4e135-7f26-42c5-9ef1-8ae22042f178 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:55.642168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7ed4e135-7f26-42c5-9ef1-8ae22042f178 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:55.661456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ed4e135-7f26-42c5-9ef1-8ae22042f178 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:55.662228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ed4e135-7f26-42c5-9ef1-8ae22042f178 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:55.663317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ed4e135-7f26-42c5-9ef1-8ae22042f178 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:55.664180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ed4e135-7f26-42c5-9ef1-8ae22042f178 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:56.720793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7ed4e135-7f26-42c5-9ef1-8ae22042f178 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:56.743915 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7ed4e135-7f26-42c5-9ef1-8ae22042f178 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1469 microversion: 2.1 time: 1.106576 Aug 03 01:56:56.764703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fb180b88-e3f9-45c5-b8f7-ad0bc700ce61 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:56.765209 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1178/2386] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:55 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1469 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:56.777161 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fb180b88-e3f9-45c5-b8f7-ad0bc700ce61 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 1.219229 Aug 03 01:56:56.777907 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1209/2387] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:55 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:56.783209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5332464f-d8d6-43a0-848c-4f80b44f217d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:56.783852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5332464f-d8d6-43a0-848c-4f80b44f217d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:56.785544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bcb088f9-0558-4868-97b5-8ef789fadc84 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:56.786547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bcb088f9-0558-4868-97b5-8ef789fadc84 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:56.794836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcb088f9-0558-4868-97b5-8ef789fadc84 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:56.795628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcb088f9-0558-4868-97b5-8ef789fadc84 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:56.796678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcb088f9-0558-4868-97b5-8ef789fadc84 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:56.797410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcb088f9-0558-4868-97b5-8ef789fadc84 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:56.806768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5332464f-d8d6-43a0-848c-4f80b44f217d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:56.807277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5332464f-d8d6-43a0-848c-4f80b44f217d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:56.808103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5332464f-d8d6-43a0-848c-4f80b44f217d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:56.808554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5332464f-d8d6-43a0-848c-4f80b44f217d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:56.899893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bcb088f9-0558-4868-97b5-8ef789fadc84 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:56.911751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bcb088f9-0558-4868-97b5-8ef789fadc84 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:56.913599 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bcb088f9-0558-4868-97b5-8ef789fadc84 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:56.914784 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bcb088f9-0558-4868-97b5-8ef789fadc84 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1265 microversion: 2.25 time: 0.135639 Aug 03 01:56:56.917221 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1210/2388] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:56 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:57.219220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5332464f-d8d6-43a0-848c-4f80b44f217d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:57.233678 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5332464f-d8d6-43a0-848c-4f80b44f217d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e" status: 200 len: 1308 microversion: 2.1 time: 0.467218 Aug 03 01:56:57.234274 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1179/2389] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:56 2022] GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e => generated 1308 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:57.560804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-6df67e4c-cea4-4808-a10e-2edc7f7ff7d3 req-5d2a88bd-4819-4812-adb0-9b3a88dc7bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058c9df7-48a2-4acc-8a43-6f25e86cf9a2", "name": "network-vif-deleted", "tag": "84a59355-6b06-4c67-84d4-df2ade0771df"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:57.575949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6df67e4c-cea4-4808-a10e-2edc7f7ff7d3 req-5d2a88bd-4819-4812-adb0-9b3a88dc7bcd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:57.580328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6df67e4c-cea4-4808-a10e-2edc7f7ff7d3 req-5d2a88bd-4819-4812-adb0-9b3a88dc7bcd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:57.597774 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-6df67e4c-cea4-4808-a10e-2edc7f7ff7d3 req-5d2a88bd-4819-4812-adb0-9b3a88dc7bcd service nova] Creating event network-vif-deleted:84a59355-6b06-4c67-84d4-df2ade0771df for instance 058c9df7-48a2-4acc-8a43-6f25e86cf9a2 on n-h1-826529-8 Aug 03 01:56:57.603502 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-6df67e4c-cea4-4808-a10e-2edc7f7ff7d3 req-5d2a88bd-4819-4812-adb0-9b3a88dc7bcd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050097 Aug 03 01:56:57.604828 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1211/2390] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:56:57.774730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f4d23a2a-077c-46c3-aeb2-111caabf02c8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:57.778030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f4d23a2a-077c-46c3-aeb2-111caabf02c8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:57.801640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4d23a2a-077c-46c3-aeb2-111caabf02c8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:57.802930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4d23a2a-077c-46c3-aeb2-111caabf02c8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:57.804539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3eab74c5-2bd4-476c-a6aa-53564e658b18 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:57.806043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3eab74c5-2bd4-476c-a6aa-53564e658b18 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:57.827110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3eab74c5-2bd4-476c-a6aa-53564e658b18 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:57.828748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3eab74c5-2bd4-476c-a6aa-53564e658b18 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:57.829958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3eab74c5-2bd4-476c-a6aa-53564e658b18 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:57.831385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3eab74c5-2bd4-476c-a6aa-53564e658b18 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:57.845905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4d23a2a-077c-46c3-aeb2-111caabf02c8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:57.846940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4d23a2a-077c-46c3-aeb2-111caabf02c8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:57.900278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:57.916321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4d23a2a-077c-46c3-aeb2-111caabf02c8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:57.917034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4d23a2a-077c-46c3-aeb2-111caabf02c8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:57.917688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-f4d23a2a-077c-46c3-aeb2-111caabf02c8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lazy-loading 'fault' on Instance uuid 058c9df7-48a2-4acc-8a43-6f25e86cf9a2 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:56:58.025022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f4d23a2a-077c-46c3-aeb2-111caabf02c8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:58.046216 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f4d23a2a-077c-46c3-aeb2-111caabf02c8 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 200 len: 1303 microversion: 2.1 time: 0.274167 Aug 03 01:56:58.048543 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1180/2391] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:57 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 1303 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:58.055449 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-46440b88-0c2b-4812-9723-8d69f90b407e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:58.056435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-46440b88-0c2b-4812-9723-8d69f90b407e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:58.089887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46440b88-0c2b-4812-9723-8d69f90b407e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:58.090630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46440b88-0c2b-4812-9723-8d69f90b407e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:58.094539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46440b88-0c2b-4812-9723-8d69f90b407e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:58.095798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46440b88-0c2b-4812-9723-8d69f90b407e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:58.210632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-46440b88-0c2b-4812-9723-8d69f90b407e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:58.223453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-46440b88-0c2b-4812-9723-8d69f90b407e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:58.227211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-46440b88-0c2b-4812-9723-8d69f90b407e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:58.228969 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-46440b88-0c2b-4812-9723-8d69f90b407e tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1265 microversion: 2.25 time: 0.178941 Aug 03 01:56:58.230278 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1181/2392] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:58 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:56:58.260704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e7c220b6-1ed2-41f6-a382-efe80683ecd1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:58.261635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e7c220b6-1ed2-41f6-a382-efe80683ecd1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:58.269408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3eab74c5-2bd4-476c-a6aa-53564e658b18 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:58.271193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7c220b6-1ed2-41f6-a382-efe80683ecd1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:58.271949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7c220b6-1ed2-41f6-a382-efe80683ecd1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:58.273072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7c220b6-1ed2-41f6-a382-efe80683ecd1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:58.273701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7c220b6-1ed2-41f6-a382-efe80683ecd1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:58.278417 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3eab74c5-2bd4-476c-a6aa-53564e658b18 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.479814 Aug 03 01:56:58.279255 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1212/2393] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:57 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:56:58.657842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e7c220b6-1ed2-41f6-a382-efe80683ecd1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:58.671841 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e7c220b6-1ed2-41f6-a382-efe80683ecd1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e" status: 200 len: 1487 microversion: 2.1 time: 0.415572 Aug 03 01:56:58.672468 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1182/2394] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:58 2022] GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e => generated 1487 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:58.697403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9b16fd4f-b915-4442-9c3c-95270d8f8d89 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:56:58.698322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9b16fd4f-b915-4442-9c3c-95270d8f8d89 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:58.707851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b16fd4f-b915-4442-9c3c-95270d8f8d89 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:58.708745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b16fd4f-b915-4442-9c3c-95270d8f8d89 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:58.710278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b16fd4f-b915-4442-9c3c-95270d8f8d89 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:58.711150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b16fd4f-b915-4442-9c3c-95270d8f8d89 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:58.717404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:56:58.752521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-9b16fd4f-b915-4442-9c3c-95270d8f8d89 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lazy-loading 'flavor' on Instance uuid 7f7caa5b-90d6-478e-be59-d6e0157dc11e {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:56:58.847081 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9b16fd4f-b915-4442-9c3c-95270d8f8d89 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "POST /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e/action" status: 202 len: 0 microversion: 2.1 time: 0.153190 Aug 03 01:56:58.854625 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1213/2395] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:56:58 2022] POST /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:56:58.860424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0b77ef8e-fc01-474b-891f-f6397285fdc6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:58.861537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0b77ef8e-fc01-474b-891f-f6397285fdc6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:58.878773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b77ef8e-fc01-474b-891f-f6397285fdc6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:58.879356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b77ef8e-fc01-474b-891f-f6397285fdc6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:58.880266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b77ef8e-fc01-474b-891f-f6397285fdc6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:58.880794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b77ef8e-fc01-474b-891f-f6397285fdc6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:59.071318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e6ce3c68-fa65-406b-94ea-361ac9f44cf4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:59.072022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e6ce3c68-fa65-406b-94ea-361ac9f44cf4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 058c9df7-48a2-4acc-8a43-6f25e86cf9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:59.091475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6ce3c68-fa65-406b-94ea-361ac9f44cf4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:59.092022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6ce3c68-fa65-406b-94ea-361ac9f44cf4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:59.093249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6ce3c68-fa65-406b-94ea-361ac9f44cf4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:59.093410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6ce3c68-fa65-406b-94ea-361ac9f44cf4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:59.112699 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-e6ce3c68-fa65-406b-94ea-361ac9f44cf4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] HTTP exception thrown: Instance 058c9df7-48a2-4acc-8a43-6f25e86cf9a2 could not be found. Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e6ce3c68-fa65-406b-94ea-361ac9f44cf4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Request method failure captured: Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 HTTP/1.1 Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dU0mSDS2vxxhhj-uUFUO4Bl252cbfD1gqVnWuOBareNdSeovzV9nf3nPE1Prr4OMG5S3wYiSAX3Skrdl-uMdeXAolvR6Tq9IQ12osaXYc5rRd_RugOQXSTIRM5PppUV2L3dn9bsKO_C3VaFo1FGacPWm0t7pOOfZc3m1NM7IEO98yE Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 655a411b3b2542f7b62d41257e7bf806 Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersAdminTestJSON-1638287595 Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_655a411b3b2542f7b62d41257e7bf806", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/655a411b3b2542f7b62d41257e7bf806"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/655a411b3b2542f7b62d41257e7bf806"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/655a411b3b2542f7b62d41257e7bf806"}]}] Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersAdminTestJSON-1638287595 Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 655a411b3b2542f7b62d41257e7bf806 Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersAdminTestJSON-1638287595 Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersAdminTestJSON-1638287595-project Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: d5950dd979ef4fa4a26acdd6a50c75a5 Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersAdminTestJSON-1638287595-project Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 058c9df7-48a2-4acc-8a43-6f25e86cf9a2 could not be found. Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '058c9df7-48a2-4acc-8a43-6f25e86cf9a2'} Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 058c9df7-48a2-4acc-8a43-6f25e86cf9a2 could not be found. Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 058c9df7-48a2-4acc-8a43-6f25e86cf9a2 could not be found. Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:56:59.114511 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:59.118542 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:56:59.118542 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:56:59.118542 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:56:59.118542 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:56:59.118542 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:56:59.118542 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 058c9df7-48a2-4acc-8a43-6f25e86cf9a2 could not be found. Aug 03 01:56:59.118542 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:56:59.118542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e6ce3c68-fa65-406b-94ea-361ac9f44cf4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Returning 404 to user: Instance 058c9df7-48a2-4acc-8a43-6f25e86cf9a2 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:56:59.118542 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e6ce3c68-fa65-406b-94ea-361ac9f44cf4 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2" status: 404 len: 111 microversion: 2.1 time: 0.052619 Aug 03 01:56:59.122873 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1214/2396] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:59 2022] GET /compute/v2.1/servers/058c9df7-48a2-4acc-8a43-6f25e86cf9a2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:56:59.128762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-746c3325-447e-4cb9-9cb2-6880d63ba64f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:59.129633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-746c3325-447e-4cb9-9cb2-6880d63ba64f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:59.137084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-746c3325-447e-4cb9-9cb2-6880d63ba64f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:59.137772 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-746c3325-447e-4cb9-9cb2-6880d63ba64f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:59.148231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-746c3325-447e-4cb9-9cb2-6880d63ba64f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:59.148692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-746c3325-447e-4cb9-9cb2-6880d63ba64f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:59.153152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0b77ef8e-fc01-474b-891f-f6397285fdc6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:59.161863 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0b77ef8e-fc01-474b-891f-f6397285fdc6 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e" status: 200 len: 1495 microversion: 2.1 time: 0.305768 Aug 03 01:56:59.162646 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1183/2397] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:58 2022] GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e => generated 1495 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:56:59.222560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-746c3325-447e-4cb9-9cb2-6880d63ba64f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:56:59.253839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0a799a6c-d2d4-4f8b-b9a6-7f2a6f640201 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:59.254458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0a799a6c-d2d4-4f8b-b9a6-7f2a6f640201 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:59.270365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a799a6c-d2d4-4f8b-b9a6-7f2a6f640201 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:59.270801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a799a6c-d2d4-4f8b-b9a6-7f2a6f640201 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:59.273136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a799a6c-d2d4-4f8b-b9a6-7f2a6f640201 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:59.273626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a799a6c-d2d4-4f8b-b9a6-7f2a6f640201 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:59.388358 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-746c3325-447e-4cb9-9cb2-6880d63ba64f tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 204 len: 0 microversion: 2.1 time: 0.264019 Aug 03 01:56:59.404677 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1215/2398] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:56:59 2022] DELETE /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:56:59.417581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-76262eac-cdb0-4984-9b0b-1b42d8d1e627 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:59.418306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-76262eac-cdb0-4984-9b0b-1b42d8d1e627 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:59.446986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76262eac-cdb0-4984-9b0b-1b42d8d1e627 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:59.446986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76262eac-cdb0-4984-9b0b-1b42d8d1e627 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:59.451856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76262eac-cdb0-4984-9b0b-1b42d8d1e627 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:59.452365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76262eac-cdb0-4984-9b0b-1b42d8d1e627 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:59.498567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0a799a6c-d2d4-4f8b-b9a6-7f2a6f640201 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:59.513829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0a799a6c-d2d4-4f8b-b9a6-7f2a6f640201 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:59.516682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0a799a6c-d2d4-4f8b-b9a6-7f2a6f640201 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:59.524440 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0a799a6c-d2d4-4f8b-b9a6-7f2a6f640201 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 200 len: 1265 microversion: 2.25 time: 0.274412 Aug 03 01:56:59.525533 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1184/2399] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:56:59 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:56:59.543606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-41cd5465-fa0f-457e-b262-0fb2faa2730e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:56:59.544537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-41cd5465-fa0f-457e-b262-0fb2faa2730e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:56:59.556857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41cd5465-fa0f-457e-b262-0fb2faa2730e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:59.559704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41cd5465-fa0f-457e-b262-0fb2faa2730e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:59.561532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41cd5465-fa0f-457e-b262-0fb2faa2730e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:56:59.562591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41cd5465-fa0f-457e-b262-0fb2faa2730e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:56:59.974643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-76262eac-cdb0-4984-9b0b-1b42d8d1e627 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:56:59.986023 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-76262eac-cdb0-4984-9b0b-1b42d8d1e627 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.578597 Aug 03 01:56:59.999233 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1216/2400] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:59 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:00.107132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-41cd5465-fa0f-457e-b262-0fb2faa2730e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:00.123177 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-41cd5465-fa0f-457e-b262-0fb2faa2730e tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1466 microversion: 2.1 time: 0.596012 Aug 03 01:57:00.123748 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1185/2401] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:56:59 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1466 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:00.185622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3b73889e-3d0e-4509-99bd-b8f57566f167 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:00.186573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3b73889e-3d0e-4509-99bd-b8f57566f167 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:00.199629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b73889e-3d0e-4509-99bd-b8f57566f167 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:00.200109 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b73889e-3d0e-4509-99bd-b8f57566f167 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:00.200928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b73889e-3d0e-4509-99bd-b8f57566f167 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:00.203468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b73889e-3d0e-4509-99bd-b8f57566f167 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:00.522775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3b73889e-3d0e-4509-99bd-b8f57566f167 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:00.537395 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3b73889e-3d0e-4509-99bd-b8f57566f167 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e" status: 200 len: 1478 microversion: 2.1 time: 0.356976 Aug 03 01:57:00.542145 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1217/2402] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:00 2022] GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e => generated 1478 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:00.570649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-376f7761-b383-49c3-b029-4d976e25869d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1745972703"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:00.571916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bd90cf8c-a769-4319-be1f-7f0ace03129b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:00.572553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bd90cf8c-a769-4319-be1f-7f0ace03129b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: e7a9c0c8-5bf1-435f-8c6b-74a0b447f966] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:00.577175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-376f7761-b383-49c3-b029-4d976e25869d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:00.587192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd90cf8c-a769-4319-be1f-7f0ace03129b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:00.591187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-376f7761-b383-49c3-b029-4d976e25869d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:00.591645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-376f7761-b383-49c3-b029-4d976e25869d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:00.592449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-376f7761-b383-49c3-b029-4d976e25869d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:00.592898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-376f7761-b383-49c3-b029-4d976e25869d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:00.595805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd90cf8c-a769-4319-be1f-7f0ace03129b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:00.596813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd90cf8c-a769-4319-be1f-7f0ace03129b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:00.597886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd90cf8c-a769-4319-be1f-7f0ace03129b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:00.621688 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-bd90cf8c-a769-4319-be1f-7f0ace03129b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] HTTP exception thrown: Instance e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 could not be found. Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bd90cf8c-a769-4319-be1f-7f0ace03129b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Request method failure captured: Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 HTTP/1.1 Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dQmYksyCHGe05wRQxbk6QfqbWkBxABJ5P_n0aCiHJbs9MllgVdpbYymAxb_HczTpTqJwJO5NoW-z9Kl8QAFDfkjt2Rysc3BdoTKS198Pdcf8wdPSi10_HctX3SPJqykocduTYhOzA_bALuNdgBeucW4AsPQCeHlVOF2e2nWAoRZ89Q Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.25 Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 162addf8f6634e7fa0a1f9c6004258d1 Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-519991888 Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_162addf8f6634e7fa0a1f9c6004258d1", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/162addf8f6634e7fa0a1f9c6004258d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/162addf8f6634e7fa0a1f9c6004258d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/162addf8f6634e7fa0a1f9c6004258d1"}]}] Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-519991888 Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 162addf8f6634e7fa0a1f9c6004258d1 Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-519991888 Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-LiveAutoBlockMigrationV225Test-519991888-project Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4cb821820bbb4d3a8c999e1dec6a06a4 Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-519991888-project Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 could not be found. Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'e7a9c0c8-5bf1-435f-8c6b-74a0b447f966'} Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 could not be found. Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 could not be found. Aug 03 01:57:00.623800 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:00.628505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:00.628505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:00.628505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:00.628505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:00.628505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:00.628505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:57:00.628505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:57:00.628505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 could not be found. Aug 03 01:57:00.628505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:00.630190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bd90cf8c-a769-4319-be1f-7f0ace03129b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Returning 404 to user: Instance e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:57:00.631109 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bd90cf8c-a769-4319-be1f-7f0ace03129b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966" status: 404 len: 111 microversion: 2.25 time: 0.073420 Aug 03 01:57:00.631735 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1186/2403] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:00 2022] GET /compute/v2.1/servers/e7a9c0c8-5bf1-435f-8c6b-74a0b447f966 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:57:01.014405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-65e65c06-b32c-4e22-ae90-55be35779ed5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:01.015319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-65e65c06-b32c-4e22-ae90-55be35779ed5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:01.037466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-65e65c06-b32c-4e22-ae90-55be35779ed5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:01.038189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-65e65c06-b32c-4e22-ae90-55be35779ed5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:01.039183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-65e65c06-b32c-4e22-ae90-55be35779ed5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:01.040077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-65e65c06-b32c-4e22-ae90-55be35779ed5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:01.077149 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-376f7761-b383-49c3-b029-4d976e25869d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "POST /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e/action" status: 202 len: 0 microversion: 2.1 time: 0.514721 Aug 03 01:57:01.084875 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1218/2404] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:57:00 2022] POST /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 03 01:57:01.095575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7e3576af-5e30-48a9-9079-b6ac640cf7b1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b243b9c10>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:01.216108 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7e3576af-5e30-48a9-9079-b6ac640cf7b1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.129598 Aug 03 01:57:01.227639 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1219/2405] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:01 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:01.241171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-965b1e2d-d688-463d-bdb2-924ff1015208 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:01.242690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-965b1e2d-d688-463d-bdb2-924ff1015208 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:01.267665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-965b1e2d-d688-463d-bdb2-924ff1015208 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:01.269183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-965b1e2d-d688-463d-bdb2-924ff1015208 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:01.271227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-965b1e2d-d688-463d-bdb2-924ff1015208 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:01.271948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-965b1e2d-d688-463d-bdb2-924ff1015208 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:01.906367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-65e65c06-b32c-4e22-ae90-55be35779ed5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:01.916627 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-65e65c06-b32c-4e22-ae90-55be35779ed5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.910183 Aug 03 01:57:01.921529 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1187/2406] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:01 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:57:01.952471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-965b1e2d-d688-463d-bdb2-924ff1015208 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:01.965822 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-965b1e2d-d688-463d-bdb2-924ff1015208 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1466 microversion: 2.1 time: 0.736800 Aug 03 01:57:01.967183 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1220/2407] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:01 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1466 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:02.232450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-01262a8f-2f63-440d-bb78-92f0b510587b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b24420550>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:02.333654 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-01262a8f-2f63-440d-bb78-92f0b510587b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.104925 Aug 03 01:57:02.334272 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1188/2408] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:02 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:02.941815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-26cd6d0e-e888-4ffa-9fd7-03d978e6ed7f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:02.944621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-26cd6d0e-e888-4ffa-9fd7-03d978e6ed7f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:02.965829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26cd6d0e-e888-4ffa-9fd7-03d978e6ed7f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:02.968081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26cd6d0e-e888-4ffa-9fd7-03d978e6ed7f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:02.969302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26cd6d0e-e888-4ffa-9fd7-03d978e6ed7f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:02.975399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26cd6d0e-e888-4ffa-9fd7-03d978e6ed7f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:02.990365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5b9d83fe-ad0c-4b3d-80c4-ebd66da6ea42 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:02.991973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5b9d83fe-ad0c-4b3d-80c4-ebd66da6ea42 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:03.017221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b9d83fe-ad0c-4b3d-80c4-ebd66da6ea42 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:03.023178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b9d83fe-ad0c-4b3d-80c4-ebd66da6ea42 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:03.031595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b9d83fe-ad0c-4b3d-80c4-ebd66da6ea42 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:03.033650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b9d83fe-ad0c-4b3d-80c4-ebd66da6ea42 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:03.388348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5b9d83fe-ad0c-4b3d-80c4-ebd66da6ea42 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5950dd979ef4fa4a26acdd6a50c75a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a411b3b2542f7b62d41257e7bf806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:03.406889 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5b9d83fe-ad0c-4b3d-80c4-ebd66da6ea42 tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 200 len: 1424 microversion: 2.1 time: 0.421764 Aug 03 01:57:03.409231 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1189/2409] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:02 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 1424 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:57:03.422552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-53ffb5b9-e569-4eae-a892-3d2c33a4ecd9 req-0ea1f9bf-33af-4ba0-93a9-e2254d8889dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb30620-408d-468e-b706-277ce080a2f6", "name": "network-vif-deleted", "tag": "9762e114-938b-48d4-8d92-0fae9855c76e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:03.456445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-53ffb5b9-e569-4eae-a892-3d2c33a4ecd9 req-0ea1f9bf-33af-4ba0-93a9-e2254d8889dc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:03.457189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-53ffb5b9-e569-4eae-a892-3d2c33a4ecd9 req-0ea1f9bf-33af-4ba0-93a9-e2254d8889dc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:03.473483 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-53ffb5b9-e569-4eae-a892-3d2c33a4ecd9 req-0ea1f9bf-33af-4ba0-93a9-e2254d8889dc service nova] Creating event network-vif-deleted:9762e114-938b-48d4-8d92-0fae9855c76e for instance 0eb30620-408d-468e-b706-277ce080a2f6 on n-h1-826529-8 Aug 03 01:57:03.480762 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-53ffb5b9-e569-4eae-a892-3d2c33a4ecd9 req-0ea1f9bf-33af-4ba0-93a9-e2254d8889dc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067978 Aug 03 01:57:03.484033 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1190/2410] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:03.501745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6d6e5d18-5046-44a5-aedb-ec73930ac995 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b132a2550>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:03.608610 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6d6e5d18-5046-44a5-aedb-ec73930ac995 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.119844 Aug 03 01:57:03.609744 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1191/2411] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:03 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:03.640575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-26cd6d0e-e888-4ffa-9fd7-03d978e6ed7f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:03.651519 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-26cd6d0e-e888-4ffa-9fd7-03d978e6ed7f tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.713163 Aug 03 01:57:03.655635 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1221/2412] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:02 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:04.431008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-38f50c0a-09f6-498d-bb8b-806064056e7c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:04.431928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-38f50c0a-09f6-498d-bb8b-806064056e7c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] [instance: 0eb30620-408d-468e-b706-277ce080a2f6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:04.448958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38f50c0a-09f6-498d-bb8b-806064056e7c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:04.466384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38f50c0a-09f6-498d-bb8b-806064056e7c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:04.478239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38f50c0a-09f6-498d-bb8b-806064056e7c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:04.480821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38f50c0a-09f6-498d-bb8b-806064056e7c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:04.527152 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-38f50c0a-09f6-498d-bb8b-806064056e7c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] HTTP exception thrown: Instance 0eb30620-408d-468e-b706-277ce080a2f6 could not be found. Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-38f50c0a-09f6-498d-bb8b-806064056e7c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Request method failure captured: Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 HTTP/1.1 Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dU0mSDS2vxxhhj-uUFUO4Bl252cbfD1gqVnWuOBareNdSeovzV9nf3nPE1Prr4OMG5S3wYiSAX3Skrdl-uMdeXAolvR6Tq9IQ12osaXYc5rRd_RugOQXSTIRM5PppUV2L3dn9bsKO_C3VaFo1FGacPWm0t7pOOfZc3m1NM7IEO98yE Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 655a411b3b2542f7b62d41257e7bf806 Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersAdminTestJSON-1638287595 Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_655a411b3b2542f7b62d41257e7bf806", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/655a411b3b2542f7b62d41257e7bf806"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/655a411b3b2542f7b62d41257e7bf806"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/655a411b3b2542f7b62d41257e7bf806"}]}] Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersAdminTestJSON-1638287595 Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 655a411b3b2542f7b62d41257e7bf806 Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersAdminTestJSON-1638287595 Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersAdminTestJSON-1638287595-project Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: d5950dd979ef4fa4a26acdd6a50c75a5 Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersAdminTestJSON-1638287595-project Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 0eb30620-408d-468e-b706-277ce080a2f6 could not be found. Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '0eb30620-408d-468e-b706-277ce080a2f6'} Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb30620-408d-468e-b706-277ce080a2f6 could not be found. Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb30620-408d-468e-b706-277ce080a2f6 could not be found. Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:04.538093 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:04.541288 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:04.541288 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:04.541288 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:04.541288 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:57:04.541288 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:57:04.541288 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb30620-408d-468e-b706-277ce080a2f6 could not be found. Aug 03 01:57:04.541288 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:04.541288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-38f50c0a-09f6-498d-bb8b-806064056e7c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] Returning 404 to user: Instance 0eb30620-408d-468e-b706-277ce080a2f6 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:57:04.541288 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-38f50c0a-09f6-498d-bb8b-806064056e7c tempest-ServersAdminTestJSON-1638287595 tempest-ServersAdminTestJSON-1638287595-project] 10.222.0.67 "GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6" status: 404 len: 111 microversion: 2.1 time: 0.114894 Aug 03 01:57:04.550936 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1192/2413] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:04 2022] GET /compute/v2.1/servers/0eb30620-408d-468e-b706-277ce080a2f6 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:57:04.631138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d312f43b-1ac2-4be4-b0ba-5becd0f03074 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b129fe700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:04.678207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a5758dbe-7713-4920-90fd-c3e38702564e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:04.678853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a5758dbe-7713-4920-90fd-c3e38702564e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:04.688877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5758dbe-7713-4920-90fd-c3e38702564e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:04.689340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5758dbe-7713-4920-90fd-c3e38702564e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:04.696279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5758dbe-7713-4920-90fd-c3e38702564e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:04.696774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5758dbe-7713-4920-90fd-c3e38702564e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:04.751711 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d312f43b-1ac2-4be4-b0ba-5becd0f03074 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.131346 Aug 03 01:57:04.762648 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1222/2414] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:04 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:05.239354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a5758dbe-7713-4920-90fd-c3e38702564e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:05.252120 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a5758dbe-7713-4920-90fd-c3e38702564e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.578158 Aug 03 01:57:05.257687 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1193/2415] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:04 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:05.777708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3f8e88de-c7c2-40b1-b623-654b6d059b1d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b1336d9d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:05.875093 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3f8e88de-c7c2-40b1-b623-654b6d059b1d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.104327 Aug 03 01:57:05.877449 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1223/2416] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:05 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:06.115232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-f13a8017-5d6e-4575-87f1-413bce26cadd req-47747cfc-1ded-41b6-878f-f103c5cbc09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7caa5b-90d6-478e-be59-d6e0157dc11e", "name": "network-vif-plugged", "status": "completed", "tag": "279746cc-9cd6-4060-885c-cc2e2e88c9f0"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:06.151403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f13a8017-5d6e-4575-87f1-413bce26cadd req-47747cfc-1ded-41b6-878f-f103c5cbc09b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:06.151875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f13a8017-5d6e-4575-87f1-413bce26cadd req-47747cfc-1ded-41b6-878f-f103c5cbc09b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:06.198430 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-f13a8017-5d6e-4575-87f1-413bce26cadd req-47747cfc-1ded-41b6-878f-f103c5cbc09b service nova] Creating event network-vif-plugged:279746cc-9cd6-4060-885c-cc2e2e88c9f0 for instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e on n-h1-826529-8 Aug 03 01:57:06.213090 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-f13a8017-5d6e-4575-87f1-413bce26cadd req-47747cfc-1ded-41b6-878f-f103c5cbc09b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099695 Aug 03 01:57:06.215423 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1194/2417] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:06.281377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e7396a7c-8b62-4bbf-bc55-a2ff8f468768 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:06.282003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e7396a7c-8b62-4bbf-bc55-a2ff8f468768 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:06.294303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7396a7c-8b62-4bbf-bc55-a2ff8f468768 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:06.297099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7396a7c-8b62-4bbf-bc55-a2ff8f468768 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:06.302389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7396a7c-8b62-4bbf-bc55-a2ff8f468768 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:06.303168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7396a7c-8b62-4bbf-bc55-a2ff8f468768 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:06.667833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e7396a7c-8b62-4bbf-bc55-a2ff8f468768 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:06.679274 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e7396a7c-8b62-4bbf-bc55-a2ff8f468768 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.402213 Aug 03 01:57:06.684939 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1224/2418] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:06 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:06.897590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b01a7a18-765b-4118-aa71-fad7ea7e058d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b13203310>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:07.044206 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b01a7a18-765b-4118-aa71-fad7ea7e058d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.155777 Aug 03 01:57:07.048660 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1195/2419] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:06 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:07.441713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-80e34d7d-ffdb-4ca2-8f55-c62052e32596 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:07.444132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-80e34d7d-ffdb-4ca2-8f55-c62052e32596 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:07.457273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80e34d7d-ffdb-4ca2-8f55-c62052e32596 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:07.460329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80e34d7d-ffdb-4ca2-8f55-c62052e32596 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:07.467440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80e34d7d-ffdb-4ca2-8f55-c62052e32596 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:07.469867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80e34d7d-ffdb-4ca2-8f55-c62052e32596 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:07.592978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-80e34d7d-ffdb-4ca2-8f55-c62052e32596 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:57:07.702160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e857406d-a2d9-4813-be57-ad7d970cecb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:07.705707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e857406d-a2d9-4813-be57-ad7d970cecb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:07.761348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e857406d-a2d9-4813-be57-ad7d970cecb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:07.763853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e857406d-a2d9-4813-be57-ad7d970cecb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:07.764990 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e857406d-a2d9-4813-be57-ad7d970cecb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:07.770245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e857406d-a2d9-4813-be57-ad7d970cecb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:07.872757 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-80e34d7d-ffdb-4ca2-8f55-c62052e32596 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "DELETE /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 204 len: 0 microversion: 2.25 time: 0.438692 Aug 03 01:57:07.881877 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1225/2420] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 01:57:07 2022] DELETE /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:57:07.904314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-adc2874e-835f-403d-b223-c78da14dcbe1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:07.907911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-adc2874e-835f-403d-b223-c78da14dcbe1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:07.945552 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-adc2874e-835f-403d-b223-c78da14dcbe1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:07.946074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-adc2874e-835f-403d-b223-c78da14dcbe1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:07.950013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-adc2874e-835f-403d-b223-c78da14dcbe1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:07.953195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-adc2874e-835f-403d-b223-c78da14dcbe1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:08.326029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-adc2874e-835f-403d-b223-c78da14dcbe1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:08.344386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-adc2874e-835f-403d-b223-c78da14dcbe1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:08.351538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-adc2874e-835f-403d-b223-c78da14dcbe1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:08.355765 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-adc2874e-835f-403d-b223-c78da14dcbe1 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1732 microversion: 2.25 time: 0.471464 Aug 03 01:57:08.364850 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1226/2421] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:07 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1732 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:08.388381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4554284d-bf12-4de3-9233-618b4ebb9390 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b243ff820>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:08.493832 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4554284d-bf12-4de3-9233-618b4ebb9390 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.126262 Aug 03 01:57:08.496008 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1227/2422] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:08 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:08.657269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e857406d-a2d9-4813-be57-ad7d970cecb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:08.665944 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e857406d-a2d9-4813-be57-ad7d970cecb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.967898 Aug 03 01:57:08.671369 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1196/2423] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:07 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:57:09.394872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d6736265-cab2-4281-b4d4-5bc1dc053add tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:09.395899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d6736265-cab2-4281-b4d4-5bc1dc053add tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:09.414744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6736265-cab2-4281-b4d4-5bc1dc053add tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:09.416303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6736265-cab2-4281-b4d4-5bc1dc053add tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:09.418996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6736265-cab2-4281-b4d4-5bc1dc053add tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:09.426620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6736265-cab2-4281-b4d4-5bc1dc053add tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:09.499891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:57:09.512083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-668c0035-dc42-46bf-8e8a-f4db005be0dc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b13163ca0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:09.632556 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-668c0035-dc42-46bf-8e8a-f4db005be0dc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.124869 Aug 03 01:57:09.640490 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1197/2424] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:09 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:57:09.694874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-10e7c83a-3065-4b05-8247-71cb05ea1b73 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:09.695596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-10e7c83a-3065-4b05-8247-71cb05ea1b73 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:09.714555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-10e7c83a-3065-4b05-8247-71cb05ea1b73 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:09.715802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-10e7c83a-3065-4b05-8247-71cb05ea1b73 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:09.716631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-10e7c83a-3065-4b05-8247-71cb05ea1b73 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:09.717087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-10e7c83a-3065-4b05-8247-71cb05ea1b73 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:11.378187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d6736265-cab2-4281-b4d4-5bc1dc053add tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:11.399884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d6736265-cab2-4281-b4d4-5bc1dc053add tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:11.406469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d6736265-cab2-4281-b4d4-5bc1dc053add tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:11.410637 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d6736265-cab2-4281-b4d4-5bc1dc053add tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1732 microversion: 2.25 time: 2.020452 Aug 03 01:57:11.445491 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1228/2425] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:09 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1732 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:11.477873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-611f366f-7fae-4eff-aee4-39ddbe4a8785 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b12a7e940>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:11.607090 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-611f366f-7fae-4eff-aee4-39ddbe4a8785 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.159988 Aug 03 01:57:11.608329 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1229/2426] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:11 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:11.615332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-98051d73-ca80-4c48-91fe-edd3a154af11 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Action: 'create', calling method: .version_select at 0x7f5b12a7e550>, body: {"keypair": {"name": "tempest-keypair-2008591506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUF4SxKCecgvPNdQJmP8XPdTk1aEpTyZypAhjYaUU+ZiGUyyEk2s5bG00nZJEdeglIibgffRh2r9NQaHMZmWEkrYz1uCDVgXfs14Z6Res/oc1MtCCzvPL1dN0HY82KfOg=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:11.638987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-98051d73-ca80-4c48-91fe-edd3a154af11 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Getting quotas for project 63f89d0f699c49fcb49da050cb5c769e. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:57:11.656626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-98051d73-ca80-4c48-91fe-edd3a154af11 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Getting quotas for user 38b0905e032b4d8bb313f8869e4d369b and project 63f89d0f699c49fcb49da050cb5c769e. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:57:11.713638 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-98051d73-ca80-4c48-91fe-edd3a154af11 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.103660 Aug 03 01:57:11.715008 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1230/2427] 10.222.0.67 () {62 vars in 1200 bytes} [Wed Aug 3 01:57:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 01:57:11.746741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-10e7c83a-3065-4b05-8247-71cb05ea1b73 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:11.764054 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-10e7c83a-3065-4b05-8247-71cb05ea1b73 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 2.074316 Aug 03 01:57:11.769608 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1198/2428] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:09 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 2081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:57:12.444871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7479f3df-dba4-4905-a2a2-f969ab819272 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:12.445788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7479f3df-dba4-4905-a2a2-f969ab819272 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:12.465084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7479f3df-dba4-4905-a2a2-f969ab819272 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:12.467054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7479f3df-dba4-4905-a2a2-f969ab819272 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:12.469571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7479f3df-dba4-4905-a2a2-f969ab819272 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:12.471067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7479f3df-dba4-4905-a2a2-f969ab819272 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:12.627525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d7a31954-69a4-4ceb-87eb-ddec5c225acc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b13c3ee50>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:12.704445 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d7a31954-69a4-4ceb-87eb-ddec5c225acc tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.084558 Aug 03 01:57:12.705220 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1199/2429] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:12 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:12.793188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6dedf58a-635d-4a4e-bd17-5f2c788f9597 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:12.793845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6dedf58a-635d-4a4e-bd17-5f2c788f9597 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:12.805270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dedf58a-635d-4a4e-bd17-5f2c788f9597 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:12.824566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dedf58a-635d-4a4e-bd17-5f2c788f9597 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:12.827236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dedf58a-635d-4a4e-bd17-5f2c788f9597 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:12.828045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dedf58a-635d-4a4e-bd17-5f2c788f9597 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:13.044265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7479f3df-dba4-4905-a2a2-f969ab819272 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:13.060144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7479f3df-dba4-4905-a2a2-f969ab819272 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:13.061679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7479f3df-dba4-4905-a2a2-f969ab819272 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:13.063026 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7479f3df-dba4-4905-a2a2-f969ab819272 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1732 microversion: 2.25 time: 0.624648 Aug 03 01:57:13.063490 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1231/2430] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:12 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1732 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:13.352508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6dedf58a-635d-4a4e-bd17-5f2c788f9597 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:13.366689 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6dedf58a-635d-4a4e-bd17-5f2c788f9597 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.580025 Aug 03 01:57:13.388007 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1200/2431] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:12 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:13.719914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1208280a-dd3b-4c4b-a732-be025a7b1127 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b243ff0d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:13.821721 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1208280a-dd3b-4c4b-a732-be025a7b1127 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.105634 Aug 03 01:57:13.822329 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1232/2432] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:13 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:14.069919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-54f96753-348d-4fa3-b28b-bc5e5fad6727 req-d6fac792-a2c7-4f7e-bd7e-fcb9cc1dcb70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47752419-6bf3-468f-b3a4-e212358b9e66", "name": "network-vif-deleted", "tag": "5ed2445c-012d-4ab5-960d-36a1cd1a2eed"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:14.091169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e9fe1464-995a-45ab-a43f-4df2b19d9db4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:14.091803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e9fe1464-995a-45ab-a43f-4df2b19d9db4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:14.109393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9fe1464-995a-45ab-a43f-4df2b19d9db4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:14.116542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-54f96753-348d-4fa3-b28b-bc5e5fad6727 req-d6fac792-a2c7-4f7e-bd7e-fcb9cc1dcb70 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:14.117797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9fe1464-995a-45ab-a43f-4df2b19d9db4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:14.122222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9fe1464-995a-45ab-a43f-4df2b19d9db4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:14.122571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9fe1464-995a-45ab-a43f-4df2b19d9db4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:14.125971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-54f96753-348d-4fa3-b28b-bc5e5fad6727 req-d6fac792-a2c7-4f7e-bd7e-fcb9cc1dcb70 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:14.204464 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-54f96753-348d-4fa3-b28b-bc5e5fad6727 req-d6fac792-a2c7-4f7e-bd7e-fcb9cc1dcb70 service nova] Creating event network-vif-deleted:5ed2445c-012d-4ab5-960d-36a1cd1a2eed for instance 47752419-6bf3-468f-b3a4-e212358b9e66 on n-h2-826529-8 Aug 03 01:57:14.225319 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-54f96753-348d-4fa3-b28b-bc5e5fad6727 req-d6fac792-a2c7-4f7e-bd7e-fcb9cc1dcb70 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158570 Aug 03 01:57:14.225319 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1201/2433] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:14.353907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e9fe1464-995a-45ab-a43f-4df2b19d9db4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:14.364706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e9fe1464-995a-45ab-a43f-4df2b19d9db4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:14.366269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e9fe1464-995a-45ab-a43f-4df2b19d9db4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:14.386393 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e9fe1464-995a-45ab-a43f-4df2b19d9db4 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 200 len: 1371 microversion: 2.25 time: 0.299759 Aug 03 01:57:14.394431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2549c6b8-c41b-4d5a-9468-93c9649b93a5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:14.395620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2549c6b8-c41b-4d5a-9468-93c9649b93a5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:14.406273 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1233/2434] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:14 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:57:14.418370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2549c6b8-c41b-4d5a-9468-93c9649b93a5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:14.419137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2549c6b8-c41b-4d5a-9468-93c9649b93a5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:14.422685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2549c6b8-c41b-4d5a-9468-93c9649b93a5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:14.426451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2549c6b8-c41b-4d5a-9468-93c9649b93a5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:14.735019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2549c6b8-c41b-4d5a-9468-93c9649b93a5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:14.750876 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2549c6b8-c41b-4d5a-9468-93c9649b93a5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.361419 Aug 03 01:57:14.761475 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1202/2435] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:14 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:14.840883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31782d84-44bd-4cfa-b4a9-3d7f257dada1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b243b93a0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:14.914364 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-31782d84-44bd-4cfa-b4a9-3d7f257dada1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.081523 Aug 03 01:57:14.915354 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1234/2436] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:14 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:15.427834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0a6afbca-991c-4c23-8975-66414392f4dd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:15.428945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0a6afbca-991c-4c23-8975-66414392f4dd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 47752419-6bf3-468f-b3a4-e212358b9e66] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:15.463045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a6afbca-991c-4c23-8975-66414392f4dd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:15.482827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a6afbca-991c-4c23-8975-66414392f4dd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:15.491549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a6afbca-991c-4c23-8975-66414392f4dd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:15.492759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a6afbca-991c-4c23-8975-66414392f4dd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:15.535603 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-0a6afbca-991c-4c23-8975-66414392f4dd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] HTTP exception thrown: Instance 47752419-6bf3-468f-b3a4-e212358b9e66 could not be found. Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0a6afbca-991c-4c23-8975-66414392f4dd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Request method failure captured: Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 HTTP/1.1 Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dQmYksyCHGe05wRQxbk6QfqbWkBxABJ5P_n0aCiHJbs9MllgVdpbYymAxb_HczTpTqJwJO5NoW-z9Kl8QAFDfkjt2Rysc3BdoTKS198Pdcf8wdPSi10_HctX3SPJqykocduTYhOzA_bALuNdgBeucW4AsPQCeHlVOF2e2nWAoRZ89Q Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.25 Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 162addf8f6634e7fa0a1f9c6004258d1 Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-519991888 Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_162addf8f6634e7fa0a1f9c6004258d1", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/162addf8f6634e7fa0a1f9c6004258d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/162addf8f6634e7fa0a1f9c6004258d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/162addf8f6634e7fa0a1f9c6004258d1"}]}] Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-519991888 Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 162addf8f6634e7fa0a1f9c6004258d1 Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-519991888 Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-LiveAutoBlockMigrationV225Test-519991888-project Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4cb821820bbb4d3a8c999e1dec6a06a4 Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-519991888-project Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 47752419-6bf3-468f-b3a4-e212358b9e66 could not be found. Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '47752419-6bf3-468f-b3a4-e212358b9e66'} Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47752419-6bf3-468f-b3a4-e212358b9e66 could not be found. Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47752419-6bf3-468f-b3a4-e212358b9e66 could not be found. Aug 03 01:57:15.541399 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:15.546303 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:15.546303 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:15.546303 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:15.546303 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:15.546303 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:15.546303 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:57:15.546303 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:57:15.546303 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47752419-6bf3-468f-b3a4-e212358b9e66 could not be found. Aug 03 01:57:15.546303 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:15.549594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0a6afbca-991c-4c23-8975-66414392f4dd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Returning 404 to user: Instance 47752419-6bf3-468f-b3a4-e212358b9e66 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:57:15.553507 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0a6afbca-991c-4c23-8975-66414392f4dd tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66" status: 404 len: 111 microversion: 2.25 time: 0.132045 Aug 03 01:57:15.556413 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1203/2437] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:15 2022] GET /compute/v2.1/servers/47752419-6bf3-468f-b3a4-e212358b9e66 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:57:15.570213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8f219a20-4e12-4d32-8a2e-90e12b1bd904 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '.version_select at 0x7f5b12a34940>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:15.603271 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8f219a20-4e12-4d32-8a2e-90e12b1bd904 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1478450462" status: 204 len: 0 microversion: 2.25 time: 0.042266 Aug 03 01:57:15.621950 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1235/2438] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 3 01:57:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1478450462 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:57:15.783621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9594ccb6-9d5c-4dea-892d-6dbb352d58de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:15.785312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9594ccb6-9d5c-4dea-892d-6dbb352d58de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:15.797031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9594ccb6-9d5c-4dea-892d-6dbb352d58de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:15.803695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9594ccb6-9d5c-4dea-892d-6dbb352d58de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:15.804918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9594ccb6-9d5c-4dea-892d-6dbb352d58de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:15.807838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9594ccb6-9d5c-4dea-892d-6dbb352d58de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:15.930279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a91e491f-4f8b-4b7a-acd2-af3e018835b2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b129e6ca0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:16.069873 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a91e491f-4f8b-4b7a-acd2-af3e018835b2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.143723 Aug 03 01:57:16.089561 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1236/2439] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:15 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:16.432080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9594ccb6-9d5c-4dea-892d-6dbb352d58de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:16.441773 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9594ccb6-9d5c-4dea-892d-6dbb352d58de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.663401 Aug 03 01:57:16.442383 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1204/2440] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:15 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:57:17.093995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5c381f64-a8db-45fb-9ca6-47867405646e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b243b90d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:17.198101 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5c381f64-a8db-45fb-9ca6-47867405646e tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.108199 Aug 03 01:57:17.198719 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1237/2441] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:17 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:17.465480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4395a20c-2c6c-4fa8-a8a2-2294681a047c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:17.466883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4395a20c-2c6c-4fa8-a8a2-2294681a047c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:17.490969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4395a20c-2c6c-4fa8-a8a2-2294681a047c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:17.497264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4395a20c-2c6c-4fa8-a8a2-2294681a047c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:17.499241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4395a20c-2c6c-4fa8-a8a2-2294681a047c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:17.505366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4395a20c-2c6c-4fa8-a8a2-2294681a047c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:17.629246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2b5d9e7-eb5e-4277-beda-c6c745f65362 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:17.630081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c2b5d9e7-eb5e-4277-beda-c6c745f65362 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:17.639659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2b5d9e7-eb5e-4277-beda-c6c745f65362 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:17.640455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2b5d9e7-eb5e-4277-beda-c6c745f65362 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:17.641583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2b5d9e7-eb5e-4277-beda-c6c745f65362 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:17.642207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2b5d9e7-eb5e-4277-beda-c6c745f65362 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:17.740024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c2b5d9e7-eb5e-4277-beda-c6c745f65362 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:57:17.893984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4395a20c-2c6c-4fa8-a8a2-2294681a047c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:17.899452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:57:17.933809 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4395a20c-2c6c-4fa8-a8a2-2294681a047c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.472513 Aug 03 01:57:17.959925 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1205/2442] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:17 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:18.053590 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c2b5d9e7-eb5e-4277-beda-c6c745f65362 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 204 len: 0 microversion: 2.25 time: 0.431511 Aug 03 01:57:18.054241 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1238/2443] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 01:57:17 2022] DELETE /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 03 01:57:18.069445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4f8ac010-9ab0-4239-89da-d9cad69e945a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:18.070542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4f8ac010-9ab0-4239-89da-d9cad69e945a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:18.090618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f8ac010-9ab0-4239-89da-d9cad69e945a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:18.095266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f8ac010-9ab0-4239-89da-d9cad69e945a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:18.099343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f8ac010-9ab0-4239-89da-d9cad69e945a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:18.100815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f8ac010-9ab0-4239-89da-d9cad69e945a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:18.218390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-006dfbf1-54a4-4cc6-ae56-c0418b4568f3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b137a8670>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:18.333963 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-006dfbf1-54a4-4cc6-ae56-c0418b4568f3 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.123880 Aug 03 01:57:18.335210 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1239/2444] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:18 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:18.344612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1287907970", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6a5d279d-df32-453b-bf0c-2ae0f720d5ae"}, {"port": "6afd3b79-7021-42c2-850a-794d515c4eb6", "tag": "port-1"}, {"port": "0956e1fb-7c38-41ed-9df3-a9cd8fe4b445", "tag": "port-2"}, {"uuid": "7e98e467-7ff1-4409-85db-97576cb81790", "tag": "net-1"}, {"uuid": "7e98e467-7ff1-4409-85db-97576cb81790"}, {"uuid": "44fcb01a-07e3-480e-92f7-0aa1e021eea5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "44fcb01a-07e3-480e-92f7-0aa1e021eea5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "4ebbcdd4-383f-412a-86ad-8d8957c5ba6c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f518d904-7837-4af9-bcd9-87a66fa9815c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "950bbb22-ee52-4965-8da0-b0c44885a4e1", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2039626699"}], "key_name": "tempest-keypair-2008591506", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:18.608358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4f8ac010-9ab0-4239-89da-d9cad69e945a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:18.631595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4f8ac010-9ab0-4239-89da-d9cad69e945a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:18.636592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4f8ac010-9ab0-4239-89da-d9cad69e945a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:18.641801 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4f8ac010-9ab0-4239-89da-d9cad69e945a tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1550 microversion: 2.25 time: 0.583013 Aug 03 01:57:18.646951 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1206/2445] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:18 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1550 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:18.826943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] validate_networks() for [('6a5d279d-df32-453b-bf0c-2ae0f720d5ae', None, None, None, None, None), (None, None, '6afd3b79-7021-42c2-850a-794d515c4eb6', None, None, None), (None, None, '0956e1fb-7c38-41ed-9df3-a9cd8fe4b445', None, None, None), ('7e98e467-7ff1-4409-85db-97576cb81790', None, None, None, None, None), ('7e98e467-7ff1-4409-85db-97576cb81790', None, None, None, None, None), ('44fcb01a-07e3-480e-92f7-0aa1e021eea5', '10.2.2.100', None, None, None, None), ('44fcb01a-07e3-480e-92f7-0aa1e021eea5', '10.2.2.200', None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:57:18.958742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5b6dce5c-1385-46e2-80c6-c4f2d86b90ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:18.959808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5b6dce5c-1385-46e2-80c6-c4f2d86b90ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:18.980924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b6dce5c-1385-46e2-80c6-c4f2d86b90ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:18.981483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b6dce5c-1385-46e2-80c6-c4f2d86b90ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:18.985318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b6dce5c-1385-46e2-80c6-c4f2d86b90ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:18.985979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b6dce5c-1385-46e2-80c6-c4f2d86b90ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:20.053418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5b6dce5c-1385-46e2-80c6-c4f2d86b90ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:20.071322 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5b6dce5c-1385-46e2-80c6-c4f2d86b90ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 1.113430 Aug 03 01:57:20.074296 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1207/2446] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:18 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:57:20.763992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5c718ee2-a378-497c-a714-e7912a118a24 tempest-SecurityGroupsTestAdminJSON-62233088 tempest-SecurityGroupsTestAdminJSON-62233088-project] Action: 'create', calling method: .version_select at 0x7f5b243d8670>, body: {"security_group": {"name": "tempest-securitygroup-227514939", "description": "tempest-description-1596792838"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:21.678573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:57:22.134652 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5c718ee2-a378-497c-a714-e7912a118a24 tempest-SecurityGroupsTestAdminJSON-62233088 tempest-SecurityGroupsTestAdminJSON-62233088-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.056922 Aug 03 01:57:22.135840 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1208/2447] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:57:20 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:22.148474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-11731301-69ab-4bfa-8b46-67ff48fed39f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b133fd310>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:22.274495 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-11731301-69ab-4bfa-8b46-67ff48fed39f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.137304 Aug 03 01:57:22.285987 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1209/2448] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:22 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:22.300674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-761ae827-b541-4bf2-9553-e130f515e244 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:22.303204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-761ae827-b541-4bf2-9553-e130f515e244 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:22.333273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-761ae827-b541-4bf2-9553-e130f515e244 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:22.334458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-761ae827-b541-4bf2-9553-e130f515e244 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:22.336011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-761ae827-b541-4bf2-9553-e130f515e244 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:22.337983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-761ae827-b541-4bf2-9553-e130f515e244 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:22.433803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-761ae827-b541-4bf2-9553-e130f515e244 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:22.434839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-761ae827-b541-4bf2-9553-e130f515e244 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:22.437514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-761ae827-b541-4bf2-9553-e130f515e244 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lazy-loading 'fault' on Instance uuid 1025ec9b-6b5d-445a-8c05-ae537d3273cc {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:57:22.610992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-761ae827-b541-4bf2-9553-e130f515e244 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:22.620048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-761ae827-b541-4bf2-9553-e130f515e244 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:22.631707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-761ae827-b541-4bf2-9553-e130f515e244 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:22.640819 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-761ae827-b541-4bf2-9553-e130f515e244 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 200 len: 1352 microversion: 2.25 time: 0.353271 Aug 03 01:57:22.653890 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1210/2449] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:22 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 1352 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:22.669195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-033c711f-c541-412d-8f1f-f5f5639f1c0e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:22.671106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-033c711f-c541-412d-8f1f-f5f5639f1c0e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:22.685418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-033c711f-c541-412d-8f1f-f5f5639f1c0e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:22.687455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-033c711f-c541-412d-8f1f-f5f5639f1c0e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:22.696319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-033c711f-c541-412d-8f1f-f5f5639f1c0e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:22.697018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-033c711f-c541-412d-8f1f-f5f5639f1c0e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:23.162925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-033c711f-c541-412d-8f1f-f5f5639f1c0e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:23.179517 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-033c711f-c541-412d-8f1f-f5f5639f1c0e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.523578 Aug 03 01:57:23.180356 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1211/2450] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:22 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:23.198027 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-595a0f98-d31c-43ca-a81f-d545c7a936b0 req-f9b2b848-da5f-459d-a337-88bd6d5359a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1025ec9b-6b5d-445a-8c05-ae537d3273cc", "name": "network-vif-deleted", "tag": "db8c88b5-548a-478f-bd6f-7ccdcd714cf9"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:23.251736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-595a0f98-d31c-43ca-a81f-d545c7a936b0 req-f9b2b848-da5f-459d-a337-88bd6d5359a6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:23.252944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-595a0f98-d31c-43ca-a81f-d545c7a936b0 req-f9b2b848-da5f-459d-a337-88bd6d5359a6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:23.305575 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-595a0f98-d31c-43ca-a81f-d545c7a936b0 req-f9b2b848-da5f-459d-a337-88bd6d5359a6 service nova] Creating event network-vif-deleted:db8c88b5-548a-478f-bd6f-7ccdcd714cf9 for instance 1025ec9b-6b5d-445a-8c05-ae537d3273cc on n-h2-826529-8 Aug 03 01:57:23.320245 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-595a0f98-d31c-43ca-a81f-d545c7a936b0 req-f9b2b848-da5f-459d-a337-88bd6d5359a6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134296 Aug 03 01:57:23.325516 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1212/2451] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:23.340136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1707ec52-a420-47cf-ade4-7dbea273b8ee tempest-SecurityGroupsTestAdminJSON-62233088 tempest-SecurityGroupsTestAdminJSON-62233088-project] Action: 'create', calling method: .version_select at 0x7f5b243d8310>, body: {"security_group": {"name": "tempest-securitygroup-613442915", "description": "tempest-description-1424577875"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:23.990282 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1707ec52-a420-47cf-ade4-7dbea273b8ee tempest-SecurityGroupsTestAdminJSON-62233088 tempest-SecurityGroupsTestAdminJSON-62233088-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.662719 Aug 03 01:57:24.004623 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1213/2452] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:57:23 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:24.021317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f03dbc69-e93a-4809-a5e5-36f26b068b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:24.022248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f03dbc69-e93a-4809-a5e5-36f26b068b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:24.052252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f03dbc69-e93a-4809-a5e5-36f26b068b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:24.053019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f03dbc69-e93a-4809-a5e5-36f26b068b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:24.054234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f03dbc69-e93a-4809-a5e5-36f26b068b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:24.055067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f03dbc69-e93a-4809-a5e5-36f26b068b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:24.258364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-f03dbc69-e93a-4809-a5e5-36f26b068b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lazy-loading 'services' on Instance uuid d537dd36-d584-48d0-9458-81075e06b366 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:57:24.398730 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f03dbc69-e93a-4809-a5e5-36f26b068b6a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments/163a1498-fa8e-4aed-beef-bfb6d313c4d7" status: 202 len: 0 microversion: 2.1 time: 0.392304 Aug 03 01:57:24.402007 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1214/2453] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 01:57:24 2022] DELETE /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments/163a1498-fa8e-4aed-beef-bfb6d313c4d7 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:57:24.417785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0979796b-d5ed-4fdf-a0dd-c1c5eaaffc16 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b24487670>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:24.556932 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0979796b-d5ed-4fdf-a0dd-c1c5eaaffc16 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.147330 Aug 03 01:57:24.560034 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1215/2454] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:24 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:24.583164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4c997798-18d9-4bf4-852b-ee570720b474 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:24.586713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4c997798-18d9-4bf4-852b-ee570720b474 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: 1025ec9b-6b5d-445a-8c05-ae537d3273cc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:24.635723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=67 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:57:24.641087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c997798-18d9-4bf4-852b-ee570720b474 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:24.642854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c997798-18d9-4bf4-852b-ee570720b474 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:24.645888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c997798-18d9-4bf4-852b-ee570720b474 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:24.654333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c997798-18d9-4bf4-852b-ee570720b474 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:24.694218 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-4c997798-18d9-4bf4-852b-ee570720b474 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] HTTP exception thrown: Instance 1025ec9b-6b5d-445a-8c05-ae537d3273cc could not be found. Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4c997798-18d9-4bf4-852b-ee570720b474 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Request method failure captured: Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc HTTP/1.1 Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dQmYksyCHGe05wRQxbk6QfqbWkBxABJ5P_n0aCiHJbs9MllgVdpbYymAxb_HczTpTqJwJO5NoW-z9Kl8QAFDfkjt2Rysc3BdoTKS198Pdcf8wdPSi10_HctX3SPJqykocduTYhOzA_bALuNdgBeucW4AsPQCeHlVOF2e2nWAoRZ89Q Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.25 Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 162addf8f6634e7fa0a1f9c6004258d1 Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-519991888 Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_162addf8f6634e7fa0a1f9c6004258d1", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/162addf8f6634e7fa0a1f9c6004258d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/162addf8f6634e7fa0a1f9c6004258d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/162addf8f6634e7fa0a1f9c6004258d1"}]}] Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-519991888 Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 162addf8f6634e7fa0a1f9c6004258d1 Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-519991888 Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-LiveAutoBlockMigrationV225Test-519991888-project Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4cb821820bbb4d3a8c999e1dec6a06a4 Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-519991888-project Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 1025ec9b-6b5d-445a-8c05-ae537d3273cc could not be found. Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '1025ec9b-6b5d-445a-8c05-ae537d3273cc'} Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1025ec9b-6b5d-445a-8c05-ae537d3273cc could not be found. Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1025ec9b-6b5d-445a-8c05-ae537d3273cc could not be found. Aug 03 01:57:24.700521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:24.703958 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:24.703958 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:24.703958 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:24.703958 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:24.703958 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:24.703958 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:57:24.703958 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:57:24.703958 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1025ec9b-6b5d-445a-8c05-ae537d3273cc could not be found. Aug 03 01:57:24.703958 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:24.717723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4c997798-18d9-4bf4-852b-ee570720b474 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Returning 404 to user: Instance 1025ec9b-6b5d-445a-8c05-ae537d3273cc could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:57:24.720475 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4c997798-18d9-4bf4-852b-ee570720b474 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc" status: 404 len: 111 microversion: 2.25 time: 0.156643 Aug 03 01:57:24.727527 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1216/2455] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:24 2022] GET /compute/v2.1/servers/1025ec9b-6b5d-445a-8c05-ae537d3273cc => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:57:25.440723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4312bacd-6a09-4804-adba-52e5e019c801 tempest-SecurityGroupsTestAdminJSON-227260710 tempest-SecurityGroupsTestAdminJSON-227260710-project-admin] Action: 'create', calling method: .version_select at 0x7f5b24427b80>, body: {"security_group": {"name": "tempest-securitygroup-1763902319", "description": "tempest-description-897649230"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:25.574528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:57:25.575222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:57:25.575481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:57:25.575911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:57:25.576423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:57:25.584571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:57:25.603940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:25.604680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:25.605748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:25.608664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:25.660622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Getting quotas for project 63f89d0f699c49fcb49da050cb5c769e. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:57:25.673449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Getting quotas for user 38b0905e032b4d8bb313f8869e4d369b and project 63f89d0f699c49fcb49da050cb5c769e. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:57:26.179469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:57:26.183641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='4ebbcdd4-383f-412a-86ad-8d8957c5ba6c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f518d904-7837-4af9-bcd9-87a66fa9815c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='950bbb22-ee52-4965-8da0-b0c44885a4e1',volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:57:26.225764 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4312bacd-6a09-4804-adba-52e5e019c801 tempest-SecurityGroupsTestAdminJSON-227260710 tempest-SecurityGroupsTestAdminJSON-227260710-project-admin] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.496726 Aug 03 01:57:26.227558 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1217/2456] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:57:24 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:26.240379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dde8a31e-fb99-4d92-b578-4541af672eb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:26.241620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dde8a31e-fb99-4d92-b578-4541af672eb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:26.255017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dde8a31e-fb99-4d92-b578-4541af672eb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:26.257443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dde8a31e-fb99-4d92-b578-4541af672eb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:26.259897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dde8a31e-fb99-4d92-b578-4541af672eb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:26.262615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dde8a31e-fb99-4d92-b578-4541af672eb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:27.054454 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e96fe023-9104-40f1-8ea9-305a8d503f01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.715141 Aug 03 01:57:27.059843 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1240/2457] 10.222.0.67 () {62 vars in 1189 bytes} [Wed Aug 3 01:57:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 8724 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 01:57:27.082059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d39a749a-b44c-40f6-abc0-e7092eab0a81 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:27.109835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d39a749a-b44c-40f6-abc0-e7092eab0a81 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:27.135231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d39a749a-b44c-40f6-abc0-e7092eab0a81 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:27.135923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d39a749a-b44c-40f6-abc0-e7092eab0a81 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:27.137582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d39a749a-b44c-40f6-abc0-e7092eab0a81 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:27.140347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d39a749a-b44c-40f6-abc0-e7092eab0a81 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:27.233825 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d39a749a-b44c-40f6-abc0-e7092eab0a81 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169091 Aug 03 01:57:27.238212 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1241/2458] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 01:57:27 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:27.266967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3f5d47bb-cb88-4816-8788-3e6f0e133306 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:27.268880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3f5d47bb-cb88-4816-8788-3e6f0e133306 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:27.277447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f5d47bb-cb88-4816-8788-3e6f0e133306 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:27.278175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f5d47bb-cb88-4816-8788-3e6f0e133306 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:27.279557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f5d47bb-cb88-4816-8788-3e6f0e133306 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:27.280235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f5d47bb-cb88-4816-8788-3e6f0e133306 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:27.335574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3f5d47bb-cb88-4816-8788-3e6f0e133306 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:57:27.570715 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3f5d47bb-cb88-4816-8788-3e6f0e133306 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 204 len: 0 microversion: 2.25 time: 0.329614 Aug 03 01:57:27.572750 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1242/2459] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 01:57:27 2022] DELETE /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:57:27.580344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ea675b96-0c5e-4eae-b10b-7a5a28ff2235 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b12c3a040>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:27.613597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dde8a31e-fb99-4d92-b578-4541af672eb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:27.625833 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dde8a31e-fb99-4d92-b578-4541af672eb5 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 1.393723 Aug 03 01:57:27.626500 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1218/2460] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:26 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:27.641899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-740cd3ad-f2ff-4386-9013-6b7f161d43bb tempest-SecurityGroupsTestAdminJSON-227260710 tempest-SecurityGroupsTestAdminJSON-227260710-project-admin] Action: 'create', calling method: .version_select at 0x7f5b24420c10>, body: {"security_group": {"name": "tempest-securitygroup-1585844472", "description": "tempest-description-784200810"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:27.670812 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ea675b96-0c5e-4eae-b10b-7a5a28ff2235 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.094578 Aug 03 01:57:27.673386 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1243/2461] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:27 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:27.697071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3749eab5-b969-46b9-9d76-6d1194546006 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:27.699443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3749eab5-b969-46b9-9d76-6d1194546006 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:27.952568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3749eab5-b969-46b9-9d76-6d1194546006 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:27.968878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3749eab5-b969-46b9-9d76-6d1194546006 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:27.979403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3749eab5-b969-46b9-9d76-6d1194546006 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:27.980994 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3749eab5-b969-46b9-9d76-6d1194546006 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1286 microversion: 2.32 time: 0.303496 Aug 03 01:57:27.982016 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1244/2462] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:27 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1286 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:28.028161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-238ecc08-5970-4785-bec4-be5c538226f9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:28.036718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-238ecc08-5970-4785-bec4-be5c538226f9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:28.051220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-238ecc08-5970-4785-bec4-be5c538226f9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:28.052808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-238ecc08-5970-4785-bec4-be5c538226f9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:28.056133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-238ecc08-5970-4785-bec4-be5c538226f9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:28.057563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-238ecc08-5970-4785-bec4-be5c538226f9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:29.045412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-238ecc08-5970-4785-bec4-be5c538226f9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:29.063704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-238ecc08-5970-4785-bec4-be5c538226f9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:29.065197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-238ecc08-5970-4785-bec4-be5c538226f9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:29.066594 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-238ecc08-5970-4785-bec4-be5c538226f9 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1564 microversion: 2.25 time: 1.083287 Aug 03 01:57:29.069182 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1245/2463] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:27 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1564 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:29.077116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bfe42a21-4218-44d0-8090-770b0244c516 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:29.086167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bfe42a21-4218-44d0-8090-770b0244c516 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:29.103763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfe42a21-4218-44d0-8090-770b0244c516 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:29.104434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfe42a21-4218-44d0-8090-770b0244c516 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:29.105441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfe42a21-4218-44d0-8090-770b0244c516 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:29.108417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfe42a21-4218-44d0-8090-770b0244c516 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:29.195256 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-740cd3ad-f2ff-4386-9013-6b7f161d43bb tempest-SecurityGroupsTestAdminJSON-227260710 tempest-SecurityGroupsTestAdminJSON-227260710-project-admin] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.567357 Aug 03 01:57:29.199092 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bfe42a21-4218-44d0-8090-770b0244c516 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128344 Aug 03 01:57:29.199681 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1246/2464] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 01:57:29 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:29.204769 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1219/2465] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 01:57:27 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:29.210181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b078b592-83f0-4406-a821-5a0b9c49ce23 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b24487280>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:29.211270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f8a4ebe2-d07d-45c3-b3a4-a4ddd79737de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:29.217696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f8a4ebe2-d07d-45c3-b3a4-a4ddd79737de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:29.232227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8a4ebe2-d07d-45c3-b3a4-a4ddd79737de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:29.234657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8a4ebe2-d07d-45c3-b3a4-a4ddd79737de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:29.239936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8a4ebe2-d07d-45c3-b3a4-a4ddd79737de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:29.240405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8a4ebe2-d07d-45c3-b3a4-a4ddd79737de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:29.314383 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b078b592-83f0-4406-a821-5a0b9c49ce23 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.108326 Aug 03 01:57:29.317362 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1220/2466] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:29 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:29.323381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-04f971f8-443f-4d4c-bad4-41e0f8f593b3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:29.324329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-04f971f8-443f-4d4c-bad4-41e0f8f593b3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:29.490340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-04f971f8-443f-4d4c-bad4-41e0f8f593b3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:29.509866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-04f971f8-443f-4d4c-bad4-41e0f8f593b3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:29.519654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-04f971f8-443f-4d4c-bad4-41e0f8f593b3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:29.528929 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-04f971f8-443f-4d4c-bad4-41e0f8f593b3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1286 microversion: 2.32 time: 0.210191 Aug 03 01:57:29.533134 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1221/2467] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:29 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1286 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:29.543939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-35caa0b0-b81d-4e70-9dcc-3f6d93403e97 tempest-SecurityGroupsTestAdminJSON-227260710 tempest-SecurityGroupsTestAdminJSON-227260710-project-admin] Calling method '.version_select at 0x7f5b243e6e50>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:30.068807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f8a4ebe2-d07d-45c3-b3a4-a4ddd79737de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:30.089725 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f8a4ebe2-d07d-45c3-b3a4-a4ddd79737de tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.888777 Aug 03 01:57:30.107933 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1247/2468] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:29 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:30.125919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-93aa64ab-7c2c-4b55-a315-e65e3d7742a6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:30.126953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-93aa64ab-7c2c-4b55-a315-e65e3d7742a6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:30.172647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93aa64ab-7c2c-4b55-a315-e65e3d7742a6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:30.179664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93aa64ab-7c2c-4b55-a315-e65e3d7742a6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:30.180861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93aa64ab-7c2c-4b55-a315-e65e3d7742a6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:30.187586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93aa64ab-7c2c-4b55-a315-e65e3d7742a6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:31.032359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-93aa64ab-7c2c-4b55-a315-e65e3d7742a6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:31.041940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-93aa64ab-7c2c-4b55-a315-e65e3d7742a6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:31.057072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-93aa64ab-7c2c-4b55-a315-e65e3d7742a6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:31.064820 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-93aa64ab-7c2c-4b55-a315-e65e3d7742a6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1564 microversion: 2.25 time: 0.955089 Aug 03 01:57:31.074547 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1248/2469] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:30 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1564 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:31.083130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3a72347b-a8eb-4f52-befa-ea75895d511e tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:31.102178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3a72347b-a8eb-4f52-befa-ea75895d511e tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:31.130721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a72347b-a8eb-4f52-befa-ea75895d511e tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:31.144167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a72347b-a8eb-4f52-befa-ea75895d511e tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:31.145433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a72347b-a8eb-4f52-befa-ea75895d511e tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:31.146254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a72347b-a8eb-4f52-befa-ea75895d511e tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:31.327920 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3a72347b-a8eb-4f52-befa-ea75895d511e tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.251385 Aug 03 01:57:31.348772 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1249/2470] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 01:57:31 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments => generated 197 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:31.364234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5e8d7f16-73b8-4432-8125-77d73094e6a1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b243b90d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:31.507860 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5e8d7f16-73b8-4432-8125-77d73094e6a1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.151312 Aug 03 01:57:31.511946 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1250/2471] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:31 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:31.524369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b32eb2bf-0358-431f-9214-12e16183108f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:31.539114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b32eb2bf-0358-431f-9214-12e16183108f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:31.571153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b32eb2bf-0358-431f-9214-12e16183108f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:31.578751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b32eb2bf-0358-431f-9214-12e16183108f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:31.580225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b32eb2bf-0358-431f-9214-12e16183108f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:31.582198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b32eb2bf-0358-431f-9214-12e16183108f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:32.051230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b32eb2bf-0358-431f-9214-12e16183108f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:32.080677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b32eb2bf-0358-431f-9214-12e16183108f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:32.088935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b32eb2bf-0358-431f-9214-12e16183108f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:32.100337 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b32eb2bf-0358-431f-9214-12e16183108f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1584 microversion: 2.32 time: 0.585709 Aug 03 01:57:32.107208 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1251/2472] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:31 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1584 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:32.114142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7d2a0328-f4eb-4d6a-93ff-624708169fc8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:32.157842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7d2a0328-f4eb-4d6a-93ff-624708169fc8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:32.181394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d2a0328-f4eb-4d6a-93ff-624708169fc8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:32.186621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d2a0328-f4eb-4d6a-93ff-624708169fc8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:32.202306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d2a0328-f4eb-4d6a-93ff-624708169fc8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:32.203485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d2a0328-f4eb-4d6a-93ff-624708169fc8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:33.650064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7d2a0328-f4eb-4d6a-93ff-624708169fc8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:33.658487 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7d2a0328-f4eb-4d6a-93ff-624708169fc8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 1.549741 Aug 03 01:57:33.678622 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1252/2473] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:32 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:33.683808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-276bc18a-f5b7-4350-8bac-443d1f2bbef6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:33.684425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-276bc18a-f5b7-4350-8bac-443d1f2bbef6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:33.738272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-276bc18a-f5b7-4350-8bac-443d1f2bbef6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:33.738882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-276bc18a-f5b7-4350-8bac-443d1f2bbef6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:33.743899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-276bc18a-f5b7-4350-8bac-443d1f2bbef6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:33.745828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-276bc18a-f5b7-4350-8bac-443d1f2bbef6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:33.868843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:57:33.912336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-276bc18a-f5b7-4350-8bac-443d1f2bbef6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:33.919800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-276bc18a-f5b7-4350-8bac-443d1f2bbef6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:33.920386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-276bc18a-f5b7-4350-8bac-443d1f2bbef6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lazy-loading 'fault' on Instance uuid cb726272-286a-410e-8911-d328476b7755 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:57:34.515715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-276bc18a-f5b7-4350-8bac-443d1f2bbef6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:34.531605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-276bc18a-f5b7-4350-8bac-443d1f2bbef6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:34.533253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-276bc18a-f5b7-4350-8bac-443d1f2bbef6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb821820bbb4d3a8c999e1dec6a06a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162addf8f6634e7fa0a1f9c6004258d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:34.546690 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-276bc18a-f5b7-4350-8bac-443d1f2bbef6 tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 200 len: 1352 microversion: 2.25 time: 0.866796 Aug 03 01:57:34.551943 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1253/2474] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:33 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 1352 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:34.566173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ef680d1f-6bb1-43c5-a81d-1edb33c644bd tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:34.587072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ef680d1f-6bb1-43c5-a81d-1edb33c644bd tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:34.625365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef680d1f-6bb1-43c5-a81d-1edb33c644bd tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:34.625837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef680d1f-6bb1-43c5-a81d-1edb33c644bd tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:34.626752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef680d1f-6bb1-43c5-a81d-1edb33c644bd tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:34.637389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef680d1f-6bb1-43c5-a81d-1edb33c644bd tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:34.773846 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ef680d1f-6bb1-43c5-a81d-1edb33c644bd tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.220691 Aug 03 01:57:34.774465 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1254/2475] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 01:57:34 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:34.783537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-562e68e8-c577-484a-8f23-fc8648b36fa5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b2455cb80>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:34.943336 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-562e68e8-c577-484a-8f23-fc8648b36fa5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1440 microversion: 2.1 time: 0.163743 Aug 03 01:57:34.945786 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1255/2476] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:34 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1440 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:34.952528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-dbf8f8cf-d676-43a4-bec0-075ae81f335e req-67007ad8-810e-4926-b410-8c35e53a65dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb726272-286a-410e-8911-d328476b7755", "name": "network-vif-deleted", "tag": "1fa2be26-8348-4842-ada3-bc3a43cd46ee"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:35.007226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-dbf8f8cf-d676-43a4-bec0-075ae81f335e req-67007ad8-810e-4926-b410-8c35e53a65dc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:35.015982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-dbf8f8cf-d676-43a4-bec0-075ae81f335e req-67007ad8-810e-4926-b410-8c35e53a65dc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:35.114943 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-dbf8f8cf-d676-43a4-bec0-075ae81f335e req-67007ad8-810e-4926-b410-8c35e53a65dc service nova] Creating event network-vif-deleted:1fa2be26-8348-4842-ada3-bc3a43cd46ee for instance cb726272-286a-410e-8911-d328476b7755 on n-h2-826529-8 Aug 03 01:57:35.163381 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-dbf8f8cf-d676-43a4-bec0-075ae81f335e req-67007ad8-810e-4926-b410-8c35e53a65dc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214238 Aug 03 01:57:35.163999 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1256/2477] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:35.202600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5ef3e472-3eef-405b-bc52-1d22e8838e3d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:35.203383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5ef3e472-3eef-405b-bc52-1d22e8838e3d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:35.225971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ef3e472-3eef-405b-bc52-1d22e8838e3d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:35.226456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ef3e472-3eef-405b-bc52-1d22e8838e3d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:35.227570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ef3e472-3eef-405b-bc52-1d22e8838e3d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:35.228018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ef3e472-3eef-405b-bc52-1d22e8838e3d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:35.563907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ef3e472-3eef-405b-bc52-1d22e8838e3d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:35.588256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ef3e472-3eef-405b-bc52-1d22e8838e3d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:35.603588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ef3e472-3eef-405b-bc52-1d22e8838e3d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:35.604804 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5ef3e472-3eef-405b-bc52-1d22e8838e3d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1594 microversion: 2.32 time: 0.435185 Aug 03 01:57:35.605372 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1257/2478] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:35 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1594 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:35.640338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ccb66c14-c6cb-46fe-978d-155062871520 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:35.644619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ccb66c14-c6cb-46fe-978d-155062871520 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:35.662990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:57:35.665300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccb66c14-c6cb-46fe-978d-155062871520 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:35.666335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccb66c14-c6cb-46fe-978d-155062871520 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:35.667459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccb66c14-c6cb-46fe-978d-155062871520 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:35.668436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccb66c14-c6cb-46fe-978d-155062871520 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:36.724535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ccb66c14-c6cb-46fe-978d-155062871520 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:36.739914 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ccb66c14-c6cb-46fe-978d-155062871520 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1486 microversion: 2.1 time: 1.120436 Aug 03 01:57:36.745069 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1258/2479] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:35 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1486 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:36.758391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7276b979-269f-4ba6-bd19-c4d0729a527b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:36.759327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7276b979-269f-4ba6-bd19-c4d0729a527b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] [instance: cb726272-286a-410e-8911-d328476b7755] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:36.767944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7276b979-269f-4ba6-bd19-c4d0729a527b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:36.779188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7276b979-269f-4ba6-bd19-c4d0729a527b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:36.780523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7276b979-269f-4ba6-bd19-c4d0729a527b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:36.781119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7276b979-269f-4ba6-bd19-c4d0729a527b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:36.810251 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-7276b979-269f-4ba6-bd19-c4d0729a527b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] HTTP exception thrown: Instance cb726272-286a-410e-8911-d328476b7755 could not be found. Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7276b979-269f-4ba6-bd19-c4d0729a527b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Request method failure captured: Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 HTTP/1.1 Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dQmYksyCHGe05wRQxbk6QfqbWkBxABJ5P_n0aCiHJbs9MllgVdpbYymAxb_HczTpTqJwJO5NoW-z9Kl8QAFDfkjt2Rysc3BdoTKS198Pdcf8wdPSi10_HctX3SPJqykocduTYhOzA_bALuNdgBeucW4AsPQCeHlVOF2e2nWAoRZ89Q Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Openstack-Nova-Api-Version: 2.25 Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 162addf8f6634e7fa0a1f9c6004258d1 Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-519991888 Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_162addf8f6634e7fa0a1f9c6004258d1", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/162addf8f6634e7fa0a1f9c6004258d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/162addf8f6634e7fa0a1f9c6004258d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/162addf8f6634e7fa0a1f9c6004258d1"}]}] Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-519991888 Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 162addf8f6634e7fa0a1f9c6004258d1 Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-519991888 Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-LiveAutoBlockMigrationV225Test-519991888-project Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4cb821820bbb4d3a8c999e1dec6a06a4 Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-519991888-project Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance cb726272-286a-410e-8911-d328476b7755 could not be found. Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'cb726272-286a-410e-8911-d328476b7755'} Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb726272-286a-410e-8911-d328476b7755 could not be found. Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb726272-286a-410e-8911-d328476b7755 could not be found. Aug 03 01:57:36.817102 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:57:36.821119 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:36.821119 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:57:36.821119 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:36.821119 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:36.821119 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:36.821119 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:57:36.821119 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:57:36.821119 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb726272-286a-410e-8911-d328476b7755 could not be found. Aug 03 01:57:36.821119 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:57:36.822635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7276b979-269f-4ba6-bd19-c4d0729a527b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] Returning 404 to user: Instance cb726272-286a-410e-8911-d328476b7755 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:57:36.824062 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7276b979-269f-4ba6-bd19-c4d0729a527b tempest-LiveAutoBlockMigrationV225Test-519991888 tempest-LiveAutoBlockMigrationV225Test-519991888-project] 10.222.0.67 "GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755" status: 404 len: 111 microversion: 2.25 time: 0.077347 Aug 03 01:57:36.824807 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1259/2480] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:36 2022] GET /compute/v2.1/servers/cb726272-286a-410e-8911-d328476b7755 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:57:36.832297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ea4c4551-336c-4ebc-a559-624749b51445 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:36.835669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ea4c4551-336c-4ebc-a559-624749b51445 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:36.843461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea4c4551-336c-4ebc-a559-624749b51445 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:36.844100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea4c4551-336c-4ebc-a559-624749b51445 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:36.845076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea4c4551-336c-4ebc-a559-624749b51445 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:36.845714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea4c4551-336c-4ebc-a559-624749b51445 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:36.890210 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ea4c4551-336c-4ebc-a559-624749b51445 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063616 Aug 03 01:57:36.891458 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1260/2481] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 01:57:36 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:36.897441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bb0661e7-4980-4f00-8be5-c6b262b0e842 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b2455c160>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:36.979763 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bb0661e7-4980-4f00-8be5-c6b262b0e842 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1449 microversion: 2.1 time: 0.087031 Aug 03 01:57:36.982197 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1261/2482] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:36 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1449 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:36.987848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0792c1a0-c19c-493b-bfa6-87e511f53ae6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:36.999486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0792c1a0-c19c-493b-bfa6-87e511f53ae6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:37.012913 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0792c1a0-c19c-493b-bfa6-87e511f53ae6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:37.013634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0792c1a0-c19c-493b-bfa6-87e511f53ae6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:37.014579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0792c1a0-c19c-493b-bfa6-87e511f53ae6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:37.015204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0792c1a0-c19c-493b-bfa6-87e511f53ae6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:37.618475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:57:37.959327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:57:38.207441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0792c1a0-c19c-493b-bfa6-87e511f53ae6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:38.228416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0792c1a0-c19c-493b-bfa6-87e511f53ae6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:38.230327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0792c1a0-c19c-493b-bfa6-87e511f53ae6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:38.231718 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0792c1a0-c19c-493b-bfa6-87e511f53ae6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1662 microversion: 2.32 time: 1.248263 Aug 03 01:57:38.232580 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1262/2483] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:36 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1662 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:38.251098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f505c15e-653a-4aca-9803-db55939a5946 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:38.251974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f505c15e-653a-4aca-9803-db55939a5946 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:38.263671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f505c15e-653a-4aca-9803-db55939a5946 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:38.264334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f505c15e-653a-4aca-9803-db55939a5946 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:38.265395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f505c15e-653a-4aca-9803-db55939a5946 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:38.267507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f505c15e-653a-4aca-9803-db55939a5946 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:38.453110 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f505c15e-653a-4aca-9803-db55939a5946 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "POST /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d/action" status: 202 len: 0 microversion: 2.1 time: 0.219085 Aug 03 01:57:38.453772 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1263/2484] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:57:38 2022] POST /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:57:38.464118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a36eb19b-a626-4429-9d6b-42ec9330e1f5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b12c3a4c0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:38.567565 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a36eb19b-a626-4429-9d6b-42ec9330e1f5 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 200 len: 1449 microversion: 2.1 time: 0.112299 Aug 03 01:57:38.573986 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1264/2485] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:57:38 2022] GET /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 1449 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:39.085920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-acfc6418-b63e-4485-8603-db76ca092aa7 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:39.089535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-acfc6418-b63e-4485-8603-db76ca092aa7 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:39.117507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-acfc6418-b63e-4485-8603-db76ca092aa7 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:39.118234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-acfc6418-b63e-4485-8603-db76ca092aa7 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:39.119077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-acfc6418-b63e-4485-8603-db76ca092aa7 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:39.119517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-acfc6418-b63e-4485-8603-db76ca092aa7 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:39.221988 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-acfc6418-b63e-4485-8603-db76ca092aa7 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.646421 Aug 03 01:57:39.227833 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1265/2486] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 01:57:38 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366/os-volume_attachments => generated 25 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:57:39.232680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dd7de69d-4729-4f59-8c56-5bcb762c11d6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:39.233297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dd7de69d-4729-4f59-8c56-5bcb762c11d6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:39.277214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd7de69d-4729-4f59-8c56-5bcb762c11d6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:39.277416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd7de69d-4729-4f59-8c56-5bcb762c11d6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:39.278164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd7de69d-4729-4f59-8c56-5bcb762c11d6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:39.278608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd7de69d-4729-4f59-8c56-5bcb762c11d6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:39.341964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=7 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:57:39.497522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:57:39.591940 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 01:57:39.592308 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 01:57:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups?all_tenants=true (ip 10.222.0.67) !!! Aug 03 01:57:40.536675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dd7de69d-4729-4f59-8c56-5bcb762c11d6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:40.548486 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dd7de69d-4729-4f59-8c56-5bcb762c11d6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1494 microversion: 2.1 time: 1.319480 Aug 03 01:57:40.567390 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1266/2487] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:39 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1494 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:40.582379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d5ed1658-7427-4868-892b-08ca41eef9d7 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b12a34af0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:41.844989 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d5ed1658-7427-4868-892b-08ca41eef9d7 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 204 len: 0 microversion: 2.1 time: 1.275825 Aug 03 01:57:41.847463 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1267/2488] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:40 2022] DELETE /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 0 bytes in 1279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:57:41.853095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a18011ee-8ef0-4e94-8d8f-3663d2fb8c8b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:41.853776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a18011ee-8ef0-4e94-8d8f-3663d2fb8c8b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:41.878883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a18011ee-8ef0-4e94-8d8f-3663d2fb8c8b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:41.879410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a18011ee-8ef0-4e94-8d8f-3663d2fb8c8b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:41.880700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a18011ee-8ef0-4e94-8d8f-3663d2fb8c8b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:41.882963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a18011ee-8ef0-4e94-8d8f-3663d2fb8c8b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:41.945597 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-35caa0b0-b81d-4e70-9dcc-3f6d93403e97 tempest-SecurityGroupsTestAdminJSON-227260710 tempest-SecurityGroupsTestAdminJSON-227260710-project-admin] 10.222.0.67 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11676 microversion: 2.1 time: 12.409246 Aug 03 01:57:41.946736 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1222/2489] 10.222.0.67 () {58 vars in 1191 bytes} [Wed Aug 3 01:57:29 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11676 bytes in 12413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:57:41.951572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c7e1c8eb-9bf2-4bb8-a798-5b48362648b3 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:41.956294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c7e1c8eb-9bf2-4bb8-a798-5b48362648b3 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:41.973340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7e1c8eb-9bf2-4bb8-a798-5b48362648b3 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:41.974022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7e1c8eb-9bf2-4bb8-a798-5b48362648b3 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:41.975074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7e1c8eb-9bf2-4bb8-a798-5b48362648b3 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:41.978342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7e1c8eb-9bf2-4bb8-a798-5b48362648b3 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:42.038543 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-c7e1c8eb-9bf2-4bb8-a798-5b48362648b3 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] HTTP exception thrown: Cannot 'reboot' instance 56094624-65e4-48bb-8337-280213fb3238 while it is in vm_state rescued Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c7e1c8eb-9bf2-4bb8-a798-5b48362648b3 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Request method failure captured: Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238/action HTTP/1.1 Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 28 Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTll7VklSXVKPY7IA1_5ob-tKVm2Z_7z42qGXzDSvTdwVAzc-uu26I_RdtLVhoAwHCuPbYMUDNABwS67wYISa8yagl02RQzcDUh0SQ8u7p5lboe4i0RQPeTExpnFXWWBwbJADXBFZ5wGYauWv3NNIL4oxW8HVYZDtaGv8yUqCCibqo Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c183e2fc6dbb419fbd8fa81c90163adf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}] Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 0b99d344c16b4221bcccfe37d32bb69e Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: {"reboot": {"type": "HARD"}} Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: exception: Cannot 'reboot' instance 56094624-65e4-48bb-8337-280213fb3238 while it is in vm_state rescued Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '56094624-65e4-48bb-8337-280213fb3238', 'body': {'reboot': {'type': 'HARD'}}} Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3499, in reboot Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 56094624-65e4-48bb-8337-280213fb3238 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 01:57:42.040243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 01:57:42.044420 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 56094624-65e4-48bb-8337-280213fb3238 while it is in vm_state rescued Aug 03 01:57:42.044420 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:42.044420 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:42.044420 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:42.044420 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:42.044420 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:42.044420 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:42.044420 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:57:42.044420 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:57:42.044420 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 56094624-65e4-48bb-8337-280213fb3238 while it is in vm_state rescued Aug 03 01:57:42.044420 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:42.044420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c7e1c8eb-9bf2-4bb8-a798-5b48362648b3 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Returning 409 to user: Cannot 'reboot' instance 56094624-65e4-48bb-8337-280213fb3238 while it is in vm_state rescued {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:57:42.052038 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c7e1c8eb-9bf2-4bb8-a798-5b48362648b3 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238/action" status: 409 len: 145 microversion: 2.1 time: 0.093836 Aug 03 01:57:42.058200 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1223/2490] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:57:41 2022] POST /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238/action => generated 145 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:57:42.076185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-528c89a1-4039-4fb0-aad1-409eb7128a12 req-4ebf63f9-a20b-4122-9eeb-fcd642b2f0ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7caa5b-90d6-478e-be59-d6e0157dc11e", "name": "network-vif-unplugged", "status": "completed", "tag": "279746cc-9cd6-4060-885c-cc2e2e88c9f0"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:42.111292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-528c89a1-4039-4fb0-aad1-409eb7128a12 req-4ebf63f9-a20b-4122-9eeb-fcd642b2f0ce service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:42.113202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-528c89a1-4039-4fb0-aad1-409eb7128a12 req-4ebf63f9-a20b-4122-9eeb-fcd642b2f0ce service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:42.147241 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-528c89a1-4039-4fb0-aad1-409eb7128a12 req-4ebf63f9-a20b-4122-9eeb-fcd642b2f0ce service nova] Creating event network-vif-unplugged:279746cc-9cd6-4060-885c-cc2e2e88c9f0 for instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e on n-h1-826529-8 Aug 03 01:57:42.155231 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-528c89a1-4039-4fb0-aad1-409eb7128a12 req-4ebf63f9-a20b-4122-9eeb-fcd642b2f0ce service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094133 Aug 03 01:57:42.156111 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1224/2491] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:42.169357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d5679f48-d63c-404a-a428-54e1e44a5be9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:42.170280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d5679f48-d63c-404a-a428-54e1e44a5be9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:42.178083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5679f48-d63c-404a-a428-54e1e44a5be9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:42.178741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5679f48-d63c-404a-a428-54e1e44a5be9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:42.179726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5679f48-d63c-404a-a428-54e1e44a5be9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:42.180356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5679f48-d63c-404a-a428-54e1e44a5be9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:42.883580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d5679f48-d63c-404a-a428-54e1e44a5be9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:42.897509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a18011ee-8ef0-4e94-8d8f-3663d2fb8c8b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:42.926584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a18011ee-8ef0-4e94-8d8f-3663d2fb8c8b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:42.932429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a18011ee-8ef0-4e94-8d8f-3663d2fb8c8b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:42.936800 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a18011ee-8ef0-4e94-8d8f-3663d2fb8c8b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1756 microversion: 2.32 time: 1.088240 Aug 03 01:57:42.937379 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1268/2492] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:41 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1756 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:42.961822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f532483c-b4a5-4eec-a104-3e454129dd1c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:42.963798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f532483c-b4a5-4eec-a104-3e454129dd1c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:42.968935 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d5679f48-d63c-404a-a428-54e1e44a5be9 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1494 microversion: 2.1 time: 0.805140 Aug 03 01:57:42.974063 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1225/2493] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:42 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1494 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:42.983177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f532483c-b4a5-4eec-a104-3e454129dd1c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:42.983968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f532483c-b4a5-4eec-a104-3e454129dd1c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:42.992274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f532483c-b4a5-4eec-a104-3e454129dd1c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:42.993099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f532483c-b4a5-4eec-a104-3e454129dd1c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:43.008320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d897bd3d-335a-416a-bd6e-b673c1e93fa2 tempest-SecurityGroupsTestAdminJSON-62233088 tempest-SecurityGroupsTestAdminJSON-62233088-project] Calling method '.version_select at 0x7f5b128fc430>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:43.066270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f532483c-b4a5-4eec-a104-3e454129dd1c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:57:43.235437 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f532483c-b4a5-4eec-a104-3e454129dd1c tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e" status: 204 len: 0 microversion: 2.1 time: 0.292356 Aug 03 01:57:43.240418 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1269/2494] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:57:42 2022] DELETE /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:57:43.256735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b66350c2-4fb5-45cb-94d1-d9b667d149b5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:43.286016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b66350c2-4fb5-45cb-94d1-d9b667d149b5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:43.295541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b66350c2-4fb5-45cb-94d1-d9b667d149b5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:43.296244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b66350c2-4fb5-45cb-94d1-d9b667d149b5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:43.297998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b66350c2-4fb5-45cb-94d1-d9b667d149b5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:43.298887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b66350c2-4fb5-45cb-94d1-d9b667d149b5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:43.351421 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-b66350c2-4fb5-45cb-94d1-d9b667d149b5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] HTTP exception thrown: Cannot 'rebuild' instance 56094624-65e4-48bb-8337-280213fb3238 while it is in vm_state rescued Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b66350c2-4fb5-45cb-94d1-d9b667d149b5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Request method failure captured: Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238/action HTTP/1.1 Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 65 Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dTll7VklSXVKPY7IA1_5ob-tKVm2Z_7z42qGXzDSvTdwVAzc-uu26I_RdtLVhoAwHCuPbYMUDNABwS67wYISa8yagl02RQzcDUh0SQ8u7p5lboe4i0RQPeTExpnFXWWBwbJADXBFZ5wGYauWv3NNIL4oxW8HVYZDtaGv8yUqCCibqo Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c183e2fc6dbb419fbd8fa81c90163adf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}] Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0b99d344c16b4221bcccfe37d32bb69e Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: {"rebuild": {"imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3"}} Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: exception: Cannot 'rebuild' instance 56094624-65e4-48bb-8337-280213fb3238 while it is in vm_state rescued Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '56094624-65e4-48bb-8337-280213fb3238', 'body': {'rebuild': {'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3'}}} Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 56094624-65e4-48bb-8337-280213fb3238 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:57:43.355538 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 56094624-65e4-48bb-8337-280213fb3238 while it is in vm_state rescued Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 56094624-65e4-48bb-8337-280213fb3238 while it is in vm_state rescued Aug 03 01:57:43.360458 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:57:43.367930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b66350c2-4fb5-45cb-94d1-d9b667d149b5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Returning 409 to user: Cannot 'rebuild' instance 56094624-65e4-48bb-8337-280213fb3238 while it is in vm_state rescued {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:57:43.369833 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b66350c2-4fb5-45cb-94d1-d9b667d149b5 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "POST /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238/action" status: 409 len: 146 microversion: 2.1 time: 0.127665 Aug 03 01:57:43.370783 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1270/2495] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:57:43 2022] POST /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238/action => generated 146 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:57:43.383489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e2ad589d-e219-4567-b4c5-eddbb3114431 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:43.386357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e2ad589d-e219-4567-b4c5-eddbb3114431 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:43.397753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e2ad589d-e219-4567-b4c5-eddbb3114431 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:43.398475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e2ad589d-e219-4567-b4c5-eddbb3114431 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:43.399520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e2ad589d-e219-4567-b4c5-eddbb3114431 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:43.401030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e2ad589d-e219-4567-b4c5-eddbb3114431 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:43.482606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e2ad589d-e219-4567-b4c5-eddbb3114431 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:57:43.571287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:57:43.704352 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e2ad589d-e219-4567-b4c5-eddbb3114431 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 204 len: 0 microversion: 2.1 time: 0.325087 Aug 03 01:57:43.706086 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1271/2496] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:57:43 2022] DELETE /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:57:43.718554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-812089555", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "53d4fe2c-f615-4656-9157-a036740f9e27"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:43.817923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] validate_networks() for [('53d4fe2c-f615-4656-9157-a036740f9e27', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:57:45.136472 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d897bd3d-335a-416a-bd6e-b673c1e93fa2 tempest-SecurityGroupsTestAdminJSON-62233088 tempest-SecurityGroupsTestAdminJSON-62233088-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 2.157048 Aug 03 01:57:45.137624 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1226/2497] 10.222.0.67 () {58 vars in 1191 bytes} [Wed Aug 3 01:57:42 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 2163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:45.143527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1fec6230-76c1-4572-a1f3-91b54754b453 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:45.145261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1fec6230-76c1-4572-a1f3-91b54754b453 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:45.165348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fec6230-76c1-4572-a1f3-91b54754b453 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:45.166093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fec6230-76c1-4572-a1f3-91b54754b453 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:45.167096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fec6230-76c1-4572-a1f3-91b54754b453 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:45.169782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1fec6230-76c1-4572-a1f3-91b54754b453 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:46.290538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1fec6230-76c1-4572-a1f3-91b54754b453 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:46.310095 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1fec6230-76c1-4572-a1f3-91b54754b453 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1688 microversion: 2.1 time: 1.171152 Aug 03 01:57:46.319838 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1227/2498] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:45 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1688 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:46.343323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0166dd8-52c5-4672-bac7-bf67e9955a05 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:46.346298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0166dd8-52c5-4672-bac7-bf67e9955a05 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:46.357887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0166dd8-52c5-4672-bac7-bf67e9955a05 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:46.358682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0166dd8-52c5-4672-bac7-bf67e9955a05 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:46.359929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0166dd8-52c5-4672-bac7-bf67e9955a05 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:46.360655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0166dd8-52c5-4672-bac7-bf67e9955a05 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:46.664795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:57:46.665920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:57:46.666851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:57:46.667549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:57:46.668178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:57:46.684125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:46.687736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:46.688909 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:46.692592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:46.751495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Getting quotas for project 6bf2395335564acdaf819f2175dbd3bc. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:57:46.767231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Getting quotas for user 47e6a189229d4f8ab3aa4ca416d84594 and project 6bf2395335564acdaf819f2175dbd3bc. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:57:46.810820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:57:46.816051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:57:46.935582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:57:47.010447 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ad61545c-4f69-4d92-9b88-259a58cd2872 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.302084 Aug 03 01:57:47.021510 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1272/2499] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:57:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:57:47.053378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-11214eea-998f-46bd-9ee4-bf690fb2c2fa tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:47.054194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-11214eea-998f-46bd-9ee4-bf690fb2c2fa tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:47.072350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11214eea-998f-46bd-9ee4-bf690fb2c2fa tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:47.078114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11214eea-998f-46bd-9ee4-bf690fb2c2fa tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:47.079720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11214eea-998f-46bd-9ee4-bf690fb2c2fa tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:47.085941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11214eea-998f-46bd-9ee4-bf690fb2c2fa tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:48.750918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0166dd8-52c5-4672-bac7-bf67e9955a05 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:48.769836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0166dd8-52c5-4672-bac7-bf67e9955a05 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:48.772458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0166dd8-52c5-4672-bac7-bf67e9955a05 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:48.774977 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0166dd8-52c5-4672-bac7-bf67e9955a05 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1803 microversion: 2.32 time: 2.443770 Aug 03 01:57:48.776080 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1228/2500] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:46 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1803 bytes in 2455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:48.801493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eb5ddf82-d29c-49e0-b65e-93aa89889aa7 tempest-SecurityGroupsTestAdminJSON-227260710 tempest-SecurityGroupsTestAdminJSON-227260710-project-admin] Calling method '.version_select at 0x7f5b13203ca0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:50.082217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-11214eea-998f-46bd-9ee4-bf690fb2c2fa tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:50.098127 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-11214eea-998f-46bd-9ee4-bf690fb2c2fa tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1500 microversion: 2.1 time: 3.075338 Aug 03 01:57:50.102588 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1273/2501] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:47 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1500 bytes in 3081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:50.115834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-ba32f6d0-1b83-4a48-9ae3-e00fda51c4ff req-afebe722-23cf-46b1-a881-17693f6dba7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7caa5b-90d6-478e-be59-d6e0157dc11e", "name": "network-vif-deleted", "tag": "279746cc-9cd6-4060-885c-cc2e2e88c9f0"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:50.171916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ba32f6d0-1b83-4a48-9ae3-e00fda51c4ff req-afebe722-23cf-46b1-a881-17693f6dba7b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:50.172374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ba32f6d0-1b83-4a48-9ae3-e00fda51c4ff req-afebe722-23cf-46b1-a881-17693f6dba7b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:50.207929 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-ba32f6d0-1b83-4a48-9ae3-e00fda51c4ff req-afebe722-23cf-46b1-a881-17693f6dba7b service nova] Creating event network-vif-deleted:279746cc-9cd6-4060-885c-cc2e2e88c9f0 for instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e on n-h1-826529-8 Aug 03 01:57:50.223174 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-ba32f6d0-1b83-4a48-9ae3-e00fda51c4ff req-afebe722-23cf-46b1-a881-17693f6dba7b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118000 Aug 03 01:57:50.223827 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1274/2502] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:50.244751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9c5b96ba-56a0-471f-a3cc-93192e321651 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:50.248283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9c5b96ba-56a0-471f-a3cc-93192e321651 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:50.268826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c5b96ba-56a0-471f-a3cc-93192e321651 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:50.271297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c5b96ba-56a0-471f-a3cc-93192e321651 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:50.289359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c5b96ba-56a0-471f-a3cc-93192e321651 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:50.291799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c5b96ba-56a0-471f-a3cc-93192e321651 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:52.368902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9c5b96ba-56a0-471f-a3cc-93192e321651 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:52.386345 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9c5b96ba-56a0-471f-a3cc-93192e321651 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce" status: 200 len: 1307 microversion: 2.1 time: 2.158419 Aug 03 01:57:52.388462 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1275/2503] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:50 2022] GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce => generated 1307 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:52.403367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9c3ffe1a-f090-4473-9b74-e7782c1b1fb9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:52.404272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9c3ffe1a-f090-4473-9b74-e7782c1b1fb9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:52.419780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c3ffe1a-f090-4473-9b74-e7782c1b1fb9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:52.422436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c3ffe1a-f090-4473-9b74-e7782c1b1fb9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:52.423520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c3ffe1a-f090-4473-9b74-e7782c1b1fb9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:52.426048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c3ffe1a-f090-4473-9b74-e7782c1b1fb9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:53.365918 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eb5ddf82-d29c-49e0-b65e-93aa89889aa7 tempest-SecurityGroupsTestAdminJSON-227260710 tempest-SecurityGroupsTestAdminJSON-227260710-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/afe598a6-56e0-410b-bc29-021945a3cf72" status: 202 len: 0 microversion: 2.1 time: 4.584670 Aug 03 01:57:53.368362 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1229/2504] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:57:48 2022] DELETE /compute/v2.1/os-security-groups/afe598a6-56e0-410b-bc29-021945a3cf72 => generated 0 bytes in 4590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:57:53.374790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7bad6092-784e-431d-bcb4-f076422c8cbe tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:53.375466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7bad6092-784e-431d-bcb4-f076422c8cbe tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:53.421378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7bad6092-784e-431d-bcb4-f076422c8cbe tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:53.421848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7bad6092-784e-431d-bcb4-f076422c8cbe tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:53.422665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7bad6092-784e-431d-bcb4-f076422c8cbe tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:53.423215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7bad6092-784e-431d-bcb4-f076422c8cbe tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:53.821234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9c3ffe1a-f090-4473-9b74-e7782c1b1fb9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:53.839622 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9c3ffe1a-f090-4473-9b74-e7782c1b1fb9 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1688 microversion: 2.1 time: 1.448598 Aug 03 01:57:53.840231 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1276/2505] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:52 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1688 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:53.863980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-74061c04-b6c6-4ef8-b06d-e77f26f0a02c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:53.864512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-74061c04-b6c6-4ef8-b06d-e77f26f0a02c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:53.894515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74061c04-b6c6-4ef8-b06d-e77f26f0a02c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:53.900077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74061c04-b6c6-4ef8-b06d-e77f26f0a02c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:53.908230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74061c04-b6c6-4ef8-b06d-e77f26f0a02c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:53.911700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74061c04-b6c6-4ef8-b06d-e77f26f0a02c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:54.020946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-74061c04-b6c6-4ef8-b06d-e77f26f0a02c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:57:54.199339 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-74061c04-b6c6-4ef8-b06d-e77f26f0a02c tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 204 len: 0 microversion: 2.1 time: 0.357500 Aug 03 01:57:54.202106 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1277/2506] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:57:53 2022] DELETE /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:57:54.224984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-78349d29-faa7-43bc-ae6c-3eb791b0c41b req-668fd6b8-3e31-429f-8262-0bb746ee99be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d537dd36-d584-48d0-9458-81075e06b366", "name": "network-vif-unplugged", "status": "completed", "tag": "02b87219-959c-40f7-baa4-183c4ffd1862"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:54.248624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-78349d29-faa7-43bc-ae6c-3eb791b0c41b req-668fd6b8-3e31-429f-8262-0bb746ee99be service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:54.250232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-78349d29-faa7-43bc-ae6c-3eb791b0c41b req-668fd6b8-3e31-429f-8262-0bb746ee99be service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:54.293022 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-78349d29-faa7-43bc-ae6c-3eb791b0c41b req-668fd6b8-3e31-429f-8262-0bb746ee99be service nova] Creating event network-vif-unplugged:02b87219-959c-40f7-baa4-183c4ffd1862 for instance d537dd36-d584-48d0-9458-81075e06b366 on n-h2-826529-8 Aug 03 01:57:54.317783 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-78349d29-faa7-43bc-ae6c-3eb791b0c41b req-668fd6b8-3e31-429f-8262-0bb746ee99be service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100664 Aug 03 01:57:54.323160 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1278/2507] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:54.345883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-18c16894-c11c-42f4-8cdb-e3cd9f559cef tempest-SecurityGroupsTestAdminJSON-227260710 tempest-SecurityGroupsTestAdminJSON-227260710-project-admin] Calling method '.version_select at 0x7f5b125d29d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:54.633195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7bad6092-784e-431d-bcb4-f076422c8cbe tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:54.647875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7bad6092-784e-431d-bcb4-f076422c8cbe tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:54.652421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7bad6092-784e-431d-bcb4-f076422c8cbe tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:54.660346 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7bad6092-784e-431d-bcb4-f076422c8cbe tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1850 microversion: 2.32 time: 1.290574 Aug 03 01:57:54.671801 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1230/2508] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:53 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1850 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:54.686057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-801e9dc7-a9cf-4832-9f33-beea066d51b7 req-d11f735c-8f8f-4169-a18b-9cbc497423e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16268f31-3fcc-4f5f-96f6-137c129581ce", "tag": "d040aed7-adb8-4a77-960c-06e14a41dab2"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:54.733081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-801e9dc7-a9cf-4832-9f33-beea066d51b7 req-d11f735c-8f8f-4169-a18b-9cbc497423e8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:54.735022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-801e9dc7-a9cf-4832-9f33-beea066d51b7 req-d11f735c-8f8f-4169-a18b-9cbc497423e8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:54.776403 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-801e9dc7-a9cf-4832-9f33-beea066d51b7 req-d11f735c-8f8f-4169-a18b-9cbc497423e8 service nova] Creating event network-changed:d040aed7-adb8-4a77-960c-06e14a41dab2 for instance 16268f31-3fcc-4f5f-96f6-137c129581ce on n-h1-826529-8 Aug 03 01:57:54.793410 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-801e9dc7-a9cf-4832-9f33-beea066d51b7 req-d11f735c-8f8f-4169-a18b-9cbc497423e8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119644 Aug 03 01:57:54.795053 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1231/2509] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:54.811315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ae38fe57-787d-4b5f-98ff-f3afb082f062 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:54.815657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ae38fe57-787d-4b5f-98ff-f3afb082f062 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:54.831555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ae38fe57-787d-4b5f-98ff-f3afb082f062 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:54.834758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ae38fe57-787d-4b5f-98ff-f3afb082f062 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:54.837190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ae38fe57-787d-4b5f-98ff-f3afb082f062 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:54.842778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ae38fe57-787d-4b5f-98ff-f3afb082f062 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:55.519005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ae38fe57-787d-4b5f-98ff-f3afb082f062 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:55.561456 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ae38fe57-787d-4b5f-98ff-f3afb082f062 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce" status: 200 len: 1307 microversion: 2.1 time: 0.747621 Aug 03 01:57:55.575657 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1232/2510] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:54 2022] GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce => generated 1307 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:55.611748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cef9bdfd-69e7-454b-8e91-8f501d6d81c3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:55.613048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cef9bdfd-69e7-454b-8e91-8f501d6d81c3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:55.629302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cef9bdfd-69e7-454b-8e91-8f501d6d81c3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:55.630336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cef9bdfd-69e7-454b-8e91-8f501d6d81c3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:55.631770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cef9bdfd-69e7-454b-8e91-8f501d6d81c3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:55.632588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cef9bdfd-69e7-454b-8e91-8f501d6d81c3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:56.551614 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-18c16894-c11c-42f4-8cdb-e3cd9f559cef tempest-SecurityGroupsTestAdminJSON-227260710 tempest-SecurityGroupsTestAdminJSON-227260710-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/afdd1738-8ad1-45c8-8210-163b94aa44af" status: 202 len: 0 microversion: 2.1 time: 2.226668 Aug 03 01:57:56.554188 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1279/2511] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:57:54 2022] DELETE /compute/v2.1/os-security-groups/afdd1738-8ad1-45c8-8210-163b94aa44af => generated 0 bytes in 2230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:57:56.563398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-855caf83-48fb-45a8-8e09-be1b6db2e0eb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:56.565767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-855caf83-48fb-45a8-8e09-be1b6db2e0eb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:56.640897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-855caf83-48fb-45a8-8e09-be1b6db2e0eb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:56.657537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-855caf83-48fb-45a8-8e09-be1b6db2e0eb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:56.675971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-855caf83-48fb-45a8-8e09-be1b6db2e0eb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:56.676467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-855caf83-48fb-45a8-8e09-be1b6db2e0eb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:56.782866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cef9bdfd-69e7-454b-8e91-8f501d6d81c3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:56.823815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:57:56.825048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:57:56.863336 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cef9bdfd-69e7-454b-8e91-8f501d6d81c3 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 1.264897 Aug 03 01:57:56.881174 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1233/2512] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:55 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:56.912810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6028ef71-e463-497f-b97a-eb10d61d20fa tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:56.915274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6028ef71-e463-497f-b97a-eb10d61d20fa tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:56.958269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6028ef71-e463-497f-b97a-eb10d61d20fa tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:56.964430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6028ef71-e463-497f-b97a-eb10d61d20fa tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:56.976847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6028ef71-e463-497f-b97a-eb10d61d20fa tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:56.978656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6028ef71-e463-497f-b97a-eb10d61d20fa tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:57.225901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-855caf83-48fb-45a8-8e09-be1b6db2e0eb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:57.248696 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-855caf83-48fb-45a8-8e09-be1b6db2e0eb tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 200 len: 1621 microversion: 2.1 time: 0.693125 Aug 03 01:57:57.255793 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1280/2513] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:56 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 1621 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:57.289492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6ebf187a-6727-4d31-a957-be01c8f3df12 tempest-SecurityGroupsTestAdminJSON-62233088 tempest-SecurityGroupsTestAdminJSON-62233088-project] Calling method '.version_select at 0x7f5b1267e1f0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:57.683200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6028ef71-e463-497f-b97a-eb10d61d20fa tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:57.700035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6028ef71-e463-497f-b97a-eb10d61d20fa tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:57.702804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6028ef71-e463-497f-b97a-eb10d61d20fa tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:57.704466 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6028ef71-e463-497f-b97a-eb10d61d20fa tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1850 microversion: 2.32 time: 0.819722 Aug 03 01:57:57.716083 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1234/2514] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:56 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1850 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:57:57.729658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-68f07166-d0fa-45ac-bea9-5b12a74c0ba0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:57.730726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-68f07166-d0fa-45ac-bea9-5b12a74c0ba0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:57.740491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68f07166-d0fa-45ac-bea9-5b12a74c0ba0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:57.741375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68f07166-d0fa-45ac-bea9-5b12a74c0ba0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:57.742541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68f07166-d0fa-45ac-bea9-5b12a74c0ba0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:57.743577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68f07166-d0fa-45ac-bea9-5b12a74c0ba0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:59.143575 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6ebf187a-6727-4d31-a957-be01c8f3df12 tempest-SecurityGroupsTestAdminJSON-62233088 tempest-SecurityGroupsTestAdminJSON-62233088-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/d0118c7b-e0ae-4523-878e-9f02d69e5d0e" status: 202 len: 0 microversion: 2.1 time: 1.885985 Aug 03 01:57:59.146232 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1281/2515] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:57:57 2022] DELETE /compute/v2.1/os-security-groups/d0118c7b-e0ae-4523-878e-9f02d69e5d0e => generated 0 bytes in 1890 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:57:59.153756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-38d98e45-8650-4357-b001-29ac7744dbfc req-7bbececf-6add-4531-966c-8ad28ca3e7b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d537dd36-d584-48d0-9458-81075e06b366", "name": "network-vif-deleted", "tag": "02b87219-959c-40f7-baa4-183c4ffd1862"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:57:59.210720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-38d98e45-8650-4357-b001-29ac7744dbfc req-7bbececf-6add-4531-966c-8ad28ca3e7b1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:59.214465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-38d98e45-8650-4357-b001-29ac7744dbfc req-7bbececf-6add-4531-966c-8ad28ca3e7b1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:59.250842 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-38d98e45-8650-4357-b001-29ac7744dbfc req-7bbececf-6add-4531-966c-8ad28ca3e7b1 service nova] Creating event network-vif-deleted:02b87219-959c-40f7-baa4-183c4ffd1862 for instance d537dd36-d584-48d0-9458-81075e06b366 on n-h2-826529-8 Aug 03 01:57:59.261804 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-38d98e45-8650-4357-b001-29ac7744dbfc req-7bbececf-6add-4531-966c-8ad28ca3e7b1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114021 Aug 03 01:57:59.267458 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1282/2516] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:57:59.277764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-407f31cd-e79c-4e25-867b-28eb770c889e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:59.285497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-407f31cd-e79c-4e25-867b-28eb770c889e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:59.298310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-407f31cd-e79c-4e25-867b-28eb770c889e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:59.302228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-407f31cd-e79c-4e25-867b-28eb770c889e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:59.305841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-407f31cd-e79c-4e25-867b-28eb770c889e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:59.306566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-407f31cd-e79c-4e25-867b-28eb770c889e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:59.387768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-68f07166-d0fa-45ac-bea9-5b12a74c0ba0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:57:59.407242 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-68f07166-d0fa-45ac-bea9-5b12a74c0ba0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce" status: 200 len: 1307 microversion: 2.1 time: 1.689612 Aug 03 01:57:59.408164 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1235/2517] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:57 2022] GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce => generated 1307 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:57:59.419879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-171c3f16-9c78-497f-9755-c1cd0c2674e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:59.423632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-171c3f16-9c78-497f-9755-c1cd0c2674e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: d537dd36-d584-48d0-9458-81075e06b366] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:59.445804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-171c3f16-9c78-497f-9755-c1cd0c2674e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:59.449068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-171c3f16-9c78-497f-9755-c1cd0c2674e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:59.450650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-171c3f16-9c78-497f-9755-c1cd0c2674e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:59.451524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-171c3f16-9c78-497f-9755-c1cd0c2674e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:59.476440 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-171c3f16-9c78-497f-9755-c1cd0c2674e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] HTTP exception thrown: Instance d537dd36-d584-48d0-9458-81075e06b366 could not be found. Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-171c3f16-9c78-497f-9755-c1cd0c2674e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Request method failure captured: Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 HTTP/1.1 Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTll7VklSXVKPY7IA1_5ob-tKVm2Z_7z42qGXzDSvTdwVAzc-uu26I_RdtLVhoAwHCuPbYMUDNABwS67wYISa8yagl02RQzcDUh0SQ8u7p5lboe4i0RQPeTExpnFXWWBwbJADXBFZ5wGYauWv3NNIL4oxW8HVYZDtaGv8yUqCCibqo Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c183e2fc6dbb419fbd8fa81c90163adf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}] Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 0b99d344c16b4221bcccfe37d32bb69e Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance d537dd36-d584-48d0-9458-81075e06b366 could not be found. Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'd537dd36-d584-48d0-9458-81075e06b366'} Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d537dd36-d584-48d0-9458-81075e06b366 could not be found. Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d537dd36-d584-48d0-9458-81075e06b366 could not be found. Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:59.478929 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:57:59.483219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:59.483219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:57:59.483219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:57:59.483219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:57:59.483219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:57:59.483219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:57:59.483219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d537dd36-d584-48d0-9458-81075e06b366 could not be found. Aug 03 01:57:59.483219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:57:59.486119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-171c3f16-9c78-497f-9755-c1cd0c2674e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Returning 404 to user: Instance d537dd36-d584-48d0-9458-81075e06b366 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:57:59.488118 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-171c3f16-9c78-497f-9755-c1cd0c2674e1 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366" status: 404 len: 111 microversion: 2.1 time: 0.075196 Aug 03 01:57:59.489383 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1236/2518] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:59 2022] GET /compute/v2.1/servers/d537dd36-d584-48d0-9458-81075e06b366 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:57:59.494810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-49c2cfd5-ca0c-450d-9c64-7229bacaaf23 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:57:59.495921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-49c2cfd5-ca0c-450d-9c64-7229bacaaf23 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:57:59.504776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49c2cfd5-ca0c-450d-9c64-7229bacaaf23 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:59.505778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49c2cfd5-ca0c-450d-9c64-7229bacaaf23 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:57:59.506718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49c2cfd5-ca0c-450d-9c64-7229bacaaf23 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:57:59.507458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49c2cfd5-ca0c-450d-9c64-7229bacaaf23 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:00.042448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-407f31cd-e79c-4e25-867b-28eb770c889e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:00.066048 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-407f31cd-e79c-4e25-867b-28eb770c889e tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1506 microversion: 2.1 time: 0.796141 Aug 03 01:58:00.072489 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1283/2519] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:57:59 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1506 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:00.087272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5d90dd58-7d6c-47d5-b4ab-d0179b929dea tempest-SecurityGroupsTestAdminJSON-62233088 tempest-SecurityGroupsTestAdminJSON-62233088-project] Calling method '.version_select at 0x7f5b12bdcdc0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:00.817562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-49c2cfd5-ca0c-450d-9c64-7229bacaaf23 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:00.833749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-49c2cfd5-ca0c-450d-9c64-7229bacaaf23 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:00.849954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-49c2cfd5-ca0c-450d-9c64-7229bacaaf23 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:00.854120 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-49c2cfd5-ca0c-450d-9c64-7229bacaaf23 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1850 microversion: 2.32 time: 1.362803 Aug 03 01:58:00.867305 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1237/2520] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:57:59 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1850 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:00.879399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-73fad8e8-56e0-4e65-aa61-8955318b003c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '.version_select at 0x7f5b243d88b0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:00.981261 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-73fad8e8-56e0-4e65-aa61-8955318b003c tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-57918381" status: 202 len: 0 microversion: 2.1 time: 0.112215 Aug 03 01:58:00.981857 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1238/2521] 10.222.0.67 () {58 vars in 1215 bytes} [Wed Aug 3 01:58:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-57918381 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:58:00.998189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c0fc5d93-8851-44dd-bda9-10431c64139a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:00.999629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c0fc5d93-8851-44dd-bda9-10431c64139a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:01.034197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0fc5d93-8851-44dd-bda9-10431c64139a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:01.041709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0fc5d93-8851-44dd-bda9-10431c64139a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:01.045693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0fc5d93-8851-44dd-bda9-10431c64139a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:01.045693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0fc5d93-8851-44dd-bda9-10431c64139a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:01.960396 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5d90dd58-7d6c-47d5-b4ab-d0179b929dea tempest-SecurityGroupsTestAdminJSON-62233088 tempest-SecurityGroupsTestAdminJSON-62233088-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/021d080b-0053-4765-9401-520ae4fdf276" status: 202 len: 0 microversion: 2.1 time: 1.886302 Aug 03 01:58:01.962179 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1284/2522] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:58:00 2022] DELETE /compute/v2.1/os-security-groups/021d080b-0053-4765-9401-520ae4fdf276 => generated 0 bytes in 1889 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 01:58:01.982003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4220136c-be21-4a62-ad67-8085900ff7e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:01.986463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4220136c-be21-4a62-ad67-8085900ff7e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:02.020349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4220136c-be21-4a62-ad67-8085900ff7e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:02.024424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4220136c-be21-4a62-ad67-8085900ff7e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:02.027376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4220136c-be21-4a62-ad67-8085900ff7e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:02.029525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4220136c-be21-4a62-ad67-8085900ff7e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:02.187144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c0fc5d93-8851-44dd-bda9-10431c64139a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:02.199094 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c0fc5d93-8851-44dd-bda9-10431c64139a tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce" status: 200 len: 1307 microversion: 2.1 time: 1.215931 Aug 03 01:58:02.199693 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1239/2523] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:00 2022] GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce => generated 1307 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:02.249620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4220136c-be21-4a62-ad67-8085900ff7e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:02.250078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4220136c-be21-4a62-ad67-8085900ff7e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:02.250607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-4220136c-be21-4a62-ad67-8085900ff7e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lazy-loading 'fault' on Instance uuid a4c1a495-99ee-4678-bc30-798f3e08b44d {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:58:02.327209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4220136c-be21-4a62-ad67-8085900ff7e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:02.343234 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4220136c-be21-4a62-ad67-8085900ff7e6 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 200 len: 1304 microversion: 2.1 time: 0.375279 Aug 03 01:58:02.348291 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1285/2524] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:01 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 1304 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:02.376893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-351917a1-0459-4c90-a679-f0eaec43c95d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:02.386456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-351917a1-0459-4c90-a679-f0eaec43c95d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:02.412747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-351917a1-0459-4c90-a679-f0eaec43c95d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:02.416756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-351917a1-0459-4c90-a679-f0eaec43c95d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:02.420614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-351917a1-0459-4c90-a679-f0eaec43c95d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:02.424670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-351917a1-0459-4c90-a679-f0eaec43c95d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:02.773745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-626830f9-5686-46c6-bf12-5bf457906626 req-75ea663f-093d-4251-befc-52400ca56be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "tag": "9106a59f-415c-4da3-93ee-ae5f0c636a4a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:02.810047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-626830f9-5686-46c6-bf12-5bf457906626 req-75ea663f-093d-4251-befc-52400ca56be3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:02.812495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-626830f9-5686-46c6-bf12-5bf457906626 req-75ea663f-093d-4251-befc-52400ca56be3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:02.837996 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-626830f9-5686-46c6-bf12-5bf457906626 req-75ea663f-093d-4251-befc-52400ca56be3 service nova] Creating event network-changed:9106a59f-415c-4da3-93ee-ae5f0c636a4a for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 01:58:02.854541 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-626830f9-5686-46c6-bf12-5bf457906626 req-75ea663f-093d-4251-befc-52400ca56be3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.650679 Aug 03 01:58:02.857981 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1240/2525] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:03.066063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-351917a1-0459-4c90-a679-f0eaec43c95d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:03.096884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-351917a1-0459-4c90-a679-f0eaec43c95d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:03.105436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-351917a1-0459-4c90-a679-f0eaec43c95d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:03.109047 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-351917a1-0459-4c90-a679-f0eaec43c95d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1850 microversion: 2.32 time: 0.759291 Aug 03 01:58:03.113844 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1286/2526] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:02 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1850 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:03.225970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-35789bf5-05ad-410e-a0dd-6ef6331068cf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:03.227507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-35789bf5-05ad-410e-a0dd-6ef6331068cf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:03.286365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35789bf5-05ad-410e-a0dd-6ef6331068cf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:03.287067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35789bf5-05ad-410e-a0dd-6ef6331068cf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:03.288406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35789bf5-05ad-410e-a0dd-6ef6331068cf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:03.288978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35789bf5-05ad-410e-a0dd-6ef6331068cf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:03.375622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0969d9bb-9ed3-442d-b6ac-436f52879301 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:03.378561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0969d9bb-9ed3-442d-b6ac-436f52879301 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: a4c1a495-99ee-4678-bc30-798f3e08b44d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:03.396699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0969d9bb-9ed3-442d-b6ac-436f52879301 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:03.399277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0969d9bb-9ed3-442d-b6ac-436f52879301 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:03.403505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0969d9bb-9ed3-442d-b6ac-436f52879301 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:03.407871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0969d9bb-9ed3-442d-b6ac-436f52879301 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:03.473775 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-0969d9bb-9ed3-442d-b6ac-436f52879301 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] HTTP exception thrown: Instance a4c1a495-99ee-4678-bc30-798f3e08b44d could not be found. Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0969d9bb-9ed3-442d-b6ac-436f52879301 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Request method failure captured: Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d HTTP/1.1 Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dWC1JasgyvT4EtHSVyCTVZT5230Z-Reb0TCDZRLfPHtCP3cGiFUleyfGqwJ1ch5ucbaJGk2x5ZfDJ5e9uxMy1vIIXeuqLphxA4DpckWXyqhO0gQk4OYDIZ312x2gbmckSL6ySrs8lXgq7vsrENcJCm7c8BZCCs15yTe9GcLKyTIVC0 Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 5afa51a97bca4402b44c445a5382e23e Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerRescueTestJSON-1026627391 Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5afa51a97bca4402b44c445a5382e23e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5afa51a97bca4402b44c445a5382e23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5afa51a97bca4402b44c445a5382e23e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5afa51a97bca4402b44c445a5382e23e"}]}] Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerRescueTestJSON-1026627391 Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 5afa51a97bca4402b44c445a5382e23e Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerRescueTestJSON-1026627391 Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerRescueTestJSON-1026627391-project Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1849063489bf44fabc0785643c0c28e2 Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerRescueTestJSON-1026627391-project Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance a4c1a495-99ee-4678-bc30-798f3e08b44d could not be found. Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'a4c1a495-99ee-4678-bc30-798f3e08b44d'} Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c1a495-99ee-4678-bc30-798f3e08b44d could not be found. Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c1a495-99ee-4678-bc30-798f3e08b44d could not be found. Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:03.476807 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:03.480516 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:03.480516 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:03.480516 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:03.480516 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:03.480516 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:03.480516 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c1a495-99ee-4678-bc30-798f3e08b44d could not be found. Aug 03 01:58:03.480516 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:03.483104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0969d9bb-9ed3-442d-b6ac-436f52879301 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Returning 404 to user: Instance a4c1a495-99ee-4678-bc30-798f3e08b44d could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:03.488748 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0969d9bb-9ed3-442d-b6ac-436f52879301 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d" status: 404 len: 111 microversion: 2.1 time: 0.113373 Aug 03 01:58:03.490228 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1287/2527] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:03 2022] GET /compute/v2.1/servers/a4c1a495-99ee-4678-bc30-798f3e08b44d => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:58:03.497803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-01712102-cc15-411d-ade3-2643d1047350 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:03.498621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-01712102-cc15-411d-ade3-2643d1047350 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:03.509288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01712102-cc15-411d-ade3-2643d1047350 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:03.510061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01712102-cc15-411d-ade3-2643d1047350 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:03.511185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01712102-cc15-411d-ade3-2643d1047350 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:03.511900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01712102-cc15-411d-ade3-2643d1047350 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:03.547331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-01712102-cc15-411d-ade3-2643d1047350 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:58:03.696925 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-01712102-cc15-411d-ade3-2643d1047350 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "DELETE /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 204 len: 0 microversion: 2.1 time: 0.204238 Aug 03 01:58:03.700518 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1288/2528] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:58:03 2022] DELETE /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:58:03.704898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-6d426c8e-f749-4200-9324-3c5237721b43 req-227540c6-f036-4984-99c1-79d203f26a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16268f31-3fcc-4f5f-96f6-137c129581ce", "name": "network-vif-plugged", "status": "completed", "tag": "d040aed7-adb8-4a77-960c-06e14a41dab2"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:03.747203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6d426c8e-f749-4200-9324-3c5237721b43 req-227540c6-f036-4984-99c1-79d203f26a57 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:03.747203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6d426c8e-f749-4200-9324-3c5237721b43 req-227540c6-f036-4984-99c1-79d203f26a57 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:03.780190 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-6d426c8e-f749-4200-9324-3c5237721b43 req-227540c6-f036-4984-99c1-79d203f26a57 service nova] Creating event network-vif-plugged:d040aed7-adb8-4a77-960c-06e14a41dab2 for instance 16268f31-3fcc-4f5f-96f6-137c129581ce on n-h1-826529-8 Aug 03 01:58:03.792905 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-6d426c8e-f749-4200-9324-3c5237721b43 req-227540c6-f036-4984-99c1-79d203f26a57 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093567 Aug 03 01:58:03.793534 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1289/2529] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:03.800513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5ece56c3-1cc1-40fd-8f60-579c6d2dcfb2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:03.801414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5ece56c3-1cc1-40fd-8f60-579c6d2dcfb2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:03.813005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ece56c3-1cc1-40fd-8f60-579c6d2dcfb2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:03.813376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ece56c3-1cc1-40fd-8f60-579c6d2dcfb2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:03.814203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ece56c3-1cc1-40fd-8f60-579c6d2dcfb2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:03.814707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ece56c3-1cc1-40fd-8f60-579c6d2dcfb2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:03.983329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-35789bf5-05ad-410e-a0dd-6ef6331068cf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:03.992046 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-35789bf5-05ad-410e-a0dd-6ef6331068cf tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce" status: 200 len: 1307 microversion: 2.1 time: 0.774201 Aug 03 01:58:03.992644 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1241/2530] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:03 2022] GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce => generated 1307 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:04.137897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f2d4f30f-58dc-4f1f-a609-468311d70af8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:04.138525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f2d4f30f-58dc-4f1f-a609-468311d70af8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:04.148537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2d4f30f-58dc-4f1f-a609-468311d70af8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:04.154261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2d4f30f-58dc-4f1f-a609-468311d70af8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:04.156271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2d4f30f-58dc-4f1f-a609-468311d70af8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:04.159385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2d4f30f-58dc-4f1f-a609-468311d70af8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:04.340592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ece56c3-1cc1-40fd-8f60-579c6d2dcfb2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:04.343181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:58:04.354512 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5ece56c3-1cc1-40fd-8f60-579c6d2dcfb2 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1492 microversion: 2.1 time: 0.558929 Aug 03 01:58:04.365106 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1290/2531] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:03 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1492 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:05.015718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37983811-e4c5-45b4-9f51-636959d29332 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:05.016710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-37983811-e4c5-45b4-9f51-636959d29332 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:05.060004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37983811-e4c5-45b4-9f51-636959d29332 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:05.066890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37983811-e4c5-45b4-9f51-636959d29332 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:05.067776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37983811-e4c5-45b4-9f51-636959d29332 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:05.068232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37983811-e4c5-45b4-9f51-636959d29332 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:05.241196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f2d4f30f-58dc-4f1f-a609-468311d70af8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:05.261531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f2d4f30f-58dc-4f1f-a609-468311d70af8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:05.265798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f2d4f30f-58dc-4f1f-a609-468311d70af8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:05.271818 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f2d4f30f-58dc-4f1f-a609-468311d70af8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1871 microversion: 2.32 time: 1.138011 Aug 03 01:58:05.276029 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1242/2532] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:04 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1871 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:58:05.290624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-0dc60e75-f70e-4bf8-be57-cb5b1acb6f68 req-f3e08af2-b880-4796-ba0a-fefc21b0b092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c1a495-99ee-4678-bc30-798f3e08b44d", "name": "network-vif-deleted", "tag": "2d526941-b201-4313-82bb-04874c53fceb"}, {"name": "network-changed", "server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "tag": "6afd3b79-7021-42c2-850a-794d515c4eb6"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:05.322001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0dc60e75-f70e-4bf8-be57-cb5b1acb6f68 req-f3e08af2-b880-4796-ba0a-fefc21b0b092 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:05.322666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0dc60e75-f70e-4bf8-be57-cb5b1acb6f68 req-f3e08af2-b880-4796-ba0a-fefc21b0b092 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:05.342099 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-0dc60e75-f70e-4bf8-be57-cb5b1acb6f68 req-f3e08af2-b880-4796-ba0a-fefc21b0b092 service nova] Creating event network-vif-deleted:2d526941-b201-4313-82bb-04874c53fceb for instance a4c1a495-99ee-4678-bc30-798f3e08b44d on n-h2-826529-8 Aug 03 01:58:05.342952 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-0dc60e75-f70e-4bf8-be57-cb5b1acb6f68 req-f3e08af2-b880-4796-ba0a-fefc21b0b092 service nova] Creating event network-changed:6afd3b79-7021-42c2-850a-794d515c4eb6 for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 01:58:05.355493 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-0dc60e75-f70e-4bf8-be57-cb5b1acb6f68 req-f3e08af2-b880-4796-ba0a-fefc21b0b092 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.077581 Aug 03 01:58:05.359067 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1243/2533] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:05.386508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b0c6547f-ed67-46f7-ac0a-03e2e6d023bd tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:05.389241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b0c6547f-ed67-46f7-ac0a-03e2e6d023bd tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:05.404896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0c6547f-ed67-46f7-ac0a-03e2e6d023bd tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:05.405703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0c6547f-ed67-46f7-ac0a-03e2e6d023bd tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:05.409266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0c6547f-ed67-46f7-ac0a-03e2e6d023bd tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:05.414160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0c6547f-ed67-46f7-ac0a-03e2e6d023bd tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:06.188655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b0c6547f-ed67-46f7-ac0a-03e2e6d023bd tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:06.210147 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b0c6547f-ed67-46f7-ac0a-03e2e6d023bd tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1492 microversion: 2.1 time: 0.827708 Aug 03 01:58:06.212116 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1244/2534] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:05 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1492 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:58:06.302258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1a2a70c9-9621-417a-aeda-86cea5bbe5ca tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:06.303612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1a2a70c9-9621-417a-aeda-86cea5bbe5ca tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:06.326893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a2a70c9-9621-417a-aeda-86cea5bbe5ca tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:06.327614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a2a70c9-9621-417a-aeda-86cea5bbe5ca tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:06.328629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a2a70c9-9621-417a-aeda-86cea5bbe5ca tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:06.329241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a2a70c9-9621-417a-aeda-86cea5bbe5ca tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:06.347145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-37983811-e4c5-45b4-9f51-636959d29332 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:06.359561 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-37983811-e4c5-45b4-9f51-636959d29332 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce" status: 200 len: 1307 microversion: 2.1 time: 1.348776 Aug 03 01:58:06.360190 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1291/2535] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:05 2022] GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce => generated 1307 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:07.234135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-55815517-bc5e-4cd6-9d2f-2e93a75b48c8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:07.234750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-55815517-bc5e-4cd6-9d2f-2e93a75b48c8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:07.254371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55815517-bc5e-4cd6-9d2f-2e93a75b48c8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:07.255105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55815517-bc5e-4cd6-9d2f-2e93a75b48c8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:07.256058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55815517-bc5e-4cd6-9d2f-2e93a75b48c8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:07.256681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55815517-bc5e-4cd6-9d2f-2e93a75b48c8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:08.612735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-55815517-bc5e-4cd6-9d2f-2e93a75b48c8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:08.622585 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-55815517-bc5e-4cd6-9d2f-2e93a75b48c8 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1492 microversion: 2.1 time: 1.392157 Aug 03 01:58:08.632732 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1292/2536] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:07 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1492 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:58:08.637982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0edc7a0f-7646-46ac-b8f7-879d1247cb25 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:08.657182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0edc7a0f-7646-46ac-b8f7-879d1247cb25 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:08.688629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0edc7a0f-7646-46ac-b8f7-879d1247cb25 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:08.688979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0edc7a0f-7646-46ac-b8f7-879d1247cb25 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:08.700050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0edc7a0f-7646-46ac-b8f7-879d1247cb25 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:08.700720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0edc7a0f-7646-46ac-b8f7-879d1247cb25 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:08.745888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1a2a70c9-9621-417a-aeda-86cea5bbe5ca tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:08.762561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:58:08.775040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1a2a70c9-9621-417a-aeda-86cea5bbe5ca tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:08.776747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1a2a70c9-9621-417a-aeda-86cea5bbe5ca tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:08.786474 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1a2a70c9-9621-417a-aeda-86cea5bbe5ca tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1892 microversion: 2.32 time: 2.488994 Aug 03 01:58:08.787129 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1245/2537] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:06 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1892 bytes in 2490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:58:09.443193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0edc7a0f-7646-46ac-b8f7-879d1247cb25 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:09.453565 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0edc7a0f-7646-46ac-b8f7-879d1247cb25 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce" status: 200 len: 1486 microversion: 2.1 time: 0.818550 Aug 03 01:58:09.454526 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1293/2538] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:08 2022] GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce => generated 1486 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:09.480488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a070068c-1e29-47ab-a6c0-3a9d6290a883 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1063421335"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:09.483794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a070068c-1e29-47ab-a6c0-3a9d6290a883 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:09.500036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:58:09.503843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a070068c-1e29-47ab-a6c0-3a9d6290a883 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:09.504584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a070068c-1e29-47ab-a6c0-3a9d6290a883 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:09.505787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a070068c-1e29-47ab-a6c0-3a9d6290a883 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:09.506832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a070068c-1e29-47ab-a6c0-3a9d6290a883 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:09.656041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3d7ee5ab-ef21-4d89-8bf4-47161f0fd348 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:09.656929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3d7ee5ab-ef21-4d89-8bf4-47161f0fd348 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:09.681583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3d7ee5ab-ef21-4d89-8bf4-47161f0fd348 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:09.683339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3d7ee5ab-ef21-4d89-8bf4-47161f0fd348 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:09.687304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3d7ee5ab-ef21-4d89-8bf4-47161f0fd348 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:09.688018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3d7ee5ab-ef21-4d89-8bf4-47161f0fd348 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:09.925531 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a070068c-1e29-47ab-a6c0-3a9d6290a883 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "POST /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce/action" status: 202 len: 0 microversion: 2.1 time: 0.448123 Aug 03 01:58:09.926202 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1246/2539] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 01:58:09 2022] POST /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 01:58:09.950692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-c30e1972-c628-480a-b023-bf22f361fb69 req-169e16c0-1a41-4a73-8dd1-5700ff57ce2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "tag": "0956e1fb-7c38-41ed-9df3-a9cd8fe4b445"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:09.977475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c30e1972-c628-480a-b023-bf22f361fb69 req-169e16c0-1a41-4a73-8dd1-5700ff57ce2c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:09.977921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c30e1972-c628-480a-b023-bf22f361fb69 req-169e16c0-1a41-4a73-8dd1-5700ff57ce2c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:10.008670 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c30e1972-c628-480a-b023-bf22f361fb69 req-169e16c0-1a41-4a73-8dd1-5700ff57ce2c service nova] Creating event network-changed:0956e1fb-7c38-41ed-9df3-a9cd8fe4b445 for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 01:58:10.025041 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-c30e1972-c628-480a-b023-bf22f361fb69 req-169e16c0-1a41-4a73-8dd1-5700ff57ce2c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081797 Aug 03 01:58:10.025957 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1247/2540] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:10.031478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4eaec7c2-4d10-4aea-8d31-8115eb2acbb2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:10.039959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4eaec7c2-4d10-4aea-8d31-8115eb2acbb2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:10.057544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eaec7c2-4d10-4aea-8d31-8115eb2acbb2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:10.058323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eaec7c2-4d10-4aea-8d31-8115eb2acbb2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:10.059400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eaec7c2-4d10-4aea-8d31-8115eb2acbb2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:10.060032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eaec7c2-4d10-4aea-8d31-8115eb2acbb2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:10.630210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3d7ee5ab-ef21-4d89-8bf4-47161f0fd348 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1849063489bf44fabc0785643c0c28e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afa51a97bca4402b44c445a5382e23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:10.639191 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3d7ee5ab-ef21-4d89-8bf4-47161f0fd348 tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 200 len: 1492 microversion: 2.1 time: 0.990218 Aug 03 01:58:10.642240 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1294/2541] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:09 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 1492 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:58:10.655635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ecea70d5-3593-49d6-9b8f-0548927534e1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b12589dc0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:10.738656 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ecea70d5-3593-49d6-9b8f-0548927534e1 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/bd14e672-fd22-4e6a-97f6-09c8136c44fb" status: 200 len: 1414 microversion: 2.1 time: 0.094565 Aug 03 01:58:10.740186 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1295/2542] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:58:10 2022] GET /compute/v2.1/images/bd14e672-fd22-4e6a-97f6-09c8136c44fb => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:10.977871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4eaec7c2-4d10-4aea-8d31-8115eb2acbb2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:10.993161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4eaec7c2-4d10-4aea-8d31-8115eb2acbb2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:11.007651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4eaec7c2-4d10-4aea-8d31-8115eb2acbb2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:11.009267 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4eaec7c2-4d10-4aea-8d31-8115eb2acbb2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1892 microversion: 2.32 time: 0.982016 Aug 03 01:58:11.013604 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1248/2543] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:10 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1892 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:11.021098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1e267937-e08b-4c1e-ae2e-109a118e4147 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b243e6670>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:11.111069 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1e267937-e08b-4c1e-ae2e-109a118e4147 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/bd14e672-fd22-4e6a-97f6-09c8136c44fb" status: 200 len: 1414 microversion: 2.1 time: 0.096094 Aug 03 01:58:11.127578 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1249/2544] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:58:11 2022] GET /compute/v2.1/images/bd14e672-fd22-4e6a-97f6-09c8136c44fb => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:11.143793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-35c869c2-4334-4b62-a9e5-4957fd844b64 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b24427940>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:11.263491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1402222427", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:11.449329 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-35c869c2-4334-4b62-a9e5-4957fd844b64 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/images/bd14e672-fd22-4e6a-97f6-09c8136c44fb" status: 204 len: 0 microversion: 2.1 time: 0.319989 Aug 03 01:58:11.450235 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1250/2545] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:11 2022] DELETE /compute/v2.1/images/bd14e672-fd22-4e6a-97f6-09c8136c44fb => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:58:11.459891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4d24b5ac-f6d0-43ec-8a4b-e363a81ab24b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b244271f0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:11.514086 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-4d24b5ac-f6d0-43ec-8a4b-e363a81ab24b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] HTTP exception thrown: Image not found. Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4d24b5ac-f6d0-43ec-8a4b-e363a81ab24b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Request method failure captured: Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/images/bd14e672-fd22-4e6a-97f6-09c8136c44fb HTTP/1.1 Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dVR-uR9PJ3ItUhBzG_WhhLRpHjT_F5EmstYt1sksaXu8YQycHlQ2v0WaZKjQWy6Ho6OtrWyjCIN_qTUm3fm2Dw34k3YP9rB28KqbKYSP4TLmMLV0dJr5eU5og-0HLsfpQQ_qwRQjzTCA12Tyw8grKEsl7oBiyxzKFVu27eT_jRkQ7U Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6bf2395335564acdaf819f2175dbd3bc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}] Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 47e6a189229d4f8ab3aa4ca416d84594 Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: exception: Image not found. Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'bd14e672-fd22-4e6a-97f6-09c8136c44fb'} Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bd14e672-fd22-4e6a-97f6-09c8136c44fb Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 01:58:11.516433 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bd14e672-fd22-4e6a-97f6-09c8136c44fb could not be found. Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:11.522099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4d24b5ac-f6d0-43ec-8a4b-e363a81ab24b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Returning 404 to user: Image not found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:11.527411 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4d24b5ac-f6d0-43ec-8a4b-e363a81ab24b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/images/bd14e672-fd22-4e6a-97f6-09c8136c44fb" status: 404 len: 62 microversion: 2.1 time: 0.068074 Aug 03 01:58:11.530991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:58:11.536661 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1251/2546] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 01:58:11 2022] GET /compute/v2.1/images/bd14e672-fd22-4e6a-97f6-09c8136c44fb => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 03 01:58:11.560103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cf4f06fa-7f6a-49e0-af5a-7da64a9e5d5d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:11.563627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cf4f06fa-7f6a-49e0-af5a-7da64a9e5d5d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:11.587107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf4f06fa-7f6a-49e0-af5a-7da64a9e5d5d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:11.591482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf4f06fa-7f6a-49e0-af5a-7da64a9e5d5d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:11.592519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf4f06fa-7f6a-49e0-af5a-7da64a9e5d5d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:11.593626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf4f06fa-7f6a-49e0-af5a-7da64a9e5d5d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:12.313165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cf4f06fa-7f6a-49e0-af5a-7da64a9e5d5d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:12.326092 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cf4f06fa-7f6a-49e0-af5a-7da64a9e5d5d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce" status: 200 len: 1504 microversion: 2.1 time: 0.784950 Aug 03 01:58:12.326680 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1252/2547] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:11 2022] GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce => generated 1504 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:12.336829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-01b5032d-dd00-4248-bd9a-32eb013f44ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:12.340096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-01b5032d-dd00-4248-bd9a-32eb013f44ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] [instance: 072d2dbc-29dd-41c9-ac28-a9961d858bf0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:12.356742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01b5032d-dd00-4248-bd9a-32eb013f44ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:12.357241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01b5032d-dd00-4248-bd9a-32eb013f44ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:12.360771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01b5032d-dd00-4248-bd9a-32eb013f44ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:12.362021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01b5032d-dd00-4248-bd9a-32eb013f44ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:12.393663 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-01b5032d-dd00-4248-bd9a-32eb013f44ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] HTTP exception thrown: Instance 072d2dbc-29dd-41c9-ac28-a9961d858bf0 could not be found. Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-01b5032d-dd00-4248-bd9a-32eb013f44ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Request method failure captured: Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 HTTP/1.1 Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dWC1JasgyvT4EtHSVyCTVZT5230Z-Reb0TCDZRLfPHtCP3cGiFUleyfGqwJ1ch5ucbaJGk2x5ZfDJ5e9uxMy1vIIXeuqLphxA4DpckWXyqhO0gQk4OYDIZ312x2gbmckSL6ySrs8lXgq7vsrENcJCm7c8BZCCs15yTe9GcLKyTIVC0 Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 5afa51a97bca4402b44c445a5382e23e Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerRescueTestJSON-1026627391 Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5afa51a97bca4402b44c445a5382e23e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5afa51a97bca4402b44c445a5382e23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5afa51a97bca4402b44c445a5382e23e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5afa51a97bca4402b44c445a5382e23e"}]}] Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerRescueTestJSON-1026627391 Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 5afa51a97bca4402b44c445a5382e23e Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerRescueTestJSON-1026627391 Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerRescueTestJSON-1026627391-project Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1849063489bf44fabc0785643c0c28e2 Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerRescueTestJSON-1026627391-project Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 072d2dbc-29dd-41c9-ac28-a9961d858bf0 could not be found. Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '072d2dbc-29dd-41c9-ac28-a9961d858bf0'} Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 072d2dbc-29dd-41c9-ac28-a9961d858bf0 could not be found. Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 072d2dbc-29dd-41c9-ac28-a9961d858bf0 could not be found. Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:12.395892 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:12.403709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:12.403709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:12.403709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:12.403709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:12.403709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:12.403709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 072d2dbc-29dd-41c9-ac28-a9961d858bf0 could not be found. Aug 03 01:58:12.403709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:12.403709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-01b5032d-dd00-4248-bd9a-32eb013f44ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] Returning 404 to user: Instance 072d2dbc-29dd-41c9-ac28-a9961d858bf0 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:12.403709 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-01b5032d-dd00-4248-bd9a-32eb013f44ad tempest-ServerRescueTestJSON-1026627391 tempest-ServerRescueTestJSON-1026627391-project] 10.222.0.67 "GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0" status: 404 len: 111 microversion: 2.1 time: 0.068538 Aug 03 01:58:12.403709 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1253/2548] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:12 2022] GET /compute/v2.1/servers/072d2dbc-29dd-41c9-ac28-a9961d858bf0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:58:12.415803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-697ddd1d-b028-4b6a-a622-afad60096516 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:12.415803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-697ddd1d-b028-4b6a-a622-afad60096516 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:12.433334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-697ddd1d-b028-4b6a-a622-afad60096516 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:12.433797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-697ddd1d-b028-4b6a-a622-afad60096516 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:12.434603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-697ddd1d-b028-4b6a-a622-afad60096516 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:12.437165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-697ddd1d-b028-4b6a-a622-afad60096516 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:12.811494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:58:12.811494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:58:12.811494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:58:12.811494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:58:12.812177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:58:12.852165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:12.856740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:12.860923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:12.864455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:12.948178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Getting quotas for project efbf4b3aadcb451b95cbb030d640c4ba. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:58:12.963572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Getting quotas for user 683a203709e0436a99b818d902561e46 and project efbf4b3aadcb451b95cbb030d640c4ba. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:58:12.999616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:58:13.005016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:58:13.162230 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3befe90a-22f1-4e67-aebf-f89a21e56281 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.420702 Aug 03 01:58:13.162920 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1296/2549] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:58:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:58:13.188980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-139c584c-8dce-49a1-8691-1f38bc256df1 req-16fb9bf8-7f36-4c43-8178-eb95147774cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072d2dbc-29dd-41c9-ac28-a9961d858bf0", "name": "network-vif-deleted", "tag": "b1dc1187-e8b5-4240-b07e-e49126145f1b"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:13.230340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-139c584c-8dce-49a1-8691-1f38bc256df1 req-16fb9bf8-7f36-4c43-8178-eb95147774cb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:13.230787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-139c584c-8dce-49a1-8691-1f38bc256df1 req-16fb9bf8-7f36-4c43-8178-eb95147774cb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:13.278469 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-139c584c-8dce-49a1-8691-1f38bc256df1 req-16fb9bf8-7f36-4c43-8178-eb95147774cb service nova] Creating event network-vif-deleted:b1dc1187-e8b5-4240-b07e-e49126145f1b for instance 072d2dbc-29dd-41c9-ac28-a9961d858bf0 on n-h2-826529-8 Aug 03 01:58:13.300770 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-139c584c-8dce-49a1-8691-1f38bc256df1 req-16fb9bf8-7f36-4c43-8178-eb95147774cb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119892 Aug 03 01:58:13.308771 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1297/2550] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:13.325366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e3617778-a7dd-459b-9c65-2e0279a94957 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:13.339072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e3617778-a7dd-459b-9c65-2e0279a94957 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:13.674475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3617778-a7dd-459b-9c65-2e0279a94957 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:13.688171 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e3617778-a7dd-459b-9c65-2e0279a94957 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1223 microversion: 2.1 time: 0.371702 Aug 03 01:58:13.706553 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1298/2551] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:13 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1223 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:13.719063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7979c2ac-37b3-40b4-a704-578cf97fd33f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:13.720209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7979c2ac-37b3-40b4-a704-578cf97fd33f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:13.754487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7979c2ac-37b3-40b4-a704-578cf97fd33f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:13.755604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7979c2ac-37b3-40b4-a704-578cf97fd33f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:13.756622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7979c2ac-37b3-40b4-a704-578cf97fd33f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:13.757270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7979c2ac-37b3-40b4-a704-578cf97fd33f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:13.963220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-697ddd1d-b028-4b6a-a622-afad60096516 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:13.989477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-697ddd1d-b028-4b6a-a622-afad60096516 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:14.004409 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-697ddd1d-b028-4b6a-a622-afad60096516 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:14.016237 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-697ddd1d-b028-4b6a-a622-afad60096516 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1892 microversion: 2.32 time: 1.608551 Aug 03 01:58:14.017203 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1254/2552] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:12 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1892 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:14.711045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-78657db0-4fe9-47da-a173-4742625578f2 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:14.711731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-78657db0-4fe9-47da-a173-4742625578f2 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:14.802799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7979c2ac-37b3-40b4-a704-578cf97fd33f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:14.820915 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7979c2ac-37b3-40b4-a704-578cf97fd33f tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce" status: 200 len: 1486 microversion: 2.1 time: 1.112119 Aug 03 01:58:14.859505 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1299/2553] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:13 2022] GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce => generated 1486 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:14.867639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fde184c5-e2bf-4ff4-8936-0541ba69439b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:14.868387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fde184c5-e2bf-4ff4-8936-0541ba69439b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:14.881481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fde184c5-e2bf-4ff4-8936-0541ba69439b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:14.882586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fde184c5-e2bf-4ff4-8936-0541ba69439b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:14.884016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fde184c5-e2bf-4ff4-8936-0541ba69439b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:14.884676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fde184c5-e2bf-4ff4-8936-0541ba69439b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:14.936466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fde184c5-e2bf-4ff4-8936-0541ba69439b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:58:15.119467 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fde184c5-e2bf-4ff4-8936-0541ba69439b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce" status: 204 len: 0 microversion: 2.1 time: 0.255816 Aug 03 01:58:15.122676 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1300/2554] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:58:14 2022] DELETE /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:58:15.166554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a780c751-660b-40c8-83f5-fe1688a601b7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:15.172584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a780c751-660b-40c8-83f5-fe1688a601b7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:15.177625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-78657db0-4fe9-47da-a173-4742625578f2 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:15.192680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a780c751-660b-40c8-83f5-fe1688a601b7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:15.193694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a780c751-660b-40c8-83f5-fe1688a601b7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:15.195797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a780c751-660b-40c8-83f5-fe1688a601b7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:15.197281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a780c751-660b-40c8-83f5-fe1688a601b7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:15.214471 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-78657db0-4fe9-47da-a173-4742625578f2 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1223 microversion: 2.1 time: 0.507012 Aug 03 01:58:15.229040 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1255/2555] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:14 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1223 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:15.250245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-66bd47e9-e56a-49c3-999b-35a6e1ebe8b0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b24420ee0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:15.315384 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-66bd47e9-e56a-49c3-999b-35a6e1ebe8b0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] HTTP exception thrown: Image not found. Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-66bd47e9-e56a-49c3-999b-35a6e1ebe8b0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Request method failure captured: Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/images/bd14e672-fd22-4e6a-97f6-09c8136c44fb HTTP/1.1 Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dVR-uR9PJ3ItUhBzG_WhhLRpHjT_F5EmstYt1sksaXu8YQycHlQ2v0WaZKjQWy6Ho6OtrWyjCIN_qTUm3fm2Dw34k3YP9rB28KqbKYSP4TLmMLV0dJr5eU5og-0HLsfpQQ_qwRQjzTCA12Tyw8grKEsl7oBiyxzKFVu27eT_jRkQ7U Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6bf2395335564acdaf819f2175dbd3bc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}] Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 47e6a189229d4f8ab3aa4ca416d84594 Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: exception: Image not found. Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'bd14e672-fd22-4e6a-97f6-09c8136c44fb'} Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bd14e672-fd22-4e6a-97f6-09c8136c44fb to delete Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bd14e672-fd22-4e6a-97f6-09c8136c44fb could not be found. Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:15.320816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:58:15.336879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:15.350852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-66bd47e9-e56a-49c3-999b-35a6e1ebe8b0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Returning 404 to user: Image not found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:15.352943 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-66bd47e9-e56a-49c3-999b-35a6e1ebe8b0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/images/bd14e672-fd22-4e6a-97f6-09c8136c44fb" status: 404 len: 62 microversion: 2.1 time: 0.121756 Aug 03 01:58:15.354181 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1256/2556] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:15 2022] DELETE /compute/v2.1/images/bd14e672-fd22-4e6a-97f6-09c8136c44fb => generated 62 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:58:15.367299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6d8baaa6-829b-4ffa-9cfd-56da50b6541b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:15.373496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6d8baaa6-829b-4ffa-9cfd-56da50b6541b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:15.405989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d8baaa6-829b-4ffa-9cfd-56da50b6541b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:15.407259 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d8baaa6-829b-4ffa-9cfd-56da50b6541b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:15.413976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d8baaa6-829b-4ffa-9cfd-56da50b6541b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:15.415147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d8baaa6-829b-4ffa-9cfd-56da50b6541b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:15.490193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6d8baaa6-829b-4ffa-9cfd-56da50b6541b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:58:15.622577 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.compute.api [None req-6d8baaa6-829b-4ffa-9cfd-56da50b6541b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Instance is already in deleting state, ignoring this request Aug 03 01:58:15.624570 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6d8baaa6-829b-4ffa-9cfd-56da50b6541b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce" status: 204 len: 0 microversion: 2.1 time: 0.265603 Aug 03 01:58:15.626466 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1257/2557] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:58:15 2022] DELETE /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:58:15.646515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c406c71d-3351-4cd6-bc25-58a3377150b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:15.655103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c406c71d-3351-4cd6-bc25-58a3377150b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:15.679362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c406c71d-3351-4cd6-bc25-58a3377150b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:15.694769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c406c71d-3351-4cd6-bc25-58a3377150b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:15.698690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c406c71d-3351-4cd6-bc25-58a3377150b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:15.706156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c406c71d-3351-4cd6-bc25-58a3377150b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:16.898750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a780c751-660b-40c8-83f5-fe1688a601b7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:16.914634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a780c751-660b-40c8-83f5-fe1688a601b7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:16.919635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a780c751-660b-40c8-83f5-fe1688a601b7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:16.922283 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a780c751-660b-40c8-83f5-fe1688a601b7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.789154 Aug 03 01:58:16.925019 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1301/2558] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:15 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:16.931768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c406c71d-3351-4cd6-bc25-58a3377150b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:16.936152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-af2ad7ff-ae32-43ee-9bec-696f2aabbe70 req-ee9a56f5-4105-4101-806f-c8cd12ce91b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "tag": "de5bbd3b-5e5b-4a91-bb47-0b6cfdc6c874"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:16.944084 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c406c71d-3351-4cd6-bc25-58a3377150b4 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce" status: 200 len: 1492 microversion: 2.1 time: 1.311608 Aug 03 01:58:16.945212 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1258/2559] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:15 2022] GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce => generated 1492 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:58:16.962413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7719d5e0-af06-4efa-ad31-43c063cc78a6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:16.963354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7719d5e0-af06-4efa-ad31-43c063cc78a6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:16.975116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7719d5e0-af06-4efa-ad31-43c063cc78a6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:16.975824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7719d5e0-af06-4efa-ad31-43c063cc78a6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:16.977530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-af2ad7ff-ae32-43ee-9bec-696f2aabbe70 req-ee9a56f5-4105-4101-806f-c8cd12ce91b3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:16.979754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7719d5e0-af06-4efa-ad31-43c063cc78a6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:16.980464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-af2ad7ff-ae32-43ee-9bec-696f2aabbe70 req-ee9a56f5-4105-4101-806f-c8cd12ce91b3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:16.982076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7719d5e0-af06-4efa-ad31-43c063cc78a6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:17.006089 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-af2ad7ff-ae32-43ee-9bec-696f2aabbe70 req-ee9a56f5-4105-4101-806f-c8cd12ce91b3 service nova] Creating event network-changed:de5bbd3b-5e5b-4a91-bb47-0b6cfdc6c874 for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 01:58:17.020995 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-af2ad7ff-ae32-43ee-9bec-696f2aabbe70 req-ee9a56f5-4105-4101-806f-c8cd12ce91b3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094344 Aug 03 01:58:17.022218 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1302/2560] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:17.128661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7719d5e0-af06-4efa-ad31-43c063cc78a6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:17.137776 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7719d5e0-af06-4efa-ad31-43c063cc78a6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1281 microversion: 2.1 time: 0.190804 Aug 03 01:58:17.161574 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1259/2561] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:16 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1281 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:17.953507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fbbb8cc0-bd9d-49dc-a2da-edfb72e0e49f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:17.957012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fbbb8cc0-bd9d-49dc-a2da-edfb72e0e49f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:17.978211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbbb8cc0-bd9d-49dc-a2da-edfb72e0e49f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:17.979981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbbb8cc0-bd9d-49dc-a2da-edfb72e0e49f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:17.981953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbbb8cc0-bd9d-49dc-a2da-edfb72e0e49f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:17.994336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbbb8cc0-bd9d-49dc-a2da-edfb72e0e49f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:18.213608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-d828c0b4-b306-4d7f-8807-f93729f80367 req-6c8fcc6d-1a41-42c0-88cb-4db095b89f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16268f31-3fcc-4f5f-96f6-137c129581ce", "name": "network-vif-plugged", "status": "completed", "tag": "d040aed7-adb8-4a77-960c-06e14a41dab2"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:18.230390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=83,nova_api:UPDATE=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:58:18.254887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d828c0b4-b306-4d7f-8807-f93729f80367 req-6c8fcc6d-1a41-42c0-88cb-4db095b89f30 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:18.255650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d828c0b4-b306-4d7f-8807-f93729f80367 req-6c8fcc6d-1a41-42c0-88cb-4db095b89f30 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:18.294174 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-d828c0b4-b306-4d7f-8807-f93729f80367 req-6c8fcc6d-1a41-42c0-88cb-4db095b89f30 service nova] Creating event network-vif-plugged:d040aed7-adb8-4a77-960c-06e14a41dab2 for instance 16268f31-3fcc-4f5f-96f6-137c129581ce on n-h1-826529-8 Aug 03 01:58:18.323100 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-d828c0b4-b306-4d7f-8807-f93729f80367 req-6c8fcc6d-1a41-42c0-88cb-4db095b89f30 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.619377 Aug 03 01:58:18.325332 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1303/2562] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:18.350693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b9ff23f6-1214-438b-993f-ee8d026c62e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:18.352134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b9ff23f6-1214-438b-993f-ee8d026c62e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:18.378112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9ff23f6-1214-438b-993f-ee8d026c62e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:18.382331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9ff23f6-1214-438b-993f-ee8d026c62e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:18.385736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9ff23f6-1214-438b-993f-ee8d026c62e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:18.388032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9ff23f6-1214-438b-993f-ee8d026c62e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:19.890437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fbbb8cc0-bd9d-49dc-a2da-edfb72e0e49f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:19.911302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fbbb8cc0-bd9d-49dc-a2da-edfb72e0e49f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:19.917348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fbbb8cc0-bd9d-49dc-a2da-edfb72e0e49f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:19.924330 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fbbb8cc0-bd9d-49dc-a2da-edfb72e0e49f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.974410 Aug 03 01:58:19.926031 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1260/2563] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:17 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:19.945679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-23c0fd08-5f0d-4528-b12b-a41e2b810745 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:19.947740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-23c0fd08-5f0d-4528-b12b-a41e2b810745 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:19.972882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23c0fd08-5f0d-4528-b12b-a41e2b810745 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:19.977191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23c0fd08-5f0d-4528-b12b-a41e2b810745 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:19.978760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23c0fd08-5f0d-4528-b12b-a41e2b810745 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:19.982286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23c0fd08-5f0d-4528-b12b-a41e2b810745 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:20.113749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b9ff23f6-1214-438b-993f-ee8d026c62e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e6a189229d4f8ab3aa4ca416d84594', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf2395335564acdaf819f2175dbd3bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:20.128638 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b9ff23f6-1214-438b-993f-ee8d026c62e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce" status: 200 len: 1492 microversion: 2.1 time: 1.801237 Aug 03 01:58:20.130749 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1304/2564] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:18 2022] GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce => generated 1492 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:20.261547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-23c0fd08-5f0d-4528-b12b-a41e2b810745 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:20.279262 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-23c0fd08-5f0d-4528-b12b-a41e2b810745 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1281 microversion: 2.1 time: 0.351346 Aug 03 01:58:20.294520 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1261/2565] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:19 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1281 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:20.416592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-2214b676-7c1a-4453-b095-45ec294908fc req-835255e0-bc95-4319-89fc-aed8434c3f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16268f31-3fcc-4f5f-96f6-137c129581ce", "name": "network-vif-unplugged", "status": "completed", "tag": "d040aed7-adb8-4a77-960c-06e14a41dab2"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:20.440279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2214b676-7c1a-4453-b095-45ec294908fc req-835255e0-bc95-4319-89fc-aed8434c3f2a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:20.449481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2214b676-7c1a-4453-b095-45ec294908fc req-835255e0-bc95-4319-89fc-aed8434c3f2a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:20.488693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-84c861b9-3bfa-4231-ac3e-26141463d35d req-03273cab-dcaa-4ddd-952c-6ba9aab67f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16268f31-3fcc-4f5f-96f6-137c129581ce", "name": "network-vif-deleted", "tag": "d040aed7-adb8-4a77-960c-06e14a41dab2"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:20.519448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-84c861b9-3bfa-4231-ac3e-26141463d35d req-03273cab-dcaa-4ddd-952c-6ba9aab67f14 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:20.520254 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-2214b676-7c1a-4453-b095-45ec294908fc req-835255e0-bc95-4319-89fc-aed8434c3f2a service nova] Creating event network-vif-unplugged:d040aed7-adb8-4a77-960c-06e14a41dab2 for instance 16268f31-3fcc-4f5f-96f6-137c129581ce on n-h1-826529-8 Aug 03 01:58:20.522149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-84c861b9-3bfa-4231-ac3e-26141463d35d req-03273cab-dcaa-4ddd-952c-6ba9aab67f14 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:20.537747 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-2214b676-7c1a-4453-b095-45ec294908fc req-835255e0-bc95-4319-89fc-aed8434c3f2a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125466 Aug 03 01:58:20.538361 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1262/2566] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:58:20.572667 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-84c861b9-3bfa-4231-ac3e-26141463d35d req-03273cab-dcaa-4ddd-952c-6ba9aab67f14 service nova] Creating event network-vif-deleted:d040aed7-adb8-4a77-960c-06e14a41dab2 for instance 16268f31-3fcc-4f5f-96f6-137c129581ce on n-h1-826529-8 Aug 03 01:58:20.589309 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-84c861b9-3bfa-4231-ac3e-26141463d35d req-03273cab-dcaa-4ddd-952c-6ba9aab67f14 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.456031 Aug 03 01:58:20.591772 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1305/2567] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:20.953331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-091f9112-f558-4c62-8369-751864acc889 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:20.954113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-091f9112-f558-4c62-8369-751864acc889 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:20.980854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-091f9112-f558-4c62-8369-751864acc889 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:20.981479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-091f9112-f558-4c62-8369-751864acc889 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:20.983563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-091f9112-f558-4c62-8369-751864acc889 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:20.984022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-091f9112-f558-4c62-8369-751864acc889 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:21.160565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-485ecc8b-2001-458b-b8ce-2bd8b412ba20 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:21.161299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-485ecc8b-2001-458b-b8ce-2bd8b412ba20 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 16268f31-3fcc-4f5f-96f6-137c129581ce] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:21.182269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-485ecc8b-2001-458b-b8ce-2bd8b412ba20 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:21.184858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-485ecc8b-2001-458b-b8ce-2bd8b412ba20 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:21.190494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-485ecc8b-2001-458b-b8ce-2bd8b412ba20 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:21.190887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-485ecc8b-2001-458b-b8ce-2bd8b412ba20 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:21.229437 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-485ecc8b-2001-458b-b8ce-2bd8b412ba20 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] HTTP exception thrown: Instance 16268f31-3fcc-4f5f-96f6-137c129581ce could not be found. Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-485ecc8b-2001-458b-b8ce-2bd8b412ba20 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Request method failure captured: Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce HTTP/1.1 Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dVR-uR9PJ3ItUhBzG_WhhLRpHjT_F5EmstYt1sksaXu8YQycHlQ2v0WaZKjQWy6Ho6OtrWyjCIN_qTUm3fm2Dw34k3YP9rB28KqbKYSP4TLmMLV0dJr5eU5og-0HLsfpQQ_qwRQjzTCA12Tyw8grKEsl7oBiyxzKFVu27eT_jRkQ7U Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6bf2395335564acdaf819f2175dbd3bc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}] Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 47e6a189229d4f8ab3aa4ca416d84594 Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 16268f31-3fcc-4f5f-96f6-137c129581ce could not be found. Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '16268f31-3fcc-4f5f-96f6-137c129581ce'} Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16268f31-3fcc-4f5f-96f6-137c129581ce could not be found. Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16268f31-3fcc-4f5f-96f6-137c129581ce could not be found. Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:21.235160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:21.240297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:21.240297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:21.240297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:21.240297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:21.240297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16268f31-3fcc-4f5f-96f6-137c129581ce could not be found. Aug 03 01:58:21.240297 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:21.244085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-485ecc8b-2001-458b-b8ce-2bd8b412ba20 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Returning 404 to user: Instance 16268f31-3fcc-4f5f-96f6-137c129581ce could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:21.245232 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-485ecc8b-2001-458b-b8ce-2bd8b412ba20 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce" status: 404 len: 111 microversion: 2.1 time: 0.090817 Aug 03 01:58:21.249550 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1306/2568] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:21 2022] GET /compute/v2.1/servers/16268f31-3fcc-4f5f-96f6-137c129581ce => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 01:58:21.258938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0d8cea94-500b-4a7b-87ed-ed0cf6a26c21 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b243f8a60>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:21.325825 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-0d8cea94-500b-4a7b-87ed-ed0cf6a26c21 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] HTTP exception thrown: Image not found. Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0d8cea94-500b-4a7b-87ed-ed0cf6a26c21 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Request method failure captured: Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 HTTP/1.1 Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dVR-uR9PJ3ItUhBzG_WhhLRpHjT_F5EmstYt1sksaXu8YQycHlQ2v0WaZKjQWy6Ho6OtrWyjCIN_qTUm3fm2Dw34k3YP9rB28KqbKYSP4TLmMLV0dJr5eU5og-0HLsfpQQ_qwRQjzTCA12Tyw8grKEsl7oBiyxzKFVu27eT_jRkQ7U Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6bf2395335564acdaf819f2175dbd3bc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}] Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 47e6a189229d4f8ab3aa4ca416d84594 Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: exception: Image not found. Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0'} Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 to delete Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 could not be found. Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:21.327663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0d8cea94-500b-4a7b-87ed-ed0cf6a26c21 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Returning 404 to user: Image not found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0d8cea94-500b-4a7b-87ed-ed0cf6a26c21 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0" status: 404 len: 62 microversion: 2.1 time: 0.074551 Aug 03 01:58:21.332924 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1307/2569] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:21 2022] DELETE /compute/v2.1/images/6031fc0e-942c-4d55-8ce1-3d0aef1ee1e0 => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 03 01:58:21.335354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-464a202d-e8cb-4424-886b-15e5a8d0cbd4 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:21.340175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-464a202d-e8cb-4424-886b-15e5a8d0cbd4 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:21.356422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-464a202d-e8cb-4424-886b-15e5a8d0cbd4 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:21.356710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-464a202d-e8cb-4424-886b-15e5a8d0cbd4 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:21.357506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-464a202d-e8cb-4424-886b-15e5a8d0cbd4 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:21.357951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-464a202d-e8cb-4424-886b-15e5a8d0cbd4 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:22.860798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-091f9112-f558-4c62-8369-751864acc889 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:22.897998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:58:22.901166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-091f9112-f558-4c62-8369-751864acc889 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:22.908070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-091f9112-f558-4c62-8369-751864acc889 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:22.912301 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-091f9112-f558-4c62-8369-751864acc889 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.962679 Aug 03 01:58:22.914626 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1263/2570] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:20 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:22.928690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c659ff95-c1a8-42a6-9bba-998a7f3b1e96 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:22.930378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c659ff95-c1a8-42a6-9bba-998a7f3b1e96 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:22.951886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c659ff95-c1a8-42a6-9bba-998a7f3b1e96 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:22.952354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c659ff95-c1a8-42a6-9bba-998a7f3b1e96 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:22.953151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c659ff95-c1a8-42a6-9bba-998a7f3b1e96 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:22.958712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c659ff95-c1a8-42a6-9bba-998a7f3b1e96 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:22.992851 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-c659ff95-c1a8-42a6-9bba-998a7f3b1e96 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] HTTP exception thrown: Instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e could not be found. Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c659ff95-c1a8-42a6-9bba-998a7f3b1e96 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Request method failure captured: Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e HTTP/1.1 Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dVR-uR9PJ3ItUhBzG_WhhLRpHjT_F5EmstYt1sksaXu8YQycHlQ2v0WaZKjQWy6Ho6OtrWyjCIN_qTUm3fm2Dw34k3YP9rB28KqbKYSP4TLmMLV0dJr5eU5og-0HLsfpQQ_qwRQjzTCA12Tyw8grKEsl7oBiyxzKFVu27eT_jRkQ7U Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6bf2395335564acdaf819f2175dbd3bc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}] Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 47e6a189229d4f8ab3aa4ca416d84594 Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e could not be found. Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '7f7caa5b-90d6-478e-be59-d6e0157dc11e'} Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e could not be found. Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:58:23.001605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e could not be found. Aug 03 01:58:23.006816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.006816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.006816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.006816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.006816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.006816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.006816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:23.006816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:23.006816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e could not be found. Aug 03 01:58:23.006816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.009072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c659ff95-c1a8-42a6-9bba-998a7f3b1e96 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Returning 404 to user: Instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:23.010123 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c659ff95-c1a8-42a6-9bba-998a7f3b1e96 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e" status: 404 len: 111 microversion: 2.1 time: 0.091781 Aug 03 01:58:23.010855 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1264/2571] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:58:22 2022] DELETE /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:58:23.027927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-9661c95f-26dd-44b6-8487-0b834c67f7e3 req-a45e24f6-13fe-4039-b342-5796e85a02cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "tag": "2f376776-be8e-4267-a6c7-1496121c265b"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:23.042948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9661c95f-26dd-44b6-8487-0b834c67f7e3 req-a45e24f6-13fe-4039-b342-5796e85a02cf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:23.047152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9661c95f-26dd-44b6-8487-0b834c67f7e3 req-a45e24f6-13fe-4039-b342-5796e85a02cf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:23.079176 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-9661c95f-26dd-44b6-8487-0b834c67f7e3 req-a45e24f6-13fe-4039-b342-5796e85a02cf service nova] Creating event network-changed:2f376776-be8e-4267-a6c7-1496121c265b for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 01:58:23.092558 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-9661c95f-26dd-44b6-8487-0b834c67f7e3 req-a45e24f6-13fe-4039-b342-5796e85a02cf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080293 Aug 03 01:58:23.098256 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1265/2572] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:23.112036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7877cd79-9ce8-4b6e-9d98-b9714d990239 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:23.117556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7877cd79-9ce8-4b6e-9d98-b9714d990239 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 7f7caa5b-90d6-478e-be59-d6e0157dc11e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:23.134416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7877cd79-9ce8-4b6e-9d98-b9714d990239 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:23.135248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7877cd79-9ce8-4b6e-9d98-b9714d990239 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:23.136304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7877cd79-9ce8-4b6e-9d98-b9714d990239 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:23.136947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7877cd79-9ce8-4b6e-9d98-b9714d990239 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:23.175114 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-7877cd79-9ce8-4b6e-9d98-b9714d990239 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] HTTP exception thrown: Instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e could not be found. Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7877cd79-9ce8-4b6e-9d98-b9714d990239 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Request method failure captured: Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e HTTP/1.1 Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dVR-uR9PJ3ItUhBzG_WhhLRpHjT_F5EmstYt1sksaXu8YQycHlQ2v0WaZKjQWy6Ho6OtrWyjCIN_qTUm3fm2Dw34k3YP9rB28KqbKYSP4TLmMLV0dJr5eU5og-0HLsfpQQ_qwRQjzTCA12Tyw8grKEsl7oBiyxzKFVu27eT_jRkQ7U Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6bf2395335564acdaf819f2175dbd3bc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}] Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 47e6a189229d4f8ab3aa4ca416d84594 Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e could not be found. Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '7f7caa5b-90d6-478e-be59-d6e0157dc11e'} Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e could not be found. Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e could not be found. Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.177243 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.181246 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.181246 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.181246 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:23.181246 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:23.181246 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e could not be found. Aug 03 01:58:23.181246 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.186425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7877cd79-9ce8-4b6e-9d98-b9714d990239 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Returning 404 to user: Instance 7f7caa5b-90d6-478e-be59-d6e0157dc11e could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:23.187371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-464a202d-e8cb-4424-886b-15e5a8d0cbd4 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:23.191280 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7877cd79-9ce8-4b6e-9d98-b9714d990239 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e" status: 404 len: 111 microversion: 2.1 time: 0.087830 Aug 03 01:58:23.192846 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1266/2573] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:23 2022] GET /compute/v2.1/servers/7f7caa5b-90d6-478e-be59-d6e0157dc11e => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:58:23.200960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a35917d2-3f27-4ca4-849e-3f0d840d18e0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b1286e0d0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:23.225657 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-464a202d-e8cb-4424-886b-15e5a8d0cbd4 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1323 microversion: 2.1 time: 1.893480 Aug 03 01:58:23.257327 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1308/2574] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:21 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1323 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:23.302873 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-a35917d2-3f27-4ca4-849e-3f0d840d18e0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] HTTP exception thrown: Image not found. Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a35917d2-3f27-4ca4-849e-3f0d840d18e0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Request method failure captured: Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f HTTP/1.1 Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dVR-uR9PJ3ItUhBzG_WhhLRpHjT_F5EmstYt1sksaXu8YQycHlQ2v0WaZKjQWy6Ho6OtrWyjCIN_qTUm3fm2Dw34k3YP9rB28KqbKYSP4TLmMLV0dJr5eU5og-0HLsfpQQ_qwRQjzTCA12Tyw8grKEsl7oBiyxzKFVu27eT_jRkQ7U Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6bf2395335564acdaf819f2175dbd3bc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}] Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 47e6a189229d4f8ab3aa4ca416d84594 Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: exception: Image not found. Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '912a73e0-c7b9-43bd-a876-0ab03c568f5f'} Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 912a73e0-c7b9-43bd-a876-0ab03c568f5f to delete Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 912a73e0-c7b9-43bd-a876-0ab03c568f5f could not be found. Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.304759 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a35917d2-3f27-4ca4-849e-3f0d840d18e0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Returning 404 to user: Image not found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a35917d2-3f27-4ca4-849e-3f0d840d18e0 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f" status: 404 len: 62 microversion: 2.1 time: 0.111473 Aug 03 01:58:23.312852 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1267/2575] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:23 2022] DELETE /compute/v2.1/images/912a73e0-c7b9-43bd-a876-0ab03c568f5f => generated 62 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 03 01:58:23.322933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-45764bcd-d8cc-4893-a2a8-7ec44a5164e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:23.322933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-45764bcd-d8cc-4893-a2a8-7ec44a5164e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:23.334847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45764bcd-d8cc-4893-a2a8-7ec44a5164e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:23.341412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45764bcd-d8cc-4893-a2a8-7ec44a5164e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:23.345198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45764bcd-d8cc-4893-a2a8-7ec44a5164e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:23.347596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45764bcd-d8cc-4893-a2a8-7ec44a5164e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:23.401030 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-45764bcd-d8cc-4893-a2a8-7ec44a5164e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] HTTP exception thrown: Instance f92c67e8-bc6b-44c4-b012-63b940619b6d could not be found. Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-45764bcd-d8cc-4893-a2a8-7ec44a5164e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Request method failure captured: Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d HTTP/1.1 Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dVR-uR9PJ3ItUhBzG_WhhLRpHjT_F5EmstYt1sksaXu8YQycHlQ2v0WaZKjQWy6Ho6OtrWyjCIN_qTUm3fm2Dw34k3YP9rB28KqbKYSP4TLmMLV0dJr5eU5og-0HLsfpQQ_qwRQjzTCA12Tyw8grKEsl7oBiyxzKFVu27eT_jRkQ7U Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6bf2395335564acdaf819f2175dbd3bc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}] Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 47e6a189229d4f8ab3aa4ca416d84594 Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance f92c67e8-bc6b-44c4-b012-63b940619b6d could not be found. Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'f92c67e8-bc6b-44c4-b012-63b940619b6d'} Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92c67e8-bc6b-44c4-b012-63b940619b6d could not be found. Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:58:23.402659 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92c67e8-bc6b-44c4-b012-63b940619b6d could not be found. Aug 03 01:58:23.409072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.409072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.409072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.409072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.409072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.409072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.409072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:23.409072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:23.409072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92c67e8-bc6b-44c4-b012-63b940619b6d could not be found. Aug 03 01:58:23.409072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.409072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-45764bcd-d8cc-4893-a2a8-7ec44a5164e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Returning 404 to user: Instance f92c67e8-bc6b-44c4-b012-63b940619b6d could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:23.409072 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-45764bcd-d8cc-4893-a2a8-7ec44a5164e2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 404 len: 111 microversion: 2.1 time: 0.089970 Aug 03 01:58:23.431978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d9ece58-17cb-40ec-afa2-94c28ba9e32d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:23.435757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8d9ece58-17cb-40ec-afa2-94c28ba9e32d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: f92c67e8-bc6b-44c4-b012-63b940619b6d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:23.438819 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1309/2576] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:58:23 2022] DELETE /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:58:23.453273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d9ece58-17cb-40ec-afa2-94c28ba9e32d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:23.459113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d9ece58-17cb-40ec-afa2-94c28ba9e32d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:23.460001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d9ece58-17cb-40ec-afa2-94c28ba9e32d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:23.460476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d9ece58-17cb-40ec-afa2-94c28ba9e32d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:23.541374 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-8d9ece58-17cb-40ec-afa2-94c28ba9e32d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] HTTP exception thrown: Instance f92c67e8-bc6b-44c4-b012-63b940619b6d could not be found. Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d9ece58-17cb-40ec-afa2-94c28ba9e32d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Request method failure captured: Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d HTTP/1.1 Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dVR-uR9PJ3ItUhBzG_WhhLRpHjT_F5EmstYt1sksaXu8YQycHlQ2v0WaZKjQWy6Ho6OtrWyjCIN_qTUm3fm2Dw34k3YP9rB28KqbKYSP4TLmMLV0dJr5eU5og-0HLsfpQQ_qwRQjzTCA12Tyw8grKEsl7oBiyxzKFVu27eT_jRkQ7U Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6bf2395335564acdaf819f2175dbd3bc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}] Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 47e6a189229d4f8ab3aa4ca416d84594 Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance f92c67e8-bc6b-44c4-b012-63b940619b6d could not be found. Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'f92c67e8-bc6b-44c4-b012-63b940619b6d'} Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92c67e8-bc6b-44c4-b012-63b940619b6d could not be found. Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92c67e8-bc6b-44c4-b012-63b940619b6d could not be found. Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.550466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.556938 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.556938 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.556938 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:23.556938 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:23.556938 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92c67e8-bc6b-44c4-b012-63b940619b6d could not be found. Aug 03 01:58:23.556938 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.556938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d9ece58-17cb-40ec-afa2-94c28ba9e32d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Returning 404 to user: Instance f92c67e8-bc6b-44c4-b012-63b940619b6d could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:23.556938 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8d9ece58-17cb-40ec-afa2-94c28ba9e32d tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d" status: 404 len: 111 microversion: 2.1 time: 0.128056 Aug 03 01:58:23.561697 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1268/2577] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:23 2022] GET /compute/v2.1/servers/f92c67e8-bc6b-44c4-b012-63b940619b6d => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 01:58:23.566009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a5400fbb-2731-488f-9697-23390ba4cc26 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '.version_select at 0x7f5b125b6ca0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:23.603722 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-a5400fbb-2731-488f-9697-23390ba4cc26 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] HTTP exception thrown: Image not found. Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a5400fbb-2731-488f-9697-23390ba4cc26 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Request method failure captured: Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa HTTP/1.1 Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dVR-uR9PJ3ItUhBzG_WhhLRpHjT_F5EmstYt1sksaXu8YQycHlQ2v0WaZKjQWy6Ho6OtrWyjCIN_qTUm3fm2Dw34k3YP9rB28KqbKYSP4TLmMLV0dJr5eU5og-0HLsfpQQ_qwRQjzTCA12Tyw8grKEsl7oBiyxzKFVu27eT_jRkQ7U Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6bf2395335564acdaf819f2175dbd3bc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}] Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 47e6a189229d4f8ab3aa4ca416d84594 Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: exception: Image not found. Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '4e839402-65ee-4a77-acf6-f47b9b81d7aa'} Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4e839402-65ee-4a77-acf6-f47b9b81d7aa to delete Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4e839402-65ee-4a77-acf6-f47b9b81d7aa could not be found. Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.605789 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.609421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a5400fbb-2731-488f-9697-23390ba4cc26 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Returning 404 to user: Image not found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:23.621144 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a5400fbb-2731-488f-9697-23390ba4cc26 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa" status: 404 len: 62 microversion: 2.1 time: 0.045804 Aug 03 01:58:23.621752 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1310/2578] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:23 2022] DELETE /compute/v2.1/images/4e839402-65ee-4a77-acf6-f47b9b81d7aa => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 01:58:23.632152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c16a04b6-68c6-460c-8eeb-21a44c86680b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:23.633309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c16a04b6-68c6-460c-8eeb-21a44c86680b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:23.648958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c16a04b6-68c6-460c-8eeb-21a44c86680b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:23.649422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c16a04b6-68c6-460c-8eeb-21a44c86680b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:23.650233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c16a04b6-68c6-460c-8eeb-21a44c86680b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:23.650681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c16a04b6-68c6-460c-8eeb-21a44c86680b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:23.716447 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-c16a04b6-68c6-460c-8eeb-21a44c86680b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] HTTP exception thrown: Instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 could not be found. Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c16a04b6-68c6-460c-8eeb-21a44c86680b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Request method failure captured: Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 HTTP/1.1 Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dVR-uR9PJ3ItUhBzG_WhhLRpHjT_F5EmstYt1sksaXu8YQycHlQ2v0WaZKjQWy6Ho6OtrWyjCIN_qTUm3fm2Dw34k3YP9rB28KqbKYSP4TLmMLV0dJr5eU5og-0HLsfpQQ_qwRQjzTCA12Tyw8grKEsl7oBiyxzKFVu27eT_jRkQ7U Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6bf2395335564acdaf819f2175dbd3bc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}] Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 47e6a189229d4f8ab3aa4ca416d84594 Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 could not be found. Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '2e79bb51-ff27-4ccf-b55a-b7eed7f8a784'} Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 could not be found. Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:58:23.731063 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 could not be found. Aug 03 01:58:23.734559 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.734559 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.734559 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.734559 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.734559 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.734559 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.734559 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:23.734559 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:23.734559 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 could not be found. Aug 03 01:58:23.734559 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.734559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c16a04b6-68c6-460c-8eeb-21a44c86680b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Returning 404 to user: Instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:23.734559 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c16a04b6-68c6-460c-8eeb-21a44c86680b tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784" status: 404 len: 111 microversion: 2.1 time: 0.106559 Aug 03 01:58:23.737256 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1269/2579] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:58:23 2022] DELETE /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 01:58:23.739012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:58:23.743893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-29ed345c-6361-4749-9f89-a3b885042ed2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:23.745942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-29ed345c-6361-4749-9f89-a3b885042ed2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] [instance: 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:23.767181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-29ed345c-6361-4749-9f89-a3b885042ed2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:23.768597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-29ed345c-6361-4749-9f89-a3b885042ed2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:23.769607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-29ed345c-6361-4749-9f89-a3b885042ed2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:23.770198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-29ed345c-6361-4749-9f89-a3b885042ed2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:23.801632 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-29ed345c-6361-4749-9f89-a3b885042ed2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] HTTP exception thrown: Instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 could not be found. Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-29ed345c-6361-4749-9f89-a3b885042ed2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Request method failure captured: Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 HTTP/1.1 Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dVR-uR9PJ3ItUhBzG_WhhLRpHjT_F5EmstYt1sksaXu8YQycHlQ2v0WaZKjQWy6Ho6OtrWyjCIN_qTUm3fm2Dw34k3YP9rB28KqbKYSP4TLmMLV0dJr5eU5og-0HLsfpQQ_qwRQjzTCA12Tyw8grKEsl7oBiyxzKFVu27eT_jRkQ7U Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6bf2395335564acdaf819f2175dbd3bc", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6bf2395335564acdaf819f2175dbd3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6bf2395335564acdaf819f2175dbd3bc"}]}] Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 6bf2395335564acdaf819f2175dbd3bc Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesTestJSON-1078767581 Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 47e6a189229d4f8ab3aa4ca416d84594 Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesTestJSON-1078767581-project Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 could not be found. Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '2e79bb51-ff27-4ccf-b55a-b7eed7f8a784'} Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 could not be found. Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 could not be found. Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.803253 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:23.808051 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:23.808051 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:23.808051 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:23.808051 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:23.808051 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 could not be found. Aug 03 01:58:23.808051 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:23.808051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-29ed345c-6361-4749-9f89-a3b885042ed2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] Returning 404 to user: Instance 2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:23.808051 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-29ed345c-6361-4749-9f89-a3b885042ed2 tempest-ImagesTestJSON-1078767581 tempest-ImagesTestJSON-1078767581-project] 10.222.0.67 "GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784" status: 404 len: 111 microversion: 2.1 time: 0.066452 Aug 03 01:58:23.831174 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1311/2580] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:23 2022] GET /compute/v2.1/servers/2e79bb51-ff27-4ccf-b55a-b7eed7f8a784 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:58:23.943864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-66633f33-bdea-4ec3-be41-b62a854d6d07 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:23.944781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-66633f33-bdea-4ec3-be41-b62a854d6d07 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:23.979108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66633f33-bdea-4ec3-be41-b62a854d6d07 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:23.979868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66633f33-bdea-4ec3-be41-b62a854d6d07 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:23.984032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66633f33-bdea-4ec3-be41-b62a854d6d07 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:23.984724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66633f33-bdea-4ec3-be41-b62a854d6d07 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:24.271708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fff177d5-df27-4d2e-89de-44143fb7cdf6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:24.272936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fff177d5-df27-4d2e-89de-44143fb7cdf6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:24.293552 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fff177d5-df27-4d2e-89de-44143fb7cdf6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:24.294314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fff177d5-df27-4d2e-89de-44143fb7cdf6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:24.295321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fff177d5-df27-4d2e-89de-44143fb7cdf6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:24.295965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fff177d5-df27-4d2e-89de-44143fb7cdf6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:25.167175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fff177d5-df27-4d2e-89de-44143fb7cdf6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:25.182769 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fff177d5-df27-4d2e-89de-44143fb7cdf6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1323 microversion: 2.1 time: 0.915415 Aug 03 01:58:25.199314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:58:25.218976 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1312/2581] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:24 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1323 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:25.875312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-66633f33-bdea-4ec3-be41-b62a854d6d07 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:25.889421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-66633f33-bdea-4ec3-be41-b62a854d6d07 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:25.897090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-66633f33-bdea-4ec3-be41-b62a854d6d07 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:25.898317 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-66633f33-bdea-4ec3-be41-b62a854d6d07 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.960923 Aug 03 01:58:25.903209 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1270/2582] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:23 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:26.063260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9843746b-b351-4e11-9744-cb5e006852dc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:26.065045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9843746b-b351-4e11-9744-cb5e006852dc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:26.081875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9843746b-b351-4e11-9744-cb5e006852dc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:26.082591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9843746b-b351-4e11-9744-cb5e006852dc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:26.083590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9843746b-b351-4e11-9744-cb5e006852dc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:26.084185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9843746b-b351-4e11-9744-cb5e006852dc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:26.152841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9843746b-b351-4e11-9744-cb5e006852dc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:58:26.224019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-74dd1a65-03bc-47b4-add5-922561c6c067 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:26.225435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-74dd1a65-03bc-47b4-add5-922561c6c067 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:26.239453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74dd1a65-03bc-47b4-add5-922561c6c067 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:26.240319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74dd1a65-03bc-47b4-add5-922561c6c067 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:26.248100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74dd1a65-03bc-47b4-add5-922561c6c067 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:26.248921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74dd1a65-03bc-47b4-add5-922561c6c067 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:26.252462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:58:26.335936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:58:26.452389 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9843746b-b351-4e11-9744-cb5e006852dc tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "DELETE /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 204 len: 0 microversion: 2.1 time: 0.392550 Aug 03 01:58:26.453824 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1313/2583] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:58:26 2022] DELETE /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:58:26.463435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d16bc699-d070-4ff7-babf-16da162ffa84 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:26.464204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d16bc699-d070-4ff7-babf-16da162ffa84 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:26.477665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d16bc699-d070-4ff7-babf-16da162ffa84 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:26.478498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d16bc699-d070-4ff7-babf-16da162ffa84 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:26.480315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d16bc699-d070-4ff7-babf-16da162ffa84 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:26.482566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d16bc699-d070-4ff7-babf-16da162ffa84 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:27.832824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-74dd1a65-03bc-47b4-add5-922561c6c067 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:27.847415 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-74dd1a65-03bc-47b4-add5-922561c6c067 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1323 microversion: 2.1 time: 1.622766 Aug 03 01:58:27.850136 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1271/2584] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:26 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1323 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:58:27.867733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3a88054c-d5c9-440f-a557-fbae34e723f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:27.869608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3a88054c-d5c9-440f-a557-fbae34e723f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:27.880355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a88054c-d5c9-440f-a557-fbae34e723f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:27.881149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a88054c-d5c9-440f-a557-fbae34e723f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:27.882149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a88054c-d5c9-440f-a557-fbae34e723f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:27.882761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a88054c-d5c9-440f-a557-fbae34e723f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:28.567925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d16bc699-d070-4ff7-babf-16da162ffa84 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:28.583528 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d16bc699-d070-4ff7-babf-16da162ffa84 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1507 microversion: 2.1 time: 2.118957 Aug 03 01:58:28.585633 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1314/2585] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:26 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1507 bytes in 2128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:58:29.136869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9d5af30b-dd3e-461f-9dca-d74ef33587df tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Action: 'create', calling method: .version_select at 0x7f5b243f8700>, body: {"keypair": {"name": "tempest-keypair-1378201405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1+dwI0ASX0EEYXJ4TWWN02XEzyhS0EcdO+eKfxYTdgkJc/cS7hVXswGydvoImZ+C+ddahdQUBha5uFGXBUw/pkKcoT5qHluYacY3+VxqEWYJ7Mymes/ia4oCrpuvG6xA=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:29.252592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-9d5af30b-dd3e-461f-9dca-d74ef33587df tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Getting quotas for project 0f5bb83130fc4c2fa081000f12dec8ae. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:58:29.265029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-9d5af30b-dd3e-461f-9dca-d74ef33587df tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Getting quotas for user a165ac862c6349cd927c829bb9136417 and project 0f5bb83130fc4c2fa081000f12dec8ae. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:58:29.312632 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9d5af30b-dd3e-461f-9dca-d74ef33587df tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.725544 Aug 03 01:58:29.313658 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1315/2586] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 01:58:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:29.321973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-b5fd9473-9afa-4bc5-a7a6-09dde938f376 req-712dca50-8432-40de-ba6d-171afebb6ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "tag": "65cef764-1eae-46de-942f-7f9098703fc5"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:29.353231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b5fd9473-9afa-4bc5-a7a6-09dde938f376 req-712dca50-8432-40de-ba6d-171afebb6ade service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:29.353681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b5fd9473-9afa-4bc5-a7a6-09dde938f376 req-712dca50-8432-40de-ba6d-171afebb6ade service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:29.377907 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-b5fd9473-9afa-4bc5-a7a6-09dde938f376 req-712dca50-8432-40de-ba6d-171afebb6ade service nova] Creating event network-changed:65cef764-1eae-46de-942f-7f9098703fc5 for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 01:58:29.387375 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-b5fd9473-9afa-4bc5-a7a6-09dde938f376 req-712dca50-8432-40de-ba6d-171afebb6ade service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071464 Aug 03 01:58:29.407742 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1316/2587] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:29.423005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fac82331-609f-4c2f-8d59-a8361043f17a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:29.425257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fac82331-609f-4c2f-8d59-a8361043f17a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:29.432764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fac82331-609f-4c2f-8d59-a8361043f17a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:29.433531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fac82331-609f-4c2f-8d59-a8361043f17a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:29.435250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fac82331-609f-4c2f-8d59-a8361043f17a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:29.435885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fac82331-609f-4c2f-8d59-a8361043f17a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:29.808900 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3a88054c-d5c9-440f-a557-fbae34e723f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:29.829125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3a88054c-d5c9-440f-a557-fbae34e723f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:29.832277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3a88054c-d5c9-440f-a557-fbae34e723f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:29.835700 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3a88054c-d5c9-440f-a557-fbae34e723f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.983865 Aug 03 01:58:29.837181 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1272/2588] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:27 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:29.844456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bd8de030-0a46-4684-afec-c3997c592b6b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:29.845249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bd8de030-0a46-4684-afec-c3997c592b6b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:29.853624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd8de030-0a46-4684-afec-c3997c592b6b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:29.854306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd8de030-0a46-4684-afec-c3997c592b6b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:29.855187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd8de030-0a46-4684-afec-c3997c592b6b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:29.856197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd8de030-0a46-4684-afec-c3997c592b6b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:30.208542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fac82331-609f-4c2f-8d59-a8361043f17a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:30.217398 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fac82331-609f-4c2f-8d59-a8361043f17a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1323 microversion: 2.1 time: 0.807655 Aug 03 01:58:30.218619 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1317/2589] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:29 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1323 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:30.862605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0bfc3f33-05c6-47c8-a134-ee758b309aa8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:30.863403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0bfc3f33-05c6-47c8-a134-ee758b309aa8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:30.874741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0bfc3f33-05c6-47c8-a134-ee758b309aa8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:30.875548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0bfc3f33-05c6-47c8-a134-ee758b309aa8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:30.877545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0bfc3f33-05c6-47c8-a134-ee758b309aa8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:30.878528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0bfc3f33-05c6-47c8-a134-ee758b309aa8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:31.150336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bd8de030-0a46-4684-afec-c3997c592b6b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:31.161457 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bd8de030-0a46-4684-afec-c3997c592b6b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1507 microversion: 2.1 time: 1.322540 Aug 03 01:58:31.162745 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1273/2590] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:29 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1507 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:31.239493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-92c62d64-c835-4f87-9e37-d91bb7efef70 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:31.240118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-92c62d64-c835-4f87-9e37-d91bb7efef70 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:31.255695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92c62d64-c835-4f87-9e37-d91bb7efef70 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:31.256153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92c62d64-c835-4f87-9e37-d91bb7efef70 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:31.256955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92c62d64-c835-4f87-9e37-d91bb7efef70 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:31.257398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92c62d64-c835-4f87-9e37-d91bb7efef70 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:32.638822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0bfc3f33-05c6-47c8-a134-ee758b309aa8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:32.681861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0bfc3f33-05c6-47c8-a134-ee758b309aa8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:32.690398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0bfc3f33-05c6-47c8-a134-ee758b309aa8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:32.695899 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0bfc3f33-05c6-47c8-a134-ee758b309aa8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.837560 Aug 03 01:58:32.710226 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1318/2591] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:30 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:32.732439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-92c62d64-c835-4f87-9e37-d91bb7efef70 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:32.737916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-39725805-67f2-4ffa-8770-0191e404e8de req-ec2426e9-803c-4b5e-a5f7-9e7a5ff12f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a2c151-70c4-4162-aa5c-19aeda031057", "tag": "269edc87-62e3-4292-986d-bb28c98829a7"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:32.749597 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-92c62d64-c835-4f87-9e37-d91bb7efef70 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1323 microversion: 2.1 time: 1.514317 Aug 03 01:58:32.750569 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1274/2592] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:31 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1323 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:58:32.766346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-39725805-67f2-4ffa-8770-0191e404e8de req-ec2426e9-803c-4b5e-a5f7-9e7a5ff12f0d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:32.766536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7d18e4ee-ea98-4880-a7af-884b1b638f86 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:32.770484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7d18e4ee-ea98-4880-a7af-884b1b638f86 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:32.773893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-39725805-67f2-4ffa-8770-0191e404e8de req-ec2426e9-803c-4b5e-a5f7-9e7a5ff12f0d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:32.779013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d18e4ee-ea98-4880-a7af-884b1b638f86 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:32.781103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d18e4ee-ea98-4880-a7af-884b1b638f86 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:32.782161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d18e4ee-ea98-4880-a7af-884b1b638f86 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:32.786365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d18e4ee-ea98-4880-a7af-884b1b638f86 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:32.810514 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-39725805-67f2-4ffa-8770-0191e404e8de req-ec2426e9-803c-4b5e-a5f7-9e7a5ff12f0d service nova] Creating event network-changed:269edc87-62e3-4292-986d-bb28c98829a7 for instance 86a2c151-70c4-4162-aa5c-19aeda031057 on n-h2-826529-8 Aug 03 01:58:32.822577 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-39725805-67f2-4ffa-8770-0191e404e8de req-ec2426e9-803c-4b5e-a5f7-9e7a5ff12f0d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105834 Aug 03 01:58:32.823431 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1319/2593] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:33.014165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7d18e4ee-ea98-4880-a7af-884b1b638f86 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:33.027123 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7d18e4ee-ea98-4880-a7af-884b1b638f86 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 200 len: 1465 microversion: 2.1 time: 0.275146 Aug 03 01:58:33.027623 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1275/2594] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:32 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 1465 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:33.727282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a9913557-54f3-4a71-af9a-6409bd705912 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:33.728775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a9913557-54f3-4a71-af9a-6409bd705912 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:33.737908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9913557-54f3-4a71-af9a-6409bd705912 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:33.738592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9913557-54f3-4a71-af9a-6409bd705912 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:33.739656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9913557-54f3-4a71-af9a-6409bd705912 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:33.740167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9913557-54f3-4a71-af9a-6409bd705912 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:33.775623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-630e2de6-20f1-44c3-87e6-6b5255b13695 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:33.776407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-630e2de6-20f1-44c3-87e6-6b5255b13695 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:33.786661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-630e2de6-20f1-44c3-87e6-6b5255b13695 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:33.793428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-630e2de6-20f1-44c3-87e6-6b5255b13695 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:33.794358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-630e2de6-20f1-44c3-87e6-6b5255b13695 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:33.794987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-630e2de6-20f1-44c3-87e6-6b5255b13695 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:34.463761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a9913557-54f3-4a71-af9a-6409bd705912 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:34.465446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-630e2de6-20f1-44c3-87e6-6b5255b13695 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:34.527886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a9913557-54f3-4a71-af9a-6409bd705912 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:34.530283 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-630e2de6-20f1-44c3-87e6-6b5255b13695 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1323 microversion: 2.1 time: 0.758129 Aug 03 01:58:34.536250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a9913557-54f3-4a71-af9a-6409bd705912 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:34.551168 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1276/2595] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:33 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1323 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:34.558975 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a9913557-54f3-4a71-af9a-6409bd705912 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 0.837716 Aug 03 01:58:34.559394 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1320/2596] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:33 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:34.572700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3f8bf940-cc41-4d22-9bd8-294b9e14bbff tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:34.573401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3f8bf940-cc41-4d22-9bd8-294b9e14bbff tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: 56094624-65e4-48bb-8337-280213fb3238] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:34.585398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-2038164279", "imageRef": "d29e19e6-f2ff-4409-9ab7-0fb9b2583d1b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8dd0322e-05e4-4565-ade3-9af54418b33b"}], "security_groups": [{"name": "tempest-securitygroup--1493177861"}], "key_name": "tempest-keypair-1378201405", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:34.610177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f8bf940-cc41-4d22-9bd8-294b9e14bbff tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:34.610962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f8bf940-cc41-4d22-9bd8-294b9e14bbff tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:34.616828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f8bf940-cc41-4d22-9bd8-294b9e14bbff tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:34.618261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f8bf940-cc41-4d22-9bd8-294b9e14bbff tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:34.664456 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-3f8bf940-cc41-4d22-9bd8-294b9e14bbff tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] HTTP exception thrown: Instance 56094624-65e4-48bb-8337-280213fb3238 could not be found. Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3f8bf940-cc41-4d22-9bd8-294b9e14bbff tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Request method failure captured: Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 HTTP/1.1 Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTll7VklSXVKPY7IA1_5ob-tKVm2Z_7z42qGXzDSvTdwVAzc-uu26I_RdtLVhoAwHCuPbYMUDNABwS67wYISa8yagl02RQzcDUh0SQ8u7p5lboe4i0RQPeTExpnFXWWBwbJADXBFZ5wGYauWv3NNIL4oxW8HVYZDtaGv8yUqCCibqo Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c183e2fc6dbb419fbd8fa81c90163adf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}] Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 0b99d344c16b4221bcccfe37d32bb69e Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 56094624-65e4-48bb-8337-280213fb3238 could not be found. Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '56094624-65e4-48bb-8337-280213fb3238'} Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56094624-65e4-48bb-8337-280213fb3238 could not be found. Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56094624-65e4-48bb-8337-280213fb3238 could not be found. Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:34.667667 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:34.672204 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:34.672204 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:34.672204 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:34.672204 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:34.672204 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:34.672204 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:34.672204 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56094624-65e4-48bb-8337-280213fb3238 could not be found. Aug 03 01:58:34.672204 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:34.696804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3f8bf940-cc41-4d22-9bd8-294b9e14bbff tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Returning 404 to user: Instance 56094624-65e4-48bb-8337-280213fb3238 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:34.702106 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3f8bf940-cc41-4d22-9bd8-294b9e14bbff tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238" status: 404 len: 111 microversion: 2.1 time: 0.146432 Aug 03 01:58:34.704999 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1277/2597] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:34 2022] GET /compute/v2.1/servers/56094624-65e4-48bb-8337-280213fb3238 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:58:34.721342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eb9e0a75-c40e-42d0-ac37-8538eedbb79a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:34.732913 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eb9e0a75-c40e-42d0-ac37-8538eedbb79a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:34.764013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb9e0a75-c40e-42d0-ac37-8538eedbb79a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:34.769657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb9e0a75-c40e-42d0-ac37-8538eedbb79a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:34.771346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb9e0a75-c40e-42d0-ac37-8538eedbb79a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:34.774163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb9e0a75-c40e-42d0-ac37-8538eedbb79a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:34.857931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eb9e0a75-c40e-42d0-ac37-8538eedbb79a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:58:35.072385 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eb9e0a75-c40e-42d0-ac37-8538eedbb79a tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 204 len: 0 microversion: 2.1 time: 0.359089 Aug 03 01:58:35.074968 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1278/2598] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:58:34 2022] DELETE /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:58:35.098319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-3c9768cf-4e10-4ed2-a6d9-7a151e3a59c2 req-5becd1ec-27aa-495f-91af-d44f7a1919cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56094624-65e4-48bb-8337-280213fb3238", "name": "network-vif-deleted", "tag": "5b6b43c2-2954-468c-ab30-27bff1ffac6c"}, {"name": "network-changed", "server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "tag": "c455abfe-c5d9-4600-90ed-3417c36c463c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:35.131834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3c9768cf-4e10-4ed2-a6d9-7a151e3a59c2 req-5becd1ec-27aa-495f-91af-d44f7a1919cb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:35.132820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3c9768cf-4e10-4ed2-a6d9-7a151e3a59c2 req-5becd1ec-27aa-495f-91af-d44f7a1919cb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:35.163746 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-3c9768cf-4e10-4ed2-a6d9-7a151e3a59c2 req-5becd1ec-27aa-495f-91af-d44f7a1919cb service nova] Creating event network-vif-deleted:5b6b43c2-2954-468c-ab30-27bff1ffac6c for instance 56094624-65e4-48bb-8337-280213fb3238 on n-h2-826529-8 Aug 03 01:58:35.164787 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-3c9768cf-4e10-4ed2-a6d9-7a151e3a59c2 req-5becd1ec-27aa-495f-91af-d44f7a1919cb service nova] Creating event network-changed:c455abfe-c5d9-4600-90ed-3417c36c463c for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 01:58:35.188252 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-3c9768cf-4e10-4ed2-a6d9-7a151e3a59c2 req-5becd1ec-27aa-495f-91af-d44f7a1919cb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.110701 Aug 03 01:58:35.192894 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1279/2599] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:35.203264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f3ef4ea4-e08b-4071-a773-3d62265af07f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:35.206630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f3ef4ea4-e08b-4071-a773-3d62265af07f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:35.227686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3ef4ea4-e08b-4071-a773-3d62265af07f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:35.228531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3ef4ea4-e08b-4071-a773-3d62265af07f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:35.235213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3ef4ea4-e08b-4071-a773-3d62265af07f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:35.237029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3ef4ea4-e08b-4071-a773-3d62265af07f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:35.324089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] validate_networks() for [('8dd0322e-05e4-4565-ade3-9af54418b33b', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:58:36.090760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f3ef4ea4-e08b-4071-a773-3d62265af07f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:36.099575 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f3ef4ea4-e08b-4071-a773-3d62265af07f tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1520 microversion: 2.1 time: 0.905167 Aug 03 01:58:36.100620 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1280/2600] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:35 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1520 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:36.105438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3ca32ccb-289d-408c-82b0-293682b79523 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:36.106275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3ca32ccb-289d-408c-82b0-293682b79523 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:36.113381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ca32ccb-289d-408c-82b0-293682b79523 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:36.114091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ca32ccb-289d-408c-82b0-293682b79523 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:36.115113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ca32ccb-289d-408c-82b0-293682b79523 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:36.115749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ca32ccb-289d-408c-82b0-293682b79523 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:36.488683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3ca32ccb-289d-408c-82b0-293682b79523 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:36.500286 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3ca32ccb-289d-408c-82b0-293682b79523 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1323 microversion: 2.1 time: 0.398350 Aug 03 01:58:36.526149 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1281/2601] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:36 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1323 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:36.545081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6eee5a31-c528-4167-969e-f5b240f5dccb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:36.545724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6eee5a31-c528-4167-969e-f5b240f5dccb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:36.554111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6eee5a31-c528-4167-969e-f5b240f5dccb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:36.555223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6eee5a31-c528-4167-969e-f5b240f5dccb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:36.557035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6eee5a31-c528-4167-969e-f5b240f5dccb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:36.558518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6eee5a31-c528-4167-969e-f5b240f5dccb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:37.287064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:58:37.287624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:58:37.287957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:58:37.288922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:58:37.289358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:58:37.312733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:37.313189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:37.314125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:37.314658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:37.365669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Getting quotas for project 0f5bb83130fc4c2fa081000f12dec8ae. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:58:37.377229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Getting quotas for user a165ac862c6349cd927c829bb9136417 and project 0f5bb83130fc4c2fa081000f12dec8ae. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:58:37.406061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6eee5a31-c528-4167-969e-f5b240f5dccb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:37.417954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:58:37.426796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d29e19e6-f2ff-4409-9ab7-0fb9b2583d1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:58:37.427573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6eee5a31-c528-4167-969e-f5b240f5dccb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:37.429663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6eee5a31-c528-4167-969e-f5b240f5dccb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:37.432248 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6eee5a31-c528-4167-969e-f5b240f5dccb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 0.904223 Aug 03 01:58:37.433139 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1282/2602] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:36 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:37.537659 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eb45521d-e88c-4c56-9f2c-f7ce740be241 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.974550 Aug 03 01:58:37.540511 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1321/2603] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:58:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 2978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:58:37.552837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7c90a7da-1a02-4572-b2e0-b57d52cb3d97 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:37.554211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7c90a7da-1a02-4572-b2e0-b57d52cb3d97 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:37.569077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c90a7da-1a02-4572-b2e0-b57d52cb3d97 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:37.569799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c90a7da-1a02-4572-b2e0-b57d52cb3d97 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:37.573322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c90a7da-1a02-4572-b2e0-b57d52cb3d97 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:37.574203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c90a7da-1a02-4572-b2e0-b57d52cb3d97 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:37.870420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-20a36b8f-d246-411b-b59a-08d9cce42537 tempest-PortsAdminExtendedAttrsTestJSON-1325455486 tempest-PortsAdminExtendedAttrsTestJSON-1325455486-project-admin] Calling method '.version_select at 0x7f5b1286e310>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:37.872149 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:58:37.872149 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:58:37.873888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20a36b8f-d246-411b-b59a-08d9cce42537 tempest-PortsAdminExtendedAttrsTestJSON-1325455486 tempest-PortsAdminExtendedAttrsTestJSON-1325455486-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:37.874547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20a36b8f-d246-411b-b59a-08d9cce42537 tempest-PortsAdminExtendedAttrsTestJSON-1325455486 tempest-PortsAdminExtendedAttrsTestJSON-1325455486-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:37.929503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20a36b8f-d246-411b-b59a-08d9cce42537 tempest-PortsAdminExtendedAttrsTestJSON-1325455486 tempest-PortsAdminExtendedAttrsTestJSON-1325455486-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:37.930069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20a36b8f-d246-411b-b59a-08d9cce42537 tempest-PortsAdminExtendedAttrsTestJSON-1325455486 tempest-PortsAdminExtendedAttrsTestJSON-1325455486-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:37.958252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20a36b8f-d246-411b-b59a-08d9cce42537 tempest-PortsAdminExtendedAttrsTestJSON-1325455486 tempest-PortsAdminExtendedAttrsTestJSON-1325455486-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:37.958625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20a36b8f-d246-411b-b59a-08d9cce42537 tempest-PortsAdminExtendedAttrsTestJSON-1325455486 tempest-PortsAdminExtendedAttrsTestJSON-1325455486-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:37.973181 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-20a36b8f-d246-411b-b59a-08d9cce42537 tempest-PortsAdminExtendedAttrsTestJSON-1325455486 tempest-PortsAdminExtendedAttrsTestJSON-1325455486-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.538721 Aug 03 01:58:37.974136 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1283/2604] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 01:58:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:37.996654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-49b524f1-0fa1-4254-b139-f796d37d82af tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:37.999606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-49b524f1-0fa1-4254-b139-f796d37d82af tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:38.015320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49b524f1-0fa1-4254-b139-f796d37d82af tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:38.015766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49b524f1-0fa1-4254-b139-f796d37d82af tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:38.017614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49b524f1-0fa1-4254-b139-f796d37d82af tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:38.018398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49b524f1-0fa1-4254-b139-f796d37d82af tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:38.307183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7c90a7da-1a02-4572-b2e0-b57d52cb3d97 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:38.326490 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7c90a7da-1a02-4572-b2e0-b57d52cb3d97 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1520 microversion: 2.1 time: 0.784846 Aug 03 01:58:38.328473 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1322/2605] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:37 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1520 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:38.352570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dcef3828-eefb-4898-b3ff-fb05e760e10a tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:38.353227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dcef3828-eefb-4898-b3ff-fb05e760e10a tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:38.528195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dcef3828-eefb-4898-b3ff-fb05e760e10a tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:38.540931 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dcef3828-eefb-4898-b3ff-fb05e760e10a tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1246 microversion: 2.1 time: 0.210042 Aug 03 01:58:38.543752 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1323/2606] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:38 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1246 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:38.554945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-94a9534e-cec1-448a-9c3b-2fcf937421cc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:38.555480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-94a9534e-cec1-448a-9c3b-2fcf937421cc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:38.576280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94a9534e-cec1-448a-9c3b-2fcf937421cc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:38.579066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94a9534e-cec1-448a-9c3b-2fcf937421cc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:38.583389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94a9534e-cec1-448a-9c3b-2fcf937421cc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:38.584501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94a9534e-cec1-448a-9c3b-2fcf937421cc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:38.656686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-49b524f1-0fa1-4254-b139-f796d37d82af tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:38.679226 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-49b524f1-0fa1-4254-b139-f796d37d82af tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1323 microversion: 2.1 time: 0.702059 Aug 03 01:58:38.679914 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1284/2607] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:37 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1323 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:39.351248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b4429de2-4740-46bf-8fe5-a065a47be192 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:39.352267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b4429de2-4740-46bf-8fe5-a065a47be192 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:39.371038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4429de2-4740-46bf-8fe5-a065a47be192 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:39.371776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4429de2-4740-46bf-8fe5-a065a47be192 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:39.372761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4429de2-4740-46bf-8fe5-a065a47be192 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:39.373373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4429de2-4740-46bf-8fe5-a065a47be192 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:39.676946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-94a9534e-cec1-448a-9c3b-2fcf937421cc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:39.709087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-94a9534e-cec1-448a-9c3b-2fcf937421cc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:39.714254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-94a9534e-cec1-448a-9c3b-2fcf937421cc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:39.719057 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-94a9534e-cec1-448a-9c3b-2fcf937421cc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.172791 Aug 03 01:58:39.720214 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1324/2608] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:38 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:39.753741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-266d30a8-b984-4a5c-85fe-f2ccab40b779 req-1e993889-69e2-4cea-9220-0f040e21e866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a2c151-70c4-4162-aa5c-19aeda031057", "name": "network-vif-plugged", "status": "completed", "tag": "269edc87-62e3-4292-986d-bb28c98829a7"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:39.780597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-266d30a8-b984-4a5c-85fe-f2ccab40b779 req-1e993889-69e2-4cea-9220-0f040e21e866 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:39.781268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-266d30a8-b984-4a5c-85fe-f2ccab40b779 req-1e993889-69e2-4cea-9220-0f040e21e866 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:39.813636 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-266d30a8-b984-4a5c-85fe-f2ccab40b779 req-1e993889-69e2-4cea-9220-0f040e21e866 service nova] Creating event network-vif-plugged:269edc87-62e3-4292-986d-bb28c98829a7 for instance 86a2c151-70c4-4162-aa5c-19aeda031057 on n-h2-826529-8 Aug 03 01:58:39.836712 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-266d30a8-b984-4a5c-85fe-f2ccab40b779 req-1e993889-69e2-4cea-9220-0f040e21e866 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106207 Aug 03 01:58:39.837650 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1325/2609] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:39.842730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c3ea307c-fc90-4dd7-a1a9-bcb3653ad70d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:39.843454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c3ea307c-fc90-4dd7-a1a9-bcb3653ad70d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:39.855613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3ea307c-fc90-4dd7-a1a9-bcb3653ad70d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:39.860032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3ea307c-fc90-4dd7-a1a9-bcb3653ad70d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:39.861791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3ea307c-fc90-4dd7-a1a9-bcb3653ad70d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:39.864595 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3ea307c-fc90-4dd7-a1a9-bcb3653ad70d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:40.398399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c3ea307c-fc90-4dd7-a1a9-bcb3653ad70d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:40.407335 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c3ea307c-fc90-4dd7-a1a9-bcb3653ad70d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1304 microversion: 2.1 time: 0.568420 Aug 03 01:58:40.408981 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1326/2610] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:39 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1304 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:40.431393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0f71c489-43a7-40a3-94c6-5b9aef7e0bc6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:40.432357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0f71c489-43a7-40a3-94c6-5b9aef7e0bc6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:40.450647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0f71c489-43a7-40a3-94c6-5b9aef7e0bc6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:40.451138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0f71c489-43a7-40a3-94c6-5b9aef7e0bc6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:40.452170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0f71c489-43a7-40a3-94c6-5b9aef7e0bc6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:40.452634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0f71c489-43a7-40a3-94c6-5b9aef7e0bc6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:41.210311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b4429de2-4740-46bf-8fe5-a065a47be192 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b99d344c16b4221bcccfe37d32bb69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c183e2fc6dbb419fbd8fa81c90163adf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:41.278531 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b4429de2-4740-46bf-8fe5-a065a47be192 tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 200 len: 1520 microversion: 2.1 time: 1.930998 Aug 03 01:58:41.280730 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1285/2611] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:39 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 1520 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:58:41.299492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4c2021ee-b89b-4f7f-b8ee-a14b8fd0a54c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:41.303834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4c2021ee-b89b-4f7f-b8ee-a14b8fd0a54c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:41.326697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:58:41.331804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c2021ee-b89b-4f7f-b8ee-a14b8fd0a54c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:41.333422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c2021ee-b89b-4f7f-b8ee-a14b8fd0a54c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:41.343611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c2021ee-b89b-4f7f-b8ee-a14b8fd0a54c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:41.346009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c2021ee-b89b-4f7f-b8ee-a14b8fd0a54c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:42.103934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0f71c489-43a7-40a3-94c6-5b9aef7e0bc6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:42.114136 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0f71c489-43a7-40a3-94c6-5b9aef7e0bc6 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1323 microversion: 2.1 time: 1.703935 Aug 03 01:58:42.115322 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1327/2612] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:40 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1323 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:42.124549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-18541291-2c9a-4119-b8bd-8fb4caa8f3eb tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:42.125577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-18541291-2c9a-4119-b8bd-8fb4caa8f3eb tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:42.138446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18541291-2c9a-4119-b8bd-8fb4caa8f3eb tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:42.139277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18541291-2c9a-4119-b8bd-8fb4caa8f3eb tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:42.140520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18541291-2c9a-4119-b8bd-8fb4caa8f3eb tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:42.141173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18541291-2c9a-4119-b8bd-8fb4caa8f3eb tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:42.390637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-18541291-2c9a-4119-b8bd-8fb4caa8f3eb tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:42.415874 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-18541291-2c9a-4119-b8bd-8fb4caa8f3eb tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1304 microversion: 2.1 time: 0.292427 Aug 03 01:58:42.416513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4c2021ee-b89b-4f7f-b8ee-a14b8fd0a54c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:42.417147 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1328/2613] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:42 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1304 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:42.433392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-8c2c6270-7a0c-4f44-8fac-6fecfde0f469 req-b95678cb-f888-46c4-9f30-73134fba68aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8397a8e-08c7-4844-90eb-80949ac27e92", "name": "network-vif-deleted", "tag": "163a242a-344a-4765-b50c-fff46a880c74"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:42.451826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4c2021ee-b89b-4f7f-b8ee-a14b8fd0a54c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:42.456731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4c2021ee-b89b-4f7f-b8ee-a14b8fd0a54c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:42.459587 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4c2021ee-b89b-4f7f-b8ee-a14b8fd0a54c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.176385 Aug 03 01:58:42.477060 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1286/2614] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:41 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:42.489654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b3d8828c-f6b7-4ccf-b24e-5c94cd11b15b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:42.489879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8c2c6270-7a0c-4f44-8fac-6fecfde0f469 req-b95678cb-f888-46c4-9f30-73134fba68aa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:42.489879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8c2c6270-7a0c-4f44-8fac-6fecfde0f469 req-b95678cb-f888-46c4-9f30-73134fba68aa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:42.491362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b3d8828c-f6b7-4ccf-b24e-5c94cd11b15b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] [instance: c8397a8e-08c7-4844-90eb-80949ac27e92] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:42.522607 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-8c2c6270-7a0c-4f44-8fac-6fecfde0f469 req-b95678cb-f888-46c4-9f30-73134fba68aa service nova] Creating event network-vif-deleted:163a242a-344a-4765-b50c-fff46a880c74 for instance c8397a8e-08c7-4844-90eb-80949ac27e92 on n-h1-826529-8 Aug 03 01:58:42.526713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3d8828c-f6b7-4ccf-b24e-5c94cd11b15b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:42.527232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3d8828c-f6b7-4ccf-b24e-5c94cd11b15b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:42.528129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3d8828c-f6b7-4ccf-b24e-5c94cd11b15b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:42.528675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3d8828c-f6b7-4ccf-b24e-5c94cd11b15b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:42.536446 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-8c2c6270-7a0c-4f44-8fac-6fecfde0f469 req-b95678cb-f888-46c4-9f30-73134fba68aa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117096 Aug 03 01:58:42.537517 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1329/2615] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:42.580543 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-b3d8828c-f6b7-4ccf-b24e-5c94cd11b15b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] HTTP exception thrown: Instance c8397a8e-08c7-4844-90eb-80949ac27e92 could not be found. Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b3d8828c-f6b7-4ccf-b24e-5c94cd11b15b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Request method failure captured: Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 HTTP/1.1 Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dTll7VklSXVKPY7IA1_5ob-tKVm2Z_7z42qGXzDSvTdwVAzc-uu26I_RdtLVhoAwHCuPbYMUDNABwS67wYISa8yagl02RQzcDUh0SQ8u7p5lboe4i0RQPeTExpnFXWWBwbJADXBFZ5wGYauWv3NNIL4oxW8HVYZDtaGv8yUqCCibqo Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c183e2fc6dbb419fbd8fa81c90163adf", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c183e2fc6dbb419fbd8fa81c90163adf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c183e2fc6dbb419fbd8fa81c90163adf"}]}] Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c183e2fc6dbb419fbd8fa81c90163adf Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-735823373 Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 0b99d344c16b4221bcccfe37d32bb69e Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerRescueNegativeTestJSON-735823373-project Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance c8397a8e-08c7-4844-90eb-80949ac27e92 could not be found. Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'c8397a8e-08c7-4844-90eb-80949ac27e92'} Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8397a8e-08c7-4844-90eb-80949ac27e92 could not be found. Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8397a8e-08c7-4844-90eb-80949ac27e92 could not be found. Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:42.583505 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:42.587142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:42.587142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:42.587142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:42.587142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:42.587142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:42.587142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:42.587142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8397a8e-08c7-4844-90eb-80949ac27e92 could not be found. Aug 03 01:58:42.587142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:42.591588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b3d8828c-f6b7-4ccf-b24e-5c94cd11b15b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] Returning 404 to user: Instance c8397a8e-08c7-4844-90eb-80949ac27e92 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:42.593375 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b3d8828c-f6b7-4ccf-b24e-5c94cd11b15b tempest-ServerRescueNegativeTestJSON-735823373 tempest-ServerRescueNegativeTestJSON-735823373-project] 10.222.0.67 "GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92" status: 404 len: 111 microversion: 2.1 time: 0.114253 Aug 03 01:58:42.594506 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1287/2616] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:42 2022] GET /compute/v2.1/servers/c8397a8e-08c7-4844-90eb-80949ac27e92 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:58:43.145884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f228c150-a46b-45fe-a30a-fc9822c4bd3a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:43.146850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f228c150-a46b-45fe-a30a-fc9822c4bd3a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:43.168456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f228c150-a46b-45fe-a30a-fc9822c4bd3a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:43.174489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f228c150-a46b-45fe-a30a-fc9822c4bd3a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:43.177042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f228c150-a46b-45fe-a30a-fc9822c4bd3a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:43.177536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f228c150-a46b-45fe-a30a-fc9822c4bd3a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:43.439790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6bc626c8-ae47-4a9b-8330-8896956ce710 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:43.441227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6bc626c8-ae47-4a9b-8330-8896956ce710 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:43.457951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6bc626c8-ae47-4a9b-8330-8896956ce710 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:43.458746 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6bc626c8-ae47-4a9b-8330-8896956ce710 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:43.459851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6bc626c8-ae47-4a9b-8330-8896956ce710 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:43.460501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6bc626c8-ae47-4a9b-8330-8896956ce710 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:43.476083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:58:44.134060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6bc626c8-ae47-4a9b-8330-8896956ce710 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:44.144572 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6bc626c8-ae47-4a9b-8330-8896956ce710 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1304 microversion: 2.1 time: 0.709300 Aug 03 01:58:44.154964 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1288/2617] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:43 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1304 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:58:44.154964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1b275fd1-1698-45c4-96f8-a80c3b81fd83 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:44.154964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1b275fd1-1698-45c4-96f8-a80c3b81fd83 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:44.179987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b275fd1-1698-45c4-96f8-a80c3b81fd83 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:44.180511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b275fd1-1698-45c4-96f8-a80c3b81fd83 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:44.181340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b275fd1-1698-45c4-96f8-a80c3b81fd83 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:44.181793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b275fd1-1698-45c4-96f8-a80c3b81fd83 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:44.627285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f228c150-a46b-45fe-a30a-fc9822c4bd3a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:44.639387 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f228c150-a46b-45fe-a30a-fc9822c4bd3a tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1323 microversion: 2.1 time: 1.501017 Aug 03 01:58:44.654134 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1330/2618] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:43 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1323 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:44.781443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1b275fd1-1698-45c4-96f8-a80c3b81fd83 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:44.800367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1b275fd1-1698-45c4-96f8-a80c3b81fd83 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:44.801967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1b275fd1-1698-45c4-96f8-a80c3b81fd83 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:44.811756 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1b275fd1-1698-45c4-96f8-a80c3b81fd83 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 0.656695 Aug 03 01:58:44.812446 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1289/2619] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:44 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:45.172014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-98f76b42-6e1e-4b1f-a3e4-f06fc8ab40f4 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:45.172641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-98f76b42-6e1e-4b1f-a3e4-f06fc8ab40f4 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:45.201103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98f76b42-6e1e-4b1f-a3e4-f06fc8ab40f4 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:45.207423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98f76b42-6e1e-4b1f-a3e4-f06fc8ab40f4 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:45.208444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98f76b42-6e1e-4b1f-a3e4-f06fc8ab40f4 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:45.209277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98f76b42-6e1e-4b1f-a3e4-f06fc8ab40f4 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:45.662219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-97fc2b74-e35b-4c7c-895b-09f28b26240d tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:45.662846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-97fc2b74-e35b-4c7c-895b-09f28b26240d tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:45.685096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97fc2b74-e35b-4c7c-895b-09f28b26240d tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:45.685556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97fc2b74-e35b-4c7c-895b-09f28b26240d tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:45.693061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97fc2b74-e35b-4c7c-895b-09f28b26240d tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:45.693061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97fc2b74-e35b-4c7c-895b-09f28b26240d tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:45.951263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-98f76b42-6e1e-4b1f-a3e4-f06fc8ab40f4 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:45.973458 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-98f76b42-6e1e-4b1f-a3e4-f06fc8ab40f4 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1372 microversion: 2.1 time: 0.808161 Aug 03 01:58:45.976611 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1331/2620] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:45 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1372 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:45.991177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8eb96a81-9c09-47ea-b5eb-ba1e15112129 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:46.024403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8eb96a81-9c09-47ea-b5eb-ba1e15112129 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:46.046677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8eb96a81-9c09-47ea-b5eb-ba1e15112129 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:46.047326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8eb96a81-9c09-47ea-b5eb-ba1e15112129 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:46.048166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8eb96a81-9c09-47ea-b5eb-ba1e15112129 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:46.048654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8eb96a81-9c09-47ea-b5eb-ba1e15112129 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:47.352962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:58:48.537268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=12 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:58:49.113253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-97fc2b74-e35b-4c7c-895b-09f28b26240d tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:49.121971 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-97fc2b74-e35b-4c7c-895b-09f28b26240d tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1472 microversion: 2.1 time: 3.463891 Aug 03 01:58:49.147139 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1290/2621] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:45 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1472 bytes in 3489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:49.152333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-138bb48a-49a4-43bd-bc0a-6bb6a5298965 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:49.153151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-138bb48a-49a4-43bd-bc0a-6bb6a5298965 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:49.215936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-138bb48a-49a4-43bd-bc0a-6bb6a5298965 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:49.217635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-138bb48a-49a4-43bd-bc0a-6bb6a5298965 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:49.220259 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-138bb48a-49a4-43bd-bc0a-6bb6a5298965 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:49.222472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-138bb48a-49a4-43bd-bc0a-6bb6a5298965 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:49.432357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8eb96a81-9c09-47ea-b5eb-ba1e15112129 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:49.457847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8eb96a81-9c09-47ea-b5eb-ba1e15112129 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:49.499641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8eb96a81-9c09-47ea-b5eb-ba1e15112129 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:49.499641 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8eb96a81-9c09-47ea-b5eb-ba1e15112129 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 3.514185 Aug 03 01:58:49.509186 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1332/2622] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:45 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 3527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:49.514561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cf1e6328-e706-43b1-8a37-d1424f634b74 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:49.536209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cf1e6328-e706-43b1-8a37-d1424f634b74 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:49.575681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:58:49.582756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf1e6328-e706-43b1-8a37-d1424f634b74 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:49.585066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf1e6328-e706-43b1-8a37-d1424f634b74 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:49.587422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf1e6328-e706-43b1-8a37-d1424f634b74 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:49.588543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf1e6328-e706-43b1-8a37-d1424f634b74 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:49.691576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cf1e6328-e706-43b1-8a37-d1424f634b74 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cf1e6328-e706-43b1-8a37-d1424f634b74 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Request method failure captured: Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057/diagnostics HTTP/1.1 Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dYwiXcf90H7LGxB1aRh_vnoUHgGFueGzQtOUcUj-ptJ_dMLvr__mp0vozSbvDobm-ghEdVStYT2BpLRc3xdE7FXmouVVCtm6QZSMQWB4SZtEoQNcxsjYgjxmFdSh7QdMvAzAlv_7r-D7_qjWrDcoeUs4X2p-uj6f8rMFa5gtcoEwlM Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: efbf4b3aadcb451b95cbb030d640c4ba Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-345540368 Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_efbf4b3aadcb451b95cbb030d640c4ba", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/efbf4b3aadcb451b95cbb030d640c4ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/efbf4b3aadcb451b95cbb030d640c4ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/efbf4b3aadcb451b95cbb030d640c4ba"}]}] Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-345540368 Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: efbf4b3aadcb451b95cbb030d640c4ba Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-345540368 Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerDiagnosticsNegativeTest-345540368-project Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 683a203709e0436a99b818d902561e46 Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-345540368-project Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'server_id': '86a2c151-70c4-4162-aa5c-19aeda031057'} Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:49.699371 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:49.709163 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:49.709163 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:49.709163 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 01:58:49.709163 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 01:58:49.709163 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 03 01:58:49.709163 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 01:58:49.713311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cf1e6328-e706-43b1-8a37-d1424f634b74 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:49.714301 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cf1e6328-e706-43b1-8a37-d1424f634b74 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.203403 Aug 03 01:58:49.717931 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1333/2623] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 01:58:49 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057/diagnostics => generated 117 bytes in 207 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:58:49.775571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1a435ca8-128c-4498-8725-54938106dd7e tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:49.779823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1a435ca8-128c-4498-8725-54938106dd7e tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:49.801727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a435ca8-128c-4498-8725-54938106dd7e tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:49.803225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a435ca8-128c-4498-8725-54938106dd7e tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:49.805910 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a435ca8-128c-4498-8725-54938106dd7e tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:49.808323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a435ca8-128c-4498-8725-54938106dd7e tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:49.941517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1a435ca8-128c-4498-8725-54938106dd7e tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:58:50.127465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:58:50.292967 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1a435ca8-128c-4498-8725-54938106dd7e tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "DELETE /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 204 len: 0 microversion: 2.1 time: 0.557106 Aug 03 01:58:50.302715 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1334/2624] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 01:58:49 2022] DELETE /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 01:58:50.324164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e7c514af-6cfd-4695-af68-2814cbb71507 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:50.324904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e7c514af-6cfd-4695-af68-2814cbb71507 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:50.357177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7c514af-6cfd-4695-af68-2814cbb71507 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:50.363769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7c514af-6cfd-4695-af68-2814cbb71507 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:50.370594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7c514af-6cfd-4695-af68-2814cbb71507 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:50.373623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7c514af-6cfd-4695-af68-2814cbb71507 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:51.193999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e7c514af-6cfd-4695-af68-2814cbb71507 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:51.231668 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e7c514af-6cfd-4695-af68-2814cbb71507 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1478 microversion: 2.1 time: 0.920761 Aug 03 01:58:51.258259 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1335/2625] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:50 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1478 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:51.270427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd7c36c5-c495-4ecb-a214-81e6769d6bc2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:51.272139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cd7c36c5-c495-4ecb-a214-81e6769d6bc2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:51.290222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd7c36c5-c495-4ecb-a214-81e6769d6bc2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:51.291264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd7c36c5-c495-4ecb-a214-81e6769d6bc2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:51.293015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd7c36c5-c495-4ecb-a214-81e6769d6bc2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:51.294363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd7c36c5-c495-4ecb-a214-81e6769d6bc2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:51.321521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-138bb48a-49a4-43bd-bc0a-6bb6a5298965 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:51.347445 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-138bb48a-49a4-43bd-bc0a-6bb6a5298965 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1372 microversion: 2.1 time: 2.198849 Aug 03 01:58:51.348337 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1291/2626] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:49 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1372 bytes in 2201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:52.120311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-35bb9a33-4d4a-4e52-bf6e-8422e8347022 req-731bf861-c006-4595-87de-804226f7ca68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3285da37-7f8b-462d-b271-1cc87f6fba1b", "tag": "df876788-24fb-404a-8272-e552c07ff6fb"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:52.156772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-35bb9a33-4d4a-4e52-bf6e-8422e8347022 req-731bf861-c006-4595-87de-804226f7ca68 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:52.160751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cd7c36c5-c495-4ecb-a214-81e6769d6bc2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:52.163595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-35bb9a33-4d4a-4e52-bf6e-8422e8347022 req-731bf861-c006-4595-87de-804226f7ca68 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:52.182560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cd7c36c5-c495-4ecb-a214-81e6769d6bc2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:52.184225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cd7c36c5-c495-4ecb-a214-81e6769d6bc2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:52.186719 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cd7c36c5-c495-4ecb-a214-81e6769d6bc2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 0.926055 Aug 03 01:58:52.207112 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1336/2627] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:51 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:52.210623 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-35bb9a33-4d4a-4e52-bf6e-8422e8347022 req-731bf861-c006-4595-87de-804226f7ca68 service nova] Creating event network-changed:df876788-24fb-404a-8272-e552c07ff6fb for instance 3285da37-7f8b-462d-b271-1cc87f6fba1b on n-h2-826529-8 Aug 03 01:58:52.224892 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-35bb9a33-4d4a-4e52-bf6e-8422e8347022 req-731bf861-c006-4595-87de-804226f7ca68 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109493 Aug 03 01:58:52.226162 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1292/2628] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:52.306157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c274a5a7-1416-48bb-a621-9e0768f5b03f tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:52.308233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c274a5a7-1416-48bb-a621-9e0768f5b03f tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:52.327703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c274a5a7-1416-48bb-a621-9e0768f5b03f tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:52.329110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c274a5a7-1416-48bb-a621-9e0768f5b03f tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:52.339163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c274a5a7-1416-48bb-a621-9e0768f5b03f tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:52.340458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c274a5a7-1416-48bb-a621-9e0768f5b03f tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:52.386009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9bc881f8-81dd-4b13-a036-146543f97058 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:52.386741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9bc881f8-81dd-4b13-a036-146543f97058 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:52.404708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9bc881f8-81dd-4b13-a036-146543f97058 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:52.409553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9bc881f8-81dd-4b13-a036-146543f97058 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:52.412998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9bc881f8-81dd-4b13-a036-146543f97058 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:52.425193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9bc881f8-81dd-4b13-a036-146543f97058 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:54.151192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9bc881f8-81dd-4b13-a036-146543f97058 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:54.175929 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9bc881f8-81dd-4b13-a036-146543f97058 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1372 microversion: 2.1 time: 1.790341 Aug 03 01:58:54.177857 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1293/2629] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:52 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1372 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:54.203171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-14fb1ce0-b9ab-4bd8-ab30-678f7c0fae03 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:54.205822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-14fb1ce0-b9ab-4bd8-ab30-678f7c0fae03 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:54.233373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c274a5a7-1416-48bb-a621-9e0768f5b03f tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:54.242441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-14fb1ce0-b9ab-4bd8-ab30-678f7c0fae03 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:54.243359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-14fb1ce0-b9ab-4bd8-ab30-678f7c0fae03 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:54.244650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-14fb1ce0-b9ab-4bd8-ab30-678f7c0fae03 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:54.245252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-14fb1ce0-b9ab-4bd8-ab30-678f7c0fae03 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:54.262385 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c274a5a7-1416-48bb-a621-9e0768f5b03f tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1478 microversion: 2.1 time: 1.966009 Aug 03 01:58:54.279568 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1337/2630] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:52 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1478 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:54.724141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-898acd8f-a2af-4b58-abf5-6ffe064534df tempest-AZV2TestJSON-912099749 tempest-AZV2TestJSON-912099749-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:54.735140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-898acd8f-a2af-4b58-abf5-6ffe064534df tempest-AZV2TestJSON-912099749 tempest-AZV2TestJSON-912099749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:54.736474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-898acd8f-a2af-4b58-abf5-6ffe064534df tempest-AZV2TestJSON-912099749 tempest-AZV2TestJSON-912099749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:54.738052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-898acd8f-a2af-4b58-abf5-6ffe064534df tempest-AZV2TestJSON-912099749 tempest-AZV2TestJSON-912099749-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:54.738739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-898acd8f-a2af-4b58-abf5-6ffe064534df tempest-AZV2TestJSON-912099749 tempest-AZV2TestJSON-912099749-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:54.824429 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-898acd8f-a2af-4b58-abf5-6ffe064534df tempest-AZV2TestJSON-912099749 tempest-AZV2TestJSON-912099749-project] 10.222.0.67 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.542656 Aug 03 01:58:54.835598 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1338/2631] 10.222.0.67 () {58 vars in 1164 bytes} [Wed Aug 3 01:58:54 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 01:58:55.207723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-73acfcb5-34fd-429d-a208-d8e13ff8d0d7 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:55.208805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-73acfcb5-34fd-429d-a208-d8e13ff8d0d7 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:55.234092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73acfcb5-34fd-429d-a208-d8e13ff8d0d7 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:55.234886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73acfcb5-34fd-429d-a208-d8e13ff8d0d7 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:55.240692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73acfcb5-34fd-429d-a208-d8e13ff8d0d7 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:55.241426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73acfcb5-34fd-429d-a208-d8e13ff8d0d7 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:55.703456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-14fb1ce0-b9ab-4bd8-ab30-678f7c0fae03 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:55.715090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-14fb1ce0-b9ab-4bd8-ab30-678f7c0fae03 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:55.724408 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-14fb1ce0-b9ab-4bd8-ab30-678f7c0fae03 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:55.734724 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-14fb1ce0-b9ab-4bd8-ab30-678f7c0fae03 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.551816 Aug 03 01:58:55.740452 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1294/2632] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:54 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:55.770122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fcaad225-289a-4ea3-93fc-d534e8164f78 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:55.775435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fcaad225-289a-4ea3-93fc-d534e8164f78 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:55.817641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcaad225-289a-4ea3-93fc-d534e8164f78 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:55.823662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcaad225-289a-4ea3-93fc-d534e8164f78 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:55.824517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcaad225-289a-4ea3-93fc-d534e8164f78 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:55.824963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcaad225-289a-4ea3-93fc-d534e8164f78 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:55.994035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-73acfcb5-34fd-429d-a208-d8e13ff8d0d7 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:55.999407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fcaad225-289a-4ea3-93fc-d534e8164f78 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:56.011857 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fcaad225-289a-4ea3-93fc-d534e8164f78 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1436 microversion: 2.1 time: 0.267646 Aug 03 01:58:56.014504 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-73acfcb5-34fd-429d-a208-d8e13ff8d0d7 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1372 microversion: 2.1 time: 0.814787 Aug 03 01:58:56.018516 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1295/2633] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:55 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1436 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:56.021854 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1339/2634] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:55 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1372 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:56.042270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-7ab13642-e3ab-4b48-b937-87f560016326 req-684b1477-64f3-47da-a066-691140c040b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a2c151-70c4-4162-aa5c-19aeda031057", "name": "network-vif-deleted", "tag": "269edc87-62e3-4292-986d-bb28c98829a7"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:56.083115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7ab13642-e3ab-4b48-b937-87f560016326 req-684b1477-64f3-47da-a066-691140c040b0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:56.084522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7ab13642-e3ab-4b48-b937-87f560016326 req-684b1477-64f3-47da-a066-691140c040b0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:56.118045 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-7ab13642-e3ab-4b48-b937-87f560016326 req-684b1477-64f3-47da-a066-691140c040b0 service nova] Creating event network-vif-deleted:269edc87-62e3-4292-986d-bb28c98829a7 for instance 86a2c151-70c4-4162-aa5c-19aeda031057 on n-h2-826529-8 Aug 03 01:58:56.131484 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-7ab13642-e3ab-4b48-b937-87f560016326 req-684b1477-64f3-47da-a066-691140c040b0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091934 Aug 03 01:58:56.132962 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1296/2635] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:58:56.230209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bf36dc05-de69-4c8c-bf91-1cca8766ef46 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Action: 'create', calling method: .version_select at 0x7f5b129cb3a0>, body: {"keypair": {"name": "tempest-keypair-1046613658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMbLmosh5kZF4d2aZYVsGpaMj37HcdShqrT+PxQSsex1TFcSi5ctNawAL76NdoRCsjtxDIUg6ZIP3mkohfogTmX7F8P3PXP/EGbV4k55wEBli3eeK5u7Sze8cBvaeZSdw=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:58:56.248880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-bf36dc05-de69-4c8c-bf91-1cca8766ef46 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Getting quotas for project 9907ef20b17f42acb99a8b61502f29a3. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:58:56.256964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-bf36dc05-de69-4c8c-bf91-1cca8766ef46 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Getting quotas for user 81ae7aa9aed7440a8bdfd4595eae3be8 and project 9907ef20b17f42acb99a8b61502f29a3. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:58:56.292359 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bf36dc05-de69-4c8c-bf91-1cca8766ef46 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.237019 Aug 03 01:58:56.302089 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1340/2636] 10.222.0.67 () {62 vars in 1200 bytes} [Wed Aug 3 01:58:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 247 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 01:58:56.772705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2d9b742b-03da-4ea4-b1af-ed250de9b4e5 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:56.773619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2d9b742b-03da-4ea4-b1af-ed250de9b4e5 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:56.780299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d9b742b-03da-4ea4-b1af-ed250de9b4e5 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:56.780792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d9b742b-03da-4ea4-b1af-ed250de9b4e5 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:56.781881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d9b742b-03da-4ea4-b1af-ed250de9b4e5 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:56.783172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d9b742b-03da-4ea4-b1af-ed250de9b4e5 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:57.043258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03d0bf40-d940-445c-ba08-a7d786ab9815 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:57.044277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-03d0bf40-d940-445c-ba08-a7d786ab9815 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:57.070597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03d0bf40-d940-445c-ba08-a7d786ab9815 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:57.071540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03d0bf40-d940-445c-ba08-a7d786ab9815 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:57.075671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03d0bf40-d940-445c-ba08-a7d786ab9815 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:57.076334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03d0bf40-d940-445c-ba08-a7d786ab9815 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:57.184482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03d0bf40-d940-445c-ba08-a7d786ab9815 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:57.185108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03d0bf40-d940-445c-ba08-a7d786ab9815 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:57.185587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-03d0bf40-d940-445c-ba08-a7d786ab9815 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lazy-loading 'fault' on Instance uuid 86a2c151-70c4-4162-aa5c-19aeda031057 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:58:57.435481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03d0bf40-d940-445c-ba08-a7d786ab9815 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683a203709e0436a99b818d902561e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbf4b3aadcb451b95cbb030d640c4ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:57.445410 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03d0bf40-d940-445c-ba08-a7d786ab9815 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 200 len: 1313 microversion: 2.1 time: 0.406750 Aug 03 01:58:57.445838 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1341/2637] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:57 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:57.474418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b9c6652a-33c2-41df-a6f6-c02328a0d53d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:57.478245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b9c6652a-33c2-41df-a6f6-c02328a0d53d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:57.497021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9c6652a-33c2-41df-a6f6-c02328a0d53d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:57.499208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9c6652a-33c2-41df-a6f6-c02328a0d53d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:57.502745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9c6652a-33c2-41df-a6f6-c02328a0d53d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:57.504376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9c6652a-33c2-41df-a6f6-c02328a0d53d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:57.900182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2d9b742b-03da-4ea4-b1af-ed250de9b4e5 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:57.924471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2d9b742b-03da-4ea4-b1af-ed250de9b4e5 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:57.931776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2d9b742b-03da-4ea4-b1af-ed250de9b4e5 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:57.935928 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2d9b742b-03da-4ea4-b1af-ed250de9b4e5 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.169028 Aug 03 01:58:57.937560 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1297/2638] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:56 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:58:58.043916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b9c6652a-33c2-41df-a6f6-c02328a0d53d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:58.058706 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b9c6652a-33c2-41df-a6f6-c02328a0d53d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1372 microversion: 2.1 time: 0.604555 Aug 03 01:58:58.064251 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1342/2639] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:57 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1372 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:58:58.466596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cee60f47-0b4b-41dc-8daa-966311b687e1 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:58.467545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cee60f47-0b4b-41dc-8daa-966311b687e1 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] [instance: 86a2c151-70c4-4162-aa5c-19aeda031057] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:58.483120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cee60f47-0b4b-41dc-8daa-966311b687e1 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:58.486115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cee60f47-0b4b-41dc-8daa-966311b687e1 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:58.489236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cee60f47-0b4b-41dc-8daa-966311b687e1 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:58.489904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cee60f47-0b4b-41dc-8daa-966311b687e1 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:58.524689 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-cee60f47-0b4b-41dc-8daa-966311b687e1 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] HTTP exception thrown: Instance 86a2c151-70c4-4162-aa5c-19aeda031057 could not be found. Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cee60f47-0b4b-41dc-8daa-966311b687e1 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Request method failure captured: Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 HTTP/1.1 Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dYwiXcf90H7LGxB1aRh_vnoUHgGFueGzQtOUcUj-ptJ_dMLvr__mp0vozSbvDobm-ghEdVStYT2BpLRc3xdE7FXmouVVCtm6QZSMQWB4SZtEoQNcxsjYgjxmFdSh7QdMvAzAlv_7r-D7_qjWrDcoeUs4X2p-uj6f8rMFa5gtcoEwlM Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: efbf4b3aadcb451b95cbb030d640c4ba Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-345540368 Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_efbf4b3aadcb451b95cbb030d640c4ba", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/efbf4b3aadcb451b95cbb030d640c4ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/efbf4b3aadcb451b95cbb030d640c4ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/efbf4b3aadcb451b95cbb030d640c4ba"}]}] Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-345540368 Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: efbf4b3aadcb451b95cbb030d640c4ba Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-345540368 Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerDiagnosticsNegativeTest-345540368-project Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 683a203709e0436a99b818d902561e46 Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-345540368-project Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 86a2c151-70c4-4162-aa5c-19aeda031057 could not be found. Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '86a2c151-70c4-4162-aa5c-19aeda031057'} Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a2c151-70c4-4162-aa5c-19aeda031057 could not be found. Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a2c151-70c4-4162-aa5c-19aeda031057 could not be found. Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:58.532201 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:58:58.536867 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:58.536867 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:58:58.536867 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:58:58.536867 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:58:58.536867 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:58:58.536867 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:58:58.536867 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a2c151-70c4-4162-aa5c-19aeda031057 could not be found. Aug 03 01:58:58.536867 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:58:58.538556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cee60f47-0b4b-41dc-8daa-966311b687e1 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] Returning 404 to user: Instance 86a2c151-70c4-4162-aa5c-19aeda031057 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:58:58.539689 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cee60f47-0b4b-41dc-8daa-966311b687e1 tempest-ServerDiagnosticsNegativeTest-345540368 tempest-ServerDiagnosticsNegativeTest-345540368-project] 10.222.0.67 "GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057" status: 404 len: 111 microversion: 2.1 time: 0.077680 Aug 03 01:58:58.547455 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1298/2640] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:58 2022] GET /compute/v2.1/servers/86a2c151-70c4-4162-aa5c-19aeda031057 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 01:58:58.968661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cabdf387-851f-4b47-939c-91c5802a61af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:58.971385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cabdf387-851f-4b47-939c-91c5802a61af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:58.992232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cabdf387-851f-4b47-939c-91c5802a61af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:58.992701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cabdf387-851f-4b47-939c-91c5802a61af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:58.993615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cabdf387-851f-4b47-939c-91c5802a61af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:58.994073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cabdf387-851f-4b47-939c-91c5802a61af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:59.085465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-adccb67d-1764-4fb9-8690-ae45c05bab51 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:58:59.086099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-adccb67d-1764-4fb9-8690-ae45c05bab51 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:58:59.108018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adccb67d-1764-4fb9-8690-ae45c05bab51 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:59.109808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adccb67d-1764-4fb9-8690-ae45c05bab51 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:59.120224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adccb67d-1764-4fb9-8690-ae45c05bab51 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:58:59.124210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adccb67d-1764-4fb9-8690-ae45c05bab51 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:58:59.964747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-adccb67d-1764-4fb9-8690-ae45c05bab51 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:58:59.991806 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-adccb67d-1764-4fb9-8690-ae45c05bab51 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1372 microversion: 2.1 time: 0.910131 Aug 03 01:59:00.009289 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1299/2641] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:58:59 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1372 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:59:00.056226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cabdf387-851f-4b47-939c-91c5802a61af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:00.075958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cabdf387-851f-4b47-939c-91c5802a61af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:00.083290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cabdf387-851f-4b47-939c-91c5802a61af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:00.085812 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cabdf387-851f-4b47-939c-91c5802a61af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.121157 Aug 03 01:59:00.091800 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1343/2642] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:58:58 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:01.020691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b255d6cc-aa4f-43bd-89a4-24d8813b51ab tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:01.040080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b255d6cc-aa4f-43bd-89a4-24d8813b51ab tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:01.065823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b255d6cc-aa4f-43bd-89a4-24d8813b51ab tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:01.066653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b255d6cc-aa4f-43bd-89a4-24d8813b51ab tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:01.067837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b255d6cc-aa4f-43bd-89a4-24d8813b51ab tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:01.068289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b255d6cc-aa4f-43bd-89a4-24d8813b51ab tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:01.124752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f18ef47e-fe33-44b8-8220-301c9de8bcb6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:01.125442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f18ef47e-fe33-44b8-8220-301c9de8bcb6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:01.143318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f18ef47e-fe33-44b8-8220-301c9de8bcb6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:01.144439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f18ef47e-fe33-44b8-8220-301c9de8bcb6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:01.145584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f18ef47e-fe33-44b8-8220-301c9de8bcb6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:01.146267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f18ef47e-fe33-44b8-8220-301c9de8bcb6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:02.139809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f18ef47e-fe33-44b8-8220-301c9de8bcb6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:02.159665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f18ef47e-fe33-44b8-8220-301c9de8bcb6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:02.162370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f18ef47e-fe33-44b8-8220-301c9de8bcb6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:02.171565 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f18ef47e-fe33-44b8-8220-301c9de8bcb6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.048681 Aug 03 01:59:02.172296 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1344/2643] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:01 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:02.176021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b255d6cc-aa4f-43bd-89a4-24d8813b51ab tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:02.179721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-db98047d-ddb4-4b51-af54-8964d36b357d req-e9e49ad4-5c14-4c18-9aaf-b2abe3afcbea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3285da37-7f8b-462d-b271-1cc87f6fba1b", "name": "network-vif-plugged", "status": "completed", "tag": "df876788-24fb-404a-8272-e552c07ff6fb"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:02.203020 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b255d6cc-aa4f-43bd-89a4-24d8813b51ab tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1372 microversion: 2.1 time: 1.186476 Aug 03 01:59:02.204097 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1300/2644] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:01 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1372 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:02.209574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-db98047d-ddb4-4b51-af54-8964d36b357d req-e9e49ad4-5c14-4c18-9aaf-b2abe3afcbea service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:02.215096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-db98047d-ddb4-4b51-af54-8964d36b357d req-e9e49ad4-5c14-4c18-9aaf-b2abe3afcbea service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:02.268221 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-db98047d-ddb4-4b51-af54-8964d36b357d req-e9e49ad4-5c14-4c18-9aaf-b2abe3afcbea service nova] Creating event network-vif-plugged:df876788-24fb-404a-8272-e552c07ff6fb for instance 3285da37-7f8b-462d-b271-1cc87f6fba1b on n-h2-826529-8 Aug 03 01:59:02.284108 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-db98047d-ddb4-4b51-af54-8964d36b357d req-e9e49ad4-5c14-4c18-9aaf-b2abe3afcbea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107718 Aug 03 01:59:02.288727 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1345/2645] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:03.212851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-74524bf5-7a7e-48e9-be2f-63952ee0df80 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:03.213564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-74524bf5-7a7e-48e9-be2f-63952ee0df80 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:03.234395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74524bf5-7a7e-48e9-be2f-63952ee0df80 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:03.234871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74524bf5-7a7e-48e9-be2f-63952ee0df80 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:03.237458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b8c925c5-271e-49d2-9b00-9f77c9d83f2f tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:03.238751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b8c925c5-271e-49d2-9b00-9f77c9d83f2f tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:03.241734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74524bf5-7a7e-48e9-be2f-63952ee0df80 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:03.249751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74524bf5-7a7e-48e9-be2f-63952ee0df80 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:03.284377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8c925c5-271e-49d2-9b00-9f77c9d83f2f tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:03.285257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8c925c5-271e-49d2-9b00-9f77c9d83f2f tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:03.286346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8c925c5-271e-49d2-9b00-9f77c9d83f2f tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:03.286959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8c925c5-271e-49d2-9b00-9f77c9d83f2f tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:04.249725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-74524bf5-7a7e-48e9-be2f-63952ee0df80 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:04.254722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b8c925c5-271e-49d2-9b00-9f77c9d83f2f tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:04.265572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-74524bf5-7a7e-48e9-be2f-63952ee0df80 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:04.267979 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b8c925c5-271e-49d2-9b00-9f77c9d83f2f tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1372 microversion: 2.1 time: 1.039903 Aug 03 01:59:04.271227 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1346/2646] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:03 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1372 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:04.274190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-74524bf5-7a7e-48e9-be2f-63952ee0df80 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:04.276309 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-74524bf5-7a7e-48e9-be2f-63952ee0df80 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.069453 Aug 03 01:59:04.279149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-110677015", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4dd68a0-3d6e-4462-97da-1cd536a6d48a"}], "security_groups": [{"name": "tempest-securitygroup--548143371"}], "key_name": "tempest-keypair-1046613658", "user_data": "}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:04.287074 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1301/2647] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:03 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:04.772944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:04.844234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] validate_networks() for [('b4dd68a0-3d6e-4462-97da-1cd536a6d48a', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:59:05.309357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-94224107-3112-4e36-84ee-0f7af75b86c0 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:05.312454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-94224107-3112-4e36-84ee-0f7af75b86c0 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:05.335379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94224107-3112-4e36-84ee-0f7af75b86c0 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:05.336378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94224107-3112-4e36-84ee-0f7af75b86c0 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:05.338045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94224107-3112-4e36-84ee-0f7af75b86c0 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:05.344151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94224107-3112-4e36-84ee-0f7af75b86c0 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:06.268101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:06.377146 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-94224107-3112-4e36-84ee-0f7af75b86c0 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:06.387763 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-94224107-3112-4e36-84ee-0f7af75b86c0 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1559 microversion: 2.1 time: 1.086540 Aug 03 01:59:06.393807 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1302/2648] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:05 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1559 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:06.411895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93ad1a78-9d43-4981-9497-b6de6566ce73 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:06.415105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93ad1a78-9d43-4981-9497-b6de6566ce73 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:06.427973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93ad1a78-9d43-4981-9497-b6de6566ce73 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:06.428733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93ad1a78-9d43-4981-9497-b6de6566ce73 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:06.430088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93ad1a78-9d43-4981-9497-b6de6566ce73 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:06.430687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93ad1a78-9d43-4981-9497-b6de6566ce73 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:06.511636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:59:06.512406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:59:06.513132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:59:06.514044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:59:06.515166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:59:06.533404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:06.537811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:06.540111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:06.540572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:06.597614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Getting quotas for project 9907ef20b17f42acb99a8b61502f29a3. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:59:06.621134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Getting quotas for user 81ae7aa9aed7440a8bdfd4595eae3be8 and project 9907ef20b17f42acb99a8b61502f29a3. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:59:06.653122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:59:06.656246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:59:06.754308 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-02ec021f-82f3-4a07-96b6-8da59c98cd38 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.481714 Aug 03 01:59:06.755594 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1347/2649] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 01:59:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 2483 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 01:59:06.763877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1a5c63f2-b5ba-4d84-be28-f5e5105ba303 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:06.765179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1a5c63f2-b5ba-4d84-be28-f5e5105ba303 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:06.775097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a5c63f2-b5ba-4d84-be28-f5e5105ba303 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:06.776006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a5c63f2-b5ba-4d84-be28-f5e5105ba303 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:06.777191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a5c63f2-b5ba-4d84-be28-f5e5105ba303 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:06.777797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a5c63f2-b5ba-4d84-be28-f5e5105ba303 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:06.890369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-93ad1a78-9d43-4981-9497-b6de6566ce73 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:06.910246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-93ad1a78-9d43-4981-9497-b6de6566ce73 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:06.915067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-93ad1a78-9d43-4981-9497-b6de6566ce73 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:06.916582 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93ad1a78-9d43-4981-9497-b6de6566ce73 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 0.518831 Aug 03 01:59:06.920161 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1303/2650] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:06 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:06.962921 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1a5c63f2-b5ba-4d84-be28-f5e5105ba303 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.205706 Aug 03 01:59:06.964370 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1348/2651] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 01:59:06 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b/os-interface => generated 285 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:06.969643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d1467fec-a6c0-4349-b397-ec991b85fae1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:06.971718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d1467fec-a6c0-4349-b397-ec991b85fae1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:07.393361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1325696644", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:07.492374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d1467fec-a6c0-4349-b397-ec991b85fae1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:07.511630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d1467fec-a6c0-4349-b397-ec991b85fae1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:07.513922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d1467fec-a6c0-4349-b397-ec991b85fae1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:07.515471 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d1467fec-a6c0-4349-b397-ec991b85fae1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1281 microversion: 2.20 time: 0.549908 Aug 03 01:59:07.516311 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1349/2652] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:06 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1281 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:07.525963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:59:07.953877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-394cdb6e-6b26-40a4-9b0c-fb6a1860d82b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:07.955185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-394cdb6e-6b26-40a4-9b0c-fb6a1860d82b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:07.968134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-394cdb6e-6b26-40a4-9b0c-fb6a1860d82b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:07.970353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-394cdb6e-6b26-40a4-9b0c-fb6a1860d82b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:07.973751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-394cdb6e-6b26-40a4-9b0c-fb6a1860d82b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:07.976039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-394cdb6e-6b26-40a4-9b0c-fb6a1860d82b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:08.194825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:59:08.196256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:59:08.196910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:59:08.198127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:59:08.199240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:59:08.215581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:08.217007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:08.218020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:08.218713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:08.245748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:59:08.254697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:59:08.276075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:59:08.279023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:59:08.357624 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-005839f7-ad74-422b-8191-872b35197496 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.434617 Aug 03 01:59:08.358653 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1304/2653] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:59:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:59:08.383727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-76e38864-ef0d-4cb4-8553-7556f0af200c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:08.384844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-76e38864-ef0d-4cb4-8553-7556f0af200c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:08.480423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-394cdb6e-6b26-40a4-9b0c-fb6a1860d82b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:08.498109 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-394cdb6e-6b26-40a4-9b0c-fb6a1860d82b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:08.503325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-394cdb6e-6b26-40a4-9b0c-fb6a1860d82b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:08.505480 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-394cdb6e-6b26-40a4-9b0c-fb6a1860d82b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 0.555414 Aug 03 01:59:08.523765 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1350/2654] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:07 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:59:08.532278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-76e38864-ef0d-4cb4-8553-7556f0af200c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:08.549563 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-76e38864-ef0d-4cb4-8553-7556f0af200c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1217 microversion: 2.1 time: 0.175469 Aug 03 01:59:08.552170 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1305/2655] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:08 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:08.554972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f367b7f3-d8b4-436f-82f7-7982df05d402 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:08.555979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f367b7f3-d8b4-436f-82f7-7982df05d402 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:08.568351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f367b7f3-d8b4-436f-82f7-7982df05d402 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:08.569029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f367b7f3-d8b4-436f-82f7-7982df05d402 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:08.570064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f367b7f3-d8b4-436f-82f7-7982df05d402 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:08.570814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f367b7f3-d8b4-436f-82f7-7982df05d402 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:08.800371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f367b7f3-d8b4-436f-82f7-7982df05d402 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:08.823743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f367b7f3-d8b4-436f-82f7-7982df05d402 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:08.825877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f367b7f3-d8b4-436f-82f7-7982df05d402 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:08.827371 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f367b7f3-d8b4-436f-82f7-7982df05d402 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1333 microversion: 2.20 time: 0.283128 Aug 03 01:59:08.833749 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1351/2656] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:08 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1333 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:09.542417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c03d2e76-ad6d-4b92-9bd6-69a2b62ca5f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:09.545444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c03d2e76-ad6d-4b92-9bd6-69a2b62ca5f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:09.561111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c03d2e76-ad6d-4b92-9bd6-69a2b62ca5f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:09.561832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c03d2e76-ad6d-4b92-9bd6-69a2b62ca5f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:09.562862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c03d2e76-ad6d-4b92-9bd6-69a2b62ca5f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:09.567072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c03d2e76-ad6d-4b92-9bd6-69a2b62ca5f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:09.574414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0c89b727-3b8a-4a65-bc95-ca72a741b36f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:09.575962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0c89b727-3b8a-4a65-bc95-ca72a741b36f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:09.598236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c89b727-3b8a-4a65-bc95-ca72a741b36f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:09.599238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c89b727-3b8a-4a65-bc95-ca72a741b36f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:09.600307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c89b727-3b8a-4a65-bc95-ca72a741b36f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:09.608809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c89b727-3b8a-4a65-bc95-ca72a741b36f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:10.556895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0c89b727-3b8a-4a65-bc95-ca72a741b36f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:10.572503 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0c89b727-3b8a-4a65-bc95-ca72a741b36f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1213 microversion: 2.1 time: 1.002460 Aug 03 01:59:10.591326 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1352/2657] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:09 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1213 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:59:10.604277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8d4296b-ae95-4d8c-bbba-b8eef1135140 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:10.606218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8d4296b-ae95-4d8c-bbba-b8eef1135140 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:10.623824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8d4296b-ae95-4d8c-bbba-b8eef1135140 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:10.626452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8d4296b-ae95-4d8c-bbba-b8eef1135140 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:10.629113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8d4296b-ae95-4d8c-bbba-b8eef1135140 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:10.629779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8d4296b-ae95-4d8c-bbba-b8eef1135140 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:10.805650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c03d2e76-ad6d-4b92-9bd6-69a2b62ca5f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:10.825347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c03d2e76-ad6d-4b92-9bd6-69a2b62ca5f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:10.830959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c03d2e76-ad6d-4b92-9bd6-69a2b62ca5f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:10.835364 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c03d2e76-ad6d-4b92-9bd6-69a2b62ca5f8 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.303849 Aug 03 01:59:10.836565 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1306/2658] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:09 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:10.849978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-93b17b63-ce0b-4ccb-8c89-5cb811d82817 req-2e65fdfe-c8f3-4768-9934-63e704e7c75a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3285da37-7f8b-462d-b271-1cc87f6fba1b", "tag": "df876788-24fb-404a-8272-e552c07ff6fb"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:10.880594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8d4296b-ae95-4d8c-bbba-b8eef1135140 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:10.890695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-93b17b63-ce0b-4ccb-8c89-5cb811d82817 req-2e65fdfe-c8f3-4768-9934-63e704e7c75a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:10.893518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-93b17b63-ce0b-4ccb-8c89-5cb811d82817 req-2e65fdfe-c8f3-4768-9934-63e704e7c75a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:10.912397 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8d4296b-ae95-4d8c-bbba-b8eef1135140 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:10.920169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8d4296b-ae95-4d8c-bbba-b8eef1135140 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:10.924166 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8d4296b-ae95-4d8c-bbba-b8eef1135140 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1339 microversion: 2.20 time: 0.327878 Aug 03 01:59:10.926265 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1353/2659] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:10 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1339 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:10.930823 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-93b17b63-ce0b-4ccb-8c89-5cb811d82817 req-2e65fdfe-c8f3-4768-9934-63e704e7c75a service nova] Creating event network-changed:df876788-24fb-404a-8272-e552c07ff6fb for instance 3285da37-7f8b-462d-b271-1cc87f6fba1b on n-h2-826529-8 Aug 03 01:59:10.942071 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-93b17b63-ce0b-4ccb-8c89-5cb811d82817 req-2e65fdfe-c8f3-4768-9934-63e704e7c75a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103653 Aug 03 01:59:10.947673 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1307/2660] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:11.596981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7f7cf1e5-50be-4c63-9a00-4bc0592e86a7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:11.597629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7f7cf1e5-50be-4c63-9a00-4bc0592e86a7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:11.606885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f7cf1e5-50be-4c63-9a00-4bc0592e86a7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:11.615723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f7cf1e5-50be-4c63-9a00-4bc0592e86a7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:11.616875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f7cf1e5-50be-4c63-9a00-4bc0592e86a7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:11.617523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f7cf1e5-50be-4c63-9a00-4bc0592e86a7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:11.851980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7f7cf1e5-50be-4c63-9a00-4bc0592e86a7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:11.859560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:11.865122 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7f7cf1e5-50be-4c63-9a00-4bc0592e86a7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1275 microversion: 2.1 time: 0.271987 Aug 03 01:59:11.868665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7fe2ac5e-dfbf-4aa5-a57f-c50292aea0ea tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:11.869395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7fe2ac5e-dfbf-4aa5-a57f-c50292aea0ea tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:11.875491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:11.884424 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1354/2661] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:11 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1275 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:11.900431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fe2ac5e-dfbf-4aa5-a57f-c50292aea0ea tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:11.900904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fe2ac5e-dfbf-4aa5-a57f-c50292aea0ea tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:11.910492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fe2ac5e-dfbf-4aa5-a57f-c50292aea0ea tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:11.911474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fe2ac5e-dfbf-4aa5-a57f-c50292aea0ea tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:11.962117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-21132c7b-4ed1-463c-9116-84f4e550d2a7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:11.969299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-21132c7b-4ed1-463c-9116-84f4e550d2a7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:12.006103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21132c7b-4ed1-463c-9116-84f4e550d2a7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:12.006835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21132c7b-4ed1-463c-9116-84f4e550d2a7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:12.008294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21132c7b-4ed1-463c-9116-84f4e550d2a7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:12.009110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21132c7b-4ed1-463c-9116-84f4e550d2a7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:12.374490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-21132c7b-4ed1-463c-9116-84f4e550d2a7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:12.389663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-21132c7b-4ed1-463c-9116-84f4e550d2a7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:12.392401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-21132c7b-4ed1-463c-9116-84f4e550d2a7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:12.394659 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-21132c7b-4ed1-463c-9116-84f4e550d2a7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1339 microversion: 2.20 time: 0.440883 Aug 03 01:59:12.405675 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1355/2662] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:11 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1339 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:59:12.893838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b6487b73-ab16-48be-9cf9-cb5e0c3eaef3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:12.896397 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b6487b73-ab16-48be-9cf9-cb5e0c3eaef3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:12.907884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6487b73-ab16-48be-9cf9-cb5e0c3eaef3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:12.908807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6487b73-ab16-48be-9cf9-cb5e0c3eaef3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:12.912681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7fe2ac5e-dfbf-4aa5-a57f-c50292aea0ea tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:12.913624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6487b73-ab16-48be-9cf9-cb5e0c3eaef3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:12.914263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6487b73-ab16-48be-9cf9-cb5e0c3eaef3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:12.928330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7fe2ac5e-dfbf-4aa5-a57f-c50292aea0ea tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:12.930367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7fe2ac5e-dfbf-4aa5-a57f-c50292aea0ea tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:12.933025 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7fe2ac5e-dfbf-4aa5-a57f-c50292aea0ea tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.068822 Aug 03 01:59:12.937161 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1308/2663] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:11 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:59:13.134423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b6487b73-ab16-48be-9cf9-cb5e0c3eaef3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:13.142825 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b6487b73-ab16-48be-9cf9-cb5e0c3eaef3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1275 microversion: 2.1 time: 0.252957 Aug 03 01:59:13.156159 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1356/2664] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:12 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1275 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:59:13.433826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bf9dd062-da54-4595-bb36-d3cdb61d5d59 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:13.434470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bf9dd062-da54-4595-bb36-d3cdb61d5d59 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:13.441525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf9dd062-da54-4595-bb36-d3cdb61d5d59 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:13.441992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf9dd062-da54-4595-bb36-d3cdb61d5d59 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:13.442800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf9dd062-da54-4595-bb36-d3cdb61d5d59 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:13.443282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf9dd062-da54-4595-bb36-d3cdb61d5d59 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:13.446327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:13.952936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bf9dd062-da54-4595-bb36-d3cdb61d5d59 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:13.962825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bf9dd062-da54-4595-bb36-d3cdb61d5d59 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:13.963078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b893a400-13a5-4c93-bafc-4f8e3d42745c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:13.963714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b893a400-13a5-4c93-bafc-4f8e3d42745c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:13.978091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bf9dd062-da54-4595-bb36-d3cdb61d5d59 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:13.979673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b893a400-13a5-4c93-bafc-4f8e3d42745c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:13.980305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b893a400-13a5-4c93-bafc-4f8e3d42745c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:13.980716 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bf9dd062-da54-4595-bb36-d3cdb61d5d59 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1406 microversion: 2.20 time: 0.550694 Aug 03 01:59:13.981406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b893a400-13a5-4c93-bafc-4f8e3d42745c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:13.982123 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1309/2665] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:13 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1406 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:13.999978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b893a400-13a5-4c93-bafc-4f8e3d42745c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:14.164250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1a446b17-ab21-4470-99a7-7022e788b917 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:14.165339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1a446b17-ab21-4470-99a7-7022e788b917 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:14.179795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a446b17-ab21-4470-99a7-7022e788b917 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:14.180752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a446b17-ab21-4470-99a7-7022e788b917 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:14.183094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a446b17-ab21-4470-99a7-7022e788b917 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:14.183650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a446b17-ab21-4470-99a7-7022e788b917 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:14.633801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1a446b17-ab21-4470-99a7-7022e788b917 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:14.642491 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1a446b17-ab21-4470-99a7-7022e788b917 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1275 microversion: 2.1 time: 0.481744 Aug 03 01:59:14.648022 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1310/2666] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:14 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1275 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:14.998276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b893a400-13a5-4c93-bafc-4f8e3d42745c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:15.007374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9fff60da-8f62-4181-bfe7-b0902011e5f4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:15.008581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9fff60da-8f62-4181-bfe7-b0902011e5f4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:15.021359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fff60da-8f62-4181-bfe7-b0902011e5f4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:15.021933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fff60da-8f62-4181-bfe7-b0902011e5f4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:15.023034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fff60da-8f62-4181-bfe7-b0902011e5f4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:15.024233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fff60da-8f62-4181-bfe7-b0902011e5f4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:15.039408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b893a400-13a5-4c93-bafc-4f8e3d42745c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:15.046869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b893a400-13a5-4c93-bafc-4f8e3d42745c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:15.049378 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b893a400-13a5-4c93-bafc-4f8e3d42745c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.090102 Aug 03 01:59:15.050325 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1357/2667] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:13 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:59:15.671345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-512cc6eb-7a50-4dee-a048-16887c86a816 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:15.671963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-512cc6eb-7a50-4dee-a048-16887c86a816 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:15.685474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-512cc6eb-7a50-4dee-a048-16887c86a816 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:15.687298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-512cc6eb-7a50-4dee-a048-16887c86a816 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:15.689348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-512cc6eb-7a50-4dee-a048-16887c86a816 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:15.691454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-512cc6eb-7a50-4dee-a048-16887c86a816 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:15.979902 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9fff60da-8f62-4181-bfe7-b0902011e5f4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:15.989622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9fff60da-8f62-4181-bfe7-b0902011e5f4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:15.991277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9fff60da-8f62-4181-bfe7-b0902011e5f4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:15.992467 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9fff60da-8f62-4181-bfe7-b0902011e5f4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1406 microversion: 2.20 time: 0.989016 Aug 03 01:59:15.993072 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1311/2668] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:15 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1406 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:16.082459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6537d70d-d21a-4168-b03c-0e793805af65 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:16.085148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6537d70d-d21a-4168-b03c-0e793805af65 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:16.104721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6537d70d-d21a-4168-b03c-0e793805af65 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:16.106732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6537d70d-d21a-4168-b03c-0e793805af65 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:16.108584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6537d70d-d21a-4168-b03c-0e793805af65 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:16.110189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6537d70d-d21a-4168-b03c-0e793805af65 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:16.436376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-512cc6eb-7a50-4dee-a048-16887c86a816 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:16.499979 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-512cc6eb-7a50-4dee-a048-16887c86a816 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1317 microversion: 2.1 time: 0.824706 Aug 03 01:59:16.503721 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1358/2669] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:15 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1317 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:59:16.978359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:17.078504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6537d70d-d21a-4168-b03c-0e793805af65 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:17.114127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6537d70d-d21a-4168-b03c-0e793805af65 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:17.120584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6537d70d-d21a-4168-b03c-0e793805af65 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:17.125797 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6537d70d-d21a-4168-b03c-0e793805af65 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.054619 Aug 03 01:59:17.127274 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1312/2670] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:16 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:59:17.134456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6dbc91b0-24f3-45fb-b90e-9a3526a759a4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:17.135371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6dbc91b0-24f3-45fb-b90e-9a3526a759a4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:17.163203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dbc91b0-24f3-45fb-b90e-9a3526a759a4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:17.163981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dbc91b0-24f3-45fb-b90e-9a3526a759a4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:17.164998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dbc91b0-24f3-45fb-b90e-9a3526a759a4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:17.166666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dbc91b0-24f3-45fb-b90e-9a3526a759a4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:17.261624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9dd22f86-8527-45fb-88ac-f03c56e58ca9 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Action: 'create', calling method: .version_select at 0x7f5b1256b5e0>, body: {"keypair": {"name": "tempest-keypair-132520990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUZoPDlDrBh0Cx7tRMjSw4sOtPXX31vkNVQl4RTf2oH0OUzmbjJX0M9CCmLdHx6m4JuRlBfYRK9u4nSk8tae8iTxAyGhnRIsBbyfXAPLaSZwtj2WaYW/VsFj7vq1Xf/FA=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:17.314930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-9dd22f86-8527-45fb-88ac-f03c56e58ca9 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Getting quotas for project 9eee59a7fb1d47f1891bd1825fa25570. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:59:17.329938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-9dd22f86-8527-45fb-88ac-f03c56e58ca9 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Getting quotas for user ce42157841b14c72a73e7c32de4b5373 and project 9eee59a7fb1d47f1891bd1825fa25570. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:59:17.352684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:17.368566 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9dd22f86-8527-45fb-88ac-f03c56e58ca9 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.400934 Aug 03 01:59:17.380959 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1359/2671] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 01:59:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:17.491850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c881b843-616f-4d0d-a72a-f2989da5ee36 req-f3d71188-dd11-4377-bc2a-0e03d6905f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7d0db2-f64d-4df7-b0dd-2ecf688290b0", "tag": "1b653dfb-172c-43c5-8d81-55e28541d60d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:17.523145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c881b843-616f-4d0d-a72a-f2989da5ee36 req-f3d71188-dd11-4377-bc2a-0e03d6905f01 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:17.523798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c881b843-616f-4d0d-a72a-f2989da5ee36 req-f3d71188-dd11-4377-bc2a-0e03d6905f01 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:17.560743 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c881b843-616f-4d0d-a72a-f2989da5ee36 req-f3d71188-dd11-4377-bc2a-0e03d6905f01 service nova] Creating event network-changed:1b653dfb-172c-43c5-8d81-55e28541d60d for instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 on n-h2-826529-8 Aug 03 01:59:17.577994 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c881b843-616f-4d0d-a72a-f2989da5ee36 req-f3d71188-dd11-4377-bc2a-0e03d6905f01 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093875 Aug 03 01:59:17.579943 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1360/2672] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:59:17.592402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-79340fd0-9ff8-43b2-a389-217b937cdb6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:17.593260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-79340fd0-9ff8-43b2-a389-217b937cdb6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:17.612627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-79340fd0-9ff8-43b2-a389-217b937cdb6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:17.613753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-79340fd0-9ff8-43b2-a389-217b937cdb6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:17.614740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-79340fd0-9ff8-43b2-a389-217b937cdb6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:17.616520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-79340fd0-9ff8-43b2-a389-217b937cdb6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:18.233795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:18.401848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-79340fd0-9ff8-43b2-a389-217b937cdb6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:18.418895 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-79340fd0-9ff8-43b2-a389-217b937cdb6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1317 microversion: 2.1 time: 0.837511 Aug 03 01:59:18.423537 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1361/2673] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:17 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1317 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:18.443915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d000c822-a3fa-4553-9c60-9b40ffa47b78 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:18.444943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d000c822-a3fa-4553-9c60-9b40ffa47b78 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:18.462730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d000c822-a3fa-4553-9c60-9b40ffa47b78 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:18.463505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d000c822-a3fa-4553-9c60-9b40ffa47b78 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:18.464457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d000c822-a3fa-4553-9c60-9b40ffa47b78 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:18.464906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d000c822-a3fa-4553-9c60-9b40ffa47b78 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:18.540427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:18.560508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6dbc91b0-24f3-45fb-b90e-9a3526a759a4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:18.587944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6dbc91b0-24f3-45fb-b90e-9a3526a759a4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:18.598395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6dbc91b0-24f3-45fb-b90e-9a3526a759a4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:18.600674 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6dbc91b0-24f3-45fb-b90e-9a3526a759a4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1406 microversion: 2.20 time: 1.471658 Aug 03 01:59:18.603478 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1313/2674] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:17 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1406 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:19.159632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d000c822-a3fa-4553-9c60-9b40ffa47b78 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:19.170551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d000c822-a3fa-4553-9c60-9b40ffa47b78 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:19.173498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d000c822-a3fa-4553-9c60-9b40ffa47b78 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:19.175771 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d000c822-a3fa-4553-9c60-9b40ffa47b78 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 0.750675 Aug 03 01:59:19.176714 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1362/2675] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:18 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:19.458869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e6dd7541-ac8c-403a-91ba-7e4bb520411b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:19.474790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e6dd7541-ac8c-403a-91ba-7e4bb520411b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:19.494595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6dd7541-ac8c-403a-91ba-7e4bb520411b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:19.495833 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6dd7541-ac8c-403a-91ba-7e4bb520411b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:19.499316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6dd7541-ac8c-403a-91ba-7e4bb520411b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:19.517548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6dd7541-ac8c-403a-91ba-7e4bb520411b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:19.635970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d539b62e-21fb-4c07-8b1c-8b3e87036d1f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:19.650986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d539b62e-21fb-4c07-8b1c-8b3e87036d1f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:19.660010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d539b62e-21fb-4c07-8b1c-8b3e87036d1f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:19.660624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d539b62e-21fb-4c07-8b1c-8b3e87036d1f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:19.662478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d539b62e-21fb-4c07-8b1c-8b3e87036d1f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:19.663127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d539b62e-21fb-4c07-8b1c-8b3e87036d1f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:20.461759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e6dd7541-ac8c-403a-91ba-7e4bb520411b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:20.478652 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e6dd7541-ac8c-403a-91ba-7e4bb520411b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1317 microversion: 2.1 time: 1.035611 Aug 03 01:59:20.480683 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1314/2676] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:19 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1317 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:20.489107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-51c8b172-c836-479d-b343-41d6d38fc95b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:20.490718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-51c8b172-c836-479d-b343-41d6d38fc95b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:20.503883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51c8b172-c836-479d-b343-41d6d38fc95b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:20.505023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51c8b172-c836-479d-b343-41d6d38fc95b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:20.505751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d539b62e-21fb-4c07-8b1c-8b3e87036d1f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:20.507795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51c8b172-c836-479d-b343-41d6d38fc95b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:20.508509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51c8b172-c836-479d-b343-41d6d38fc95b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:20.520287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d539b62e-21fb-4c07-8b1c-8b3e87036d1f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:20.521935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d539b62e-21fb-4c07-8b1c-8b3e87036d1f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:20.528366 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d539b62e-21fb-4c07-8b1c-8b3e87036d1f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1406 microversion: 2.20 time: 0.900969 Aug 03 01:59:20.529528 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1363/2677] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:19 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1406 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:20.823525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-7e0a7c82-a61b-4037-b3e2-8cdd1ed87f68 req-149f9135-7290-4e68-a1d3-9c9304dabba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba033cef-0c1e-4b18-9584-427e6db2fcb1", "tag": "7291d4ce-8dad-4d1e-8529-b562facf8218"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:20.845368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7e0a7c82-a61b-4037-b3e2-8cdd1ed87f68 req-149f9135-7290-4e68-a1d3-9c9304dabba6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:20.846300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7e0a7c82-a61b-4037-b3e2-8cdd1ed87f68 req-149f9135-7290-4e68-a1d3-9c9304dabba6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:20.879482 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-7e0a7c82-a61b-4037-b3e2-8cdd1ed87f68 req-149f9135-7290-4e68-a1d3-9c9304dabba6 service nova] Creating event network-changed:7291d4ce-8dad-4d1e-8529-b562facf8218 for instance ba033cef-0c1e-4b18-9584-427e6db2fcb1 on n-h1-826529-8 Aug 03 01:59:20.895191 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-7e0a7c82-a61b-4037-b3e2-8cdd1ed87f68 req-149f9135-7290-4e68-a1d3-9c9304dabba6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075287 Aug 03 01:59:20.896450 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1364/2678] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:21.502178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c7a4303c-c8dd-4dd7-9ef6-3d620188d3fc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:21.503987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c7a4303c-c8dd-4dd7-9ef6-3d620188d3fc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:21.537481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7a4303c-c8dd-4dd7-9ef6-3d620188d3fc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:21.538093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7a4303c-c8dd-4dd7-9ef6-3d620188d3fc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:21.539065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7a4303c-c8dd-4dd7-9ef6-3d620188d3fc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:21.539511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7a4303c-c8dd-4dd7-9ef6-3d620188d3fc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:22.003390 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-51c8b172-c836-479d-b343-41d6d38fc95b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:22.023799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-51c8b172-c836-479d-b343-41d6d38fc95b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:22.025360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-51c8b172-c836-479d-b343-41d6d38fc95b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:22.026556 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-51c8b172-c836-479d-b343-41d6d38fc95b tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.544628 Aug 03 01:59:22.027819 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1315/2679] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:20 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:22.049475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3e535729-3906-4eb3-b891-e383d1b527a5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:22.050465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3e535729-3906-4eb3-b891-e383d1b527a5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:22.064589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e535729-3906-4eb3-b891-e383d1b527a5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:22.065250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e535729-3906-4eb3-b891-e383d1b527a5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:22.066363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e535729-3906-4eb3-b891-e383d1b527a5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:22.070267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e535729-3906-4eb3-b891-e383d1b527a5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:22.909682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c7a4303c-c8dd-4dd7-9ef6-3d620188d3fc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:22.921251 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c7a4303c-c8dd-4dd7-9ef6-3d620188d3fc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1317 microversion: 2.1 time: 1.424660 Aug 03 01:59:22.923724 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1365/2680] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:21 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1317 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:59:23.366796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1465250546", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "e7c5df2b-30aa-45a8-86e9-00169f99d3da"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:23.400479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3e535729-3906-4eb3-b891-e383d1b527a5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:23.414478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3e535729-3906-4eb3-b891-e383d1b527a5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:23.431608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3e535729-3906-4eb3-b891-e383d1b527a5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:23.433156 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3e535729-3906-4eb3-b891-e383d1b527a5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1406 microversion: 2.20 time: 1.404205 Aug 03 01:59:23.433991 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1316/2681] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:22 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1406 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:23.464804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e2219a57-7ad2-48c4-b2c6-a8e827a6f946 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:23.467540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e2219a57-7ad2-48c4-b2c6-a8e827a6f946 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:23.495491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2219a57-7ad2-48c4-b2c6-a8e827a6f946 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:23.496263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2219a57-7ad2-48c4-b2c6-a8e827a6f946 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:23.496684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] validate_networks() for [('e7c5df2b-30aa-45a8-86e9-00169f99d3da', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:59:23.497775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2219a57-7ad2-48c4-b2c6-a8e827a6f946 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:23.499572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2219a57-7ad2-48c4-b2c6-a8e827a6f946 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:24.414262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e2219a57-7ad2-48c4-b2c6-a8e827a6f946 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:24.435805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e2219a57-7ad2-48c4-b2c6-a8e827a6f946 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:24.437502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e2219a57-7ad2-48c4-b2c6-a8e827a6f946 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:24.440240 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e2219a57-7ad2-48c4-b2c6-a8e827a6f946 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.004871 Aug 03 01:59:24.461102 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1317/2682] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:23 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:24.468031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ba219b88-d0c1-4447-8b22-9b5745aafdb6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:24.470809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ba219b88-d0c1-4447-8b22-9b5745aafdb6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:24.481540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba219b88-d0c1-4447-8b22-9b5745aafdb6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:24.482620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba219b88-d0c1-4447-8b22-9b5745aafdb6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:24.483899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba219b88-d0c1-4447-8b22-9b5745aafdb6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:24.485226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba219b88-d0c1-4447-8b22-9b5745aafdb6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:25.527507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ba219b88-d0c1-4447-8b22-9b5745aafdb6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:25.547602 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ba219b88-d0c1-4447-8b22-9b5745aafdb6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1317 microversion: 2.1 time: 1.084977 Aug 03 01:59:25.549132 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1318/2683] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:24 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1317 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:25.561563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-017f568f-76ba-4d15-b29c-fc6a6c56743f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:25.562927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-017f568f-76ba-4d15-b29c-fc6a6c56743f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:25.571381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-017f568f-76ba-4d15-b29c-fc6a6c56743f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:25.572215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-017f568f-76ba-4d15-b29c-fc6a6c56743f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:25.573254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-017f568f-76ba-4d15-b29c-fc6a6c56743f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:25.574037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-017f568f-76ba-4d15-b29c-fc6a6c56743f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:25.723821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:59:25.724539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:59:25.725145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:59:25.725628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:59:25.726814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:59:25.746455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:25.748337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:25.750554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:25.755920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:25.826480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Getting quotas for project a679c70fd0694e078b9634f7e87d64e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:59:25.844413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Getting quotas for user ebcb7e1744d7401883a357f7671c55af and project a679c70fd0694e078b9634f7e87d64e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:59:25.888284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:59:25.895326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:59:26.013009 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f98f2e9f-07f0-4798-b4c0-fc68fb8c18aa tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.087741 Aug 03 01:59:26.020217 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1366/2684] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 01:59:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3096 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 01:59:26.055192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ec90feff-1870-45c8-972e-cc521056f78e tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:26.058077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ec90feff-1870-45c8-972e-cc521056f78e tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:26.068855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec90feff-1870-45c8-972e-cc521056f78e tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:26.069321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec90feff-1870-45c8-972e-cc521056f78e tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:26.070501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec90feff-1870-45c8-972e-cc521056f78e tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:26.076627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec90feff-1870-45c8-972e-cc521056f78e tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:26.300111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-017f568f-76ba-4d15-b29c-fc6a6c56743f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:26.325300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-017f568f-76ba-4d15-b29c-fc6a6c56743f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:26.326811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-017f568f-76ba-4d15-b29c-fc6a6c56743f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:26.339828 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-017f568f-76ba-4d15-b29c-fc6a6c56743f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1406 microversion: 2.20 time: 0.786094 Aug 03 01:59:26.342010 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1319/2685] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:25 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1406 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:26.358203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-45a5cb7f-ae10-4509-9dd8-03ef1e384f24 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:26.359040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-45a5cb7f-ae10-4509-9dd8-03ef1e384f24 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:26.595295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-45a5cb7f-ae10-4509-9dd8-03ef1e384f24 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:26.621837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-45a5cb7f-ae10-4509-9dd8-03ef1e384f24 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:26.624978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-45a5cb7f-ae10-4509-9dd8-03ef1e384f24 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:26.628903 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-45a5cb7f-ae10-4509-9dd8-03ef1e384f24 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905" status: 200 len: 1262 microversion: 2.26 time: 0.278571 Aug 03 01:59:26.629878 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1320/2686] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:26 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 => generated 1262 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:26.652794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "960a46aa-065b-4f25-ab11-0357edb3b705"}], "security_groups": [{"name": "tempest-securitygroup--1256323513"}], "key_name": "tempest-keypair-132520990", "user_data": "}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:27.001906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] validate_networks() for [('960a46aa-065b-4f25-ab11-0357edb3b705', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:59:27.171686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ec90feff-1870-45c8-972e-cc521056f78e tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:27.189673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ec90feff-1870-45c8-972e-cc521056f78e tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:27.195372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ec90feff-1870-45c8-972e-cc521056f78e tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:27.199342 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ec90feff-1870-45c8-972e-cc521056f78e tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.171057 Aug 03 01:59:27.220273 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1367/2687] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:26 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:27.225918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed3f8a48-744a-474a-ac22-4cc0feb7fbfc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:27.237314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ed3f8a48-744a-474a-ac22-4cc0feb7fbfc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:27.258384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed3f8a48-744a-474a-ac22-4cc0feb7fbfc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:27.262385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed3f8a48-744a-474a-ac22-4cc0feb7fbfc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:27.263500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed3f8a48-744a-474a-ac22-4cc0feb7fbfc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:27.264157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed3f8a48-744a-474a-ac22-4cc0feb7fbfc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:28.321767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ed3f8a48-744a-474a-ac22-4cc0feb7fbfc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:28.338531 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed3f8a48-744a-474a-ac22-4cc0feb7fbfc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1317 microversion: 2.1 time: 1.116315 Aug 03 01:59:28.340306 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1368/2688] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:27 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1317 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:28.376504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5eade739-39d0-4ce4-aedd-022516750d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:28.377735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5eade739-39d0-4ce4-aedd-022516750d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:28.403914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5eade739-39d0-4ce4-aedd-022516750d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:28.404521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5eade739-39d0-4ce4-aedd-022516750d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:28.405363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5eade739-39d0-4ce4-aedd-022516750d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:28.405997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5eade739-39d0-4ce4-aedd-022516750d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:28.998011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5eade739-39d0-4ce4-aedd-022516750d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:29.023087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5eade739-39d0-4ce4-aedd-022516750d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:29.025614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5eade739-39d0-4ce4-aedd-022516750d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:29.027045 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5eade739-39d0-4ce4-aedd-022516750d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1406 microversion: 2.20 time: 0.663319 Aug 03 01:59:29.030593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:59:29.041686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:59:29.044173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:59:29.044955 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1369/2689] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:28 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1406 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:29.045705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:59:29.050134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:59:29.052797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-0c0a5647-fc54-450b-9ee9-5455bf077cb2 req-c4cb29dd-8513-4445-8e39-8dc9c159a1ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7d0db2-f64d-4df7-b0dd-2ecf688290b0", "name": "network-vif-plugged", "status": "completed", "tag": "1b653dfb-172c-43c5-8d81-55e28541d60d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:29.070241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-0c0a5647-fc54-450b-9ee9-5455bf077cb2 req-c4cb29dd-8513-4445-8e39-8dc9c159a1ff service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:29.071529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-0c0a5647-fc54-450b-9ee9-5455bf077cb2 req-c4cb29dd-8513-4445-8e39-8dc9c159a1ff service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:29.091405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:29.091878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:29.092728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:29.098403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:29.103914 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-0c0a5647-fc54-450b-9ee9-5455bf077cb2 req-c4cb29dd-8513-4445-8e39-8dc9c159a1ff service nova] Creating event network-vif-plugged:1b653dfb-172c-43c5-8d81-55e28541d60d for instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 on n-h2-826529-8 Aug 03 01:59:29.129297 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-0c0a5647-fc54-450b-9ee9-5455bf077cb2 req-c4cb29dd-8513-4445-8e39-8dc9c159a1ff service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082471 Aug 03 01:59:29.132196 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1370/2690] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:29.156285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Getting quotas for project 9eee59a7fb1d47f1891bd1825fa25570. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:59:29.169970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-84722220-3b02-4ac5-8651-b2d6e14144e8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:29.173517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-84722220-3b02-4ac5-8651-b2d6e14144e8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:29.180345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Getting quotas for user ce42157841b14c72a73e7c32de4b5373 and project 9eee59a7fb1d47f1891bd1825fa25570. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:59:29.183276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84722220-3b02-4ac5-8651-b2d6e14144e8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:29.184191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84722220-3b02-4ac5-8651-b2d6e14144e8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:29.185986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84722220-3b02-4ac5-8651-b2d6e14144e8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:29.192236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84722220-3b02-4ac5-8651-b2d6e14144e8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:29.212162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:59:29.214961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:59:29.316894 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2424271b-833f-449e-a284-96b70545a200 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.683975 Aug 03 01:59:29.318315 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1321/2691] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:59:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 2687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 01:59:29.339918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5b68784e-a097-43f6-b770-0d639a580c72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:29.341181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5b68784e-a097-43f6-b770-0d639a580c72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:29.356219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b68784e-a097-43f6-b770-0d639a580c72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:29.356907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b68784e-a097-43f6-b770-0d639a580c72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:29.358071 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b68784e-a097-43f6-b770-0d639a580c72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:29.359043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b68784e-a097-43f6-b770-0d639a580c72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:29.444744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-84722220-3b02-4ac5-8651-b2d6e14144e8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:29.460260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-84722220-3b02-4ac5-8651-b2d6e14144e8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:29.462614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-84722220-3b02-4ac5-8651-b2d6e14144e8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:29.469616 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-84722220-3b02-4ac5-8651-b2d6e14144e8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905" status: 200 len: 1320 microversion: 2.26 time: 0.319019 Aug 03 01:59:29.479152 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1371/2692] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:29 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 => generated 1320 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:29.494320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7b79df99-0312-4f27-a204-dc54019a1cdc tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:29.496271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7b79df99-0312-4f27-a204-dc54019a1cdc tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:30.022665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7b79df99-0312-4f27-a204-dc54019a1cdc tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:30.033895 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7b79df99-0312-4f27-a204-dc54019a1cdc tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1225 microversion: 2.1 time: 0.549240 Aug 03 01:59:30.037805 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1372/2693] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:29 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1225 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:30.050730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-978dd1a8-0a92-4895-84b1-0fd3912f3a44 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:30.060581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-978dd1a8-0a92-4895-84b1-0fd3912f3a44 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:30.098417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-978dd1a8-0a92-4895-84b1-0fd3912f3a44 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:30.100689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-978dd1a8-0a92-4895-84b1-0fd3912f3a44 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:30.105882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-978dd1a8-0a92-4895-84b1-0fd3912f3a44 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:30.107643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-978dd1a8-0a92-4895-84b1-0fd3912f3a44 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:30.382648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5b68784e-a097-43f6-b770-0d639a580c72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:30.423909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5b68784e-a097-43f6-b770-0d639a580c72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:30.427856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5b68784e-a097-43f6-b770-0d639a580c72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:30.429095 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5b68784e-a097-43f6-b770-0d639a580c72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.108986 Aug 03 01:59:30.429669 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1322/2694] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:29 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:30.468771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-01951298-e801-4ef6-ab40-64b2a21a5947 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:30.472339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-01951298-e801-4ef6-ab40-64b2a21a5947 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:30.494411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01951298-e801-4ef6-ab40-64b2a21a5947 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:30.496685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01951298-e801-4ef6-ab40-64b2a21a5947 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:30.500205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01951298-e801-4ef6-ab40-64b2a21a5947 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:30.502192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01951298-e801-4ef6-ab40-64b2a21a5947 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:30.792810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-978dd1a8-0a92-4895-84b1-0fd3912f3a44 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:30.826713 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-978dd1a8-0a92-4895-84b1-0fd3912f3a44 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1317 microversion: 2.1 time: 0.783300 Aug 03 01:59:30.864072 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1373/2695] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:30 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1317 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:30.878431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-27d01ca9-b7e3-4119-a344-901bf421eed2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:30.885290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-27d01ca9-b7e3-4119-a344-901bf421eed2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:30.896314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27d01ca9-b7e3-4119-a344-901bf421eed2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:30.896774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27d01ca9-b7e3-4119-a344-901bf421eed2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:30.897559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27d01ca9-b7e3-4119-a344-901bf421eed2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:30.898009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27d01ca9-b7e3-4119-a344-901bf421eed2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:31.110507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-01951298-e801-4ef6-ab40-64b2a21a5947 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:31.124604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-01951298-e801-4ef6-ab40-64b2a21a5947 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:31.127288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-01951298-e801-4ef6-ab40-64b2a21a5947 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:31.133760 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-01951298-e801-4ef6-ab40-64b2a21a5947 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1406 microversion: 2.20 time: 0.686367 Aug 03 01:59:31.134537 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1323/2696] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:30 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1406 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:31.139640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-685702e1-d3c2-4ecf-ab87-3de2f0241054 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:31.149196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-685702e1-d3c2-4ecf-ab87-3de2f0241054 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:31.170692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-685702e1-d3c2-4ecf-ab87-3de2f0241054 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:31.174604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-685702e1-d3c2-4ecf-ab87-3de2f0241054 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:31.175855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-685702e1-d3c2-4ecf-ab87-3de2f0241054 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:31.176537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-685702e1-d3c2-4ecf-ab87-3de2f0241054 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:31.415496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-685702e1-d3c2-4ecf-ab87-3de2f0241054 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:31.435647 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-685702e1-d3c2-4ecf-ab87-3de2f0241054 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1285 microversion: 2.1 time: 0.294842 Aug 03 01:59:31.436477 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1324/2697] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:31 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1285 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:31.462983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-49a45546-aa62-4357-9321-3293ac31afbb req-efa6461f-8557-42e5-a132-b92af0ef7cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-plugged", "status": "completed", "tag": "6afd3b79-7021-42c2-850a-794d515c4eb6"}, {"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-plugged", "status": "completed", "tag": "9106a59f-415c-4da3-93ee-ae5f0c636a4a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:31.495030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-49a45546-aa62-4357-9321-3293ac31afbb req-efa6461f-8557-42e5-a132-b92af0ef7cd4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:31.495724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-49a45546-aa62-4357-9321-3293ac31afbb req-efa6461f-8557-42e5-a132-b92af0ef7cd4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:31.541287 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-49a45546-aa62-4357-9321-3293ac31afbb req-efa6461f-8557-42e5-a132-b92af0ef7cd4 service nova] Creating event network-vif-plugged:6afd3b79-7021-42c2-850a-794d515c4eb6 for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 01:59:31.541805 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-49a45546-aa62-4357-9321-3293ac31afbb req-efa6461f-8557-42e5-a132-b92af0ef7cd4 service nova] Creating event network-vif-plugged:9106a59f-415c-4da3-93ee-ae5f0c636a4a for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 01:59:31.553748 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-49a45546-aa62-4357-9321-3293ac31afbb req-efa6461f-8557-42e5-a132-b92af0ef7cd4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102728 Aug 03 01:59:31.559022 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1325/2698] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:31.567902 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c5d177af-a1ae-4a32-9c96-5a96480b91a7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:31.569691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c5d177af-a1ae-4a32-9c96-5a96480b91a7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:31.581376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5d177af-a1ae-4a32-9c96-5a96480b91a7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:31.582198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5d177af-a1ae-4a32-9c96-5a96480b91a7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:31.583354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5d177af-a1ae-4a32-9c96-5a96480b91a7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:31.584015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5d177af-a1ae-4a32-9c96-5a96480b91a7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:31.996245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-27d01ca9-b7e3-4119-a344-901bf421eed2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:32.012677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-27d01ca9-b7e3-4119-a344-901bf421eed2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:32.014556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-27d01ca9-b7e3-4119-a344-901bf421eed2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:32.016050 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-27d01ca9-b7e3-4119-a344-901bf421eed2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905" status: 200 len: 1362 microversion: 2.26 time: 1.145943 Aug 03 01:59:32.017523 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1374/2699] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:30 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 => generated 1362 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:32.028027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c6375acf-070f-4487-8df0-c46392371be6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:32.031860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c6375acf-070f-4487-8df0-c46392371be6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:32.069634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6375acf-070f-4487-8df0-c46392371be6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:32.070470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6375acf-070f-4487-8df0-c46392371be6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:32.092724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6375acf-070f-4487-8df0-c46392371be6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:32.093206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6375acf-070f-4487-8df0-c46392371be6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:32.811121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c5d177af-a1ae-4a32-9c96-5a96480b91a7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:32.836731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c5d177af-a1ae-4a32-9c96-5a96480b91a7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:32.837212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c5d177af-a1ae-4a32-9c96-5a96480b91a7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:32.838761 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c5d177af-a1ae-4a32-9c96-5a96480b91a7 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.277198 Aug 03 01:59:32.839626 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1326/2700] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:31 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:32.858473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ac83ba2e-778d-4758-897d-7bf416a74e7a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:32.859415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ac83ba2e-778d-4758-897d-7bf416a74e7a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:32.875224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac83ba2e-778d-4758-897d-7bf416a74e7a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:32.875988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac83ba2e-778d-4758-897d-7bf416a74e7a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:32.877207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac83ba2e-778d-4758-897d-7bf416a74e7a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:32.877927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac83ba2e-778d-4758-897d-7bf416a74e7a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:32.920183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c6375acf-070f-4487-8df0-c46392371be6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:32.936083 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c6375acf-070f-4487-8df0-c46392371be6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1317 microversion: 2.1 time: 0.916248 Aug 03 01:59:32.939602 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1375/2701] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:32 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1317 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:32.950672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-186c4762-9fca-4cd9-9843-2faf5b6ab551 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:32.957199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-186c4762-9fca-4cd9-9843-2faf5b6ab551 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:32.981588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-186c4762-9fca-4cd9-9843-2faf5b6ab551 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:32.982459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-186c4762-9fca-4cd9-9843-2faf5b6ab551 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:32.983611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-186c4762-9fca-4cd9-9843-2faf5b6ab551 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:32.986876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-186c4762-9fca-4cd9-9843-2faf5b6ab551 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:32.991939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:33.341574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-186c4762-9fca-4cd9-9843-2faf5b6ab551 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:33.355228 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-186c4762-9fca-4cd9-9843-2faf5b6ab551 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1283 microversion: 2.1 time: 0.411963 Aug 03 01:59:33.363163 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1376/2702] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:32 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1283 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:33.376390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e609fc9f-710d-4926-a0be-362a58e3e3b2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:33.377203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e609fc9f-710d-4926-a0be-362a58e3e3b2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:33.395611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e609fc9f-710d-4926-a0be-362a58e3e3b2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:33.396067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e609fc9f-710d-4926-a0be-362a58e3e3b2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:33.396854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e609fc9f-710d-4926-a0be-362a58e3e3b2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:33.403680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e609fc9f-710d-4926-a0be-362a58e3e3b2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:33.570865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ac83ba2e-778d-4758-897d-7bf416a74e7a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:33.585584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ac83ba2e-778d-4758-897d-7bf416a74e7a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:33.588795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ac83ba2e-778d-4758-897d-7bf416a74e7a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:33.591233 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ac83ba2e-778d-4758-897d-7bf416a74e7a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1598 microversion: 2.20 time: 0.750136 Aug 03 01:59:33.592968 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1327/2703] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:32 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1598 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:33.637087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4e3678a6-22c8-410e-943b-82bba58c8da4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:33.638616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4e3678a6-22c8-410e-943b-82bba58c8da4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:33.651428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e3678a6-22c8-410e-943b-82bba58c8da4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:33.652175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e3678a6-22c8-410e-943b-82bba58c8da4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:33.653161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e3678a6-22c8-410e-943b-82bba58c8da4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:33.653769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e3678a6-22c8-410e-943b-82bba58c8da4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:33.685254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:33.846862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e609fc9f-710d-4926-a0be-362a58e3e3b2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:33.871205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e609fc9f-710d-4926-a0be-362a58e3e3b2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:33.872835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e609fc9f-710d-4926-a0be-362a58e3e3b2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:33.881577 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e609fc9f-710d-4926-a0be-362a58e3e3b2 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905" status: 200 len: 1362 microversion: 2.26 time: 0.516381 Aug 03 01:59:33.882439 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1377/2704] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:33 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 => generated 1362 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:33.900551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f3e67eb3-3acf-4e7e-9a04-25bf710cacd6 req-cd677124-40cf-4b09-b395-2ae66eac7634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-plugged", "status": "completed", "tag": "0956e1fb-7c38-41ed-9df3-a9cd8fe4b445"}, {"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-plugged", "status": "completed", "tag": "65cef764-1eae-46de-942f-7f9098703fc5"}, {"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-plugged", "status": "completed", "tag": "de5bbd3b-5e5b-4a91-bb47-0b6cfdc6c874"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:33.927358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f3e67eb3-3acf-4e7e-9a04-25bf710cacd6 req-cd677124-40cf-4b09-b395-2ae66eac7634 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:33.929086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f3e67eb3-3acf-4e7e-9a04-25bf710cacd6 req-cd677124-40cf-4b09-b395-2ae66eac7634 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:33.956747 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4e3678a6-22c8-410e-943b-82bba58c8da4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.329882 Aug 03 01:59:33.958706 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1328/2705] 10.222.0.67 () {60 vars in 1316 bytes} [Wed Aug 3 01:59:33 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-interface => generated 284 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 01:59:33.972173 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f3e67eb3-3acf-4e7e-9a04-25bf710cacd6 req-cd677124-40cf-4b09-b395-2ae66eac7634 service nova] Creating event network-vif-plugged:0956e1fb-7c38-41ed-9df3-a9cd8fe4b445 for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 01:59:33.974040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-30af2e89-24db-43ee-83d6-00a6246db11a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:33.974412 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f3e67eb3-3acf-4e7e-9a04-25bf710cacd6 req-cd677124-40cf-4b09-b395-2ae66eac7634 service nova] Creating event network-vif-plugged:65cef764-1eae-46de-942f-7f9098703fc5 for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 01:59:33.974745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-30af2e89-24db-43ee-83d6-00a6246db11a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:33.976602 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f3e67eb3-3acf-4e7e-9a04-25bf710cacd6 req-cd677124-40cf-4b09-b395-2ae66eac7634 service nova] Creating event network-vif-plugged:de5bbd3b-5e5b-4a91-bb47-0b6cfdc6c874 for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 01:59:33.990540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30af2e89-24db-43ee-83d6-00a6246db11a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:33.991489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30af2e89-24db-43ee-83d6-00a6246db11a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:33.992317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30af2e89-24db-43ee-83d6-00a6246db11a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:33.992702 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f3e67eb3-3acf-4e7e-9a04-25bf710cacd6 req-cd677124-40cf-4b09-b395-2ae66eac7634 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.107645 Aug 03 01:59:33.996364 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1378/2706] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:33.996796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30af2e89-24db-43ee-83d6-00a6246db11a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:34.009853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9b37f3f1-1fce-45ed-b07b-42b97b3e267e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:34.014752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9b37f3f1-1fce-45ed-b07b-42b97b3e267e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:34.029390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b37f3f1-1fce-45ed-b07b-42b97b3e267e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:34.033093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b37f3f1-1fce-45ed-b07b-42b97b3e267e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:34.034224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b37f3f1-1fce-45ed-b07b-42b97b3e267e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:34.036915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b37f3f1-1fce-45ed-b07b-42b97b3e267e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:34.648357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9b37f3f1-1fce-45ed-b07b-42b97b3e267e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:34.660437 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9b37f3f1-1fce-45ed-b07b-42b97b3e267e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1317 microversion: 2.1 time: 0.659146 Aug 03 01:59:34.675145 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1379/2707] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:33 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:34.681028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dbef3b56-cab8-4d05-ab4f-de438eb47660 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:34.681954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dbef3b56-cab8-4d05-ab4f-de438eb47660 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:34.691579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbef3b56-cab8-4d05-ab4f-de438eb47660 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:34.692294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbef3b56-cab8-4d05-ab4f-de438eb47660 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:34.693297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbef3b56-cab8-4d05-ab4f-de438eb47660 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:34.694451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbef3b56-cab8-4d05-ab4f-de438eb47660 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:34.987195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dbef3b56-cab8-4d05-ab4f-de438eb47660 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:35.005251 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dbef3b56-cab8-4d05-ab4f-de438eb47660 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1283 microversion: 2.1 time: 0.328737 Aug 03 01:59:35.008379 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1380/2708] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:34 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1283 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:35.014878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ddbd63f7-b940-4771-a06b-ec0d3be50699 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:35.016322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ddbd63f7-b940-4771-a06b-ec0d3be50699 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:35.035871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-30af2e89-24db-43ee-83d6-00a6246db11a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:35.052055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddbd63f7-b940-4771-a06b-ec0d3be50699 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:35.053513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddbd63f7-b940-4771-a06b-ec0d3be50699 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:35.057866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddbd63f7-b940-4771-a06b-ec0d3be50699 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:35.059603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-30af2e89-24db-43ee-83d6-00a6246db11a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:35.061125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddbd63f7-b940-4771-a06b-ec0d3be50699 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:35.074985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-30af2e89-24db-43ee-83d6-00a6246db11a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:35.083378 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-30af2e89-24db-43ee-83d6-00a6246db11a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 1.119004 Aug 03 01:59:35.086377 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1329/2709] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:33 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:35.272577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-c27a216f-095a-4537-af34-91a5cd9e605d req-1af05b11-dd4b-4141-8faf-8495faaeefa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905", "tag": "bda9830a-35f9-4244-a00c-fbc8d7049100"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:35.295047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c27a216f-095a-4537-af34-91a5cd9e605d req-1af05b11-dd4b-4141-8faf-8495faaeefa5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:35.295518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c27a216f-095a-4537-af34-91a5cd9e605d req-1af05b11-dd4b-4141-8faf-8495faaeefa5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:35.322336 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c27a216f-095a-4537-af34-91a5cd9e605d req-1af05b11-dd4b-4141-8faf-8495faaeefa5 service nova] Creating event network-changed:bda9830a-35f9-4244-a00c-fbc8d7049100 for instance 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 on n-h2-826529-8 Aug 03 01:59:35.337208 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-c27a216f-095a-4537-af34-91a5cd9e605d req-1af05b11-dd4b-4141-8faf-8495faaeefa5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069403 Aug 03 01:59:35.338781 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1330/2710] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:59:35.684032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9934b1db-da09-4b36-bc07-dc5d1b0a2f99 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:35.684757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9934b1db-da09-4b36-bc07-dc5d1b0a2f99 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:35.701830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9934b1db-da09-4b36-bc07-dc5d1b0a2f99 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:35.703445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9934b1db-da09-4b36-bc07-dc5d1b0a2f99 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:35.705578 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9934b1db-da09-4b36-bc07-dc5d1b0a2f99 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:35.707013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9934b1db-da09-4b36-bc07-dc5d1b0a2f99 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:35.748102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ddbd63f7-b940-4771-a06b-ec0d3be50699 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:35.778681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ddbd63f7-b940-4771-a06b-ec0d3be50699 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:35.783467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ddbd63f7-b940-4771-a06b-ec0d3be50699 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:35.786191 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ddbd63f7-b940-4771-a06b-ec0d3be50699 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905" status: 200 len: 1362 microversion: 2.26 time: 0.775854 Aug 03 01:59:35.788387 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1381/2711] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:35 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 => generated 1362 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:36.030973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6433f7de-8822-43b3-85a3-2b61d7e045bf tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:36.032297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6433f7de-8822-43b3-85a3-2b61d7e045bf tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:36.043823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:36.051743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6433f7de-8822-43b3-85a3-2b61d7e045bf tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:36.052506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6433f7de-8822-43b3-85a3-2b61d7e045bf tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:36.059912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6433f7de-8822-43b3-85a3-2b61d7e045bf tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:36.061155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6433f7de-8822-43b3-85a3-2b61d7e045bf tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:36.463157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9934b1db-da09-4b36-bc07-dc5d1b0a2f99 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:36.482104 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9934b1db-da09-4b36-bc07-dc5d1b0a2f99 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1317 microversion: 2.1 time: 0.803106 Aug 03 01:59:36.485903 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1331/2712] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:35 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1317 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:59:36.500011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-36afe3e4-d80c-4a0c-a7a9-f143475d8476 req-94d17af7-d7f3-467c-ab07-63d6d37f40af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-plugged", "status": "completed", "tag": "2f376776-be8e-4267-a6c7-1496121c265b"}, {"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-plugged", "status": "completed", "tag": "c455abfe-c5d9-4600-90ed-3417c36c463c"}, {"server_uuid": "ba033cef-0c1e-4b18-9584-427e6db2fcb1", "name": "network-vif-plugged", "status": "completed", "tag": "7291d4ce-8dad-4d1e-8529-b562facf8218"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:36.518067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-36afe3e4-d80c-4a0c-a7a9-f143475d8476 req-94d17af7-d7f3-467c-ab07-63d6d37f40af service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:36.518980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-36afe3e4-d80c-4a0c-a7a9-f143475d8476 req-94d17af7-d7f3-467c-ab07-63d6d37f40af service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:36.545958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6433f7de-8822-43b3-85a3-2b61d7e045bf tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:36.546873 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-36afe3e4-d80c-4a0c-a7a9-f143475d8476 req-94d17af7-d7f3-467c-ab07-63d6d37f40af service nova] Creating event network-vif-plugged:2f376776-be8e-4267-a6c7-1496121c265b for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 01:59:36.550741 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-36afe3e4-d80c-4a0c-a7a9-f143475d8476 req-94d17af7-d7f3-467c-ab07-63d6d37f40af service nova] Creating event network-vif-plugged:c455abfe-c5d9-4600-90ed-3417c36c463c for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 01:59:36.552079 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-36afe3e4-d80c-4a0c-a7a9-f143475d8476 req-94d17af7-d7f3-467c-ab07-63d6d37f40af service nova] Creating event network-vif-plugged:7291d4ce-8dad-4d1e-8529-b562facf8218 for instance ba033cef-0c1e-4b18-9584-427e6db2fcb1 on n-h1-826529-8 Aug 03 01:59:36.555115 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6433f7de-8822-43b3-85a3-2b61d7e045bf tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1351 microversion: 2.1 time: 0.527492 Aug 03 01:59:36.556121 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1382/2713] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:36 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1351 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:59:36.563558 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-36afe3e4-d80c-4a0c-a7a9-f143475d8476 req-94d17af7-d7f3-467c-ab07-63d6d37f40af service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.072329 Aug 03 01:59:36.565619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7c045e1b-fed1-4ed2-b0eb-105481448c2f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:36.566696 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1332/2714] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:36.568005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7c045e1b-fed1-4ed2-b0eb-105481448c2f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:36.596047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c045e1b-fed1-4ed2-b0eb-105481448c2f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:36.597726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c045e1b-fed1-4ed2-b0eb-105481448c2f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:36.606573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c045e1b-fed1-4ed2-b0eb-105481448c2f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:36.611087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c045e1b-fed1-4ed2-b0eb-105481448c2f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:36.818230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4b7e5cb2-8e0c-46e1-85fc-a5f300bae177 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:36.819631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4b7e5cb2-8e0c-46e1-85fc-a5f300bae177 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:36.831236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b7e5cb2-8e0c-46e1-85fc-a5f300bae177 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:36.832085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b7e5cb2-8e0c-46e1-85fc-a5f300bae177 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:36.834063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b7e5cb2-8e0c-46e1-85fc-a5f300bae177 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:36.834788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b7e5cb2-8e0c-46e1-85fc-a5f300bae177 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:37.305909 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7c045e1b-fed1-4ed2-b0eb-105481448c2f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:37.316467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7c045e1b-fed1-4ed2-b0eb-105481448c2f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:37.318466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7c045e1b-fed1-4ed2-b0eb-105481448c2f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:37.320331 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7c045e1b-fed1-4ed2-b0eb-105481448c2f tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 0.762945 Aug 03 01:59:37.321034 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1383/2715] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:36 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:37.499856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-12b7e6f8-bb49-4c25-988f-1a643e0a07ed tempest-QuotaClassesAdminTestJSON-2006287891 tempest-QuotaClassesAdminTestJSON-2006287891-project-admin] Calling method '.version_select at 0x7f5b125e1310>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:37.501082 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:59:37.501082 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 01:59:37.509964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=21 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:37.514058 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-12b7e6f8-bb49-4c25-988f-1a643e0a07ed tempest-QuotaClassesAdminTestJSON-2006287891 tempest-QuotaClassesAdminTestJSON-2006287891-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.191591 Aug 03 01:59:37.522350 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1384/2716] 10.222.0.67 () {58 vars in 1185 bytes} [Wed Aug 3 01:59:37 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:37.528272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-930cc383-4e46-49af-b83f-95fc3e8ac915 req-799cb578-08de-46ad-ae3b-7f8711f9ae5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7d0db2-f64d-4df7-b0dd-2ecf688290b0", "tag": "1b653dfb-172c-43c5-8d81-55e28541d60d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:37.540728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-930cc383-4e46-49af-b83f-95fc3e8ac915 req-799cb578-08de-46ad-ae3b-7f8711f9ae5b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:37.541179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-930cc383-4e46-49af-b83f-95fc3e8ac915 req-799cb578-08de-46ad-ae3b-7f8711f9ae5b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:37.555694 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-930cc383-4e46-49af-b83f-95fc3e8ac915 req-799cb578-08de-46ad-ae3b-7f8711f9ae5b service nova] Creating event network-changed:1b653dfb-172c-43c5-8d81-55e28541d60d for instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 on n-h2-826529-8 Aug 03 01:59:37.562326 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-930cc383-4e46-49af-b83f-95fc3e8ac915 req-799cb578-08de-46ad-ae3b-7f8711f9ae5b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036937 Aug 03 01:59:37.564745 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1385/2717] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:37.570398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8744556-e75d-46bf-b362-d9251d00ebef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:37.571150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8744556-e75d-46bf-b362-d9251d00ebef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:37.578490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8744556-e75d-46bf-b362-d9251d00ebef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:37.579704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8744556-e75d-46bf-b362-d9251d00ebef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:37.580465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8744556-e75d-46bf-b362-d9251d00ebef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:37.581002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8744556-e75d-46bf-b362-d9251d00ebef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:37.790299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4b7e5cb2-8e0c-46e1-85fc-a5f300bae177 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:37.805995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4b7e5cb2-8e0c-46e1-85fc-a5f300bae177 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:37.812655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4b7e5cb2-8e0c-46e1-85fc-a5f300bae177 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:37.815336 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4b7e5cb2-8e0c-46e1-85fc-a5f300bae177 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905" status: 200 len: 1362 microversion: 2.26 time: 1.006920 Aug 03 01:59:37.818468 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1333/2718] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:36 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 => generated 1362 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:37.824454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f3b0a19d-6603-4d5a-b6ed-def65d98c3a0 tempest-QuotaClassesAdminTestJSON-2006287891 tempest-QuotaClassesAdminTestJSON-2006287891-project-admin] Action: 'update', calling method: .version_select at 0x7f5b12801820>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:37.828314 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:59:37.828314 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:59:38.023366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:UPDATE=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:38.112026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8744556-e75d-46bf-b362-d9251d00ebef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:38.123504 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8744556-e75d-46bf-b362-d9251d00ebef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1317 microversion: 2.1 time: 0.557263 Aug 03 01:59:38.127329 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1386/2719] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:37 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:38.132677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8ab0eda9-686b-467a-9c71-8f83df9c6a92 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:38.136993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8ab0eda9-686b-467a-9c71-8f83df9c6a92 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:38.144298 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f3b0a19d-6603-4d5a-b6ed-def65d98c3a0 tempest-QuotaClassesAdminTestJSON-2006287891 tempest-QuotaClassesAdminTestJSON-2006287891-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.324406 Aug 03 01:59:38.145202 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1334/2720] 10.222.0.67 () {60 vars in 1206 bytes} [Wed Aug 3 01:59:37 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:38.161683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ab0eda9-686b-467a-9c71-8f83df9c6a92 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:38.162242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ab0eda9-686b-467a-9c71-8f83df9c6a92 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:38.163419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ab0eda9-686b-467a-9c71-8f83df9c6a92 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:38.164097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ab0eda9-686b-467a-9c71-8f83df9c6a92 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:38.169398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1f69377c-ff74-4d00-8f71-247ccc00a40b tempest-QuotaClassesAdminTestJSON-2006287891 tempest-QuotaClassesAdminTestJSON-2006287891-project-admin] Calling method '.version_select at 0x7f5b243d8550>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:38.170688 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 01:59:38.170688 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 01:59:38.196069 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1f69377c-ff74-4d00-8f71-247ccc00a40b tempest-QuotaClassesAdminTestJSON-2006287891 tempest-QuotaClassesAdminTestJSON-2006287891-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.040455 Aug 03 01:59:38.198820 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1335/2721] 10.222.0.67 () {58 vars in 1185 bytes} [Wed Aug 3 01:59:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:38.212840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5f74bb5e-2024-4f1f-b6f1-3b18f03ff106 tempest-QuotaClassesAdminTestJSON-2006287891 tempest-QuotaClassesAdminTestJSON-2006287891-project-admin] Action: 'update', calling method: .version_select at 0x7f5b128698b0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:38.398463 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5f74bb5e-2024-4f1f-b6f1-3b18f03ff106 tempest-QuotaClassesAdminTestJSON-2006287891 tempest-QuotaClassesAdminTestJSON-2006287891-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.188600 Aug 03 01:59:38.399464 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1336/2722] 10.222.0.67 () {60 vars in 1206 bytes} [Wed Aug 3 01:59:38 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:38.404146 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-166e7982-d07b-4e82-9f15-2a29060c0168 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:38.404770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-166e7982-d07b-4e82-9f15-2a29060c0168 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:38.412588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-166e7982-d07b-4e82-9f15-2a29060c0168 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:38.413152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-166e7982-d07b-4e82-9f15-2a29060c0168 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:38.413967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-166e7982-d07b-4e82-9f15-2a29060c0168 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:38.414485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-166e7982-d07b-4e82-9f15-2a29060c0168 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:39.045857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-166e7982-d07b-4e82-9f15-2a29060c0168 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:39.076139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-166e7982-d07b-4e82-9f15-2a29060c0168 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:39.077958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-166e7982-d07b-4e82-9f15-2a29060c0168 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:39.079794 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-166e7982-d07b-4e82-9f15-2a29060c0168 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1880 microversion: 2.32 time: 0.679341 Aug 03 01:59:39.080369 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1337/2723] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:38 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1880 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:39.105522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fe90419d-81cf-4787-a963-9b5dd781f542 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:39.106148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fe90419d-81cf-4787-a963-9b5dd781f542 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:39.114517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe90419d-81cf-4787-a963-9b5dd781f542 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:39.115622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe90419d-81cf-4787-a963-9b5dd781f542 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:39.117254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe90419d-81cf-4787-a963-9b5dd781f542 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:39.117963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe90419d-81cf-4787-a963-9b5dd781f542 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:39.126454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:39.304921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8ab0eda9-686b-467a-9c71-8f83df9c6a92 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:39.314028 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8ab0eda9-686b-467a-9c71-8f83df9c6a92 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1351 microversion: 2.1 time: 1.184718 Aug 03 01:59:39.315104 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1387/2724] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:38 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1351 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:39.321783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-02868d47-efbd-4846-b8e5-b5888dacd979 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:39.322626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-02868d47-efbd-4846-b8e5-b5888dacd979 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:39.329987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02868d47-efbd-4846-b8e5-b5888dacd979 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:39.330681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02868d47-efbd-4846-b8e5-b5888dacd979 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:39.331525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02868d47-efbd-4846-b8e5-b5888dacd979 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:39.332121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02868d47-efbd-4846-b8e5-b5888dacd979 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:39.778998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fe90419d-81cf-4787-a963-9b5dd781f542 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:39.790637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fe90419d-81cf-4787-a963-9b5dd781f542 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:39.792480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fe90419d-81cf-4787-a963-9b5dd781f542 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:39.793746 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fe90419d-81cf-4787-a963-9b5dd781f542 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905" status: 200 len: 1362 microversion: 2.26 time: 0.692151 Aug 03 01:59:39.794398 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1338/2725] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:39 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 => generated 1362 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:39.992263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-02868d47-efbd-4846-b8e5-b5888dacd979 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:40.004282 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-02868d47-efbd-4846-b8e5-b5888dacd979 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1466 microversion: 2.1 time: 0.687933 Aug 03 01:59:40.023144 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1388/2726] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:39 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1466 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:40.084044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-cfe58a59-a3be-411b-b500-c3fecd15ed91 req-2e841f2e-a546-4555-8c71-2ebbfc10a1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0854fcf5-4f57-475f-90e1-168756cd85ec", "tag": "68bee7ad-303d-4e02-8c6b-ac1919fcdfd4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:40.104031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-cfe58a59-a3be-411b-b500-c3fecd15ed91 req-2e841f2e-a546-4555-8c71-2ebbfc10a1e7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:40.104532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-cfe58a59-a3be-411b-b500-c3fecd15ed91 req-2e841f2e-a546-4555-8c71-2ebbfc10a1e7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:40.122674 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-cfe58a59-a3be-411b-b500-c3fecd15ed91 req-2e841f2e-a546-4555-8c71-2ebbfc10a1e7 service nova] Creating event network-changed:68bee7ad-303d-4e02-8c6b-ac1919fcdfd4 for instance 0854fcf5-4f57-475f-90e1-168756cd85ec on n-h1-826529-8 Aug 03 01:59:40.141072 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-cfe58a59-a3be-411b-b500-c3fecd15ed91 req-2e841f2e-a546-4555-8c71-2ebbfc10a1e7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060572 Aug 03 01:59:40.141874 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1389/2727] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:40.147328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-69db7f29-bd4b-45e3-a037-b97c1e52d9a4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:40.148024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-69db7f29-bd4b-45e3-a037-b97c1e52d9a4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:40.175606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69db7f29-bd4b-45e3-a037-b97c1e52d9a4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:40.176270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69db7f29-bd4b-45e3-a037-b97c1e52d9a4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:40.177067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69db7f29-bd4b-45e3-a037-b97c1e52d9a4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:40.177647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69db7f29-bd4b-45e3-a037-b97c1e52d9a4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:40.414624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9f91ab48-64ee-4780-81e5-e30f0ce11f7d tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:40.415301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9f91ab48-64ee-4780-81e5-e30f0ce11f7d tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:40.422398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f91ab48-64ee-4780-81e5-e30f0ce11f7d tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:40.423585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f91ab48-64ee-4780-81e5-e30f0ce11f7d tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:40.424376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f91ab48-64ee-4780-81e5-e30f0ce11f7d tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:40.424813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f91ab48-64ee-4780-81e5-e30f0ce11f7d tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:41.158053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-69db7f29-bd4b-45e3-a037-b97c1e52d9a4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:41.172014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-69db7f29-bd4b-45e3-a037-b97c1e52d9a4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:41.174166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-69db7f29-bd4b-45e3-a037-b97c1e52d9a4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:41.180591 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-69db7f29-bd4b-45e3-a037-b97c1e52d9a4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2834 microversion: 2.32 time: 1.037232 Aug 03 01:59:41.188740 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1390/2728] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:40 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2834 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:41.193917 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3130bc7e-bd62-4cc8-8cce-cc8364f4efc4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:41.194540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3130bc7e-bd62-4cc8-8cce-cc8364f4efc4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:41.213180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3130bc7e-bd62-4cc8-8cce-cc8364f4efc4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:41.213621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3130bc7e-bd62-4cc8-8cce-cc8364f4efc4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:41.214376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3130bc7e-bd62-4cc8-8cce-cc8364f4efc4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:41.214821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3130bc7e-bd62-4cc8-8cce-cc8364f4efc4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:41.571269 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9f91ab48-64ee-4780-81e5-e30f0ce11f7d tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1617 microversion: 2.1 time: 1.545747 Aug 03 01:59:41.582994 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1339/2729] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:40 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1617 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:41.582994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6a92f8ad-e5f8-493c-9d18-dc1b5a55e37c tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:41.582994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6a92f8ad-e5f8-493c-9d18-dc1b5a55e37c tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:41.584266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3130bc7e-bd62-4cc8-8cce-cc8364f4efc4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:41.584793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a92f8ad-e5f8-493c-9d18-dc1b5a55e37c tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:41.585439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a92f8ad-e5f8-493c-9d18-dc1b5a55e37c tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:41.586438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a92f8ad-e5f8-493c-9d18-dc1b5a55e37c tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:41.587226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a92f8ad-e5f8-493c-9d18-dc1b5a55e37c tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:41.601643 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3130bc7e-bd62-4cc8-8cce-cc8364f4efc4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1351 microversion: 2.1 time: 0.411346 Aug 03 01:59:41.604788 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1391/2730] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:41 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1351 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:41.617821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-d81675ea-060f-4242-8de7-fcbdbd36e683 req-841cf749-4e8b-4237-898c-5c5522c8a9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905", "name": "network-vif-plugged", "status": "completed", "tag": "bda9830a-35f9-4244-a00c-fbc8d7049100"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:41.643636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d81675ea-060f-4242-8de7-fcbdbd36e683 req-841cf749-4e8b-4237-898c-5c5522c8a9a4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:41.644394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d81675ea-060f-4242-8de7-fcbdbd36e683 req-841cf749-4e8b-4237-898c-5c5522c8a9a4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:41.661656 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-d81675ea-060f-4242-8de7-fcbdbd36e683 req-841cf749-4e8b-4237-898c-5c5522c8a9a4 service nova] Creating event network-vif-plugged:bda9830a-35f9-4244-a00c-fbc8d7049100 for instance 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 on n-h2-826529-8 Aug 03 01:59:41.668095 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-d81675ea-060f-4242-8de7-fcbdbd36e683 req-841cf749-4e8b-4237-898c-5c5522c8a9a4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059237 Aug 03 01:59:41.669279 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1392/2731] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:41.678328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-175acb02-a119-415c-a638-dc6a36137307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:41.679262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-175acb02-a119-415c-a638-dc6a36137307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:41.686643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-175acb02-a119-415c-a638-dc6a36137307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:41.687747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-175acb02-a119-415c-a638-dc6a36137307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:41.689192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-175acb02-a119-415c-a638-dc6a36137307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:41.689860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-175acb02-a119-415c-a638-dc6a36137307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:41.964111 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-175acb02-a119-415c-a638-dc6a36137307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.293180 Aug 03 01:59:41.975364 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1393/2732] 10.222.0.67 () {60 vars in 1316 bytes} [Wed Aug 3 01:59:41 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174/os-interface => generated 1832 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:41.980721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0b7dc503-2393-45c3-8161-807d23829786 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Action: 'create', calling method: .version_select at 0x7f5b12502c10>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1256884779", "policies": ["affinity"]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:42.015892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-0b7dc503-2393-45c3-8161-807d23829786 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:59:42.022580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-0b7dc503-2393-45c3-8161-807d23829786 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:59:42.027225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6a92f8ad-e5f8-493c-9d18-dc1b5a55e37c tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:42.048470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:42.055581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6a92f8ad-e5f8-493c-9d18-dc1b5a55e37c tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:42.058217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6a92f8ad-e5f8-493c-9d18-dc1b5a55e37c tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:42.066155 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6a92f8ad-e5f8-493c-9d18-dc1b5a55e37c tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905" status: 200 len: 1362 microversion: 2.26 time: 0.490038 Aug 03 01:59:42.067164 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1340/2733] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:41 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 => generated 1362 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:42.083476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-0b7dc503-2393-45c3-8161-807d23829786 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:59:42.093885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-0b7dc503-2393-45c3-8161-807d23829786 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:59:42.119250 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0b7dc503-2393-45c3-8161-807d23829786 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.142532 Aug 03 01:59:42.119858 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1394/2734] 10.222.0.67 () {60 vars in 1174 bytes} [Wed Aug 3 01:59:41 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:42.258254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-685787617", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "6ca1c80e-8953-4e0a-a575-873d5f4c5235"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:42.334250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 01:59:42.626170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-23d00d73-e030-4fd1-bb84-8bd74936fcd4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:42.629195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-23d00d73-e030-4fd1-bb84-8bd74936fcd4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:42.639677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23d00d73-e030-4fd1-bb84-8bd74936fcd4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:42.640492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23d00d73-e030-4fd1-bb84-8bd74936fcd4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:42.642148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23d00d73-e030-4fd1-bb84-8bd74936fcd4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:42.642924 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23d00d73-e030-4fd1-bb84-8bd74936fcd4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:42.769297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 01:59:42.770367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 01:59:42.771077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 01:59:42.771492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 01:59:42.772066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 01:59:42.792546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:42.793014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:42.794513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:42.795318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:42.821609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:59:42.830168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:59:42.846311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Going to run 2 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 01:59:42.848734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: d9c4a0e5-24a7-4482-9879-3f6763ea0fb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:59:42.895476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=125942) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 03 01:59:42.919237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:59:42.926489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:59:42.984460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:59:42.991634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-23d00d73-e030-4fd1-bb84-8bd74936fcd4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:43.002495 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-23d00d73-e030-4fd1-bb84-8bd74936fcd4 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1351 microversion: 2.1 time: 0.380525 Aug 03 01:59:43.015154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:59:43.020426 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1395/2735] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:42 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1351 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:59:43.031123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=d9c4a0e5-24a7-4482-9879-3f6763ea0fb0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 01:59:43.082749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=16,nova_api:INSERT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:43.092758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6ddbb000-6884-4284-b511-a4c382558ba5 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:43.093493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6ddbb000-6884-4284-b511-a4c382558ba5 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:43.104781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ddbb000-6884-4284-b511-a4c382558ba5 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:43.105490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ddbb000-6884-4284-b511-a4c382558ba5 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:43.106492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ddbb000-6884-4284-b511-a4c382558ba5 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:43.107130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ddbb000-6884-4284-b511-a4c382558ba5 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:43.108435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:59:43.120670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:59:43.176769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 01:59:43.183434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 01:59:43.242357 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-614939ed-5de8-4b4d-8e2a-920d9d3dbaee tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.988467 Aug 03 01:59:43.247013 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1341/2736] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 01:59:42 2022] POST /compute/v2.1/servers => generated 32 bytes in 994 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 03 01:59:43.254602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ed6eee8e-fb6e-43e8-bfd7-3e2f85e4b881 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:43.262169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ed6eee8e-fb6e-43e8-bfd7-3e2f85e4b881 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:43.265491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ed6eee8e-fb6e-43e8-bfd7-3e2f85e4b881 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Searching by: {'deleted': False, 'project_id': '66bb501c093b4f47a1a50eb37387bb14'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 01:59:43.303341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed6eee8e-fb6e-43e8-bfd7-3e2f85e4b881 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:43.304400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed6eee8e-fb6e-43e8-bfd7-3e2f85e4b881 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:43.305778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed6eee8e-fb6e-43e8-bfd7-3e2f85e4b881 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:43.306458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed6eee8e-fb6e-43e8-bfd7-3e2f85e4b881 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:43.338512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-ed6eee8e-fb6e-43e8-bfd7-3e2f85e4b881 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 01:59:43.386269 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ed6eee8e-fb6e-43e8-bfd7-3e2f85e4b881 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.137699 Aug 03 01:59:43.387052 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1342/2737] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 3 01:59:43 2022] GET /compute/v2.1/servers => generated 1002 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:43.398832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4186380f-36e3-43d3-b686-51255342358b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:43.399481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4186380f-36e3-43d3-b686-51255342358b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:43.608013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4186380f-36e3-43d3-b686-51255342358b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:43.619510 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4186380f-36e3-43d3-b686-51255342358b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1218 microversion: 2.1 time: 0.224432 Aug 03 01:59:43.631573 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1343/2738] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:43 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1218 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:59:43.949739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6ddbb000-6884-4284-b511-a4c382558ba5 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:43.968486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6ddbb000-6884-4284-b511-a4c382558ba5 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:43.971551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6ddbb000-6884-4284-b511-a4c382558ba5 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:43.973202 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6ddbb000-6884-4284-b511-a4c382558ba5 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905" status: 200 len: 1362 microversion: 2.26 time: 0.884806 Aug 03 01:59:43.975849 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1396/2739] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:43 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 => generated 1362 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:59:44.029575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8bba4714-3ede-4b11-9e0d-717aa845aa30 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:44.030304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8bba4714-3ede-4b11-9e0d-717aa845aa30 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:44.051967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bba4714-3ede-4b11-9e0d-717aa845aa30 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:44.053101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bba4714-3ede-4b11-9e0d-717aa845aa30 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:44.054545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bba4714-3ede-4b11-9e0d-717aa845aa30 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:44.060509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bba4714-3ede-4b11-9e0d-717aa845aa30 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:44.252944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-974ed870-3a93-4555-85f8-3b23acdbff25 req-258b3472-fc3e-4b0b-9789-42417cf09989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "tag": "9106a59f-415c-4da3-93ee-ae5f0c636a4a"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:44.293719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-974ed870-3a93-4555-85f8-3b23acdbff25 req-258b3472-fc3e-4b0b-9789-42417cf09989 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:44.295647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-974ed870-3a93-4555-85f8-3b23acdbff25 req-258b3472-fc3e-4b0b-9789-42417cf09989 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:44.331788 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-974ed870-3a93-4555-85f8-3b23acdbff25 req-258b3472-fc3e-4b0b-9789-42417cf09989 service nova] Creating event network-changed:9106a59f-415c-4da3-93ee-ae5f0c636a4a for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 01:59:44.348497 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-974ed870-3a93-4555-85f8-3b23acdbff25 req-258b3472-fc3e-4b0b-9789-42417cf09989 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100871 Aug 03 01:59:44.349377 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1397/2740] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:44.646619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e56238ac-624d-471a-9ced-998eb0880dac tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:44.651245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e56238ac-624d-471a-9ced-998eb0880dac tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:45.021041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e56238ac-624d-471a-9ced-998eb0880dac tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:45.035296 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e56238ac-624d-471a-9ced-998eb0880dac tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1218 microversion: 2.1 time: 0.388509 Aug 03 01:59:45.036003 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1398/2741] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:44 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1218 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:59:45.053508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b0603601-97de-4351-bb8c-ac4a050c798f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:45.054391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b0603601-97de-4351-bb8c-ac4a050c798f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:45.065526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0603601-97de-4351-bb8c-ac4a050c798f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:45.066019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0603601-97de-4351-bb8c-ac4a050c798f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:45.071419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0603601-97de-4351-bb8c-ac4a050c798f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:45.071913 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0603601-97de-4351-bb8c-ac4a050c798f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:45.108389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:45.355078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8bba4714-3ede-4b11-9e0d-717aa845aa30 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:45.367754 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8bba4714-3ede-4b11-9e0d-717aa845aa30 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1351 microversion: 2.1 time: 1.344319 Aug 03 01:59:45.371958 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1344/2742] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:44 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1351 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:59:45.579081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b0603601-97de-4351-bb8c-ac4a050c798f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:45.590521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b0603601-97de-4351-bb8c-ac4a050c798f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:45.604612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b0603601-97de-4351-bb8c-ac4a050c798f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:45.609284 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b0603601-97de-4351-bb8c-ac4a050c798f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905" status: 200 len: 1546 microversion: 2.26 time: 0.571532 Aug 03 01:59:45.615406 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1399/2743] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:45 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 => generated 1546 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:45.639213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c2481b2a-ecb2-4887-9686-8d62786010ee tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b128698b0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:45.653934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2481b2a-ecb2-4887-9686-8d62786010ee tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:45.659715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2481b2a-ecb2-4887-9686-8d62786010ee tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:45.660474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c2481b2a-ecb2-4887-9686-8d62786010ee tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:45.672206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2481b2a-ecb2-4887-9686-8d62786010ee tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:45.674731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2481b2a-ecb2-4887-9686-8d62786010ee tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:45.678303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2481b2a-ecb2-4887-9686-8d62786010ee tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:45.678996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2481b2a-ecb2-4887-9686-8d62786010ee tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:45.777097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2481b2a-ecb2-4887-9686-8d62786010ee tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:45.777591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2481b2a-ecb2-4887-9686-8d62786010ee tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:45.817805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2481b2a-ecb2-4887-9686-8d62786010ee tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:45.820637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2481b2a-ecb2-4887-9686-8d62786010ee tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:45.882379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-c2481b2a-ecb2-4887-9686-8d62786010ee tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lazy-loading 'flavor' on Instance uuid 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:59:45.937885 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c2481b2a-ecb2-4887-9686-8d62786010ee tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "PUT /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-872306579" status: 201 len: 0 microversion: 2.26 time: 0.302824 Aug 03 01:59:45.938995 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1345/2744] 10.222.0.67 () {62 vars in 1377 bytes} [Wed Aug 3 01:59:45 2022] PUT /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-872306579 => generated 0 bytes in 305 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 03 01:59:45.949549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-669424e5-91ec-42a7-8566-33489d98da80 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b12525700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:45.979993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-669424e5-91ec-42a7-8566-33489d98da80 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:45.984109 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-669424e5-91ec-42a7-8566-33489d98da80 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.047737 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-669424e5-91ec-42a7-8566-33489d98da80 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-872306579" status: 204 len: 0 microversion: 2.26 time: 0.102387 Aug 03 01:59:46.049541 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1400/2745] 10.222.0.67 () {60 vars in 1358 bytes} [Wed Aug 3 01:59:45 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-872306579 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:59:46.064930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ccf5fb20-52ed-4310-8465-fd088d6221db tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b12805a60>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:46.066705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2fbbee4a-34e5-4c6d-a303-02afeac42714 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:46.067277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2fbbee4a-34e5-4c6d-a303-02afeac42714 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:46.091810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ccf5fb20-52ed-4310-8465-fd088d6221db tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.093097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ccf5fb20-52ed-4310-8465-fd088d6221db tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.093910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ccf5fb20-52ed-4310-8465-fd088d6221db tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:46.100524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fbbee4a-34e5-4c6d-a303-02afeac42714 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.100980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fbbee4a-34e5-4c6d-a303-02afeac42714 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.101785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fbbee4a-34e5-4c6d-a303-02afeac42714 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.104886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ccf5fb20-52ed-4310-8465-fd088d6221db tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.105678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ccf5fb20-52ed-4310-8465-fd088d6221db tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.107759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ccf5fb20-52ed-4310-8465-fd088d6221db tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.108667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ccf5fb20-52ed-4310-8465-fd088d6221db tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.111360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fbbee4a-34e5-4c6d-a303-02afeac42714 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.193877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ccf5fb20-52ed-4310-8465-fd088d6221db tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.194322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ccf5fb20-52ed-4310-8465-fd088d6221db tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.234220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-ccf5fb20-52ed-4310-8465-fd088d6221db tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lazy-loading 'flavor' on Instance uuid 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:59:46.279156 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ccf5fb20-52ed-4310-8465-fd088d6221db tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags" status: 204 len: 0 microversion: 2.26 time: 0.219564 Aug 03 01:59:46.287665 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1346/2746] 10.222.0.67 () {60 vars in 1295 bytes} [Wed Aug 3 01:59:46 2022] DELETE /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:59:46.316686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-462643b4-c78d-4746-aa8b-db8f80f38b94 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b127c41f0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:46.371594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-462643b4-c78d-4746-aa8b-db8f80f38b94 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.376550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-462643b4-c78d-4746-aa8b-db8f80f38b94 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.412146 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-462643b4-c78d-4746-aa8b-db8f80f38b94 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags" status: 200 len: 12 microversion: 2.26 time: 0.114872 Aug 03 01:59:46.415019 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1347/2747] 10.222.0.67 () {60 vars in 1292 bytes} [Wed Aug 3 01:59:46 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags => generated 12 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:46.424843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2711003f-3957-4629-b4c6-52d46d1dda7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:46.426522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2711003f-3957-4629-b4c6-52d46d1dda7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:46.446437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2711003f-3957-4629-b4c6-52d46d1dda7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.450684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2fbbee4a-34e5-4c6d-a303-02afeac42714 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:46.476450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2711003f-3957-4629-b4c6-52d46d1dda7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.477667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2711003f-3957-4629-b4c6-52d46d1dda7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.483534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2711003f-3957-4629-b4c6-52d46d1dda7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.497110 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2fbbee4a-34e5-4c6d-a303-02afeac42714 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1278 microversion: 2.1 time: 0.419000 Aug 03 01:59:46.505898 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1401/2748] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:46 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1278 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:59:46.521981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1e5bfd34-286d-4006-b638-666119f6a530 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b12526820>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:46.550432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e5bfd34-286d-4006-b638-666119f6a530 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.551187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e5bfd34-286d-4006-b638-666119f6a530 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.551877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1e5bfd34-286d-4006-b638-666119f6a530 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:46.561952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e5bfd34-286d-4006-b638-666119f6a530 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.562657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e5bfd34-286d-4006-b638-666119f6a530 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.565079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e5bfd34-286d-4006-b638-666119f6a530 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.567834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e5bfd34-286d-4006-b638-666119f6a530 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.620390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e5bfd34-286d-4006-b638-666119f6a530 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.621782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e5bfd34-286d-4006-b638-666119f6a530 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.642025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e5bfd34-286d-4006-b638-666119f6a530 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.646684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e5bfd34-286d-4006-b638-666119f6a530 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.715213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-1e5bfd34-286d-4006-b638-666119f6a530 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lazy-loading 'flavor' on Instance uuid 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:59:46.761337 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1e5bfd34-286d-4006-b638-666119f6a530 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "PUT /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-779849106" status: 201 len: 0 microversion: 2.26 time: 0.253544 Aug 03 01:59:46.768419 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1402/2749] 10.222.0.67 () {62 vars in 1377 bytes} [Wed Aug 3 01:59:46 2022] PUT /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-779849106 => generated 0 bytes in 262 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 03 01:59:46.792285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fe60683e-3a68-4ff6-9424-2ffe7f551d19 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b12502af0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:46.835740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe60683e-3a68-4ff6-9424-2ffe7f551d19 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.843757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe60683e-3a68-4ff6-9424-2ffe7f551d19 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.873350 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fe60683e-3a68-4ff6-9424-2ffe7f551d19 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags" status: 200 len: 35 microversion: 2.26 time: 0.096847 Aug 03 01:59:46.874360 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1403/2750] 10.222.0.67 () {60 vars in 1292 bytes} [Wed Aug 3 01:59:46 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags => generated 35 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:46.900149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7250ca05-c22b-4d8d-a52a-d0fbfa12b8a8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b1267eca0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:46.927169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7250ca05-c22b-4d8d-a52a-d0fbfa12b8a8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.927635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7250ca05-c22b-4d8d-a52a-d0fbfa12b8a8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.928138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7250ca05-c22b-4d8d-a52a-d0fbfa12b8a8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:46.946600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7250ca05-c22b-4d8d-a52a-d0fbfa12b8a8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.947090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7250ca05-c22b-4d8d-a52a-d0fbfa12b8a8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:46.947887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7250ca05-c22b-4d8d-a52a-d0fbfa12b8a8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:46.948328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7250ca05-c22b-4d8d-a52a-d0fbfa12b8a8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.010498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7250ca05-c22b-4d8d-a52a-d0fbfa12b8a8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.013962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7250ca05-c22b-4d8d-a52a-d0fbfa12b8a8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.066473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-7250ca05-c22b-4d8d-a52a-d0fbfa12b8a8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lazy-loading 'flavor' on Instance uuid 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:59:47.090542 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7250ca05-c22b-4d8d-a52a-d0fbfa12b8a8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-779849106" status: 204 len: 0 microversion: 2.26 time: 0.196527 Aug 03 01:59:47.091459 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1404/2751] 10.222.0.67 () {60 vars in 1361 bytes} [Wed Aug 3 01:59:46 2022] DELETE /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-779849106 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:59:47.102152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3cde5f50-1f40-4d90-9bfe-f5498f7fea36 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b1256da60>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:47.126479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3cde5f50-1f40-4d90-9bfe-f5498f7fea36 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.130825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3cde5f50-1f40-4d90-9bfe-f5498f7fea36 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.163265 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3cde5f50-1f40-4d90-9bfe-f5498f7fea36 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags" status: 200 len: 12 microversion: 2.26 time: 0.065377 Aug 03 01:59:47.165546 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1405/2752] 10.222.0.67 () {60 vars in 1292 bytes} [Wed Aug 3 01:59:47 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags => generated 12 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:47.202883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0b70e7ef-1985-456a-957c-6b49bfd8cfd9 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b1255b310>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:47.224437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b70e7ef-1985-456a-957c-6b49bfd8cfd9 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.224896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b70e7ef-1985-456a-957c-6b49bfd8cfd9 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.225391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0b70e7ef-1985-456a-957c-6b49bfd8cfd9 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:47.249843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b70e7ef-1985-456a-957c-6b49bfd8cfd9 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.249843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b70e7ef-1985-456a-957c-6b49bfd8cfd9 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.250661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b70e7ef-1985-456a-957c-6b49bfd8cfd9 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.251656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b70e7ef-1985-456a-957c-6b49bfd8cfd9 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.298699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b70e7ef-1985-456a-957c-6b49bfd8cfd9 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.302313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b70e7ef-1985-456a-957c-6b49bfd8cfd9 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.321962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-0b70e7ef-1985-456a-957c-6b49bfd8cfd9 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lazy-loading 'flavor' on Instance uuid 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:59:47.350990 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0b70e7ef-1985-456a-957c-6b49bfd8cfd9 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags" status: 204 len: 0 microversion: 2.26 time: 0.178773 Aug 03 01:59:47.352896 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1406/2753] 10.222.0.67 () {60 vars in 1295 bytes} [Wed Aug 3 01:59:47 2022] DELETE /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:59:47.364837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3ff18e6b-7f94-47df-8284-30c2d3856ab4 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b12538280>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:47.375810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ff18e6b-7f94-47df-8284-30c2d3856ab4 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.377065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ff18e6b-7f94-47df-8284-30c2d3856ab4 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.377733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3ff18e6b-7f94-47df-8284-30c2d3856ab4 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:47.385534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ff18e6b-7f94-47df-8284-30c2d3856ab4 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.386240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ff18e6b-7f94-47df-8284-30c2d3856ab4 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.387236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ff18e6b-7f94-47df-8284-30c2d3856ab4 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.387871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ff18e6b-7f94-47df-8284-30c2d3856ab4 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.433374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ff18e6b-7f94-47df-8284-30c2d3856ab4 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.435070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ff18e6b-7f94-47df-8284-30c2d3856ab4 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.456985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ff18e6b-7f94-47df-8284-30c2d3856ab4 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.458022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ff18e6b-7f94-47df-8284-30c2d3856ab4 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.494991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2711003f-3957-4629-b4c6-52d46d1dda7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:47.504944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-3ff18e6b-7f94-47df-8284-30c2d3856ab4 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lazy-loading 'flavor' on Instance uuid 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:59:47.507699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:47.523547 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2711003f-3957-4629-b4c6-52d46d1dda7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1351 microversion: 2.1 time: 1.107154 Aug 03 01:59:47.528737 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3ff18e6b-7f94-47df-8284-30c2d3856ab4 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "PUT /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-912331423" status: 201 len: 0 microversion: 2.26 time: 0.169872 Aug 03 01:59:47.530142 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1407/2754] 10.222.0.67 () {62 vars in 1377 bytes} [Wed Aug 3 01:59:47 2022] PUT /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-912331423 => generated 0 bytes in 172 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 03 01:59:47.542773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-87b73a64-9ec2-4289-a8f0-23bf0709cf10 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:47.544764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-87b73a64-9ec2-4289-a8f0-23bf0709cf10 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:47.546651 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1348/2755] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:46 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1351 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:47.552282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e2f1eaa3-e510-40d7-ba0b-ab888fb0e3eb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b133a6550>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:47.555849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87b73a64-9ec2-4289-a8f0-23bf0709cf10 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.556815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87b73a64-9ec2-4289-a8f0-23bf0709cf10 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.558864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87b73a64-9ec2-4289-a8f0-23bf0709cf10 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.559534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87b73a64-9ec2-4289-a8f0-23bf0709cf10 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.588455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2f1eaa3-e510-40d7-ba0b-ab888fb0e3eb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.588992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2f1eaa3-e510-40d7-ba0b-ab888fb0e3eb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.589684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e2f1eaa3-e510-40d7-ba0b-ab888fb0e3eb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:47.627569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2f1eaa3-e510-40d7-ba0b-ab888fb0e3eb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.628437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2f1eaa3-e510-40d7-ba0b-ab888fb0e3eb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.629442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2f1eaa3-e510-40d7-ba0b-ab888fb0e3eb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.630056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2f1eaa3-e510-40d7-ba0b-ab888fb0e3eb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.669124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2f1eaa3-e510-40d7-ba0b-ab888fb0e3eb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.669855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2f1eaa3-e510-40d7-ba0b-ab888fb0e3eb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.682068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2f1eaa3-e510-40d7-ba0b-ab888fb0e3eb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.682737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2f1eaa3-e510-40d7-ba0b-ab888fb0e3eb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.734753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-e2f1eaa3-e510-40d7-ba0b-ab888fb0e3eb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lazy-loading 'flavor' on Instance uuid 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:59:47.780666 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e2f1eaa3-e510-40d7-ba0b-ab888fb0e3eb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "PUT /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-997188650" status: 201 len: 0 microversion: 2.26 time: 0.232528 Aug 03 01:59:47.781400 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1349/2756] 10.222.0.67 () {62 vars in 1377 bytes} [Wed Aug 3 01:59:47 2022] PUT /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-997188650 => generated 0 bytes in 234 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 03 01:59:47.795390 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a2d99f94-1524-439b-8779-d7d4d6a8937f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b244275e0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:47.806541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2d99f94-1524-439b-8779-d7d4d6a8937f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.807319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2d99f94-1524-439b-8779-d7d4d6a8937f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.808016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a2d99f94-1524-439b-8779-d7d4d6a8937f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:47.818715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-87b73a64-9ec2-4289-a8f0-23bf0709cf10 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:47.825195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2d99f94-1524-439b-8779-d7d4d6a8937f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.825736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2d99f94-1524-439b-8779-d7d4d6a8937f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.826747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2d99f94-1524-439b-8779-d7d4d6a8937f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.827288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2d99f94-1524-439b-8779-d7d4d6a8937f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.830034 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-87b73a64-9ec2-4289-a8f0-23bf0709cf10 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1276 microversion: 2.1 time: 0.298519 Aug 03 01:59:47.837073 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1408/2757] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:47 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1276 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:47.855644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2d99f94-1524-439b-8779-d7d4d6a8937f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.856176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2d99f94-1524-439b-8779-d7d4d6a8937f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.878550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-a2d99f94-1524-439b-8779-d7d4d6a8937f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lazy-loading 'flavor' on Instance uuid 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:59:47.910972 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a2d99f94-1524-439b-8779-d7d4d6a8937f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags" status: 204 len: 0 microversion: 2.26 time: 0.121292 Aug 03 01:59:47.912003 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1350/2758] 10.222.0.67 () {60 vars in 1295 bytes} [Wed Aug 3 01:59:47 2022] DELETE /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:59:47.925028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d1200dbd-9a12-491f-a35c-fe4321f3a741 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b1255c0d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:47.945267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1200dbd-9a12-491f-a35c-fe4321f3a741 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:47.947389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1200dbd-9a12-491f-a35c-fe4321f3a741 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:47.965372 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d1200dbd-9a12-491f-a35c-fe4321f3a741 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags" status: 200 len: 12 microversion: 2.26 time: 0.048739 Aug 03 01:59:47.966647 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1409/2759] 10.222.0.67 () {60 vars in 1292 bytes} [Wed Aug 3 01:59:47 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags => generated 12 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:59:47.991479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7ad3cb31-34f9-4c1b-8544-9494d1a7cba8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b127c4430>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:47.993074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-58c8a9ed-ca40-4f03-bd26-16283665d110 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c89fdd2b-3321-4a99-b8d5-18cfe4f2c11f"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:47.995969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-58c8a9ed-ca40-4f03-bd26-16283665d110 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:48.004359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58c8a9ed-ca40-4f03-bd26-16283665d110 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.004359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58c8a9ed-ca40-4f03-bd26-16283665d110 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.005232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58c8a9ed-ca40-4f03-bd26-16283665d110 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.005748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58c8a9ed-ca40-4f03-bd26-16283665d110 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.018627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ad3cb31-34f9-4c1b-8544-9494d1a7cba8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.019470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ad3cb31-34f9-4c1b-8544-9494d1a7cba8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.020133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7ad3cb31-34f9-4c1b-8544-9494d1a7cba8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:48.030315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ad3cb31-34f9-4c1b-8544-9494d1a7cba8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.030765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ad3cb31-34f9-4c1b-8544-9494d1a7cba8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.032513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ad3cb31-34f9-4c1b-8544-9494d1a7cba8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.033120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ad3cb31-34f9-4c1b-8544-9494d1a7cba8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.099114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ad3cb31-34f9-4c1b-8544-9494d1a7cba8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.099899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ad3cb31-34f9-4c1b-8544-9494d1a7cba8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.115299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-7ad3cb31-34f9-4c1b-8544-9494d1a7cba8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lazy-loading 'flavor' on Instance uuid 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:59:48.137394 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7ad3cb31-34f9-4c1b-8544-9494d1a7cba8 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags" status: 204 len: 0 microversion: 2.26 time: 0.151437 Aug 03 01:59:48.138066 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1351/2760] 10.222.0.67 () {60 vars in 1295 bytes} [Wed Aug 3 01:59:47 2022] DELETE /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:59:48.150296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69effdc9-a56d-4d03-b36a-0336f3a0ffd3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b24427790>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:48.160911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69effdc9-a56d-4d03-b36a-0336f3a0ffd3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.161569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69effdc9-a56d-4d03-b36a-0336f3a0ffd3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.162223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-69effdc9-a56d-4d03-b36a-0336f3a0ffd3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:48.171141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69effdc9-a56d-4d03-b36a-0336f3a0ffd3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.171809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69effdc9-a56d-4d03-b36a-0336f3a0ffd3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.173489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69effdc9-a56d-4d03-b36a-0336f3a0ffd3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.174371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69effdc9-a56d-4d03-b36a-0336f3a0ffd3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.214431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69effdc9-a56d-4d03-b36a-0336f3a0ffd3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.214947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69effdc9-a56d-4d03-b36a-0336f3a0ffd3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.226751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69effdc9-a56d-4d03-b36a-0336f3a0ffd3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.227382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69effdc9-a56d-4d03-b36a-0336f3a0ffd3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.261892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-69effdc9-a56d-4d03-b36a-0336f3a0ffd3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lazy-loading 'flavor' on Instance uuid 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:59:48.279105 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-69effdc9-a56d-4d03-b36a-0336f3a0ffd3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "PUT /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-439113867" status: 201 len: 0 microversion: 2.26 time: 0.132786 Aug 03 01:59:48.279655 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1352/2761] 10.222.0.67 () {62 vars in 1377 bytes} [Wed Aug 3 01:59:48 2022] PUT /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-439113867 => generated 0 bytes in 134 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 03 01:59:48.292751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6fd21c35-e1ed-41db-9f1d-91f62405c9fb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b1286e8b0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:48.332879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fd21c35-e1ed-41db-9f1d-91f62405c9fb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.334713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fd21c35-e1ed-41db-9f1d-91f62405c9fb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.336878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6fd21c35-e1ed-41db-9f1d-91f62405c9fb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:48.346692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fd21c35-e1ed-41db-9f1d-91f62405c9fb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.347302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fd21c35-e1ed-41db-9f1d-91f62405c9fb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.348420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fd21c35-e1ed-41db-9f1d-91f62405c9fb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.349037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fd21c35-e1ed-41db-9f1d-91f62405c9fb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.401185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fd21c35-e1ed-41db-9f1d-91f62405c9fb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.401641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fd21c35-e1ed-41db-9f1d-91f62405c9fb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.424337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fd21c35-e1ed-41db-9f1d-91f62405c9fb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.425002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fd21c35-e1ed-41db-9f1d-91f62405c9fb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.437003 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-58c8a9ed-ca40-4f03-bd26-16283665d110 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "POST /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.447173 Aug 03 01:59:48.455090 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1410/2762] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 01:59:47 2022] POST /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:59:48.483583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-6fd21c35-e1ed-41db-9f1d-91f62405c9fb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lazy-loading 'flavor' on Instance uuid 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:59:48.518066 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6fd21c35-e1ed-41db-9f1d-91f62405c9fb tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "PUT /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-1409165848" status: 201 len: 0 microversion: 2.26 time: 0.230243 Aug 03 01:59:48.536227 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1353/2763] 10.222.0.67 () {62 vars in 1380 bytes} [Wed Aug 3 01:59:48 2022] PUT /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags/tempest-tag-1409165848 => generated 0 bytes in 249 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 03 01:59:48.564722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-441025df-839d-412e-8534-16f545b48268 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:48.565406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-441025df-839d-412e-8534-16f545b48268 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:48.567464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-535d3969-5dc1-4b6c-ab77-04ca305d7998 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Action: 'update_all', calling method: .version_select at 0x7f5b1272ac10>, body: {"tags": ["tempest-tag-934736409", "tempest-tag-1815364941"]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:48.582234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-441025df-839d-412e-8534-16f545b48268 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.582744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-441025df-839d-412e-8534-16f545b48268 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.587402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-441025df-839d-412e-8534-16f545b48268 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.589518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-441025df-839d-412e-8534-16f545b48268 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.595333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-535d3969-5dc1-4b6c-ab77-04ca305d7998 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.597100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-535d3969-5dc1-4b6c-ab77-04ca305d7998 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.599816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-535d3969-5dc1-4b6c-ab77-04ca305d7998 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:48.619480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-535d3969-5dc1-4b6c-ab77-04ca305d7998 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.621254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-535d3969-5dc1-4b6c-ab77-04ca305d7998 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.622218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-535d3969-5dc1-4b6c-ab77-04ca305d7998 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.625941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-535d3969-5dc1-4b6c-ab77-04ca305d7998 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.674428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:48.686144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-535d3969-5dc1-4b6c-ab77-04ca305d7998 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.687226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-535d3969-5dc1-4b6c-ab77-04ca305d7998 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.730199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-535d3969-5dc1-4b6c-ab77-04ca305d7998 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lazy-loading 'flavor' on Instance uuid 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:59:48.768866 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-535d3969-5dc1-4b6c-ab77-04ca305d7998 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "PUT /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags" status: 200 len: 61 microversion: 2.26 time: 0.224367 Aug 03 01:59:48.774323 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1411/2764] 10.222.0.67 () {62 vars in 1312 bytes} [Wed Aug 3 01:59:48 2022] PUT /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags => generated 61 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:48.780657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fb54d3f6-9be7-4cde-ae7a-18f45ec18608 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b129cb3a0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:48.793459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb54d3f6-9be7-4cde-ae7a-18f45ec18608 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.794130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb54d3f6-9be7-4cde-ae7a-18f45ec18608 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.809372 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fb54d3f6-9be7-4cde-ae7a-18f45ec18608 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags" status: 200 len: 61 microversion: 2.26 time: 0.033390 Aug 03 01:59:48.811171 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1412/2765] 10.222.0.67 () {60 vars in 1292 bytes} [Wed Aug 3 01:59:48 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags => generated 61 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:59:48.847953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37614fd4-9bde-4862-9501-a6e8d621a225 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '.version_select at 0x7f5b1272a700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:48.859286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37614fd4-9bde-4862-9501-a6e8d621a225 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.861172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37614fd4-9bde-4862-9501-a6e8d621a225 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.861846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-37614fd4-9bde-4862-9501-a6e8d621a225 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:48.872011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37614fd4-9bde-4862-9501-a6e8d621a225 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.872721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37614fd4-9bde-4862-9501-a6e8d621a225 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.874380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37614fd4-9bde-4862-9501-a6e8d621a225 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.875070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37614fd4-9bde-4862-9501-a6e8d621a225 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.914375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37614fd4-9bde-4862-9501-a6e8d621a225 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.915330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37614fd4-9bde-4862-9501-a6e8d621a225 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.937466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-37614fd4-9bde-4862-9501-a6e8d621a225 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lazy-loading 'flavor' on Instance uuid 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 01:59:48.968399 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-37614fd4-9bde-4862-9501-a6e8d621a225 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags" status: 204 len: 0 microversion: 2.26 time: 0.131384 Aug 03 01:59:48.971386 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1413/2766] 10.222.0.67 () {60 vars in 1295 bytes} [Wed Aug 3 01:59:48 2022] DELETE /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905/tags => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:59:48.980151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-97851769-fbb0-4cf7-88cb-76ae12b2c541 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:48.981654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-97851769-fbb0-4cf7-88cb-76ae12b2c541 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:48.990371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97851769-fbb0-4cf7-88cb-76ae12b2c541 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.991626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97851769-fbb0-4cf7-88cb-76ae12b2c541 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:48.992905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97851769-fbb0-4cf7-88cb-76ae12b2c541 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:48.993562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97851769-fbb0-4cf7-88cb-76ae12b2c541 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:49.086133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-441025df-839d-412e-8534-16f545b48268 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:49.101977 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-441025df-839d-412e-8534-16f545b48268 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1351 microversion: 2.1 time: 0.543928 Aug 03 01:59:49.102598 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1354/2767] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:48 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1351 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 01:59:49.108355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6c36d8cc-c781-4c3f-bb09-74b2065bdc4f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:49.116000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6c36d8cc-c781-4c3f-bb09-74b2065bdc4f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:49.128180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c36d8cc-c781-4c3f-bb09-74b2065bdc4f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:49.131756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c36d8cc-c781-4c3f-bb09-74b2065bdc4f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:49.132882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c36d8cc-c781-4c3f-bb09-74b2065bdc4f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:49.133506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c36d8cc-c781-4c3f-bb09-74b2065bdc4f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:49.177549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6c36d8cc-c781-4c3f-bb09-74b2065bdc4f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 01:59:49.342851 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6c36d8cc-c781-4c3f-bb09-74b2065bdc4f tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905" status: 204 len: 0 microversion: 2.26 time: 0.238420 Aug 03 01:59:49.343613 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1355/2768] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 01:59:49 2022] DELETE /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 01:59:49.353728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dd1c6a65-e7f8-4f3e-aedc-65aabbd234c3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:49.354464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dd1c6a65-e7f8-4f3e-aedc-65aabbd234c3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:49.377592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd1c6a65-e7f8-4f3e-aedc-65aabbd234c3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:49.378108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd1c6a65-e7f8-4f3e-aedc-65aabbd234c3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:49.379683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd1c6a65-e7f8-4f3e-aedc-65aabbd234c3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:49.380403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd1c6a65-e7f8-4f3e-aedc-65aabbd234c3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:49.816503 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-97851769-fbb0-4cf7-88cb-76ae12b2c541 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:49.831470 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-97851769-fbb0-4cf7-88cb-76ae12b2c541 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1318 microversion: 2.1 time: 0.858550 Aug 03 01:59:49.832342 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1414/2769] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:48 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1318 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:49.841355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-5956e86e-00a8-4ef2-b6c7-58217e39ab96 req-c555e130-82d1-40c1-b48a-e3e2b6577aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0854fcf5-4f57-475f-90e1-168756cd85ec", "name": "network-vif-plugged", "status": "completed", "tag": "68bee7ad-303d-4e02-8c6b-ac1919fcdfd4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:49.864466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5956e86e-00a8-4ef2-b6c7-58217e39ab96 req-c555e130-82d1-40c1-b48a-e3e2b6577aeb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:49.865157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5956e86e-00a8-4ef2-b6c7-58217e39ab96 req-c555e130-82d1-40c1-b48a-e3e2b6577aeb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:49.880011 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-5956e86e-00a8-4ef2-b6c7-58217e39ab96 req-c555e130-82d1-40c1-b48a-e3e2b6577aeb service nova] Creating event network-vif-plugged:68bee7ad-303d-4e02-8c6b-ac1919fcdfd4 for instance 0854fcf5-4f57-475f-90e1-168756cd85ec on n-h1-826529-8 Aug 03 01:59:49.887011 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-5956e86e-00a8-4ef2-b6c7-58217e39ab96 req-c555e130-82d1-40c1-b48a-e3e2b6577aeb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053588 Aug 03 01:59:49.889210 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1415/2770] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:50.124423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f232bc51-cbea-49a9-b215-3cede0892534 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:50.125152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f232bc51-cbea-49a9-b215-3cede0892534 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:50.136628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f232bc51-cbea-49a9-b215-3cede0892534 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:50.137099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f232bc51-cbea-49a9-b215-3cede0892534 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:50.138052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f232bc51-cbea-49a9-b215-3cede0892534 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:50.138505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f232bc51-cbea-49a9-b215-3cede0892534 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:50.230216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dd1c6a65-e7f8-4f3e-aedc-65aabbd234c3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:50.248712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dd1c6a65-e7f8-4f3e-aedc-65aabbd234c3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:50.253719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dd1c6a65-e7f8-4f3e-aedc-65aabbd234c3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:50.257836 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dd1c6a65-e7f8-4f3e-aedc-65aabbd234c3 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905" status: 200 len: 1552 microversion: 2.26 time: 0.908814 Aug 03 01:59:50.259406 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1356/2771] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:49 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 => generated 1552 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:59:50.808562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f232bc51-cbea-49a9-b215-3cede0892534 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:50.817082 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f232bc51-cbea-49a9-b215-3cede0892534 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1351 microversion: 2.1 time: 0.697134 Aug 03 01:59:50.822753 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1416/2772] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:50 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1351 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:50.858779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-63cdd5c8-c88f-456a-8916-bdbaa5f6a161 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:50.860860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-63cdd5c8-c88f-456a-8916-bdbaa5f6a161 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:50.898069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63cdd5c8-c88f-456a-8916-bdbaa5f6a161 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:50.898692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63cdd5c8-c88f-456a-8916-bdbaa5f6a161 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:50.899797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63cdd5c8-c88f-456a-8916-bdbaa5f6a161 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:50.905447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63cdd5c8-c88f-456a-8916-bdbaa5f6a161 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:50.944830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:51.206638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-1dc30d88-a8cc-4e99-b67e-914e0f3fe00d req-12b25c52-08e8-4e7c-a291-f948700bea81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9c4a0e5-24a7-4482-9879-3f6763ea0fb0", "tag": "6c61232f-31f0-4ddd-8700-46f556c85fa6"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:51.229948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1dc30d88-a8cc-4e99-b67e-914e0f3fe00d req-12b25c52-08e8-4e7c-a291-f948700bea81 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:51.230501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1dc30d88-a8cc-4e99-b67e-914e0f3fe00d req-12b25c52-08e8-4e7c-a291-f948700bea81 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:51.261247 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-1dc30d88-a8cc-4e99-b67e-914e0f3fe00d req-12b25c52-08e8-4e7c-a291-f948700bea81 service nova] Creating event network-changed:6c61232f-31f0-4ddd-8700-46f556c85fa6 for instance d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 on n-h2-826529-8 Aug 03 01:59:51.270189 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-1dc30d88-a8cc-4e99-b67e-914e0f3fe00d req-12b25c52-08e8-4e7c-a291-f948700bea81 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067231 Aug 03 01:59:51.272553 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1417/2773] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:51.288671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-32585c0d-e33c-464b-af78-aa6626e89081 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:51.289824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-32585c0d-e33c-464b-af78-aa6626e89081 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:51.302997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-32585c0d-e33c-464b-af78-aa6626e89081 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:51.303865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-32585c0d-e33c-464b-af78-aa6626e89081 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:51.306618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-32585c0d-e33c-464b-af78-aa6626e89081 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:51.307277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-32585c0d-e33c-464b-af78-aa6626e89081 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:51.596203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-63cdd5c8-c88f-456a-8916-bdbaa5f6a161 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:51.611680 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-63cdd5c8-c88f-456a-8916-bdbaa5f6a161 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1318 microversion: 2.1 time: 0.756206 Aug 03 01:59:51.615138 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1357/2774] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:50 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1318 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:51.770536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-32585c0d-e33c-464b-af78-aa6626e89081 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:51.811228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-32585c0d-e33c-464b-af78-aa6626e89081 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:51.823376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-32585c0d-e33c-464b-af78-aa6626e89081 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:51.827703 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-32585c0d-e33c-464b-af78-aa6626e89081 tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905" status: 200 len: 1552 microversion: 2.26 time: 0.543239 Aug 03 01:59:51.848439 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1418/2775] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:51 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 => generated 1552 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 01:59:51.863164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0548b400-46cb-4564-8390-e9c818c41a7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:51.864108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0548b400-46cb-4564-8390-e9c818c41a7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:51.876881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0548b400-46cb-4564-8390-e9c818c41a7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:51.878004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0548b400-46cb-4564-8390-e9c818c41a7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:51.879029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0548b400-46cb-4564-8390-e9c818c41a7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:51.882472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0548b400-46cb-4564-8390-e9c818c41a7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:52.211811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0548b400-46cb-4564-8390-e9c818c41a7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:52.234023 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0548b400-46cb-4564-8390-e9c818c41a7c tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1542 microversion: 2.1 time: 0.382142 Aug 03 01:59:52.251370 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1358/2776] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:51 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1542 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:52.269841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cebaf8f1-607e-417c-943a-8122ef61ccc8 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:52.271078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cebaf8f1-607e-417c-943a-8122ef61ccc8 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:52.287161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cebaf8f1-607e-417c-943a-8122ef61ccc8 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:52.287643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cebaf8f1-607e-417c-943a-8122ef61ccc8 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:52.288481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cebaf8f1-607e-417c-943a-8122ef61ccc8 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:52.289940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cebaf8f1-607e-417c-943a-8122ef61ccc8 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:52.448952 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cebaf8f1-607e-417c-943a-8122ef61ccc8 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.184057 Aug 03 01:59:52.457868 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1419/2777] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 01:59:52 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec/os-interface => generated 285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:52.637583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7855a1d5-2add-41e9-b0eb-7efd48a9c873 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:52.638214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7855a1d5-2add-41e9-b0eb-7efd48a9c873 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:52.650331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7855a1d5-2add-41e9-b0eb-7efd48a9c873 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:52.655052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7855a1d5-2add-41e9-b0eb-7efd48a9c873 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:52.656469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7855a1d5-2add-41e9-b0eb-7efd48a9c873 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:52.659705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7855a1d5-2add-41e9-b0eb-7efd48a9c873 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:52.867602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e1fd297b-e162-4a9e-af21-7df39cb869ed tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:52.868234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e1fd297b-e162-4a9e-af21-7df39cb869ed tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:52.880156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e1fd297b-e162-4a9e-af21-7df39cb869ed tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:52.880628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e1fd297b-e162-4a9e-af21-7df39cb869ed tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:52.884659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e1fd297b-e162-4a9e-af21-7df39cb869ed tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:52.885141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e1fd297b-e162-4a9e-af21-7df39cb869ed tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:53.325507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:53.446227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7855a1d5-2add-41e9-b0eb-7efd48a9c873 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:53.459493 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7855a1d5-2add-41e9-b0eb-7efd48a9c873 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1318 microversion: 2.1 time: 0.827348 Aug 03 01:59:53.460830 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1359/2778] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:52 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1318 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:53.633685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e1fd297b-e162-4a9e-af21-7df39cb869ed tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:53.656117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e1fd297b-e162-4a9e-af21-7df39cb869ed tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:53.662117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e1fd297b-e162-4a9e-af21-7df39cb869ed tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebcb7e1744d7401883a357f7671c55af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a679c70fd0694e078b9634f7e87d64e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:53.670941 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e1fd297b-e162-4a9e-af21-7df39cb869ed tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905" status: 200 len: 1552 microversion: 2.26 time: 0.807378 Aug 03 01:59:53.671808 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1420/2779] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:52 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 => generated 1552 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 01:59:53.800993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ec709d1c-b1f5-4f1e-807e-e1c882b75e4d req-9dfbb3f8-a9fe-4926-86da-8e3ac39aa57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905", "name": "network-vif-deleted", "tag": "bda9830a-35f9-4244-a00c-fbc8d7049100"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:53.821082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=59,nova_cell0:UPDATE=7 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:53.839887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ec709d1c-b1f5-4f1e-807e-e1c882b75e4d req-9dfbb3f8-a9fe-4926-86da-8e3ac39aa57d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:53.842691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ec709d1c-b1f5-4f1e-807e-e1c882b75e4d req-9dfbb3f8-a9fe-4926-86da-8e3ac39aa57d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:53.906693 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ec709d1c-b1f5-4f1e-807e-e1c882b75e4d req-9dfbb3f8-a9fe-4926-86da-8e3ac39aa57d service nova] Creating event network-vif-deleted:bda9830a-35f9-4244-a00c-fbc8d7049100 for instance 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 on n-h2-826529-8 Aug 03 01:59:53.919494 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ec709d1c-b1f5-4f1e-807e-e1c882b75e4d req-9dfbb3f8-a9fe-4926-86da-8e3ac39aa57d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127505 Aug 03 01:59:53.921078 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1360/2780] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 01:59:54.492271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b36d0482-9e35-452f-a1e0-c04edd7b031e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:54.494403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b36d0482-9e35-452f-a1e0-c04edd7b031e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:54.517968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b36d0482-9e35-452f-a1e0-c04edd7b031e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:54.518444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b36d0482-9e35-452f-a1e0-c04edd7b031e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:54.525809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b36d0482-9e35-452f-a1e0-c04edd7b031e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:54.526500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b36d0482-9e35-452f-a1e0-c04edd7b031e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:54.696543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-396604bb-e49f-4624-9a3f-ea13b5a1990a tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:54.697478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-396604bb-e49f-4624-9a3f-ea13b5a1990a tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] [instance: 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:54.705216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-396604bb-e49f-4624-9a3f-ea13b5a1990a tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:54.705909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-396604bb-e49f-4624-9a3f-ea13b5a1990a tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:54.706812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-396604bb-e49f-4624-9a3f-ea13b5a1990a tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:54.715336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-396604bb-e49f-4624-9a3f-ea13b5a1990a tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:54.755362 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-396604bb-e49f-4624-9a3f-ea13b5a1990a tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] HTTP exception thrown: Instance 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 could not be found. Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-396604bb-e49f-4624-9a3f-ea13b5a1990a tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Request method failure captured: Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 HTTP/1.1 Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dZ5ex2WenyLzit8qlDVToyg4SZfT3EoY3Vu5zha-H2sji67RmECfT2YZ1r1FlFlbTQ7HFjYVbroFvCtT9l5HyGNlRmrIGzJykRzaZisMZisZePxyZws3FZpyyU-yf3x5JfoP-pBH5YvxozfL_y9CysibmGr1xqJKoq61592cXT7X3Q Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.26 Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: a679c70fd0694e078b9634f7e87d64e6 Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerTagsTestJSON-1495305895 Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a679c70fd0694e078b9634f7e87d64e6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a679c70fd0694e078b9634f7e87d64e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a679c70fd0694e078b9634f7e87d64e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a679c70fd0694e078b9634f7e87d64e6"}]}] Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerTagsTestJSON-1495305895 Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: a679c70fd0694e078b9634f7e87d64e6 Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerTagsTestJSON-1495305895 Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerTagsTestJSON-1495305895-project Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: ebcb7e1744d7401883a357f7671c55af Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerTagsTestJSON-1495305895-project Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 could not be found. Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905'} Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 could not be found. Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 could not be found. Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 01:59:54.757576 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:59:54.761549 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 01:59:54.761549 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 01:59:54.761549 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 01:59:54.761549 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 01:59:54.761549 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 01:59:54.761549 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 could not be found. Aug 03 01:59:54.761549 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 01:59:54.771386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-396604bb-e49f-4624-9a3f-ea13b5a1990a tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] Returning 404 to user: Instance 3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 01:59:54.772517 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-396604bb-e49f-4624-9a3f-ea13b5a1990a tempest-ServerTagsTestJSON-1495305895 tempest-ServerTagsTestJSON-1495305895-project] 10.222.0.67 "GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905" status: 404 len: 111 microversion: 2.26 time: 0.080320 Aug 03 01:59:54.773830 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1361/2781] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 01:59:54 2022] GET /compute/v2.1/servers/3d7f114b-6e3b-4f08-8be7-5b8e3e6a2905 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 01:59:54.976911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-63ccba93-18f4-47f6-9b48-f2e2b6f36091 req-b654e437-9374-4914-82d2-b3169792d086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a4a5809-822e-4ca2-a69c-f4c0a7eb200c", "tag": "98bf53e4-9a43-4434-b546-96cc0a850ea8"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:55.002853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-63ccba93-18f4-47f6-9b48-f2e2b6f36091 req-b654e437-9374-4914-82d2-b3169792d086 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:55.003568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-63ccba93-18f4-47f6-9b48-f2e2b6f36091 req-b654e437-9374-4914-82d2-b3169792d086 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:55.020452 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-63ccba93-18f4-47f6-9b48-f2e2b6f36091 req-b654e437-9374-4914-82d2-b3169792d086 service nova] Creating event network-changed:98bf53e4-9a43-4434-b546-96cc0a850ea8 for instance 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c on n-h2-826529-8 Aug 03 01:59:55.029138 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-63ccba93-18f4-47f6-9b48-f2e2b6f36091 req-b654e437-9374-4914-82d2-b3169792d086 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057463 Aug 03 01:59:55.029744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=11 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 01:59:55.031093 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1362/2782] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:59:55.632771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b36d0482-9e35-452f-a1e0-c04edd7b031e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:55.645363 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b36d0482-9e35-452f-a1e0-c04edd7b031e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1318 microversion: 2.1 time: 1.162602 Aug 03 01:59:55.669165 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1421/2783] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:54 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1318 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:56.676018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d97c6e26-8a15-449f-8ee6-884e875ecdbe tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:56.679542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d97c6e26-8a15-449f-8ee6-884e875ecdbe tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:56.684292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-d1d4a481-efea-4be7-8aa6-1dd35de811ea req-abcd51f2-da46-4925-8dad-f7a222b2563f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0854fcf5-4f57-475f-90e1-168756cd85ec", "tag": "68bee7ad-303d-4e02-8c6b-ac1919fcdfd4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:56.702042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d97c6e26-8a15-449f-8ee6-884e875ecdbe tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:56.702959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d97c6e26-8a15-449f-8ee6-884e875ecdbe tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:56.705213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d97c6e26-8a15-449f-8ee6-884e875ecdbe tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:56.707187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d97c6e26-8a15-449f-8ee6-884e875ecdbe tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:56.708328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d1d4a481-efea-4be7-8aa6-1dd35de811ea req-abcd51f2-da46-4925-8dad-f7a222b2563f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:56.708787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d1d4a481-efea-4be7-8aa6-1dd35de811ea req-abcd51f2-da46-4925-8dad-f7a222b2563f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:56.750865 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-d1d4a481-efea-4be7-8aa6-1dd35de811ea req-abcd51f2-da46-4925-8dad-f7a222b2563f service nova] Creating event network-changed:68bee7ad-303d-4e02-8c6b-ac1919fcdfd4 for instance 0854fcf5-4f57-475f-90e1-168756cd85ec on n-h1-826529-8 Aug 03 01:59:56.773520 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-d1d4a481-efea-4be7-8aa6-1dd35de811ea req-abcd51f2-da46-4925-8dad-f7a222b2563f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093351 Aug 03 01:59:56.774164 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1422/2784] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:59:57.174484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d97c6e26-8a15-449f-8ee6-884e875ecdbe tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:57.189111 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d97c6e26-8a15-449f-8ee6-884e875ecdbe tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1318 microversion: 2.1 time: 0.523850 Aug 03 01:59:57.214175 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1363/2785] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:56 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:57.976882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-e5b3de06-ffc9-4909-91d1-54ef4b38b514 req-4c269e56-c93c-418c-9c8c-e89b3d788931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c4a0e5-24a7-4482-9879-3f6763ea0fb0", "name": "network-vif-plugged", "status": "completed", "tag": "6c61232f-31f0-4ddd-8700-46f556c85fa6"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 01:59:57.998617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e5b3de06-ffc9-4909-91d1-54ef4b38b514 req-4c269e56-c93c-418c-9c8c-e89b3d788931 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:58.005057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e5b3de06-ffc9-4909-91d1-54ef4b38b514 req-4c269e56-c93c-418c-9c8c-e89b3d788931 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:58.028031 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-e5b3de06-ffc9-4909-91d1-54ef4b38b514 req-4c269e56-c93c-418c-9c8c-e89b3d788931 service nova] Creating event network-vif-plugged:6c61232f-31f0-4ddd-8700-46f556c85fa6 for instance d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 on n-h2-826529-8 Aug 03 01:59:58.040044 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-e5b3de06-ffc9-4909-91d1-54ef4b38b514 req-4c269e56-c93c-418c-9c8c-e89b3d788931 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066959 Aug 03 01:59:58.043770 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1423/2786] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 01:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 01:59:58.224760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-42db916f-8631-4055-8610-ad37934a37d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:58.226238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-42db916f-8631-4055-8610-ad37934a37d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:58.242051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42db916f-8631-4055-8610-ad37934a37d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:58.243443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42db916f-8631-4055-8610-ad37934a37d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:58.248859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42db916f-8631-4055-8610-ad37934a37d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:58.249502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42db916f-8631-4055-8610-ad37934a37d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:58.611888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-42db916f-8631-4055-8610-ad37934a37d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:58.626772 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-42db916f-8631-4055-8610-ad37934a37d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1318 microversion: 2.1 time: 0.403034 Aug 03 01:59:58.651620 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1364/2787] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:58 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 01:59:59.667364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b8d39e62-7227-4d6f-97b3-e47640aec1ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 01:59:59.669177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b8d39e62-7227-4d6f-97b3-e47640aec1ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 01:59:59.681535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8d39e62-7227-4d6f-97b3-e47640aec1ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:59.682348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8d39e62-7227-4d6f-97b3-e47640aec1ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:59.683436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8d39e62-7227-4d6f-97b3-e47640aec1ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 01:59:59.684045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8d39e62-7227-4d6f-97b3-e47640aec1ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 01:59:59.947408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b8d39e62-7227-4d6f-97b3-e47640aec1ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 01:59:59.964911 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b8d39e62-7227-4d6f-97b3-e47640aec1ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1318 microversion: 2.1 time: 0.304116 Aug 03 01:59:59.966246 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1424/2788] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 01:59:59 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:01.000712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e8b5b54d-adb2-43ac-8fa9-40ed8bad24b3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:01.002102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e8b5b54d-adb2-43ac-8fa9-40ed8bad24b3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:01.012607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8b5b54d-adb2-43ac-8fa9-40ed8bad24b3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:01.013416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8b5b54d-adb2-43ac-8fa9-40ed8bad24b3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:01.014406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8b5b54d-adb2-43ac-8fa9-40ed8bad24b3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:01.015063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8b5b54d-adb2-43ac-8fa9-40ed8bad24b3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:01.462019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e8b5b54d-adb2-43ac-8fa9-40ed8bad24b3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:01.472174 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e8b5b54d-adb2-43ac-8fa9-40ed8bad24b3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1318 microversion: 2.1 time: 0.477677 Aug 03 02:00:01.507425 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1365/2789] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:00 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:02.498343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-19d504c9-bd37-4d7e-861a-31262e556f95 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:02.501008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-19d504c9-bd37-4d7e-861a-31262e556f95 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:02.517990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19d504c9-bd37-4d7e-861a-31262e556f95 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:02.519279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19d504c9-bd37-4d7e-861a-31262e556f95 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:02.520505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19d504c9-bd37-4d7e-861a-31262e556f95 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:02.521182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19d504c9-bd37-4d7e-861a-31262e556f95 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:03.596942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d88c04d2-eb87-45f6-9db1-d1db0f543ecc req-a594d26e-11ed-459f-8282-96e9b0cdd796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a4a5809-822e-4ca2-a69c-f4c0a7eb200c", "name": "network-vif-plugged", "status": "completed", "tag": "98bf53e4-9a43-4434-b546-96cc0a850ea8"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:03.667133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d88c04d2-eb87-45f6-9db1-d1db0f543ecc req-a594d26e-11ed-459f-8282-96e9b0cdd796 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:03.667996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d88c04d2-eb87-45f6-9db1-d1db0f543ecc req-a594d26e-11ed-459f-8282-96e9b0cdd796 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:03.686472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-19d504c9-bd37-4d7e-861a-31262e556f95 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:03.690875 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d88c04d2-eb87-45f6-9db1-d1db0f543ecc req-a594d26e-11ed-459f-8282-96e9b0cdd796 service nova] Creating event network-vif-plugged:98bf53e4-9a43-4434-b546-96cc0a850ea8 for instance 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c on n-h2-826529-8 Aug 03 02:00:03.704618 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d88c04d2-eb87-45f6-9db1-d1db0f543ecc req-a594d26e-11ed-459f-8282-96e9b0cdd796 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114743 Aug 03 02:00:03.706259 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-19d504c9-bd37-4d7e-861a-31262e556f95 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1318 microversion: 2.1 time: 1.214795 Aug 03 02:00:03.707729 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1366/2790] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:00:03.721981 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1425/2791] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:02 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1318 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:04.426697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-75142da3-1609-4c59-9a61-e6f59d26f07d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:04.434733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-75142da3-1609-4c59-9a61-e6f59d26f07d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:04.462148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-75142da3-1609-4c59-9a61-e6f59d26f07d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:04.462974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-75142da3-1609-4c59-9a61-e6f59d26f07d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:04.474018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-75142da3-1609-4c59-9a61-e6f59d26f07d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:04.475351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-75142da3-1609-4c59-9a61-e6f59d26f07d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:04.588592 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-75142da3-1609-4c59-9a61-e6f59d26f07d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169967 Aug 03 02:00:04.591166 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1367/2792] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:00:04 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:00:04.618463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a8e0713f-dcf2-4334-b7c5-bbff7b7bd057 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:04.619402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a8e0713f-dcf2-4334-b7c5-bbff7b7bd057 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:04.630923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8e0713f-dcf2-4334-b7c5-bbff7b7bd057 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:04.631525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8e0713f-dcf2-4334-b7c5-bbff7b7bd057 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:04.632464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8e0713f-dcf2-4334-b7c5-bbff7b7bd057 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:04.633171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8e0713f-dcf2-4334-b7c5-bbff7b7bd057 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:04.735430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c50902d3-3ee2-427b-8314-c78fb9545660 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:04.735430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c50902d3-3ee2-427b-8314-c78fb9545660 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:04.740002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:04.759129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c50902d3-3ee2-427b-8314-c78fb9545660 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:04.760261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c50902d3-3ee2-427b-8314-c78fb9545660 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:04.763564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c50902d3-3ee2-427b-8314-c78fb9545660 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:04.769618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c50902d3-3ee2-427b-8314-c78fb9545660 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:04.856772 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-a8e0713f-dcf2-4334-b7c5-bbff7b7bd057 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lazy-loading 'services' on Instance uuid 3285da37-7f8b-462d-b271-1cc87f6fba1b {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:00:05.043865 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a8e0713f-dcf2-4334-b7c5-bbff7b7bd057 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b/os-volume_attachments/c89fdd2b-3321-4a99-b8d5-18cfe4f2c11f" status: 202 len: 0 microversion: 2.1 time: 0.440964 Aug 03 02:00:05.052010 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1426/2793] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:00:04 2022] DELETE /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b/os-volume_attachments/c89fdd2b-3321-4a99-b8d5-18cfe4f2c11f => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:00:05.259730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c50902d3-3ee2-427b-8314-c78fb9545660 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:05.273926 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c50902d3-3ee2-427b-8314-c78fb9545660 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1318 microversion: 2.1 time: 0.540952 Aug 03 02:00:05.274987 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1368/2794] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:04 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1318 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:00:06.306785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d96b0912-8965-4ad4-85a4-7ba5b1a82606 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:06.309109 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d96b0912-8965-4ad4-85a4-7ba5b1a82606 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:06.337624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d96b0912-8965-4ad4-85a4-7ba5b1a82606 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:06.341249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d96b0912-8965-4ad4-85a4-7ba5b1a82606 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:06.348064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d96b0912-8965-4ad4-85a4-7ba5b1a82606 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:06.352313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d96b0912-8965-4ad4-85a4-7ba5b1a82606 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:06.854659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d96b0912-8965-4ad4-85a4-7ba5b1a82606 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:06.870587 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d96b0912-8965-4ad4-85a4-7ba5b1a82606 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1467 microversion: 2.1 time: 0.567018 Aug 03 02:00:06.873142 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1427/2795] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:06 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1467 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:06.915444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-709b8b50-790c-4088-ae0c-ae5fa05fcb63 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:06.916893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-709b8b50-790c-4088-ae0c-ae5fa05fcb63 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: d9c4a0e5-24a7-4482-9879-3f6763ea0fb0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:06.935356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-709b8b50-790c-4088-ae0c-ae5fa05fcb63 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:06.940909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-709b8b50-790c-4088-ae0c-ae5fa05fcb63 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:06.945617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-709b8b50-790c-4088-ae0c-ae5fa05fcb63 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:06.946513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-709b8b50-790c-4088-ae0c-ae5fa05fcb63 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:07.314176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-709b8b50-790c-4088-ae0c-ae5fa05fcb63 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:07.327255 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-709b8b50-790c-4088-ae0c-ae5fa05fcb63 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0" status: 200 len: 1467 microversion: 2.1 time: 0.419979 Aug 03 02:00:07.330731 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1369/2796] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:06 2022] GET /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 => generated 1467 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:07.368315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-861d2283-13c9-47c6-a036-6ff317f326da tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:07.376246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-861d2283-13c9-47c6-a036-6ff317f326da tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:07.378799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-861d2283-13c9-47c6-a036-6ff317f326da tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Searching by: {'reservation_id': 'r-74fd8xfv', 'deleted': False, 'project_id': '66bb501c093b4f47a1a50eb37387bb14'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:00:07.395140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-861d2283-13c9-47c6-a036-6ff317f326da tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:07.395316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-861d2283-13c9-47c6-a036-6ff317f326da tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:07.399300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-861d2283-13c9-47c6-a036-6ff317f326da tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:07.399771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-861d2283-13c9-47c6-a036-6ff317f326da tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:07.607258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-861d2283-13c9-47c6-a036-6ff317f326da tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:00:07.807173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-861d2283-13c9-47c6-a036-6ff317f326da tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:07.820434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-861d2283-13c9-47c6-a036-6ff317f326da tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:07.821518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-861d2283-13c9-47c6-a036-6ff317f326da tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:07.837677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:08.642428 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-861d2283-13c9-47c6-a036-6ff317f326da tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/detail?reservation_id=r-74fd8xfv" status: 200 len: 2927 microversion: 2.1 time: 1.278347 Aug 03 02:00:08.643898 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1428/2797] 10.222.0.67 () {58 vars in 1197 bytes} [Wed Aug 3 02:00:07 2022] GET /compute/v2.1/servers/detail?reservation_id=r-74fd8xfv => generated 2927 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:08.680429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3e77fd50-62df-4094-8378-d641e15a268d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:08.755374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.compute.server_groups [None req-3e77fd50-62df-4094-8378-d641e15a268d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Querying cell 812a442e-24ba-4152-b2b0-f99907b19272(cell1) for 2 instances {{(pid=125942) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 03 02:00:08.761020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e77fd50-62df-4094-8378-d641e15a268d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:08.762287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e77fd50-62df-4094-8378-d641e15a268d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:08.864057 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3e77fd50-62df-4094-8378-d641e15a268d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups/6ca1c80e-8953-4e0a-a575-873d5f4c5235" status: 200 len: 266 microversion: 2.1 time: 0.194897 Aug 03 02:00:08.864880 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1370/2798] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 02:00:08 2022] GET /compute/v2.1/os-server-groups/6ca1c80e-8953-4e0a-a575-873d5f4c5235 => generated 266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:00:08.876582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9bd0fbbd-d6a5-4fac-b053-8c4fc78d7853 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:08.877347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9bd0fbbd-d6a5-4fac-b053-8c4fc78d7853 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:08.897443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bd0fbbd-d6a5-4fac-b053-8c4fc78d7853 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:08.899159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bd0fbbd-d6a5-4fac-b053-8c4fc78d7853 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:08.901551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bd0fbbd-d6a5-4fac-b053-8c4fc78d7853 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:08.903232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bd0fbbd-d6a5-4fac-b053-8c4fc78d7853 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:09.574511 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9bd0fbbd-d6a5-4fac-b053-8c4fc78d7853 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1618 microversion: 2.1 time: 0.700998 Aug 03 02:00:09.580827 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1429/2799] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:08 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1618 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:00:09.604556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69dbb870-7a33-41d6-9ad4-3eaa452779f5 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:09.605884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-69dbb870-7a33-41d6-9ad4-3eaa452779f5 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] [instance: d9c4a0e5-24a7-4482-9879-3f6763ea0fb0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:09.613819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69dbb870-7a33-41d6-9ad4-3eaa452779f5 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:09.614275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69dbb870-7a33-41d6-9ad4-3eaa452779f5 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:09.615345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69dbb870-7a33-41d6-9ad4-3eaa452779f5 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:09.616251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69dbb870-7a33-41d6-9ad4-3eaa452779f5 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:10.066671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d8375fbf-1975-47c5-a887-1d82422efc82 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Action: 'create', calling method: .version_select at 0x7f5b124eb1f0>, body: {"keypair": {"name": "tempest-keypair-903112045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3HY4Q1/K2jtCOv3zZAZw2ocoeH646/xC1ufNEjfrhpCWLd419Z3qHQD9smkE0JqB5eFB/9EORLgTM34AqRtNLe47h3HbP3RsGJ5ETdsOXKw3Ha/9UnD47NyCDY3uO9iw=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:10.075800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:10.087390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-d8375fbf-1975-47c5-a887-1d82422efc82 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Getting quotas for project e8dc5a1c3fbd4cad8b0f2045bb872b0d. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:00:10.093329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-d8375fbf-1975-47c5-a887-1d82422efc82 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Getting quotas for user f009ea44cc4a4c37a236b93a2c5a9028 and project e8dc5a1c3fbd4cad8b0f2045bb872b0d. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:00:10.127972 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d8375fbf-1975-47c5-a887-1d82422efc82 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.356696 Aug 03 02:00:10.136354 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1430/2800] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:00:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:00:10.308994 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-69dbb870-7a33-41d6-9ad4-3eaa452779f5 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0" status: 200 len: 1618 microversion: 2.1 time: 0.707926 Aug 03 02:00:10.310163 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1371/2801] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:09 2022] GET /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 => generated 1618 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:10.348118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cce29e28-f020-400f-a4ba-8e8b07998f7d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Action: 'create', calling method: .version_select at 0x7f5b1272a1f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-247572452", "policies": ["anti-affinity"]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:10.372685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-cce29e28-f020-400f-a4ba-8e8b07998f7d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:00:10.391043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-cce29e28-f020-400f-a4ba-8e8b07998f7d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:00:10.451448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-cce29e28-f020-400f-a4ba-8e8b07998f7d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:00:10.462206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-cce29e28-f020-400f-a4ba-8e8b07998f7d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:00:10.495275 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cce29e28-f020-400f-a4ba-8e8b07998f7d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.153301 Aug 03 02:00:10.498800 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1431/2802] 10.222.0.67 () {60 vars in 1174 bytes} [Wed Aug 3 02:00:10 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:00:10.708807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-337656102", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "d1fe1cce-fb90-4322-883d-83fb6f40bba9"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:10.851878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:00:11.341985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:00:11.343294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:00:11.343294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:00:11.343812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:00:11.344997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:00:11.382313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:11.383000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:11.383899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:11.386861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:11.447778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:00:11.468149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:00:11.518549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Going to run 2 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:00:11.521474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: b22f91a3-0dc4-4228-9510-8605086caef8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:00:11.675723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:00:11.685204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:00:12.426883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:00:12.435354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:00:12.462938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=b22f91a3-0dc4-4228-9510-8605086caef8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:00:12.535980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:00:12.542363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:00:12.640074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:00:12.647871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'server_group_members'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:00:12.712457 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3d612bc3-4dbf-4ab3-93d8-80bfd8a060ff tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.009915 Aug 03 02:00:12.714260 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1372/2803] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:00:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 2017 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 03 02:00:12.723707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0ff33de7-cc1d-4c2c-9b11-a40a2880a5ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:12.731060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0ff33de7-cc1d-4c2c-9b11-a40a2880a5ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:12.731761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0ff33de7-cc1d-4c2c-9b11-a40a2880a5ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Searching by: {'deleted': False, 'project_id': '66bb501c093b4f47a1a50eb37387bb14'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:00:12.800632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0ff33de7-cc1d-4c2c-9b11-a40a2880a5ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:12.802234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0ff33de7-cc1d-4c2c-9b11-a40a2880a5ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:12.803493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0ff33de7-cc1d-4c2c-9b11-a40a2880a5ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:12.804225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0ff33de7-cc1d-4c2c-9b11-a40a2880a5ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:12.869234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-0ff33de7-cc1d-4c2c-9b11-a40a2880a5ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:00:12.917977 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0ff33de7-cc1d-4c2c-9b11-a40a2880a5ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.199283 Aug 03 02:00:12.928425 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1432/2804] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 3 02:00:12 2022] GET /compute/v2.1/servers => generated 1662 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:12.936276 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-44ca0ad5-d232-4407-a2b5-ce27553a85d6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:12.936909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-44ca0ad5-d232-4407-a2b5-ce27553a85d6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:13.109161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-44ca0ad5-d232-4407-a2b5-ce27553a85d6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:13.126404 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-44ca0ad5-d232-4407-a2b5-ce27553a85d6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 200 len: 1218 microversion: 2.1 time: 0.192296 Aug 03 02:00:13.129584 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1373/2805] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:12 2022] GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 1218 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:13.259360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1634220033", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "f4565ac3-4eed-4500-a57f-9610c234fecc"}], "security_groups": [{"name": "tempest-securitygroup--1587728169"}], "key_name": "tempest-keypair-903112045", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:14.053798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b355f8e2-5b64-499e-a795-81cabef33bee tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:14.054772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b355f8e2-5b64-499e-a795-81cabef33bee tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:14.070713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b355f8e2-5b64-499e-a795-81cabef33bee tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:14.071290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b355f8e2-5b64-499e-a795-81cabef33bee tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:14.072313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b355f8e2-5b64-499e-a795-81cabef33bee tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:14.072941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b355f8e2-5b64-499e-a795-81cabef33bee tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:14.179019 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b355f8e2-5b64-499e-a795-81cabef33bee tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/ips" status: 200 len: 152 microversion: 2.20 time: 0.134550 Aug 03 02:00:14.180405 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1374/2806] 10.222.0.67 () {60 vars in 1289 bytes} [Wed Aug 3 02:00:14 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/ips => generated 152 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 02:00:14.193032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e9bacd11-6798-4830-977c-00b6fbd89cf5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:14.195210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e9bacd11-6798-4830-977c-00b6fbd89cf5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:14.212223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9bacd11-6798-4830-977c-00b6fbd89cf5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:14.212938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9bacd11-6798-4830-977c-00b6fbd89cf5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:14.214073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9bacd11-6798-4830-977c-00b6fbd89cf5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:14.214710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9bacd11-6798-4830-977c-00b6fbd89cf5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:14.432325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e9bacd11-6798-4830-977c-00b6fbd89cf5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:14.437539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] validate_networks() for [('f4565ac3-4eed-4500-a57f-9610c234fecc', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:00:14.447558 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e9bacd11-6798-4830-977c-00b6fbd89cf5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 200 len: 1222 microversion: 2.1 time: 0.265913 Aug 03 02:00:14.454755 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1375/2807] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:14 2022] GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 1222 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:15.472700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9d82e737-64dd-4cda-858c-c1b49b135447 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:15.474184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9d82e737-64dd-4cda-858c-c1b49b135447 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:15.490464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d82e737-64dd-4cda-858c-c1b49b135447 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:15.494764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d82e737-64dd-4cda-858c-c1b49b135447 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:15.496419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d82e737-64dd-4cda-858c-c1b49b135447 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:15.497108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d82e737-64dd-4cda-858c-c1b49b135447 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:15.656752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:00:15.658318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:00:15.658999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:00:15.659578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:00:15.660158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:00:15.692415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9d82e737-64dd-4cda-858c-c1b49b135447 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:15.694292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:15.695103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:15.696228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:15.697008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:15.705490 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9d82e737-64dd-4cda-858c-c1b49b135447 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 200 len: 1278 microversion: 2.1 time: 0.238111 Aug 03 02:00:15.710221 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1376/2808] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:15 2022] GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 1278 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:00:15.777404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Getting quotas for project e8dc5a1c3fbd4cad8b0f2045bb872b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:00:15.787339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Getting quotas for user f009ea44cc4a4c37a236b93a2c5a9028 and project e8dc5a1c3fbd4cad8b0f2045bb872b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:00:15.817217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:00:15.820233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:00:15.901283 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2523421a-b29c-4903-8c03-b3d11edafa2e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.647568 Aug 03 02:00:15.905321 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1433/2809] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:00:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 2652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:00:15.917052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eaee18d1-a372-4579-ab69-5512b5b66a8d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:15.917772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eaee18d1-a372-4579-ab69-5512b5b66a8d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:16.057174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eaee18d1-a372-4579-ab69-5512b5b66a8d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:16.073325 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eaee18d1-a372-4579-ab69-5512b5b66a8d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1241 microversion: 2.1 time: 0.159907 Aug 03 02:00:16.081200 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1377/2810] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:15 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1241 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:16.418179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-19d93427-6e9e-4539-b6ca-053cdec907ac tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:16.421272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-19d93427-6e9e-4539-b6ca-053cdec907ac tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:16.442598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19d93427-6e9e-4539-b6ca-053cdec907ac tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:16.454021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19d93427-6e9e-4539-b6ca-053cdec907ac tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:16.458003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19d93427-6e9e-4539-b6ca-053cdec907ac tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:16.459841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19d93427-6e9e-4539-b6ca-053cdec907ac tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:16.559491 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-19d93427-6e9e-4539-b6ca-053cdec907ac tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.142576 Aug 03 02:00:16.566663 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1434/2811] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:00:16 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b/os-volume_attachments => generated 25 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:00:16.747446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8913d022-7002-4f0f-a40d-e0fbef5464a3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:16.748860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8913d022-7002-4f0f-a40d-e0fbef5464a3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:16.755718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7fd2c37d-a22e-4ceb-b1af-2131f78e33bc tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:16.758563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7fd2c37d-a22e-4ceb-b1af-2131f78e33bc tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:16.779899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fd2c37d-a22e-4ceb-b1af-2131f78e33bc tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:16.780111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8913d022-7002-4f0f-a40d-e0fbef5464a3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:16.780875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fd2c37d-a22e-4ceb-b1af-2131f78e33bc tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:16.784750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fd2c37d-a22e-4ceb-b1af-2131f78e33bc tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:16.785502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fd2c37d-a22e-4ceb-b1af-2131f78e33bc tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:16.787429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8913d022-7002-4f0f-a40d-e0fbef5464a3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:16.792846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8913d022-7002-4f0f-a40d-e0fbef5464a3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:16.793443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8913d022-7002-4f0f-a40d-e0fbef5464a3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:16.866533 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7fd2c37d-a22e-4ceb-b1af-2131f78e33bc tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128755 Aug 03 02:00:16.879729 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1378/2812] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:00:16 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:00:17.011345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7d59eae1-0146-4585-8dfb-a53f0f16703d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:17.012271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7d59eae1-0146-4585-8dfb-a53f0f16703d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:17.024626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8913d022-7002-4f0f-a40d-e0fbef5464a3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:17.035650 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8913d022-7002-4f0f-a40d-e0fbef5464a3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 200 len: 1276 microversion: 2.1 time: 0.296180 Aug 03 02:00:17.036794 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1435/2813] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:16 2022] GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 1276 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:17.038775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d59eae1-0146-4585-8dfb-a53f0f16703d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:17.039727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d59eae1-0146-4585-8dfb-a53f0f16703d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:17.041017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d59eae1-0146-4585-8dfb-a53f0f16703d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:17.041728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d59eae1-0146-4585-8dfb-a53f0f16703d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:17.111184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-65daa6a2-208f-46f5-b3ed-d6b46c30b69a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:17.113569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-65daa6a2-208f-46f5-b3ed-d6b46c30b69a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:17.142280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7d59eae1-0146-4585-8dfb-a53f0f16703d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:00:17.192696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:17.243306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-65daa6a2-208f-46f5-b3ed-d6b46c30b69a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:17.255594 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-65daa6a2-208f-46f5-b3ed-d6b46c30b69a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1241 microversion: 2.1 time: 0.149947 Aug 03 02:00:17.256889 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1436/2814] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:17 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1241 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:17.385075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:17.416399 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7d59eae1-0146-4585-8dfb-a53f0f16703d tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 204 len: 0 microversion: 2.1 time: 0.408812 Aug 03 02:00:17.416990 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1379/2815] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:00:17 2022] DELETE /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:00:17.430552 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-11327318-e62a-4475-88a3-380fa76da90b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:17.431325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-11327318-e62a-4475-88a3-380fa76da90b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:17.443231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11327318-e62a-4475-88a3-380fa76da90b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:17.444095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11327318-e62a-4475-88a3-380fa76da90b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:17.445182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11327318-e62a-4475-88a3-380fa76da90b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:17.445899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11327318-e62a-4475-88a3-380fa76da90b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:17.717989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-11327318-e62a-4475-88a3-380fa76da90b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:17.732820 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-11327318-e62a-4475-88a3-380fa76da90b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1684 microversion: 2.1 time: 0.310889 Aug 03 02:00:17.738936 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1437/2816] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:17 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1684 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:00:18.066445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bcbe9fb3-957c-425d-b284-1295591c1cc5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:18.067848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bcbe9fb3-957c-425d-b284-1295591c1cc5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:18.090102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bcbe9fb3-957c-425d-b284-1295591c1cc5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:18.091427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bcbe9fb3-957c-425d-b284-1295591c1cc5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:18.093033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bcbe9fb3-957c-425d-b284-1295591c1cc5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:18.094320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bcbe9fb3-957c-425d-b284-1295591c1cc5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:18.230498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37f74fba-9c1d-4cf2-bc11-be57f8c58805 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:18.232746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-37f74fba-9c1d-4cf2-bc11-be57f8c58805 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:18.245203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37f74fba-9c1d-4cf2-bc11-be57f8c58805 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:18.245711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37f74fba-9c1d-4cf2-bc11-be57f8c58805 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:18.246808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37f74fba-9c1d-4cf2-bc11-be57f8c58805 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:18.253366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37f74fba-9c1d-4cf2-bc11-be57f8c58805 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:18.278015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bcbe9fb3-957c-425d-b284-1295591c1cc5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:18.287985 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bcbe9fb3-957c-425d-b284-1295591c1cc5 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 200 len: 1276 microversion: 2.1 time: 0.228845 Aug 03 02:00:18.288582 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1380/2817] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:18 2022] GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 1276 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:18.304004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0cdcf234-05fd-4edb-ba7a-e8dbbf67eed6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:18.309937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0cdcf234-05fd-4edb-ba7a-e8dbbf67eed6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:18.322776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cdcf234-05fd-4edb-ba7a-e8dbbf67eed6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:18.324875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cdcf234-05fd-4edb-ba7a-e8dbbf67eed6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:18.330395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cdcf234-05fd-4edb-ba7a-e8dbbf67eed6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:18.331198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cdcf234-05fd-4edb-ba7a-e8dbbf67eed6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:18.364598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-37f74fba-9c1d-4cf2-bc11-be57f8c58805 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lazy-loading 'flavor' on Instance uuid 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:00:18.570532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0cdcf234-05fd-4edb-ba7a-e8dbbf67eed6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:18.600043 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0cdcf234-05fd-4edb-ba7a-e8dbbf67eed6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1237 microversion: 2.1 time: 0.300495 Aug 03 02:00:18.602861 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1381/2818] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:18 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1237 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:18.770179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-01b75352-cd4f-445f-a5b1-472882709234 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:18.771769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-01b75352-cd4f-445f-a5b1-472882709234 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:18.795773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01b75352-cd4f-445f-a5b1-472882709234 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:18.796903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01b75352-cd4f-445f-a5b1-472882709234 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:18.798333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01b75352-cd4f-445f-a5b1-472882709234 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:18.799217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01b75352-cd4f-445f-a5b1-472882709234 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:18.905090 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-37f74fba-9c1d-4cf2-bc11-be57f8c58805 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "POST /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/action" status: 202 len: 0 microversion: 2.20 time: 0.683924 Aug 03 02:00:18.911119 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1438/2819] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 3 02:00:18 2022] POST /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/action => generated 0 bytes in 691 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:00:18.917932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cefda151-c272-4dd8-b465-2b920078fdd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:18.937085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cefda151-c272-4dd8-b465-2b920078fdd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:18.966198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cefda151-c272-4dd8-b465-2b920078fdd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:18.970393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cefda151-c272-4dd8-b465-2b920078fdd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:18.972064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cefda151-c272-4dd8-b465-2b920078fdd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:18.972987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cefda151-c272-4dd8-b465-2b920078fdd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:19.784854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-01b75352-cd4f-445f-a5b1-472882709234 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:19.804566 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-01b75352-cd4f-445f-a5b1-472882709234 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1684 microversion: 2.1 time: 1.037078 Aug 03 02:00:19.820949 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1382/2820] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:18 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1684 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:00:19.826734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a9ac2e8e-f36c-4665-ac2e-53725a9294bf tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:19.827884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a9ac2e8e-f36c-4665-ac2e-53725a9294bf tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:19.835940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9ac2e8e-f36c-4665-ac2e-53725a9294bf tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:19.836635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9ac2e8e-f36c-4665-ac2e-53725a9294bf tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:19.837659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9ac2e8e-f36c-4665-ac2e-53725a9294bf tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:19.838257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9ac2e8e-f36c-4665-ac2e-53725a9294bf tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:20.281573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cefda151-c272-4dd8-b465-2b920078fdd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:20.290853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cefda151-c272-4dd8-b465-2b920078fdd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:20.292432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cefda151-c272-4dd8-b465-2b920078fdd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:20.321688 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cefda151-c272-4dd8-b465-2b920078fdd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1723 microversion: 2.20 time: 1.408121 Aug 03 02:00:20.338020 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1439/2821] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:18 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1723 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:00:20.338020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-57ee00cd-0652-45c8-b0b6-8ae7960846c9 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:20.338020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-57ee00cd-0652-45c8-b0b6-8ae7960846c9 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:20.355793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57ee00cd-0652-45c8-b0b6-8ae7960846c9 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:20.356261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57ee00cd-0652-45c8-b0b6-8ae7960846c9 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:20.357065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57ee00cd-0652-45c8-b0b6-8ae7960846c9 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:20.357520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57ee00cd-0652-45c8-b0b6-8ae7960846c9 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:20.684280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-57ee00cd-0652-45c8-b0b6-8ae7960846c9 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:20.697191 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-57ee00cd-0652-45c8-b0b6-8ae7960846c9 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1299 microversion: 2.1 time: 0.372180 Aug 03 02:00:20.699015 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1440/2822] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:20 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1299 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:20.833509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d3e184d7-ccf6-49c6-942f-72d9aedc932b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:20.836380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d3e184d7-ccf6-49c6-942f-72d9aedc932b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:20.858985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3e184d7-ccf6-49c6-942f-72d9aedc932b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:20.862120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3e184d7-ccf6-49c6-942f-72d9aedc932b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:20.863394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3e184d7-ccf6-49c6-942f-72d9aedc932b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:20.864558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3e184d7-ccf6-49c6-942f-72d9aedc932b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:21.406815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:21.489621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a9ac2e8e-f36c-4665-ac2e-53725a9294bf tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:21.498232 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a9ac2e8e-f36c-4665-ac2e-53725a9294bf tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 200 len: 1318 microversion: 2.1 time: 1.675713 Aug 03 02:00:21.503777 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1383/2823] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:19 2022] GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 1318 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:21.517327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-5680ecba-c627-45ff-8e21-766c7cee37e7 req-0d91c876-1d46-462d-9cdc-ad7c282cf298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b22f91a3-0dc4-4228-9510-8605086caef8", "tag": "2a64e8d3-4059-41b5-aaec-8cba861ff604"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:21.552658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5680ecba-c627-45ff-8e21-766c7cee37e7 req-0d91c876-1d46-462d-9cdc-ad7c282cf298 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:21.552658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5680ecba-c627-45ff-8e21-766c7cee37e7 req-0d91c876-1d46-462d-9cdc-ad7c282cf298 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:21.573145 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-5680ecba-c627-45ff-8e21-766c7cee37e7 req-0d91c876-1d46-462d-9cdc-ad7c282cf298 service nova] Creating event network-changed:2a64e8d3-4059-41b5-aaec-8cba861ff604 for instance b22f91a3-0dc4-4228-9510-8605086caef8 on n-h2-826529-8 Aug 03 02:00:21.588500 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-5680ecba-c627-45ff-8e21-766c7cee37e7 req-0d91c876-1d46-462d-9cdc-ad7c282cf298 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083080 Aug 03 02:00:21.589777 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1384/2824] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:00:21.602994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0412ad89-8dfb-4bf8-a968-b2d427d73dd9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:21.607655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0412ad89-8dfb-4bf8-a968-b2d427d73dd9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:21.631721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0412ad89-8dfb-4bf8-a968-b2d427d73dd9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:21.632449 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0412ad89-8dfb-4bf8-a968-b2d427d73dd9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:21.633415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0412ad89-8dfb-4bf8-a968-b2d427d73dd9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:21.635124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0412ad89-8dfb-4bf8-a968-b2d427d73dd9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:22.385958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d3e184d7-ccf6-49c6-942f-72d9aedc932b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:22.408398 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d3e184d7-ccf6-49c6-942f-72d9aedc932b tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1684 microversion: 2.1 time: 1.579550 Aug 03 02:00:22.409443 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1441/2825] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:20 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1684 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:22.427003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-52b1f979-19db-4c18-81cf-fc4cdb83c403 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:22.433649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-52b1f979-19db-4c18-81cf-fc4cdb83c403 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:22.457361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52b1f979-19db-4c18-81cf-fc4cdb83c403 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:22.481543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52b1f979-19db-4c18-81cf-fc4cdb83c403 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:22.483474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52b1f979-19db-4c18-81cf-fc4cdb83c403 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:22.492670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52b1f979-19db-4c18-81cf-fc4cdb83c403 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:23.001724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-52b1f979-19db-4c18-81cf-fc4cdb83c403 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:23.010229 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-52b1f979-19db-4c18-81cf-fc4cdb83c403 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1299 microversion: 2.1 time: 0.596706 Aug 03 02:00:23.011103 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1442/2826] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:22 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1299 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:23.016388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5f57f3f2-09a1-463b-8e02-98adf18ed2ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:23.017453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5f57f3f2-09a1-463b-8e02-98adf18ed2ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:23.028266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f57f3f2-09a1-463b-8e02-98adf18ed2ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:23.028954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f57f3f2-09a1-463b-8e02-98adf18ed2ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:23.029969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f57f3f2-09a1-463b-8e02-98adf18ed2ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:23.030672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f57f3f2-09a1-463b-8e02-98adf18ed2ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:23.146792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0412ad89-8dfb-4bf8-a968-b2d427d73dd9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:23.163492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0412ad89-8dfb-4bf8-a968-b2d427d73dd9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:23.171439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0412ad89-8dfb-4bf8-a968-b2d427d73dd9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:23.173741 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0412ad89-8dfb-4bf8-a968-b2d427d73dd9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1723 microversion: 2.20 time: 1.575302 Aug 03 02:00:23.174702 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1385/2827] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:21 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1723 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:00:23.423483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-cee60f20-5dc7-49cd-912c-d954e2edf9ec req-4798c7ae-d416-4d88-90c6-7b0c70014166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3285da37-7f8b-462d-b271-1cc87f6fba1b", "name": "network-vif-unplugged", "status": "completed", "tag": "df876788-24fb-404a-8272-e552c07ff6fb"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:23.439569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-cee60f20-5dc7-49cd-912c-d954e2edf9ec req-4798c7ae-d416-4d88-90c6-7b0c70014166 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:23.440566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-cee60f20-5dc7-49cd-912c-d954e2edf9ec req-4798c7ae-d416-4d88-90c6-7b0c70014166 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:23.476888 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-cee60f20-5dc7-49cd-912c-d954e2edf9ec req-4798c7ae-d416-4d88-90c6-7b0c70014166 service nova] Creating event network-vif-unplugged:df876788-24fb-404a-8272-e552c07ff6fb for instance 3285da37-7f8b-462d-b271-1cc87f6fba1b on n-h2-826529-8 Aug 03 02:00:23.487758 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-cee60f20-5dc7-49cd-912c-d954e2edf9ec req-4798c7ae-d416-4d88-90c6-7b0c70014166 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076196 Aug 03 02:00:23.491163 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1386/2828] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:00:23.503421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d20bb8fc-ba39-4192-ac31-fbc542a51025 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:23.505130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d20bb8fc-ba39-4192-ac31-fbc542a51025 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:23.516126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d20bb8fc-ba39-4192-ac31-fbc542a51025 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:23.517210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d20bb8fc-ba39-4192-ac31-fbc542a51025 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:23.518402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d20bb8fc-ba39-4192-ac31-fbc542a51025 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:23.519174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d20bb8fc-ba39-4192-ac31-fbc542a51025 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:23.818939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5f57f3f2-09a1-463b-8e02-98adf18ed2ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:23.852498 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5f57f3f2-09a1-463b-8e02-98adf18ed2ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 200 len: 1318 microversion: 2.1 time: 0.826994 Aug 03 02:00:23.868945 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1443/2829] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:23 2022] GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 1318 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:23.874288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-52cf94b3-586d-4186-89fe-0612daaaf731 req-9d44ed64-1eb0-40f5-bf4e-83630718569c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5828876-bf1f-481e-9960-b98652a1ce58", "tag": "d9877663-29d9-418c-9aa5-dad3ecd344d4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:23.911873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-52cf94b3-586d-4186-89fe-0612daaaf731 req-9d44ed64-1eb0-40f5-bf4e-83630718569c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:23.913792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-52cf94b3-586d-4186-89fe-0612daaaf731 req-9d44ed64-1eb0-40f5-bf4e-83630718569c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:23.962272 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-52cf94b3-586d-4186-89fe-0612daaaf731 req-9d44ed64-1eb0-40f5-bf4e-83630718569c service nova] Creating event network-changed:d9877663-29d9-418c-9aa5-dad3ecd344d4 for instance e5828876-bf1f-481e-9960-b98652a1ce58 on n-h1-826529-8 Aug 03 02:00:23.968341 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-52cf94b3-586d-4186-89fe-0612daaaf731 req-9d44ed64-1eb0-40f5-bf4e-83630718569c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097860 Aug 03 02:00:23.970777 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1444/2830] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:00:24.058511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20b94159-fe3d-4020-aa10-92bfc07ad6a3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:24.066632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-20b94159-fe3d-4020-aa10-92bfc07ad6a3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:24.075558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20b94159-fe3d-4020-aa10-92bfc07ad6a3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:24.076282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20b94159-fe3d-4020-aa10-92bfc07ad6a3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:24.077304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20b94159-fe3d-4020-aa10-92bfc07ad6a3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:24.078619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20b94159-fe3d-4020-aa10-92bfc07ad6a3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:24.269856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-20b94159-fe3d-4020-aa10-92bfc07ad6a3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:24.288298 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-20b94159-fe3d-4020-aa10-92bfc07ad6a3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1299 microversion: 2.1 time: 0.242964 Aug 03 02:00:24.292237 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1445/2831] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:24 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1299 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:24.303724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f71f6722-9708-41ff-9d07-c8d660cbc0e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:24.304467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f71f6722-9708-41ff-9d07-c8d660cbc0e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:24.324171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f71f6722-9708-41ff-9d07-c8d660cbc0e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:24.324703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f71f6722-9708-41ff-9d07-c8d660cbc0e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:24.331029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f71f6722-9708-41ff-9d07-c8d660cbc0e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:24.331990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f71f6722-9708-41ff-9d07-c8d660cbc0e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:24.471057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d20bb8fc-ba39-4192-ac31-fbc542a51025 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:24.484706 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d20bb8fc-ba39-4192-ac31-fbc542a51025 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1684 microversion: 2.1 time: 0.991134 Aug 03 02:00:24.488201 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1387/2832] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:23 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1684 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:24.884982 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c50d5626-5103-4b80-bc1c-24d562f36668 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:24.884982 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c50d5626-5103-4b80-bc1c-24d562f36668 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:24.928231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c50d5626-5103-4b80-bc1c-24d562f36668 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:24.928696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c50d5626-5103-4b80-bc1c-24d562f36668 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:24.929540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c50d5626-5103-4b80-bc1c-24d562f36668 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:24.929981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c50d5626-5103-4b80-bc1c-24d562f36668 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:25.551025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f71f6722-9708-41ff-9d07-c8d660cbc0e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:25.562218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f71f6722-9708-41ff-9d07-c8d660cbc0e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:25.565507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f71f6722-9708-41ff-9d07-c8d660cbc0e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:25.567155 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f71f6722-9708-41ff-9d07-c8d660cbc0e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1723 microversion: 2.20 time: 1.273752 Aug 03 02:00:25.568441 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1446/2833] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:24 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1723 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:00:25.590519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6621a4a1-602b-43b0-9437-fbf1fc57752d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:25.591659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6621a4a1-602b-43b0-9437-fbf1fc57752d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:25.599662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6621a4a1-602b-43b0-9437-fbf1fc57752d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:25.600470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6621a4a1-602b-43b0-9437-fbf1fc57752d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:25.601414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6621a4a1-602b-43b0-9437-fbf1fc57752d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:25.602355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6621a4a1-602b-43b0-9437-fbf1fc57752d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:25.626208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:25.731869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:25.798144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c50d5626-5103-4b80-bc1c-24d562f36668 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:25.808551 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c50d5626-5103-4b80-bc1c-24d562f36668 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 200 len: 1318 microversion: 2.1 time: 0.935378 Aug 03 02:00:25.810034 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1388/2834] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:24 2022] GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 1318 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:25.816304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-566527f4-2ada-4074-ad8b-06e6a0dde301 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:25.816854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6621a4a1-602b-43b0-9437-fbf1fc57752d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:25.817302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-566527f4-2ada-4074-ad8b-06e6a0dde301 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:25.824976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-566527f4-2ada-4074-ad8b-06e6a0dde301 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:25.826842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-566527f4-2ada-4074-ad8b-06e6a0dde301 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:25.826842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-566527f4-2ada-4074-ad8b-06e6a0dde301 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:25.827565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-566527f4-2ada-4074-ad8b-06e6a0dde301 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:25.829742 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6621a4a1-602b-43b0-9437-fbf1fc57752d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1299 microversion: 2.1 time: 0.258409 Aug 03 02:00:25.840838 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1447/2835] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:25 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1299 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:26.072714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=26 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:26.101750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-566527f4-2ada-4074-ad8b-06e6a0dde301 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a165ac862c6349cd927c829bb9136417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5bb83130fc4c2fa081000f12dec8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:26.110671 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-566527f4-2ada-4074-ad8b-06e6a0dde301 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 200 len: 1616 microversion: 2.1 time: 0.299103 Aug 03 02:00:26.112021 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1389/2836] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:25 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 1616 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:26.404765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-11a48728-99b5-4c56-a6f4-fe0754b76ead req-3dfa0338-3a35-45d7-96d7-0aa6623ffffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3285da37-7f8b-462d-b271-1cc87f6fba1b", "name": "network-vif-deleted", "tag": "df876788-24fb-404a-8272-e552c07ff6fb"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:26.421324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-11a48728-99b5-4c56-a6f4-fe0754b76ead req-3dfa0338-3a35-45d7-96d7-0aa6623ffffc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:26.435925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-11a48728-99b5-4c56-a6f4-fe0754b76ead req-3dfa0338-3a35-45d7-96d7-0aa6623ffffc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:26.450337 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-11a48728-99b5-4c56-a6f4-fe0754b76ead req-3dfa0338-3a35-45d7-96d7-0aa6623ffffc service nova] Creating event network-vif-deleted:df876788-24fb-404a-8272-e552c07ff6fb for instance 3285da37-7f8b-462d-b271-1cc87f6fba1b on n-h2-826529-8 Aug 03 02:00:26.469500 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-11a48728-99b5-4c56-a6f4-fe0754b76ead req-3dfa0338-3a35-45d7-96d7-0aa6623ffffc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067781 Aug 03 02:00:26.470945 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1448/2837] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:00:26.601169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ab2130ad-3dbe-4c1e-98e0-63f357360548 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:26.602431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ab2130ad-3dbe-4c1e-98e0-63f357360548 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:26.611247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab2130ad-3dbe-4c1e-98e0-63f357360548 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:26.612016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab2130ad-3dbe-4c1e-98e0-63f357360548 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:26.613391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab2130ad-3dbe-4c1e-98e0-63f357360548 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:26.614305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab2130ad-3dbe-4c1e-98e0-63f357360548 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:26.839457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cfc878d9-3d88-4fb6-89f0-c271fc63c7d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:26.842834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cfc878d9-3d88-4fb6-89f0-c271fc63c7d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:26.871939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cfc878d9-3d88-4fb6-89f0-c271fc63c7d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:26.876542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cfc878d9-3d88-4fb6-89f0-c271fc63c7d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:26.877951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cfc878d9-3d88-4fb6-89f0-c271fc63c7d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:26.883564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cfc878d9-3d88-4fb6-89f0-c271fc63c7d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:27.249279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=22 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:27.265875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ab2130ad-3dbe-4c1e-98e0-63f357360548 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:27.276810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ab2130ad-3dbe-4c1e-98e0-63f357360548 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:27.278715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ab2130ad-3dbe-4c1e-98e0-63f357360548 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:27.280121 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ab2130ad-3dbe-4c1e-98e0-63f357360548 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1723 microversion: 2.20 time: 0.685123 Aug 03 02:00:27.298744 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1390/2838] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:26 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1723 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:00:27.305102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25f52d06-27b0-48e8-95cf-3a4a1fe26552 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:27.305741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-25f52d06-27b0-48e8-95cf-3a4a1fe26552 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:27.314048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25f52d06-27b0-48e8-95cf-3a4a1fe26552 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:27.314519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25f52d06-27b0-48e8-95cf-3a4a1fe26552 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:27.315374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25f52d06-27b0-48e8-95cf-3a4a1fe26552 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:27.315824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25f52d06-27b0-48e8-95cf-3a4a1fe26552 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:27.561351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cfc878d9-3d88-4fb6-89f0-c271fc63c7d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:27.569340 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cfc878d9-3d88-4fb6-89f0-c271fc63c7d1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 200 len: 1318 microversion: 2.1 time: 0.742134 Aug 03 02:00:27.570623 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1449/2839] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:26 2022] GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 1318 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:00:27.578507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3a6bda66-5204-4400-a14c-ac200aa4dcb9 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:27.579508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3a6bda66-5204-4400-a14c-ac200aa4dcb9 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:27.586342 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a6bda66-5204-4400-a14c-ac200aa4dcb9 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:27.588108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a6bda66-5204-4400-a14c-ac200aa4dcb9 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:27.589213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a6bda66-5204-4400-a14c-ac200aa4dcb9 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:27.589873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a6bda66-5204-4400-a14c-ac200aa4dcb9 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:27.607449 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-3a6bda66-5204-4400-a14c-ac200aa4dcb9 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] HTTP exception thrown: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3a6bda66-5204-4400-a14c-ac200aa4dcb9 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Request method failure captured: Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b HTTP/1.1 Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dYErDng4aHszBxom9bJ-e3vHxu0AxHGTDAi2OmyKjg3fDKP2bel_ddc65UxdHkr_iYdUMS54rqjpNsv8o67hGd5k6csCZy-wIbgur4vY9_1wiqazTrGN9dms-AJEHXPAdYy4RmL9DXwaAKrTXeIe_EWF9v3PduliJC76pg5UFBI8ME Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 0f5bb83130fc4c2fa081000f12dec8ae Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-197782882 Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0f5bb83130fc4c2fa081000f12dec8ae", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0f5bb83130fc4c2fa081000f12dec8ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0f5bb83130fc4c2fa081000f12dec8ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0f5bb83130fc4c2fa081000f12dec8ae"}]}] Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-197782882 Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 0f5bb83130fc4c2fa081000f12dec8ae Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-197782882 Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachSCSIVolumeTestJSON-197782882-project Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: a165ac862c6349cd927c829bb9136417 Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-197782882-project Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '3285da37-7f8b-462d-b271-1cc87f6fba1b'} Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:00:27.609416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:27.616493 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:00:27.616493 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:00:27.616493 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:00:27.616493 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:00:27.616493 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:00:27.616493 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. Aug 03 02:00:27.616493 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:27.619562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3a6bda66-5204-4400-a14c-ac200aa4dcb9 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Returning 404 to user: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:00:27.620679 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3a6bda66-5204-4400-a14c-ac200aa4dcb9 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 404 len: 111 microversion: 2.1 time: 0.047356 Aug 03 02:00:27.621722 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1450/2840] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:27 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:00:27.635098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5590f3f9-89a5-45c3-b273-8c07152c6a8e tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '.version_select at 0x7f5b12518a60>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:27.661564 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5590f3f9-89a5-45c3-b273-8c07152c6a8e tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378201405" status: 202 len: 0 microversion: 2.1 time: 0.034317 Aug 03 02:00:27.666164 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1451/2841] 10.222.0.67 () {58 vars in 1221 bytes} [Wed Aug 3 02:00:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378201405 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:00:27.893622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-25f52d06-27b0-48e8-95cf-3a4a1fe26552 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:27.914130 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-25f52d06-27b0-48e8-95cf-3a4a1fe26552 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1367 microversion: 2.1 time: 0.613633 Aug 03 02:00:27.919392 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1391/2842] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:27 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1367 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:28.305697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a6f3fd5b-a88c-48ac-b7ee-e2ece34f5e3c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:28.306966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a6f3fd5b-a88c-48ac-b7ee-e2ece34f5e3c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:28.314977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6f3fd5b-a88c-48ac-b7ee-e2ece34f5e3c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:28.315720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6f3fd5b-a88c-48ac-b7ee-e2ece34f5e3c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:28.316706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6f3fd5b-a88c-48ac-b7ee-e2ece34f5e3c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:28.317313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6f3fd5b-a88c-48ac-b7ee-e2ece34f5e3c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:28.599588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7b7ba28f-faa3-4116-ab52-f83acfbe43e6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:28.601061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7b7ba28f-faa3-4116-ab52-f83acfbe43e6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:28.620653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b7ba28f-faa3-4116-ab52-f83acfbe43e6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:28.621539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b7ba28f-faa3-4116-ab52-f83acfbe43e6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:28.625571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b7ba28f-faa3-4116-ab52-f83acfbe43e6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:28.627061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b7ba28f-faa3-4116-ab52-f83acfbe43e6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:29.124380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a6f3fd5b-a88c-48ac-b7ee-e2ece34f5e3c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:29.139477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a6f3fd5b-a88c-48ac-b7ee-e2ece34f5e3c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:29.141908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a6f3fd5b-a88c-48ac-b7ee-e2ece34f5e3c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:29.143251 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a6f3fd5b-a88c-48ac-b7ee-e2ece34f5e3c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1723 microversion: 2.20 time: 0.842894 Aug 03 02:00:29.143909 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1452/2843] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:28 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1723 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:00:29.153206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d143dbf-a880-4e02-b534-4b68e65e07cb tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:29.154189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6d143dbf-a880-4e02-b534-4b68e65e07cb tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:29.161043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:29.175091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d143dbf-a880-4e02-b534-4b68e65e07cb tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:29.178481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d143dbf-a880-4e02-b534-4b68e65e07cb tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:29.180057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d143dbf-a880-4e02-b534-4b68e65e07cb tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:29.181843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d143dbf-a880-4e02-b534-4b68e65e07cb tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:29.296220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7b7ba28f-faa3-4116-ab52-f83acfbe43e6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:29.324859 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7b7ba28f-faa3-4116-ab52-f83acfbe43e6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 200 len: 1318 microversion: 2.1 time: 0.733172 Aug 03 02:00:29.326499 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1392/2844] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:28 2022] GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 1318 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:29.696506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6d143dbf-a880-4e02-b534-4b68e65e07cb tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:29.707284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-de87df73-7cc4-4752-8cb3-bd95f959a290 req-8febff3b-bf22-48bb-bc30-b27388c3f795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b22f91a3-0dc4-4228-9510-8605086caef8", "name": "network-vif-plugged", "status": "completed", "tag": "2a64e8d3-4059-41b5-aaec-8cba861ff604"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:29.724903 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6d143dbf-a880-4e02-b534-4b68e65e07cb tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1367 microversion: 2.1 time: 0.576917 Aug 03 02:00:29.737926 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1453/2845] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:29 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1367 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:29.751757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-de87df73-7cc4-4752-8cb3-bd95f959a290 req-8febff3b-bf22-48bb-bc30-b27388c3f795 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:29.752440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-de87df73-7cc4-4752-8cb3-bd95f959a290 req-8febff3b-bf22-48bb-bc30-b27388c3f795 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:29.776544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-79844128-e1b7-48ac-8a58-7a427864f6f7 req-07e5c27d-39dd-49d2-bff3-9cf5eba10e05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6731bf52-2375-4f2a-9905-79b334d5917b", "tag": "63736276-b283-41b5-b35a-a47cb4db71fe"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:29.805177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-79844128-e1b7-48ac-8a58-7a427864f6f7 req-07e5c27d-39dd-49d2-bff3-9cf5eba10e05 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:29.809636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-79844128-e1b7-48ac-8a58-7a427864f6f7 req-07e5c27d-39dd-49d2-bff3-9cf5eba10e05 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:29.810557 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-de87df73-7cc4-4752-8cb3-bd95f959a290 req-8febff3b-bf22-48bb-bc30-b27388c3f795 service nova] Creating event network-vif-plugged:2a64e8d3-4059-41b5-aaec-8cba861ff604 for instance b22f91a3-0dc4-4228-9510-8605086caef8 on n-h2-826529-8 Aug 03 02:00:29.826843 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-de87df73-7cc4-4752-8cb3-bd95f959a290 req-8febff3b-bf22-48bb-bc30-b27388c3f795 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144746 Aug 03 02:00:29.832115 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1393/2846] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:00:29.834770 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-79844128-e1b7-48ac-8a58-7a427864f6f7 req-07e5c27d-39dd-49d2-bff3-9cf5eba10e05 service nova] Creating event network-changed:63736276-b283-41b5-b35a-a47cb4db71fe for instance 6731bf52-2375-4f2a-9905-79b334d5917b on n-h2-826529-8 Aug 03 02:00:29.855314 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-79844128-e1b7-48ac-8a58-7a427864f6f7 req-07e5c27d-39dd-49d2-bff3-9cf5eba10e05 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094700 Aug 03 02:00:29.856015 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1454/2847] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:00:30.170238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9259082d-fa15-40e3-9c2f-ed72a0b6a1c5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:30.170989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9259082d-fa15-40e3-9c2f-ed72a0b6a1c5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:30.191900 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9259082d-fa15-40e3-9c2f-ed72a0b6a1c5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:30.192778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9259082d-fa15-40e3-9c2f-ed72a0b6a1c5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:30.195505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9259082d-fa15-40e3-9c2f-ed72a0b6a1c5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:30.196846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9259082d-fa15-40e3-9c2f-ed72a0b6a1c5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:30.349624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-40e71cb6-ec9f-4d79-af32-244442eb5157 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:30.350340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-40e71cb6-ec9f-4d79-af32-244442eb5157 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:30.379148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40e71cb6-ec9f-4d79-af32-244442eb5157 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:30.380052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40e71cb6-ec9f-4d79-af32-244442eb5157 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:30.381124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40e71cb6-ec9f-4d79-af32-244442eb5157 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:30.383285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40e71cb6-ec9f-4d79-af32-244442eb5157 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:30.782722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9259082d-fa15-40e3-9c2f-ed72a0b6a1c5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:30.794027 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9259082d-fa15-40e3-9c2f-ed72a0b6a1c5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:30.798680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9259082d-fa15-40e3-9c2f-ed72a0b6a1c5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:30.801652 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9259082d-fa15-40e3-9c2f-ed72a0b6a1c5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1744 microversion: 2.20 time: 0.635668 Aug 03 02:00:30.827275 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1394/2848] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:30 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1744 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:00:30.840288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-578dc37b-be19-4e23-857b-897791412d03 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:30.841117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-578dc37b-be19-4e23-857b-897791412d03 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:30.860641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-578dc37b-be19-4e23-857b-897791412d03 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:30.861111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-578dc37b-be19-4e23-857b-897791412d03 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:30.862117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-578dc37b-be19-4e23-857b-897791412d03 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:30.865040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-578dc37b-be19-4e23-857b-897791412d03 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:31.139463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-40e71cb6-ec9f-4d79-af32-244442eb5157 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:31.161138 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-40e71cb6-ec9f-4d79-af32-244442eb5157 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 200 len: 1318 microversion: 2.1 time: 0.815655 Aug 03 02:00:31.162975 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1455/2849] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:30 2022] GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 1318 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:31.356768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-578dc37b-be19-4e23-857b-897791412d03 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:31.367484 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-578dc37b-be19-4e23-857b-897791412d03 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1367 microversion: 2.1 time: 0.538329 Aug 03 02:00:31.368232 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1395/2850] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:30 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1367 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:31.837099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1480a6ad-a3dc-46f9-9ae3-64f26b7052b4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:31.837999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1480a6ad-a3dc-46f9-9ae3-64f26b7052b4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:31.848469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1480a6ad-a3dc-46f9-9ae3-64f26b7052b4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:31.853054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1480a6ad-a3dc-46f9-9ae3-64f26b7052b4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:31.856795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1480a6ad-a3dc-46f9-9ae3-64f26b7052b4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:31.857528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1480a6ad-a3dc-46f9-9ae3-64f26b7052b4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:32.017756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-e726d8d7-21a0-4afc-aa92-53032a7ecaf6 req-c7ac9532-117d-46a1-b9c1-5cc8ad6ba8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5828876-bf1f-481e-9960-b98652a1ce58", "name": "network-vif-plugged", "status": "completed", "tag": "d9877663-29d9-418c-9aa5-dad3ecd344d4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:32.061185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e726d8d7-21a0-4afc-aa92-53032a7ecaf6 req-c7ac9532-117d-46a1-b9c1-5cc8ad6ba8a9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:32.061643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e726d8d7-21a0-4afc-aa92-53032a7ecaf6 req-c7ac9532-117d-46a1-b9c1-5cc8ad6ba8a9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:32.132658 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e726d8d7-21a0-4afc-aa92-53032a7ecaf6 req-c7ac9532-117d-46a1-b9c1-5cc8ad6ba8a9 service nova] Creating event network-vif-plugged:d9877663-29d9-418c-9aa5-dad3ecd344d4 for instance e5828876-bf1f-481e-9960-b98652a1ce58 on n-h1-826529-8 Aug 03 02:00:32.147090 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-e726d8d7-21a0-4afc-aa92-53032a7ecaf6 req-c7ac9532-117d-46a1-b9c1-5cc8ad6ba8a9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132913 Aug 03 02:00:32.149588 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1396/2851] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:00:32.188518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ddd5a3b0-40b5-407b-8c4e-2056a6a5e6c9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:32.193023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ddd5a3b0-40b5-407b-8c4e-2056a6a5e6c9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:32.212790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ddd5a3b0-40b5-407b-8c4e-2056a6a5e6c9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:32.214293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ddd5a3b0-40b5-407b-8c4e-2056a6a5e6c9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:32.217371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ddd5a3b0-40b5-407b-8c4e-2056a6a5e6c9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:32.218042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ddd5a3b0-40b5-407b-8c4e-2056a6a5e6c9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:32.698988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1480a6ad-a3dc-46f9-9ae3-64f26b7052b4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:32.721515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1480a6ad-a3dc-46f9-9ae3-64f26b7052b4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:32.725724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1480a6ad-a3dc-46f9-9ae3-64f26b7052b4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:32.727404 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1480a6ad-a3dc-46f9-9ae3-64f26b7052b4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1744 microversion: 2.20 time: 0.894505 Aug 03 02:00:32.752036 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1456/2852] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:31 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1744 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:00:32.765830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aded1be5-953e-4bc0-9b07-d6a155d69c93 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:32.768685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-aded1be5-953e-4bc0-9b07-d6a155d69c93 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:32.802840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aded1be5-953e-4bc0-9b07-d6a155d69c93 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:32.807165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aded1be5-953e-4bc0-9b07-d6a155d69c93 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:32.810742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aded1be5-953e-4bc0-9b07-d6a155d69c93 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:32.812057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aded1be5-953e-4bc0-9b07-d6a155d69c93 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:33.242516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ddd5a3b0-40b5-407b-8c4e-2056a6a5e6c9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:33.247532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:33.297912 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ddd5a3b0-40b5-407b-8c4e-2056a6a5e6c9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 200 len: 1318 microversion: 2.1 time: 1.113562 Aug 03 02:00:33.317770 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1397/2853] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:32 2022] GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 1318 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:33.638981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-aded1be5-953e-4bc0-9b07-d6a155d69c93 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:33.647326 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-aded1be5-953e-4bc0-9b07-d6a155d69c93 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1367 microversion: 2.1 time: 0.891930 Aug 03 02:00:33.647925 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1457/2854] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:32 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1367 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:33.771973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a30f047a-f4b5-4ea1-bc37-460d979b3464 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:33.774815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a30f047a-f4b5-4ea1-bc37-460d979b3464 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:33.801509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a30f047a-f4b5-4ea1-bc37-460d979b3464 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:33.802021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a30f047a-f4b5-4ea1-bc37-460d979b3464 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:33.802851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a30f047a-f4b5-4ea1-bc37-460d979b3464 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:33.809247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a30f047a-f4b5-4ea1-bc37-460d979b3464 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:34.317666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-3871f953-9c54-4822-a574-f6217392c6a4 req-950cd1ab-5ee6-4c55-bccb-d7135a36f923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7d0db2-f64d-4df7-b0dd-2ecf688290b0", "name": "network-vif-plugged", "status": "completed", "tag": "1b653dfb-172c-43c5-8d81-55e28541d60d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:34.340672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3871f953-9c54-4822-a574-f6217392c6a4 req-950cd1ab-5ee6-4c55-bccb-d7135a36f923 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:34.343899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3871f953-9c54-4822-a574-f6217392c6a4 req-950cd1ab-5ee6-4c55-bccb-d7135a36f923 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:34.378262 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-3871f953-9c54-4822-a574-f6217392c6a4 req-950cd1ab-5ee6-4c55-bccb-d7135a36f923 service nova] Creating event network-vif-plugged:1b653dfb-172c-43c5-8d81-55e28541d60d for instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 on n-h2-826529-8 Aug 03 02:00:34.384956 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-3871f953-9c54-4822-a574-f6217392c6a4 req-950cd1ab-5ee6-4c55-bccb-d7135a36f923 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071261 Aug 03 02:00:34.388400 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1458/2855] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:00:34.400811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-749c8285-1d0c-4060-9c37-5cd964ac0ceb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:34.401841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-749c8285-1d0c-4060-9c37-5cd964ac0ceb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:34.422609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-749c8285-1d0c-4060-9c37-5cd964ac0ceb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:34.426864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-749c8285-1d0c-4060-9c37-5cd964ac0ceb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:34.429581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-749c8285-1d0c-4060-9c37-5cd964ac0ceb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:34.432972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-749c8285-1d0c-4060-9c37-5cd964ac0ceb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:35.178183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a30f047a-f4b5-4ea1-bc37-460d979b3464 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:35.188753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a30f047a-f4b5-4ea1-bc37-460d979b3464 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:35.198615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a30f047a-f4b5-4ea1-bc37-460d979b3464 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:35.200192 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a30f047a-f4b5-4ea1-bc37-460d979b3464 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1744 microversion: 2.20 time: 1.447768 Aug 03 02:00:35.201235 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1398/2856] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:33 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1744 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:00:35.215134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dea2f966-93ea-484d-aa7e-925b837f0637 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:35.215890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dea2f966-93ea-484d-aa7e-925b837f0637 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:35.238071 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dea2f966-93ea-484d-aa7e-925b837f0637 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:35.238770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dea2f966-93ea-484d-aa7e-925b837f0637 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:35.239780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dea2f966-93ea-484d-aa7e-925b837f0637 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:35.240631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dea2f966-93ea-484d-aa7e-925b837f0637 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:35.289959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dea2f966-93ea-484d-aa7e-925b837f0637 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:00:35.492995 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dea2f966-93ea-484d-aa7e-925b837f0637 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 204 len: 0 microversion: 2.1 time: 0.288825 Aug 03 02:00:35.495343 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1399/2857] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:00:35 2022] DELETE /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:00:35.512013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f62678f5-10ac-4ebb-8d99-4e8fee40d54d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:35.513849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f62678f5-10ac-4ebb-8d99-4e8fee40d54d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:35.532841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f62678f5-10ac-4ebb-8d99-4e8fee40d54d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:35.533541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f62678f5-10ac-4ebb-8d99-4e8fee40d54d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:35.534742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f62678f5-10ac-4ebb-8d99-4e8fee40d54d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:35.538542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f62678f5-10ac-4ebb-8d99-4e8fee40d54d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:36.187907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-749c8285-1d0c-4060-9c37-5cd964ac0ceb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:36.211188 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-749c8285-1d0c-4060-9c37-5cd964ac0ceb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 200 len: 1467 microversion: 2.1 time: 1.814837 Aug 03 02:00:36.222948 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1459/2858] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:34 2022] GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 1467 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:36.238321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-42c7a6a2-cebf-49ba-8524-80bd2fce10d9 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:36.241135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-42c7a6a2-cebf-49ba-8524-80bd2fce10d9 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:36.271700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42c7a6a2-cebf-49ba-8524-80bd2fce10d9 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:36.272415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42c7a6a2-cebf-49ba-8524-80bd2fce10d9 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:36.275705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42c7a6a2-cebf-49ba-8524-80bd2fce10d9 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:36.280125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42c7a6a2-cebf-49ba-8524-80bd2fce10d9 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:36.421211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f62678f5-10ac-4ebb-8d99-4e8fee40d54d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:36.431077 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f62678f5-10ac-4ebb-8d99-4e8fee40d54d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1367 microversion: 2.1 time: 0.934253 Aug 03 02:00:36.455123 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1400/2859] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:35 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1367 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:36.463368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4bd12e37-59c5-4e98-bc7a-7c9a6b16df40 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:36.464427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4bd12e37-59c5-4e98-bc7a-7c9a6b16df40 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:36.477073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4bd12e37-59c5-4e98-bc7a-7c9a6b16df40 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:36.482307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4bd12e37-59c5-4e98-bc7a-7c9a6b16df40 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:36.483486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4bd12e37-59c5-4e98-bc7a-7c9a6b16df40 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:36.484312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4bd12e37-59c5-4e98-bc7a-7c9a6b16df40 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:37.209413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-42c7a6a2-cebf-49ba-8524-80bd2fce10d9 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:37.228095 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-42c7a6a2-cebf-49ba-8524-80bd2fce10d9 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1666 microversion: 2.1 time: 1.002228 Aug 03 02:00:37.248375 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1460/2860] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:36 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1666 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:37.275568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2d66e4d-81fe-400e-be1e-b933652341db tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:37.276658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c2d66e4d-81fe-400e-be1e-b933652341db tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: b22f91a3-0dc4-4228-9510-8605086caef8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:37.304096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2d66e4d-81fe-400e-be1e-b933652341db tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:37.304564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2d66e4d-81fe-400e-be1e-b933652341db tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:37.314532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2d66e4d-81fe-400e-be1e-b933652341db tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:37.315246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2d66e4d-81fe-400e-be1e-b933652341db tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:37.804257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4bd12e37-59c5-4e98-bc7a-7c9a6b16df40 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:37.814111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4bd12e37-59c5-4e98-bc7a-7c9a6b16df40 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:37.821581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4bd12e37-59c5-4e98-bc7a-7c9a6b16df40 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:37.824005 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4bd12e37-59c5-4e98-bc7a-7c9a6b16df40 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1739 microversion: 2.20 time: 1.367467 Aug 03 02:00:37.828387 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1401/2861] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:36 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1739 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:00:37.846538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-794dd680-c8fc-4d5f-b0c1-05730a3837af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:37.847230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-794dd680-c8fc-4d5f-b0c1-05730a3837af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:37.869578 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-794dd680-c8fc-4d5f-b0c1-05730a3837af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:37.875984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-794dd680-c8fc-4d5f-b0c1-05730a3837af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:37.876901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-794dd680-c8fc-4d5f-b0c1-05730a3837af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:37.877365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-794dd680-c8fc-4d5f-b0c1-05730a3837af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:38.570245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c2d66e4d-81fe-400e-be1e-b933652341db tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:38.603547 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c2d66e4d-81fe-400e-be1e-b933652341db tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8" status: 200 len: 1468 microversion: 2.1 time: 1.345424 Aug 03 02:00:38.607744 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1461/2862] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:37 2022] GET /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8 => generated 1468 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:38.622816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-92389aee-27a6-4e28-8f81-a3490d4d6b34 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:38.626624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-92389aee-27a6-4e28-8f81-a3490d4d6b34 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:38.646655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92389aee-27a6-4e28-8f81-a3490d4d6b34 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:38.647531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92389aee-27a6-4e28-8f81-a3490d4d6b34 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:38.649095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92389aee-27a6-4e28-8f81-a3490d4d6b34 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:38.652488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92389aee-27a6-4e28-8f81-a3490d4d6b34 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:38.686345 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-92389aee-27a6-4e28-8f81-a3490d4d6b34 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] HTTP exception thrown: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-92389aee-27a6-4e28-8f81-a3490d4d6b34 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Request method failure captured: Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b HTTP/1.1 Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dYErDng4aHszBxom9bJ-e3vHxu0AxHGTDAi2OmyKjg3fDKP2bel_ddc65UxdHkr_iYdUMS54rqjpNsv8o67hGd5k6csCZy-wIbgur4vY9_1wiqazTrGN9dms-AJEHXPAdYy4RmL9DXwaAKrTXeIe_EWF9v3PduliJC76pg5UFBI8ME Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 0f5bb83130fc4c2fa081000f12dec8ae Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-197782882 Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0f5bb83130fc4c2fa081000f12dec8ae", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0f5bb83130fc4c2fa081000f12dec8ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0f5bb83130fc4c2fa081000f12dec8ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0f5bb83130fc4c2fa081000f12dec8ae"}]}] Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-197782882 Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 0f5bb83130fc4c2fa081000f12dec8ae Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-197782882 Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachSCSIVolumeTestJSON-197782882-project Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: a165ac862c6349cd927c829bb9136417 Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-197782882-project Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '3285da37-7f8b-462d-b271-1cc87f6fba1b'} Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:00:38.709491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:00:38.714709 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. Aug 03 02:00:38.714709 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:38.714709 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:00:38.714709 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:38.714709 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:00:38.714709 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:00:38.714709 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:00:38.714709 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:00:38.714709 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:00:38.714709 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. Aug 03 02:00:38.714709 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:38.714709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-92389aee-27a6-4e28-8f81-a3490d4d6b34 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Returning 404 to user: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:00:38.714709 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-92389aee-27a6-4e28-8f81-a3490d4d6b34 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 404 len: 111 microversion: 2.1 time: 0.101950 Aug 03 02:00:38.714709 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1462/2863] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:00:38 2022] DELETE /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:00:38.726064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6e803e8b-4f39-4c12-9471-139a3e50c2d4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:38.726704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6e803e8b-4f39-4c12-9471-139a3e50c2d4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:38.759330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e803e8b-4f39-4c12-9471-139a3e50c2d4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:38.759891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e803e8b-4f39-4c12-9471-139a3e50c2d4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:38.767869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e803e8b-4f39-4c12-9471-139a3e50c2d4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:38.768352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e803e8b-4f39-4c12-9471-139a3e50c2d4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:39.736192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6e803e8b-4f39-4c12-9471-139a3e50c2d4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:39.756962 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6e803e8b-4f39-4c12-9471-139a3e50c2d4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1367 microversion: 2.1 time: 1.041299 Aug 03 02:00:39.758353 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1463/2864] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:38 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1367 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:39.769415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-81f28de4-aec4-49f8-8301-b1c68f206b6e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:39.778052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-81f28de4-aec4-49f8-8301-b1c68f206b6e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:39.804498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81f28de4-aec4-49f8-8301-b1c68f206b6e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:39.804946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81f28de4-aec4-49f8-8301-b1c68f206b6e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:39.805744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81f28de4-aec4-49f8-8301-b1c68f206b6e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:39.806374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81f28de4-aec4-49f8-8301-b1c68f206b6e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:40.905211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-794dd680-c8fc-4d5f-b0c1-05730a3837af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:40.917220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-794dd680-c8fc-4d5f-b0c1-05730a3837af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:40.919008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-794dd680-c8fc-4d5f-b0c1-05730a3837af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:40.926787 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-794dd680-c8fc-4d5f-b0c1-05730a3837af tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2952 microversion: 2.32 time: 3.094423 Aug 03 02:00:40.960396 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1402/2865] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:37 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2952 bytes in 3131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:00:40.978706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-02f6da65-1b74-4977-b283-fcf3f97fa608 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:40.995129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-02f6da65-1b74-4977-b283-fcf3f97fa608 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:40.996920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-02f6da65-1b74-4977-b283-fcf3f97fa608 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Searching by: {'reservation_id': 'r-ikvy3z2w', 'deleted': False, 'project_id': '66bb501c093b4f47a1a50eb37387bb14'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:00:41.019613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02f6da65-1b74-4977-b283-fcf3f97fa608 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:41.020264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02f6da65-1b74-4977-b283-fcf3f97fa608 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:41.021940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02f6da65-1b74-4977-b283-fcf3f97fa608 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:41.022784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02f6da65-1b74-4977-b283-fcf3f97fa608 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:41.199678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-02f6da65-1b74-4977-b283-fcf3f97fa608 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:00:41.389673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-02f6da65-1b74-4977-b283-fcf3f97fa608 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:41.415015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02f6da65-1b74-4977-b283-fcf3f97fa608 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:41.419254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02f6da65-1b74-4977-b283-fcf3f97fa608 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:42.017757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-81f28de4-aec4-49f8-8301-b1c68f206b6e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:42.033598 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-81f28de4-aec4-49f8-8301-b1c68f206b6e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1666 microversion: 2.1 time: 2.273147 Aug 03 02:00:42.034470 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1464/2866] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:39 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1666 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:42.051573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d92da709-a63f-453b-b9b9-a06b7e16b643 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:42.052643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d92da709-a63f-453b-b9b9-a06b7e16b643 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] [instance: 3285da37-7f8b-462d-b271-1cc87f6fba1b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:42.067233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d92da709-a63f-453b-b9b9-a06b7e16b643 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:42.071038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d92da709-a63f-453b-b9b9-a06b7e16b643 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:42.072759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d92da709-a63f-453b-b9b9-a06b7e16b643 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:42.077112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d92da709-a63f-453b-b9b9-a06b7e16b643 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:42.095620 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-02f6da65-1b74-4977-b283-fcf3f97fa608 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/detail?reservation_id=r-ikvy3z2w" status: 200 len: 2928 microversion: 2.1 time: 1.132840 Aug 03 02:00:42.096523 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1403/2867] 10.222.0.67 () {58 vars in 1197 bytes} [Wed Aug 3 02:00:40 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ikvy3z2w => generated 2928 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:42.114369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-09a577da-0c5b-48c6-80bb-0418d4682795 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:42.118025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-09a577da-0c5b-48c6-80bb-0418d4682795 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:42.135525 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-d92da709-a63f-453b-b9b9-a06b7e16b643 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] HTTP exception thrown: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d92da709-a63f-453b-b9b9-a06b7e16b643 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Request method failure captured: Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b HTTP/1.1 Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dYErDng4aHszBxom9bJ-e3vHxu0AxHGTDAi2OmyKjg3fDKP2bel_ddc65UxdHkr_iYdUMS54rqjpNsv8o67hGd5k6csCZy-wIbgur4vY9_1wiqazTrGN9dms-AJEHXPAdYy4RmL9DXwaAKrTXeIe_EWF9v3PduliJC76pg5UFBI8ME Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 0f5bb83130fc4c2fa081000f12dec8ae Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-197782882 Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0f5bb83130fc4c2fa081000f12dec8ae", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0f5bb83130fc4c2fa081000f12dec8ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0f5bb83130fc4c2fa081000f12dec8ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0f5bb83130fc4c2fa081000f12dec8ae"}]}] Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-197782882 Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 0f5bb83130fc4c2fa081000f12dec8ae Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-197782882 Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachSCSIVolumeTestJSON-197782882-project Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: a165ac862c6349cd927c829bb9136417 Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-197782882-project Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '3285da37-7f8b-462d-b271-1cc87f6fba1b'} Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:00:42.140886 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:42.145325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:00:42.145325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:00:42.145325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:00:42.145325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:00:42.145325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:00:42.145325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. Aug 03 02:00:42.145325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:42.151799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09a577da-0c5b-48c6-80bb-0418d4682795 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:42.152252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09a577da-0c5b-48c6-80bb-0418d4682795 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:42.153289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d92da709-a63f-453b-b9b9-a06b7e16b643 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] Returning 404 to user: Instance 3285da37-7f8b-462d-b271-1cc87f6fba1b could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:00:42.159000 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d92da709-a63f-453b-b9b9-a06b7e16b643 tempest-AttachSCSIVolumeTestJSON-197782882 tempest-AttachSCSIVolumeTestJSON-197782882-project] 10.222.0.67 "GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b" status: 404 len: 111 microversion: 2.1 time: 0.121275 Aug 03 02:00:42.160310 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1465/2868] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:42 2022] GET /compute/v2.1/servers/3285da37-7f8b-462d-b271-1cc87f6fba1b => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:00:42.167324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09a577da-0c5b-48c6-80bb-0418d4682795 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:42.168130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09a577da-0c5b-48c6-80bb-0418d4682795 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:42.174217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-0d1ba371-6ccd-43ce-9a76-f5520c522d51 req-42366b38-ee18-4460-8286-cf52beb08aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6731bf52-2375-4f2a-9905-79b334d5917b", "name": "network-vif-plugged", "status": "completed", "tag": "63736276-b283-41b5-b35a-a47cb4db71fe"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:42.209822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-0d1ba371-6ccd-43ce-9a76-f5520c522d51 req-42366b38-ee18-4460-8286-cf52beb08aea service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:42.210815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-0d1ba371-6ccd-43ce-9a76-f5520c522d51 req-42366b38-ee18-4460-8286-cf52beb08aea service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:42.237640 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-0d1ba371-6ccd-43ce-9a76-f5520c522d51 req-42366b38-ee18-4460-8286-cf52beb08aea service nova] Creating event network-vif-plugged:63736276-b283-41b5-b35a-a47cb4db71fe for instance 6731bf52-2375-4f2a-9905-79b334d5917b on n-h2-826529-8 Aug 03 02:00:42.255174 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-0d1ba371-6ccd-43ce-9a76-f5520c522d51 req-42366b38-ee18-4460-8286-cf52beb08aea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093194 Aug 03 02:00:42.259768 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1466/2869] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:00:42.288459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b050e336-b31c-47e5-b8cf-4d727e86ff12 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:42.290999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b050e336-b31c-47e5-b8cf-4d727e86ff12 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:42.310333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b050e336-b31c-47e5-b8cf-4d727e86ff12 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:42.313230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b050e336-b31c-47e5-b8cf-4d727e86ff12 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:42.315102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b050e336-b31c-47e5-b8cf-4d727e86ff12 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:42.322253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b050e336-b31c-47e5-b8cf-4d727e86ff12 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:43.586272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-09a577da-0c5b-48c6-80bb-0418d4682795 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:43.599752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-09a577da-0c5b-48c6-80bb-0418d4682795 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:43.603575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-09a577da-0c5b-48c6-80bb-0418d4682795 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:43.605835 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-09a577da-0c5b-48c6-80bb-0418d4682795 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1739 microversion: 2.20 time: 1.507791 Aug 03 02:00:43.630493 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1404/2870] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:42 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1739 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:00:43.644921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7da0b8ee-532d-4499-8ccc-2e3a7607db45 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:43.647263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7da0b8ee-532d-4499-8ccc-2e3a7607db45 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:43.657708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7da0b8ee-532d-4499-8ccc-2e3a7607db45 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:43.658521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7da0b8ee-532d-4499-8ccc-2e3a7607db45 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:43.659541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7da0b8ee-532d-4499-8ccc-2e3a7607db45 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:43.660166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7da0b8ee-532d-4499-8ccc-2e3a7607db45 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:43.733306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b050e336-b31c-47e5-b8cf-4d727e86ff12 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:43.758474 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b050e336-b31c-47e5-b8cf-4d727e86ff12 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1367 microversion: 2.1 time: 1.496775 Aug 03 02:00:43.759993 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1467/2871] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:42 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1367 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:43.766125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7f0ecb73-5d3f-44a9-b19c-ae3d5dc9d600 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:43.788426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.compute.server_groups [None req-7f0ecb73-5d3f-44a9-b19c-ae3d5dc9d600 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Querying cell 812a442e-24ba-4152-b2b0-f99907b19272(cell1) for 2 instances {{(pid=125941) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 03 02:00:43.789547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f0ecb73-5d3f-44a9-b19c-ae3d5dc9d600 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:43.790175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f0ecb73-5d3f-44a9-b19c-ae3d5dc9d600 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:43.833038 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7f0ecb73-5d3f-44a9-b19c-ae3d5dc9d600 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups/d1fe1cce-fb90-4322-883d-83fb6f40bba9" status: 200 len: 270 microversion: 2.1 time: 0.071611 Aug 03 02:00:43.834378 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1468/2872] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 02:00:43 2022] GET /compute/v2.1/os-server-groups/d1fe1cce-fb90-4322-883d-83fb6f40bba9 => generated 270 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:00:43.839829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-963c60d2-bee3-44ba-8446-eb5571e887c0 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:43.840687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-963c60d2-bee3-44ba-8446-eb5571e887c0 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:43.851640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-963c60d2-bee3-44ba-8446-eb5571e887c0 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:43.852367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-963c60d2-bee3-44ba-8446-eb5571e887c0 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:43.854577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-963c60d2-bee3-44ba-8446-eb5571e887c0 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:43.856153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-963c60d2-bee3-44ba-8446-eb5571e887c0 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:44.769920 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7da0b8ee-532d-4499-8ccc-2e3a7607db45 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174/os-interface" status: 200 len: 1832 microversion: 2.32 time: 1.133110 Aug 03 02:00:44.770562 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1405/2873] 10.222.0.67 () {60 vars in 1316 bytes} [Wed Aug 3 02:00:43 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174/os-interface => generated 1832 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:00:44.778413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d22ae3a7-06ef-4c5d-96d1-8a4f75d21aaa tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:44.779379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d22ae3a7-06ef-4c5d-96d1-8a4f75d21aaa tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:44.805285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d22ae3a7-06ef-4c5d-96d1-8a4f75d21aaa tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:44.807655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d22ae3a7-06ef-4c5d-96d1-8a4f75d21aaa tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:44.811631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d22ae3a7-06ef-4c5d-96d1-8a4f75d21aaa tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:44.812873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d22ae3a7-06ef-4c5d-96d1-8a4f75d21aaa tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:45.297541 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d22ae3a7-06ef-4c5d-96d1-8a4f75d21aaa tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 200 len: 1618 microversion: 2.1 time: 0.525784 Aug 03 02:00:45.300885 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1406/2874] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:44 2022] GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 1618 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:45.315419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-0412f429-3eeb-4470-9e0e-1d9fc36f5bed req-768aa4d0-0a3c-4914-8a42-849976baeb73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0854fcf5-4f57-475f-90e1-168756cd85ec", "name": "network-vif-unplugged", "status": "completed", "tag": "68bee7ad-303d-4e02-8c6b-ac1919fcdfd4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:45.344953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0412f429-3eeb-4470-9e0e-1d9fc36f5bed req-768aa4d0-0a3c-4914-8a42-849976baeb73 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:45.348032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0412f429-3eeb-4470-9e0e-1d9fc36f5bed req-768aa4d0-0a3c-4914-8a42-849976baeb73 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:45.396219 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-0412f429-3eeb-4470-9e0e-1d9fc36f5bed req-768aa4d0-0a3c-4914-8a42-849976baeb73 service nova] Creating event network-vif-unplugged:68bee7ad-303d-4e02-8c6b-ac1919fcdfd4 for instance 0854fcf5-4f57-475f-90e1-168756cd85ec on n-h1-826529-8 Aug 03 02:00:45.417481 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-0412f429-3eeb-4470-9e0e-1d9fc36f5bed req-768aa4d0-0a3c-4914-8a42-849976baeb73 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112978 Aug 03 02:00:45.419611 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1407/2875] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:00:45.431974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c4562ac9-0315-4a15-a49d-b74df2c86fe1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:45.432705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c4562ac9-0315-4a15-a49d-b74df2c86fe1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:45.451261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4562ac9-0315-4a15-a49d-b74df2c86fe1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:45.451813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4562ac9-0315-4a15-a49d-b74df2c86fe1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:45.452825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4562ac9-0315-4a15-a49d-b74df2c86fe1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:45.453594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4562ac9-0315-4a15-a49d-b74df2c86fe1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:46.525484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-963c60d2-bee3-44ba-8446-eb5571e887c0 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:46.545176 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-963c60d2-bee3-44ba-8446-eb5571e887c0 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1666 microversion: 2.1 time: 2.702252 Aug 03 02:00:46.547282 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1469/2876] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:43 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1666 bytes in 2711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:46.571489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7945c1bf-26e9-4a4a-93e6-96e662df9c78 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:46.572802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7945c1bf-26e9-4a4a-93e6-96e662df9c78 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:46.626689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7945c1bf-26e9-4a4a-93e6-96e662df9c78 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:46.631517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7945c1bf-26e9-4a4a-93e6-96e662df9c78 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:46.637915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7945c1bf-26e9-4a4a-93e6-96e662df9c78 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:46.642259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7945c1bf-26e9-4a4a-93e6-96e662df9c78 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:46.667202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:46.758538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c4562ac9-0315-4a15-a49d-b74df2c86fe1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:46.775237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c4562ac9-0315-4a15-a49d-b74df2c86fe1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:46.806516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c4562ac9-0315-4a15-a49d-b74df2c86fe1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:46.809535 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c4562ac9-0315-4a15-a49d-b74df2c86fe1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1739 microversion: 2.20 time: 1.388712 Aug 03 02:00:46.815923 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1408/2877] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:45 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1739 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:00:46.850702 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c0613d5f-b4fc-453f-a40f-19ef3c3a3eb6 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:46.854149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c0613d5f-b4fc-453f-a40f-19ef3c3a3eb6 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] [instance: b22f91a3-0dc4-4228-9510-8605086caef8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:46.876049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0613d5f-b4fc-453f-a40f-19ef3c3a3eb6 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:46.876605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0613d5f-b4fc-453f-a40f-19ef3c3a3eb6 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:46.882427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0613d5f-b4fc-453f-a40f-19ef3c3a3eb6 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:46.884323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0613d5f-b4fc-453f-a40f-19ef3c3a3eb6 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:47.527291 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c0613d5f-b4fc-453f-a40f-19ef3c3a3eb6 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8" status: 200 len: 1619 microversion: 2.1 time: 0.692106 Aug 03 02:00:47.543804 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1409/2878] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:46 2022] GET /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8 => generated 1619 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:47.588701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7945c1bf-26e9-4a4a-93e6-96e662df9c78 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:47.603408 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7945c1bf-26e9-4a4a-93e6-96e662df9c78 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1558 microversion: 2.1 time: 1.050329 Aug 03 02:00:47.606615 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1470/2879] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:46 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1558 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:47.608232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ba4c4a06-8274-4d2d-8f7e-ef7a14b519a1 req-998e3c52-6e20-4bf7-b8d6-37defcba4c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0854fcf5-4f57-475f-90e1-168756cd85ec", "name": "network-vif-deleted", "tag": "68bee7ad-303d-4e02-8c6b-ac1919fcdfd4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:47.614484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7b41c61a-90ad-4521-8d6f-aa4e4d04d430 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:47.619671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7b41c61a-90ad-4521-8d6f-aa4e4d04d430 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:47.627249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=69 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:47.636556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b41c61a-90ad-4521-8d6f-aa4e4d04d430 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:47.637812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b41c61a-90ad-4521-8d6f-aa4e4d04d430 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:47.638974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ba4c4a06-8274-4d2d-8f7e-ef7a14b519a1 req-998e3c52-6e20-4bf7-b8d6-37defcba4c2b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:47.640812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b41c61a-90ad-4521-8d6f-aa4e4d04d430 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:47.642165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ba4c4a06-8274-4d2d-8f7e-ef7a14b519a1 req-998e3c52-6e20-4bf7-b8d6-37defcba4c2b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:47.653243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b41c61a-90ad-4521-8d6f-aa4e4d04d430 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:47.720728 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ba4c4a06-8274-4d2d-8f7e-ef7a14b519a1 req-998e3c52-6e20-4bf7-b8d6-37defcba4c2b service nova] Creating event network-vif-deleted:68bee7ad-303d-4e02-8c6b-ac1919fcdfd4 for instance 0854fcf5-4f57-475f-90e1-168756cd85ec on n-h1-826529-8 Aug 03 02:00:47.739899 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ba4c4a06-8274-4d2d-8f7e-ef7a14b519a1 req-998e3c52-6e20-4bf7-b8d6-37defcba4c2b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191582 Aug 03 02:00:47.741511 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1410/2880] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:00:47.759722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-467fed2a-5c32-4e9c-8326-b8478d155d4b tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:47.764444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-467fed2a-5c32-4e9c-8326-b8478d155d4b tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:47.787791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b41c61a-90ad-4521-8d6f-aa4e4d04d430 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:47.788297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-467fed2a-5c32-4e9c-8326-b8478d155d4b tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:47.789108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-467fed2a-5c32-4e9c-8326-b8478d155d4b tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:47.789659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b41c61a-90ad-4521-8d6f-aa4e4d04d430 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:47.790157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-467fed2a-5c32-4e9c-8326-b8478d155d4b tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:47.790608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-467fed2a-5c32-4e9c-8326-b8478d155d4b tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:47.791039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-7b41c61a-90ad-4521-8d6f-aa4e4d04d430 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lazy-loading 'fault' on Instance uuid 0854fcf5-4f57-475f-90e1-168756cd85ec {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:00:48.007769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7b41c61a-90ad-4521-8d6f-aa4e4d04d430 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce42157841b14c72a73e7c32de4b5373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee59a7fb1d47f1891bd1825fa25570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:48.017612 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7b41c61a-90ad-4521-8d6f-aa4e4d04d430 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 200 len: 1315 microversion: 2.1 time: 0.409637 Aug 03 02:00:48.022777 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1471/2881] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:47 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:48.027954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d9a95101-ae2c-46f1-8fd9-3c939bcc8226 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:48.032662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d9a95101-ae2c-46f1-8fd9-3c939bcc8226 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:48.050720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9a95101-ae2c-46f1-8fd9-3c939bcc8226 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:48.051829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9a95101-ae2c-46f1-8fd9-3c939bcc8226 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:48.052825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9a95101-ae2c-46f1-8fd9-3c939bcc8226 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:48.059804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9a95101-ae2c-46f1-8fd9-3c939bcc8226 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:48.456292 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-467fed2a-5c32-4e9c-8326-b8478d155d4b tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.710756 Aug 03 02:00:48.457674 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1411/2882] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:00:47 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-interface => generated 285 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:00:48.464593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1100533945", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "ba033cef-0c1e-4b18-9584-427e6db2fcb1"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:48.620751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:00:48.901813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d9a95101-ae2c-46f1-8fd9-3c939bcc8226 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:48.927948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d9a95101-ae2c-46f1-8fd9-3c939bcc8226 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:48.930096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d9a95101-ae2c-46f1-8fd9-3c939bcc8226 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:48.935658 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d9a95101-ae2c-46f1-8fd9-3c939bcc8226 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1739 microversion: 2.20 time: 0.911415 Aug 03 02:00:48.937875 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1472/2883] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:48 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1739 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:00:49.048089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-26e7707a-f358-4736-a78d-7f8bd909207e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:49.049066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-26e7707a-f358-4736-a78d-7f8bd909207e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] [instance: 0854fcf5-4f57-475f-90e1-168756cd85ec] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:49.058432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26e7707a-f358-4736-a78d-7f8bd909207e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:49.061230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26e7707a-f358-4736-a78d-7f8bd909207e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:49.067558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26e7707a-f358-4736-a78d-7f8bd909207e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:49.068489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26e7707a-f358-4736-a78d-7f8bd909207e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:49.118793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:00:49.119894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:00:49.120595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:00:49.121185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:00:49.122046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:00:49.127893 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-26e7707a-f358-4736-a78d-7f8bd909207e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] HTTP exception thrown: Instance 0854fcf5-4f57-475f-90e1-168756cd85ec could not be found. Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-26e7707a-f358-4736-a78d-7f8bd909207e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Request method failure captured: Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec HTTP/1.1 Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dZ0BbcLL3QIf1_gDXmmGTBPqqeT67HoQQZBp4ML9NntP43yk2nb5jK_qoZDtoe3k5V1NA1hPdcp9mgpqfuugKL_JBpFDPs57iOnt2fNtgGdcJ1Fgbq24DXczw4LfUFi5CEsU73YQhlTBm888GGMlvR_lkKF7Tw4zpIv_pdWfhmiGyk Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9eee59a7fb1d47f1891bd1825fa25570 Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersTestFqdnHostnames-1157018135 Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9eee59a7fb1d47f1891bd1825fa25570", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9eee59a7fb1d47f1891bd1825fa25570"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9eee59a7fb1d47f1891bd1825fa25570"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9eee59a7fb1d47f1891bd1825fa25570"}]}] Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersTestFqdnHostnames-1157018135 Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9eee59a7fb1d47f1891bd1825fa25570 Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1157018135 Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersTestFqdnHostnames-1157018135-project Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: ce42157841b14c72a73e7c32de4b5373 Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersTestFqdnHostnames-1157018135-project Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 0854fcf5-4f57-475f-90e1-168756cd85ec could not be found. Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '0854fcf5-4f57-475f-90e1-168756cd85ec'} Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0854fcf5-4f57-475f-90e1-168756cd85ec could not be found. Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0854fcf5-4f57-475f-90e1-168756cd85ec could not be found. Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:00:49.130637 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:49.135198 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:00:49.135198 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:00:49.135198 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:00:49.135198 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:00:49.135198 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:00:49.135198 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0854fcf5-4f57-475f-90e1-168756cd85ec could not be found. Aug 03 02:00:49.135198 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:00:49.142129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-26e7707a-f358-4736-a78d-7f8bd909207e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Returning 404 to user: Instance 0854fcf5-4f57-475f-90e1-168756cd85ec could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:00:49.147631 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-26e7707a-f358-4736-a78d-7f8bd909207e tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec" status: 404 len: 111 microversion: 2.1 time: 0.103294 Aug 03 02:00:49.150095 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1473/2884] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:49 2022] GET /compute/v2.1/servers/0854fcf5-4f57-475f-90e1-168756cd85ec => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:00:49.162430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:49.165925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:49.168147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:49.168915 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:49.174429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-454461ab-a268-446e-bf43-8a2c70f968a5 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] Calling method '.version_select at 0x7f5b12518a60>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:49.224917 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-454461ab-a268-446e-bf43-8a2c70f968a5 tempest-ServersTestFqdnHostnames-1157018135 tempest-ServersTestFqdnHostnames-1157018135-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-132520990" status: 202 len: 0 microversion: 2.1 time: 0.070963 Aug 03 02:00:49.230180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:00:49.230677 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1474/2885] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 3 02:00:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-132520990 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:00:49.240974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:00:49.286820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:00:49.289576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:00:49.473586 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-02dfb669-aac3-45af-b561-1170e9a47fb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.014422 Aug 03 02:00:49.474785 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1412/2886] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:00:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:00:49.487191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-573fc476-6035-4dd1-9567-b6e9f237a49d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:49.488226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-573fc476-6035-4dd1-9567-b6e9f237a49d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:49.961928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-78c4f799-ab74-4f25-bab3-0382f71d93f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:49.962921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-78c4f799-ab74-4f25-bab3-0382f71d93f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:49.976563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78c4f799-ab74-4f25-bab3-0382f71d93f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:49.989543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78c4f799-ab74-4f25-bab3-0382f71d93f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:49.991762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78c4f799-ab74-4f25-bab3-0382f71d93f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:49.992660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78c4f799-ab74-4f25-bab3-0382f71d93f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:50.050701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-573fc476-6035-4dd1-9567-b6e9f237a49d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:50.134027 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-573fc476-6035-4dd1-9567-b6e9f237a49d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1217 microversion: 2.1 time: 0.652296 Aug 03 02:00:50.135004 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1475/2887] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:49 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1217 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:51.172049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-474704b7-8f75-4c55-9ada-1850ca8e7d56 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:51.173065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-474704b7-8f75-4c55-9ada-1850ca8e7d56 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:51.184485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-474704b7-8f75-4c55-9ada-1850ca8e7d56 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:51.185298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-474704b7-8f75-4c55-9ada-1850ca8e7d56 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:51.185756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-474704b7-8f75-4c55-9ada-1850ca8e7d56 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:51.186181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-474704b7-8f75-4c55-9ada-1850ca8e7d56 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:51.266748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-78c4f799-ab74-4f25-bab3-0382f71d93f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:51.311132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-78c4f799-ab74-4f25-bab3-0382f71d93f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:51.317040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-78c4f799-ab74-4f25-bab3-0382f71d93f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:51.333796 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-78c4f799-ab74-4f25-bab3-0382f71d93f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1739 microversion: 2.20 time: 1.375377 Aug 03 02:00:51.345125 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1413/2888] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:49 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1739 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:00:51.561203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-474704b7-8f75-4c55-9ada-1850ca8e7d56 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:51.576504 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-474704b7-8f75-4c55-9ada-1850ca8e7d56 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1213 microversion: 2.1 time: 0.415987 Aug 03 02:00:51.580427 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1476/2889] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:51 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1213 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:52.365277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-991762c6-a20e-46f2-80fd-8db6f54f6ff1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:52.366643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-991762c6-a20e-46f2-80fd-8db6f54f6ff1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:52.452846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-991762c6-a20e-46f2-80fd-8db6f54f6ff1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:52.453955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-991762c6-a20e-46f2-80fd-8db6f54f6ff1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:52.457178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-991762c6-a20e-46f2-80fd-8db6f54f6ff1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:52.464559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-991762c6-a20e-46f2-80fd-8db6f54f6ff1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:52.626824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e5a49d48-7039-4f2c-b492-fa4e86c6af41 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:52.628218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e5a49d48-7039-4f2c-b492-fa4e86c6af41 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:52.650613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e5a49d48-7039-4f2c-b492-fa4e86c6af41 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:52.658352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e5a49d48-7039-4f2c-b492-fa4e86c6af41 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:52.659677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e5a49d48-7039-4f2c-b492-fa4e86c6af41 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:52.669911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e5a49d48-7039-4f2c-b492-fa4e86c6af41 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:53.159400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e5a49d48-7039-4f2c-b492-fa4e86c6af41 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:53.167557 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e5a49d48-7039-4f2c-b492-fa4e86c6af41 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1275 microversion: 2.1 time: 0.546442 Aug 03 02:00:53.183046 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1477/2890] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:52 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1275 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:00:53.189172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-677ff715-1142-41d0-8ec9-dcffb60d396f req-93abc53e-9289-4141-9d7e-b20650b3618a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6731bf52-2375-4f2a-9905-79b334d5917b", "tag": "63736276-b283-41b5-b35a-a47cb4db71fe"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:00:53.211461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-677ff715-1142-41d0-8ec9-dcffb60d396f req-93abc53e-9289-4141-9d7e-b20650b3618a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:53.219943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-677ff715-1142-41d0-8ec9-dcffb60d396f req-93abc53e-9289-4141-9d7e-b20650b3618a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:53.255902 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-677ff715-1142-41d0-8ec9-dcffb60d396f req-93abc53e-9289-4141-9d7e-b20650b3618a service nova] Creating event network-changed:63736276-b283-41b5-b35a-a47cb4db71fe for instance 6731bf52-2375-4f2a-9905-79b334d5917b on n-h2-826529-8 Aug 03 02:00:53.265152 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-677ff715-1142-41d0-8ec9-dcffb60d396f req-93abc53e-9289-4141-9d7e-b20650b3618a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080097 Aug 03 02:00:53.266398 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1478/2891] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:00:54.191655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-888454b9-4ffe-476d-a8dd-4a1bb3100fdd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:54.193273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-888454b9-4ffe-476d-a8dd-4a1bb3100fdd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:54.212117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-888454b9-4ffe-476d-a8dd-4a1bb3100fdd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:54.213036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-888454b9-4ffe-476d-a8dd-4a1bb3100fdd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:54.218655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-888454b9-4ffe-476d-a8dd-4a1bb3100fdd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:54.220039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-888454b9-4ffe-476d-a8dd-4a1bb3100fdd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:54.390624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-991762c6-a20e-46f2-80fd-8db6f54f6ff1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:54.407367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:54.415703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-991762c6-a20e-46f2-80fd-8db6f54f6ff1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:54.420056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-991762c6-a20e-46f2-80fd-8db6f54f6ff1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:54.424886 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-991762c6-a20e-46f2-80fd-8db6f54f6ff1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1739 microversion: 2.20 time: 2.067861 Aug 03 02:00:54.446251 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1414/2892] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:52 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1739 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:00:54.590672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-888454b9-4ffe-476d-a8dd-4a1bb3100fdd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:54.624951 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-888454b9-4ffe-476d-a8dd-4a1bb3100fdd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1275 microversion: 2.1 time: 0.438442 Aug 03 02:00:54.633760 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1479/2893] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:54 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1275 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:55.484226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2033223f-5b22-4c16-95a4-1fb45fcad885 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:55.497562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2033223f-5b22-4c16-95a4-1fb45fcad885 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:55.558508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2033223f-5b22-4c16-95a4-1fb45fcad885 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:55.559555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2033223f-5b22-4c16-95a4-1fb45fcad885 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:55.560798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2033223f-5b22-4c16-95a4-1fb45fcad885 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:55.561696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2033223f-5b22-4c16-95a4-1fb45fcad885 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:55.671632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1f9cd9d4-10b3-4327-bd90-092e81fa56a9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:55.673087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1f9cd9d4-10b3-4327-bd90-092e81fa56a9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:55.693959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f9cd9d4-10b3-4327-bd90-092e81fa56a9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:55.694446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f9cd9d4-10b3-4327-bd90-092e81fa56a9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:55.695285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f9cd9d4-10b3-4327-bd90-092e81fa56a9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:55.695956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f9cd9d4-10b3-4327-bd90-092e81fa56a9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:55.883813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1f9cd9d4-10b3-4327-bd90-092e81fa56a9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:55.912538 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1f9cd9d4-10b3-4327-bd90-092e81fa56a9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1275 microversion: 2.1 time: 0.239646 Aug 03 02:00:55.924758 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1480/2894] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:55 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1275 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:00:56.939735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dfaeaa08-ac5e-49ff-bb0b-1f79b73d7ea2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:56.941202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dfaeaa08-ac5e-49ff-bb0b-1f79b73d7ea2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:56.956198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfaeaa08-ac5e-49ff-bb0b-1f79b73d7ea2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:56.958996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfaeaa08-ac5e-49ff-bb0b-1f79b73d7ea2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:56.959862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfaeaa08-ac5e-49ff-bb0b-1f79b73d7ea2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:56.960323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfaeaa08-ac5e-49ff-bb0b-1f79b73d7ea2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:57.033317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2033223f-5b22-4c16-95a4-1fb45fcad885 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:57.078577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2033223f-5b22-4c16-95a4-1fb45fcad885 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:57.087516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2033223f-5b22-4c16-95a4-1fb45fcad885 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:57.088788 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2033223f-5b22-4c16-95a4-1fb45fcad885 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1739 microversion: 2.20 time: 1.616546 Aug 03 02:00:57.095254 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1415/2895] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:55 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1739 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:00:57.322738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dfaeaa08-ac5e-49ff-bb0b-1f79b73d7ea2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:57.334169 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dfaeaa08-ac5e-49ff-bb0b-1f79b73d7ea2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1275 microversion: 2.1 time: 0.400093 Aug 03 02:00:57.340046 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1481/2896] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:56 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1275 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:00:58.113955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7829d58d-9eb8-45d7-9ced-75eeae56cb28 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:58.114608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7829d58d-9eb8-45d7-9ced-75eeae56cb28 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:58.195916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7829d58d-9eb8-45d7-9ced-75eeae56cb28 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:58.196378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7829d58d-9eb8-45d7-9ced-75eeae56cb28 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:58.197190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7829d58d-9eb8-45d7-9ced-75eeae56cb28 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:58.197637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7829d58d-9eb8-45d7-9ced-75eeae56cb28 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:58.365918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b5f8f65a-8776-46fc-9904-6dd03e2b4f2b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:00:58.378647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b5f8f65a-8776-46fc-9904-6dd03e2b4f2b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:00:58.421977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5f8f65a-8776-46fc-9904-6dd03e2b4f2b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:58.422817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5f8f65a-8776-46fc-9904-6dd03e2b4f2b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:58.424080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5f8f65a-8776-46fc-9904-6dd03e2b4f2b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:00:58.434296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5f8f65a-8776-46fc-9904-6dd03e2b4f2b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:00:59.196907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:59.258429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:00:59.953866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7829d58d-9eb8-45d7-9ced-75eeae56cb28 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:59.972134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7829d58d-9eb8-45d7-9ced-75eeae56cb28 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:59.978102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7829d58d-9eb8-45d7-9ced-75eeae56cb28 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:00:59.980805 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7829d58d-9eb8-45d7-9ced-75eeae56cb28 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1739 microversion: 2.20 time: 1.871346 Aug 03 02:00:59.985216 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1416/2897] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:00:58 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1739 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:00.133647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:00.219916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b5f8f65a-8776-46fc-9904-6dd03e2b4f2b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:00.231976 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b5f8f65a-8776-46fc-9904-6dd03e2b4f2b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1317 microversion: 2.1 time: 1.875078 Aug 03 02:01:00.244151 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1482/2898] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:00:58 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1317 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:01.013298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-18411f40-f4f0-42e7-ad9e-feacaf064916 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:01.013942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-18411f40-f4f0-42e7-ad9e-feacaf064916 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:01.022592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18411f40-f4f0-42e7-ad9e-feacaf064916 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:01.023047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18411f40-f4f0-42e7-ad9e-feacaf064916 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:01.023849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18411f40-f4f0-42e7-ad9e-feacaf064916 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:01.024305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18411f40-f4f0-42e7-ad9e-feacaf064916 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:01.263006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8a1744a0-77ed-44be-bc4e-30db05d44bd1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:01.264329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8a1744a0-77ed-44be-bc4e-30db05d44bd1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:01.267564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:01.275105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a1744a0-77ed-44be-bc4e-30db05d44bd1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:01.275879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a1744a0-77ed-44be-bc4e-30db05d44bd1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:01.277521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a1744a0-77ed-44be-bc4e-30db05d44bd1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:01.278200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a1744a0-77ed-44be-bc4e-30db05d44bd1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:01.777985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-18411f40-f4f0-42e7-ad9e-feacaf064916 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:01.791873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-18411f40-f4f0-42e7-ad9e-feacaf064916 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:01.794534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-18411f40-f4f0-42e7-ad9e-feacaf064916 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:01.796855 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-18411f40-f4f0-42e7-ad9e-feacaf064916 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1721 microversion: 2.20 time: 0.787028 Aug 03 02:01:01.813172 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1417/2899] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:01 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1721 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:02.357524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8a1744a0-77ed-44be-bc4e-30db05d44bd1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:02.373469 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8a1744a0-77ed-44be-bc4e-30db05d44bd1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1317 microversion: 2.1 time: 1.111443 Aug 03 02:01:02.383096 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1483/2900] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:01 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1317 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:02.824646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-550e294b-e1d2-4630-bf1b-440ab308e2f3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:02.826701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-550e294b-e1d2-4630-bf1b-440ab308e2f3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:02.838209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-550e294b-e1d2-4630-bf1b-440ab308e2f3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:02.838735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-550e294b-e1d2-4630-bf1b-440ab308e2f3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:02.839651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-550e294b-e1d2-4630-bf1b-440ab308e2f3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:02.840383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-550e294b-e1d2-4630-bf1b-440ab308e2f3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:03.350271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-832f409a-cc9c-4126-8251-d78cf0fff629 req-68112e39-d141-478c-8ef7-13bc644a926b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7d0db2-f64d-4df7-b0dd-2ecf688290b0", "name": "network-vif-unplugged", "status": "completed", "tag": "1b653dfb-172c-43c5-8d81-55e28541d60d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:03.375292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-832f409a-cc9c-4126-8251-d78cf0fff629 req-68112e39-d141-478c-8ef7-13bc644a926b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:03.377379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-832f409a-cc9c-4126-8251-d78cf0fff629 req-68112e39-d141-478c-8ef7-13bc644a926b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:03.409584 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-832f409a-cc9c-4126-8251-d78cf0fff629 req-68112e39-d141-478c-8ef7-13bc644a926b service nova] Creating event network-vif-unplugged:1b653dfb-172c-43c5-8d81-55e28541d60d for instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 on n-h2-826529-8 Aug 03 02:01:03.425067 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-832f409a-cc9c-4126-8251-d78cf0fff629 req-68112e39-d141-478c-8ef7-13bc644a926b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083802 Aug 03 02:01:03.425952 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1484/2901] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:03.441863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-92273d4a-a13d-4165-9f93-12bd0847b2eb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:03.443529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-92273d4a-a13d-4165-9f93-12bd0847b2eb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:03.475976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92273d4a-a13d-4165-9f93-12bd0847b2eb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:03.499465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92273d4a-a13d-4165-9f93-12bd0847b2eb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:03.501278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92273d4a-a13d-4165-9f93-12bd0847b2eb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:03.501278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92273d4a-a13d-4165-9f93-12bd0847b2eb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:03.539029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-550e294b-e1d2-4630-bf1b-440ab308e2f3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:03.569041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-550e294b-e1d2-4630-bf1b-440ab308e2f3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:03.581105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-550e294b-e1d2-4630-bf1b-440ab308e2f3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:03.589289 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-550e294b-e1d2-4630-bf1b-440ab308e2f3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1721 microversion: 2.20 time: 0.770885 Aug 03 02:01:03.593744 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1418/2902] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:02 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1721 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:03.700269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2e830dc7-96b1-40e3-a118-9a1181d0b481 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Calling method '.version_select at 0x7f5b132ef9d0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:03.819180 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2e830dc7-96b1-40e3-a118-9a1181d0b481 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "GET /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b" status: 200 len: 635 microversion: 2.1 time: 0.125235 Aug 03 02:01:03.821367 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1419/2903] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:01:03 2022] GET /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b => generated 635 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:01:03.839756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-79d07501-8817-4660-b8f0-35b91c2eb889 req-b86b6325-9e26-447a-88e1-a282c22b0415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "156b2ce7-f4a3-4cd8-83ef-1bc5e233f320", "tag": "46618a0d-ac10-4dcf-ad3b-2acef3bbe726"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:03.879502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-79d07501-8817-4660-b8f0-35b91c2eb889 req-b86b6325-9e26-447a-88e1-a282c22b0415 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:03.880229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-79d07501-8817-4660-b8f0-35b91c2eb889 req-b86b6325-9e26-447a-88e1-a282c22b0415 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:03.919692 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-79d07501-8817-4660-b8f0-35b91c2eb889 req-b86b6325-9e26-447a-88e1-a282c22b0415 service nova] Creating event network-changed:46618a0d-ac10-4dcf-ad3b-2acef3bbe726 for instance 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 on n-h2-826529-8 Aug 03 02:01:03.930118 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-79d07501-8817-4660-b8f0-35b91c2eb889 req-b86b6325-9e26-447a-88e1-a282c22b0415 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104479 Aug 03 02:01:03.933762 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1420/2904] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:03.939674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ce3756d1-4249-478f-ad43-8a18721d04a3 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Action: 'update_all', calling method: .version_select at 0x7f5b128563a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:04.019294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ce3756d1-4249-478f-ad43-8a18721d04a3 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:04.026431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ce3756d1-4249-478f-ad43-8a18721d04a3 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for user a46425699e044641bbdfeebf1bf3e8dd and project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:04.405546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-92273d4a-a13d-4165-9f93-12bd0847b2eb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:04.414161 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-92273d4a-a13d-4165-9f93-12bd0847b2eb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1317 microversion: 2.1 time: 0.987228 Aug 03 02:01:04.414753 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1485/2905] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:03 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1317 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:04.615111 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ce3756d1-4249-478f-ad43-8a18721d04a3 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.675170 Aug 03 02:01:04.616029 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1421/2906] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:01:03 2022] PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata => generated 61 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:01:04.629298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-290aec0a-bfe2-4a71-9bc7-ea4f304a549a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:04.630962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-290aec0a-bfe2-4a71-9bc7-ea4f304a549a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:04.648958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-290aec0a-bfe2-4a71-9bc7-ea4f304a549a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:04.650934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-290aec0a-bfe2-4a71-9bc7-ea4f304a549a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:04.654298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-290aec0a-bfe2-4a71-9bc7-ea4f304a549a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:04.654804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-290aec0a-bfe2-4a71-9bc7-ea4f304a549a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:04.740550 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-204001723", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "cbf7a55a-8561-4279-848f-ace1e371861c"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:04.811172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] validate_networks() for [('cbf7a55a-8561-4279-848f-ace1e371861c', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:01:05.053254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-290aec0a-bfe2-4a71-9bc7-ea4f304a549a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:05.063079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-290aec0a-bfe2-4a71-9bc7-ea4f304a549a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:05.065309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-290aec0a-bfe2-4a71-9bc7-ea4f304a549a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:05.066798 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-290aec0a-bfe2-4a71-9bc7-ea4f304a549a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1721 microversion: 2.20 time: 0.443804 Aug 03 02:01:05.067430 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1422/2907] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:04 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1721 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:05.087770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8e3d6e75-83be-4d88-b3b5-e6863fcafc8f tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Calling method '.version_select at 0x7f5b12856af0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:05.432548 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8e3d6e75-83be-4d88-b3b5-e6863fcafc8f tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "DELETE /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.348649 Aug 03 02:01:05.433147 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1423/2908] 10.222.0.67 () {58 vars in 1296 bytes} [Wed Aug 3 02:01:05 2022] DELETE /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata/os_version => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:01:05.441345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cc21ee62-6a92-4744-8a91-0e3d36621cbb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:05.443273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cc21ee62-6a92-4744-8a91-0e3d36621cbb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:05.478246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cc21ee62-6a92-4744-8a91-0e3d36621cbb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:05.479075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cc21ee62-6a92-4744-8a91-0e3d36621cbb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:05.480557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cc21ee62-6a92-4744-8a91-0e3d36621cbb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:05.481431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cc21ee62-6a92-4744-8a91-0e3d36621cbb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:06.055293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cc21ee62-6a92-4744-8a91-0e3d36621cbb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:06.073476 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cc21ee62-6a92-4744-8a91-0e3d36621cbb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1317 microversion: 2.1 time: 0.634740 Aug 03 02:01:06.075019 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1424/2909] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:05 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1317 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:06.093892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c79973ee-f153-41f5-9342-3f7d3ab883a3 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Calling method '.version_select at 0x7f5b132fbe50>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:06.160172 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c79973ee-f153-41f5-9342-3f7d3ab883a3 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "GET /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata" status: 200 len: 37 microversion: 2.1 time: 0.083898 Aug 03 02:01:06.165901 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1425/2910] 10.222.0.67 () {58 vars in 1260 bytes} [Wed Aug 3 02:01:06 2022] GET /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata => generated 37 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:01:06.172479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-28da7156-f2d0-4e0c-872f-82672524dcc2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:06.176522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-28da7156-f2d0-4e0c-872f-82672524dcc2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:06.196049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28da7156-f2d0-4e0c-872f-82672524dcc2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:06.198734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28da7156-f2d0-4e0c-872f-82672524dcc2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:06.202592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28da7156-f2d0-4e0c-872f-82672524dcc2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:06.203197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28da7156-f2d0-4e0c-872f-82672524dcc2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:06.744335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:01:06.745533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:01:06.746450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:01:06.747411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:01:06.748487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:01:06.763198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:06.763788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:06.765303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:06.765784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:06.788707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Getting quotas for project 56e9e5bc9e0d45148d1e5a789990dc22. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:06.794677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Getting quotas for user e1415cd573ff435a9b4fe6b0b7a833a6 and project 56e9e5bc9e0d45148d1e5a789990dc22. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:06.809993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:01:06.813877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:01:06.887988 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1bf837d1-f315-4bbc-b47f-44d04b46b2b7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.463411 Aug 03 02:01:06.889173 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1486/2911] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:01:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:01:06.896701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cb244611-262a-41bf-a773-c2584c5b87af tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Action: 'update_all', calling method: .version_select at 0x7f5b1272a700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:06.906395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-28da7156-f2d0-4e0c-872f-82672524dcc2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:06.960312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-28da7156-f2d0-4e0c-872f-82672524dcc2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:06.965284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-28da7156-f2d0-4e0c-872f-82672524dcc2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:06.970238 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-28da7156-f2d0-4e0c-872f-82672524dcc2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1724 microversion: 2.20 time: 0.805364 Aug 03 02:01:06.972658 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1426/2912] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:06 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1724 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:06.982371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-cb244611-262a-41bf-a773-c2584c5b87af tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:06.983013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-de08bcae-3070-4ae1-85f3-f6b9afb26a3a tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:06.984413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-de08bcae-3070-4ae1-85f3-f6b9afb26a3a tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:06.992517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-cb244611-262a-41bf-a773-c2584c5b87af tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for user a46425699e044641bbdfeebf1bf3e8dd and project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:07.262642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-de08bcae-3070-4ae1-85f3-f6b9afb26a3a tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1415cd573ff435a9b4fe6b0b7a833a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e9e5bc9e0d45148d1e5a789990dc22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:07.281698 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-de08bcae-3070-4ae1-85f3-f6b9afb26a3a tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 200 len: 1227 microversion: 2.1 time: 0.307159 Aug 03 02:01:07.282310 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1427/2913] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:06 2022] GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 1227 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:07.299431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4f3cc054-864d-42fc-bb97-3d07d92d7a4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07c5172f-8e8b-4dee-adca-77157e9125ab"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:07.308540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4f3cc054-864d-42fc-bb97-3d07d92d7a4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:07.330394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f3cc054-864d-42fc-bb97-3d07d92d7a4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:07.337282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f3cc054-864d-42fc-bb97-3d07d92d7a4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:07.339029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f3cc054-864d-42fc-bb97-3d07d92d7a4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:07.339643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f3cc054-864d-42fc-bb97-3d07d92d7a4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:07.593238 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cb244611-262a-41bf-a773-c2584c5b87af tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.700676 Aug 03 02:01:07.593238 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1487/2914] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:01:06 2022] PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata => generated 61 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:01:07.604690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eadec37b-d896-486b-99e7-1e783626b6b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:07.605350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eadec37b-d896-486b-99e7-1e783626b6b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:07.633653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eadec37b-d896-486b-99e7-1e783626b6b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:07.634268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eadec37b-d896-486b-99e7-1e783626b6b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:07.639366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eadec37b-d896-486b-99e7-1e783626b6b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:07.640421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eadec37b-d896-486b-99e7-1e783626b6b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:08.267155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-eadec37b-d896-486b-99e7-1e783626b6b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:08.298345 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4f3cc054-864d-42fc-bb97-3d07d92d7a4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "POST /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.002681 Aug 03 02:01:08.305490 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1428/2915] 10.222.0.67 () {62 vars in 1364 bytes} [Wed Aug 3 02:01:07 2022] POST /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments => generated 188 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:01:08.321757 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eadec37b-d896-486b-99e7-1e783626b6b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1317 microversion: 2.1 time: 0.700503 Aug 03 02:01:08.322399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f576eb01-9469-4af9-867d-9090c3ee943c tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Calling method '.version_select at 0x7f5b12849160>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:08.326976 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1488/2916] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:07 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1317 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:08.348848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c99db4be-22b0-4e64-aee9-e7a0e7a710cc tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:08.351077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c99db4be-22b0-4e64-aee9-e7a0e7a710cc tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:08.371418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c99db4be-22b0-4e64-aee9-e7a0e7a710cc tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:08.375014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c99db4be-22b0-4e64-aee9-e7a0e7a710cc tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:08.382529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c99db4be-22b0-4e64-aee9-e7a0e7a710cc tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:08.383107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c99db4be-22b0-4e64-aee9-e7a0e7a710cc tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:08.486653 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f576eb01-9469-4af9-867d-9090c3ee943c tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "GET /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.179564 Aug 03 02:01:08.488042 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1429/2917] 10.222.0.67 () {58 vars in 1290 bytes} [Wed Aug 3 02:01:08 2022] GET /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata/os_distro => generated 33 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:01:08.507224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3251c2bd-e2d8-4b43-b14b-68049154a18f tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Action: 'update_all', calling method: .version_select at 0x7f5b12856160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:08.610084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3251c2bd-e2d8-4b43-b14b-68049154a18f tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:08.624922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3251c2bd-e2d8-4b43-b14b-68049154a18f tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for user a46425699e044641bbdfeebf1bf3e8dd and project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:08.701235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c99db4be-22b0-4e64-aee9-e7a0e7a710cc tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1415cd573ff435a9b4fe6b0b7a833a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e9e5bc9e0d45148d1e5a789990dc22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:08.715379 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c99db4be-22b0-4e64-aee9-e7a0e7a710cc tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 200 len: 1231 microversion: 2.1 time: 0.387079 Aug 03 02:01:08.718110 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1489/2918] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:08 2022] GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 1231 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:08.752743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-95a15937-8d88-4042-bc5d-b20b9c808e19 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:08.755464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-95a15937-8d88-4042-bc5d-b20b9c808e19 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:08.775071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95a15937-8d88-4042-bc5d-b20b9c808e19 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:08.775901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95a15937-8d88-4042-bc5d-b20b9c808e19 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:08.776898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95a15937-8d88-4042-bc5d-b20b9c808e19 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:08.778751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95a15937-8d88-4042-bc5d-b20b9c808e19 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:08.899404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-95a15937-8d88-4042-bc5d-b20b9c808e19 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125941) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 02:01:08.999131 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3251c2bd-e2d8-4b43-b14b-68049154a18f tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.504649 Aug 03 02:01:09.007459 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1430/2919] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:01:08 2022] PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata => generated 61 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:01:09.016340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9e9c238e-f33a-429c-a3c2-f111abdb7362 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Calling method '.version_select at 0x7f5b132a2d30>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:09.092137 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-95a15937-8d88-4042-bc5d-b20b9c808e19 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "POST /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/action" status: 202 len: 0 microversion: 2.20 time: 0.372066 Aug 03 02:01:09.094781 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1490/2920] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 3 02:01:08 2022] POST /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:01:09.105434 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9e9c238e-f33a-429c-a3c2-f111abdb7362 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "GET /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.096404 Aug 03 02:01:09.108037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8a22ca9f-0a10-46fd-a649-ebc2dbc2cc4f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:09.114385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8a22ca9f-0a10-46fd-a649-ebc2dbc2cc4f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:09.117935 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1431/2921] 10.222.0.67 () {58 vars in 1260 bytes} [Wed Aug 3 02:01:09 2022] GET /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata => generated 61 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:01:09.138799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a22ca9f-0a10-46fd-a649-ebc2dbc2cc4f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:09.141427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3bcd1b89-a501-454f-97d0-15af3717fb5c tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Action: 'update_all', calling method: .version_select at 0x7f5b128569d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:09.142497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a22ca9f-0a10-46fd-a649-ebc2dbc2cc4f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:09.144127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a22ca9f-0a10-46fd-a649-ebc2dbc2cc4f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:09.145463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a22ca9f-0a10-46fd-a649-ebc2dbc2cc4f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:09.158310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:09.254987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3bcd1b89-a501-454f-97d0-15af3717fb5c tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:09.273670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3bcd1b89-a501-454f-97d0-15af3717fb5c tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for user a46425699e044641bbdfeebf1bf3e8dd and project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:09.702479 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3bcd1b89-a501-454f-97d0-15af3717fb5c tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.578506 Aug 03 02:01:09.708067 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1432/2922] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:01:09 2022] PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata => generated 61 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:01:09.712027 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-84f56513-4f89-4c68-ae65-60df6554e831 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:09.712658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-84f56513-4f89-4c68-ae65-60df6554e831 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:09.732626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-84f56513-4f89-4c68-ae65-60df6554e831 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:09.734121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-84f56513-4f89-4c68-ae65-60df6554e831 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:09.742963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-84f56513-4f89-4c68-ae65-60df6554e831 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:09.745396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-84f56513-4f89-4c68-ae65-60df6554e831 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:10.369239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8a22ca9f-0a10-46fd-a649-ebc2dbc2cc4f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:10.408167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8a22ca9f-0a10-46fd-a649-ebc2dbc2cc4f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:10.411612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8a22ca9f-0a10-46fd-a649-ebc2dbc2cc4f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:10.415531 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8a22ca9f-0a10-46fd-a649-ebc2dbc2cc4f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1750 microversion: 2.20 time: 1.316231 Aug 03 02:01:10.417670 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1491/2923] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:09 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1750 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:01:10.427151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eae7ce99-83d2-401c-9b02-381697438055 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Action: 'update_all', calling method: .version_select at 0x7f5b123cb550>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:10.511143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-eae7ce99-83d2-401c-9b02-381697438055 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:10.520388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-eae7ce99-83d2-401c-9b02-381697438055 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for user a46425699e044641bbdfeebf1bf3e8dd and project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:10.533443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-84f56513-4f89-4c68-ae65-60df6554e831 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:10.558026 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-84f56513-4f89-4c68-ae65-60df6554e831 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1317 microversion: 2.1 time: 0.852458 Aug 03 02:01:10.561964 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1433/2924] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:09 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1317 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:10.580441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6546993b-df77-49d6-a5ee-ea684104db90 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:10.591119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6546993b-df77-49d6-a5ee-ea684104db90 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:10.610286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6546993b-df77-49d6-a5ee-ea684104db90 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:10.612024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6546993b-df77-49d6-a5ee-ea684104db90 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:10.616611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6546993b-df77-49d6-a5ee-ea684104db90 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:10.619470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6546993b-df77-49d6-a5ee-ea684104db90 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:10.828870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6546993b-df77-49d6-a5ee-ea684104db90 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1415cd573ff435a9b4fe6b0b7a833a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e9e5bc9e0d45148d1e5a789990dc22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:10.878166 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6546993b-df77-49d6-a5ee-ea684104db90 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 200 len: 1285 microversion: 2.1 time: 0.300657 Aug 03 02:01:10.883661 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1434/2925] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:10 2022] GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 1285 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:11.215075 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eae7ce99-83d2-401c-9b02-381697438055 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata" status: 200 len: 64 microversion: 2.1 time: 0.795257 Aug 03 02:01:11.216909 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1492/2926] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:01:10 2022] PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata => generated 64 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:01:11.227399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b367c776-894c-44f4-82bc-328b28e03b8a tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Calling method '.version_select at 0x7f5b13129dc0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:11.305122 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b367c776-894c-44f4-82bc-328b28e03b8a tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "GET /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata" status: 200 len: 64 microversion: 2.1 time: 0.080691 Aug 03 02:01:11.316554 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1435/2927] 10.222.0.67 () {58 vars in 1260 bytes} [Wed Aug 3 02:01:11 2022] GET /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata => generated 64 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:01:11.322000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4e2ec7f2-3269-48c1-913c-114f68093649 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Action: 'update_all', calling method: .version_select at 0x7f5b123c1040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:11.461708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e52b7c7f-982a-4f91-8367-c5385c5f1c63 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:11.462794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e52b7c7f-982a-4f91-8367-c5385c5f1c63 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:11.488124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e52b7c7f-982a-4f91-8367-c5385c5f1c63 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:11.489419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e52b7c7f-982a-4f91-8367-c5385c5f1c63 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:11.492532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e52b7c7f-982a-4f91-8367-c5385c5f1c63 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:11.496110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e52b7c7f-982a-4f91-8367-c5385c5f1c63 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:11.497969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-4e2ec7f2-3269-48c1-913c-114f68093649 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:11.524783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-4e2ec7f2-3269-48c1-913c-114f68093649 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for user a46425699e044641bbdfeebf1bf3e8dd and project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:12.025537 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4e2ec7f2-3269-48c1-913c-114f68093649 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.711237 Aug 03 02:01:12.026165 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1493/2928] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:01:11 2022] PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata => generated 61 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:01:12.033909 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1da001af-94c3-4e86-b703-f00c47d335c0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:12.035744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1da001af-94c3-4e86-b703-f00c47d335c0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:12.047910 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1da001af-94c3-4e86-b703-f00c47d335c0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:12.048462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1da001af-94c3-4e86-b703-f00c47d335c0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:12.049400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1da001af-94c3-4e86-b703-f00c47d335c0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:12.049911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1da001af-94c3-4e86-b703-f00c47d335c0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:12.412166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e52b7c7f-982a-4f91-8367-c5385c5f1c63 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:12.428693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e52b7c7f-982a-4f91-8367-c5385c5f1c63 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:12.430167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e52b7c7f-982a-4f91-8367-c5385c5f1c63 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:12.432000 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e52b7c7f-982a-4f91-8367-c5385c5f1c63 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1750 microversion: 2.20 time: 0.981676 Aug 03 02:01:12.447346 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1436/2929] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:11 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1750 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:12.453355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-85b1f82d-fe4e-4743-8e81-a17942881bb8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:12.454279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-85b1f82d-fe4e-4743-8e81-a17942881bb8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:12.471056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85b1f82d-fe4e-4743-8e81-a17942881bb8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:12.479693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85b1f82d-fe4e-4743-8e81-a17942881bb8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:12.480814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85b1f82d-fe4e-4743-8e81-a17942881bb8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:12.483468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85b1f82d-fe4e-4743-8e81-a17942881bb8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:12.669729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1da001af-94c3-4e86-b703-f00c47d335c0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:12.693451 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1da001af-94c3-4e86-b703-f00c47d335c0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1317 microversion: 2.1 time: 0.666152 Aug 03 02:01:12.698292 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1494/2930] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:12 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1317 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:12.716538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c682c853-f37b-4a82-8c0d-caa182242e75 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Action: 'update', calling method: .version_select at 0x7f5b123c9550>, body: {"meta": {"os_version": "alt"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:12.875768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-85b1f82d-fe4e-4743-8e81-a17942881bb8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1415cd573ff435a9b4fe6b0b7a833a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e9e5bc9e0d45148d1e5a789990dc22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:12.924891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-c682c853-f37b-4a82-8c0d-caa182242e75 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:12.927699 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-85b1f82d-fe4e-4743-8e81-a17942881bb8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 200 len: 1327 microversion: 2.1 time: 0.478721 Aug 03 02:01:12.928787 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1437/2931] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:12 2022] GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 1327 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:12.973784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-c682c853-f37b-4a82-8c0d-caa182242e75 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for user a46425699e044641bbdfeebf1bf3e8dd and project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:13.460584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f68d65af-2cf6-46af-91a4-ea137b8617b5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:13.461145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f68d65af-2cf6-46af-91a4-ea137b8617b5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:13.472074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f68d65af-2cf6-46af-91a4-ea137b8617b5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:13.472545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f68d65af-2cf6-46af-91a4-ea137b8617b5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:13.473360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f68d65af-2cf6-46af-91a4-ea137b8617b5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:13.473811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f68d65af-2cf6-46af-91a4-ea137b8617b5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:13.556761 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c682c853-f37b-4a82-8c0d-caa182242e75 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.850251 Aug 03 02:01:13.558547 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1495/2932] 10.222.0.67 () {60 vars in 1313 bytes} [Wed Aug 3 02:01:12 2022] PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata/os_version => generated 31 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:01:13.580371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ac533049-cdc7-4803-adfa-3c5a6424cc77 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Calling method '.version_select at 0x7f5b123cb040>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:13.688104 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ac533049-cdc7-4803-adfa-3c5a6424cc77 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "GET /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata" status: 200 len: 58 microversion: 2.1 time: 0.117626 Aug 03 02:01:13.701441 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1496/2933] 10.222.0.67 () {58 vars in 1260 bytes} [Wed Aug 3 02:01:13 2022] GET /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata => generated 58 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:01:13.711034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-135cfb38-a2e1-4386-9817-faf9ce6d40ac req-cfc3bb90-ad88-4a03-81de-4834e59b481f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156b2ce7-f4a3-4cd8-83ef-1bc5e233f320", "name": "network-vif-plugged", "status": "completed", "tag": "46618a0d-ac10-4dcf-ad3b-2acef3bbe726"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:13.738287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-135cfb38-a2e1-4386-9817-faf9ce6d40ac req-cfc3bb90-ad88-4a03-81de-4834e59b481f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:13.739510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-135cfb38-a2e1-4386-9817-faf9ce6d40ac req-cfc3bb90-ad88-4a03-81de-4834e59b481f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:13.769314 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-135cfb38-a2e1-4386-9817-faf9ce6d40ac req-cfc3bb90-ad88-4a03-81de-4834e59b481f service nova] Creating event network-vif-plugged:46618a0d-ac10-4dcf-ad3b-2acef3bbe726 for instance 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 on n-h2-826529-8 Aug 03 02:01:13.816054 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-135cfb38-a2e1-4386-9817-faf9ce6d40ac req-cfc3bb90-ad88-4a03-81de-4834e59b481f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098472 Aug 03 02:01:13.819176 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1497/2934] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:13.837923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b479e55e-99ae-42b0-a658-9c59a540e41b tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Action: 'update_all', calling method: .version_select at 0x7f5b124eb3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:13.962421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-b479e55e-99ae-42b0-a658-9c59a540e41b tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:13.973652 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-b479e55e-99ae-42b0-a658-9c59a540e41b tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for user a46425699e044641bbdfeebf1bf3e8dd and project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:14.134677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f68d65af-2cf6-46af-91a4-ea137b8617b5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:14.148424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f68d65af-2cf6-46af-91a4-ea137b8617b5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:14.150024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f68d65af-2cf6-46af-91a4-ea137b8617b5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:14.154325 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f68d65af-2cf6-46af-91a4-ea137b8617b5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1752 microversion: 2.20 time: 0.697794 Aug 03 02:01:14.157160 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1438/2935] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:13 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1752 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:14.167822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-42490565-88ed-4b50-b0d3-0d623611263c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:14.171523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-42490565-88ed-4b50-b0d3-0d623611263c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:14.184601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42490565-88ed-4b50-b0d3-0d623611263c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:14.186892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42490565-88ed-4b50-b0d3-0d623611263c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:14.188142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42490565-88ed-4b50-b0d3-0d623611263c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:14.188766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42490565-88ed-4b50-b0d3-0d623611263c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:14.219162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:14.465211 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b479e55e-99ae-42b0-a658-9c59a540e41b tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.641930 Aug 03 02:01:14.465819 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1498/2936] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:01:13 2022] PUT /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata => generated 61 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:01:14.471349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f54273e3-ecb4-4858-9b89-5ed2562ae5f7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:14.472065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f54273e3-ecb4-4858-9b89-5ed2562ae5f7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:14.477173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-42490565-88ed-4b50-b0d3-0d623611263c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:14.485898 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-42490565-88ed-4b50-b0d3-0d623611263c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1317 microversion: 2.1 time: 0.325812 Aug 03 02:01:14.486883 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1439/2937] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:14 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:14.492624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-03665a5c-47b1-4c00-adac-17b256c3835f tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Action: 'create', calling method: .version_select at 0x7f5b1333aee0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:14.507258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f54273e3-ecb4-4858-9b89-5ed2562ae5f7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:14.507740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f54273e3-ecb4-4858-9b89-5ed2562ae5f7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:14.508551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f54273e3-ecb4-4858-9b89-5ed2562ae5f7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:14.508999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f54273e3-ecb4-4858-9b89-5ed2562ae5f7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:14.571185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-03665a5c-47b1-4c00-adac-17b256c3835f tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:14.578754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-03665a5c-47b1-4c00-adac-17b256c3835f tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Getting quotas for user a46425699e044641bbdfeebf1bf3e8dd and project 93fff1ada80d47ac953d08025ba63449. Resources: dict_keys(['metadata_items']) {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:15.052250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f54273e3-ecb4-4858-9b89-5ed2562ae5f7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1415cd573ff435a9b4fe6b0b7a833a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e9e5bc9e0d45148d1e5a789990dc22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:15.065636 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f54273e3-ecb4-4858-9b89-5ed2562ae5f7 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 200 len: 1327 microversion: 2.1 time: 0.594236 Aug 03 02:01:15.066873 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1499/2938] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:14 2022] GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 1327 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:15.083407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2a4cb99e-0cf9-42f4-8e38-831336286b99 req-e2c21ac5-a8be-4d40-9952-af9ee3c9a08e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd3c963b-474a-4ef5-b462-d66d56fa3c67", "tag": "ba99fbd4-52ef-4e45-b720-b7eb6f4f3259"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:15.102595 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-03665a5c-47b1-4c00-adac-17b256c3835f tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "POST /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata" status: 200 len: 85 microversion: 2.1 time: 0.614359 Aug 03 02:01:15.103120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2a4cb99e-0cf9-42f4-8e38-831336286b99 req-e2c21ac5-a8be-4d40-9952-af9ee3c9a08e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:15.103523 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1440/2939] 10.222.0.67 () {60 vars in 1281 bytes} [Wed Aug 3 02:01:14 2022] POST /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata => generated 85 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:01:15.105698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2a4cb99e-0cf9-42f4-8e38-831336286b99 req-e2c21ac5-a8be-4d40-9952-af9ee3c9a08e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:15.114737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-78dd3fae-b295-4c4f-8104-627b576093b1 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] Calling method '.version_select at 0x7f5b133ad8b0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:15.149555 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2a4cb99e-0cf9-42f4-8e38-831336286b99 req-e2c21ac5-a8be-4d40-9952-af9ee3c9a08e service nova] Creating event network-changed:ba99fbd4-52ef-4e45-b720-b7eb6f4f3259 for instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 on n-h1-826529-8 Aug 03 02:01:15.163056 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2a4cb99e-0cf9-42f4-8e38-831336286b99 req-e2c21ac5-a8be-4d40-9952-af9ee3c9a08e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091247 Aug 03 02:01:15.165214 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1500/2940] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:15.185235 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-78dd3fae-b295-4c4f-8104-627b576093b1 tempest-ImagesMetadataTestJSON-713029796 tempest-ImagesMetadataTestJSON-713029796-project] 10.222.0.67 "GET /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata" status: 200 len: 85 microversion: 2.1 time: 0.074349 Aug 03 02:01:15.187106 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1441/2941] 10.222.0.67 () {58 vars in 1260 bytes} [Wed Aug 3 02:01:15 2022] GET /compute/v2.1/images/637a10d7-efb2-4e82-91e3-9da571ce5c4b/metadata => generated 85 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 02:01:15.190564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bd460f38-11c6-4679-9b3c-f42f8630d342 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:15.192475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bd460f38-11c6-4679-9b3c-f42f8630d342 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:15.215069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd460f38-11c6-4679-9b3c-f42f8630d342 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:15.215792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd460f38-11c6-4679-9b3c-f42f8630d342 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:15.216774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd460f38-11c6-4679-9b3c-f42f8630d342 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:15.217216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd460f38-11c6-4679-9b3c-f42f8630d342 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:15.520813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c98a8bb1-518f-4d5c-82e3-6c3d05ad254c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:15.521465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c98a8bb1-518f-4d5c-82e3-6c3d05ad254c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:15.543252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c98a8bb1-518f-4d5c-82e3-6c3d05ad254c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:15.544108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c98a8bb1-518f-4d5c-82e3-6c3d05ad254c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:15.545159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c98a8bb1-518f-4d5c-82e3-6c3d05ad254c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:15.546595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c98a8bb1-518f-4d5c-82e3-6c3d05ad254c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:15.605135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bd460f38-11c6-4679-9b3c-f42f8630d342 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:15.626047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bd460f38-11c6-4679-9b3c-f42f8630d342 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:15.636294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bd460f38-11c6-4679-9b3c-f42f8630d342 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:15.643358 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bd460f38-11c6-4679-9b3c-f42f8630d342 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1752 microversion: 2.20 time: 0.459831 Aug 03 02:01:15.644360 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1501/2942] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:15 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1752 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:15.806546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c98a8bb1-518f-4d5c-82e3-6c3d05ad254c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:15.817785 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c98a8bb1-518f-4d5c-82e3-6c3d05ad254c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1317 microversion: 2.1 time: 0.306108 Aug 03 02:01:15.819028 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1442/2943] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:15 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:16.109567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-520ce451-b66f-40af-b12e-f8c8cd64ff63 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:16.110594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-520ce451-b66f-40af-b12e-f8c8cd64ff63 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:16.138047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-520ce451-b66f-40af-b12e-f8c8cd64ff63 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:16.138829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-520ce451-b66f-40af-b12e-f8c8cd64ff63 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:16.141133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-520ce451-b66f-40af-b12e-f8c8cd64ff63 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:16.142209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-520ce451-b66f-40af-b12e-f8c8cd64ff63 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:16.651835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-520ce451-b66f-40af-b12e-f8c8cd64ff63 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1415cd573ff435a9b4fe6b0b7a833a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e9e5bc9e0d45148d1e5a789990dc22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:16.666630 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-520ce451-b66f-40af-b12e-f8c8cd64ff63 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 200 len: 1327 microversion: 2.1 time: 0.562518 Aug 03 02:01:16.668207 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1502/2944] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:16 2022] GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 1327 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:16.668756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-588c214b-8067-4b8b-a4a5-b4b45f7c7fe4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:16.669972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-588c214b-8067-4b8b-a4a5-b4b45f7c7fe4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:16.687701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-588c214b-8067-4b8b-a4a5-b4b45f7c7fe4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:16.688161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-588c214b-8067-4b8b-a4a5-b4b45f7c7fe4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:16.689144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-588c214b-8067-4b8b-a4a5-b4b45f7c7fe4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:16.689750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-588c214b-8067-4b8b-a4a5-b4b45f7c7fe4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:16.839237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b962ee35-7913-43d7-879d-a06435c00720 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:16.840055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b962ee35-7913-43d7-879d-a06435c00720 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:16.844577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:16.851066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b962ee35-7913-43d7-879d-a06435c00720 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:16.851661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b962ee35-7913-43d7-879d-a06435c00720 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:16.852686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b962ee35-7913-43d7-879d-a06435c00720 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:16.853222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b962ee35-7913-43d7-879d-a06435c00720 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:17.267882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-588c214b-8067-4b8b-a4a5-b4b45f7c7fe4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:17.281308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-588c214b-8067-4b8b-a4a5-b4b45f7c7fe4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:17.302859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-588c214b-8067-4b8b-a4a5-b4b45f7c7fe4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:17.311017 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-588c214b-8067-4b8b-a4a5-b4b45f7c7fe4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1752 microversion: 2.20 time: 0.643350 Aug 03 02:01:17.316067 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1443/2945] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:16 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1752 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:01:17.689268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d3779e1f-daa3-444e-80a5-8bb2e8bbca3f tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:17.690764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d3779e1f-daa3-444e-80a5-8bb2e8bbca3f tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:17.711609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d3779e1f-daa3-444e-80a5-8bb2e8bbca3f tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:17.718294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d3779e1f-daa3-444e-80a5-8bb2e8bbca3f tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:17.720656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d3779e1f-daa3-444e-80a5-8bb2e8bbca3f tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:17.721133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d3779e1f-daa3-444e-80a5-8bb2e8bbca3f tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:18.007333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b962ee35-7913-43d7-879d-a06435c00720 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:18.026046 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b962ee35-7913-43d7-879d-a06435c00720 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1467 microversion: 2.1 time: 1.191486 Aug 03 02:01:18.035564 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1503/2946] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:16 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1467 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:01:18.064149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-91330773-f8e7-4e32-8010-1fd2908777de tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:18.065054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-91330773-f8e7-4e32-8010-1fd2908777de tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:18.080851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91330773-f8e7-4e32-8010-1fd2908777de tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:18.081575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91330773-f8e7-4e32-8010-1fd2908777de tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:18.083183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91330773-f8e7-4e32-8010-1fd2908777de tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:18.085178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91330773-f8e7-4e32-8010-1fd2908777de tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:18.593069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d3779e1f-daa3-444e-80a5-8bb2e8bbca3f tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1415cd573ff435a9b4fe6b0b7a833a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e9e5bc9e0d45148d1e5a789990dc22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:18.608794 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d3779e1f-daa3-444e-80a5-8bb2e8bbca3f tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 200 len: 1327 microversion: 2.1 time: 0.921333 Aug 03 02:01:18.609736 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1444/2947] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:17 2022] GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 1327 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:01:18.629318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-61222cf3-439d-48e8-9678-1809a16e78f8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:18.630653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-61222cf3-439d-48e8-9678-1809a16e78f8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:18.641419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:18.664624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61222cf3-439d-48e8-9678-1809a16e78f8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:18.665191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61222cf3-439d-48e8-9678-1809a16e78f8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:18.669402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61222cf3-439d-48e8-9678-1809a16e78f8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:18.670016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61222cf3-439d-48e8-9678-1809a16e78f8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:18.758896 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-91330773-f8e7-4e32-8010-1fd2908777de tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1618 microversion: 2.1 time: 0.711270 Aug 03 02:01:18.759535 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1504/2948] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:18 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1618 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:19.013754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-404981375", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["ba033cef-0c1e-4b18-9584-427e6db2fcb1"]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:19.119620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:01:19.737438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-61222cf3-439d-48e8-9678-1809a16e78f8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:19.748466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-61222cf3-439d-48e8-9678-1809a16e78f8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:19.754771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-61222cf3-439d-48e8-9678-1809a16e78f8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:19.761758 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-61222cf3-439d-48e8-9678-1809a16e78f8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1752 microversion: 2.20 time: 1.148503 Aug 03 02:01:19.780948 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1445/2949] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:18 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1752 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:19.793446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-81f59479-d109-4d76-a616-0d419c5b7ea6 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:19.794086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-81f59479-d109-4d76-a616-0d419c5b7ea6 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:19.814434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81f59479-d109-4d76-a616-0d419c5b7ea6 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:19.815152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81f59479-d109-4d76-a616-0d419c5b7ea6 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:19.816114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81f59479-d109-4d76-a616-0d419c5b7ea6 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:19.816714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81f59479-d109-4d76-a616-0d419c5b7ea6 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:20.479919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-81f59479-d109-4d76-a616-0d419c5b7ea6 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1415cd573ff435a9b4fe6b0b7a833a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e9e5bc9e0d45148d1e5a789990dc22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:20.492236 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-81f59479-d109-4d76-a616-0d419c5b7ea6 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 200 len: 1327 microversion: 2.1 time: 0.709718 Aug 03 02:01:20.493329 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1446/2950] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:19 2022] GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 1327 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:20.501218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-2a656694-ba52-45c4-9e1e-be0295066ce0 req-2724d5bc-a84a-4a97-a16c-c89a2a7ee1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd3c963b-474a-4ef5-b462-d66d56fa3c67", "name": "network-vif-plugged", "status": "completed", "tag": "ba99fbd4-52ef-4e45-b720-b7eb6f4f3259"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:20.513759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2a656694-ba52-45c4-9e1e-be0295066ce0 req-2724d5bc-a84a-4a97-a16c-c89a2a7ee1b2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:20.515395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2a656694-ba52-45c4-9e1e-be0295066ce0 req-2724d5bc-a84a-4a97-a16c-c89a2a7ee1b2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:20.526589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:01:20.527127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:01:20.527708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:01:20.528191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:01:20.528974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:01:20.545452 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-2a656694-ba52-45c4-9e1e-be0295066ce0 req-2724d5bc-a84a-4a97-a16c-c89a2a7ee1b2 service nova] Creating event network-vif-plugged:ba99fbd4-52ef-4e45-b720-b7eb6f4f3259 for instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 on n-h1-826529-8 Aug 03 02:01:20.546289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:20.547165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:20.549141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:20.550592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:20.559544 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-2a656694-ba52-45c4-9e1e-be0295066ce0 req-2724d5bc-a84a-4a97-a16c-c89a2a7ee1b2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063694 Aug 03 02:01:20.563997 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1447/2951] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:20.637290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:20.645066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:20.651059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:20.669863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:01:20.672986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:01:20.770145 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fafef34a-650d-4928-a59f-3d76346db95d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.751444 Aug 03 02:01:20.771239 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1505/2952] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:01:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 02:01:20.785903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b46d12cf-c19a-4d70-b9fe-a39fa02036db tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:20.786840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b46d12cf-c19a-4d70-b9fe-a39fa02036db tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:20.854979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3c72f527-aead-450c-ab4e-549430a1e108 tempest-ListImageFiltersNegativeTestJSON-1582137353 tempest-ListImageFiltersNegativeTestJSON-1582137353-project] Calling method '.version_select at 0x7f5b12823430>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:20.926539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b46d12cf-c19a-4d70-b9fe-a39fa02036db tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:20.938753 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b46d12cf-c19a-4d70-b9fe-a39fa02036db tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1216 microversion: 2.1 time: 0.159701 Aug 03 02:01:20.940959 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-3c72f527-aead-450c-ab4e-549430a1e108 tempest-ListImageFiltersNegativeTestJSON-1582137353 tempest-ListImageFiltersNegativeTestJSON-1582137353-project] HTTP exception thrown: Image not found. Aug 03 02:01:20.941709 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1506/2953] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:20 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3c72f527-aead-450c-ab4e-549430a1e108 tempest-ListImageFiltersNegativeTestJSON-1582137353 tempest-ListImageFiltersNegativeTestJSON-1582137353-project] Request method failure captured: Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/images/9f7a0d1d-8bd1-462c-9f18-79d002be9089 HTTP/1.1 Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dbw1pMnnZO71y8GRVtP5vdyPjOq-EYsjnHF1hn8ke58tiOGhuzHtgOJiBdyv63bGKlB3236PGbcwh8Mdy8i0idLVjrCtfZGgTV08HDikn4bsX45T839T9IfPmyN4Dq2oyz8sjOZRRjpVzqWDwTff51b0qTYdSZqyF6-wvrG6GjkXT8 Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 4e79b20cc643444582dee80f5d46ed5a Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1582137353 Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4e79b20cc643444582dee80f5d46ed5a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e79b20cc643444582dee80f5d46ed5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4e79b20cc643444582dee80f5d46ed5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e79b20cc643444582dee80f5d46ed5a"}]}] Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1582137353 Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 4e79b20cc643444582dee80f5d46ed5a Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1582137353 Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ListImageFiltersNegativeTestJSON-1582137353-project Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 141aa73814524345871574ab13a49598 Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1582137353-project Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: exception: Image not found. Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '9f7a0d1d-8bd1-462c-9f18-79d002be9089'} Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9f7a0d1d-8bd1-462c-9f18-79d002be9089 Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 02:01:20.944016 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f7a0d1d-8bd1-462c-9f18-79d002be9089 could not be found. Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:01:20.948836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3c72f527-aead-450c-ab4e-549430a1e108 tempest-ListImageFiltersNegativeTestJSON-1582137353 tempest-ListImageFiltersNegativeTestJSON-1582137353-project] Returning 404 to user: Image not found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:01:20.955204 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3c72f527-aead-450c-ab4e-549430a1e108 tempest-ListImageFiltersNegativeTestJSON-1582137353 tempest-ListImageFiltersNegativeTestJSON-1582137353-project] 10.222.0.67 "GET /compute/v2.1/images/9f7a0d1d-8bd1-462c-9f18-79d002be9089" status: 404 len: 62 microversion: 2.1 time: 0.385886 Aug 03 02:01:20.955292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a3000d57-03f9-43a3-91c5-9426cefee04b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:20.957353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a3000d57-03f9-43a3-91c5-9426cefee04b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:20.958421 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1448/2954] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:01:20 2022] GET /compute/v2.1/images/9f7a0d1d-8bd1-462c-9f18-79d002be9089 => generated 62 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:01:21.003378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3000d57-03f9-43a3-91c5-9426cefee04b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:21.004127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3000d57-03f9-43a3-91c5-9426cefee04b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:21.005362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3000d57-03f9-43a3-91c5-9426cefee04b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:21.006099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3000d57-03f9-43a3-91c5-9426cefee04b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:21.443987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a3000d57-03f9-43a3-91c5-9426cefee04b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:21.459107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a3000d57-03f9-43a3-91c5-9426cefee04b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:21.461128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a3000d57-03f9-43a3-91c5-9426cefee04b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:21.464509 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a3000d57-03f9-43a3-91c5-9426cefee04b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1752 microversion: 2.20 time: 0.521440 Aug 03 02:01:21.465274 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1507/2955] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:20 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1752 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:21.526634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6415f6fe-cf6f-4c0a-aa67-a0f7a4aafd8c tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:21.527482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6415f6fe-cf6f-4c0a-aa67-a0f7a4aafd8c tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:21.543083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6415f6fe-cf6f-4c0a-aa67-a0f7a4aafd8c tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:21.548443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6415f6fe-cf6f-4c0a-aa67-a0f7a4aafd8c tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:21.549320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6415f6fe-cf6f-4c0a-aa67-a0f7a4aafd8c tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:21.549877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6415f6fe-cf6f-4c0a-aa67-a0f7a4aafd8c tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:21.832325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6415f6fe-cf6f-4c0a-aa67-a0f7a4aafd8c tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1415cd573ff435a9b4fe6b0b7a833a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e9e5bc9e0d45148d1e5a789990dc22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:21.854006 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6415f6fe-cf6f-4c0a-aa67-a0f7a4aafd8c tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 200 len: 1327 microversion: 2.1 time: 0.332353 Aug 03 02:01:21.871896 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1449/2956] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:21 2022] GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 1327 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:21.962311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-92412cdd-79a7-4836-af1b-2c0ae9d946d0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:21.973219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-92412cdd-79a7-4836-af1b-2c0ae9d946d0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:21.994673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92412cdd-79a7-4836-af1b-2c0ae9d946d0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:22.004651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92412cdd-79a7-4836-af1b-2c0ae9d946d0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:22.006630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92412cdd-79a7-4836-af1b-2c0ae9d946d0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:22.015169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92412cdd-79a7-4836-af1b-2c0ae9d946d0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:22.162767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-92412cdd-79a7-4836-af1b-2c0ae9d946d0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:22.184525 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-92412cdd-79a7-4836-af1b-2c0ae9d946d0 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1268 microversion: 2.1 time: 0.225134 Aug 03 02:01:22.188129 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1508/2957] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:21 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1268 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:22.500389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5f77c5fc-5505-477c-ac26-ca73efed70e4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:22.501172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5f77c5fc-5505-477c-ac26-ca73efed70e4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:22.520935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f77c5fc-5505-477c-ac26-ca73efed70e4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:22.522968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f77c5fc-5505-477c-ac26-ca73efed70e4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:22.528263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f77c5fc-5505-477c-ac26-ca73efed70e4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:22.529068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f77c5fc-5505-477c-ac26-ca73efed70e4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:22.896716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-511e5447-f942-4fc9-82ee-da63b8feb5fb tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:22.897655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-511e5447-f942-4fc9-82ee-da63b8feb5fb tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:22.912516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-511e5447-f942-4fc9-82ee-da63b8feb5fb tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:22.914389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-511e5447-f942-4fc9-82ee-da63b8feb5fb tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:22.915547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-511e5447-f942-4fc9-82ee-da63b8feb5fb tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:22.924678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-511e5447-f942-4fc9-82ee-da63b8feb5fb tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:23.188056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5f77c5fc-5505-477c-ac26-ca73efed70e4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:23.205134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5f77c5fc-5505-477c-ac26-ca73efed70e4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:23.208085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5f77c5fc-5505-477c-ac26-ca73efed70e4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:23.215300 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5f77c5fc-5505-477c-ac26-ca73efed70e4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 0.714454 Aug 03 02:01:23.218138 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1450/2958] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:22 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:23.235830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fb9a1a58-93fc-40de-bed2-1480d50f4508 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:23.236482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fb9a1a58-93fc-40de-bed2-1480d50f4508 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:23.247951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb9a1a58-93fc-40de-bed2-1480d50f4508 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:23.252296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb9a1a58-93fc-40de-bed2-1480d50f4508 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:23.254392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb9a1a58-93fc-40de-bed2-1480d50f4508 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:23.254881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb9a1a58-93fc-40de-bed2-1480d50f4508 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:23.516479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fb9a1a58-93fc-40de-bed2-1480d50f4508 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:23.529767 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fb9a1a58-93fc-40de-bed2-1480d50f4508 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1274 microversion: 2.1 time: 0.310460 Aug 03 02:01:23.531559 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1451/2959] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:23 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1274 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:23.868962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3a64fc52-8d16-4d8c-ae25-2b19c0d98e9f tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Action: 'create', calling method: .version_select at 0x7f5b13259e50>, body: {"keypair": {"name": "tempest-keypair-1028806104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEa/cuIjGzq6IHtgopMriHJpzdVvvBsKiwPpNRyMZAeJG+STkhLBjyCPxtOq1STpPYQoAfUtWfL7+u4OHWGIdAxyYHbsGS8/zFljR/cI9RKuQ2pwQLOiOdAQ41N6jSElg=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:23.902361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3a64fc52-8d16-4d8c-ae25-2b19c0d98e9f tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Getting quotas for project 9948422cd34a44579f72a8377a628c80. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:23.913830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3a64fc52-8d16-4d8c-ae25-2b19c0d98e9f tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Getting quotas for user 1f9332739a1c47ed9581b5c5719e5563 and project 9948422cd34a44579f72a8377a628c80. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:23.946648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-511e5447-f942-4fc9-82ee-da63b8feb5fb tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1415cd573ff435a9b4fe6b0b7a833a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e9e5bc9e0d45148d1e5a789990dc22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:23.959461 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-511e5447-f942-4fc9-82ee-da63b8feb5fb tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 200 len: 1527 microversion: 2.1 time: 1.069610 Aug 03 02:01:23.960870 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3a64fc52-8d16-4d8c-ae25-2b19c0d98e9f tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.285553 Aug 03 02:01:23.962562 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1452/2960] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:01:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:01:23.963305 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1509/2961] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:22 2022] GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 1527 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:23.999512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9faa72e0-20b1-4166-9fcc-48afbd288bfd tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Calling method '.version_select at 0x7f5b132a3820>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:24.004308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f7f07134-b770-4bac-9a31-b07a8b393493 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:24.005206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f7f07134-b770-4bac-9a31-b07a8b393493 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:24.021604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7f07134-b770-4bac-9a31-b07a8b393493 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:24.024822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7f07134-b770-4bac-9a31-b07a8b393493 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:24.025419 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9faa72e0-20b1-4166-9fcc-48afbd288bfd tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs/tempest-keypair-1028806104" status: 200 len: 498 microversion: 2.1 time: 0.050297 Aug 03 02:01:24.026557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7f07134-b770-4bac-9a31-b07a8b393493 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:24.027766 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1453/2962] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 3 02:01:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1028806104 => generated 498 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:24.035828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7f07134-b770-4bac-9a31-b07a8b393493 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:24.041233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-882f7a8f-75c8-4e6c-9f12-31ed5082c968 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Calling method '.version_select at 0x7f5b13b45550>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:24.076312 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-882f7a8f-75c8-4e6c-9f12-31ed5082c968 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028806104" status: 202 len: 0 microversion: 2.1 time: 0.038766 Aug 03 02:01:24.082982 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1454/2963] 10.222.0.67 () {58 vars in 1221 bytes} [Wed Aug 3 02:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028806104 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:01:24.099306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-918dc363-eeaf-43b0-82b1-655257c85f5f tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Action: 'create', calling method: .version_select at 0x7f5b132228b0>, body: {"keypair": {"name": "tempest-keypair-789964512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuYlWAL3xXTxP/C2NQipWDcJ7Yu9W2VXUPLNh4LCjufURR0mxhZ/4SP/WZEa3nvMAoW1lhFD0SfGDsLSF/1hSu8kbz3FkYk7hEEfsuBtR1etNTJ8OrPPhrAQ/onahlHNQ=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:24.122094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-918dc363-eeaf-43b0-82b1-655257c85f5f tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Getting quotas for project 9948422cd34a44579f72a8377a628c80. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:24.130797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-918dc363-eeaf-43b0-82b1-655257c85f5f tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Getting quotas for user 1f9332739a1c47ed9581b5c5719e5563 and project 9948422cd34a44579f72a8377a628c80. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:24.167730 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-918dc363-eeaf-43b0-82b1-655257c85f5f tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.081029 Aug 03 02:01:24.168777 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1455/2964] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:01:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:01:24.184327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-72619e60-d01b-4c65-85f0-acbece56ea8b tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Calling method '.version_select at 0x7f5b13dd2550>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:24.214307 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-72619e60-d01b-4c65-85f0-acbece56ea8b tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-789964512" status: 202 len: 0 microversion: 2.1 time: 0.035232 Aug 03 02:01:24.216170 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1456/2965] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 3 02:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-789964512 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:01:24.228635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7a8e0c0d-0161-4deb-bfb7-4ac69afb8eb3 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Action: 'create', calling method: .version_select at 0x7f5b134c1940>, body: {"keypair": {"name": "tempest-keypair-1114182916", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:24.260334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-7a8e0c0d-0161-4deb-bfb7-4ac69afb8eb3 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Getting quotas for project 9948422cd34a44579f72a8377a628c80. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:24.273472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-7a8e0c0d-0161-4deb-bfb7-4ac69afb8eb3 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Getting quotas for user 1f9332739a1c47ed9581b5c5719e5563 and project 9948422cd34a44579f72a8377a628c80. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:24.316800 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7a8e0c0d-0161-4deb-bfb7-4ac69afb8eb3 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.095320 Aug 03 02:01:24.318642 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1457/2966] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:01:24 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:24.326257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d7e767d-fca1-41dd-8c4f-8748445458c8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:24.327035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8d7e767d-fca1-41dd-8c4f-8748445458c8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:24.334810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d7e767d-fca1-41dd-8c4f-8748445458c8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:24.335301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d7e767d-fca1-41dd-8c4f-8748445458c8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:24.336566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d7e767d-fca1-41dd-8c4f-8748445458c8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:24.337022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d7e767d-fca1-41dd-8c4f-8748445458c8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:24.637864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f7f07134-b770-4bac-9a31-b07a8b393493 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1415cd573ff435a9b4fe6b0b7a833a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e9e5bc9e0d45148d1e5a789990dc22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:24.650988 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f7f07134-b770-4bac-9a31-b07a8b393493 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 200 len: 1527 microversion: 2.1 time: 0.673123 Aug 03 02:01:24.652355 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1510/2967] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:23 2022] GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 1527 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:24.671223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-affb67b9-c495-4219-a1e3-3c8a89b5cc70 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Calling method '.version_select at 0x7f5b12352040>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:24.704208 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-affb67b9-c495-4219-a1e3-3c8a89b5cc70 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114182916" status: 202 len: 0 microversion: 2.1 time: 0.050232 Aug 03 02:01:24.705065 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1511/2968] 10.222.0.67 () {58 vars in 1221 bytes} [Wed Aug 3 02:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114182916 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:01:24.712562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a7943a02-765f-4e37-9847-8b7708ef74b1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:24.713451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a7943a02-765f-4e37-9847-8b7708ef74b1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:24.722153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a7943a02-765f-4e37-9847-8b7708ef74b1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:24.723023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a7943a02-765f-4e37-9847-8b7708ef74b1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:24.724046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a7943a02-765f-4e37-9847-8b7708ef74b1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:24.724659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a7943a02-765f-4e37-9847-8b7708ef74b1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:24.888204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a7943a02-765f-4e37-9847-8b7708ef74b1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:24.911810 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a7943a02-765f-4e37-9847-8b7708ef74b1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1274 microversion: 2.1 time: 0.191705 Aug 03 02:01:24.913045 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1512/2969] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:24 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1274 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:24.977993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8d7e767d-fca1-41dd-8c4f-8748445458c8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:24.993511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8d7e767d-fca1-41dd-8c4f-8748445458c8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:24.998207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8d7e767d-fca1-41dd-8c4f-8748445458c8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:25.001775 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8d7e767d-fca1-41dd-8c4f-8748445458c8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 0.681560 Aug 03 02:01:25.006768 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1458/2970] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:24 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:25.017806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-58a3d64c-2edd-45f9-9864-2c10abb03c53 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Action: 'create', calling method: .version_select at 0x7f5b13342040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-569748484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxODWWZ7eznH7W5NXh0qHbcZlbRF8jINk9oUB2QJ6yWmKeJ8CcmJVd2scPHmoeIe/OiSpspwtPHcWz31s8864ZgR0RdayuDytvnCSk/nbZRKJPQHgs/FCRd/TTuvFYTXw=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:25.052584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-58a3d64c-2edd-45f9-9864-2c10abb03c53 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Getting quotas for project 9948422cd34a44579f72a8377a628c80. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:25.063434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-58a3d64c-2edd-45f9-9864-2c10abb03c53 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Getting quotas for user 1f9332739a1c47ed9581b5c5719e5563 and project 9948422cd34a44579f72a8377a628c80. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:25.102576 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-58a3d64c-2edd-45f9-9864-2c10abb03c53 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.094131 Aug 03 02:01:25.103408 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1459/2971] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:01:25 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:25.120487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-94968204-7f51-49a5-8b0f-22bc06e64288 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Action: 'create', calling method: .version_select at 0x7f5b13b058b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-253237924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyqpAANiq/e3UcFjxlOX5+D3DVhGppAeD5rsOSZ1hvvgN7niv/L3jLGuwQXtppsgwfOODeleJNPF5l79JAIqNV4Ij6whp598Q33F/SIxri2N0JN29LRMLx59TrZZRBEQw=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:25.147473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-94968204-7f51-49a5-8b0f-22bc06e64288 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Getting quotas for project 9948422cd34a44579f72a8377a628c80. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:25.159285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-94968204-7f51-49a5-8b0f-22bc06e64288 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Getting quotas for user 1f9332739a1c47ed9581b5c5719e5563 and project 9948422cd34a44579f72a8377a628c80. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:25.192838 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-94968204-7f51-49a5-8b0f-22bc06e64288 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.075667 Aug 03 02:01:25.201334 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1460/2972] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:01:25 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:01:25.207738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-56796ef6-623d-4d60-a392-bddb241fc3e8 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Action: 'create', calling method: .version_select at 0x7f5b12823e50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-890973345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjrUx9WNEQhIOu76LTij+XLYohXiUY5BsnWlsV97h240yGFhDv6uPu3O2JXOMm1uzwL/YJVkCZJnZU/vhyxmqZhxQ7qY3rZ9UqWtPMvlwLt3Ru5h+ss8AR4bgLcYefIiQ=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:25.237027 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-56796ef6-623d-4d60-a392-bddb241fc3e8 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Getting quotas for project 9948422cd34a44579f72a8377a628c80. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:25.252688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-56796ef6-623d-4d60-a392-bddb241fc3e8 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Getting quotas for user 1f9332739a1c47ed9581b5c5719e5563 and project 9948422cd34a44579f72a8377a628c80. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:25.334203 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-56796ef6-623d-4d60-a392-bddb241fc3e8 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.130435 Aug 03 02:01:25.337645 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1461/2973] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:01:25 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:01:25.348451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eddce3a0-ed1a-43ad-acc1-cd77b8d1e04b tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Calling method '.version_select at 0x7f5b13b45700>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:25.352917 n-d-826529-8 devstack@n-api.service[125942]: WARNING oslo_db.sqlalchemy.utils [None req-eddce3a0-ed1a-43ad-acc1-cd77b8d1e04b tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 03 02:01:25.362377 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eddce3a0-ed1a-43ad-acc1-cd77b8d1e04b tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.018390 Aug 03 02:01:25.368455 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1462/2974] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 02:01:25 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:25.393517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-41beb31c-f3b5-42e9-8640-9245b39396bc tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Calling method '.version_select at 0x7f5b134c1d30>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:25.415885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2e11f6bf-2f09-4ab0-acae-0690a2e621ec tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:25.416403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2e11f6bf-2f09-4ab0-acae-0690a2e621ec tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:25.433413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e11f6bf-2f09-4ab0-acae-0690a2e621ec tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:25.433870 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e11f6bf-2f09-4ab0-acae-0690a2e621ec tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:25.434665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e11f6bf-2f09-4ab0-acae-0690a2e621ec tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:25.435133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e11f6bf-2f09-4ab0-acae-0690a2e621ec tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:25.444358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:25.460034 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-41beb31c-f3b5-42e9-8640-9245b39396bc tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-890973345" status: 202 len: 0 microversion: 2.1 time: 0.087914 Aug 03 02:01:25.461344 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1463/2975] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:01:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-890973345 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:01:25.477772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7167c851-0440-4e58-b72e-782bdf6b09d4 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Calling method '.version_select at 0x7f5b132a2b80>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:25.489430 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-2e11f6bf-2f09-4ab0-acae-0690a2e621ec tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] HTTP exception thrown: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2e11f6bf-2f09-4ab0-acae-0690a2e621ec tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] Request method failure captured: Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 HTTP/1.1 Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dbf-2udoy01Vtb4yRUxjYi3HxL9sEntKeUW67gvLIuJI6YSIjjrRGIJrLCVLZGIBjFXfnSHy7VAyKr1skT59MngMF5-RPl8Fmaq1nhhGbsNFG6Z-UfcveHoHmY1E94Czivx96E3KkwOQsE0-rontYOHdE1pVwediraHyq4Hwe-gW58 Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 85f8f9e57c894d6fb4164eaf5ad18d71 Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1977254209 Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_85f8f9e57c894d6fb4164eaf5ad18d71", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85f8f9e57c894d6fb4164eaf5ad18d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/85f8f9e57c894d6fb4164eaf5ad18d71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85f8f9e57c894d6fb4164eaf5ad18d71"}]}] Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1977254209 Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 85f8f9e57c894d6fb4164eaf5ad18d71 Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1977254209 Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1977254209-project Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 35359752576b45a2923ded6176acda03 Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1977254209-project Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'bd3c963b-474a-4ef5-b462-d66d56fa3c67'} Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:01:25.495636 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:01:25.504670 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. Aug 03 02:01:25.504670 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:25.504670 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:01:25.504670 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:25.504670 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:25.504670 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:01:25.504670 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:01:25.504670 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:01:25.504670 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:01:25.504670 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. Aug 03 02:01:25.504670 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:25.504670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2e11f6bf-2f09-4ab0-acae-0690a2e621ec tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] Returning 404 to user: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:01:25.504670 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2e11f6bf-2f09-4ab0-acae-0690a2e621ec tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 404 len: 111 microversion: 2.1 time: 0.583033 Aug 03 02:01:25.504670 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1513/2976] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:01:24 2022] DELETE /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 111 bytes in 586 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:01:25.528335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0de0d376-d587-4d44-8d34-e9cd096c227e tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:25.533031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0de0d376-d587-4d44-8d34-e9cd096c227e tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:25.548503 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7167c851-0440-4e58-b72e-782bdf6b09d4 tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-253237924" status: 202 len: 0 microversion: 2.1 time: 0.083111 Aug 03 02:01:25.552470 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1464/2977] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:01:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-253237924 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 02:01:25.559119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-44c02e56-1e52-4167-98df-63a3f3a9658b tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] Calling method '.version_select at 0x7f5b13222820>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:25.570999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0de0d376-d587-4d44-8d34-e9cd096c227e tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:25.571788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0de0d376-d587-4d44-8d34-e9cd096c227e tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:25.573155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0de0d376-d587-4d44-8d34-e9cd096c227e tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:25.584691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0de0d376-d587-4d44-8d34-e9cd096c227e tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:25.664010 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-44c02e56-1e52-4167-98df-63a3f3a9658b tempest-KeyPairsV2TestJSON-1012852459 tempest-KeyPairsV2TestJSON-1012852459-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-569748484" status: 202 len: 0 microversion: 2.1 time: 0.108835 Aug 03 02:01:25.665604 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1465/2978] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:01:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-569748484 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:01:25.943941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d51b2d2f-b47b-46f4-a0b5-bdcc2a6dd9dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:25.950602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d51b2d2f-b47b-46f4-a0b5-bdcc2a6dd9dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:26.005525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d51b2d2f-b47b-46f4-a0b5-bdcc2a6dd9dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:26.008101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d51b2d2f-b47b-46f4-a0b5-bdcc2a6dd9dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:26.013424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d51b2d2f-b47b-46f4-a0b5-bdcc2a6dd9dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:26.016917 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d51b2d2f-b47b-46f4-a0b5-bdcc2a6dd9dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:26.246133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d51b2d2f-b47b-46f4-a0b5-bdcc2a6dd9dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:26.267385 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d51b2d2f-b47b-46f4-a0b5-bdcc2a6dd9dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1274 microversion: 2.1 time: 0.335746 Aug 03 02:01:26.273655 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1466/2979] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:25 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1274 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:26.295269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-83e8b664-1eba-41cb-b357-ec3050bb72d2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:26.297676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-83e8b664-1eba-41cb-b357-ec3050bb72d2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:26.309421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83e8b664-1eba-41cb-b357-ec3050bb72d2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:26.310443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83e8b664-1eba-41cb-b357-ec3050bb72d2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:26.312563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83e8b664-1eba-41cb-b357-ec3050bb72d2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:26.313733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83e8b664-1eba-41cb-b357-ec3050bb72d2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:26.540843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0de0d376-d587-4d44-8d34-e9cd096c227e tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1415cd573ff435a9b4fe6b0b7a833a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e9e5bc9e0d45148d1e5a789990dc22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:26.556139 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0de0d376-d587-4d44-8d34-e9cd096c227e tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 200 len: 1527 microversion: 2.1 time: 1.045811 Aug 03 02:01:26.558828 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1514/2980] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:25 2022] GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 1527 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:26.593907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6df6172a-c8d2-42a3-8600-1c9e79f0d294 tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] Action: 'update', calling method: >, body: {"server": {"name": "bd3c963b-474a-4ef5-b462-d66d56fa3c67_new"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:26.627579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6df6172a-c8d2-42a3-8600-1c9e79f0d294 tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:26.666187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6df6172a-c8d2-42a3-8600-1c9e79f0d294 tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:26.679296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6df6172a-c8d2-42a3-8600-1c9e79f0d294 tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:26.688102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6df6172a-c8d2-42a3-8600-1c9e79f0d294 tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:26.691294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6df6172a-c8d2-42a3-8600-1c9e79f0d294 tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:26.786650 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-6df6172a-c8d2-42a3-8600-1c9e79f0d294 tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] HTTP exception thrown: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6df6172a-c8d2-42a3-8600-1c9e79f0d294 tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] Request method failure captured: Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: request: PUT /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 HTTP/1.1 Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 64 Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dbf-2udoy01Vtb4yRUxjYi3HxL9sEntKeUW67gvLIuJI6YSIjjrRGIJrLCVLZGIBjFXfnSHy7VAyKr1skT59MngMF5-RPl8Fmaq1nhhGbsNFG6Z-UfcveHoHmY1E94Czivx96E3KkwOQsE0-rontYOHdE1pVwediraHyq4Hwe-gW58 Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 85f8f9e57c894d6fb4164eaf5ad18d71 Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1977254209 Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_85f8f9e57c894d6fb4164eaf5ad18d71", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85f8f9e57c894d6fb4164eaf5ad18d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/85f8f9e57c894d6fb4164eaf5ad18d71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85f8f9e57c894d6fb4164eaf5ad18d71"}]}] Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1977254209 Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 85f8f9e57c894d6fb4164eaf5ad18d71 Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1977254209 Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1977254209-project Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 35359752576b45a2923ded6176acda03 Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1977254209-project Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: {"server": {"name": "bd3c963b-474a-4ef5-b462-d66d56fa3c67_new"}} Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'bd3c963b-474a-4ef5-b462-d66d56fa3c67', 'body': {'server': {'name': 'bd3c963b-474a-4ef5-b462-d66d56fa3c67_new'}}} Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:01:26.794922 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:26.801361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6df6172a-c8d2-42a3-8600-1c9e79f0d294 tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] Returning 404 to user: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:01:26.804574 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6df6172a-c8d2-42a3-8600-1c9e79f0d294 tempest-ServersNegativeTestMultiTenantJSON-1977254209 tempest-ServersNegativeTestMultiTenantJSON-1977254209-project] 10.222.0.67 "PUT /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 404 len: 111 microversion: 2.1 time: 0.221472 Aug 03 02:01:26.805018 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1515/2981] 10.222.0.67 () {60 vars in 1256 bytes} [Wed Aug 3 02:01:26 2022] PUT /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:01:26.829481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a2c28f2b-6a5e-44a8-b224-f5e91e8698ac tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:26.835123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a2c28f2b-6a5e-44a8-b224-f5e91e8698ac tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:26.858761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2c28f2b-6a5e-44a8-b224-f5e91e8698ac tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:26.859481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2c28f2b-6a5e-44a8-b224-f5e91e8698ac tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:26.861010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2c28f2b-6a5e-44a8-b224-f5e91e8698ac tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:26.861950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2c28f2b-6a5e-44a8-b224-f5e91e8698ac tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:26.914562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a2c28f2b-6a5e-44a8-b224-f5e91e8698ac tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:01:27.004864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:27.075514 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a2c28f2b-6a5e-44a8-b224-f5e91e8698ac tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 204 len: 0 microversion: 2.1 time: 0.265755 Aug 03 02:01:27.076542 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1516/2982] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:01:26 2022] DELETE /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:01:27.089253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e67e58ae-8896-4c48-a358-5fdc56576b6b tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:27.090564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e67e58ae-8896-4c48-a358-5fdc56576b6b tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:27.100803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e67e58ae-8896-4c48-a358-5fdc56576b6b tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:27.101882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e67e58ae-8896-4c48-a358-5fdc56576b6b tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:27.103068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e67e58ae-8896-4c48-a358-5fdc56576b6b tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:27.103814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e67e58ae-8896-4c48-a358-5fdc56576b6b tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:27.122702 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-83e8b664-1eba-41cb-b357-ec3050bb72d2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:27.139798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-83e8b664-1eba-41cb-b357-ec3050bb72d2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:27.142116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-83e8b664-1eba-41cb-b357-ec3050bb72d2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:27.151071 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-83e8b664-1eba-41cb-b357-ec3050bb72d2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 0.855225 Aug 03 02:01:27.153071 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1467/2983] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:26 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:27.316795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c110ebad-2a50-4c74-9954-87e39d4d6e40 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:27.323945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c110ebad-2a50-4c74-9954-87e39d4d6e40 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:27.348132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c110ebad-2a50-4c74-9954-87e39d4d6e40 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:27.350890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c110ebad-2a50-4c74-9954-87e39d4d6e40 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:27.353209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c110ebad-2a50-4c74-9954-87e39d4d6e40 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:27.359551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c110ebad-2a50-4c74-9954-87e39d4d6e40 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:28.249922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e67e58ae-8896-4c48-a358-5fdc56576b6b tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1415cd573ff435a9b4fe6b0b7a833a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e9e5bc9e0d45148d1e5a789990dc22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:28.269075 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e67e58ae-8896-4c48-a358-5fdc56576b6b tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 200 len: 1533 microversion: 2.1 time: 1.185292 Aug 03 02:01:28.269685 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1517/2984] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:27 2022] GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 1533 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:01:28.293497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a53274cf-5711-4b32-8429-4aac6168c7b7 req-fc907491-95cd-4227-b474-beddaa19bbf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7d0db2-f64d-4df7-b0dd-2ecf688290b0", "tag": "1b653dfb-172c-43c5-8d81-55e28541d60d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:28.316988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a53274cf-5711-4b32-8429-4aac6168c7b7 req-fc907491-95cd-4227-b474-beddaa19bbf4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:28.319518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a53274cf-5711-4b32-8429-4aac6168c7b7 req-fc907491-95cd-4227-b474-beddaa19bbf4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:28.342272 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a53274cf-5711-4b32-8429-4aac6168c7b7 req-fc907491-95cd-4227-b474-beddaa19bbf4 service nova] Creating event network-changed:1b653dfb-172c-43c5-8d81-55e28541d60d for instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 on n-h1-826529-8 Aug 03 02:01:28.351164 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a53274cf-5711-4b32-8429-4aac6168c7b7 req-fc907491-95cd-4227-b474-beddaa19bbf4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079894 Aug 03 02:01:28.352336 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1518/2985] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:28.360842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-570ebbe4-b5fb-4db9-b2c0-e2e8fae4e381 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:28.374366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-570ebbe4-b5fb-4db9-b2c0-e2e8fae4e381 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:28.385924 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-570ebbe4-b5fb-4db9-b2c0-e2e8fae4e381 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:28.387244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-570ebbe4-b5fb-4db9-b2c0-e2e8fae4e381 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:28.389753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-570ebbe4-b5fb-4db9-b2c0-e2e8fae4e381 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:28.391143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-570ebbe4-b5fb-4db9-b2c0-e2e8fae4e381 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:28.799780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c110ebad-2a50-4c74-9954-87e39d4d6e40 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:28.820325 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c110ebad-2a50-4c74-9954-87e39d4d6e40 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1316 microversion: 2.1 time: 1.527187 Aug 03 02:01:28.821908 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1468/2986] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:27 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1316 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:28.835596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-00075167-5bff-4057-ba48-25c0d359708d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa5de5ae-02d1-490d-bb2c-5069737dd6da"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:28.841825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-00075167-5bff-4057-ba48-25c0d359708d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:28.856803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00075167-5bff-4057-ba48-25c0d359708d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:28.859192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00075167-5bff-4057-ba48-25c0d359708d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:28.861204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00075167-5bff-4057-ba48-25c0d359708d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:28.862369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00075167-5bff-4057-ba48-25c0d359708d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:29.339497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-570ebbe4-b5fb-4db9-b2c0-e2e8fae4e381 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:29.349825 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-00075167-5bff-4057-ba48-25c0d359708d tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "POST /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.525482 Aug 03 02:01:29.350842 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1469/2987] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:01:28 2022] POST /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments => generated 194 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:29.351311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-570ebbe4-b5fb-4db9-b2c0-e2e8fae4e381 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:29.353305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-570ebbe4-b5fb-4db9-b2c0-e2e8fae4e381 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:29.355270 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-570ebbe4-b5fb-4db9-b2c0-e2e8fae4e381 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 1.001096 Aug 03 02:01:29.376083 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1519/2988] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:28 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:29.391397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0a311838-32b9-4f83-af2e-37a7453884b8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:29.392143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0a311838-32b9-4f83-af2e-37a7453884b8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:29.417181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a311838-32b9-4f83-af2e-37a7453884b8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:29.417181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a311838-32b9-4f83-af2e-37a7453884b8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:29.418090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a311838-32b9-4f83-af2e-37a7453884b8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:29.419033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a311838-32b9-4f83-af2e-37a7453884b8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:29.471880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-36cb89d0-78a9-4109-8ac3-d18b6df06e91 req-9d47f4ee-2aa1-400d-93d4-9a2c488ab331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd3c963b-474a-4ef5-b462-d66d56fa3c67", "name": "network-vif-deleted", "tag": "ba99fbd4-52ef-4e45-b720-b7eb6f4f3259"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:29.496387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-36cb89d0-78a9-4109-8ac3-d18b6df06e91 req-9d47f4ee-2aa1-400d-93d4-9a2c488ab331 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:29.498609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-36cb89d0-78a9-4109-8ac3-d18b6df06e91 req-9d47f4ee-2aa1-400d-93d4-9a2c488ab331 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:29.535303 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-36cb89d0-78a9-4109-8ac3-d18b6df06e91 req-9d47f4ee-2aa1-400d-93d4-9a2c488ab331 service nova] Creating event network-vif-deleted:ba99fbd4-52ef-4e45-b720-b7eb6f4f3259 for instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 on n-h1-826529-8 Aug 03 02:01:29.550205 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-36cb89d0-78a9-4109-8ac3-d18b6df06e91 req-9d47f4ee-2aa1-400d-93d4-9a2c488ab331 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082612 Aug 03 02:01:29.551169 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1520/2989] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:01:29.714333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0a311838-32b9-4f83-af2e-37a7453884b8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1415cd573ff435a9b4fe6b0b7a833a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e9e5bc9e0d45148d1e5a789990dc22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:29.727109 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0a311838-32b9-4f83-af2e-37a7453884b8 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 200 len: 1491 microversion: 2.1 time: 0.374708 Aug 03 02:01:29.728444 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1470/2990] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:29 2022] GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 1491 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:29.853502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fb9a7ff3-e828-4206-b66e-89d6acafc96d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:29.854765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fb9a7ff3-e828-4206-b66e-89d6acafc96d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:29.868857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb9a7ff3-e828-4206-b66e-89d6acafc96d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:29.869744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb9a7ff3-e828-4206-b66e-89d6acafc96d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:29.870890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb9a7ff3-e828-4206-b66e-89d6acafc96d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:29.872995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb9a7ff3-e828-4206-b66e-89d6acafc96d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:30.391700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a18aa7b1-bd27-4750-9a66-50a5f64f8dc0 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:30.393327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a18aa7b1-bd27-4750-9a66-50a5f64f8dc0 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:30.421794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a18aa7b1-bd27-4750-9a66-50a5f64f8dc0 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:30.426274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a18aa7b1-bd27-4750-9a66-50a5f64f8dc0 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:30.430589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a18aa7b1-bd27-4750-9a66-50a5f64f8dc0 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:30.431331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a18aa7b1-bd27-4750-9a66-50a5f64f8dc0 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:30.466392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:30.603920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:30.679291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fb9a7ff3-e828-4206-b66e-89d6acafc96d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:30.699764 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fb9a7ff3-e828-4206-b66e-89d6acafc96d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1316 microversion: 2.1 time: 0.853974 Aug 03 02:01:30.703774 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1521/2991] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:29 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1316 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:30.752310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9d596949-ec2d-41c2-a646-57848c0846e1 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:30.753129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9d596949-ec2d-41c2-a646-57848c0846e1 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] [instance: bd3c963b-474a-4ef5-b462-d66d56fa3c67] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:30.760778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d596949-ec2d-41c2-a646-57848c0846e1 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:30.761292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d596949-ec2d-41c2-a646-57848c0846e1 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:30.762147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d596949-ec2d-41c2-a646-57848c0846e1 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:30.762876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d596949-ec2d-41c2-a646-57848c0846e1 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:30.790209 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-9d596949-ec2d-41c2-a646-57848c0846e1 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] HTTP exception thrown: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9d596949-ec2d-41c2-a646-57848c0846e1 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Request method failure captured: Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 HTTP/1.1 Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6da-0kaXoX5UNcgPBWPPZAPQkihYACEqdQwcKTP_9Xg2PGb8lyZTP1ngSgZlEC7M6NML-wNcsG8rVl6UvXp11rfKaiii6s44LT2IAfiHtBqUXd6GotT3A95XU1P3phcIchalPATf-G1ZQjtqQJehGBHIGcufhaMWwxIhYnaKDuRH3lM Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 56e9e5bc9e0d45148d1e5a789990dc22 Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2037091988 Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_56e9e5bc9e0d45148d1e5a789990dc22", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e9e5bc9e0d45148d1e5a789990dc22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/56e9e5bc9e0d45148d1e5a789990dc22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/56e9e5bc9e0d45148d1e5a789990dc22"}]}] Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2037091988 Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 56e9e5bc9e0d45148d1e5a789990dc22 Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2037091988 Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2037091988-project Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e1415cd573ff435a9b4fe6b0b7a833a6 Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2037091988-project Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'bd3c963b-474a-4ef5-b462-d66d56fa3c67'} Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. Aug 03 02:01:30.794719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:30.805919 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:01:30.805919 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:30.805919 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:30.805919 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:01:30.805919 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:01:30.805919 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:01:30.805919 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:01:30.805919 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. Aug 03 02:01:30.805919 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:30.805919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9d596949-ec2d-41c2-a646-57848c0846e1 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] Returning 404 to user: Instance bd3c963b-474a-4ef5-b462-d66d56fa3c67 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:01:30.805919 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9d596949-ec2d-41c2-a646-57848c0846e1 tempest-ServersNegativeTestMultiTenantJSON-2037091988 tempest-ServersNegativeTestMultiTenantJSON-2037091988-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67" status: 404 len: 111 microversion: 2.1 time: 0.049881 Aug 03 02:01:30.805919 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1522/2992] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:30 2022] GET /compute/v2.1/servers/bd3c963b-474a-4ef5-b462-d66d56fa3c67 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:01:31.252434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a18aa7b1-bd27-4750-9a66-50a5f64f8dc0 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:31.278199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a18aa7b1-bd27-4750-9a66-50a5f64f8dc0 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:31.279918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a18aa7b1-bd27-4750-9a66-50a5f64f8dc0 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:31.281406 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a18aa7b1-bd27-4750-9a66-50a5f64f8dc0 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 0.895494 Aug 03 02:01:31.283228 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1471/2993] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:30 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:01:31.406152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c8a36b8f-9340-4e55-9275-0844289cd299 req-b963ea8a-c1aa-46a9-82d9-fa5eb31874f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ef72c23-de99-468f-851f-7964dc0a58b5", "tag": "96df043c-6c35-4150-8a96-ec528a27b440"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:31.425807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=34 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:31.431740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c8a36b8f-9340-4e55-9275-0844289cd299 req-b963ea8a-c1aa-46a9-82d9-fa5eb31874f1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:31.432644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c8a36b8f-9340-4e55-9275-0844289cd299 req-b963ea8a-c1aa-46a9-82d9-fa5eb31874f1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:31.481976 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c8a36b8f-9340-4e55-9275-0844289cd299 req-b963ea8a-c1aa-46a9-82d9-fa5eb31874f1 service nova] Creating event network-changed:96df043c-6c35-4150-8a96-ec528a27b440 for instance 9ef72c23-de99-468f-851f-7964dc0a58b5 on n-h2-826529-8 Aug 03 02:01:31.493635 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c8a36b8f-9340-4e55-9275-0844289cd299 req-b963ea8a-c1aa-46a9-82d9-fa5eb31874f1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092681 Aug 03 02:01:31.495328 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1523/2994] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:31.729269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-552db9bd-e948-4c95-9093-e0d8c5dae0e1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:31.730025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-552db9bd-e948-4c95-9093-e0d8c5dae0e1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:31.767896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552db9bd-e948-4c95-9093-e0d8c5dae0e1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:31.768373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552db9bd-e948-4c95-9093-e0d8c5dae0e1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:31.773539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552db9bd-e948-4c95-9093-e0d8c5dae0e1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:31.774010 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552db9bd-e948-4c95-9093-e0d8c5dae0e1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:32.446545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1401354123", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "cf1e5fc2-66a4-4802-965c-545f628b0c29"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:32.694197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] validate_networks() for [('cf1e5fc2-66a4-4802-965c-545f628b0c29', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:01:35.091612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:01:35.093253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:01:35.093923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:01:35.094877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:01:35.095849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:01:35.133866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:35.141114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:35.142984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:35.151053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:35.276403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Getting quotas for project 01f1d9f8216e4f729a5e24aad713fe98. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:35.276672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=42 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:35.311890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Getting quotas for user 0dc56b77862f410d82c8617f3d679775 and project 01f1d9f8216e4f729a5e24aad713fe98. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:35.391424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:01:35.413976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:01:35.582703 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e9a3d025-0e51-4ec9-84ca-acd5a8188e48 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.479516 Aug 03 02:01:35.583898 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1524/2995] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:01:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 02:01:35.590300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4a2192df-af7a-4030-b30b-19ec8a933899 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:35.591222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4a2192df-af7a-4030-b30b-19ec8a933899 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:35.601888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a2192df-af7a-4030-b30b-19ec8a933899 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:35.603064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a2192df-af7a-4030-b30b-19ec8a933899 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:35.605788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a2192df-af7a-4030-b30b-19ec8a933899 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:35.606798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a2192df-af7a-4030-b30b-19ec8a933899 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:36.244454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-552db9bd-e948-4c95-9093-e0d8c5dae0e1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:36.267406 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-552db9bd-e948-4c95-9093-e0d8c5dae0e1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1316 microversion: 2.1 time: 4.541172 Aug 03 02:01:36.304575 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1472/2996] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:31 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1316 bytes in 4562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:36.320872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8d32067-b239-4909-bd7c-76bfbd99aa57 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:36.323296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b8d32067-b239-4909-bd7c-76bfbd99aa57 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:37.132904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b8d32067-b239-4909-bd7c-76bfbd99aa57 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:37.160364 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b8d32067-b239-4909-bd7c-76bfbd99aa57 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 200 len: 1215 microversion: 2.1 time: 0.852334 Aug 03 02:01:37.169673 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1473/2997] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:36 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 1215 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:37.309950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1f376ba7-91e7-4f68-be51-16325c4a91dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:37.312830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1f376ba7-91e7-4f68-be51-16325c4a91dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:37.332376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f376ba7-91e7-4f68-be51-16325c4a91dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:37.334055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f376ba7-91e7-4f68-be51-16325c4a91dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:37.337288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f376ba7-91e7-4f68-be51-16325c4a91dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:37.338010 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f376ba7-91e7-4f68-be51-16325c4a91dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:37.563662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4a2192df-af7a-4030-b30b-19ec8a933899 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:37.583773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4a2192df-af7a-4030-b30b-19ec8a933899 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:37.591019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4a2192df-af7a-4030-b30b-19ec8a933899 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:37.597340 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4a2192df-af7a-4030-b30b-19ec8a933899 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 2.010344 Aug 03 02:01:37.602056 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1525/2998] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:35 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:38.201809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3491637f-d622-4256-bd20-a6e8b25f76a1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:38.202788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3491637f-d622-4256-bd20-a6e8b25f76a1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:38.268785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3491637f-d622-4256-bd20-a6e8b25f76a1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:38.289936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3491637f-d622-4256-bd20-a6e8b25f76a1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:38.295639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3491637f-d622-4256-bd20-a6e8b25f76a1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:38.301963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3491637f-d622-4256-bd20-a6e8b25f76a1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:39.499421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3491637f-d622-4256-bd20-a6e8b25f76a1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:39.571527 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3491637f-d622-4256-bd20-a6e8b25f76a1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 200 len: 1275 microversion: 2.1 time: 1.372650 Aug 03 02:01:39.579788 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1526/2999] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:38 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 1275 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:01:39.616721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cee2b10d-c845-42c7-a83b-1d11e090c29b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:39.628526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cee2b10d-c845-42c7-a83b-1d11e090c29b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:39.663193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cee2b10d-c845-42c7-a83b-1d11e090c29b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:39.664262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cee2b10d-c845-42c7-a83b-1d11e090c29b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:39.667967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cee2b10d-c845-42c7-a83b-1d11e090c29b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:39.668370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cee2b10d-c845-42c7-a83b-1d11e090c29b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:40.100503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1f376ba7-91e7-4f68-be51-16325c4a91dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:40.136720 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1f376ba7-91e7-4f68-be51-16325c4a91dc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1316 microversion: 2.1 time: 2.832776 Aug 03 02:01:40.147295 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1474/3000] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:37 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1316 bytes in 2844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:01:40.614223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c3318330-abe9-475f-a0f0-abb8c0ad4eaf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:40.615631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c3318330-abe9-475f-a0f0-abb8c0ad4eaf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:40.661364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3318330-abe9-475f-a0f0-abb8c0ad4eaf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:40.663554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3318330-abe9-475f-a0f0-abb8c0ad4eaf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:40.665800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3318330-abe9-475f-a0f0-abb8c0ad4eaf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:40.668709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3318330-abe9-475f-a0f0-abb8c0ad4eaf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:41.354288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c3318330-abe9-475f-a0f0-abb8c0ad4eaf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:41.377028 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c3318330-abe9-475f-a0f0-abb8c0ad4eaf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 200 len: 1273 microversion: 2.1 time: 0.769768 Aug 03 02:01:41.391507 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1475/3001] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:40 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 1273 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:41.397313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c684c37e-85c2-46e0-a825-e14d395cf434 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:41.407177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c684c37e-85c2-46e0-a825-e14d395cf434 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:41.426991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c684c37e-85c2-46e0-a825-e14d395cf434 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:41.447428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c684c37e-85c2-46e0-a825-e14d395cf434 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:41.463824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c684c37e-85c2-46e0-a825-e14d395cf434 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:41.465942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c684c37e-85c2-46e0-a825-e14d395cf434 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:42.507900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cee2b10d-c845-42c7-a83b-1d11e090c29b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:42.563316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cee2b10d-c845-42c7-a83b-1d11e090c29b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:42.575507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cee2b10d-c845-42c7-a83b-1d11e090c29b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:42.579972 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cee2b10d-c845-42c7-a83b-1d11e090c29b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 2.982243 Aug 03 02:01:42.596477 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1527/3002] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:39 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 3001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:42.615012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-42dd0ccb-c4f9-4c67-a81e-c77b30beada9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:42.616137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-42dd0ccb-c4f9-4c67-a81e-c77b30beada9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:42.631038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42dd0ccb-c4f9-4c67-a81e-c77b30beada9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:42.631894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42dd0ccb-c4f9-4c67-a81e-c77b30beada9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:42.633094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42dd0ccb-c4f9-4c67-a81e-c77b30beada9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:42.634622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42dd0ccb-c4f9-4c67-a81e-c77b30beada9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:44.335654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c684c37e-85c2-46e0-a825-e14d395cf434 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:44.391561 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c684c37e-85c2-46e0-a825-e14d395cf434 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1316 microversion: 2.1 time: 2.997931 Aug 03 02:01:44.433360 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1476/3003] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:41 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1316 bytes in 3041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:44.461569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-543882e5-e388-4025-b0fb-45e79152c843 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:44.471348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-543882e5-e388-4025-b0fb-45e79152c843 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:44.502888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-543882e5-e388-4025-b0fb-45e79152c843 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:44.510896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-543882e5-e388-4025-b0fb-45e79152c843 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:44.521594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-543882e5-e388-4025-b0fb-45e79152c843 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:44.522810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-543882e5-e388-4025-b0fb-45e79152c843 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:45.214399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:45.365644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:45.503316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-42dd0ccb-c4f9-4c67-a81e-c77b30beada9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:45.536235 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-42dd0ccb-c4f9-4c67-a81e-c77b30beada9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 200 len: 1315 microversion: 2.1 time: 2.937986 Aug 03 02:01:45.539816 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1528/3004] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:42 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 1315 bytes in 2943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:45.555291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c9cb600a-8ead-4a7c-b180-91ce91606b6b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:45.557063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c9cb600a-8ead-4a7c-b180-91ce91606b6b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:45.576130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9cb600a-8ead-4a7c-b180-91ce91606b6b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:45.577692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9cb600a-8ead-4a7c-b180-91ce91606b6b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:45.579142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9cb600a-8ead-4a7c-b180-91ce91606b6b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:45.580018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9cb600a-8ead-4a7c-b180-91ce91606b6b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:47.160134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:47.433540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-543882e5-e388-4025-b0fb-45e79152c843 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:47.520798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-543882e5-e388-4025-b0fb-45e79152c843 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:47.543167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-543882e5-e388-4025-b0fb-45e79152c843 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:47.553185 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-543882e5-e388-4025-b0fb-45e79152c843 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 3.117140 Aug 03 02:01:47.557311 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1477/3005] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:44 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 3123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:47.601059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-7c2ed2cb-e3f4-4be5-b644-a2b4d3f19dd5 req-ab071078-b7ee-419d-8486-52f659e996e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "934e4649-81b8-4e89-b7a0-3897750957ba", "tag": "21041173-9f5c-47c6-bbcd-42e02ea8da17"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:47.671842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7c2ed2cb-e3f4-4be5-b644-a2b4d3f19dd5 req-ab071078-b7ee-419d-8486-52f659e996e5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:47.672554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7c2ed2cb-e3f4-4be5-b644-a2b4d3f19dd5 req-ab071078-b7ee-419d-8486-52f659e996e5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:47.693165 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-7c2ed2cb-e3f4-4be5-b644-a2b4d3f19dd5 req-ab071078-b7ee-419d-8486-52f659e996e5 service nova] Creating event network-changed:21041173-9f5c-47c6-bbcd-42e02ea8da17 for instance 934e4649-81b8-4e89-b7a0-3897750957ba on n-h1-826529-8 Aug 03 02:01:47.702794 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-7c2ed2cb-e3f4-4be5-b644-a2b4d3f19dd5 req-ab071078-b7ee-419d-8486-52f659e996e5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141650 Aug 03 02:01:47.703480 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1478/3006] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:47.729139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-59ff30dd-c7b9-4c13-825d-49653d510d6c req-a93a3373-fc75-4258-a6e6-8727047387f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef72c23-de99-468f-851f-7964dc0a58b5", "name": "network-vif-plugged", "status": "completed", "tag": "96df043c-6c35-4150-8a96-ec528a27b440"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:47.753535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-59ff30dd-c7b9-4c13-825d-49653d510d6c req-a93a3373-fc75-4258-a6e6-8727047387f9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:47.758343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-59ff30dd-c7b9-4c13-825d-49653d510d6c req-a93a3373-fc75-4258-a6e6-8727047387f9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:47.818337 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-59ff30dd-c7b9-4c13-825d-49653d510d6c req-a93a3373-fc75-4258-a6e6-8727047387f9 service nova] Creating event network-vif-plugged:96df043c-6c35-4150-8a96-ec528a27b440 for instance 9ef72c23-de99-468f-851f-7964dc0a58b5 on n-h2-826529-8 Aug 03 02:01:47.844346 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-59ff30dd-c7b9-4c13-825d-49653d510d6c req-a93a3373-fc75-4258-a6e6-8727047387f9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131432 Aug 03 02:01:47.863293 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1479/3007] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:47.894154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6044b45f-fcf3-4f1f-bdd6-8bffbaf5e572 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:47.909025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6044b45f-fcf3-4f1f-bdd6-8bffbaf5e572 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:47.943831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6044b45f-fcf3-4f1f-bdd6-8bffbaf5e572 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:47.947809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6044b45f-fcf3-4f1f-bdd6-8bffbaf5e572 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:47.952158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6044b45f-fcf3-4f1f-bdd6-8bffbaf5e572 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:47.964087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6044b45f-fcf3-4f1f-bdd6-8bffbaf5e572 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:48.329932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c9cb600a-8ead-4a7c-b180-91ce91606b6b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:48.345496 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c9cb600a-8ead-4a7c-b180-91ce91606b6b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1316 microversion: 2.1 time: 2.803065 Aug 03 02:01:48.346101 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1529/3008] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:45 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1316 bytes in 2805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:48.586833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-456b8946-1c09-488f-9c34-25318fee5926 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:48.587863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-456b8946-1c09-488f-9c34-25318fee5926 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:48.600653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-456b8946-1c09-488f-9c34-25318fee5926 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:48.601724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-456b8946-1c09-488f-9c34-25318fee5926 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:48.603541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-456b8946-1c09-488f-9c34-25318fee5926 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:48.604556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-456b8946-1c09-488f-9c34-25318fee5926 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:48.716150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6044b45f-fcf3-4f1f-bdd6-8bffbaf5e572 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:48.737383 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6044b45f-fcf3-4f1f-bdd6-8bffbaf5e572 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 200 len: 1315 microversion: 2.1 time: 0.871344 Aug 03 02:01:48.749707 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1480/3009] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:47 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 1315 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:49.259900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-456b8946-1c09-488f-9c34-25318fee5926 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:49.289275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-456b8946-1c09-488f-9c34-25318fee5926 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:49.299082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-456b8946-1c09-488f-9c34-25318fee5926 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:49.305012 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-456b8946-1c09-488f-9c34-25318fee5926 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 0.724245 Aug 03 02:01:49.321628 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1530/3010] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:48 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:01:49.387292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d55ffdfe-e403-4a56-9e65-9c8487d2cdbc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:49.388399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d55ffdfe-e403-4a56-9e65-9c8487d2cdbc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:49.433175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d55ffdfe-e403-4a56-9e65-9c8487d2cdbc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:49.442256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d55ffdfe-e403-4a56-9e65-9c8487d2cdbc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:49.449286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d55ffdfe-e403-4a56-9e65-9c8487d2cdbc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:49.457989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d55ffdfe-e403-4a56-9e65-9c8487d2cdbc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:49.782832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4805bc01-3b2f-4b39-a703-acfbdc8efc46 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:49.784532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4805bc01-3b2f-4b39-a703-acfbdc8efc46 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:49.806339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4805bc01-3b2f-4b39-a703-acfbdc8efc46 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:49.809852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4805bc01-3b2f-4b39-a703-acfbdc8efc46 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:49.812812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4805bc01-3b2f-4b39-a703-acfbdc8efc46 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:49.813573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4805bc01-3b2f-4b39-a703-acfbdc8efc46 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:50.062871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d55ffdfe-e403-4a56-9e65-9c8487d2cdbc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:50.087827 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d55ffdfe-e403-4a56-9e65-9c8487d2cdbc tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1316 microversion: 2.1 time: 0.707657 Aug 03 02:01:50.096066 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1481/3011] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:49 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1316 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:50.342664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-33992db5-a1b8-4575-b199-3f390fd53384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:50.343821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-33992db5-a1b8-4575-b199-3f390fd53384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:50.359812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33992db5-a1b8-4575-b199-3f390fd53384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:50.362767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33992db5-a1b8-4575-b199-3f390fd53384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:50.363757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33992db5-a1b8-4575-b199-3f390fd53384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:50.375730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33992db5-a1b8-4575-b199-3f390fd53384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:50.507214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4805bc01-3b2f-4b39-a703-acfbdc8efc46 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:50.551682 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4805bc01-3b2f-4b39-a703-acfbdc8efc46 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 200 len: 1315 microversion: 2.1 time: 0.762064 Aug 03 02:01:50.556684 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1531/3012] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:49 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 1315 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:01:51.142774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0a857696-7581-4b60-b6dd-51c2dc6a0a6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:51.149529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0a857696-7581-4b60-b6dd-51c2dc6a0a6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:51.163020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:51.212804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a857696-7581-4b60-b6dd-51c2dc6a0a6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:51.220238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a857696-7581-4b60-b6dd-51c2dc6a0a6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:51.222441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a857696-7581-4b60-b6dd-51c2dc6a0a6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:51.229560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a857696-7581-4b60-b6dd-51c2dc6a0a6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:51.487376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-33992db5-a1b8-4575-b199-3f390fd53384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:51.525734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-33992db5-a1b8-4575-b199-3f390fd53384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:51.532061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-33992db5-a1b8-4575-b199-3f390fd53384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:51.534588 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-33992db5-a1b8-4575-b199-3f390fd53384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 1.198451 Aug 03 02:01:51.540361 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1482/3013] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:50 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:51.602811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eeb9fa0d-aba0-4687-810c-8490a85ed6ea tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:51.612057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eeb9fa0d-aba0-4687-810c-8490a85ed6ea tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:51.633797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eeb9fa0d-aba0-4687-810c-8490a85ed6ea tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:51.634650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eeb9fa0d-aba0-4687-810c-8490a85ed6ea tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:51.636418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eeb9fa0d-aba0-4687-810c-8490a85ed6ea tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:51.638175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eeb9fa0d-aba0-4687-810c-8490a85ed6ea tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:52.043665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a857696-7581-4b60-b6dd-51c2dc6a0a6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:52.064710 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0a857696-7581-4b60-b6dd-51c2dc6a0a6e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1466 microversion: 2.1 time: 0.929784 Aug 03 02:01:52.081665 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1532/3014] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:51 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1466 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:01:52.144666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eeb9fa0d-aba0-4687-810c-8490a85ed6ea tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:52.172340 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eeb9fa0d-aba0-4687-810c-8490a85ed6ea tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 200 len: 1315 microversion: 2.1 time: 0.581449 Aug 03 02:01:52.187885 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1483/3015] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:51 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:01:52.212817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-73619e8d-8cac-48b2-adc4-2d94a6b2fa13 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:52.214064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-73619e8d-8cac-48b2-adc4-2d94a6b2fa13 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:52.227464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73619e8d-8cac-48b2-adc4-2d94a6b2fa13 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:52.228715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73619e8d-8cac-48b2-adc4-2d94a6b2fa13 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:52.230427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73619e8d-8cac-48b2-adc4-2d94a6b2fa13 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:52.231563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73619e8d-8cac-48b2-adc4-2d94a6b2fa13 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:52.240939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-082afe19-9c89-4671-97a1-04cec81d4b30 tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ce31f7f4-0a5b-4d5f-a039-b6ad5fbde38a"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:52.243759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-082afe19-9c89-4671-97a1-04cec81d4b30 tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:52.264782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-082afe19-9c89-4671-97a1-04cec81d4b30 tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:52.265990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-082afe19-9c89-4671-97a1-04cec81d4b30 tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:52.268857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-082afe19-9c89-4671-97a1-04cec81d4b30 tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:52.269996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-082afe19-9c89-4671-97a1-04cec81d4b30 tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:52.525906 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-082afe19-9c89-4671-97a1-04cec81d4b30 tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] HTTP exception thrown: Volume ce31f7f4-0a5b-4d5f-a039-b6ad5fbde38a could not be found. Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-082afe19-9c89-4671-97a1-04cec81d4b30 tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] Request method failure captured: Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: request: PUT /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments/aa5de5ae-02d1-490d-bb2c-5069737dd6da HTTP/1.1 Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 74 Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dapNYBfbTunsxts9a4uRYHEqjcLGH71jI_AKPBN7dubn_23GenT0j-tT9rjG-fkCl0Gq0clKdf2L_Nosmy-QR8OKZhsTKX2DwiGUcULL8kAcC9I9fLciO3rSoAt9ozZafN6D5A98C3JzWl1ZdWKXFUbAaJuwrcHkSW8QBv30DQOb84 Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 6d6996cc8cd54c519bd6116bc76a0966 Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-VolumesAdminNegativeTest-733503398 Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6d6996cc8cd54c519bd6116bc76a0966", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6d6996cc8cd54c519bd6116bc76a0966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6d6996cc8cd54c519bd6116bc76a0966"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6d6996cc8cd54c519bd6116bc76a0966"}]}] Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-VolumesAdminNegativeTest-733503398 Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 6d6996cc8cd54c519bd6116bc76a0966 Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-733503398 Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-VolumesAdminNegativeTest-733503398-project-admin Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: b5b344c2b24742d6a2135d973c6db9d7 Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-VolumesAdminNegativeTest-733503398-project-admin Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: {"volumeAttachment": {"volumeId": "ce31f7f4-0a5b-4d5f-a039-b6ad5fbde38a"}} Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: exception: Volume ce31f7f4-0a5b-4d5f-a039-b6ad5fbde38a could not be found. Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'server_id': '6731bf52-2375-4f2a-9905-79b334d5917b', 'id': 'aa5de5ae-02d1-490d-bb2c-5069737dd6da', 'body': {'volumeAttachment': {'volumeId': 'ce31f7f4-0a5b-4d5f-a039-b6ad5fbde38a'}}} Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce31f7f4-0a5b-4d5f-a039-b6ad5fbde38a could not be found. (HTTP 404) (Request-ID: req-7621b76c-b0e1-4b58-8694-58b9d4f33ff5) Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 02:01:52.550846 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce31f7f4-0a5b-4d5f-a039-b6ad5fbde38a could not be found. Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume ce31f7f4-0a5b-4d5f-a039-b6ad5fbde38a could not be found. Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce31f7f4-0a5b-4d5f-a039-b6ad5fbde38a could not be found. Aug 03 02:01:52.563957 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:01:52.574355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-082afe19-9c89-4671-97a1-04cec81d4b30 tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] Returning 400 to user: Volume ce31f7f4-0a5b-4d5f-a039-b6ad5fbde38a could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:01:52.574355 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-082afe19-9c89-4671-97a1-04cec81d4b30 tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] 10.222.0.67 "PUT /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments/aa5de5ae-02d1-490d-bb2c-5069737dd6da" status: 400 len: 107 microversion: 2.1 time: 0.489623 Aug 03 02:01:52.580716 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1533/3016] 10.222.0.67 () {60 vars in 1433 bytes} [Wed Aug 3 02:01:52 2022] PUT /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments/aa5de5ae-02d1-490d-bb2c-5069737dd6da => generated 107 bytes in 493 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:01:52.585420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b19d699e-e997-48d9-b7d0-a9c2a9ea1e4c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:52.586522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b19d699e-e997-48d9-b7d0-a9c2a9ea1e4c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:52.604606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b19d699e-e997-48d9-b7d0-a9c2a9ea1e4c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:52.606449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b19d699e-e997-48d9-b7d0-a9c2a9ea1e4c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:52.609121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b19d699e-e997-48d9-b7d0-a9c2a9ea1e4c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:52.610195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b19d699e-e997-48d9-b7d0-a9c2a9ea1e4c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:53.103869 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-73619e8d-8cac-48b2-adc4-2d94a6b2fa13 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1617 microversion: 2.1 time: 0.914316 Aug 03 02:01:53.112090 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1484/3017] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:52 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1617 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:53.132383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-be9300f0-107b-4b67-88fa-393d5099484e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:53.133607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-be9300f0-107b-4b67-88fa-393d5099484e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:53.147811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be9300f0-107b-4b67-88fa-393d5099484e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:53.150193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be9300f0-107b-4b67-88fa-393d5099484e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:53.152470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be9300f0-107b-4b67-88fa-393d5099484e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:53.156647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be9300f0-107b-4b67-88fa-393d5099484e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:53.209591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b19d699e-e997-48d9-b7d0-a9c2a9ea1e4c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:53.255291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b19d699e-e997-48d9-b7d0-a9c2a9ea1e4c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:53.278507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b19d699e-e997-48d9-b7d0-a9c2a9ea1e4c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:53.285580 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b19d699e-e997-48d9-b7d0-a9c2a9ea1e4c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 0.708646 Aug 03 02:01:53.315864 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1534/3018] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:52 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:53.340723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a307728f-a208-4186-9364-24ba30db36e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:53.343079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a307728f-a208-4186-9364-24ba30db36e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:53.356841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a307728f-a208-4186-9364-24ba30db36e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:53.358284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a307728f-a208-4186-9364-24ba30db36e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:53.360337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a307728f-a208-4186-9364-24ba30db36e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:53.361387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a307728f-a208-4186-9364-24ba30db36e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:53.585241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-be9300f0-107b-4b67-88fa-393d5099484e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lazy-loading 'services' on Instance uuid 6731bf52-2375-4f2a-9905-79b334d5917b {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:01:53.685580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a307728f-a208-4186-9364-24ba30db36e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:53.705361 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a307728f-a208-4186-9364-24ba30db36e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 200 len: 1315 microversion: 2.1 time: 0.386924 Aug 03 02:01:53.710758 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1535/3019] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:53 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:53.724899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-422752929", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ba033cef-0c1e-4b18-9584-427e6db2fcb1"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:53.896655 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-be9300f0-107b-4b67-88fa-393d5099484e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments/aa5de5ae-02d1-490d-bb2c-5069737dd6da" status: 202 len: 0 microversion: 2.1 time: 0.782193 Aug 03 02:01:53.913641 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1485/3020] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:01:53 2022] DELETE /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments/aa5de5ae-02d1-490d-bb2c-5069737dd6da => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:01:53.928165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d43a8d8b-dfbf-47f7-9716-4ffda212c821 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:53.945061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d43a8d8b-dfbf-47f7-9716-4ffda212c821 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:53.945835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:01:53.979615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d43a8d8b-dfbf-47f7-9716-4ffda212c821 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:53.980160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d43a8d8b-dfbf-47f7-9716-4ffda212c821 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:53.981023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d43a8d8b-dfbf-47f7-9716-4ffda212c821 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:53.981473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d43a8d8b-dfbf-47f7-9716-4ffda212c821 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:54.203186 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d43a8d8b-dfbf-47f7-9716-4ffda212c821 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.284861 Aug 03 02:01:54.228641 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1486/3021] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:01:53 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments => generated 197 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:01:54.261338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-e1977052-cd4a-4a68-8452-9aa3d46889ce req-39cd5d29-f3b2-4a80-989c-2cd77398bf5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "934e4649-81b8-4e89-b7a0-3897750957ba", "name": "network-vif-plugged", "status": "completed", "tag": "21041173-9f5c-47c6-bbcd-42e02ea8da17"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:01:54.316930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e1977052-cd4a-4a68-8452-9aa3d46889ce req-39cd5d29-f3b2-4a80-989c-2cd77398bf5f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:54.319421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e1977052-cd4a-4a68-8452-9aa3d46889ce req-39cd5d29-f3b2-4a80-989c-2cd77398bf5f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:54.353070 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e1977052-cd4a-4a68-8452-9aa3d46889ce req-39cd5d29-f3b2-4a80-989c-2cd77398bf5f service nova] Creating event network-vif-plugged:21041173-9f5c-47c6-bbcd-42e02ea8da17 for instance 934e4649-81b8-4e89-b7a0-3897750957ba on n-h1-826529-8 Aug 03 02:01:54.370777 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-e1977052-cd4a-4a68-8452-9aa3d46889ce req-39cd5d29-f3b2-4a80-989c-2cd77398bf5f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118330 Aug 03 02:01:54.373293 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1487/3022] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:01:54.387249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4a3c0411-a890-4780-8fc0-2002f1e80e04 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:54.391436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4a3c0411-a890-4780-8fc0-2002f1e80e04 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:54.413447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a3c0411-a890-4780-8fc0-2002f1e80e04 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:54.415209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a3c0411-a890-4780-8fc0-2002f1e80e04 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:54.416906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a3c0411-a890-4780-8fc0-2002f1e80e04 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:54.418168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a3c0411-a890-4780-8fc0-2002f1e80e04 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:54.728605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:01:54.730099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:01:54.731264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:01:54.733081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:01:54.735050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:01:54.781352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:54.783644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:54.786473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:54.787223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:54.835936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:01:54.848395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Getting quotas for user 3d335144d6f34ae78eaa6001b906a0df and project 66bb501c093b4f47a1a50eb37387bb14. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:01:54.862969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4a3c0411-a890-4780-8fc0-2002f1e80e04 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:54.889000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4a3c0411-a890-4780-8fc0-2002f1e80e04 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:54.895228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:01:54.896268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4a3c0411-a890-4780-8fc0-2002f1e80e04 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:54.897538 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4a3c0411-a890-4780-8fc0-2002f1e80e04 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 0.520033 Aug 03 02:01:54.898464 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1488/3023] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:54 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:54.908531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:01:54.912578 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e9db2093-2001-4777-bafc-50d5a882efe0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:54.915867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e9db2093-2001-4777-bafc-50d5a882efe0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:54.936940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9db2093-2001-4777-bafc-50d5a882efe0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:54.941916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9db2093-2001-4777-bafc-50d5a882efe0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:54.942838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9db2093-2001-4777-bafc-50d5a882efe0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:54.943376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9db2093-2001-4777-bafc-50d5a882efe0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:55.071971 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ddc8f38a-15a5-4b15-81cf-29b59a8abfcb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.359041 Aug 03 02:01:55.073033 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1536/3024] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:01:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:01:55.100934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03411526-7059-4b65-a6f5-b34ee2c0604b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:55.101588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-03411526-7059-4b65-a6f5-b34ee2c0604b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:55.390286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03411526-7059-4b65-a6f5-b34ee2c0604b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:55.410975 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03411526-7059-4b65-a6f5-b34ee2c0604b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1216 microversion: 2.1 time: 0.314624 Aug 03 02:01:55.412551 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1537/3025] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:55 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1216 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:55.437753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-68b73583-ec0d-49fe-aef0-e9dae33e2489 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:55.439370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-68b73583-ec0d-49fe-aef0-e9dae33e2489 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:55.458969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68b73583-ec0d-49fe-aef0-e9dae33e2489 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:55.459452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68b73583-ec0d-49fe-aef0-e9dae33e2489 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:55.460354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68b73583-ec0d-49fe-aef0-e9dae33e2489 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:55.460836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68b73583-ec0d-49fe-aef0-e9dae33e2489 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:55.506823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:55.540023 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-68b73583-ec0d-49fe-aef0-e9dae33e2489 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125846 Aug 03 02:01:55.541504 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1538/3026] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:01:55 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:55.561713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e9db2093-2001-4777-bafc-50d5a882efe0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:55.583155 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e9db2093-2001-4777-bafc-50d5a882efe0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 200 len: 1315 microversion: 2.1 time: 0.683765 Aug 03 02:01:55.584317 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1489/3027] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:54 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:55.932428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-543bacd3-286a-4927-a54e-21cfcffb9de6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:55.933333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-543bacd3-286a-4927-a54e-21cfcffb9de6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:55.963695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-543bacd3-286a-4927-a54e-21cfcffb9de6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:55.964637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-543bacd3-286a-4927-a54e-21cfcffb9de6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:55.966065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-543bacd3-286a-4927-a54e-21cfcffb9de6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:55.966894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-543bacd3-286a-4927-a54e-21cfcffb9de6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:56.262416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-543bacd3-286a-4927-a54e-21cfcffb9de6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:56.273992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-543bacd3-286a-4927-a54e-21cfcffb9de6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:56.276307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-543bacd3-286a-4927-a54e-21cfcffb9de6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:56.277818 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-543bacd3-286a-4927-a54e-21cfcffb9de6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 0.353596 Aug 03 02:01:56.278955 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1539/3028] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:55 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:01:56.476398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-608b2d6c-a58b-4bbb-8466-7f010ddde45c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:56.481198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-608b2d6c-a58b-4bbb-8466-7f010ddde45c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:56.496951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=57 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:56.517737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-608b2d6c-a58b-4bbb-8466-7f010ddde45c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:56.518279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-608b2d6c-a58b-4bbb-8466-7f010ddde45c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:56.519131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-608b2d6c-a58b-4bbb-8466-7f010ddde45c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:56.527769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-608b2d6c-a58b-4bbb-8466-7f010ddde45c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:56.556366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-107fab63-c21a-4c97-883d-023328604dd3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:56.558790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-107fab63-c21a-4c97-883d-023328604dd3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:56.587623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-107fab63-c21a-4c97-883d-023328604dd3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:56.591448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-107fab63-c21a-4c97-883d-023328604dd3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:56.593507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-107fab63-c21a-4c97-883d-023328604dd3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:56.593971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-107fab63-c21a-4c97-883d-023328604dd3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:56.643329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:01:56.699969 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-107fab63-c21a-4c97-883d-023328604dd3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147771 Aug 03 02:01:56.702082 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1540/3029] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:01:56 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:01:56.713505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3799b079-bde5-454f-a0c0-74db58e9af06 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:56.714750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3799b079-bde5-454f-a0c0-74db58e9af06 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:56.755570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3799b079-bde5-454f-a0c0-74db58e9af06 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:56.756494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3799b079-bde5-454f-a0c0-74db58e9af06 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:56.758507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3799b079-bde5-454f-a0c0-74db58e9af06 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:56.759496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3799b079-bde5-454f-a0c0-74db58e9af06 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:56.858416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-608b2d6c-a58b-4bbb-8466-7f010ddde45c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:56.894981 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-608b2d6c-a58b-4bbb-8466-7f010ddde45c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1220 microversion: 2.1 time: 0.441157 Aug 03 02:01:56.921701 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1490/3030] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:56 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1220 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:57.216992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3799b079-bde5-454f-a0c0-74db58e9af06 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:57.236579 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3799b079-bde5-454f-a0c0-74db58e9af06 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 200 len: 1315 microversion: 2.1 time: 0.532661 Aug 03 02:01:57.237944 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1541/3031] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:56 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:57.324637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8602a7d2-d0b2-4efb-9c2f-cdc4590c9e69 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:57.325408 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8602a7d2-d0b2-4efb-9c2f-cdc4590c9e69 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:57.339920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8602a7d2-d0b2-4efb-9c2f-cdc4590c9e69 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:57.343724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8602a7d2-d0b2-4efb-9c2f-cdc4590c9e69 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:57.344903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8602a7d2-d0b2-4efb-9c2f-cdc4590c9e69 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:57.347329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8602a7d2-d0b2-4efb-9c2f-cdc4590c9e69 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:57.714302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-459dede2-8e1c-4a60-b2dd-ea68b8ec27ac tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:57.725380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-459dede2-8e1c-4a60-b2dd-ea68b8ec27ac tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:57.743333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-459dede2-8e1c-4a60-b2dd-ea68b8ec27ac tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:57.756839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-459dede2-8e1c-4a60-b2dd-ea68b8ec27ac tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:57.757944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-459dede2-8e1c-4a60-b2dd-ea68b8ec27ac tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:57.758713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-459dede2-8e1c-4a60-b2dd-ea68b8ec27ac tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:57.857634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8602a7d2-d0b2-4efb-9c2f-cdc4590c9e69 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:57.872592 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-459dede2-8e1c-4a60-b2dd-ea68b8ec27ac tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161946 Aug 03 02:01:57.876363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8602a7d2-d0b2-4efb-9c2f-cdc4590c9e69 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:57.886713 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1542/3032] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:01:57 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:57.887029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8602a7d2-d0b2-4efb-9c2f-cdc4590c9e69 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:57.887029 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8602a7d2-d0b2-4efb-9c2f-cdc4590c9e69 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 0.562859 Aug 03 02:01:57.891323 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1491/3033] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:57 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:57.924418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dc17bcf4-e712-440a-83f4-b567fc6b04ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:57.925157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dc17bcf4-e712-440a-83f4-b567fc6b04ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:57.939548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc17bcf4-e712-440a-83f4-b567fc6b04ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:57.940256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc17bcf4-e712-440a-83f4-b567fc6b04ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:57.941309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc17bcf4-e712-440a-83f4-b567fc6b04ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:57.941873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc17bcf4-e712-440a-83f4-b567fc6b04ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:58.214882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dc17bcf4-e712-440a-83f4-b567fc6b04ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:58.225754 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dc17bcf4-e712-440a-83f4-b567fc6b04ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1286 microversion: 2.1 time: 0.305385 Aug 03 02:01:58.227437 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1543/3034] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:57 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1286 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:58.262491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1749569c-f270-4152-9722-3aa693c71d19 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:58.264044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1749569c-f270-4152-9722-3aa693c71d19 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:58.279556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1749569c-f270-4152-9722-3aa693c71d19 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:58.280903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1749569c-f270-4152-9722-3aa693c71d19 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:58.285241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1749569c-f270-4152-9722-3aa693c71d19 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:58.287620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1749569c-f270-4152-9722-3aa693c71d19 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:58.621230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1749569c-f270-4152-9722-3aa693c71d19 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:58.634879 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1749569c-f270-4152-9722-3aa693c71d19 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 200 len: 1503 microversion: 2.1 time: 0.376503 Aug 03 02:01:58.636357 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1492/3035] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:58 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 1503 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:01:58.659179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-285e40a8-46c3-443d-a76f-6b1ab077590e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:58.660019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-285e40a8-46c3-443d-a76f-6b1ab077590e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:58.672103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-285e40a8-46c3-443d-a76f-6b1ab077590e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:58.672600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-285e40a8-46c3-443d-a76f-6b1ab077590e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:58.673415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-285e40a8-46c3-443d-a76f-6b1ab077590e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:58.673902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-285e40a8-46c3-443d-a76f-6b1ab077590e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:58.706966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-285e40a8-46c3-443d-a76f-6b1ab077590e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:01:58.895817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8c070efb-04aa-42f1-aadb-b96fd07763b2 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:58.912977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8c070efb-04aa-42f1-aadb-b96fd07763b2 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:58.931558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c070efb-04aa-42f1-aadb-b96fd07763b2 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:58.932577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c070efb-04aa-42f1-aadb-b96fd07763b2 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:58.936983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c070efb-04aa-42f1-aadb-b96fd07763b2 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:58.938384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c070efb-04aa-42f1-aadb-b96fd07763b2 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:58.944959 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-285e40a8-46c3-443d-a76f-6b1ab077590e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "DELETE /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 204 len: 0 microversion: 2.1 time: 0.290841 Aug 03 02:01:58.958390 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1544/3036] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:01:58 2022] DELETE /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:01:58.970497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3a09eacf-5a0c-426d-b1a8-3fa2e2f32bae tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:58.971627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3a09eacf-5a0c-426d-b1a8-3fa2e2f32bae tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:58.991352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a09eacf-5a0c-426d-b1a8-3fa2e2f32bae tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:58.992226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a09eacf-5a0c-426d-b1a8-3fa2e2f32bae tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:58.995942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a09eacf-5a0c-426d-b1a8-3fa2e2f32bae tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:58.996708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a09eacf-5a0c-426d-b1a8-3fa2e2f32bae tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:59.089899 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8c070efb-04aa-42f1-aadb-b96fd07763b2 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198623 Aug 03 02:01:59.094995 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1493/3037] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:01:58 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:01:59.120742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b76e6c29-cc61-426e-a868-e6495c4fe0b0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:59.127178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b76e6c29-cc61-426e-a868-e6495c4fe0b0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:59.164109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b76e6c29-cc61-426e-a868-e6495c4fe0b0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:59.164940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b76e6c29-cc61-426e-a868-e6495c4fe0b0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:59.165985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b76e6c29-cc61-426e-a868-e6495c4fe0b0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:59.167742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b76e6c29-cc61-426e-a868-e6495c4fe0b0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:59.445318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3a09eacf-5a0c-426d-b1a8-3fa2e2f32bae tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:59.460469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3a09eacf-5a0c-426d-b1a8-3fa2e2f32bae tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:59.469269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3a09eacf-5a0c-426d-b1a8-3fa2e2f32bae tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:59.473475 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3a09eacf-5a0c-426d-b1a8-3fa2e2f32bae tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 0.515214 Aug 03 02:01:59.492715 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1545/3038] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:01:58 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:01:59.509596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-840f5ac7-06cc-4b45-a9ab-b41a72fb7ccd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:01:59.510212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-840f5ac7-06cc-4b45-a9ab-b41a72fb7ccd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:01:59.524223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-840f5ac7-06cc-4b45-a9ab-b41a72fb7ccd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:59.526214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-840f5ac7-06cc-4b45-a9ab-b41a72fb7ccd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:59.528257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-840f5ac7-06cc-4b45-a9ab-b41a72fb7ccd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:01:59.529635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-840f5ac7-06cc-4b45-a9ab-b41a72fb7ccd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:01:59.779746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-840f5ac7-06cc-4b45-a9ab-b41a72fb7ccd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:59.790276 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-840f5ac7-06cc-4b45-a9ab-b41a72fb7ccd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1274 microversion: 2.1 time: 0.296116 Aug 03 02:01:59.808962 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1546/3039] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:59 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1274 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:01:59.891393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b76e6c29-cc61-426e-a868-e6495c4fe0b0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:01:59.925638 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b76e6c29-cc61-426e-a868-e6495c4fe0b0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 200 len: 1509 microversion: 2.1 time: 0.823989 Aug 03 02:01:59.936210 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1494/3040] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:01:59 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 1509 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:00.108284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-93f473dd-d34f-4c74-8e3d-e69ae70bd4c3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:00.112043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-93f473dd-d34f-4c74-8e3d-e69ae70bd4c3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:00.130629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93f473dd-d34f-4c74-8e3d-e69ae70bd4c3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:00.131971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93f473dd-d34f-4c74-8e3d-e69ae70bd4c3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:00.133158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93f473dd-d34f-4c74-8e3d-e69ae70bd4c3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:00.133910 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93f473dd-d34f-4c74-8e3d-e69ae70bd4c3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:00.186612 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-93f473dd-d34f-4c74-8e3d-e69ae70bd4c3 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082639 Aug 03 02:02:00.189765 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1547/3041] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:02:00 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:00.518896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0b0ed80b-e777-4d58-9583-22e59149830b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:00.524314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0b0ed80b-e777-4d58-9583-22e59149830b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:00.539881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b0ed80b-e777-4d58-9583-22e59149830b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:00.540983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b0ed80b-e777-4d58-9583-22e59149830b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:00.542084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b0ed80b-e777-4d58-9583-22e59149830b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:00.542884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b0ed80b-e777-4d58-9583-22e59149830b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:00.815703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a6bc2eb3-7e3b-447e-b971-c01a3eddbe5f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:00.817185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a6bc2eb3-7e3b-447e-b971-c01a3eddbe5f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:00.844901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6bc2eb3-7e3b-447e-b971-c01a3eddbe5f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:00.847966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6bc2eb3-7e3b-447e-b971-c01a3eddbe5f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:00.851885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6bc2eb3-7e3b-447e-b971-c01a3eddbe5f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:00.868894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6bc2eb3-7e3b-447e-b971-c01a3eddbe5f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:01.058061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a6bc2eb3-7e3b-447e-b971-c01a3eddbe5f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:01.069287 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a6bc2eb3-7e3b-447e-b971-c01a3eddbe5f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1274 microversion: 2.1 time: 0.258389 Aug 03 02:02:01.071262 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1548/3042] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:00 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1274 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:01.078804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0b0ed80b-e777-4d58-9583-22e59149830b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:01.084727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6008d303-16ff-4fcc-84ba-efb36c961ab7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:01.085371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6008d303-16ff-4fcc-84ba-efb36c961ab7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:01.100189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6008d303-16ff-4fcc-84ba-efb36c961ab7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:01.100663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6008d303-16ff-4fcc-84ba-efb36c961ab7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:01.101481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6008d303-16ff-4fcc-84ba-efb36c961ab7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:01.101941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6008d303-16ff-4fcc-84ba-efb36c961ab7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:01.115231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0b0ed80b-e777-4d58-9583-22e59149830b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:01.116995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0b0ed80b-e777-4d58-9583-22e59149830b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:01.118259 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0b0ed80b-e777-4d58-9583-22e59149830b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 0.616355 Aug 03 02:02:01.118847 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1495/3043] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:02:00 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:02:01.210011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1535b019-6e9a-43bf-927e-fac0195a37da tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:01.222826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1535b019-6e9a-43bf-927e-fac0195a37da tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:01.254867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1535b019-6e9a-43bf-927e-fac0195a37da tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:01.255355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1535b019-6e9a-43bf-927e-fac0195a37da tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:01.259226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1535b019-6e9a-43bf-927e-fac0195a37da tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:01.260073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1535b019-6e9a-43bf-927e-fac0195a37da tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:01.402763 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1535b019-6e9a-43bf-927e-fac0195a37da tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201273 Aug 03 02:02:01.417709 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1496/3044] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:02:01 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:01.492411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6008d303-16ff-4fcc-84ba-efb36c961ab7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:01.514660 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6008d303-16ff-4fcc-84ba-efb36c961ab7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 200 len: 1509 microversion: 2.1 time: 0.441027 Aug 03 02:02:01.516916 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1549/3045] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:01 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 1509 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:02.110412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1e99d040-368e-4f8f-bae1-74ca47a425c6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:02.112441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1e99d040-368e-4f8f-bae1-74ca47a425c6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:02.120944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e99d040-368e-4f8f-bae1-74ca47a425c6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:02.121808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e99d040-368e-4f8f-bae1-74ca47a425c6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:02.123656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e99d040-368e-4f8f-bae1-74ca47a425c6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:02.125363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e99d040-368e-4f8f-bae1-74ca47a425c6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:02.151174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0cdde098-7833-4de4-a985-315b01c70611 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:02.152391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0cdde098-7833-4de4-a985-315b01c70611 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:02.168571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cdde098-7833-4de4-a985-315b01c70611 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:02.176681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cdde098-7833-4de4-a985-315b01c70611 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:02.187076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cdde098-7833-4de4-a985-315b01c70611 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:02.188073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cdde098-7833-4de4-a985-315b01c70611 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:02.309818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1e99d040-368e-4f8f-bae1-74ca47a425c6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:02.318948 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1e99d040-368e-4f8f-bae1-74ca47a425c6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1274 microversion: 2.1 time: 0.213220 Aug 03 02:02:02.330447 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1497/3046] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:02 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1274 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:02.433545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-36c194f7-e571-4143-98ad-8e0fa79cf035 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:02.448466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-36c194f7-e571-4143-98ad-8e0fa79cf035 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:02.471337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36c194f7-e571-4143-98ad-8e0fa79cf035 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:02.471811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36c194f7-e571-4143-98ad-8e0fa79cf035 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:02.474985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36c194f7-e571-4143-98ad-8e0fa79cf035 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:02.476191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36c194f7-e571-4143-98ad-8e0fa79cf035 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:02.524323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0cdde098-7833-4de4-a985-315b01c70611 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:02.536326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0cdde098-7833-4de4-a985-315b01c70611 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:02.538080 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-36c194f7-e571-4143-98ad-8e0fa79cf035 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111913 Aug 03 02:02:02.538724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0cdde098-7833-4de4-a985-315b01c70611 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:02.542144 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0cdde098-7833-4de4-a985-315b01c70611 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 0.396085 Aug 03 02:02:02.543233 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1498/3047] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:02:02 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:02.551825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5fd8ef19-e9bf-4a9c-85de-cfefa365a795 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:02.555497 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1550/3048] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:02:02 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:02:02.561286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5fd8ef19-e9bf-4a9c-85de-cfefa365a795 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:02.571620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fd8ef19-e9bf-4a9c-85de-cfefa365a795 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:02.572353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fd8ef19-e9bf-4a9c-85de-cfefa365a795 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:02.573945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fd8ef19-e9bf-4a9c-85de-cfefa365a795 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:02.574582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fd8ef19-e9bf-4a9c-85de-cfefa365a795 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:02.921204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5fd8ef19-e9bf-4a9c-85de-cfefa365a795 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:02.954860 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5fd8ef19-e9bf-4a9c-85de-cfefa365a795 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 200 len: 1509 microversion: 2.1 time: 0.406640 Aug 03 02:02:02.967127 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1499/3049] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:02 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 1509 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:03.371095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-24340c3d-4db0-4f20-8dc7-0654f8137212 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:03.376936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-24340c3d-4db0-4f20-8dc7-0654f8137212 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:03.419274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24340c3d-4db0-4f20-8dc7-0654f8137212 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:03.419274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24340c3d-4db0-4f20-8dc7-0654f8137212 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:03.419274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24340c3d-4db0-4f20-8dc7-0654f8137212 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:03.419274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24340c3d-4db0-4f20-8dc7-0654f8137212 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:04.446189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-24340c3d-4db0-4f20-8dc7-0654f8137212 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:04.471007 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-24340c3d-4db0-4f20-8dc7-0654f8137212 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1316 microversion: 2.1 time: 1.107648 Aug 03 02:02:04.487343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-76a53a04-e330-4638-b5da-accbc4448322 tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Calling method '.version_select at 0x7f5b1317e280>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:04.516905 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1551/3050] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:03 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1316 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:04.541948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d1b40fc8-12ab-407d-a34b-129cb2f866c9 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:04.549678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d1b40fc8-12ab-407d-a34b-129cb2f866c9 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:04.572719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1b40fc8-12ab-407d-a34b-129cb2f866c9 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:04.574497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1b40fc8-12ab-407d-a34b-129cb2f866c9 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:04.578115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1b40fc8-12ab-407d-a34b-129cb2f866c9 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:04.580334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1b40fc8-12ab-407d-a34b-129cb2f866c9 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:04.680053 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d1b40fc8-12ab-407d-a34b-129cb2f866c9 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161490 Aug 03 02:02:04.685923 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1552/3051] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:02:04 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:04.688696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG neutronclient.v2_0.client [None req-76a53a04-e330-4638-b5da-accbc4448322 tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e6a90d6a-4054-4397-8d96-31a4d202b56a does not exist", "detail": ""}} {{(pid=125942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 02:02:04.689779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.security_group_api [None req-76a53a04-e330-4638-b5da-accbc4448322 tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Neutron security group e6a90d6a-4054-4397-8d96-31a4d202b56a not found {{(pid=125942) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 02:02:04.690994 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-76a53a04-e330-4638-b5da-accbc4448322 tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] HTTP exception thrown: Security group e6a90d6a-4054-4397-8d96-31a4d202b56a does not exist Aug 03 02:02:04.690994 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-95d6fde2-80c0-47b4-84a3-54feaded3791'] Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-76a53a04-e330-4638-b5da-accbc4448322 tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Request method failure captured: Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/os-security-groups/e6a90d6a-4054-4397-8d96-31a4d202b56a HTTP/1.1 Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dcbRUZIZHIlm6nlFVe-d1ZZm8zpXNij7aLEcP1YwuT2BesbZV388mhSqE2eO0ioFopM3LaGvbSrzuTBpULYbzDC7JAMMunH0nTDAYRKyWmr6A7epw_SeGqyfGk1WklrNQEBo-uoiqP5tSbM3qL4A3vJ8Z9C1xMH8SomjLQd6Dr66Hk Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 3ff0ed39cbd84e44817a52746dd76013 Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1895184673 Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3ff0ed39cbd84e44817a52746dd76013", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3ff0ed39cbd84e44817a52746dd76013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3ff0ed39cbd84e44817a52746dd76013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3ff0ed39cbd84e44817a52746dd76013"}]}] Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1895184673 Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 3ff0ed39cbd84e44817a52746dd76013 Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1895184673 Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-SecurityGroupsNegativeTestJSON-1895184673-project Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 432046b0cc1d4493a99cd2582790ff4e Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1895184673-project Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: exception: Security group e6a90d6a-4054-4397-8d96-31a4d202b56a does not exist Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-95d6fde2-80c0-47b4-84a3-54feaded3791'] Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'e6a90d6a-4054-4397-8d96-31a4d202b56a'} Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 02:02:04.694180 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e6a90d6a-4054-4397-8d96-31a4d202b56a does not exist Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95d6fde2-80c0-47b4-84a3-54feaded3791'] Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e6a90d6a-4054-4397-8d96-31a4d202b56a does not exist Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95d6fde2-80c0-47b4-84a3-54feaded3791'] Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e6a90d6a-4054-4397-8d96-31a4d202b56a does not exist Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95d6fde2-80c0-47b4-84a3-54feaded3791'] Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e6a90d6a-4054-4397-8d96-31a4d202b56a does not exist Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95d6fde2-80c0-47b4-84a3-54feaded3791'] Aug 03 02:02:04.700169 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:04.706352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-76a53a04-e330-4638-b5da-accbc4448322 tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Returning 404 to user: Security group e6a90d6a-4054-4397-8d96-31a4d202b56a does not exist Aug 03 02:02:04.706352 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-95d6fde2-80c0-47b4-84a3-54feaded3791'] {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:02:04.707925 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-76a53a04-e330-4638-b5da-accbc4448322 tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/e6a90d6a-4054-4397-8d96-31a4d202b56a" status: 404 len: 194 microversion: 2.1 time: 1.217771 Aug 03 02:02:04.709537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3a3eb12d-7f20-477f-9af5-aa503f025d0c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:04.710128 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1500/3052] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 02:02:03 2022] DELETE /compute/v2.1/os-security-groups/e6a90d6a-4054-4397-8d96-31a4d202b56a => generated 194 bytes in 1220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:02:04.710980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3a3eb12d-7f20-477f-9af5-aa503f025d0c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:04.723359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-a9d13b2d-ef13-4d0c-af89-a540a1bd03fd req-6d8a99a9-dae5-4792-ac30-37d12419073b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "934e4649-81b8-4e89-b7a0-3897750957ba", "name": "network-vif-deleted", "tag": "21041173-9f5c-47c6-bbcd-42e02ea8da17"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:04.735781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a3eb12d-7f20-477f-9af5-aa503f025d0c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:04.740216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a3eb12d-7f20-477f-9af5-aa503f025d0c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:04.753658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a3eb12d-7f20-477f-9af5-aa503f025d0c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:04.754257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a3eb12d-7f20-477f-9af5-aa503f025d0c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:04.765063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a9d13b2d-ef13-4d0c-af89-a540a1bd03fd req-6d8a99a9-dae5-4792-ac30-37d12419073b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:04.766270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a9d13b2d-ef13-4d0c-af89-a540a1bd03fd req-6d8a99a9-dae5-4792-ac30-37d12419073b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:04.801750 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-a9d13b2d-ef13-4d0c-af89-a540a1bd03fd req-6d8a99a9-dae5-4792-ac30-37d12419073b service nova] Creating event network-vif-deleted:21041173-9f5c-47c6-bbcd-42e02ea8da17 for instance 934e4649-81b8-4e89-b7a0-3897750957ba on n-h1-826529-8 Aug 03 02:02:04.810582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:04.816434 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-a9d13b2d-ef13-4d0c-af89-a540a1bd03fd req-6d8a99a9-dae5-4792-ac30-37d12419073b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104890 Aug 03 02:02:04.821441 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1501/3053] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:04.825480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:04.843032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fd8915c8-17c2-4500-9250-ff85d3355654 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:04.845794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fd8915c8-17c2-4500-9250-ff85d3355654 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:04.870609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd8915c8-17c2-4500-9250-ff85d3355654 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:04.871097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd8915c8-17c2-4500-9250-ff85d3355654 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:04.871893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd8915c8-17c2-4500-9250-ff85d3355654 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:04.872340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd8915c8-17c2-4500-9250-ff85d3355654 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:04.940802 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-fd8915c8-17c2-4500-9250-ff85d3355654 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fd8915c8-17c2-4500-9250-ff85d3355654 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba HTTP/1.1 Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '934e4649-81b8-4e89-b7a0-3897750957ba'} Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:04.942500 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:04.947385 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:04.947385 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:04.947385 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:04.947385 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:02:04.947385 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:02:04.947385 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. Aug 03 02:02:04.947385 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:04.959880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fd8915c8-17c2-4500-9250-ff85d3355654 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:02:04.961069 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fd8915c8-17c2-4500-9250-ff85d3355654 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 404 len: 111 microversion: 2.1 time: 0.134179 Aug 03 02:02:04.964132 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1502/3054] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:04 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:02:04.985737 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-91b4dfa1-52e6-41fd-acc4-35b6d2847269 tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.008194 Aug 03 02:02:04.986779 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1503/3055] 10.222.0.67 () {58 vars in 1164 bytes} [Wed Aug 3 02:02:04 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 02:02:05.007243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b01035b5-7d2a-4ebb-a796-99443992e18c tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Calling method '.version_select at 0x7f5b13129280>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:05.346731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3a3eb12d-7f20-477f-9af5-aa503f025d0c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:05.381061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3a3eb12d-7f20-477f-9af5-aa503f025d0c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:05.391486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3a3eb12d-7f20-477f-9af5-aa503f025d0c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:05.393449 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3a3eb12d-7f20-477f-9af5-aa503f025d0c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 0.705528 Aug 03 02:02:05.399546 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1553/3056] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:02:04 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:02:05.422462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1934367304", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "cf1e5fc2-66a4-4802-965c-545f628b0c29"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:05.444395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:05.503316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] validate_networks() for [('cf1e5fc2-66a4-4802-965c-545f628b0c29', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:02:05.944229 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b01035b5-7d2a-4ebb-a796-99443992e18c tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.946597 Aug 03 02:02:05.945462 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1504/3057] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 02:02:04 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:05.961790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-b4a806d9-2bc9-4154-b188-3aa7eee68436 req-31a0cc30-3c97-4c28-a912-a1125d635134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7d0db2-f64d-4df7-b0dd-2ecf688290b0", "name": "network-vif-plugged", "status": "completed", "tag": "1b653dfb-172c-43c5-8d81-55e28541d60d"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:06.001979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b4a806d9-2bc9-4154-b188-3aa7eee68436 req-31a0cc30-3c97-4c28-a912-a1125d635134 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:06.006809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b4a806d9-2bc9-4154-b188-3aa7eee68436 req-31a0cc30-3c97-4c28-a912-a1125d635134 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:06.038976 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-b4a806d9-2bc9-4154-b188-3aa7eee68436 req-31a0cc30-3c97-4c28-a912-a1125d635134 service nova] Creating event network-vif-plugged:1b653dfb-172c-43c5-8d81-55e28541d60d for instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 on n-h1-826529-8 Aug 03 02:02:06.055253 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-b4a806d9-2bc9-4154-b188-3aa7eee68436 req-31a0cc30-3c97-4c28-a912-a1125d635134 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105916 Aug 03 02:02:06.057230 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1505/3058] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:06.072868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5352eb26-a36e-46c5-b56d-aee5c4e7b8f6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:06.076775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5352eb26-a36e-46c5-b56d-aee5c4e7b8f6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:06.124320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5352eb26-a36e-46c5-b56d-aee5c4e7b8f6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:06.125566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5352eb26-a36e-46c5-b56d-aee5c4e7b8f6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:06.126600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5352eb26-a36e-46c5-b56d-aee5c4e7b8f6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:06.127418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5352eb26-a36e-46c5-b56d-aee5c4e7b8f6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:06.490412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5352eb26-a36e-46c5-b56d-aee5c4e7b8f6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:06.520862 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5352eb26-a36e-46c5-b56d-aee5c4e7b8f6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1316 microversion: 2.1 time: 0.456990 Aug 03 02:02:06.523756 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1506/3059] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:06 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:06.548997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-08935653-9f8c-4b92-84fc-8eda1cde1d20 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:06.554434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-08935653-9f8c-4b92-84fc-8eda1cde1d20 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:06.570024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08935653-9f8c-4b92-84fc-8eda1cde1d20 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:06.570939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08935653-9f8c-4b92-84fc-8eda1cde1d20 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:06.572717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08935653-9f8c-4b92-84fc-8eda1cde1d20 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:06.573877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08935653-9f8c-4b92-84fc-8eda1cde1d20 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:06.652654 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-08935653-9f8c-4b92-84fc-8eda1cde1d20 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.126653 Aug 03 02:02:06.657762 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1507/3060] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:02:06 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:02:06.673755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4d1fc3f9-7190-4154-9c8a-038edbc3147c tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Calling method '.version_select at 0x7f5b1317e700>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:06.796740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:02:06.797461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:02:06.798436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:02:06.798681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:02:06.799741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:02:06.847633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:06.851074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:06.853496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:06.855875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:06.937751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Getting quotas for project 01f1d9f8216e4f729a5e24aad713fe98. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:02:06.951667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Getting quotas for user 0dc56b77862f410d82c8617f3d679775 and project 01f1d9f8216e4f729a5e24aad713fe98. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:02:06.990535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:02:06.999667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:02:07.090159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG neutronclient.v2_0.client [None req-4d1fc3f9-7190-4154-9c8a-038edbc3147c tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=125942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 02:02:07.093798 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-4d1fc3f9-7190-4154-9c8a-038edbc3147c tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 03 02:02:07.093798 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-ffb38542-2ccd-41d6-8697-153eba598724'] Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4d1fc3f9-7190-4154-9c8a-038edbc3147c tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Request method failure captured: Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/os-security-groups/95dd8aed-9f32-4a66-8004-450c06ca1f71 HTTP/1.1 Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dcbRUZIZHIlm6nlFVe-d1ZZm8zpXNij7aLEcP1YwuT2BesbZV388mhSqE2eO0ioFopM3LaGvbSrzuTBpULYbzDC7JAMMunH0nTDAYRKyWmr6A7epw_SeGqyfGk1WklrNQEBo-uoiqP5tSbM3qL4A3vJ8Z9C1xMH8SomjLQd6Dr66Hk Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 3ff0ed39cbd84e44817a52746dd76013 Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1895184673 Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3ff0ed39cbd84e44817a52746dd76013", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3ff0ed39cbd84e44817a52746dd76013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3ff0ed39cbd84e44817a52746dd76013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3ff0ed39cbd84e44817a52746dd76013"}]}] Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1895184673 Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 3ff0ed39cbd84e44817a52746dd76013 Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1895184673 Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-SecurityGroupsNegativeTestJSON-1895184673-project Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 432046b0cc1d4493a99cd2582790ff4e Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1895184673-project Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: exception: Insufficient rights for removing default security group. Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-ffb38542-2ccd-41d6-8697-153eba598724'] Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '95dd8aed-9f32-4a66-8004-450c06ca1f71'} Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 02:02:07.096238 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ffb38542-2ccd-41d6-8697-153eba598724'] Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ffb38542-2ccd-41d6-8697-153eba598724'] Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ffb38542-2ccd-41d6-8697-153eba598724'] Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ffb38542-2ccd-41d6-8697-153eba598724'] Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4d1fc3f9-7190-4154-9c8a-038edbc3147c tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-ffb38542-2ccd-41d6-8697-153eba598724'] {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4d1fc3f9-7190-4154-9c8a-038edbc3147c tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/95dd8aed-9f32-4a66-8004-450c06ca1f71" status: 400 len: 182 microversion: 2.1 time: 0.437860 Aug 03 02:02:07.100777 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1508/3061] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 02:02:06 2022] DELETE /compute/v2.1/os-security-groups/95dd8aed-9f32-4a66-8004-450c06ca1f71 => generated 182 bytes in 440 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:02:07.131790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6eb2edca-eb08-4d62-9180-db4ae7b52097 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:07.133740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6eb2edca-eb08-4d62-9180-db4ae7b52097 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:07.161718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6eb2edca-eb08-4d62-9180-db4ae7b52097 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:07.176882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6eb2edca-eb08-4d62-9180-db4ae7b52097 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:07.178747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6eb2edca-eb08-4d62-9180-db4ae7b52097 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:07.182822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6eb2edca-eb08-4d62-9180-db4ae7b52097 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:07.191235 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a7524067-c545-4e94-bd4a-9b46a9b73a39 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.789990 Aug 03 02:02:07.198415 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1554/3062] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:02:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:02:07.219684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a2386e96-9884-43ca-87ea-543d3f65093a req-81d0e01d-a4e5-4e79-87ba-9779c6ec85b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a64bad3c-11b7-4854-b7ac-77b18e53f597", "tag": "5c7de705-6f07-4663-9068-afd2ff1326cb"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:07.239469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a2386e96-9884-43ca-87ea-543d3f65093a req-81d0e01d-a4e5-4e79-87ba-9779c6ec85b9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:07.240262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a2386e96-9884-43ca-87ea-543d3f65093a req-81d0e01d-a4e5-4e79-87ba-9779c6ec85b9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:07.274597 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a2386e96-9884-43ca-87ea-543d3f65093a req-81d0e01d-a4e5-4e79-87ba-9779c6ec85b9 service nova] Creating event network-changed:5c7de705-6f07-4663-9068-afd2ff1326cb for instance a64bad3c-11b7-4854-b7ac-77b18e53f597 on n-h1-826529-8 Aug 03 02:02:07.313268 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a2386e96-9884-43ca-87ea-543d3f65093a req-81d0e01d-a4e5-4e79-87ba-9779c6ec85b9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111655 Aug 03 02:02:07.315583 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1555/3063] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:07.332381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1bc6b70b-5726-4899-8b4c-fa0bb25151f8 tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Calling method '.version_select at 0x7f5b124dd670>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:07.432010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG neutronclient.v2_0.client [None req-1bc6b70b-5726-4899-8b4c-fa0bb25151f8 tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5089c3f2-789b-47cd-93e2-e8e0b33df4e0 does not exist", "detail": ""}} {{(pid=125941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 02:02:07.433024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.security_group_api [None req-1bc6b70b-5726-4899-8b4c-fa0bb25151f8 tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Neutron security group 5089c3f2-789b-47cd-93e2-e8e0b33df4e0 not found {{(pid=125941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 02:02:07.433918 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-1bc6b70b-5726-4899-8b4c-fa0bb25151f8 tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] HTTP exception thrown: Security group 5089c3f2-789b-47cd-93e2-e8e0b33df4e0 does not exist Aug 03 02:02:07.433918 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-bed2e9ae-0460-45ea-9ec7-1a332f129105'] Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1bc6b70b-5726-4899-8b4c-fa0bb25151f8 tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Request method failure captured: Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-security-groups/5089c3f2-789b-47cd-93e2-e8e0b33df4e0 HTTP/1.1 Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dcbRUZIZHIlm6nlFVe-d1ZZm8zpXNij7aLEcP1YwuT2BesbZV388mhSqE2eO0ioFopM3LaGvbSrzuTBpULYbzDC7JAMMunH0nTDAYRKyWmr6A7epw_SeGqyfGk1WklrNQEBo-uoiqP5tSbM3qL4A3vJ8Z9C1xMH8SomjLQd6Dr66Hk Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 3ff0ed39cbd84e44817a52746dd76013 Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1895184673 Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3ff0ed39cbd84e44817a52746dd76013", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3ff0ed39cbd84e44817a52746dd76013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3ff0ed39cbd84e44817a52746dd76013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3ff0ed39cbd84e44817a52746dd76013"}]}] Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1895184673 Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 3ff0ed39cbd84e44817a52746dd76013 Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1895184673 Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-SecurityGroupsNegativeTestJSON-1895184673-project Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 432046b0cc1d4493a99cd2582790ff4e Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1895184673-project Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: exception: Security group 5089c3f2-789b-47cd-93e2-e8e0b33df4e0 does not exist Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-bed2e9ae-0460-45ea-9ec7-1a332f129105'] Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '5089c3f2-789b-47cd-93e2-e8e0b33df4e0'} Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 02:02:07.439437 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5089c3f2-789b-47cd-93e2-e8e0b33df4e0 does not exist Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bed2e9ae-0460-45ea-9ec7-1a332f129105'] Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5089c3f2-789b-47cd-93e2-e8e0b33df4e0 does not exist Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bed2e9ae-0460-45ea-9ec7-1a332f129105'] Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5089c3f2-789b-47cd-93e2-e8e0b33df4e0 does not exist Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bed2e9ae-0460-45ea-9ec7-1a332f129105'] Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5089c3f2-789b-47cd-93e2-e8e0b33df4e0 does not exist Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bed2e9ae-0460-45ea-9ec7-1a332f129105'] Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1bc6b70b-5726-4899-8b4c-fa0bb25151f8 tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Returning 404 to user: Security group 5089c3f2-789b-47cd-93e2-e8e0b33df4e0 does not exist Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: Neutron server returns request_ids: ['req-bed2e9ae-0460-45ea-9ec7-1a332f129105'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1bc6b70b-5726-4899-8b4c-fa0bb25151f8 tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] 10.222.0.67 "GET /compute/v2.1/os-security-groups/5089c3f2-789b-47cd-93e2-e8e0b33df4e0" status: 404 len: 194 microversion: 2.1 time: 0.120964 Aug 03 02:02:07.443642 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1556/3064] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 02:02:07 2022] GET /compute/v2.1/os-security-groups/5089c3f2-789b-47cd-93e2-e8e0b33df4e0 => generated 194 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:02:07.475585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1809734914", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "f4565ac3-4eed-4500-a57f-9610c234fecc"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:07.642582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] validate_networks() for [('f4565ac3-4eed-4500-a57f-9610c234fecc', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:02:07.785733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6eb2edca-eb08-4d62-9180-db4ae7b52097 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:07.818802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6eb2edca-eb08-4d62-9180-db4ae7b52097 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:07.863206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6eb2edca-eb08-4d62-9180-db4ae7b52097 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:07.877858 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6eb2edca-eb08-4d62-9180-db4ae7b52097 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 0.778156 Aug 03 02:02:07.878466 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1509/3065] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:02:07 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:02:07.897621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-478152f7-a21e-4016-b6bb-8aea898690f5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:07.898391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-478152f7-a21e-4016-b6bb-8aea898690f5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:08.136925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-478152f7-a21e-4016-b6bb-8aea898690f5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:08.149903 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-478152f7-a21e-4016-b6bb-8aea898690f5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1215 microversion: 2.1 time: 0.265478 Aug 03 02:02:08.154543 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1510/3066] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:07 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1215 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:08.169157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ff46258-cfd3-42cf-99d6-a3d7c18fda2a tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Action: 'update', calling method: .version_select at 0x7f5b136d91f0>, body: {"security_group": {"name": "tempest-sg-452554842", "description": "tempest-description-70702183"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:08.289554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG neutronclient.v2_0.client [None req-2ff46258-cfd3-42cf-99d6-a3d7c18fda2a tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 91a893f1-9e78-4262-8b82-8e326e28b0cb does not exist", "detail": ""}} {{(pid=125942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 02:02:08.290337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.security_group_api [None req-2ff46258-cfd3-42cf-99d6-a3d7c18fda2a tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Neutron security group 91a893f1-9e78-4262-8b82-8e326e28b0cb not found {{(pid=125942) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 02:02:08.290933 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-2ff46258-cfd3-42cf-99d6-a3d7c18fda2a tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] HTTP exception thrown: Security group 91a893f1-9e78-4262-8b82-8e326e28b0cb does not exist Aug 03 02:02:08.290933 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-a94291d9-56d6-4742-ae40-1f2f988dec26'] Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ff46258-cfd3-42cf-99d6-a3d7c18fda2a tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Request method failure captured: Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: request: PUT /compute/v2.1/os-security-groups/91a893f1-9e78-4262-8b82-8e326e28b0cb HTTP/1.1 Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 99 Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dcbRUZIZHIlm6nlFVe-d1ZZm8zpXNij7aLEcP1YwuT2BesbZV388mhSqE2eO0ioFopM3LaGvbSrzuTBpULYbzDC7JAMMunH0nTDAYRKyWmr6A7epw_SeGqyfGk1WklrNQEBo-uoiqP5tSbM3qL4A3vJ8Z9C1xMH8SomjLQd6Dr66Hk Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 3ff0ed39cbd84e44817a52746dd76013 Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1895184673 Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3ff0ed39cbd84e44817a52746dd76013", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3ff0ed39cbd84e44817a52746dd76013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3ff0ed39cbd84e44817a52746dd76013"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3ff0ed39cbd84e44817a52746dd76013"}]}] Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1895184673 Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 3ff0ed39cbd84e44817a52746dd76013 Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1895184673 Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-SecurityGroupsNegativeTestJSON-1895184673-project Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 432046b0cc1d4493a99cd2582790ff4e Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1895184673-project Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: {"security_group": {"name": "tempest-sg-452554842", "description": "tempest-description-70702183"}} Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: exception: Security group 91a893f1-9e78-4262-8b82-8e326e28b0cb does not exist Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-a94291d9-56d6-4742-ae40-1f2f988dec26'] Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '91a893f1-9e78-4262-8b82-8e326e28b0cb', 'body': {'security_group': {'name': 'tempest-sg-452554842', 'description': 'tempest-description-70702183'}}} Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 02:02:08.292829 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 91a893f1-9e78-4262-8b82-8e326e28b0cb does not exist Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a94291d9-56d6-4742-ae40-1f2f988dec26'] Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 91a893f1-9e78-4262-8b82-8e326e28b0cb does not exist Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a94291d9-56d6-4742-ae40-1f2f988dec26'] Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 91a893f1-9e78-4262-8b82-8e326e28b0cb does not exist Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a94291d9-56d6-4742-ae40-1f2f988dec26'] Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 91a893f1-9e78-4262-8b82-8e326e28b0cb does not exist Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a94291d9-56d6-4742-ae40-1f2f988dec26'] Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ff46258-cfd3-42cf-99d6-a3d7c18fda2a tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] Returning 404 to user: Security group 91a893f1-9e78-4262-8b82-8e326e28b0cb does not exist Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: Neutron server returns request_ids: ['req-a94291d9-56d6-4742-ae40-1f2f988dec26'] {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2ff46258-cfd3-42cf-99d6-a3d7c18fda2a tempest-SecurityGroupsNegativeTestJSON-1895184673 tempest-SecurityGroupsNegativeTestJSON-1895184673-project] 10.222.0.67 "PUT /compute/v2.1/os-security-groups/91a893f1-9e78-4262-8b82-8e326e28b0cb" status: 404 len: 194 microversion: 2.1 time: 0.136944 Aug 03 02:02:08.303398 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1511/3067] 10.222.0.67 () {60 vars in 1289 bytes} [Wed Aug 3 02:02:08 2022] PUT /compute/v2.1/os-security-groups/91a893f1-9e78-4262-8b82-8e326e28b0cb => generated 194 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:02:08.329439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9ff95b0d-9186-4d51-8fc4-09524e3ca051 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:08.330125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9ff95b0d-9186-4d51-8fc4-09524e3ca051 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:08.375720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9ff95b0d-9186-4d51-8fc4-09524e3ca051 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:08.376179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9ff95b0d-9186-4d51-8fc4-09524e3ca051 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:08.376995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9ff95b0d-9186-4d51-8fc4-09524e3ca051 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:08.377438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9ff95b0d-9186-4d51-8fc4-09524e3ca051 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:08.768384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:02:08.769088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:02:08.769293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:02:08.769702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:02:08.770376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:02:08.772339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9ff95b0d-9186-4d51-8fc4-09524e3ca051 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:08.787700 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9ff95b0d-9186-4d51-8fc4-09524e3ca051 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1316 microversion: 2.1 time: 0.477715 Aug 03 02:02:08.789772 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1512/3068] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:08 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:08.811486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:08.812676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:08.816083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:08.829105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:08.907559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bd03359d-cd52-4594-aa98-c33fa9064ec5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:08.908194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bd03359d-cd52-4594-aa98-c33fa9064ec5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:08.918536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd03359d-cd52-4594-aa98-c33fa9064ec5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:08.921141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd03359d-cd52-4594-aa98-c33fa9064ec5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:08.922221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd03359d-cd52-4594-aa98-c33fa9064ec5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:08.926523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd03359d-cd52-4594-aa98-c33fa9064ec5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:08.955812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Getting quotas for project e8dc5a1c3fbd4cad8b0f2045bb872b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:02:08.968628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Getting quotas for user f009ea44cc4a4c37a236b93a2c5a9028 and project e8dc5a1c3fbd4cad8b0f2045bb872b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:02:08.993128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:02:08.997050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:02:09.156021 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-596933d1-be59-4904-afa8-3c4be5c95285 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.711239 Aug 03 02:02:09.157297 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1557/3069] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:02:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:02:09.175815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2cd7c363-22dd-4fce-af88-c890cbbcfe54 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:09.176443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2cd7c363-22dd-4fce-af88-c890cbbcfe54 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:09.178559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:09.391336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2cd7c363-22dd-4fce-af88-c890cbbcfe54 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:09.413548 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2cd7c363-22dd-4fce-af88-c890cbbcfe54 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1218 microversion: 2.1 time: 0.240928 Aug 03 02:02:09.422479 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1558/3070] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:09 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1218 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:09.442600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7be2b812-cd26-4252-97fa-52b0f4afc5d7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:09.449349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7be2b812-cd26-4252-97fa-52b0f4afc5d7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:09.469752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7be2b812-cd26-4252-97fa-52b0f4afc5d7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:09.472474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7be2b812-cd26-4252-97fa-52b0f4afc5d7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:09.473476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7be2b812-cd26-4252-97fa-52b0f4afc5d7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:09.473748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7be2b812-cd26-4252-97fa-52b0f4afc5d7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:09.763960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7be2b812-cd26-4252-97fa-52b0f4afc5d7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:09.784075 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7be2b812-cd26-4252-97fa-52b0f4afc5d7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1267 microversion: 2.1 time: 0.357789 Aug 03 02:02:09.785015 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1559/3071] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:09 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1267 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:09.794001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bd03359d-cd52-4594-aa98-c33fa9064ec5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:09.813385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ebd10c6d-a5a2-4e30-bcae-09789d5df847 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:09.823099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bd03359d-cd52-4594-aa98-c33fa9064ec5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:09.824650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ebd10c6d-a5a2-4e30-bcae-09789d5df847 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:09.831053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bd03359d-cd52-4594-aa98-c33fa9064ec5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:09.836538 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bd03359d-cd52-4594-aa98-c33fa9064ec5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1808 microversion: 2.20 time: 0.934451 Aug 03 02:02:09.838013 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1513/3072] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:02:08 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1808 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:02:09.849646 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebd10c6d-a5a2-4e30-bcae-09789d5df847 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:09.852266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebd10c6d-a5a2-4e30-bcae-09789d5df847 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:09.863584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebd10c6d-a5a2-4e30-bcae-09789d5df847 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:09.864145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebd10c6d-a5a2-4e30-bcae-09789d5df847 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:10.370756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ebd10c6d-a5a2-4e30-bcae-09789d5df847 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:10.388003 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ebd10c6d-a5a2-4e30-bcae-09789d5df847 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1316 microversion: 2.1 time: 0.575466 Aug 03 02:02:10.392068 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1560/3073] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:09 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1316 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:10.459658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-451868a6-5235-4b81-a059-7e97f031ef63 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:10.461160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-451868a6-5235-4b81-a059-7e97f031ef63 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:10.488349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-451868a6-5235-4b81-a059-7e97f031ef63 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:10.489647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-451868a6-5235-4b81-a059-7e97f031ef63 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:10.491800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-451868a6-5235-4b81-a059-7e97f031ef63 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:10.493491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-451868a6-5235-4b81-a059-7e97f031ef63 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:10.640674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-451868a6-5235-4b81-a059-7e97f031ef63 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:10.655537 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-451868a6-5235-4b81-a059-7e97f031ef63 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1214 microversion: 2.1 time: 0.199083 Aug 03 02:02:10.657331 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1514/3074] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:10 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:10.808404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a9559ad8-17f1-40df-82a7-afb337871e7e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:10.809110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a9559ad8-17f1-40df-82a7-afb337871e7e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:10.822513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9559ad8-17f1-40df-82a7-afb337871e7e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:10.823608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9559ad8-17f1-40df-82a7-afb337871e7e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:10.825119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9559ad8-17f1-40df-82a7-afb337871e7e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:10.826404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9559ad8-17f1-40df-82a7-afb337871e7e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:10.881855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-59c17ea1-f705-4ac1-8d91-33058d1eb59f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:10.884811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-59c17ea1-f705-4ac1-8d91-33058d1eb59f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:10.895041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59c17ea1-f705-4ac1-8d91-33058d1eb59f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:10.895428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59c17ea1-f705-4ac1-8d91-33058d1eb59f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:10.896427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59c17ea1-f705-4ac1-8d91-33058d1eb59f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:10.896869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59c17ea1-f705-4ac1-8d91-33058d1eb59f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:10.900423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:10.941649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a9559ad8-17f1-40df-82a7-afb337871e7e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:10.952637 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a9559ad8-17f1-40df-82a7-afb337871e7e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1273 microversion: 2.1 time: 0.147718 Aug 03 02:02:10.963395 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1561/3075] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:10 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:11.182192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-59c17ea1-f705-4ac1-8d91-33058d1eb59f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:11.208770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-59c17ea1-f705-4ac1-8d91-33058d1eb59f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:11.212968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-59c17ea1-f705-4ac1-8d91-33058d1eb59f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:11.218183 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-59c17ea1-f705-4ac1-8d91-33058d1eb59f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1795 microversion: 2.20 time: 0.351881 Aug 03 02:02:11.222425 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1515/3076] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:02:10 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1795 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:02:11.413967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c9d0d8d1-4483-4535-a22f-165548b67962 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:11.414928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c9d0d8d1-4483-4535-a22f-165548b67962 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:11.425840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9d0d8d1-4483-4535-a22f-165548b67962 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:11.426694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9d0d8d1-4483-4535-a22f-165548b67962 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:11.427934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9d0d8d1-4483-4535-a22f-165548b67962 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:11.428571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9d0d8d1-4483-4535-a22f-165548b67962 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:11.680697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ffac9b9-e62c-4533-a672-f0dd16af5c0a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:11.682265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2ffac9b9-e62c-4533-a672-f0dd16af5c0a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:11.703145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ffac9b9-e62c-4533-a672-f0dd16af5c0a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:11.704315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ffac9b9-e62c-4533-a672-f0dd16af5c0a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:11.706734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ffac9b9-e62c-4533-a672-f0dd16af5c0a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:11.708126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ffac9b9-e62c-4533-a672-f0dd16af5c0a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:11.840488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c9d0d8d1-4483-4535-a22f-165548b67962 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:11.854790 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c9d0d8d1-4483-4535-a22f-165548b67962 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1316 microversion: 2.1 time: 0.444361 Aug 03 02:02:11.856100 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1562/3077] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:11 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:11.932461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2ffac9b9-e62c-4533-a672-f0dd16af5c0a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:11.952268 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2ffac9b9-e62c-4533-a672-f0dd16af5c0a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1276 microversion: 2.1 time: 0.276506 Aug 03 02:02:11.953034 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1516/3078] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:11 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1276 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:11.979111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bfcc2e48-c8d6-4870-8671-a8f59db5d10f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:11.979745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bfcc2e48-c8d6-4870-8671-a8f59db5d10f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:11.995877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfcc2e48-c8d6-4870-8671-a8f59db5d10f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:11.996340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfcc2e48-c8d6-4870-8671-a8f59db5d10f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:12.003625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfcc2e48-c8d6-4870-8671-a8f59db5d10f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:12.006439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfcc2e48-c8d6-4870-8671-a8f59db5d10f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:12.143910 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bfcc2e48-c8d6-4870-8671-a8f59db5d10f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:12.167806 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bfcc2e48-c8d6-4870-8671-a8f59db5d10f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1273 microversion: 2.1 time: 0.193251 Aug 03 02:02:12.168432 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1563/3079] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:11 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:12.883296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3400d7d1-0576-41d3-8c28-a956cdd2d3fb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:12.883929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3400d7d1-0576-41d3-8c28-a956cdd2d3fb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:12.906236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3400d7d1-0576-41d3-8c28-a956cdd2d3fb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:12.907050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3400d7d1-0576-41d3-8c28-a956cdd2d3fb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:12.908462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3400d7d1-0576-41d3-8c28-a956cdd2d3fb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:12.909256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3400d7d1-0576-41d3-8c28-a956cdd2d3fb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:12.978852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5b86a30b-fbc0-4fed-b5a2-11b783e783aa tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:12.979967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5b86a30b-fbc0-4fed-b5a2-11b783e783aa tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:13.019363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b86a30b-fbc0-4fed-b5a2-11b783e783aa tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:13.020149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b86a30b-fbc0-4fed-b5a2-11b783e783aa tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:13.025602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b86a30b-fbc0-4fed-b5a2-11b783e783aa tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:13.029717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b86a30b-fbc0-4fed-b5a2-11b783e783aa tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:13.564758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5b86a30b-fbc0-4fed-b5a2-11b783e783aa tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:13.599580 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5b86a30b-fbc0-4fed-b5a2-11b783e783aa tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1318 microversion: 2.1 time: 0.628499 Aug 03 02:02:13.615700 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1564/3080] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:12 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1318 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:13.629688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d851e4d4-994e-4869-9a36-ac1ff1158444 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:13.630520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d851e4d4-994e-4869-9a36-ac1ff1158444 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:13.641805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d851e4d4-994e-4869-9a36-ac1ff1158444 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:13.642523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d851e4d4-994e-4869-9a36-ac1ff1158444 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:13.643727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d851e4d4-994e-4869-9a36-ac1ff1158444 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:13.644403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d851e4d4-994e-4869-9a36-ac1ff1158444 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:13.692882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3400d7d1-0576-41d3-8c28-a956cdd2d3fb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:13.707003 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3400d7d1-0576-41d3-8c28-a956cdd2d3fb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1316 microversion: 2.1 time: 0.828387 Aug 03 02:02:13.712271 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1517/3081] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:12 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1316 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:14.455462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2eb58389-d189-4aff-b55a-6bb3de25c55b tempest-ComputeTenantNetworksTest-1498435998 tempest-ComputeTenantNetworksTest-1498435998-project] Calling method '.version_select at 0x7f5b1306b3a0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:14.508769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d851e4d4-994e-4869-9a36-ac1ff1158444 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:14.565217 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d851e4d4-994e-4869-9a36-ac1ff1158444 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1315 microversion: 2.1 time: 0.942817 Aug 03 02:02:14.569124 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1565/3082] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:13 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1315 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:14.586972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-1b0ab259-93ac-4dd3-b974-0390d604c1cf req-45a4b6bf-6435-4053-909e-ef3a0cdfdbcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a64bad3c-11b7-4854-b7ac-77b18e53f597", "name": "network-vif-plugged", "status": "completed", "tag": "5c7de705-6f07-4663-9068-afd2ff1326cb"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:14.625432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1b0ab259-93ac-4dd3-b974-0390d604c1cf req-45a4b6bf-6435-4053-909e-ef3a0cdfdbcc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:14.626738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1b0ab259-93ac-4dd3-b974-0390d604c1cf req-45a4b6bf-6435-4053-909e-ef3a0cdfdbcc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:14.684969 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-1b0ab259-93ac-4dd3-b974-0390d604c1cf req-45a4b6bf-6435-4053-909e-ef3a0cdfdbcc service nova] Creating event network-vif-plugged:5c7de705-6f07-4663-9068-afd2ff1326cb for instance a64bad3c-11b7-4854-b7ac-77b18e53f597 on n-h1-826529-8 Aug 03 02:02:14.703568 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-1b0ab259-93ac-4dd3-b974-0390d604c1cf req-45a4b6bf-6435-4053-909e-ef3a0cdfdbcc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132404 Aug 03 02:02:14.705337 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1566/3083] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:14.735594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-54070cce-e2f6-4085-87df-d7d8b0470b9a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:14.737558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-54070cce-e2f6-4085-87df-d7d8b0470b9a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:14.775368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54070cce-e2f6-4085-87df-d7d8b0470b9a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:14.776305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54070cce-e2f6-4085-87df-d7d8b0470b9a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:14.777425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54070cce-e2f6-4085-87df-d7d8b0470b9a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:14.780499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54070cce-e2f6-4085-87df-d7d8b0470b9a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:15.028105 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2eb58389-d189-4aff-b55a-6bb3de25c55b tempest-ComputeTenantNetworksTest-1498435998 tempest-ComputeTenantNetworksTest-1498435998-project] 10.222.0.67 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.829882 Aug 03 02:02:15.031322 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1518/3084] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 02:02:14 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:02:15.062793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e80afb29-8607-447f-8df9-f93ee32e9bb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:15.071476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e80afb29-8607-447f-8df9-f93ee32e9bb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:15.095305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e80afb29-8607-447f-8df9-f93ee32e9bb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:15.096713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-54070cce-e2f6-4085-87df-d7d8b0470b9a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:15.097120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e80afb29-8607-447f-8df9-f93ee32e9bb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:15.098215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e80afb29-8607-447f-8df9-f93ee32e9bb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:15.099541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e80afb29-8607-447f-8df9-f93ee32e9bb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:15.117797 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-54070cce-e2f6-4085-87df-d7d8b0470b9a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1318 microversion: 2.1 time: 0.410789 Aug 03 02:02:15.118775 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1567/3085] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:14 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:15.126417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dd80b6e5-cfd8-4317-aa3b-83069140624e tempest-ComputeTenantNetworksTest-1498435998 tempest-ComputeTenantNetworksTest-1498435998-project] Calling method '.version_select at 0x7f5b12480b80>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:15.804661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e80afb29-8607-447f-8df9-f93ee32e9bb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:15.819256 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dd80b6e5-cfd8-4317-aa3b-83069140624e tempest-ComputeTenantNetworksTest-1498435998 tempest-ComputeTenantNetworksTest-1498435998-project] 10.222.0.67 "GET /compute/v2.1/os-tenant-networks/fbe92d6f-4372-4db0-9e1c-82a5d880fb78" status: 200 len: 140 microversion: 2.1 time: 0.696895 Aug 03 02:02:15.831656 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1568/3086] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 02:02:15 2022] GET /compute/v2.1/os-tenant-networks/fbe92d6f-4372-4db0-9e1c-82a5d880fb78 => generated 140 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:15.844004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-d2521238-8551-45ec-be33-0ec119c18938 req-b6547d5a-178f-4078-9a26-c82032c300a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca5751e-57cb-49b2-982e-0201e2a94ffe", "tag": "c7bcefb8-692d-4f3f-a81c-d005d80524f4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:15.859711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d2521238-8551-45ec-be33-0ec119c18938 req-b6547d5a-178f-4078-9a26-c82032c300a8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:15.860644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d2521238-8551-45ec-be33-0ec119c18938 req-b6547d5a-178f-4078-9a26-c82032c300a8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:15.877567 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-d2521238-8551-45ec-be33-0ec119c18938 req-b6547d5a-178f-4078-9a26-c82032c300a8 service nova] Creating event network-changed:c7bcefb8-692d-4f3f-a81c-d005d80524f4 for instance cca5751e-57cb-49b2-982e-0201e2a94ffe on n-h1-826529-8 Aug 03 02:02:15.879467 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e80afb29-8607-447f-8df9-f93ee32e9bb3 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1316 microversion: 2.1 time: 0.844943 Aug 03 02:02:15.883936 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-d2521238-8551-45ec-be33-0ec119c18938 req-b6547d5a-178f-4078-9a26-c82032c300a8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049326 Aug 03 02:02:15.884775 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1569/3087] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:15.892779 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1519/3088] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:15 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1316 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:15.893661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-52d7ccb8-ef18-4f91-a756-e9ab638a9351 req-56b2e9e4-470f-4110-9cd9-954ffc490ead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91646d0d-7cde-4a99-9ffc-d4281bc31566", "tag": "73a006d2-6970-4db7-af83-88559a774ddb"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:15.906270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-52d7ccb8-ef18-4f91-a756-e9ab638a9351 req-56b2e9e4-470f-4110-9cd9-954ffc490ead service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:15.907161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-52d7ccb8-ef18-4f91-a756-e9ab638a9351 req-56b2e9e4-470f-4110-9cd9-954ffc490ead service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:15.908464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b2e0eff7-ca10-4a88-a52c-05b8e576ca04 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:15.910539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b2e0eff7-ca10-4a88-a52c-05b8e576ca04 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:15.928967 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-52d7ccb8-ef18-4f91-a756-e9ab638a9351 req-56b2e9e4-470f-4110-9cd9-954ffc490ead service nova] Creating event network-changed:73a006d2-6970-4db7-af83-88559a774ddb for instance 91646d0d-7cde-4a99-9ffc-d4281bc31566 on n-h2-826529-8 Aug 03 02:02:15.934381 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-52d7ccb8-ef18-4f91-a756-e9ab638a9351 req-56b2e9e4-470f-4110-9cd9-954ffc490ead service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047534 Aug 03 02:02:15.936349 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1570/3089] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:15.937097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2e0eff7-ca10-4a88-a52c-05b8e576ca04 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:15.943174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2e0eff7-ca10-4a88-a52c-05b8e576ca04 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:15.944542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2e0eff7-ca10-4a88-a52c-05b8e576ca04 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:15.945249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2e0eff7-ca10-4a88-a52c-05b8e576ca04 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:16.150185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9e2e0911-7b40-44a2-a3da-d29543a4665a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:16.151031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9e2e0911-7b40-44a2-a3da-d29543a4665a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:16.160868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e2e0911-7b40-44a2-a3da-d29543a4665a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:16.161340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e2e0911-7b40-44a2-a3da-d29543a4665a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:16.162304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e2e0911-7b40-44a2-a3da-d29543a4665a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:16.163400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e2e0911-7b40-44a2-a3da-d29543a4665a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:16.641319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b2e0eff7-ca10-4a88-a52c-05b8e576ca04 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:16.649575 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b2e0eff7-ca10-4a88-a52c-05b8e576ca04 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1315 microversion: 2.1 time: 0.748963 Aug 03 02:02:16.650403 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1520/3090] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:15 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1315 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:16.743801 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9e2e0911-7b40-44a2-a3da-d29543a4665a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:16.755311 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9e2e0911-7b40-44a2-a3da-d29543a4665a tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1318 microversion: 2.1 time: 0.614650 Aug 03 02:02:16.761543 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1571/3091] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:16 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1318 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:16.905286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1f637bdd-dfa8-40b3-8971-2dc01e37d426 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:16.906111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1f637bdd-dfa8-40b3-8971-2dc01e37d426 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:16.913331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f637bdd-dfa8-40b3-8971-2dc01e37d426 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:16.913875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f637bdd-dfa8-40b3-8971-2dc01e37d426 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:16.914775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f637bdd-dfa8-40b3-8971-2dc01e37d426 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:16.915318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f637bdd-dfa8-40b3-8971-2dc01e37d426 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:17.223498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1f637bdd-dfa8-40b3-8971-2dc01e37d426 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:17.233921 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1f637bdd-dfa8-40b3-8971-2dc01e37d426 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1465 microversion: 2.1 time: 0.332743 Aug 03 02:02:17.240059 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1521/3092] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:16 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1465 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:17.256162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d7a219a4-3284-48f9-88c6-476a37d3aaf3 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:17.257439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d7a219a4-3284-48f9-88c6-476a37d3aaf3 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:17.265207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d7a219a4-3284-48f9-88c6-476a37d3aaf3 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:17.265890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d7a219a4-3284-48f9-88c6-476a37d3aaf3 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:17.266685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d7a219a4-3284-48f9-88c6-476a37d3aaf3 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:17.267330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d7a219a4-3284-48f9-88c6-476a37d3aaf3 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:17.571304 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d7a219a4-3284-48f9-88c6-476a37d3aaf3 tempest-ServersOnMultiNodesTest-1724872188 tempest-ServersOnMultiNodesTest-1724872188-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1616 microversion: 2.1 time: 0.318090 Aug 03 02:02:17.573520 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1572/3093] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:17 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1616 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:17.596868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fbba031a-5376-48d7-94c2-775bdc8ef5b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:17.597419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fbba031a-5376-48d7-94c2-775bdc8ef5b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:17.606396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbba031a-5376-48d7-94c2-775bdc8ef5b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:17.606923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbba031a-5376-48d7-94c2-775bdc8ef5b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:17.607997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbba031a-5376-48d7-94c2-775bdc8ef5b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:17.608651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbba031a-5376-48d7-94c2-775bdc8ef5b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:17.670354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fbba031a-5376-48d7-94c2-775bdc8ef5b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:02:17.676169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d05ff79-454a-4857-852c-9243c481e62a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:17.677073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6d05ff79-454a-4857-852c-9243c481e62a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:17.689617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d05ff79-454a-4857-852c-9243c481e62a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:17.691665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d05ff79-454a-4857-852c-9243c481e62a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:17.695218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d05ff79-454a-4857-852c-9243c481e62a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:17.696042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d05ff79-454a-4857-852c-9243c481e62a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:17.819969 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fbba031a-5376-48d7-94c2-775bdc8ef5b6 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 204 len: 0 microversion: 2.1 time: 0.226827 Aug 03 02:02:17.822617 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1522/3094] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:02:17 2022] DELETE /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:02:17.835563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-73c97670-46aa-4f77-997d-0f57a252ded4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:17.840512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-73c97670-46aa-4f77-997d-0f57a252ded4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:17.864432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73c97670-46aa-4f77-997d-0f57a252ded4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:17.865175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73c97670-46aa-4f77-997d-0f57a252ded4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:17.866310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73c97670-46aa-4f77-997d-0f57a252ded4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:17.867422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73c97670-46aa-4f77-997d-0f57a252ded4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:18.090251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6d05ff79-454a-4857-852c-9243c481e62a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:18.105306 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6d05ff79-454a-4857-852c-9243c481e62a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1315 microversion: 2.1 time: 0.433014 Aug 03 02:02:18.118939 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1573/3095] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:17 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:18.118939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1fe71d90-e171-46f2-86b4-aac330a3e22f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:18.118939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1fe71d90-e171-46f2-86b4-aac330a3e22f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:18.132870 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fe71d90-e171-46f2-86b4-aac330a3e22f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:18.133374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fe71d90-e171-46f2-86b4-aac330a3e22f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:18.134220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fe71d90-e171-46f2-86b4-aac330a3e22f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:18.134667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fe71d90-e171-46f2-86b4-aac330a3e22f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:18.149893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:18.297574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-73c97670-46aa-4f77-997d-0f57a252ded4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:18.307488 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-73c97670-46aa-4f77-997d-0f57a252ded4 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1318 microversion: 2.1 time: 0.482550 Aug 03 02:02:18.319061 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1523/3096] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:17 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:18.554919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1fe71d90-e171-46f2-86b4-aac330a3e22f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:18.564433 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1fe71d90-e171-46f2-86b4-aac330a3e22f tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1471 microversion: 2.1 time: 0.456437 Aug 03 02:02:18.567633 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1574/3097] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:18 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1471 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:19.133363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9e71debc-f592-4863-9474-678f8fd7a2db tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:19.134268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9e71debc-f592-4863-9474-678f8fd7a2db tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:19.149767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e71debc-f592-4863-9474-678f8fd7a2db tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:19.155799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e71debc-f592-4863-9474-678f8fd7a2db tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:19.156885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e71debc-f592-4863-9474-678f8fd7a2db tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:19.157336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e71debc-f592-4863-9474-678f8fd7a2db tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:19.348127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6ad5ae03-8f86-458a-866e-202353b71d00 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:19.348997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6ad5ae03-8f86-458a-866e-202353b71d00 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:19.365354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:19.376245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ad5ae03-8f86-458a-866e-202353b71d00 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:19.377013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ad5ae03-8f86-458a-866e-202353b71d00 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:19.378365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ad5ae03-8f86-458a-866e-202353b71d00 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:19.379179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ad5ae03-8f86-458a-866e-202353b71d00 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:19.415153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=14 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:19.564159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9e71debc-f592-4863-9474-678f8fd7a2db tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:19.581162 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9e71debc-f592-4863-9474-678f8fd7a2db tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1315 microversion: 2.1 time: 0.452108 Aug 03 02:02:19.582437 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1524/3098] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:19 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:19.605975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ed6a9214-6c3f-483d-8d9e-5c39fe2633f4 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:19.607927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ed6a9214-6c3f-483d-8d9e-5c39fe2633f4 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:19.621171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed6a9214-6c3f-483d-8d9e-5c39fe2633f4 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:19.621771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed6a9214-6c3f-483d-8d9e-5c39fe2633f4 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:19.642641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed6a9214-6c3f-483d-8d9e-5c39fe2633f4 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:19.644657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed6a9214-6c3f-483d-8d9e-5c39fe2633f4 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:19.695621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6ad5ae03-8f86-458a-866e-202353b71d00 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:19.718511 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6ad5ae03-8f86-458a-866e-202353b71d00 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1318 microversion: 2.1 time: 0.389776 Aug 03 02:02:19.720088 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1575/3099] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:19 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:20.054249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ed6a9214-6c3f-483d-8d9e-5c39fe2633f4 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:20.068047 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ed6a9214-6c3f-483d-8d9e-5c39fe2633f4 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1471 microversion: 2.1 time: 0.468699 Aug 03 02:02:20.085452 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1525/3100] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:19 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1471 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:20.614678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4c3a43e1-59ea-47f0-b6fb-02473222b96d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:20.615663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4c3a43e1-59ea-47f0-b6fb-02473222b96d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:20.623804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4c3a43e1-59ea-47f0-b6fb-02473222b96d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:20.625695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4c3a43e1-59ea-47f0-b6fb-02473222b96d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:20.633093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4c3a43e1-59ea-47f0-b6fb-02473222b96d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:20.633865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4c3a43e1-59ea-47f0-b6fb-02473222b96d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:20.742332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-c7e7a4b6-d14e-4c09-9245-a20201fce6e4 req-e35ac1d2-9ddb-4779-8c8b-abe28b430f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a64bad3c-11b7-4854-b7ac-77b18e53f597", "name": "network-vif-deleted", "tag": "5c7de705-6f07-4663-9068-afd2ff1326cb"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:20.784483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c7e7a4b6-d14e-4c09-9245-a20201fce6e4 req-e35ac1d2-9ddb-4779-8c8b-abe28b430f6b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:20.785958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c7e7a4b6-d14e-4c09-9245-a20201fce6e4 req-e35ac1d2-9ddb-4779-8c8b-abe28b430f6b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:20.822185 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c7e7a4b6-d14e-4c09-9245-a20201fce6e4 req-e35ac1d2-9ddb-4779-8c8b-abe28b430f6b service nova] Creating event network-vif-deleted:5c7de705-6f07-4663-9068-afd2ff1326cb for instance a64bad3c-11b7-4854-b7ac-77b18e53f597 on n-h1-826529-8 Aug 03 02:02:20.835021 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-c7e7a4b6-d14e-4c09-9245-a20201fce6e4 req-e35ac1d2-9ddb-4779-8c8b-abe28b430f6b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100416 Aug 03 02:02:20.840370 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1526/3101] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:20.851130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-460af8b3-4d9c-452e-975d-72d130969492 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:20.859013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-460af8b3-4d9c-452e-975d-72d130969492 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:20.870318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-460af8b3-4d9c-452e-975d-72d130969492 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:20.871304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-460af8b3-4d9c-452e-975d-72d130969492 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:20.873534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-460af8b3-4d9c-452e-975d-72d130969492 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:20.874409 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-460af8b3-4d9c-452e-975d-72d130969492 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:21.251799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4c3a43e1-59ea-47f0-b6fb-02473222b96d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:21.261690 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4c3a43e1-59ea-47f0-b6fb-02473222b96d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1315 microversion: 2.1 time: 0.655856 Aug 03 02:02:21.277052 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1576/3102] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:20 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:21.283582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-18a76e0f-a11b-4472-9d03-9f9bdee65c06 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:21.284361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-18a76e0f-a11b-4472-9d03-9f9bdee65c06 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:21.303576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18a76e0f-a11b-4472-9d03-9f9bdee65c06 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:21.304208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18a76e0f-a11b-4472-9d03-9f9bdee65c06 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:21.308576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18a76e0f-a11b-4472-9d03-9f9bdee65c06 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:21.309180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18a76e0f-a11b-4472-9d03-9f9bdee65c06 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:21.319006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:21.350427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18a76e0f-a11b-4472-9d03-9f9bdee65c06 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:21.351412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18a76e0f-a11b-4472-9d03-9f9bdee65c06 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:21.352119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-18a76e0f-a11b-4472-9d03-9f9bdee65c06 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lazy-loading 'fault' on Instance uuid a64bad3c-11b7-4854-b7ac-77b18e53f597 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:02:21.538952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-18a76e0f-a11b-4472-9d03-9f9bdee65c06 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:21.552359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-460af8b3-4d9c-452e-975d-72d130969492 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:21.563574 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-18a76e0f-a11b-4472-9d03-9f9bdee65c06 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 200 len: 1306 microversion: 2.1 time: 0.270086 Aug 03 02:02:21.583637 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1577/3103] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:21 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 1306 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:21.584615 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-460af8b3-4d9c-452e-975d-72d130969492 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1318 microversion: 2.1 time: 0.740248 Aug 03 02:02:21.587703 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1527/3104] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:20 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1318 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:22.286549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f35b9ae1-6568-4f0f-b5bc-17354ff5fa6e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:22.287885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f35b9ae1-6568-4f0f-b5bc-17354ff5fa6e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:22.294744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f35b9ae1-6568-4f0f-b5bc-17354ff5fa6e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:22.295611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f35b9ae1-6568-4f0f-b5bc-17354ff5fa6e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:22.296626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f35b9ae1-6568-4f0f-b5bc-17354ff5fa6e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:22.297253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f35b9ae1-6568-4f0f-b5bc-17354ff5fa6e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:22.588433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-de29d0e3-80c2-40d6-a64b-ec7da28f28cd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:22.589720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-de29d0e3-80c2-40d6-a64b-ec7da28f28cd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: a64bad3c-11b7-4854-b7ac-77b18e53f597] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:22.603897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de29d0e3-80c2-40d6-a64b-ec7da28f28cd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:22.607453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de29d0e3-80c2-40d6-a64b-ec7da28f28cd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:22.613871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de29d0e3-80c2-40d6-a64b-ec7da28f28cd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:22.614707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de29d0e3-80c2-40d6-a64b-ec7da28f28cd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:22.642878 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-de29d0e3-80c2-40d6-a64b-ec7da28f28cd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] HTTP exception thrown: Instance a64bad3c-11b7-4854-b7ac-77b18e53f597 could not be found. Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-de29d0e3-80c2-40d6-a64b-ec7da28f28cd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Request method failure captured: Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 HTTP/1.1 Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dZofcTz_x2_7Lj1YEl6R12KxRSOiZkZiWzL30t623FiVy913gQvbNGAvI0w9tEOWmMse3IGx8KMoyzuQGFPkISyW4w855Uc6Xe9jv8rI8g40HxWgpW7y6poTWGDc1_pVV2lAI3HiwZn-pq0YEQAOwE0O3zhX-NramgI9ImnhQefFic Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66bb501c093b4f47a1a50eb37387bb14", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}] Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 3d335144d6f34ae78eaa6001b906a0df Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance a64bad3c-11b7-4854-b7ac-77b18e53f597 could not be found. Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'a64bad3c-11b7-4854-b7ac-77b18e53f597'} Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a64bad3c-11b7-4854-b7ac-77b18e53f597 could not be found. Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a64bad3c-11b7-4854-b7ac-77b18e53f597 could not be found. Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:22.649607 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:22.654826 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:22.654826 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:22.654826 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:22.654826 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:02:22.654826 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:02:22.654826 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a64bad3c-11b7-4854-b7ac-77b18e53f597 could not be found. Aug 03 02:02:22.654826 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:22.654826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-de29d0e3-80c2-40d6-a64b-ec7da28f28cd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Returning 404 to user: Instance a64bad3c-11b7-4854-b7ac-77b18e53f597 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:02:22.658326 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-de29d0e3-80c2-40d6-a64b-ec7da28f28cd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597" status: 404 len: 111 microversion: 2.1 time: 0.073267 Aug 03 02:02:22.663250 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1528/3105] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:22 2022] GET /compute/v2.1/servers/a64bad3c-11b7-4854-b7ac-77b18e53f597 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:02:22.680375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4fc3e48c-45aa-42ac-ad8f-0df1c6add8c6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:22.682286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4fc3e48c-45aa-42ac-ad8f-0df1c6add8c6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:22.757053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f35b9ae1-6568-4f0f-b5bc-17354ff5fa6e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:22.767900 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4fc3e48c-45aa-42ac-ad8f-0df1c6add8c6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:22.770976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4fc3e48c-45aa-42ac-ad8f-0df1c6add8c6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:22.775072 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f35b9ae1-6568-4f0f-b5bc-17354ff5fa6e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1315 microversion: 2.1 time: 0.490580 Aug 03 02:02:22.775694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4fc3e48c-45aa-42ac-ad8f-0df1c6add8c6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:22.791593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4fc3e48c-45aa-42ac-ad8f-0df1c6add8c6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:22.791907 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1578/3106] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:22 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:22.817275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5f9687b-bdf2-4e13-8a9a-62891c7244e2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:22.818139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5f9687b-bdf2-4e13-8a9a-62891c7244e2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:22.838532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5f9687b-bdf2-4e13-8a9a-62891c7244e2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:22.839336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5f9687b-bdf2-4e13-8a9a-62891c7244e2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:22.840407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5f9687b-bdf2-4e13-8a9a-62891c7244e2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:22.841094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5f9687b-bdf2-4e13-8a9a-62891c7244e2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:22.897476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5f9687b-bdf2-4e13-8a9a-62891c7244e2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:02:23.107964 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5f9687b-bdf2-4e13-8a9a-62891c7244e2 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 204 len: 0 microversion: 2.1 time: 0.303917 Aug 03 02:02:23.108879 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1579/3107] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:02:22 2022] DELETE /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:02:23.118569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-91d63225-bf7d-494c-91b8-69ae8eb8c6cb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:23.130139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-91d63225-bf7d-494c-91b8-69ae8eb8c6cb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:23.139316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91d63225-bf7d-494c-91b8-69ae8eb8c6cb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:23.139316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91d63225-bf7d-494c-91b8-69ae8eb8c6cb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:23.139316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91d63225-bf7d-494c-91b8-69ae8eb8c6cb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:23.139686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91d63225-bf7d-494c-91b8-69ae8eb8c6cb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:23.374759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4fc3e48c-45aa-42ac-ad8f-0df1c6add8c6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:23.384378 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4fc3e48c-45aa-42ac-ad8f-0df1c6add8c6 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1318 microversion: 2.1 time: 0.721198 Aug 03 02:02:23.399291 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1529/3108] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:22 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1318 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:23.590374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-91d63225-bf7d-494c-91b8-69ae8eb8c6cb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:23.599265 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-91d63225-bf7d-494c-91b8-69ae8eb8c6cb tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1472 microversion: 2.1 time: 0.484944 Aug 03 02:02:23.600527 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1580/3109] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:23 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1472 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:23.809585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-03029289-ee71-45dd-b009-50e3df15aeec tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:23.812189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-03029289-ee71-45dd-b009-50e3df15aeec tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:23.821533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03029289-ee71-45dd-b009-50e3df15aeec tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:23.822291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03029289-ee71-45dd-b009-50e3df15aeec tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:23.823345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03029289-ee71-45dd-b009-50e3df15aeec tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:23.823986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03029289-ee71-45dd-b009-50e3df15aeec tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:24.173923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-03029289-ee71-45dd-b009-50e3df15aeec tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:24.182777 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-03029289-ee71-45dd-b009-50e3df15aeec tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1315 microversion: 2.1 time: 0.377246 Aug 03 02:02:24.183602 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1530/3110] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:23 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:24.409746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd5ecacb-c073-4c87-948b-f0e437480985 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:24.410677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cd5ecacb-c073-4c87-948b-f0e437480985 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:24.422939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd5ecacb-c073-4c87-948b-f0e437480985 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:24.423689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd5ecacb-c073-4c87-948b-f0e437480985 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:24.425445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd5ecacb-c073-4c87-948b-f0e437480985 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:24.426210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd5ecacb-c073-4c87-948b-f0e437480985 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:24.625012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-895e8b5f-1dac-48a8-aa5a-043ec9b6229b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:24.625807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-895e8b5f-1dac-48a8-aa5a-043ec9b6229b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:24.640794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-895e8b5f-1dac-48a8-aa5a-043ec9b6229b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:24.645782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-895e8b5f-1dac-48a8-aa5a-043ec9b6229b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:24.646837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-895e8b5f-1dac-48a8-aa5a-043ec9b6229b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:24.647587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-895e8b5f-1dac-48a8-aa5a-043ec9b6229b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:25.522124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-895e8b5f-1dac-48a8-aa5a-043ec9b6229b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:25.540180 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-895e8b5f-1dac-48a8-aa5a-043ec9b6229b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1472 microversion: 2.1 time: 0.920198 Aug 03 02:02:25.543781 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1531/3111] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:24 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1472 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:25.550256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-854b0ba4-c16c-46cb-897e-17d92d0e26a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:25.551587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-854b0ba4-c16c-46cb-897e-17d92d0e26a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:25.559513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-854b0ba4-c16c-46cb-897e-17d92d0e26a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:25.562141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-854b0ba4-c16c-46cb-897e-17d92d0e26a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:25.563591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-854b0ba4-c16c-46cb-897e-17d92d0e26a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:25.564286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-854b0ba4-c16c-46cb-897e-17d92d0e26a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:25.609203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:25.779311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cd5ecacb-c073-4c87-948b-f0e437480985 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:25.803250 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cd5ecacb-c073-4c87-948b-f0e437480985 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1318 microversion: 2.1 time: 1.396836 Aug 03 02:02:25.824401 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1581/3112] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:24 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1318 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:26.577968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c6c094b0-7ee9-46e5-b8e3-c2df7e880898 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:26.579502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c6c094b0-7ee9-46e5-b8e3-c2df7e880898 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:26.598291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6c094b0-7ee9-46e5-b8e3-c2df7e880898 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:26.599267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6c094b0-7ee9-46e5-b8e3-c2df7e880898 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:26.600252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6c094b0-7ee9-46e5-b8e3-c2df7e880898 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:26.602564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6c094b0-7ee9-46e5-b8e3-c2df7e880898 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:26.767517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-854b0ba4-c16c-46cb-897e-17d92d0e26a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:26.786669 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-854b0ba4-c16c-46cb-897e-17d92d0e26a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1315 microversion: 2.1 time: 1.237986 Aug 03 02:02:26.789615 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1532/3113] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:25 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1315 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:26.807821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-6a1b596e-9e06-4d11-a833-8c17cf272d01 req-ab8a9940-cfc0-4839-9a53-5a7f1ca4a94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca5751e-57cb-49b2-982e-0201e2a94ffe", "name": "network-vif-plugged", "status": "completed", "tag": "c7bcefb8-692d-4f3f-a81c-d005d80524f4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:26.835822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:26.850706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6a1b596e-9e06-4d11-a833-8c17cf272d01 req-ab8a9940-cfc0-4839-9a53-5a7f1ca4a94b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:26.851730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6a1b596e-9e06-4d11-a833-8c17cf272d01 req-ab8a9940-cfc0-4839-9a53-5a7f1ca4a94b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:26.901294 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-6a1b596e-9e06-4d11-a833-8c17cf272d01 req-ab8a9940-cfc0-4839-9a53-5a7f1ca4a94b service nova] Creating event network-vif-plugged:c7bcefb8-692d-4f3f-a81c-d005d80524f4 for instance cca5751e-57cb-49b2-982e-0201e2a94ffe on n-h1-826529-8 Aug 03 02:02:26.919414 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-6a1b596e-9e06-4d11-a833-8c17cf272d01 req-ab8a9940-cfc0-4839-9a53-5a7f1ca4a94b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123863 Aug 03 02:02:26.921926 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1533/3114] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:26.939870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-782bc3de-3613-44ab-962b-a7de705418ad tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:26.941596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-782bc3de-3613-44ab-962b-a7de705418ad tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:26.963366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-782bc3de-3613-44ab-962b-a7de705418ad tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:26.963831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-782bc3de-3613-44ab-962b-a7de705418ad tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:26.964897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-782bc3de-3613-44ab-962b-a7de705418ad tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:26.965414 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-782bc3de-3613-44ab-962b-a7de705418ad tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:27.366424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c6c094b0-7ee9-46e5-b8e3-c2df7e880898 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:27.384458 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c6c094b0-7ee9-46e5-b8e3-c2df7e880898 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1472 microversion: 2.1 time: 0.812159 Aug 03 02:02:27.387130 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1582/3115] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:26 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1472 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:27.720872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-782bc3de-3613-44ab-962b-a7de705418ad tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:27.751571 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-782bc3de-3613-44ab-962b-a7de705418ad tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1318 microversion: 2.1 time: 0.826327 Aug 03 02:02:27.758004 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1534/3116] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:26 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1318 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:27.811001 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5d83b2ee-697e-4dd7-885f-e116f0f7dea6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:27.812426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5d83b2ee-697e-4dd7-885f-e116f0f7dea6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:27.828962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d83b2ee-697e-4dd7-885f-e116f0f7dea6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:27.832121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d83b2ee-697e-4dd7-885f-e116f0f7dea6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:27.834439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d83b2ee-697e-4dd7-885f-e116f0f7dea6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:27.835215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d83b2ee-697e-4dd7-885f-e116f0f7dea6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:28.357835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-245e4fc8-544a-49c7-80a4-b68cf570cf54 req-7a0d4a70-5016-4a01-8959-7e56568047ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef72c23-de99-468f-851f-7964dc0a58b5", "name": "network-vif-deleted", "tag": "96df043c-6c35-4150-8a96-ec528a27b440"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:28.398741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-245e4fc8-544a-49c7-80a4-b68cf570cf54 req-7a0d4a70-5016-4a01-8959-7e56568047ed service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:28.399528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-245e4fc8-544a-49c7-80a4-b68cf570cf54 req-7a0d4a70-5016-4a01-8959-7e56568047ed service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:28.441208 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-245e4fc8-544a-49c7-80a4-b68cf570cf54 req-7a0d4a70-5016-4a01-8959-7e56568047ed service nova] Creating event network-vif-deleted:96df043c-6c35-4150-8a96-ec528a27b440 for instance 9ef72c23-de99-468f-851f-7964dc0a58b5 on n-h2-826529-8 Aug 03 02:02:28.452857 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-245e4fc8-544a-49c7-80a4-b68cf570cf54 req-7a0d4a70-5016-4a01-8959-7e56568047ed service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103329 Aug 03 02:02:28.454477 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1535/3117] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 03 02:02:28.460130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-db9705f1-c619-4243-a6bc-b2b67efb2833 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:28.468091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-db9705f1-c619-4243-a6bc-b2b67efb2833 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:28.488842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db9705f1-c619-4243-a6bc-b2b67efb2833 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:28.489624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db9705f1-c619-4243-a6bc-b2b67efb2833 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:28.490694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db9705f1-c619-4243-a6bc-b2b67efb2833 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:28.491426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db9705f1-c619-4243-a6bc-b2b67efb2833 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:28.596280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db9705f1-c619-4243-a6bc-b2b67efb2833 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:28.597552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db9705f1-c619-4243-a6bc-b2b67efb2833 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:28.598192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-db9705f1-c619-4243-a6bc-b2b67efb2833 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lazy-loading 'fault' on Instance uuid 9ef72c23-de99-468f-851f-7964dc0a58b5 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:02:28.619611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5d83b2ee-697e-4dd7-885f-e116f0f7dea6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:28.639291 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5d83b2ee-697e-4dd7-885f-e116f0f7dea6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1315 microversion: 2.1 time: 0.831548 Aug 03 02:02:28.641489 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1583/3118] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:27 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1315 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:28.709020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-db9705f1-c619-4243-a6bc-b2b67efb2833 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:28.719882 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-db9705f1-c619-4243-a6bc-b2b67efb2833 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 200 len: 1306 microversion: 2.1 time: 0.264058 Aug 03 02:02:28.740490 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1536/3119] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:28 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 1306 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:28.782373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fbb42bfb-6aa1-42b8-a9bb-9ca33ca6268f tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:28.783052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fbb42bfb-6aa1-42b8-a9bb-9ca33ca6268f tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:28.801343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbb42bfb-6aa1-42b8-a9bb-9ca33ca6268f tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:28.801808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbb42bfb-6aa1-42b8-a9bb-9ca33ca6268f tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:28.802619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbb42bfb-6aa1-42b8-a9bb-9ca33ca6268f tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:28.813679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbb42bfb-6aa1-42b8-a9bb-9ca33ca6268f tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:29.250241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5660ff3c-b17a-43f3-bd47-9d9c2bb247cc tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Action: 'create', calling method: .version_select at 0x7f5b1306b4c0>, body: {"keypair": {"name": "tempest-keypair-1742974591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmazu+P3pqnPC1ofQIwWcLSmG3Gv7dfZnOVggjKO79e7h+WWmiees2R/PxRu3c5FSlB94G/t9SWMWcWph9Ni+E5mjuUkrJjQeqxhh+FsQfA/VYjHcZlQVmNWlHsSJr2/A=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:29.280358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-5660ff3c-b17a-43f3-bd47-9d9c2bb247cc tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:02:29.281527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fbb42bfb-6aa1-42b8-a9bb-9ca33ca6268f tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:29.289502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-5660ff3c-b17a-43f3-bd47-9d9c2bb247cc tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for user 4c1fb7af331344dcb26c43368a9daa6e and project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:02:29.294896 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fbb42bfb-6aa1-42b8-a9bb-9ca33ca6268f tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1318 microversion: 2.1 time: 0.515912 Aug 03 02:02:29.295943 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1584/3120] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:28 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:29.308522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c95590b0-c976-45aa-9c3f-d07af04fb28f req-f33920c0-a73b-4be1-b84f-f7b61125406f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91646d0d-7cde-4a99-9ffc-d4281bc31566", "name": "network-vif-plugged", "status": "completed", "tag": "73a006d2-6970-4db7-af83-88559a774ddb"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:29.328174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c95590b0-c976-45aa-9c3f-d07af04fb28f req-f33920c0-a73b-4be1-b84f-f7b61125406f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:29.328885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c95590b0-c976-45aa-9c3f-d07af04fb28f req-f33920c0-a73b-4be1-b84f-f7b61125406f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:29.338960 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5660ff3c-b17a-43f3-bd47-9d9c2bb247cc tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.373021 Aug 03 02:02:29.346755 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1537/3121] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:02:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:29.376465 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c95590b0-c976-45aa-9c3f-d07af04fb28f req-f33920c0-a73b-4be1-b84f-f7b61125406f service nova] Creating event network-vif-plugged:73a006d2-6970-4db7-af83-88559a774ddb for instance 91646d0d-7cde-4a99-9ffc-d4281bc31566 on n-h2-826529-8 Aug 03 02:02:29.393211 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c95590b0-c976-45aa-9c3f-d07af04fb28f req-f33920c0-a73b-4be1-b84f-f7b61125406f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093616 Aug 03 02:02:29.397951 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1585/3122] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:29.668283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-280c4090-0975-4bbe-8f7f-2dddc9090299 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:29.670386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-280c4090-0975-4bbe-8f7f-2dddc9090299 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:29.719978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-280c4090-0975-4bbe-8f7f-2dddc9090299 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:29.721894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-280c4090-0975-4bbe-8f7f-2dddc9090299 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:29.724822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-280c4090-0975-4bbe-8f7f-2dddc9090299 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:29.725289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-280c4090-0975-4bbe-8f7f-2dddc9090299 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:29.765138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-91389154-9dcd-47dc-b069-5a0c3437e82c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:29.766841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-91389154-9dcd-47dc-b069-5a0c3437e82c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 9ef72c23-de99-468f-851f-7964dc0a58b5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:29.794961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91389154-9dcd-47dc-b069-5a0c3437e82c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:29.796115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91389154-9dcd-47dc-b069-5a0c3437e82c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:29.797257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91389154-9dcd-47dc-b069-5a0c3437e82c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:29.801569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91389154-9dcd-47dc-b069-5a0c3437e82c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:29.834240 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-91389154-9dcd-47dc-b069-5a0c3437e82c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] HTTP exception thrown: Instance 9ef72c23-de99-468f-851f-7964dc0a58b5 could not be found. Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-91389154-9dcd-47dc-b069-5a0c3437e82c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Request method failure captured: Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 HTTP/1.1 Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dZofcTz_x2_7Lj1YEl6R12KxRSOiZkZiWzL30t623FiVy913gQvbNGAvI0w9tEOWmMse3IGx8KMoyzuQGFPkISyW4w855Uc6Xe9jv8rI8g40HxWgpW7y6poTWGDc1_pVV2lAI3HiwZn-pq0YEQAOwE0O3zhX-NramgI9ImnhQefFic Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66bb501c093b4f47a1a50eb37387bb14", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}] Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 3d335144d6f34ae78eaa6001b906a0df Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 9ef72c23-de99-468f-851f-7964dc0a58b5 could not be found. Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '9ef72c23-de99-468f-851f-7964dc0a58b5'} Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef72c23-de99-468f-851f-7964dc0a58b5 could not be found. Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef72c23-de99-468f-851f-7964dc0a58b5 could not be found. Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:29.837053 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:29.846632 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:29.846632 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:29.846632 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:29.846632 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:02:29.846632 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:02:29.846632 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef72c23-de99-468f-851f-7964dc0a58b5 could not be found. Aug 03 02:02:29.846632 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:29.853548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-91389154-9dcd-47dc-b069-5a0c3437e82c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Returning 404 to user: Instance 9ef72c23-de99-468f-851f-7964dc0a58b5 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:02:29.855631 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-91389154-9dcd-47dc-b069-5a0c3437e82c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5" status: 404 len: 111 microversion: 2.1 time: 0.097531 Aug 03 02:02:29.859532 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1586/3123] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:29 2022] GET /compute/v2.1/servers/9ef72c23-de99-468f-851f-7964dc0a58b5 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:02:29.870792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6905b6a0-d5a9-4a7f-a332-f5d8061fef8e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:29.876134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6905b6a0-d5a9-4a7f-a332-f5d8061fef8e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:29.900709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6905b6a0-d5a9-4a7f-a332-f5d8061fef8e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:29.904268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6905b6a0-d5a9-4a7f-a332-f5d8061fef8e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:29.906145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6905b6a0-d5a9-4a7f-a332-f5d8061fef8e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:29.907351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6905b6a0-d5a9-4a7f-a332-f5d8061fef8e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:29.979377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6905b6a0-d5a9-4a7f-a332-f5d8061fef8e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:02:30.038962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-280c4090-0975-4bbe-8f7f-2dddc9090299 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:30.047635 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-280c4090-0975-4bbe-8f7f-2dddc9090299 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1502 microversion: 2.1 time: 0.386482 Aug 03 02:02:30.050706 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1538/3124] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:29 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1502 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:30.180958 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6905b6a0-d5a9-4a7f-a332-f5d8061fef8e tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "DELETE /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 204 len: 0 microversion: 2.1 time: 0.316091 Aug 03 02:02:30.187112 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1587/3125] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:02:29 2022] DELETE /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:02:30.191565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25b7a297-d410-4ed5-aa7d-4fcb8700b17c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:30.192334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-25b7a297-d410-4ed5-aa7d-4fcb8700b17c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:30.202713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25b7a297-d410-4ed5-aa7d-4fcb8700b17c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:30.206892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25b7a297-d410-4ed5-aa7d-4fcb8700b17c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:30.210650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25b7a297-d410-4ed5-aa7d-4fcb8700b17c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:30.211329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25b7a297-d410-4ed5-aa7d-4fcb8700b17c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:30.322807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d3325316-4e77-4deb-a46c-965849dc3255 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:30.323655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d3325316-4e77-4deb-a46c-965849dc3255 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:30.335601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3325316-4e77-4deb-a46c-965849dc3255 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:30.336061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3325316-4e77-4deb-a46c-965849dc3255 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:30.336862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3325316-4e77-4deb-a46c-965849dc3255 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:30.337305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3325316-4e77-4deb-a46c-965849dc3255 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:30.692536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-25b7a297-d410-4ed5-aa7d-4fcb8700b17c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:30.719742 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-25b7a297-d410-4ed5-aa7d-4fcb8700b17c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1473 microversion: 2.1 time: 0.529642 Aug 03 02:02:30.721000 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1539/3126] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:30 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1473 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:30.776384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d3325316-4e77-4deb-a46c-965849dc3255 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:30.787483 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d3325316-4e77-4deb-a46c-965849dc3255 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1318 microversion: 2.1 time: 0.469720 Aug 03 02:02:30.804944 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1588/3127] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:30 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:31.749090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e63a567b-1c38-40ba-a548-9b0a629a3913 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:31.749877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e63a567b-1c38-40ba-a548-9b0a629a3913 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:31.776359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e63a567b-1c38-40ba-a548-9b0a629a3913 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:31.777341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e63a567b-1c38-40ba-a548-9b0a629a3913 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:31.781865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e63a567b-1c38-40ba-a548-9b0a629a3913 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:31.782623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e63a567b-1c38-40ba-a548-9b0a629a3913 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:31.811855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f55dd1d9-4f7a-4358-8002-323532f3e308 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:31.812618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f55dd1d9-4f7a-4358-8002-323532f3e308 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:31.822237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f55dd1d9-4f7a-4358-8002-323532f3e308 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:31.822703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f55dd1d9-4f7a-4358-8002-323532f3e308 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:31.832837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f55dd1d9-4f7a-4358-8002-323532f3e308 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:31.833307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f55dd1d9-4f7a-4358-8002-323532f3e308 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:32.713578 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e63a567b-1c38-40ba-a548-9b0a629a3913 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:32.733243 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e63a567b-1c38-40ba-a548-9b0a629a3913 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1473 microversion: 2.1 time: 0.993050 Aug 03 02:02:32.749089 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1540/3128] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:31 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1473 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:32.877982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f55dd1d9-4f7a-4358-8002-323532f3e308 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:32.890507 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f55dd1d9-4f7a-4358-8002-323532f3e308 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1318 microversion: 2.1 time: 1.082906 Aug 03 02:02:32.900517 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1589/3129] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:31 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1318 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:33.097262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5f089c96-cbd1-45e9-a2ed-2f9cb50b395a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93d71eb6-71ee-4ae0-8512-b4e9ab8230a2"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:33.101669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5f089c96-cbd1-45e9-a2ed-2f9cb50b395a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:33.114930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f089c96-cbd1-45e9-a2ed-2f9cb50b395a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:33.115604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f089c96-cbd1-45e9-a2ed-2f9cb50b395a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:33.117216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f089c96-cbd1-45e9-a2ed-2f9cb50b395a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:33.117823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f089c96-cbd1-45e9-a2ed-2f9cb50b395a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:33.614640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-8c1f9c41-b2f1-4fa5-99b0-74fb843c0e6c req-f75f7672-ea0b-4c79-b6dc-24772ea32486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156b2ce7-f4a3-4cd8-83ef-1bc5e233f320", "name": "network-vif-deleted", "tag": "46618a0d-ac10-4dcf-ad3b-2acef3bbe726"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:33.694564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8c1f9c41-b2f1-4fa5-99b0-74fb843c0e6c req-f75f7672-ea0b-4c79-b6dc-24772ea32486 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:33.698360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8c1f9c41-b2f1-4fa5-99b0-74fb843c0e6c req-f75f7672-ea0b-4c79-b6dc-24772ea32486 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:33.770192 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-8c1f9c41-b2f1-4fa5-99b0-74fb843c0e6c req-f75f7672-ea0b-4c79-b6dc-24772ea32486 service nova] Creating event network-vif-deleted:46618a0d-ac10-4dcf-ad3b-2acef3bbe726 for instance 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 on n-h2-826529-8 Aug 03 02:02:33.788414 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-8c1f9c41-b2f1-4fa5-99b0-74fb843c0e6c req-f75f7672-ea0b-4c79-b6dc-24772ea32486 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187635 Aug 03 02:02:33.789771 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1590/3130] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:02:33.799026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bc6a5d1e-c704-4a02-ba5f-86e0ac9a610b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:33.800696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bc6a5d1e-c704-4a02-ba5f-86e0ac9a610b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:33.822675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc6a5d1e-c704-4a02-ba5f-86e0ac9a610b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:33.827797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc6a5d1e-c704-4a02-ba5f-86e0ac9a610b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:33.831205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc6a5d1e-c704-4a02-ba5f-86e0ac9a610b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:33.832083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc6a5d1e-c704-4a02-ba5f-86e0ac9a610b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:33.986945 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5f089c96-cbd1-45e9-a2ed-2f9cb50b395a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "POST /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.875051 Aug 03 02:02:33.994553 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1541/3131] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:02:33 2022] POST /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe/os-volume_attachments => generated 194 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:34.027732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc6a5d1e-c704-4a02-ba5f-86e0ac9a610b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:34.032041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc6a5d1e-c704-4a02-ba5f-86e0ac9a610b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:34.033049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-bc6a5d1e-c704-4a02-ba5f-86e0ac9a610b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lazy-loading 'fault' on Instance uuid 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:02:34.045877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4ff0f06f-a197-4ed0-bd3c-751abd78d02c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:34.046684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4ff0f06f-a197-4ed0-bd3c-751abd78d02c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:34.102159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ff0f06f-a197-4ed0-bd3c-751abd78d02c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:34.102630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ff0f06f-a197-4ed0-bd3c-751abd78d02c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:34.117837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ff0f06f-a197-4ed0-bd3c-751abd78d02c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:34.136470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ff0f06f-a197-4ed0-bd3c-751abd78d02c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:34.170064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bc6a5d1e-c704-4a02-ba5f-86e0ac9a610b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:34.174434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:34.215075 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bc6a5d1e-c704-4a02-ba5f-86e0ac9a610b tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 200 len: 1307 microversion: 2.1 time: 0.423348 Aug 03 02:02:34.220128 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1591/3132] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:33 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 1307 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:34.714695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4ff0f06f-a197-4ed0-bd3c-751abd78d02c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:34.737347 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4ff0f06f-a197-4ed0-bd3c-751abd78d02c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1508 microversion: 2.1 time: 0.711951 Aug 03 02:02:34.738390 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1542/3133] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:33 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1508 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:35.255760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-550b0de2-c2b4-448e-bd40-02b2d7b13f97 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:35.266465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-550b0de2-c2b4-448e-bd40-02b2d7b13f97 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:35.293936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-550b0de2-c2b4-448e-bd40-02b2d7b13f97 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:35.302766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-550b0de2-c2b4-448e-bd40-02b2d7b13f97 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:35.304415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-550b0de2-c2b4-448e-bd40-02b2d7b13f97 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:35.309078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-550b0de2-c2b4-448e-bd40-02b2d7b13f97 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:35.362831 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-550b0de2-c2b4-448e-bd40-02b2d7b13f97 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] HTTP exception thrown: Instance 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 could not be found. Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-550b0de2-c2b4-448e-bd40-02b2d7b13f97 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Request method failure captured: Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 HTTP/1.1 Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dZofcTz_x2_7Lj1YEl6R12KxRSOiZkZiWzL30t623FiVy913gQvbNGAvI0w9tEOWmMse3IGx8KMoyzuQGFPkISyW4w855Uc6Xe9jv8rI8g40HxWgpW7y6poTWGDc1_pVV2lAI3HiwZn-pq0YEQAOwE0O3zhX-NramgI9ImnhQefFic Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66bb501c093b4f47a1a50eb37387bb14", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}] Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 3d335144d6f34ae78eaa6001b906a0df Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 could not be found. Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '156b2ce7-f4a3-4cd8-83ef-1bc5e233f320'} Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 could not be found. Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 could not be found. Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:35.368583 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:35.374843 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:35.374843 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:35.374843 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:35.374843 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:02:35.374843 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:02:35.374843 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 could not be found. Aug 03 02:02:35.374843 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:35.378638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-550b0de2-c2b4-448e-bd40-02b2d7b13f97 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Returning 404 to user: Instance 156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:02:35.380067 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-550b0de2-c2b4-448e-bd40-02b2d7b13f97 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320" status: 404 len: 111 microversion: 2.1 time: 0.142338 Aug 03 02:02:35.384903 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1592/3134] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:35 2022] GET /compute/v2.1/servers/156b2ce7-f4a3-4cd8-83ef-1bc5e233f320 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:02:35.397169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-971b9927-8208-4343-b31c-30e190ef5253 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:35.397924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-971b9927-8208-4343-b31c-30e190ef5253 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: b22f91a3-0dc4-4228-9510-8605086caef8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:35.413434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-971b9927-8208-4343-b31c-30e190ef5253 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:35.413893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-971b9927-8208-4343-b31c-30e190ef5253 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:35.414694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-971b9927-8208-4343-b31c-30e190ef5253 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:35.415169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-971b9927-8208-4343-b31c-30e190ef5253 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:35.541292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-971b9927-8208-4343-b31c-30e190ef5253 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: b22f91a3-0dc4-4228-9510-8605086caef8] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:02:35.804233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-154325383", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1bcbe413-2b5f-4286-84d0-26739a6b3703"}], "security_groups": [{"name": "tempest-securitygroup--965491613"}], "key_name": "tempest-keypair-1742974591", "user_data": "}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:35.847848 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-971b9927-8208-4343-b31c-30e190ef5253 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8" status: 204 len: 0 microversion: 2.1 time: 0.461385 Aug 03 02:02:35.848449 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1543/3135] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:02:35 2022] DELETE /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:02:35.872779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-164d428f-651a-4170-bfdb-4cc0332ca7ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:35.874546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-164d428f-651a-4170-bfdb-4cc0332ca7ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:35.937672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-164d428f-651a-4170-bfdb-4cc0332ca7ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:35.938549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-164d428f-651a-4170-bfdb-4cc0332ca7ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:35.939623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-164d428f-651a-4170-bfdb-4cc0332ca7ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:35.943421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-164d428f-651a-4170-bfdb-4cc0332ca7ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:36.021016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-164d428f-651a-4170-bfdb-4cc0332ca7ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:02:36.102513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] validate_networks() for [('1bcbe413-2b5f-4286-84d0-26739a6b3703', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:02:36.283953 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-164d428f-651a-4170-bfdb-4cc0332ca7ef tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 204 len: 0 microversion: 2.1 time: 0.427015 Aug 03 02:02:36.291400 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1544/3136] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:02:35 2022] DELETE /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:02:36.304955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a48b1cdc-db0b-4b40-9a6e-598cd470ca5c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:36.308129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a48b1cdc-db0b-4b40-9a6e-598cd470ca5c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: b22f91a3-0dc4-4228-9510-8605086caef8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:36.322642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a48b1cdc-db0b-4b40-9a6e-598cd470ca5c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:36.322642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a48b1cdc-db0b-4b40-9a6e-598cd470ca5c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:36.323531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a48b1cdc-db0b-4b40-9a6e-598cd470ca5c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:36.326761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a48b1cdc-db0b-4b40-9a6e-598cd470ca5c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:37.114833 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a48b1cdc-db0b-4b40-9a6e-598cd470ca5c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:37.130612 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a48b1cdc-db0b-4b40-9a6e-598cd470ca5c tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8" status: 200 len: 1474 microversion: 2.1 time: 0.838502 Aug 03 02:02:37.135355 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1545/3137] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:36 2022] GET /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8 => generated 1474 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:37.312665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-612b4abc-9ec2-45e5-a7a8-8fd629464a59 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Action: 'create', calling method: .version_select at 0x7f5b132a2b80>, body: {"keypair": {"name": "tempest-keypair-1075513856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPmvgrbkSKXBejyHzOg0qbrV0jiogt8jvLva0X3dYhWE0+4h+r4roP3RWKiSFhcLu3kHFh6ZmkMKzJ/8zpmGDhKN5DwTvYjcgtnA+s2tsos70FnDdAO3I9ElShHcWLgvA=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:37.356669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-612b4abc-9ec2-45e5-a7a8-8fd629464a59 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Getting quotas for project e58f4b233c354db7be024f63337a78f0. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:02:37.375555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-612b4abc-9ec2-45e5-a7a8-8fd629464a59 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Getting quotas for user 635b99a4523149d08cf149f321420288 and project e58f4b233c354db7be024f63337a78f0. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:02:37.435545 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-612b4abc-9ec2-45e5-a7a8-8fd629464a59 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.288937 Aug 03 02:02:37.442635 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1546/3138] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:02:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:38.083396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:02:38.083983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:02:38.084298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:02:38.084715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:02:38.085133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:02:38.116647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:38.117116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:38.118065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:38.118522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:38.163324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-50475c2e-f731-487e-ac8a-48f8f5414291 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:38.164908 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-50475c2e-f731-487e-ac8a-48f8f5414291 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: b22f91a3-0dc4-4228-9510-8605086caef8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:38.206843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50475c2e-f731-487e-ac8a-48f8f5414291 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:38.208421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:02:38.211065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50475c2e-f731-487e-ac8a-48f8f5414291 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:38.213847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50475c2e-f731-487e-ac8a-48f8f5414291 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:38.216886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50475c2e-f731-487e-ac8a-48f8f5414291 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:38.226013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for user 4c1fb7af331344dcb26c43368a9daa6e and project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:02:38.286947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:02:38.292415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:02:38.302160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:38.348235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:38.476756 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6813f14e-b6dc-4411-ab06-94d60a9f95a3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.668936 Aug 03 02:02:38.477526 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1593/3139] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:02:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 2680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:02:38.494526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1ae6d74d-2b18-42c3-abba-ce71bcae0dbd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:38.495740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1ae6d74d-2b18-42c3-abba-ce71bcae0dbd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:38.766334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1ae6d74d-2b18-42c3-abba-ce71bcae0dbd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:38.773842 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1ae6d74d-2b18-42c3-abba-ce71bcae0dbd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1241 microversion: 2.1 time: 0.286424 Aug 03 02:02:38.786863 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1594/3140] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:38 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1241 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:38.905451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-50475c2e-f731-487e-ac8a-48f8f5414291 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:38.917073 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-50475c2e-f731-487e-ac8a-48f8f5414291 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8" status: 200 len: 1474 microversion: 2.1 time: 0.758806 Aug 03 02:02:38.921011 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1547/3141] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:38 2022] GET /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8 => generated 1474 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:39.148103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a29400f8-1bf7-4102-8b71-5882eb76b81f tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7b11ca35-fce8-45d0-89ba-693b5c6ca03c"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:39.155935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a29400f8-1bf7-4102-8b71-5882eb76b81f tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:39.173019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a29400f8-1bf7-4102-8b71-5882eb76b81f tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:39.173493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a29400f8-1bf7-4102-8b71-5882eb76b81f tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:39.179013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a29400f8-1bf7-4102-8b71-5882eb76b81f tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:39.179789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a29400f8-1bf7-4102-8b71-5882eb76b81f tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:39.445498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-78c0a029-b5d8-4b3e-bd02-0953973f8061 req-f22b8629-81fb-48b1-ae06-59089ae6e7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5828876-bf1f-481e-9960-b98652a1ce58", "name": "network-vif-deleted", "tag": "d9877663-29d9-418c-9aa5-dad3ecd344d4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:39.480422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-78c0a029-b5d8-4b3e-bd02-0953973f8061 req-f22b8629-81fb-48b1-ae06-59089ae6e7a5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:39.484471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-78c0a029-b5d8-4b3e-bd02-0953973f8061 req-f22b8629-81fb-48b1-ae06-59089ae6e7a5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:39.523240 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-a29400f8-1bf7-4102-8b71-5882eb76b81f tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] HTTP exception thrown: Volume e206dd57-d7dc-4f75-9ad9-6df6a9439445 could not be found. Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a29400f8-1bf7-4102-8b71-5882eb76b81f tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] Request method failure captured: Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: request: PUT /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566/os-volume_attachments/e206dd57-d7dc-4f75-9ad9-6df6a9439445 HTTP/1.1 Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 74 Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dapNYBfbTunsxts9a4uRYHEqjcLGH71jI_AKPBN7dubn_23GenT0j-tT9rjG-fkCl0Gq0clKdf2L_Nosmy-QR8OKZhsTKX2DwiGUcULL8kAcC9I9fLciO3rSoAt9ozZafN6D5A98C3JzWl1ZdWKXFUbAaJuwrcHkSW8QBv30DQOb84 Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 6d6996cc8cd54c519bd6116bc76a0966 Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-VolumesAdminNegativeTest-733503398 Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6d6996cc8cd54c519bd6116bc76a0966", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6d6996cc8cd54c519bd6116bc76a0966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6d6996cc8cd54c519bd6116bc76a0966"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6d6996cc8cd54c519bd6116bc76a0966"}]}] Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-VolumesAdminNegativeTest-733503398 Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 6d6996cc8cd54c519bd6116bc76a0966 Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-733503398 Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-VolumesAdminNegativeTest-733503398-project-admin Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: b5b344c2b24742d6a2135d973c6db9d7 Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-VolumesAdminNegativeTest-733503398-project-admin Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: {"volumeAttachment": {"volumeId": "7b11ca35-fce8-45d0-89ba-693b5c6ca03c"}} Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: exception: Volume e206dd57-d7dc-4f75-9ad9-6df6a9439445 could not be found. Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'server_id': '91646d0d-7cde-4a99-9ffc-d4281bc31566', 'id': 'e206dd57-d7dc-4f75-9ad9-6df6a9439445', 'body': {'volumeAttachment': {'volumeId': '7b11ca35-fce8-45d0-89ba-693b5c6ca03c'}}} Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e206dd57-d7dc-4f75-9ad9-6df6a9439445 could not be found. (HTTP 404) (Request-ID: req-f81751ce-c3a2-4319-99ef-34b1e19aed55) Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 02:02:39.528122 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e206dd57-d7dc-4f75-9ad9-6df6a9439445 could not be found. Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e206dd57-d7dc-4f75-9ad9-6df6a9439445 could not be found. Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e206dd57-d7dc-4f75-9ad9-6df6a9439445 could not be found. Aug 03 02:02:39.532395 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:39.536711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a29400f8-1bf7-4102-8b71-5882eb76b81f tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] Returning 404 to user: Volume e206dd57-d7dc-4f75-9ad9-6df6a9439445 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:02:39.545075 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a29400f8-1bf7-4102-8b71-5882eb76b81f tempest-VolumesAdminNegativeTest-733503398 tempest-VolumesAdminNegativeTest-733503398-project-admin] 10.222.0.67 "PUT /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566/os-volume_attachments/e206dd57-d7dc-4f75-9ad9-6df6a9439445" status: 404 len: 109 microversion: 2.1 time: 0.402350 Aug 03 02:02:39.562784 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-78c0a029-b5d8-4b3e-bd02-0953973f8061 req-f22b8629-81fb-48b1-ae06-59089ae6e7a5 service nova] Creating event network-vif-deleted:d9877663-29d9-418c-9aa5-dad3ecd344d4 for instance e5828876-bf1f-481e-9960-b98652a1ce58 on n-h1-826529-8 Aug 03 02:02:39.563092 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1595/3142] 10.222.0.67 () {60 vars in 1433 bytes} [Wed Aug 3 02:02:39 2022] PUT /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566/os-volume_attachments/e206dd57-d7dc-4f75-9ad9-6df6a9439445 => generated 109 bytes in 422 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:02:39.589977 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-78c0a029-b5d8-4b3e-bd02-0953973f8061 req-f22b8629-81fb-48b1-ae06-59089ae6e7a5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148386 Aug 03 02:02:39.597993 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1548/3143] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:02:39.808412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9c116cb0-4774-4e89-b0b8-89327466b429 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:39.809534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9c116cb0-4774-4e89-b0b8-89327466b429 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:39.821962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c116cb0-4774-4e89-b0b8-89327466b429 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:39.823035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c116cb0-4774-4e89-b0b8-89327466b429 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:39.828383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c116cb0-4774-4e89-b0b8-89327466b429 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:39.829878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c116cb0-4774-4e89-b0b8-89327466b429 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:39.958394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e95504b5-1345-4c14-83fd-64ce457327ce tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:39.959334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e95504b5-1345-4c14-83fd-64ce457327ce tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: b22f91a3-0dc4-4228-9510-8605086caef8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:39.976942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e95504b5-1345-4c14-83fd-64ce457327ce tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:39.977806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e95504b5-1345-4c14-83fd-64ce457327ce tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:39.986285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e95504b5-1345-4c14-83fd-64ce457327ce tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:39.989696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e95504b5-1345-4c14-83fd-64ce457327ce tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:40.809030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9c116cb0-4774-4e89-b0b8-89327466b429 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:40.822065 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9c116cb0-4774-4e89-b0b8-89327466b429 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1245 microversion: 2.1 time: 1.017415 Aug 03 02:02:40.826183 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1596/3144] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:39 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1245 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:40.878211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e95504b5-1345-4c14-83fd-64ce457327ce tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:40.890421 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e95504b5-1345-4c14-83fd-64ce457327ce tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8" status: 200 len: 1474 microversion: 2.1 time: 0.936242 Aug 03 02:02:40.896038 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1549/3145] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:39 2022] GET /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8 => generated 1474 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:41.145631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-1b75c913-d601-4946-9eed-0011de042e61 req-a4fc85f7-5f01-4bf2-be2d-e85014f8e9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b22f91a3-0dc4-4228-9510-8605086caef8", "name": "network-vif-deleted", "tag": "2a64e8d3-4059-41b5-aaec-8cba861ff604"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:41.194009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1b75c913-d601-4946-9eed-0011de042e61 req-a4fc85f7-5f01-4bf2-be2d-e85014f8e9a6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:41.210645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1b75c913-d601-4946-9eed-0011de042e61 req-a4fc85f7-5f01-4bf2-be2d-e85014f8e9a6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:41.285552 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-1b75c913-d601-4946-9eed-0011de042e61 req-a4fc85f7-5f01-4bf2-be2d-e85014f8e9a6 service nova] Creating event network-vif-deleted:2a64e8d3-4059-41b5-aaec-8cba861ff604 for instance b22f91a3-0dc4-4228-9510-8605086caef8 on n-h2-826529-8 Aug 03 02:02:41.306719 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-1b75c913-d601-4946-9eed-0011de042e61 req-a4fc85f7-5f01-4bf2-be2d-e85014f8e9a6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165560 Aug 03 02:02:41.317345 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1597/3146] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:02:41.846637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d267bc61-2a2d-44e8-b989-87d913f5604f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:41.847332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d267bc61-2a2d-44e8-b989-87d913f5604f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:41.866144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d267bc61-2a2d-44e8-b989-87d913f5604f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:41.866498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d267bc61-2a2d-44e8-b989-87d913f5604f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:41.867336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d267bc61-2a2d-44e8-b989-87d913f5604f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:41.867780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d267bc61-2a2d-44e8-b989-87d913f5604f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:41.926895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6edfa48b-cb95-432d-b922-fb232bf665e8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:41.927749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6edfa48b-cb95-432d-b922-fb232bf665e8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: b22f91a3-0dc4-4228-9510-8605086caef8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:41.953744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6edfa48b-cb95-432d-b922-fb232bf665e8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:41.954543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6edfa48b-cb95-432d-b922-fb232bf665e8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:41.956297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6edfa48b-cb95-432d-b922-fb232bf665e8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:41.959977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6edfa48b-cb95-432d-b922-fb232bf665e8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:42.100970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6edfa48b-cb95-432d-b922-fb232bf665e8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:42.101778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6edfa48b-cb95-432d-b922-fb232bf665e8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:42.103851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-6edfa48b-cb95-432d-b922-fb232bf665e8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lazy-loading 'fault' on Instance uuid b22f91a3-0dc4-4228-9510-8605086caef8 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:02:42.336991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d267bc61-2a2d-44e8-b989-87d913f5604f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:42.338433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6edfa48b-cb95-432d-b922-fb232bf665e8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:42.358609 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6edfa48b-cb95-432d-b922-fb232bf665e8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8" status: 200 len: 1308 microversion: 2.1 time: 0.437951 Aug 03 02:02:42.388634 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d267bc61-2a2d-44e8-b989-87d913f5604f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1299 microversion: 2.1 time: 0.545950 Aug 03 02:02:42.392508 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1598/3147] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:41 2022] GET /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8 => generated 1308 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:42.399702 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1550/3148] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:41 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1299 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:43.414717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1f07af30-ed2b-4c40-b5da-fedebdd1fe32 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:43.416050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1f07af30-ed2b-4c40-b5da-fedebdd1fe32 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: b22f91a3-0dc4-4228-9510-8605086caef8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:43.430242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-19304378-3381-462d-b6d9-7da248b95aca tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:43.431557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-19304378-3381-462d-b6d9-7da248b95aca tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:43.449034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19304378-3381-462d-b6d9-7da248b95aca tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:43.450572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f07af30-ed2b-4c40-b5da-fedebdd1fe32 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:43.451354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f07af30-ed2b-4c40-b5da-fedebdd1fe32 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:43.452405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f07af30-ed2b-4c40-b5da-fedebdd1fe32 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:43.455873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19304378-3381-462d-b6d9-7da248b95aca tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:43.456914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f07af30-ed2b-4c40-b5da-fedebdd1fe32 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:43.462181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19304378-3381-462d-b6d9-7da248b95aca tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:43.464300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19304378-3381-462d-b6d9-7da248b95aca tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:43.515405 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-1f07af30-ed2b-4c40-b5da-fedebdd1fe32 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] HTTP exception thrown: Instance b22f91a3-0dc4-4228-9510-8605086caef8 could not be found. Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1f07af30-ed2b-4c40-b5da-fedebdd1fe32 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Request method failure captured: Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8 HTTP/1.1 Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dZofcTz_x2_7Lj1YEl6R12KxRSOiZkZiWzL30t623FiVy913gQvbNGAvI0w9tEOWmMse3IGx8KMoyzuQGFPkISyW4w855Uc6Xe9jv8rI8g40HxWgpW7y6poTWGDc1_pVV2lAI3HiwZn-pq0YEQAOwE0O3zhX-NramgI9ImnhQefFic Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66bb501c093b4f47a1a50eb37387bb14", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}] Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 3d335144d6f34ae78eaa6001b906a0df Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance b22f91a3-0dc4-4228-9510-8605086caef8 could not be found. Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'b22f91a3-0dc4-4228-9510-8605086caef8'} Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b22f91a3-0dc4-4228-9510-8605086caef8 could not be found. Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b22f91a3-0dc4-4228-9510-8605086caef8 could not be found. Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:43.519048 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:43.527782 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:43.527782 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:43.527782 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:43.527782 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:02:43.527782 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:02:43.527782 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b22f91a3-0dc4-4228-9510-8605086caef8 could not be found. Aug 03 02:02:43.527782 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:43.533165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1f07af30-ed2b-4c40-b5da-fedebdd1fe32 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Returning 404 to user: Instance b22f91a3-0dc4-4228-9510-8605086caef8 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:02:43.536045 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1f07af30-ed2b-4c40-b5da-fedebdd1fe32 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8" status: 404 len: 111 microversion: 2.1 time: 0.125286 Aug 03 02:02:43.539542 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1599/3149] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:43 2022] GET /compute/v2.1/servers/b22f91a3-0dc4-4228-9510-8605086caef8 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:02:43.554514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b2bb4a96-f45e-482a-85e9-e59eadc1c258 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:43.555717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b2bb4a96-f45e-482a-85e9-e59eadc1c258 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: e5828876-bf1f-481e-9960-b98652a1ce58] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:43.577106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2bb4a96-f45e-482a-85e9-e59eadc1c258 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:43.580002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2bb4a96-f45e-482a-85e9-e59eadc1c258 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:43.583726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2bb4a96-f45e-482a-85e9-e59eadc1c258 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:43.584469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2bb4a96-f45e-482a-85e9-e59eadc1c258 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:43.642513 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-b2bb4a96-f45e-482a-85e9-e59eadc1c258 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] HTTP exception thrown: Instance e5828876-bf1f-481e-9960-b98652a1ce58 could not be found. Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b2bb4a96-f45e-482a-85e9-e59eadc1c258 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Request method failure captured: Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 HTTP/1.1 Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dZofcTz_x2_7Lj1YEl6R12KxRSOiZkZiWzL30t623FiVy913gQvbNGAvI0w9tEOWmMse3IGx8KMoyzuQGFPkISyW4w855Uc6Xe9jv8rI8g40HxWgpW7y6poTWGDc1_pVV2lAI3HiwZn-pq0YEQAOwE0O3zhX-NramgI9ImnhQefFic Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66bb501c093b4f47a1a50eb37387bb14", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}] Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 3d335144d6f34ae78eaa6001b906a0df Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance e5828876-bf1f-481e-9960-b98652a1ce58 could not be found. Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'e5828876-bf1f-481e-9960-b98652a1ce58'} Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5828876-bf1f-481e-9960-b98652a1ce58 could not be found. Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5828876-bf1f-481e-9960-b98652a1ce58 could not be found. Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:43.644611 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:43.648592 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:43.648592 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:43.648592 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:43.648592 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:02:43.648592 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:02:43.648592 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5828876-bf1f-481e-9960-b98652a1ce58 could not be found. Aug 03 02:02:43.648592 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:02:43.650747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b2bb4a96-f45e-482a-85e9-e59eadc1c258 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Returning 404 to user: Instance e5828876-bf1f-481e-9960-b98652a1ce58 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:02:43.651976 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b2bb4a96-f45e-482a-85e9-e59eadc1c258 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58" status: 404 len: 111 microversion: 2.1 time: 0.107554 Aug 03 02:02:43.655297 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1600/3150] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:43 2022] GET /compute/v2.1/servers/e5828876-bf1f-481e-9960-b98652a1ce58 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:02:43.665315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5de2582e-66e3-4b6e-a8ef-cebf6bdc1c00 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:43.714182 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5de2582e-66e3-4b6e-a8ef-cebf6bdc1c00 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/d1fe1cce-fb90-4322-883d-83fb6f40bba9" status: 204 len: 0 microversion: 2.1 time: 0.051569 Aug 03 02:02:43.717361 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1601/3151] 10.222.0.67 () {58 vars in 1266 bytes} [Wed Aug 3 02:02:43 2022] DELETE /compute/v2.1/os-server-groups/d1fe1cce-fb90-4322-883d-83fb6f40bba9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:02:43.732698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c1e34a51-de96-4a62-8b27-e535c2b8f7f1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:43.735367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c1e34a51-de96-4a62-8b27-e535c2b8f7f1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: d9c4a0e5-24a7-4482-9879-3f6763ea0fb0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:43.774888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1e34a51-de96-4a62-8b27-e535c2b8f7f1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:43.778428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1e34a51-de96-4a62-8b27-e535c2b8f7f1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:43.782091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1e34a51-de96-4a62-8b27-e535c2b8f7f1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:43.784140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1e34a51-de96-4a62-8b27-e535c2b8f7f1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:43.860559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c1e34a51-de96-4a62-8b27-e535c2b8f7f1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: d9c4a0e5-24a7-4482-9879-3f6763ea0fb0] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:02:44.085008 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c1e34a51-de96-4a62-8b27-e535c2b8f7f1 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0" status: 204 len: 0 microversion: 2.1 time: 0.363304 Aug 03 02:02:44.086169 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1602/3152] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:02:43 2022] DELETE /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:02:44.103092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b8f6135-c6f5-44a2-a89c-f9f45b5b06c8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:44.104293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8b8f6135-c6f5-44a2-a89c-f9f45b5b06c8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:44.124919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b8f6135-c6f5-44a2-a89c-f9f45b5b06c8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:44.128453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b8f6135-c6f5-44a2-a89c-f9f45b5b06c8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:44.129891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b8f6135-c6f5-44a2-a89c-f9f45b5b06c8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:44.161330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b8f6135-c6f5-44a2-a89c-f9f45b5b06c8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:44.281546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8b8f6135-c6f5-44a2-a89c-f9f45b5b06c8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:02:44.347428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-19304378-3381-462d-b6d9-7da248b95aca tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:44.365410 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-19304378-3381-462d-b6d9-7da248b95aca tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1366 microversion: 2.1 time: 0.939496 Aug 03 02:02:44.368950 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1551/3153] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:43 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1366 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:44.385270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1194531421", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "57018bbe-ac26-4922-b137-0c3866a873db"}], "security_groups": [{"name": "tempest-securitygroup--1968763831"}], "key_name": "tempest-keypair-1075513856", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:44.521644 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8b8f6135-c6f5-44a2-a89c-f9f45b5b06c8 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 204 len: 0 microversion: 2.1 time: 0.426087 Aug 03 02:02:44.522610 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1603/3154] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:02:44 2022] DELETE /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:02:44.542613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d80414c2-386f-4df9-8cce-218b766d499a tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:44.546192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d80414c2-386f-4df9-8cce-218b766d499a tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: d9c4a0e5-24a7-4482-9879-3f6763ea0fb0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:44.553705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d80414c2-386f-4df9-8cce-218b766d499a tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:44.555664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d80414c2-386f-4df9-8cce-218b766d499a tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:44.556933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d80414c2-386f-4df9-8cce-218b766d499a tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:44.557832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d80414c2-386f-4df9-8cce-218b766d499a tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:44.780840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] validate_networks() for [('57018bbe-ac26-4922-b137-0c3866a873db', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:02:45.124607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d80414c2-386f-4df9-8cce-218b766d499a tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:45.154468 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d80414c2-386f-4df9-8cce-218b766d499a tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0" status: 200 len: 1473 microversion: 2.1 time: 0.627409 Aug 03 02:02:45.155997 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1604/3155] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:44 2022] GET /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 => generated 1473 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:45.169095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-5c96025d-02c6-4f5b-bca2-db91835f89a6 req-2159d7e0-ad2c-4398-a988-429f0dbfa556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99358f36-9bc7-4e58-8a98-70b4e391e244", "tag": "75880f3c-9e7a-4a26-9ab7-243bab43e9a8"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:45.209307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5c96025d-02c6-4f5b-bca2-db91835f89a6 req-2159d7e0-ad2c-4398-a988-429f0dbfa556 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:45.210385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5c96025d-02c6-4f5b-bca2-db91835f89a6 req-2159d7e0-ad2c-4398-a988-429f0dbfa556 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:45.243591 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-5c96025d-02c6-4f5b-bca2-db91835f89a6 req-2159d7e0-ad2c-4398-a988-429f0dbfa556 service nova] Creating event network-changed:75880f3c-9e7a-4a26-9ab7-243bab43e9a8 for instance 99358f36-9bc7-4e58-8a98-70b4e391e244 on n-h1-826529-8 Aug 03 02:02:45.259319 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-5c96025d-02c6-4f5b-bca2-db91835f89a6 req-2159d7e0-ad2c-4398-a988-429f0dbfa556 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101455 Aug 03 02:02:45.260183 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1605/3156] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:45.395000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c3d7f590-22ed-4cd9-89d7-c1ac2f21cbf1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:45.396608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c3d7f590-22ed-4cd9-89d7-c1ac2f21cbf1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:45.418807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3d7f590-22ed-4cd9-89d7-c1ac2f21cbf1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:45.419466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3d7f590-22ed-4cd9-89d7-c1ac2f21cbf1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:45.433452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3d7f590-22ed-4cd9-89d7-c1ac2f21cbf1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:45.434008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3d7f590-22ed-4cd9-89d7-c1ac2f21cbf1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:45.919911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c3d7f590-22ed-4cd9-89d7-c1ac2f21cbf1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:45.941725 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c3d7f590-22ed-4cd9-89d7-c1ac2f21cbf1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1366 microversion: 2.1 time: 0.552371 Aug 03 02:02:45.956439 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1606/3157] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:45 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1366 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:45.979385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Getting quotas for project e58f4b233c354db7be024f63337a78f0. Resources: dict_keys(['metadata_items']) {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:02:45.984635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-241b2982-6def-452f-91e5-726844a65bc0 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:45.987830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-241b2982-6def-452f-91e5-726844a65bc0 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:46.004645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Getting quotas for user 635b99a4523149d08cf149f321420288 and project e58f4b233c354db7be024f63337a78f0. Resources: dict_keys(['metadata_items']) {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:02:46.012034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-241b2982-6def-452f-91e5-726844a65bc0 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:46.014077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-241b2982-6def-452f-91e5-726844a65bc0 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:46.019013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-241b2982-6def-452f-91e5-726844a65bc0 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:46.020737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-241b2982-6def-452f-91e5-726844a65bc0 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:46.057611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:02:46.060996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:02:46.062939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:02:46.065174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:02:46.065776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:02:46.085585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-241b2982-6def-452f-91e5-726844a65bc0 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:02:46.098654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:46.100670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:46.104774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:46.108493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:46.159632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Getting quotas for project e58f4b233c354db7be024f63337a78f0. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:02:46.166979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Getting quotas for user 635b99a4523149d08cf149f321420288 and project e58f4b233c354db7be024f63337a78f0. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:02:46.207104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:02:46.212871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:02:46.316340 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-241b2982-6def-452f-91e5-726844a65bc0 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "DELETE /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 204 len: 0 microversion: 2.1 time: 0.345532 Aug 03 02:02:46.319271 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1607/3158] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:02:45 2022] DELETE /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:02:46.339127 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a1e176ee-85dd-4751-9001-d081e5c69861 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.968972 Aug 03 02:02:46.340152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8c6fe8d-8725-4f5e-9e70-6bc44c00d6c7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:46.342028 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1552/3159] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:02:44 2022] POST /compute/v2.1/servers => generated 407 bytes in 1973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:02:46.346997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8c6fe8d-8725-4f5e-9e70-6bc44c00d6c7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: d9c4a0e5-24a7-4482-9879-3f6763ea0fb0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:46.352094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5f02b293-4528-4e29-8d7a-528e2637d624 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:46.359823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5f02b293-4528-4e29-8d7a-528e2637d624 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:46.388692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f02b293-4528-4e29-8d7a-528e2637d624 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:46.389426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f02b293-4528-4e29-8d7a-528e2637d624 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:46.391123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f02b293-4528-4e29-8d7a-528e2637d624 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:46.391572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f02b293-4528-4e29-8d7a-528e2637d624 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:46.394004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8c6fe8d-8725-4f5e-9e70-6bc44c00d6c7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:46.396754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8c6fe8d-8725-4f5e-9e70-6bc44c00d6c7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:46.405757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8c6fe8d-8725-4f5e-9e70-6bc44c00d6c7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:46.407273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8c6fe8d-8725-4f5e-9e70-6bc44c00d6c7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:46.737666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5f02b293-4528-4e29-8d7a-528e2637d624 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:46.752968 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5f02b293-4528-4e29-8d7a-528e2637d624 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1514 microversion: 2.1 time: 0.405413 Aug 03 02:02:46.753902 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1553/3160] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:46 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1514 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:46.758671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9cc7c6ff-707e-4665-9859-76740a9f2633 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:46.764875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9cc7c6ff-707e-4665-9859-76740a9f2633 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:46.772348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:46.871671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9cc7c6ff-707e-4665-9859-76740a9f2633 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:46.906224 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9cc7c6ff-707e-4665-9859-76740a9f2633 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1270 microversion: 2.1 time: 0.151113 Aug 03 02:02:46.922436 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1554/3161] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:46 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:46.970490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-59fee312-7206-4fcf-8a89-28917e531c62 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:46.973424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-59fee312-7206-4fcf-8a89-28917e531c62 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:47.004230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59fee312-7206-4fcf-8a89-28917e531c62 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:47.004820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59fee312-7206-4fcf-8a89-28917e531c62 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:47.005507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59fee312-7206-4fcf-8a89-28917e531c62 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:47.014782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8c6fe8d-8725-4f5e-9e70-6bc44c00d6c7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:47.026117 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8c6fe8d-8725-4f5e-9e70-6bc44c00d6c7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0" status: 200 len: 1473 microversion: 2.1 time: 0.704674 Aug 03 02:02:47.030439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59fee312-7206-4fcf-8a89-28917e531c62 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:47.037747 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1608/3162] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:46 2022] GET /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 => generated 1473 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:47.401952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-59fee312-7206-4fcf-8a89-28917e531c62 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:47.412622 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-59fee312-7206-4fcf-8a89-28917e531c62 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1366 microversion: 2.1 time: 0.448436 Aug 03 02:02:47.426547 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1555/3163] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:46 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:47.777428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4e4df3db-e054-4779-8a9b-5d0a57321111 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:47.778255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4e4df3db-e054-4779-8a9b-5d0a57321111 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:47.786836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e4df3db-e054-4779-8a9b-5d0a57321111 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:47.787677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e4df3db-e054-4779-8a9b-5d0a57321111 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:47.789254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e4df3db-e054-4779-8a9b-5d0a57321111 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:47.790299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e4df3db-e054-4779-8a9b-5d0a57321111 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:47.823113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:47.937625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-84b52f13-31b0-43c2-816f-c8293235d222 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:47.938635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-84b52f13-31b0-43c2-816f-c8293235d222 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:47.945550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-84b52f13-31b0-43c2-816f-c8293235d222 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:47.946400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-84b52f13-31b0-43c2-816f-c8293235d222 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:47.947300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-84b52f13-31b0-43c2-816f-c8293235d222 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:47.947954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-84b52f13-31b0-43c2-816f-c8293235d222 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:48.036090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-84b52f13-31b0-43c2-816f-c8293235d222 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:48.040339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4e4df3db-e054-4779-8a9b-5d0a57321111 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:48.048051 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-84b52f13-31b0-43c2-816f-c8293235d222 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1274 microversion: 2.1 time: 0.116011 Aug 03 02:02:48.048645 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1556/3164] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:47 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1274 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:48.052722 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4e4df3db-e054-4779-8a9b-5d0a57321111 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1514 microversion: 2.1 time: 0.278777 Aug 03 02:02:48.054016 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1609/3165] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:47 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1514 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:48.065573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-42da77c8-96f0-4698-b92e-0725eb5350ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:48.066206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-42da77c8-96f0-4698-b92e-0725eb5350ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: d9c4a0e5-24a7-4482-9879-3f6763ea0fb0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:48.072577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42da77c8-96f0-4698-b92e-0725eb5350ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:48.073174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42da77c8-96f0-4698-b92e-0725eb5350ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:48.074387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42da77c8-96f0-4698-b92e-0725eb5350ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:48.074387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42da77c8-96f0-4698-b92e-0725eb5350ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:48.249956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-42da77c8-96f0-4698-b92e-0725eb5350ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:48.264016 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-42da77c8-96f0-4698-b92e-0725eb5350ea tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0" status: 200 len: 1473 microversion: 2.1 time: 0.202114 Aug 03 02:02:48.267344 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1557/3166] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:48 2022] GET /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 => generated 1473 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:48.435274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-12974212-348e-46dc-bf0a-bce8f1366953 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:48.436249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-12974212-348e-46dc-bf0a-bce8f1366953 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:48.438835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:48.451214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-12974212-348e-46dc-bf0a-bce8f1366953 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:48.462257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-12974212-348e-46dc-bf0a-bce8f1366953 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:48.463328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-12974212-348e-46dc-bf0a-bce8f1366953 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:48.464064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-12974212-348e-46dc-bf0a-bce8f1366953 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:48.775219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:48.881862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-12974212-348e-46dc-bf0a-bce8f1366953 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:48.897096 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-12974212-348e-46dc-bf0a-bce8f1366953 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1366 microversion: 2.1 time: 0.466429 Aug 03 02:02:48.905984 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1610/3167] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:48 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1366 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:49.077029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-52817b2c-c343-488e-b4e7-3cdf8c774706 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:49.077670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-86d15e8c-ec83-400a-befa-3adda78c4684 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:49.078078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-52817b2c-c343-488e-b4e7-3cdf8c774706 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:49.078167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-86d15e8c-ec83-400a-befa-3adda78c4684 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:49.085320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52817b2c-c343-488e-b4e7-3cdf8c774706 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:49.091662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52817b2c-c343-488e-b4e7-3cdf8c774706 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:49.093971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86d15e8c-ec83-400a-befa-3adda78c4684 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:49.094830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86d15e8c-ec83-400a-befa-3adda78c4684 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:49.096437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52817b2c-c343-488e-b4e7-3cdf8c774706 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:49.096897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52817b2c-c343-488e-b4e7-3cdf8c774706 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:49.097135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86d15e8c-ec83-400a-befa-3adda78c4684 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:49.097852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86d15e8c-ec83-400a-befa-3adda78c4684 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:49.432165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-52817b2c-c343-488e-b4e7-3cdf8c774706 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:49.441630 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-52817b2c-c343-488e-b4e7-3cdf8c774706 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1328 microversion: 2.1 time: 0.369225 Aug 03 02:02:49.451517 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1611/3168] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:49 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1328 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:49.456958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-73fa7c98-8192-4182-b5f1-52f41934b758 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:49.459957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-73fa7c98-8192-4182-b5f1-52f41934b758 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: d9c4a0e5-24a7-4482-9879-3f6763ea0fb0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:49.478655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73fa7c98-8192-4182-b5f1-52f41934b758 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:49.479714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73fa7c98-8192-4182-b5f1-52f41934b758 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:49.480982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73fa7c98-8192-4182-b5f1-52f41934b758 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:49.482265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73fa7c98-8192-4182-b5f1-52f41934b758 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:49.627734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-86d15e8c-ec83-400a-befa-3adda78c4684 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:49.643527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-73fa7c98-8192-4182-b5f1-52f41934b758 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:49.647803 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-86d15e8c-ec83-400a-befa-3adda78c4684 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1514 microversion: 2.1 time: 0.576043 Aug 03 02:02:49.648771 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1558/3169] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:49 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1514 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:49.655313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-9e093740-0ad8-4787-9b7c-d418311b3224 req-9be710b3-96c6-4ceb-aa5e-7499f7c9afcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c4a0e5-24a7-4482-9879-3f6763ea0fb0", "name": "network-vif-deleted", "tag": "6c61232f-31f0-4ddd-8700-46f556c85fa6"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:49.667351 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-73fa7c98-8192-4182-b5f1-52f41934b758 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0" status: 200 len: 1303 microversion: 2.1 time: 0.214215 Aug 03 02:02:49.684948 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1612/3170] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:49 2022] GET /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 => generated 1303 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:49.692757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9e093740-0ad8-4787-9b7c-d418311b3224 req-9be710b3-96c6-4ceb-aa5e-7499f7c9afcf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:49.692757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9e093740-0ad8-4787-9b7c-d418311b3224 req-9be710b3-96c6-4ceb-aa5e-7499f7c9afcf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:49.741615 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-9e093740-0ad8-4787-9b7c-d418311b3224 req-9be710b3-96c6-4ceb-aa5e-7499f7c9afcf service nova] Creating event network-vif-deleted:6c61232f-31f0-4ddd-8700-46f556c85fa6 for instance d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 on n-h2-826529-8 Aug 03 02:02:49.763593 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-9e093740-0ad8-4787-9b7c-d418311b3224 req-9be710b3-96c6-4ceb-aa5e-7499f7c9afcf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113149 Aug 03 02:02:49.764682 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1559/3171] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:49.923354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-57f8390b-da65-4f3b-9ee7-0842eed5258e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:49.924504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-57f8390b-da65-4f3b-9ee7-0842eed5258e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:49.947193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57f8390b-da65-4f3b-9ee7-0842eed5258e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:49.951651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57f8390b-da65-4f3b-9ee7-0842eed5258e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:49.953493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57f8390b-da65-4f3b-9ee7-0842eed5258e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:49.955534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57f8390b-da65-4f3b-9ee7-0842eed5258e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:50.022654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-002f6e65-af03-403e-9da6-519ea5bf79cd tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:50.024390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-002f6e65-af03-403e-9da6-519ea5bf79cd tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:50.053856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-002f6e65-af03-403e-9da6-519ea5bf79cd tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:50.054781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-002f6e65-af03-403e-9da6-519ea5bf79cd tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:50.064435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-002f6e65-af03-403e-9da6-519ea5bf79cd tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:50.065508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-002f6e65-af03-403e-9da6-519ea5bf79cd tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:50.147190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-002f6e65-af03-403e-9da6-519ea5bf79cd tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:02:50.355769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-57f8390b-da65-4f3b-9ee7-0842eed5258e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:50.375012 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-57f8390b-da65-4f3b-9ee7-0842eed5258e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1366 microversion: 2.1 time: 0.455769 Aug 03 02:02:50.382093 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1560/3172] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:49 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1366 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:50.396444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-96c620f3-e023-4505-94fc-2590a41a4fb9 req-82fe5620-7a0b-47c1-b2a2-bf84cdc1154f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91646d0d-7cde-4a99-9ffc-d4281bc31566", "name": "network-vif-deleted", "tag": "73a006d2-6970-4db7-af83-88559a774ddb"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:50.417743 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-002f6e65-af03-403e-9da6-519ea5bf79cd tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "DELETE /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 204 len: 0 microversion: 2.32 time: 0.730200 Aug 03 02:02:50.425574 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1613/3173] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:02:49 2022] DELETE /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 02:02:50.427434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-96c620f3-e023-4505-94fc-2590a41a4fb9 req-82fe5620-7a0b-47c1-b2a2-bf84cdc1154f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:50.428263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-96c620f3-e023-4505-94fc-2590a41a4fb9 req-82fe5620-7a0b-47c1-b2a2-bf84cdc1154f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:50.463126 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-96c620f3-e023-4505-94fc-2590a41a4fb9 req-82fe5620-7a0b-47c1-b2a2-bf84cdc1154f service nova] Creating event network-vif-deleted:73a006d2-6970-4db7-af83-88559a774ddb for instance 91646d0d-7cde-4a99-9ffc-d4281bc31566 on n-h2-826529-8 Aug 03 02:02:50.481557 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-96c620f3-e023-4505-94fc-2590a41a4fb9 req-82fe5620-7a0b-47c1-b2a2-bf84cdc1154f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097333 Aug 03 02:02:50.484812 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1561/3174] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:50.492994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-34e57192-6ad7-4ea5-ac0b-6c0b7c0d03f9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:50.496871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-34e57192-6ad7-4ea5-ac0b-6c0b7c0d03f9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:50.504610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-90bf051e-ec50-4453-baa2-cdac0f05032c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:50.505508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-90bf051e-ec50-4453-baa2-cdac0f05032c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:50.507367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34e57192-6ad7-4ea5-ac0b-6c0b7c0d03f9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:50.508098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34e57192-6ad7-4ea5-ac0b-6c0b7c0d03f9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:50.509131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34e57192-6ad7-4ea5-ac0b-6c0b7c0d03f9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:50.509841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34e57192-6ad7-4ea5-ac0b-6c0b7c0d03f9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:50.530224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90bf051e-ec50-4453-baa2-cdac0f05032c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:50.532961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90bf051e-ec50-4453-baa2-cdac0f05032c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:50.534071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90bf051e-ec50-4453-baa2-cdac0f05032c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:50.535281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90bf051e-ec50-4453-baa2-cdac0f05032c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:50.620325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-34e57192-6ad7-4ea5-ac0b-6c0b7c0d03f9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:50.635218 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-34e57192-6ad7-4ea5-ac0b-6c0b7c0d03f9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1328 microversion: 2.1 time: 0.147672 Aug 03 02:02:50.647741 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1562/3175] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:50 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1328 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:50.677135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5ec1ccaa-5e40-4df3-9982-16e89632496e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:50.677776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5ec1ccaa-5e40-4df3-9982-16e89632496e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:50.685536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ec1ccaa-5e40-4df3-9982-16e89632496e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:50.686005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ec1ccaa-5e40-4df3-9982-16e89632496e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:50.686838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ec1ccaa-5e40-4df3-9982-16e89632496e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:50.687545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ec1ccaa-5e40-4df3-9982-16e89632496e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:50.790397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ec1ccaa-5e40-4df3-9982-16e89632496e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:50.791173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ec1ccaa-5e40-4df3-9982-16e89632496e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:50.792439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-5ec1ccaa-5e40-4df3-9982-16e89632496e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lazy-loading 'fault' on Instance uuid 91646d0d-7cde-4a99-9ffc-d4281bc31566 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:02:51.044821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5ec1ccaa-5e40-4df3-9982-16e89632496e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:51.069401 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5ec1ccaa-5e40-4df3-9982-16e89632496e tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 200 len: 1308 microversion: 2.1 time: 0.399331 Aug 03 02:02:51.092084 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1563/3176] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:50 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:51.111347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-35ca15c7-abf9-4df8-b7ef-8b7bf4f42753 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:51.112363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-35ca15c7-abf9-4df8-b7ef-8b7bf4f42753 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: d9c4a0e5-24a7-4482-9879-3f6763ea0fb0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:51.131850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35ca15c7-abf9-4df8-b7ef-8b7bf4f42753 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.132060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-90bf051e-ec50-4453-baa2-cdac0f05032c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:51.132758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35ca15c7-abf9-4df8-b7ef-8b7bf4f42753 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:51.133891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35ca15c7-abf9-4df8-b7ef-8b7bf4f42753 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.135774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35ca15c7-abf9-4df8-b7ef-8b7bf4f42753 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:51.148766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-90bf051e-ec50-4453-baa2-cdac0f05032c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:51.163247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-90bf051e-ec50-4453-baa2-cdac0f05032c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:51.171576 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-90bf051e-ec50-4453-baa2-cdac0f05032c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2958 microversion: 2.32 time: 0.739914 Aug 03 02:02:51.172920 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1614/3177] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:02:50 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2958 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:02:51.186350 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-35ca15c7-abf9-4df8-b7ef-8b7bf4f42753 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] HTTP exception thrown: Instance d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 could not be found. Aug 03 02:02:51.188172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9b70a119-d1d1-4b99-85ea-43175790b9d3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-35ca15c7-abf9-4df8-b7ef-8b7bf4f42753 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Request method failure captured: Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 HTTP/1.1 Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dZofcTz_x2_7Lj1YEl6R12KxRSOiZkZiWzL30t623FiVy913gQvbNGAvI0w9tEOWmMse3IGx8KMoyzuQGFPkISyW4w855Uc6Xe9jv8rI8g40HxWgpW7y6poTWGDc1_pVV2lAI3HiwZn-pq0YEQAOwE0O3zhX-NramgI9ImnhQefFic Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66bb501c093b4f47a1a50eb37387bb14", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}] Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 3d335144d6f34ae78eaa6001b906a0df Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 could not be found. Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'd9c4a0e5-24a7-4482-9879-3f6763ea0fb0'} Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 could not be found. Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 could not be found. Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:51.188695 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:51.193940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:51.193940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:51.193940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:51.193940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:02:51.193940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:02:51.193940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 could not be found. Aug 03 02:02:51.193940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:51.193940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-35ca15c7-abf9-4df8-b7ef-8b7bf4f42753 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Returning 404 to user: Instance d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:02:51.193940 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-35ca15c7-abf9-4df8-b7ef-8b7bf4f42753 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0" status: 404 len: 111 microversion: 2.1 time: 0.099018 Aug 03 02:02:51.194753 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1564/3178] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:51 2022] GET /compute/v2.1/servers/d9c4a0e5-24a7-4482-9879-3f6763ea0fb0 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:02:51.196295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9b70a119-d1d1-4b99-85ea-43175790b9d3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:51.204756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b70a119-d1d1-4b99-85ea-43175790b9d3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.206873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b70a119-d1d1-4b99-85ea-43175790b9d3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:51.207902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b70a119-d1d1-4b99-85ea-43175790b9d3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.208346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b70a119-d1d1-4b99-85ea-43175790b9d3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:51.221301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-10161d7d-eac9-447e-afb3-4b692e5956b7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:51.223105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-10161d7d-eac9-447e-afb3-4b692e5956b7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:51.233196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-10161d7d-eac9-447e-afb3-4b692e5956b7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.233972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-10161d7d-eac9-447e-afb3-4b692e5956b7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:51.235109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-10161d7d-eac9-447e-afb3-4b692e5956b7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.235816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-10161d7d-eac9-447e-afb3-4b692e5956b7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:51.306895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-10161d7d-eac9-447e-afb3-4b692e5956b7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.307802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-10161d7d-eac9-447e-afb3-4b692e5956b7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:51.308488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-10161d7d-eac9-447e-afb3-4b692e5956b7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lazy-loading 'fault' on Instance uuid 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:02:51.327657 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9b70a119-d1d1-4b99-85ea-43175790b9d3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments/07c5172f-8e8b-4dee-adca-77157e9125ab" status: 200 len: 194 microversion: 2.20 time: 0.150862 Aug 03 02:02:51.328309 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1615/3179] 10.222.0.67 () {60 vars in 1454 bytes} [Wed Aug 3 02:02:51 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments/07c5172f-8e8b-4dee-adca-77157e9125ab => generated 194 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:02:51.407422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d8e8cf8-7d0e-4de6-9b3e-18c1df81c1a9 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:51.408116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6d8e8cf8-7d0e-4de6-9b3e-18c1df81c1a9 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:51.415195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d8e8cf8-7d0e-4de6-9b3e-18c1df81c1a9 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.415711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d8e8cf8-7d0e-4de6-9b3e-18c1df81c1a9 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:51.416523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d8e8cf8-7d0e-4de6-9b3e-18c1df81c1a9 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.416966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d8e8cf8-7d0e-4de6-9b3e-18c1df81c1a9 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:51.470593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-10161d7d-eac9-447e-afb3-4b692e5956b7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:51.497092 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-10161d7d-eac9-447e-afb3-4b692e5956b7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 200 len: 1308 microversion: 2.1 time: 0.294780 Aug 03 02:02:51.500364 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1565/3180] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:51 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 1308 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:51.509535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-462ad8b1-2950-4a75-8eac-f532020d1359 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:51.510196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-462ad8b1-2950-4a75-8eac-f532020d1359 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:51.537574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-462ad8b1-2950-4a75-8eac-f532020d1359 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.538194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-462ad8b1-2950-4a75-8eac-f532020d1359 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:51.539828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-462ad8b1-2950-4a75-8eac-f532020d1359 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.541612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-462ad8b1-2950-4a75-8eac-f532020d1359 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:51.714421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-462ad8b1-2950-4a75-8eac-f532020d1359 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lazy-loading 'services' on Instance uuid 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:02:51.791580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6d8e8cf8-7d0e-4de6-9b3e-18c1df81c1a9 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:51.805026 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6d8e8cf8-7d0e-4de6-9b3e-18c1df81c1a9 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1366 microversion: 2.1 time: 0.402735 Aug 03 02:02:51.805567 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1616/3181] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:51 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:51.812598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0c0301e8-c636-42bc-94eb-a82759d0a5ed tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:51.813383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0c0301e8-c636-42bc-94eb-a82759d0a5ed tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:51.823495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c0301e8-c636-42bc-94eb-a82759d0a5ed tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.824212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c0301e8-c636-42bc-94eb-a82759d0a5ed tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:51.826864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c0301e8-c636-42bc-94eb-a82759d0a5ed tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.826864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c0301e8-c636-42bc-94eb-a82759d0a5ed tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:51.879927 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-462ad8b1-2950-4a75-8eac-f532020d1359 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments/07c5172f-8e8b-4dee-adca-77157e9125ab" status: 202 len: 0 microversion: 2.20 time: 0.378151 Aug 03 02:02:51.880552 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1566/3182] 10.222.0.67 () {60 vars in 1457 bytes} [Wed Aug 3 02:02:51 2022] DELETE /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments/07c5172f-8e8b-4dee-adca-77157e9125ab => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:02:51.889882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-886974f6-4837-42e3-bc80-4f4d9891cb69 req-d572b977-8bcf-445f-809d-15a1a52a332b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a4a5809-822e-4ca2-a69c-f4c0a7eb200c", "name": "network-vif-deleted", "tag": "98bf53e4-9a43-4434-b546-96cc0a850ea8"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:51.922103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-886974f6-4837-42e3-bc80-4f4d9891cb69 req-d572b977-8bcf-445f-809d-15a1a52a332b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.922649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-886974f6-4837-42e3-bc80-4f4d9891cb69 req-d572b977-8bcf-445f-809d-15a1a52a332b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:51.925832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:51.952507 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-886974f6-4837-42e3-bc80-4f4d9891cb69 req-d572b977-8bcf-445f-809d-15a1a52a332b service nova] Creating event network-vif-deleted:98bf53e4-9a43-4434-b546-96cc0a850ea8 for instance 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c on n-h2-826529-8 Aug 03 02:02:51.959056 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-886974f6-4837-42e3-bc80-4f4d9891cb69 req-d572b977-8bcf-445f-809d-15a1a52a332b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076904 Aug 03 02:02:51.960502 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1567/3183] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:51.971169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-48ade87f-47c3-4e32-8968-f1b3f6048ec8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:51.974004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-48ade87f-47c3-4e32-8968-f1b3f6048ec8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:51.982763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-48ade87f-47c3-4e32-8968-f1b3f6048ec8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.983649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-48ade87f-47c3-4e32-8968-f1b3f6048ec8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:51.984693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-48ade87f-47c3-4e32-8968-f1b3f6048ec8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:51.985365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-48ade87f-47c3-4e32-8968-f1b3f6048ec8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:52.033437 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-48ade87f-47c3-4e32-8968-f1b3f6048ec8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071428 Aug 03 02:02:52.034813 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1568/3184] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 02:02:51 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:02:52.080529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0c0301e8-c636-42bc-94eb-a82759d0a5ed tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:52.091093 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0c0301e8-c636-42bc-94eb-a82759d0a5ed tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1396 microversion: 2.1 time: 0.283214 Aug 03 02:02:52.092651 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1617/3185] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:51 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1396 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:52.099984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-de45786e-ff40-46d7-b02f-e6f886d0a776 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:52.100770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-de45786e-ff40-46d7-b02f-e6f886d0a776 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 91646d0d-7cde-4a99-9ffc-d4281bc31566] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:52.109563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de45786e-ff40-46d7-b02f-e6f886d0a776 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:52.110013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de45786e-ff40-46d7-b02f-e6f886d0a776 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:52.112393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de45786e-ff40-46d7-b02f-e6f886d0a776 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:52.113136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de45786e-ff40-46d7-b02f-e6f886d0a776 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:52.137293 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-de45786e-ff40-46d7-b02f-e6f886d0a776 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] HTTP exception thrown: Instance 91646d0d-7cde-4a99-9ffc-d4281bc31566 could not be found. Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-de45786e-ff40-46d7-b02f-e6f886d0a776 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Request method failure captured: Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 HTTP/1.1 Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dad4ahuj48aSemPcxZZEhg6pISuNFbGj8qLszH8HzXjmwjVlj_Ar6f7qbwHRtEp6bzbvsfqvrl85pMXfUIbqOLzj-DL8qrS8_n4yCWxqBPd7bMiVphi1VHH5opD6hd2N2PJz6Jdb_Iy8blpQF8zV33R8ANHQEgdNaS9asaveSaWQLc Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: e8dc5a1c3fbd4cad8b0f2045bb872b0d Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-VolumesAdminNegativeTest-1021915728 Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e8dc5a1c3fbd4cad8b0f2045bb872b0d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e8dc5a1c3fbd4cad8b0f2045bb872b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e8dc5a1c3fbd4cad8b0f2045bb872b0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e8dc5a1c3fbd4cad8b0f2045bb872b0d"}]}] Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-VolumesAdminNegativeTest-1021915728 Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: e8dc5a1c3fbd4cad8b0f2045bb872b0d Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1021915728 Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-VolumesAdminNegativeTest-1021915728-project Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: f009ea44cc4a4c37a236b93a2c5a9028 Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-VolumesAdminNegativeTest-1021915728-project Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 91646d0d-7cde-4a99-9ffc-d4281bc31566 could not be found. Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '91646d0d-7cde-4a99-9ffc-d4281bc31566'} Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91646d0d-7cde-4a99-9ffc-d4281bc31566 could not be found. Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91646d0d-7cde-4a99-9ffc-d4281bc31566 could not be found. Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:52.140968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:52.145428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:52.145428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:52.145428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:52.145428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:02:52.145428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:02:52.145428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91646d0d-7cde-4a99-9ffc-d4281bc31566 could not be found. Aug 03 02:02:52.145428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:52.148099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-de45786e-ff40-46d7-b02f-e6f886d0a776 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Returning 404 to user: Instance 91646d0d-7cde-4a99-9ffc-d4281bc31566 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:02:52.150643 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-de45786e-ff40-46d7-b02f-e6f886d0a776 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566" status: 404 len: 111 microversion: 2.1 time: 0.054265 Aug 03 02:02:52.152462 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1569/3186] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:52 2022] GET /compute/v2.1/servers/91646d0d-7cde-4a99-9ffc-d4281bc31566 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:02:52.208952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e3e321f1-5aa7-4f79-a82b-9950ef554bdb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:52.210489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e3e321f1-5aa7-4f79-a82b-9950ef554bdb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:52.223920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3e321f1-5aa7-4f79-a82b-9950ef554bdb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:52.225150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3e321f1-5aa7-4f79-a82b-9950ef554bdb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:52.226312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3e321f1-5aa7-4f79-a82b-9950ef554bdb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:52.228348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3e321f1-5aa7-4f79-a82b-9950ef554bdb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:52.524353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1facf738-dea6-40c6-b393-4ed76c62e662 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:52.525053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1facf738-dea6-40c6-b393-4ed76c62e662 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:52.546643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1facf738-dea6-40c6-b393-4ed76c62e662 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:52.548174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1facf738-dea6-40c6-b393-4ed76c62e662 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:52.549633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1facf738-dea6-40c6-b393-4ed76c62e662 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:52.550423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1facf738-dea6-40c6-b393-4ed76c62e662 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:52.570472 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-1facf738-dea6-40c6-b393-4ed76c62e662 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] HTTP exception thrown: Instance 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c could not be found. Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1facf738-dea6-40c6-b393-4ed76c62e662 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Request method failure captured: Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c HTTP/1.1 Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dZofcTz_x2_7Lj1YEl6R12KxRSOiZkZiWzL30t623FiVy913gQvbNGAvI0w9tEOWmMse3IGx8KMoyzuQGFPkISyW4w855Uc6Xe9jv8rI8g40HxWgpW7y6poTWGDc1_pVV2lAI3HiwZn-pq0YEQAOwE0O3zhX-NramgI9ImnhQefFic Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66bb501c093b4f47a1a50eb37387bb14", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}] Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 3d335144d6f34ae78eaa6001b906a0df Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c could not be found. Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '4a4a5809-822e-4ca2-a69c-f4c0a7eb200c'} Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c could not be found. Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c could not be found. Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:02:52.573125 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:52.580079 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:02:52.580079 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:02:52.580079 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:02:52.580079 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:02:52.580079 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:02:52.580079 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c could not be found. Aug 03 02:02:52.580079 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:02:52.581867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1facf738-dea6-40c6-b393-4ed76c62e662 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Returning 404 to user: Instance 4a4a5809-822e-4ca2-a69c-f4c0a7eb200c could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:02:52.583843 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1facf738-dea6-40c6-b393-4ed76c62e662 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c" status: 404 len: 111 microversion: 2.1 time: 0.064991 Aug 03 02:02:52.584982 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1570/3187] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:52 2022] GET /compute/v2.1/servers/4a4a5809-822e-4ca2-a69c-f4c0a7eb200c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:02:52.598216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5d46f07d-64f3-42d8-b100-6eda4c0a3e0d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:52.649253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3e321f1-5aa7-4f79-a82b-9950ef554bdb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:52.671649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3e321f1-5aa7-4f79-a82b-9950ef554bdb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:52.676745 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5d46f07d-64f3-42d8-b100-6eda4c0a3e0d tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/6ca1c80e-8953-4e0a-a575-873d5f4c5235" status: 204 len: 0 microversion: 2.1 time: 0.085802 Aug 03 02:02:52.677686 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1571/3188] 10.222.0.67 () {58 vars in 1266 bytes} [Wed Aug 3 02:02:52 2022] DELETE /compute/v2.1/os-server-groups/6ca1c80e-8953-4e0a-a575-873d5f4c5235 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:02:52.687180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3e321f1-5aa7-4f79-a82b-9950ef554bdb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:52.687841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-04d05f2f-5bb2-4641-86ad-d5267c370350 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:52.688362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-04d05f2f-5bb2-4641-86ad-d5267c370350 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:52.691201 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e3e321f1-5aa7-4f79-a82b-9950ef554bdb tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2958 microversion: 2.32 time: 0.486970 Aug 03 02:02:52.709338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04d05f2f-5bb2-4641-86ad-d5267c370350 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:52.709914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04d05f2f-5bb2-4641-86ad-d5267c370350 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:52.710599 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1618/3189] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:02:52 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2958 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:02:52.715461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04d05f2f-5bb2-4641-86ad-d5267c370350 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:52.716386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04d05f2f-5bb2-4641-86ad-d5267c370350 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:52.771256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-57014032-bd2b-4285-8f00-58204341fb16 req-53e44dd9-b89b-4525-8cc1-a319b5a567f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb08bbd-64e7-4cfd-9d16-667eaf5a529e", "tag": "36f2c82b-8079-4a94-86a7-6b8a1d823941"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:52.796893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-57014032-bd2b-4285-8f00-58204341fb16 req-53e44dd9-b89b-4525-8cc1-a319b5a567f9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:52.797754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-57014032-bd2b-4285-8f00-58204341fb16 req-53e44dd9-b89b-4525-8cc1-a319b5a567f9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:52.808252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-04d05f2f-5bb2-4641-86ad-d5267c370350 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:02:52.831961 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-57014032-bd2b-4285-8f00-58204341fb16 req-53e44dd9-b89b-4525-8cc1-a319b5a567f9 service nova] Creating event network-changed:36f2c82b-8079-4a94-86a7-6b8a1d823941 for instance 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e on n-h2-826529-8 Aug 03 02:02:52.850242 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-57014032-bd2b-4285-8f00-58204341fb16 req-53e44dd9-b89b-4525-8cc1-a319b5a567f9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085157 Aug 03 02:02:52.851149 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1619/3190] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:02:52.864989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fea4ce88-a4fe-4b16-9b79-1afb9a2e80d6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:52.865820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fea4ce88-a4fe-4b16-9b79-1afb9a2e80d6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:52.878555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fea4ce88-a4fe-4b16-9b79-1afb9a2e80d6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:52.881788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fea4ce88-a4fe-4b16-9b79-1afb9a2e80d6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:52.884489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fea4ce88-a4fe-4b16-9b79-1afb9a2e80d6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:52.885263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fea4ce88-a4fe-4b16-9b79-1afb9a2e80d6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:52.990085 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-04d05f2f-5bb2-4641-86ad-d5267c370350 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 204 len: 0 microversion: 2.1 time: 0.305588 Aug 03 02:02:52.993726 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1572/3191] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:02:52 2022] DELETE /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:02:53.020367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bea1bcff-5f28-408e-9883-d6ad6cbe8180 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:53.021878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bea1bcff-5f28-408e-9883-d6ad6cbe8180 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:53.052517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bea1bcff-5f28-408e-9883-d6ad6cbe8180 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:53.053758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bea1bcff-5f28-408e-9883-d6ad6cbe8180 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:53.057363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bea1bcff-5f28-408e-9883-d6ad6cbe8180 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:53.059732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bea1bcff-5f28-408e-9883-d6ad6cbe8180 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:53.192786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fea4ce88-a4fe-4b16-9b79-1afb9a2e80d6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:53.220426 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fea4ce88-a4fe-4b16-9b79-1afb9a2e80d6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1366 microversion: 2.1 time: 0.366825 Aug 03 02:02:53.226614 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1620/3192] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:52 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:53.244905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-167e9990-cbf0-443f-a5cd-433aed069076 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:53.255385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-167e9990-cbf0-443f-a5cd-433aed069076 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:53.275747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-167e9990-cbf0-443f-a5cd-433aed069076 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:53.276259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-167e9990-cbf0-443f-a5cd-433aed069076 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:53.281575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-167e9990-cbf0-443f-a5cd-433aed069076 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:53.283194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-167e9990-cbf0-443f-a5cd-433aed069076 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:53.322888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bea1bcff-5f28-408e-9883-d6ad6cbe8180 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:53.332977 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bea1bcff-5f28-408e-9883-d6ad6cbe8180 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1472 microversion: 2.1 time: 0.334108 Aug 03 02:02:53.334183 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1573/3193] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:52 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1472 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:53.339775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3e4ea9c1-0163-4302-b2e9-84e9c322c9c3 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:53.341588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3e4ea9c1-0163-4302-b2e9-84e9c322c9c3 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:53.354456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e4ea9c1-0163-4302-b2e9-84e9c322c9c3 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:53.355412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e4ea9c1-0163-4302-b2e9-84e9c322c9c3 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:53.356783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e4ea9c1-0163-4302-b2e9-84e9c322c9c3 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:53.357803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e4ea9c1-0163-4302-b2e9-84e9c322c9c3 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:53.364572 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-167e9990-cbf0-443f-a5cd-433aed069076 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.136277 Aug 03 02:02:53.365472 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1621/3194] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 02:02:53 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:02:53.545113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3e4ea9c1-0163-4302-b2e9-84e9c322c9c3 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:53.555516 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3e4ea9c1-0163-4302-b2e9-84e9c322c9c3 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1396 microversion: 2.1 time: 0.219018 Aug 03 02:02:53.556123 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1574/3195] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:53 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1396 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:53.727104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a216f556-9583-44cd-9880-ad8b10ad9a1a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:53.727738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a216f556-9583-44cd-9880-ad8b10ad9a1a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:53.738364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a216f556-9583-44cd-9880-ad8b10ad9a1a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:53.739027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a216f556-9583-44cd-9880-ad8b10ad9a1a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:53.740401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a216f556-9583-44cd-9880-ad8b10ad9a1a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:53.741394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a216f556-9583-44cd-9880-ad8b10ad9a1a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:54.113590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a216f556-9583-44cd-9880-ad8b10ad9a1a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:54.128048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a216f556-9583-44cd-9880-ad8b10ad9a1a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:54.130668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a216f556-9583-44cd-9880-ad8b10ad9a1a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:54.132717 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a216f556-9583-44cd-9880-ad8b10ad9a1a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2958 microversion: 2.32 time: 0.411513 Aug 03 02:02:54.148275 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1622/3196] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:02:53 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2958 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:02:54.246292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f6e28dd2-c334-40f7-ba01-e289cf835a7b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:54.248129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f6e28dd2-c334-40f7-ba01-e289cf835a7b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:54.257931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6e28dd2-c334-40f7-ba01-e289cf835a7b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:54.258736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6e28dd2-c334-40f7-ba01-e289cf835a7b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:54.259803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6e28dd2-c334-40f7-ba01-e289cf835a7b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:54.260471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6e28dd2-c334-40f7-ba01-e289cf835a7b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:54.276089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-125195d8-10d3-474a-8a8a-378940bb2600 req-544906c9-29fa-4062-9842-43a3e11ce38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99358f36-9bc7-4e58-8a98-70b4e391e244", "name": "network-vif-plugged", "status": "completed", "tag": "75880f3c-9e7a-4a26-9ab7-243bab43e9a8"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:54.299355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-125195d8-10d3-474a-8a8a-378940bb2600 req-544906c9-29fa-4062-9842-43a3e11ce38c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:54.303422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-125195d8-10d3-474a-8a8a-378940bb2600 req-544906c9-29fa-4062-9842-43a3e11ce38c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:54.336013 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-125195d8-10d3-474a-8a8a-378940bb2600 req-544906c9-29fa-4062-9842-43a3e11ce38c service nova] Creating event network-vif-plugged:75880f3c-9e7a-4a26-9ab7-243bab43e9a8 for instance 99358f36-9bc7-4e58-8a98-70b4e391e244 on n-h1-826529-8 Aug 03 02:02:54.355006 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-125195d8-10d3-474a-8a8a-378940bb2600 req-544906c9-29fa-4062-9842-43a3e11ce38c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080243 Aug 03 02:02:54.355911 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1623/3197] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:54.370589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2261c36-79a6-40c4-8f3e-70a13b4264fd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:54.372858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c2261c36-79a6-40c4-8f3e-70a13b4264fd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:54.382000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2261c36-79a6-40c4-8f3e-70a13b4264fd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:54.382999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2261c36-79a6-40c4-8f3e-70a13b4264fd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:54.383962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2261c36-79a6-40c4-8f3e-70a13b4264fd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:54.384708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2261c36-79a6-40c4-8f3e-70a13b4264fd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:54.632076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f6e28dd2-c334-40f7-ba01-e289cf835a7b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:54.647656 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f6e28dd2-c334-40f7-ba01-e289cf835a7b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1366 microversion: 2.1 time: 0.408693 Aug 03 02:02:54.649853 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1575/3198] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:54 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:54.659287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-12a6ec75-60e1-4f8c-9c5d-310ac3609c9e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:54.664068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-12a6ec75-60e1-4f8c-9c5d-310ac3609c9e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:54.672824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c2261c36-79a6-40c4-8f3e-70a13b4264fd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:54.675638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12a6ec75-60e1-4f8c-9c5d-310ac3609c9e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:54.676208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12a6ec75-60e1-4f8c-9c5d-310ac3609c9e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:54.677111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12a6ec75-60e1-4f8c-9c5d-310ac3609c9e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:54.677795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12a6ec75-60e1-4f8c-9c5d-310ac3609c9e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:54.696359 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c2261c36-79a6-40c4-8f3e-70a13b4264fd tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1472 microversion: 2.1 time: 0.330757 Aug 03 02:02:54.698723 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1624/3199] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:54 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1472 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:54.705922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9f37113a-58c0-459e-8213-341c57a94845 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:54.707416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9f37113a-58c0-459e-8213-341c57a94845 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:54.712834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=90,nova_api:DELETE=3,nova_api:UPDATE=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:54.714648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f37113a-58c0-459e-8213-341c57a94845 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:54.716818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f37113a-58c0-459e-8213-341c57a94845 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:54.716818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f37113a-58c0-459e-8213-341c57a94845 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:54.717267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f37113a-58c0-459e-8213-341c57a94845 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:54.723015 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-12a6ec75-60e1-4f8c-9c5d-310ac3609c9e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070271 Aug 03 02:02:54.723973 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1576/3200] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 02:02:54 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:02:54.929114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9f37113a-58c0-459e-8213-341c57a94845 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:54.934002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:54.945052 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9f37113a-58c0-459e-8213-341c57a94845 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1396 microversion: 2.1 time: 0.245891 Aug 03 02:02:54.960469 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1625/3201] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:54 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1396 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:55.166612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3cc6b13c-3767-4ee6-95b4-04b3361dc076 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:55.167568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3cc6b13c-3767-4ee6-95b4-04b3361dc076 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:55.189366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3cc6b13c-3767-4ee6-95b4-04b3361dc076 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:55.194260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3cc6b13c-3767-4ee6-95b4-04b3361dc076 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:55.195311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3cc6b13c-3767-4ee6-95b4-04b3361dc076 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:55.195780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3cc6b13c-3767-4ee6-95b4-04b3361dc076 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:55.532789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3cc6b13c-3767-4ee6-95b4-04b3361dc076 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:55.548412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3cc6b13c-3767-4ee6-95b4-04b3361dc076 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:55.552210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3cc6b13c-3767-4ee6-95b4-04b3361dc076 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:55.555204 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3cc6b13c-3767-4ee6-95b4-04b3361dc076 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2958 microversion: 2.32 time: 0.392897 Aug 03 02:02:55.557736 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1577/3202] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:02:55 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2958 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:02:55.681118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fe1f3773-2670-48dd-8757-a3cee4a421d1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:55.681955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fe1f3773-2670-48dd-8757-a3cee4a421d1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:55.702506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe1f3773-2670-48dd-8757-a3cee4a421d1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:55.715907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe1f3773-2670-48dd-8757-a3cee4a421d1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:55.717183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe1f3773-2670-48dd-8757-a3cee4a421d1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:55.717830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe1f3773-2670-48dd-8757-a3cee4a421d1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:55.731643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-37b582ce-a82d-4bdb-900a-b5479bc04b78 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:55.734335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-37b582ce-a82d-4bdb-900a-b5479bc04b78 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:55.754173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37b582ce-a82d-4bdb-900a-b5479bc04b78 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:55.755445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37b582ce-a82d-4bdb-900a-b5479bc04b78 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:55.756484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37b582ce-a82d-4bdb-900a-b5479bc04b78 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:55.758197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37b582ce-a82d-4bdb-900a-b5479bc04b78 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:56.073672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fe1f3773-2670-48dd-8757-a3cee4a421d1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:56.120828 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fe1f3773-2670-48dd-8757-a3cee4a421d1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1366 microversion: 2.1 time: 0.444073 Aug 03 02:02:56.121482 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1626/3203] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:55 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:56.141095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:56.166213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-37b582ce-a82d-4bdb-900a-b5479bc04b78 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:56.167983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37aac770-3e3d-4bff-bd98-0d18476658d5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:56.177626 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-37b582ce-a82d-4bdb-900a-b5479bc04b78 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1472 microversion: 2.1 time: 0.452473 Aug 03 02:02:56.178221 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1578/3204] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:55 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1472 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:56.186214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a375e135-d538-470c-a2ca-b4a0549222de tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:56.187274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a375e135-d538-470c-a2ca-b4a0549222de tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:56.195664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a375e135-d538-470c-a2ca-b4a0549222de tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:56.196907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a375e135-d538-470c-a2ca-b4a0549222de tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:56.198204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a375e135-d538-470c-a2ca-b4a0549222de tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:56.198818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a375e135-d538-470c-a2ca-b4a0549222de tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:56.220027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-37aac770-3e3d-4bff-bd98-0d18476658d5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:56.243695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37aac770-3e3d-4bff-bd98-0d18476658d5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:56.244162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37aac770-3e3d-4bff-bd98-0d18476658d5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:56.248186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37aac770-3e3d-4bff-bd98-0d18476658d5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:56.254477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37aac770-3e3d-4bff-bd98-0d18476658d5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:56.337806 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-37aac770-3e3d-4bff-bd98-0d18476658d5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.179666 Aug 03 02:02:56.338926 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1627/3205] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 02:02:56 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:02:56.585892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0150f885-8bc5-49a2-bbc1-8df52b28eee4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:56.586638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0150f885-8bc5-49a2-bbc1-8df52b28eee4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:56.600130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a375e135-d538-470c-a2ca-b4a0549222de tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:56.604692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0150f885-8bc5-49a2-bbc1-8df52b28eee4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:56.605168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0150f885-8bc5-49a2-bbc1-8df52b28eee4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:56.606590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0150f885-8bc5-49a2-bbc1-8df52b28eee4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:56.607064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0150f885-8bc5-49a2-bbc1-8df52b28eee4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:56.619594 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a375e135-d538-470c-a2ca-b4a0549222de tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1396 microversion: 2.1 time: 0.439552 Aug 03 02:02:56.638301 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1579/3206] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:56 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1396 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:57.160974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f9848016-49be-4666-b2cf-a41fcded259a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:57.163039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f9848016-49be-4666-b2cf-a41fcded259a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:57.172484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=20 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:57.174787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9848016-49be-4666-b2cf-a41fcded259a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:57.175642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9848016-49be-4666-b2cf-a41fcded259a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:57.176684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9848016-49be-4666-b2cf-a41fcded259a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:57.177307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9848016-49be-4666-b2cf-a41fcded259a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:57.483097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0150f885-8bc5-49a2-bbc1-8df52b28eee4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:57.518384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0150f885-8bc5-49a2-bbc1-8df52b28eee4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:57.521163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0150f885-8bc5-49a2-bbc1-8df52b28eee4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:57.523250 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0150f885-8bc5-49a2-bbc1-8df52b28eee4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2958 microversion: 2.32 time: 0.941573 Aug 03 02:02:57.524582 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1628/3207] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:02:56 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2958 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:02:57.550065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-671e88f0-a031-4fc3-84bc-696e993376d9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:57.561098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-671e88f0-a031-4fc3-84bc-696e993376d9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:57.574102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-671e88f0-a031-4fc3-84bc-696e993376d9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:57.574613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-671e88f0-a031-4fc3-84bc-696e993376d9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:57.588462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-671e88f0-a031-4fc3-84bc-696e993376d9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:57.589608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-671e88f0-a031-4fc3-84bc-696e993376d9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:57.696481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f9848016-49be-4666-b2cf-a41fcded259a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:57.710307 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f9848016-49be-4666-b2cf-a41fcded259a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1366 microversion: 2.1 time: 0.554641 Aug 03 02:02:57.712136 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1580/3208] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:57 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1366 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:02:57.721268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e4a501e4-9e38-4520-bdf2-9be81109f643 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:57.725676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e4a501e4-9e38-4520-bdf2-9be81109f643 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:57.755895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4a501e4-9e38-4520-bdf2-9be81109f643 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:57.756613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4a501e4-9e38-4520-bdf2-9be81109f643 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:57.758500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4a501e4-9e38-4520-bdf2-9be81109f643 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:57.759290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4a501e4-9e38-4520-bdf2-9be81109f643 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:57.819537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-671e88f0-a031-4fc3-84bc-696e993376d9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:57.843602 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-671e88f0-a031-4fc3-84bc-696e993376d9 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1430 microversion: 2.1 time: 0.316951 Aug 03 02:02:57.848515 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1629/3209] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:57 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1430 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:57.875259 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e4a501e4-9e38-4520-bdf2-9be81109f643 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.161345 Aug 03 02:02:57.876589 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1581/3210] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 02:02:57 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:02:57.879081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7c9ee1af-3763-4f29-b768-1b960a7cc2be tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:57.879877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7c9ee1af-3763-4f29-b768-1b960a7cc2be tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:57.882936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-358bb403-001d-4e7e-a3fb-db70cf59da00 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:57.884138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-358bb403-001d-4e7e-a3fb-db70cf59da00 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:57.896077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-358bb403-001d-4e7e-a3fb-db70cf59da00 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:57.897870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-358bb403-001d-4e7e-a3fb-db70cf59da00 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:57.899242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-358bb403-001d-4e7e-a3fb-db70cf59da00 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:57.900046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-358bb403-001d-4e7e-a3fb-db70cf59da00 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:57.907925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c9ee1af-3763-4f29-b768-1b960a7cc2be tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:57.909594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c9ee1af-3763-4f29-b768-1b960a7cc2be tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:57.912191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c9ee1af-3763-4f29-b768-1b960a7cc2be tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:57.913080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c9ee1af-3763-4f29-b768-1b960a7cc2be tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:57.984214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7c9ee1af-3763-4f29-b768-1b960a7cc2be tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:02:58.224676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-358bb403-001d-4e7e-a3fb-db70cf59da00 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:58.249621 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-358bb403-001d-4e7e-a3fb-db70cf59da00 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1396 microversion: 2.1 time: 0.367994 Aug 03 02:02:58.254326 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1582/3211] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:57 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1396 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:58.266217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-00938ee4-49e7-4bb5-8bd1-a5036734b58a req-f9fc9692-77f8-4218-8ff7-11c41409c1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba033cef-0c1e-4b18-9584-427e6db2fcb1", "name": "network-vif-deleted", "tag": "7291d4ce-8dad-4d1e-8529-b562facf8218"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:58.275318 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7c9ee1af-3763-4f29-b768-1b960a7cc2be tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 204 len: 0 microversion: 2.1 time: 0.422983 Aug 03 02:02:58.280726 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1630/3212] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:02:57 2022] DELETE /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:02:58.289461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3dd69e40-9b3e-45b8-a467-341c475c01e7 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:58.290494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3dd69e40-9b3e-45b8-a467-341c475c01e7 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:58.300443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-00938ee4-49e7-4bb5-8bd1-a5036734b58a req-f9fc9692-77f8-4218-8ff7-11c41409c1d7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:58.301090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-00938ee4-49e7-4bb5-8bd1-a5036734b58a req-f9fc9692-77f8-4218-8ff7-11c41409c1d7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:58.306988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3dd69e40-9b3e-45b8-a467-341c475c01e7 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:58.307760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3dd69e40-9b3e-45b8-a467-341c475c01e7 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:58.311876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3dd69e40-9b3e-45b8-a467-341c475c01e7 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:58.312669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3dd69e40-9b3e-45b8-a467-341c475c01e7 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:58.337049 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-00938ee4-49e7-4bb5-8bd1-a5036734b58a req-f9fc9692-77f8-4218-8ff7-11c41409c1d7 service nova] Creating event network-vif-deleted:7291d4ce-8dad-4d1e-8529-b562facf8218 for instance ba033cef-0c1e-4b18-9584-427e6db2fcb1 on n-h1-826529-8 Aug 03 02:02:58.363585 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-00938ee4-49e7-4bb5-8bd1-a5036734b58a req-f9fc9692-77f8-4218-8ff7-11c41409c1d7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104607 Aug 03 02:02:58.371323 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1583/3213] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:58.399073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-41e05e04-d4a2-4f95-8cc4-640096923e55 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:58.406617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-41e05e04-d4a2-4f95-8cc4-640096923e55 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:58.423762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3dd69e40-9b3e-45b8-a467-341c475c01e7 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:02:58.443395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41e05e04-d4a2-4f95-8cc4-640096923e55 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:58.451845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41e05e04-d4a2-4f95-8cc4-640096923e55 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:58.459186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41e05e04-d4a2-4f95-8cc4-640096923e55 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:58.464678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-41e05e04-d4a2-4f95-8cc4-640096923e55 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:58.657397 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3dd69e40-9b3e-45b8-a467-341c475c01e7 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 204 len: 0 microversion: 2.1 time: 0.374718 Aug 03 02:02:58.660050 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1631/3214] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:02:58 2022] DELETE /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:02:58.679475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dfa55340-48a0-4aea-8766-103bcf139fce tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:58.683202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dfa55340-48a0-4aea-8766-103bcf139fce tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:58.700690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfa55340-48a0-4aea-8766-103bcf139fce tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:58.709080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfa55340-48a0-4aea-8766-103bcf139fce tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:58.711824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfa55340-48a0-4aea-8766-103bcf139fce tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:58.713538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfa55340-48a0-4aea-8766-103bcf139fce tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:58.874445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-41e05e04-d4a2-4f95-8cc4-640096923e55 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:58.932181 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-41e05e04-d4a2-4f95-8cc4-640096923e55 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1554 microversion: 2.1 time: 0.557281 Aug 03 02:02:58.941910 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1584/3215] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:58 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1554 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:58.982316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-4cb9079e-7474-494e-ae6d-189dda81e4cd req-4b6ad672-0d67-412b-8f75-6c6895f3ad68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-unplugged", "status": "completed", "tag": "6afd3b79-7021-42c2-850a-794d515c4eb6"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:02:59.023487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4cb9079e-7474-494e-ae6d-189dda81e4cd req-4b6ad672-0d67-412b-8f75-6c6895f3ad68 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:59.029945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4cb9079e-7474-494e-ae6d-189dda81e4cd req-4b6ad672-0d67-412b-8f75-6c6895f3ad68 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:59.082133 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-4cb9079e-7474-494e-ae6d-189dda81e4cd req-4b6ad672-0d67-412b-8f75-6c6895f3ad68 service nova] Creating event network-vif-unplugged:6afd3b79-7021-42c2-850a-794d515c4eb6 for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 02:02:59.107465 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-4cb9079e-7474-494e-ae6d-189dda81e4cd req-4b6ad672-0d67-412b-8f75-6c6895f3ad68 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160081 Aug 03 02:02:59.110722 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1585/3216] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:02:59.130862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5aa2667e-488e-4ebe-8604-35e8e820272c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:59.133593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5aa2667e-488e-4ebe-8604-35e8e820272c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:59.151096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5aa2667e-488e-4ebe-8604-35e8e820272c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:59.152009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5aa2667e-488e-4ebe-8604-35e8e820272c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:59.154057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5aa2667e-488e-4ebe-8604-35e8e820272c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:59.158755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5aa2667e-488e-4ebe-8604-35e8e820272c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:59.202207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:02:59.503763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dfa55340-48a0-4aea-8766-103bcf139fce tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:59.551902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dfa55340-48a0-4aea-8766-103bcf139fce tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:59.561127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dfa55340-48a0-4aea-8766-103bcf139fce tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:59.565564 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dfa55340-48a0-4aea-8766-103bcf139fce tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2958 microversion: 2.32 time: 0.901892 Aug 03 02:02:59.567787 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1632/3217] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:02:58 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2958 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:02:59.578845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-63bcf400-4723-4998-a0ef-db6fb33ebfa0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:59.579951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-63bcf400-4723-4998-a0ef-db6fb33ebfa0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:59.594183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63bcf400-4723-4998-a0ef-db6fb33ebfa0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:59.596622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63bcf400-4723-4998-a0ef-db6fb33ebfa0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:59.598404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63bcf400-4723-4998-a0ef-db6fb33ebfa0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:59.599529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63bcf400-4723-4998-a0ef-db6fb33ebfa0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:59.646031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5aa2667e-488e-4ebe-8604-35e8e820272c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:59.663311 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5aa2667e-488e-4ebe-8604-35e8e820272c tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1683 microversion: 2.1 time: 0.549997 Aug 03 02:02:59.677756 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1586/3218] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:59 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1683 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:02:59.714512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e85fb177-18b7-4674-91f3-23e48a835db7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:02:59.717548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e85fb177-18b7-4674-91f3-23e48a835db7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:02:59.741154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e85fb177-18b7-4674-91f3-23e48a835db7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:59.742319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e85fb177-18b7-4674-91f3-23e48a835db7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:59.743874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e85fb177-18b7-4674-91f3-23e48a835db7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:59.746115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e85fb177-18b7-4674-91f3-23e48a835db7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:59.838679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e85fb177-18b7-4674-91f3-23e48a835db7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:02:59.839738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e85fb177-18b7-4674-91f3-23e48a835db7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:02:59.841477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-e85fb177-18b7-4674-91f3-23e48a835db7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lazy-loading 'fault' on Instance uuid ba033cef-0c1e-4b18-9584-427e6db2fcb1 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:02:59.964702 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e85fb177-18b7-4674-91f3-23e48a835db7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d335144d6f34ae78eaa6001b906a0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bb501c093b4f47a1a50eb37387bb14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:59.986938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-63bcf400-4723-4998-a0ef-db6fb33ebfa0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:02:59.992174 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e85fb177-18b7-4674-91f3-23e48a835db7 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 200 len: 1307 microversion: 2.1 time: 0.312386 Aug 03 02:02:59.993087 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1587/3219] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:59 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 1307 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:00.011843 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-63bcf400-4723-4998-a0ef-db6fb33ebfa0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1556 microversion: 2.1 time: 0.441952 Aug 03 02:03:00.028729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-81bb4107-1908-407a-a2c4-96db84e9dbc5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:00.029955 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1633/3220] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:02:59 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1556 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:00.030711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-81bb4107-1908-407a-a2c4-96db84e9dbc5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:00.041554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5198413-4344-42aa-a917-c4e13cf794fe tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:00.043944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5198413-4344-42aa-a917-c4e13cf794fe tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:00.049998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81bb4107-1908-407a-a2c4-96db84e9dbc5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:00.050867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81bb4107-1908-407a-a2c4-96db84e9dbc5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:00.052471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81bb4107-1908-407a-a2c4-96db84e9dbc5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:00.053611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81bb4107-1908-407a-a2c4-96db84e9dbc5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:00.070680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5198413-4344-42aa-a917-c4e13cf794fe tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:00.071972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5198413-4344-42aa-a917-c4e13cf794fe tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:00.073579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5198413-4344-42aa-a917-c4e13cf794fe tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:00.076354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5198413-4344-42aa-a917-c4e13cf794fe tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:00.215511 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-81bb4107-1908-407a-a2c4-96db84e9dbc5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.214891 Aug 03 02:03:00.219951 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1588/3221] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 02:02:59 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:03:00.236099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1a0f6c96-86df-4b96-9c6a-fddd93fa3434 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:00.243930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1a0f6c96-86df-4b96-9c6a-fddd93fa3434 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:00.271103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a0f6c96-86df-4b96-9c6a-fddd93fa3434 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:00.272165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a0f6c96-86df-4b96-9c6a-fddd93fa3434 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:00.274936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a0f6c96-86df-4b96-9c6a-fddd93fa3434 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:00.279505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a0f6c96-86df-4b96-9c6a-fddd93fa3434 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:00.640916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c5198413-4344-42aa-a917-c4e13cf794fe tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:00.673925 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5198413-4344-42aa-a917-c4e13cf794fe tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1396 microversion: 2.1 time: 0.640127 Aug 03 02:03:00.678629 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1634/3222] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:00 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1396 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:00.706097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-90c15f2d-a153-4995-b728-e789e0630742 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:00.711364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-90c15f2d-a153-4995-b728-e789e0630742 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:00.741509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90c15f2d-a153-4995-b728-e789e0630742 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:00.743172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90c15f2d-a153-4995-b728-e789e0630742 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:00.745812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90c15f2d-a153-4995-b728-e789e0630742 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:00.748448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90c15f2d-a153-4995-b728-e789e0630742 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:00.926665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1a0f6c96-86df-4b96-9c6a-fddd93fa3434 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:00.943600 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1a0f6c96-86df-4b96-9c6a-fddd93fa3434 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1554 microversion: 2.1 time: 0.721806 Aug 03 02:03:00.967319 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1589/3223] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:00 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1554 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:00.976414 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-395df9f6-4d99-4a1f-821c-97bd633abf01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:00.977915 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-395df9f6-4d99-4a1f-821c-97bd633abf01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:00.994015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-395df9f6-4d99-4a1f-821c-97bd633abf01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:01.001569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-395df9f6-4d99-4a1f-821c-97bd633abf01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:01.005640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-395df9f6-4d99-4a1f-821c-97bd633abf01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:01.019437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-395df9f6-4d99-4a1f-821c-97bd633abf01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:01.103699 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-90c15f2d-a153-4995-b728-e789e0630742 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.421431 Aug 03 02:03:01.113617 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1635/3224] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:03:00 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-interface => generated 285 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:01.120027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d702148-d66b-4784-ad2f-e59a37871702 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:01.120907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6d702148-d66b-4784-ad2f-e59a37871702 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:01.165333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d702148-d66b-4784-ad2f-e59a37871702 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:01.172888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d702148-d66b-4784-ad2f-e59a37871702 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:01.173991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d702148-d66b-4784-ad2f-e59a37871702 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:01.174594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d702148-d66b-4784-ad2f-e59a37871702 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:02.170720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6d702148-d66b-4784-ad2f-e59a37871702 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:02.193635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-395df9f6-4d99-4a1f-821c-97bd633abf01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:02.201257 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6d702148-d66b-4784-ad2f-e59a37871702 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1683 microversion: 2.1 time: 1.071476 Aug 03 02:03:02.215881 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1636/3225] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:01 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1683 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:02.225319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7a5d3a1c-e181-4bc9-9186-d5ec462c5910 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:02.226794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7a5d3a1c-e181-4bc9-9186-d5ec462c5910 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] [instance: ba033cef-0c1e-4b18-9584-427e6db2fcb1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:02.239245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-395df9f6-4d99-4a1f-821c-97bd633abf01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:02.242149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-395df9f6-4d99-4a1f-821c-97bd633abf01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:02.244529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a5d3a1c-e181-4bc9-9186-d5ec462c5910 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:02.245676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a5d3a1c-e181-4bc9-9186-d5ec462c5910 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:02.247444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a5d3a1c-e181-4bc9-9186-d5ec462c5910 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:02.248464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a5d3a1c-e181-4bc9-9186-d5ec462c5910 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:02.250089 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-395df9f6-4d99-4a1f-821c-97bd633abf01 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2958 microversion: 2.32 time: 1.281107 Aug 03 02:03:02.253139 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1590/3226] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:00 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2958 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:02.258332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-13ebb2ea-3cf9-42e9-a189-4938eb8290d0 req-6304fd98-8cbb-4c19-ab28-564dfee46198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-unplugged", "status": "completed", "tag": "9106a59f-415c-4da3-93ee-ae5f0c636a4a"}, {"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-unplugged", "status": "completed", "tag": "2f376776-be8e-4267-a6c7-1496121c265b"}, {"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-unplugged", "status": "completed", "tag": "0956e1fb-7c38-41ed-9df3-a9cd8fe4b445"}, {"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-unplugged", "status": "completed", "tag": "65cef764-1eae-46de-942f-7f9098703fc5"}, {"server_uuid": "5bb08bbd-64e7-4cfd-9d16-667eaf5a529e", "name": "network-vif-plugged", "status": "completed", "tag": "36f2c82b-8079-4a94-86a7-6b8a1d823941"}, {"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-unplugged", "status": "completed", "tag": "de5bbd3b-5e5b-4a91-bb47-0b6cfdc6c874"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:02.283806 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-7a5d3a1c-e181-4bc9-9186-d5ec462c5910 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] HTTP exception thrown: Instance ba033cef-0c1e-4b18-9584-427e6db2fcb1 could not be found. Aug 03 02:03:02.285922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-13ebb2ea-3cf9-42e9-a189-4938eb8290d0 req-6304fd98-8cbb-4c19-ab28-564dfee46198 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7a5d3a1c-e181-4bc9-9186-d5ec462c5910 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Request method failure captured: Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 HTTP/1.1 Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dZofcTz_x2_7Lj1YEl6R12KxRSOiZkZiWzL30t623FiVy913gQvbNGAvI0w9tEOWmMse3IGx8KMoyzuQGFPkISyW4w855Uc6Xe9jv8rI8g40HxWgpW7y6poTWGDc1_pVV2lAI3HiwZn-pq0YEQAOwE0O3zhX-NramgI9ImnhQefFic Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_66bb501c093b4f47a1a50eb37387bb14", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/66bb501c093b4f47a1a50eb37387bb14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/66bb501c093b4f47a1a50eb37387bb14"}]}] Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 66bb501c093b4f47a1a50eb37387bb14 Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2093576222 Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 3d335144d6f34ae78eaa6001b906a0df Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersOnMultiNodesTest-2093576222-project Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance ba033cef-0c1e-4b18-9584-427e6db2fcb1 could not be found. Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'ba033cef-0c1e-4b18-9584-427e6db2fcb1'} Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba033cef-0c1e-4b18-9584-427e6db2fcb1 could not be found. Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba033cef-0c1e-4b18-9584-427e6db2fcb1 could not be found. Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:02.288284 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:02.304159 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:02.304159 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:02.304159 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:02.304159 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:03:02.304159 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:03:02.304159 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba033cef-0c1e-4b18-9584-427e6db2fcb1 could not be found. Aug 03 02:03:02.304159 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:02.305579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-13ebb2ea-3cf9-42e9-a189-4938eb8290d0 req-6304fd98-8cbb-4c19-ab28-564dfee46198 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:02.305754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7a5d3a1c-e181-4bc9-9186-d5ec462c5910 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] Returning 404 to user: Instance ba033cef-0c1e-4b18-9584-427e6db2fcb1 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:03:02.305754 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7a5d3a1c-e181-4bc9-9186-d5ec462c5910 tempest-ServersOnMultiNodesTest-2093576222 tempest-ServersOnMultiNodesTest-2093576222-project] 10.222.0.67 "GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1" status: 404 len: 111 microversion: 2.1 time: 0.090344 Aug 03 02:03:02.306872 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1637/3227] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:02 2022] GET /compute/v2.1/servers/ba033cef-0c1e-4b18-9584-427e6db2fcb1 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:03:02.336677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d5525bc2-f47f-404b-93de-e9657c09f0d4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:02.343226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d5525bc2-f47f-404b-93de-e9657c09f0d4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:02.368196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5525bc2-f47f-404b-93de-e9657c09f0d4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:02.369962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5525bc2-f47f-404b-93de-e9657c09f0d4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:02.373321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5525bc2-f47f-404b-93de-e9657c09f0d4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:02.375119 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-13ebb2ea-3cf9-42e9-a189-4938eb8290d0 req-6304fd98-8cbb-4c19-ab28-564dfee46198 service nova] Creating event network-vif-unplugged:9106a59f-415c-4da3-93ee-ae5f0c636a4a for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 02:03:02.376099 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-13ebb2ea-3cf9-42e9-a189-4938eb8290d0 req-6304fd98-8cbb-4c19-ab28-564dfee46198 service nova] Creating event network-vif-unplugged:2f376776-be8e-4267-a6c7-1496121c265b for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 02:03:02.377977 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-13ebb2ea-3cf9-42e9-a189-4938eb8290d0 req-6304fd98-8cbb-4c19-ab28-564dfee46198 service nova] Creating event network-vif-unplugged:0956e1fb-7c38-41ed-9df3-a9cd8fe4b445 for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 02:03:02.380379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5525bc2-f47f-404b-93de-e9657c09f0d4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:02.383257 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-13ebb2ea-3cf9-42e9-a189-4938eb8290d0 req-6304fd98-8cbb-4c19-ab28-564dfee46198 service nova] Creating event network-vif-unplugged:65cef764-1eae-46de-942f-7f9098703fc5 for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 02:03:02.384678 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-13ebb2ea-3cf9-42e9-a189-4938eb8290d0 req-6304fd98-8cbb-4c19-ab28-564dfee46198 service nova] Creating event network-vif-plugged:36f2c82b-8079-4a94-86a7-6b8a1d823941 for instance 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e on n-h2-826529-8 Aug 03 02:03:02.385593 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-13ebb2ea-3cf9-42e9-a189-4938eb8290d0 req-6304fd98-8cbb-4c19-ab28-564dfee46198 service nova] Creating event network-vif-unplugged:de5bbd3b-5e5b-4a91-bb47-0b6cfdc6c874 for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 02:03:02.457031 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-13ebb2ea-3cf9-42e9-a189-4938eb8290d0 req-6304fd98-8cbb-4c19-ab28-564dfee46198 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1048 microversion: 2.1 time: 0.192595 Aug 03 02:03:02.458249 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1591/3228] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 1048 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:02.475636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e87576a9-3a25-486b-839b-879f2154c5ad tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:02.483305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e87576a9-3a25-486b-839b-879f2154c5ad tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:02.494984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e87576a9-3a25-486b-839b-879f2154c5ad tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:02.495597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e87576a9-3a25-486b-839b-879f2154c5ad tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:02.496615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e87576a9-3a25-486b-839b-879f2154c5ad tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:02.497111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e87576a9-3a25-486b-839b-879f2154c5ad tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:02.540814 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d5525bc2-f47f-404b-93de-e9657c09f0d4 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.226347 Aug 03 02:03:02.546106 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1638/3229] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 02:03:02 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:03:02.564333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-42c2763b-dfac-4d0d-9592-51002cca7c28 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:02.569298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-42c2763b-dfac-4d0d-9592-51002cca7c28 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:02.584865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42c2763b-dfac-4d0d-9592-51002cca7c28 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:02.585953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42c2763b-dfac-4d0d-9592-51002cca7c28 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:02.609005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42c2763b-dfac-4d0d-9592-51002cca7c28 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:02.609509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42c2763b-dfac-4d0d-9592-51002cca7c28 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:03.053168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e87576a9-3a25-486b-839b-879f2154c5ad tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:03.063313 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e87576a9-3a25-486b-839b-879f2154c5ad tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1396 microversion: 2.1 time: 0.602325 Aug 03 02:03:03.083371 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1592/3230] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:02 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1396 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:03.130104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-42c2763b-dfac-4d0d-9592-51002cca7c28 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:03.144276 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-42c2763b-dfac-4d0d-9592-51002cca7c28 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1554 microversion: 2.1 time: 0.596152 Aug 03 02:03:03.145547 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1639/3231] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:02 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1554 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:03.235203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e3664f61-14a2-4b87-ad8b-b4677d299f28 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:03.236556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e3664f61-14a2-4b87-ad8b-b4677d299f28 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:03.259904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3664f61-14a2-4b87-ad8b-b4677d299f28 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:03.260861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3664f61-14a2-4b87-ad8b-b4677d299f28 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:03.261847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3664f61-14a2-4b87-ad8b-b4677d299f28 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:03.262530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3664f61-14a2-4b87-ad8b-b4677d299f28 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:03.312900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b205b155-2c6a-43a9-af91-ec640c24c424 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:03.315634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b205b155-2c6a-43a9-af91-ec640c24c424 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:03.332737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b205b155-2c6a-43a9-af91-ec640c24c424 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:03.333718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b205b155-2c6a-43a9-af91-ec640c24c424 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:03.335537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b205b155-2c6a-43a9-af91-ec640c24c424 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:03.336327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b205b155-2c6a-43a9-af91-ec640c24c424 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:03.385573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:03.506307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e3664f61-14a2-4b87-ad8b-b4677d299f28 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:03.535409 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e3664f61-14a2-4b87-ad8b-b4677d299f28 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1615 microversion: 2.1 time: 0.307042 Aug 03 02:03:03.536681 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1593/3232] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:03 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1615 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:03.565393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-681a6822-af9e-4fd2-b8a1-cc9730cecca8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:03.568934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-681a6822-af9e-4fd2-b8a1-cc9730cecca8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:03.591925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:03.594857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-681a6822-af9e-4fd2-b8a1-cc9730cecca8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:03.595669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-681a6822-af9e-4fd2-b8a1-cc9730cecca8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:03.596741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-681a6822-af9e-4fd2-b8a1-cc9730cecca8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:03.597510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-681a6822-af9e-4fd2-b8a1-cc9730cecca8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:03.648139 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-681a6822-af9e-4fd2-b8a1-cc9730cecca8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089852 Aug 03 02:03:03.649455 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1594/3233] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 02:03:03 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:03:03.750382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-29af44ff-e664-40cd-bf99-fc84596ddfd1 req-a846d75c-f309-40c9-8be7-13bdb4dc0ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca5751e-57cb-49b2-982e-0201e2a94ffe", "name": "network-vif-deleted", "tag": "c7bcefb8-692d-4f3f-a81c-d005d80524f4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:03.764229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-29af44ff-e664-40cd-bf99-fc84596ddfd1 req-a846d75c-f309-40c9-8be7-13bdb4dc0ba8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:03.765005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-29af44ff-e664-40cd-bf99-fc84596ddfd1 req-a846d75c-f309-40c9-8be7-13bdb4dc0ba8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:03.789703 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-29af44ff-e664-40cd-bf99-fc84596ddfd1 req-a846d75c-f309-40c9-8be7-13bdb4dc0ba8 service nova] Creating event network-vif-deleted:c7bcefb8-692d-4f3f-a81c-d005d80524f4 for instance cca5751e-57cb-49b2-982e-0201e2a94ffe on n-h1-826529-8 Aug 03 02:03:03.811657 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-29af44ff-e664-40cd-bf99-fc84596ddfd1 req-a846d75c-f309-40c9-8be7-13bdb4dc0ba8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073571 Aug 03 02:03:03.812926 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1595/3234] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:04.093910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4a511512-35c7-4c75-a3a4-255db6c87981 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:04.095295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4a511512-35c7-4c75-a3a4-255db6c87981 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:04.107863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a511512-35c7-4c75-a3a4-255db6c87981 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:04.108643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a511512-35c7-4c75-a3a4-255db6c87981 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:04.109903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a511512-35c7-4c75-a3a4-255db6c87981 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:04.110537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a511512-35c7-4c75-a3a4-255db6c87981 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:04.275829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b205b155-2c6a-43a9-af91-ec640c24c424 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:04.296212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b205b155-2c6a-43a9-af91-ec640c24c424 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:04.298063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b205b155-2c6a-43a9-af91-ec640c24c424 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:04.299579 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b205b155-2c6a-43a9-af91-ec640c24c424 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2937 microversion: 2.32 time: 0.995270 Aug 03 02:03:04.301234 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1640/3235] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:03 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2937 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:04.310293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2e60d87b-010d-4cd3-91e6-47e3e73d9af7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:04.311285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2e60d87b-010d-4cd3-91e6-47e3e73d9af7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:04.329362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e60d87b-010d-4cd3-91e6-47e3e73d9af7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:04.330359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e60d87b-010d-4cd3-91e6-47e3e73d9af7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:04.330804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e60d87b-010d-4cd3-91e6-47e3e73d9af7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:04.331539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e60d87b-010d-4cd3-91e6-47e3e73d9af7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:04.604165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2e60d87b-010d-4cd3-91e6-47e3e73d9af7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:04.621343 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2e60d87b-010d-4cd3-91e6-47e3e73d9af7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1346 microversion: 2.1 time: 0.318108 Aug 03 02:03:04.640738 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1641/3236] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:04 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1346 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:04.649453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-cb58979a-1c4b-4463-bacf-1470501dc217 req-f6b1de8c-547d-42d7-b4bb-431045fd7624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-unplugged", "status": "completed", "tag": "c455abfe-c5d9-4600-90ed-3417c36c463c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:04.690537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-cb58979a-1c4b-4463-bacf-1470501dc217 req-f6b1de8c-547d-42d7-b4bb-431045fd7624 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:04.691350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-cb58979a-1c4b-4463-bacf-1470501dc217 req-f6b1de8c-547d-42d7-b4bb-431045fd7624 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:04.738826 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-cb58979a-1c4b-4463-bacf-1470501dc217 req-f6b1de8c-547d-42d7-b4bb-431045fd7624 service nova] Creating event network-vif-unplugged:c455abfe-c5d9-4600-90ed-3417c36c463c for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 02:03:04.752825 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-cb58979a-1c4b-4463-bacf-1470501dc217 req-f6b1de8c-547d-42d7-b4bb-431045fd7624 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123141 Aug 03 02:03:04.758271 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1642/3237] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:04.783844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4a511512-35c7-4c75-a3a4-255db6c87981 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:04.793841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3696a442-8d36-437f-81d6-82dd7ca42e42 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:04.796720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3696a442-8d36-437f-81d6-82dd7ca42e42 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:04.813388 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4a511512-35c7-4c75-a3a4-255db6c87981 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1396 microversion: 2.1 time: 0.730270 Aug 03 02:03:04.830934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3696a442-8d36-437f-81d6-82dd7ca42e42 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:04.831210 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1596/3238] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:04 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1396 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:04.831311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3696a442-8d36-437f-81d6-82dd7ca42e42 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:04.831311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3696a442-8d36-437f-81d6-82dd7ca42e42 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:04.831311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3696a442-8d36-437f-81d6-82dd7ca42e42 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:04.831572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-708a686c-a6f7-4c35-9f86-d6685326d5d5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:04.840991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-708a686c-a6f7-4c35-9f86-d6685326d5d5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:04.853850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-708a686c-a6f7-4c35-9f86-d6685326d5d5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:04.860280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-708a686c-a6f7-4c35-9f86-d6685326d5d5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:04.868443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-708a686c-a6f7-4c35-9f86-d6685326d5d5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:04.870425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-708a686c-a6f7-4c35-9f86-d6685326d5d5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:04.954700 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-708a686c-a6f7-4c35-9f86-d6685326d5d5 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.138047 Aug 03 02:03:04.962242 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1597/3239] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 02:03:04 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:03:05.037645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3696a442-8d36-437f-81d6-82dd7ca42e42 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f009ea44cc4a4c37a236b93a2c5a9028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8dc5a1c3fbd4cad8b0f2045bb872b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:05.075586 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3696a442-8d36-437f-81d6-82dd7ca42e42 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 200 len: 1615 microversion: 2.1 time: 0.295703 Aug 03 02:03:05.076590 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1643/3240] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:04 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 1615 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:05.336076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-98cf0967-0a6b-4ca1-b486-71f5736aaa8d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:05.364817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-98cf0967-0a6b-4ca1-b486-71f5736aaa8d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:05.391181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98cf0967-0a6b-4ca1-b486-71f5736aaa8d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:05.396132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98cf0967-0a6b-4ca1-b486-71f5736aaa8d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:05.411754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98cf0967-0a6b-4ca1-b486-71f5736aaa8d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:05.413663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98cf0967-0a6b-4ca1-b486-71f5736aaa8d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:05.847894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-98cf0967-0a6b-4ca1-b486-71f5736aaa8d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:05.880436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-98cf0967-0a6b-4ca1-b486-71f5736aaa8d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:05.890821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-98cf0967-0a6b-4ca1-b486-71f5736aaa8d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:05.893797 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-98cf0967-0a6b-4ca1-b486-71f5736aaa8d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2916 microversion: 2.32 time: 0.565015 Aug 03 02:03:05.918480 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1598/3241] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:05 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2916 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:05.927616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9d059f0d-8981-4bc1-9c15-2ed5b5bc92b3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:05.928266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9d059f0d-8981-4bc1-9c15-2ed5b5bc92b3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:05.943570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d059f0d-8981-4bc1-9c15-2ed5b5bc92b3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:05.944040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d059f0d-8981-4bc1-9c15-2ed5b5bc92b3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:05.944835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d059f0d-8981-4bc1-9c15-2ed5b5bc92b3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:05.945667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d059f0d-8981-4bc1-9c15-2ed5b5bc92b3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:06.134249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9d059f0d-8981-4bc1-9c15-2ed5b5bc92b3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:06.157700 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9d059f0d-8981-4bc1-9c15-2ed5b5bc92b3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1346 microversion: 2.1 time: 0.236768 Aug 03 02:03:06.179462 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1599/3242] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:05 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1346 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:06.192276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-e87d7d43-a504-47f1-b59e-e5f5082e3d9b req-ceb8d699-3a78-435d-9e03-3fd72660af24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99358f36-9bc7-4e58-8a98-70b4e391e244", "tag": "75880f3c-9e7a-4a26-9ab7-243bab43e9a8"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:06.204070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-790c8e83-761e-4385-8f9e-a5cce124a350 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:06.205034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-790c8e83-761e-4385-8f9e-a5cce124a350 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:06.223123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-790c8e83-761e-4385-8f9e-a5cce124a350 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:06.224381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-790c8e83-761e-4385-8f9e-a5cce124a350 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:06.225421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-790c8e83-761e-4385-8f9e-a5cce124a350 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:06.226132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-790c8e83-761e-4385-8f9e-a5cce124a350 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:06.237129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e87d7d43-a504-47f1-b59e-e5f5082e3d9b req-ceb8d699-3a78-435d-9e03-3fd72660af24 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:06.245820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e87d7d43-a504-47f1-b59e-e5f5082e3d9b req-ceb8d699-3a78-435d-9e03-3fd72660af24 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:06.291382 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-e87d7d43-a504-47f1-b59e-e5f5082e3d9b req-ceb8d699-3a78-435d-9e03-3fd72660af24 service nova] Creating event network-changed:75880f3c-9e7a-4a26-9ab7-243bab43e9a8 for instance 99358f36-9bc7-4e58-8a98-70b4e391e244 on n-h1-826529-8 Aug 03 02:03:06.316609 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-e87d7d43-a504-47f1-b59e-e5f5082e3d9b req-ceb8d699-3a78-435d-9e03-3fd72660af24 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.796288 Aug 03 02:03:06.322191 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1644/3243] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:03:06.336231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-024c31f9-af64-413e-8cad-6ffa8aad5674 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:06.339377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-024c31f9-af64-413e-8cad-6ffa8aad5674 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:06.353353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-024c31f9-af64-413e-8cad-6ffa8aad5674 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:06.354185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-024c31f9-af64-413e-8cad-6ffa8aad5674 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:06.355432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-024c31f9-af64-413e-8cad-6ffa8aad5674 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:06.357089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-024c31f9-af64-413e-8cad-6ffa8aad5674 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:06.426330 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-024c31f9-af64-413e-8cad-6ffa8aad5674 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102245 Aug 03 02:03:06.427570 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1645/3244] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 02:03:06 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:03:06.432784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed47dccf-8a41-4037-a774-94b49a8bb803 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:06.434350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ed47dccf-8a41-4037-a774-94b49a8bb803 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] [instance: 6731bf52-2375-4f2a-9905-79b334d5917b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:06.441864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed47dccf-8a41-4037-a774-94b49a8bb803 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:06.442643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed47dccf-8a41-4037-a774-94b49a8bb803 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:06.443822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed47dccf-8a41-4037-a774-94b49a8bb803 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:06.444528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed47dccf-8a41-4037-a774-94b49a8bb803 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:06.464046 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-ed47dccf-8a41-4037-a774-94b49a8bb803 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] HTTP exception thrown: Instance 6731bf52-2375-4f2a-9905-79b334d5917b could not be found. Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed47dccf-8a41-4037-a774-94b49a8bb803 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Request method failure captured: Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b HTTP/1.1 Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dad4ahuj48aSemPcxZZEhg6pISuNFbGj8qLszH8HzXjmwjVlj_Ar6f7qbwHRtEp6bzbvsfqvrl85pMXfUIbqOLzj-DL8qrS8_n4yCWxqBPd7bMiVphi1VHH5opD6hd2N2PJz6Jdb_Iy8blpQF8zV33R8ANHQEgdNaS9asaveSaWQLc Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: e8dc5a1c3fbd4cad8b0f2045bb872b0d Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-VolumesAdminNegativeTest-1021915728 Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e8dc5a1c3fbd4cad8b0f2045bb872b0d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e8dc5a1c3fbd4cad8b0f2045bb872b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e8dc5a1c3fbd4cad8b0f2045bb872b0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e8dc5a1c3fbd4cad8b0f2045bb872b0d"}]}] Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-VolumesAdminNegativeTest-1021915728 Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: e8dc5a1c3fbd4cad8b0f2045bb872b0d Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1021915728 Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-VolumesAdminNegativeTest-1021915728-project Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: f009ea44cc4a4c37a236b93a2c5a9028 Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-VolumesAdminNegativeTest-1021915728-project Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 6731bf52-2375-4f2a-9905-79b334d5917b could not be found. Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '6731bf52-2375-4f2a-9905-79b334d5917b'} Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6731bf52-2375-4f2a-9905-79b334d5917b could not be found. Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6731bf52-2375-4f2a-9905-79b334d5917b could not be found. Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:06.466850 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:06.471727 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:06.471727 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:06.471727 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:06.471727 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:03:06.471727 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:03:06.471727 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6731bf52-2375-4f2a-9905-79b334d5917b could not be found. Aug 03 02:03:06.471727 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:06.474850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed47dccf-8a41-4037-a774-94b49a8bb803 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Returning 404 to user: Instance 6731bf52-2375-4f2a-9905-79b334d5917b could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:03:06.476077 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed47dccf-8a41-4037-a774-94b49a8bb803 tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b" status: 404 len: 111 microversion: 2.1 time: 0.047268 Aug 03 02:03:06.476888 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1646/3245] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:06 2022] GET /compute/v2.1/servers/6731bf52-2375-4f2a-9905-79b334d5917b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:03:06.483085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-5b55baa7-9275-4110-a0b9-4190a771c451 req-60569708-dfc9-4813-b1c6-361cf904bb1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6731bf52-2375-4f2a-9905-79b334d5917b", "name": "network-vif-deleted", "tag": "63736276-b283-41b5-b35a-a47cb4db71fe"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:06.495687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5b55baa7-9275-4110-a0b9-4190a771c451 req-60569708-dfc9-4813-b1c6-361cf904bb1b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:06.496961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5b55baa7-9275-4110-a0b9-4190a771c451 req-60569708-dfc9-4813-b1c6-361cf904bb1b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:06.511486 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-5b55baa7-9275-4110-a0b9-4190a771c451 req-60569708-dfc9-4813-b1c6-361cf904bb1b service nova] Creating event network-vif-deleted:63736276-b283-41b5-b35a-a47cb4db71fe for instance 6731bf52-2375-4f2a-9905-79b334d5917b on n-h2-826529-8 Aug 03 02:03:06.521759 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-5b55baa7-9275-4110-a0b9-4190a771c451 req-60569708-dfc9-4813-b1c6-361cf904bb1b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042987 Aug 03 02:03:06.523690 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1647/3246] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:06.533932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-57efd6b7-affd-4ad3-94cc-aaf579d6c3ab tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] Calling method '.version_select at 0x7f5b12a2c550>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:06.599841 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-57efd6b7-affd-4ad3-94cc-aaf579d6c3ab tempest-VolumesAdminNegativeTest-1021915728 tempest-VolumesAdminNegativeTest-1021915728-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-903112045" status: 202 len: 0 microversion: 2.1 time: 0.073481 Aug 03 02:03:06.600568 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1648/3247] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 3 02:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-903112045 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:03:06.935890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6704d6e0-e429-4e01-b893-2a4c7994ef9d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:06.938998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6704d6e0-e429-4e01-b893-2a4c7994ef9d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:06.982427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6704d6e0-e429-4e01-b893-2a4c7994ef9d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:06.984005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6704d6e0-e429-4e01-b893-2a4c7994ef9d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:06.985905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6704d6e0-e429-4e01-b893-2a4c7994ef9d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:06.987056 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6704d6e0-e429-4e01-b893-2a4c7994ef9d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:06.998963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-790c8e83-761e-4385-8f9e-a5cce124a350 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:07.035470 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-790c8e83-761e-4385-8f9e-a5cce124a350 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1578 microversion: 2.1 time: 0.832091 Aug 03 02:03:07.036783 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1600/3248] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:06 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1578 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:07.069268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0226085b-e1b7-4624-adff-fb60bd3e680e tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:07.070518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0226085b-e1b7-4624-adff-fb60bd3e680e tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:07.108337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0226085b-e1b7-4624-adff-fb60bd3e680e tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:07.133835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0226085b-e1b7-4624-adff-fb60bd3e680e tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:07.141107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0226085b-e1b7-4624-adff-fb60bd3e680e tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:07.141940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0226085b-e1b7-4624-adff-fb60bd3e680e tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:07.531997 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0226085b-e1b7-4624-adff-fb60bd3e680e tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.475318 Aug 03 02:03:07.533196 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1601/3249] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:03:07 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e/os-interface => generated 285 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:07.538224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-114a7824-c2e3-4c1d-9581-4b2cb859cead tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:07.539287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-114a7824-c2e3-4c1d-9581-4b2cb859cead tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:07.557470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-114a7824-c2e3-4c1d-9581-4b2cb859cead tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:07.557812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-114a7824-c2e3-4c1d-9581-4b2cb859cead tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:07.558502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-114a7824-c2e3-4c1d-9581-4b2cb859cead tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:07.559218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-114a7824-c2e3-4c1d-9581-4b2cb859cead tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:07.869878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6704d6e0-e429-4e01-b893-2a4c7994ef9d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:07.916348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6704d6e0-e429-4e01-b893-2a4c7994ef9d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:07.928988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6704d6e0-e429-4e01-b893-2a4c7994ef9d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:07.930940 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6704d6e0-e429-4e01-b893-2a4c7994ef9d tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2869 microversion: 2.32 time: 1.010014 Aug 03 02:03:07.939394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-114a7824-c2e3-4c1d-9581-4b2cb859cead tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:07.957800 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1649/3250] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:06 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2869 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:07.980046 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-114a7824-c2e3-4c1d-9581-4b2cb859cead tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1346 microversion: 2.1 time: 0.445076 Aug 03 02:03:08.005958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3d2856a1-b51a-46c0-b634-3a21005e5ef7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:08.010742 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1602/3251] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:07 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1346 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:08.014644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3d2856a1-b51a-46c0-b634-3a21005e5ef7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:08.049805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3d2856a1-b51a-46c0-b634-3a21005e5ef7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:08.051299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3d2856a1-b51a-46c0-b634-3a21005e5ef7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:08.053048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3d2856a1-b51a-46c0-b634-3a21005e5ef7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:08.054938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3d2856a1-b51a-46c0-b634-3a21005e5ef7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:08.172283 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3d2856a1-b51a-46c0-b634-3a21005e5ef7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.212469 Aug 03 02:03:08.181011 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1650/3252] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 02:03:07 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:03:08.594418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ca5a7c8f-628c-447e-95c7-a85a7a091e71 req-2dec7f7c-d5f0-44c9-b59c-21cd5b695e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-deleted", "tag": "c455abfe-c5d9-4600-90ed-3417c36c463c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:08.636737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ca5a7c8f-628c-447e-95c7-a85a7a091e71 req-2dec7f7c-d5f0-44c9-b59c-21cd5b695e04 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:08.641820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ca5a7c8f-628c-447e-95c7-a85a7a091e71 req-2dec7f7c-d5f0-44c9-b59c-21cd5b695e04 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:08.702214 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ca5a7c8f-628c-447e-95c7-a85a7a091e71 req-2dec7f7c-d5f0-44c9-b59c-21cd5b695e04 service nova] Creating event network-vif-deleted:c455abfe-c5d9-4600-90ed-3417c36c463c for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 02:03:08.726982 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ca5a7c8f-628c-447e-95c7-a85a7a091e71 req-2dec7f7c-d5f0-44c9-b59c-21cd5b695e04 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131787 Aug 03 02:03:08.728571 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1603/3253] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:09.005641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e6f344de-1327-433d-b623-09c8e0b746be tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:09.007614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e6f344de-1327-433d-b623-09c8e0b746be tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:09.035220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-05a977ed-4f03-45f2-9b7d-8416359f5d42 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:09.035960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-05a977ed-4f03-45f2-9b7d-8416359f5d42 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:09.053855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6f344de-1327-433d-b623-09c8e0b746be tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:09.054326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6f344de-1327-433d-b623-09c8e0b746be tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:09.055193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6f344de-1327-433d-b623-09c8e0b746be tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:09.055648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6f344de-1327-433d-b623-09c8e0b746be tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:09.061669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05a977ed-4f03-45f2-9b7d-8416359f5d42 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:09.062517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05a977ed-4f03-45f2-9b7d-8416359f5d42 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:09.063618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05a977ed-4f03-45f2-9b7d-8416359f5d42 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:09.067575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05a977ed-4f03-45f2-9b7d-8416359f5d42 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:09.557416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-05a977ed-4f03-45f2-9b7d-8416359f5d42 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:09.601514 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-05a977ed-4f03-45f2-9b7d-8416359f5d42 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1346 microversion: 2.1 time: 0.570773 Aug 03 02:03:09.604966 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1604/3254] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:09 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1346 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:03:09.640675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9d81dbb9-4502-46e2-bc79-4173313eb071 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:09.649632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9d81dbb9-4502-46e2-bc79-4173313eb071 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:09.672325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d81dbb9-4502-46e2-bc79-4173313eb071 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:09.672784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d81dbb9-4502-46e2-bc79-4173313eb071 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:09.674203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d81dbb9-4502-46e2-bc79-4173313eb071 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:09.689802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d81dbb9-4502-46e2-bc79-4173313eb071 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:09.706289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:09.774931 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9d81dbb9-4502-46e2-bc79-4173313eb071 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.162661 Aug 03 02:03:09.776027 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1605/3255] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 02:03:09 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0/os-volume_attachments => generated 25 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:09.920314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cb6c8fb4-915f-4a39-bc94-852701407210 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:09.920919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cb6c8fb4-915f-4a39-bc94-852701407210 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:09.955998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cb6c8fb4-915f-4a39-bc94-852701407210 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:09.956897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cb6c8fb4-915f-4a39-bc94-852701407210 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:09.958397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cb6c8fb4-915f-4a39-bc94-852701407210 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:09.959303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cb6c8fb4-915f-4a39-bc94-852701407210 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:10.064226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cb6c8fb4-915f-4a39-bc94-852701407210 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:03:10.324413 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cb6c8fb4-915f-4a39-bc94-852701407210 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 204 len: 0 microversion: 2.20 time: 0.408676 Aug 03 02:03:10.326320 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1606/3256] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:03:09 2022] DELETE /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 02:03:10.343398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e430902e-0fb0-46e7-b003-e9b2cee4400d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:10.348810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e430902e-0fb0-46e7-b003-e9b2cee4400d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:10.369590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e430902e-0fb0-46e7-b003-e9b2cee4400d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:10.384277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e430902e-0fb0-46e7-b003-e9b2cee4400d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:10.386327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e430902e-0fb0-46e7-b003-e9b2cee4400d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:10.388095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e430902e-0fb0-46e7-b003-e9b2cee4400d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:10.684600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e6f344de-1327-433d-b623-09c8e0b746be tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:10.739962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e6f344de-1327-433d-b623-09c8e0b746be tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:10.753059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e6f344de-1327-433d-b623-09c8e0b746be tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:10.755962 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e6f344de-1327-433d-b623-09c8e0b746be tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2708 microversion: 2.32 time: 1.766186 Aug 03 02:03:10.766274 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1651/3257] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:08 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2708 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:10.777116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bdf3b2a9-91d3-47eb-9fde-0742cc9c22cb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:10.784588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bdf3b2a9-91d3-47eb-9fde-0742cc9c22cb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:10.805544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdf3b2a9-91d3-47eb-9fde-0742cc9c22cb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:10.807789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdf3b2a9-91d3-47eb-9fde-0742cc9c22cb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:10.818333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdf3b2a9-91d3-47eb-9fde-0742cc9c22cb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:10.819692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdf3b2a9-91d3-47eb-9fde-0742cc9c22cb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:11.202319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e430902e-0fb0-46e7-b003-e9b2cee4400d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:11.234755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e430902e-0fb0-46e7-b003-e9b2cee4400d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:11.236478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e430902e-0fb0-46e7-b003-e9b2cee4400d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:11.238089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bdf3b2a9-91d3-47eb-9fde-0742cc9c22cb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:11.241627 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e430902e-0fb0-46e7-b003-e9b2cee4400d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1723 microversion: 2.20 time: 0.908275 Aug 03 02:03:11.242667 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1607/3258] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:10 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1723 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:11.247742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-801593a3-9059-4bbd-a383-c792de15e551 req-854df47b-6289-478f-8156-55b29770b446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-deleted", "tag": "65cef764-1eae-46de-942f-7f9098703fc5"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:11.274192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-801593a3-9059-4bbd-a383-c792de15e551 req-854df47b-6289-478f-8156-55b29770b446 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:11.276293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-801593a3-9059-4bbd-a383-c792de15e551 req-854df47b-6289-478f-8156-55b29770b446 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:11.306257 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bdf3b2a9-91d3-47eb-9fde-0742cc9c22cb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1346 microversion: 2.1 time: 0.535443 Aug 03 02:03:11.306887 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-801593a3-9059-4bbd-a383-c792de15e551 req-854df47b-6289-478f-8156-55b29770b446 service nova] Creating event network-vif-deleted:65cef764-1eae-46de-942f-7f9098703fc5 for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 02:03:11.317748 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-801593a3-9059-4bbd-a383-c792de15e551 req-854df47b-6289-478f-8156-55b29770b446 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073060 Aug 03 02:03:11.319235 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1608/3259] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:11.327640 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1652/3260] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:10 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1346 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:11.803946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3dc69b13-d12e-439e-bf24-ac6a4bff5ca2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:11.804915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3dc69b13-d12e-439e-bf24-ac6a4bff5ca2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:11.830791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3dc69b13-d12e-439e-bf24-ac6a4bff5ca2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:11.838775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3dc69b13-d12e-439e-bf24-ac6a4bff5ca2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:11.840580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3dc69b13-d12e-439e-bf24-ac6a4bff5ca2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:11.841279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3dc69b13-d12e-439e-bf24-ac6a4bff5ca2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:11.997667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1938193758", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:12.157278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:03:12.375813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3dc69b13-d12e-439e-bf24-ac6a4bff5ca2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:12.404120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3dc69b13-d12e-439e-bf24-ac6a4bff5ca2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:12.407181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3dc69b13-d12e-439e-bf24-ac6a4bff5ca2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:12.409866 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3dc69b13-d12e-439e-bf24-ac6a4bff5ca2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2503 microversion: 2.32 time: 0.615435 Aug 03 02:03:12.424671 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1653/3261] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:11 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2503 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:03:12.453763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ca04f1c7-685a-48ca-8ebd-fc0e00ac4800 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:12.457395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ca04f1c7-685a-48ca-8ebd-fc0e00ac4800 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:12.479443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca04f1c7-685a-48ca-8ebd-fc0e00ac4800 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:12.480730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca04f1c7-685a-48ca-8ebd-fc0e00ac4800 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:12.482511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca04f1c7-685a-48ca-8ebd-fc0e00ac4800 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:12.485120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca04f1c7-685a-48ca-8ebd-fc0e00ac4800 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:12.954742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ca04f1c7-685a-48ca-8ebd-fc0e00ac4800 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:12.979316 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ca04f1c7-685a-48ca-8ebd-fc0e00ac4800 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1578 microversion: 2.1 time: 0.536459 Aug 03 02:03:12.979316 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1654/3262] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:12 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1578 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:12.983641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:03:12.985970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:03:12.986829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:03:12.987571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:03:12.988286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:03:12.989213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-94ca958b-6f41-4e74-9cfb-cb2362325c9f req-201d3cd2-1d95-432a-bd5b-2e7ec37c96c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb08bbd-64e7-4cfd-9d16-667eaf5a529e", "tag": "36f2c82b-8079-4a94-86a7-6b8a1d823941"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:13.002296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-94ca958b-6f41-4e74-9cfb-cb2362325c9f req-201d3cd2-1d95-432a-bd5b-2e7ec37c96c8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:13.002756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-94ca958b-6f41-4e74-9cfb-cb2362325c9f req-201d3cd2-1d95-432a-bd5b-2e7ec37c96c8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:13.008296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:13.009235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:13.010232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:13.011052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:13.036240 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-94ca958b-6f41-4e74-9cfb-cb2362325c9f req-201d3cd2-1d95-432a-bd5b-2e7ec37c96c8 service nova] Creating event network-changed:36f2c82b-8079-4a94-86a7-6b8a1d823941 for instance 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e on n-h2-826529-8 Aug 03 02:03:13.048652 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-94ca958b-6f41-4e74-9cfb-cb2362325c9f req-201d3cd2-1d95-432a-bd5b-2e7ec37c96c8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072971 Aug 03 02:03:13.054481 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1655/3263] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:13.068939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Getting quotas for project 59f56311404b427ca1dc013c8c96f556. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:03:13.077092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8f9f2e7e-e33c-45b9-aa66-d0ceb47f1a88 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:13.081115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8f9f2e7e-e33c-45b9-aa66-d0ceb47f1a88 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:13.096323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f9f2e7e-e33c-45b9-aa66-d0ceb47f1a88 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:13.099898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f9f2e7e-e33c-45b9-aa66-d0ceb47f1a88 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:13.103366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Getting quotas for user e717c47d484148d2aa85c9f1c880ad87 and project 59f56311404b427ca1dc013c8c96f556. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:03:13.104523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f9f2e7e-e33c-45b9-aa66-d0ceb47f1a88 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:13.105172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f9f2e7e-e33c-45b9-aa66-d0ceb47f1a88 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:13.142219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:03:13.150530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:03:13.254495 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b55899b7-27ac-48dc-9976-eeffd18d9c77 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.544968 Aug 03 02:03:13.257436 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1609/3264] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:03:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 02:03:13.278130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d191d277-944c-46b5-8907-b05304a93666 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:13.280770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d191d277-944c-46b5-8907-b05304a93666 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:13.301193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d191d277-944c-46b5-8907-b05304a93666 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:13.301687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d191d277-944c-46b5-8907-b05304a93666 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:13.302538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d191d277-944c-46b5-8907-b05304a93666 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:13.303029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d191d277-944c-46b5-8907-b05304a93666 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:13.516408 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d191d277-944c-46b5-8907-b05304a93666 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:13.527088 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d191d277-944c-46b5-8907-b05304a93666 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1346 microversion: 2.1 time: 0.268439 Aug 03 02:03:13.528660 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1610/3265] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:13 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1346 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:13.539007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4a5c18f8-2d02-4f99-8827-84f3c03fb102 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:13.539718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4a5c18f8-2d02-4f99-8827-84f3c03fb102 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:13.681603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4a5c18f8-2d02-4f99-8827-84f3c03fb102 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:13.731197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8f9f2e7e-e33c-45b9-aa66-d0ceb47f1a88 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:13.756789 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4a5c18f8-2d02-4f99-8827-84f3c03fb102 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1214 microversion: 2.1 time: 0.175199 Aug 03 02:03:13.760785 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1611/3266] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:13 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1214 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:13.775530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8f9f2e7e-e33c-45b9-aa66-d0ceb47f1a88 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:13.783429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-7976d25c-9194-4b93-aece-483e9ee3490d req-29c0ba03-f695-42fb-982d-b1d5e4ca5a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-deleted", "tag": "2f376776-be8e-4267-a6c7-1496121c265b"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:13.789901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8f9f2e7e-e33c-45b9-aa66-d0ceb47f1a88 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:13.808385 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8f9f2e7e-e33c-45b9-aa66-d0ceb47f1a88 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1723 microversion: 2.20 time: 0.750673 Aug 03 02:03:13.811370 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1656/3267] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:13 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1723 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:13.816554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d35f90ef-0360-4810-ab46-5bb74a4ea673 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:13.823724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d35f90ef-0360-4810-ab46-5bb74a4ea673 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:13.830550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7976d25c-9194-4b93-aece-483e9ee3490d req-29c0ba03-f695-42fb-982d-b1d5e4ca5a6b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:13.833064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7976d25c-9194-4b93-aece-483e9ee3490d req-29c0ba03-f695-42fb-982d-b1d5e4ca5a6b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:13.847246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d35f90ef-0360-4810-ab46-5bb74a4ea673 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:13.856955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d35f90ef-0360-4810-ab46-5bb74a4ea673 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:13.867478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d35f90ef-0360-4810-ab46-5bb74a4ea673 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:13.870765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d35f90ef-0360-4810-ab46-5bb74a4ea673 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:13.900108 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-7976d25c-9194-4b93-aece-483e9ee3490d req-29c0ba03-f695-42fb-982d-b1d5e4ca5a6b service nova] Creating event network-vif-deleted:2f376776-be8e-4267-a6c7-1496121c265b for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 02:03:13.914855 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-7976d25c-9194-4b93-aece-483e9ee3490d req-29c0ba03-f695-42fb-982d-b1d5e4ca5a6b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148880 Aug 03 02:03:13.918795 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1612/3268] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:14.381382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d35f90ef-0360-4810-ab46-5bb74a4ea673 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:14.434896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d35f90ef-0360-4810-ab46-5bb74a4ea673 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:14.446182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d35f90ef-0360-4810-ab46-5bb74a4ea673 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:14.452070 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d35f90ef-0360-4810-ab46-5bb74a4ea673 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2503 microversion: 2.32 time: 0.635016 Aug 03 02:03:14.455178 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1657/3269] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:13 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2503 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:14.575856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4eeaa40a-a844-4e24-937a-2000f589c9c7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:14.577962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4eeaa40a-a844-4e24-937a-2000f589c9c7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:14.619405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eeaa40a-a844-4e24-937a-2000f589c9c7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:14.619989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eeaa40a-a844-4e24-937a-2000f589c9c7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:14.621754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eeaa40a-a844-4e24-937a-2000f589c9c7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:14.622595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eeaa40a-a844-4e24-937a-2000f589c9c7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:14.828727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fe3f99dd-3c2e-40e9-905a-8b961cf9c9c1 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:14.829611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fe3f99dd-3c2e-40e9-905a-8b961cf9c9c1 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:14.891529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4eeaa40a-a844-4e24-937a-2000f589c9c7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:14.909066 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4eeaa40a-a844-4e24-937a-2000f589c9c7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1346 microversion: 2.1 time: 0.340329 Aug 03 02:03:14.913925 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1613/3270] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:14 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1346 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:14.925350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-92170fed-9967-414e-b431-8f564d86bdff tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:14.926474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-92170fed-9967-414e-b431-8f564d86bdff tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:14.944861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92170fed-9967-414e-b431-8f564d86bdff tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:14.948516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92170fed-9967-414e-b431-8f564d86bdff tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:14.950607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92170fed-9967-414e-b431-8f564d86bdff tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:14.953119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92170fed-9967-414e-b431-8f564d86bdff tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:15.024206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fe3f99dd-3c2e-40e9-905a-8b961cf9c9c1 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:15.054693 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fe3f99dd-3c2e-40e9-905a-8b961cf9c9c1 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1214 microversion: 2.1 time: 0.254515 Aug 03 02:03:15.061270 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1658/3271] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:14 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1214 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:03:15.302621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-92170fed-9967-414e-b431-8f564d86bdff tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:15.319740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-92170fed-9967-414e-b431-8f564d86bdff tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:15.329031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-92170fed-9967-414e-b431-8f564d86bdff tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:15.330841 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-92170fed-9967-414e-b431-8f564d86bdff tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1723 microversion: 2.20 time: 0.415211 Aug 03 02:03:15.334425 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1614/3272] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:14 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1723 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:15.508884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8cda67e0-95d1-4bf1-ba63-63ccb47201d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:15.509903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8cda67e0-95d1-4bf1-ba63-63ccb47201d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:15.581445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8cda67e0-95d1-4bf1-ba63-63ccb47201d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:15.582415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8cda67e0-95d1-4bf1-ba63-63ccb47201d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:15.588437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8cda67e0-95d1-4bf1-ba63-63ccb47201d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:15.589778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8cda67e0-95d1-4bf1-ba63-63ccb47201d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:15.949797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0569a9a2-9183-4d27-8016-8132522c2e2c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:15.952823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0569a9a2-9183-4d27-8016-8132522c2e2c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:15.992207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0569a9a2-9183-4d27-8016-8132522c2e2c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:15.993080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0569a9a2-9183-4d27-8016-8132522c2e2c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:15.995400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0569a9a2-9183-4d27-8016-8132522c2e2c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:16.001713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0569a9a2-9183-4d27-8016-8132522c2e2c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:16.313601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0569a9a2-9183-4d27-8016-8132522c2e2c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:16.328177 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0569a9a2-9183-4d27-8016-8132522c2e2c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1346 microversion: 2.1 time: 0.384827 Aug 03 02:03:16.331546 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1615/3273] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:15 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1346 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:16.351852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-87ed079a-1553-47b1-8979-138528d8fc10 req-c6b655f9-1712-4c5a-a9e4-b4944de753d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-deleted", "tag": "de5bbd3b-5e5b-4a91-bb47-0b6cfdc6c874"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:16.377965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8cda67e0-95d1-4bf1-ba63-63ccb47201d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:16.392802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-87ed079a-1553-47b1-8979-138528d8fc10 req-c6b655f9-1712-4c5a-a9e4-b4944de753d7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:16.394023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-87ed079a-1553-47b1-8979-138528d8fc10 req-c6b655f9-1712-4c5a-a9e4-b4944de753d7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:16.406501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8cda67e0-95d1-4bf1-ba63-63ccb47201d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:16.411036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8cda67e0-95d1-4bf1-ba63-63ccb47201d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:16.414325 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8cda67e0-95d1-4bf1-ba63-63ccb47201d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2342 microversion: 2.32 time: 0.914124 Aug 03 02:03:16.416793 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1659/3274] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:15 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2342 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:16.425349 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-87ed079a-1553-47b1-8979-138528d8fc10 req-c6b655f9-1712-4c5a-a9e4-b4944de753d7 service nova] Creating event network-vif-deleted:de5bbd3b-5e5b-4a91-bb47-0b6cfdc6c874 for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 02:03:16.427513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9ea1803e-dec3-415c-a4d3-1fa486a925b0 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:16.430358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9ea1803e-dec3-415c-a4d3-1fa486a925b0 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:16.440543 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-87ed079a-1553-47b1-8979-138528d8fc10 req-c6b655f9-1712-4c5a-a9e4-b4944de753d7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103478 Aug 03 02:03:16.442306 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1616/3275] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:16.445039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ea1803e-dec3-415c-a4d3-1fa486a925b0 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:16.446508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ea1803e-dec3-415c-a4d3-1fa486a925b0 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:16.448565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ea1803e-dec3-415c-a4d3-1fa486a925b0 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:16.453027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ea1803e-dec3-415c-a4d3-1fa486a925b0 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:16.479772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c40677a3-63da-4a15-b731-abf2fc43bd14 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:16.488926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c40677a3-63da-4a15-b731-abf2fc43bd14 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:16.525750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c40677a3-63da-4a15-b731-abf2fc43bd14 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:16.526563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c40677a3-63da-4a15-b731-abf2fc43bd14 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:16.533231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c40677a3-63da-4a15-b731-abf2fc43bd14 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:16.534122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c40677a3-63da-4a15-b731-abf2fc43bd14 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:16.776352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c40677a3-63da-4a15-b731-abf2fc43bd14 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:16.779046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9ea1803e-dec3-415c-a4d3-1fa486a925b0 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:16.793376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c40677a3-63da-4a15-b731-abf2fc43bd14 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:16.797351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c40677a3-63da-4a15-b731-abf2fc43bd14 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:16.798604 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c40677a3-63da-4a15-b731-abf2fc43bd14 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1656 microversion: 2.20 time: 0.354313 Aug 03 02:03:16.811303 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9ea1803e-dec3-415c-a4d3-1fa486a925b0 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1266 microversion: 2.1 time: 0.375669 Aug 03 02:03:16.812267 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1660/3276] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:16 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:16.814636 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1617/3277] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:16 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1656 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:17.374355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c3f19966-5140-4ee3-b1a2-606cd2615dc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:17.375992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c3f19966-5140-4ee3-b1a2-606cd2615dc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:17.390370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3f19966-5140-4ee3-b1a2-606cd2615dc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:17.391575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3f19966-5140-4ee3-b1a2-606cd2615dc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:17.393248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3f19966-5140-4ee3-b1a2-606cd2615dc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:17.394373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3f19966-5140-4ee3-b1a2-606cd2615dc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:17.472286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-56fea630-1e5f-45ca-a36a-717879e35996 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:17.473149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-56fea630-1e5f-45ca-a36a-717879e35996 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:17.494554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c3f19966-5140-4ee3-b1a2-606cd2615dc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:17.498506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56fea630-1e5f-45ca-a36a-717879e35996 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:17.501897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56fea630-1e5f-45ca-a36a-717879e35996 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:17.504783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56fea630-1e5f-45ca-a36a-717879e35996 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:17.505256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56fea630-1e5f-45ca-a36a-717879e35996 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:17.510967 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c3f19966-5140-4ee3-b1a2-606cd2615dc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1346 microversion: 2.1 time: 0.145342 Aug 03 02:03:17.517701 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1661/3278] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:17 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1346 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:17.751438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-56fea630-1e5f-45ca-a36a-717879e35996 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:17.760815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-56fea630-1e5f-45ca-a36a-717879e35996 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:17.763487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-56fea630-1e5f-45ca-a36a-717879e35996 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:17.764846 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-56fea630-1e5f-45ca-a36a-717879e35996 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2228 microversion: 2.32 time: 0.297625 Aug 03 02:03:17.765779 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1618/3279] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:17 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2228 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:17.837447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a5192fa1-447b-4323-9fb4-361894de37a1 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:17.838653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-996e086f-7c01-46d6-95de-ee5f166e8df3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:17.841562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a5192fa1-447b-4323-9fb4-361894de37a1 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:17.842897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-996e086f-7c01-46d6-95de-ee5f166e8df3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:17.860375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-996e086f-7c01-46d6-95de-ee5f166e8df3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:17.862411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5192fa1-447b-4323-9fb4-361894de37a1 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:17.863123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5192fa1-447b-4323-9fb4-361894de37a1 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:17.863835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-996e086f-7c01-46d6-95de-ee5f166e8df3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:17.865360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-996e086f-7c01-46d6-95de-ee5f166e8df3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:17.866144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5192fa1-447b-4323-9fb4-361894de37a1 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:17.866777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5192fa1-447b-4323-9fb4-361894de37a1 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:17.867502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-996e086f-7c01-46d6-95de-ee5f166e8df3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:17.927595 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:18.037033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a5192fa1-447b-4323-9fb4-361894de37a1 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:18.045818 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a5192fa1-447b-4323-9fb4-361894de37a1 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1272 microversion: 2.1 time: 0.215460 Aug 03 02:03:18.050210 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1619/3280] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:17 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:03:18.055027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-996e086f-7c01-46d6-95de-ee5f166e8df3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:18.073089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-996e086f-7c01-46d6-95de-ee5f166e8df3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:18.076793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-996e086f-7c01-46d6-95de-ee5f166e8df3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:18.078710 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-996e086f-7c01-46d6-95de-ee5f166e8df3 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1656 microversion: 2.20 time: 0.256854 Aug 03 02:03:18.088148 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1662/3281] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:17 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1656 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:18.551440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8832807b-8f0c-45e5-92dd-f325aafe84b4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:18.552151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8832807b-8f0c-45e5-92dd-f325aafe84b4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:18.596155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8832807b-8f0c-45e5-92dd-f325aafe84b4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:18.607226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8832807b-8f0c-45e5-92dd-f325aafe84b4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:18.608255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8832807b-8f0c-45e5-92dd-f325aafe84b4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:18.612187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8832807b-8f0c-45e5-92dd-f325aafe84b4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:18.693347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-7aaf56f6-228e-4128-9364-9167bd77b4e3 req-80afd9be-9918-4119-a177-9c8d1bab18e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7d0db2-f64d-4df7-b0dd-2ecf688290b0", "name": "network-vif-deleted", "tag": "1b653dfb-172c-43c5-8d81-55e28541d60d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:18.775341 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7aaf56f6-228e-4128-9364-9167bd77b4e3 req-80afd9be-9918-4119-a177-9c8d1bab18e8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:18.780713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7aaf56f6-228e-4128-9364-9167bd77b4e3 req-80afd9be-9918-4119-a177-9c8d1bab18e8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:18.811723 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-7aaf56f6-228e-4128-9364-9167bd77b4e3 req-80afd9be-9918-4119-a177-9c8d1bab18e8 service nova] Creating event network-vif-deleted:1b653dfb-172c-43c5-8d81-55e28541d60d for instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 on n-h1-826529-8 Aug 03 02:03:18.827381 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-7aaf56f6-228e-4128-9364-9167bd77b4e3 req-80afd9be-9918-4119-a177-9c8d1bab18e8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151482 Aug 03 02:03:18.830894 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1663/3282] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:03:18.835420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8832807b-8f0c-45e5-92dd-f325aafe84b4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:18.854543 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8832807b-8f0c-45e5-92dd-f325aafe84b4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 200 len: 1346 microversion: 2.1 time: 0.316493 Aug 03 02:03:18.855086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-963be281-e92f-4907-b803-c65915f2fbd3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:18.856451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-963be281-e92f-4907-b803-c65915f2fbd3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:18.875775 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1620/3283] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:18 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 1346 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:18.880804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-963be281-e92f-4907-b803-c65915f2fbd3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:18.888039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-963be281-e92f-4907-b803-c65915f2fbd3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:18.889156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-963be281-e92f-4907-b803-c65915f2fbd3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:18.889764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-963be281-e92f-4907-b803-c65915f2fbd3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:19.074455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d9cd93dd-2faa-4a82-b050-714e6659e1c7 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:19.075842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d9cd93dd-2faa-4a82-b050-714e6659e1c7 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:19.092540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9cd93dd-2faa-4a82-b050-714e6659e1c7 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:19.093937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9cd93dd-2faa-4a82-b050-714e6659e1c7 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:19.095628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9cd93dd-2faa-4a82-b050-714e6659e1c7 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:19.096708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9cd93dd-2faa-4a82-b050-714e6659e1c7 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:19.215068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-963be281-e92f-4907-b803-c65915f2fbd3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:19.228259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-963be281-e92f-4907-b803-c65915f2fbd3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:19.247851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-963be281-e92f-4907-b803-c65915f2fbd3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:19.255192 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-963be281-e92f-4907-b803-c65915f2fbd3 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2228 microversion: 2.32 time: 0.415714 Aug 03 02:03:19.255915 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1664/3284] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:18 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2228 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:19.269727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2d8f8ab4-0e2d-40ce-b1a1-a3d4ebe70e64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:19.271026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2d8f8ab4-0e2d-40ce-b1a1-a3d4ebe70e64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:19.283285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d9cd93dd-2faa-4a82-b050-714e6659e1c7 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:19.291704 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d9cd93dd-2faa-4a82-b050-714e6659e1c7 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1272 microversion: 2.1 time: 0.224727 Aug 03 02:03:19.292314 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1621/3285] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:19 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:03:19.295434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d8f8ab4-0e2d-40ce-b1a1-a3d4ebe70e64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:19.296328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d8f8ab4-0e2d-40ce-b1a1-a3d4ebe70e64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:19.297145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d8f8ab4-0e2d-40ce-b1a1-a3d4ebe70e64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:19.297587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d8f8ab4-0e2d-40ce-b1a1-a3d4ebe70e64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:19.348447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d8f8ab4-0e2d-40ce-b1a1-a3d4ebe70e64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:19.348818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d8f8ab4-0e2d-40ce-b1a1-a3d4ebe70e64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:19.349287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-2d8f8ab4-0e2d-40ce-b1a1-a3d4ebe70e64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lazy-loading 'fault' on Instance uuid 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:03:19.406483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2d8f8ab4-0e2d-40ce-b1a1-a3d4ebe70e64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:19.416933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2d8f8ab4-0e2d-40ce-b1a1-a3d4ebe70e64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:19.420017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2d8f8ab4-0e2d-40ce-b1a1-a3d4ebe70e64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:19.421260 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2d8f8ab4-0e2d-40ce-b1a1-a3d4ebe70e64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 200 len: 1371 microversion: 2.20 time: 0.164197 Aug 03 02:03:19.429100 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1665/3286] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:19 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:19.887854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8c1b24f0-13ba-470c-b236-e8709adff542 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:19.891501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8c1b24f0-13ba-470c-b236-e8709adff542 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:19.919754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c1b24f0-13ba-470c-b236-e8709adff542 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:19.920216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c1b24f0-13ba-470c-b236-e8709adff542 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:19.921024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c1b24f0-13ba-470c-b236-e8709adff542 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:19.927466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c1b24f0-13ba-470c-b236-e8709adff542 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:19.969553 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-8c1b24f0-13ba-470c-b236-e8709adff542 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8c1b24f0-13ba-470c-b236-e8709adff542 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe HTTP/1.1 Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'cca5751e-57cb-49b2-982e-0201e2a94ffe'} Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:19.973546 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:19.991177 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:19.991177 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:19.991177 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:19.991177 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:03:19.991177 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:03:19.991177 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:03:19.991177 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:19.991177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8c1b24f0-13ba-470c-b236-e8709adff542 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:03:19.994771 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8c1b24f0-13ba-470c-b236-e8709adff542 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 404 len: 111 microversion: 2.1 time: 0.116564 Aug 03 02:03:19.997927 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1622/3287] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:19 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:03:20.145364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2c56c3c-1bc7-401d-9679-540a447bc035 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:20.147750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c2c56c3c-1bc7-401d-9679-540a447bc035 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:20.157423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:20.161981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2c56c3c-1bc7-401d-9679-540a447bc035 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:20.162445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2c56c3c-1bc7-401d-9679-540a447bc035 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:20.166537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2c56c3c-1bc7-401d-9679-540a447bc035 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:20.167041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2c56c3c-1bc7-401d-9679-540a447bc035 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:20.189139 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-c2c56c3c-1bc7-401d-9679-540a447bc035 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2c56c3c-1bc7-401d-9679-540a447bc035 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe/os-volume_attachments HTTP/1.1 Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'server_id': 'cca5751e-57cb-49b2-982e-0201e2a94ffe'} Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:03:20.190985 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:03:20.195836 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:03:20.195836 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:20.195836 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:20.195836 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:20.195836 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:20.195836 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:20.195836 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:20.195836 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:03:20.195836 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:03:20.195836 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:03:20.195836 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:20.197590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2c56c3c-1bc7-401d-9679-540a447bc035 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:03:20.198636 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c2c56c3c-1bc7-401d-9679-540a447bc035 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.058806 Aug 03 02:03:20.200076 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1666/3288] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:03:20 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:03:20.281614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5dcb20ef-c8b9-4b01-8b8c-847a53fa6fb4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:20.283338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5dcb20ef-c8b9-4b01-8b8c-847a53fa6fb4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:20.296312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dcb20ef-c8b9-4b01-8b8c-847a53fa6fb4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:20.297488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dcb20ef-c8b9-4b01-8b8c-847a53fa6fb4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:20.299234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dcb20ef-c8b9-4b01-8b8c-847a53fa6fb4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:20.300739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dcb20ef-c8b9-4b01-8b8c-847a53fa6fb4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:20.324696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9175939b-ebb5-4061-a875-8f9539b58078 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:20.325734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9175939b-ebb5-4061-a875-8f9539b58078 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:20.342993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9175939b-ebb5-4061-a875-8f9539b58078 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:20.343467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9175939b-ebb5-4061-a875-8f9539b58078 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:20.344284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9175939b-ebb5-4061-a875-8f9539b58078 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:20.344763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9175939b-ebb5-4061-a875-8f9539b58078 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:20.436969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5dcb20ef-c8b9-4b01-8b8c-847a53fa6fb4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:20.482026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5dcb20ef-c8b9-4b01-8b8c-847a53fa6fb4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:20.489831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5dcb20ef-c8b9-4b01-8b8c-847a53fa6fb4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:20.499229 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5dcb20ef-c8b9-4b01-8b8c-847a53fa6fb4 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 2160 microversion: 2.32 time: 0.214953 Aug 03 02:03:20.500677 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1623/3289] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:20 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 2160 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:20.515702 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1013660839", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "cf1e5fc2-66a4-4802-965c-545f628b0c29"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:20.586374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9175939b-ebb5-4061-a875-8f9539b58078 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:20.603071 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9175939b-ebb5-4061-a875-8f9539b58078 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1272 microversion: 2.1 time: 0.283047 Aug 03 02:03:20.604651 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1667/3290] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:20 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1272 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:03:20.623279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1576cad7-524a-4128-beb7-07df742594ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:20.625804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1576cad7-524a-4128-beb7-07df742594ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:20.642077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1576cad7-524a-4128-beb7-07df742594ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:20.643952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] validate_networks() for [('cf1e5fc2-66a4-4802-965c-545f628b0c29', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:03:20.644196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1576cad7-524a-4128-beb7-07df742594ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:20.647061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1576cad7-524a-4128-beb7-07df742594ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:20.647765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1576cad7-524a-4128-beb7-07df742594ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:20.710460 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-1576cad7-524a-4128-beb7-07df742594ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] HTTP exception thrown: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1576cad7-524a-4128-beb7-07df742594ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Request method failure captured: Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 HTTP/1.1 Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dZfxZiFPysNXB16bIkMZ-7Cn3Km1a9HAWIfreNeUgh28J492cbxEOoO45TNvWVYIjM_-kJI7qB8Rjq_YL9i6dck-QJkcpmdKs-lu8MY59NuRi9m1ThcgH_s-Z12NV8EyT03_1vhmc7B6Kd_fnAY-0bH5gEh-wmfO4V_HDSUxJngFvE Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9907ef20b17f42acb99a8b61502f29a3 Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9907ef20b17f42acb99a8b61502f29a3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9907ef20b17f42acb99a8b61502f29a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9907ef20b17f42acb99a8b61502f29a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9907ef20b17f42acb99a8b61502f29a3"}]}] Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9907ef20b17f42acb99a8b61502f29a3 Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeShelveTestJSON-2134656059-project Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 81ae7aa9aed7440a8bdfd4595eae3be8 Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2134656059-project Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '7c7d0db2-f64d-4df7-b0dd-2ecf688290b0'} Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:20.719061 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:20.728448 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:20.728448 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:20.728448 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:20.728448 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:20.728448 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:03:20.728448 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:03:20.728448 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. Aug 03 02:03:20.728448 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:20.734049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1576cad7-524a-4128-beb7-07df742594ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Returning 404 to user: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:03:20.736831 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1576cad7-524a-4128-beb7-07df742594ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 404 len: 111 microversion: 2.20 time: 0.127232 Aug 03 02:03:20.741653 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1668/3291] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:20 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:03:20.779451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4f6a443c-565e-4517-a42f-8fd69163a2b6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '.version_select at 0x7f5b12342550>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:20.874335 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4f6a443c-565e-4517-a42f-8fd69163a2b6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046613658" status: 204 len: 0 microversion: 2.20 time: 0.128242 Aug 03 02:03:20.879308 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1669/3292] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 3 02:03:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046613658 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 02:03:21.279099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-4e84ab8c-6cf1-4d26-a47c-643a7e3fd932 req-bc4c7be9-7d50-43fd-8998-b84cf1e2a4eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c5fe16-6b90-4d79-a61d-c9bede1ee174", "name": "network-vif-deleted", "tag": "9106a59f-415c-4da3-93ee-ae5f0c636a4a"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:21.303917 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4e84ab8c-6cf1-4d26-a47c-643a7e3fd932 req-bc4c7be9-7d50-43fd-8998-b84cf1e2a4eb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:21.306415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4e84ab8c-6cf1-4d26-a47c-643a7e3fd932 req-bc4c7be9-7d50-43fd-8998-b84cf1e2a4eb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:21.344177 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-4e84ab8c-6cf1-4d26-a47c-643a7e3fd932 req-bc4c7be9-7d50-43fd-8998-b84cf1e2a4eb service nova] Creating event network-vif-deleted:9106a59f-415c-4da3-93ee-ae5f0c636a4a for instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 on n-h1-826529-8 Aug 03 02:03:21.357210 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-4e84ab8c-6cf1-4d26-a47c-643a7e3fd932 req-bc4c7be9-7d50-43fd-8998-b84cf1e2a4eb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242395 Aug 03 02:03:21.360876 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1670/3293] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:21.530888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cf3f0e13-46cd-4c31-b751-244a717c3a38 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:21.531781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cf3f0e13-46cd-4c31-b751-244a717c3a38 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:21.550461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf3f0e13-46cd-4c31-b751-244a717c3a38 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:21.550984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf3f0e13-46cd-4c31-b751-244a717c3a38 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:21.558985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf3f0e13-46cd-4c31-b751-244a717c3a38 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:21.558985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf3f0e13-46cd-4c31-b751-244a717c3a38 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:22.225951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cf3f0e13-46cd-4c31-b751-244a717c3a38 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:22.278956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cf3f0e13-46cd-4c31-b751-244a717c3a38 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:22.284935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cf3f0e13-46cd-4c31-b751-244a717c3a38 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:22.289778 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cf3f0e13-46cd-4c31-b751-244a717c3a38 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.764211 Aug 03 02:03:22.296714 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1671/3294] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:21 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:03:22.309326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d2a3d456-a021-4586-a722-f8bf5280e9b6 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:22.311731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d2a3d456-a021-4586-a722-f8bf5280e9b6 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:22.345778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2a3d456-a021-4586-a722-f8bf5280e9b6 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:22.346417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2a3d456-a021-4586-a722-f8bf5280e9b6 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:22.352865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2a3d456-a021-4586-a722-f8bf5280e9b6 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:22.353466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2a3d456-a021-4586-a722-f8bf5280e9b6 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:23.029044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:23.433309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d2a3d456-a021-4586-a722-f8bf5280e9b6 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:23.441100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:03:23.441100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:03:23.441100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:03:23.441100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:03:23.441100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:03:23.446543 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d2a3d456-a021-4586-a722-f8bf5280e9b6 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1314 microversion: 2.1 time: 1.148285 Aug 03 02:03:23.454089 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1672/3295] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:22 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1314 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:23.475069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-34f89d79-7b36-4275-8e3d-ba9206b2782a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:23.477344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-34f89d79-7b36-4275-8e3d-ba9206b2782a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:23.489068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34f89d79-7b36-4275-8e3d-ba9206b2782a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:23.492453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34f89d79-7b36-4275-8e3d-ba9206b2782a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:23.498483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34f89d79-7b36-4275-8e3d-ba9206b2782a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:23.499376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:23.499991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:23.500757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34f89d79-7b36-4275-8e3d-ba9206b2782a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:23.503362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:23.514565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:23.577231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Getting quotas for project 01f1d9f8216e4f729a5e24aad713fe98. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:03:23.598108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Getting quotas for user 0dc56b77862f410d82c8617f3d679775 and project 01f1d9f8216e4f729a5e24aad713fe98. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:03:23.634699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:03:23.641816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 427d3e2e-05aa-4e34-9a36-56c13e67dc77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:03:23.763467 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9797c1af-9602-4df1-85e3-75deb169fedc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.261371 Aug 03 02:03:23.780947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-34f89d79-7b36-4275-8e3d-ba9206b2782a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:23.784394 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1624/3296] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:03:23.789403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d9038e81-a407-4a5b-80e0-f9891947c909 req-ba4ee9b7-d69b-4e55-9e32-f4a586da8a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e5fb4f-3500-430d-aeed-68585f707abc", "tag": "73acd654-aad5-44f0-9132-9feedbd29b84"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:23.818815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d9038e81-a407-4a5b-80e0-f9891947c909 req-ba4ee9b7-d69b-4e55-9e32-f4a586da8a65 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:23.819318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d9038e81-a407-4a5b-80e0-f9891947c909 req-ba4ee9b7-d69b-4e55-9e32-f4a586da8a65 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:23.822331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:23.843473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-34f89d79-7b36-4275-8e3d-ba9206b2782a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:23.852541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-34f89d79-7b36-4275-8e3d-ba9206b2782a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:23.854826 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-34f89d79-7b36-4275-8e3d-ba9206b2782a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.398735 Aug 03 02:03:23.875233 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1673/3297] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:23 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:23.889086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-88502d79-310d-4e3c-b011-ee4114f495b9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:23.889086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-88502d79-310d-4e3c-b011-ee4114f495b9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 427d3e2e-05aa-4e34-9a36-56c13e67dc77] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:23.891313 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d9038e81-a407-4a5b-80e0-f9891947c909 req-ba4ee9b7-d69b-4e55-9e32-f4a586da8a65 service nova] Creating event network-changed:73acd654-aad5-44f0-9132-9feedbd29b84 for instance f6e5fb4f-3500-430d-aeed-68585f707abc on n-h2-826529-8 Aug 03 02:03:23.898638 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d9038e81-a407-4a5b-80e0-f9891947c909 req-ba4ee9b7-d69b-4e55-9e32-f4a586da8a65 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112891 Aug 03 02:03:23.909352 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1625/3298] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:24.061564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-88502d79-310d-4e3c-b011-ee4114f495b9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:24.076540 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-88502d79-310d-4e3c-b011-ee4114f495b9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/427d3e2e-05aa-4e34-9a36-56c13e67dc77" status: 200 len: 1215 microversion: 2.1 time: 0.207490 Aug 03 02:03:24.079883 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1674/3299] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:23 2022] GET /compute/v2.1/servers/427d3e2e-05aa-4e34-9a36-56c13e67dc77 => generated 1215 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:24.108595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-52e13c1b-bc25-456e-870b-40ddd1c077e9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:24.109293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-52e13c1b-bc25-456e-870b-40ddd1c077e9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 427d3e2e-05aa-4e34-9a36-56c13e67dc77] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:24.120713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:24.169142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-52e13c1b-bc25-456e-870b-40ddd1c077e9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 427d3e2e-05aa-4e34-9a36-56c13e67dc77] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:03:24.477862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b12f5b26-543a-4947-b593-d143d3208140 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:24.478626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b12f5b26-543a-4947-b593-d143d3208140 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:24.498248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b12f5b26-543a-4947-b593-d143d3208140 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:24.499119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b12f5b26-543a-4947-b593-d143d3208140 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:24.500478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b12f5b26-543a-4947-b593-d143d3208140 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:24.502088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b12f5b26-543a-4947-b593-d143d3208140 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:24.760087 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.compute.api [None req-52e13c1b-bc25-456e-870b-40ddd1c077e9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 427d3e2e-05aa-4e34-9a36-56c13e67dc77] Instance Mapping does not exist while attempting local delete cleanup. Aug 03 02:03:24.761013 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-52e13c1b-bc25-456e-870b-40ddd1c077e9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "DELETE /compute/v2.1/servers/427d3e2e-05aa-4e34-9a36-56c13e67dc77" status: 204 len: 0 microversion: 2.1 time: 0.659679 Aug 03 02:03:24.762163 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1626/3300] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:03:24 2022] DELETE /compute/v2.1/servers/427d3e2e-05aa-4e34-9a36-56c13e67dc77 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:03:24.771260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-77a7ec11-1377-441a-8618-c16ce5fb8fca tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:24.771893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-77a7ec11-1377-441a-8618-c16ce5fb8fca tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 427d3e2e-05aa-4e34-9a36-56c13e67dc77] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:24.812061 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-77a7ec11-1377-441a-8618-c16ce5fb8fca tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-77a7ec11-1377-441a-8618-c16ce5fb8fca tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/427d3e2e-05aa-4e34-9a36-56c13e67dc77 HTTP/1.1 Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '427d3e2e-05aa-4e34-9a36-56c13e67dc77'} Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:24.813761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:24.818233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:24.818233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:03:24.818233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:03:24.818233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. Aug 03 02:03:24.818233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:24.818233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-77a7ec11-1377-441a-8618-c16ce5fb8fca tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:03:24.826395 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-77a7ec11-1377-441a-8618-c16ce5fb8fca tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/427d3e2e-05aa-4e34-9a36-56c13e67dc77" status: 404 len: 111 microversion: 2.1 time: 0.048325 Aug 03 02:03:24.827542 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1627/3301] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:24 2022] GET /compute/v2.1/servers/427d3e2e-05aa-4e34-9a36-56c13e67dc77 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:03:24.888530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1776847598", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "cf1e5fc2-66a4-4802-965c-545f628b0c29"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:24.986530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] validate_networks() for [('cf1e5fc2-66a4-4802-965c-545f628b0c29', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:03:25.393721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b12f5b26-543a-4947-b593-d143d3208140 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:25.408396 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b12f5b26-543a-4947-b593-d143d3208140 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1314 microversion: 2.1 time: 0.934629 Aug 03 02:03:25.413453 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1675/3302] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:24 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1314 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:25.434310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f6d8ab94-b671-44e2-93e9-c1bbba8d6be2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:25.434993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f6d8ab94-b671-44e2-93e9-c1bbba8d6be2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:25.451891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f6d8ab94-b671-44e2-93e9-c1bbba8d6be2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:25.452410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f6d8ab94-b671-44e2-93e9-c1bbba8d6be2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:25.454886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f6d8ab94-b671-44e2-93e9-c1bbba8d6be2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:25.458185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f6d8ab94-b671-44e2-93e9-c1bbba8d6be2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:25.676049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f6d8ab94-b671-44e2-93e9-c1bbba8d6be2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:25.740983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f6d8ab94-b671-44e2-93e9-c1bbba8d6be2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:25.742874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f6d8ab94-b671-44e2-93e9-c1bbba8d6be2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:25.748045 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f6d8ab94-b671-44e2-93e9-c1bbba8d6be2 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.333395 Aug 03 02:03:25.749208 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1676/3303] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:25 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:25.780197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-131ccb88-beaa-4e73-9963-19646575f2fc tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Action: 'create', calling method: .version_select at 0x7f5b12a7e9d0>, body: {"keypair": {"name": "tempest-keypair-2130768673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXIsoqeVj58YepcP+YP9Yp6iJZkG4AezOdp61+DOVTmJkEvzsVjE/qNWUh0FlaV/YFwdoyV0p14bmHfcL2h2PWHzr6kaV4LQFBB4/8HiWlnsRZaQ90LfNI+GhWdgn+LNA=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:25.813909 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-131ccb88-beaa-4e73-9963-19646575f2fc tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Getting quotas for project 9907ef20b17f42acb99a8b61502f29a3. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:03:25.831108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-131ccb88-beaa-4e73-9963-19646575f2fc tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Getting quotas for user 81ae7aa9aed7440a8bdfd4595eae3be8 and project 9907ef20b17f42acb99a8b61502f29a3. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:03:25.875285 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-131ccb88-beaa-4e73-9963-19646575f2fc tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.122066 Aug 03 02:03:25.876662 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1677/3304] 10.222.0.67 () {62 vars in 1200 bytes} [Wed Aug 3 02:03:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 02:03:26.081680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:03:26.082192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:03:26.082784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:03:26.083318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:03:26.083815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:03:26.104732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:26.106265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:26.107733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:26.109599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:26.176549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Getting quotas for project 01f1d9f8216e4f729a5e24aad713fe98. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:03:26.201574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Getting quotas for user 0dc56b77862f410d82c8617f3d679775 and project 01f1d9f8216e4f729a5e24aad713fe98. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:03:26.240935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:03:26.243653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:03:26.349034 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-47b19010-0b7b-487c-b6fb-ff88155c556c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.466680 Aug 03 02:03:26.353393 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1628/3305] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:03:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 02:03:26.368341 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2acbde28-40b8-46a8-a6ff-425be845654b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:26.369129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2acbde28-40b8-46a8-a6ff-425be845654b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:26.462852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5d75cf81-b357-424b-b8d2-2398ab0020d2 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:26.462852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5d75cf81-b357-424b-b8d2-2398ab0020d2 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:26.476520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d75cf81-b357-424b-b8d2-2398ab0020d2 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:26.483638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d75cf81-b357-424b-b8d2-2398ab0020d2 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:26.484971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d75cf81-b357-424b-b8d2-2398ab0020d2 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:26.485693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d75cf81-b357-424b-b8d2-2398ab0020d2 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:26.537019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2acbde28-40b8-46a8-a6ff-425be845654b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:26.558032 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2acbde28-40b8-46a8-a6ff-425be845654b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1215 microversion: 2.1 time: 0.193441 Aug 03 02:03:26.564537 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1678/3306] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:26 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:26.778559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-51b46465-fa4b-4741-bd3d-5ec50bfbd8a0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:26.779289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-51b46465-fa4b-4741-bd3d-5ec50bfbd8a0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:26.796963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51b46465-fa4b-4741-bd3d-5ec50bfbd8a0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:26.808061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51b46465-fa4b-4741-bd3d-5ec50bfbd8a0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:26.810024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51b46465-fa4b-4741-bd3d-5ec50bfbd8a0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:26.815997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51b46465-fa4b-4741-bd3d-5ec50bfbd8a0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:26.970197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-51b46465-fa4b-4741-bd3d-5ec50bfbd8a0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:26.980021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-51b46465-fa4b-4741-bd3d-5ec50bfbd8a0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:26.988347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-51b46465-fa4b-4741-bd3d-5ec50bfbd8a0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:26.992070 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-51b46465-fa4b-4741-bd3d-5ec50bfbd8a0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.219751 Aug 03 02:03:26.996046 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1679/3307] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:26 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:03:27.000674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5d75cf81-b357-424b-b8d2-2398ab0020d2 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:27.018529 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5d75cf81-b357-424b-b8d2-2398ab0020d2 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1314 microversion: 2.1 time: 0.577609 Aug 03 02:03:27.019460 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1629/3308] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:26 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:27.583986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7bb47ae8-944a-4364-aab5-1826bdf085e5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:27.585241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7bb47ae8-944a-4364-aab5-1826bdf085e5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:27.598057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bb47ae8-944a-4364-aab5-1826bdf085e5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:27.606308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bb47ae8-944a-4364-aab5-1826bdf085e5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:27.607512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bb47ae8-944a-4364-aab5-1826bdf085e5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:27.608155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bb47ae8-944a-4364-aab5-1826bdf085e5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:27.822538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7bb47ae8-944a-4364-aab5-1826bdf085e5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:27.835141 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7bb47ae8-944a-4364-aab5-1826bdf085e5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1211 microversion: 2.1 time: 0.256370 Aug 03 02:03:27.836309 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1680/3309] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:27 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1211 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:28.032025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4ab987f8-56dd-4869-adb1-f65a192a7d24 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:28.032771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4ab987f8-56dd-4869-adb1-f65a192a7d24 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:28.051618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ab987f8-56dd-4869-adb1-f65a192a7d24 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:28.052129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-77e14ec8-c3ef-4158-98d2-f34efabe386a tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:28.052320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ab987f8-56dd-4869-adb1-f65a192a7d24 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:28.053404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-77e14ec8-c3ef-4158-98d2-f34efabe386a tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:28.057031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ab987f8-56dd-4869-adb1-f65a192a7d24 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:28.057590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ab987f8-56dd-4869-adb1-f65a192a7d24 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:28.072359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77e14ec8-c3ef-4158-98d2-f34efabe386a tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:28.077061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77e14ec8-c3ef-4158-98d2-f34efabe386a tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:28.079059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77e14ec8-c3ef-4158-98d2-f34efabe386a tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:28.082247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77e14ec8-c3ef-4158-98d2-f34efabe386a tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:28.179038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4ab987f8-56dd-4869-adb1-f65a192a7d24 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:28.197274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4ab987f8-56dd-4869-adb1-f65a192a7d24 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:28.206301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4ab987f8-56dd-4869-adb1-f65a192a7d24 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:28.207626 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4ab987f8-56dd-4869-adb1-f65a192a7d24 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.181340 Aug 03 02:03:28.232870 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1630/3310] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:28 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:28.530387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-77e14ec8-c3ef-4158-98d2-f34efabe386a tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:28.548645 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-77e14ec8-c3ef-4158-98d2-f34efabe386a tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1314 microversion: 2.1 time: 0.502344 Aug 03 02:03:28.553893 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1681/3311] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:28 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:28.690882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-a366e2be-2ad5-46dd-9756-5d524cc8e9cb req-824b23cb-762c-4b70-8844-27611ae9055b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e5fb4f-3500-430d-aeed-68585f707abc", "name": "network-vif-plugged", "status": "completed", "tag": "73acd654-aad5-44f0-9132-9feedbd29b84"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:28.705852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a366e2be-2ad5-46dd-9756-5d524cc8e9cb req-824b23cb-762c-4b70-8844-27611ae9055b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:28.706537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a366e2be-2ad5-46dd-9756-5d524cc8e9cb req-824b23cb-762c-4b70-8844-27611ae9055b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:28.720806 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-a366e2be-2ad5-46dd-9756-5d524cc8e9cb req-824b23cb-762c-4b70-8844-27611ae9055b service nova] Creating event network-vif-plugged:73acd654-aad5-44f0-9132-9feedbd29b84 for instance f6e5fb4f-3500-430d-aeed-68585f707abc on n-h2-826529-8 Aug 03 02:03:28.734013 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-a366e2be-2ad5-46dd-9756-5d524cc8e9cb req-824b23cb-762c-4b70-8844-27611ae9055b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202559 Aug 03 02:03:28.739221 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1631/3312] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:03:28.860875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4b2d9701-e537-4f53-b5d5-90ccdb1200e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:28.862130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4b2d9701-e537-4f53-b5d5-90ccdb1200e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:28.884332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b2d9701-e537-4f53-b5d5-90ccdb1200e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:28.885688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b2d9701-e537-4f53-b5d5-90ccdb1200e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:28.891429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b2d9701-e537-4f53-b5d5-90ccdb1200e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:28.893014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b2d9701-e537-4f53-b5d5-90ccdb1200e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:29.033102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4b2d9701-e537-4f53-b5d5-90ccdb1200e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:29.041331 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4b2d9701-e537-4f53-b5d5-90ccdb1200e1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1273 microversion: 2.1 time: 0.187745 Aug 03 02:03:29.043537 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1682/3313] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:28 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:29.239213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9094c57b-40fd-40d7-8fb4-44f15b5982d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:29.239908 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9094c57b-40fd-40d7-8fb4-44f15b5982d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:29.255014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9094c57b-40fd-40d7-8fb4-44f15b5982d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:29.263366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9094c57b-40fd-40d7-8fb4-44f15b5982d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:29.264305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9094c57b-40fd-40d7-8fb4-44f15b5982d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:29.264849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9094c57b-40fd-40d7-8fb4-44f15b5982d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:29.425639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9094c57b-40fd-40d7-8fb4-44f15b5982d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:29.441177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9094c57b-40fd-40d7-8fb4-44f15b5982d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:29.443083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9094c57b-40fd-40d7-8fb4-44f15b5982d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:29.444708 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9094c57b-40fd-40d7-8fb4-44f15b5982d0 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.212230 Aug 03 02:03:29.448109 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1632/3314] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:29 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:03:29.576585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-57282567-2cac-4c3b-9036-9b9be91fa278 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:29.577532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-57282567-2cac-4c3b-9036-9b9be91fa278 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:29.595262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57282567-2cac-4c3b-9036-9b9be91fa278 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:29.595907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57282567-2cac-4c3b-9036-9b9be91fa278 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:29.598455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57282567-2cac-4c3b-9036-9b9be91fa278 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:29.598978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57282567-2cac-4c3b-9036-9b9be91fa278 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:29.980614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-57282567-2cac-4c3b-9036-9b9be91fa278 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:29.993109 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-57282567-2cac-4c3b-9036-9b9be91fa278 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1314 microversion: 2.1 time: 0.422842 Aug 03 02:03:30.020695 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1683/3315] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:29 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:30.069919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-27486246-e3f9-4755-9ad8-29e68f02c4a9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:30.070478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-27486246-e3f9-4755-9ad8-29e68f02c4a9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:30.084850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27486246-e3f9-4755-9ad8-29e68f02c4a9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:30.085302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27486246-e3f9-4755-9ad8-29e68f02c4a9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:30.091032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27486246-e3f9-4755-9ad8-29e68f02c4a9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:30.091500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27486246-e3f9-4755-9ad8-29e68f02c4a9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:30.297726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-27486246-e3f9-4755-9ad8-29e68f02c4a9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:30.312136 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-27486246-e3f9-4755-9ad8-29e68f02c4a9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1273 microversion: 2.1 time: 0.241415 Aug 03 02:03:30.313349 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1633/3316] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:30 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:30.475505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5ab9e801-c5ec-43ac-b5d0-83fb5fd3c063 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:30.476172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5ab9e801-c5ec-43ac-b5d0-83fb5fd3c063 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:30.496847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ab9e801-c5ec-43ac-b5d0-83fb5fd3c063 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:30.499735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ab9e801-c5ec-43ac-b5d0-83fb5fd3c063 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:30.500767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ab9e801-c5ec-43ac-b5d0-83fb5fd3c063 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:30.506502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ab9e801-c5ec-43ac-b5d0-83fb5fd3c063 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:30.702051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ab9e801-c5ec-43ac-b5d0-83fb5fd3c063 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:30.716969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ab9e801-c5ec-43ac-b5d0-83fb5fd3c063 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:30.719244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ab9e801-c5ec-43ac-b5d0-83fb5fd3c063 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:30.720793 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5ab9e801-c5ec-43ac-b5d0-83fb5fd3c063 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.249466 Aug 03 02:03:30.721990 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1684/3317] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:30 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:31.025949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6a74ac6f-c057-4bd9-b8e9-13cabf3bfbe8 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:31.027149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6a74ac6f-c057-4bd9-b8e9-13cabf3bfbe8 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:31.035575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a74ac6f-c057-4bd9-b8e9-13cabf3bfbe8 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:31.036377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a74ac6f-c057-4bd9-b8e9-13cabf3bfbe8 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:31.037531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a74ac6f-c057-4bd9-b8e9-13cabf3bfbe8 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:31.038198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a74ac6f-c057-4bd9-b8e9-13cabf3bfbe8 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:31.212940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6a74ac6f-c057-4bd9-b8e9-13cabf3bfbe8 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:31.228011 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6a74ac6f-c057-4bd9-b8e9-13cabf3bfbe8 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1314 microversion: 2.1 time: 0.209749 Aug 03 02:03:31.229889 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1634/3318] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:31 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:31.335187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a9813cf9-e7c1-4fac-8923-197882f22826 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:31.336633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a9813cf9-e7c1-4fac-8923-197882f22826 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:31.359928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9813cf9-e7c1-4fac-8923-197882f22826 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:31.360780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9813cf9-e7c1-4fac-8923-197882f22826 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:31.361835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9813cf9-e7c1-4fac-8923-197882f22826 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:31.376372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9813cf9-e7c1-4fac-8923-197882f22826 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:31.422517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1431794941", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4dd68a0-3d6e-4462-97da-1cd536a6d48a"}], "security_groups": [{"name": "tempest-securitygroup--358649047"}], "key_name": "tempest-keypair-2130768673", "user_data": "}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:31.436149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:31.713508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] validate_networks() for [('b4dd68a0-3d6e-4462-97da-1cd536a6d48a', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:03:31.835537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a9813cf9-e7c1-4fac-8923-197882f22826 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:31.847329 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a9813cf9-e7c1-4fac-8923-197882f22826 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1315 microversion: 2.1 time: 0.517439 Aug 03 02:03:31.852927 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1685/3319] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:31 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:31.874242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e4e3e6b7-905e-4551-a41f-304a30795c3c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:31.877424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e4e3e6b7-905e-4551-a41f-304a30795c3c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:31.892295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4e3e6b7-905e-4551-a41f-304a30795c3c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:31.893188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4e3e6b7-905e-4551-a41f-304a30795c3c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:31.894067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4e3e6b7-905e-4551-a41f-304a30795c3c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:31.894614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4e3e6b7-905e-4551-a41f-304a30795c3c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:32.046087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e4e3e6b7-905e-4551-a41f-304a30795c3c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:32.056406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e4e3e6b7-905e-4551-a41f-304a30795c3c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:32.058435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e4e3e6b7-905e-4551-a41f-304a30795c3c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:32.060350 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e4e3e6b7-905e-4551-a41f-304a30795c3c tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.205052 Aug 03 02:03:32.061172 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1686/3320] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:31 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:32.259968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2579bc8b-64d4-4517-9d8d-1ab9e548282b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:32.262482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2579bc8b-64d4-4517-9d8d-1ab9e548282b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:32.277584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2579bc8b-64d4-4517-9d8d-1ab9e548282b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:32.278197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2579bc8b-64d4-4517-9d8d-1ab9e548282b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:32.279707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2579bc8b-64d4-4517-9d8d-1ab9e548282b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:32.280432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2579bc8b-64d4-4517-9d8d-1ab9e548282b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:32.788894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:03:32.789448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:03:32.789799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:03:32.790223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:03:32.803296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:03:32.837273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:32.843801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:32.845472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:32.846257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:32.890504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2579bc8b-64d4-4517-9d8d-1ab9e548282b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:32.894355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Getting quotas for project 9907ef20b17f42acb99a8b61502f29a3. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:03:32.901042 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2579bc8b-64d4-4517-9d8d-1ab9e548282b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1464 microversion: 2.1 time: 0.654518 Aug 03 02:03:32.902053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Getting quotas for user 81ae7aa9aed7440a8bdfd4595eae3be8 and project 9907ef20b17f42acb99a8b61502f29a3. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:03:32.902561 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1687/3321] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:32 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1464 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:03:32.910593 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4aa51ed9-658e-4254-942d-41c1a3a77c7f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:32.911565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4aa51ed9-658e-4254-942d-41c1a3a77c7f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:32.922178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4aa51ed9-658e-4254-942d-41c1a3a77c7f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:32.922872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4aa51ed9-658e-4254-942d-41c1a3a77c7f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:32.923860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4aa51ed9-658e-4254-942d-41c1a3a77c7f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:32.924624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4aa51ed9-658e-4254-942d-41c1a3a77c7f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:32.943435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:03:32.946062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:03:33.017771 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-02b85133-1d36-4631-8437-bf032dc4fd5a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.600280 Aug 03 02:03:33.022390 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1635/3322] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 02:03:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 03 02:03:33.113675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4aa51ed9-658e-4254-942d-41c1a3a77c7f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:33.122403 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4aa51ed9-658e-4254-942d-41c1a3a77c7f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1315 microversion: 2.1 time: 0.218163 Aug 03 02:03:33.124167 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1688/3323] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:32 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:33.129319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c84f1b10-3e30-4ae4-aaa4-e243937babd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:33.130120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c84f1b10-3e30-4ae4-aaa4-e243937babd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:33.248144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c84f1b10-3e30-4ae4-aaa4-e243937babd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:33.256483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c84f1b10-3e30-4ae4-aaa4-e243937babd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:33.258101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c84f1b10-3e30-4ae4-aaa4-e243937babd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:33.259241 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c84f1b10-3e30-4ae4-aaa4-e243937babd7 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1282 microversion: 2.20 time: 0.133672 Aug 03 02:03:33.259929 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1689/3324] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:33 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1282 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:33.265767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-da2be332-9af3-446c-8657-22684f82ac87 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:33.266398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-da2be332-9af3-446c-8657-22684f82ac87 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:33.291622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da2be332-9af3-446c-8657-22684f82ac87 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:33.295282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da2be332-9af3-446c-8657-22684f82ac87 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:33.296534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da2be332-9af3-446c-8657-22684f82ac87 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:33.297329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da2be332-9af3-446c-8657-22684f82ac87 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:33.441782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-da2be332-9af3-446c-8657-22684f82ac87 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:33.466651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-da2be332-9af3-446c-8657-22684f82ac87 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:33.471068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-da2be332-9af3-446c-8657-22684f82ac87 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:33.472460 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-da2be332-9af3-446c-8657-22684f82ac87 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.211621 Aug 03 02:03:33.473048 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1690/3325] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:33 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:33.543813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-435248e4-e20c-46b4-af62-977abb027642 tempest-TenantUsagesTestJSON-667057076 tempest-TenantUsagesTestJSON-667057076-project-admin] Calling method '.version_select at 0x7f5b132a2a60>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:33.578949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-435248e4-e20c-46b4-af62-977abb027642 tempest-TenantUsagesTestJSON-667057076 tempest-TenantUsagesTestJSON-667057076-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:33.579446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-435248e4-e20c-46b4-af62-977abb027642 tempest-TenantUsagesTestJSON-667057076 tempest-TenantUsagesTestJSON-667057076-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:33.666277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-435248e4-e20c-46b4-af62-977abb027642 tempest-TenantUsagesTestJSON-667057076 tempest-TenantUsagesTestJSON-667057076-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:33.667058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-435248e4-e20c-46b4-af62-977abb027642 tempest-TenantUsagesTestJSON-667057076 tempest-TenantUsagesTestJSON-667057076-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:33.735659 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-435248e4-e20c-46b4-af62-977abb027642 tempest-TenantUsagesTestJSON-667057076 tempest-TenantUsagesTestJSON-667057076-project-admin] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage/59f56311404b427ca1dc013c8c96f556?start=2022-08-02T02%3A03%3A32.928158&end=2022-08-04T02%3A03%3A32.928158" status: 200 len: 695 microversion: 2.1 time: 0.709146 Aug 03 02:03:33.756826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cfddbb0d-c5ce-4921-a095-703783f3167a tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '.version_select at 0x7f5b12aca5e0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:33.769217 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1636/3326] 10.222.0.67 () {58 vars in 1412 bytes} [Wed Aug 3 02:03:33 2022] GET /compute/v2.1/os-simple-tenant-usage/59f56311404b427ca1dc013c8c96f556?start=2022-08-02T02%3A03%3A32.928158&end=2022-08-04T02%3A03%3A32.928158 => generated 695 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:33.794781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cfddbb0d-c5ce-4921-a095-703783f3167a tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:33.795300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cfddbb0d-c5ce-4921-a095-703783f3167a tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:33.847244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cfddbb0d-c5ce-4921-a095-703783f3167a tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:33.848834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cfddbb0d-c5ce-4921-a095-703783f3167a tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:33.902451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ea78af50-da55-41af-9599-cf010a814e73 req-4c275308-d0a7-4578-b105-25f3e8f97954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3896d3ca-97e6-4db3-998a-49e5beb3191d", "tag": "0c7e9a87-aae8-4057-aba1-1986ee826063"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:33.935339 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cfddbb0d-c5ce-4921-a095-703783f3167a tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage/59f56311404b427ca1dc013c8c96f556?start=2022-08-02T02%3A03%3A32.928158&end=2022-08-04T02%3A03%3A32.928158" status: 200 len: 651 microversion: 2.1 time: 0.180077 Aug 03 02:03:33.938767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ea78af50-da55-41af-9599-cf010a814e73 req-4c275308-d0a7-4578-b105-25f3e8f97954 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:33.941788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ea78af50-da55-41af-9599-cf010a814e73 req-4c275308-d0a7-4578-b105-25f3e8f97954 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:33.944768 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1691/3327] 10.222.0.67 () {58 vars in 1412 bytes} [Wed Aug 3 02:03:33 2022] GET /compute/v2.1/os-simple-tenant-usage/59f56311404b427ca1dc013c8c96f556?start=2022-08-02T02%3A03%3A32.928158&end=2022-08-04T02%3A03%3A32.928158 => generated 651 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:33.966302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d7e35505-7298-4a8d-bd0e-d1eda98240e0 tempest-TenantUsagesTestJSON-667057076 tempest-TenantUsagesTestJSON-667057076-project-admin] Calling method '.version_select at 0x7f5b243b9940>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:33.976620 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ea78af50-da55-41af-9599-cf010a814e73 req-4c275308-d0a7-4578-b105-25f3e8f97954 service nova] Creating event network-changed:0c7e9a87-aae8-4057-aba1-1986ee826063 for instance 3896d3ca-97e6-4db3-998a-49e5beb3191d on n-h1-826529-8 Aug 03 02:03:33.988694 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ea78af50-da55-41af-9599-cf010a814e73 req-4c275308-d0a7-4578-b105-25f3e8f97954 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092762 Aug 03 02:03:33.997272 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1637/3328] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:34.013530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d7e35505-7298-4a8d-bd0e-d1eda98240e0 tempest-TenantUsagesTestJSON-667057076 tempest-TenantUsagesTestJSON-667057076-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:34.014773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d7e35505-7298-4a8d-bd0e-d1eda98240e0 tempest-TenantUsagesTestJSON-667057076 tempest-TenantUsagesTestJSON-667057076-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:34.059627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d7e35505-7298-4a8d-bd0e-d1eda98240e0 tempest-TenantUsagesTestJSON-667057076 tempest-TenantUsagesTestJSON-667057076-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:34.065993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d7e35505-7298-4a8d-bd0e-d1eda98240e0 tempest-TenantUsagesTestJSON-667057076 tempest-TenantUsagesTestJSON-667057076-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:34.149789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-47159d0d-f354-4a2a-be49-8e745bb7a348 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:34.150762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-47159d0d-f354-4a2a-be49-8e745bb7a348 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:34.175299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47159d0d-f354-4a2a-be49-8e745bb7a348 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:34.177307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47159d0d-f354-4a2a-be49-8e745bb7a348 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:34.178202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47159d0d-f354-4a2a-be49-8e745bb7a348 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:34.178661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47159d0d-f354-4a2a-be49-8e745bb7a348 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:34.459032 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d7e35505-7298-4a8d-bd0e-d1eda98240e0 tempest-TenantUsagesTestJSON-667057076 tempest-TenantUsagesTestJSON-667057076-project-admin] 10.222.0.67 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-02T02%3A03%3A32.928158&end=2022-08-04T02%3A03%3A32.928158&detailed=1" status: 200 len: 40942 microversion: 2.1 time: 0.511247 Aug 03 02:03:34.460359 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1692/3329] 10.222.0.67 () {58 vars in 1335 bytes} [Wed Aug 3 02:03:33 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-02T02%3A03%3A32.928158&end=2022-08-04T02%3A03%3A32.928158&detailed=1 => generated 40942 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:03:34.466213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8dde866-5339-49ea-ab31-50039caf031c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:34.466834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8dde866-5339-49ea-ab31-50039caf031c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:34.475631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8dde866-5339-49ea-ab31-50039caf031c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:34.476091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8dde866-5339-49ea-ab31-50039caf031c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:34.476963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8dde866-5339-49ea-ab31-50039caf031c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:34.477402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8dde866-5339-49ea-ab31-50039caf031c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:34.766256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8dde866-5339-49ea-ab31-50039caf031c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:34.784332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8dde866-5339-49ea-ab31-50039caf031c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:34.789268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8dde866-5339-49ea-ab31-50039caf031c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:34.793404 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8dde866-5339-49ea-ab31-50039caf031c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1334 microversion: 2.20 time: 0.330909 Aug 03 02:03:34.796339 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1693/3330] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:34 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1334 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:34.805079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4b3ba01-e373-4e2f-ad3f-89c7453abf77 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:34.810403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f4b3ba01-e373-4e2f-ad3f-89c7453abf77 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:34.838031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4b3ba01-e373-4e2f-ad3f-89c7453abf77 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:34.839141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4b3ba01-e373-4e2f-ad3f-89c7453abf77 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:34.841973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4b3ba01-e373-4e2f-ad3f-89c7453abf77 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:34.842837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4b3ba01-e373-4e2f-ad3f-89c7453abf77 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:34.883362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-47159d0d-f354-4a2a-be49-8e745bb7a348 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:34.896427 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-47159d0d-f354-4a2a-be49-8e745bb7a348 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1315 microversion: 2.1 time: 0.751803 Aug 03 02:03:34.897648 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1638/3331] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:34 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1315 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:03:34.909108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8808edc-0b07-4f11-9827-fa39aed25607 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:34.910066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b8808edc-0b07-4f11-9827-fa39aed25607 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:34.935931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8808edc-0b07-4f11-9827-fa39aed25607 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:34.936465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8808edc-0b07-4f11-9827-fa39aed25607 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:34.937381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8808edc-0b07-4f11-9827-fa39aed25607 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:34.937945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8808edc-0b07-4f11-9827-fa39aed25607 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:34.976616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b8808edc-0b07-4f11-9827-fa39aed25607 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:03:35.028851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f4b3ba01-e373-4e2f-ad3f-89c7453abf77 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:35.056845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f4b3ba01-e373-4e2f-ad3f-89c7453abf77 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:35.058562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f4b3ba01-e373-4e2f-ad3f-89c7453abf77 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:35.066792 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f4b3ba01-e373-4e2f-ad3f-89c7453abf77 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.267462 Aug 03 02:03:35.069700 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1694/3332] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:34 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:35.150251 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b8808edc-0b07-4f11-9827-fa39aed25607 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 204 len: 0 microversion: 2.1 time: 0.245584 Aug 03 02:03:35.151758 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1639/3333] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:03:34 2022] DELETE /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:03:35.160793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b92b05da-6300-479a-9bb5-39df36a8651c tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:35.162241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b92b05da-6300-479a-9bb5-39df36a8651c tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:35.179285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b92b05da-6300-479a-9bb5-39df36a8651c tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:35.181580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b92b05da-6300-479a-9bb5-39df36a8651c tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:35.184492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b92b05da-6300-479a-9bb5-39df36a8651c tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:35.185493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b92b05da-6300-479a-9bb5-39df36a8651c tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:35.481623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b92b05da-6300-479a-9bb5-39df36a8651c tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:35.494832 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b92b05da-6300-479a-9bb5-39df36a8651c tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1470 microversion: 2.1 time: 0.336475 Aug 03 02:03:35.497356 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1695/3334] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:35 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1470 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:35.823794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a367876a-7de6-4958-859d-d4a5f8d57595 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:35.824923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a367876a-7de6-4958-859d-d4a5f8d57595 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:35.832333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a367876a-7de6-4958-859d-d4a5f8d57595 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:35.833114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a367876a-7de6-4958-859d-d4a5f8d57595 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:35.834288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a367876a-7de6-4958-859d-d4a5f8d57595 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:35.834980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a367876a-7de6-4958-859d-d4a5f8d57595 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:35.923469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a367876a-7de6-4958-859d-d4a5f8d57595 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:35.924132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-96184fb0-744c-4277-80f6-7c93263d6ac9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:35.924232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-96184fb0-744c-4277-80f6-7c93263d6ac9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:35.933299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96184fb0-744c-4277-80f6-7c93263d6ac9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:35.934232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96184fb0-744c-4277-80f6-7c93263d6ac9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:35.934869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a367876a-7de6-4958-859d-d4a5f8d57595 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:35.935524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96184fb0-744c-4277-80f6-7c93263d6ac9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:35.936157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96184fb0-744c-4277-80f6-7c93263d6ac9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:35.937280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a367876a-7de6-4958-859d-d4a5f8d57595 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:35.938660 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a367876a-7de6-4958-859d-d4a5f8d57595 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1352 microversion: 2.20 time: 0.119062 Aug 03 02:03:35.953271 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1640/3335] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:35 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1352 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:36.097614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-923f1f4f-1bc7-4bbb-8a72-2bfe52b6f307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:36.098588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-923f1f4f-1bc7-4bbb-8a72-2bfe52b6f307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:36.111320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-923f1f4f-1bc7-4bbb-8a72-2bfe52b6f307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:36.111932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-923f1f4f-1bc7-4bbb-8a72-2bfe52b6f307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:36.112684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-923f1f4f-1bc7-4bbb-8a72-2bfe52b6f307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:36.113339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-923f1f4f-1bc7-4bbb-8a72-2bfe52b6f307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:36.171841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-96184fb0-744c-4277-80f6-7c93263d6ac9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:36.191116 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-96184fb0-744c-4277-80f6-7c93263d6ac9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1315 microversion: 2.1 time: 0.271126 Aug 03 02:03:36.191847 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1696/3336] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:35 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:36.209022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-923f1f4f-1bc7-4bbb-8a72-2bfe52b6f307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:36.220345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-923f1f4f-1bc7-4bbb-8a72-2bfe52b6f307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:36.221940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-923f1f4f-1bc7-4bbb-8a72-2bfe52b6f307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:36.223174 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-923f1f4f-1bc7-4bbb-8a72-2bfe52b6f307 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.129497 Aug 03 02:03:36.237154 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1641/3337] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:36 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:03:36.519245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7510e1af-53ca-4f4e-b9e0-e72ccac84307 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:36.520099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7510e1af-53ca-4f4e-b9e0-e72ccac84307 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:36.532832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7510e1af-53ca-4f4e-b9e0-e72ccac84307 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:36.539501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7510e1af-53ca-4f4e-b9e0-e72ccac84307 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:36.541058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7510e1af-53ca-4f4e-b9e0-e72ccac84307 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:36.541738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7510e1af-53ca-4f4e-b9e0-e72ccac84307 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:36.755455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7510e1af-53ca-4f4e-b9e0-e72ccac84307 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:36.766452 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7510e1af-53ca-4f4e-b9e0-e72ccac84307 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1470 microversion: 2.1 time: 0.251774 Aug 03 02:03:36.768520 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1697/3338] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:36 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1470 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:36.962238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eb94c3da-ee92-4b49-a216-97aead1bcefe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:36.963947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eb94c3da-ee92-4b49-a216-97aead1bcefe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:36.974891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb94c3da-ee92-4b49-a216-97aead1bcefe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:36.976223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb94c3da-ee92-4b49-a216-97aead1bcefe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:36.977527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb94c3da-ee92-4b49-a216-97aead1bcefe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:36.978221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb94c3da-ee92-4b49-a216-97aead1bcefe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:37.094311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eb94c3da-ee92-4b49-a216-97aead1bcefe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:37.107265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eb94c3da-ee92-4b49-a216-97aead1bcefe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:37.111286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eb94c3da-ee92-4b49-a216-97aead1bcefe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:37.112678 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eb94c3da-ee92-4b49-a216-97aead1bcefe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1340 microversion: 2.20 time: 0.154995 Aug 03 02:03:37.113639 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1642/3339] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:36 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1340 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:03:37.212925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31550b36-caae-485d-9dcc-6a3640f7fb53 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:37.214474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-31550b36-caae-485d-9dcc-6a3640f7fb53 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:37.221012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31550b36-caae-485d-9dcc-6a3640f7fb53 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:37.221478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31550b36-caae-485d-9dcc-6a3640f7fb53 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:37.222251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31550b36-caae-485d-9dcc-6a3640f7fb53 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:37.222691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31550b36-caae-485d-9dcc-6a3640f7fb53 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:37.248666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c368084d-6cec-439a-aa22-42b5ef3634ba tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:37.249565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c368084d-6cec-439a-aa22-42b5ef3634ba tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:37.281970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c368084d-6cec-439a-aa22-42b5ef3634ba tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:37.282555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c368084d-6cec-439a-aa22-42b5ef3634ba tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:37.286214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c368084d-6cec-439a-aa22-42b5ef3634ba tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:37.286958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c368084d-6cec-439a-aa22-42b5ef3634ba tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:37.432364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c368084d-6cec-439a-aa22-42b5ef3634ba tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:37.445738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c368084d-6cec-439a-aa22-42b5ef3634ba tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:37.452342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c368084d-6cec-439a-aa22-42b5ef3634ba tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:37.454015 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c368084d-6cec-439a-aa22-42b5ef3634ba tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.210444 Aug 03 02:03:37.454802 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1643/3340] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:37 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:37.473192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-31550b36-caae-485d-9dcc-6a3640f7fb53 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:37.488429 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-31550b36-caae-485d-9dcc-6a3640f7fb53 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1315 microversion: 2.1 time: 0.278985 Aug 03 02:03:37.495532 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1698/3341] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:37 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:37.758725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9a932742-0c27-467d-99eb-f3f421b59b3a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:37.759638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9a932742-0c27-467d-99eb-f3f421b59b3a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:37.784922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a932742-0c27-467d-99eb-f3f421b59b3a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:37.784922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a932742-0c27-467d-99eb-f3f421b59b3a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:37.784922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a932742-0c27-467d-99eb-f3f421b59b3a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:37.787159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a932742-0c27-467d-99eb-f3f421b59b3a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:37.790409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-400f689f-8ce2-4086-b5cc-6f6a812b1134 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:37.791223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-400f689f-8ce2-4086-b5cc-6f6a812b1134 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:37.805407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-400f689f-8ce2-4086-b5cc-6f6a812b1134 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:37.806020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-400f689f-8ce2-4086-b5cc-6f6a812b1134 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:37.807137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-400f689f-8ce2-4086-b5cc-6f6a812b1134 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:37.809308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-400f689f-8ce2-4086-b5cc-6f6a812b1134 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:37.876122 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9a932742-0c27-467d-99eb-f3f421b59b3a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/ips" status: 200 len: 150 microversion: 2.1 time: 0.122013 Aug 03 02:03:37.876762 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1644/3342] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 02:03:37 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/ips => generated 150 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:38.038785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-400f689f-8ce2-4086-b5cc-6f6a812b1134 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:38.049374 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-400f689f-8ce2-4086-b5cc-6f6a812b1134 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1470 microversion: 2.1 time: 0.262281 Aug 03 02:03:38.051230 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1699/3343] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:37 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1470 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:38.140000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-206b7de1-49cc-45ec-93bd-ae5dffbacdc6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:38.140702 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-206b7de1-49cc-45ec-93bd-ae5dffbacdc6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:38.153339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-206b7de1-49cc-45ec-93bd-ae5dffbacdc6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:38.154101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-206b7de1-49cc-45ec-93bd-ae5dffbacdc6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:38.155534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-206b7de1-49cc-45ec-93bd-ae5dffbacdc6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:38.156382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-206b7de1-49cc-45ec-93bd-ae5dffbacdc6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:38.244140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-206b7de1-49cc-45ec-93bd-ae5dffbacdc6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:38.264983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-206b7de1-49cc-45ec-93bd-ae5dffbacdc6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:38.272781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-206b7de1-49cc-45ec-93bd-ae5dffbacdc6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:38.276992 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-206b7de1-49cc-45ec-93bd-ae5dffbacdc6 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1340 microversion: 2.20 time: 0.139064 Aug 03 02:03:38.280257 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1645/3344] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:38 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1340 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:03:38.482456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0aa70d69-185b-421c-83bc-13fc322e1f48 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:38.484270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0aa70d69-185b-421c-83bc-13fc322e1f48 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:38.500514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0aa70d69-185b-421c-83bc-13fc322e1f48 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:38.510488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0aa70d69-185b-421c-83bc-13fc322e1f48 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:38.514646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-90d2c6b7-64f6-4fe7-b13f-45a033a1848a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:38.515099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0aa70d69-185b-421c-83bc-13fc322e1f48 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:38.515221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-90d2c6b7-64f6-4fe7-b13f-45a033a1848a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:38.516513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0aa70d69-185b-421c-83bc-13fc322e1f48 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:38.527360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90d2c6b7-64f6-4fe7-b13f-45a033a1848a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:38.528034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90d2c6b7-64f6-4fe7-b13f-45a033a1848a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:38.529167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90d2c6b7-64f6-4fe7-b13f-45a033a1848a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:38.533253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90d2c6b7-64f6-4fe7-b13f-45a033a1848a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:38.576922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:38.702968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0aa70d69-185b-421c-83bc-13fc322e1f48 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:38.739606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0aa70d69-185b-421c-83bc-13fc322e1f48 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:38.744000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0aa70d69-185b-421c-83bc-13fc322e1f48 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:38.745351 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0aa70d69-185b-421c-83bc-13fc322e1f48 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.269654 Aug 03 02:03:38.770552 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1700/3345] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:38 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:38.965800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-6b997b5c-d082-4fa9-9fac-27509f65951a req-8dda57b6-69ff-4cb0-a7ff-70fb10a4fcf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e5fb4f-3500-430d-aeed-68585f707abc", "name": "network-vif-deleted", "tag": "73acd654-aad5-44f0-9132-9feedbd29b84"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:39.019521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6b997b5c-d082-4fa9-9fac-27509f65951a req-8dda57b6-69ff-4cb0-a7ff-70fb10a4fcf5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:39.033154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6b997b5c-d082-4fa9-9fac-27509f65951a req-8dda57b6-69ff-4cb0-a7ff-70fb10a4fcf5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:39.094931 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-6b997b5c-d082-4fa9-9fac-27509f65951a req-8dda57b6-69ff-4cb0-a7ff-70fb10a4fcf5 service nova] Creating event network-vif-deleted:73acd654-aad5-44f0-9132-9feedbd29b84 for instance f6e5fb4f-3500-430d-aeed-68585f707abc on n-h2-826529-8 Aug 03 02:03:39.115046 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-6b997b5c-d082-4fa9-9fac-27509f65951a req-8dda57b6-69ff-4cb0-a7ff-70fb10a4fcf5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155392 Aug 03 02:03:39.115727 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1701/3346] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:03:39.133752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f1cf4576-0c7e-4f1e-bbe1-33dbcf69ded3 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:39.135630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f1cf4576-0c7e-4f1e-bbe1-33dbcf69ded3 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:39.155174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1cf4576-0c7e-4f1e-bbe1-33dbcf69ded3 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:39.157901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1cf4576-0c7e-4f1e-bbe1-33dbcf69ded3 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:39.159399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1cf4576-0c7e-4f1e-bbe1-33dbcf69ded3 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:39.161644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1cf4576-0c7e-4f1e-bbe1-33dbcf69ded3 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:39.277092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1cf4576-0c7e-4f1e-bbe1-33dbcf69ded3 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:39.277853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1cf4576-0c7e-4f1e-bbe1-33dbcf69ded3 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:39.278247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-f1cf4576-0c7e-4f1e-bbe1-33dbcf69ded3 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lazy-loading 'fault' on Instance uuid f6e5fb4f-3500-430d-aeed-68585f707abc {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:03:39.325123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-90d2c6b7-64f6-4fe7-b13f-45a033a1848a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:39.337758 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-90d2c6b7-64f6-4fe7-b13f-45a033a1848a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1315 microversion: 2.1 time: 0.827865 Aug 03 02:03:39.341536 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1646/3347] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:38 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1315 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:39.359167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c3c58cf7-14bb-440c-85ca-b36088f0f8af tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:39.360474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c3c58cf7-14bb-440c-85ca-b36088f0f8af tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:39.379942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3c58cf7-14bb-440c-85ca-b36088f0f8af tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:39.382178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3c58cf7-14bb-440c-85ca-b36088f0f8af tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:39.384157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3c58cf7-14bb-440c-85ca-b36088f0f8af tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:39.386109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3c58cf7-14bb-440c-85ca-b36088f0f8af tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:39.612069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f1cf4576-0c7e-4f1e-bbe1-33dbcf69ded3 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e717c47d484148d2aa85c9f1c880ad87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59f56311404b427ca1dc013c8c96f556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:39.637464 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f1cf4576-0c7e-4f1e-bbe1-33dbcf69ded3 tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 200 len: 1304 microversion: 2.1 time: 0.520040 Aug 03 02:03:39.638259 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1702/3348] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:39 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 1304 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:39.779092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-516d85e7-3a9d-4cd2-a0a2-0dac08d55ef6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:39.780253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-516d85e7-3a9d-4cd2-a0a2-0dac08d55ef6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:39.793070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-516d85e7-3a9d-4cd2-a0a2-0dac08d55ef6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:39.798276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-516d85e7-3a9d-4cd2-a0a2-0dac08d55ef6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:39.800111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-516d85e7-3a9d-4cd2-a0a2-0dac08d55ef6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:39.800820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-516d85e7-3a9d-4cd2-a0a2-0dac08d55ef6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:40.255041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-516d85e7-3a9d-4cd2-a0a2-0dac08d55ef6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:40.273736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-516d85e7-3a9d-4cd2-a0a2-0dac08d55ef6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:40.275562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-516d85e7-3a9d-4cd2-a0a2-0dac08d55ef6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:40.284912 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-516d85e7-3a9d-4cd2-a0a2-0dac08d55ef6 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.507602 Aug 03 02:03:40.287703 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1703/3349] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:39 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:03:40.368944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-069a3eac-90c8-42ad-90b6-74f91c84c5a0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:40.370100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-069a3eac-90c8-42ad-90b6-74f91c84c5a0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:40.389879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-069a3eac-90c8-42ad-90b6-74f91c84c5a0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:40.395239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-069a3eac-90c8-42ad-90b6-74f91c84c5a0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:40.397443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-069a3eac-90c8-42ad-90b6-74f91c84c5a0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:40.402413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-069a3eac-90c8-42ad-90b6-74f91c84c5a0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:40.410764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c3c58cf7-14bb-440c-85ca-b36088f0f8af tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:40.450989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c3c58cf7-14bb-440c-85ca-b36088f0f8af tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:40.456923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:40.458761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c3c58cf7-14bb-440c-85ca-b36088f0f8af tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:40.462617 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c3c58cf7-14bb-440c-85ca-b36088f0f8af tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1407 microversion: 2.20 time: 1.116502 Aug 03 02:03:40.466738 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1647/3350] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:39 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1407 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:40.573025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-303e4cbf-c0f7-422e-90b4-aad91045f3b2 req-c766684d-a421-4042-817a-f707a5f14335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3896d3ca-97e6-4db3-998a-49e5beb3191d", "name": "network-vif-plugged", "status": "completed", "tag": "0c7e9a87-aae8-4057-aba1-1986ee826063"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:40.597180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-303e4cbf-c0f7-422e-90b4-aad91045f3b2 req-c766684d-a421-4042-817a-f707a5f14335 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:40.604476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-303e4cbf-c0f7-422e-90b4-aad91045f3b2 req-c766684d-a421-4042-817a-f707a5f14335 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:40.639549 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-303e4cbf-c0f7-422e-90b4-aad91045f3b2 req-c766684d-a421-4042-817a-f707a5f14335 service nova] Creating event network-vif-plugged:0c7e9a87-aae8-4057-aba1-1986ee826063 for instance 3896d3ca-97e6-4db3-998a-49e5beb3191d on n-h1-826529-8 Aug 03 02:03:40.693884 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-303e4cbf-c0f7-422e-90b4-aad91045f3b2 req-c766684d-a421-4042-817a-f707a5f14335 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103654 Aug 03 02:03:40.701632 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1648/3351] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:40.727328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-039545ad-9c95-43aa-9e50-3543627b8c3b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:40.727328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-039545ad-9c95-43aa-9e50-3543627b8c3b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] [instance: f6e5fb4f-3500-430d-aeed-68585f707abc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:40.747609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-039545ad-9c95-43aa-9e50-3543627b8c3b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:40.748756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-039545ad-9c95-43aa-9e50-3543627b8c3b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:40.751937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-039545ad-9c95-43aa-9e50-3543627b8c3b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:40.754159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-039545ad-9c95-43aa-9e50-3543627b8c3b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:40.812006 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-039545ad-9c95-43aa-9e50-3543627b8c3b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] HTTP exception thrown: Instance f6e5fb4f-3500-430d-aeed-68585f707abc could not be found. Aug 03 02:03:40.841142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-069a3eac-90c8-42ad-90b6-74f91c84c5a0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:40.873654 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-069a3eac-90c8-42ad-90b6-74f91c84c5a0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1315 microversion: 2.1 time: 0.515513 Aug 03 02:03:40.891243 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1704/3352] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:40 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-039545ad-9c95-43aa-9e50-3543627b8c3b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Request method failure captured: Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc HTTP/1.1 Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dddbqPZx9Tlzv0jIxxPqq0MlhYPCVSGgz1QYH1jHB7B2jvwsgtfF5vO8IjebhsjsBnHvZHFKL7E3-2_VuiTIhGCc9bF_cFbZY1NrtD55p2khhk3dIMeIjv8zzfUsMjR3De3MifKEtAYUiVvW6seU8ffjdXC7hdD2rpJl4mCPunKWDo Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 59f56311404b427ca1dc013c8c96f556 Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TenantUsagesTestJSON-1114362432 Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_59f56311404b427ca1dc013c8c96f556", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/59f56311404b427ca1dc013c8c96f556"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/59f56311404b427ca1dc013c8c96f556"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/59f56311404b427ca1dc013c8c96f556"}]}] Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TenantUsagesTestJSON-1114362432 Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 59f56311404b427ca1dc013c8c96f556 Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1114362432 Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TenantUsagesTestJSON-1114362432-project Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: e717c47d484148d2aa85c9f1c880ad87 Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TenantUsagesTestJSON-1114362432-project Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance f6e5fb4f-3500-430d-aeed-68585f707abc could not be found. Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'f6e5fb4f-3500-430d-aeed-68585f707abc'} Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6e5fb4f-3500-430d-aeed-68585f707abc could not be found. Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6e5fb4f-3500-430d-aeed-68585f707abc could not be found. Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:40.900118 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:40.907378 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:40.907378 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:40.907378 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:40.907378 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:03:40.907378 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:03:40.907378 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6e5fb4f-3500-430d-aeed-68585f707abc could not be found. Aug 03 02:03:40.907378 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:40.910786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-039545ad-9c95-43aa-9e50-3543627b8c3b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] Returning 404 to user: Instance f6e5fb4f-3500-430d-aeed-68585f707abc could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:03:40.912150 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-039545ad-9c95-43aa-9e50-3543627b8c3b tempest-TenantUsagesTestJSON-1114362432 tempest-TenantUsagesTestJSON-1114362432-project] 10.222.0.67 "GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc" status: 404 len: 111 microversion: 2.1 time: 0.205026 Aug 03 02:03:40.913935 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1649/3353] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:40 2022] GET /compute/v2.1/servers/f6e5fb4f-3500-430d-aeed-68585f707abc => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:03:40.921265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0b2d2c05-52d5-4182-a703-666516462c9c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bc98a69-ec1c-4ff5-b047-a6de4615108e"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:40.955615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0b2d2c05-52d5-4182-a703-666516462c9c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:40.991286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b2d2c05-52d5-4182-a703-666516462c9c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:40.991761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b2d2c05-52d5-4182-a703-666516462c9c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:40.999949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b2d2c05-52d5-4182-a703-666516462c9c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:41.000409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b2d2c05-52d5-4182-a703-666516462c9c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:41.318980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-5f49fa46-93a6-4a7d-bd1e-17ba08eda067 req-8ec8c816-d3ab-420a-bf4e-3c8bae302e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ce11775-ab73-457e-8799-239915dc2406", "tag": "12c644d8-021b-4605-8e3c-16ff33d29cd1"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:41.388500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5f49fa46-93a6-4a7d-bd1e-17ba08eda067 req-8ec8c816-d3ab-420a-bf4e-3c8bae302e1a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:41.389037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5f49fa46-93a6-4a7d-bd1e-17ba08eda067 req-8ec8c816-d3ab-420a-bf4e-3c8bae302e1a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:41.429216 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-5f49fa46-93a6-4a7d-bd1e-17ba08eda067 req-8ec8c816-d3ab-420a-bf4e-3c8bae302e1a service nova] Creating event network-changed:12c644d8-021b-4605-8e3c-16ff33d29cd1 for instance 9ce11775-ab73-457e-8799-239915dc2406 on n-h2-826529-8 Aug 03 02:03:41.439742 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-5f49fa46-93a6-4a7d-bd1e-17ba08eda067 req-8ec8c816-d3ab-420a-bf4e-3c8bae302e1a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125065 Aug 03 02:03:41.442284 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1650/3354] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:41.457791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eff8c133-1075-4519-8ed2-f91d950f1ec1 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:41.458841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eff8c133-1075-4519-8ed2-f91d950f1ec1 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:41.470330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eff8c133-1075-4519-8ed2-f91d950f1ec1 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:41.471290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eff8c133-1075-4519-8ed2-f91d950f1ec1 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:41.472707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eff8c133-1075-4519-8ed2-f91d950f1ec1 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:41.473337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eff8c133-1075-4519-8ed2-f91d950f1ec1 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:41.687017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eff8c133-1075-4519-8ed2-f91d950f1ec1 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:41.703597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eff8c133-1075-4519-8ed2-f91d950f1ec1 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:41.710653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eff8c133-1075-4519-8ed2-f91d950f1ec1 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:41.716479 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eff8c133-1075-4519-8ed2-f91d950f1ec1 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.269962 Aug 03 02:03:41.720638 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1651/3355] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:41 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:41.735784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f513af2b-7367-460c-a578-581664881037 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:41.736786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f513af2b-7367-460c-a578-581664881037 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:41.756847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f513af2b-7367-460c-a578-581664881037 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:41.757811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f513af2b-7367-460c-a578-581664881037 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:41.758961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f513af2b-7367-460c-a578-581664881037 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:41.759698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f513af2b-7367-460c-a578-581664881037 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:42.137201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f513af2b-7367-460c-a578-581664881037 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:42.150753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f513af2b-7367-460c-a578-581664881037 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:42.157174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f513af2b-7367-460c-a578-581664881037 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:42.162229 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f513af2b-7367-460c-a578-581664881037 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1407 microversion: 2.20 time: 0.430680 Aug 03 02:03:42.163260 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1652/3356] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:41 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:42.179860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-02c726a7-f7d9-4349-85fd-90fab93cd07e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:42.180820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-02c726a7-f7d9-4349-85fd-90fab93cd07e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:42.190599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:42.226935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02c726a7-f7d9-4349-85fd-90fab93cd07e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:42.228291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02c726a7-f7d9-4349-85fd-90fab93cd07e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:42.230384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02c726a7-f7d9-4349-85fd-90fab93cd07e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:42.231140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02c726a7-f7d9-4349-85fd-90fab93cd07e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:42.528850 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0b2d2c05-52d5-4182-a703-666516462c9c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "POST /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.638253 Aug 03 02:03:42.529466 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1705/3357] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:03:40 2022] POST /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-volume_attachments => generated 194 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:42.750936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-57bdb442-ea2e-4e30-8ffb-d55f2bdf6b72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:42.751967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-57bdb442-ea2e-4e30-8ffb-d55f2bdf6b72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:42.760301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:42.771594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57bdb442-ea2e-4e30-8ffb-d55f2bdf6b72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:42.772052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57bdb442-ea2e-4e30-8ffb-d55f2bdf6b72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:42.772843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57bdb442-ea2e-4e30-8ffb-d55f2bdf6b72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:42.776750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57bdb442-ea2e-4e30-8ffb-d55f2bdf6b72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:42.914969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-02c726a7-f7d9-4349-85fd-90fab93cd07e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:42.940971 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-02c726a7-f7d9-4349-85fd-90fab93cd07e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1503 microversion: 2.1 time: 0.771861 Aug 03 02:03:42.941643 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1653/3358] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:42 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1503 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:42.989658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b6fb3f17-7163-4671-baf7-ddc611ec2bc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:42.993577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b6fb3f17-7163-4671-baf7-ddc611ec2bc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:42.997757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=28 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:43.005767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6fb3f17-7163-4671-baf7-ddc611ec2bc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:43.006500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6fb3f17-7163-4671-baf7-ddc611ec2bc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:43.007528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6fb3f17-7163-4671-baf7-ddc611ec2bc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:43.008198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6fb3f17-7163-4671-baf7-ddc611ec2bc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:43.035259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-57bdb442-ea2e-4e30-8ffb-d55f2bdf6b72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:43.050886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-57bdb442-ea2e-4e30-8ffb-d55f2bdf6b72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:43.054284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-57bdb442-ea2e-4e30-8ffb-d55f2bdf6b72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:43.066473 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-57bdb442-ea2e-4e30-8ffb-d55f2bdf6b72 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1605 microversion: 2.32 time: 0.315073 Aug 03 02:03:43.088789 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1706/3359] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:42 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1605 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:43.195116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-357fd0c0-b119-4067-8170-68f805672d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:43.196104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-357fd0c0-b119-4067-8170-68f805672d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:43.208340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-357fd0c0-b119-4067-8170-68f805672d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:43.211041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-357fd0c0-b119-4067-8170-68f805672d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:43.212123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-357fd0c0-b119-4067-8170-68f805672d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:43.215639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-357fd0c0-b119-4067-8170-68f805672d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:43.222506 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b6fb3f17-7163-4671-baf7-ddc611ec2bc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "POST /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d/action" status: 202 len: 0 microversion: 2.1 time: 0.233294 Aug 03 02:03:43.225078 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1654/3360] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:03:42 2022] POST /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:03:43.244288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-455f1d9d-5525-4bc6-be32-6387c527c024 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:43.254639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-455f1d9d-5525-4bc6-be32-6387c527c024 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:43.255928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=12 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:43.281186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-455f1d9d-5525-4bc6-be32-6387c527c024 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:43.281653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-455f1d9d-5525-4bc6-be32-6387c527c024 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:43.282518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-455f1d9d-5525-4bc6-be32-6387c527c024 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:43.283007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-455f1d9d-5525-4bc6-be32-6387c527c024 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:43.661305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:44.048346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:44.145751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-455f1d9d-5525-4bc6-be32-6387c527c024 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:44.156884 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-455f1d9d-5525-4bc6-be32-6387c527c024 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1508 microversion: 2.1 time: 0.926444 Aug 03 02:03:44.158107 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1655/3361] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:43 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1508 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:44.172932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7ef86362-1feb-4de2-aa1e-3e180340a19a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:44.173986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7ef86362-1feb-4de2-aa1e-3e180340a19a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:44.181155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ef86362-1feb-4de2-aa1e-3e180340a19a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:44.182050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ef86362-1feb-4de2-aa1e-3e180340a19a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:44.184076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ef86362-1feb-4de2-aa1e-3e180340a19a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:44.184890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ef86362-1feb-4de2-aa1e-3e180340a19a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:44.240462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ef86362-1feb-4de2-aa1e-3e180340a19a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:44.241503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ef86362-1feb-4de2-aa1e-3e180340a19a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:44.242285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-7ef86362-1feb-4de2-aa1e-3e180340a19a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lazy-loading 'fault' on Instance uuid 82c5fe16-6b90-4d79-a61d-c9bede1ee174 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:03:44.338701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-357fd0c0-b119-4067-8170-68f805672d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:44.354001 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-357fd0c0-b119-4067-8170-68f805672d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:44.355933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-357fd0c0-b119-4067-8170-68f805672d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:44.360629 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-357fd0c0-b119-4067-8170-68f805672d0a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1407 microversion: 2.20 time: 1.169617 Aug 03 02:03:44.362190 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1707/3362] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:43 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1407 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:44.370307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-654265191", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "5ed366b1-2d1f-42b2-860d-cb56aa2e73af"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:44.438072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7ef86362-1feb-4de2-aa1e-3e180340a19a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:44.463164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7ef86362-1feb-4de2-aa1e-3e180340a19a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:44.489088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7ef86362-1feb-4de2-aa1e-3e180340a19a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38b0905e032b4d8bb313f8869e4d369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f89d0f699c49fcb49da050cb5c769e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:44.493811 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7ef86362-1feb-4de2-aa1e-3e180340a19a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 200 len: 1610 microversion: 2.32 time: 0.333955 Aug 03 02:03:44.497132 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1656/3363] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:44 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 1610 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:44.531188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] validate_networks() for [('5ed366b1-2d1f-42b2-860d-cb56aa2e73af', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:03:45.179283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ba357e89-4d75-41d7-a63d-e3ee0103ce62 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:45.179909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ba357e89-4d75-41d7-a63d-e3ee0103ce62 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:45.192373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba357e89-4d75-41d7-a63d-e3ee0103ce62 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:45.193217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba357e89-4d75-41d7-a63d-e3ee0103ce62 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:45.194194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba357e89-4d75-41d7-a63d-e3ee0103ce62 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:45.195072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba357e89-4d75-41d7-a63d-e3ee0103ce62 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:45.677420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ba357e89-4d75-41d7-a63d-e3ee0103ce62 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:45.687585 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ba357e89-4d75-41d7-a63d-e3ee0103ce62 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1488 microversion: 2.1 time: 0.511944 Aug 03 02:03:45.704708 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1657/3364] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:45 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1488 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:03:45.712150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-85c64aac-d7b0-4ae6-8313-2b8710e900ac tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:45.713435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-85c64aac-d7b0-4ae6-8313-2b8710e900ac tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:45.733920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85c64aac-d7b0-4ae6-8313-2b8710e900ac tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:45.734830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85c64aac-d7b0-4ae6-8313-2b8710e900ac tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:45.736047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85c64aac-d7b0-4ae6-8313-2b8710e900ac tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:45.739175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85c64aac-d7b0-4ae6-8313-2b8710e900ac tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:45.934019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:03:45.936011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:03:45.936784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:03:45.938589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:03:45.941346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:03:45.959422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:45.960154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:45.961256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:45.962426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:45.985245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Getting quotas for project 82b6fa5e476644de89acfd1d2bbbff62. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:03:45.991159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Getting quotas for user a9853c1a55054968a931638100af4360 and project 82b6fa5e476644de89acfd1d2bbbff62. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:03:46.005271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:03:46.007695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:03:46.074111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-85c64aac-d7b0-4ae6-8313-2b8710e900ac tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:46.085727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-85c64aac-d7b0-4ae6-8313-2b8710e900ac tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:46.087408 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-85c64aac-d7b0-4ae6-8313-2b8710e900ac tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:46.088669 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-85c64aac-d7b0-4ae6-8313-2b8710e900ac tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1407 microversion: 2.20 time: 0.382511 Aug 03 02:03:46.095402 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-368ae17a-6a2d-4d3b-a4d4-4f3909651def tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.730021 Aug 03 02:03:46.096906 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1708/3365] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:03:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:03:46.103816 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1658/3366] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:45 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:46.116898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-462c68bc-8e41-43a9-b8a6-c5d8cd335c2a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:46.121610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-462c68bc-8e41-43a9-b8a6-c5d8cd335c2a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:46.122559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e6676131-ea17-4748-906d-4a2cc59759e2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:46.123348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e6676131-ea17-4748-906d-4a2cc59759e2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:46.133751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6676131-ea17-4748-906d-4a2cc59759e2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:46.134496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6676131-ea17-4748-906d-4a2cc59759e2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:46.135574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6676131-ea17-4748-906d-4a2cc59759e2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:46.136312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6676131-ea17-4748-906d-4a2cc59759e2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:46.136573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-462c68bc-8e41-43a9-b8a6-c5d8cd335c2a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:46.137192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-462c68bc-8e41-43a9-b8a6-c5d8cd335c2a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:46.138389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-462c68bc-8e41-43a9-b8a6-c5d8cd335c2a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:46.138644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-462c68bc-8e41-43a9-b8a6-c5d8cd335c2a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:46.161791 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-462c68bc-8e41-43a9-b8a6-c5d8cd335c2a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] HTTP exception thrown: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-462c68bc-8e41-43a9-b8a6-c5d8cd335c2a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Request method failure captured: Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 HTTP/1.1 Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dW4CFWugwSdfmlDGBzpbCfO7ctB29RdgEay767amxpDQnah3aA1AcfB6jdbU-_Vn8CpjnJW44USO21Gti8C0xj3TARuYoX1UB1EojIRjOZ7X4MR4cSYmQKoBXCqvLqsiStqQflYvAnntXOCqq75UI4CGw4czOulSiZVGnUbA3rZZzc Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Openstack-Nova-Api-Version: 2.32 Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 63f89d0f699c49fcb49da050cb5c769e Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TaggedBootDevicesTest-971928644 Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_63f89d0f699c49fcb49da050cb5c769e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63f89d0f699c49fcb49da050cb5c769e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/63f89d0f699c49fcb49da050cb5c769e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63f89d0f699c49fcb49da050cb5c769e"}]}] Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TaggedBootDevicesTest-971928644 Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 63f89d0f699c49fcb49da050cb5c769e Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TaggedBootDevicesTest-971928644 Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TaggedBootDevicesTest-971928644-project Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 38b0905e032b4d8bb313f8869e4d369b Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TaggedBootDevicesTest-971928644-project Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '82c5fe16-6b90-4d79-a61d-c9bede1ee174'} Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:46.163779 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:46.172451 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:46.172451 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:46.172451 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:46.172451 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:03:46.172451 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:03:46.172451 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. Aug 03 02:03:46.172451 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:46.172451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-462c68bc-8e41-43a9-b8a6-c5d8cd335c2a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Returning 404 to user: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:03:46.172451 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-462c68bc-8e41-43a9-b8a6-c5d8cd335c2a tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 404 len: 111 microversion: 2.32 time: 0.067394 Aug 03 02:03:46.172451 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1709/3367] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:46 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:03:46.175435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d429f91-c184-4ef7-ab53-33145b8f684a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:46.176067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6d429f91-c184-4ef7-ab53-33145b8f684a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:46.208602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e6676131-ea17-4748-906d-4a2cc59759e2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:03:46.305746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6d429f91-c184-4ef7-ab53-33145b8f684a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:46.316637 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6d429f91-c184-4ef7-ab53-33145b8f684a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 200 len: 1213 microversion: 2.1 time: 0.144802 Aug 03 02:03:46.317236 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1710/3368] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:46 2022] GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 1213 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:46.329378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed36697c-efde-4f79-869a-8f8654f95711 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '.version_select at 0x7f5b129a4ee0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:46.378079 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed36697c-efde-4f79-869a-8f8654f95711 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2008591506" status: 204 len: 0 microversion: 2.32 time: 0.055817 Aug 03 02:03:46.382473 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1711/3369] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 3 02:03:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2008591506 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 02:03:46.466945 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e6676131-ea17-4748-906d-4a2cc59759e2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 204 len: 0 microversion: 2.1 time: 0.348762 Aug 03 02:03:46.473174 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1659/3370] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:03:46 2022] DELETE /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:03:46.482838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0affb678-cb0e-4b67-95ec-3cb635bc7316 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:46.484979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0affb678-cb0e-4b67-95ec-3cb635bc7316 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:46.505229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0affb678-cb0e-4b67-95ec-3cb635bc7316 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:46.508441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0affb678-cb0e-4b67-95ec-3cb635bc7316 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:46.514153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0affb678-cb0e-4b67-95ec-3cb635bc7316 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:46.517381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0affb678-cb0e-4b67-95ec-3cb635bc7316 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:46.864855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d385ab1a-6193-4df2-884d-e3919ae8667e req-48fdb4da-b9eb-4800-ac27-3c16150e780f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ce11775-ab73-457e-8799-239915dc2406", "name": "network-vif-plugged", "status": "completed", "tag": "12c644d8-021b-4605-8e3c-16ff33d29cd1"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:46.885514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d385ab1a-6193-4df2-884d-e3919ae8667e req-48fdb4da-b9eb-4800-ac27-3c16150e780f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:46.891606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d385ab1a-6193-4df2-884d-e3919ae8667e req-48fdb4da-b9eb-4800-ac27-3c16150e780f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:46.918620 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d385ab1a-6193-4df2-884d-e3919ae8667e req-48fdb4da-b9eb-4800-ac27-3c16150e780f service nova] Creating event network-vif-plugged:12c644d8-021b-4605-8e3c-16ff33d29cd1 for instance 9ce11775-ab73-457e-8799-239915dc2406 on n-h2-826529-8 Aug 03 02:03:46.936923 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d385ab1a-6193-4df2-884d-e3919ae8667e req-48fdb4da-b9eb-4800-ac27-3c16150e780f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075846 Aug 03 02:03:46.938133 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1660/3371] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:47.035856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5dcbc43d-9e49-406c-9f5f-3daa7a05f13f tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:47.046897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5dcbc43d-9e49-406c-9f5f-3daa7a05f13f tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:47.059575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5dcbc43d-9e49-406c-9f5f-3daa7a05f13f tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Searching by: {'deleted': False, 'project_id': 'e58f4b233c354db7be024f63337a78f0'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:03:47.075771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dcbc43d-9e49-406c-9f5f-3daa7a05f13f tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:47.076246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dcbc43d-9e49-406c-9f5f-3daa7a05f13f tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:47.080941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dcbc43d-9e49-406c-9f5f-3daa7a05f13f tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:47.081996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dcbc43d-9e49-406c-9f5f-3daa7a05f13f tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:47.142892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-5dcbc43d-9e49-406c-9f5f-3daa7a05f13f tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:03:47.188080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0affb678-cb0e-4b67-95ec-3cb635bc7316 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:47.206676 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0affb678-cb0e-4b67-95ec-3cb635bc7316 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1494 microversion: 2.1 time: 0.726517 Aug 03 02:03:47.209706 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1712/3372] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:46 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1494 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:47.215591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f30f1aa5-d3ed-41d9-b9b9-3828f37c305c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:47.226135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f30f1aa5-d3ed-41d9-b9b9-3828f37c305c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:47.233488 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5dcbc43d-9e49-406c-9f5f-3daa7a05f13f tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.202652 Aug 03 02:03:47.238107 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1661/3373] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 3 02:03:47 2022] GET /compute/v2.1/servers => generated 334 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:47.253204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f30f1aa5-d3ed-41d9-b9b9-3828f37c305c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:47.254100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f30f1aa5-d3ed-41d9-b9b9-3828f37c305c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:47.256075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f30f1aa5-d3ed-41d9-b9b9-3828f37c305c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:47.257228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f30f1aa5-d3ed-41d9-b9b9-3828f37c305c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:47.262257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-563bc224-7a4b-48a5-9981-8c4142f303c0 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:47.280624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-563bc224-7a4b-48a5-9981-8c4142f303c0 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:47.281450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-563bc224-7a4b-48a5-9981-8c4142f303c0 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Searching by: {'deleted': False, 'project_id': 'e58f4b233c354db7be024f63337a78f0'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:03:47.299657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-563bc224-7a4b-48a5-9981-8c4142f303c0 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:47.304622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-563bc224-7a4b-48a5-9981-8c4142f303c0 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:47.309627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-563bc224-7a4b-48a5-9981-8c4142f303c0 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:47.310555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-563bc224-7a4b-48a5-9981-8c4142f303c0 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:47.365841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:47.375624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-563bc224-7a4b-48a5-9981-8c4142f303c0 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:03:47.460757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-563bc224-7a4b-48a5-9981-8c4142f303c0 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:47.482115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-563bc224-7a4b-48a5-9981-8c4142f303c0 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:47.483001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-563bc224-7a4b-48a5-9981-8c4142f303c0 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:47.538663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f30f1aa5-d3ed-41d9-b9b9-3828f37c305c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:47.549384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f30f1aa5-d3ed-41d9-b9b9-3828f37c305c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:47.550936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f30f1aa5-d3ed-41d9-b9b9-3828f37c305c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:47.564433 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f30f1aa5-d3ed-41d9-b9b9-3828f37c305c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1407 microversion: 2.20 time: 0.352568 Aug 03 02:03:47.566598 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1713/3374] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:47 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:47.583530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-23bea0fe-4498-4b5d-a947-e4e7e05641f9 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:47.583806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-23bea0fe-4498-4b5d-a947-e4e7e05641f9 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:47.613969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23bea0fe-4498-4b5d-a947-e4e7e05641f9 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:47.614569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23bea0fe-4498-4b5d-a947-e4e7e05641f9 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:47.617348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23bea0fe-4498-4b5d-a947-e4e7e05641f9 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:47.617846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23bea0fe-4498-4b5d-a947-e4e7e05641f9 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:47.816816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-23bea0fe-4498-4b5d-a947-e4e7e05641f9 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:47.831555 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-23bea0fe-4498-4b5d-a947-e4e7e05641f9 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 200 len: 1217 microversion: 2.1 time: 0.263981 Aug 03 02:03:47.832178 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1714/3375] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:47 2022] GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 1217 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:48.100402 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-563bc224-7a4b-48a5-9981-8c4142f303c0 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.852247 Aug 03 02:03:48.101008 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1662/3376] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 02:03:47 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:48.128519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b3895ca4-8345-4fbd-a102-282a371e6e58 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:48.146838 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b3895ca4-8345-4fbd-a102-282a371e6e58 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022660 Aug 03 02:03:48.152281 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1715/3377] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 02:03:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:48.231013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9d5bb060-d8b0-4c22-a747-2ae10cff854c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:48.232143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9d5bb060-d8b0-4c22-a747-2ae10cff854c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:48.256024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d5bb060-d8b0-4c22-a747-2ae10cff854c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:48.257550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d5bb060-d8b0-4c22-a747-2ae10cff854c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:48.258674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d5bb060-d8b0-4c22-a747-2ae10cff854c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:48.262268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d5bb060-d8b0-4c22-a747-2ae10cff854c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:48.522455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2bcc4955-6c0a-4998-8d18-566e975b4947 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:48.523084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2bcc4955-6c0a-4998-8d18-566e975b4947 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:48.550578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2bcc4955-6c0a-4998-8d18-566e975b4947 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:48.551368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2bcc4955-6c0a-4998-8d18-566e975b4947 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:48.552731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2bcc4955-6c0a-4998-8d18-566e975b4947 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:48.555327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2bcc4955-6c0a-4998-8d18-566e975b4947 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:48.628794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2bcc4955-6c0a-4998-8d18-566e975b4947 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:03:48.672015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9d5bb060-d8b0-4c22-a747-2ae10cff854c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:48.703630 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9d5bb060-d8b0-4c22-a747-2ae10cff854c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1494 microversion: 2.1 time: 0.477683 Aug 03 02:03:48.736918 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1663/3378] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:48 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1494 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:48.757143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-39ee8789-a269-46ed-923f-63432195bf80 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:48.760079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-39ee8789-a269-46ed-923f-63432195bf80 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:48.774045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39ee8789-a269-46ed-923f-63432195bf80 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:48.778182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39ee8789-a269-46ed-923f-63432195bf80 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:48.780345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39ee8789-a269-46ed-923f-63432195bf80 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:48.782532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39ee8789-a269-46ed-923f-63432195bf80 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:48.906256 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2bcc4955-6c0a-4998-8d18-566e975b4947 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 204 len: 0 microversion: 2.1 time: 0.401433 Aug 03 02:03:48.907533 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1716/3379] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:03:48 2022] DELETE /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:03:48.917543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-39251c18-04af-4e36-b846-44c8ab184dbe tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:48.919784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-39251c18-04af-4e36-b846-44c8ab184dbe tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:48.931515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39251c18-04af-4e36-b846-44c8ab184dbe tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:48.931975 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39251c18-04af-4e36-b846-44c8ab184dbe tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:48.937912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39251c18-04af-4e36-b846-44c8ab184dbe tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:48.938390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39251c18-04af-4e36-b846-44c8ab184dbe tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:49.082354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-39251c18-04af-4e36-b846-44c8ab184dbe tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:49.094249 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-39251c18-04af-4e36-b846-44c8ab184dbe tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 200 len: 1271 microversion: 2.1 time: 0.184904 Aug 03 02:03:49.095385 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1717/3380] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:48 2022] GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:49.102697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c28a18c9-b0c1-4191-af07-79099a899170 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:49.104246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c28a18c9-b0c1-4191-af07-79099a899170 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:49.112988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c28a18c9-b0c1-4191-af07-79099a899170 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:49.113503 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c28a18c9-b0c1-4191-af07-79099a899170 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:49.114619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c28a18c9-b0c1-4191-af07-79099a899170 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:49.115164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c28a18c9-b0c1-4191-af07-79099a899170 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:49.146230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-39ee8789-a269-46ed-923f-63432195bf80 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:49.169857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-39ee8789-a269-46ed-923f-63432195bf80 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:49.175239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-39ee8789-a269-46ed-923f-63432195bf80 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:49.178893 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-39ee8789-a269-46ed-923f-63432195bf80 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1407 microversion: 2.20 time: 0.440230 Aug 03 02:03:49.179504 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1664/3381] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:48 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:49.749431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c28a18c9-b0c1-4191-af07-79099a899170 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:49.754542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-82a061d3-8b80-4103-93d7-d03472ebd816 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:49.755277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-82a061d3-8b80-4103-93d7-d03472ebd816 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:49.762051 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c28a18c9-b0c1-4191-af07-79099a899170 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1702 microversion: 2.1 time: 0.663123 Aug 03 02:03:49.762672 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1718/3382] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:49 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1702 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:49.771400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-82a061d3-8b80-4103-93d7-d03472ebd816 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:49.773837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-82a061d3-8b80-4103-93d7-d03472ebd816 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:49.775258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-82a061d3-8b80-4103-93d7-d03472ebd816 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:49.776056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-82a061d3-8b80-4103-93d7-d03472ebd816 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:50.122592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cc0a6114-654e-49d8-9fc5-d3107bcba9dc tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:50.123623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cc0a6114-654e-49d8-9fc5-d3107bcba9dc tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:50.139698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc0a6114-654e-49d8-9fc5-d3107bcba9dc tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:50.140264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc0a6114-654e-49d8-9fc5-d3107bcba9dc tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:50.142672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc0a6114-654e-49d8-9fc5-d3107bcba9dc tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:50.143875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc0a6114-654e-49d8-9fc5-d3107bcba9dc tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:50.208933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-82a061d3-8b80-4103-93d7-d03472ebd816 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:50.224376 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-82a061d3-8b80-4103-93d7-d03472ebd816 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 200 len: 1494 microversion: 2.1 time: 0.489611 Aug 03 02:03:50.227321 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1665/3383] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:49 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 1494 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:50.238891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4c9fd126-8add-460d-abc6-7f7c1eff051e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:50.239927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4c9fd126-8add-460d-abc6-7f7c1eff051e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:50.305757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c9fd126-8add-460d-abc6-7f7c1eff051e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:50.309406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c9fd126-8add-460d-abc6-7f7c1eff051e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:50.310330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c9fd126-8add-460d-abc6-7f7c1eff051e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:50.315405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c9fd126-8add-460d-abc6-7f7c1eff051e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:50.355253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cc0a6114-654e-49d8-9fc5-d3107bcba9dc tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:50.369656 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cc0a6114-654e-49d8-9fc5-d3107bcba9dc tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 200 len: 1271 microversion: 2.1 time: 0.251368 Aug 03 02:03:50.374801 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1719/3384] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:50 2022] GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 1271 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:50.788246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-27cd3222-ee5b-47ba-a53d-2c535a5819a4 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:50.789712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-27cd3222-ee5b-47ba-a53d-2c535a5819a4 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:50.821715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27cd3222-ee5b-47ba-a53d-2c535a5819a4 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:50.822175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27cd3222-ee5b-47ba-a53d-2c535a5819a4 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:50.825773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27cd3222-ee5b-47ba-a53d-2c535a5819a4 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:50.826286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27cd3222-ee5b-47ba-a53d-2c535a5819a4 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:51.000093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4c9fd126-8add-460d-abc6-7f7c1eff051e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:51.017360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4c9fd126-8add-460d-abc6-7f7c1eff051e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:51.028279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4c9fd126-8add-460d-abc6-7f7c1eff051e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:51.032525 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4c9fd126-8add-460d-abc6-7f7c1eff051e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1599 microversion: 2.20 time: 0.802661 Aug 03 02:03:51.036334 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1666/3385] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:03:50 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1599 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:03:51.049033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-5c48e1ff-7784-4842-afd4-afa9f9cfb1c4 req-755d5dc9-0eb4-4d4e-a9bc-7731e2599580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3896d3ca-97e6-4db3-998a-49e5beb3191d", "name": "network-vif-deleted", "tag": "0c7e9a87-aae8-4057-aba1-1986ee826063"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:51.096198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5c48e1ff-7784-4842-afd4-afa9f9cfb1c4 req-755d5dc9-0eb4-4d4e-a9bc-7731e2599580 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:51.096669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5c48e1ff-7784-4842-afd4-afa9f9cfb1c4 req-755d5dc9-0eb4-4d4e-a9bc-7731e2599580 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:51.160638 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-5c48e1ff-7784-4842-afd4-afa9f9cfb1c4 req-755d5dc9-0eb4-4d4e-a9bc-7731e2599580 service nova] Creating event network-vif-deleted:0c7e9a87-aae8-4057-aba1-1986ee826063 for instance 3896d3ca-97e6-4db3-998a-49e5beb3191d on n-h1-826529-8 Aug 03 02:03:51.177170 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-5c48e1ff-7784-4842-afd4-afa9f9cfb1c4 req-755d5dc9-0eb4-4d4e-a9bc-7731e2599580 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137337 Aug 03 02:03:51.178438 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1667/3386] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:51.191705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-752480e3-5905-411f-89f5-21c4a2cfe3b1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:51.192782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-752480e3-5905-411f-89f5-21c4a2cfe3b1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:51.215911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-752480e3-5905-411f-89f5-21c4a2cfe3b1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:51.219683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-752480e3-5905-411f-89f5-21c4a2cfe3b1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:51.220811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-752480e3-5905-411f-89f5-21c4a2cfe3b1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:51.223092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-752480e3-5905-411f-89f5-21c4a2cfe3b1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:51.494964 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-752480e3-5905-411f-89f5-21c4a2cfe3b1 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.315013 Aug 03 02:03:51.497361 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1668/3387] 10.222.0.67 () {60 vars in 1316 bytes} [Wed Aug 3 02:03:51 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406/os-interface => generated 284 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:03:51.502476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1c29ba00-ff90-4aff-9fec-bd2d8e19bb05 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:51.503128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1c29ba00-ff90-4aff-9fec-bd2d8e19bb05 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:51.518597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c29ba00-ff90-4aff-9fec-bd2d8e19bb05 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:51.519120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c29ba00-ff90-4aff-9fec-bd2d8e19bb05 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:51.519921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c29ba00-ff90-4aff-9fec-bd2d8e19bb05 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:51.520370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c29ba00-ff90-4aff-9fec-bd2d8e19bb05 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:51.559416 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-1c29ba00-ff90-4aff-9fec-bd2d8e19bb05 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1c29ba00-ff90-4aff-9fec-bd2d8e19bb05 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d HTTP/1.1 Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '3896d3ca-97e6-4db3-998a-49e5beb3191d'} Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:51.560629 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:51.565702 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:51.565702 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:51.565702 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:51.565702 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:03:51.565702 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:03:51.565702 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. Aug 03 02:03:51.565702 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:03:51.567058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1c29ba00-ff90-4aff-9fec-bd2d8e19bb05 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:03:51.568120 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1c29ba00-ff90-4aff-9fec-bd2d8e19bb05 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 404 len: 111 microversion: 2.1 time: 0.069619 Aug 03 02:03:51.572101 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1669/3388] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:51 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:03:51.585057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f565f3c2-6ed9-4643-a891-3dd7668bf9b4 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:51.585686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f565f3c2-6ed9-4643-a891-3dd7668bf9b4 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:51.606240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-27cd3222-ee5b-47ba-a53d-2c535a5819a4 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:51.607254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f565f3c2-6ed9-4643-a891-3dd7668bf9b4 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:51.607717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f565f3c2-6ed9-4643-a891-3dd7668bf9b4 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:51.608519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f565f3c2-6ed9-4643-a891-3dd7668bf9b4 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:51.609153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f565f3c2-6ed9-4643-a891-3dd7668bf9b4 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:51.624698 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-27cd3222-ee5b-47ba-a53d-2c535a5819a4 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1702 microversion: 2.1 time: 0.840793 Aug 03 02:03:51.627093 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1720/3389] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:50 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1702 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:03:51.793550 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1087479425", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "cf1e5fc2-66a4-4802-965c-545f628b0c29"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:51.906514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] validate_networks() for [('cf1e5fc2-66a4-4802-965c-545f628b0c29', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:03:52.920343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f565f3c2-6ed9-4643-a891-3dd7668bf9b4 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:52.931506 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f565f3c2-6ed9-4643-a891-3dd7668bf9b4 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 200 len: 1313 microversion: 2.1 time: 1.357553 Aug 03 02:03:52.932982 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1670/3390] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:51 2022] GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 1313 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:52.945381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f33103cd-16ac-4709-b2f6-67ef553d88d9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:52.946275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f33103cd-16ac-4709-b2f6-67ef553d88d9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:52.954874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f33103cd-16ac-4709-b2f6-67ef553d88d9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:52.955564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f33103cd-16ac-4709-b2f6-67ef553d88d9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:52.956626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f33103cd-16ac-4709-b2f6-67ef553d88d9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:52.957335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f33103cd-16ac-4709-b2f6-67ef553d88d9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:53.174068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f33103cd-16ac-4709-b2f6-67ef553d88d9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635b99a4523149d08cf149f321420288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58f4b233c354db7be024f63337a78f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:53.189448 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f33103cd-16ac-4709-b2f6-67ef553d88d9 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 200 len: 1634 microversion: 2.1 time: 0.254639 Aug 03 02:03:53.190494 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1671/3391] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:52 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 1634 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:53.943313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:03:53.943887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:03:53.944126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:03:53.944547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:03:53.944967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:03:53.955651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3808e8cf-d28d-43fb-bcd9-2c79f23eab5e tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:53.957428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3808e8cf-d28d-43fb-bcd9-2c79f23eab5e tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:53.964344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:53.964873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:53.965912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:53.970864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:53.975684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3808e8cf-d28d-43fb-bcd9-2c79f23eab5e tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:53.976144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3808e8cf-d28d-43fb-bcd9-2c79f23eab5e tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:53.977108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3808e8cf-d28d-43fb-bcd9-2c79f23eab5e tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:53.977552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3808e8cf-d28d-43fb-bcd9-2c79f23eab5e tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:54.030487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Getting quotas for project 01f1d9f8216e4f729a5e24aad713fe98. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:03:54.052822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Getting quotas for user 0dc56b77862f410d82c8617f3d679775 and project 01f1d9f8216e4f729a5e24aad713fe98. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:03:54.079813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:03:54.087078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:03:54.173912 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-58a2991f-e424-480a-b7fa-725515c4d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.386715 Aug 03 02:03:54.180035 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1721/3392] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:03:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:03:54.218139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-3950be48-35fa-4884-b25e-3a4ca2177179 req-5395c3bb-db0d-42e6-8e14-d9384ec5440f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb08bbd-64e7-4cfd-9d16-667eaf5a529e", "name": "network-vif-deleted", "tag": "36f2c82b-8079-4a94-86a7-6b8a1d823941"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:54.245885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3950be48-35fa-4884-b25e-3a4ca2177179 req-5395c3bb-db0d-42e6-8e14-d9384ec5440f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:54.247723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3950be48-35fa-4884-b25e-3a4ca2177179 req-5395c3bb-db0d-42e6-8e14-d9384ec5440f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:54.270012 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-3950be48-35fa-4884-b25e-3a4ca2177179 req-5395c3bb-db0d-42e6-8e14-d9384ec5440f service nova] Creating event network-vif-deleted:36f2c82b-8079-4a94-86a7-6b8a1d823941 for instance 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e on n-h2-826529-8 Aug 03 02:03:54.278434 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-3950be48-35fa-4884-b25e-3a4ca2177179 req-5395c3bb-db0d-42e6-8e14-d9384ec5440f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093922 Aug 03 02:03:54.279550 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1722/3393] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:54.287067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-808562f0-e88f-4996-b209-9669d77e3672 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:54.288843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-808562f0-e88f-4996-b209-9669d77e3672 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:55.375230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-808562f0-e88f-4996-b209-9669d77e3672 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:55.382361 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-808562f0-e88f-4996-b209-9669d77e3672 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1215 microversion: 2.1 time: 1.101289 Aug 03 02:03:55.383819 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1723/3394] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:54 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1215 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:55.395151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f7889409-72ad-4ba7-9d02-8fb94f7aca05 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:55.398845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f7889409-72ad-4ba7-9d02-8fb94f7aca05 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] [instance: 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:55.415661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7889409-72ad-4ba7-9d02-8fb94f7aca05 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:55.421803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7889409-72ad-4ba7-9d02-8fb94f7aca05 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:55.423160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7889409-72ad-4ba7-9d02-8fb94f7aca05 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:55.425125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7889409-72ad-4ba7-9d02-8fb94f7aca05 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:55.464250 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-f7889409-72ad-4ba7-9d02-8fb94f7aca05 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] HTTP exception thrown: Instance 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e could not be found. Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f7889409-72ad-4ba7-9d02-8fb94f7aca05 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Request method failure captured: Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e HTTP/1.1 Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dc8SM-6YTf5s2onhrtWq29gfsgrx1OoPoXXNFWzxucTZ03oIWD2xO3pPDTvu5Sk4L0-xaaE1Ni-uqySp9hwj72heR9JtJ1uFImnoPFNSQLATAmFe2ujHA0ojQy7EZE6kEK08M9huHFBTYGt6PuIJ8TeICHWNiXonwlR5_7rIv-DYsM Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: e58f4b233c354db7be024f63337a78f0 Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersTestJSON-2038629436 Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_e58f4b233c354db7be024f63337a78f0", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e58f4b233c354db7be024f63337a78f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/e58f4b233c354db7be024f63337a78f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/e58f4b233c354db7be024f63337a78f0"}]}] Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersTestJSON-2038629436 Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: e58f4b233c354db7be024f63337a78f0 Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersTestJSON-2038629436 Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersTestJSON-2038629436-project Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 635b99a4523149d08cf149f321420288 Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersTestJSON-2038629436-project Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e could not be found. Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '5bb08bbd-64e7-4cfd-9d16-667eaf5a529e'} Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e could not be found. Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e could not be found. Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:03:55.467808 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:55.473079 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:03:55.473079 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:03:55.473079 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:03:55.473079 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:03:55.473079 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:03:55.473079 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e could not be found. Aug 03 02:03:55.473079 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:03:55.473079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f7889409-72ad-4ba7-9d02-8fb94f7aca05 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Returning 404 to user: Instance 5bb08bbd-64e7-4cfd-9d16-667eaf5a529e could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:03:55.473079 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f7889409-72ad-4ba7-9d02-8fb94f7aca05 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e" status: 404 len: 111 microversion: 2.1 time: 0.084318 Aug 03 02:03:55.477361 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1724/3395] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:55 2022] GET /compute/v2.1/servers/5bb08bbd-64e7-4cfd-9d16-667eaf5a529e => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:03:55.564655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3808e8cf-d28d-43fb-bcd9-2c79f23eab5e tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:55.589626 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3808e8cf-d28d-43fb-bcd9-2c79f23eab5e tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 200 len: 1313 microversion: 2.1 time: 1.637090 Aug 03 02:03:55.592663 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1672/3396] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:53 2022] GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 1313 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:55.619371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-80be4f4e-9609-424f-8112-c1d08fa33774 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] Calling method '.version_select at 0x7f5b127c6dc0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:55.684491 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-80be4f4e-9609-424f-8112-c1d08fa33774 tempest-ServersTestJSON-2038629436 tempest-ServersTestJSON-2038629436-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075513856" status: 202 len: 0 microversion: 2.1 time: 0.085150 Aug 03 02:03:55.689609 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1673/3397] 10.222.0.67 () {58 vars in 1221 bytes} [Wed Aug 3 02:03:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1075513856 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:03:55.856464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-448491423", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "c1556e5c-ee98-4873-8046-a2026aaca40f"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:55.988248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] validate_networks() for [('c1556e5c-ee98-4873-8046-a2026aaca40f', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:03:56.334455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-bb25091a-d988-4e37-9077-f73513d98fdd req-5058704b-f698-4383-b973-3cb673812a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "873e4f59-41f4-4cf7-8735-a43a798609f2", "tag": "aa98ab8d-cbf8-47e2-9ee3-de6aa6f0391f"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:56.350323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bb25091a-d988-4e37-9077-f73513d98fdd req-5058704b-f698-4383-b973-3cb673812a2b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:56.351244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bb25091a-d988-4e37-9077-f73513d98fdd req-5058704b-f698-4383-b973-3cb673812a2b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:56.376818 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-bb25091a-d988-4e37-9077-f73513d98fdd req-5058704b-f698-4383-b973-3cb673812a2b service nova] Creating event network-changed:aa98ab8d-cbf8-47e2-9ee3-de6aa6f0391f for instance 873e4f59-41f4-4cf7-8735-a43a798609f2 on n-h1-826529-8 Aug 03 02:03:56.402772 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-bb25091a-d988-4e37-9077-f73513d98fdd req-5058704b-f698-4383-b973-3cb673812a2b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079594 Aug 03 02:03:56.405862 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1674/3398] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:03:56.435767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2575adc0-53c2-496a-b9e7-731e492be81f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:56.436822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2575adc0-53c2-496a-b9e7-731e492be81f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:56.450968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2575adc0-53c2-496a-b9e7-731e492be81f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:56.452558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2575adc0-53c2-496a-b9e7-731e492be81f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:56.454728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2575adc0-53c2-496a-b9e7-731e492be81f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:56.456732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2575adc0-53c2-496a-b9e7-731e492be81f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:56.902498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2575adc0-53c2-496a-b9e7-731e492be81f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:56.916462 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2575adc0-53c2-496a-b9e7-731e492be81f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1273 microversion: 2.1 time: 0.489180 Aug 03 02:03:56.935458 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1675/3399] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:56 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1273 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:56.955435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-46302b5a-7d49-4023-a211-fd4ed8b96fc0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:56.956511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-46302b5a-7d49-4023-a211-fd4ed8b96fc0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:56.963115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46302b5a-7d49-4023-a211-fd4ed8b96fc0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:56.964127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46302b5a-7d49-4023-a211-fd4ed8b96fc0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:56.965335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46302b5a-7d49-4023-a211-fd4ed8b96fc0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:56.966101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46302b5a-7d49-4023-a211-fd4ed8b96fc0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:57.324062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:57.459955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:58.395936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-46302b5a-7d49-4023-a211-fd4ed8b96fc0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:58.406926 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-46302b5a-7d49-4023-a211-fd4ed8b96fc0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 200 len: 1313 microversion: 2.1 time: 1.469918 Aug 03 02:03:58.408259 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1676/3400] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:56 2022] GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 1313 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:58.425212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-436bdeb1-5921-4526-a7f9-9e44cc012c0c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:58.426670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-436bdeb1-5921-4526-a7f9-9e44cc012c0c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:58.435075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-436bdeb1-5921-4526-a7f9-9e44cc012c0c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:58.435534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-436bdeb1-5921-4526-a7f9-9e44cc012c0c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:58.440700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-436bdeb1-5921-4526-a7f9-9e44cc012c0c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:58.441382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-436bdeb1-5921-4526-a7f9-9e44cc012c0c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:58.893938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:03:58.896505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:03:58.897775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:03:58.898729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:03:58.899715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:03:58.923100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:58.923840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:58.931479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:58.933150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:58.989558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Getting quotas for project 78ae2f8c7bef4a959cdfa8c61360e7e5. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:03:59.007292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Getting quotas for user e2c17b2e7e9f4c878826497386ee3ba7 and project 78ae2f8c7bef4a959cdfa8c61360e7e5. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:03:59.058824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:03:59.068362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:03:59.190315 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-70850f73-e029-4791-a7b0-dbd831965102 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.711685 Aug 03 02:03:59.192283 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1725/3401] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:03:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:03:59.198476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-da4e1433-c620-4e6b-bc00-91ff032ac852 req-276bd278-7e8a-4357-a99a-954d73137f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fea7f2e-eb34-40c8-8171-11e0a65bae4a", "tag": "e1ea085a-3d24-4a01-addc-213948d9671b"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:59.250018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-da4e1433-c620-4e6b-bc00-91ff032ac852 req-276bd278-7e8a-4357-a99a-954d73137f48 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:59.251269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-da4e1433-c620-4e6b-bc00-91ff032ac852 req-276bd278-7e8a-4357-a99a-954d73137f48 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:59.257759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:59.271142 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-da4e1433-c620-4e6b-bc00-91ff032ac852 req-276bd278-7e8a-4357-a99a-954d73137f48 service nova] Creating event network-changed:e1ea085a-3d24-4a01-addc-213948d9671b for instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a on n-h2-826529-8 Aug 03 02:03:59.282120 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-da4e1433-c620-4e6b-bc00-91ff032ac852 req-276bd278-7e8a-4357-a99a-954d73137f48 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087783 Aug 03 02:03:59.283922 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1726/3402] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:59.291429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f914e5f5-c144-4ba9-800c-94f7fbfd030a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:59.292556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f914e5f5-c144-4ba9-800c-94f7fbfd030a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:59.489858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f914e5f5-c144-4ba9-800c-94f7fbfd030a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:59.500386 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f914e5f5-c144-4ba9-800c-94f7fbfd030a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1224 microversion: 2.1 time: 0.214559 Aug 03 02:03:59.506741 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1727/3403] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:59 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1224 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:59.519300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b99041ee-9aba-4b08-8d6b-069fd5f997fd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Action: 'create', calling method: .version_select at 0x7f5b243b9ca0>, body: {"keypair": {"name": "tempest-keypair-470046397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4V6xHdHmp+UaNEGHcYem13+hH7JXsLAwbgiLeeb9uJSCx+XOWm4nF3FUHcWwebQM7rlnbU/4f+o7VRpcVfWtno6eOcmkekeZ6kEsk3/p6keuhAWq7PtwQIRoavTmqkPQ=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:59.525481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:03:59.553669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-b99041ee-9aba-4b08-8d6b-069fd5f997fd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:03:59.575250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-b99041ee-9aba-4b08-8d6b-069fd5f997fd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for user 4c1fb7af331344dcb26c43368a9daa6e and project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:03:59.606322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-436bdeb1-5921-4526-a7f9-9e44cc012c0c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:03:59.636509 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b99041ee-9aba-4b08-8d6b-069fd5f997fd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126910 Aug 03 02:03:59.637092 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1728/3404] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:03:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:03:59.643080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-01fe6bf8-d111-4d7f-816c-fca0972df09b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:03:59.656003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-01fe6bf8-d111-4d7f-816c-fca0972df09b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:03:59.658371 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-436bdeb1-5921-4526-a7f9-9e44cc012c0c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1315 microversion: 2.1 time: 1.246108 Aug 03 02:03:59.675297 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1677/3405] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:58 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1315 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:03:59.677643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01fe6bf8-d111-4d7f-816c-fca0972df09b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:59.681303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01fe6bf8-d111-4d7f-816c-fca0972df09b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:59.682965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01fe6bf8-d111-4d7f-816c-fca0972df09b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:59.692412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01fe6bf8-d111-4d7f-816c-fca0972df09b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:59.836166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-1aece680-f093-42ff-938e-16bceba44823 req-7e3bbf23-4f59-4e22-b8f7-6081a5fc2788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ce11775-ab73-457e-8799-239915dc2406", "tag": "12c644d8-021b-4605-8e3c-16ff33d29cd1"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:03:59.893787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1aece680-f093-42ff-938e-16bceba44823 req-7e3bbf23-4f59-4e22-b8f7-6081a5fc2788 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:03:59.894627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1aece680-f093-42ff-938e-16bceba44823 req-7e3bbf23-4f59-4e22-b8f7-6081a5fc2788 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:03:59.965905 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-1aece680-f093-42ff-938e-16bceba44823 req-7e3bbf23-4f59-4e22-b8f7-6081a5fc2788 service nova] Creating event network-changed:12c644d8-021b-4605-8e3c-16ff33d29cd1 for instance 9ce11775-ab73-457e-8799-239915dc2406 on n-h2-826529-8 Aug 03 02:03:59.989040 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-1aece680-f093-42ff-938e-16bceba44823 req-7e3bbf23-4f59-4e22-b8f7-6081a5fc2788 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170921 Aug 03 02:03:59.993734 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1678/3406] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:00.521912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-01fe6bf8-d111-4d7f-816c-fca0972df09b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:00.539035 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-01fe6bf8-d111-4d7f-816c-fca0972df09b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 200 len: 1313 microversion: 2.1 time: 0.892237 Aug 03 02:04:00.548342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3f2dd71d-db73-4099-ba22-f8e210712067 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:00.551457 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1729/3407] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:03:59 2022] GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 1313 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:00.552057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3f2dd71d-db73-4099-ba22-f8e210712067 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:00.604182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f2dd71d-db73-4099-ba22-f8e210712067 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:00.608756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f2dd71d-db73-4099-ba22-f8e210712067 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:00.613448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f2dd71d-db73-4099-ba22-f8e210712067 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:00.618244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f2dd71d-db73-4099-ba22-f8e210712067 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:00.688279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-23c2e0bc-ead6-4ee4-9e93-a9c1af4962e4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:00.689069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-23c2e0bc-ead6-4ee4-9e93-a9c1af4962e4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:00.703750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23c2e0bc-ead6-4ee4-9e93-a9c1af4962e4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:00.704487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23c2e0bc-ead6-4ee4-9e93-a9c1af4962e4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:00.705480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23c2e0bc-ead6-4ee4-9e93-a9c1af4962e4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:00.706096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23c2e0bc-ead6-4ee4-9e93-a9c1af4962e4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:00.795274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3f2dd71d-db73-4099-ba22-f8e210712067 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:00.809684 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3f2dd71d-db73-4099-ba22-f8e210712067 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1220 microversion: 2.1 time: 0.283540 Aug 03 02:04:00.810430 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1679/3408] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:00 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1220 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:01.458679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e1d244cd-54fb-4b3d-a245-9161a8eb1131 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:01.459206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e1d244cd-54fb-4b3d-a245-9161a8eb1131 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:01.470147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1d244cd-54fb-4b3d-a245-9161a8eb1131 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:01.470497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1d244cd-54fb-4b3d-a245-9161a8eb1131 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:01.471091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1d244cd-54fb-4b3d-a245-9161a8eb1131 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:01.480580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1d244cd-54fb-4b3d-a245-9161a8eb1131 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:01.484010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-23c2e0bc-ead6-4ee4-9e93-a9c1af4962e4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:01.503677 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-23c2e0bc-ead6-4ee4-9e93-a9c1af4962e4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1315 microversion: 2.1 time: 0.819009 Aug 03 02:04:01.508875 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1730/3409] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:00 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1315 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:01.520994 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-e1d244cd-54fb-4b3d-a245-9161a8eb1131 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] HTTP exception thrown: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e1d244cd-54fb-4b3d-a245-9161a8eb1131 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Request method failure captured: Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 HTTP/1.1 Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dW4CFWugwSdfmlDGBzpbCfO7ctB29RdgEay767amxpDQnah3aA1AcfB6jdbU-_Vn8CpjnJW44USO21Gti8C0xj3TARuYoX1UB1EojIRjOZ7X4MR4cSYmQKoBXCqvLqsiStqQflYvAnntXOCqq75UI4CGw4czOulSiZVGnUbA3rZZzc Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.32 Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 63f89d0f699c49fcb49da050cb5c769e Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TaggedBootDevicesTest-971928644 Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_63f89d0f699c49fcb49da050cb5c769e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63f89d0f699c49fcb49da050cb5c769e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/63f89d0f699c49fcb49da050cb5c769e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63f89d0f699c49fcb49da050cb5c769e"}]}] Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TaggedBootDevicesTest-971928644 Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 63f89d0f699c49fcb49da050cb5c769e Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TaggedBootDevicesTest-971928644 Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TaggedBootDevicesTest-971928644-project Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 38b0905e032b4d8bb313f8869e4d369b Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TaggedBootDevicesTest-971928644-project Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '82c5fe16-6b90-4d79-a61d-c9bede1ee174'} Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:04:01.523645 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:04:01.529375 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. Aug 03 02:04:01.529375 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:01.529375 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:01.529375 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:01.529375 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:01.529375 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:01.529375 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:01.529375 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:04:01.529375 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:04:01.529375 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. Aug 03 02:04:01.529375 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:01.529375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e1d244cd-54fb-4b3d-a245-9161a8eb1131 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Returning 404 to user: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:04:01.529375 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e1d244cd-54fb-4b3d-a245-9161a8eb1131 tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "DELETE /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 404 len: 111 microversion: 2.32 time: 0.072075 Aug 03 02:04:01.529375 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1680/3410] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:04:01 2022] DELETE /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:04:01.535191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc48a8dc-9c63-4811-a057-9d5891a1f7fc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:01.535860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fc48a8dc-9c63-4811-a057-9d5891a1f7fc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] [instance: 82c5fe16-6b90-4d79-a61d-c9bede1ee174] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:01.566841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-962afdeb-b4d1-4ac7-860b-6e1c795a7ffa tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:01.567499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-962afdeb-b4d1-4ac7-860b-6e1c795a7ffa tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:01.571820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc48a8dc-9c63-4811-a057-9d5891a1f7fc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:01.572277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc48a8dc-9c63-4811-a057-9d5891a1f7fc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:01.573716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc48a8dc-9c63-4811-a057-9d5891a1f7fc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:01.574266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc48a8dc-9c63-4811-a057-9d5891a1f7fc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:01.594262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-962afdeb-b4d1-4ac7-860b-6e1c795a7ffa tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:01.597780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-962afdeb-b4d1-4ac7-860b-6e1c795a7ffa tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:01.598675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-962afdeb-b4d1-4ac7-860b-6e1c795a7ffa tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:01.602450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-962afdeb-b4d1-4ac7-860b-6e1c795a7ffa tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:01.626385 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-fc48a8dc-9c63-4811-a057-9d5891a1f7fc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] HTTP exception thrown: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc48a8dc-9c63-4811-a057-9d5891a1f7fc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Request method failure captured: Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 HTTP/1.1 Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dW4CFWugwSdfmlDGBzpbCfO7ctB29RdgEay767amxpDQnah3aA1AcfB6jdbU-_Vn8CpjnJW44USO21Gti8C0xj3TARuYoX1UB1EojIRjOZ7X4MR4cSYmQKoBXCqvLqsiStqQflYvAnntXOCqq75UI4CGw4czOulSiZVGnUbA3rZZzc Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Openstack-Nova-Api-Version: 2.32 Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 63f89d0f699c49fcb49da050cb5c769e Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TaggedBootDevicesTest-971928644 Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_63f89d0f699c49fcb49da050cb5c769e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63f89d0f699c49fcb49da050cb5c769e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/63f89d0f699c49fcb49da050cb5c769e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/63f89d0f699c49fcb49da050cb5c769e"}]}] Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TaggedBootDevicesTest-971928644 Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 63f89d0f699c49fcb49da050cb5c769e Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TaggedBootDevicesTest-971928644 Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TaggedBootDevicesTest-971928644-project Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 38b0905e032b4d8bb313f8869e4d369b Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TaggedBootDevicesTest-971928644-project Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '82c5fe16-6b90-4d79-a61d-c9bede1ee174'} Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:01.628535 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:01.633211 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:01.633211 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:01.633211 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:01.633211 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:04:01.633211 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:04:01.633211 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. Aug 03 02:04:01.633211 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:01.633211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc48a8dc-9c63-4811-a057-9d5891a1f7fc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] Returning 404 to user: Instance 82c5fe16-6b90-4d79-a61d-c9bede1ee174 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:04:01.633211 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fc48a8dc-9c63-4811-a057-9d5891a1f7fc tempest-TaggedBootDevicesTest-971928644 tempest-TaggedBootDevicesTest-971928644-project] 10.222.0.67 "GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174" status: 404 len: 111 microversion: 2.32 time: 0.099525 Aug 03 02:04:01.637462 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1731/3411] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:04:01 2022] GET /compute/v2.1/servers/82c5fe16-6b90-4d79-a61d-c9bede1ee174 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:04:01.840200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2fe03310-d8ab-448c-83f6-c92333cb9a86 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:01.841165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2fe03310-d8ab-448c-83f6-c92333cb9a86 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:01.850689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fe03310-d8ab-448c-83f6-c92333cb9a86 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:01.851460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fe03310-d8ab-448c-83f6-c92333cb9a86 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:01.852500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fe03310-d8ab-448c-83f6-c92333cb9a86 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:01.853482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fe03310-d8ab-448c-83f6-c92333cb9a86 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:02.166053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2fe03310-d8ab-448c-83f6-c92333cb9a86 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:02.175190 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2fe03310-d8ab-448c-83f6-c92333cb9a86 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1282 microversion: 2.1 time: 0.342092 Aug 03 02:04:02.184094 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1732/3412] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:01 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1282 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:02.351669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-962afdeb-b4d1-4ac7-860b-6e1c795a7ffa tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:02.369214 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-962afdeb-b4d1-4ac7-860b-6e1c795a7ffa tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 200 len: 1313 microversion: 2.1 time: 0.806062 Aug 03 02:04:02.390865 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1681/3413] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:01 2022] GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 1313 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:02.535599 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fb287202-b77c-4965-a7b6-a62311d1bf0b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:02.537101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fb287202-b77c-4965-a7b6-a62311d1bf0b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:02.560344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb287202-b77c-4965-a7b6-a62311d1bf0b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:02.577827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb287202-b77c-4965-a7b6-a62311d1bf0b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:02.579038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb287202-b77c-4965-a7b6-a62311d1bf0b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:02.582602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb287202-b77c-4965-a7b6-a62311d1bf0b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:02.757208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-a8531e6f-a4e7-4d28-a141-45ad66ad2753 req-9498194e-d1de-4358-9a12-613fbb21dbbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873e4f59-41f4-4cf7-8735-a43a798609f2", "name": "network-vif-plugged", "status": "completed", "tag": "aa98ab8d-cbf8-47e2-9ee3-de6aa6f0391f"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:02.782167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a8531e6f-a4e7-4d28-a141-45ad66ad2753 req-9498194e-d1de-4358-9a12-613fbb21dbbd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:02.782752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a8531e6f-a4e7-4d28-a141-45ad66ad2753 req-9498194e-d1de-4358-9a12-613fbb21dbbd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:02.816257 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-a8531e6f-a4e7-4d28-a141-45ad66ad2753 req-9498194e-d1de-4358-9a12-613fbb21dbbd service nova] Creating event network-vif-plugged:aa98ab8d-cbf8-47e2-9ee3-de6aa6f0391f for instance 873e4f59-41f4-4cf7-8735-a43a798609f2 on n-h1-826529-8 Aug 03 02:04:02.831124 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-a8531e6f-a4e7-4d28-a141-45ad66ad2753 req-9498194e-d1de-4358-9a12-613fbb21dbbd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074727 Aug 03 02:04:02.831923 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1682/3414] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:04:03.197522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-38f4318c-8577-4b71-a6fc-d08e613f69a5 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:03.198544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-38f4318c-8577-4b71-a6fc-d08e613f69a5 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:03.205573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38f4318c-8577-4b71-a6fc-d08e613f69a5 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:03.206345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38f4318c-8577-4b71-a6fc-d08e613f69a5 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:03.207364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38f4318c-8577-4b71-a6fc-d08e613f69a5 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:03.207975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38f4318c-8577-4b71-a6fc-d08e613f69a5 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:03.357602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-38f4318c-8577-4b71-a6fc-d08e613f69a5 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:03.358709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fb287202-b77c-4965-a7b6-a62311d1bf0b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:03.364859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:03.371616 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fb287202-b77c-4965-a7b6-a62311d1bf0b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1315 microversion: 2.1 time: 0.845059 Aug 03 02:04:03.372235 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1733/3415] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:02 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1315 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:03.395545 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-38f4318c-8577-4b71-a6fc-d08e613f69a5 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1282 microversion: 2.1 time: 0.195228 Aug 03 02:04:03.396846 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1683/3416] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:03 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1282 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:04:03.397296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9da159e9-77ed-4012-995f-09b7569a0f30 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:03.397935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9da159e9-77ed-4012-995f-09b7569a0f30 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:03.412466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9da159e9-77ed-4012-995f-09b7569a0f30 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:03.413261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9da159e9-77ed-4012-995f-09b7569a0f30 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:03.414397 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9da159e9-77ed-4012-995f-09b7569a0f30 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:03.415120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9da159e9-77ed-4012-995f-09b7569a0f30 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:04.042991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9da159e9-77ed-4012-995f-09b7569a0f30 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:04.056644 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9da159e9-77ed-4012-995f-09b7569a0f30 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 200 len: 1313 microversion: 2.1 time: 0.663229 Aug 03 02:04:04.059241 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1734/3417] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:03 2022] GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 1313 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:04.340777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-673913944", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1bcbe413-2b5f-4286-84d0-26739a6b3703"}], "security_groups": [{"name": "tempest-securitygroup--558066375"}], "key_name": "tempest-keypair-470046397", "user_data": "}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:04.402323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f07b6385-3189-497f-92ec-bbb2d1ab5918 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:04.403053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f07b6385-3189-497f-92ec-bbb2d1ab5918 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:04.418942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f07b6385-3189-497f-92ec-bbb2d1ab5918 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:04.419408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f07b6385-3189-497f-92ec-bbb2d1ab5918 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:04.426372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f07b6385-3189-497f-92ec-bbb2d1ab5918 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:04.427033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f07b6385-3189-497f-92ec-bbb2d1ab5918 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:04.707313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] validate_networks() for [('1bcbe413-2b5f-4286-84d0-26739a6b3703', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:04:05.525738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f07b6385-3189-497f-92ec-bbb2d1ab5918 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:05.539370 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f07b6385-3189-497f-92ec-bbb2d1ab5918 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1315 microversion: 2.1 time: 1.141457 Aug 03 02:04:05.543278 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1735/3418] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:04 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1315 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:05.550863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a5202fa7-eac3-4ccf-818f-6fbd35be5d79 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:05.555804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a5202fa7-eac3-4ccf-818f-6fbd35be5d79 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:05.575062 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5202fa7-eac3-4ccf-818f-6fbd35be5d79 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:05.576018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5202fa7-eac3-4ccf-818f-6fbd35be5d79 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:05.577639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5202fa7-eac3-4ccf-818f-6fbd35be5d79 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:05.578538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5202fa7-eac3-4ccf-818f-6fbd35be5d79 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:06.082565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a5202fa7-eac3-4ccf-818f-6fbd35be5d79 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:06.134595 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a5202fa7-eac3-4ccf-818f-6fbd35be5d79 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1324 microversion: 2.1 time: 0.587845 Aug 03 02:04:06.137994 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1736/3419] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:05 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1324 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:06.150450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e2a32bb3-b77c-432d-8e94-69d03d879020 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:06.152290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e2a32bb3-b77c-432d-8e94-69d03d879020 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:06.164544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e2a32bb3-b77c-432d-8e94-69d03d879020 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:06.169446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e2a32bb3-b77c-432d-8e94-69d03d879020 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:06.175502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e2a32bb3-b77c-432d-8e94-69d03d879020 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:06.176616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e2a32bb3-b77c-432d-8e94-69d03d879020 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:06.541841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:04:06.542455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:04:06.542731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:04:06.543358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:04:06.543941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:04:06.565062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:06.565725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:06.566749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:06.567394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:06.613445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:04:06.644631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for user 4c1fb7af331344dcb26c43368a9daa6e and project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:04:06.686545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:04:06.689403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:04:06.876093 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d9e668e0-4941-4cce-a10e-494851b8e16b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.539525 Aug 03 02:04:06.896338 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1684/3420] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:04:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 2560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:04:06.906806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a18245d2-dfac-45a8-b643-a86ca432e62e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:06.908360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a18245d2-dfac-45a8-b643-a86ca432e62e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:06.919066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a18245d2-dfac-45a8-b643-a86ca432e62e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:06.919713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a18245d2-dfac-45a8-b643-a86ca432e62e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:06.922389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a18245d2-dfac-45a8-b643-a86ca432e62e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:06.923151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a18245d2-dfac-45a8-b643-a86ca432e62e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:07.622396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e2a32bb3-b77c-432d-8e94-69d03d879020 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:07.644050 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e2a32bb3-b77c-432d-8e94-69d03d879020 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 200 len: 1498 microversion: 2.1 time: 1.504171 Aug 03 02:04:07.644644 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1737/3421] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:06 2022] GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 1498 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:07.680381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-776b4b78-1b4d-4773-a3b7-9c244a8ebbaa tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:07.691319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-776b4b78-1b4d-4773-a3b7-9c244a8ebbaa tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:07.820918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a18245d2-dfac-45a8-b643-a86ca432e62e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:07.839531 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a18245d2-dfac-45a8-b643-a86ca432e62e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1315 microversion: 2.1 time: 0.931437 Aug 03 02:04:07.840353 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1685/3422] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:06 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1315 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:07.858767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-b60d123d-2589-4f46-b82a-6eca8cd27650 req-55725441-46fe-482a-9f78-0ff411448366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd09fc6-043e-40e1-9725-6c3ff4ff28bf", "tag": "6d5b657d-e7e5-44b1-a6df-9ad2ea5e9e88"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:07.884523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b60d123d-2589-4f46-b82a-6eca8cd27650 req-55725441-46fe-482a-9f78-0ff411448366 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:07.885272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b60d123d-2589-4f46-b82a-6eca8cd27650 req-55725441-46fe-482a-9f78-0ff411448366 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:07.923656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-776b4b78-1b4d-4773-a3b7-9c244a8ebbaa tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:07.932561 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-776b4b78-1b4d-4773-a3b7-9c244a8ebbaa tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2" status: 200 len: 1240 microversion: 2.1 time: 0.280778 Aug 03 02:04:07.933315 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1738/3423] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:07 2022] GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 => generated 1240 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:07.949313 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-b60d123d-2589-4f46-b82a-6eca8cd27650 req-55725441-46fe-482a-9f78-0ff411448366 service nova] Creating event network-changed:6d5b657d-e7e5-44b1-a6df-9ad2ea5e9e88 for instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf on n-h1-826529-8 Aug 03 02:04:07.976782 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-b60d123d-2589-4f46-b82a-6eca8cd27650 req-55725441-46fe-482a-9f78-0ff411448366 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135007 Aug 03 02:04:07.977400 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1686/3424] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:07.979242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cf1b9552-03bd-4365-b420-65b75f5797e3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:07.981951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cf1b9552-03bd-4365-b420-65b75f5797e3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:07.999938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-a812b677-912c-48ad-9c30-67ec2114ab1b req-1c8735bd-1c27-4423-b500-c5a4c928fd24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fea7f2e-eb34-40c8-8171-11e0a65bae4a", "name": "network-vif-plugged", "status": "completed", "tag": "e1ea085a-3d24-4a01-addc-213948d9671b"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:08.014782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf1b9552-03bd-4365-b420-65b75f5797e3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:08.017800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf1b9552-03bd-4365-b420-65b75f5797e3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:08.023884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf1b9552-03bd-4365-b420-65b75f5797e3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:08.024619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf1b9552-03bd-4365-b420-65b75f5797e3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:08.048107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a812b677-912c-48ad-9c30-67ec2114ab1b req-1c8735bd-1c27-4423-b500-c5a4c928fd24 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:08.050675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a812b677-912c-48ad-9c30-67ec2114ab1b req-1c8735bd-1c27-4423-b500-c5a4c928fd24 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:08.108840 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-a812b677-912c-48ad-9c30-67ec2114ab1b req-1c8735bd-1c27-4423-b500-c5a4c928fd24 service nova] Creating event network-vif-plugged:e1ea085a-3d24-4a01-addc-213948d9671b for instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a on n-h2-826529-8 Aug 03 02:04:08.116284 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-a812b677-912c-48ad-9c30-67ec2114ab1b req-1c8735bd-1c27-4423-b500-c5a4c928fd24 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135180 Aug 03 02:04:08.122165 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1687/3425] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:08.757973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-499786c2-2b67-4f5b-a490-8f1e134b864c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:08.758561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-499786c2-2b67-4f5b-a490-8f1e134b864c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:08.774211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-499786c2-2b67-4f5b-a490-8f1e134b864c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:08.774670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-499786c2-2b67-4f5b-a490-8f1e134b864c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:08.783983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-499786c2-2b67-4f5b-a490-8f1e134b864c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:08.784562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-499786c2-2b67-4f5b-a490-8f1e134b864c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:08.864779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-499786c2-2b67-4f5b-a490-8f1e134b864c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:04:08.943201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cf1b9552-03bd-4365-b420-65b75f5797e3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:08.957453 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cf1b9552-03bd-4365-b420-65b75f5797e3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1324 microversion: 2.1 time: 0.999414 Aug 03 02:04:08.976316 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1739/3426] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:07 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1324 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:08.983104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2b0d9193-636f-40d5-94ec-130e57a68fd0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:08.993407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2b0d9193-636f-40d5-94ec-130e57a68fd0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:09.022699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:09.025174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b0d9193-636f-40d5-94ec-130e57a68fd0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:09.025638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b0d9193-636f-40d5-94ec-130e57a68fd0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:09.027105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b0d9193-636f-40d5-94ec-130e57a68fd0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:09.027696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b0d9193-636f-40d5-94ec-130e57a68fd0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:09.096535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:09.166109 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-499786c2-2b67-4f5b-a490-8f1e134b864c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "DELETE /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 204 len: 0 microversion: 2.1 time: 0.412107 Aug 03 02:04:09.169805 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1688/3427] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:04:08 2022] DELETE /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:04:09.177752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e0fab5a3-9253-4df7-8d0f-6d29baad7ad7 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:09.184407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e0fab5a3-9253-4df7-8d0f-6d29baad7ad7 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:09.214870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0fab5a3-9253-4df7-8d0f-6d29baad7ad7 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:09.216035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0fab5a3-9253-4df7-8d0f-6d29baad7ad7 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:09.217113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0fab5a3-9253-4df7-8d0f-6d29baad7ad7 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:09.221553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0fab5a3-9253-4df7-8d0f-6d29baad7ad7 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:09.381687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e0fab5a3-9253-4df7-8d0f-6d29baad7ad7 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:09.392425 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e0fab5a3-9253-4df7-8d0f-6d29baad7ad7 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2" status: 200 len: 1298 microversion: 2.1 time: 0.221015 Aug 03 02:04:09.394548 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1689/3428] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:09 2022] GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 => generated 1298 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:09.409500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6dcd1714-0699-49a2-ac02-4e4fde198f4a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:09.410409 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6dcd1714-0699-49a2-ac02-4e4fde198f4a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:09.433339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dcd1714-0699-49a2-ac02-4e4fde198f4a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:09.433573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dcd1714-0699-49a2-ac02-4e4fde198f4a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:09.434450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dcd1714-0699-49a2-ac02-4e4fde198f4a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:09.435030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dcd1714-0699-49a2-ac02-4e4fde198f4a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:09.672093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2b0d9193-636f-40d5-94ec-130e57a68fd0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:09.684467 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2b0d9193-636f-40d5-94ec-130e57a68fd0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1315 microversion: 2.1 time: 0.706489 Aug 03 02:04:09.688065 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1740/3429] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:08 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1315 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:09.912677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6dcd1714-0699-49a2-ac02-4e4fde198f4a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:09.929685 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6dcd1714-0699-49a2-ac02-4e4fde198f4a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 200 len: 1504 microversion: 2.1 time: 0.533029 Aug 03 02:04:09.934357 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1690/3430] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:09 2022] GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 1504 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:09.991709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a3669891-0b7e-4efb-a99b-1e4442f4cd52 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:09.992541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a3669891-0b7e-4efb-a99b-1e4442f4cd52 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:10.020395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3669891-0b7e-4efb-a99b-1e4442f4cd52 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:10.020592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3669891-0b7e-4efb-a99b-1e4442f4cd52 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:10.024829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3669891-0b7e-4efb-a99b-1e4442f4cd52 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:10.025346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3669891-0b7e-4efb-a99b-1e4442f4cd52 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:10.197530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1965573138", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "019fe6d8-1b74-4afa-8697-7fe379f8a53a"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:10.302224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] validate_networks() for [('019fe6d8-1b74-4afa-8697-7fe379f8a53a', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:04:10.551618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a3669891-0b7e-4efb-a99b-1e4442f4cd52 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:10.563437 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a3669891-0b7e-4efb-a99b-1e4442f4cd52 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1324 microversion: 2.1 time: 0.578870 Aug 03 02:04:10.586762 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1741/3431] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:09 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1324 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:10.617641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2fe3709d-a6d3-4d3f-a85b-c3c7d599192f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:10.618060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2fe3709d-a6d3-4d3f-a85b-c3c7d599192f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:10.646691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fe3709d-a6d3-4d3f-a85b-c3c7d599192f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:10.647191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fe3709d-a6d3-4d3f-a85b-c3c7d599192f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:10.648010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fe3709d-a6d3-4d3f-a85b-c3c7d599192f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:10.648470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fe3709d-a6d3-4d3f-a85b-c3c7d599192f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:11.443174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2fe3709d-a6d3-4d3f-a85b-c3c7d599192f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:11.452359 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2fe3709d-a6d3-4d3f-a85b-c3c7d599192f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2" status: 200 len: 1365 microversion: 2.1 time: 0.853873 Aug 03 02:04:11.465180 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1742/3432] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:10 2022] GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 => generated 1365 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:11.491670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c14dd795-b12f-473a-8cc9-e87a37af2b6d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:11.492480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c14dd795-b12f-473a-8cc9-e87a37af2b6d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:11.512046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c14dd795-b12f-473a-8cc9-e87a37af2b6d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:11.512674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c14dd795-b12f-473a-8cc9-e87a37af2b6d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:11.513893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c14dd795-b12f-473a-8cc9-e87a37af2b6d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:11.514590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c14dd795-b12f-473a-8cc9-e87a37af2b6d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:11.980433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c14dd795-b12f-473a-8cc9-e87a37af2b6d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:11.989800 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c14dd795-b12f-473a-8cc9-e87a37af2b6d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1502 microversion: 2.1 time: 0.508735 Aug 03 02:04:11.992978 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1743/3433] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:11 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1502 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:11.998821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d09ed7e6-6db9-4858-9316-a1f274b04829 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:11.999805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d09ed7e6-6db9-4858-9316-a1f274b04829 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:12.003016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:04:12.004087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:04:12.004976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:04:12.005600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:04:12.006024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:04:12.017966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d09ed7e6-6db9-4858-9316-a1f274b04829 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:12.018430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d09ed7e6-6db9-4858-9316-a1f274b04829 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:12.019270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d09ed7e6-6db9-4858-9316-a1f274b04829 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:12.019722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d09ed7e6-6db9-4858-9316-a1f274b04829 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:12.035763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:12.036153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:12.037008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:12.037456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:12.085047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Getting quotas for project fb5f76083896407f8fbedf0c61c6f793. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:04:12.101983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Getting quotas for user 2a0159b26db744799487da9445a7346b and project fb5f76083896407f8fbedf0c61c6f793. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:04:12.135777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:04:12.139464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:04:12.212866 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a929ef8e-d974-443e-97fa-9e379321bff0 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.118910 Aug 03 02:04:12.218786 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1691/3434] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:04:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 02:04:12.226092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f873981d-404c-4937-9f59-8e9e251e08a8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:12.227085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f873981d-404c-4937-9f59-8e9e251e08a8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:12.234692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f873981d-404c-4937-9f59-8e9e251e08a8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:12.235497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f873981d-404c-4937-9f59-8e9e251e08a8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:12.236558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f873981d-404c-4937-9f59-8e9e251e08a8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:12.237174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f873981d-404c-4937-9f59-8e9e251e08a8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:13.049960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d09ed7e6-6db9-4858-9316-a1f274b04829 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:13.067581 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d09ed7e6-6db9-4858-9316-a1f274b04829 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 200 len: 1504 microversion: 2.1 time: 1.072952 Aug 03 02:04:13.068580 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1744/3435] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:11 2022] GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 1504 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:13.079919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-61f5e9fc-852a-4f0e-9cd0-16b153f9bb25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:13.080750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-61f5e9fc-852a-4f0e-9cd0-16b153f9bb25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:13.108764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61f5e9fc-852a-4f0e-9cd0-16b153f9bb25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:13.110269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f873981d-404c-4937-9f59-8e9e251e08a8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:13.112777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61f5e9fc-852a-4f0e-9cd0-16b153f9bb25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:13.114400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61f5e9fc-852a-4f0e-9cd0-16b153f9bb25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:13.114868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61f5e9fc-852a-4f0e-9cd0-16b153f9bb25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:13.122303 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f873981d-404c-4937-9f59-8e9e251e08a8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1324 microversion: 2.1 time: 0.901666 Aug 03 02:04:13.127912 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1692/3436] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:12 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1324 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:13.153479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d182a7a-7913-48b9-a2b4-049bd148549a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:13.155132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8d182a7a-7913-48b9-a2b4-049bd148549a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:13.159291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-61f5e9fc-852a-4f0e-9cd0-16b153f9bb25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lazy-loading 'flavor' on Instance uuid 8fea7f2e-eb34-40c8-8171-11e0a65bae4a {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:04:13.181469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d182a7a-7913-48b9-a2b4-049bd148549a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:13.181469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d182a7a-7913-48b9-a2b4-049bd148549a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:13.182554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d182a7a-7913-48b9-a2b4-049bd148549a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:13.184450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d182a7a-7913-48b9-a2b4-049bd148549a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:13.335240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:13.434693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8d182a7a-7913-48b9-a2b4-049bd148549a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:13.445874 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8d182a7a-7913-48b9-a2b4-049bd148549a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded" status: 200 len: 1228 microversion: 2.1 time: 0.316534 Aug 03 02:04:13.459223 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1693/3437] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:13 2022] GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded => generated 1228 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:13.472087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-adef05eb-0b42-4ab9-a35d-1b90bd535639 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:13.474398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-adef05eb-0b42-4ab9-a35d-1b90bd535639 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:13.507427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adef05eb-0b42-4ab9-a35d-1b90bd535639 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:13.509656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adef05eb-0b42-4ab9-a35d-1b90bd535639 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:13.515088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adef05eb-0b42-4ab9-a35d-1b90bd535639 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:13.515803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adef05eb-0b42-4ab9-a35d-1b90bd535639 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:13.606246 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-61f5e9fc-852a-4f0e-9cd0-16b153f9bb25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "POST /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a/action" status: 202 len: 0 microversion: 2.1 time: 0.531920 Aug 03 02:04:13.607301 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1745/3438] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:04:13 2022] POST /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:04:13.616099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-83527054-156a-46d6-8e0c-dd06e37e5e72 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:13.619463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-83527054-156a-46d6-8e0c-dd06e37e5e72 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:13.638168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83527054-156a-46d6-8e0c-dd06e37e5e72 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:13.639052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83527054-156a-46d6-8e0c-dd06e37e5e72 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:13.640119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83527054-156a-46d6-8e0c-dd06e37e5e72 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:13.640794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83527054-156a-46d6-8e0c-dd06e37e5e72 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:13.902726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-adef05eb-0b42-4ab9-a35d-1b90bd535639 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:13.912269 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-adef05eb-0b42-4ab9-a35d-1b90bd535639 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2" status: 200 len: 1365 microversion: 2.1 time: 0.458755 Aug 03 02:04:13.912864 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1694/3439] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:13 2022] GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 => generated 1365 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:13.918429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-4634318d-1419-4f67-8214-b78b63e1d5c7 req-71f36253-4114-49af-85aa-f172e69828df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccde6102-3858-4f7d-aa96-9d1a2527f9a2", "tag": "e16784fb-69ab-402c-8e6c-d8e45c1468aa"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:13.973445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4634318d-1419-4f67-8214-b78b63e1d5c7 req-71f36253-4114-49af-85aa-f172e69828df service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:13.975860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4634318d-1419-4f67-8214-b78b63e1d5c7 req-71f36253-4114-49af-85aa-f172e69828df service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:14.007887 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-4634318d-1419-4f67-8214-b78b63e1d5c7 req-71f36253-4114-49af-85aa-f172e69828df service nova] Creating event network-changed:e16784fb-69ab-402c-8e6c-d8e45c1468aa for instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 on n-h2-826529-8 Aug 03 02:04:14.015316 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-4634318d-1419-4f67-8214-b78b63e1d5c7 req-71f36253-4114-49af-85aa-f172e69828df service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101118 Aug 03 02:04:14.017320 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1695/3440] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:14.102128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b9ba943c-9ee1-4a1e-9e2e-6f9ede271218 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:14.106463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b9ba943c-9ee1-4a1e-9e2e-6f9ede271218 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:14.116519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b9ba943c-9ee1-4a1e-9e2e-6f9ede271218 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:14.118158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b9ba943c-9ee1-4a1e-9e2e-6f9ede271218 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:14.119285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b9ba943c-9ee1-4a1e-9e2e-6f9ede271218 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:14.122715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b9ba943c-9ee1-4a1e-9e2e-6f9ede271218 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:14.272243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b9ba943c-9ee1-4a1e-9e2e-6f9ede271218 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:14.293900 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b9ba943c-9ee1-4a1e-9e2e-6f9ede271218 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 200 len: 1462 microversion: 2.1 time: 0.207675 Aug 03 02:04:14.295206 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1696/3441] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:14 2022] GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 1462 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:04:14.303655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-83527054-156a-46d6-8e0c-dd06e37e5e72 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:14.314604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-71844221-3f7c-41c9-8cd0-a1c8ff404324 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:14.315256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-71844221-3f7c-41c9-8cd0-a1c8ff404324 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:14.335921 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-83527054-156a-46d6-8e0c-dd06e37e5e72 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1508 microversion: 2.1 time: 0.720824 Aug 03 02:04:14.337059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71844221-3f7c-41c9-8cd0-a1c8ff404324 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:14.339302 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1746/3442] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:13 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1508 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:14.360739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71844221-3f7c-41c9-8cd0-a1c8ff404324 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:14.362508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71844221-3f7c-41c9-8cd0-a1c8ff404324 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:14.363713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71844221-3f7c-41c9-8cd0-a1c8ff404324 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:14.476470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f40f9152-5fe0-4b4d-9ba0-c9bd8644043c tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:14.477194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f40f9152-5fe0-4b4d-9ba0-c9bd8644043c tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:14.493534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f40f9152-5fe0-4b4d-9ba0-c9bd8644043c tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:14.497096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f40f9152-5fe0-4b4d-9ba0-c9bd8644043c tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:14.501769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f40f9152-5fe0-4b4d-9ba0-c9bd8644043c tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:14.502644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f40f9152-5fe0-4b4d-9ba0-c9bd8644043c tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:14.756062 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f40f9152-5fe0-4b4d-9ba0-c9bd8644043c tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:14.783094 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f40f9152-5fe0-4b4d-9ba0-c9bd8644043c tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded" status: 200 len: 1282 microversion: 2.1 time: 0.310873 Aug 03 02:04:14.788559 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1747/3443] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:14 2022] GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded => generated 1282 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:04:14.937195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5adfe9f7-72eb-4cc3-b6f4-072e4b6fa1c4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:14.938554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5adfe9f7-72eb-4cc3-b6f4-072e4b6fa1c4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:14.959608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5adfe9f7-72eb-4cc3-b6f4-072e4b6fa1c4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:14.966222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5adfe9f7-72eb-4cc3-b6f4-072e4b6fa1c4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:14.967644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5adfe9f7-72eb-4cc3-b6f4-072e4b6fa1c4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:14.973059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5adfe9f7-72eb-4cc3-b6f4-072e4b6fa1c4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:15.186139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-71844221-3f7c-41c9-8cd0-a1c8ff404324 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:15.195031 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-71844221-3f7c-41c9-8cd0-a1c8ff404324 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1324 microversion: 2.1 time: 0.897837 Aug 03 02:04:15.195633 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1697/3444] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:14 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1324 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:15.316985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6ad70ce5-2153-480c-96a9-8281e276d64c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:15.317613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6ad70ce5-2153-480c-96a9-8281e276d64c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: 873e4f59-41f4-4cf7-8735-a43a798609f2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:15.323876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5adfe9f7-72eb-4cc3-b6f4-072e4b6fa1c4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:15.330942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ad70ce5-2153-480c-96a9-8281e276d64c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:15.331643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ad70ce5-2153-480c-96a9-8281e276d64c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:15.337210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ad70ce5-2153-480c-96a9-8281e276d64c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:15.337931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ad70ce5-2153-480c-96a9-8281e276d64c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:15.340307 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5adfe9f7-72eb-4cc3-b6f4-072e4b6fa1c4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2" status: 200 len: 1365 microversion: 2.1 time: 0.409454 Aug 03 02:04:15.342678 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1748/3445] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:14 2022] GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 => generated 1365 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:15.364041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d4994b6d-7f9d-4cba-8bd8-90e0774d9afa tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:15.365070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d4994b6d-7f9d-4cba-8bd8-90e0774d9afa tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:15.377317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4994b6d-7f9d-4cba-8bd8-90e0774d9afa tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:15.379828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4994b6d-7f9d-4cba-8bd8-90e0774d9afa tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:15.382471 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-6ad70ce5-2153-480c-96a9-8281e276d64c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] HTTP exception thrown: Instance 873e4f59-41f4-4cf7-8735-a43a798609f2 could not be found. Aug 03 02:04:15.383774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4994b6d-7f9d-4cba-8bd8-90e0774d9afa tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:15.384414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4994b6d-7f9d-4cba-8bd8-90e0774d9afa tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6ad70ce5-2153-480c-96a9-8281e276d64c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Request method failure captured: Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 HTTP/1.1 Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dd9utOUSIjcp00xfr6xmowCWQr03r-_ZX4bAUvtihO8b_tfad9A4hA7BM28DxBkH3sXuDRSMKdt0ZwdX7qbN5E9bpt_dPXA1cHbyCq_aYMdEBJJBYqbj6b6hfk9Y3EWpDNZPEIcrXiGIU1mRM8qCbTE70W3nw6LwYSFluzd5dkSDmk Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 82b6fa5e476644de89acfd1d2bbbff62 Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-VolumesActionsTest-855881437 Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_82b6fa5e476644de89acfd1d2bbbff62", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/82b6fa5e476644de89acfd1d2bbbff62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/82b6fa5e476644de89acfd1d2bbbff62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/82b6fa5e476644de89acfd1d2bbbff62"}]}] Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-VolumesActionsTest-855881437 Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 82b6fa5e476644de89acfd1d2bbbff62 Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-VolumesActionsTest-855881437 Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-VolumesActionsTest-855881437-project Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: a9853c1a55054968a931638100af4360 Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-VolumesActionsTest-855881437-project Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 873e4f59-41f4-4cf7-8735-a43a798609f2 could not be found. Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '873e4f59-41f4-4cf7-8735-a43a798609f2'} Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 873e4f59-41f4-4cf7-8735-a43a798609f2 could not be found. Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 873e4f59-41f4-4cf7-8735-a43a798609f2 could not be found. Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:15.384643 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:15.390030 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:15.390030 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:15.390030 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:15.390030 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:04:15.390030 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:04:15.390030 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 873e4f59-41f4-4cf7-8735-a43a798609f2 could not be found. Aug 03 02:04:15.390030 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:15.390030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6ad70ce5-2153-480c-96a9-8281e276d64c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Returning 404 to user: Instance 873e4f59-41f4-4cf7-8735-a43a798609f2 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:04:15.390030 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6ad70ce5-2153-480c-96a9-8281e276d64c tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2" status: 404 len: 111 microversion: 2.1 time: 0.074817 Aug 03 02:04:15.390030 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1698/3446] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:15 2022] GET /compute/v2.1/servers/873e4f59-41f4-4cf7-8735-a43a798609f2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:04:15.644505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-328658941", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "5ed366b1-2d1f-42b2-860d-cb56aa2e73af"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:15.697184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d4994b6d-7f9d-4cba-8bd8-90e0774d9afa tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:15.719719 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d4994b6d-7f9d-4cba-8bd8-90e0774d9afa tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1508 microversion: 2.1 time: 0.358017 Aug 03 02:04:15.731626 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1749/3447] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:15 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1508 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:15.797075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] validate_networks() for [('5ed366b1-2d1f-42b2-860d-cb56aa2e73af', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:04:15.811528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c62d92ef-df84-419d-a65f-4ec639e56055 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:15.812218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c62d92ef-df84-419d-a65f-4ec639e56055 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:15.825959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c62d92ef-df84-419d-a65f-4ec639e56055 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:15.826426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c62d92ef-df84-419d-a65f-4ec639e56055 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:15.828520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c62d92ef-df84-419d-a65f-4ec639e56055 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:15.828978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c62d92ef-df84-419d-a65f-4ec639e56055 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:16.012739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c62d92ef-df84-419d-a65f-4ec639e56055 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:16.025997 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c62d92ef-df84-419d-a65f-4ec639e56055 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded" status: 200 len: 1282 microversion: 2.1 time: 0.219975 Aug 03 02:04:16.030226 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1750/3448] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:15 2022] GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded => generated 1282 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:04:16.053738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-df9a67bb-9d82-46ff-b396-b6d62d9842c8 req-099aa99f-b548-420d-8cff-20f06d2d30a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873e4f59-41f4-4cf7-8735-a43a798609f2", "name": "network-vif-deleted", "tag": "aa98ab8d-cbf8-47e2-9ee3-de6aa6f0391f"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:16.067127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-df9a67bb-9d82-46ff-b396-b6d62d9842c8 req-099aa99f-b548-420d-8cff-20f06d2d30a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:16.067873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-df9a67bb-9d82-46ff-b396-b6d62d9842c8 req-099aa99f-b548-420d-8cff-20f06d2d30a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:16.083991 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-df9a67bb-9d82-46ff-b396-b6d62d9842c8 req-099aa99f-b548-420d-8cff-20f06d2d30a7 service nova] Creating event network-vif-deleted:aa98ab8d-cbf8-47e2-9ee3-de6aa6f0391f for instance 873e4f59-41f4-4cf7-8735-a43a798609f2 on n-h1-826529-8 Aug 03 02:04:16.091979 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-df9a67bb-9d82-46ff-b396-b6d62d9842c8 req-099aa99f-b548-420d-8cff-20f06d2d30a7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043368 Aug 03 02:04:16.093704 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1751/3449] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:04:16.219118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a0a0ed3b-f41a-4f0a-97ba-97e7450c85e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:16.219837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a0a0ed3b-f41a-4f0a-97ba-97e7450c85e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:16.229808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0a0ed3b-f41a-4f0a-97ba-97e7450c85e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:16.230370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0a0ed3b-f41a-4f0a-97ba-97e7450c85e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:16.231188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0a0ed3b-f41a-4f0a-97ba-97e7450c85e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:16.231821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0a0ed3b-f41a-4f0a-97ba-97e7450c85e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:16.663927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a0a0ed3b-f41a-4f0a-97ba-97e7450c85e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:16.685102 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a0a0ed3b-f41a-4f0a-97ba-97e7450c85e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1324 microversion: 2.1 time: 0.470412 Aug 03 02:04:16.703847 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1752/3450] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:16 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1324 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:04:16.709218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c1d86871-be20-41d8-988d-0110d068895f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:16.709855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c1d86871-be20-41d8-988d-0110d068895f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:16.742570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d86871-be20-41d8-988d-0110d068895f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:16.743064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d86871-be20-41d8-988d-0110d068895f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:16.754575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d86871-be20-41d8-988d-0110d068895f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:16.757027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d86871-be20-41d8-988d-0110d068895f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:17.152327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:04:17.153358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:04:17.154032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:04:17.154691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:04:17.155369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:04:17.172285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:17.173821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:17.177892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:17.178804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:17.215629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c1d86871-be20-41d8-988d-0110d068895f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:17.229796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Getting quotas for project 82b6fa5e476644de89acfd1d2bbbff62. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:04:17.230248 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c1d86871-be20-41d8-988d-0110d068895f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2" status: 200 len: 1365 microversion: 2.1 time: 0.524952 Aug 03 02:04:17.231082 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1753/3451] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:16 2022] GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 => generated 1365 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:17.249195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Getting quotas for user a9853c1a55054968a931638100af4360 and project 82b6fa5e476644de89acfd1d2bbbff62. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:04:17.254891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6327d5f8-00e0-4e4a-81e2-c8a79b7c7a61 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:17.255835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6327d5f8-00e0-4e4a-81e2-c8a79b7c7a61 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:17.265426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6327d5f8-00e0-4e4a-81e2-c8a79b7c7a61 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:17.266228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6327d5f8-00e0-4e4a-81e2-c8a79b7c7a61 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:17.267535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6327d5f8-00e0-4e4a-81e2-c8a79b7c7a61 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:17.268796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6327d5f8-00e0-4e4a-81e2-c8a79b7c7a61 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:17.280517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:04:17.291916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:04:17.397271 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-52db95ae-27c9-47fa-a5cc-6d3eab19b1bd tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.757896 Aug 03 02:04:17.406332 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1699/3452] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:04:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 02:04:17.418503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-631843fd-67b6-4c80-9dd9-121a693b7fc9 req-c91e7659-3ec0-408e-aa14-c9e03e7d5a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd09fc6-043e-40e1-9725-6c3ff4ff28bf", "name": "network-vif-plugged", "status": "completed", "tag": "6d5b657d-e7e5-44b1-a6df-9ad2ea5e9e88"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:17.437761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-631843fd-67b6-4c80-9dd9-121a693b7fc9 req-c91e7659-3ec0-408e-aa14-c9e03e7d5a5c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:17.438210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-631843fd-67b6-4c80-9dd9-121a693b7fc9 req-c91e7659-3ec0-408e-aa14-c9e03e7d5a5c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:17.465801 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-631843fd-67b6-4c80-9dd9-121a693b7fc9 req-c91e7659-3ec0-408e-aa14-c9e03e7d5a5c service nova] Creating event network-vif-plugged:6d5b657d-e7e5-44b1-a6df-9ad2ea5e9e88 for instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf on n-h1-826529-8 Aug 03 02:04:17.478166 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-631843fd-67b6-4c80-9dd9-121a693b7fc9 req-c91e7659-3ec0-408e-aa14-c9e03e7d5a5c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070002 Aug 03 02:04:17.479154 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1700/3453] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:17.489080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e0be5c90-660a-4710-8399-d50c942c516f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:17.489886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e0be5c90-660a-4710-8399-d50c942c516f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:17.524478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0be5c90-660a-4710-8399-d50c942c516f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:17.524929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0be5c90-660a-4710-8399-d50c942c516f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:17.526363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0be5c90-660a-4710-8399-d50c942c516f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:17.526803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0be5c90-660a-4710-8399-d50c942c516f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:17.929150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=30 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:18.252688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6327d5f8-00e0-4e4a-81e2-c8a79b7c7a61 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:18.261236 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6327d5f8-00e0-4e4a-81e2-c8a79b7c7a61 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1508 microversion: 2.1 time: 1.012669 Aug 03 02:04:18.262169 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1754/3454] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:17 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1508 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:18.267354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fbe86e6e-1f30-43c3-8a2e-44e28220d3ba tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:18.268138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fbe86e6e-1f30-43c3-8a2e-44e28220d3ba tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:18.280515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e0be5c90-660a-4710-8399-d50c942c516f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:18.287492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbe86e6e-1f30-43c3-8a2e-44e28220d3ba tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:18.287943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbe86e6e-1f30-43c3-8a2e-44e28220d3ba tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:18.289027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbe86e6e-1f30-43c3-8a2e-44e28220d3ba tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:18.290179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbe86e6e-1f30-43c3-8a2e-44e28220d3ba tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:18.295946 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e0be5c90-660a-4710-8399-d50c942c516f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded" status: 200 len: 1324 microversion: 2.1 time: 0.815154 Aug 03 02:04:18.296976 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1701/3455] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:17 2022] GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded => generated 1324 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:18.320511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d2390071-5439-4081-a786-cb772eaf279e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:18.322215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d2390071-5439-4081-a786-cb772eaf279e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:18.335481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2390071-5439-4081-a786-cb772eaf279e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:18.336522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2390071-5439-4081-a786-cb772eaf279e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:18.338041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2390071-5439-4081-a786-cb772eaf279e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:18.339744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2390071-5439-4081-a786-cb772eaf279e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:18.401848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fbe86e6e-1f30-43c3-8a2e-44e28220d3ba tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:18.418033 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fbe86e6e-1f30-43c3-8a2e-44e28220d3ba tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 200 len: 1209 microversion: 2.1 time: 0.154249 Aug 03 02:04:18.431418 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1755/3456] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:18 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 1209 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:18.431418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-48f92870-a362-4d8b-8606-13fb9f1f0043 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:18.431418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-48f92870-a362-4d8b-8606-13fb9f1f0043 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:18.436928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48f92870-a362-4d8b-8606-13fb9f1f0043 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:18.437631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48f92870-a362-4d8b-8606-13fb9f1f0043 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:18.438600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48f92870-a362-4d8b-8606-13fb9f1f0043 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:18.439240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48f92870-a362-4d8b-8606-13fb9f1f0043 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:18.805157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d2390071-5439-4081-a786-cb772eaf279e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:18.822680 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d2390071-5439-4081-a786-cb772eaf279e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1324 microversion: 2.1 time: 0.511332 Aug 03 02:04:18.825187 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1702/3457] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:18 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1324 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:19.015171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-48f92870-a362-4d8b-8606-13fb9f1f0043 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:19.029730 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-48f92870-a362-4d8b-8606-13fb9f1f0043 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2" status: 200 len: 1365 microversion: 2.1 time: 0.609296 Aug 03 02:04:19.031631 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1756/3458] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:18 2022] GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 => generated 1365 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:19.287812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1b772a37-9749-4d84-b124-c1f3f8b025a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:19.288859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1b772a37-9749-4d84-b124-c1f3f8b025a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:19.306507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b772a37-9749-4d84-b124-c1f3f8b025a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:19.307228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b772a37-9749-4d84-b124-c1f3f8b025a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:19.308184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b772a37-9749-4d84-b124-c1f3f8b025a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:19.308627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b772a37-9749-4d84-b124-c1f3f8b025a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:19.324814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9cd9ea58-6334-4f6a-b7c1-74d2e70ed6cd tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:19.326132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9cd9ea58-6334-4f6a-b7c1-74d2e70ed6cd tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:19.357654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cd9ea58-6334-4f6a-b7c1-74d2e70ed6cd tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:19.358116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cd9ea58-6334-4f6a-b7c1-74d2e70ed6cd tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:19.382774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cd9ea58-6334-4f6a-b7c1-74d2e70ed6cd tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:19.383475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cd9ea58-6334-4f6a-b7c1-74d2e70ed6cd tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:19.831590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1b772a37-9749-4d84-b124-c1f3f8b025a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:19.848142 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1b772a37-9749-4d84-b124-c1f3f8b025a4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1508 microversion: 2.1 time: 0.565868 Aug 03 02:04:19.849003 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1703/3459] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:19 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1508 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:19.854744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e1005447-1e3c-423d-9531-b7203c3af35f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:19.859917 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e1005447-1e3c-423d-9531-b7203c3af35f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:19.867517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1005447-1e3c-423d-9531-b7203c3af35f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:19.868237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1005447-1e3c-423d-9531-b7203c3af35f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:19.869835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1005447-1e3c-423d-9531-b7203c3af35f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:19.870576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1005447-1e3c-423d-9531-b7203c3af35f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:19.875748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:20.016202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9cd9ea58-6334-4f6a-b7c1-74d2e70ed6cd tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:20.019890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e1005447-1e3c-423d-9531-b7203c3af35f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:20.036573 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e1005447-1e3c-423d-9531-b7203c3af35f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 200 len: 1271 microversion: 2.1 time: 0.186271 Aug 03 02:04:20.038375 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1704/3460] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:19 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 1271 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:20.040528 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9cd9ea58-6334-4f6a-b7c1-74d2e70ed6cd tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded" status: 200 len: 1324 microversion: 2.1 time: 0.720195 Aug 03 02:04:20.058109 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1757/3461] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:19 2022] GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded => generated 1324 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:04:20.063530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-40c1f190-802b-4b18-adda-50e4ee3910e8 req-6184f252-5c5f-404b-9a99-c5ab98367af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "407c74a8-e6f7-4146-8b2d-842fa10fbded", "tag": "a6e067d4-bea0-49c9-b26b-8af45883186c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:20.071584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6a4f1fae-772f-4393-b394-981012e0d060 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:20.072765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6a4f1fae-772f-4393-b394-981012e0d060 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:20.086860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a4f1fae-772f-4393-b394-981012e0d060 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:20.094267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a4f1fae-772f-4393-b394-981012e0d060 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:20.096456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a4f1fae-772f-4393-b394-981012e0d060 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:20.096648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-40c1f190-802b-4b18-adda-50e4ee3910e8 req-6184f252-5c5f-404b-9a99-c5ab98367af8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:20.097199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a4f1fae-772f-4393-b394-981012e0d060 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:20.097779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-40c1f190-802b-4b18-adda-50e4ee3910e8 req-6184f252-5c5f-404b-9a99-c5ab98367af8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:20.141198 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-40c1f190-802b-4b18-adda-50e4ee3910e8 req-6184f252-5c5f-404b-9a99-c5ab98367af8 service nova] Creating event network-changed:a6e067d4-bea0-49c9-b26b-8af45883186c for instance 407c74a8-e6f7-4146-8b2d-842fa10fbded on n-h1-826529-8 Aug 03 02:04:20.155856 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-40c1f190-802b-4b18-adda-50e4ee3910e8 req-6184f252-5c5f-404b-9a99-c5ab98367af8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115478 Aug 03 02:04:20.161084 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1705/3462] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:20.176330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-05af3717-e2aa-4691-a8df-a9c1545f2f91 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:20.178089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-05af3717-e2aa-4691-a8df-a9c1545f2f91 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:20.202790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05af3717-e2aa-4691-a8df-a9c1545f2f91 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:20.208248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05af3717-e2aa-4691-a8df-a9c1545f2f91 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:20.211180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05af3717-e2aa-4691-a8df-a9c1545f2f91 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:20.212207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05af3717-e2aa-4691-a8df-a9c1545f2f91 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:21.060211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-05af3717-e2aa-4691-a8df-a9c1545f2f91 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:21.064928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6a4f1fae-772f-4393-b394-981012e0d060 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:21.079329 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6a4f1fae-772f-4393-b394-981012e0d060 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1521 microversion: 2.1 time: 1.019593 Aug 03 02:04:21.082798 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-05af3717-e2aa-4691-a8df-a9c1545f2f91 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2" status: 200 len: 1365 microversion: 2.1 time: 0.919862 Aug 03 02:04:21.083336 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1758/3463] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:20 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1521 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:21.083594 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1706/3464] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:20 2022] GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 => generated 1365 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:21.092192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-85e016d8-cda4-4a50-be0c-94556af47b8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:21.093420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-85e016d8-cda4-4a50-be0c-94556af47b8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:21.104675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-935dc686-2c03-42df-afe5-9bdb9f236a19 req-737db590-cdb2-45cc-a8a7-af6c75a4eff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccde6102-3858-4f7d-aa96-9d1a2527f9a2", "name": "network-vif-plugged", "status": "completed", "tag": "e16784fb-69ab-402c-8e6c-d8e45c1468aa"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:21.122493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85e016d8-cda4-4a50-be0c-94556af47b8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:21.127114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85e016d8-cda4-4a50-be0c-94556af47b8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:21.132695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85e016d8-cda4-4a50-be0c-94556af47b8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:21.133765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85e016d8-cda4-4a50-be0c-94556af47b8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:21.138516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-935dc686-2c03-42df-afe5-9bdb9f236a19 req-737db590-cdb2-45cc-a8a7-af6c75a4eff2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:21.144137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-935dc686-2c03-42df-afe5-9bdb9f236a19 req-737db590-cdb2-45cc-a8a7-af6c75a4eff2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:21.162821 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-935dc686-2c03-42df-afe5-9bdb9f236a19 req-737db590-cdb2-45cc-a8a7-af6c75a4eff2 service nova] Creating event network-vif-plugged:e16784fb-69ab-402c-8e6c-d8e45c1468aa for instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 on n-h2-826529-8 Aug 03 02:04:21.170130 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-935dc686-2c03-42df-afe5-9bdb9f236a19 req-737db590-cdb2-45cc-a8a7-af6c75a4eff2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070722 Aug 03 02:04:21.174602 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1759/3465] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:21.183628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d20aecca-4ce7-4f33-b61b-90ec66497f8a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:21.184356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d20aecca-4ce7-4f33-b61b-90ec66497f8a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:21.206099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d20aecca-4ce7-4f33-b61b-90ec66497f8a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:21.206877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d20aecca-4ce7-4f33-b61b-90ec66497f8a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:21.207995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d20aecca-4ce7-4f33-b61b-90ec66497f8a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:21.208625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d20aecca-4ce7-4f33-b61b-90ec66497f8a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:21.402969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d20aecca-4ce7-4f33-b61b-90ec66497f8a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:21.411461 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d20aecca-4ce7-4f33-b61b-90ec66497f8a tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 200 len: 1271 microversion: 2.1 time: 0.232704 Aug 03 02:04:21.412337 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1760/3466] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:21 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:21.418361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5392a49-416d-4fe8-aa16-f0bc73977d9b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:21.419652 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5392a49-416d-4fe8-aa16-f0bc73977d9b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:21.430635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5392a49-416d-4fe8-aa16-f0bc73977d9b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:21.431415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5392a49-416d-4fe8-aa16-f0bc73977d9b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:21.432483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5392a49-416d-4fe8-aa16-f0bc73977d9b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:21.443820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5392a49-416d-4fe8-aa16-f0bc73977d9b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:21.733708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-85e016d8-cda4-4a50-be0c-94556af47b8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:21.758502 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-85e016d8-cda4-4a50-be0c-94556af47b8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1508 microversion: 2.1 time: 0.665357 Aug 03 02:04:21.760446 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1707/3467] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:21 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1508 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:21.769093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c389a76d-63ae-4e8d-8e79-a68a0b304a65 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:21.770055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c389a76d-63ae-4e8d-8e79-a68a0b304a65 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:21.781606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c389a76d-63ae-4e8d-8e79-a68a0b304a65 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:21.782615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c389a76d-63ae-4e8d-8e79-a68a0b304a65 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:21.783707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c389a76d-63ae-4e8d-8e79-a68a0b304a65 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:21.784382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c389a76d-63ae-4e8d-8e79-a68a0b304a65 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:21.856846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c5392a49-416d-4fe8-aa16-f0bc73977d9b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:21.876806 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5392a49-416d-4fe8-aa16-f0bc73977d9b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded" status: 200 len: 1324 microversion: 2.1 time: 0.463151 Aug 03 02:04:21.877668 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1761/3468] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:21 2022] GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded => generated 1324 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:22.105303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b493b8fa-ff9e-4fba-bbb0-d63b616ecb5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:22.106024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b493b8fa-ff9e-4fba-bbb0-d63b616ecb5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:22.118235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b493b8fa-ff9e-4fba-bbb0-d63b616ecb5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:22.118721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b493b8fa-ff9e-4fba-bbb0-d63b616ecb5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:22.131066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b493b8fa-ff9e-4fba-bbb0-d63b616ecb5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:22.132184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b493b8fa-ff9e-4fba-bbb0-d63b616ecb5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:22.132664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c389a76d-63ae-4e8d-8e79-a68a0b304a65 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:22.152128 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c389a76d-63ae-4e8d-8e79-a68a0b304a65 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1521 microversion: 2.1 time: 0.390275 Aug 03 02:04:22.167556 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1708/3469] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:21 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:22.192028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-077433d9-49c4-483d-946d-a58b0201a0e3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-133418502", "metadata": {"": ""}}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-077433d9-49c4-483d-946d-a58b0201a0e3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Request method failure captured: Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf/action HTTP/1.1 Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 106 Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6deKj_4ni6BiP5hu0KReUjCwN-jXFzDltBsZkdmHfZJw3iCK1NJe4cC4HqyDHfr9U2Xj9tTYrH-rL2Y-nfbcV2kQPduI8yks5ljNEDlazy86SExfxbA5OA6iqfJroq-67nWDTGmlBdStRJ_EHNLs6bYrB1tkODLPTKFNyABk3rb39eQ Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_78ae2f8c7bef4a959cdfa8c61360e7e5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}] Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: e2c17b2e7e9f4c878826497386ee3ba7 Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-133418502", "metadata": {"": ""}}} Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '4fd09fc6-043e-40e1-9725-6c3ff4ff28bf', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-133418502', 'metadata': {'': ''}}}} Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'': ''} Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:04:22.211920 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:04:22.218010 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:22.220838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-077433d9-49c4-483d-946d-a58b0201a0e3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:04:22.223740 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-077433d9-49c4-483d-946d-a58b0201a0e3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "POST /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf/action" status: 400 len: 170 microversion: 2.1 time: 0.044940 Aug 03 02:04:22.227704 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1709/3470] 10.222.0.67 () {60 vars in 1279 bytes} [Wed Aug 3 02:04:22 2022] POST /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf/action => generated 170 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:04:22.238770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-30ecff87-21bf-4ff9-9cde-88a8aa438b9b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:22.239689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-30ecff87-21bf-4ff9-9cde-88a8aa438b9b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:22.284350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30ecff87-21bf-4ff9-9cde-88a8aa438b9b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:22.285061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30ecff87-21bf-4ff9-9cde-88a8aa438b9b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:22.287534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30ecff87-21bf-4ff9-9cde-88a8aa438b9b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:22.290541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30ecff87-21bf-4ff9-9cde-88a8aa438b9b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:22.569193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-30ecff87-21bf-4ff9-9cde-88a8aa438b9b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:22.580053 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-30ecff87-21bf-4ff9-9cde-88a8aa438b9b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1521 microversion: 2.1 time: 0.348736 Aug 03 02:04:22.595545 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1710/3471] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:22 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:22.600549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b493b8fa-ff9e-4fba-bbb0-d63b616ecb5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:22.607161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-614f3252-8f41-42ce-aeae-44154208e09f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:22.608642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-614f3252-8f41-42ce-aeae-44154208e09f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:22.614986 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b493b8fa-ff9e-4fba-bbb0-d63b616ecb5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2" status: 200 len: 1365 microversion: 2.1 time: 0.514130 Aug 03 02:04:22.616543 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1762/3472] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:22 2022] GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 => generated 1365 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:04:22.616739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-614f3252-8f41-42ce-aeae-44154208e09f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:22.617384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-614f3252-8f41-42ce-aeae-44154208e09f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:22.618358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-614f3252-8f41-42ce-aeae-44154208e09f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:22.619580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-614f3252-8f41-42ce-aeae-44154208e09f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:22.623520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-839e6f14-2062-444e-8e9f-640f47421766 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:22.626633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-839e6f14-2062-444e-8e9f-640f47421766 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:22.644487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-839e6f14-2062-444e-8e9f-640f47421766 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:22.645104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-839e6f14-2062-444e-8e9f-640f47421766 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:22.646376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-839e6f14-2062-444e-8e9f-640f47421766 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:22.647525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-839e6f14-2062-444e-8e9f-640f47421766 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:22.656243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:23.449313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-839e6f14-2062-444e-8e9f-640f47421766 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:23.451181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-614f3252-8f41-42ce-aeae-44154208e09f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:23.460891 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-614f3252-8f41-42ce-aeae-44154208e09f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 200 len: 1313 microversion: 2.1 time: 0.863787 Aug 03 02:04:23.461242 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-839e6f14-2062-444e-8e9f-640f47421766 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1521 microversion: 2.1 time: 0.843331 Aug 03 02:04:23.463152 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1711/3473] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:22 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 1313 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:23.469052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0e49ecba-0ff2-4847-a5e3-8cc796ca1645 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:23.471643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0e49ecba-0ff2-4847-a5e3-8cc796ca1645 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:23.481106 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1763/3474] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:22 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1521 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:23.489128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0e49ecba-0ff2-4847-a5e3-8cc796ca1645 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:23.489128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0e49ecba-0ff2-4847-a5e3-8cc796ca1645 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:23.489128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0e49ecba-0ff2-4847-a5e3-8cc796ca1645 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:23.493404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0e49ecba-0ff2-4847-a5e3-8cc796ca1645 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:23.530618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-02918315-07eb-4e2d-aa7d-1200a237e216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:23.532784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-02918315-07eb-4e2d-aa7d-1200a237e216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:23.560303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02918315-07eb-4e2d-aa7d-1200a237e216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:23.561027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02918315-07eb-4e2d-aa7d-1200a237e216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:23.562424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02918315-07eb-4e2d-aa7d-1200a237e216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:23.563252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02918315-07eb-4e2d-aa7d-1200a237e216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:23.903437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0e49ecba-0ff2-4847-a5e3-8cc796ca1645 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:23.912123 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0e49ecba-0ff2-4847-a5e3-8cc796ca1645 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1508 microversion: 2.1 time: 0.446422 Aug 03 02:04:23.912921 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1712/3475] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:23 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1508 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:23.918321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dfafd907-55f2-4f01-a69b-d4b64ec41b0c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-538261911", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dfafd907-55f2-4f01-a69b-d4b64ec41b0c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Request method failure captured: Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf/action HTTP/1.1 Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 618 Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6deKj_4ni6BiP5hu0KReUjCwN-jXFzDltBsZkdmHfZJw3iCK1NJe4cC4HqyDHfr9U2Xj9tTYrH-rL2Y-nfbcV2kQPduI8yks5ljNEDlazy86SExfxbA5OA6iqfJroq-67nWDTGmlBdStRJ_EHNLs6bYrB1tkODLPTKFNyABk3rb39eQ Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_78ae2f8c7bef4a959cdfa8c61360e7e5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}] Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: e2c17b2e7e9f4c878826497386ee3ba7 Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-538261911", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '4fd09fc6-043e-40e1-9725-6c3ff4ff28bf', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-538261911', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:04:23.922856 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:04:23.926070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:23.930858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dfafd907-55f2-4f01-a69b-d4b64ec41b0c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:04:23.933032 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dfafd907-55f2-4f01-a69b-d4b64ec41b0c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "POST /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf/action" status: 400 len: 938 microversion: 2.1 time: 0.018612 Aug 03 02:04:23.934800 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1713/3476] 10.222.0.67 () {60 vars in 1279 bytes} [Wed Aug 3 02:04:23 2022] POST /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf/action => generated 938 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:04:23.940388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-37239fce-b8de-4867-a550-b50206e48a84 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:23.942033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-37239fce-b8de-4867-a550-b50206e48a84 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:23.950649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37239fce-b8de-4867-a550-b50206e48a84 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:23.951547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37239fce-b8de-4867-a550-b50206e48a84 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:23.952623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37239fce-b8de-4867-a550-b50206e48a84 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:23.953295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37239fce-b8de-4867-a550-b50206e48a84 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:24.139676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-02918315-07eb-4e2d-aa7d-1200a237e216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:24.153752 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-02918315-07eb-4e2d-aa7d-1200a237e216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded" status: 200 len: 1324 microversion: 2.1 time: 0.662651 Aug 03 02:04:24.155493 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1764/3477] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:23 2022] GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded => generated 1324 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:24.162299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0423c2ff-8cd6-4a04-bf3b-03092501fd49 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:24.163987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0423c2ff-8cd6-4a04-bf3b-03092501fd49 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:24.172697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0423c2ff-8cd6-4a04-bf3b-03092501fd49 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:24.173460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0423c2ff-8cd6-4a04-bf3b-03092501fd49 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:24.175302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0423c2ff-8cd6-4a04-bf3b-03092501fd49 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:24.175941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0423c2ff-8cd6-4a04-bf3b-03092501fd49 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:24.533544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-37239fce-b8de-4867-a550-b50206e48a84 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:24.540867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0423c2ff-8cd6-4a04-bf3b-03092501fd49 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:24.545980 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-37239fce-b8de-4867-a550-b50206e48a84 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2" status: 200 len: 1555 microversion: 2.1 time: 0.609482 Aug 03 02:04:24.547195 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1714/3478] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:23 2022] GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 => generated 1555 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:24.556232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-90810d61-5bda-4802-9c1c-919656d03c2e req-50f127e1-67bc-4e72-9c58-bbd3e330be28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb74278c-2659-41c6-a903-12fc69cb18ab", "tag": "9fb9ed87-7eda-4b07-a3ff-cd3a8a92b357"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:24.570546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-90810d61-5bda-4802-9c1c-919656d03c2e req-50f127e1-67bc-4e72-9c58-bbd3e330be28 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:24.571335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-90810d61-5bda-4802-9c1c-919656d03c2e req-50f127e1-67bc-4e72-9c58-bbd3e330be28 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:24.573810 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0423c2ff-8cd6-4a04-bf3b-03092501fd49 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1521 microversion: 2.1 time: 0.416022 Aug 03 02:04:24.574441 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1765/3479] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:24 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:24.587314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a4a875ea-709f-47a1-8f34-7a591f2c935d tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:24.591518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a4a875ea-709f-47a1-8f34-7a591f2c935d tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:24.605059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4a875ea-709f-47a1-8f34-7a591f2c935d tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:24.605441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4a875ea-709f-47a1-8f34-7a591f2c935d tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:24.608351 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-90810d61-5bda-4802-9c1c-919656d03c2e req-50f127e1-67bc-4e72-9c58-bbd3e330be28 service nova] Creating event network-changed:9fb9ed87-7eda-4b07-a3ff-cd3a8a92b357 for instance fb74278c-2659-41c6-a903-12fc69cb18ab on n-h1-826529-8 Aug 03 02:04:24.613318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4a875ea-709f-47a1-8f34-7a591f2c935d tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:24.613962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4a875ea-709f-47a1-8f34-7a591f2c935d tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:24.615244 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-90810d61-5bda-4802-9c1c-919656d03c2e req-50f127e1-67bc-4e72-9c58-bbd3e330be28 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066224 Aug 03 02:04:24.616096 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1715/3480] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:24.632832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dac2f404-9b43-4006-b03b-2aa691ef1f1b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:24.660281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dac2f404-9b43-4006-b03b-2aa691ef1f1b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:24.680747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dac2f404-9b43-4006-b03b-2aa691ef1f1b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:24.681201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dac2f404-9b43-4006-b03b-2aa691ef1f1b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:24.683250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dac2f404-9b43-4006-b03b-2aa691ef1f1b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:24.683462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dac2f404-9b43-4006-b03b-2aa691ef1f1b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:24.969559 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dac2f404-9b43-4006-b03b-2aa691ef1f1b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.350498 Aug 03 02:04:24.969900 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1716/3481] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:04:24 2022] GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2/os-interface => generated 285 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:24.979430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3962d197-d4f4-41f6-8c9f-fd79f71ee7cb tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:24.979430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3962d197-d4f4-41f6-8c9f-fd79f71ee7cb tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:25.023652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3962d197-d4f4-41f6-8c9f-fd79f71ee7cb tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:25.028544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3962d197-d4f4-41f6-8c9f-fd79f71ee7cb tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:25.033325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3962d197-d4f4-41f6-8c9f-fd79f71ee7cb tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:25.034605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3962d197-d4f4-41f6-8c9f-fd79f71ee7cb tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:25.185532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a4a875ea-709f-47a1-8f34-7a591f2c935d tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:25.232655 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a4a875ea-709f-47a1-8f34-7a591f2c935d tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 200 len: 1313 microversion: 2.1 time: 0.657048 Aug 03 02:04:25.233285 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1766/3482] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:24 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:25.238329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e11a493-31c2-4817-9306-3b841c70774f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:25.252078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3e11a493-31c2-4817-9306-3b841c70774f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:25.258884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e11a493-31c2-4817-9306-3b841c70774f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:25.259791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e11a493-31c2-4817-9306-3b841c70774f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:25.261995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e11a493-31c2-4817-9306-3b841c70774f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:25.262668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e11a493-31c2-4817-9306-3b841c70774f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:25.700727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3962d197-d4f4-41f6-8c9f-fd79f71ee7cb tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:25.712404 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3962d197-d4f4-41f6-8c9f-fd79f71ee7cb tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1521 microversion: 2.1 time: 0.740814 Aug 03 02:04:25.734097 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1717/3483] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:24 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1521 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:25.743090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d621a4fe-68ea-4c5f-8627-77acdce630c5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:25.747818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d621a4fe-68ea-4c5f-8627-77acdce630c5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:25.757445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3e11a493-31c2-4817-9306-3b841c70774f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:25.758004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d621a4fe-68ea-4c5f-8627-77acdce630c5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:25.758454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d621a4fe-68ea-4c5f-8627-77acdce630c5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:25.759373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d621a4fe-68ea-4c5f-8627-77acdce630c5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:25.759863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d621a4fe-68ea-4c5f-8627-77acdce630c5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:25.766527 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e11a493-31c2-4817-9306-3b841c70774f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1508 microversion: 2.1 time: 0.531757 Aug 03 02:04:25.766965 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1767/3484] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:25 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1508 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:25.786329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-29175a7a-fb9e-4179-b266-8e436cd5a3ba tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-29175a7a-fb9e-4179-b266-8e436cd5a3ba tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Request method failure captured: Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf/action HTTP/1.1 Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 285 Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6deKj_4ni6BiP5hu0KReUjCwN-jXFzDltBsZkdmHfZJw3iCK1NJe4cC4HqyDHfr9U2Xj9tTYrH-rL2Y-nfbcV2kQPduI8yks5ljNEDlazy86SExfxbA5OA6iqfJroq-67nWDTGmlBdStRJ_EHNLs6bYrB1tkODLPTKFNyABk3rb39eQ Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_78ae2f8c7bef4a959cdfa8c61360e7e5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}] Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e2c17b2e7e9f4c878826497386ee3ba7 Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '4fd09fc6-043e-40e1-9725-6c3ff4ff28bf', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:25.797259 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:25.801315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-29175a7a-fb9e-4179-b266-8e436cd5a3ba tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:04:25.807846 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-29175a7a-fb9e-4179-b266-8e436cd5a3ba tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "POST /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf/action" status: 400 len: 619 microversion: 2.1 time: 0.031138 Aug 03 02:04:25.809533 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1768/3485] 10.222.0.67 () {60 vars in 1279 bytes} [Wed Aug 3 02:04:25 2022] POST /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf/action => generated 619 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:04:25.833011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a57c92d0-b77e-4c41-83bd-a7164591ad4a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:25.835604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a57c92d0-b77e-4c41-83bd-a7164591ad4a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:25.848807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a57c92d0-b77e-4c41-83bd-a7164591ad4a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:25.849640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a57c92d0-b77e-4c41-83bd-a7164591ad4a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:25.850696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a57c92d0-b77e-4c41-83bd-a7164591ad4a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:25.851427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a57c92d0-b77e-4c41-83bd-a7164591ad4a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:26.342861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d621a4fe-68ea-4c5f-8627-77acdce630c5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:26.358346 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d621a4fe-68ea-4c5f-8627-77acdce630c5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded" status: 200 len: 1324 microversion: 2.1 time: 0.622747 Aug 03 02:04:26.359112 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1718/3486] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:25 2022] GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded => generated 1324 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:26.366284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5f11a532-ba6b-4911-b8e7-71cf9a42e788 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:26.372715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5f11a532-ba6b-4911-b8e7-71cf9a42e788 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:26.394163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f11a532-ba6b-4911-b8e7-71cf9a42e788 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:26.395787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f11a532-ba6b-4911-b8e7-71cf9a42e788 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:26.398190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f11a532-ba6b-4911-b8e7-71cf9a42e788 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:26.399173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f11a532-ba6b-4911-b8e7-71cf9a42e788 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:26.425014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a57c92d0-b77e-4c41-83bd-a7164591ad4a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:26.444327 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a57c92d0-b77e-4c41-83bd-a7164591ad4a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1521 microversion: 2.1 time: 0.628974 Aug 03 02:04:26.445110 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1769/3487] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:25 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1521 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:26.476826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b4538c38-0d7f-43a6-9261-94ce7fa1d074 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:26.477753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b4538c38-0d7f-43a6-9261-94ce7fa1d074 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:26.486711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4538c38-0d7f-43a6-9261-94ce7fa1d074 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:26.487473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4538c38-0d7f-43a6-9261-94ce7fa1d074 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:26.490169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4538c38-0d7f-43a6-9261-94ce7fa1d074 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:26.492683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4538c38-0d7f-43a6-9261-94ce7fa1d074 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:27.204180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:27.266832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=18 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:27.455755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5f11a532-ba6b-4911-b8e7-71cf9a42e788 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:27.464234 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5f11a532-ba6b-4911-b8e7-71cf9a42e788 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 200 len: 1313 microversion: 2.1 time: 1.103569 Aug 03 02:04:27.473533 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1719/3488] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:26 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 1313 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:27.485344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9a800840-79d8-406a-a9ad-a735ab935bb1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:27.486380 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9a800840-79d8-406a-a9ad-a735ab935bb1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:27.506777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a800840-79d8-406a-a9ad-a735ab935bb1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:27.507734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a800840-79d8-406a-a9ad-a735ab935bb1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:27.508815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a800840-79d8-406a-a9ad-a735ab935bb1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:27.519279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a800840-79d8-406a-a9ad-a735ab935bb1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:27.532084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b4538c38-0d7f-43a6-9261-94ce7fa1d074 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:27.542563 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b4538c38-0d7f-43a6-9261-94ce7fa1d074 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1521 microversion: 2.1 time: 1.069713 Aug 03 02:04:27.543199 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1770/3489] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:26 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1521 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:04:27.561873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a8f30387-4085-4c6f-82cd-3fceeaea6a9b req-d61370d2-a04c-4a89-91d3-b6d6ceae0731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407c74a8-e6f7-4146-8b2d-842fa10fbded", "name": "network-vif-plugged", "status": "completed", "tag": "a6e067d4-bea0-49c9-b26b-8af45883186c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:27.593968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a8f30387-4085-4c6f-82cd-3fceeaea6a9b req-d61370d2-a04c-4a89-91d3-b6d6ceae0731 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:27.599531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a8f30387-4085-4c6f-82cd-3fceeaea6a9b req-d61370d2-a04c-4a89-91d3-b6d6ceae0731 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:27.619618 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a8f30387-4085-4c6f-82cd-3fceeaea6a9b req-d61370d2-a04c-4a89-91d3-b6d6ceae0731 service nova] Creating event network-vif-plugged:a6e067d4-bea0-49c9-b26b-8af45883186c for instance 407c74a8-e6f7-4146-8b2d-842fa10fbded on n-h1-826529-8 Aug 03 02:04:27.632372 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a8f30387-4085-4c6f-82cd-3fceeaea6a9b req-d61370d2-a04c-4a89-91d3-b6d6ceae0731 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080035 Aug 03 02:04:27.636219 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1771/3490] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:27.644110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-555ab498-186b-42c7-9d00-016501ea067f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:27.645148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-555ab498-186b-42c7-9d00-016501ea067f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:27.680144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-555ab498-186b-42c7-9d00-016501ea067f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:27.681270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-555ab498-186b-42c7-9d00-016501ea067f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:27.681630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-555ab498-186b-42c7-9d00-016501ea067f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:27.685552 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-555ab498-186b-42c7-9d00-016501ea067f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:27.943679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9a800840-79d8-406a-a9ad-a735ab935bb1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:27.965192 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9a800840-79d8-406a-a9ad-a735ab935bb1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1508 microversion: 2.1 time: 0.489370 Aug 03 02:04:27.968547 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1720/3491] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:27 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1508 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:28.075795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-555ab498-186b-42c7-9d00-016501ea067f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:28.102322 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-555ab498-186b-42c7-9d00-016501ea067f tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded" status: 200 len: 1324 microversion: 2.1 time: 0.459217 Aug 03 02:04:28.104888 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1772/3492] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:27 2022] GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded => generated 1324 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:28.113242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-179206f2-b60b-423a-acb5-f9382d7c357a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1960099046"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:28.115879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-179206f2-b60b-423a-acb5-f9382d7c357a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:28.131261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:28.134467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-179206f2-b60b-423a-acb5-f9382d7c357a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:28.135860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-179206f2-b60b-423a-acb5-f9382d7c357a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:28.136857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-179206f2-b60b-423a-acb5-f9382d7c357a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:28.137475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-179206f2-b60b-423a-acb5-f9382d7c357a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:28.292086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1426347746", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "27ec7239-2674-4383-a0e2-c571a929d4aa"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:28.431618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] validate_networks() for [('27ec7239-2674-4383-a0e2-c571a929d4aa', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:04:28.553297 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-179206f2-b60b-423a-acb5-f9382d7c357a tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "POST /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf/action" status: 202 len: 0 microversion: 2.1 time: 0.446691 Aug 03 02:04:28.554486 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1773/3493] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:04:28 2022] POST /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 02:04:28.565623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-6611a7b4-c752-4e06-a83b-7cdbf32f3ff9 req-a7245c47-6c07-44c6-adbb-f5feec821af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccde6102-3858-4f7d-aa96-9d1a2527f9a2", "tag": "e16784fb-69ab-402c-8e6c-d8e45c1468aa"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:28.583541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6611a7b4-c752-4e06-a83b-7cdbf32f3ff9 req-a7245c47-6c07-44c6-adbb-f5feec821af5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:28.584556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6611a7b4-c752-4e06-a83b-7cdbf32f3ff9 req-a7245c47-6c07-44c6-adbb-f5feec821af5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:28.605505 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-6611a7b4-c752-4e06-a83b-7cdbf32f3ff9 req-a7245c47-6c07-44c6-adbb-f5feec821af5 service nova] Creating event network-changed:e16784fb-69ab-402c-8e6c-d8e45c1468aa for instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 on n-h2-826529-8 Aug 03 02:04:28.614254 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-6611a7b4-c752-4e06-a83b-7cdbf32f3ff9 req-a7245c47-6c07-44c6-adbb-f5feec821af5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057886 Aug 03 02:04:28.615539 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1774/3494] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:28.644322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-30828970-ff90-4a91-84ff-d9e16e7e0c97 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:28.645752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-30828970-ff90-4a91-84ff-d9e16e7e0c97 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:28.656318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30828970-ff90-4a91-84ff-d9e16e7e0c97 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:28.657353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30828970-ff90-4a91-84ff-d9e16e7e0c97 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:28.658407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30828970-ff90-4a91-84ff-d9e16e7e0c97 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:28.659159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30828970-ff90-4a91-84ff-d9e16e7e0c97 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:29.183758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-30828970-ff90-4a91-84ff-d9e16e7e0c97 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:29.210257 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-30828970-ff90-4a91-84ff-d9e16e7e0c97 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 200 len: 1313 microversion: 2.1 time: 0.589030 Aug 03 02:04:29.217659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:04:29.219375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:04:29.220452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:04:29.221675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:04:29.223100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:04:29.235231 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1775/3495] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:28 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:29.261398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b9a268b3-6384-4081-80aa-9c54769c3131 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2114159"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:29.269329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:29.271579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:29.274546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b9a268b3-6384-4081-80aa-9c54769c3131 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:29.276051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:29.280736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:29.294756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9a268b3-6384-4081-80aa-9c54769c3131 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:29.295789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9a268b3-6384-4081-80aa-9c54769c3131 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:29.299952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9a268b3-6384-4081-80aa-9c54769c3131 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:29.300651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9a268b3-6384-4081-80aa-9c54769c3131 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:29.332587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Getting quotas for project bcbcd11319224cb5a4a68df7ae586618. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:04:29.340363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:29.343092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Getting quotas for user 6658b6ab1ddc4df6b1b7674a3ca0deb0 and project bcbcd11319224cb5a4a68df7ae586618. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:04:29.391752 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-b9a268b3-6384-4081-80aa-9c54769c3131 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] HTTP exception thrown: Cannot 'createImage' instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf while it is in task_state image_snapshot Aug 03 02:04:29.392934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b9a268b3-6384-4081-80aa-9c54769c3131 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Request method failure captured: Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf/action HTTP/1.1 Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 82 Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6deKj_4ni6BiP5hu0KReUjCwN-jXFzDltBsZkdmHfZJw3iCK1NJe4cC4HqyDHfr9U2Xj9tTYrH-rL2Y-nfbcV2kQPduI8yks5ljNEDlazy86SExfxbA5OA6iqfJroq-67nWDTGmlBdStRJ_EHNLs6bYrB1tkODLPTKFNyABk3rb39eQ Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_78ae2f8c7bef4a959cdfa8c61360e7e5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}] Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e2c17b2e7e9f4c878826497386ee3ba7 Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2114159"}} Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: exception: Cannot 'createImage' instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf while it is in task_state image_snapshot Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '4fd09fc6-043e-40e1-9725-6c3ff4ff28bf', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2114159'}}} Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf in task_state image_snapshot. Cannot snapshot while the instance is in this state. Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 02:04:29.393481 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf while it is in task_state image_snapshot Aug 03 02:04:29.403047 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:29.403047 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:29.403047 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:29.403047 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:29.403047 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:29.403047 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:29.403047 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:04:29.403047 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:04:29.403047 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf while it is in task_state image_snapshot Aug 03 02:04:29.403047 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:29.403047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b9a268b3-6384-4081-80aa-9c54769c3131 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Returning 409 to user: Cannot 'createImage' instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf while it is in task_state image_snapshot {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:04:29.403047 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b9a268b3-6384-4081-80aa-9c54769c3131 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "POST /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf/action" status: 409 len: 159 microversion: 2.1 time: 0.154636 Aug 03 02:04:29.407569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:04:29.411558 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1776/3496] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:04:29 2022] POST /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf/action => generated 159 bytes in 171 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:04:29.429201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4c2ab890-e5f9-4e75-a568-990c90f6ff26 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:29.430477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4c2ab890-e5f9-4e75-a568-990c90f6ff26 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:29.441363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4c2ab890-e5f9-4e75-a568-990c90f6ff26 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:29.441994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4c2ab890-e5f9-4e75-a568-990c90f6ff26 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:29.442857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4c2ab890-e5f9-4e75-a568-990c90f6ff26 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:29.444085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4c2ab890-e5f9-4e75-a568-990c90f6ff26 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:29.516069 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545640 Aug 03 02:04:29.517344 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1721/3497] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:04:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:04:29.523241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-11b135ec-1e59-4ce7-b87d-88691f512cd5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:29.527321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-11b135ec-1e59-4ce7-b87d-88691f512cd5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:29.546682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11b135ec-1e59-4ce7-b87d-88691f512cd5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:29.547456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11b135ec-1e59-4ce7-b87d-88691f512cd5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:29.548604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11b135ec-1e59-4ce7-b87d-88691f512cd5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:29.549219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11b135ec-1e59-4ce7-b87d-88691f512cd5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:29.849015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4c2ab890-e5f9-4e75-a568-990c90f6ff26 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:29.862049 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4c2ab890-e5f9-4e75-a568-990c90f6ff26 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1508 microversion: 2.1 time: 0.448243 Aug 03 02:04:29.863286 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1777/3498] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:29 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1508 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:29.868073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-43da26a0-8f88-42b0-8bce-1e73dad3b7cd tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '.version_select at 0x7f5b12a7edc0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:29.969722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-11b135ec-1e59-4ce7-b87d-88691f512cd5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:29.988223 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-11b135ec-1e59-4ce7-b87d-88691f512cd5 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded" status: 200 len: 1520 microversion: 2.1 time: 0.468964 Aug 03 02:04:29.990049 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1722/3499] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:29 2022] GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded => generated 1520 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:29.997602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d1f4350b-2fa2-4ef6-9528-3618e11434de tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:29.998589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d1f4350b-2fa2-4ef6-9528-3618e11434de tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:30.114152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d1f4350b-2fa2-4ef6-9528-3618e11434de tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658b6ab1ddc4df6b1b7674a3ca0deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbcd11319224cb5a4a68df7ae586618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:30.141253 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d1f4350b-2fa2-4ef6-9528-3618e11434de tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8" status: 200 len: 1217 microversion: 2.1 time: 0.146849 Aug 03 02:04:30.159275 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1723/3500] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:29 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:30.180199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-236a700b-f214-48dd-8579-65cf6923011e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Action: 'create', calling method: .version_select at 0x7f5b12fdd040>, body: {"pool": null} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:30.215573 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-43da26a0-8f88-42b0-8bce-1e73dad3b7cd tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "DELETE /compute/v2.1/images/04670ad8-d529-4538-a93c-e6b466282994" status: 204 len: 0 microversion: 2.1 time: 0.350765 Aug 03 02:04:30.217544 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1778/3501] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:29 2022] DELETE /compute/v2.1/images/04670ad8-d529-4538-a93c-e6b466282994 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:04:30.230673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9c1199fa-1693-4838-b796-40d441d4673f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:30.231602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9c1199fa-1693-4838-b796-40d441d4673f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:30.256970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c1199fa-1693-4838-b796-40d441d4673f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:30.258941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c1199fa-1693-4838-b796-40d441d4673f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:30.263627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c1199fa-1693-4838-b796-40d441d4673f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:30.266302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c1199fa-1693-4838-b796-40d441d4673f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:30.716568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9c1199fa-1693-4838-b796-40d441d4673f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:30.768784 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9c1199fa-1693-4838-b796-40d441d4673f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1539 microversion: 2.1 time: 0.544251 Aug 03 02:04:30.778200 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1779/3502] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:30 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1539 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:04:30.784338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-454de0c3-e2e1-4bfd-bda4-13caed07f322 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:30.786152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-454de0c3-e2e1-4bfd-bda4-13caed07f322 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:30.796703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-454de0c3-e2e1-4bfd-bda4-13caed07f322 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:30.797738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-454de0c3-e2e1-4bfd-bda4-13caed07f322 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:30.798749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-454de0c3-e2e1-4bfd-bda4-13caed07f322 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:30.799453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-454de0c3-e2e1-4bfd-bda4-13caed07f322 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:31.239035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-454de0c3-e2e1-4bfd-bda4-13caed07f322 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:31.256778 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-454de0c3-e2e1-4bfd-bda4-13caed07f322 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 200 len: 1313 microversion: 2.1 time: 0.475246 Aug 03 02:04:31.272457 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1780/3503] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:30 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:31.289204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4303c11c-facf-4a0c-b29d-9f8774dd8134 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:31.289833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4303c11c-facf-4a0c-b29d-9f8774dd8134 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:31.341413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4303c11c-facf-4a0c-b29d-9f8774dd8134 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:31.341867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4303c11c-facf-4a0c-b29d-9f8774dd8134 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:31.346056 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4303c11c-facf-4a0c-b29d-9f8774dd8134 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:31.347539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4303c11c-facf-4a0c-b29d-9f8774dd8134 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:31.792934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4303c11c-facf-4a0c-b29d-9f8774dd8134 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:31.798659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:31.806261 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4303c11c-facf-4a0c-b29d-9f8774dd8134 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1508 microversion: 2.1 time: 0.531853 Aug 03 02:04:31.807517 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1781/3504] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:31 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1508 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:31.813020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a778a9a9-cb17-4cb5-951d-d15f871bf024 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:31.813796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a778a9a9-cb17-4cb5-951d-d15f871bf024 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:31.825907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a778a9a9-cb17-4cb5-951d-d15f871bf024 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:31.826698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a778a9a9-cb17-4cb5-951d-d15f871bf024 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:31.827559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a778a9a9-cb17-4cb5-951d-d15f871bf024 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:31.828005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a778a9a9-cb17-4cb5-951d-d15f871bf024 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:31.953370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a778a9a9-cb17-4cb5-951d-d15f871bf024 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658b6ab1ddc4df6b1b7674a3ca0deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbcd11319224cb5a4a68df7ae586618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:31.962593 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a778a9a9-cb17-4cb5-951d-d15f871bf024 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8" status: 200 len: 1275 microversion: 2.1 time: 0.153028 Aug 03 02:04:31.962593 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1782/3505] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:31 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:31.969907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9855359c-0d18-4bd8-a923-dd28697dde8b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:31.969907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9855359c-0d18-4bd8-a923-dd28697dde8b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:31.977469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9855359c-0d18-4bd8-a923-dd28697dde8b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:31.977937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9855359c-0d18-4bd8-a923-dd28697dde8b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:31.979955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9855359c-0d18-4bd8-a923-dd28697dde8b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:31.980627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9855359c-0d18-4bd8-a923-dd28697dde8b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:33.047005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9855359c-0d18-4bd8-a923-dd28697dde8b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:33.065427 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9855359c-0d18-4bd8-a923-dd28697dde8b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1539 microversion: 2.1 time: 1.101334 Aug 03 02:04:33.066239 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1783/3506] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:31 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1539 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:33.071554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-790470d8-7811-4d1b-be16-68bb6c695019 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:33.079095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-790470d8-7811-4d1b-be16-68bb6c695019 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:33.087753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-790470d8-7811-4d1b-be16-68bb6c695019 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:33.089334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-790470d8-7811-4d1b-be16-68bb6c695019 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:33.090371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-790470d8-7811-4d1b-be16-68bb6c695019 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:33.091035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-790470d8-7811-4d1b-be16-68bb6c695019 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:33.484699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-790470d8-7811-4d1b-be16-68bb6c695019 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:33.501801 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-790470d8-7811-4d1b-be16-68bb6c695019 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 200 len: 1313 microversion: 2.1 time: 0.433471 Aug 03 02:04:33.502653 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1784/3507] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:33 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:33.773360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a90b1375-271a-48d3-94c3-2f8115dcdd16 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:33.774026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a90b1375-271a-48d3-94c3-2f8115dcdd16 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:33.786454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a90b1375-271a-48d3-94c3-2f8115dcdd16 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:33.787252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a90b1375-271a-48d3-94c3-2f8115dcdd16 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:33.788253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a90b1375-271a-48d3-94c3-2f8115dcdd16 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:33.788905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a90b1375-271a-48d3-94c3-2f8115dcdd16 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:33.846509 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a90b1375-271a-48d3-94c3-2f8115dcdd16 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406/ips" status: 200 len: 151 microversion: 2.20 time: 0.338332 Aug 03 02:04:33.850532 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1785/3508] 10.222.0.67 () {60 vars in 1289 bytes} [Wed Aug 3 02:04:33 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406/ips => generated 151 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:04:33.857761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1b418f9-8775-4d4c-8a83-2c5a55333dba tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:33.880449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b1b418f9-8775-4d4c-8a83-2c5a55333dba tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:33.907895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1b418f9-8775-4d4c-8a83-2c5a55333dba tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:33.908363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1b418f9-8775-4d4c-8a83-2c5a55333dba tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:33.913246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1b418f9-8775-4d4c-8a83-2c5a55333dba tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:33.914233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1b418f9-8775-4d4c-8a83-2c5a55333dba tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:34.446757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b1b418f9-8775-4d4c-8a83-2c5a55333dba tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:34.460136 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b1b418f9-8775-4d4c-8a83-2c5a55333dba tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1508 microversion: 2.1 time: 0.607459 Aug 03 02:04:34.461178 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1786/3509] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:33 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1508 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:34.484516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-61a9335a-79a0-4952-b1bb-60894e410505 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:34.485053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-61a9335a-79a0-4952-b1bb-60894e410505 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:34.493829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61a9335a-79a0-4952-b1bb-60894e410505 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:34.494275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61a9335a-79a0-4952-b1bb-60894e410505 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:34.495369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61a9335a-79a0-4952-b1bb-60894e410505 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:34.495814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61a9335a-79a0-4952-b1bb-60894e410505 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:34.546494 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-236a700b-f214-48dd-8579-65cf6923011e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.378034 Aug 03 02:04:34.550178 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1724/3510] 10.222.0.67 () {60 vars in 1170 bytes} [Wed Aug 3 02:04:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:34.559840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-e65e32ff-a74d-4c58-bfbb-aac6833e24c8 req-d7fd6f1a-291d-4ea9-9326-e0d84bc5d68c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb74278c-2659-41c6-a903-12fc69cb18ab", "name": "network-vif-plugged", "status": "completed", "tag": "9fb9ed87-7eda-4b07-a3ff-cd3a8a92b357"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:34.575885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e65e32ff-a74d-4c58-bfbb-aac6833e24c8 req-d7fd6f1a-291d-4ea9-9326-e0d84bc5d68c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:34.576938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e65e32ff-a74d-4c58-bfbb-aac6833e24c8 req-d7fd6f1a-291d-4ea9-9326-e0d84bc5d68c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:34.592991 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e65e32ff-a74d-4c58-bfbb-aac6833e24c8 req-d7fd6f1a-291d-4ea9-9326-e0d84bc5d68c service nova] Creating event network-vif-plugged:9fb9ed87-7eda-4b07-a3ff-cd3a8a92b357 for instance fb74278c-2659-41c6-a903-12fc69cb18ab on n-h1-826529-8 Aug 03 02:04:34.601069 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-e65e32ff-a74d-4c58-bfbb-aac6833e24c8 req-d7fd6f1a-291d-4ea9-9326-e0d84bc5d68c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046825 Aug 03 02:04:34.631154 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1725/3511] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:34.653476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-8bd34ae5-9602-43f0-b5d2-e1dbdfd451cb req-1278e2ed-e769-4b34-ac1e-cda1be60bd45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67eb11b-0d41-49a9-98a8-41290b4dfaa8", "tag": "93d381ca-4ee5-4e97-bc0d-9e91089a2a37"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:34.696087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8bd34ae5-9602-43f0-b5d2-e1dbdfd451cb req-1278e2ed-e769-4b34-ac1e-cda1be60bd45 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:34.700404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8bd34ae5-9602-43f0-b5d2-e1dbdfd451cb req-1278e2ed-e769-4b34-ac1e-cda1be60bd45 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:34.737631 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-8bd34ae5-9602-43f0-b5d2-e1dbdfd451cb req-1278e2ed-e769-4b34-ac1e-cda1be60bd45 service nova] Creating event network-changed:93d381ca-4ee5-4e97-bc0d-9e91089a2a37 for instance d67eb11b-0d41-49a9-98a8-41290b4dfaa8 on n-h2-826529-8 Aug 03 02:04:34.753614 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-8bd34ae5-9602-43f0-b5d2-e1dbdfd451cb req-1278e2ed-e769-4b34-ac1e-cda1be60bd45 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113012 Aug 03 02:04:34.758535 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1726/3512] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:34.770162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7368988b-68d5-4244-b09f-b552085f5b7c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:34.774279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7368988b-68d5-4244-b09f-b552085f5b7c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:34.798073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7368988b-68d5-4244-b09f-b552085f5b7c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:34.801185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7368988b-68d5-4244-b09f-b552085f5b7c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:34.802255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-61a9335a-79a0-4952-b1bb-60894e410505 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658b6ab1ddc4df6b1b7674a3ca0deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbcd11319224cb5a4a68df7ae586618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:34.803024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7368988b-68d5-4244-b09f-b552085f5b7c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:34.804463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7368988b-68d5-4244-b09f-b552085f5b7c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:34.815959 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-61a9335a-79a0-4952-b1bb-60894e410505 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8" status: 200 len: 1317 microversion: 2.1 time: 0.342003 Aug 03 02:04:34.834920 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1787/3513] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:34 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:34.844656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a67cc470-e7cc-4053-80bd-366d652c3eea tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:34.847427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a67cc470-e7cc-4053-80bd-366d652c3eea tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:34.862836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a67cc470-e7cc-4053-80bd-366d652c3eea tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:34.863569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a67cc470-e7cc-4053-80bd-366d652c3eea tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:34.870840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a67cc470-e7cc-4053-80bd-366d652c3eea tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:34.873609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a67cc470-e7cc-4053-80bd-366d652c3eea tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:35.451312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7368988b-68d5-4244-b09f-b552085f5b7c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:35.460279 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7368988b-68d5-4244-b09f-b552085f5b7c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1521 microversion: 2.1 time: 0.700299 Aug 03 02:04:35.461617 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1727/3514] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:34 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1521 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:35.467817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1410785295", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "019fe6d8-1b74-4afa-8697-7fe379f8a53a"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:35.521688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a67cc470-e7cc-4053-80bd-366d652c3eea tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:35.531739 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a67cc470-e7cc-4053-80bd-366d652c3eea tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 200 len: 1313 microversion: 2.1 time: 0.695525 Aug 03 02:04:35.537567 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1788/3515] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:34 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 1313 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:35.549451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5052cdcf-6299-4f12-8efc-7a69257f60d0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:35.549955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5052cdcf-6299-4f12-8efc-7a69257f60d0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:35.556498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] validate_networks() for [('019fe6d8-1b74-4afa-8697-7fe379f8a53a', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:04:35.569384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5052cdcf-6299-4f12-8efc-7a69257f60d0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:35.569844 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5052cdcf-6299-4f12-8efc-7a69257f60d0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:35.570634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5052cdcf-6299-4f12-8efc-7a69257f60d0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:35.573970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5052cdcf-6299-4f12-8efc-7a69257f60d0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:35.639043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5052cdcf-6299-4f12-8efc-7a69257f60d0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:04:35.801279 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5052cdcf-6299-4f12-8efc-7a69257f60d0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 204 len: 0 microversion: 2.1 time: 0.259541 Aug 03 02:04:35.809334 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1789/3516] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:04:35 2022] DELETE /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:04:35.818003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ddcd58f4-6c60-4a23-b366-6dd7209a1c3f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:35.819262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ddcd58f4-6c60-4a23-b366-6dd7209a1c3f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:35.828020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddcd58f4-6c60-4a23-b366-6dd7209a1c3f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:35.828700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddcd58f4-6c60-4a23-b366-6dd7209a1c3f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:35.829812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddcd58f4-6c60-4a23-b366-6dd7209a1c3f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:35.830360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ddcd58f4-6c60-4a23-b366-6dd7209a1c3f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:36.205324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ddcd58f4-6c60-4a23-b366-6dd7209a1c3f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:36.216679 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ddcd58f4-6c60-4a23-b366-6dd7209a1c3f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1508 microversion: 2.1 time: 0.404718 Aug 03 02:04:36.217301 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1790/3517] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:35 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1508 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:36.222772 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5c368014-c322-484a-9392-dbc3137d6be7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:36.223668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5c368014-c322-484a-9392-dbc3137d6be7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:36.231794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c368014-c322-484a-9392-dbc3137d6be7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:36.232153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c368014-c322-484a-9392-dbc3137d6be7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:36.233178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c368014-c322-484a-9392-dbc3137d6be7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:36.233634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c368014-c322-484a-9392-dbc3137d6be7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:36.466161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:04:36.467698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:04:36.468793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:04:36.469858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:04:36.470607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:04:36.494594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:36.495634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:36.497955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:36.499566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:36.534355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Getting quotas for project fb5f76083896407f8fbedf0c61c6f793. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:04:36.541661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Getting quotas for user 2a0159b26db744799487da9445a7346b and project fb5f76083896407f8fbedf0c61c6f793. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:04:36.560640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:04:36.563938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:04:36.639512 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9b8a27c5-0847-4c29-82dc-adcf84ca99d8 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171886 Aug 03 02:04:36.650930 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1728/3518] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:04:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:04:36.662143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-370c4f71-4144-47f9-89f4-31b89b6ad23e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:36.665113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-370c4f71-4144-47f9-89f4-31b89b6ad23e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:36.682817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-370c4f71-4144-47f9-89f4-31b89b6ad23e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:36.684527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-370c4f71-4144-47f9-89f4-31b89b6ad23e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:36.685470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-370c4f71-4144-47f9-89f4-31b89b6ad23e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:36.686008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-370c4f71-4144-47f9-89f4-31b89b6ad23e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:36.691429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:37.037248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5c368014-c322-484a-9392-dbc3137d6be7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:37.059010 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5c368014-c322-484a-9392-dbc3137d6be7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1527 microversion: 2.1 time: 0.839671 Aug 03 02:04:37.060088 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1791/3519] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:36 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1527 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:37.077472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-40369298-4a6a-443f-b59e-bea3083b86e0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:37.078094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-40369298-4a6a-443f-b59e-bea3083b86e0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:37.095974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40369298-4a6a-443f-b59e-bea3083b86e0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:37.096452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40369298-4a6a-443f-b59e-bea3083b86e0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:37.097285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40369298-4a6a-443f-b59e-bea3083b86e0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:37.102089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40369298-4a6a-443f-b59e-bea3083b86e0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:37.396941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-370c4f71-4144-47f9-89f4-31b89b6ad23e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658b6ab1ddc4df6b1b7674a3ca0deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbcd11319224cb5a4a68df7ae586618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:37.422737 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-370c4f71-4144-47f9-89f4-31b89b6ad23e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8" status: 200 len: 1317 microversion: 2.1 time: 0.772676 Aug 03 02:04:37.424312 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1729/3520] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:36 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 => generated 1317 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:37.433111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-9c6c8d57-cb07-48ec-b2af-54dbc705e527 req-8de93c17-9578-45d4-9361-43e3490600a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd09fc6-043e-40e1-9725-6c3ff4ff28bf", "name": "network-vif-plugged", "status": "completed", "tag": "6d5b657d-e7e5-44b1-a6df-9ad2ea5e9e88"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:37.449627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9c6c8d57-cb07-48ec-b2af-54dbc705e527 req-8de93c17-9578-45d4-9361-43e3490600a8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:37.450077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9c6c8d57-cb07-48ec-b2af-54dbc705e527 req-8de93c17-9578-45d4-9361-43e3490600a8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:37.464349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-40369298-4a6a-443f-b59e-bea3083b86e0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:37.470783 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-9c6c8d57-cb07-48ec-b2af-54dbc705e527 req-8de93c17-9578-45d4-9361-43e3490600a8 service nova] Creating event network-vif-plugged:6d5b657d-e7e5-44b1-a6df-9ad2ea5e9e88 for instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf on n-h1-826529-8 Aug 03 02:04:37.477931 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-40369298-4a6a-443f-b59e-bea3083b86e0 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 200 len: 1313 microversion: 2.1 time: 0.416324 Aug 03 02:04:37.482466 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1792/3521] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:37 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:37.483609 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-9c6c8d57-cb07-48ec-b2af-54dbc705e527 req-8de93c17-9578-45d4-9361-43e3490600a8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056661 Aug 03 02:04:37.486144 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1730/3522] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:37.497691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-257f9041-f8aa-49fe-9951-c55c7d518564 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:37.498130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e9b7fc39-ee10-41a7-bb36-12b0341166c2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:37.498760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-257f9041-f8aa-49fe-9951-c55c7d518564 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:37.502055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e9b7fc39-ee10-41a7-bb36-12b0341166c2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:37.516207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-257f9041-f8aa-49fe-9951-c55c7d518564 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:37.517480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9b7fc39-ee10-41a7-bb36-12b0341166c2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:37.518144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9b7fc39-ee10-41a7-bb36-12b0341166c2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:37.519179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9b7fc39-ee10-41a7-bb36-12b0341166c2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:37.519822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9b7fc39-ee10-41a7-bb36-12b0341166c2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:37.520396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-257f9041-f8aa-49fe-9951-c55c7d518564 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:37.523831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-257f9041-f8aa-49fe-9951-c55c7d518564 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:37.524428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-257f9041-f8aa-49fe-9951-c55c7d518564 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:37.690680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-257f9041-f8aa-49fe-9951-c55c7d518564 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:37.705124 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-257f9041-f8aa-49fe-9951-c55c7d518564 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" status: 200 len: 1228 microversion: 2.1 time: 0.221024 Aug 03 02:04:37.706027 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1793/3523] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:37 2022] GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e => generated 1228 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:37.871472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e9b7fc39-ee10-41a7-bb36-12b0341166c2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:37.884446 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e9b7fc39-ee10-41a7-bb36-12b0341166c2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1508 microversion: 2.1 time: 0.396299 Aug 03 02:04:37.895622 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1731/3524] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:37 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1508 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:38.001999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8559d43-e8a2-4805-ae75-172a95eab3ba tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:38.003294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8559d43-e8a2-4805-ae75-172a95eab3ba tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:38.012708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8559d43-e8a2-4805-ae75-172a95eab3ba tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:38.013168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8559d43-e8a2-4805-ae75-172a95eab3ba tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:38.013968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8559d43-e8a2-4805-ae75-172a95eab3ba tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:38.014499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8559d43-e8a2-4805-ae75-172a95eab3ba tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:38.054599 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-e8559d43-e8a2-4805-ae75-172a95eab3ba tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lazy-loading 'flavor' on Instance uuid 9ce11775-ab73-457e-8799-239915dc2406 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:04:38.087163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-435afb2c-f444-4d6f-ba56-554cecce2ea7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:38.088426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-435afb2c-f444-4d6f-ba56-554cecce2ea7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:38.097478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-435afb2c-f444-4d6f-ba56-554cecce2ea7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:38.098065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-435afb2c-f444-4d6f-ba56-554cecce2ea7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:38.099266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-435afb2c-f444-4d6f-ba56-554cecce2ea7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:38.099798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-435afb2c-f444-4d6f-ba56-554cecce2ea7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:38.327064 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8559d43-e8a2-4805-ae75-172a95eab3ba tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "POST /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406/action" status: 202 len: 0 microversion: 2.20 time: 0.333817 Aug 03 02:04:38.328589 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1794/3525] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 3 02:04:37 2022] POST /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:04:38.343364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ea549c4f-40be-42eb-a320-a441dcddad81 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:38.344546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ea549c4f-40be-42eb-a320-a441dcddad81 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:38.355928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea549c4f-40be-42eb-a320-a441dcddad81 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:38.357481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea549c4f-40be-42eb-a320-a441dcddad81 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:38.359635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea549c4f-40be-42eb-a320-a441dcddad81 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:38.360491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea549c4f-40be-42eb-a320-a441dcddad81 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:38.368936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:38.665508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-435afb2c-f444-4d6f-ba56-554cecce2ea7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:38.682793 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-435afb2c-f444-4d6f-ba56-554cecce2ea7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1527 microversion: 2.1 time: 0.600444 Aug 03 02:04:38.684380 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1732/3526] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:38 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1527 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:38.694353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6ed74ab9-3177-4cf9-a46d-f64a1512d939 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:38.698244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6ed74ab9-3177-4cf9-a46d-f64a1512d939 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:38.722111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ed74ab9-3177-4cf9-a46d-f64a1512d939 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:38.723431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ed74ab9-3177-4cf9-a46d-f64a1512d939 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:38.726099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ed74ab9-3177-4cf9-a46d-f64a1512d939 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:38.730445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ed74ab9-3177-4cf9-a46d-f64a1512d939 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:38.811601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ea549c4f-40be-42eb-a320-a441dcddad81 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:38.820914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ea549c4f-40be-42eb-a320-a441dcddad81 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:38.829136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ea549c4f-40be-42eb-a320-a441dcddad81 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:38.831183 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ea549c4f-40be-42eb-a320-a441dcddad81 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1723 microversion: 2.20 time: 0.496006 Aug 03 02:04:38.832329 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1795/3527] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:04:38 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1723 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:04:38.842202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-70207668-7642-45df-9803-ef1bdc886542 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:38.842869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-70207668-7642-45df-9803-ef1bdc886542 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:38.854166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70207668-7642-45df-9803-ef1bdc886542 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:38.855001 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70207668-7642-45df-9803-ef1bdc886542 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:38.856050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70207668-7642-45df-9803-ef1bdc886542 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:38.856673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70207668-7642-45df-9803-ef1bdc886542 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:39.141570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6ed74ab9-3177-4cf9-a46d-f64a1512d939 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658b6ab1ddc4df6b1b7674a3ca0deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbcd11319224cb5a4a68df7ae586618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:39.144251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-70207668-7642-45df-9803-ef1bdc886542 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:39.151815 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6ed74ab9-3177-4cf9-a46d-f64a1512d939 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8" status: 200 len: 1317 microversion: 2.1 time: 0.466188 Aug 03 02:04:39.152819 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1733/3528] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:38 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:39.157296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b0bf1fa7-70a7-46ce-ba25-8f29ef3168e9 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:39.157537 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-70207668-7642-45df-9803-ef1bdc886542 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 200 len: 1498 microversion: 2.1 time: 0.321528 Aug 03 02:04:39.157910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b0bf1fa7-70a7-46ce-ba25-8f29ef3168e9 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:39.164981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0bf1fa7-70a7-46ce-ba25-8f29ef3168e9 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:39.167738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0bf1fa7-70a7-46ce-ba25-8f29ef3168e9 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:39.167738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0bf1fa7-70a7-46ce-ba25-8f29ef3168e9 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:39.167738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0bf1fa7-70a7-46ce-ba25-8f29ef3168e9 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:39.168285 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1796/3529] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:38 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 1498 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:39.195315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-08167b68-38ef-40ba-8f29-390e21334a51 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:39.196684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-08167b68-38ef-40ba-8f29-390e21334a51 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:39.207141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08167b68-38ef-40ba-8f29-390e21334a51 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:39.208226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08167b68-38ef-40ba-8f29-390e21334a51 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:39.209928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08167b68-38ef-40ba-8f29-390e21334a51 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:39.210987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08167b68-38ef-40ba-8f29-390e21334a51 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:39.357631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b0bf1fa7-70a7-46ce-ba25-8f29ef3168e9 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:39.372525 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b0bf1fa7-70a7-46ce-ba25-8f29ef3168e9 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" status: 200 len: 1276 microversion: 2.1 time: 0.218785 Aug 03 02:04:39.375603 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1734/3530] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:39 2022] GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e => generated 1276 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:39.679180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-6b3b6bc1-4327-4919-967d-361ad05fdfbd req-97ea3c6d-0cf4-40e6-881c-c628c4e80ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd09fc6-043e-40e1-9725-6c3ff4ff28bf", "name": "network-vif-deleted", "tag": "6d5b657d-e7e5-44b1-a6df-9ad2ea5e9e88"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:39.706429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6b3b6bc1-4327-4919-967d-361ad05fdfbd req-97ea3c6d-0cf4-40e6-881c-c628c4e80ea9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:39.714415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6b3b6bc1-4327-4919-967d-361ad05fdfbd req-97ea3c6d-0cf4-40e6-881c-c628c4e80ea9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:39.738114 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-6b3b6bc1-4327-4919-967d-361ad05fdfbd req-97ea3c6d-0cf4-40e6-881c-c628c4e80ea9 service nova] Creating event network-vif-deleted:6d5b657d-e7e5-44b1-a6df-9ad2ea5e9e88 for instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf on n-h1-826529-8 Aug 03 02:04:39.755980 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-6b3b6bc1-4327-4919-967d-361ad05fdfbd req-97ea3c6d-0cf4-40e6-881c-c628c4e80ea9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080890 Aug 03 02:04:39.759969 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1735/3531] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:04:39.772749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-667cd787-082b-4760-be8d-0fd7d7c00781 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:39.777603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-667cd787-082b-4760-be8d-0fd7d7c00781 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:39.796785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-667cd787-082b-4760-be8d-0fd7d7c00781 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:39.799698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-667cd787-082b-4760-be8d-0fd7d7c00781 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:39.800857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-667cd787-082b-4760-be8d-0fd7d7c00781 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:39.809365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-667cd787-082b-4760-be8d-0fd7d7c00781 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:40.036921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-08167b68-38ef-40ba-8f29-390e21334a51 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:40.051860 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-08167b68-38ef-40ba-8f29-390e21334a51 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1508 microversion: 2.1 time: 0.873170 Aug 03 02:04:40.062932 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1797/3532] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:39 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1508 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:40.062932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-59927765-625f-4aae-adbd-e805218fe9e8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:40.062932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-59927765-625f-4aae-adbd-e805218fe9e8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:40.067057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59927765-625f-4aae-adbd-e805218fe9e8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:40.068718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59927765-625f-4aae-adbd-e805218fe9e8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:40.069867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59927765-625f-4aae-adbd-e805218fe9e8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:40.070533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59927765-625f-4aae-adbd-e805218fe9e8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:40.074512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-667cd787-082b-4760-be8d-0fd7d7c00781 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:40.089990 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-667cd787-082b-4760-be8d-0fd7d7c00781 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1309 microversion: 2.1 time: 0.327923 Aug 03 02:04:40.091105 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1736/3533] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:39 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1309 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:40.110274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-402d10f7-d6ec-4933-aad6-ff4435487d0f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:40.110796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-402d10f7-d6ec-4933-aad6-ff4435487d0f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:40.117500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-402d10f7-d6ec-4933-aad6-ff4435487d0f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:40.117957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-402d10f7-d6ec-4933-aad6-ff4435487d0f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:40.121516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-402d10f7-d6ec-4933-aad6-ff4435487d0f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:40.122032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-402d10f7-d6ec-4933-aad6-ff4435487d0f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:40.157884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-402d10f7-d6ec-4933-aad6-ff4435487d0f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:04:40.278874 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-402d10f7-d6ec-4933-aad6-ff4435487d0f tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 204 len: 0 microversion: 2.1 time: 0.186482 Aug 03 02:04:40.285873 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1737/3534] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:04:40 2022] DELETE /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:04:40.296586 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8db95649-e401-4975-a983-8a60cdbf5e0b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:40.298009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8db95649-e401-4975-a983-8a60cdbf5e0b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:40.309511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8db95649-e401-4975-a983-8a60cdbf5e0b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:40.310314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8db95649-e401-4975-a983-8a60cdbf5e0b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:40.311695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8db95649-e401-4975-a983-8a60cdbf5e0b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:40.312507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8db95649-e401-4975-a983-8a60cdbf5e0b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:40.564529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-59927765-625f-4aae-adbd-e805218fe9e8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:40.574139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-59927765-625f-4aae-adbd-e805218fe9e8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:40.575795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-59927765-625f-4aae-adbd-e805218fe9e8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:40.577004 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-59927765-625f-4aae-adbd-e805218fe9e8 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1723 microversion: 2.20 time: 0.523327 Aug 03 02:04:40.577577 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1798/3535] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:04:40 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1723 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:04:40.583140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-04b57e6e-4acf-4759-8daf-dba9610b5939 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:40.583140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-04b57e6e-4acf-4759-8daf-dba9610b5939 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:40.590814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04b57e6e-4acf-4759-8daf-dba9610b5939 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:40.591562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04b57e6e-4acf-4759-8daf-dba9610b5939 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:40.592354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04b57e6e-4acf-4759-8daf-dba9610b5939 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:40.592799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04b57e6e-4acf-4759-8daf-dba9610b5939 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:40.744346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8db95649-e401-4975-a983-8a60cdbf5e0b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658b6ab1ddc4df6b1b7674a3ca0deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbcd11319224cb5a4a68df7ae586618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:40.769161 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8db95649-e401-4975-a983-8a60cdbf5e0b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8" status: 200 len: 1317 microversion: 2.1 time: 0.481320 Aug 03 02:04:40.776419 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1738/3536] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:40 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:40.786664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-94808732-50fc-4dd1-8b4e-5ff89421b44b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:40.787689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-94808732-50fc-4dd1-8b4e-5ff89421b44b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:40.798573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94808732-50fc-4dd1-8b4e-5ff89421b44b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:40.799474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94808732-50fc-4dd1-8b4e-5ff89421b44b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:40.800875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94808732-50fc-4dd1-8b4e-5ff89421b44b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:40.801694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94808732-50fc-4dd1-8b4e-5ff89421b44b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:40.947235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-94808732-50fc-4dd1-8b4e-5ff89421b44b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:40.967441 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-94808732-50fc-4dd1-8b4e-5ff89421b44b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" status: 200 len: 1282 microversion: 2.1 time: 0.189048 Aug 03 02:04:40.968049 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1739/3537] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:40 2022] GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e => generated 1282 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:40.984325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-5fbc9fbb-b33b-4cb1-ac6f-6ecdaf4769fb req-e24ba427-2bb9-4740-b7fb-9dd70546d21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67eb11b-0d41-49a9-98a8-41290b4dfaa8", "name": "network-vif-plugged", "status": "completed", "tag": "93d381ca-4ee5-4e97-bc0d-9e91089a2a37"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:41.001279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5fbc9fbb-b33b-4cb1-ac6f-6ecdaf4769fb req-e24ba427-2bb9-4740-b7fb-9dd70546d21b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:41.002357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5fbc9fbb-b33b-4cb1-ac6f-6ecdaf4769fb req-e24ba427-2bb9-4740-b7fb-9dd70546d21b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:41.019758 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-5fbc9fbb-b33b-4cb1-ac6f-6ecdaf4769fb req-e24ba427-2bb9-4740-b7fb-9dd70546d21b service nova] Creating event network-vif-plugged:93d381ca-4ee5-4e97-bc0d-9e91089a2a37 for instance d67eb11b-0d41-49a9-98a8-41290b4dfaa8 on n-h2-826529-8 Aug 03 02:04:41.024738 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-5fbc9fbb-b33b-4cb1-ac6f-6ecdaf4769fb req-e24ba427-2bb9-4740-b7fb-9dd70546d21b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053570 Aug 03 02:04:41.026791 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1740/3538] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:41.029449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-04b57e6e-4acf-4759-8daf-dba9610b5939 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:41.059794 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-04b57e6e-4acf-4759-8daf-dba9610b5939 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 200 len: 1504 microversion: 2.1 time: 0.481138 Aug 03 02:04:41.061373 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1799/3539] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:40 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 1504 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:41.082390 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d4a8dca6-2a64-43cd-b62e-8d211ad37dc0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:41.084624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d4a8dca6-2a64-43cd-b62e-8d211ad37dc0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:41.100235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4a8dca6-2a64-43cd-b62e-8d211ad37dc0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:41.101201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4a8dca6-2a64-43cd-b62e-8d211ad37dc0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:41.114072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2fd7fefc-54e1-460c-9a0f-3c3263bf6a9d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:41.114481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4a8dca6-2a64-43cd-b62e-8d211ad37dc0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:41.114685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2fd7fefc-54e1-460c-9a0f-3c3263bf6a9d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:41.115948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4a8dca6-2a64-43cd-b62e-8d211ad37dc0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:41.128908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fd7fefc-54e1-460c-9a0f-3c3263bf6a9d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:41.129466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fd7fefc-54e1-460c-9a0f-3c3263bf6a9d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:41.130274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fd7fefc-54e1-460c-9a0f-3c3263bf6a9d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:41.130723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fd7fefc-54e1-460c-9a0f-3c3263bf6a9d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:41.205295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fd7fefc-54e1-460c-9a0f-3c3263bf6a9d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:41.206302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fd7fefc-54e1-460c-9a0f-3c3263bf6a9d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:41.207334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-2fd7fefc-54e1-460c-9a0f-3c3263bf6a9d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lazy-loading 'fault' on Instance uuid 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:04:41.309279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2fd7fefc-54e1-460c-9a0f-3c3263bf6a9d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:41.318431 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2fd7fefc-54e1-460c-9a0f-3c3263bf6a9d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 200 len: 1314 microversion: 2.1 time: 0.207545 Aug 03 02:04:41.319557 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1800/3540] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:41 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:41.559646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d4a8dca6-2a64-43cd-b62e-8d211ad37dc0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:41.577726 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d4a8dca6-2a64-43cd-b62e-8d211ad37dc0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1529 microversion: 2.1 time: 0.503131 Aug 03 02:04:41.579786 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1741/3541] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:41 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1529 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:41.609929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b99ec658-b907-49a3-915e-c6d5de2227ca tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:41.612441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b99ec658-b907-49a3-915e-c6d5de2227ca tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:41.635478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b99ec658-b907-49a3-915e-c6d5de2227ca tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:41.640906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b99ec658-b907-49a3-915e-c6d5de2227ca tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:41.642173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b99ec658-b907-49a3-915e-c6d5de2227ca tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:41.642773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b99ec658-b907-49a3-915e-c6d5de2227ca tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:41.794072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5431321b-7292-45f7-8775-b0f8c0a2f453 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:41.794704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5431321b-7292-45f7-8775-b0f8c0a2f453 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:41.808361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5431321b-7292-45f7-8775-b0f8c0a2f453 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:41.809175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5431321b-7292-45f7-8775-b0f8c0a2f453 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:41.810180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5431321b-7292-45f7-8775-b0f8c0a2f453 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:41.810890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5431321b-7292-45f7-8775-b0f8c0a2f453 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:42.058647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b99ec658-b907-49a3-915e-c6d5de2227ca tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:42.068841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b99ec658-b907-49a3-915e-c6d5de2227ca tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:42.070781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b99ec658-b907-49a3-915e-c6d5de2227ca tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:42.073483 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b99ec658-b907-49a3-915e-c6d5de2227ca tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1723 microversion: 2.20 time: 0.474596 Aug 03 02:04:42.074697 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1801/3542] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:04:41 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1723 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:04:42.080835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-70189184-7143-4e40-827e-98b5c5b3615d tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:42.081718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-70189184-7143-4e40-827e-98b5c5b3615d tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:42.105013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70189184-7143-4e40-827e-98b5c5b3615d tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:42.105474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70189184-7143-4e40-827e-98b5c5b3615d tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:42.106295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70189184-7143-4e40-827e-98b5c5b3615d tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:42.106800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70189184-7143-4e40-827e-98b5c5b3615d tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:42.297164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5431321b-7292-45f7-8775-b0f8c0a2f453 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658b6ab1ddc4df6b1b7674a3ca0deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbcd11319224cb5a4a68df7ae586618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:42.309039 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5431321b-7292-45f7-8775-b0f8c0a2f453 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8" status: 200 len: 1317 microversion: 2.1 time: 0.519705 Aug 03 02:04:42.324157 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1742/3543] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:41 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:04:42.329942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cd267c92-d38f-431e-b033-953bae2ca42b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:42.330711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cd267c92-d38f-431e-b033-953bae2ca42b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:42.339554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd267c92-d38f-431e-b033-953bae2ca42b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:42.341160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd267c92-d38f-431e-b033-953bae2ca42b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:42.342534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd267c92-d38f-431e-b033-953bae2ca42b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:42.344042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd267c92-d38f-431e-b033-953bae2ca42b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:42.439803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-70189184-7143-4e40-827e-98b5c5b3615d tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:42.450554 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-70189184-7143-4e40-827e-98b5c5b3615d tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" status: 200 len: 1324 microversion: 2.1 time: 0.373938 Aug 03 02:04:42.465501 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1802/3544] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:42 2022] GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e => generated 1324 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:42.472326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8a236b19-e852-48eb-a9fd-8c7b91547621 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:42.473333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8a236b19-e852-48eb-a9fd-8c7b91547621 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:42.482209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a236b19-e852-48eb-a9fd-8c7b91547621 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:42.483247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a236b19-e852-48eb-a9fd-8c7b91547621 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:42.484313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a236b19-e852-48eb-a9fd-8c7b91547621 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:42.484966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a236b19-e852-48eb-a9fd-8c7b91547621 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:42.504647 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-8a236b19-e852-48eb-a9fd-8c7b91547621 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] HTTP exception thrown: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8a236b19-e852-48eb-a9fd-8c7b91547621 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Request method failure captured: Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf HTTP/1.1 Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6deKj_4ni6BiP5hu0KReUjCwN-jXFzDltBsZkdmHfZJw3iCK1NJe4cC4HqyDHfr9U2Xj9tTYrH-rL2Y-nfbcV2kQPduI8yks5ljNEDlazy86SExfxbA5OA6iqfJroq-67nWDTGmlBdStRJ_EHNLs6bYrB1tkODLPTKFNyABk3rb39eQ Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_78ae2f8c7bef4a959cdfa8c61360e7e5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}] Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e2c17b2e7e9f4c878826497386ee3ba7 Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '4fd09fc6-043e-40e1-9725-6c3ff4ff28bf'} Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:42.507921 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:42.513677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:42.513677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:42.513677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:42.513677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:42.513677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:04:42.513677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:04:42.513677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. Aug 03 02:04:42.513677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:42.515982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8a236b19-e852-48eb-a9fd-8c7b91547621 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Returning 404 to user: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:04:42.517232 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8a236b19-e852-48eb-a9fd-8c7b91547621 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 404 len: 111 microversion: 2.1 time: 0.050696 Aug 03 02:04:42.518293 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1803/3545] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:42 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:04:42.533863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-492e87bd-edba-4816-851d-254f436233cf tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Action: 'create', calling method: .version_select at 0x7f5b1273e700>, body: {"keypair": {"name": "tempest-keypair-1269134610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlecJC1s6enAh6LKidM1MvFMhksxHKXCwQRd6yWI8GPb9oSi5ulIiQZF0ZwWU5vNAH6fFLrienrVZZPb8AlAdjM6zmBCwuFZxuEGCG6Yzx2DpC3ngTa1K10lcpCzj/SMg=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:42.553874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-492e87bd-edba-4816-851d-254f436233cf tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Getting quotas for project 78ae2f8c7bef4a959cdfa8c61360e7e5. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:04:42.561383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-492e87bd-edba-4816-851d-254f436233cf tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Getting quotas for user e2c17b2e7e9f4c878826497386ee3ba7 and project 78ae2f8c7bef4a959cdfa8c61360e7e5. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:04:42.611093 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-492e87bd-edba-4816-851d-254f436233cf tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080066 Aug 03 02:04:42.614109 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1804/3546] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:04:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:42.629746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fa57f2f6-ace2-4002-b73a-a90ae72997f9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:42.630729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fa57f2f6-ace2-4002-b73a-a90ae72997f9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:42.655525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa57f2f6-ace2-4002-b73a-a90ae72997f9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:42.656315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa57f2f6-ace2-4002-b73a-a90ae72997f9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:42.657770 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa57f2f6-ace2-4002-b73a-a90ae72997f9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:42.658221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa57f2f6-ace2-4002-b73a-a90ae72997f9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:42.811062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cd267c92-d38f-431e-b033-953bae2ca42b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:42.830079 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cd267c92-d38f-431e-b033-953bae2ca42b tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 200 len: 1504 microversion: 2.1 time: 0.504145 Aug 03 02:04:42.830736 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1743/3547] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:42 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 1504 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:43.132636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7c208af8-fe33-47ab-a46c-173af53c934b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:43.138251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7c208af8-fe33-47ab-a46c-173af53c934b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:43.168110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c208af8-fe33-47ab-a46c-173af53c934b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:43.169573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c208af8-fe33-47ab-a46c-173af53c934b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:43.175077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c208af8-fe33-47ab-a46c-173af53c934b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:43.175658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c208af8-fe33-47ab-a46c-173af53c934b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:43.576410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fa57f2f6-ace2-4002-b73a-a90ae72997f9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:43.587197 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fa57f2f6-ace2-4002-b73a-a90ae72997f9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1524 microversion: 2.1 time: 0.970856 Aug 03 02:04:43.592707 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1805/3548] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:42 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1524 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:43.603587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd1c8c4b-dc3b-4b47-8fb0-a1172e70c56f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:43.604693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cd1c8c4b-dc3b-4b47-8fb0-a1172e70c56f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:43.618508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd1c8c4b-dc3b-4b47-8fb0-a1172e70c56f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:43.621143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd1c8c4b-dc3b-4b47-8fb0-a1172e70c56f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:43.622381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd1c8c4b-dc3b-4b47-8fb0-a1172e70c56f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:43.624171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd1c8c4b-dc3b-4b47-8fb0-a1172e70c56f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:44.359345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7c208af8-fe33-47ab-a46c-173af53c934b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:44.375723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7c208af8-fe33-47ab-a46c-173af53c934b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:44.378530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7c208af8-fe33-47ab-a46c-173af53c934b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:44.380408 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7c208af8-fe33-47ab-a46c-173af53c934b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1723 microversion: 2.20 time: 1.273233 Aug 03 02:04:44.381997 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1744/3549] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:04:43 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1723 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:04:44.390687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5cba6f5e-c066-4058-a7c6-5d87db4982f1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:44.391899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5cba6f5e-c066-4058-a7c6-5d87db4982f1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:44.404345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cba6f5e-c066-4058-a7c6-5d87db4982f1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:44.405782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cba6f5e-c066-4058-a7c6-5d87db4982f1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:44.407240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cba6f5e-c066-4058-a7c6-5d87db4982f1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:44.407901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cba6f5e-c066-4058-a7c6-5d87db4982f1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:44.441871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cd1c8c4b-dc3b-4b47-8fb0-a1172e70c56f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658b6ab1ddc4df6b1b7674a3ca0deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbcd11319224cb5a4a68df7ae586618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:44.467683 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cd1c8c4b-dc3b-4b47-8fb0-a1172e70c56f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8" status: 200 len: 1505 microversion: 2.1 time: 0.873633 Aug 03 02:04:44.468326 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1806/3550] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:43 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 => generated 1505 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:44.484391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-af460999-a346-4e61-869c-8a72dd043e93 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:44.485936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-af460999-a346-4e61-869c-8a72dd043e93 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:44.500340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af460999-a346-4e61-869c-8a72dd043e93 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:44.501029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af460999-a346-4e61-869c-8a72dd043e93 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:44.502077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af460999-a346-4e61-869c-8a72dd043e93 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:44.502632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af460999-a346-4e61-869c-8a72dd043e93 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:44.593502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af460999-a346-4e61-869c-8a72dd043e93 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:44.593972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af460999-a346-4e61-869c-8a72dd043e93 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:44.594438 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-af460999-a346-4e61-869c-8a72dd043e93 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lazy-loading 'fault' on Instance uuid fb74278c-2659-41c6-a903-12fc69cb18ab {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:04:44.878050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-af460999-a346-4e61-869c-8a72dd043e93 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9853c1a55054968a931638100af4360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b6fa5e476644de89acfd1d2bbbff62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:44.890742 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-af460999-a346-4e61-869c-8a72dd043e93 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 200 len: 1303 microversion: 2.1 time: 0.421097 Aug 03 02:04:44.891770 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1807/3551] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:44 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 1303 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:44.914972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-7171cc18-e16b-4430-829b-0fa5b12a5cd3 req-bfd71be6-31cb-46d2-a0e3-0a519e6102a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb74278c-2659-41c6-a903-12fc69cb18ab", "name": "network-vif-deleted", "tag": "9fb9ed87-7eda-4b07-a3ff-cd3a8a92b357"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:44.943533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7171cc18-e16b-4430-829b-0fa5b12a5cd3 req-bfd71be6-31cb-46d2-a0e3-0a519e6102a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:44.945027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7171cc18-e16b-4430-829b-0fa5b12a5cd3 req-bfd71be6-31cb-46d2-a0e3-0a519e6102a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:44.984271 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-7171cc18-e16b-4430-829b-0fa5b12a5cd3 req-bfd71be6-31cb-46d2-a0e3-0a519e6102a7 service nova] Creating event network-vif-deleted:9fb9ed87-7eda-4b07-a3ff-cd3a8a92b357 for instance fb74278c-2659-41c6-a903-12fc69cb18ab on n-h1-826529-8 Aug 03 02:04:45.002186 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-7171cc18-e16b-4430-829b-0fa5b12a5cd3 req-bfd71be6-31cb-46d2-a0e3-0a519e6102a7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109009 Aug 03 02:04:45.005092 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1808/3552] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:45.022213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-46a5085c-904f-4baa-8162-36326bb205df tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:45.022213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-46a5085c-904f-4baa-8162-36326bb205df tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:45.036064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46a5085c-904f-4baa-8162-36326bb205df tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:45.036064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46a5085c-904f-4baa-8162-36326bb205df tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:45.038020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46a5085c-904f-4baa-8162-36326bb205df tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:45.040096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46a5085c-904f-4baa-8162-36326bb205df tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:45.141394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5cba6f5e-c066-4058-a7c6-5d87db4982f1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:45.154282 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5cba6f5e-c066-4058-a7c6-5d87db4982f1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" status: 200 len: 1324 microversion: 2.1 time: 0.770310 Aug 03 02:04:45.156378 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1745/3553] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:44 2022] GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e => generated 1324 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:45.169404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-46a5085c-904f-4baa-8162-36326bb205df tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '6658b6ab1ddc4df6b1b7674a3ca0deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbcd11319224cb5a4a68df7ae586618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:45.173840 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-46a5085c-904f-4baa-8162-36326bb205df tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8/os-instance-actions/req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd" status: 200 len: 313 microversion: 2.1 time: 0.165850 Aug 03 02:04:45.175809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ed1049de-6a27-4deb-a43e-cb6e931d4fc9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:45.176678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ed1049de-6a27-4deb-a43e-cb6e931d4fc9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:45.190368 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1809/3554] 10.222.0.67 () {58 vars in 1419 bytes} [Wed Aug 3 02:04:45 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8/os-instance-actions/req-820ed4a8-c4a4-4f00-a2b0-4cb195536abd => generated 313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:45.201535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9588c0ed-7a59-41f0-b5c6-56d78db5ab91 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:45.208262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9588c0ed-7a59-41f0-b5c6-56d78db5ab91 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:45.220500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed1049de-6a27-4deb-a43e-cb6e931d4fc9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:45.221123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed1049de-6a27-4deb-a43e-cb6e931d4fc9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:45.225953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9588c0ed-7a59-41f0-b5c6-56d78db5ab91 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:45.230080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed1049de-6a27-4deb-a43e-cb6e931d4fc9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:45.230522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9588c0ed-7a59-41f0-b5c6-56d78db5ab91 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:45.231779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9588c0ed-7a59-41f0-b5c6-56d78db5ab91 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:45.235564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9588c0ed-7a59-41f0-b5c6-56d78db5ab91 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:45.236579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ed1049de-6a27-4deb-a43e-cb6e931d4fc9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:45.254599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:45.468044 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9588c0ed-7a59-41f0-b5c6-56d78db5ab91 tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "POST /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8/action" status: 202 len: 0 microversion: 2.1 time: 0.275212 Aug 03 02:04:45.469493 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1810/3555] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:04:45 2022] POST /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:04:45.494869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-58a39576-b634-47a9-91d5-a0d9c1360406 req-c6e1c145-e92e-4601-8ff2-e59a783e896a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fea7f2e-eb34-40c8-8171-11e0a65bae4a", "name": "network-vif-plugged", "status": "completed", "tag": "e1ea085a-3d24-4a01-addc-213948d9671b"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:45.555551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-58a39576-b634-47a9-91d5-a0d9c1360406 req-c6e1c145-e92e-4601-8ff2-e59a783e896a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:45.558527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-58a39576-b634-47a9-91d5-a0d9c1360406 req-c6e1c145-e92e-4601-8ff2-e59a783e896a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:45.608170 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-58a39576-b634-47a9-91d5-a0d9c1360406 req-c6e1c145-e92e-4601-8ff2-e59a783e896a service nova] Creating event network-vif-plugged:e1ea085a-3d24-4a01-addc-213948d9671b for instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a on n-h2-826529-8 Aug 03 02:04:45.626339 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-58a39576-b634-47a9-91d5-a0d9c1360406 req-c6e1c145-e92e-4601-8ff2-e59a783e896a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155157 Aug 03 02:04:45.627541 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1811/3556] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:45.647464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-48801b62-3650-4146-bf38-d7fe1685c32a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:45.648511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-48801b62-3650-4146-bf38-d7fe1685c32a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:45.677864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48801b62-3650-4146-bf38-d7fe1685c32a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:45.678358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48801b62-3650-4146-bf38-d7fe1685c32a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:45.681888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48801b62-3650-4146-bf38-d7fe1685c32a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:45.682569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48801b62-3650-4146-bf38-d7fe1685c32a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:45.974861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ed1049de-6a27-4deb-a43e-cb6e931d4fc9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:45.994432 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ed1049de-6a27-4deb-a43e-cb6e931d4fc9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1524 microversion: 2.1 time: 0.833603 Aug 03 02:04:45.998975 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1746/3557] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:45 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1524 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:46.010885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-85d38988-c4d4-4199-91d0-2c633487f84d req-1464713a-eb43-4a9e-b4b8-6b117c9499a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e", "tag": "52d7951f-c056-422b-91e9-87c1ee53edc8"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:46.049914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-85d38988-c4d4-4199-91d0-2c633487f84d req-1464713a-eb43-4a9e-b4b8-6b117c9499a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:46.050780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-85d38988-c4d4-4199-91d0-2c633487f84d req-1464713a-eb43-4a9e-b4b8-6b117c9499a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:46.070507 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-85d38988-c4d4-4199-91d0-2c633487f84d req-1464713a-eb43-4a9e-b4b8-6b117c9499a7 service nova] Creating event network-changed:52d7951f-c056-422b-91e9-87c1ee53edc8 for instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e on n-h1-826529-8 Aug 03 02:04:46.081322 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-85d38988-c4d4-4199-91d0-2c633487f84d req-1464713a-eb43-4a9e-b4b8-6b117c9499a7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075368 Aug 03 02:04:46.085182 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1747/3558] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:46.093905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ca318145-7370-4144-98cb-d4ebfc086c9e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:46.096224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ca318145-7370-4144-98cb-d4ebfc086c9e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:46.110116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca318145-7370-4144-98cb-d4ebfc086c9e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:46.111149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca318145-7370-4144-98cb-d4ebfc086c9e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:46.113105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca318145-7370-4144-98cb-d4ebfc086c9e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:46.114194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca318145-7370-4144-98cb-d4ebfc086c9e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:46.521378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:46.552976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=14 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:46.627089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-48801b62-3650-4146-bf38-d7fe1685c32a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:46.649579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-48801b62-3650-4146-bf38-d7fe1685c32a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:46.686478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-48801b62-3650-4146-bf38-d7fe1685c32a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:46.696995 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-48801b62-3650-4146-bf38-d7fe1685c32a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1723 microversion: 2.20 time: 1.066235 Aug 03 02:04:46.697839 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1812/3559] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:04:45 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1723 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:04:46.724373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b73a86c-8752-4ac0-945f-23b99fddd5d1 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:46.725374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8b73a86c-8752-4ac0-945f-23b99fddd5d1 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] [instance: fb74278c-2659-41c6-a903-12fc69cb18ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:46.741222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b73a86c-8752-4ac0-945f-23b99fddd5d1 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:46.742115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b73a86c-8752-4ac0-945f-23b99fddd5d1 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:46.743328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b73a86c-8752-4ac0-945f-23b99fddd5d1 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:46.744880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b73a86c-8752-4ac0-945f-23b99fddd5d1 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:46.752157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:46.783115 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-8b73a86c-8752-4ac0-945f-23b99fddd5d1 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] HTTP exception thrown: Instance fb74278c-2659-41c6-a903-12fc69cb18ab could not be found. Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b73a86c-8752-4ac0-945f-23b99fddd5d1 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Request method failure captured: Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab HTTP/1.1 Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dd9utOUSIjcp00xfr6xmowCWQr03r-_ZX4bAUvtihO8b_tfad9A4hA7BM28DxBkH3sXuDRSMKdt0ZwdX7qbN5E9bpt_dPXA1cHbyCq_aYMdEBJJBYqbj6b6hfk9Y3EWpDNZPEIcrXiGIU1mRM8qCbTE70W3nw6LwYSFluzd5dkSDmk Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 82b6fa5e476644de89acfd1d2bbbff62 Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-VolumesActionsTest-855881437 Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_82b6fa5e476644de89acfd1d2bbbff62", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/82b6fa5e476644de89acfd1d2bbbff62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/82b6fa5e476644de89acfd1d2bbbff62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/82b6fa5e476644de89acfd1d2bbbff62"}]}] Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-VolumesActionsTest-855881437 Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 82b6fa5e476644de89acfd1d2bbbff62 Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-VolumesActionsTest-855881437 Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-VolumesActionsTest-855881437-project Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: a9853c1a55054968a931638100af4360 Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-VolumesActionsTest-855881437-project Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance fb74278c-2659-41c6-a903-12fc69cb18ab could not be found. Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'fb74278c-2659-41c6-a903-12fc69cb18ab'} Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb74278c-2659-41c6-a903-12fc69cb18ab could not be found. Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb74278c-2659-41c6-a903-12fc69cb18ab could not be found. Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:46.785447 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:46.795786 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:46.795786 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:46.795786 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:46.795786 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:04:46.795786 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:04:46.795786 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb74278c-2659-41c6-a903-12fc69cb18ab could not be found. Aug 03 02:04:46.795786 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:04:46.800242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b73a86c-8752-4ac0-945f-23b99fddd5d1 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] Returning 404 to user: Instance fb74278c-2659-41c6-a903-12fc69cb18ab could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:04:46.801154 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8b73a86c-8752-4ac0-945f-23b99fddd5d1 tempest-VolumesActionsTest-855881437 tempest-VolumesActionsTest-855881437-project] 10.222.0.67 "GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab" status: 404 len: 111 microversion: 2.1 time: 0.099200 Aug 03 02:04:46.806029 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1813/3560] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:46 2022] GET /compute/v2.1/servers/fb74278c-2659-41c6-a903-12fc69cb18ab => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:04:46.846547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-40db1bda-f18c-40ee-8430-3c98a941c8ae tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:46.848653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-40db1bda-f18c-40ee-8430-3c98a941c8ae tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:46.856642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:46.874433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40db1bda-f18c-40ee-8430-3c98a941c8ae tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:46.878111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40db1bda-f18c-40ee-8430-3c98a941c8ae tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:46.880007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40db1bda-f18c-40ee-8430-3c98a941c8ae tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:46.881363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40db1bda-f18c-40ee-8430-3c98a941c8ae tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:47.162824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ca318145-7370-4144-98cb-d4ebfc086c9e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658b6ab1ddc4df6b1b7674a3ca0deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbcd11319224cb5a4a68df7ae586618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:47.188844 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ca318145-7370-4144-98cb-d4ebfc086c9e tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8" status: 200 len: 1507 microversion: 2.1 time: 1.101108 Aug 03 02:04:47.207875 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1748/3561] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:46 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 => generated 1507 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:47.232439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d6c8cf20-5eaf-467b-9a64-03cd7f796fd1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:47.233422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d6c8cf20-5eaf-467b-9a64-03cd7f796fd1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:47.270849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6c8cf20-5eaf-467b-9a64-03cd7f796fd1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:47.284192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6c8cf20-5eaf-467b-9a64-03cd7f796fd1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:47.289125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6c8cf20-5eaf-467b-9a64-03cd7f796fd1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:47.290166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6c8cf20-5eaf-467b-9a64-03cd7f796fd1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:47.552944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-40db1bda-f18c-40ee-8430-3c98a941c8ae tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:47.582569 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-40db1bda-f18c-40ee-8430-3c98a941c8ae tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" status: 200 len: 1324 microversion: 2.1 time: 0.772535 Aug 03 02:04:47.616234 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1814/3562] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:46 2022] GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e => generated 1324 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:47.734171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-979b8861-65d8-4cf2-b32c-6897594fc65f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:47.736550 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-979b8861-65d8-4cf2-b32c-6897594fc65f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:47.791731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-979b8861-65d8-4cf2-b32c-6897594fc65f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:47.792370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-979b8861-65d8-4cf2-b32c-6897594fc65f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:47.800835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-979b8861-65d8-4cf2-b32c-6897594fc65f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:47.801312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-979b8861-65d8-4cf2-b32c-6897594fc65f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:47.938594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d6c8cf20-5eaf-467b-9a64-03cd7f796fd1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:47.956597 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d6c8cf20-5eaf-467b-9a64-03cd7f796fd1 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1524 microversion: 2.1 time: 0.746800 Aug 03 02:04:47.969148 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1749/3563] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:47 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1524 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:47.975818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1844203282", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:48.072346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] validate_networks() for [('c1556e5c-ee98-4873-8046-a2026aaca40f', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:04:48.536295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-979b8861-65d8-4cf2-b32c-6897594fc65f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:48.561840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-979b8861-65d8-4cf2-b32c-6897594fc65f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:48.571041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-979b8861-65d8-4cf2-b32c-6897594fc65f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:48.575875 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-979b8861-65d8-4cf2-b32c-6897594fc65f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1723 microversion: 2.20 time: 0.848999 Aug 03 02:04:48.592950 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1815/3564] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:04:47 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1723 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:04:48.614489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d76011e4-d3c8-40c2-9934-aebdd2c7b2ab tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:48.616111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d76011e4-d3c8-40c2-9934-aebdd2c7b2ab tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:48.629613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d76011e4-d3c8-40c2-9934-aebdd2c7b2ab tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:48.630478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d76011e4-d3c8-40c2-9934-aebdd2c7b2ab tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:48.631669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d76011e4-d3c8-40c2-9934-aebdd2c7b2ab tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:48.632449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d76011e4-d3c8-40c2-9934-aebdd2c7b2ab tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:49.351949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d76011e4-d3c8-40c2-9934-aebdd2c7b2ab tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658b6ab1ddc4df6b1b7674a3ca0deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbcd11319224cb5a4a68df7ae586618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:49.381562 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d76011e4-d3c8-40c2-9934-aebdd2c7b2ab tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8" status: 200 len: 1505 microversion: 2.1 time: 0.786285 Aug 03 02:04:49.386987 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1816/3565] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:48 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 => generated 1505 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:49.455504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-43250274-352f-4372-8afd-6ea24aafbb3b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:49.457718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-43250274-352f-4372-8afd-6ea24aafbb3b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:49.564448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43250274-352f-4372-8afd-6ea24aafbb3b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:49.567934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43250274-352f-4372-8afd-6ea24aafbb3b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:49.572799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43250274-352f-4372-8afd-6ea24aafbb3b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:49.573305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43250274-352f-4372-8afd-6ea24aafbb3b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:50.109093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-43250274-352f-4372-8afd-6ea24aafbb3b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:50.133482 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-43250274-352f-4372-8afd-6ea24aafbb3b tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" status: 200 len: 1324 microversion: 2.1 time: 0.744165 Aug 03 02:04:50.136145 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1817/3566] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:49 2022] GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e => generated 1324 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:50.152880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03b52621-610e-4f56-88ac-e9c8b71b45c6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:50.159409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-03b52621-610e-4f56-88ac-e9c8b71b45c6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:50.190706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03b52621-610e-4f56-88ac-e9c8b71b45c6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:50.195529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03b52621-610e-4f56-88ac-e9c8b71b45c6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:50.200401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03b52621-610e-4f56-88ac-e9c8b71b45c6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:50.205876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03b52621-610e-4f56-88ac-e9c8b71b45c6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:50.312409 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:04:50.314148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:04:50.315397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:04:50.316937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:04:50.318022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:04:50.365395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:50.365906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:50.366752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:50.384801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:50.511714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Getting quotas for project 78ae2f8c7bef4a959cdfa8c61360e7e5. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:04:50.536204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Getting quotas for user e2c17b2e7e9f4c878826497386ee3ba7 and project 78ae2f8c7bef4a959cdfa8c61360e7e5. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:04:50.597314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:04:50.608016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:04:50.758945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:50.831257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03b52621-610e-4f56-88ac-e9c8b71b45c6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:50.879077 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3e658aa2-0408-4434-9802-dd778c7ea8e2 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.900582 Aug 03 02:04:50.882349 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03b52621-610e-4f56-88ac-e9c8b71b45c6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1524 microversion: 2.1 time: 0.744262 Aug 03 02:04:50.882589 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1750/3567] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:04:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 2912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:04:50.897951 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1818/3568] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:50 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1524 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:50.929167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ba51ae0d-b855-480c-a5c5-d20b0c663384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:50.929787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ba51ae0d-b855-480c-a5c5-d20b0c663384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:50.932331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0f752756-e0d4-41ba-b72d-bc7503a222da tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '.version_select at 0x7f5b1261caf0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:50.934831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0f752756-e0d4-41ba-b72d-bc7503a222da tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:50.967584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f752756-e0d4-41ba-b72d-bc7503a222da tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:50.975679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba51ae0d-b855-480c-a5c5-d20b0c663384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:50.976827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba51ae0d-b855-480c-a5c5-d20b0c663384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:50.978321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f752756-e0d4-41ba-b72d-bc7503a222da tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:50.980282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f752756-e0d4-41ba-b72d-bc7503a222da tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:50.982565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f752756-e0d4-41ba-b72d-bc7503a222da tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:50.983146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba51ae0d-b855-480c-a5c5-d20b0c663384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:50.983745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba51ae0d-b855-480c-a5c5-d20b0c663384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:51.188643 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0f752756-e0d4-41ba-b72d-bc7503a222da tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.300477 Aug 03 02:04:51.196028 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1751/3569] 10.222.0.67 () {58 vars in 1296 bytes} [Wed Aug 3 02:04:50 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8/os-instance-actions => generated 611 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:51.236676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1fa4ae89-9754-4394-8a72-28188c7c1bce tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:51.245768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1fa4ae89-9754-4394-8a72-28188c7c1bce tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:51.505208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1fa4ae89-9754-4394-8a72-28188c7c1bce tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:51.523418 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1fa4ae89-9754-4394-8a72-28188c7c1bce tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1225 microversion: 2.1 time: 0.323218 Aug 03 02:04:51.531220 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1752/3570] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:51 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1225 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:51.562385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bd2a2225-752b-40c2-9e41-8070a7d2558e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:51.565859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bd2a2225-752b-40c2-9e41-8070a7d2558e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:51.617662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd2a2225-752b-40c2-9e41-8070a7d2558e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:51.621123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd2a2225-752b-40c2-9e41-8070a7d2558e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:51.625784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ba51ae0d-b855-480c-a5c5-d20b0c663384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:51.627396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd2a2225-752b-40c2-9e41-8070a7d2558e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:51.635643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd2a2225-752b-40c2-9e41-8070a7d2558e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:51.645647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ba51ae0d-b855-480c-a5c5-d20b0c663384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:51.649078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ba51ae0d-b855-480c-a5c5-d20b0c663384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:51.652347 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ba51ae0d-b855-480c-a5c5-d20b0c663384 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1723 microversion: 2.20 time: 0.750576 Aug 03 02:04:51.657511 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1819/3571] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:04:50 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1723 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:04:51.680810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cbdf0524-80fa-4c99-8621-cab22210fcbf tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:51.682855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cbdf0524-80fa-4c99-8621-cab22210fcbf tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:51.703914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbdf0524-80fa-4c99-8621-cab22210fcbf tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:51.713672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbdf0524-80fa-4c99-8621-cab22210fcbf tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:51.720522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbdf0524-80fa-4c99-8621-cab22210fcbf tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:51.721632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbdf0524-80fa-4c99-8621-cab22210fcbf tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:51.857188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cbdf0524-80fa-4c99-8621-cab22210fcbf tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:04:52.188550 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cbdf0524-80fa-4c99-8621-cab22210fcbf tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8" status: 204 len: 0 microversion: 2.1 time: 0.529292 Aug 03 02:04:52.190666 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1820/3572] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:04:51 2022] DELETE /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:04:52.215967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-743aa168-3e2a-483b-8f63-98d8b2d78e7c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:52.223467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-743aa168-3e2a-483b-8f63-98d8b2d78e7c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:52.244416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-743aa168-3e2a-483b-8f63-98d8b2d78e7c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:52.245408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-743aa168-3e2a-483b-8f63-98d8b2d78e7c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:52.247975 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-743aa168-3e2a-483b-8f63-98d8b2d78e7c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:52.250087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-743aa168-3e2a-483b-8f63-98d8b2d78e7c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:52.298282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bd2a2225-752b-40c2-9e41-8070a7d2558e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:52.344633 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bd2a2225-752b-40c2-9e41-8070a7d2558e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" status: 200 len: 1324 microversion: 2.1 time: 0.811206 Aug 03 02:04:52.348364 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1753/3573] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:51 2022] GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e => generated 1324 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:52.375868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6acf4e41-eada-436a-9e18-ef3f858198ce tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:52.376820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6acf4e41-eada-436a-9e18-ef3f858198ce tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:52.397152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6acf4e41-eada-436a-9e18-ef3f858198ce tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:52.397921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6acf4e41-eada-436a-9e18-ef3f858198ce tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:52.401645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6acf4e41-eada-436a-9e18-ef3f858198ce tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:52.402878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6acf4e41-eada-436a-9e18-ef3f858198ce tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:52.688359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:04:52.934414 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6acf4e41-eada-436a-9e18-ef3f858198ce tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658b6ab1ddc4df6b1b7674a3ca0deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbcd11319224cb5a4a68df7ae586618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:52.936931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-743aa168-3e2a-483b-8f63-98d8b2d78e7c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:52.948770 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-743aa168-3e2a-483b-8f63-98d8b2d78e7c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1524 microversion: 2.1 time: 0.752219 Aug 03 02:04:52.949515 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1821/3574] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:52 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1524 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:52.954334 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6acf4e41-eada-436a-9e18-ef3f858198ce tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8" status: 200 len: 1511 microversion: 2.1 time: 0.601527 Aug 03 02:04:52.955786 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1754/3575] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:52 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 => generated 1511 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:52.956941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-11716448-8049-4f88-9acb-16bd224ec587 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:52.965337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-11716448-8049-4f88-9acb-16bd224ec587 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:52.980996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11716448-8049-4f88-9acb-16bd224ec587 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:52.981865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11716448-8049-4f88-9acb-16bd224ec587 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:52.983122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11716448-8049-4f88-9acb-16bd224ec587 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:52.983987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11716448-8049-4f88-9acb-16bd224ec587 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:52.987520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f1a48b9f-845b-4545-a1e1-df1d75e3a7e2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:52.988154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f1a48b9f-845b-4545-a1e1-df1d75e3a7e2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:53.002080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1a48b9f-845b-4545-a1e1-df1d75e3a7e2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:53.002548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1a48b9f-845b-4545-a1e1-df1d75e3a7e2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:53.004548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1a48b9f-845b-4545-a1e1-df1d75e3a7e2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:53.006111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1a48b9f-845b-4545-a1e1-df1d75e3a7e2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:53.458774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-11716448-8049-4f88-9acb-16bd224ec587 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:53.468141 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-11716448-8049-4f88-9acb-16bd224ec587 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1229 microversion: 2.1 time: 0.517154 Aug 03 02:04:53.472454 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1822/3576] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:52 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1229 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:53.480109 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6dcb818c-7e44-45de-9d36-f0fd9c793216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:53.481782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6dcb818c-7e44-45de-9d36-f0fd9c793216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:53.509476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dcb818c-7e44-45de-9d36-f0fd9c793216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:53.517868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dcb818c-7e44-45de-9d36-f0fd9c793216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:53.524669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dcb818c-7e44-45de-9d36-f0fd9c793216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:53.526506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dcb818c-7e44-45de-9d36-f0fd9c793216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:53.757408 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f1a48b9f-845b-4545-a1e1-df1d75e3a7e2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:53.781730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f1a48b9f-845b-4545-a1e1-df1d75e3a7e2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:53.791530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f1a48b9f-845b-4545-a1e1-df1d75e3a7e2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:53.803432 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f1a48b9f-845b-4545-a1e1-df1d75e3a7e2 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1723 microversion: 2.20 time: 0.844523 Aug 03 02:04:53.809921 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1755/3577] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:04:52 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1723 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:04:53.908812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6dcb818c-7e44-45de-9d36-f0fd9c793216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:53.951508 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6dcb818c-7e44-45de-9d36-f0fd9c793216 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" status: 200 len: 1324 microversion: 2.1 time: 0.469255 Aug 03 02:04:53.958996 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1823/3578] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:53 2022] GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e => generated 1324 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:53.974641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-53c825a0-22f7-43aa-b479-bc840cd99015 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:53.976069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-53c825a0-22f7-43aa-b479-bc840cd99015 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:54.005592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b837e64e-3861-4447-b7bc-a02d26a3991f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:54.006582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b837e64e-3861-4447-b7bc-a02d26a3991f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:54.010303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53c825a0-22f7-43aa-b479-bc840cd99015 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:54.015332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53c825a0-22f7-43aa-b479-bc840cd99015 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:54.019165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53c825a0-22f7-43aa-b479-bc840cd99015 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:54.020611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53c825a0-22f7-43aa-b479-bc840cd99015 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:54.031175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b837e64e-3861-4447-b7bc-a02d26a3991f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:54.033192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b837e64e-3861-4447-b7bc-a02d26a3991f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:54.035927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b837e64e-3861-4447-b7bc-a02d26a3991f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:54.038887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b837e64e-3861-4447-b7bc-a02d26a3991f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:55.409367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b837e64e-3861-4447-b7bc-a02d26a3991f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658b6ab1ddc4df6b1b7674a3ca0deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbcd11319224cb5a4a68df7ae586618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:55.423008 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b837e64e-3861-4447-b7bc-a02d26a3991f tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8" status: 200 len: 1511 microversion: 2.1 time: 1.426689 Aug 03 02:04:55.426464 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1824/3579] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:53 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 => generated 1511 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:55.455145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-19df5c24-6b96-4ad2-a203-fae8fe17eda8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:55.456803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-19df5c24-6b96-4ad2-a203-fae8fe17eda8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:55.488005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19df5c24-6b96-4ad2-a203-fae8fe17eda8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:55.494510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19df5c24-6b96-4ad2-a203-fae8fe17eda8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:55.498522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19df5c24-6b96-4ad2-a203-fae8fe17eda8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:55.503229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19df5c24-6b96-4ad2-a203-fae8fe17eda8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:55.580694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-53c825a0-22f7-43aa-b479-bc840cd99015 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:55.602224 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-53c825a0-22f7-43aa-b479-bc840cd99015 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1524 microversion: 2.1 time: 1.631568 Aug 03 02:04:55.606814 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1756/3580] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:53 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1524 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:55.631381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-27a669c2-aa9c-4155-83a5-5c9645211b6a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:55.634203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-27a669c2-aa9c-4155-83a5-5c9645211b6a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:55.658665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27a669c2-aa9c-4155-83a5-5c9645211b6a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:55.663704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27a669c2-aa9c-4155-83a5-5c9645211b6a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:55.664654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27a669c2-aa9c-4155-83a5-5c9645211b6a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:55.666198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27a669c2-aa9c-4155-83a5-5c9645211b6a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:55.952690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-19df5c24-6b96-4ad2-a203-fae8fe17eda8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:55.976242 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-19df5c24-6b96-4ad2-a203-fae8fe17eda8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1283 microversion: 2.1 time: 0.546665 Aug 03 02:04:55.979565 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1825/3581] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:55 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1283 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:56.002630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eed03d2d-5edc-4c53-9d7e-7cbf6eb0b1d1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:56.010432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eed03d2d-5edc-4c53-9d7e-7cbf6eb0b1d1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:56.026963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed03d2d-5edc-4c53-9d7e-7cbf6eb0b1d1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:56.045000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed03d2d-5edc-4c53-9d7e-7cbf6eb0b1d1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:56.050733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed03d2d-5edc-4c53-9d7e-7cbf6eb0b1d1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:56.061273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed03d2d-5edc-4c53-9d7e-7cbf6eb0b1d1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:56.783384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-27a669c2-aa9c-4155-83a5-5c9645211b6a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:56.811528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-27a669c2-aa9c-4155-83a5-5c9645211b6a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:56.828126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-27a669c2-aa9c-4155-83a5-5c9645211b6a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:56.829782 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-27a669c2-aa9c-4155-83a5-5c9645211b6a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1723 microversion: 2.20 time: 1.218426 Aug 03 02:04:56.831044 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1757/3582] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:04:55 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1723 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:04:56.860416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4052df35-5e20-4f5d-84a0-d445d94b9f4b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:56.862576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4052df35-5e20-4f5d-84a0-d445d94b9f4b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:56.877277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4052df35-5e20-4f5d-84a0-d445d94b9f4b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:56.883637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4052df35-5e20-4f5d-84a0-d445d94b9f4b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:56.887383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4052df35-5e20-4f5d-84a0-d445d94b9f4b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:56.891552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4052df35-5e20-4f5d-84a0-d445d94b9f4b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:57.035271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-eed03d2d-5edc-4c53-9d7e-7cbf6eb0b1d1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:57.057273 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eed03d2d-5edc-4c53-9d7e-7cbf6eb0b1d1 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" status: 200 len: 1324 microversion: 2.1 time: 1.067002 Aug 03 02:04:57.058187 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1826/3583] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:55 2022] GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e => generated 1324 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:57.069088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6b947933-0b0d-42c4-a2d5-17417eaf79d0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:57.074619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6b947933-0b0d-42c4-a2d5-17417eaf79d0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:57.098731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b947933-0b0d-42c4-a2d5-17417eaf79d0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:57.101150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b947933-0b0d-42c4-a2d5-17417eaf79d0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:57.106577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b947933-0b0d-42c4-a2d5-17417eaf79d0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:57.108255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b947933-0b0d-42c4-a2d5-17417eaf79d0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:57.183909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4052df35-5e20-4f5d-84a0-d445d94b9f4b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6658b6ab1ddc4df6b1b7674a3ca0deb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcbcd11319224cb5a4a68df7ae586618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:57.222978 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4052df35-5e20-4f5d-84a0-d445d94b9f4b tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8" status: 200 len: 1469 microversion: 2.1 time: 0.390066 Aug 03 02:04:57.229992 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1758/3584] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:56 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 => generated 1469 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:57.260810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5ce8e47b-938a-4b90-b4ba-ce5981c631a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:57.267134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5ce8e47b-938a-4b90-b4ba-ce5981c631a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:57.303378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ce8e47b-938a-4b90-b4ba-ce5981c631a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:57.308229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ce8e47b-938a-4b90-b4ba-ce5981c631a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:57.310122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ce8e47b-938a-4b90-b4ba-ce5981c631a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:57.313399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ce8e47b-938a-4b90-b4ba-ce5981c631a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:57.498967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5ce8e47b-938a-4b90-b4ba-ce5981c631a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:57.540762 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5ce8e47b-938a-4b90-b4ba-ce5981c631a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1283 microversion: 2.1 time: 0.299154 Aug 03 02:04:57.581581 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1759/3585] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:57 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1283 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:57.690868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-bd6c1a28-0e65-4018-95ae-1aae1026319d req-06b38689-bf56-4722-9365-97d8dc6e8ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e", "name": "network-vif-plugged", "status": "completed", "tag": "52d7951f-c056-422b-91e9-87c1ee53edc8"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:57.755033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bd6c1a28-0e65-4018-95ae-1aae1026319d req-06b38689-bf56-4722-9365-97d8dc6e8ab5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:57.755830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bd6c1a28-0e65-4018-95ae-1aae1026319d req-06b38689-bf56-4722-9365-97d8dc6e8ab5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:57.822750 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-bd6c1a28-0e65-4018-95ae-1aae1026319d req-06b38689-bf56-4722-9365-97d8dc6e8ab5 service nova] Creating event network-vif-plugged:52d7951f-c056-422b-91e9-87c1ee53edc8 for instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e on n-h1-826529-8 Aug 03 02:04:57.867910 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-bd6c1a28-0e65-4018-95ae-1aae1026319d req-06b38689-bf56-4722-9365-97d8dc6e8ab5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181233 Aug 03 02:04:57.870194 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1760/3586] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:57.913878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-c01f053f-3f5a-427c-9be6-db2ec4763aa5 req-3760b777-fb28-4011-a25a-178277bb12d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67eb11b-0d41-49a9-98a8-41290b4dfaa8", "name": "network-vif-deleted", "tag": "93d381ca-4ee5-4e97-bc0d-9e91089a2a37"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:04:57.949888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c01f053f-3f5a-427c-9be6-db2ec4763aa5 req-3760b777-fb28-4011-a25a-178277bb12d4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:57.950339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c01f053f-3f5a-427c-9be6-db2ec4763aa5 req-3760b777-fb28-4011-a25a-178277bb12d4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:57.991119 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c01f053f-3f5a-427c-9be6-db2ec4763aa5 req-3760b777-fb28-4011-a25a-178277bb12d4 service nova] Creating event network-vif-deleted:93d381ca-4ee5-4e97-bc0d-9e91089a2a37 for instance d67eb11b-0d41-49a9-98a8-41290b4dfaa8 on n-h2-826529-8 Aug 03 02:04:58.002438 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-c01f053f-3f5a-427c-9be6-db2ec4763aa5 req-3760b777-fb28-4011-a25a-178277bb12d4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127648 Aug 03 02:04:58.012375 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1761/3587] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:04:58.018158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-621871d3-455b-4cee-b3af-6001a3be9e00 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:58.019589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-621871d3-455b-4cee-b3af-6001a3be9e00 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:58.042722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-621871d3-455b-4cee-b3af-6001a3be9e00 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:58.051185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-621871d3-455b-4cee-b3af-6001a3be9e00 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:58.052733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-621871d3-455b-4cee-b3af-6001a3be9e00 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:58.052733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-621871d3-455b-4cee-b3af-6001a3be9e00 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:58.131808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6b947933-0b0d-42c4-a2d5-17417eaf79d0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:58.153220 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6b947933-0b0d-42c4-a2d5-17417eaf79d0 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1524 microversion: 2.1 time: 1.093640 Aug 03 02:04:58.153839 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1827/3588] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:57 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1524 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:04:58.184053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0cf7cdda-e1c3-4de5-a394-95e485a1c151 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:58.189855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0cf7cdda-e1c3-4de5-a394-95e485a1c151 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:58.230894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cf7cdda-e1c3-4de5-a394-95e485a1c151 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:58.234187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cf7cdda-e1c3-4de5-a394-95e485a1c151 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:58.237944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cf7cdda-e1c3-4de5-a394-95e485a1c151 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:58.238660 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cf7cdda-e1c3-4de5-a394-95e485a1c151 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:58.966813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-621871d3-455b-4cee-b3af-6001a3be9e00 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:59.022290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-621871d3-455b-4cee-b3af-6001a3be9e00 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:59.034756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-621871d3-455b-4cee-b3af-6001a3be9e00 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:04:59.037272 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-621871d3-455b-4cee-b3af-6001a3be9e00 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1723 microversion: 2.20 time: 1.022939 Aug 03 02:04:59.039314 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1762/3589] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:04:58 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1723 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:04:59.065277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8cd5d615-124d-4341-8886-fbd2d585c8ac tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:59.072977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8cd5d615-124d-4341-8886-fbd2d585c8ac tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] [instance: d67eb11b-0d41-49a9-98a8-41290b4dfaa8] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:59.098295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8cd5d615-124d-4341-8886-fbd2d585c8ac tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:59.106648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8cd5d615-124d-4341-8886-fbd2d585c8ac tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:59.109033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8cd5d615-124d-4341-8886-fbd2d585c8ac tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:59.112063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8cd5d615-124d-4341-8886-fbd2d585c8ac tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:59.156885 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-8cd5d615-124d-4341-8886-fbd2d585c8ac tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] HTTP exception thrown: Instance d67eb11b-0d41-49a9-98a8-41290b4dfaa8 could not be found. Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8cd5d615-124d-4341-8886-fbd2d585c8ac tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Request method failure captured: Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 HTTP/1.1 Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6derk-s1hngYWrlarr_vNId2IM2nRQEbmszBaHKpz5HD89z8LoXlZFFfQugrWSY5jC9U0mCI3guZWwvYk6OLKcowYnns7zenEliXBAAJqKRWahBBw57g8Y2r7L54JFy7XXb1e3WO8ArUdYo2bRqI8lXA_QQupYuM-FvNifdbUGz-5Dk Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: bcbcd11319224cb5a4a68df7ae586618 Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-InstanceActionsTestJSON-1220766643 Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bcbcd11319224cb5a4a68df7ae586618", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bcbcd11319224cb5a4a68df7ae586618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bcbcd11319224cb5a4a68df7ae586618"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bcbcd11319224cb5a4a68df7ae586618"}]}] Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-InstanceActionsTestJSON-1220766643 Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: bcbcd11319224cb5a4a68df7ae586618 Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1220766643 Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-InstanceActionsTestJSON-1220766643-project Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 6658b6ab1ddc4df6b1b7674a3ca0deb0 Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-InstanceActionsTestJSON-1220766643-project Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance d67eb11b-0d41-49a9-98a8-41290b4dfaa8 could not be found. Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'd67eb11b-0d41-49a9-98a8-41290b4dfaa8'} Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67eb11b-0d41-49a9-98a8-41290b4dfaa8 could not be found. Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67eb11b-0d41-49a9-98a8-41290b4dfaa8 could not be found. Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:04:59.162250 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:59.184423 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:04:59.184423 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:04:59.184423 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:04:59.184423 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:04:59.184423 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:04:59.184423 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67eb11b-0d41-49a9-98a8-41290b4dfaa8 could not be found. Aug 03 02:04:59.184423 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:04:59.184423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8cd5d615-124d-4341-8886-fbd2d585c8ac tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] Returning 404 to user: Instance d67eb11b-0d41-49a9-98a8-41290b4dfaa8 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:04:59.184423 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8cd5d615-124d-4341-8886-fbd2d585c8ac tempest-InstanceActionsTestJSON-1220766643 tempest-InstanceActionsTestJSON-1220766643-project] 10.222.0.67 "GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8" status: 404 len: 111 microversion: 2.1 time: 0.131674 Aug 03 02:04:59.192094 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1763/3590] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:59 2022] GET /compute/v2.1/servers/d67eb11b-0d41-49a9-98a8-41290b4dfaa8 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:04:59.202304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b95a6a77-3574-4dce-bdf1-19a1b6d1faf8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:04:59.203980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b95a6a77-3574-4dce-bdf1-19a1b6d1faf8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:04:59.218743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b95a6a77-3574-4dce-bdf1-19a1b6d1faf8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:59.219983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b95a6a77-3574-4dce-bdf1-19a1b6d1faf8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:04:59.221800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b95a6a77-3574-4dce-bdf1-19a1b6d1faf8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:04:59.222890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b95a6a77-3574-4dce-bdf1-19a1b6d1faf8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:00.397022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0cf7cdda-e1c3-4de5-a394-95e485a1c151 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:00.403408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:05:00.417697 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0cf7cdda-e1c3-4de5-a394-95e485a1c151 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" status: 200 len: 1324 microversion: 2.1 time: 2.260559 Aug 03 02:05:00.421647 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1828/3591] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:58 2022] GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e => generated 1324 bytes in 2267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:00.426981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5bf58621-f6db-446c-a075-74c92819d6fe tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:00.432607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5bf58621-f6db-446c-a075-74c92819d6fe tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:00.442604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:05:00.456714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bf58621-f6db-446c-a075-74c92819d6fe tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:00.457355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bf58621-f6db-446c-a075-74c92819d6fe tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:00.458308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bf58621-f6db-446c-a075-74c92819d6fe tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:00.460474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bf58621-f6db-446c-a075-74c92819d6fe tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:00.799230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b95a6a77-3574-4dce-bdf1-19a1b6d1faf8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:00.815774 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b95a6a77-3574-4dce-bdf1-19a1b6d1faf8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1325 microversion: 2.1 time: 1.621389 Aug 03 02:05:00.817848 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1764/3592] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:04:59 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1325 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:00.831707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-26592104-7165-4332-bbaa-7b74e7f4f482 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:00.850194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-26592104-7165-4332-bbaa-7b74e7f4f482 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:00.880686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26592104-7165-4332-bbaa-7b74e7f4f482 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:00.887302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26592104-7165-4332-bbaa-7b74e7f4f482 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:00.889392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26592104-7165-4332-bbaa-7b74e7f4f482 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:00.890331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26592104-7165-4332-bbaa-7b74e7f4f482 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:01.236022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5bf58621-f6db-446c-a075-74c92819d6fe tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:01.250554 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5bf58621-f6db-446c-a075-74c92819d6fe tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1524 microversion: 2.1 time: 0.826887 Aug 03 02:05:01.253071 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1829/3593] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:00 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1524 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:01.295066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-26592104-7165-4332-bbaa-7b74e7f4f482 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:01.311429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-26592104-7165-4332-bbaa-7b74e7f4f482 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:01.313239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-26592104-7165-4332-bbaa-7b74e7f4f482 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:01.317167 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-26592104-7165-4332-bbaa-7b74e7f4f482 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1744 microversion: 2.20 time: 0.489450 Aug 03 02:05:01.320360 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1765/3594] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:05:00 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1744 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:05:01.452580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-27e75418-080a-475c-a773-d93e4359f95a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:01.453285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-27e75418-080a-475c-a773-d93e4359f95a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:01.465032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27e75418-080a-475c-a773-d93e4359f95a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:01.465627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27e75418-080a-475c-a773-d93e4359f95a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:01.467145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27e75418-080a-475c-a773-d93e4359f95a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:01.467683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27e75418-080a-475c-a773-d93e4359f95a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:01.857643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f1a6f074-7491-4d94-94d1-77cd3b34ef53 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:01.859033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f1a6f074-7491-4d94-94d1-77cd3b34ef53 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:01.888410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:05:01.890994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1a6f074-7491-4d94-94d1-77cd3b34ef53 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:01.891696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1a6f074-7491-4d94-94d1-77cd3b34ef53 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:01.893497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1a6f074-7491-4d94-94d1-77cd3b34ef53 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:01.894157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1a6f074-7491-4d94-94d1-77cd3b34ef53 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:02.763856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-27e75418-080a-475c-a773-d93e4359f95a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:02.791988 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-27e75418-080a-475c-a773-d93e4359f95a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" status: 200 len: 1521 microversion: 2.1 time: 1.343193 Aug 03 02:05:02.816029 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1830/3595] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:01 2022] GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e => generated 1521 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:05:02.831673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2e0e461b-7339-408e-a4cd-058f5ef7661d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:02.832332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2e0e461b-7339-408e-a4cd-058f5ef7661d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:02.876994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e0e461b-7339-408e-a4cd-058f5ef7661d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:02.878027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e0e461b-7339-408e-a4cd-058f5ef7661d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:02.878888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e0e461b-7339-408e-a4cd-058f5ef7661d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:02.893100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e0e461b-7339-408e-a4cd-058f5ef7661d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:02.974169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f1a6f074-7491-4d94-94d1-77cd3b34ef53 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:02.993129 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f1a6f074-7491-4d94-94d1-77cd3b34ef53 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1325 microversion: 2.1 time: 1.151562 Aug 03 02:05:02.994604 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1766/3596] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:01 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1325 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:05:03.010032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3a56186d-d6d1-4200-9d4e-7dcb2981199d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:03.016776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3a56186d-d6d1-4200-9d4e-7dcb2981199d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:03.033968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a56186d-d6d1-4200-9d4e-7dcb2981199d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:03.043356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a56186d-d6d1-4200-9d4e-7dcb2981199d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:03.044817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a56186d-d6d1-4200-9d4e-7dcb2981199d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:03.045515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a56186d-d6d1-4200-9d4e-7dcb2981199d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:03.137791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:05:03.762570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2e0e461b-7339-408e-a4cd-058f5ef7661d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:03.783793 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2e0e461b-7339-408e-a4cd-058f5ef7661d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1524 microversion: 2.1 time: 0.966196 Aug 03 02:05:03.785397 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1831/3597] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:02 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1524 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:03.808632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-85d8cac9-5a3c-4640-a0ad-2bad648bd717 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.225"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:03.821791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-85d8cac9-5a3c-4640-a0ad-2bad648bd717 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:03.835280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85d8cac9-5a3c-4640-a0ad-2bad648bd717 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:03.837276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85d8cac9-5a3c-4640-a0ad-2bad648bd717 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:03.838754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85d8cac9-5a3c-4640-a0ad-2bad648bd717 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:03.854635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85d8cac9-5a3c-4640-a0ad-2bad648bd717 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:03.944426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3a56186d-d6d1-4200-9d4e-7dcb2981199d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:03.968313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3a56186d-d6d1-4200-9d4e-7dcb2981199d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:03.989705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3a56186d-d6d1-4200-9d4e-7dcb2981199d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:03.991437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85d8cac9-5a3c-4640-a0ad-2bad648bd717 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Acquired lock "refresh_cache-407c74a8-e6f7-4146-8b2d-842fa10fbded" {{(pid=125941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 02:05:03.997742 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3a56186d-d6d1-4200-9d4e-7dcb2981199d tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1739 microversion: 2.20 time: 1.001841 Aug 03 02:05:04.009823 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1767/3598] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:05:02 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1739 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:05:04.025045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ef799af6-636b-4eac-9be2-61644af7f37b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:04.026171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ef799af6-636b-4eac-9be2-61644af7f37b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:04.043465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef799af6-636b-4eac-9be2-61644af7f37b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:04.047592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef799af6-636b-4eac-9be2-61644af7f37b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:04.049205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef799af6-636b-4eac-9be2-61644af7f37b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:04.057768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef799af6-636b-4eac-9be2-61644af7f37b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:04.771749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ef799af6-636b-4eac-9be2-61644af7f37b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:04.789703 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ef799af6-636b-4eac-9be2-61644af7f37b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1325 microversion: 2.1 time: 0.769019 Aug 03 02:05:04.790607 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1768/3599] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:04 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1325 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:05:04.817718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d5f555c9-0ddf-4adc-acb1-557542afc337 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:04.824532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d5f555c9-0ddf-4adc-acb1-557542afc337 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:04.841515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5f555c9-0ddf-4adc-acb1-557542afc337 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:04.843487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5f555c9-0ddf-4adc-acb1-557542afc337 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:04.844602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5f555c9-0ddf-4adc-acb1-557542afc337 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:04.852009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5f555c9-0ddf-4adc-acb1-557542afc337 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:07.469940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d5f555c9-0ddf-4adc-acb1-557542afc337 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:07.484633 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d5f555c9-0ddf-4adc-acb1-557542afc337 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1524 microversion: 2.1 time: 2.675191 Aug 03 02:05:07.501261 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1769/3600] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:04 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1524 bytes in 2695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:07.516917 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f2bc9f71-2a20-4513-9104-e7c085d0b85c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:07.520665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f2bc9f71-2a20-4513-9104-e7c085d0b85c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:07.542794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2bc9f71-2a20-4513-9104-e7c085d0b85c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:07.543748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2bc9f71-2a20-4513-9104-e7c085d0b85c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:07.544850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2bc9f71-2a20-4513-9104-e7c085d0b85c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:07.545550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2bc9f71-2a20-4513-9104-e7c085d0b85c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:09.134297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f2bc9f71-2a20-4513-9104-e7c085d0b85c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:09.153811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f2bc9f71-2a20-4513-9104-e7c085d0b85c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:09.159513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f2bc9f71-2a20-4513-9104-e7c085d0b85c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:09.160774 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f2bc9f71-2a20-4513-9104-e7c085d0b85c tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1739 microversion: 2.20 time: 1.658293 Aug 03 02:05:09.197564 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1770/3601] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:05:07 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1739 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:05:09.210870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-05a60cc5-43bb-4148-bffe-d4ca7364901e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:09.215312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-05a60cc5-43bb-4148-bffe-d4ca7364901e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:09.240540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05a60cc5-43bb-4148-bffe-d4ca7364901e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:09.241325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05a60cc5-43bb-4148-bffe-d4ca7364901e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:09.242717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05a60cc5-43bb-4148-bffe-d4ca7364901e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:09.251615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05a60cc5-43bb-4148-bffe-d4ca7364901e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:09.835302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-85d8cac9-5a3c-4640-a0ad-2bad648bd717 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Building network info cache for instance {{(pid=125941) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 02:05:10.035633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-05a60cc5-43bb-4148-bffe-d4ca7364901e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:10.067830 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-05a60cc5-43bb-4148-bffe-d4ca7364901e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1325 microversion: 2.1 time: 0.864796 Aug 03 02:05:10.069735 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1771/3602] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:09 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1325 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:10.101630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-a37dddb3-3723-444b-9bb5-253ad3496e54 req-a6a84835-f7ca-4c6d-b1c4-3a5cfac65082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ce11775-ab73-457e-8799-239915dc2406", "name": "network-vif-plugged", "status": "completed", "tag": "12c644d8-021b-4605-8e3c-16ff33d29cd1"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:10.151808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a37dddb3-3723-444b-9bb5-253ad3496e54 req-a6a84835-f7ca-4c6d-b1c4-3a5cfac65082 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:10.153824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a37dddb3-3723-444b-9bb5-253ad3496e54 req-a6a84835-f7ca-4c6d-b1c4-3a5cfac65082 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:10.195376 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-a37dddb3-3723-444b-9bb5-253ad3496e54 req-a6a84835-f7ca-4c6d-b1c4-3a5cfac65082 service nova] Creating event network-vif-plugged:12c644d8-021b-4605-8e3c-16ff33d29cd1 for instance 9ce11775-ab73-457e-8799-239915dc2406 on n-h2-826529-8 Aug 03 02:05:10.211450 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-a37dddb3-3723-444b-9bb5-253ad3496e54 req-a6a84835-f7ca-4c6d-b1c4-3a5cfac65082 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138652 Aug 03 02:05:10.215094 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1772/3603] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:10.225738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-53597218-982e-441d-9b77-a67396ccc813 req-383d01c5-02d7-4d69-96af-1c1ff0c2d764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d899e1f4-ca44-4ab5-bda0-97d7e101bf2d", "tag": "d36319d8-ba29-46b8-bb38-02c46a6360e6"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:10.312459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-53597218-982e-441d-9b77-a67396ccc813 req-383d01c5-02d7-4d69-96af-1c1ff0c2d764 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:10.316608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-53597218-982e-441d-9b77-a67396ccc813 req-383d01c5-02d7-4d69-96af-1c1ff0c2d764 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:10.402841 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-53597218-982e-441d-9b77-a67396ccc813 req-383d01c5-02d7-4d69-96af-1c1ff0c2d764 service nova] Creating event network-changed:d36319d8-ba29-46b8-bb38-02c46a6360e6 for instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d on n-h1-826529-8 Aug 03 02:05:10.420850 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-53597218-982e-441d-9b77-a67396ccc813 req-383d01c5-02d7-4d69-96af-1c1ff0c2d764 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202920 Aug 03 02:05:10.428422 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1773/3604] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:10.440779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e0c8cd02-0bcf-4e2e-9f75-46236ccfc698 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:10.445760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e0c8cd02-0bcf-4e2e-9f75-46236ccfc698 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:10.456736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0c8cd02-0bcf-4e2e-9f75-46236ccfc698 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:10.457678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0c8cd02-0bcf-4e2e-9f75-46236ccfc698 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:10.459348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0c8cd02-0bcf-4e2e-9f75-46236ccfc698 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:10.460060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e0c8cd02-0bcf-4e2e-9f75-46236ccfc698 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:11.262773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e0c8cd02-0bcf-4e2e-9f75-46236ccfc698 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:11.283892 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e0c8cd02-0bcf-4e2e-9f75-46236ccfc698 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1524 microversion: 2.1 time: 0.853816 Aug 03 02:05:11.290478 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1774/3605] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:10 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1524 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:11.300523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-90f51f19-85d8-49c2-8110-6ae27a68f294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:11.307866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-90f51f19-85d8-49c2-8110-6ae27a68f294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:11.315837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90f51f19-85d8-49c2-8110-6ae27a68f294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:11.316579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90f51f19-85d8-49c2-8110-6ae27a68f294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:11.317762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90f51f19-85d8-49c2-8110-6ae27a68f294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:11.318382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90f51f19-85d8-49c2-8110-6ae27a68f294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:12.621034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-90f51f19-85d8-49c2-8110-6ae27a68f294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:12.639528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-90f51f19-85d8-49c2-8110-6ae27a68f294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:12.648635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-90f51f19-85d8-49c2-8110-6ae27a68f294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:12.651329 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-90f51f19-85d8-49c2-8110-6ae27a68f294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1739 microversion: 2.20 time: 1.359137 Aug 03 02:05:12.651943 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1775/3606] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:05:11 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1739 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:05:12.671378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-faa00d75-a6c3-408b-b4ef-1a1301b94b3d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:12.672011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-faa00d75-a6c3-408b-b4ef-1a1301b94b3d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:12.712339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-faa00d75-a6c3-408b-b4ef-1a1301b94b3d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:12.713211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-faa00d75-a6c3-408b-b4ef-1a1301b94b3d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:12.714278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-faa00d75-a6c3-408b-b4ef-1a1301b94b3d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:12.714735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-faa00d75-a6c3-408b-b4ef-1a1301b94b3d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:13.693567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-85d8cac9-5a3c-4640-a0ad-2bad648bd717 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Updating instance_info_cache with network_info: [{"id": "a6e067d4-bea0-49c9-b26b-8af45883186c", "address": "fa:16:3e:17:d1:36", "network": {"id": "019fe6d8-1b74-4afa-8697-7fe379f8a53a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1371263325-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fb5f76083896407f8fbedf0c61c6f793", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa6e067d4-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125941) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 02:05:13.726654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85d8cac9-5a3c-4640-a0ad-2bad648bd717 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Releasing lock "refresh_cache-407c74a8-e6f7-4146-8b2d-842fa10fbded" {{(pid=125941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 02:05:13.729320 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-85d8cac9-5a3c-4640-a0ad-2bad648bd717 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "POST /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded/action" status: 202 len: 0 microversion: 2.1 time: 9.925517 Aug 03 02:05:13.737147 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1832/3607] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:05:03 2022] POST /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded/action => generated 0 bytes in 9948 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 02:05:13.770442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2ed6ac32-0ea8-454d-b246-4b26b50e3fc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:13.777377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2ed6ac32-0ea8-454d-b246-4b26b50e3fc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:13.802189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ed6ac32-0ea8-454d-b246-4b26b50e3fc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:13.803206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ed6ac32-0ea8-454d-b246-4b26b50e3fc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:13.804506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ed6ac32-0ea8-454d-b246-4b26b50e3fc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:13.806679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ed6ac32-0ea8-454d-b246-4b26b50e3fc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:14.463274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-faa00d75-a6c3-408b-b4ef-1a1301b94b3d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:14.471018 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-faa00d75-a6c3-408b-b4ef-1a1301b94b3d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1325 microversion: 2.1 time: 1.817989 Aug 03 02:05:14.492008 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1776/3608] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:12 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1325 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:14.498935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-1d8a5539-5513-45bc-a2b6-46814218ee92 req-10c15d8b-b0a6-4b64-a51c-4bd6b77fc3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "407c74a8-e6f7-4146-8b2d-842fa10fbded", "tag": "a6e067d4-bea0-49c9-b26b-8af45883186c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:14.507642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2ed6ac32-0ea8-454d-b246-4b26b50e3fc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:14.521097 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2ed6ac32-0ea8-454d-b246-4b26b50e3fc2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1524 microversion: 2.1 time: 0.778663 Aug 03 02:05:14.528406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1d8a5539-5513-45bc-a2b6-46814218ee92 req-10c15d8b-b0a6-4b64-a51c-4bd6b77fc3d8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:14.539292 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1833/3609] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:13 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1524 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:14.548616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1d8a5539-5513-45bc-a2b6-46814218ee92 req-10c15d8b-b0a6-4b64-a51c-4bd6b77fc3d8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:14.559000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-433990f8-5845-46c5-815f-840b01b942e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:14.560237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-433990f8-5845-46c5-815f-840b01b942e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:14.572075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-433990f8-5845-46c5-815f-840b01b942e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:14.573380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-433990f8-5845-46c5-815f-840b01b942e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:14.575522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-433990f8-5845-46c5-815f-840b01b942e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:14.576498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-433990f8-5845-46c5-815f-840b01b942e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:14.577213 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-1d8a5539-5513-45bc-a2b6-46814218ee92 req-10c15d8b-b0a6-4b64-a51c-4bd6b77fc3d8 service nova] Creating event network-changed:a6e067d4-bea0-49c9-b26b-8af45883186c for instance 407c74a8-e6f7-4146-8b2d-842fa10fbded on n-h1-826529-8 Aug 03 02:05:14.589672 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-1d8a5539-5513-45bc-a2b6-46814218ee92 req-10c15d8b-b0a6-4b64-a51c-4bd6b77fc3d8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095118 Aug 03 02:05:14.591072 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1777/3610] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:14.619044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-abef5924-164f-4fdd-9c05-d3d6ee9ac575 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.225"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:14.622017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-abef5924-164f-4fdd-9c05-d3d6ee9ac575 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:14.643759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abef5924-164f-4fdd-9c05-d3d6ee9ac575 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:14.647461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abef5924-164f-4fdd-9c05-d3d6ee9ac575 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:14.650013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abef5924-164f-4fdd-9c05-d3d6ee9ac575 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:14.651939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abef5924-164f-4fdd-9c05-d3d6ee9ac575 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:14.703120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abef5924-164f-4fdd-9c05-d3d6ee9ac575 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Acquired lock "refresh_cache-ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" {{(pid=125942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 02:05:15.655901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-433990f8-5845-46c5-815f-840b01b942e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:15.690632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-433990f8-5845-46c5-815f-840b01b942e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:15.700738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-433990f8-5845-46c5-815f-840b01b942e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:15.710604 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-433990f8-5845-46c5-815f-840b01b942e9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1739 microversion: 2.20 time: 1.169519 Aug 03 02:05:15.715703 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1834/3611] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:05:14 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1739 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:05:15.740776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-46f6353f-f3fc-4fff-9d23-ed643fde7ff0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:15.749818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-46f6353f-f3fc-4fff-9d23-ed643fde7ff0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:15.770332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46f6353f-f3fc-4fff-9d23-ed643fde7ff0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:15.770795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46f6353f-f3fc-4fff-9d23-ed643fde7ff0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:15.777127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46f6353f-f3fc-4fff-9d23-ed643fde7ff0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:15.777127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46f6353f-f3fc-4fff-9d23-ed643fde7ff0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:17.979321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-46f6353f-f3fc-4fff-9d23-ed643fde7ff0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:17.993312 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-46f6353f-f3fc-4fff-9d23-ed643fde7ff0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1325 microversion: 2.1 time: 2.275965 Aug 03 02:05:18.012421 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1835/3612] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:15 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1325 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:18.017565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7871fb1b-0e93-44ba-923b-d024e3f21e6a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:18.018191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7871fb1b-0e93-44ba-923b-d024e3f21e6a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:18.020243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:05:18.040237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7871fb1b-0e93-44ba-923b-d024e3f21e6a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:18.044441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7871fb1b-0e93-44ba-923b-d024e3f21e6a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:18.045356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7871fb1b-0e93-44ba-923b-d024e3f21e6a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:18.045812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7871fb1b-0e93-44ba-923b-d024e3f21e6a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:18.396329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7871fb1b-0e93-44ba-923b-d024e3f21e6a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:18.419166 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7871fb1b-0e93-44ba-923b-d024e3f21e6a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1506 microversion: 2.1 time: 0.405039 Aug 03 02:05:18.419774 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1836/3613] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:18 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:18.458541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-12d8ad55-16ca-4223-909e-e6beb671f119 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:18.465124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-12d8ad55-16ca-4223-909e-e6beb671f119 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:18.487388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-12d8ad55-16ca-4223-909e-e6beb671f119 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:18.487830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-12d8ad55-16ca-4223-909e-e6beb671f119 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:18.491292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-12d8ad55-16ca-4223-909e-e6beb671f119 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:18.491932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-12d8ad55-16ca-4223-909e-e6beb671f119 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:19.990363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-12d8ad55-16ca-4223-909e-e6beb671f119 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:20.020391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-12d8ad55-16ca-4223-909e-e6beb671f119 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:20.033434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-12d8ad55-16ca-4223-909e-e6beb671f119 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:20.041811 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-12d8ad55-16ca-4223-909e-e6beb671f119 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1739 microversion: 2.20 time: 1.601907 Aug 03 02:05:20.050001 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1837/3614] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:05:18 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1739 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:05:20.056015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a6679a4e-1c88-43fb-90c2-6a5416f3bcb1 req-eb809aee-cbee-429b-898c-61fdb15d90af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fea7f2e-eb34-40c8-8171-11e0a65bae4a", "name": "network-vif-unplugged", "status": "completed", "tag": "e1ea085a-3d24-4a01-addc-213948d9671b"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:20.100797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a6679a4e-1c88-43fb-90c2-6a5416f3bcb1 req-eb809aee-cbee-429b-898c-61fdb15d90af service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:20.101247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a6679a4e-1c88-43fb-90c2-6a5416f3bcb1 req-eb809aee-cbee-429b-898c-61fdb15d90af service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:20.134621 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a6679a4e-1c88-43fb-90c2-6a5416f3bcb1 req-eb809aee-cbee-429b-898c-61fdb15d90af service nova] Creating event network-vif-unplugged:e1ea085a-3d24-4a01-addc-213948d9671b for instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a on n-h2-826529-8 Aug 03 02:05:20.153954 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a6679a4e-1c88-43fb-90c2-6a5416f3bcb1 req-eb809aee-cbee-429b-898c-61fdb15d90af service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101663 Aug 03 02:05:20.164899 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1838/3615] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:20.169711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c79083be-9f39-4421-af08-bd942c1e4c0c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:20.175491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c79083be-9f39-4421-af08-bd942c1e4c0c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:20.193695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c79083be-9f39-4421-af08-bd942c1e4c0c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:20.195186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c79083be-9f39-4421-af08-bd942c1e4c0c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:20.197630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c79083be-9f39-4421-af08-bd942c1e4c0c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:20.202781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c79083be-9f39-4421-af08-bd942c1e4c0c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:20.930003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c79083be-9f39-4421-af08-bd942c1e4c0c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:20.958215 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c79083be-9f39-4421-af08-bd942c1e4c0c tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1325 microversion: 2.1 time: 0.796533 Aug 03 02:05:20.972710 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1839/3616] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:20 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1325 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:21.030715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-014311b5-f825-4be0-8fc1-4648d9062318 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:21.034513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-014311b5-f825-4be0-8fc1-4648d9062318 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:21.088172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-014311b5-f825-4be0-8fc1-4648d9062318 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:21.089446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-014311b5-f825-4be0-8fc1-4648d9062318 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:21.097390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-014311b5-f825-4be0-8fc1-4648d9062318 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:21.098320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-014311b5-f825-4be0-8fc1-4648d9062318 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:21.495086 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.network.neutron [None req-abef5924-164f-4fdd-9c05-d3d6ee9ac575 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] re-assign floating IP 172.25.1.225 from instance 407c74a8-e6f7-4146-8b2d-842fa10fbded Aug 03 02:05:21.660639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-abef5924-164f-4fdd-9c05-d3d6ee9ac575 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Building network info cache for instance {{(pid=125942) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 02:05:21.701290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-014311b5-f825-4be0-8fc1-4648d9062318 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:21.717926 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-014311b5-f825-4be0-8fc1-4648d9062318 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1506 microversion: 2.1 time: 0.739311 Aug 03 02:05:21.723086 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1840/3617] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:20 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1506 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:21.750461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-45b6ace4-1af4-4f36-b4c6-551f2d095e80 req-5a7a3544-ab93-48a9-9877-c0af85608423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "407c74a8-e6f7-4146-8b2d-842fa10fbded", "tag": "a6e067d4-bea0-49c9-b26b-8af45883186c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:21.783749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-45b6ace4-1af4-4f36-b4c6-551f2d095e80 req-5a7a3544-ab93-48a9-9877-c0af85608423 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:21.784607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-45b6ace4-1af4-4f36-b4c6-551f2d095e80 req-5a7a3544-ab93-48a9-9877-c0af85608423 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:21.814769 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-45b6ace4-1af4-4f36-b4c6-551f2d095e80 req-5a7a3544-ab93-48a9-9877-c0af85608423 service nova] Creating event network-changed:a6e067d4-bea0-49c9-b26b-8af45883186c for instance 407c74a8-e6f7-4146-8b2d-842fa10fbded on n-h1-826529-8 Aug 03 02:05:21.829753 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-45b6ace4-1af4-4f36-b4c6-551f2d095e80 req-5a7a3544-ab93-48a9-9877-c0af85608423 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103429 Aug 03 02:05:21.894002 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1841/3618] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:21.934562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ca976ece-7365-4378-a2f9-31491384c89b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:21.956083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ca976ece-7365-4378-a2f9-31491384c89b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:21.982209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca976ece-7365-4378-a2f9-31491384c89b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:21.982670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca976ece-7365-4378-a2f9-31491384c89b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:21.988267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca976ece-7365-4378-a2f9-31491384c89b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:21.989458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca976ece-7365-4378-a2f9-31491384c89b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:24.378646 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ca976ece-7365-4378-a2f9-31491384c89b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:24.401469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ca976ece-7365-4378-a2f9-31491384c89b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:24.403164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ca976ece-7365-4378-a2f9-31491384c89b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:24.410923 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ca976ece-7365-4378-a2f9-31491384c89b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1739 microversion: 2.20 time: 2.514812 Aug 03 02:05:24.424058 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1842/3619] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:05:21 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1739 bytes in 2529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:05:24.450335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03599024-c2b6-4079-b06d-5cdccebd5043 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:24.451977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-03599024-c2b6-4079-b06d-5cdccebd5043 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:24.480615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03599024-c2b6-4079-b06d-5cdccebd5043 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:24.481090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03599024-c2b6-4079-b06d-5cdccebd5043 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:24.485205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03599024-c2b6-4079-b06d-5cdccebd5043 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:24.485687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03599024-c2b6-4079-b06d-5cdccebd5043 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:24.643695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=58 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:05:25.711777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03599024-c2b6-4079-b06d-5cdccebd5043 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:25.809643 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03599024-c2b6-4079-b06d-5cdccebd5043 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1325 microversion: 2.1 time: 1.383798 Aug 03 02:05:25.853511 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1843/3620] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:24 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1325 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:25.905193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-57a6bceb-117c-420b-9253-0d3bd4a5c067 req-b78dbf02-6a1e-4192-b86c-50d6dc36d436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d899e1f4-ca44-4ab5-bda0-97d7e101bf2d", "name": "network-vif-plugged", "status": "completed", "tag": "d36319d8-ba29-46b8-bb38-02c46a6360e6"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:25.987773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-57a6bceb-117c-420b-9253-0d3bd4a5c067 req-b78dbf02-6a1e-4192-b86c-50d6dc36d436 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:25.995769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-57a6bceb-117c-420b-9253-0d3bd4a5c067 req-b78dbf02-6a1e-4192-b86c-50d6dc36d436 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:26.111569 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-57a6bceb-117c-420b-9253-0d3bd4a5c067 req-b78dbf02-6a1e-4192-b86c-50d6dc36d436 service nova] Creating event network-vif-plugged:d36319d8-ba29-46b8-bb38-02c46a6360e6 for instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d on n-h1-826529-8 Aug 03 02:05:26.147989 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-57a6bceb-117c-420b-9253-0d3bd4a5c067 req-b78dbf02-6a1e-4192-b86c-50d6dc36d436 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278720 Aug 03 02:05:26.155324 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1844/3621] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:26.176934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7ce48903-68d1-4ffa-b96e-62bc99aa890c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:26.178712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7ce48903-68d1-4ffa-b96e-62bc99aa890c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:26.211802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ce48903-68d1-4ffa-b96e-62bc99aa890c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:26.212890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ce48903-68d1-4ffa-b96e-62bc99aa890c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:26.214623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ce48903-68d1-4ffa-b96e-62bc99aa890c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:26.215869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ce48903-68d1-4ffa-b96e-62bc99aa890c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:26.343395 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7ce48903-68d1-4ffa-b96e-62bc99aa890c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2/ips" status: 200 len: 150 microversion: 2.1 time: 0.185882 Aug 03 02:05:26.351049 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1845/3622] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 02:05:26 2022] GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2/ips => generated 150 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:26.361950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3d23120d-3e4f-43fb-9c85-a943f2e8c0ca tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:26.386116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3d23120d-3e4f-43fb-9c85-a943f2e8c0ca tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:26.407813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3d23120d-3e4f-43fb-9c85-a943f2e8c0ca tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:26.409146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3d23120d-3e4f-43fb-9c85-a943f2e8c0ca tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:26.410892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3d23120d-3e4f-43fb-9c85-a943f2e8c0ca tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:26.416080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3d23120d-3e4f-43fb-9c85-a943f2e8c0ca tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:27.182119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-abef5924-164f-4fdd-9c05-d3d6ee9ac575 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Updating instance_info_cache with network_info: [{"id": "a6e067d4-bea0-49c9-b26b-8af45883186c", "address": "fa:16:3e:17:d1:36", "network": {"id": "019fe6d8-1b74-4afa-8697-7fe379f8a53a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1371263325-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fb5f76083896407f8fbedf0c61c6f793", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa6e067d4-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125942) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 02:05:27.206367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-abef5924-164f-4fdd-9c05-d3d6ee9ac575 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Building network info cache for instance {{(pid=125942) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 02:05:27.665262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3d23120d-3e4f-43fb-9c85-a943f2e8c0ca tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:27.678091 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3d23120d-3e4f-43fb-9c85-a943f2e8c0ca tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 200 len: 1449 microversion: 2.1 time: 1.324239 Aug 03 02:05:27.679111 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1846/3623] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:26 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 1449 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:27.690731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-dbccc08e-0705-4c38-8192-3a528892ed82 req-96a4895c-52bf-4b6e-b411-0af0bd9d5104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e", "tag": "52d7951f-c056-422b-91e9-87c1ee53edc8"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:27.717916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-dbccc08e-0705-4c38-8192-3a528892ed82 req-96a4895c-52bf-4b6e-b411-0af0bd9d5104 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:27.718340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-dbccc08e-0705-4c38-8192-3a528892ed82 req-96a4895c-52bf-4b6e-b411-0af0bd9d5104 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:27.721515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:05:27.762707 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-dbccc08e-0705-4c38-8192-3a528892ed82 req-96a4895c-52bf-4b6e-b411-0af0bd9d5104 service nova] Creating event network-changed:52d7951f-c056-422b-91e9-87c1ee53edc8 for instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e on n-h1-826529-8 Aug 03 02:05:27.775748 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-dbccc08e-0705-4c38-8192-3a528892ed82 req-96a4895c-52bf-4b6e-b411-0af0bd9d5104 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090662 Aug 03 02:05:27.777071 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1847/3624] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:27.789921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4eb01c75-7a8d-4119-9c66-a7ae7acd4a30 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:27.790674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4eb01c75-7a8d-4119-9c66-a7ae7acd4a30 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:27.814518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4eb01c75-7a8d-4119-9c66-a7ae7acd4a30 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:27.815026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4eb01c75-7a8d-4119-9c66-a7ae7acd4a30 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:27.816140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4eb01c75-7a8d-4119-9c66-a7ae7acd4a30 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:27.816754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4eb01c75-7a8d-4119-9c66-a7ae7acd4a30 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:29.011915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4eb01c75-7a8d-4119-9c66-a7ae7acd4a30 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:29.021160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4eb01c75-7a8d-4119-9c66-a7ae7acd4a30 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:29.029712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4eb01c75-7a8d-4119-9c66-a7ae7acd4a30 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:29.036237 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4eb01c75-7a8d-4119-9c66-a7ae7acd4a30 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1739 microversion: 2.20 time: 1.257293 Aug 03 02:05:29.059640 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1848/3625] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:05:27 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1739 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:05:29.075206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1b3f1351-9ea8-43a7-9e5b-cca935de8bb2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bc98a69-ec1c-4ff5-b047-a6de4615108e"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:29.077944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1b3f1351-9ea8-43a7-9e5b-cca935de8bb2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:29.094868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b3f1351-9ea8-43a7-9e5b-cca935de8bb2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:29.098523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b3f1351-9ea8-43a7-9e5b-cca935de8bb2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:29.100253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b3f1351-9ea8-43a7-9e5b-cca935de8bb2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:29.103667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b3f1351-9ea8-43a7-9e5b-cca935de8bb2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:29.448802 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-1b3f1351-9ea8-43a7-9e5b-cca935de8bb2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] HTTP exception thrown: Invalid volume: volume 4bc98a69-ec1c-4ff5-b047-a6de4615108e is already attached to instances: 99358f36-9bc7-4e58-8a98-70b4e391e244 Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1b3f1351-9ea8-43a7-9e5b-cca935de8bb2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Request method failure captured: Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2/os-volume_attachments HTTP/1.1 Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 74 Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dc0-Ae8If7bfOWI7RRBvc1phU63xlLSU5btj5ety_8fStzHcWU-vXHDYz4xfjE-ye9BJl2yypV_nSYHeeO1JR8qxTOON-NMvFY2KC116gH7mE5fGt58cYvDLyGtxXNTQSJt4xclgIAdKb4vD1HYJAxEQ3OrVusgb2MtJ9SsttIsaGA Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a5bc12da9a94f63bb71700bd01cf416", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}] Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4c1fb7af331344dcb26c43368a9daa6e Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: {"volumeAttachment": {"volumeId": "4bc98a69-ec1c-4ff5-b047-a6de4615108e"}} Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid volume: volume 4bc98a69-ec1c-4ff5-b047-a6de4615108e is already attached to instances: 99358f36-9bc7-4e58-8a98-70b4e391e244 Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'server_id': 'ccde6102-3858-4f7d-aa96-9d1a2527f9a2', 'body': {'volumeAttachment': {'volumeId': '4bc98a69-ec1c-4ff5-b047-a6de4615108e'}}} Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4bc98a69-ec1c-4ff5-b047-a6de4615108e is already attached to instances: 99358f36-9bc7-4e58-8a98-70b4e391e244 Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:05:29.455002 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4bc98a69-ec1c-4ff5-b047-a6de4615108e is already attached to instances: 99358f36-9bc7-4e58-8a98-70b4e391e244 Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4bc98a69-ec1c-4ff5-b047-a6de4615108e is already attached to instances: 99358f36-9bc7-4e58-8a98-70b4e391e244 Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1b3f1351-9ea8-43a7-9e5b-cca935de8bb2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Returning 400 to user: Invalid volume: volume 4bc98a69-ec1c-4ff5-b047-a6de4615108e is already attached to instances: 99358f36-9bc7-4e58-8a98-70b4e391e244 {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1b3f1351-9ea8-43a7-9e5b-cca935de8bb2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "POST /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.395562 Aug 03 02:05:29.460710 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1849/3626] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:05:29 2022] POST /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2/os-volume_attachments => generated 174 bytes in 397 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:05:29.482954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4f2d5cc9-84a6-4d28-bf94-c9aef65a1ff4 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:29.483665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4f2d5cc9-84a6-4d28-bf94-c9aef65a1ff4 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:29.509798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f2d5cc9-84a6-4d28-bf94-c9aef65a1ff4 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:29.510263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f2d5cc9-84a6-4d28-bf94-c9aef65a1ff4 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:29.511100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f2d5cc9-84a6-4d28-bf94-c9aef65a1ff4 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:29.511753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f2d5cc9-84a6-4d28-bf94-c9aef65a1ff4 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:30.824561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-abef5924-164f-4fdd-9c05-d3d6ee9ac575 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Updating instance_info_cache with network_info: [{"id": "52d7951f-c056-422b-91e9-87c1ee53edc8", "address": "fa:16:3e:26:be:09", "network": {"id": "019fe6d8-1b74-4afa-8697-7fe379f8a53a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1371263325-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fb5f76083896407f8fbedf0c61c6f793", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap52d7951f-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125942) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 02:05:30.854791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abef5924-164f-4fdd-9c05-d3d6ee9ac575 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Releasing lock "refresh_cache-ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" {{(pid=125942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 02:05:30.856080 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-abef5924-164f-4fdd-9c05-d3d6ee9ac575 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "POST /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e/action" status: 202 len: 0 microversion: 2.1 time: 16.244540 Aug 03 02:05:30.860085 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1778/3627] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:05:14 2022] POST /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e/action => generated 0 bytes in 16268 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 02:05:30.876255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4f2d5cc9-84a6-4d28-bf94-c9aef65a1ff4 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:30.879679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-73b05521-ca36-4a7c-8f8a-5537711432b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:30.883501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-73b05521-ca36-4a7c-8f8a-5537711432b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:30.893907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73b05521-ca36-4a7c-8f8a-5537711432b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:30.894871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73b05521-ca36-4a7c-8f8a-5537711432b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:30.895886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73b05521-ca36-4a7c-8f8a-5537711432b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:30.896506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73b05521-ca36-4a7c-8f8a-5537711432b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:30.919697 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4f2d5cc9-84a6-4d28-bf94-c9aef65a1ff4 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1522 microversion: 2.1 time: 1.430808 Aug 03 02:05:30.935989 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1850/3628] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:29 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1522 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:30.949124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ab0cc225-7c89-4724-bc18-6df4a698c07c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:30.950041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ab0cc225-7c89-4724-bc18-6df4a698c07c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:30.960953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab0cc225-7c89-4724-bc18-6df4a698c07c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:30.962789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab0cc225-7c89-4724-bc18-6df4a698c07c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:30.963973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab0cc225-7c89-4724-bc18-6df4a698c07c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:30.964742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab0cc225-7c89-4724-bc18-6df4a698c07c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:30.988389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-73b05521-ca36-4a7c-8f8a-5537711432b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:05:30.999225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ab0cc225-7c89-4724-bc18-6df4a698c07c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:05:31.006128 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.compute.api [None req-73b05521-ca36-4a7c-8f8a-5537711432b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Working on deleting snapshot 90bcfc15-50e4-4f53-9959-af5573d8f3c8 from shelved instance... Aug 03 02:05:31.294980 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ab0cc225-7c89-4724-bc18-6df4a698c07c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2" status: 204 len: 0 microversion: 2.1 time: 0.356877 Aug 03 02:05:31.300504 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1851/3629] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:05:30 2022] DELETE /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:05:31.316691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6dab1833-60b1-4e9c-9028-77e6047967f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:31.317876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6dab1833-60b1-4e9c-9028-77e6047967f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:31.329680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dab1833-60b1-4e9c-9028-77e6047967f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:31.330653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dab1833-60b1-4e9c-9028-77e6047967f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:31.331670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dab1833-60b1-4e9c-9028-77e6047967f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:31.332573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dab1833-60b1-4e9c-9028-77e6047967f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:32.150031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6dab1833-60b1-4e9c-9028-77e6047967f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:32.174063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6dab1833-60b1-4e9c-9028-77e6047967f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:32.177536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6dab1833-60b1-4e9c-9028-77e6047967f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:32.179662 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6dab1833-60b1-4e9c-9028-77e6047967f9 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1739 microversion: 2.20 time: 0.876972 Aug 03 02:05:32.181796 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1852/3630] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:05:31 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1739 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:05:32.188517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-54e67819-6d59-4eeb-9291-359ff7eaf6fe tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.225"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:32.520943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-54e67819-6d59-4eeb-9291-359ff7eaf6fe tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:32.532623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54e67819-6d59-4eeb-9291-359ff7eaf6fe tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:32.536129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54e67819-6d59-4eeb-9291-359ff7eaf6fe tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:32.542335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54e67819-6d59-4eeb-9291-359ff7eaf6fe tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:32.545037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54e67819-6d59-4eeb-9291-359ff7eaf6fe tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:33.249531 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-54e67819-6d59-4eeb-9291-359ff7eaf6fe tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] HTTP exception thrown: Floating IP 172.25.1.225 is not associated with instance 407c74a8-e6f7-4146-8b2d-842fa10fbded. Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-54e67819-6d59-4eeb-9291-359ff7eaf6fe tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Request method failure captured: Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded/action HTTP/1.1 Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 49 Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6deZkYnk31GH3gRQaRkSg5H6JEBlXKlexCwgI-OPuTfI70QI3AJAW-cTM80UUi2UxC7x42JsXMAn0lfEX22aLqz-75HD5VQ9tFT1VzdWLuHZVh2Zt7OgaVjBXsiNyGNzmWmj_QpJGdz3eodapl1cXHJE5Ym0ySSGM_oDHUUwhoxyn_g Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: fb5f76083896407f8fbedf0c61c6f793 Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-479651113 Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fb5f76083896407f8fbedf0c61c6f793", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fb5f76083896407f8fbedf0c61c6f793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fb5f76083896407f8fbedf0c61c6f793"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fb5f76083896407f8fbedf0c61c6f793"}]}] Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-479651113 Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: fb5f76083896407f8fbedf0c61c6f793 Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-479651113 Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FloatingIPsAssociationTestJSON-479651113-project Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 2a0159b26db744799487da9445a7346b Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-479651113-project Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: {"removeFloatingIp": {"address": "172.25.1.225"}} Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: exception: Floating IP 172.25.1.225 is not associated with instance 407c74a8-e6f7-4146-8b2d-842fa10fbded. Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '407c74a8-e6f7-4146-8b2d-842fa10fbded', 'body': {'removeFloatingIp': {'address': '172.25.1.225'}}} Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.1.225 is not associated with instance 407c74a8-e6f7-4146-8b2d-842fa10fbded. Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.1.225 is not associated with instance 407c74a8-e6f7-4146-8b2d-842fa10fbded. Aug 03 02:05:33.252730 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:05:33.258790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-54e67819-6d59-4eeb-9291-359ff7eaf6fe tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Returning 409 to user: Floating IP 172.25.1.225 is not associated with instance 407c74a8-e6f7-4146-8b2d-842fa10fbded. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:05:33.258790 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-54e67819-6d59-4eeb-9291-359ff7eaf6fe tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "POST /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded/action" status: 409 len: 146 microversion: 2.1 time: 1.072687 Aug 03 02:05:33.258790 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1853/3631] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:05:32 2022] POST /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded/action => generated 146 bytes in 1075 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:05:33.276911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5b8181f-7faa-476a-856b-f7d6e2495ff7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:33.277965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5b8181f-7faa-476a-856b-f7d6e2495ff7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:33.295686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5b8181f-7faa-476a-856b-f7d6e2495ff7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:33.296545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5b8181f-7faa-476a-856b-f7d6e2495ff7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:33.298050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5b8181f-7faa-476a-856b-f7d6e2495ff7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:33.298915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5b8181f-7faa-476a-856b-f7d6e2495ff7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:33.975607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c5b8181f-7faa-476a-856b-f7d6e2495ff7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:34.041762 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5b8181f-7faa-476a-856b-f7d6e2495ff7 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1522 microversion: 2.1 time: 0.755628 Aug 03 02:05:34.045971 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1854/3632] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:33 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1522 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:34.063437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5390afeb-3535-4d41-8e32-69961e13593b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:34.064181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5390afeb-3535-4d41-8e32-69961e13593b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:34.104243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5390afeb-3535-4d41-8e32-69961e13593b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:34.105838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5390afeb-3535-4d41-8e32-69961e13593b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:34.108794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5390afeb-3535-4d41-8e32-69961e13593b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:34.109544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5390afeb-3535-4d41-8e32-69961e13593b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:34.629396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5390afeb-3535-4d41-8e32-69961e13593b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:34.656358 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5390afeb-3535-4d41-8e32-69961e13593b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2" status: 200 len: 1680 microversion: 2.1 time: 0.608846 Aug 03 02:05:34.675734 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1855/3633] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:34 2022] GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 => generated 1680 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:34.688394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-79388ec9-4991-4340-bc09-deb69d944219 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:34.689580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-79388ec9-4991-4340-bc09-deb69d944219 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:34.710240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-79388ec9-4991-4340-bc09-deb69d944219 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:34.711231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-79388ec9-4991-4340-bc09-deb69d944219 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:34.712286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-79388ec9-4991-4340-bc09-deb69d944219 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:34.712981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-79388ec9-4991-4340-bc09-deb69d944219 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:35.100333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-79388ec9-4991-4340-bc09-deb69d944219 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:35.137339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-79388ec9-4991-4340-bc09-deb69d944219 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:35.141298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-79388ec9-4991-4340-bc09-deb69d944219 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:35.149097 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-79388ec9-4991-4340-bc09-deb69d944219 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1739 microversion: 2.20 time: 0.471023 Aug 03 02:05:35.150796 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1856/3634] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:05:34 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1739 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:05:35.200389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b895a833-5124-4070-a4a0-14fe1daa012a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.225"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:35.615511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b895a833-5124-4070-a4a0-14fe1daa012a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:35.624479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b895a833-5124-4070-a4a0-14fe1daa012a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:35.626354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b895a833-5124-4070-a4a0-14fe1daa012a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:35.629866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b895a833-5124-4070-a4a0-14fe1daa012a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:35.632255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b895a833-5124-4070-a4a0-14fe1daa012a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:36.317812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b895a833-5124-4070-a4a0-14fe1daa012a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Acquired lock "refresh_cache-ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" {{(pid=125941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 02:05:38.729756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-b895a833-5124-4070-a4a0-14fe1daa012a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Building network info cache for instance {{(pid=125941) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 02:05:39.331781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=74,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:05:39.515311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-73b05521-ca36-4a7c-8f8a-5537711432b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Doing local delete in cell 812a442e-24ba-4152-b2b0-f99907b19272(cell1) {{(pid=125942) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 03 02:05:39.516173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73b05521-ca36-4a7c-8f8a-5537711432b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:39.516638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73b05521-ca36-4a7c-8f8a-5537711432b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:39.517078 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.compute.api [None req-73b05521-ca36-4a7c-8f8a-5537711432b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 03 02:05:39.533721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-73b05521-ca36-4a7c-8f8a-5537711432b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] deallocate_for_instance() {{(pid=125942) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 03 02:05:40.916409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-b895a833-5124-4070-a4a0-14fe1daa012a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Updating instance_info_cache with network_info: [{"id": "52d7951f-c056-422b-91e9-87c1ee53edc8", "address": "fa:16:3e:26:be:09", "network": {"id": "019fe6d8-1b74-4afa-8697-7fe379f8a53a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1371263325-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fb5f76083896407f8fbedf0c61c6f793", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap52d7951f-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125941) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 02:05:40.933455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b895a833-5124-4070-a4a0-14fe1daa012a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Releasing lock "refresh_cache-ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" {{(pid=125941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 02:05:40.942069 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b895a833-5124-4070-a4a0-14fe1daa012a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "POST /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e/action" status: 202 len: 0 microversion: 2.1 time: 5.766230 Aug 03 02:05:40.945663 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1857/3635] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:05:35 2022] POST /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e/action => generated 0 bytes in 5794 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 02:05:40.975637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-05a62fc6-c020-493a-b580-002ff602a5ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-569681646"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:41.003365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-05a62fc6-c020-493a-b580-002ff602a5ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:41.027077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05a62fc6-c020-493a-b580-002ff602a5ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:41.027534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05a62fc6-c020-493a-b580-002ff602a5ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:41.028447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05a62fc6-c020-493a-b580-002ff602a5ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:41.028888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05a62fc6-c020-493a-b580-002ff602a5ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:42.679307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-73b05521-ca36-4a7c-8f8a-5537711432b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Updating instance_info_cache with network_info: [] {{(pid=125942) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 02:05:43.165127 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-73b05521-ca36-4a7c-8f8a-5537711432b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 204 len: 0 microversion: 2.1 time: 12.294583 Aug 03 02:05:43.171320 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1779/3636] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:05:30 2022] DELETE /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 0 bytes in 12302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:05:43.186092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5cf4f32c-4de8-4b87-8325-cb3f91f44b5a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:43.187149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5cf4f32c-4de8-4b87-8325-cb3f91f44b5a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:43.201826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cf4f32c-4de8-4b87-8325-cb3f91f44b5a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:43.204273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cf4f32c-4de8-4b87-8325-cb3f91f44b5a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:43.205107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cf4f32c-4de8-4b87-8325-cb3f91f44b5a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:43.205551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cf4f32c-4de8-4b87-8325-cb3f91f44b5a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:43.240276 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-5cf4f32c-4de8-4b87-8325-cb3f91f44b5a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] HTTP exception thrown: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5cf4f32c-4de8-4b87-8325-cb3f91f44b5a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Request method failure captured: Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 HTTP/1.1 Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dc0-Ae8If7bfOWI7RRBvc1phU63xlLSU5btj5ety_8fStzHcWU-vXHDYz4xfjE-ye9BJl2yypV_nSYHeeO1JR8qxTOON-NMvFY2KC116gH7mE5fGt58cYvDLyGtxXNTQSJt4xclgIAdKb4vD1HYJAxEQ3OrVusgb2MtJ9SsttIsaGA Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a5bc12da9a94f63bb71700bd01cf416", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}] Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4c1fb7af331344dcb26c43368a9daa6e Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'ccde6102-3858-4f7d-aa96-9d1a2527f9a2'} Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:05:43.244323 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:05:43.249315 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:05:43.249315 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:05:43.249315 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:05:43.249315 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:05:43.249315 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:05:43.249315 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. Aug 03 02:05:43.249315 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:05:43.249315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5cf4f32c-4de8-4b87-8325-cb3f91f44b5a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Returning 404 to user: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:05:43.249315 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5cf4f32c-4de8-4b87-8325-cb3f91f44b5a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2" status: 404 len: 111 microversion: 2.1 time: 0.071757 Aug 03 02:05:43.251553 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-05a62fc6-c020-493a-b580-002ff602a5ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "POST /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d/action" status: 202 len: 0 microversion: 2.1 time: 2.301072 Aug 03 02:05:43.255680 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1780/3637] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:43 2022] GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:05:43.259821 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1858/3638] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:05:40 2022] POST /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d/action => generated 0 bytes in 2313 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 02:05:43.268501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-94acde4e-4355-4201-88aa-9bd437f2a839 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:43.269179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-94acde4e-4355-4201-88aa-9bd437f2a839 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:43.274433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-7cc63924-9711-493a-9bdb-9ad073333f31 req-08655a11-0023-4957-a4b0-ddb68df8069a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e", "tag": "52d7951f-c056-422b-91e9-87c1ee53edc8"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:43.337752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94acde4e-4355-4201-88aa-9bd437f2a839 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:43.338219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94acde4e-4355-4201-88aa-9bd437f2a839 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:43.347640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7cc63924-9711-493a-9bdb-9ad073333f31 req-08655a11-0023-4957-a4b0-ddb68df8069a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:43.347640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7cc63924-9711-493a-9bdb-9ad073333f31 req-08655a11-0023-4957-a4b0-ddb68df8069a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:43.348017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94acde4e-4355-4201-88aa-9bd437f2a839 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:43.348017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94acde4e-4355-4201-88aa-9bd437f2a839 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:43.396144 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-7cc63924-9711-493a-9bdb-9ad073333f31 req-08655a11-0023-4957-a4b0-ddb68df8069a service nova] Creating event network-changed:52d7951f-c056-422b-91e9-87c1ee53edc8 for instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e on n-h1-826529-8 Aug 03 02:05:43.404466 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-7cc63924-9711-493a-9bdb-9ad073333f31 req-08655a11-0023-4957-a4b0-ddb68df8069a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143100 Aug 03 02:05:43.407275 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1859/3639] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:43.422959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-49cef3b0-820d-49e2-a3ad-32f855b27d8b req-f6d1439b-99b8-4fd0-88f6-34b1d18ab329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccde6102-3858-4f7d-aa96-9d1a2527f9a2", "name": "network-vif-deleted", "tag": "e16784fb-69ab-402c-8e6c-d8e45c1468aa"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:43.442955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-49cef3b0-820d-49e2-a3ad-32f855b27d8b req-f6d1439b-99b8-4fd0-88f6-34b1d18ab329 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:43.447831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-49cef3b0-820d-49e2-a3ad-32f855b27d8b req-f6d1439b-99b8-4fd0-88f6-34b1d18ab329 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:43.473761 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-49cef3b0-820d-49e2-a3ad-32f855b27d8b req-f6d1439b-99b8-4fd0-88f6-34b1d18ab329 service nova] Creating event network-vif-deleted:e16784fb-69ab-402c-8e6c-d8e45c1468aa for instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 on n-h2-826529-8 Aug 03 02:05:43.487301 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-49cef3b0-820d-49e2-a3ad-32f855b27d8b req-f6d1439b-99b8-4fd0-88f6-34b1d18ab329 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075814 Aug 03 02:05:43.491234 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1860/3640] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:43.505058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2584ef63-0c96-479f-b473-056e103726df tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:43.506611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2584ef63-0c96-479f-b473-056e103726df tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:43.526709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2584ef63-0c96-479f-b473-056e103726df tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:43.527416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2584ef63-0c96-479f-b473-056e103726df tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:43.528601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2584ef63-0c96-479f-b473-056e103726df tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:43.528850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2584ef63-0c96-479f-b473-056e103726df tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:43.592780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2584ef63-0c96-479f-b473-056e103726df tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:05:43.624547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:05:43.775672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-94acde4e-4355-4201-88aa-9bd437f2a839 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:43.794421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-94acde4e-4355-4201-88aa-9bd437f2a839 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:43.796751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-94acde4e-4355-4201-88aa-9bd437f2a839 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:43.798872 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-94acde4e-4355-4201-88aa-9bd437f2a839 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1739 microversion: 2.20 time: 0.541956 Aug 03 02:05:43.799877 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1781/3641] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:05:43 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1739 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:05:43.805613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-74f2e2c8-da20-4ddb-acd4-3ec9e131cdc4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:43.806513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-74f2e2c8-da20-4ddb-acd4-3ec9e131cdc4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:43.826780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74f2e2c8-da20-4ddb-acd4-3ec9e131cdc4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:43.827967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74f2e2c8-da20-4ddb-acd4-3ec9e131cdc4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:43.830039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74f2e2c8-da20-4ddb-acd4-3ec9e131cdc4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:43.832160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74f2e2c8-da20-4ddb-acd4-3ec9e131cdc4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:43.841835 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2584ef63-0c96-479f-b473-056e103726df tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" status: 204 len: 0 microversion: 2.1 time: 0.346924 Aug 03 02:05:43.842767 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1861/3642] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:05:43 2022] DELETE /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:05:43.866114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ad2219f2-c5ba-4bf7-8024-289fa8ad966d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '.version_select at 0x7f5b125b6550>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:43.955284 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ad2219f2-c5ba-4bf7-8024-289fa8ad966d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-470046397" status: 202 len: 0 microversion: 2.1 time: 0.111143 Aug 03 02:05:43.955906 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1862/3643] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 3 02:05:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-470046397 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:05:43.997339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a11a09d1-3769-4069-ba62-b2e76764a25d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '.version_select at 0x7f5b123c94c0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:44.380569 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-74f2e2c8-da20-4ddb-acd4-3ec9e131cdc4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-74f2e2c8-da20-4ddb-acd4-3ec9e131cdc4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a HTTP/1.1 Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '8fea7f2e-eb34-40c8-8171-11e0a65bae4a'} Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:05:44.382767 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:05:44.388007 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:05:44.388007 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:05:44.388007 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:05:44.388007 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:05:44.388007 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:05:44.388007 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. Aug 03 02:05:44.388007 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:05:44.389968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-74f2e2c8-da20-4ddb-acd4-3ec9e131cdc4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:05:44.391071 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-74f2e2c8-da20-4ddb-acd4-3ec9e131cdc4 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 404 len: 111 microversion: 2.1 time: 0.590194 Aug 03 02:05:44.392894 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1782/3644] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:43 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 111 bytes in 592 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:05:44.398575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-86b3c36a-8ea1-4312-9be7-c4073d31a1a6 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.225"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:44.401714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-86b3c36a-8ea1-4312-9be7-c4073d31a1a6 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:44.422569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86b3c36a-8ea1-4312-9be7-c4073d31a1a6 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:44.423157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86b3c36a-8ea1-4312-9be7-c4073d31a1a6 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:44.423971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86b3c36a-8ea1-4312-9be7-c4073d31a1a6 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:44.424506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86b3c36a-8ea1-4312-9be7-c4073d31a1a6 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:44.468920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86b3c36a-8ea1-4312-9be7-c4073d31a1a6 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Acquired lock "refresh_cache-407c74a8-e6f7-4146-8b2d-842fa10fbded" {{(pid=125942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 02:05:44.934231 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a11a09d1-3769-4069-ba62-b2e76764a25d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "DELETE /compute/v2.1/images/a399dc69-1a39-4acd-812f-b9739262cd89" status: 204 len: 0 microversion: 2.1 time: 0.976857 Aug 03 02:05:44.935608 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1863/3645] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:43 2022] DELETE /compute/v2.1/images/a399dc69-1a39-4acd-812f-b9739262cd89 => generated 0 bytes in 979 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:05:44.944864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1563332598", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "cf1e5fc2-66a4-4802-965c-545f628b0c29"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:45.112798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] validate_networks() for [('cf1e5fc2-66a4-4802-965c-545f628b0c29', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:05:47.719310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:05:47.720077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:05:47.723451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:05:47.724172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:05:47.724808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:05:47.758331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:47.761256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:47.763201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:47.773671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:47.832205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Getting quotas for project 01f1d9f8216e4f729a5e24aad713fe98. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:05:47.856639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Getting quotas for user 0dc56b77862f410d82c8617f3d679775 and project 01f1d9f8216e4f729a5e24aad713fe98. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:05:47.908645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:05:47.911127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:05:48.046273 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-73dc8545-40b9-494b-a579-030303c09366 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.109071 Aug 03 02:05:48.054763 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1864/3646] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:05:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:05:48.066765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-51a2c19d-b88c-4d8d-ab3c-ce480e3e5abe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:48.067428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-51a2c19d-b88c-4d8d-ab3c-ce480e3e5abe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:48.069553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:05:48.104653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51a2c19d-b88c-4d8d-ab3c-ce480e3e5abe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:48.105135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51a2c19d-b88c-4d8d-ab3c-ce480e3e5abe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:48.115037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51a2c19d-b88c-4d8d-ab3c-ce480e3e5abe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:48.115725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51a2c19d-b88c-4d8d-ab3c-ce480e3e5abe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:49.688494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-51a2c19d-b88c-4d8d-ab3c-ce480e3e5abe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:49.712832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-51a2c19d-b88c-4d8d-ab3c-ce480e3e5abe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:49.720861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-51a2c19d-b88c-4d8d-ab3c-ce480e3e5abe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:49.728924 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-51a2c19d-b88c-4d8d-ab3c-ce480e3e5abe tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1721 microversion: 2.20 time: 1.672838 Aug 03 02:05:49.729540 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1865/3647] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:05:48 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1721 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:05:49.746751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5d1b7b1c-6194-4808-8db2-6d507e371800 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '.version_select at 0x7f5b12518af0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:49.811330 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-5d1b7b1c-6194-4808-8db2-6d507e371800 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] HTTP exception thrown: Image not found. Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5d1b7b1c-6194-4808-8db2-6d507e371800 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Request method failure captured: Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/images/a399dc69-1a39-4acd-812f-b9739262cd89 HTTP/1.1 Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6deKj_4ni6BiP5hu0KReUjCwN-jXFzDltBsZkdmHfZJw3iCK1NJe4cC4HqyDHfr9U2Xj9tTYrH-rL2Y-nfbcV2kQPduI8yks5ljNEDlazy86SExfxbA5OA6iqfJroq-67nWDTGmlBdStRJ_EHNLs6bYrB1tkODLPTKFNyABk3rb39eQ Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_78ae2f8c7bef4a959cdfa8c61360e7e5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}] Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e2c17b2e7e9f4c878826497386ee3ba7 Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: exception: Image not found. Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'a399dc69-1a39-4acd-812f-b9739262cd89'} Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a399dc69-1a39-4acd-812f-b9739262cd89 Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 02:05:49.815780 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a399dc69-1a39-4acd-812f-b9739262cd89 could not be found. Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5d1b7b1c-6194-4808-8db2-6d507e371800 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Returning 404 to user: Image not found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:05:49.824879 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5d1b7b1c-6194-4808-8db2-6d507e371800 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/images/a399dc69-1a39-4acd-812f-b9739262cd89" status: 404 len: 62 microversion: 2.1 time: 0.083009 Aug 03 02:05:49.834500 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1866/3648] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:05:49 2022] GET /compute/v2.1/images/a399dc69-1a39-4acd-812f-b9739262cd89 => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:05:49.842267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-24b14ef9-7643-4566-9687-7b2df3dc9639 req-c16a469e-cb00-40bb-b1f3-e81ca64a526a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fea7f2e-eb34-40c8-8171-11e0a65bae4a", "name": "network-vif-deleted", "tag": "e1ea085a-3d24-4a01-addc-213948d9671b"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:49.873854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-24b14ef9-7643-4566-9687-7b2df3dc9639 req-c16a469e-cb00-40bb-b1f3-e81ca64a526a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:49.875242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-24b14ef9-7643-4566-9687-7b2df3dc9639 req-c16a469e-cb00-40bb-b1f3-e81ca64a526a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:49.904742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.compute.server_external_events [req-24b14ef9-7643-4566-9687-7b2df3dc9639 req-c16a469e-cb00-40bb-b1f3-e81ca64a526a service nova] Unable to find a host for instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a. Dropping event network-vif-deleted {{(pid=125941) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 02:05:49.906023 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-24b14ef9-7643-4566-9687-7b2df3dc9639 req-c16a469e-cb00-40bb-b1f3-e81ca64a526a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.077752 Aug 03 02:05:49.906841 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1867/3649] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 79 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 03 02:05:49.918334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed9080b2-e729-4947-ad49-6dcedea348f3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:49.923744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ed9080b2-e729-4947-ad49-6dcedea348f3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:49.939775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed9080b2-e729-4947-ad49-6dcedea348f3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:49.940657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed9080b2-e729-4947-ad49-6dcedea348f3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:49.941662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed9080b2-e729-4947-ad49-6dcedea348f3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:49.942313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed9080b2-e729-4947-ad49-6dcedea348f3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:50.110142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ed9080b2-e729-4947-ad49-6dcedea348f3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:50.122971 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed9080b2-e729-4947-ad49-6dcedea348f3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1211 microversion: 2.1 time: 0.211211 Aug 03 02:05:50.123486 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1868/3650] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:49 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1211 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:50.432585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-680223fa-1901-4591-ad28-1c74b07dfb9f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'create', calling method: .version_select at 0x7f5b1255b160>, body: {"keypair": {"name": "tempest-keypair-1908956651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtXEO5aDHVzw6auKG1yXrbUfVtEYFlFOP3aCKqZcg961Ww9mWDa+lqXsy8Y86WxYgo70HwfLzApeZQBTAKVU0jJtnM5cCgBLVdy/33faIXTmx1VdsB0pItWKNBsTvYKag=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:50.501785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-680223fa-1901-4591-ad28-1c74b07dfb9f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Getting quotas for project 43ed3dcb7307452b965ee2d303ffaecd. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:05:50.520352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-680223fa-1901-4591-ad28-1c74b07dfb9f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Getting quotas for user c6ac519db80b4ba99d67bd5db59be619 and project 43ed3dcb7307452b965ee2d303ffaecd. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:05:50.602967 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-680223fa-1901-4591-ad28-1c74b07dfb9f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.474981 Aug 03 02:05:50.606555 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1869/3651] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:05:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:50.621337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-492e71da-1553-48d5-ae2a-aa57fd73ea32 req-c416603a-99d7-4396-afb6-42b2890ef63a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ce11775-ab73-457e-8799-239915dc2406", "name": "network-vif-unplugged", "status": "completed", "tag": "12c644d8-021b-4605-8e3c-16ff33d29cd1"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:50.649955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-492e71da-1553-48d5-ae2a-aa57fd73ea32 req-c416603a-99d7-4396-afb6-42b2890ef63a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:50.650714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-492e71da-1553-48d5-ae2a-aa57fd73ea32 req-c416603a-99d7-4396-afb6-42b2890ef63a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:50.683529 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-492e71da-1553-48d5-ae2a-aa57fd73ea32 req-c416603a-99d7-4396-afb6-42b2890ef63a service nova] Creating event network-vif-unplugged:12c644d8-021b-4605-8e3c-16ff33d29cd1 for instance 9ce11775-ab73-457e-8799-239915dc2406 on n-h2-826529-8 Aug 03 02:05:50.698987 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-492e71da-1553-48d5-ae2a-aa57fd73ea32 req-c416603a-99d7-4396-afb6-42b2890ef63a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089504 Aug 03 02:05:50.701296 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1870/3652] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:50.721163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-60aafa41-7005-4ba1-84b3-0a158c81c91e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:50.722190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-60aafa41-7005-4ba1-84b3-0a158c81c91e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:50.743797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60aafa41-7005-4ba1-84b3-0a158c81c91e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:50.746605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60aafa41-7005-4ba1-84b3-0a158c81c91e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:50.747754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60aafa41-7005-4ba1-84b3-0a158c81c91e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:50.749359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60aafa41-7005-4ba1-84b3-0a158c81c91e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:51.095788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-60aafa41-7005-4ba1-84b3-0a158c81c91e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lazy-loading 'services' on Instance uuid 99358f36-9bc7-4e58-8a98-70b4e391e244 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:05:51.212498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-86b3c36a-8ea1-4312-9be7-c4073d31a1a6 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Building network info cache for instance {{(pid=125942) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 02:05:51.341892 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-60aafa41-7005-4ba1-84b3-0a158c81c91e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "DELETE /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-volume_attachments/4bc98a69-ec1c-4ff5-b047-a6de4615108e" status: 202 len: 0 microversion: 2.1 time: 0.628969 Aug 03 02:05:51.347602 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1871/3653] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:05:50 2022] DELETE /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-volume_attachments/4bc98a69-ec1c-4ff5-b047-a6de4615108e => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:05:51.396979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-05294861-bad6-4d4d-8b2a-86c92d6af357 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:51.397715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-05294861-bad6-4d4d-8b2a-86c92d6af357 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:51.452990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05294861-bad6-4d4d-8b2a-86c92d6af357 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:51.457787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05294861-bad6-4d4d-8b2a-86c92d6af357 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:51.469344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05294861-bad6-4d4d-8b2a-86c92d6af357 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:51.470289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05294861-bad6-4d4d-8b2a-86c92d6af357 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:52.493292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-05294861-bad6-4d4d-8b2a-86c92d6af357 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:52.509601 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-05294861-bad6-4d4d-8b2a-86c92d6af357 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1522 microversion: 2.1 time: 1.142054 Aug 03 02:05:52.513547 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1872/3654] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:51 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1522 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:52.529939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6f21e979-c580-4650-9f44-8deec911dc33 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:52.534049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6f21e979-c580-4650-9f44-8deec911dc33 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:52.560554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f21e979-c580-4650-9f44-8deec911dc33 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:52.564363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f21e979-c580-4650-9f44-8deec911dc33 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:52.566050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f21e979-c580-4650-9f44-8deec911dc33 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:52.569487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f21e979-c580-4650-9f44-8deec911dc33 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:53.710928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6f21e979-c580-4650-9f44-8deec911dc33 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:53.737920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6f21e979-c580-4650-9f44-8deec911dc33 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:53.753867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6f21e979-c580-4650-9f44-8deec911dc33 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:53.755190 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6f21e979-c580-4650-9f44-8deec911dc33 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1724 microversion: 2.20 time: 1.239395 Aug 03 02:05:53.758857 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1873/3655] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:05:52 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1724 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:05:53.768994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ef24160a-3324-45dd-84fa-27efe0044541 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:53.769881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ef24160a-3324-45dd-84fa-27efe0044541 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:53.800453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef24160a-3324-45dd-84fa-27efe0044541 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:53.812666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef24160a-3324-45dd-84fa-27efe0044541 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:53.816951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef24160a-3324-45dd-84fa-27efe0044541 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:53.818540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef24160a-3324-45dd-84fa-27efe0044541 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:54.162388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ef24160a-3324-45dd-84fa-27efe0044541 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:54.206370 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ef24160a-3324-45dd-84fa-27efe0044541 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1273 microversion: 2.1 time: 0.439378 Aug 03 02:05:54.208605 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1874/3656] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:53 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1273 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:54.229025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7f562d00-87d9-4e6a-9bef-e9428563c8cd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:54.235449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7f562d00-87d9-4e6a-9bef-e9428563c8cd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:54.265053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f562d00-87d9-4e6a-9bef-e9428563c8cd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:54.272538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f562d00-87d9-4e6a-9bef-e9428563c8cd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:54.279894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f562d00-87d9-4e6a-9bef-e9428563c8cd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:54.286816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f562d00-87d9-4e6a-9bef-e9428563c8cd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:54.409595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:05:54.436018 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7f562d00-87d9-4e6a-9bef-e9428563c8cd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.224197 Aug 03 02:05:54.441532 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1875/3657] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:05:54 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-volume_attachments => generated 197 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:54.472505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-de560c8f-a137-4b00-ae87-364226e354a1 req-d173107e-5ead-4195-8b12-c9d417656ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e", "name": "network-vif-deleted", "tag": "52d7951f-c056-422b-91e9-87c1ee53edc8"}, {"name": "network-changed", "server_uuid": "407c74a8-e6f7-4146-8b2d-842fa10fbded", "tag": "a6e067d4-bea0-49c9-b26b-8af45883186c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:54.529242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-de560c8f-a137-4b00-ae87-364226e354a1 req-d173107e-5ead-4195-8b12-c9d417656ab0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:54.529242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-de560c8f-a137-4b00-ae87-364226e354a1 req-d173107e-5ead-4195-8b12-c9d417656ab0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:54.627258 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-de560c8f-a137-4b00-ae87-364226e354a1 req-d173107e-5ead-4195-8b12-c9d417656ab0 service nova] Creating event network-vif-deleted:52d7951f-c056-422b-91e9-87c1ee53edc8 for instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e on n-h1-826529-8 Aug 03 02:05:54.645195 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-de560c8f-a137-4b00-ae87-364226e354a1 req-d173107e-5ead-4195-8b12-c9d417656ab0 service nova] Creating event network-changed:a6e067d4-bea0-49c9-b26b-8af45883186c for instance 407c74a8-e6f7-4146-8b2d-842fa10fbded on n-h1-826529-8 Aug 03 02:05:54.682728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-86b3c36a-8ea1-4312-9be7-c4073d31a1a6 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Updating instance_info_cache with network_info: [{"id": "a6e067d4-bea0-49c9-b26b-8af45883186c", "address": "fa:16:3e:17:d1:36", "network": {"id": "019fe6d8-1b74-4afa-8697-7fe379f8a53a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1371263325-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fb5f76083896407f8fbedf0c61c6f793", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa6e067d4-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125942) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 02:05:54.692860 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-de560c8f-a137-4b00-ae87-364226e354a1 req-d173107e-5ead-4195-8b12-c9d417656ab0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.237507 Aug 03 02:05:54.704580 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1876/3658] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:54.717479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86b3c36a-8ea1-4312-9be7-c4073d31a1a6 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Releasing lock "refresh_cache-407c74a8-e6f7-4146-8b2d-842fa10fbded" {{(pid=125942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 02:05:54.719292 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-86b3c36a-8ea1-4312-9be7-c4073d31a1a6 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "POST /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded/action" status: 202 len: 0 microversion: 2.1 time: 10.324469 Aug 03 02:05:54.740333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4c43908-987b-4424-a1cc-99840f0254a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:54.749031 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1783/3659] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:05:44 2022] POST /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded/action => generated 0 bytes in 10354 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 02:05:54.755872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f4c43908-987b-4424-a1cc-99840f0254a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:54.783054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4fb67154-54d9-4284-a38a-3645835bc545 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48a17817-8485-4fbf-a41e-20bfa6c41ae8"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:54.785812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4fb67154-54d9-4284-a38a-3645835bc545 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:54.792712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4c43908-987b-4424-a1cc-99840f0254a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:54.793830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4c43908-987b-4424-a1cc-99840f0254a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:54.795438 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4c43908-987b-4424-a1cc-99840f0254a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:54.796375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4c43908-987b-4424-a1cc-99840f0254a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:54.826750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4fb67154-54d9-4284-a38a-3645835bc545 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:54.833796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4fb67154-54d9-4284-a38a-3645835bc545 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:54.835011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4fb67154-54d9-4284-a38a-3645835bc545 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:54.835670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4fb67154-54d9-4284-a38a-3645835bc545 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:54.859993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f4c43908-987b-4424-a1cc-99840f0254a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:05:55.255657 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f4c43908-987b-4424-a1cc-99840f0254a6 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 204 len: 0 microversion: 2.1 time: 0.544572 Aug 03 02:05:55.257995 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1877/3660] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:05:54 2022] DELETE /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:05:55.281392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9af209a8-f01f-4efd-bae9-213f04d7c48a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '.version_select at 0x7f5b12678c10>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:56.018549 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4fb67154-54d9-4284-a38a-3645835bc545 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "POST /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.267407 Aug 03 02:05:56.026181 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1784/3661] 10.222.0.67 () {62 vars in 1364 bytes} [Wed Aug 3 02:05:54 2022] POST /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406/os-volume_attachments => generated 188 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:05:56.075163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ffba8835-0a62-460c-ab4c-95b8a3d92182 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:56.081417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ffba8835-0a62-460c-ab4c-95b8a3d92182 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:56.131926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffba8835-0a62-460c-ab4c-95b8a3d92182 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:56.137632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffba8835-0a62-460c-ab4c-95b8a3d92182 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:56.139947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffba8835-0a62-460c-ab4c-95b8a3d92182 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:56.141095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffba8835-0a62-460c-ab4c-95b8a3d92182 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:56.494547 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9af209a8-f01f-4efd-bae9-213f04d7c48a tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips/ab8e0698-43d6-44d4-ae1b-7b189b8887bd" status: 200 len: 184 microversion: 2.1 time: 1.230380 Aug 03 02:05:56.512133 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1878/3662] 10.222.0.67 () {58 vars in 1260 bytes} [Wed Aug 3 02:05:55 2022] GET /compute/v2.1/os-floating-ips/ab8e0698-43d6-44d4-ae1b-7b189b8887bd => generated 184 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:56.519000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6ff099a7-0998-4fe9-8bba-2cc9d001102f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:56.520121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6ff099a7-0998-4fe9-8bba-2cc9d001102f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:56.534784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ff099a7-0998-4fe9-8bba-2cc9d001102f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:56.536499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ff099a7-0998-4fe9-8bba-2cc9d001102f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:56.537518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ff099a7-0998-4fe9-8bba-2cc9d001102f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:56.537972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ff099a7-0998-4fe9-8bba-2cc9d001102f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:56.556266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ffba8835-0a62-460c-ab4c-95b8a3d92182 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:56.568150 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ffba8835-0a62-460c-ab4c-95b8a3d92182 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1273 microversion: 2.1 time: 0.539104 Aug 03 02:05:56.584711 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1785/3663] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:56 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1273 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:56.595853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1f9b304c-e105-4f72-83d9-af8840a5f71c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:56.598886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1f9b304c-e105-4f72-83d9-af8840a5f71c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:56.607959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f9b304c-e105-4f72-83d9-af8840a5f71c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:56.608899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f9b304c-e105-4f72-83d9-af8840a5f71c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:56.609989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f9b304c-e105-4f72-83d9-af8840a5f71c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:56.610670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f9b304c-e105-4f72-83d9-af8840a5f71c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:56.688175 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1f9b304c-e105-4f72-83d9-af8840a5f71c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097355 Aug 03 02:05:56.689694 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1786/3664] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:05:56 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:56.700118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fc52910e-4402-4ad6-98c8-bd5f157f966e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.225"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:57.090962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6ff099a7-0998-4fe9-8bba-2cc9d001102f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:57.121153 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6ff099a7-0998-4fe9-8bba-2cc9d001102f tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1528 microversion: 2.1 time: 0.605829 Aug 03 02:05:57.121923 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1879/3665] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:56 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1528 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:57.145802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5e558271-dad4-4c95-be0c-19a916166897 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:57.146321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5e558271-dad4-4c95-be0c-19a916166897 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:57.172835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e558271-dad4-4c95-be0c-19a916166897 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:57.173308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e558271-dad4-4c95-be0c-19a916166897 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:57.174276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e558271-dad4-4c95-be0c-19a916166897 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:57.187358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e558271-dad4-4c95-be0c-19a916166897 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:57.249432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fc52910e-4402-4ad6-98c8-bd5f157f966e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:57.259274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fc52910e-4402-4ad6-98c8-bd5f157f966e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:57.266897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fc52910e-4402-4ad6-98c8-bd5f157f966e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:57.268116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fc52910e-4402-4ad6-98c8-bd5f157f966e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:57.268803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fc52910e-4402-4ad6-98c8-bd5f157f966e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:57.777929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=5 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:05:57.845787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:05:57.933738 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5e558271-dad4-4c95-be0c-19a916166897 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406/os-volume_attachments/48a17817-8485-4fbf-a41e-20bfa6c41ae8" status: 202 len: 0 microversion: 2.20 time: 0.801090 Aug 03 02:05:57.941061 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1880/3666] 10.222.0.67 () {60 vars in 1457 bytes} [Wed Aug 3 02:05:57 2022] DELETE /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406/os-volume_attachments/48a17817-8485-4fbf-a41e-20bfa6c41ae8 => generated 0 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:05:57.984709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-05a1f01a-b1e2-44b8-8df4-9c0b0c6f7905 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:57.991447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-05a1f01a-b1e2-44b8-8df4-9c0b0c6f7905 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:58.025720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05a1f01a-b1e2-44b8-8df4-9c0b0c6f7905 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:58.043446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05a1f01a-b1e2-44b8-8df4-9c0b0c6f7905 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:58.043446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05a1f01a-b1e2-44b8-8df4-9c0b0c6f7905 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:58.043446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05a1f01a-b1e2-44b8-8df4-9c0b0c6f7905 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:58.870881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fc52910e-4402-4ad6-98c8-bd5f157f966e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Acquired lock "refresh_cache-407c74a8-e6f7-4146-8b2d-842fa10fbded" {{(pid=125942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 02:05:59.013758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-05a1f01a-b1e2-44b8-8df4-9c0b0c6f7905 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:59.036425 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-05a1f01a-b1e2-44b8-8df4-9c0b0c6f7905 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1315 microversion: 2.1 time: 1.097949 Aug 03 02:05:59.043490 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1881/3667] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:57 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1315 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:59.059573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f7526216-dddf-43ce-8c12-42bcf962400f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:59.062447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f7526216-dddf-43ce-8c12-42bcf962400f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:59.090220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7526216-dddf-43ce-8c12-42bcf962400f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:59.091366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7526216-dddf-43ce-8c12-42bcf962400f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:59.093773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7526216-dddf-43ce-8c12-42bcf962400f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:59.094947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7526216-dddf-43ce-8c12-42bcf962400f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:59.185424 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f7526216-dddf-43ce-8c12-42bcf962400f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139347 Aug 03 02:05:59.190081 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1882/3668] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:05:59 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:05:59.196455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1ea58cd0-93a4-4367-8e5c-0116db3a59c8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:05:59.204223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1ea58cd0-93a4-4367-8e5c-0116db3a59c8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:59.220308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1ea58cd0-93a4-4367-8e5c-0116db3a59c8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:59.220972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1ea58cd0-93a4-4367-8e5c-0116db3a59c8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:59.221942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1ea58cd0-93a4-4367-8e5c-0116db3a59c8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:59.223612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1ea58cd0-93a4-4367-8e5c-0116db3a59c8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:59.453504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1ea58cd0-93a4-4367-8e5c-0116db3a59c8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:05:59.474391 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1ea58cd0-93a4-4367-8e5c-0116db3a59c8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 200 len: 1486 microversion: 2.1 time: 0.277448 Aug 03 02:05:59.488163 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1883/3669] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:05:59 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 1486 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:05:59.523596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9b83c45a-f53f-41f2-b535-2784e0d795fd tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:05:59.525440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9b83c45a-f53f-41f2-b535-2784e0d795fd tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:05:59.588742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b83c45a-f53f-41f2-b535-2784e0d795fd tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:59.590077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b83c45a-f53f-41f2-b535-2784e0d795fd tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:59.592236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b83c45a-f53f-41f2-b535-2784e0d795fd tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:05:59.593338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b83c45a-f53f-41f2-b535-2784e0d795fd tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:05:59.766293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9b83c45a-f53f-41f2-b535-2784e0d795fd tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125941) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 02:05:59.974510 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9b83c45a-f53f-41f2-b535-2784e0d795fd tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "POST /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406/action" status: 202 len: 0 microversion: 2.20 time: 0.475686 Aug 03 02:05:59.983725 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1884/3670] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 3 02:05:59 2022] POST /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:05:59.999403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-214689106", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4f5b088-c1f1-4118-9137-86481e28c932"}], "security_groups": [{"name": "tempest-securitygroup--1290920791"}], "key_name": "tempest-keypair-1908956651", "user_data": "}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:00.537734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=10 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:00.829892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] validate_networks() for [('b4f5b088-c1f1-4118-9137-86481e28c932', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:06:01.785537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-fc52910e-4402-4ad6-98c8-bd5f157f966e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Building network info cache for instance {{(pid=125942) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 02:06:02.613130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:06:02.615292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:06:02.616210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:06:02.617498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:06:02.618170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:06:02.645343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:02.646354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:02.647674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:02.648328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:02.719228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Getting quotas for project 43ed3dcb7307452b965ee2d303ffaecd. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:06:02.740221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Getting quotas for user c6ac519db80b4ba99d67bd5db59be619 and project 43ed3dcb7307452b965ee2d303ffaecd. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:06:02.778626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:06:02.790180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:06:02.957413 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-de9e3a54-e3f0-479b-b400-291cb3ef1cee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.957401 Aug 03 02:06:02.961208 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1885/3671] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:05:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 2977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:06:02.985108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-9e29927d-0ab1-46f1-837d-42f7e46a818a req-9ea03fcf-b7ee-42f5-98e7-5d70d324cb9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d899e1f4-ca44-4ab5-bda0-97d7e101bf2d", "name": "network-vif-deleted", "tag": "d36319d8-ba29-46b8-bb38-02c46a6360e6"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:03.019087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9e29927d-0ab1-46f1-837d-42f7e46a818a req-9ea03fcf-b7ee-42f5-98e7-5d70d324cb9a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:03.019551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9e29927d-0ab1-46f1-837d-42f7e46a818a req-9ea03fcf-b7ee-42f5-98e7-5d70d324cb9a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:03.064774 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-9e29927d-0ab1-46f1-837d-42f7e46a818a req-9ea03fcf-b7ee-42f5-98e7-5d70d324cb9a service nova] Creating event network-vif-deleted:d36319d8-ba29-46b8-bb38-02c46a6360e6 for instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d on n-h1-826529-8 Aug 03 02:06:03.078095 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-9e29927d-0ab1-46f1-837d-42f7e46a818a req-9ea03fcf-b7ee-42f5-98e7-5d70d324cb9a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115115 Aug 03 02:06:03.079041 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1886/3672] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:03.093344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-82615a30-9b37-499a-a055-6fa27f5c340a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:03.094089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-82615a30-9b37-499a-a055-6fa27f5c340a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:03.111849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82615a30-9b37-499a-a055-6fa27f5c340a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:03.116212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82615a30-9b37-499a-a055-6fa27f5c340a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:03.120631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82615a30-9b37-499a-a055-6fa27f5c340a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:03.121134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82615a30-9b37-499a-a055-6fa27f5c340a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:03.997510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-82615a30-9b37-499a-a055-6fa27f5c340a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:04.012290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-82615a30-9b37-499a-a055-6fa27f5c340a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:04.015040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-fc52910e-4402-4ad6-98c8-bd5f157f966e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Updating instance_info_cache with network_info: [{"id": "a6e067d4-bea0-49c9-b26b-8af45883186c", "address": "fa:16:3e:17:d1:36", "network": {"id": "019fe6d8-1b74-4afa-8697-7fe379f8a53a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1371263325-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fb5f76083896407f8fbedf0c61c6f793", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa6e067d4-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125942) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 02:06:04.029942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=21,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:04.036618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fc52910e-4402-4ad6-98c8-bd5f157f966e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Releasing lock "refresh_cache-407c74a8-e6f7-4146-8b2d-842fa10fbded" {{(pid=125942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 02:06:04.037058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-82615a30-9b37-499a-a055-6fa27f5c340a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:04.039989 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fc52910e-4402-4ad6-98c8-bd5f157f966e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "POST /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded/action" status: 202 len: 0 microversion: 2.1 time: 7.348262 Aug 03 02:06:04.041101 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-82615a30-9b37-499a-a055-6fa27f5c340a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1730 microversion: 2.20 time: 0.960762 Aug 03 02:06:04.061458 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1787/3673] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:05:56 2022] POST /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded/action => generated 0 bytes in 7365 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 02:06:04.065839 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1887/3674] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:06:03 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1730 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:06:04.071509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ebebd643-45c2-4161-9e62-5f9df7f47eb1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:04.073304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2d9cfba0-7693-4c98-9847-239af4dbecdc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:04.074158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2d9cfba0-7693-4c98-9847-239af4dbecdc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:04.077569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ebebd643-45c2-4161-9e62-5f9df7f47eb1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:04.097268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d9cfba0-7693-4c98-9847-239af4dbecdc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:04.100160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebebd643-45c2-4161-9e62-5f9df7f47eb1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:04.101440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d9cfba0-7693-4c98-9847-239af4dbecdc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:04.102668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d9cfba0-7693-4c98-9847-239af4dbecdc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:04.103426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebebd643-45c2-4161-9e62-5f9df7f47eb1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:04.104437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebebd643-45c2-4161-9e62-5f9df7f47eb1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:04.105091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d9cfba0-7693-4c98-9847-239af4dbecdc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:04.106355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebebd643-45c2-4161-9e62-5f9df7f47eb1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:04.191539 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ebebd643-45c2-4161-9e62-5f9df7f47eb1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123510 Aug 03 02:06:04.193266 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1888/3675] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:06:04 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:04.211704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-18a77894-98b6-48b1-97f6-1dd8cd0895ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:04.215634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-18a77894-98b6-48b1-97f6-1dd8cd0895ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:04.237920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18a77894-98b6-48b1-97f6-1dd8cd0895ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:04.240208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18a77894-98b6-48b1-97f6-1dd8cd0895ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:04.243033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18a77894-98b6-48b1-97f6-1dd8cd0895ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:04.245958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18a77894-98b6-48b1-97f6-1dd8cd0895ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:04.291487 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-18a77894-98b6-48b1-97f6-1dd8cd0895ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] HTTP exception thrown: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-18a77894-98b6-48b1-97f6-1dd8cd0895ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Request method failure captured: Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d HTTP/1.1 Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6deKj_4ni6BiP5hu0KReUjCwN-jXFzDltBsZkdmHfZJw3iCK1NJe4cC4HqyDHfr9U2Xj9tTYrH-rL2Y-nfbcV2kQPduI8yks5ljNEDlazy86SExfxbA5OA6iqfJroq-67nWDTGmlBdStRJ_EHNLs6bYrB1tkODLPTKFNyABk3rb39eQ Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_78ae2f8c7bef4a959cdfa8c61360e7e5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}] Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e2c17b2e7e9f4c878826497386ee3ba7 Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'd899e1f4-ca44-4ab5-bda0-97d7e101bf2d'} Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:04.312278 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:04.317421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:04.317421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:04.317421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:04.317421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:04.317421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:04.317421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:04.317421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. Aug 03 02:06:04.317421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:04.317421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-18a77894-98b6-48b1-97f6-1dd8cd0895ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Returning 404 to user: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:04.317421 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-18a77894-98b6-48b1-97f6-1dd8cd0895ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 404 len: 111 microversion: 2.1 time: 0.114868 Aug 03 02:06:04.320328 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1889/3676] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:04 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:06:04.328893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-4c1ae911-d81e-45f3-8914-56f16b3240cc req-b3b4db6e-27a4-41da-bd6d-fd28ee3d204d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "407c74a8-e6f7-4146-8b2d-842fa10fbded", "tag": "a6e067d4-bea0-49c9-b26b-8af45883186c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:04.375289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4c1ae911-d81e-45f3-8914-56f16b3240cc req-b3b4db6e-27a4-41da-bd6d-fd28ee3d204d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:04.377521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4c1ae911-d81e-45f3-8914-56f16b3240cc req-b3b4db6e-27a4-41da-bd6d-fd28ee3d204d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:04.396653 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-4c1ae911-d81e-45f3-8914-56f16b3240cc req-b3b4db6e-27a4-41da-bd6d-fd28ee3d204d service nova] Creating event network-changed:a6e067d4-bea0-49c9-b26b-8af45883186c for instance 407c74a8-e6f7-4146-8b2d-842fa10fbded on n-h1-826529-8 Aug 03 02:06:04.403417 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-4c1ae911-d81e-45f3-8914-56f16b3240cc req-b3b4db6e-27a4-41da-bd6d-fd28ee3d204d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080428 Aug 03 02:06:04.405070 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1890/3677] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:04.412574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-15445e85-d87f-4c93-ab39-d12e6057ea0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:04.415063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-15445e85-d87f-4c93-ab39-d12e6057ea0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:04.423861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-15445e85-d87f-4c93-ab39-d12e6057ea0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:04.424746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-15445e85-d87f-4c93-ab39-d12e6057ea0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:04.426070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-15445e85-d87f-4c93-ab39-d12e6057ea0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:04.428228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-15445e85-d87f-4c93-ab39-d12e6057ea0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:04.682604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-15445e85-d87f-4c93-ab39-d12e6057ea0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:04.701714 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-15445e85-d87f-4c93-ab39-d12e6057ea0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1242 microversion: 2.1 time: 0.295011 Aug 03 02:06:04.712910 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1891/3678] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:04 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1242 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:04.733595 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8fcd65bf-e853-4490-8fb3-6caef8cc3b29 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:04.737437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8fcd65bf-e853-4490-8fb3-6caef8cc3b29 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:04.756501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8fcd65bf-e853-4490-8fb3-6caef8cc3b29 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:04.763452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8fcd65bf-e853-4490-8fb3-6caef8cc3b29 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:04.766133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8fcd65bf-e853-4490-8fb3-6caef8cc3b29 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:04.771234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8fcd65bf-e853-4490-8fb3-6caef8cc3b29 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:04.816178 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-8fcd65bf-e853-4490-8fb3-6caef8cc3b29 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] HTTP exception thrown: Instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e could not be found. Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8fcd65bf-e853-4490-8fb3-6caef8cc3b29 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Request method failure captured: Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e HTTP/1.1 Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6deZkYnk31GH3gRQaRkSg5H6JEBlXKlexCwgI-OPuTfI70QI3AJAW-cTM80UUi2UxC7x42JsXMAn0lfEX22aLqz-75HD5VQ9tFT1VzdWLuHZVh2Zt7OgaVjBXsiNyGNzmWmj_QpJGdz3eodapl1cXHJE5Ym0ySSGM_oDHUUwhoxyn_g Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: fb5f76083896407f8fbedf0c61c6f793 Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-479651113 Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fb5f76083896407f8fbedf0c61c6f793", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fb5f76083896407f8fbedf0c61c6f793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fb5f76083896407f8fbedf0c61c6f793"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fb5f76083896407f8fbedf0c61c6f793"}]}] Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-479651113 Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: fb5f76083896407f8fbedf0c61c6f793 Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-479651113 Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FloatingIPsAssociationTestJSON-479651113-project Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 2a0159b26db744799487da9445a7346b Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-479651113-project Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e could not be found. Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e'} Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e could not be found. Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:06:04.818324 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:06:04.829628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e could not be found. Aug 03 02:06:04.829628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:04.829628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:04.829628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:04.829628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:04.829628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:04.829628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:04.829628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:04.829628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:04.829628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e could not be found. Aug 03 02:06:04.829628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:04.829628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8fcd65bf-e853-4490-8fb3-6caef8cc3b29 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Returning 404 to user: Instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:04.829628 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8fcd65bf-e853-4490-8fb3-6caef8cc3b29 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" status: 404 len: 111 microversion: 2.1 time: 0.102682 Aug 03 02:06:04.829628 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1892/3679] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:06:04 2022] DELETE /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:06:04.837025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-97067855", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:04.904834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2d9cfba0-7693-4c98-9847-239af4dbecdc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:04.920698 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2d9cfba0-7693-4c98-9847-239af4dbecdc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1315 microversion: 2.1 time: 0.857773 Aug 03 02:06:04.922319 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1788/3680] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:04 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1315 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:04.938365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f97554d8-1f4d-4798-b189-ea50a0cdf598 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:04.940445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f97554d8-1f4d-4798-b189-ea50a0cdf598 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:04.952133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] validate_networks() for [('c1556e5c-ee98-4873-8046-a2026aaca40f', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:06:04.960532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f97554d8-1f4d-4798-b189-ea50a0cdf598 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:04.961054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f97554d8-1f4d-4798-b189-ea50a0cdf598 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:04.961901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f97554d8-1f4d-4798-b189-ea50a0cdf598 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:04.962501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f97554d8-1f4d-4798-b189-ea50a0cdf598 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:04.991014 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-f97554d8-1f4d-4798-b189-ea50a0cdf598 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] HTTP exception thrown: Instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e could not be found. Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f97554d8-1f4d-4798-b189-ea50a0cdf598 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Request method failure captured: Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e HTTP/1.1 Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6deZkYnk31GH3gRQaRkSg5H6JEBlXKlexCwgI-OPuTfI70QI3AJAW-cTM80UUi2UxC7x42JsXMAn0lfEX22aLqz-75HD5VQ9tFT1VzdWLuHZVh2Zt7OgaVjBXsiNyGNzmWmj_QpJGdz3eodapl1cXHJE5Ym0ySSGM_oDHUUwhoxyn_g Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: fb5f76083896407f8fbedf0c61c6f793 Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-479651113 Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fb5f76083896407f8fbedf0c61c6f793", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fb5f76083896407f8fbedf0c61c6f793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fb5f76083896407f8fbedf0c61c6f793"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fb5f76083896407f8fbedf0c61c6f793"}]}] Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-479651113 Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: fb5f76083896407f8fbedf0c61c6f793 Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-479651113 Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-FloatingIPsAssociationTestJSON-479651113-project Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 2a0159b26db744799487da9445a7346b Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-479651113-project Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e could not be found. Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e'} Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e could not be found. Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e could not be found. Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:04.995078 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:05.000219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:05.000219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:05.000219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:05.000219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:05.000219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:05.000219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:05.000219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e could not be found. Aug 03 02:06:05.000219 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:05.000219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f97554d8-1f4d-4798-b189-ea50a0cdf598 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Returning 404 to user: Instance ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:05.000219 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f97554d8-1f4d-4798-b189-ea50a0cdf598 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e" status: 404 len: 111 microversion: 2.1 time: 0.073112 Aug 03 02:06:05.001959 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1789/3681] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:04 2022] GET /compute/v2.1/servers/ea916a20-2c05-4fa7-aaa2-3ad3c02fd79e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:06:05.010046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-11794542", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:05.097951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:06:06.017987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:06:06.020376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:06:06.021131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:06:06.022240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:06:06.022981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:06:06.038662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:06.040208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:06.041887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:06.045320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:06.097645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Getting quotas for project 659c49cd3dd642afa881f2efe4f60c4c. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:06:06.111463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Getting quotas for user 975738127e114fbaae9f61584cd2ab4b and project 659c49cd3dd642afa881f2efe4f60c4c. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:06:06.137435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:06:06.141516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] [instance: 40c52648-e1d4-4a06-9e70-76728ecce4f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:06:06.229835 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-db927f59-2441-40a5-8f6f-10388bb4f097 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.226620 Aug 03 02:06:06.230559 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1790/3682] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:06:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:06:06.237143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-91f160ac-71ea-48d8-9fc8-f7a968edae12 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '.version_select at 0x7f5b1286eca0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:06.395195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:06:06.395859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:06:06.396845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:06:06.398198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:06:06.399168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:06:06.444884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:06.446236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:06.447307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:06.447957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:06.488187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Getting quotas for project 78ae2f8c7bef4a959cdfa8c61360e7e5. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:06:06.502420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Getting quotas for user e2c17b2e7e9f4c878826497386ee3ba7 and project 78ae2f8c7bef4a959cdfa8c61360e7e5. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:06:06.544484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:06.547954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:06:06.556470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:06:06.641554 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7b810520-dd62-42e4-a6dd-92444dbef019 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.814092 Aug 03 02:06:06.642861 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1893/3683] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:06:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:06:06.656265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-133c60ef-e8c6-4a84-be79-81398b938e96 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:06.658309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-133c60ef-e8c6-4a84-be79-81398b938e96 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:06.672532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-133c60ef-e8c6-4a84-be79-81398b938e96 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:06.674473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-133c60ef-e8c6-4a84-be79-81398b938e96 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:06.676130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-133c60ef-e8c6-4a84-be79-81398b938e96 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:06.676130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-133c60ef-e8c6-4a84-be79-81398b938e96 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:07.694121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-133c60ef-e8c6-4a84-be79-81398b938e96 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:07.719460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-133c60ef-e8c6-4a84-be79-81398b938e96 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:07.722460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-133c60ef-e8c6-4a84-be79-81398b938e96 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:07.749088 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-133c60ef-e8c6-4a84-be79-81398b938e96 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1730 microversion: 2.20 time: 1.104365 Aug 03 02:06:07.750099 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1894/3684] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:06:06 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1730 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:06:07.779473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-b0aa7324-fff6-414d-9911-4a0c1089e3a4 req-97120a0e-c226-40cc-9267-d778af9f6488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef77e1c8-a8d6-4306-89ea-0c3c169b1d75", "tag": "c5a88aa4-c808-4a91-ac92-184fb7899bd2"}, {"name": "network-changed", "server_uuid": "9ce11775-ab73-457e-8799-239915dc2406", "tag": "12c644d8-021b-4605-8e3c-16ff33d29cd1"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:07.827551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b0aa7324-fff6-414d-9911-4a0c1089e3a4 req-97120a0e-c226-40cc-9267-d778af9f6488 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:07.828596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b0aa7324-fff6-414d-9911-4a0c1089e3a4 req-97120a0e-c226-40cc-9267-d778af9f6488 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:07.893187 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-b0aa7324-fff6-414d-9911-4a0c1089e3a4 req-97120a0e-c226-40cc-9267-d778af9f6488 service nova] Creating event network-changed:c5a88aa4-c808-4a91-ac92-184fb7899bd2 for instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 on n-h2-826529-8 Aug 03 02:06:07.895564 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-b0aa7324-fff6-414d-9911-4a0c1089e3a4 req-97120a0e-c226-40cc-9267-d778af9f6488 service nova] Creating event network-changed:12c644d8-021b-4605-8e3c-16ff33d29cd1 for instance 9ce11775-ab73-457e-8799-239915dc2406 on n-h1-826529-8 Aug 03 02:06:07.924965 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-b0aa7324-fff6-414d-9911-4a0c1089e3a4 req-97120a0e-c226-40cc-9267-d778af9f6488 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.163255 Aug 03 02:06:07.947607 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1895/3685] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:07.973730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20f14987-5e16-4c5c-a6c1-54f0d998878a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:07.976429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-20f14987-5e16-4c5c-a6c1-54f0d998878a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:08.009020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20f14987-5e16-4c5c-a6c1-54f0d998878a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:08.009681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20f14987-5e16-4c5c-a6c1-54f0d998878a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:08.010715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20f14987-5e16-4c5c-a6c1-54f0d998878a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:08.011190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20f14987-5e16-4c5c-a6c1-54f0d998878a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:08.254609 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-20f14987-5e16-4c5c-a6c1-54f0d998878a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.304561 Aug 03 02:06:08.265622 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1896/3686] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:06:07 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244/os-volume_attachments => generated 25 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:06:08.292602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-954256ea-fb3d-4058-97a2-80bd3381726e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:08.308941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-954256ea-fb3d-4058-97a2-80bd3381726e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:08.332891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-954256ea-fb3d-4058-97a2-80bd3381726e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:08.336624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-954256ea-fb3d-4058-97a2-80bd3381726e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:08.337950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-954256ea-fb3d-4058-97a2-80bd3381726e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:08.340306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-954256ea-fb3d-4058-97a2-80bd3381726e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:09.827231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-954256ea-fb3d-4058-97a2-80bd3381726e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:09.846331 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-954256ea-fb3d-4058-97a2-80bd3381726e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1364 microversion: 2.1 time: 1.579279 Aug 03 02:06:09.847259 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1897/3687] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:08 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1364 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:09.866138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d120ebf9-4b6b-4a9f-b14f-77ac3c75a4d2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:09.874604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d120ebf9-4b6b-4a9f-b14f-77ac3c75a4d2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:09.887218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d120ebf9-4b6b-4a9f-b14f-77ac3c75a4d2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:09.892299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d120ebf9-4b6b-4a9f-b14f-77ac3c75a4d2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:09.893433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d120ebf9-4b6b-4a9f-b14f-77ac3c75a4d2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:09.894368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d120ebf9-4b6b-4a9f-b14f-77ac3c75a4d2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:10.877163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d120ebf9-4b6b-4a9f-b14f-77ac3c75a4d2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:10.893794 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d120ebf9-4b6b-4a9f-b14f-77ac3c75a4d2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1315 microversion: 2.1 time: 1.045207 Aug 03 02:06:10.895258 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1898/3688] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:09 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1315 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:10.915269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ec333637-7e1b-4732-9af0-0b17ba2905e6 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:10.916292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ec333637-7e1b-4732-9af0-0b17ba2905e6 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] [instance: 40c52648-e1d4-4a06-9e70-76728ecce4f0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:10.931649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec333637-7e1b-4732-9af0-0b17ba2905e6 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:10.934414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec333637-7e1b-4732-9af0-0b17ba2905e6 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:10.934414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec333637-7e1b-4732-9af0-0b17ba2905e6 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:10.935216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec333637-7e1b-4732-9af0-0b17ba2905e6 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:11.101513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ec333637-7e1b-4732-9af0-0b17ba2905e6 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975738127e114fbaae9f61584cd2ab4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659c49cd3dd642afa881f2efe4f60c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:11.127096 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ec333637-7e1b-4732-9af0-0b17ba2905e6 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] 10.222.0.67 "GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0" status: 200 len: 1271 microversion: 2.1 time: 0.228969 Aug 03 02:06:11.132587 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-91f160ac-71ea-48d8-9fc8-f7a968edae12 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/ab8e0698-43d6-44d4-ae1b-7b189b8887bd" status: 202 len: 0 microversion: 2.1 time: 4.899896 Aug 03 02:06:11.135700 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1791/3689] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 02:06:06 2022] DELETE /compute/v2.1/os-floating-ips/ab8e0698-43d6-44d4-ae1b-7b189b8887bd => generated 0 bytes in 4904 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:06:11.144080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8dbff00-3605-43ba-a32b-c9cf0abb69ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:11.149462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b8dbff00-3605-43ba-a32b-c9cf0abb69ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:11.159488 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1899/3690] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:10 2022] GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0 => generated 1271 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:11.166670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c3f0b187-46a9-4a45-8664-a1be89769b23 req-78f2de5e-be9c-48f1-8979-b647f98a29e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef77e1c8-a8d6-4306-89ea-0c3c169b1d75", "name": "network-vif-plugged", "status": "completed", "tag": "c5a88aa4-c808-4a91-ac92-184fb7899bd2"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:11.172869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8dbff00-3605-43ba-a32b-c9cf0abb69ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:11.180891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8dbff00-3605-43ba-a32b-c9cf0abb69ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:11.182860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8dbff00-3605-43ba-a32b-c9cf0abb69ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:11.185241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c3f0b187-46a9-4a45-8664-a1be89769b23 req-78f2de5e-be9c-48f1-8979-b647f98a29e0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:11.186237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8dbff00-3605-43ba-a32b-c9cf0abb69ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:11.186693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c3f0b187-46a9-4a45-8664-a1be89769b23 req-78f2de5e-be9c-48f1-8979-b647f98a29e0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:11.223615 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c3f0b187-46a9-4a45-8664-a1be89769b23 req-78f2de5e-be9c-48f1-8979-b647f98a29e0 service nova] Creating event network-vif-plugged:c5a88aa4-c808-4a91-ac92-184fb7899bd2 for instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 on n-h2-826529-8 Aug 03 02:06:11.237543 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c3f0b187-46a9-4a45-8664-a1be89769b23 req-78f2de5e-be9c-48f1-8979-b647f98a29e0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075937 Aug 03 02:06:11.238824 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1900/3691] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:11.256433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e3b95b06-bdb5-465d-aeb9-30bedb7c8448 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:11.261969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e3b95b06-bdb5-465d-aeb9-30bedb7c8448 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:11.282723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3b95b06-bdb5-465d-aeb9-30bedb7c8448 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:11.283524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3b95b06-bdb5-465d-aeb9-30bedb7c8448 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:11.284579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3b95b06-bdb5-465d-aeb9-30bedb7c8448 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:11.285660 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3b95b06-bdb5-465d-aeb9-30bedb7c8448 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:11.295225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:11.372997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e3b95b06-bdb5-465d-aeb9-30bedb7c8448 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:06:11.583955 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e3b95b06-bdb5-465d-aeb9-30bedb7c8448 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "DELETE /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 204 len: 0 microversion: 2.1 time: 0.342989 Aug 03 02:06:11.586326 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1901/3692] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:06:11 2022] DELETE /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:06:11.594850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9277dc71-cd1a-472c-b1d2-f5d8c0af790f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:11.595589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9277dc71-cd1a-472c-b1d2-f5d8c0af790f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:11.617894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9277dc71-cd1a-472c-b1d2-f5d8c0af790f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:11.617894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9277dc71-cd1a-472c-b1d2-f5d8c0af790f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:11.617894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9277dc71-cd1a-472c-b1d2-f5d8c0af790f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:11.617894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9277dc71-cd1a-472c-b1d2-f5d8c0af790f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:11.636378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b8dbff00-3605-43ba-a32b-c9cf0abb69ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:11.650340 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b8dbff00-3605-43ba-a32b-c9cf0abb69ef tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb" status: 200 len: 1281 microversion: 2.1 time: 0.511715 Aug 03 02:06:11.653943 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1792/3693] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:11 2022] GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb => generated 1281 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:11.676599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-e56a6a9c-ac6c-4111-867a-5d122f332b90 req-c98d64d7-5154-4c1d-a3b9-5c69b11c569a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9952a14-056b-4b74-ab8c-791d16592ddf", "tag": "6377bbf1-10a0-437b-a4d1-7bd2f82f03fe"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:11.700690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e56a6a9c-ac6c-4111-867a-5d122f332b90 req-c98d64d7-5154-4c1d-a3b9-5c69b11c569a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:11.701297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e56a6a9c-ac6c-4111-867a-5d122f332b90 req-c98d64d7-5154-4c1d-a3b9-5c69b11c569a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:11.717790 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e56a6a9c-ac6c-4111-867a-5d122f332b90 req-c98d64d7-5154-4c1d-a3b9-5c69b11c569a service nova] Creating event network-changed:6377bbf1-10a0-437b-a4d1-7bd2f82f03fe for instance b9952a14-056b-4b74-ab8c-791d16592ddf on n-h1-826529-8 Aug 03 02:06:11.745796 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-e56a6a9c-ac6c-4111-867a-5d122f332b90 req-c98d64d7-5154-4c1d-a3b9-5c69b11c569a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089759 Aug 03 02:06:11.747202 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1793/3694] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:11.755001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a64b02ec-0f23-4a79-a1dc-29938d34a7fa tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:11.756132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a64b02ec-0f23-4a79-a1dc-29938d34a7fa tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:11.773895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a64b02ec-0f23-4a79-a1dc-29938d34a7fa tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:11.774784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a64b02ec-0f23-4a79-a1dc-29938d34a7fa tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:11.775874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a64b02ec-0f23-4a79-a1dc-29938d34a7fa tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:11.794532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a64b02ec-0f23-4a79-a1dc-29938d34a7fa tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:12.196105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a64b02ec-0f23-4a79-a1dc-29938d34a7fa tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:12.208439 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a64b02ec-0f23-4a79-a1dc-29938d34a7fa tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1364 microversion: 2.1 time: 0.459478 Aug 03 02:06:12.209003 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1794/3695] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:11 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1364 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:12.232199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9277dc71-cd1a-472c-b1d2-f5d8c0af790f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:12.235199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e2c30027-f0c7-4d9d-a0c4-c6dc4b382dd7 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:12.236210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e2c30027-f0c7-4d9d-a0c4-c6dc4b382dd7 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:12.246574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9277dc71-cd1a-472c-b1d2-f5d8c0af790f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:12.248201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9277dc71-cd1a-472c-b1d2-f5d8c0af790f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:12.249465 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9277dc71-cd1a-472c-b1d2-f5d8c0af790f tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1730 microversion: 2.20 time: 0.661739 Aug 03 02:06:12.250426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2c30027-f0c7-4d9d-a0c4-c6dc4b382dd7 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:12.251879 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1902/3696] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:06:11 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1730 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:06:12.253469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2c30027-f0c7-4d9d-a0c4-c6dc4b382dd7 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:12.255288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2c30027-f0c7-4d9d-a0c4-c6dc4b382dd7 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:12.256271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2c30027-f0c7-4d9d-a0c4-c6dc4b382dd7 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:12.264433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9672c9b9-3122-4a7d-86cb-983bd710c34a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:12.265066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9672c9b9-3122-4a7d-86cb-983bd710c34a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:12.283944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9672c9b9-3122-4a7d-86cb-983bd710c34a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:12.284410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9672c9b9-3122-4a7d-86cb-983bd710c34a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:12.285264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9672c9b9-3122-4a7d-86cb-983bd710c34a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:12.285669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9672c9b9-3122-4a7d-86cb-983bd710c34a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:12.311163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e2c30027-f0c7-4d9d-a0c4-c6dc4b382dd7 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:06:12.479182 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e2c30027-f0c7-4d9d-a0c4-c6dc4b382dd7 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "DELETE /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded" status: 204 len: 0 microversion: 2.1 time: 0.256297 Aug 03 02:06:12.480491 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1795/3697] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:06:12 2022] DELETE /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:06:12.488901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6457aa5d-648c-4457-81db-a1a8d10d630c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:12.489997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6457aa5d-648c-4457-81db-a1a8d10d630c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:12.506515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6457aa5d-648c-4457-81db-a1a8d10d630c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:12.507955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6457aa5d-648c-4457-81db-a1a8d10d630c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:12.510286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6457aa5d-648c-4457-81db-a1a8d10d630c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:12.510928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6457aa5d-648c-4457-81db-a1a8d10d630c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:12.747175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9672c9b9-3122-4a7d-86cb-983bd710c34a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:12.755946 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9672c9b9-3122-4a7d-86cb-983bd710c34a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1681 microversion: 2.1 time: 0.499027 Aug 03 02:06:12.757405 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1903/3698] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:12 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1681 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:12.778527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6c02e13d-f786-45aa-b67c-1b50d2c4a52f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:12.779508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6c02e13d-f786-45aa-b67c-1b50d2c4a52f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] [instance: 40c52648-e1d4-4a06-9e70-76728ecce4f0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:12.787695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c02e13d-f786-45aa-b67c-1b50d2c4a52f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:12.789228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c02e13d-f786-45aa-b67c-1b50d2c4a52f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:12.791147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c02e13d-f786-45aa-b67c-1b50d2c4a52f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:12.791939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c02e13d-f786-45aa-b67c-1b50d2c4a52f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:13.135513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6457aa5d-648c-4457-81db-a1a8d10d630c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:13.159854 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6457aa5d-648c-4457-81db-a1a8d10d630c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1315 microversion: 2.1 time: 0.675604 Aug 03 02:06:13.159854 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1796/3699] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:12 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:13.164657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-195fdddd-bba9-4355-8b74-14bc7d85500e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:13.165213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-195fdddd-bba9-4355-8b74-14bc7d85500e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:13.188022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-195fdddd-bba9-4355-8b74-14bc7d85500e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:13.188692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-195fdddd-bba9-4355-8b74-14bc7d85500e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:13.199225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-195fdddd-bba9-4355-8b74-14bc7d85500e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:13.199953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-195fdddd-bba9-4355-8b74-14bc7d85500e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:13.566146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6c02e13d-f786-45aa-b67c-1b50d2c4a52f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975738127e114fbaae9f61584cd2ab4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659c49cd3dd642afa881f2efe4f60c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:13.581538 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6c02e13d-f786-45aa-b67c-1b50d2c4a52f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] 10.222.0.67 "GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0" status: 200 len: 1313 microversion: 2.1 time: 0.807572 Aug 03 02:06:13.582993 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1904/3700] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:12 2022] GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0 => generated 1313 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:13.589947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-381746de-669a-41d2-b518-0a3d5c2a2ef8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:13.591343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-381746de-669a-41d2-b518-0a3d5c2a2ef8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:13.624131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-381746de-669a-41d2-b518-0a3d5c2a2ef8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:13.625363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-381746de-669a-41d2-b518-0a3d5c2a2ef8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:13.639645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-381746de-669a-41d2-b518-0a3d5c2a2ef8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:13.644367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-381746de-669a-41d2-b518-0a3d5c2a2ef8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:13.953513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-195fdddd-bba9-4355-8b74-14bc7d85500e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:13.996333 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-195fdddd-bba9-4355-8b74-14bc7d85500e tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded" status: 200 len: 1526 microversion: 2.1 time: 0.836158 Aug 03 02:06:14.010937 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1797/3701] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:13 2022] GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded => generated 1526 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:14.013626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fad12703-3a9d-49db-aeb3-aad8113d5e91 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:14.015384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fad12703-3a9d-49db-aeb3-aad8113d5e91 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:14.030652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fad12703-3a9d-49db-aeb3-aad8113d5e91 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:14.032245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fad12703-3a9d-49db-aeb3-aad8113d5e91 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:14.034062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fad12703-3a9d-49db-aeb3-aad8113d5e91 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:14.035042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fad12703-3a9d-49db-aeb3-aad8113d5e91 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:14.330239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-381746de-669a-41d2-b518-0a3d5c2a2ef8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:14.348724 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-381746de-669a-41d2-b518-0a3d5c2a2ef8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb" status: 200 len: 1323 microversion: 2.1 time: 0.763459 Aug 03 02:06:14.351238 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1905/3702] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:13 2022] GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb => generated 1323 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:14.359862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d93bd395-4cc9-46a5-aec5-8e47ab897710 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:14.361269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d93bd395-4cc9-46a5-aec5-8e47ab897710 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:14.378206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d93bd395-4cc9-46a5-aec5-8e47ab897710 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:14.379209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d93bd395-4cc9-46a5-aec5-8e47ab897710 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:14.380239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d93bd395-4cc9-46a5-aec5-8e47ab897710 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:14.381038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d93bd395-4cc9-46a5-aec5-8e47ab897710 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:14.448212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fad12703-3a9d-49db-aeb3-aad8113d5e91 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:14.464384 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fad12703-3a9d-49db-aeb3-aad8113d5e91 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1364 microversion: 2.1 time: 0.461500 Aug 03 02:06:14.466023 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1798/3703] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:14 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1364 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:14.477278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c10f37c5-56a2-4728-a067-daff307f2001 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:14.478707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c10f37c5-56a2-4728-a067-daff307f2001 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:14.490255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c10f37c5-56a2-4728-a067-daff307f2001 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:14.492447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c10f37c5-56a2-4728-a067-daff307f2001 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:14.493319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c10f37c5-56a2-4728-a067-daff307f2001 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:14.493896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c10f37c5-56a2-4728-a067-daff307f2001 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:14.745800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d93bd395-4cc9-46a5-aec5-8e47ab897710 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:14.770233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d93bd395-4cc9-46a5-aec5-8e47ab897710 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:14.774013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d93bd395-4cc9-46a5-aec5-8e47ab897710 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:14.778526 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d93bd395-4cc9-46a5-aec5-8e47ab897710 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1730 microversion: 2.20 time: 0.423445 Aug 03 02:06:14.778837 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1906/3704] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:06:14 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1730 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:06:14.797225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c929e430-2f60-41bc-b3d4-5b9bdc34adcd req-dbed90d1-90b3-463b-aec9-936ea574e302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c52648-e1d4-4a06-9e70-76728ecce4f0", "tag": "0fd5843c-c543-4f31-8a0a-8c6b6ca53019"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:14.842362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c929e430-2f60-41bc-b3d4-5b9bdc34adcd req-dbed90d1-90b3-463b-aec9-936ea574e302 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:14.843244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c929e430-2f60-41bc-b3d4-5b9bdc34adcd req-dbed90d1-90b3-463b-aec9-936ea574e302 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:14.916459 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c929e430-2f60-41bc-b3d4-5b9bdc34adcd req-dbed90d1-90b3-463b-aec9-936ea574e302 service nova] Creating event network-changed:0fd5843c-c543-4f31-8a0a-8c6b6ca53019 for instance 40c52648-e1d4-4a06-9e70-76728ecce4f0 on n-h2-826529-8 Aug 03 02:06:14.935127 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c929e430-2f60-41bc-b3d4-5b9bdc34adcd req-dbed90d1-90b3-463b-aec9-936ea574e302 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143503 Aug 03 02:06:14.941013 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1907/3705] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:14.965397 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b9ff4a9a-d13c-4ff3-9abf-d57874a1105b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:14.982679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b9ff4a9a-d13c-4ff3-9abf-d57874a1105b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:15.015518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9ff4a9a-d13c-4ff3-9abf-d57874a1105b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:15.016416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9ff4a9a-d13c-4ff3-9abf-d57874a1105b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:15.017987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9ff4a9a-d13c-4ff3-9abf-d57874a1105b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:15.018712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9ff4a9a-d13c-4ff3-9abf-d57874a1105b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:15.343752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c10f37c5-56a2-4728-a067-daff307f2001 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:15.373728 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c10f37c5-56a2-4728-a067-daff307f2001 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1681 microversion: 2.1 time: 0.898529 Aug 03 02:06:15.375388 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1799/3706] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:14 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1681 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:15.392573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7b0211b8-d159-40f1-8e3d-8428b440e958 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:15.398666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7b0211b8-d159-40f1-8e3d-8428b440e958 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] [instance: 40c52648-e1d4-4a06-9e70-76728ecce4f0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:15.414838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b0211b8-d159-40f1-8e3d-8428b440e958 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:15.416187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b0211b8-d159-40f1-8e3d-8428b440e958 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:15.418048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b0211b8-d159-40f1-8e3d-8428b440e958 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:15.419755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b0211b8-d159-40f1-8e3d-8428b440e958 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:15.625928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b9ff4a9a-d13c-4ff3-9abf-d57874a1105b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:15.640197 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b9ff4a9a-d13c-4ff3-9abf-d57874a1105b tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1502 microversion: 2.1 time: 0.694210 Aug 03 02:06:15.649176 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1908/3707] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:14 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1502 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:15.656541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-88867709-367e-4cab-9957-92a3d291d695 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:15.662499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-88867709-367e-4cab-9957-92a3d291d695 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:15.684306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88867709-367e-4cab-9957-92a3d291d695 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:15.685082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88867709-367e-4cab-9957-92a3d291d695 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:15.689178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88867709-367e-4cab-9957-92a3d291d695 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:15.689945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88867709-367e-4cab-9957-92a3d291d695 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:16.058691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:16.125271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:16.226011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7b0211b8-d159-40f1-8e3d-8428b440e958 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975738127e114fbaae9f61584cd2ab4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659c49cd3dd642afa881f2efe4f60c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:16.258258 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7b0211b8-d159-40f1-8e3d-8428b440e958 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] 10.222.0.67 "GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0" status: 200 len: 1313 microversion: 2.1 time: 0.877784 Aug 03 02:06:16.264222 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1800/3708] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:15 2022] GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0 => generated 1313 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:16.285157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-990be7d1-9b78-410d-9a53-406042d41807 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:16.289254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-990be7d1-9b78-410d-9a53-406042d41807 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:16.318895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-990be7d1-9b78-410d-9a53-406042d41807 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:16.321215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-990be7d1-9b78-410d-9a53-406042d41807 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:16.323685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-990be7d1-9b78-410d-9a53-406042d41807 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:16.325229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-990be7d1-9b78-410d-9a53-406042d41807 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:16.464543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:16.519558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=12 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:17.130310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-88867709-367e-4cab-9957-92a3d291d695 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a0159b26db744799487da9445a7346b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5f76083896407f8fbedf0c61c6f793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:17.169843 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-88867709-367e-4cab-9957-92a3d291d695 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded" status: 200 len: 1526 microversion: 2.1 time: 1.519228 Aug 03 02:06:17.171420 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1909/3709] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:15 2022] GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded => generated 1526 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:17.189884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5c0d9b5f-dcaa-478b-a7e4-c2d431d3551e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:17.191907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5c0d9b5f-dcaa-478b-a7e4-c2d431d3551e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:17.240193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c0d9b5f-dcaa-478b-a7e4-c2d431d3551e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:17.241444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c0d9b5f-dcaa-478b-a7e4-c2d431d3551e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:17.243732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c0d9b5f-dcaa-478b-a7e4-c2d431d3551e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:17.246571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c0d9b5f-dcaa-478b-a7e4-c2d431d3551e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:17.501512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-990be7d1-9b78-410d-9a53-406042d41807 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:17.513039 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-990be7d1-9b78-410d-9a53-406042d41807 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb" status: 200 len: 1323 microversion: 2.1 time: 1.246259 Aug 03 02:06:17.524926 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1801/3710] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:16 2022] GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb => generated 1323 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:17.534928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c33e8ec3-950f-4149-9328-05c44cc0efdf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:17.568123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c33e8ec3-950f-4149-9328-05c44cc0efdf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:17.569506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c33e8ec3-950f-4149-9328-05c44cc0efdf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:17.642001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c33e8ec3-950f-4149-9328-05c44cc0efdf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Going to try to stop instance {{(pid=125942) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 02:06:17.831464 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c33e8ec3-950f-4149-9328-05c44cc0efdf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "POST /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75/action" status: 202 len: 0 microversion: 2.1 time: 0.303218 Aug 03 02:06:17.835639 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1802/3711] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:06:17 2022] POST /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:06:17.880132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d5ed8add-481c-4ea4-807c-797fa9d35995 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:17.885526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d5ed8add-481c-4ea4-807c-797fa9d35995 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:17.917450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5ed8add-481c-4ea4-807c-797fa9d35995 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:17.918122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5ed8add-481c-4ea4-807c-797fa9d35995 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:17.921290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5ed8add-481c-4ea4-807c-797fa9d35995 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:17.923638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5ed8add-481c-4ea4-807c-797fa9d35995 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:18.461561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5c0d9b5f-dcaa-478b-a7e4-c2d431d3551e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:18.479114 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5c0d9b5f-dcaa-478b-a7e4-c2d431d3551e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1364 microversion: 2.1 time: 1.306315 Aug 03 02:06:18.480494 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1910/3712] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:17 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1364 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:18.490446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-02df7244-5bea-4e06-b81b-0b2d4d09f7b9 req-05101150-1d82-47ad-abee-60cee8b458aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99358f36-9bc7-4e58-8a98-70b4e391e244", "name": "network-vif-unplugged", "status": "completed", "tag": "75880f3c-9e7a-4a26-9ab7-243bab43e9a8"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:18.507895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-02df7244-5bea-4e06-b81b-0b2d4d09f7b9 req-05101150-1d82-47ad-abee-60cee8b458aa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:18.508734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-02df7244-5bea-4e06-b81b-0b2d4d09f7b9 req-05101150-1d82-47ad-abee-60cee8b458aa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:18.531944 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-02df7244-5bea-4e06-b81b-0b2d4d09f7b9 req-05101150-1d82-47ad-abee-60cee8b458aa service nova] Creating event network-vif-unplugged:75880f3c-9e7a-4a26-9ab7-243bab43e9a8 for instance 99358f36-9bc7-4e58-8a98-70b4e391e244 on n-h1-826529-8 Aug 03 02:06:18.538560 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-02df7244-5bea-4e06-b81b-0b2d4d09f7b9 req-05101150-1d82-47ad-abee-60cee8b458aa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056309 Aug 03 02:06:18.539828 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1911/3713] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:18.549415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a21e0e50-8efb-4c21-8301-5a463dfa2976 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:18.551028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a21e0e50-8efb-4c21-8301-5a463dfa2976 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:18.562033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a21e0e50-8efb-4c21-8301-5a463dfa2976 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:18.562294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a21e0e50-8efb-4c21-8301-5a463dfa2976 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:18.564665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a21e0e50-8efb-4c21-8301-5a463dfa2976 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:18.565194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a21e0e50-8efb-4c21-8301-5a463dfa2976 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:18.585505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d5ed8add-481c-4ea4-807c-797fa9d35995 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:18.640056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d5ed8add-481c-4ea4-807c-797fa9d35995 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:18.662057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d5ed8add-481c-4ea4-807c-797fa9d35995 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:18.677707 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d5ed8add-481c-4ea4-807c-797fa9d35995 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1730 microversion: 2.20 time: 0.825198 Aug 03 02:06:18.688424 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1803/3714] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:06:17 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1730 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:06:18.696640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-51cc056b-4b4c-43b9-bc3e-23de1006273f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:18.717841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-51cc056b-4b4c-43b9-bc3e-23de1006273f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] [instance: 40c52648-e1d4-4a06-9e70-76728ecce4f0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:18.744443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51cc056b-4b4c-43b9-bc3e-23de1006273f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:18.748257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51cc056b-4b4c-43b9-bc3e-23de1006273f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:18.752991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51cc056b-4b4c-43b9-bc3e-23de1006273f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:18.760173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51cc056b-4b4c-43b9-bc3e-23de1006273f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:18.914418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:SELECT=93,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:20.421339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a21e0e50-8efb-4c21-8301-5a463dfa2976 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:20.459561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-51cc056b-4b4c-43b9-bc3e-23de1006273f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975738127e114fbaae9f61584cd2ab4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659c49cd3dd642afa881f2efe4f60c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:20.474344 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a21e0e50-8efb-4c21-8301-5a463dfa2976 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1681 microversion: 2.1 time: 1.932205 Aug 03 02:06:20.487509 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1912/3715] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:18 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1681 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:20.492104 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-51cc056b-4b4c-43b9-bc3e-23de1006273f tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] 10.222.0.67 "GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0" status: 200 len: 1313 microversion: 2.1 time: 1.801513 Aug 03 02:06:20.522942 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1804/3716] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:18 2022] GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0 => generated 1313 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:20.523676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f8f5d7d8-588b-4e9f-8101-0e276e798802 req-9471ad67-b588-41d1-b705-3cbcc4714ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407c74a8-e6f7-4146-8b2d-842fa10fbded", "name": "network-vif-deleted", "tag": "a6e067d4-bea0-49c9-b26b-8af45883186c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:20.537347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f8f5d7d8-588b-4e9f-8101-0e276e798802 req-9471ad67-b588-41d1-b705-3cbcc4714ea6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:20.537347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f8f5d7d8-588b-4e9f-8101-0e276e798802 req-9471ad67-b588-41d1-b705-3cbcc4714ea6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:20.549011 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f8f5d7d8-588b-4e9f-8101-0e276e798802 req-9471ad67-b588-41d1-b705-3cbcc4714ea6 service nova] Creating event network-vif-deleted:a6e067d4-bea0-49c9-b26b-8af45883186c for instance 407c74a8-e6f7-4146-8b2d-842fa10fbded on n-h1-826529-8 Aug 03 02:06:20.553536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6fda538f-4ada-4ae7-9e59-e3ee3b6ffc25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:20.560516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6fda538f-4ada-4ae7-9e59-e3ee3b6ffc25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:20.561142 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f8f5d7d8-588b-4e9f-8101-0e276e798802 req-9471ad67-b588-41d1-b705-3cbcc4714ea6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059723 Aug 03 02:06:20.562257 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1913/3717] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:20.574215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b2f797fa-7a1d-4c04-8628-7b72d387f163 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:20.575518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b2f797fa-7a1d-4c04-8628-7b72d387f163 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] [instance: 407c74a8-e6f7-4146-8b2d-842fa10fbded] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:20.588998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fda538f-4ada-4ae7-9e59-e3ee3b6ffc25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:20.593016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fda538f-4ada-4ae7-9e59-e3ee3b6ffc25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:20.593638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2f797fa-7a1d-4c04-8628-7b72d387f163 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:20.594514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2f797fa-7a1d-4c04-8628-7b72d387f163 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:20.596690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fda538f-4ada-4ae7-9e59-e3ee3b6ffc25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:20.598939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fda538f-4ada-4ae7-9e59-e3ee3b6ffc25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:20.599083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2f797fa-7a1d-4c04-8628-7b72d387f163 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:20.600114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2f797fa-7a1d-4c04-8628-7b72d387f163 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:20.651260 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-b2f797fa-7a1d-4c04-8628-7b72d387f163 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] HTTP exception thrown: Instance 407c74a8-e6f7-4146-8b2d-842fa10fbded could not be found. Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b2f797fa-7a1d-4c04-8628-7b72d387f163 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Request method failure captured: Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded HTTP/1.1 Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6deZkYnk31GH3gRQaRkSg5H6JEBlXKlexCwgI-OPuTfI70QI3AJAW-cTM80UUi2UxC7x42JsXMAn0lfEX22aLqz-75HD5VQ9tFT1VzdWLuHZVh2Zt7OgaVjBXsiNyGNzmWmj_QpJGdz3eodapl1cXHJE5Ym0ySSGM_oDHUUwhoxyn_g Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: fb5f76083896407f8fbedf0c61c6f793 Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-479651113 Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fb5f76083896407f8fbedf0c61c6f793", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fb5f76083896407f8fbedf0c61c6f793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fb5f76083896407f8fbedf0c61c6f793"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fb5f76083896407f8fbedf0c61c6f793"}]}] Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-479651113 Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: fb5f76083896407f8fbedf0c61c6f793 Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-479651113 Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FloatingIPsAssociationTestJSON-479651113-project Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 2a0159b26db744799487da9445a7346b Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-479651113-project Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 407c74a8-e6f7-4146-8b2d-842fa10fbded could not be found. Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '407c74a8-e6f7-4146-8b2d-842fa10fbded'} Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407c74a8-e6f7-4146-8b2d-842fa10fbded could not be found. Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407c74a8-e6f7-4146-8b2d-842fa10fbded could not be found. Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:20.653355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:20.658393 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:20.658393 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:20.658393 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:20.658393 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:20.658393 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:20.658393 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:20.658393 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407c74a8-e6f7-4146-8b2d-842fa10fbded could not be found. Aug 03 02:06:20.658393 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:20.661656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b2f797fa-7a1d-4c04-8628-7b72d387f163 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] Returning 404 to user: Instance 407c74a8-e6f7-4146-8b2d-842fa10fbded could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:20.663622 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b2f797fa-7a1d-4c04-8628-7b72d387f163 tempest-FloatingIPsAssociationTestJSON-479651113 tempest-FloatingIPsAssociationTestJSON-479651113-project] 10.222.0.67 "GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded" status: 404 len: 111 microversion: 2.1 time: 0.098519 Aug 03 02:06:20.670581 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1914/3718] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:20 2022] GET /compute/v2.1/servers/407c74a8-e6f7-4146-8b2d-842fa10fbded => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:06:20.677859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-edd5dea2-4d62-432e-96ae-c216ec0efb28 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:20.683367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-edd5dea2-4d62-432e-96ae-c216ec0efb28 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:20.695950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edd5dea2-4d62-432e-96ae-c216ec0efb28 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:20.697041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edd5dea2-4d62-432e-96ae-c216ec0efb28 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:20.701473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edd5dea2-4d62-432e-96ae-c216ec0efb28 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:20.702767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edd5dea2-4d62-432e-96ae-c216ec0efb28 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:21.992794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6fda538f-4ada-4ae7-9e59-e3ee3b6ffc25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:22.033848 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6fda538f-4ada-4ae7-9e59-e3ee3b6ffc25 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1512 microversion: 2.1 time: 1.506630 Aug 03 02:06:22.036419 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1805/3719] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:20 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1512 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:22.062109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-913a0967-8bde-4488-9e1a-9f83c87e0306 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:22.063106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-913a0967-8bde-4488-9e1a-9f83c87e0306 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:22.085304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-913a0967-8bde-4488-9e1a-9f83c87e0306 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:22.089547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-913a0967-8bde-4488-9e1a-9f83c87e0306 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:22.096718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-913a0967-8bde-4488-9e1a-9f83c87e0306 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:22.097519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-913a0967-8bde-4488-9e1a-9f83c87e0306 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:23.117566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-edd5dea2-4d62-432e-96ae-c216ec0efb28 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:23.233726 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-edd5dea2-4d62-432e-96ae-c216ec0efb28 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb" status: 200 len: 1323 microversion: 2.1 time: 2.555739 Aug 03 02:06:23.239549 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1915/3720] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:20 2022] GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb => generated 1323 bytes in 2567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:23.275998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a3dd0d25-b907-4ea3-b31b-5b0a96b3d9db tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:23.290220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a3dd0d25-b907-4ea3-b31b-5b0a96b3d9db tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:23.410288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3dd0d25-b907-4ea3-b31b-5b0a96b3d9db tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:23.421442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-913a0967-8bde-4488-9e1a-9f83c87e0306 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:23.424834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3dd0d25-b907-4ea3-b31b-5b0a96b3d9db tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:23.444832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3dd0d25-b907-4ea3-b31b-5b0a96b3d9db tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:23.489286 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-913a0967-8bde-4488-9e1a-9f83c87e0306 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1364 microversion: 2.1 time: 1.447878 Aug 03 02:06:23.496379 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1806/3721] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:22 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1364 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:23.513962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3dd0d25-b907-4ea3-b31b-5b0a96b3d9db tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.074s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:23.528037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-60f8f228-b63e-477c-90e7-7d596e866ec0 req-88ae5c3b-f604-4ba5-8540-34f36d1dabf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baae908b-c865-422d-a41c-b0add7d722bb", "tag": "c6b92644-3987-4338-b9a8-9c87591b94ed"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:23.621320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-60f8f228-b63e-477c-90e7-7d596e866ec0 req-88ae5c3b-f604-4ba5-8540-34f36d1dabf9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:23.622197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-60f8f228-b63e-477c-90e7-7d596e866ec0 req-88ae5c3b-f604-4ba5-8540-34f36d1dabf9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:23.655373 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-60f8f228-b63e-477c-90e7-7d596e866ec0 req-88ae5c3b-f604-4ba5-8540-34f36d1dabf9 service nova] Creating event network-changed:c6b92644-3987-4338-b9a8-9c87591b94ed for instance baae908b-c865-422d-a41c-b0add7d722bb on n-h2-826529-8 Aug 03 02:06:23.665025 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-60f8f228-b63e-477c-90e7-7d596e866ec0 req-88ae5c3b-f604-4ba5-8540-34f36d1dabf9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164355 Aug 03 02:06:23.666088 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1807/3722] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:23.674709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f5ab5f8c-245f-4562-9166-0409450c2592 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:23.675920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f5ab5f8c-245f-4562-9166-0409450c2592 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:23.687215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5ab5f8c-245f-4562-9166-0409450c2592 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:23.688372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5ab5f8c-245f-4562-9166-0409450c2592 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:23.689844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5ab5f8c-245f-4562-9166-0409450c2592 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:23.690854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5ab5f8c-245f-4562-9166-0409450c2592 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:23.766454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5ab5f8c-245f-4562-9166-0409450c2592 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:23.767231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5ab5f8c-245f-4562-9166-0409450c2592 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:23.768103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-f5ab5f8c-245f-4562-9166-0409450c2592 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lazy-loading 'fault' on Instance uuid 99358f36-9bc7-4e58-8a98-70b4e391e244 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:06:23.895165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f5ab5f8c-245f-4562-9166-0409450c2592 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:23.918410 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f5ab5f8c-245f-4562-9166-0409450c2592 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1331 microversion: 2.1 time: 0.250322 Aug 03 02:06:23.921940 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1808/3723] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:23 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1331 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:23.935875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0dc91652-3687-44f1-9f04-a697ea8cca4e tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:23.941203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0dc91652-3687-44f1-9f04-a697ea8cca4e tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] [instance: 40c52648-e1d4-4a06-9e70-76728ecce4f0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:23.965524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0dc91652-3687-44f1-9f04-a697ea8cca4e tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:23.966779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0dc91652-3687-44f1-9f04-a697ea8cca4e tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:23.968718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0dc91652-3687-44f1-9f04-a697ea8cca4e tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:23.969784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0dc91652-3687-44f1-9f04-a697ea8cca4e tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:24.535844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0dc91652-3687-44f1-9f04-a697ea8cca4e tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975738127e114fbaae9f61584cd2ab4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659c49cd3dd642afa881f2efe4f60c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:24.559676 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0dc91652-3687-44f1-9f04-a697ea8cca4e tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] 10.222.0.67 "GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0" status: 200 len: 1313 microversion: 2.1 time: 0.632661 Aug 03 02:06:24.579434 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1809/3724] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:23 2022] GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0 => generated 1313 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:24.593862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-47931fe3-86a1-45b9-bec5-8e341c188377 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:24.594841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-47931fe3-86a1-45b9-bec5-8e341c188377 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:24.602872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:24.606342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47931fe3-86a1-45b9-bec5-8e341c188377 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:24.606342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47931fe3-86a1-45b9-bec5-8e341c188377 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:24.607288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47931fe3-86a1-45b9-bec5-8e341c188377 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:24.607288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47931fe3-86a1-45b9-bec5-8e341c188377 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:24.628874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a3dd0d25-b907-4ea3-b31b-5b0a96b3d9db tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:24.644447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a3dd0d25-b907-4ea3-b31b-5b0a96b3d9db tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:24.646018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a3dd0d25-b907-4ea3-b31b-5b0a96b3d9db tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:24.647311 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a3dd0d25-b907-4ea3-b31b-5b0a96b3d9db tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1730 microversion: 2.20 time: 1.401887 Aug 03 02:06:24.647890 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1916/3725] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:06:23 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1730 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:06:24.696611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-943a44a5-61c2-4c58-8e8c-f2453ee08ac0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:24.697273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-943a44a5-61c2-4c58-8e8c-f2453ee08ac0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:24.738774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-943a44a5-61c2-4c58-8e8c-f2453ee08ac0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:24.739521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-943a44a5-61c2-4c58-8e8c-f2453ee08ac0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:24.740512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-943a44a5-61c2-4c58-8e8c-f2453ee08ac0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:24.747247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-943a44a5-61c2-4c58-8e8c-f2453ee08ac0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:24.940742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-47931fe3-86a1-45b9-bec5-8e341c188377 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:24.966853 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-47931fe3-86a1-45b9-bec5-8e341c188377 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1512 microversion: 2.1 time: 0.385591 Aug 03 02:06:24.968102 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1810/3726] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:24 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1512 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:24.992761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2f42066b-bba1-4387-b6e9-2e2f0335e185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:24.993784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2f42066b-bba1-4387-b6e9-2e2f0335e185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:25.004819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f42066b-bba1-4387-b6e9-2e2f0335e185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:25.005290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f42066b-bba1-4387-b6e9-2e2f0335e185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:25.006101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f42066b-bba1-4387-b6e9-2e2f0335e185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:25.018039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f42066b-bba1-4387-b6e9-2e2f0335e185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:25.252193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-943a44a5-61c2-4c58-8e8c-f2453ee08ac0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:25.261545 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-943a44a5-61c2-4c58-8e8c-f2453ee08ac0 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb" status: 200 len: 1323 microversion: 2.1 time: 0.577562 Aug 03 02:06:25.276948 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1917/3727] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:24 2022] GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb => generated 1323 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:25.276948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a05643ee-722f-4847-9933-843da66be18b req-b459246b-d5fa-42c8-b285-e60fa3395594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c52648-e1d4-4a06-9e70-76728ecce4f0", "name": "network-vif-plugged", "status": "completed", "tag": "0fd5843c-c543-4f31-8a0a-8c6b6ca53019"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:25.295652 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a05643ee-722f-4847-9933-843da66be18b req-b459246b-d5fa-42c8-b285-e60fa3395594 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:25.301374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a05643ee-722f-4847-9933-843da66be18b req-b459246b-d5fa-42c8-b285-e60fa3395594 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:25.330368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2f42066b-bba1-4387-b6e9-2e2f0335e185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:25.335713 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a05643ee-722f-4847-9933-843da66be18b req-b459246b-d5fa-42c8-b285-e60fa3395594 service nova] Creating event network-vif-plugged:0fd5843c-c543-4f31-8a0a-8c6b6ca53019 for instance 40c52648-e1d4-4a06-9e70-76728ecce4f0 on n-h2-826529-8 Aug 03 02:06:25.341443 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2f42066b-bba1-4387-b6e9-2e2f0335e185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1364 microversion: 2.1 time: 0.366747 Aug 03 02:06:25.342622 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1811/3728] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:24 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1364 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:25.347627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d9da5e87-b890-4bff-ade0-6277e7425786 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:25.348504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d9da5e87-b890-4bff-ade0-6277e7425786 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:25.353678 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a05643ee-722f-4847-9933-843da66be18b req-b459246b-d5fa-42c8-b285-e60fa3395594 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086757 Aug 03 02:06:25.359076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9da5e87-b890-4bff-ade0-6277e7425786 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:25.360247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9da5e87-b890-4bff-ade0-6277e7425786 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:25.364332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9da5e87-b890-4bff-ade0-6277e7425786 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:25.364580 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1918/3729] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:25.366207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9da5e87-b890-4bff-ade0-6277e7425786 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:25.433929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9da5e87-b890-4bff-ade0-6277e7425786 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:25.449062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9da5e87-b890-4bff-ade0-6277e7425786 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:25.449800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-d9da5e87-b890-4bff-ade0-6277e7425786 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lazy-loading 'fault' on Instance uuid 99358f36-9bc7-4e58-8a98-70b4e391e244 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:06:25.618896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0022622f-79f7-4e18-ba5d-1ac1968f8637 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:25.622558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0022622f-79f7-4e18-ba5d-1ac1968f8637 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] [instance: 40c52648-e1d4-4a06-9e70-76728ecce4f0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:25.642992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0022622f-79f7-4e18-ba5d-1ac1968f8637 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:25.649887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0022622f-79f7-4e18-ba5d-1ac1968f8637 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:25.654236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0022622f-79f7-4e18-ba5d-1ac1968f8637 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:25.657649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0022622f-79f7-4e18-ba5d-1ac1968f8637 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:25.717382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d9da5e87-b890-4bff-ade0-6277e7425786 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:25.722793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:25.736914 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d9da5e87-b890-4bff-ade0-6277e7425786 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 200 len: 1331 microversion: 2.1 time: 0.392847 Aug 03 02:06:25.743420 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1812/3730] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:25 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 1331 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:25.759580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0c15d5a-5f3c-4b64-b98d-484405e1cb45 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:25.762253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0c15d5a-5f3c-4b64-b98d-484405e1cb45 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:25.801653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0c15d5a-5f3c-4b64-b98d-484405e1cb45 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:25.803565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0c15d5a-5f3c-4b64-b98d-484405e1cb45 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:25.805507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0c15d5a-5f3c-4b64-b98d-484405e1cb45 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:25.806553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0c15d5a-5f3c-4b64-b98d-484405e1cb45 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:26.486799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0c15d5a-5f3c-4b64-b98d-484405e1cb45 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:26.495470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0022622f-79f7-4e18-ba5d-1ac1968f8637 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975738127e114fbaae9f61584cd2ab4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659c49cd3dd642afa881f2efe4f60c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:26.509708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0c15d5a-5f3c-4b64-b98d-484405e1cb45 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:26.511282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0c15d5a-5f3c-4b64-b98d-484405e1cb45 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:26.512801 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0c15d5a-5f3c-4b64-b98d-484405e1cb45 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1730 microversion: 2.20 time: 0.767704 Aug 03 02:06:26.514047 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1813/3731] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:06:25 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1730 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:06:26.517680 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0022622f-79f7-4e18-ba5d-1ac1968f8637 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] 10.222.0.67 "GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0" status: 200 len: 1313 microversion: 2.1 time: 0.922360 Aug 03 02:06:26.519827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-c096ded7-5e3f-470c-a5ac-fe994bd11405 req-e59ac77e-167d-4fcb-a6e8-b920f3055200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99358f36-9bc7-4e58-8a98-70b4e391e244", "name": "network-vif-deleted", "tag": "75880f3c-9e7a-4a26-9ab7-243bab43e9a8"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:26.535304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c096ded7-5e3f-470c-a5ac-fe994bd11405 req-e59ac77e-167d-4fcb-a6e8-b920f3055200 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:26.536662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c096ded7-5e3f-470c-a5ac-fe994bd11405 req-e59ac77e-167d-4fcb-a6e8-b920f3055200 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:26.542499 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1919/3732] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:25 2022] GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0 => generated 1313 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:26.556834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eeba7406-3e2c-4741-8789-838bf8ea4dd3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:26.557905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eeba7406-3e2c-4741-8789-838bf8ea4dd3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:26.562187 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c096ded7-5e3f-470c-a5ac-fe994bd11405 req-e59ac77e-167d-4fcb-a6e8-b920f3055200 service nova] Creating event network-vif-deleted:75880f3c-9e7a-4a26-9ab7-243bab43e9a8 for instance 99358f36-9bc7-4e58-8a98-70b4e391e244 on n-h1-826529-8 Aug 03 02:06:26.568283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeba7406-3e2c-4741-8789-838bf8ea4dd3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:26.569487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeba7406-3e2c-4741-8789-838bf8ea4dd3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:26.570112 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-c096ded7-5e3f-470c-a5ac-fe994bd11405 req-e59ac77e-167d-4fcb-a6e8-b920f3055200 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053231 Aug 03 02:06:26.570817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeba7406-3e2c-4741-8789-838bf8ea4dd3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:26.571660 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeba7406-3e2c-4741-8789-838bf8ea4dd3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:26.572652 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1814/3733] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:26.578730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1b227276-e6ff-4d57-8e74-5ac0c0dbb73e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:26.579535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1b227276-e6ff-4d57-8e74-5ac0c0dbb73e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:26.589668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b227276-e6ff-4d57-8e74-5ac0c0dbb73e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:26.590485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b227276-e6ff-4d57-8e74-5ac0c0dbb73e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:26.591677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b227276-e6ff-4d57-8e74-5ac0c0dbb73e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:26.592418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b227276-e6ff-4d57-8e74-5ac0c0dbb73e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:27.537628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1b227276-e6ff-4d57-8e74-5ac0c0dbb73e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:27.555826 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1b227276-e6ff-4d57-8e74-5ac0c0dbb73e tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb" status: 200 len: 1323 microversion: 2.1 time: 0.981608 Aug 03 02:06:27.556628 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1815/3734] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:26 2022] GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb => generated 1323 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:27.576587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-340afadb-763c-4538-810b-c2a2d4d74d7e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:27.577225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-340afadb-763c-4538-810b-c2a2d4d74d7e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:27.587401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-340afadb-763c-4538-810b-c2a2d4d74d7e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:27.594466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-340afadb-763c-4538-810b-c2a2d4d74d7e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:27.597765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-340afadb-763c-4538-810b-c2a2d4d74d7e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:27.599508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-340afadb-763c-4538-810b-c2a2d4d74d7e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:27.666625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-eeba7406-3e2c-4741-8789-838bf8ea4dd3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:27.682531 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eeba7406-3e2c-4741-8789-838bf8ea4dd3 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1512 microversion: 2.1 time: 1.138319 Aug 03 02:06:27.685979 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1920/3735] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:26 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1512 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:27.697993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a0ef3756-4d2a-4951-91bf-8bcde864489e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:27.702096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a0ef3756-4d2a-4951-91bf-8bcde864489e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:27.730544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0ef3756-4d2a-4951-91bf-8bcde864489e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:27.733993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0ef3756-4d2a-4951-91bf-8bcde864489e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:27.739540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0ef3756-4d2a-4951-91bf-8bcde864489e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:27.740265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0ef3756-4d2a-4951-91bf-8bcde864489e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:27.780030 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-a0ef3756-4d2a-4951-91bf-8bcde864489e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] HTTP exception thrown: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a0ef3756-4d2a-4951-91bf-8bcde864489e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Request method failure captured: Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 HTTP/1.1 Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dc0-Ae8If7bfOWI7RRBvc1phU63xlLSU5btj5ety_8fStzHcWU-vXHDYz4xfjE-ye9BJl2yypV_nSYHeeO1JR8qxTOON-NMvFY2KC116gH7mE5fGt58cYvDLyGtxXNTQSJt4xclgIAdKb4vD1HYJAxEQ3OrVusgb2MtJ9SsttIsaGA Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a5bc12da9a94f63bb71700bd01cf416", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}] Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4c1fb7af331344dcb26c43368a9daa6e Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '99358f36-9bc7-4e58-8a98-70b4e391e244'} Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:27.782433 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:27.789649 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:27.789649 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:27.789649 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:27.789649 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:27.789649 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:27.789649 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. Aug 03 02:06:27.789649 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:27.793522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a0ef3756-4d2a-4951-91bf-8bcde864489e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Returning 404 to user: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:27.795451 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a0ef3756-4d2a-4951-91bf-8bcde864489e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 404 len: 111 microversion: 2.1 time: 0.106946 Aug 03 02:06:27.797542 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1921/3736] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:27 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:06:27.804054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-cb97f9d0-13c1-41c6-8192-485777cec7e3 req-011eada4-e59c-40fe-b50d-5d01c63c9463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9952a14-056b-4b74-ab8c-791d16592ddf", "name": "network-vif-plugged", "status": "completed", "tag": "6377bbf1-10a0-437b-a4d1-7bd2f82f03fe"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:27.817162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-cb97f9d0-13c1-41c6-8192-485777cec7e3 req-011eada4-e59c-40fe-b50d-5d01c63c9463 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:27.818420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-cb97f9d0-13c1-41c6-8192-485777cec7e3 req-011eada4-e59c-40fe-b50d-5d01c63c9463 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:27.851318 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-cb97f9d0-13c1-41c6-8192-485777cec7e3 req-011eada4-e59c-40fe-b50d-5d01c63c9463 service nova] Creating event network-vif-plugged:6377bbf1-10a0-437b-a4d1-7bd2f82f03fe for instance b9952a14-056b-4b74-ab8c-791d16592ddf on n-h1-826529-8 Aug 03 02:06:27.861671 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-cb97f9d0-13c1-41c6-8192-485777cec7e3 req-011eada4-e59c-40fe-b50d-5d01c63c9463 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062417 Aug 03 02:06:27.862940 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1922/3737] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:27.909736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-89c9b0ea-ea6b-4a3f-8fc1-3bca64c84c4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:27.915698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-89c9b0ea-ea6b-4a3f-8fc1-3bca64c84c4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:27.939565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89c9b0ea-ea6b-4a3f-8fc1-3bca64c84c4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:27.940567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89c9b0ea-ea6b-4a3f-8fc1-3bca64c84c4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:27.942896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89c9b0ea-ea6b-4a3f-8fc1-3bca64c84c4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:27.943680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89c9b0ea-ea6b-4a3f-8fc1-3bca64c84c4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:28.071355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-340afadb-763c-4538-810b-c2a2d4d74d7e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:28.105757 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-340afadb-763c-4538-810b-c2a2d4d74d7e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1364 microversion: 2.1 time: 0.530470 Aug 03 02:06:28.110107 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1816/3738] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:27 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1364 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:28.134402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3068f83d-0944-4b1c-8fa3-f3b7f1c26858 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:28.136786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3068f83d-0944-4b1c-8fa3-f3b7f1c26858 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] [instance: 40c52648-e1d4-4a06-9e70-76728ecce4f0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:28.173931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3068f83d-0944-4b1c-8fa3-f3b7f1c26858 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:28.174396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3068f83d-0944-4b1c-8fa3-f3b7f1c26858 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:28.175457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3068f83d-0944-4b1c-8fa3-f3b7f1c26858 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:28.176083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3068f83d-0944-4b1c-8fa3-f3b7f1c26858 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:28.504067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-89c9b0ea-ea6b-4a3f-8fc1-3bca64c84c4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:28.519060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-89c9b0ea-ea6b-4a3f-8fc1-3bca64c84c4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:28.521036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-89c9b0ea-ea6b-4a3f-8fc1-3bca64c84c4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:28.523294 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-89c9b0ea-ea6b-4a3f-8fc1-3bca64c84c4a tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1730 microversion: 2.20 time: 0.657745 Aug 03 02:06:28.553250 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1923/3739] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:06:27 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1730 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:06:28.564073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e88c8ee0-37e2-4cf6-9583-f565492d6721 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '.version_select at 0x7f5b12525670>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:28.589952 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e88c8ee0-37e2-4cf6-9583-f565492d6721 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1742974591" status: 202 len: 0 microversion: 2.1 time: 0.035145 Aug 03 02:06:28.591222 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1924/3740] 10.222.0.67 () {58 vars in 1221 bytes} [Wed Aug 3 02:06:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1742974591 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:06:28.601025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b7b75467-8035-4ad1-96a4-f1c8644aa3c1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:28.602668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b7b75467-8035-4ad1-96a4-f1c8644aa3c1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:28.623078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7b75467-8035-4ad1-96a4-f1c8644aa3c1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:28.623078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7b75467-8035-4ad1-96a4-f1c8644aa3c1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:28.623078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7b75467-8035-4ad1-96a4-f1c8644aa3c1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:28.623078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7b75467-8035-4ad1-96a4-f1c8644aa3c1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:28.842007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3068f83d-0944-4b1c-8fa3-f3b7f1c26858 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975738127e114fbaae9f61584cd2ab4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659c49cd3dd642afa881f2efe4f60c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:28.860771 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3068f83d-0944-4b1c-8fa3-f3b7f1c26858 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] 10.222.0.67 "GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0" status: 200 len: 1463 microversion: 2.1 time: 0.747132 Aug 03 02:06:28.863022 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1817/3741] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:28 2022] GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0 => generated 1463 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:28.873033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2b7e4ef8-329a-473e-a786-a0c3e97ecdc7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:28.874298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2b7e4ef8-329a-473e-a786-a0c3e97ecdc7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:28.906088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b7e4ef8-329a-473e-a786-a0c3e97ecdc7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:28.906948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b7e4ef8-329a-473e-a786-a0c3e97ecdc7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:28.908279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b7e4ef8-329a-473e-a786-a0c3e97ecdc7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:28.909677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b7e4ef8-329a-473e-a786-a0c3e97ecdc7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:29.109025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b7b75467-8035-4ad1-96a4-f1c8644aa3c1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:29.118603 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b7b75467-8035-4ad1-96a4-f1c8644aa3c1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb" status: 200 len: 1323 microversion: 2.1 time: 0.525958 Aug 03 02:06:29.119842 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1925/3742] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:28 2022] GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb => generated 1323 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:29.124661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8dbcf6ce-8be2-45a0-baa1-3f5c5de962b1 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:29.125163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8dbcf6ce-8be2-45a0-baa1-3f5c5de962b1 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] [instance: 40c52648-e1d4-4a06-9e70-76728ecce4f0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:29.141791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dbcf6ce-8be2-45a0-baa1-3f5c5de962b1 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:29.142278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dbcf6ce-8be2-45a0-baa1-3f5c5de962b1 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:29.143281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dbcf6ce-8be2-45a0-baa1-3f5c5de962b1 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:29.144428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dbcf6ce-8be2-45a0-baa1-3f5c5de962b1 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:29.187407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8dbcf6ce-8be2-45a0-baa1-3f5c5de962b1 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] [instance: 40c52648-e1d4-4a06-9e70-76728ecce4f0] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:06:29.225334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2b7e4ef8-329a-473e-a786-a0c3e97ecdc7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:29.237796 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2b7e4ef8-329a-473e-a786-a0c3e97ecdc7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1512 microversion: 2.1 time: 0.372509 Aug 03 02:06:29.238405 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1818/3743] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:28 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:29.246587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-09b29042-28b2-4aeb-8d15-b538b31c0b82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:29.251403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-09b29042-28b2-4aeb-8d15-b538b31c0b82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:29.266023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09b29042-28b2-4aeb-8d15-b538b31c0b82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:29.266776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09b29042-28b2-4aeb-8d15-b538b31c0b82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:29.271815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09b29042-28b2-4aeb-8d15-b538b31c0b82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:29.273237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09b29042-28b2-4aeb-8d15-b538b31c0b82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:29.463117 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8dbcf6ce-8be2-45a0-baa1-3f5c5de962b1 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] 10.222.0.67 "DELETE /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0" status: 204 len: 0 microversion: 2.1 time: 0.340788 Aug 03 02:06:29.463890 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1926/3744] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:06:29 2022] DELETE /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:06:29.495241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7688f77a-94d3-4353-8472-5850d9830738 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:29.497855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7688f77a-94d3-4353-8472-5850d9830738 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] [instance: 40c52648-e1d4-4a06-9e70-76728ecce4f0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:29.514085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7688f77a-94d3-4353-8472-5850d9830738 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:29.515759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7688f77a-94d3-4353-8472-5850d9830738 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:29.517994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7688f77a-94d3-4353-8472-5850d9830738 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:29.519420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7688f77a-94d3-4353-8472-5850d9830738 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:29.936529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-09b29042-28b2-4aeb-8d15-b538b31c0b82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:29.946741 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-09b29042-28b2-4aeb-8d15-b538b31c0b82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1364 microversion: 2.1 time: 0.707028 Aug 03 02:06:29.947651 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1819/3745] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:29 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1364 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:29.953191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ee43191-b807-4df9-86bf-51118c399388 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:29.953940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2ee43191-b807-4df9-86bf-51118c399388 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:29.961409 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ee43191-b807-4df9-86bf-51118c399388 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:29.962878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ee43191-b807-4df9-86bf-51118c399388 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:29.963989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ee43191-b807-4df9-86bf-51118c399388 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:29.964577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ee43191-b807-4df9-86bf-51118c399388 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:30.114613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7688f77a-94d3-4353-8472-5850d9830738 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975738127e114fbaae9f61584cd2ab4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659c49cd3dd642afa881f2efe4f60c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:30.129677 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7688f77a-94d3-4353-8472-5850d9830738 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] 10.222.0.67 "GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0" status: 200 len: 1469 microversion: 2.1 time: 0.660908 Aug 03 02:06:30.132003 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1927/3746] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:29 2022] GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0 => generated 1469 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:06:30.140071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5ff1dbe-c032-4cf3-b997-9599bae3df8b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Action: 'create', calling method: .version_select at 0x7f5b12300670>, body: {"keypair": {"name": "tempest-keypair-499360839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeBUM0nK/J4n+zUVY8QENFk1xtvboaQ/AvR0MH7RCV7A9r5LDpL5BUq1f+sZeALMesge9KAo8dN2xkeWWhb/2XvYtDLrAvZtzNCc6XspAgA9y607VpcwcpahZkreCZLSg=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:30.167733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-c5ff1dbe-c032-4cf3-b997-9599bae3df8b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:06:30.175714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-c5ff1dbe-c032-4cf3-b997-9599bae3df8b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for user 4c1fb7af331344dcb26c43368a9daa6e and project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:06:30.215287 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5ff1dbe-c032-4cf3-b997-9599bae3df8b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.080744 Aug 03 02:06:30.223729 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1928/3747] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:06:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:30.232715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-4746c6c1-8f95-4da0-9a98-275bb9935d43 req-818da525-c474-49fc-bc5f-efef7e2fc26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baae908b-c865-422d-a41c-b0add7d722bb", "name": "network-vif-plugged", "status": "completed", "tag": "c6b92644-3987-4338-b9a8-9c87591b94ed"}, {"server_uuid": "9ce11775-ab73-457e-8799-239915dc2406", "name": "network-vif-plugged", "status": "completed", "tag": "12c644d8-021b-4605-8e3c-16ff33d29cd1"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:30.243861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:30.252612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4746c6c1-8f95-4da0-9a98-275bb9935d43 req-818da525-c474-49fc-bc5f-efef7e2fc26d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:30.252989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4746c6c1-8f95-4da0-9a98-275bb9935d43 req-818da525-c474-49fc-bc5f-efef7e2fc26d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:30.276768 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-4746c6c1-8f95-4da0-9a98-275bb9935d43 req-818da525-c474-49fc-bc5f-efef7e2fc26d service nova] Creating event network-vif-plugged:c6b92644-3987-4338-b9a8-9c87591b94ed for instance baae908b-c865-422d-a41c-b0add7d722bb on n-h2-826529-8 Aug 03 02:06:30.277298 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-4746c6c1-8f95-4da0-9a98-275bb9935d43 req-818da525-c474-49fc-bc5f-efef7e2fc26d service nova] Creating event network-vif-plugged:12c644d8-021b-4605-8e3c-16ff33d29cd1 for instance 9ce11775-ab73-457e-8799-239915dc2406 on n-h1-826529-8 Aug 03 02:06:30.294227 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-4746c6c1-8f95-4da0-9a98-275bb9935d43 req-818da525-c474-49fc-bc5f-efef7e2fc26d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068167 Aug 03 02:06:30.296539 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1929/3748] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:30.304940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-91d8e744-d0bb-433a-8b49-3974adfacdc8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:30.306187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-91d8e744-d0bb-433a-8b49-3974adfacdc8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:30.317728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91d8e744-d0bb-433a-8b49-3974adfacdc8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:30.319604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91d8e744-d0bb-433a-8b49-3974adfacdc8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:30.320839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91d8e744-d0bb-433a-8b49-3974adfacdc8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:30.321819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91d8e744-d0bb-433a-8b49-3974adfacdc8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:30.443167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2ee43191-b807-4df9-86bf-51118c399388 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:30.457988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2ee43191-b807-4df9-86bf-51118c399388 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:30.463032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2ee43191-b807-4df9-86bf-51118c399388 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:30.467353 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2ee43191-b807-4df9-86bf-51118c399388 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1730 microversion: 2.20 time: 0.518101 Aug 03 02:06:30.469836 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1820/3749] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:06:29 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1730 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:06:30.480245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b13e2dae-127d-4f7e-ba06-23afd1880bfb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:30.481834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b13e2dae-127d-4f7e-ba06-23afd1880bfb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:30.523522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b13e2dae-127d-4f7e-ba06-23afd1880bfb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:30.528623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b13e2dae-127d-4f7e-ba06-23afd1880bfb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:30.529660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b13e2dae-127d-4f7e-ba06-23afd1880bfb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:30.534035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b13e2dae-127d-4f7e-ba06-23afd1880bfb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:30.850441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-91d8e744-d0bb-433a-8b49-3974adfacdc8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:30.865235 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-91d8e744-d0bb-433a-8b49-3974adfacdc8 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb" status: 200 len: 1323 microversion: 2.1 time: 0.567517 Aug 03 02:06:30.867722 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1930/3750] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:30 2022] GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb => generated 1323 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:30.970692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-92b87fc2-c8b5-41c8-9b95-6706f3fdb8d0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:30.971502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-92b87fc2-c8b5-41c8-9b95-6706f3fdb8d0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:30.994393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92b87fc2-c8b5-41c8-9b95-6706f3fdb8d0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:30.995328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92b87fc2-c8b5-41c8-9b95-6706f3fdb8d0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:31.009004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92b87fc2-c8b5-41c8-9b95-6706f3fdb8d0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:31.009964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b13e2dae-127d-4f7e-ba06-23afd1880bfb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:31.013524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:31.014523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92b87fc2-c8b5-41c8-9b95-6706f3fdb8d0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:31.030180 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b13e2dae-127d-4f7e-ba06-23afd1880bfb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1512 microversion: 2.1 time: 0.558889 Aug 03 02:06:31.047874 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1821/3751] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:30 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1512 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:31.165645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a01cd2d0-1ed1-4226-8821-007df5a00824 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:31.167435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a01cd2d0-1ed1-4226-8821-007df5a00824 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] [instance: 40c52648-e1d4-4a06-9e70-76728ecce4f0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:31.185790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a01cd2d0-1ed1-4226-8821-007df5a00824 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:31.186831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a01cd2d0-1ed1-4226-8821-007df5a00824 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:31.188616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a01cd2d0-1ed1-4226-8821-007df5a00824 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:31.189718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a01cd2d0-1ed1-4226-8821-007df5a00824 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:31.519116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-92b87fc2-c8b5-41c8-9b95-6706f3fdb8d0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:31.532193 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-92b87fc2-c8b5-41c8-9b95-6706f3fdb8d0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1550 microversion: 2.1 time: 0.565624 Aug 03 02:06:31.532830 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1931/3752] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:30 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1550 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:31.540225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-357b7864-fc37-4b4a-b442-f7516901889e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:31.541276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-357b7864-fc37-4b4a-b442-f7516901889e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:31.549279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-357b7864-fc37-4b4a-b442-f7516901889e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:31.550533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-357b7864-fc37-4b4a-b442-f7516901889e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:31.551826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-357b7864-fc37-4b4a-b442-f7516901889e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:31.552522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-357b7864-fc37-4b4a-b442-f7516901889e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:31.678405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a01cd2d0-1ed1-4226-8821-007df5a00824 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975738127e114fbaae9f61584cd2ab4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659c49cd3dd642afa881f2efe4f60c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:31.695638 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a01cd2d0-1ed1-4226-8821-007df5a00824 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] 10.222.0.67 "GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0" status: 200 len: 1469 microversion: 2.1 time: 0.545207 Aug 03 02:06:31.696643 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1822/3753] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:31 2022] GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0 => generated 1469 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:31.707838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5e949ca9-a3e8-4547-bdc8-a576e2b6577d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:31.709456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5e949ca9-a3e8-4547-bdc8-a576e2b6577d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:31.724815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e949ca9-a3e8-4547-bdc8-a576e2b6577d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:31.726943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e949ca9-a3e8-4547-bdc8-a576e2b6577d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:31.728685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e949ca9-a3e8-4547-bdc8-a576e2b6577d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:31.729474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e949ca9-a3e8-4547-bdc8-a576e2b6577d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:31.901651 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5e949ca9-a3e8-4547-bdc8-a576e2b6577d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.202790 Aug 03 02:06:31.902787 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1823/3754] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:06:31 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:31.915075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6f1b1420-2abb-46a2-863d-16b933f27464 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:31.916238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6f1b1420-2abb-46a2-863d-16b933f27464 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:31.928786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f1b1420-2abb-46a2-863d-16b933f27464 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:31.929641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f1b1420-2abb-46a2-863d-16b933f27464 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:31.931389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f1b1420-2abb-46a2-863d-16b933f27464 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:31.932199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f1b1420-2abb-46a2-863d-16b933f27464 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:32.040393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-357b7864-fc37-4b4a-b442-f7516901889e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:32.051571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-357b7864-fc37-4b4a-b442-f7516901889e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:32.058196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-357b7864-fc37-4b4a-b442-f7516901889e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:32.060080 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-357b7864-fc37-4b4a-b442-f7516901889e tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1730 microversion: 2.20 time: 0.525977 Aug 03 02:06:32.060887 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1932/3755] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:06:31 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1730 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:06:32.711205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c50cc4b5-f255-4d52-bbea-51719233f457 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:32.714841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c50cc4b5-f255-4d52-bbea-51719233f457 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:32.736973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c50cc4b5-f255-4d52-bbea-51719233f457 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:32.737799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c50cc4b5-f255-4d52-bbea-51719233f457 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:32.739286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c50cc4b5-f255-4d52-bbea-51719233f457 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:32.743663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c50cc4b5-f255-4d52-bbea-51719233f457 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:32.923300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6f1b1420-2abb-46a2-863d-16b933f27464 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:32.986341 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6f1b1420-2abb-46a2-863d-16b933f27464 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb" status: 200 len: 1323 microversion: 2.1 time: 1.081507 Aug 03 02:06:33.009944 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1824/3756] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:31 2022] GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb => generated 1323 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:33.032227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9b7b316a-bf48-49e9-8ef9-106db3879c43 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:33.048805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9b7b316a-bf48-49e9-8ef9-106db3879c43 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] [instance: 40c52648-e1d4-4a06-9e70-76728ecce4f0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:33.087455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b7b316a-bf48-49e9-8ef9-106db3879c43 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:33.101407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b7b316a-bf48-49e9-8ef9-106db3879c43 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:33.103484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b7b316a-bf48-49e9-8ef9-106db3879c43 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:33.104421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b7b316a-bf48-49e9-8ef9-106db3879c43 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:33.958422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9b7b316a-bf48-49e9-8ef9-106db3879c43 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '975738127e114fbaae9f61584cd2ab4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659c49cd3dd642afa881f2efe4f60c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:34.007274 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9b7b316a-bf48-49e9-8ef9-106db3879c43 tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] 10.222.0.67 "GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0" status: 200 len: 1427 microversion: 2.1 time: 0.994808 Aug 03 02:06:34.017784 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1825/3757] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:33 2022] GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0 => generated 1427 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:34.026658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f432fe59-da22-4386-8c21-161b6f04a857 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:34.029974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f432fe59-da22-4386-8c21-161b6f04a857 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:34.043999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f432fe59-da22-4386-8c21-161b6f04a857 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:34.044802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f432fe59-da22-4386-8c21-161b6f04a857 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:34.046657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f432fe59-da22-4386-8c21-161b6f04a857 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:34.047320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f432fe59-da22-4386-8c21-161b6f04a857 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:34.680693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c50cc4b5-f255-4d52-bbea-51719233f457 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:34.684985 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c50cc4b5-f255-4d52-bbea-51719233f457 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1512 microversion: 2.1 time: 2.606434 Aug 03 02:06:34.699551 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1933/3758] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:32 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1512 bytes in 2622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:34.708833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-96935692-ad73-44b5-bc42-e383d0fc9cc6 req-b925ed55-8758-46ba-8fd4-908c5d37cc85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c52648-e1d4-4a06-9e70-76728ecce4f0", "name": "network-vif-deleted", "tag": "0fd5843c-c543-4f31-8a0a-8c6b6ca53019"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:34.734945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-96935692-ad73-44b5-bc42-e383d0fc9cc6 req-b925ed55-8758-46ba-8fd4-908c5d37cc85 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:34.736146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-96935692-ad73-44b5-bc42-e383d0fc9cc6 req-b925ed55-8758-46ba-8fd4-908c5d37cc85 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:34.774078 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-96935692-ad73-44b5-bc42-e383d0fc9cc6 req-b925ed55-8758-46ba-8fd4-908c5d37cc85 service nova] Creating event network-vif-deleted:0fd5843c-c543-4f31-8a0a-8c6b6ca53019 for instance 40c52648-e1d4-4a06-9e70-76728ecce4f0 on n-h2-826529-8 Aug 03 02:06:34.793706 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-96935692-ad73-44b5-bc42-e383d0fc9cc6 req-b925ed55-8758-46ba-8fd4-908c5d37cc85 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091609 Aug 03 02:06:34.796578 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1934/3759] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:34.807941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d5450a88-af6b-4d23-af16-5ed428347660 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:34.809709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d5450a88-af6b-4d23-af16-5ed428347660 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:34.823598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5450a88-af6b-4d23-af16-5ed428347660 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:34.825175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5450a88-af6b-4d23-af16-5ed428347660 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:34.828361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5450a88-af6b-4d23-af16-5ed428347660 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:34.830145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5450a88-af6b-4d23-af16-5ed428347660 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:35.514210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f432fe59-da22-4386-8c21-161b6f04a857 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:35.580630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f432fe59-da22-4386-8c21-161b6f04a857 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:35.589801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f432fe59-da22-4386-8c21-161b6f04a857 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:35.595106 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f432fe59-da22-4386-8c21-161b6f04a857 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1717 microversion: 2.20 time: 1.575276 Aug 03 02:06:35.599227 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1826/3760] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:06:34 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1717 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:06:35.607419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f47c9374-49c7-4379-8552-c3663104e1ce tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:35.608544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f47c9374-49c7-4379-8552-c3663104e1ce tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] [instance: 40c52648-e1d4-4a06-9e70-76728ecce4f0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:35.617847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f47c9374-49c7-4379-8552-c3663104e1ce tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:35.618830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f47c9374-49c7-4379-8552-c3663104e1ce tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:35.620411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f47c9374-49c7-4379-8552-c3663104e1ce tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:35.621817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f47c9374-49c7-4379-8552-c3663104e1ce tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:35.624578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d5450a88-af6b-4d23-af16-5ed428347660 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:35.645999 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-f47c9374-49c7-4379-8552-c3663104e1ce tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] HTTP exception thrown: Instance 40c52648-e1d4-4a06-9e70-76728ecce4f0 could not be found. Aug 03 02:06:35.648355 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d5450a88-af6b-4d23-af16-5ed428347660 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb" status: 200 len: 1520 microversion: 2.1 time: 0.849618 Aug 03 02:06:35.650529 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1935/3761] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:34 2022] GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb => generated 1520 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f47c9374-49c7-4379-8552-c3663104e1ce tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Request method failure captured: Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0 HTTP/1.1 Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dgHrf6IUF4IwmWpCIw6Xg50U8Apjwvybk8v6LkP3r5RviZhUQ6GD_fuXnyCIHZ72SvH8xqW3O_vgyOJcBNbiV5HmM5GyhVWWa3AhXyurNjPVHizYA5iA9JIvayiI6KaZ8pZd3j-8B4IOcE93uMbv5WMn4leyY726aCQMrMrEjziShQ Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 659c49cd3dd642afa881f2efe4f60c4c Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-VolumesNegativeTest-2073853521 Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_659c49cd3dd642afa881f2efe4f60c4c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/659c49cd3dd642afa881f2efe4f60c4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/659c49cd3dd642afa881f2efe4f60c4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/659c49cd3dd642afa881f2efe4f60c4c"}]}] Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-VolumesNegativeTest-2073853521 Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 659c49cd3dd642afa881f2efe4f60c4c Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-VolumesNegativeTest-2073853521 Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-VolumesNegativeTest-2073853521-project Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 975738127e114fbaae9f61584cd2ab4b Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-VolumesNegativeTest-2073853521-project Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 40c52648-e1d4-4a06-9e70-76728ecce4f0 could not be found. Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '40c52648-e1d4-4a06-9e70-76728ecce4f0'} Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40c52648-e1d4-4a06-9e70-76728ecce4f0 could not be found. Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40c52648-e1d4-4a06-9e70-76728ecce4f0 could not be found. Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:35.655672 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:35.660471 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:35.660471 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:35.660471 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:35.660471 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:35.660471 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:35.660471 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40c52648-e1d4-4a06-9e70-76728ecce4f0 could not be found. Aug 03 02:06:35.660471 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:35.666401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f47c9374-49c7-4379-8552-c3663104e1ce tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] Returning 404 to user: Instance 40c52648-e1d4-4a06-9e70-76728ecce4f0 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:35.667553 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f47c9374-49c7-4379-8552-c3663104e1ce tempest-VolumesNegativeTest-2073853521 tempest-VolumesNegativeTest-2073853521-project] 10.222.0.67 "GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0" status: 404 len: 111 microversion: 2.1 time: 0.066765 Aug 03 02:06:35.678662 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1827/3762] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:35 2022] GET /compute/v2.1/servers/40c52648-e1d4-4a06-9e70-76728ecce4f0 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:06:35.694897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a2938b56-0bff-494b-8379-71e401574c15 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:35.699394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a2938b56-0bff-494b-8379-71e401574c15 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:35.714851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a6cfba36-2fab-4230-8989-4af9b234acc5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:35.716716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2938b56-0bff-494b-8379-71e401574c15 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:35.719354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2938b56-0bff-494b-8379-71e401574c15 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:35.719626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a6cfba36-2fab-4230-8989-4af9b234acc5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:35.725680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2938b56-0bff-494b-8379-71e401574c15 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:35.726548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2938b56-0bff-494b-8379-71e401574c15 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:35.754693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6cfba36-2fab-4230-8989-4af9b234acc5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:35.758570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6cfba36-2fab-4230-8989-4af9b234acc5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:35.764486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6cfba36-2fab-4230-8989-4af9b234acc5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:35.765501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6cfba36-2fab-4230-8989-4af9b234acc5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:35.820282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a2938b56-0bff-494b-8379-71e401574c15 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:06:35.992621 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a2938b56-0bff-494b-8379-71e401574c15 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "DELETE /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb" status: 204 len: 0 microversion: 2.1 time: 0.304222 Aug 03 02:06:35.993607 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1936/3763] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:06:35 2022] DELETE /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:06:36.028688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5eb14d2f-2d11-4aa7-9256-46b25bf09084 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:36.030299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5eb14d2f-2d11-4aa7-9256-46b25bf09084 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:36.044046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5eb14d2f-2d11-4aa7-9256-46b25bf09084 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:36.045707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5eb14d2f-2d11-4aa7-9256-46b25bf09084 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:36.046841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5eb14d2f-2d11-4aa7-9256-46b25bf09084 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:36.047643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5eb14d2f-2d11-4aa7-9256-46b25bf09084 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:36.089290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:36.825998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5eb14d2f-2d11-4aa7-9256-46b25bf09084 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:36.833108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a6cfba36-2fab-4230-8989-4af9b234acc5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:36.842123 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a6cfba36-2fab-4230-8989-4af9b234acc5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1512 microversion: 2.1 time: 1.131614 Aug 03 02:06:36.842868 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1828/3764] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:35 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1512 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:36.864597 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5eb14d2f-2d11-4aa7-9256-46b25bf09084 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb" status: 200 len: 1526 microversion: 2.1 time: 0.860551 Aug 03 02:06:36.879758 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1937/3765] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:36 2022] GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb => generated 1526 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:37.627161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d1111016-b0ef-452d-ac69-592af6a812ca req-bee9af00-30ba-4e45-bf1c-89eb5adfef8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9952a14-056b-4b74-ab8c-791d16592ddf", "tag": "6377bbf1-10a0-437b-a4d1-7bd2f82f03fe"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:37.685762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d1111016-b0ef-452d-ac69-592af6a812ca req-bee9af00-30ba-4e45-bf1c-89eb5adfef8b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:37.696765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d1111016-b0ef-452d-ac69-592af6a812ca req-bee9af00-30ba-4e45-bf1c-89eb5adfef8b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:37.778421 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d1111016-b0ef-452d-ac69-592af6a812ca req-bee9af00-30ba-4e45-bf1c-89eb5adfef8b service nova] Creating event network-changed:6377bbf1-10a0-437b-a4d1-7bd2f82f03fe for instance b9952a14-056b-4b74-ab8c-791d16592ddf on n-h1-826529-8 Aug 03 02:06:37.786727 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d1111016-b0ef-452d-ac69-592af6a812ca req-bee9af00-30ba-4e45-bf1c-89eb5adfef8b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172037 Aug 03 02:06:37.800328 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1829/3766] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:06:37.867170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e3d567ac-a2d3-456c-bb97-c4375df36088 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:37.868094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e3d567ac-a2d3-456c-bb97-c4375df36088 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:37.890065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3d567ac-a2d3-456c-bb97-c4375df36088 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:37.892918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3d567ac-a2d3-456c-bb97-c4375df36088 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:37.893810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3d567ac-a2d3-456c-bb97-c4375df36088 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:37.894269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3d567ac-a2d3-456c-bb97-c4375df36088 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:37.911906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-247dff8e-f00e-4902-ae5e-6cf7389d8e1d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:37.913447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-247dff8e-f00e-4902-ae5e-6cf7389d8e1d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:37.942618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-247dff8e-f00e-4902-ae5e-6cf7389d8e1d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:37.952213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-247dff8e-f00e-4902-ae5e-6cf7389d8e1d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:37.953727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-247dff8e-f00e-4902-ae5e-6cf7389d8e1d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:37.954204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-247dff8e-f00e-4902-ae5e-6cf7389d8e1d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:39.367891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-247dff8e-f00e-4902-ae5e-6cf7389d8e1d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:39.404456 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-247dff8e-f00e-4902-ae5e-6cf7389d8e1d tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb" status: 200 len: 1526 microversion: 2.1 time: 1.505125 Aug 03 02:06:39.445190 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1830/3767] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:37 2022] GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb => generated 1526 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:39.466459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1607756264", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1bcbe413-2b5f-4286-84d0-26739a6b3703"}], "security_groups": [{"name": "tempest-securitygroup--2097596402"}], "key_name": "tempest-keypair-499360839", "user_data": "}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:39.901384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] validate_networks() for [('1bcbe413-2b5f-4286-84d0-26739a6b3703', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:06:39.958075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3d567ac-a2d3-456c-bb97-c4375df36088 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:39.973075 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e3d567ac-a2d3-456c-bb97-c4375df36088 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1512 microversion: 2.1 time: 2.110520 Aug 03 02:06:39.977401 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1938/3768] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:37 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1512 bytes in 2114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:40.001544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e6a985b3-8a2a-4be8-82d8-088af7e20f94 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Action: 'create', calling method: .version_select at 0x7f5b129fe940>, body: {"keypair": {"name": "tempest-keypair-1998967340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLB6MORxmjIr1gI6rszxo9tSUS7+KCoOeJz5VeeLiiBDn+NhYcThmIV36SWXw9C4NeACdbOxXRzVHSRnlG+ifuecYT+s6SlHMO3ciX2ME7Ta/0QgbxPZFMFGTbJ/EPPCVA=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:40.041867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-e6a985b3-8a2a-4be8-82d8-088af7e20f94 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Getting quotas for project 7fae5f26896141139f4ce396d92a1999. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:06:40.053061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-e6a985b3-8a2a-4be8-82d8-088af7e20f94 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Getting quotas for user aebcddd50c8948c898aa660b214c18ea and project 7fae5f26896141139f4ce396d92a1999. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:06:40.110615 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e6a985b3-8a2a-4be8-82d8-088af7e20f94 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.131066 Aug 03 02:06:40.113501 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1939/3769] 10.222.0.67 () {62 vars in 1200 bytes} [Wed Aug 3 02:06:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 02:06:40.390279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-8b11baf2-299e-43f4-b87e-9ca638335193 req-10eb7877-092a-4213-8fea-5e3174b7ce48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baae908b-c865-422d-a41c-b0add7d722bb", "name": "network-vif-deleted", "tag": "c6b92644-3987-4338-b9a8-9c87591b94ed"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:40.445863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8b11baf2-299e-43f4-b87e-9ca638335193 req-10eb7877-092a-4213-8fea-5e3174b7ce48 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:40.451899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8b11baf2-299e-43f4-b87e-9ca638335193 req-10eb7877-092a-4213-8fea-5e3174b7ce48 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:40.502854 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-8b11baf2-299e-43f4-b87e-9ca638335193 req-10eb7877-092a-4213-8fea-5e3174b7ce48 service nova] Creating event network-vif-deleted:c6b92644-3987-4338-b9a8-9c87591b94ed for instance baae908b-c865-422d-a41c-b0add7d722bb on n-h2-826529-8 Aug 03 02:06:40.509603 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-8b11baf2-299e-43f4-b87e-9ca638335193 req-10eb7877-092a-4213-8fea-5e3174b7ce48 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133028 Aug 03 02:06:40.510865 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1940/3770] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:06:40.519431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-df6700eb-326a-42af-8b35-a466c3f603e1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:40.520156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-df6700eb-326a-42af-8b35-a466c3f603e1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:40.529588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df6700eb-326a-42af-8b35-a466c3f603e1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:40.555452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df6700eb-326a-42af-8b35-a466c3f603e1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:40.559140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df6700eb-326a-42af-8b35-a466c3f603e1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:40.559301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df6700eb-326a-42af-8b35-a466c3f603e1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:40.646866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df6700eb-326a-42af-8b35-a466c3f603e1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:40.647955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df6700eb-326a-42af-8b35-a466c3f603e1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:40.649051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-df6700eb-326a-42af-8b35-a466c3f603e1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lazy-loading 'fault' on Instance uuid baae908b-c865-422d-a41c-b0add7d722bb {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:06:41.372368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-df6700eb-326a-42af-8b35-a466c3f603e1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c17b2e7e9f4c878826497386ee3ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ae2f8c7bef4a959cdfa8c61360e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:41.382733 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-df6700eb-326a-42af-8b35-a466c3f603e1 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb" status: 200 len: 1313 microversion: 2.1 time: 0.869677 Aug 03 02:06:41.384394 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1941/3771] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:40 2022] GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb => generated 1313 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:41.391375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-89d9da7a-b73b-4b81-9f0b-ac13a72de5b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:41.391996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-89d9da7a-b73b-4b81-9f0b-ac13a72de5b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:41.405739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89d9da7a-b73b-4b81-9f0b-ac13a72de5b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:41.407999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89d9da7a-b73b-4b81-9f0b-ac13a72de5b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:41.410122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89d9da7a-b73b-4b81-9f0b-ac13a72de5b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:41.411243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89d9da7a-b73b-4b81-9f0b-ac13a72de5b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:41.986576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-89d9da7a-b73b-4b81-9f0b-ac13a72de5b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:42.001111 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-89d9da7a-b73b-4b81-9f0b-ac13a72de5b2 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1512 microversion: 2.1 time: 0.614062 Aug 03 02:06:42.004287 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1942/3772] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:41 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1512 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:42.076966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:06:42.077764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:06:42.078079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:06:42.078866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:06:42.079955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:06:42.093325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:42.094102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:42.095199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:42.095840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:42.125473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:06:42.133785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for user 4c1fb7af331344dcb26c43368a9daa6e and project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:06:42.152149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:06:42.154511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:06:42.239306 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-376da90a-fa14-4b77-bb6f-46cd144b1b6b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.788221 Aug 03 02:06:42.258513 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1831/3773] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:06:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 2814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:06:42.260366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-901ad3e0-eff0-44a0-8163-b556dc2af399 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:42.261207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-901ad3e0-eff0-44a0-8163-b556dc2af399 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:42.405660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-56fecff5-bd0a-45d6-b56e-fa46a79165b3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:42.406305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-56fecff5-bd0a-45d6-b56e-fa46a79165b3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: baae908b-c865-422d-a41c-b0add7d722bb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:42.417633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56fecff5-bd0a-45d6-b56e-fa46a79165b3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:42.418120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56fecff5-bd0a-45d6-b56e-fa46a79165b3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:42.419011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56fecff5-bd0a-45d6-b56e-fa46a79165b3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:42.419451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56fecff5-bd0a-45d6-b56e-fa46a79165b3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:42.460957 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-56fecff5-bd0a-45d6-b56e-fa46a79165b3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] HTTP exception thrown: Instance baae908b-c865-422d-a41c-b0add7d722bb could not be found. Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-56fecff5-bd0a-45d6-b56e-fa46a79165b3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Request method failure captured: Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb HTTP/1.1 Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6deKj_4ni6BiP5hu0KReUjCwN-jXFzDltBsZkdmHfZJw3iCK1NJe4cC4HqyDHfr9U2Xj9tTYrH-rL2Y-nfbcV2kQPduI8yks5ljNEDlazy86SExfxbA5OA6iqfJroq-67nWDTGmlBdStRJ_EHNLs6bYrB1tkODLPTKFNyABk3rb39eQ Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_78ae2f8c7bef4a959cdfa8c61360e7e5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}] Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: e2c17b2e7e9f4c878826497386ee3ba7 Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance baae908b-c865-422d-a41c-b0add7d722bb could not be found. Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'baae908b-c865-422d-a41c-b0add7d722bb'} Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baae908b-c865-422d-a41c-b0add7d722bb could not be found. Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baae908b-c865-422d-a41c-b0add7d722bb could not be found. Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.466185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:42.474326 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.474326 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:42.474326 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:42.474326 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:42.474326 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:42.474326 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:42.474326 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baae908b-c865-422d-a41c-b0add7d722bb could not be found. Aug 03 02:06:42.474326 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.474326 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-56fecff5-bd0a-45d6-b56e-fa46a79165b3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Returning 404 to user: Instance baae908b-c865-422d-a41c-b0add7d722bb could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:42.474326 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-56fecff5-bd0a-45d6-b56e-fa46a79165b3 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb" status: 404 len: 111 microversion: 2.1 time: 0.070484 Aug 03 02:06:42.474326 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1832/3774] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:42 2022] GET /compute/v2.1/servers/baae908b-c865-422d-a41c-b0add7d722bb => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:06:42.491481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-580dfe9a-9b10-4d15-872c-94fa4957f817 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '.version_select at 0x7f5b24407940>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:42.553937 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-580dfe9a-9b10-4d15-872c-94fa4957f817 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] HTTP exception thrown: Image not found. Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-580dfe9a-9b10-4d15-872c-94fa4957f817 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Request method failure captured: Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/images/a399dc69-1a39-4acd-812f-b9739262cd89 HTTP/1.1 Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6deKj_4ni6BiP5hu0KReUjCwN-jXFzDltBsZkdmHfZJw3iCK1NJe4cC4HqyDHfr9U2Xj9tTYrH-rL2Y-nfbcV2kQPduI8yks5ljNEDlazy86SExfxbA5OA6iqfJroq-67nWDTGmlBdStRJ_EHNLs6bYrB1tkODLPTKFNyABk3rb39eQ Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_78ae2f8c7bef4a959cdfa8c61360e7e5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}] Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: e2c17b2e7e9f4c878826497386ee3ba7 Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: exception: Image not found. Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'a399dc69-1a39-4acd-812f-b9739262cd89'} Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a399dc69-1a39-4acd-812f-b9739262cd89 to delete Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a399dc69-1a39-4acd-812f-b9739262cd89 could not be found. Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:42.555910 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-580dfe9a-9b10-4d15-872c-94fa4957f817 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Returning 404 to user: Image not found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-580dfe9a-9b10-4d15-872c-94fa4957f817 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "DELETE /compute/v2.1/images/a399dc69-1a39-4acd-812f-b9739262cd89" status: 404 len: 62 microversion: 2.1 time: 0.078835 Aug 03 02:06:42.561009 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1833/3775] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:42 2022] DELETE /compute/v2.1/images/a399dc69-1a39-4acd-812f-b9739262cd89 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:06:42.570839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3d9b4c9a-14d7-4704-a7d3-d657325293fd tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:42.571973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3d9b4c9a-14d7-4704-a7d3-d657325293fd tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:42.599213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d9b4c9a-14d7-4704-a7d3-d657325293fd tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:42.600531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d9b4c9a-14d7-4704-a7d3-d657325293fd tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:42.601641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d9b4c9a-14d7-4704-a7d3-d657325293fd tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:42.609983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d9b4c9a-14d7-4704-a7d3-d657325293fd tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:42.676556 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-3d9b4c9a-14d7-4704-a7d3-d657325293fd tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] HTTP exception thrown: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3d9b4c9a-14d7-4704-a7d3-d657325293fd tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Request method failure captured: Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d HTTP/1.1 Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6deKj_4ni6BiP5hu0KReUjCwN-jXFzDltBsZkdmHfZJw3iCK1NJe4cC4HqyDHfr9U2Xj9tTYrH-rL2Y-nfbcV2kQPduI8yks5ljNEDlazy86SExfxbA5OA6iqfJroq-67nWDTGmlBdStRJ_EHNLs6bYrB1tkODLPTKFNyABk3rb39eQ Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_78ae2f8c7bef4a959cdfa8c61360e7e5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}] Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: e2c17b2e7e9f4c878826497386ee3ba7 Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'd899e1f4-ca44-4ab5-bda0-97d7e101bf2d'} Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:06:42.683264 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:06:42.688844 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. Aug 03 02:06:42.688844 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.688844 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:42.688844 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.688844 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:42.688844 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:42.688844 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:42.688844 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:42.688844 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:42.688844 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. Aug 03 02:06:42.688844 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.688844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3d9b4c9a-14d7-4704-a7d3-d657325293fd tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Returning 404 to user: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:42.690782 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3d9b4c9a-14d7-4704-a7d3-d657325293fd tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 404 len: 111 microversion: 2.1 time: 0.124748 Aug 03 02:06:42.695361 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1834/3776] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:06:42 2022] DELETE /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:06:42.706468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b872bae3-9d41-4bd8-81cd-1504ff0302c9 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:42.707224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b872bae3-9d41-4bd8-81cd-1504ff0302c9 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: d899e1f4-ca44-4ab5-bda0-97d7e101bf2d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:42.728919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b872bae3-9d41-4bd8-81cd-1504ff0302c9 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:42.729421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b872bae3-9d41-4bd8-81cd-1504ff0302c9 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:42.730295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b872bae3-9d41-4bd8-81cd-1504ff0302c9 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:42.730749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b872bae3-9d41-4bd8-81cd-1504ff0302c9 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:42.772918 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-b872bae3-9d41-4bd8-81cd-1504ff0302c9 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] HTTP exception thrown: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b872bae3-9d41-4bd8-81cd-1504ff0302c9 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Request method failure captured: Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d HTTP/1.1 Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6deKj_4ni6BiP5hu0KReUjCwN-jXFzDltBsZkdmHfZJw3iCK1NJe4cC4HqyDHfr9U2Xj9tTYrH-rL2Y-nfbcV2kQPduI8yks5ljNEDlazy86SExfxbA5OA6iqfJroq-67nWDTGmlBdStRJ_EHNLs6bYrB1tkODLPTKFNyABk3rb39eQ Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_78ae2f8c7bef4a959cdfa8c61360e7e5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}] Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: e2c17b2e7e9f4c878826497386ee3ba7 Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'd899e1f4-ca44-4ab5-bda0-97d7e101bf2d'} Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.776788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:42.788274 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.788274 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:42.788274 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:42.788274 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:42.788274 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:42.788274 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:42.788274 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. Aug 03 02:06:42.788274 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:42.788274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b872bae3-9d41-4bd8-81cd-1504ff0302c9 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Returning 404 to user: Instance d899e1f4-ca44-4ab5-bda0-97d7e101bf2d could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:42.788274 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b872bae3-9d41-4bd8-81cd-1504ff0302c9 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d" status: 404 len: 111 microversion: 2.1 time: 0.080517 Aug 03 02:06:42.788274 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1835/3777] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:42 2022] GET /compute/v2.1/servers/d899e1f4-ca44-4ab5-bda0-97d7e101bf2d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:06:42.790974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-901ad3e0-eff0-44a0-8163-b556dc2af399 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:42.794710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6fa943d3-4aa6-493e-8260-7a3e1a6c9bec tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '.version_select at 0x7f5b243d8af0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:42.805981 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-901ad3e0-eff0-44a0-8163-b556dc2af399 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1241 microversion: 2.1 time: 0.552546 Aug 03 02:06:42.807564 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1943/3778] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:42 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1241 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:42.854869 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6fa943d3-4aa6-493e-8260-7a3e1a6c9bec tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1269134610" status: 202 len: 0 microversion: 2.1 time: 0.063679 Aug 03 02:06:42.855942 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1836/3779] 10.222.0.67 () {58 vars in 1221 bytes} [Wed Aug 3 02:06:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1269134610 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:06:43.049414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-74a51a68-d5a8-4ad6-9d9f-5add16fecdcc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:43.053588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-74a51a68-d5a8-4ad6-9d9f-5add16fecdcc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:43.078640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74a51a68-d5a8-4ad6-9d9f-5add16fecdcc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:43.080045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74a51a68-d5a8-4ad6-9d9f-5add16fecdcc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:43.081145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74a51a68-d5a8-4ad6-9d9f-5add16fecdcc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:43.083553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-74a51a68-d5a8-4ad6-9d9f-5add16fecdcc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:43.843604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-74a51a68-d5a8-4ad6-9d9f-5add16fecdcc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:43.855866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1d882bde-c5af-4de6-9f29-a5aba606cdcf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:43.857999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1d882bde-c5af-4de6-9f29-a5aba606cdcf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:43.865955 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-74a51a68-d5a8-4ad6-9d9f-5add16fecdcc tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1512 microversion: 2.1 time: 0.829036 Aug 03 02:06:43.874191 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1944/3780] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:43 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1512 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:43.919878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d882bde-c5af-4de6-9f29-a5aba606cdcf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:43.921076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d882bde-c5af-4de6-9f29-a5aba606cdcf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:43.922760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d882bde-c5af-4de6-9f29-a5aba606cdcf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:43.942576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d882bde-c5af-4de6-9f29-a5aba606cdcf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:44.160778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1d882bde-c5af-4de6-9f29-a5aba606cdcf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:44.186421 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1d882bde-c5af-4de6-9f29-a5aba606cdcf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1293 microversion: 2.1 time: 0.345142 Aug 03 02:06:44.187339 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1837/3781] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:43 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1293 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:44.919360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bc138597-8583-4ee4-956f-04240456be80 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:44.920708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bc138597-8583-4ee4-956f-04240456be80 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:44.944245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc138597-8583-4ee4-956f-04240456be80 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:44.944657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc138597-8583-4ee4-956f-04240456be80 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:44.959445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc138597-8583-4ee4-956f-04240456be80 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:44.962336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc138597-8583-4ee4-956f-04240456be80 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:45.050632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1343689242", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "12e2c522-a949-441e-b629-2f1ae99fe79e"}, {"port": "cce1ca4d-a384-4a7c-bc85-f44f966690b5", "tag": "port-1"}, {"port": "fc6e33cc-8065-4dce-baf6-a0eed37f7c52", "tag": "port-2"}, {"uuid": "caaf9336-edc6-45f3-aa55-2773e5e54c53", "tag": "net-1"}, {"uuid": "caaf9336-edc6-45f3-aa55-2773e5e54c53"}, {"uuid": "2fcd82cf-cdd3-484c-a0a9-58c4cc5a8bae", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "2fcd82cf-cdd3-484c-a0a9-58c4cc5a8bae", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ab1c06f6-c267-40cf-b252-69bbb4079d22", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a27c5b26-e888-48e7-b747-768f78633a3d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "8c9dd04e-4e93-42fb-a441-927f714375f1", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--320182140"}], "key_name": "tempest-keypair-1998967340", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:45.450603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] validate_networks() for [('12e2c522-a949-441e-b629-2f1ae99fe79e', None, None, None, None, None), (None, None, 'cce1ca4d-a384-4a7c-bc85-f44f966690b5', None, None, None), (None, None, 'fc6e33cc-8065-4dce-baf6-a0eed37f7c52', None, None, None), ('caaf9336-edc6-45f3-aa55-2773e5e54c53', None, None, None, None, None), ('caaf9336-edc6-45f3-aa55-2773e5e54c53', None, None, None, None, None), ('2fcd82cf-cdd3-484c-a0a9-58c4cc5a8bae', '10.2.2.100', None, None, None, None), ('2fcd82cf-cdd3-484c-a0a9-58c4cc5a8bae', '10.2.2.200', None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:06:45.619579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bc138597-8583-4ee4-956f-04240456be80 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:45.644033 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bc138597-8583-4ee4-956f-04240456be80 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1512 microversion: 2.1 time: 0.729950 Aug 03 02:06:45.644885 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1945/3782] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:44 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1512 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:45.667952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fa3571cb-6abb-47d4-b6b2-4487bb75f297 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:45.668779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fa3571cb-6abb-47d4-b6b2-4487bb75f297 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:45.688390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa3571cb-6abb-47d4-b6b2-4487bb75f297 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:45.688973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa3571cb-6abb-47d4-b6b2-4487bb75f297 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:45.690031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa3571cb-6abb-47d4-b6b2-4487bb75f297 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:45.690737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa3571cb-6abb-47d4-b6b2-4487bb75f297 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:45.900007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fa3571cb-6abb-47d4-b6b2-4487bb75f297 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:45.909928 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fa3571cb-6abb-47d4-b6b2-4487bb75f297 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1299 microversion: 2.1 time: 0.262972 Aug 03 02:06:45.927789 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1946/3783] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:45 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1299 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:46.678985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b8fadcf9-9749-440b-afbd-5f8e39cd5d8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:46.679789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b8fadcf9-9749-440b-afbd-5f8e39cd5d8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:46.703668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8fadcf9-9749-440b-afbd-5f8e39cd5d8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:46.704626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8fadcf9-9749-440b-afbd-5f8e39cd5d8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:46.722965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8fadcf9-9749-440b-afbd-5f8e39cd5d8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:46.723884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8fadcf9-9749-440b-afbd-5f8e39cd5d8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:47.399729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b8fadcf9-9749-440b-afbd-5f8e39cd5d8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:47.416628 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b8fadcf9-9749-440b-afbd-5f8e39cd5d8f tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1512 microversion: 2.1 time: 0.746272 Aug 03 02:06:47.417255 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1947/3784] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:46 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1512 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:47.425006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-01198c20-7508-4ec2-97d7-717d976a64b4 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '.version_select at 0x7f5b12339040>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:47.464267 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-01198c20-7508-4ec2-97d7-717d976a64b4 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] HTTP exception thrown: Image not found. Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-01198c20-7508-4ec2-97d7-717d976a64b4 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Request method failure captured: Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/images/04670ad8-d529-4538-a93c-e6b466282994 HTTP/1.1 Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6deKj_4ni6BiP5hu0KReUjCwN-jXFzDltBsZkdmHfZJw3iCK1NJe4cC4HqyDHfr9U2Xj9tTYrH-rL2Y-nfbcV2kQPduI8yks5ljNEDlazy86SExfxbA5OA6iqfJroq-67nWDTGmlBdStRJ_EHNLs6bYrB1tkODLPTKFNyABk3rb39eQ Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_78ae2f8c7bef4a959cdfa8c61360e7e5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}] Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e2c17b2e7e9f4c878826497386ee3ba7 Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: exception: Image not found. Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '04670ad8-d529-4538-a93c-e6b466282994'} Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 04670ad8-d529-4538-a93c-e6b466282994 to delete Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 04670ad8-d529-4538-a93c-e6b466282994 could not be found. Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:47.468306 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 02:06:47.473336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:47.483981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-01198c20-7508-4ec2-97d7-717d976a64b4 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Returning 404 to user: Image not found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:47.485149 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-01198c20-7508-4ec2-97d7-717d976a64b4 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "DELETE /compute/v2.1/images/04670ad8-d529-4538-a93c-e6b466282994" status: 404 len: 62 microversion: 2.1 time: 0.066670 Aug 03 02:06:47.486345 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1948/3785] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:47 2022] DELETE /compute/v2.1/images/04670ad8-d529-4538-a93c-e6b466282994 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:06:47.495899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31133b42-f650-45ae-9740-005b7266a13c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:47.497050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-31133b42-f650-45ae-9740-005b7266a13c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:47.520320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31133b42-f650-45ae-9740-005b7266a13c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:47.520796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31133b42-f650-45ae-9740-005b7266a13c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:47.522789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31133b42-f650-45ae-9740-005b7266a13c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:47.523432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31133b42-f650-45ae-9740-005b7266a13c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:48.044838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-31133b42-f650-45ae-9740-005b7266a13c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:48.081676 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-31133b42-f650-45ae-9740-005b7266a13c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1367 microversion: 2.1 time: 0.591294 Aug 03 02:06:48.085831 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1949/3786] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:47 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1367 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:48.099825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a280d61d-f218-447d-a712-e69495078f92 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:48.106435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a280d61d-f218-447d-a712-e69495078f92 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:48.120296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a280d61d-f218-447d-a712-e69495078f92 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:48.122366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a280d61d-f218-447d-a712-e69495078f92 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:48.123515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a280d61d-f218-447d-a712-e69495078f92 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:48.127338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a280d61d-f218-447d-a712-e69495078f92 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:48.174476 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-a280d61d-f218-447d-a712-e69495078f92 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] HTTP exception thrown: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a280d61d-f218-447d-a712-e69495078f92 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Request method failure captured: Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf HTTP/1.1 Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6deKj_4ni6BiP5hu0KReUjCwN-jXFzDltBsZkdmHfZJw3iCK1NJe4cC4HqyDHfr9U2Xj9tTYrH-rL2Y-nfbcV2kQPduI8yks5ljNEDlazy86SExfxbA5OA6iqfJroq-67nWDTGmlBdStRJ_EHNLs6bYrB1tkODLPTKFNyABk3rb39eQ Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_78ae2f8c7bef4a959cdfa8c61360e7e5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}] Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e2c17b2e7e9f4c878826497386ee3ba7 Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '4fd09fc6-043e-40e1-9725-6c3ff4ff28bf'} Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:06:48.179425 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:06:48.185396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. Aug 03 02:06:48.185396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:48.185396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:48.185396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:48.185396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:48.185396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:48.185396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:48.185396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:48.185396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:48.185396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. Aug 03 02:06:48.185396 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:48.189141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a280d61d-f218-447d-a712-e69495078f92 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Returning 404 to user: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:48.194531 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a280d61d-f218-447d-a712-e69495078f92 tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 404 len: 111 microversion: 2.1 time: 0.106047 Aug 03 02:06:48.201517 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1950/3787] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:06:48 2022] DELETE /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:06:48.213297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-edee83f1-aa9c-4d50-a163-dd0d637e8d0b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:48.214047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-edee83f1-aa9c-4d50-a163-dd0d637e8d0b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] [instance: 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:48.241106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edee83f1-aa9c-4d50-a163-dd0d637e8d0b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:48.241628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edee83f1-aa9c-4d50-a163-dd0d637e8d0b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:48.250059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edee83f1-aa9c-4d50-a163-dd0d637e8d0b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:48.252437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edee83f1-aa9c-4d50-a163-dd0d637e8d0b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:48.295425 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-edee83f1-aa9c-4d50-a163-dd0d637e8d0b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] HTTP exception thrown: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-edee83f1-aa9c-4d50-a163-dd0d637e8d0b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Request method failure captured: Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf HTTP/1.1 Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6deKj_4ni6BiP5hu0KReUjCwN-jXFzDltBsZkdmHfZJw3iCK1NJe4cC4HqyDHfr9U2Xj9tTYrH-rL2Y-nfbcV2kQPduI8yks5ljNEDlazy86SExfxbA5OA6iqfJroq-67nWDTGmlBdStRJ_EHNLs6bYrB1tkODLPTKFNyABk3rb39eQ Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_78ae2f8c7bef4a959cdfa8c61360e7e5", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/78ae2f8c7bef4a959cdfa8c61360e7e5"}]}] Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 78ae2f8c7bef4a959cdfa8c61360e7e5 Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-556493458 Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e2c17b2e7e9f4c878826497386ee3ba7 Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-556493458-project Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '4fd09fc6-043e-40e1-9725-6c3ff4ff28bf'} Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:48.297087 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:48.303734 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:48.303734 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:48.303734 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:48.303734 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:48.303734 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:48.303734 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:48.303734 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. Aug 03 02:06:48.303734 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:48.303734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-edee83f1-aa9c-4d50-a163-dd0d637e8d0b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] Returning 404 to user: Instance 4fd09fc6-043e-40e1-9725-6c3ff4ff28bf could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:48.303734 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-edee83f1-aa9c-4d50-a163-dd0d637e8d0b tempest-ImagesOneServerNegativeTestJSON-556493458 tempest-ImagesOneServerNegativeTestJSON-556493458-project] 10.222.0.67 "GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf" status: 404 len: 111 microversion: 2.1 time: 0.094825 Aug 03 02:06:48.303734 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1951/3788] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:48 2022] GET /compute/v2.1/servers/4fd09fc6-043e-40e1-9725-6c3ff4ff28bf => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:06:48.439087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6bff8df1-2ce1-44cb-9b4d-d135720f3502 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:48.440330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6bff8df1-2ce1-44cb-9b4d-d135720f3502 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:48.461435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bff8df1-2ce1-44cb-9b4d-d135720f3502 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:48.468676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bff8df1-2ce1-44cb-9b4d-d135720f3502 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:48.473678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bff8df1-2ce1-44cb-9b4d-d135720f3502 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:48.474200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bff8df1-2ce1-44cb-9b4d-d135720f3502 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:49.291924 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6bff8df1-2ce1-44cb-9b4d-d135720f3502 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:49.304517 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6bff8df1-2ce1-44cb-9b4d-d135720f3502 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1489 microversion: 2.1 time: 0.869707 Aug 03 02:06:49.315512 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1952/3789] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:48 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1489 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:06:49.321349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dd7c25d7-e488-42ed-be1a-0f0ae6fb9821 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:49.322133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dd7c25d7-e488-42ed-be1a-0f0ae6fb9821 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:49.333238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd7c25d7-e488-42ed-be1a-0f0ae6fb9821 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:49.333738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd7c25d7-e488-42ed-be1a-0f0ae6fb9821 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:49.335549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd7c25d7-e488-42ed-be1a-0f0ae6fb9821 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:49.340841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dd7c25d7-e488-42ed-be1a-0f0ae6fb9821 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:50.046737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dd7c25d7-e488-42ed-be1a-0f0ae6fb9821 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:50.080269 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dd7c25d7-e488-42ed-be1a-0f0ae6fb9821 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1367 microversion: 2.1 time: 0.763563 Aug 03 02:06:50.109753 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1953/3790] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:49 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1367 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:50.128379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e0c24f8d-cc94-4524-9528-a793a696c083 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:50.129384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e0c24f8d-cc94-4524-9528-a793a696c083 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:50.153863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0c24f8d-cc94-4524-9528-a793a696c083 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:50.154603 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0c24f8d-cc94-4524-9528-a793a696c083 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:50.155873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0c24f8d-cc94-4524-9528-a793a696c083 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:50.156856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0c24f8d-cc94-4524-9528-a793a696c083 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:50.243518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e0c24f8d-cc94-4524-9528-a793a696c083 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:06:50.494895 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e0c24f8d-cc94-4524-9528-a793a696c083 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 204 len: 0 microversion: 2.1 time: 0.381768 Aug 03 02:06:50.501242 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1954/3791] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:06:50 2022] DELETE /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:06:50.513951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-bda2bd80-8d3e-4639-b990-bc85f15d986a req-03ccd046-b7c9-4508-b6c7-3cfb54462ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1ef30e-5b4e-43ac-84ce-2a3a69d77340", "tag": "4d52422a-7324-4649-bc25-a65137f3fd9a"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:50.532308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bda2bd80-8d3e-4639-b990-bc85f15d986a req-03ccd046-b7c9-4508-b6c7-3cfb54462ca2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:50.533419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bda2bd80-8d3e-4639-b990-bc85f15d986a req-03ccd046-b7c9-4508-b6c7-3cfb54462ca2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:50.551992 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-bda2bd80-8d3e-4639-b990-bc85f15d986a req-03ccd046-b7c9-4508-b6c7-3cfb54462ca2 service nova] Creating event network-changed:4d52422a-7324-4649-bc25-a65137f3fd9a for instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 on n-h1-826529-8 Aug 03 02:06:50.567533 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-bda2bd80-8d3e-4639-b990-bc85f15d986a req-03ccd046-b7c9-4508-b6c7-3cfb54462ca2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068236 Aug 03 02:06:50.569119 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1955/3792] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:50.594668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b91d3935-328f-4676-b65f-1ee7dd44f104 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:50.596125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b91d3935-328f-4676-b65f-1ee7dd44f104 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:50.613665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b91d3935-328f-4676-b65f-1ee7dd44f104 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:50.613941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b91d3935-328f-4676-b65f-1ee7dd44f104 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:50.619851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b91d3935-328f-4676-b65f-1ee7dd44f104 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:50.622426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b91d3935-328f-4676-b65f-1ee7dd44f104 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:51.406223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b91d3935-328f-4676-b65f-1ee7dd44f104 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:51.427110 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b91d3935-328f-4676-b65f-1ee7dd44f104 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1495 microversion: 2.1 time: 0.856348 Aug 03 02:06:51.433364 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1956/3793] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:50 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1495 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:51.451793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9585ad04-5bb3-44b5-b1b7-b7a18378d9a5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:51.453101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9585ad04-5bb3-44b5-b1b7-b7a18378d9a5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:51.465029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9585ad04-5bb3-44b5-b1b7-b7a18378d9a5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:51.465915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9585ad04-5bb3-44b5-b1b7-b7a18378d9a5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:51.469111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9585ad04-5bb3-44b5-b1b7-b7a18378d9a5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:51.469949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9585ad04-5bb3-44b5-b1b7-b7a18378d9a5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:52.003692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9585ad04-5bb3-44b5-b1b7-b7a18378d9a5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:52.006569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:52.020367 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9585ad04-5bb3-44b5-b1b7-b7a18378d9a5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1367 microversion: 2.1 time: 0.585293 Aug 03 02:06:52.025122 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1957/3794] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:51 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1367 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:52.108117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:52.145025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:52.471553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bd95da7b-6d66-4ccd-8deb-0bab95ed58bb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:52.473226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bd95da7b-6d66-4ccd-8deb-0bab95ed58bb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:52.487873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd95da7b-6d66-4ccd-8deb-0bab95ed58bb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:52.489036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd95da7b-6d66-4ccd-8deb-0bab95ed58bb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:52.491125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd95da7b-6d66-4ccd-8deb-0bab95ed58bb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:52.492615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd95da7b-6d66-4ccd-8deb-0bab95ed58bb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:52.797611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=10 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:52.870885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bd95da7b-6d66-4ccd-8deb-0bab95ed58bb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:52.897479 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bd95da7b-6d66-4ccd-8deb-0bab95ed58bb tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1495 microversion: 2.1 time: 0.432896 Aug 03 02:06:52.899369 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1958/3795] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:52 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1495 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:53.054009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-49f63a89-7421-469e-ad43-e48f629fa3e4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:53.056066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-49f63a89-7421-469e-ad43-e48f629fa3e4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:53.066553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49f63a89-7421-469e-ad43-e48f629fa3e4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:53.067778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49f63a89-7421-469e-ad43-e48f629fa3e4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:53.070510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49f63a89-7421-469e-ad43-e48f629fa3e4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:53.071478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49f63a89-7421-469e-ad43-e48f629fa3e4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:53.696558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:06:53.700074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:06:53.700918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:06:53.701641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:06:53.708284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:06:53.731573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-49f63a89-7421-469e-ad43-e48f629fa3e4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:53.742954 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-49f63a89-7421-469e-ad43-e48f629fa3e4 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1367 microversion: 2.1 time: 0.696311 Aug 03 02:06:53.759813 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1959/3796] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:53 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1367 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:53.767444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:53.768340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:53.769849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:53.774451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:53.829771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2032650f-7527-49c0-b698-31a096015145 req-25bcf612-7c41-4b83-9a8b-b31eb4881736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef77e1c8-a8d6-4306-89ea-0c3c169b1d75", "name": "network-vif-deleted", "tag": "c5a88aa4-c808-4a91-ac92-184fb7899bd2"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:53.845028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Getting quotas for project 7fae5f26896141139f4ce396d92a1999. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:06:53.882194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Getting quotas for user aebcddd50c8948c898aa660b214c18ea and project 7fae5f26896141139f4ce396d92a1999. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:06:53.884390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2032650f-7527-49c0-b698-31a096015145 req-25bcf612-7c41-4b83-9a8b-b31eb4881736 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:53.885341 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2032650f-7527-49c0-b698-31a096015145 req-25bcf612-7c41-4b83-9a8b-b31eb4881736 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:53.952363 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2032650f-7527-49c0-b698-31a096015145 req-25bcf612-7c41-4b83-9a8b-b31eb4881736 service nova] Creating event network-vif-deleted:c5a88aa4-c808-4a91-ac92-184fb7899bd2 for instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 on n-h2-826529-8 Aug 03 02:06:54.043375 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2032650f-7527-49c0-b698-31a096015145 req-25bcf612-7c41-4b83-9a8b-b31eb4881736 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225922 Aug 03 02:06:54.049346 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1960/3797] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:06:54.090422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6a07e9a3-ebe0-4ea2-ba98-00de92960131 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:54.092354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6a07e9a3-ebe0-4ea2-ba98-00de92960131 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:54.118092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a07e9a3-ebe0-4ea2-ba98-00de92960131 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:54.119428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a07e9a3-ebe0-4ea2-ba98-00de92960131 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:54.121048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a07e9a3-ebe0-4ea2-ba98-00de92960131 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:54.122060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a07e9a3-ebe0-4ea2-ba98-00de92960131 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:54.221344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a07e9a3-ebe0-4ea2-ba98-00de92960131 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:54.222034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a07e9a3-ebe0-4ea2-ba98-00de92960131 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:54.222718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-6a07e9a3-ebe0-4ea2-ba98-00de92960131 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lazy-loading 'fault' on Instance uuid ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:06:54.350425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:06:54.359451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ab1c06f6-c267-40cf-b252-69bbb4079d22',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a27c5b26-e888-48e7-b747-768f78633a3d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c9dd04e-4e93-42fb-a441-927f714375f1',volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:06:54.476320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6a07e9a3-ebe0-4ea2-ba98-00de92960131 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:54.496584 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6a07e9a3-ebe0-4ea2-ba98-00de92960131 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 200 len: 1305 microversion: 2.1 time: 0.443901 Aug 03 02:06:54.503898 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1961/3798] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:54 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 1305 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:54.902280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a4c1cbf4-3655-4388-8000-fa72166be9c7 tempest-FloatingIPsNegativeTestJSON-1522822824 tempest-FloatingIPsNegativeTestJSON-1522822824-project] Calling method '.version_select at 0x7f5b122c09d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:55.030471 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a4c1cbf4-3655-4388-8000-fa72166be9c7 tempest-FloatingIPsNegativeTestJSON-1522822824 tempest-FloatingIPsNegativeTestJSON-1522822824-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.521685 Aug 03 02:06:55.031205 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1962/3799] 10.222.0.67 () {58 vars in 1149 bytes} [Wed Aug 3 02:06:54 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:06:55.039942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b456979d-b100-470f-b454-26cb58c00378 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:55.041941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b456979d-b100-470f-b454-26cb58c00378 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:55.056885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b456979d-b100-470f-b454-26cb58c00378 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:55.058053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b456979d-b100-470f-b454-26cb58c00378 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:55.060434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b456979d-b100-470f-b454-26cb58c00378 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:55.062193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b456979d-b100-470f-b454-26cb58c00378 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:55.116395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:55.229932 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3a9dde11-e817-4d11-bbad-834293c98b83 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 10.183561 Aug 03 02:06:55.242018 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1838/3800] 10.222.0.67 () {62 vars in 1189 bytes} [Wed Aug 3 02:06:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 10189 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 03 02:06:55.257518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f92c16c3-30ac-40c4-bb5e-02cde1770346 tempest-FloatingIPsNegativeTestJSON-1522822824 tempest-FloatingIPsNegativeTestJSON-1522822824-project] Action: 'create', calling method: .version_select at 0x7f5b243d8b80>, body: {"pool": "non_exist_pool"} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:55.426862 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-f92c16c3-30ac-40c4-bb5e-02cde1770346 tempest-FloatingIPsNegativeTestJSON-1522822824 tempest-FloatingIPsNegativeTestJSON-1522822824-project] HTTP exception thrown: Floating IP pool not found. Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f92c16c3-30ac-40c4-bb5e-02cde1770346 tempest-FloatingIPsNegativeTestJSON-1522822824 tempest-FloatingIPsNegativeTestJSON-1522822824-project] Request method failure captured: Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 26 Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dg9p-r4GPoDpcuH7rA0tN0FD1gNNhla-DeEZ21RUzWOJKS5bPCQ1PwsqSWBd7Kvncfb5o4KiYlkPiDjSqLkU5lT_iXsWnoJGhUZBdpjK-B78wRKwCmBTfBDR3rvVf-mdUBXaXEWUnZilUm2eVJpk-FnK309CrQ-ct7QzTRMfWirxWI Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33351d96561e49fdac88925f15b74f52 Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1522822824 Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33351d96561e49fdac88925f15b74f52", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33351d96561e49fdac88925f15b74f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33351d96561e49fdac88925f15b74f52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33351d96561e49fdac88925f15b74f52"}]}] Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1522822824 Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33351d96561e49fdac88925f15b74f52 Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1522822824 Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-FloatingIPsNegativeTestJSON-1522822824-project Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 9646daa165f24e0bbc917a0ed7a6660b Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1522822824-project Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: {"pool": "non_exist_pool"} Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: exception: Floating IP pool not found. Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:55.429466 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:55.439658 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 03 02:06:55.439658 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.439658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f92c16c3-30ac-40c4-bb5e-02cde1770346 tempest-FloatingIPsNegativeTestJSON-1522822824 tempest-FloatingIPsNegativeTestJSON-1522822824-project] Returning 404 to user: Floating IP pool not found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:55.439658 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f92c16c3-30ac-40c4-bb5e-02cde1770346 tempest-FloatingIPsNegativeTestJSON-1522822824 tempest-FloatingIPsNegativeTestJSON-1522822824-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.193373 Aug 03 02:06:55.439658 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1839/3801] 10.222.0.67 () {60 vars in 1170 bytes} [Wed Aug 3 02:06:55 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:06:55.447744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3b6ea173-d88d-4949-8ca5-5cc0321e3f65 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:55.448512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3b6ea173-d88d-4949-8ca5-5cc0321e3f65 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:55.526060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b456979d-b100-470f-b454-26cb58c00378 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:55.534752 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b456979d-b100-470f-b454-26cb58c00378 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1367 microversion: 2.1 time: 0.502198 Aug 03 02:06:55.535562 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1963/3802] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:55 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:55.556941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ec5052a4-8fa0-4f08-9984-d7c5196c2fb9 tempest-FloatingIPsNegativeTestJSON-1522822824 tempest-FloatingIPsNegativeTestJSON-1522822824-project] Calling method '.version_select at 0x7f5b123359d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:55.624622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3b6ea173-d88d-4949-8ca5-5cc0321e3f65 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:55.663144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3b6ea173-d88d-4949-8ca5-5cc0321e3f65 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:55.668414 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3b6ea173-d88d-4949-8ca5-5cc0321e3f65 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:55.672122 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3b6ea173-d88d-4949-8ca5-5cc0321e3f65 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1286 microversion: 2.42 time: 0.234847 Aug 03 02:06:55.674257 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1840/3803] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:06:55 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1286 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:06:55.695914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-65b1ca43-7be2-43af-b5e7-5d2409cc730e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:55.698401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-65b1ca43-7be2-43af-b5e7-5d2409cc730e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:55.712817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG neutronclient.v2_0.client [None req-ec5052a4-8fa0-4f08-9984-d7c5196c2fb9 tempest-FloatingIPsNegativeTestJSON-1522822824 tempest-FloatingIPsNegativeTestJSON-1522822824-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1977ce47-1690-4294-b3ae-d6241f509784 could not be found", "detail": ""}} {{(pid=125941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 02:06:55.714024 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-ec5052a4-8fa0-4f08-9984-d7c5196c2fb9 tempest-FloatingIPsNegativeTestJSON-1522822824 tempest-FloatingIPsNegativeTestJSON-1522822824-project] HTTP exception thrown: Floating IP not found for ID 1977ce47-1690-4294-b3ae-d6241f509784 Aug 03 02:06:55.716267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-65b1ca43-7be2-43af-b5e7-5d2409cc730e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:55.717257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-65b1ca43-7be2-43af-b5e7-5d2409cc730e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ec5052a4-8fa0-4f08-9984-d7c5196c2fb9 tempest-FloatingIPsNegativeTestJSON-1522822824 tempest-FloatingIPsNegativeTestJSON-1522822824-project] Request method failure captured: Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/os-floating-ips/1977ce47-1690-4294-b3ae-d6241f509784 HTTP/1.1 Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dg9p-r4GPoDpcuH7rA0tN0FD1gNNhla-DeEZ21RUzWOJKS5bPCQ1PwsqSWBd7Kvncfb5o4KiYlkPiDjSqLkU5lT_iXsWnoJGhUZBdpjK-B78wRKwCmBTfBDR3rvVf-mdUBXaXEWUnZilUm2eVJpk-FnK309CrQ-ct7QzTRMfWirxWI Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33351d96561e49fdac88925f15b74f52 Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1522822824 Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33351d96561e49fdac88925f15b74f52", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33351d96561e49fdac88925f15b74f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33351d96561e49fdac88925f15b74f52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33351d96561e49fdac88925f15b74f52"}]}] Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1522822824 Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33351d96561e49fdac88925f15b74f52 Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1522822824 Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-FloatingIPsNegativeTestJSON-1522822824-project Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 9646daa165f24e0bbc917a0ed7a6660b Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1522822824-project Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: exception: Floating IP not found for ID 1977ce47-1690-4294-b3ae-d6241f509784 Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '1977ce47-1690-4294-b3ae-d6241f509784'} Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1977ce47-1690-4294-b3ae-d6241f509784 could not be found Aug 03 02:06:55.718028 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce709dda-5058-40af-b80f-c9afcc608b78'] Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1977ce47-1690-4294-b3ae-d6241f509784. Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1977ce47-1690-4294-b3ae-d6241f509784 Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1977ce47-1690-4294-b3ae-d6241f509784 Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.724180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ec5052a4-8fa0-4f08-9984-d7c5196c2fb9 tempest-FloatingIPsNegativeTestJSON-1522822824 tempest-FloatingIPsNegativeTestJSON-1522822824-project] Returning 404 to user: Floating IP not found for ID 1977ce47-1690-4294-b3ae-d6241f509784 {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:55.731529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-65b1ca43-7be2-43af-b5e7-5d2409cc730e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:55.731529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-65b1ca43-7be2-43af-b5e7-5d2409cc730e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:55.731850 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ec5052a4-8fa0-4f08-9984-d7c5196c2fb9 tempest-FloatingIPsNegativeTestJSON-1522822824 tempest-FloatingIPsNegativeTestJSON-1522822824-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/1977ce47-1690-4294-b3ae-d6241f509784" status: 404 len: 111 microversion: 2.1 time: 0.182987 Aug 03 02:06:55.731850 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1964/3804] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 02:06:55 2022] DELETE /compute/v2.1/os-floating-ips/1977ce47-1690-4294-b3ae-d6241f509784 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:06:55.756665 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-65b1ca43-7be2-43af-b5e7-5d2409cc730e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-65b1ca43-7be2-43af-b5e7-5d2409cc730e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 HTTP/1.1 Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'ef77e1c8-a8d6-4306-89ea-0c3c169b1d75'} Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:06:55.759050 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.764311 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:06:55.764311 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:06:55.764311 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:06:55.764311 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:06:55.764311 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:06:55.764311 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. Aug 03 02:06:55.764311 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:06:55.764311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-65b1ca43-7be2-43af-b5e7-5d2409cc730e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:06:55.764311 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-65b1ca43-7be2-43af-b5e7-5d2409cc730e tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 404 len: 111 microversion: 2.1 time: 0.085111 Aug 03 02:06:55.775767 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1841/3805] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:55 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:06:56.091896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1426762027", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "cf1e5fc2-66a4-4802-965c-545f628b0c29"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:06:56.197239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] validate_networks() for [('cf1e5fc2-66a4-4802-965c-545f628b0c29', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:06:56.561393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f3f94c06-5a96-4664-8cc1-345381115d5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:56.562126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f3f94c06-5a96-4664-8cc1-345381115d5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:56.580321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3f94c06-5a96-4664-8cc1-345381115d5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:56.589628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3f94c06-5a96-4664-8cc1-345381115d5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:56.591601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3f94c06-5a96-4664-8cc1-345381115d5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:56.592936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f3f94c06-5a96-4664-8cc1-345381115d5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:57.390762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f3f94c06-5a96-4664-8cc1-345381115d5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:57.404491 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f3f94c06-5a96-4664-8cc1-345381115d5f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1367 microversion: 2.1 time: 0.850373 Aug 03 02:06:57.422608 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1842/3806] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:56 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1367 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:06:57.430637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-79332776-e9f0-40c5-8fec-3c250538b5a1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:57.432684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-79332776-e9f0-40c5-8fec-3c250538b5a1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:57.447345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79332776-e9f0-40c5-8fec-3c250538b5a1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:57.447806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79332776-e9f0-40c5-8fec-3c250538b5a1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:57.448714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79332776-e9f0-40c5-8fec-3c250538b5a1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:57.449169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79332776-e9f0-40c5-8fec-3c250538b5a1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:57.670072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-79332776-e9f0-40c5-8fec-3c250538b5a1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:57.705918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-79332776-e9f0-40c5-8fec-3c250538b5a1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:57.708953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-79332776-e9f0-40c5-8fec-3c250538b5a1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:57.711832 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-79332776-e9f0-40c5-8fec-3c250538b5a1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1528 microversion: 2.42 time: 0.287430 Aug 03 02:06:57.713165 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1843/3807] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:06:57 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1528 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:06:58.364551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:06:58.366827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:06:58.368466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:06:58.369159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:06:58.370023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:06:58.449365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0706c100-db2f-40f0-89fa-b22c0baf4d81 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:58.454980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:58.455571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:58.456263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0706c100-db2f-40f0-89fa-b22c0baf4d81 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:58.460786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:58.463634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:58.486495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0706c100-db2f-40f0-89fa-b22c0baf4d81 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:58.487424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0706c100-db2f-40f0-89fa-b22c0baf4d81 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:58.488967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0706c100-db2f-40f0-89fa-b22c0baf4d81 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:58.490185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0706c100-db2f-40f0-89fa-b22c0baf4d81 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:58.578152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Getting quotas for project 01f1d9f8216e4f729a5e24aad713fe98. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:06:58.608409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:06:58.631418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Getting quotas for user 0dc56b77862f410d82c8617f3d679775 and project 01f1d9f8216e4f729a5e24aad713fe98. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:06:58.728436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:06:58.731401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:06:59.075800 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e4a462e-9dcc-45ec-8fcb-f40d7df3709d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.990692 Aug 03 02:06:59.079352 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1965/3808] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:06:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:06:59.096456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-70d9952e-fd9d-4ccf-b453-e8b6b057df30 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:59.097097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-70d9952e-fd9d-4ccf-b453-e8b6b057df30 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:59.112948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70d9952e-fd9d-4ccf-b453-e8b6b057df30 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:59.113427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70d9952e-fd9d-4ccf-b453-e8b6b057df30 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:59.121740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70d9952e-fd9d-4ccf-b453-e8b6b057df30 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:06:59.128402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-70d9952e-fd9d-4ccf-b453-e8b6b057df30 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:06:59.377633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-70d9952e-fd9d-4ccf-b453-e8b6b057df30 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:59.390192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-70d9952e-fd9d-4ccf-b453-e8b6b057df30 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:59.391720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-70d9952e-fd9d-4ccf-b453-e8b6b057df30 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:59.401191 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-70d9952e-fd9d-4ccf-b453-e8b6b057df30 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1594 microversion: 2.42 time: 0.311560 Aug 03 02:06:59.401892 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1966/3809] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:06:59 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1594 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:06:59.409747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0706c100-db2f-40f0-89fa-b22c0baf4d81 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:59.425228 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0706c100-db2f-40f0-89fa-b22c0baf4d81 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1367 microversion: 2.1 time: 0.999652 Aug 03 02:06:59.440756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cac39937-8cd5-48c7-ad8e-454663988779 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:06:59.445762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cac39937-8cd5-48c7-ad8e-454663988779 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:06:59.446008 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1844/3810] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:58 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1367 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:06:59.687486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cac39937-8cd5-48c7-ad8e-454663988779 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:06:59.717060 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cac39937-8cd5-48c7-ad8e-454663988779 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 200 len: 1215 microversion: 2.1 time: 0.301223 Aug 03 02:06:59.728753 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1967/3811] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:06:59 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 1215 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:00.447476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-13070a49-5a39-4816-a3b4-2b1bd2b5da1a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:00.462918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8eb6846b-825a-4643-b8c7-4cf9ee3cf467 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:00.463946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8eb6846b-825a-4643-b8c7-4cf9ee3cf467 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:00.469183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-13070a49-5a39-4816-a3b4-2b1bd2b5da1a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:00.502660 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8eb6846b-825a-4643-b8c7-4cf9ee3cf467 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:00.503158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8eb6846b-825a-4643-b8c7-4cf9ee3cf467 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:00.504865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13070a49-5a39-4816-a3b4-2b1bd2b5da1a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:00.509117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8eb6846b-825a-4643-b8c7-4cf9ee3cf467 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:00.510977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13070a49-5a39-4816-a3b4-2b1bd2b5da1a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:00.516616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13070a49-5a39-4816-a3b4-2b1bd2b5da1a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:00.517113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8eb6846b-825a-4643-b8c7-4cf9ee3cf467 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:00.520555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13070a49-5a39-4816-a3b4-2b1bd2b5da1a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:00.808213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-13070a49-5a39-4816-a3b4-2b1bd2b5da1a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:00.829514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-13070a49-5a39-4816-a3b4-2b1bd2b5da1a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:00.831520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-13070a49-5a39-4816-a3b4-2b1bd2b5da1a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:00.833011 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-13070a49-5a39-4816-a3b4-2b1bd2b5da1a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1594 microversion: 2.42 time: 0.395175 Aug 03 02:07:00.834223 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1845/3812] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:00 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1594 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:00.840924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c2da8bf1-ee80-4fae-8000-68b4cdd7956a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:00.842012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c2da8bf1-ee80-4fae-8000-68b4cdd7956a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:00.850890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2da8bf1-ee80-4fae-8000-68b4cdd7956a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:00.851778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2da8bf1-ee80-4fae-8000-68b4cdd7956a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:00.853903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2da8bf1-ee80-4fae-8000-68b4cdd7956a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:00.854582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2da8bf1-ee80-4fae-8000-68b4cdd7956a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:01.098190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8eb6846b-825a-4643-b8c7-4cf9ee3cf467 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:01.115814 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8eb6846b-825a-4643-b8c7-4cf9ee3cf467 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1367 microversion: 2.1 time: 0.664853 Aug 03 02:07:01.125684 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1968/3813] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:00 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1367 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:07:01.135157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c2da8bf1-ee80-4fae-8000-68b4cdd7956a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:01.139447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=92 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:07:01.167438 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c2da8bf1-ee80-4fae-8000-68b4cdd7956a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 200 len: 1267 microversion: 2.1 time: 0.330694 Aug 03 02:07:01.176364 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1846/3814] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:00 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 1267 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:01.687233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-444603c3-9c5c-4941-bed2-a5103adc9c17 req-c099547f-b465-439b-9491-668d132186ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1ef30e-5b4e-43ac-84ce-2a3a69d77340", "name": "network-vif-plugged", "status": "completed", "tag": "4d52422a-7324-4649-bc25-a65137f3fd9a"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:01.712834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-444603c3-9c5c-4941-bed2-a5103adc9c17 req-c099547f-b465-439b-9491-668d132186ad service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:01.715083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-444603c3-9c5c-4941-bed2-a5103adc9c17 req-c099547f-b465-439b-9491-668d132186ad service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:01.745197 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-444603c3-9c5c-4941-bed2-a5103adc9c17 req-c099547f-b465-439b-9491-668d132186ad service nova] Creating event network-vif-plugged:4d52422a-7324-4649-bc25-a65137f3fd9a for instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 on n-h1-826529-8 Aug 03 02:07:01.760939 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-444603c3-9c5c-4941-bed2-a5103adc9c17 req-c099547f-b465-439b-9491-668d132186ad service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077611 Aug 03 02:07:01.764402 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1969/3815] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:01.864367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-38631522-ab30-44bc-b202-242c553e699a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:01.866056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-38631522-ab30-44bc-b202-242c553e699a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:01.883732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38631522-ab30-44bc-b202-242c553e699a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:01.884486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38631522-ab30-44bc-b202-242c553e699a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:01.885660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38631522-ab30-44bc-b202-242c553e699a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:01.886296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38631522-ab30-44bc-b202-242c553e699a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:02.119009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-38631522-ab30-44bc-b202-242c553e699a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:02.130785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-38631522-ab30-44bc-b202-242c553e699a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:02.140523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-38631522-ab30-44bc-b202-242c553e699a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:02.142893 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-38631522-ab30-44bc-b202-242c553e699a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1594 microversion: 2.42 time: 0.288221 Aug 03 02:07:02.145237 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1847/3816] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:01 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1594 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:02.159789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cbd0278a-676a-4bf0-a858-080a111d0f70 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:02.164823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cbd0278a-676a-4bf0-a858-080a111d0f70 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:02.188190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbd0278a-676a-4bf0-a858-080a111d0f70 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:02.189539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbd0278a-676a-4bf0-a858-080a111d0f70 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:02.192615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbd0278a-676a-4bf0-a858-080a111d0f70 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:02.195707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbd0278a-676a-4bf0-a858-080a111d0f70 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:02.206002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-123418e4-ef4e-4f66-ba77-320a310ce552 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:02.206745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-123418e4-ef4e-4f66-ba77-320a310ce552 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:02.219877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-123418e4-ef4e-4f66-ba77-320a310ce552 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:02.220808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-123418e4-ef4e-4f66-ba77-320a310ce552 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:02.222274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-123418e4-ef4e-4f66-ba77-320a310ce552 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:02.223074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-123418e4-ef4e-4f66-ba77-320a310ce552 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:02.526407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-123418e4-ef4e-4f66-ba77-320a310ce552 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:02.539402 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-123418e4-ef4e-4f66-ba77-320a310ce552 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 200 len: 1273 microversion: 2.1 time: 0.337135 Aug 03 02:07:02.540063 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1848/3817] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:02 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 1273 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:02.861682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cbd0278a-676a-4bf0-a858-080a111d0f70 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:02.896678 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cbd0278a-676a-4bf0-a858-080a111d0f70 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1367 microversion: 2.1 time: 0.747657 Aug 03 02:07:02.901092 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1970/3818] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:02 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1367 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:03.174600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5b133c1e-ba1f-4aa9-a281-3b2f462b7519 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:03.175803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5b133c1e-ba1f-4aa9-a281-3b2f462b7519 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:03.196927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b133c1e-ba1f-4aa9-a281-3b2f462b7519 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:03.197478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b133c1e-ba1f-4aa9-a281-3b2f462b7519 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:03.198553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b133c1e-ba1f-4aa9-a281-3b2f462b7519 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:03.199204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5b133c1e-ba1f-4aa9-a281-3b2f462b7519 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:03.573401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d3e72484-1827-4630-912e-4442cd987af6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:03.574634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d3e72484-1827-4630-912e-4442cd987af6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:03.612092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3e72484-1827-4630-912e-4442cd987af6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:03.612545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3e72484-1827-4630-912e-4442cd987af6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:03.618025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3e72484-1827-4630-912e-4442cd987af6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:03.624887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3e72484-1827-4630-912e-4442cd987af6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:03.811006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:07:04.098519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d3e72484-1827-4630-912e-4442cd987af6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:04.134721 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d3e72484-1827-4630-912e-4442cd987af6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 200 len: 1273 microversion: 2.1 time: 0.568467 Aug 03 02:07:04.148840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5b133c1e-ba1f-4aa9-a281-3b2f462b7519 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:04.155050 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1971/3819] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:03 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 1273 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:07:04.179245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c85eb474-e0b5-4c2e-93d8-c16e4d7376a8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:04.180158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c85eb474-e0b5-4c2e-93d8-c16e4d7376a8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:04.191349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5b133c1e-ba1f-4aa9-a281-3b2f462b7519 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:04.200622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5b133c1e-ba1f-4aa9-a281-3b2f462b7519 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:04.211706 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5b133c1e-ba1f-4aa9-a281-3b2f462b7519 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1661 microversion: 2.42 time: 1.041236 Aug 03 02:07:04.213818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c85eb474-e0b5-4c2e-93d8-c16e4d7376a8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:04.215184 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1849/3820] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:03 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1661 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:04.216213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c85eb474-e0b5-4c2e-93d8-c16e4d7376a8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:04.217582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c85eb474-e0b5-4c2e-93d8-c16e4d7376a8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:04.220412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c85eb474-e0b5-4c2e-93d8-c16e4d7376a8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:05.162832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-62e5f15c-009e-4978-8699-dbcc89b20b63 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:05.163935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-62e5f15c-009e-4978-8699-dbcc89b20b63 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:05.187861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62e5f15c-009e-4978-8699-dbcc89b20b63 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:05.188988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62e5f15c-009e-4978-8699-dbcc89b20b63 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:05.195688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62e5f15c-009e-4978-8699-dbcc89b20b63 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:05.196865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62e5f15c-009e-4978-8699-dbcc89b20b63 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:05.655496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:07:06.047788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c85eb474-e0b5-4c2e-93d8-c16e4d7376a8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:06.095225 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c85eb474-e0b5-4c2e-93d8-c16e4d7376a8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1556 microversion: 2.1 time: 1.937531 Aug 03 02:07:06.107421 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1972/3821] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:04 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1556 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:06.147466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e23c33e8-6168-4d6c-a115-b553f74f53e3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:06.149004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e23c33e8-6168-4d6c-a115-b553f74f53e3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:06.195680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e23c33e8-6168-4d6c-a115-b553f74f53e3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:06.196196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e23c33e8-6168-4d6c-a115-b553f74f53e3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:06.197072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e23c33e8-6168-4d6c-a115-b553f74f53e3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:06.197539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e23c33e8-6168-4d6c-a115-b553f74f53e3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:07.297817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-62e5f15c-009e-4978-8699-dbcc89b20b63 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:07.313853 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-62e5f15c-009e-4978-8699-dbcc89b20b63 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 200 len: 1315 microversion: 2.1 time: 2.155691 Aug 03 02:07:07.315182 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1850/3822] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:05 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 1315 bytes in 2158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:07:07.334012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e23c33e8-6168-4d6c-a115-b553f74f53e3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:07.350677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cbec54e8-e70b-49ab-ad22-b3cf60fe3536 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:07.355919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cbec54e8-e70b-49ab-ad22-b3cf60fe3536 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:07.359303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e23c33e8-6168-4d6c-a115-b553f74f53e3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:07.363751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e23c33e8-6168-4d6c-a115-b553f74f53e3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:07.366980 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e23c33e8-6168-4d6c-a115-b553f74f53e3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1707 microversion: 2.42 time: 1.258165 Aug 03 02:07:07.379011 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1973/3823] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:06 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1707 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:07.382975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cbec54e8-e70b-49ab-ad22-b3cf60fe3536 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:07.387147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cbec54e8-e70b-49ab-ad22-b3cf60fe3536 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:07.389228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cbec54e8-e70b-49ab-ad22-b3cf60fe3536 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:07.390204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cbec54e8-e70b-49ab-ad22-b3cf60fe3536 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:07.724385 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cbec54e8-e70b-49ab-ad22-b3cf60fe3536 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.405723 Aug 03 02:07:07.742500 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1851/3824] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:07:07 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-interface => generated 284 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:08.377242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b6f25cd8-cc38-4087-b50c-179384e36c81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:08.381524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b6f25cd8-cc38-4087-b50c-179384e36c81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:08.401942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6f25cd8-cc38-4087-b50c-179384e36c81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:08.403504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6f25cd8-cc38-4087-b50c-179384e36c81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:08.415545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6989445c-15bd-4977-bdf1-830df69cbbc6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:08.420415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6989445c-15bd-4977-bdf1-830df69cbbc6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:08.421112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6f25cd8-cc38-4087-b50c-179384e36c81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:08.423884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6f25cd8-cc38-4087-b50c-179384e36c81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:08.476154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6989445c-15bd-4977-bdf1-830df69cbbc6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:08.481705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6989445c-15bd-4977-bdf1-830df69cbbc6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:08.485055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6989445c-15bd-4977-bdf1-830df69cbbc6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:08.490816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6989445c-15bd-4977-bdf1-830df69cbbc6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:08.529006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:07:09.238410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6989445c-15bd-4977-bdf1-830df69cbbc6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:09.251517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6989445c-15bd-4977-bdf1-830df69cbbc6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:09.253466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6989445c-15bd-4977-bdf1-830df69cbbc6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:09.254928 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6989445c-15bd-4977-bdf1-830df69cbbc6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1707 microversion: 2.42 time: 0.849158 Aug 03 02:07:09.257302 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1852/3825] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:08 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1707 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:09.262546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-6b663ad2-d95f-4f53-a774-e36791d31b3e req-0adaa965-a4a8-495d-9038-2711cdef57b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4212ab14-d90b-4139-a28f-2b84e43471c2", "tag": "35dc139e-71ae-4a37-9057-4972893be18f"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:09.269668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b6f25cd8-cc38-4087-b50c-179384e36c81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:09.275048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6b663ad2-d95f-4f53-a774-e36791d31b3e req-0adaa965-a4a8-495d-9038-2711cdef57b1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:09.275719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6b663ad2-d95f-4f53-a774-e36791d31b3e req-0adaa965-a4a8-495d-9038-2711cdef57b1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:09.292119 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-6b663ad2-d95f-4f53-a774-e36791d31b3e req-0adaa965-a4a8-495d-9038-2711cdef57b1 service nova] Creating event network-changed:35dc139e-71ae-4a37-9057-4972893be18f for instance 4212ab14-d90b-4139-a28f-2b84e43471c2 on n-h2-826529-8 Aug 03 02:07:09.296015 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b6f25cd8-cc38-4087-b50c-179384e36c81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 200 len: 1315 microversion: 2.1 time: 0.941798 Aug 03 02:07:09.300736 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-6b663ad2-d95f-4f53-a774-e36791d31b3e req-0adaa965-a4a8-495d-9038-2711cdef57b1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041934 Aug 03 02:07:09.300981 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1974/3826] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:08 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 1315 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:09.302810 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1853/3827] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:09.319885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-57ff94b1-03dc-4412-be3e-7d2524421631 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b12327700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:09.388397 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-57ff94b1-03dc-4412-be3e-7d2524421631 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/30e71a1e-0c70-4194-8bb9-1dfcd8230373" status: 200 len: 661 microversion: 2.1 time: 0.082595 Aug 03 02:07:09.401523 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1975/3828] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:07:09 2022] GET /compute/v2.1/images/30e71a1e-0c70-4194-8bb9-1dfcd8230373 => generated 661 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:09.414019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-220544ad-cc34-4f8e-80a0-2543556cd4b4 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b24487d30>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:09.534131 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-220544ad-cc34-4f8e-80a0-2543556cd4b4 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/30e71a1e-0c70-4194-8bb9-1dfcd8230373" status: 200 len: 661 microversion: 2.1 time: 0.125578 Aug 03 02:07:09.547836 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1854/3829] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:07:09 2022] GET /compute/v2.1/images/30e71a1e-0c70-4194-8bb9-1dfcd8230373 => generated 661 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:10.300657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:07:10.319291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-68ed864b-128f-49c8-a609-ad7c5f49de91 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:10.320846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-68ed864b-128f-49c8-a609-ad7c5f49de91 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:10.339054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a4ab1d87-1e48-4673-8063-7d48e4e37d74 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:10.340242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a4ab1d87-1e48-4673-8063-7d48e4e37d74 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:10.356466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68ed864b-128f-49c8-a609-ad7c5f49de91 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:10.358164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68ed864b-128f-49c8-a609-ad7c5f49de91 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:10.358442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4ab1d87-1e48-4673-8063-7d48e4e37d74 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:10.360299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4ab1d87-1e48-4673-8063-7d48e4e37d74 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:10.361451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4ab1d87-1e48-4673-8063-7d48e4e37d74 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:10.361664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68ed864b-128f-49c8-a609-ad7c5f49de91 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:10.362307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68ed864b-128f-49c8-a609-ad7c5f49de91 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:10.363472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4ab1d87-1e48-4673-8063-7d48e4e37d74 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:10.892446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a4ab1d87-1e48-4673-8063-7d48e4e37d74 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:10.908305 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a4ab1d87-1e48-4673-8063-7d48e4e37d74 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 200 len: 1315 microversion: 2.1 time: 0.577400 Aug 03 02:07:10.914557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-68ed864b-128f-49c8-a609-ad7c5f49de91 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:10.923190 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1855/3830] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:10 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:10.938165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-68ed864b-128f-49c8-a609-ad7c5f49de91 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:10.941695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-68ed864b-128f-49c8-a609-ad7c5f49de91 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:10.945851 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-68ed864b-128f-49c8-a609-ad7c5f49de91 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1707 microversion: 2.42 time: 0.649446 Aug 03 02:07:10.964234 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1976/3831] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:10 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1707 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:11.331453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bbd9c4df-0197-44f5-93c2-78862b6fd933 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b1286e4c0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:11.405675 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bbd9c4df-0197-44f5-93c2-78862b6fd933 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/3e6cf1b5-170b-48d6-9a99-ab963281062b" status: 200 len: 662 microversion: 2.1 time: 0.081376 Aug 03 02:07:11.418777 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1856/3832] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:07:11 2022] GET /compute/v2.1/images/3e6cf1b5-170b-48d6-9a99-ab963281062b => generated 662 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:11.425419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a048f009-66ef-474c-96f2-3e44715d5268 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b12327700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:11.502115 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a048f009-66ef-474c-96f2-3e44715d5268 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/3e6cf1b5-170b-48d6-9a99-ab963281062b" status: 200 len: 662 microversion: 2.1 time: 0.079410 Aug 03 02:07:11.503533 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1977/3833] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:07:11 2022] GET /compute/v2.1/images/3e6cf1b5-170b-48d6-9a99-ab963281062b => generated 662 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:11.930929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d90abcf0-4fbd-4fd2-a71c-3e14ca427842 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:11.931728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d90abcf0-4fbd-4fd2-a71c-3e14ca427842 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:11.943394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d90abcf0-4fbd-4fd2-a71c-3e14ca427842 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:11.948236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d90abcf0-4fbd-4fd2-a71c-3e14ca427842 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:11.949231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d90abcf0-4fbd-4fd2-a71c-3e14ca427842 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:11.949689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d90abcf0-4fbd-4fd2-a71c-3e14ca427842 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:11.976834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3523b3b8-aa72-4abc-8f2e-6f4c418eadb8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:11.977780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3523b3b8-aa72-4abc-8f2e-6f4c418eadb8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:12.000836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3523b3b8-aa72-4abc-8f2e-6f4c418eadb8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:12.001574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3523b3b8-aa72-4abc-8f2e-6f4c418eadb8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:12.011189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3523b3b8-aa72-4abc-8f2e-6f4c418eadb8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:12.011651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3523b3b8-aa72-4abc-8f2e-6f4c418eadb8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:13.420139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3523b3b8-aa72-4abc-8f2e-6f4c418eadb8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:13.434884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3523b3b8-aa72-4abc-8f2e-6f4c418eadb8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:13.438079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3523b3b8-aa72-4abc-8f2e-6f4c418eadb8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:13.443749 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3523b3b8-aa72-4abc-8f2e-6f4c418eadb8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1753 microversion: 2.42 time: 1.472819 Aug 03 02:07:13.444884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d90abcf0-4fbd-4fd2-a71c-3e14ca427842 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:13.446475 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1978/3834] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:11 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1753 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:13.468276 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d90abcf0-4fbd-4fd2-a71c-3e14ca427842 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 200 len: 1315 microversion: 2.1 time: 1.541945 Aug 03 02:07:13.482023 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1857/3835] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:11 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 1315 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:13.537235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-15721b1a-5045-4e12-882b-297bf0c9a51b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b123355e0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:13.656065 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-15721b1a-5045-4e12-882b-297bf0c9a51b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/1e4a1fa9-2b8f-4519-adc2-aa70d61ab881" status: 200 len: 662 microversion: 2.1 time: 0.124541 Aug 03 02:07:13.660611 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1979/3836] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:07:13 2022] GET /compute/v2.1/images/1e4a1fa9-2b8f-4519-adc2-aa70d61ab881 => generated 662 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:13.700594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d4636a83-7aa5-4d2b-9269-1d59c589dc80 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b1286e8b0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:13.857742 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d4636a83-7aa5-4d2b-9269-1d59c589dc80 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/1e4a1fa9-2b8f-4519-adc2-aa70d61ab881" status: 200 len: 662 microversion: 2.1 time: 0.165847 Aug 03 02:07:13.862067 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1858/3837] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:07:13 2022] GET /compute/v2.1/images/1e4a1fa9-2b8f-4519-adc2-aa70d61ab881 => generated 662 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:14.204622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1399489430", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:14.289788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-beaa820c-4cfe-4118-96c6-98bcffb76b55 req-3548132e-0cce-4e99-b50c-cc9d136c663f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1ef30e-5b4e-43ac-84ce-2a3a69d77340", "tag": "4d52422a-7324-4649-bc25-a65137f3fd9a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:14.347486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-beaa820c-4cfe-4118-96c6-98bcffb76b55 req-3548132e-0cce-4e99-b50c-cc9d136c663f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:14.351428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-beaa820c-4cfe-4118-96c6-98bcffb76b55 req-3548132e-0cce-4e99-b50c-cc9d136c663f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:14.400321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:07:14.411345 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-beaa820c-4cfe-4118-96c6-98bcffb76b55 req-3548132e-0cce-4e99-b50c-cc9d136c663f service nova] Creating event network-changed:4d52422a-7324-4649-bc25-a65137f3fd9a for instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 on n-h1-826529-8 Aug 03 02:07:14.434735 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-beaa820c-4cfe-4118-96c6-98bcffb76b55 req-3548132e-0cce-4e99-b50c-cc9d136c663f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146417 Aug 03 02:07:14.438800 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1859/3838] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:14.504253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-624051cd-c601-426a-821a-080f9c7d870a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:14.514291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-624051cd-c601-426a-821a-080f9c7d870a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:14.567909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-624051cd-c601-426a-821a-080f9c7d870a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:14.568958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-624051cd-c601-426a-821a-080f9c7d870a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:14.576407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-624051cd-c601-426a-821a-080f9c7d870a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:14.577278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-624051cd-c601-426a-821a-080f9c7d870a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:15.969382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-624051cd-c601-426a-821a-080f9c7d870a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:15.986660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-624051cd-c601-426a-821a-080f9c7d870a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:15.991215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-624051cd-c601-426a-821a-080f9c7d870a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:15.999888 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-624051cd-c601-426a-821a-080f9c7d870a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1799 microversion: 2.42 time: 1.524307 Aug 03 02:07:16.000918 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1860/3839] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:14 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1799 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:07:16.017352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-88b4e055-d569-461d-9300-6b664a1048cf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:16.019180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-88b4e055-d569-461d-9300-6b664a1048cf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:16.050972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88b4e055-d569-461d-9300-6b664a1048cf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:16.051465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88b4e055-d569-461d-9300-6b664a1048cf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:16.052622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88b4e055-d569-461d-9300-6b664a1048cf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:16.053084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88b4e055-d569-461d-9300-6b664a1048cf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:16.569205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:07:16.570148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:07:16.571406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:07:16.572515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:07:16.581748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:07:16.622670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:16.628115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:16.634238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:16.635367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:16.720230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Getting quotas for project acd05a9fbfed458caf63ce7043ed2faa. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:07:16.758481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Getting quotas for user aeb4cc56d87a45209c7d3ec5381e341f and project acd05a9fbfed458caf63ce7043ed2faa. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:07:16.794544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:07:16.797157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 4c93a8f4-a14e-4937-a7bd-641747f3b86b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:07:16.937190 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f4c5ce1a-5992-407e-aaad-1da7f8824ab6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.738379 Aug 03 02:07:16.938079 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1980/3840] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:07:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:07:16.951984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fae965e8-fe14-42d3-a23c-af80793badbb tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:16.959873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fae965e8-fe14-42d3-a23c-af80793badbb tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:17.004342 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fae965e8-fe14-42d3-a23c-af80793badbb tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:17.007494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fae965e8-fe14-42d3-a23c-af80793badbb tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:17.014292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fae965e8-fe14-42d3-a23c-af80793badbb tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:17.019018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fae965e8-fe14-42d3-a23c-af80793badbb tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:17.120781 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fae965e8-fe14-42d3-a23c-af80793badbb tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.181198 Aug 03 02:07:17.134007 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1981/3841] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 3 02:07:16 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406/os-volume_attachments => generated 25 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:17.148692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-95619703-3f30-4753-a96e-893167360d75 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:17.151258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-95619703-3f30-4753-a96e-893167360d75 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:17.164511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95619703-3f30-4753-a96e-893167360d75 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:17.168588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95619703-3f30-4753-a96e-893167360d75 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:17.173700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95619703-3f30-4753-a96e-893167360d75 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:17.177862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95619703-3f30-4753-a96e-893167360d75 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:18.075090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-88b4e055-d569-461d-9300-6b664a1048cf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:18.128530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-95619703-3f30-4753-a96e-893167360d75 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:18.138268 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-88b4e055-d569-461d-9300-6b664a1048cf tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 200 len: 1315 microversion: 2.1 time: 2.108051 Aug 03 02:07:18.139278 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1861/3842] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:16 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 1315 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:18.141628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:07:18.152019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-95619703-3f30-4753-a96e-893167360d75 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:18.158833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-95619703-3f30-4753-a96e-893167360d75 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:18.165234 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-95619703-3f30-4753-a96e-893167360d75 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1845 microversion: 2.42 time: 1.028847 Aug 03 02:07:18.169818 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1982/3843] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:17 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1845 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:18.180434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-47914552", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:18.191385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e8c88277-2d47-427b-b7a6-2cabfe06e3ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:18.191922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e8c88277-2d47-427b-b7a6-2cabfe06e3ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:18.238423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8c88277-2d47-427b-b7a6-2cabfe06e3ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:18.239761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8c88277-2d47-427b-b7a6-2cabfe06e3ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:18.244640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8c88277-2d47-427b-b7a6-2cabfe06e3ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:18.245482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8c88277-2d47-427b-b7a6-2cabfe06e3ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:18.283571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:07:18.341861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e8c88277-2d47-427b-b7a6-2cabfe06e3ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:07:18.547571 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e8c88277-2d47-427b-b7a6-2cabfe06e3ea tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 204 len: 0 microversion: 2.20 time: 0.405142 Aug 03 02:07:18.553465 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1862/3844] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:07:18 2022] DELETE /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 02:07:18.561994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-aeb1623d-9f54-411f-800a-bc28e6ebb18e req-5215bae1-4c46-4ee7-b96d-e0e425c1bfe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4212ab14-d90b-4139-a28f-2b84e43471c2", "name": "network-vif-plugged", "status": "completed", "tag": "35dc139e-71ae-4a37-9057-4972893be18f"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:18.574787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-aeb1623d-9f54-411f-800a-bc28e6ebb18e req-5215bae1-4c46-4ee7-b96d-e0e425c1bfe7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:18.575823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-aeb1623d-9f54-411f-800a-bc28e6ebb18e req-5215bae1-4c46-4ee7-b96d-e0e425c1bfe7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:18.592880 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-aeb1623d-9f54-411f-800a-bc28e6ebb18e req-5215bae1-4c46-4ee7-b96d-e0e425c1bfe7 service nova] Creating event network-vif-plugged:35dc139e-71ae-4a37-9057-4972893be18f for instance 4212ab14-d90b-4139-a28f-2b84e43471c2 on n-h2-826529-8 Aug 03 02:07:18.601660 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-aeb1623d-9f54-411f-800a-bc28e6ebb18e req-5215bae1-4c46-4ee7-b96d-e0e425c1bfe7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045845 Aug 03 02:07:18.602696 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1863/3845] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:18.627189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d81ebcdb-a01b-4529-a0bb-c85fc05d5924 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:18.637332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d81ebcdb-a01b-4529-a0bb-c85fc05d5924 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:18.675101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d81ebcdb-a01b-4529-a0bb-c85fc05d5924 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:18.687141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d81ebcdb-a01b-4529-a0bb-c85fc05d5924 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:18.694728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d81ebcdb-a01b-4529-a0bb-c85fc05d5924 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:18.696556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d81ebcdb-a01b-4529-a0bb-c85fc05d5924 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:19.477776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d81ebcdb-a01b-4529-a0bb-c85fc05d5924 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:19.495123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d81ebcdb-a01b-4529-a0bb-c85fc05d5924 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:19.498823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d81ebcdb-a01b-4529-a0bb-c85fc05d5924 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:19.501627 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d81ebcdb-a01b-4529-a0bb-c85fc05d5924 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1723 microversion: 2.20 time: 0.897009 Aug 03 02:07:19.503347 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1864/3846] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:18 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1723 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:19.521536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c625b4bf-aa97-441d-9d4b-7590adcf2c70 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:19.523167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c625b4bf-aa97-441d-9d4b-7590adcf2c70 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:19.536813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c625b4bf-aa97-441d-9d4b-7590adcf2c70 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:19.537992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c625b4bf-aa97-441d-9d4b-7590adcf2c70 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:19.541303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c625b4bf-aa97-441d-9d4b-7590adcf2c70 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:19.542646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c625b4bf-aa97-441d-9d4b-7590adcf2c70 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:20.221978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:07:20.222566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:07:20.222881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:07:20.223343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:07:20.223902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:07:20.239841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:20.241384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:20.255574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:20.256402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:20.297805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Getting quotas for project acd05a9fbfed458caf63ce7043ed2faa. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:07:20.308547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Getting quotas for user aeb4cc56d87a45209c7d3ec5381e341f and project acd05a9fbfed458caf63ce7043ed2faa. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:07:20.354101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:07:20.359218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:07:20.437986 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b772885c-dc53-41b1-8f38-7e8a19752501 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.266408 Aug 03 02:07:20.438659 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1983/3847] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:07:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:07:20.448659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c625b4bf-aa97-441d-9d4b-7590adcf2c70 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:20.473014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-b34dc56d-d21b-4afb-971e-e7fdc29db4e8 req-68dd96ce-cefa-4655-92d5-584d4ad2373c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "tag": "8cbd61f7-4c8d-4411-9cf8-c16e2c78580e"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:20.481839 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c625b4bf-aa97-441d-9d4b-7590adcf2c70 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 200 len: 1315 microversion: 2.1 time: 0.976802 Aug 03 02:07:20.488072 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1865/3848] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:19 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 1315 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:20.506177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-61fe4262-7239-4957-91a8-b6fe212d9e6c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:20.530687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-61fe4262-7239-4957-91a8-b6fe212d9e6c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:20.539224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b34dc56d-d21b-4afb-971e-e7fdc29db4e8 req-68dd96ce-cefa-4655-92d5-584d4ad2373c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:20.539687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b34dc56d-d21b-4afb-971e-e7fdc29db4e8 req-68dd96ce-cefa-4655-92d5-584d4ad2373c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:20.568116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61fe4262-7239-4957-91a8-b6fe212d9e6c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:20.568908 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61fe4262-7239-4957-91a8-b6fe212d9e6c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:20.569753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61fe4262-7239-4957-91a8-b6fe212d9e6c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:20.570217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61fe4262-7239-4957-91a8-b6fe212d9e6c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:20.585312 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-b34dc56d-d21b-4afb-971e-e7fdc29db4e8 req-68dd96ce-cefa-4655-92d5-584d4ad2373c service nova] Creating event network-changed:8cbd61f7-4c8d-4411-9cf8-c16e2c78580e for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:07:20.606563 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-b34dc56d-d21b-4afb-971e-e7fdc29db4e8 req-68dd96ce-cefa-4655-92d5-584d4ad2373c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151651 Aug 03 02:07:20.615789 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1984/3849] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:20.623151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bc1b80c0-05c9-4d56-b3c8-00f0ab00d0ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:20.639539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bc1b80c0-05c9-4d56-b3c8-00f0ab00d0ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:20.668171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc1b80c0-05c9-4d56-b3c8-00f0ab00d0ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:20.674873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc1b80c0-05c9-4d56-b3c8-00f0ab00d0ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:20.677713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc1b80c0-05c9-4d56-b3c8-00f0ab00d0ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:20.683625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc1b80c0-05c9-4d56-b3c8-00f0ab00d0ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:21.342530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bc1b80c0-05c9-4d56-b3c8-00f0ab00d0ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:21.392052 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bc1b80c0-05c9-4d56-b3c8-00f0ab00d0ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.774545 Aug 03 02:07:21.396808 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1985/3850] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:20 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:21.404725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d21060d0-b7e4-486e-bb63-91fcdeb8b201 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:21.405355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d21060d0-b7e4-486e-bb63-91fcdeb8b201 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:21.799168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d21060d0-b7e4-486e-bb63-91fcdeb8b201 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:21.818777 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d21060d0-b7e4-486e-bb63-91fcdeb8b201 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1216 microversion: 2.1 time: 0.414142 Aug 03 02:07:21.819895 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1986/3851] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:21 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1216 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:21.830277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6b805af5-b9ce-49e7-a74f-2ccefb84ab55 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:21.830563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6b805af5-b9ce-49e7-a74f-2ccefb84ab55 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:21.860188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b805af5-b9ce-49e7-a74f-2ccefb84ab55 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:21.860818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b805af5-b9ce-49e7-a74f-2ccefb84ab55 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:21.861913 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b805af5-b9ce-49e7-a74f-2ccefb84ab55 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:21.862465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b805af5-b9ce-49e7-a74f-2ccefb84ab55 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:22.487612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-61fe4262-7239-4957-91a8-b6fe212d9e6c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:22.528577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-61fe4262-7239-4957-91a8-b6fe212d9e6c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:22.538414 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-61fe4262-7239-4957-91a8-b6fe212d9e6c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:22.544312 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-61fe4262-7239-4957-91a8-b6fe212d9e6c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1866 microversion: 2.42 time: 2.050882 Aug 03 02:07:22.547022 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1866/3852] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:20 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1866 bytes in 2057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:22.566173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a67e3fea-ff5e-4b9a-bd86-7d5fef795f68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:22.567646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a67e3fea-ff5e-4b9a-bd86-7d5fef795f68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:22.602287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a67e3fea-ff5e-4b9a-bd86-7d5fef795f68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:22.603347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a67e3fea-ff5e-4b9a-bd86-7d5fef795f68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:22.604541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a67e3fea-ff5e-4b9a-bd86-7d5fef795f68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:22.605410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a67e3fea-ff5e-4b9a-bd86-7d5fef795f68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:22.622940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:07:22.740536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6b805af5-b9ce-49e7-a74f-2ccefb84ab55 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:22.764627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6b805af5-b9ce-49e7-a74f-2ccefb84ab55 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:22.773587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6b805af5-b9ce-49e7-a74f-2ccefb84ab55 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:22.777717 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6b805af5-b9ce-49e7-a74f-2ccefb84ab55 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1723 microversion: 2.20 time: 0.956589 Aug 03 02:07:22.784608 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1987/3853] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:21 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1723 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:22.801229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-130d25a4-d0d0-46c5-a3e6-7f3198643bf8 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:22.807681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-130d25a4-d0d0-46c5-a3e6-7f3198643bf8 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:22.835029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-130d25a4-d0d0-46c5-a3e6-7f3198643bf8 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:22.843385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-130d25a4-d0d0-46c5-a3e6-7f3198643bf8 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:22.844466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-130d25a4-d0d0-46c5-a3e6-7f3198643bf8 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:22.847270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-130d25a4-d0d0-46c5-a3e6-7f3198643bf8 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:24.147003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a67e3fea-ff5e-4b9a-bd86-7d5fef795f68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:24.168905 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a67e3fea-ff5e-4b9a-bd86-7d5fef795f68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 1.619672 Aug 03 02:07:24.170323 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1867/3854] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:22 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:24.180084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6c9a99f0-15a8-461d-bf9a-072b5fcb6636 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:24.181415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6c9a99f0-15a8-461d-bf9a-072b5fcb6636 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:24.195685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c9a99f0-15a8-461d-bf9a-072b5fcb6636 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:24.196280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c9a99f0-15a8-461d-bf9a-072b5fcb6636 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:24.199121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c9a99f0-15a8-461d-bf9a-072b5fcb6636 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:24.200492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c9a99f0-15a8-461d-bf9a-072b5fcb6636 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:24.894270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-130d25a4-d0d0-46c5-a3e6-7f3198643bf8 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:24.896189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6c9a99f0-15a8-461d-bf9a-072b5fcb6636 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:24.908615 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-130d25a4-d0d0-46c5-a3e6-7f3198643bf8 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 200 len: 1503 microversion: 2.1 time: 2.120080 Aug 03 02:07:24.909564 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1988/3855] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:22 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 1503 bytes in 2123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:24.927164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-38138925-d70d-43cd-9d05-bd9f062eb67b req-57ab5c3e-ba56-44bd-93a9-0448c7bc613c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "tag": "cce1ca4d-a384-4a7c-bc85-f44f966690b5"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:24.932085 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6c9a99f0-15a8-461d-bf9a-072b5fcb6636 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1274 microversion: 2.1 time: 0.757192 Aug 03 02:07:24.934536 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1868/3856] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:24 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1274 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:24.962209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-38138925-d70d-43cd-9d05-bd9f062eb67b req-57ab5c3e-ba56-44bd-93a9-0448c7bc613c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:24.963013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-38138925-d70d-43cd-9d05-bd9f062eb67b req-57ab5c3e-ba56-44bd-93a9-0448c7bc613c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:24.976722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-23274ace-5645-42d4-a599-0353f578a545 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:24.979386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-23274ace-5645-42d4-a599-0353f578a545 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:24.997643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23274ace-5645-42d4-a599-0353f578a545 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:25.003382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23274ace-5645-42d4-a599-0353f578a545 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:25.003707 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-38138925-d70d-43cd-9d05-bd9f062eb67b req-57ab5c3e-ba56-44bd-93a9-0448c7bc613c service nova] Creating event network-changed:cce1ca4d-a384-4a7c-bc85-f44f966690b5 for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:07:25.009446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23274ace-5645-42d4-a599-0353f578a545 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:25.010317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23274ace-5645-42d4-a599-0353f578a545 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:25.017285 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-38138925-d70d-43cd-9d05-bd9f062eb67b req-57ab5c3e-ba56-44bd-93a9-0448c7bc613c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106197 Aug 03 02:07:25.029827 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1989/3857] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:25.045051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-87cb9805-fa36-41dc-a164-6909d8231467 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:25.060956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-87cb9805-fa36-41dc-a164-6909d8231467 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:25.084320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87cb9805-fa36-41dc-a164-6909d8231467 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:25.085097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87cb9805-fa36-41dc-a164-6909d8231467 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:25.086397 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87cb9805-fa36-41dc-a164-6909d8231467 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:25.087041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87cb9805-fa36-41dc-a164-6909d8231467 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:26.363366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-87cb9805-fa36-41dc-a164-6909d8231467 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:26.380680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-87cb9805-fa36-41dc-a164-6909d8231467 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:26.382268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-87cb9805-fa36-41dc-a164-6909d8231467 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:26.383654 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-87cb9805-fa36-41dc-a164-6909d8231467 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1656 microversion: 2.20 time: 1.351899 Aug 03 02:07:26.384317 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1990/3858] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:25 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1656 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:26.410153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e5c2515d-de1a-4db7-bf02-cb07d00c1bfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:26.419078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e5c2515d-de1a-4db7-bf02-cb07d00c1bfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:26.440333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e5c2515d-de1a-4db7-bf02-cb07d00c1bfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:26.440925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e5c2515d-de1a-4db7-bf02-cb07d00c1bfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:26.441886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e5c2515d-de1a-4db7-bf02-cb07d00c1bfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:26.443535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e5c2515d-de1a-4db7-bf02-cb07d00c1bfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:26.923740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-23274ace-5645-42d4-a599-0353f578a545 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:26.946421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-23274ace-5645-42d4-a599-0353f578a545 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:26.950059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-23274ace-5645-42d4-a599-0353f578a545 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:26.952750 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-23274ace-5645-42d4-a599-0353f578a545 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1887 microversion: 2.42 time: 2.010628 Aug 03 02:07:26.953335 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1869/3859] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:24 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1887 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:26.971659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-94eae0c1-5de1-4293-a326-b8bd6c7a4c08 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:26.972580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-94eae0c1-5de1-4293-a326-b8bd6c7a4c08 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:26.992612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:07:26.995416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94eae0c1-5de1-4293-a326-b8bd6c7a4c08 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:26.996861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94eae0c1-5de1-4293-a326-b8bd6c7a4c08 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:26.997228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94eae0c1-5de1-4293-a326-b8bd6c7a4c08 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:26.997859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94eae0c1-5de1-4293-a326-b8bd6c7a4c08 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:27.074894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-94eae0c1-5de1-4293-a326-b8bd6c7a4c08 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lazy-loading 'flavor' on Instance uuid 4212ab14-d90b-4139-a28f-2b84e43471c2 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:07:27.222537 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-94eae0c1-5de1-4293-a326-b8bd6c7a4c08 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "POST /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2/action" status: 202 len: 0 microversion: 2.1 time: 0.263639 Aug 03 02:07:27.228959 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1870/3860] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:07:26 2022] POST /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:07:27.244888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9f2c0132-bb65-4784-bc40-f788264ec182 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:27.245651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9f2c0132-bb65-4784-bc40-f788264ec182 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:27.260616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f2c0132-bb65-4784-bc40-f788264ec182 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:27.261995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f2c0132-bb65-4784-bc40-f788264ec182 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:27.264131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f2c0132-bb65-4784-bc40-f788264ec182 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:27.265278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f2c0132-bb65-4784-bc40-f788264ec182 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:27.642153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9f2c0132-bb65-4784-bc40-f788264ec182 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:27.653720 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9f2c0132-bb65-4784-bc40-f788264ec182 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1274 microversion: 2.1 time: 0.423230 Aug 03 02:07:27.656133 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1871/3861] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:27 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1274 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:27.666379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-c117b698-d948-497b-9932-53c12cd85cb8 req-31db3c4a-51c9-4d71-8815-f460072f7445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "tag": "fc6e33cc-8065-4dce-baf6-a0eed37f7c52"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:27.686177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c117b698-d948-497b-9932-53c12cd85cb8 req-31db3c4a-51c9-4d71-8815-f460072f7445 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:27.687909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c117b698-d948-497b-9932-53c12cd85cb8 req-31db3c4a-51c9-4d71-8815-f460072f7445 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:27.719814 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c117b698-d948-497b-9932-53c12cd85cb8 req-31db3c4a-51c9-4d71-8815-f460072f7445 service nova] Creating event network-changed:fc6e33cc-8065-4dce-baf6-a0eed37f7c52 for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:07:27.732991 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-c117b698-d948-497b-9932-53c12cd85cb8 req-31db3c4a-51c9-4d71-8815-f460072f7445 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074455 Aug 03 02:07:27.740126 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1872/3862] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:27.750107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-529e8e36-22c8-47da-883e-ca6a371dfdb7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:27.751508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-529e8e36-22c8-47da-883e-ca6a371dfdb7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:27.766473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-529e8e36-22c8-47da-883e-ca6a371dfdb7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:27.767781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-529e8e36-22c8-47da-883e-ca6a371dfdb7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:27.768794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-529e8e36-22c8-47da-883e-ca6a371dfdb7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:27.769883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-529e8e36-22c8-47da-883e-ca6a371dfdb7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:28.070990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e5c2515d-de1a-4db7-bf02-cb07d00c1bfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:28.096240 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e5c2515d-de1a-4db7-bf02-cb07d00c1bfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 1.690057 Aug 03 02:07:28.097611 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1991/3863] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:26 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:28.118525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e3041edf-f6fc-444f-9e48-b5331fee1a64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:28.119541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e3041edf-f6fc-444f-9e48-b5331fee1a64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:28.134615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3041edf-f6fc-444f-9e48-b5331fee1a64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:28.135653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3041edf-f6fc-444f-9e48-b5331fee1a64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:28.137713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3041edf-f6fc-444f-9e48-b5331fee1a64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:28.138463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3041edf-f6fc-444f-9e48-b5331fee1a64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:28.323271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3041edf-f6fc-444f-9e48-b5331fee1a64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:28.365793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3041edf-f6fc-444f-9e48-b5331fee1a64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:28.367354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3041edf-f6fc-444f-9e48-b5331fee1a64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81ae7aa9aed7440a8bdfd4595eae3be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9907ef20b17f42acb99a8b61502f29a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:28.368572 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e3041edf-f6fc-444f-9e48-b5331fee1a64 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 200 len: 1656 microversion: 2.20 time: 0.266899 Aug 03 02:07:28.379561 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1992/3864] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:28 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 1656 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:28.387941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-22e240ce-7b5c-48dd-8c18-4ae4fafae53d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:28.388656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-22e240ce-7b5c-48dd-8c18-4ae4fafae53d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:28.398632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22e240ce-7b5c-48dd-8c18-4ae4fafae53d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:28.399399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22e240ce-7b5c-48dd-8c18-4ae4fafae53d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:28.400519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22e240ce-7b5c-48dd-8c18-4ae4fafae53d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:28.401145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22e240ce-7b5c-48dd-8c18-4ae4fafae53d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:28.792896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-529e8e36-22c8-47da-883e-ca6a371dfdb7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:28.814855 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-529e8e36-22c8-47da-883e-ca6a371dfdb7 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 200 len: 1511 microversion: 2.1 time: 1.069335 Aug 03 02:07:28.816603 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1873/3865] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:27 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 1511 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:28.846859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9fb76f78-4513-42d6-80ed-f16b4cd69396 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1668489573"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:28.870950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9fb76f78-4513-42d6-80ed-f16b4cd69396 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:28.897826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fb76f78-4513-42d6-80ed-f16b4cd69396 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:28.898297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fb76f78-4513-42d6-80ed-f16b4cd69396 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:28.899140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fb76f78-4513-42d6-80ed-f16b4cd69396 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:28.907716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fb76f78-4513-42d6-80ed-f16b4cd69396 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:29.462396 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9fb76f78-4513-42d6-80ed-f16b4cd69396 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.635608 Aug 03 02:07:29.464555 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1874/3866] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:07:28 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 03 02:07:29.519555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-64953661-2449-40f2-83d8-86375bec8c80 req-6ef0d9e2-b46d-4f5c-a617-d557d92a0690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ce11775-ab73-457e-8799-239915dc2406", "name": "network-vif-deleted", "tag": "12c644d8-021b-4605-8e3c-16ff33d29cd1"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:29.564290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-64953661-2449-40f2-83d8-86375bec8c80 req-6ef0d9e2-b46d-4f5c-a617-d557d92a0690 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:29.565204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-64953661-2449-40f2-83d8-86375bec8c80 req-6ef0d9e2-b46d-4f5c-a617-d557d92a0690 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:29.610829 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-64953661-2449-40f2-83d8-86375bec8c80 req-6ef0d9e2-b46d-4f5c-a617-d557d92a0690 service nova] Creating event network-vif-deleted:12c644d8-021b-4605-8e3c-16ff33d29cd1 for instance 9ce11775-ab73-457e-8799-239915dc2406 on n-h1-826529-8 Aug 03 02:07:29.634557 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-64953661-2449-40f2-83d8-86375bec8c80 req-6ef0d9e2-b46d-4f5c-a617-d557d92a0690 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165182 Aug 03 02:07:29.645109 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1875/3867] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:29.655272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-46d5ce86-c5de-4c3c-bf6e-f0affdb10aee tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:29.656591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-46d5ce86-c5de-4c3c-bf6e-f0affdb10aee tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:29.705844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46d5ce86-c5de-4c3c-bf6e-f0affdb10aee tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:29.707707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46d5ce86-c5de-4c3c-bf6e-f0affdb10aee tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:29.708782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46d5ce86-c5de-4c3c-bf6e-f0affdb10aee tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:29.719287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46d5ce86-c5de-4c3c-bf6e-f0affdb10aee tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:29.904241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-22e240ce-7b5c-48dd-8c18-4ae4fafae53d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:29.929329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-22e240ce-7b5c-48dd-8c18-4ae4fafae53d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:29.930942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-22e240ce-7b5c-48dd-8c18-4ae4fafae53d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:29.939883 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-22e240ce-7b5c-48dd-8c18-4ae4fafae53d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1887 microversion: 2.42 time: 1.558131 Aug 03 02:07:29.944108 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1993/3868] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:28 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1887 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:29.949924 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a9b93492-e2c8-4478-8f02-ed6a111b8b84 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:29.950731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a9b93492-e2c8-4478-8f02-ed6a111b8b84 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:29.952973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:07:29.966818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9b93492-e2c8-4478-8f02-ed6a111b8b84 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:29.969588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9b93492-e2c8-4478-8f02-ed6a111b8b84 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:29.970842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9b93492-e2c8-4478-8f02-ed6a111b8b84 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:29.978939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9b93492-e2c8-4478-8f02-ed6a111b8b84 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:30.024388 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-a9b93492-e2c8-4478-8f02-ed6a111b8b84 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] HTTP exception thrown: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a9b93492-e2c8-4478-8f02-ed6a111b8b84 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Request method failure captured: Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 HTTP/1.1 Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dZfxZiFPysNXB16bIkMZ-7Cn3Km1a9HAWIfreNeUgh28J492cbxEOoO45TNvWVYIjM_-kJI7qB8Rjq_YL9i6dck-QJkcpmdKs-lu8MY59NuRi9m1ThcgH_s-Z12NV8EyT03_1vhmc7B6Kd_fnAY-0bH5gEh-wmfO4V_HDSUxJngFvE Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9907ef20b17f42acb99a8b61502f29a3 Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9907ef20b17f42acb99a8b61502f29a3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9907ef20b17f42acb99a8b61502f29a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9907ef20b17f42acb99a8b61502f29a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9907ef20b17f42acb99a8b61502f29a3"}]}] Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9907ef20b17f42acb99a8b61502f29a3 Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeShelveTestJSON-2134656059-project Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 81ae7aa9aed7440a8bdfd4595eae3be8 Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2134656059-project Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '9ce11775-ab73-457e-8799-239915dc2406'} Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:30.026418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:30.031947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:30.031947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:30.031947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:30.031947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:30.031947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:30.031947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:30.031947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. Aug 03 02:07:30.031947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:30.033383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a9b93492-e2c8-4478-8f02-ed6a111b8b84 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Returning 404 to user: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:30.034420 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a9b93492-e2c8-4478-8f02-ed6a111b8b84 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 404 len: 111 microversion: 2.20 time: 0.088681 Aug 03 02:07:30.041106 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1994/3869] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:29 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:07:30.051791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9acb0c4d-dbdd-42a5-b5f2-ffbdb560db81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:30.055763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9acb0c4d-dbdd-42a5-b5f2-ffbdb560db81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:30.064485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9acb0c4d-dbdd-42a5-b5f2-ffbdb560db81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:30.065298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9acb0c4d-dbdd-42a5-b5f2-ffbdb560db81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:30.066561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9acb0c4d-dbdd-42a5-b5f2-ffbdb560db81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:30.068822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9acb0c4d-dbdd-42a5-b5f2-ffbdb560db81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:30.279539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:07:31.441698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9acb0c4d-dbdd-42a5-b5f2-ffbdb560db81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:31.456749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-46d5ce86-c5de-4c3c-bf6e-f0affdb10aee tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:31.463007 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9acb0c4d-dbdd-42a5-b5f2-ffbdb560db81 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 200 len: 1494 microversion: 2.1 time: 1.420132 Aug 03 02:07:31.474774 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-46d5ce86-c5de-4c3c-bf6e-f0affdb10aee tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1316 microversion: 2.1 time: 1.827021 Aug 03 02:07:31.476192 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1995/3870] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:30 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 1494 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:31.483073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-fa21f7c8-2402-4e80-90e8-c8e7fad5fb68 req-05b10dee-9851-4f92-a79f-29e19d72f1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "tag": "dd896678-ab80-49e5-8344-6b05edfc5dd4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:31.487511 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1876/3871] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:29 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1316 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:31.513956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-fa21f7c8-2402-4e80-90e8-c8e7fad5fb68 req-05b10dee-9851-4f92-a79f-29e19d72f1b0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:31.514845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4f8990cf-7192-417e-b2a1-46bebbc4cd12 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '.version_select at 0x7f5b12a5a1f0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:31.515158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-fa21f7c8-2402-4e80-90e8-c8e7fad5fb68 req-05b10dee-9851-4f92-a79f-29e19d72f1b0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:31.548521 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-fa21f7c8-2402-4e80-90e8-c8e7fad5fb68 req-05b10dee-9851-4f92-a79f-29e19d72f1b0 service nova] Creating event network-changed:dd896678-ab80-49e5-8344-6b05edfc5dd4 for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:07:31.557200 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-fa21f7c8-2402-4e80-90e8-c8e7fad5fb68 req-05b10dee-9851-4f92-a79f-29e19d72f1b0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078831 Aug 03 02:07:31.562461 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1996/3872] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:31.564137 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4f8990cf-7192-417e-b2a1-46bebbc4cd12 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2130768673" status: 204 len: 0 microversion: 2.20 time: 0.074112 Aug 03 02:07:31.564895 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1877/3873] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 3 02:07:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2130768673 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 02:07:31.578643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2d602468-968d-4617-a1df-36e210aae871 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:31.579713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e53a27bc-9f52-48b4-85b3-7e1c782b81a3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:31.580345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2d602468-968d-4617-a1df-36e210aae871 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:31.580954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e53a27bc-9f52-48b4-85b3-7e1c782b81a3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:31.597589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e53a27bc-9f52-48b4-85b3-7e1c782b81a3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:31.599830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e53a27bc-9f52-48b4-85b3-7e1c782b81a3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:31.600997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e53a27bc-9f52-48b4-85b3-7e1c782b81a3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:31.601740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e53a27bc-9f52-48b4-85b3-7e1c782b81a3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:31.604800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d602468-968d-4617-a1df-36e210aae871 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:31.605596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d602468-968d-4617-a1df-36e210aae871 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:31.606955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d602468-968d-4617-a1df-36e210aae871 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:31.607717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d602468-968d-4617-a1df-36e210aae871 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:31.699167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2d602468-968d-4617-a1df-36e210aae871 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:07:31.811881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=14 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:07:31.873504 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2d602468-968d-4617-a1df-36e210aae871 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 204 len: 0 microversion: 2.1 time: 0.302867 Aug 03 02:07:31.874434 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1878/3874] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:07:31 2022] DELETE /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:07:31.888220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aa8e2def-439a-4ebe-8bb5-42848e04d53a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:31.889171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-aa8e2def-439a-4ebe-8bb5-42848e04d53a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:31.898003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa8e2def-439a-4ebe-8bb5-42848e04d53a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:31.898478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa8e2def-439a-4ebe-8bb5-42848e04d53a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:31.899434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa8e2def-439a-4ebe-8bb5-42848e04d53a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:31.900052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa8e2def-439a-4ebe-8bb5-42848e04d53a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:32.853320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e53a27bc-9f52-48b4-85b3-7e1c782b81a3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:32.899665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e53a27bc-9f52-48b4-85b3-7e1c782b81a3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:32.902610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e53a27bc-9f52-48b4-85b3-7e1c782b81a3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:32.904458 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e53a27bc-9f52-48b4-85b3-7e1c782b81a3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1887 microversion: 2.42 time: 1.340426 Aug 03 02:07:32.905872 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1997/3875] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:31 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1887 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:32.924216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eed16a2d-a4c6-4ee5-b380-f51917da5a36 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:32.925279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eed16a2d-a4c6-4ee5-b380-f51917da5a36 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:32.935237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed16a2d-a4c6-4ee5-b380-f51917da5a36 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:32.936280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed16a2d-a4c6-4ee5-b380-f51917da5a36 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:32.937444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed16a2d-a4c6-4ee5-b380-f51917da5a36 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:32.938808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed16a2d-a4c6-4ee5-b380-f51917da5a36 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:33.120598 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-aa8e2def-439a-4ebe-8bb5-42848e04d53a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:33.145457 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aa8e2def-439a-4ebe-8bb5-42848e04d53a tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 200 len: 1500 microversion: 2.1 time: 1.265161 Aug 03 02:07:33.147566 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1879/3876] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:31 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 1500 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:07:33.326645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-eed16a2d-a4c6-4ee5-b380-f51917da5a36 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:33.341677 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eed16a2d-a4c6-4ee5-b380-f51917da5a36 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1316 microversion: 2.1 time: 0.434304 Aug 03 02:07:33.342404 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1998/3877] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:32 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1316 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:33.376951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-09eaed29-782b-41f5-b438-d6de254b3e19 req-a1e2ed3a-ab20-4327-be5d-c1d9d298fe65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ead359f-4427-4285-9677-d3cac524d8b2", "tag": "4d3985fb-3a8f-49e3-b887-095a18ea295a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:33.390360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-09eaed29-782b-41f5-b438-d6de254b3e19 req-a1e2ed3a-ab20-4327-be5d-c1d9d298fe65 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:33.396022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-09eaed29-782b-41f5-b438-d6de254b3e19 req-a1e2ed3a-ab20-4327-be5d-c1d9d298fe65 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:33.421729 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-09eaed29-782b-41f5-b438-d6de254b3e19 req-a1e2ed3a-ab20-4327-be5d-c1d9d298fe65 service nova] Creating event network-changed:4d3985fb-3a8f-49e3-b887-095a18ea295a for instance 7ead359f-4427-4285-9677-d3cac524d8b2 on n-h2-826529-8 Aug 03 02:07:33.433935 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-09eaed29-782b-41f5-b438-d6de254b3e19 req-a1e2ed3a-ab20-4327-be5d-c1d9d298fe65 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060828 Aug 03 02:07:33.435193 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1880/3878] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:33.946855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-784694d3-e4cf-42ef-8b0c-345191c0eb4b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:33.947563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-784694d3-e4cf-42ef-8b0c-345191c0eb4b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:33.969925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-784694d3-e4cf-42ef-8b0c-345191c0eb4b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:33.971337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-784694d3-e4cf-42ef-8b0c-345191c0eb4b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:33.981497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-784694d3-e4cf-42ef-8b0c-345191c0eb4b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:33.983154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-784694d3-e4cf-42ef-8b0c-345191c0eb4b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:34.169782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7a28db50-c54a-4b80-b5d7-d7cd9740fd5d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:34.170515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7a28db50-c54a-4b80-b5d7-d7cd9740fd5d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:34.177684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a28db50-c54a-4b80-b5d7-d7cd9740fd5d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:34.178184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a28db50-c54a-4b80-b5d7-d7cd9740fd5d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:34.179045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a28db50-c54a-4b80-b5d7-d7cd9740fd5d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:34.179757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a28db50-c54a-4b80-b5d7-d7cd9740fd5d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:36.245951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-784694d3-e4cf-42ef-8b0c-345191c0eb4b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:36.265168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-784694d3-e4cf-42ef-8b0c-345191c0eb4b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:36.275006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-784694d3-e4cf-42ef-8b0c-345191c0eb4b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:36.280303 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-784694d3-e4cf-42ef-8b0c-345191c0eb4b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 2.338915 Aug 03 02:07:36.300210 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 1999/3879] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:33 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 2355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:36.308897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-455c4edf-2ae4-45a5-805a-d588829850ec req-1d1c4948-c5df-475d-a0b1-868d6230e3cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c93a8f4-a14e-4937-a7bd-641747f3b86b", "tag": "a63917f9-9c39-45f8-a71c-b65c4056617d"}, {"name": "network-changed", "server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "tag": "cd112bb2-d68e-45f9-8740-1a2cdf18bce8"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:36.338311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-455c4edf-2ae4-45a5-805a-d588829850ec req-1d1c4948-c5df-475d-a0b1-868d6230e3cb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:36.338989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-455c4edf-2ae4-45a5-805a-d588829850ec req-1d1c4948-c5df-475d-a0b1-868d6230e3cb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:36.376823 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-455c4edf-2ae4-45a5-805a-d588829850ec req-1d1c4948-c5df-475d-a0b1-868d6230e3cb service nova] Creating event network-changed:a63917f9-9c39-45f8-a71c-b65c4056617d for instance 4c93a8f4-a14e-4937-a7bd-641747f3b86b on n-h1-826529-8 Aug 03 02:07:36.377809 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-455c4edf-2ae4-45a5-805a-d588829850ec req-1d1c4948-c5df-475d-a0b1-868d6230e3cb service nova] Creating event network-changed:cd112bb2-d68e-45f9-8740-1a2cdf18bce8 for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:07:36.394113 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-455c4edf-2ae4-45a5-805a-d588829850ec req-1d1c4948-c5df-475d-a0b1-868d6230e3cb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.091622 Aug 03 02:07:36.394713 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2000/3880] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:36.417743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f111c51e-ff61-4f95-92e7-4062042b046c tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:36.418788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f111c51e-ff61-4f95-92e7-4062042b046c tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:36.427313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f111c51e-ff61-4f95-92e7-4062042b046c tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:36.430107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f111c51e-ff61-4f95-92e7-4062042b046c tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:36.432960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f111c51e-ff61-4f95-92e7-4062042b046c tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:36.433607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f111c51e-ff61-4f95-92e7-4062042b046c tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:36.858382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7a28db50-c54a-4b80-b5d7-d7cd9740fd5d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc56b77862f410d82c8617f3d679775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1d9f8216e4f729a5e24aad713fe98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:36.887572 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7a28db50-c54a-4b80-b5d7-d7cd9740fd5d tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 200 len: 1500 microversion: 2.1 time: 2.718847 Aug 03 02:07:36.893485 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1881/3881] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:34 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 1500 bytes in 2730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:07:37.073911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f111c51e-ff61-4f95-92e7-4062042b046c tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:37.083500 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f111c51e-ff61-4f95-92e7-4062042b046c tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1316 microversion: 2.1 time: 0.682904 Aug 03 02:07:37.088664 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2001/3882] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:36 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1316 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:37.310547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-786d571c-7dc7-4198-bac7-01a6b8d2664e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:37.311933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-786d571c-7dc7-4198-bac7-01a6b8d2664e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:37.325766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-786d571c-7dc7-4198-bac7-01a6b8d2664e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:37.327750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-786d571c-7dc7-4198-bac7-01a6b8d2664e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:37.328736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-786d571c-7dc7-4198-bac7-01a6b8d2664e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:37.331085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-786d571c-7dc7-4198-bac7-01a6b8d2664e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:37.547351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-33b43175-b555-44ea-8736-e2d929e782a2 tempest-FloatingIPDetailsNegativeTestJSON-1286416822 tempest-FloatingIPDetailsNegativeTestJSON-1286416822-project] Calling method '.version_select at 0x7f5b244b9d30>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:37.994521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG neutronclient.v2_0.client [None req-33b43175-b555-44ea-8736-e2d929e782a2 tempest-FloatingIPDetailsNegativeTestJSON-1286416822 tempest-FloatingIPDetailsNegativeTestJSON-1286416822-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b8227f02-9c05-4b75-8a22-b5c844bf6816 could not be found", "detail": ""}} {{(pid=125942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 02:07:37.996703 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-33b43175-b555-44ea-8736-e2d929e782a2 tempest-FloatingIPDetailsNegativeTestJSON-1286416822 tempest-FloatingIPDetailsNegativeTestJSON-1286416822-project] HTTP exception thrown: Floating IP not found for ID b8227f02-9c05-4b75-8a22-b5c844bf6816 Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-33b43175-b555-44ea-8736-e2d929e782a2 tempest-FloatingIPDetailsNegativeTestJSON-1286416822 tempest-FloatingIPDetailsNegativeTestJSON-1286416822-project] Request method failure captured: Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-floating-ips/b8227f02-9c05-4b75-8a22-b5c844bf6816 HTTP/1.1 Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dhnhX5URlqcwiah32IJa1ZjoGov6D1MEy_Lye5VczaEko03i2NnCq_5B4Ch8ptqXVlpU8Qp3zyUSWOFEspSWoYfMk3SR3Yr7fMa1QcDAZ4vr_W4WZClh2ZM7Y843-_cOfPuhZCa4-Img6Xqm2ohXXIynq8pul18xuiQDuPDOwnXSH0 Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 9316be8ac45345b2bb033cd26f652b8e Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1286416822 Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9316be8ac45345b2bb033cd26f652b8e", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9316be8ac45345b2bb033cd26f652b8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9316be8ac45345b2bb033cd26f652b8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9316be8ac45345b2bb033cd26f652b8e"}]}] Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1286416822 Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 9316be8ac45345b2bb033cd26f652b8e Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1286416822 Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1286416822-project Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: d6dabb8d362c4dd7b778da47fd326a9f Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1286416822-project Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: exception: Floating IP not found for ID b8227f02-9c05-4b75-8a22-b5c844bf6816 Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'b8227f02-9c05-4b75-8a22-b5c844bf6816'} Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 02:07:37.999273 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b8227f02-9c05-4b75-8a22-b5c844bf6816 could not be found Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d948dfb9-037d-45e5-bdb3-646b4d37bd99'] Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b8227f02-9c05-4b75-8a22-b5c844bf6816. Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b8227f02-9c05-4b75-8a22-b5c844bf6816 Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b8227f02-9c05-4b75-8a22-b5c844bf6816 Aug 03 02:07:38.005281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.010926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-33b43175-b555-44ea-8736-e2d929e782a2 tempest-FloatingIPDetailsNegativeTestJSON-1286416822 tempest-FloatingIPDetailsNegativeTestJSON-1286416822-project] Returning 404 to user: Floating IP not found for ID b8227f02-9c05-4b75-8a22-b5c844bf6816 {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:38.010926 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-33b43175-b555-44ea-8736-e2d929e782a2 tempest-FloatingIPDetailsNegativeTestJSON-1286416822 tempest-FloatingIPDetailsNegativeTestJSON-1286416822-project] 10.222.0.67 "GET /compute/v2.1/os-floating-ips/b8227f02-9c05-4b75-8a22-b5c844bf6816" status: 404 len: 111 microversion: 2.1 time: 1.115724 Aug 03 02:07:38.011380 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1882/3883] 10.222.0.67 () {58 vars in 1260 bytes} [Wed Aug 3 02:07:36 2022] GET /compute/v2.1/os-floating-ips/b8227f02-9c05-4b75-8a22-b5c844bf6816 => generated 111 bytes in 1117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:38.032268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e7d9da76-168a-42f2-9675-461251da54b9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:38.034538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e7d9da76-168a-42f2-9675-461251da54b9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:38.056725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7d9da76-168a-42f2-9675-461251da54b9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:38.059118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7d9da76-168a-42f2-9675-461251da54b9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:38.061571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7d9da76-168a-42f2-9675-461251da54b9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:38.063850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7d9da76-168a-42f2-9675-461251da54b9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:38.072765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:07:38.113062 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-e7d9da76-168a-42f2-9675-461251da54b9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e7d9da76-168a-42f2-9675-461251da54b9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 HTTP/1.1 Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '4212ab14-d90b-4139-a28f-2b84e43471c2'} Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:38.118788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.124368 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:38.124368 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:38.124368 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:38.124368 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:38.124368 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:38.124368 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. Aug 03 02:07:38.124368 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.124368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e7d9da76-168a-42f2-9675-461251da54b9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:38.124368 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e7d9da76-168a-42f2-9675-461251da54b9 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 404 len: 111 microversion: 2.1 time: 0.109891 Aug 03 02:07:38.124368 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1883/3884] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:38 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:38.135724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8e190794-0799-4e94-9067-3f4fd979fe44 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:38.136373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8e190794-0799-4e94-9067-3f4fd979fe44 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:38.159173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e190794-0799-4e94-9067-3f4fd979fe44 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:38.161473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e190794-0799-4e94-9067-3f4fd979fe44 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:38.163697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e190794-0799-4e94-9067-3f4fd979fe44 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:38.165626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e190794-0799-4e94-9067-3f4fd979fe44 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:38.495545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-786d571c-7dc7-4198-bac7-01a6b8d2664e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:38.513110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-786d571c-7dc7-4198-bac7-01a6b8d2664e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:38.525998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-786d571c-7dc7-4198-bac7-01a6b8d2664e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:38.536794 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-786d571c-7dc7-4198-bac7-01a6b8d2664e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.223839 Aug 03 02:07:38.537695 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2002/3885] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:37 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:38.558935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d2d2cb30-3b42-49d5-afcb-65a9c85f1451 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:38.559480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d2d2cb30-3b42-49d5-afcb-65a9c85f1451 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:38.575194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2d2cb30-3b42-49d5-afcb-65a9c85f1451 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:38.575774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2d2cb30-3b42-49d5-afcb-65a9c85f1451 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:38.583293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2d2cb30-3b42-49d5-afcb-65a9c85f1451 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:38.584224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2d2cb30-3b42-49d5-afcb-65a9c85f1451 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:38.633422 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-d2d2cb30-3b42-49d5-afcb-65a9c85f1451 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d2d2cb30-3b42-49d5-afcb-65a9c85f1451 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 HTTP/1.1 Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '4212ab14-d90b-4139-a28f-2b84e43471c2'} Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:38.639969 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:38.644569 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. Aug 03 02:07:38.644569 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.644569 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:38.644569 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.644569 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:38.644569 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:38.644569 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:38.644569 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:38.644569 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:38.644569 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. Aug 03 02:07:38.644569 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.644569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d2d2cb30-3b42-49d5-afcb-65a9c85f1451 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:38.644569 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d2d2cb30-3b42-49d5-afcb-65a9c85f1451 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 404 len: 111 microversion: 2.1 time: 0.099999 Aug 03 02:07:38.649504 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2003/3886] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:07:38 2022] DELETE /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:38.669748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f339a82f-7f4d-49ab-b709-6b1fe81ab214 req-69ca5d0c-6e56-4527-b9e4-d338c9b6351a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "tag": "805da5ad-6ade-4a2c-94be-dc2a26fa060a"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:38.705686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f339a82f-7f4d-49ab-b709-6b1fe81ab214 req-69ca5d0c-6e56-4527-b9e4-d338c9b6351a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:38.706152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f339a82f-7f4d-49ab-b709-6b1fe81ab214 req-69ca5d0c-6e56-4527-b9e4-d338c9b6351a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:38.751943 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f339a82f-7f4d-49ab-b709-6b1fe81ab214 req-69ca5d0c-6e56-4527-b9e4-d338c9b6351a service nova] Creating event network-changed:805da5ad-6ade-4a2c-94be-dc2a26fa060a for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:07:38.763781 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f339a82f-7f4d-49ab-b709-6b1fe81ab214 req-69ca5d0c-6e56-4527-b9e4-d338c9b6351a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111184 Aug 03 02:07:38.769459 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2004/3887] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:38.786635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a5c4b967-0f8a-4393-aa4c-b091715e6ce0 req-132cdbf3-f3fc-4721-844a-ec606416d380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4212ab14-d90b-4139-a28f-2b84e43471c2", "name": "network-vif-deleted", "tag": "35dc139e-71ae-4a37-9057-4972893be18f"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:38.817366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a5c4b967-0f8a-4393-aa4c-b091715e6ce0 req-132cdbf3-f3fc-4721-844a-ec606416d380 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:38.817916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a5c4b967-0f8a-4393-aa4c-b091715e6ce0 req-132cdbf3-f3fc-4721-844a-ec606416d380 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:38.861353 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a5c4b967-0f8a-4393-aa4c-b091715e6ce0 req-132cdbf3-f3fc-4721-844a-ec606416d380 service nova] Creating event network-vif-deleted:35dc139e-71ae-4a37-9057-4972893be18f for instance 4212ab14-d90b-4139-a28f-2b84e43471c2 on n-h2-826529-8 Aug 03 02:07:38.868136 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a5c4b967-0f8a-4393-aa4c-b091715e6ce0 req-132cdbf3-f3fc-4721-844a-ec606416d380 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094441 Aug 03 02:07:38.872770 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2005/3888] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:38.887719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1b1c9630-ca48-499a-9e94-c588eb534b8c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:38.891641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1b1c9630-ca48-499a-9e94-c588eb534b8c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 4212ab14-d90b-4139-a28f-2b84e43471c2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:38.905493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b1c9630-ca48-499a-9e94-c588eb534b8c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:38.906382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b1c9630-ca48-499a-9e94-c588eb534b8c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:38.934495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b1c9630-ca48-499a-9e94-c588eb534b8c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:38.936953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b1c9630-ca48-499a-9e94-c588eb534b8c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:38.981572 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-1b1c9630-ca48-499a-9e94-c588eb534b8c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1b1c9630-ca48-499a-9e94-c588eb534b8c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 HTTP/1.1 Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '4212ab14-d90b-4139-a28f-2b84e43471c2'} Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:38.983421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.989560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:38.989560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:38.989560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:38.989560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:38.989560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:38.989560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. Aug 03 02:07:38.989560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:38.989560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1b1c9630-ca48-499a-9e94-c588eb534b8c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance 4212ab14-d90b-4139-a28f-2b84e43471c2 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:38.989560 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1b1c9630-ca48-499a-9e94-c588eb534b8c tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2" status: 404 len: 111 microversion: 2.1 time: 0.112499 Aug 03 02:07:38.989560 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2006/3889] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:38 2022] GET /compute/v2.1/servers/4212ab14-d90b-4139-a28f-2b84e43471c2 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:39.004607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7325bcad-c8ad-4df8-9bfa-6d9ec80b2401 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:39.027214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7325bcad-c8ad-4df8-9bfa-6d9ec80b2401 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:39.055723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7325bcad-c8ad-4df8-9bfa-6d9ec80b2401 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:39.056403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7325bcad-c8ad-4df8-9bfa-6d9ec80b2401 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:39.057475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7325bcad-c8ad-4df8-9bfa-6d9ec80b2401 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:39.058316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7325bcad-c8ad-4df8-9bfa-6d9ec80b2401 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:39.075155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:07:39.077024 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-7325bcad-c8ad-4df8-9bfa-6d9ec80b2401 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7325bcad-c8ad-4df8-9bfa-6d9ec80b2401 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 HTTP/1.1 Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'ef77e1c8-a8d6-4306-89ea-0c3c169b1d75'} Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:39.079237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:39.084714 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. Aug 03 02:07:39.084714 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.084714 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.084714 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.084714 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.084714 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.084714 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.084714 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:39.084714 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:39.084714 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. Aug 03 02:07:39.084714 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.088870 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7325bcad-c8ad-4df8-9bfa-6d9ec80b2401 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:39.090083 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7325bcad-c8ad-4df8-9bfa-6d9ec80b2401 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 404 len: 111 microversion: 2.1 time: 0.094065 Aug 03 02:07:39.091335 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2007/3890] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:07:38 2022] DELETE /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:39.108446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b7368112-48ab-4014-b89e-e5c4e24ce680 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:39.109749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b7368112-48ab-4014-b89e-e5c4e24ce680 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: ef77e1c8-a8d6-4306-89ea-0c3c169b1d75] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:39.120677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7368112-48ab-4014-b89e-e5c4e24ce680 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:39.121544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7368112-48ab-4014-b89e-e5c4e24ce680 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:39.122609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7368112-48ab-4014-b89e-e5c4e24ce680 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:39.124344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7368112-48ab-4014-b89e-e5c4e24ce680 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:39.147335 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-b7368112-48ab-4014-b89e-e5c4e24ce680 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b7368112-48ab-4014-b89e-e5c4e24ce680 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 HTTP/1.1 Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'ef77e1c8-a8d6-4306-89ea-0c3c169b1d75'} Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.149468 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.154108 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.154108 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.154108 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.154108 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:39.154108 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:39.154108 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. Aug 03 02:07:39.154108 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.159890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b7368112-48ab-4014-b89e-e5c4e24ce680 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:39.161627 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b7368112-48ab-4014-b89e-e5c4e24ce680 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75" status: 404 len: 111 microversion: 2.1 time: 0.061105 Aug 03 02:07:39.162858 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2008/3891] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:39 2022] GET /compute/v2.1/servers/ef77e1c8-a8d6-4306-89ea-0c3c169b1d75 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:39.175190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0603e030-3ec0-40b0-97d3-55e5db2ce334 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:39.182367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0603e030-3ec0-40b0-97d3-55e5db2ce334 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:39.212922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0603e030-3ec0-40b0-97d3-55e5db2ce334 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:39.213380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0603e030-3ec0-40b0-97d3-55e5db2ce334 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:39.214180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0603e030-3ec0-40b0-97d3-55e5db2ce334 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:39.214620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0603e030-3ec0-40b0-97d3-55e5db2ce334 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:39.257354 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-0603e030-3ec0-40b0-97d3-55e5db2ce334 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0603e030-3ec0-40b0-97d3-55e5db2ce334 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a HTTP/1.1 Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '8fea7f2e-eb34-40c8-8171-11e0a65bae4a'} Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:39.259355 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:39.265130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. Aug 03 02:07:39.265130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.265130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.265130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.265130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.265130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.265130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.265130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:39.265130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:39.265130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. Aug 03 02:07:39.265130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.267038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0603e030-3ec0-40b0-97d3-55e5db2ce334 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:39.268111 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0603e030-3ec0-40b0-97d3-55e5db2ce334 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 404 len: 111 microversion: 2.1 time: 0.101291 Aug 03 02:07:39.272433 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2009/3892] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:07:39 2022] DELETE /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:39.277606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f5abbfe9-561a-435c-8901-006b4350d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:39.283864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f5abbfe9-561a-435c-8901-006b4350d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 8fea7f2e-eb34-40c8-8171-11e0a65bae4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:39.313471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5abbfe9-561a-435c-8901-006b4350d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:39.314217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5abbfe9-561a-435c-8901-006b4350d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:39.315275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5abbfe9-561a-435c-8901-006b4350d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:39.316006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5abbfe9-561a-435c-8901-006b4350d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:39.344100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8e190794-0799-4e94-9067-3f4fd979fe44 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:39.360467 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8e190794-0799-4e94-9067-3f4fd979fe44 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1316 microversion: 2.1 time: 1.234959 Aug 03 02:07:39.361071 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1884/3893] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:38 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1316 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:39.378115 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-f5abbfe9-561a-435c-8901-006b4350d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f5abbfe9-561a-435c-8901-006b4350d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a HTTP/1.1 Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '8fea7f2e-eb34-40c8-8171-11e0a65bae4a'} Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.381224 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.387169 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.387169 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.387169 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.387169 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:39.387169 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:39.387169 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. Aug 03 02:07:39.387169 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.388427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f5abbfe9-561a-435c-8901-006b4350d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance 8fea7f2e-eb34-40c8-8171-11e0a65bae4a could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:39.389526 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f5abbfe9-561a-435c-8901-006b4350d945 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a" status: 404 len: 111 microversion: 2.1 time: 0.115796 Aug 03 02:07:39.393450 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2010/3894] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:39 2022] GET /compute/v2.1/servers/8fea7f2e-eb34-40c8-8171-11e0a65bae4a => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:39.399198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-86489306-602e-494e-9523-bf2949e8e0b5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:39.399710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-86489306-602e-494e-9523-bf2949e8e0b5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:39.415376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86489306-602e-494e-9523-bf2949e8e0b5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:39.416143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86489306-602e-494e-9523-bf2949e8e0b5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:39.417291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86489306-602e-494e-9523-bf2949e8e0b5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:39.417884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86489306-602e-494e-9523-bf2949e8e0b5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:39.487983 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-86489306-602e-494e-9523-bf2949e8e0b5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-86489306-602e-494e-9523-bf2949e8e0b5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d HTTP/1.1 Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '3896d3ca-97e6-4db3-998a-49e5beb3191d'} Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:39.494271 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:39.498803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. Aug 03 02:07:39.498803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.498803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.498803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.498803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.498803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.498803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.498803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:39.498803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:39.498803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. Aug 03 02:07:39.498803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.501359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-86489306-602e-494e-9523-bf2949e8e0b5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:39.506196 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-86489306-602e-494e-9523-bf2949e8e0b5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 404 len: 111 microversion: 2.1 time: 0.110007 Aug 03 02:07:39.510145 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1885/3895] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:07:39 2022] DELETE /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:39.515628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b507248-e9cf-4099-b63e-b4e34ee37ed5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:39.516862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8b507248-e9cf-4099-b63e-b4e34ee37ed5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 3896d3ca-97e6-4db3-998a-49e5beb3191d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:39.538371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b507248-e9cf-4099-b63e-b4e34ee37ed5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:39.539187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b507248-e9cf-4099-b63e-b4e34ee37ed5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:39.540217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b507248-e9cf-4099-b63e-b4e34ee37ed5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:39.540870 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b507248-e9cf-4099-b63e-b4e34ee37ed5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:39.574442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dd19e2a4-d2d8-4602-87e1-2602f9758ca4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:39.580786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dd19e2a4-d2d8-4602-87e1-2602f9758ca4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:39.584569 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-8b507248-e9cf-4099-b63e-b4e34ee37ed5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b507248-e9cf-4099-b63e-b4e34ee37ed5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d HTTP/1.1 Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '3896d3ca-97e6-4db3-998a-49e5beb3191d'} Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.587111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.591657 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.591657 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.591657 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.591657 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:39.591657 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:39.591657 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. Aug 03 02:07:39.591657 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.593888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b507248-e9cf-4099-b63e-b4e34ee37ed5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance 3896d3ca-97e6-4db3-998a-49e5beb3191d could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:39.597484 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8b507248-e9cf-4099-b63e-b4e34ee37ed5 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d" status: 404 len: 111 microversion: 2.1 time: 0.085659 Aug 03 02:07:39.621444 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2011/3896] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:39 2022] GET /compute/v2.1/servers/3896d3ca-97e6-4db3-998a-49e5beb3191d => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:39.631375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd19e2a4-d2d8-4602-87e1-2602f9758ca4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:39.632318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd19e2a4-d2d8-4602-87e1-2602f9758ca4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:39.633799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd19e2a4-d2d8-4602-87e1-2602f9758ca4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:39.634594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd19e2a4-d2d8-4602-87e1-2602f9758ca4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:39.635878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4fcf877-a3f3-41eb-b26e-b195496824bd tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:39.639276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f4fcf877-a3f3-41eb-b26e-b195496824bd tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 427d3e2e-05aa-4e34-9a36-56c13e67dc77] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:39.656159 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-f4fcf877-a3f3-41eb-b26e-b195496824bd tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4fcf877-a3f3-41eb-b26e-b195496824bd tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/427d3e2e-05aa-4e34-9a36-56c13e67dc77 HTTP/1.1 Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '427d3e2e-05aa-4e34-9a36-56c13e67dc77'} Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.658072 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.663474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.663474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.663474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.663474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:39.663474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:39.663474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. Aug 03 02:07:39.663474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.664836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4fcf877-a3f3-41eb-b26e-b195496824bd tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:39.666007 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f4fcf877-a3f3-41eb-b26e-b195496824bd tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "DELETE /compute/v2.1/servers/427d3e2e-05aa-4e34-9a36-56c13e67dc77" status: 404 len: 111 microversion: 2.1 time: 0.041306 Aug 03 02:07:39.666804 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2012/3897] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:07:39 2022] DELETE /compute/v2.1/servers/427d3e2e-05aa-4e34-9a36-56c13e67dc77 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:39.687452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-57046942-92c2-4fe2-b770-9ffb833c3c49 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:39.688174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-57046942-92c2-4fe2-b770-9ffb833c3c49 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 427d3e2e-05aa-4e34-9a36-56c13e67dc77] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:39.708656 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-57046942-92c2-4fe2-b770-9ffb833c3c49 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-57046942-92c2-4fe2-b770-9ffb833c3c49 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/427d3e2e-05aa-4e34-9a36-56c13e67dc77 HTTP/1.1 Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '427d3e2e-05aa-4e34-9a36-56c13e67dc77'} Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:39.710260 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:39.715148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:39.715148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:39.715148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:39.715148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. Aug 03 02:07:39.715148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:39.715148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-57046942-92c2-4fe2-b770-9ffb833c3c49 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance 427d3e2e-05aa-4e34-9a36-56c13e67dc77 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:39.715148 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-57046942-92c2-4fe2-b770-9ffb833c3c49 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/427d3e2e-05aa-4e34-9a36-56c13e67dc77" status: 404 len: 111 microversion: 2.1 time: 0.042008 Aug 03 02:07:39.722126 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2013/3898] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:39 2022] GET /compute/v2.1/servers/427d3e2e-05aa-4e34-9a36-56c13e67dc77 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:40.393530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f21481a5-3a10-4b65-962e-ae812e0ee24f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:40.394253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f21481a5-3a10-4b65-962e-ae812e0ee24f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:40.424288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f21481a5-3a10-4b65-962e-ae812e0ee24f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:40.424771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f21481a5-3a10-4b65-962e-ae812e0ee24f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:40.427598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f21481a5-3a10-4b65-962e-ae812e0ee24f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:40.430433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f21481a5-3a10-4b65-962e-ae812e0ee24f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:41.738576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dd19e2a4-d2d8-4602-87e1-2602f9758ca4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:41.760362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dd19e2a4-d2d8-4602-87e1-2602f9758ca4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:41.768761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dd19e2a4-d2d8-4602-87e1-2602f9758ca4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:41.770982 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dd19e2a4-d2d8-4602-87e1-2602f9758ca4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 2.205691 Aug 03 02:07:41.777703 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1886/3899] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:39 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 2213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:41.793752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-b71dac0a-aa09-4f6a-9bd3-4bef36702580 req-e9b3211b-99c6-4c2c-912b-0d72f3cbe04b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9952a14-056b-4b74-ab8c-791d16592ddf", "name": "network-vif-plugged", "status": "completed", "tag": "6377bbf1-10a0-437b-a4d1-7bd2f82f03fe"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:41.866641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b71dac0a-aa09-4f6a-9bd3-4bef36702580 req-e9b3211b-99c6-4c2c-912b-0d72f3cbe04b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:41.867140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b71dac0a-aa09-4f6a-9bd3-4bef36702580 req-e9b3211b-99c6-4c2c-912b-0d72f3cbe04b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:41.923314 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-b71dac0a-aa09-4f6a-9bd3-4bef36702580 req-e9b3211b-99c6-4c2c-912b-0d72f3cbe04b service nova] Creating event network-vif-plugged:6377bbf1-10a0-437b-a4d1-7bd2f82f03fe for instance b9952a14-056b-4b74-ab8c-791d16592ddf on n-h1-826529-8 Aug 03 02:07:41.945856 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-b71dac0a-aa09-4f6a-9bd3-4bef36702580 req-e9b3211b-99c6-4c2c-912b-0d72f3cbe04b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161978 Aug 03 02:07:41.946869 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1887/3900] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:42.470707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f21481a5-3a10-4b65-962e-ae812e0ee24f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:42.479902 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f21481a5-3a10-4b65-962e-ae812e0ee24f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1316 microversion: 2.1 time: 2.092092 Aug 03 02:07:42.486057 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2014/3901] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:40 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1316 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:42.808237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4ffe2146-705f-464f-b7c5-7dae779ba477 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:42.811802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4ffe2146-705f-464f-b7c5-7dae779ba477 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:42.858162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ffe2146-705f-464f-b7c5-7dae779ba477 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:42.863995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ffe2146-705f-464f-b7c5-7dae779ba477 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:42.877389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ffe2146-705f-464f-b7c5-7dae779ba477 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:42.887648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ffe2146-705f-464f-b7c5-7dae779ba477 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:43.045299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-577419b8-58a5-4f86-b1d7-40d95d4bce7b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:43.045793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-577419b8-58a5-4f86-b1d7-40d95d4bce7b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:43.070316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-577419b8-58a5-4f86-b1d7-40d95d4bce7b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:43.081978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-577419b8-58a5-4f86-b1d7-40d95d4bce7b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:43.083776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-577419b8-58a5-4f86-b1d7-40d95d4bce7b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:43.091488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-577419b8-58a5-4f86-b1d7-40d95d4bce7b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:43.170417 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-577419b8-58a5-4f86-b1d7-40d95d4bce7b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] HTTP exception thrown: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-577419b8-58a5-4f86-b1d7-40d95d4bce7b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Request method failure captured: Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 HTTP/1.1 Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dZfxZiFPysNXB16bIkMZ-7Cn3Km1a9HAWIfreNeUgh28J492cbxEOoO45TNvWVYIjM_-kJI7qB8Rjq_YL9i6dck-QJkcpmdKs-lu8MY59NuRi9m1ThcgH_s-Z12NV8EyT03_1vhmc7B6Kd_fnAY-0bH5gEh-wmfO4V_HDSUxJngFvE Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9907ef20b17f42acb99a8b61502f29a3 Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9907ef20b17f42acb99a8b61502f29a3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9907ef20b17f42acb99a8b61502f29a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9907ef20b17f42acb99a8b61502f29a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9907ef20b17f42acb99a8b61502f29a3"}]}] Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9907ef20b17f42acb99a8b61502f29a3 Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeShelveTestJSON-2134656059-project Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 81ae7aa9aed7440a8bdfd4595eae3be8 Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2134656059-project Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '9ce11775-ab73-457e-8799-239915dc2406'} Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:43.183414 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:43.191176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. Aug 03 02:07:43.191176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:43.191176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:43.191176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:43.191176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:43.191176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:43.191176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:43.191176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:43.191176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:43.191176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. Aug 03 02:07:43.191176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:43.191176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-577419b8-58a5-4f86-b1d7-40d95d4bce7b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Returning 404 to user: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:43.195273 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-577419b8-58a5-4f86-b1d7-40d95d4bce7b tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 404 len: 111 microversion: 2.20 time: 0.147092 Aug 03 02:07:43.198516 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2015/3902] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:07:43 2022] DELETE /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:07:43.208664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4a4afacf-3521-4462-962f-c5e90d021568 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:43.209291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4a4afacf-3521-4462-962f-c5e90d021568 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 9ce11775-ab73-457e-8799-239915dc2406] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:43.253239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a4afacf-3521-4462-962f-c5e90d021568 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:43.253722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a4afacf-3521-4462-962f-c5e90d021568 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:43.261976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a4afacf-3521-4462-962f-c5e90d021568 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:43.262960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a4afacf-3521-4462-962f-c5e90d021568 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:43.350346 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-4a4afacf-3521-4462-962f-c5e90d021568 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] HTTP exception thrown: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4a4afacf-3521-4462-962f-c5e90d021568 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Request method failure captured: Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 HTTP/1.1 Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dZfxZiFPysNXB16bIkMZ-7Cn3Km1a9HAWIfreNeUgh28J492cbxEOoO45TNvWVYIjM_-kJI7qB8Rjq_YL9i6dck-QJkcpmdKs-lu8MY59NuRi9m1ThcgH_s-Z12NV8EyT03_1vhmc7B6Kd_fnAY-0bH5gEh-wmfO4V_HDSUxJngFvE Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9907ef20b17f42acb99a8b61502f29a3 Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9907ef20b17f42acb99a8b61502f29a3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9907ef20b17f42acb99a8b61502f29a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9907ef20b17f42acb99a8b61502f29a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9907ef20b17f42acb99a8b61502f29a3"}]}] Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9907ef20b17f42acb99a8b61502f29a3 Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeShelveTestJSON-2134656059-project Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 81ae7aa9aed7440a8bdfd4595eae3be8 Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2134656059-project Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '9ce11775-ab73-457e-8799-239915dc2406'} Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:43.351781 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:43.357159 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:43.357159 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:43.357159 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:43.357159 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:43.357159 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:43.357159 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:43.357159 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. Aug 03 02:07:43.357159 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:43.357159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4a4afacf-3521-4462-962f-c5e90d021568 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Returning 404 to user: Instance 9ce11775-ab73-457e-8799-239915dc2406 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:43.357159 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4a4afacf-3521-4462-962f-c5e90d021568 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406" status: 404 len: 111 microversion: 2.20 time: 0.151103 Aug 03 02:07:43.357159 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2016/3903] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:43 2022] GET /compute/v2.1/servers/9ce11775-ab73-457e-8799-239915dc2406 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:07:43.513469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-69ccc921-7fd7-409d-b5da-b0d5ecb0dc78 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:43.514092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-69ccc921-7fd7-409d-b5da-b0d5ecb0dc78 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:43.533606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69ccc921-7fd7-409d-b5da-b0d5ecb0dc78 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:43.546880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69ccc921-7fd7-409d-b5da-b0d5ecb0dc78 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:43.548084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69ccc921-7fd7-409d-b5da-b0d5ecb0dc78 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:43.548656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69ccc921-7fd7-409d-b5da-b0d5ecb0dc78 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:46.367119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4ffe2146-705f-464f-b7c5-7dae779ba477 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:46.391371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4ffe2146-705f-464f-b7c5-7dae779ba477 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:46.395271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4ffe2146-705f-464f-b7c5-7dae779ba477 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:46.399162 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4ffe2146-705f-464f-b7c5-7dae779ba477 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 3.594195 Aug 03 02:07:46.402159 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1888/3904] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:42 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 3601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:46.407847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d6356660-2aa1-4266-a202-cd3cbe7a3c78 req-d67378ee-d672-4d17-9bce-43483468579b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c93a8f4-a14e-4937-a7bd-641747f3b86b", "name": "network-vif-plugged", "status": "completed", "tag": "a63917f9-9c39-45f8-a71c-b65c4056617d"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:46.433466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d6356660-2aa1-4266-a202-cd3cbe7a3c78 req-d67378ee-d672-4d17-9bce-43483468579b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:46.434571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d6356660-2aa1-4266-a202-cd3cbe7a3c78 req-d67378ee-d672-4d17-9bce-43483468579b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:46.469780 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d6356660-2aa1-4266-a202-cd3cbe7a3c78 req-d67378ee-d672-4d17-9bce-43483468579b service nova] Creating event network-vif-plugged:a63917f9-9c39-45f8-a71c-b65c4056617d for instance 4c93a8f4-a14e-4937-a7bd-641747f3b86b on n-h1-826529-8 Aug 03 02:07:46.489092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-69ccc921-7fd7-409d-b5da-b0d5ecb0dc78 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:46.511929 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d6356660-2aa1-4266-a202-cd3cbe7a3c78 req-d67378ee-d672-4d17-9bce-43483468579b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103627 Aug 03 02:07:46.521269 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1889/3905] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:46.525643 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-69ccc921-7fd7-409d-b5da-b0d5ecb0dc78 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1316 microversion: 2.1 time: 3.021715 Aug 03 02:07:46.529567 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2017/3906] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:43 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1316 bytes in 3026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:46.947282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-51d172a8-a603-4397-a72c-3444f34699d8 req-ce15edbb-d54d-4108-9398-86646078a327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "tag": "2d1a410d-29d6-424d-b7ce-91aa60713c2c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:46.993830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-51d172a8-a603-4397-a72c-3444f34699d8 req-ce15edbb-d54d-4108-9398-86646078a327 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:46.995327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-51d172a8-a603-4397-a72c-3444f34699d8 req-ce15edbb-d54d-4108-9398-86646078a327 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:47.062564 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-51d172a8-a603-4397-a72c-3444f34699d8 req-ce15edbb-d54d-4108-9398-86646078a327 service nova] Creating event network-changed:2d1a410d-29d6-424d-b7ce-91aa60713c2c for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:07:47.086484 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-51d172a8-a603-4397-a72c-3444f34699d8 req-ce15edbb-d54d-4108-9398-86646078a327 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148015 Aug 03 02:07:47.093946 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1890/3907] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:07:47.431145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-48d44fe5-bb5e-43d7-82fe-d0bc2fe6c7db tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:47.432571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-48d44fe5-bb5e-43d7-82fe-d0bc2fe6c7db tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:47.445049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48d44fe5-bb5e-43d7-82fe-d0bc2fe6c7db tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:47.446541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48d44fe5-bb5e-43d7-82fe-d0bc2fe6c7db tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:47.447725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48d44fe5-bb5e-43d7-82fe-d0bc2fe6c7db tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:47.450106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48d44fe5-bb5e-43d7-82fe-d0bc2fe6c7db tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:47.553882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-750dfe61-7830-4a01-b92f-fc4fe193b998 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:47.555318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-750dfe61-7830-4a01-b92f-fc4fe193b998 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:47.571191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-750dfe61-7830-4a01-b92f-fc4fe193b998 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:47.571662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-750dfe61-7830-4a01-b92f-fc4fe193b998 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:47.572471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-750dfe61-7830-4a01-b92f-fc4fe193b998 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:47.572924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-750dfe61-7830-4a01-b92f-fc4fe193b998 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:48.117075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-750dfe61-7830-4a01-b92f-fc4fe193b998 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:48.132261 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-750dfe61-7830-4a01-b92f-fc4fe193b998 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1316 microversion: 2.1 time: 0.585232 Aug 03 02:07:48.149692 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1891/3908] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:47 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:48.205792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-48d44fe5-bb5e-43d7-82fe-d0bc2fe6c7db tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:48.227655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-48d44fe5-bb5e-43d7-82fe-d0bc2fe6c7db tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:48.232446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-48d44fe5-bb5e-43d7-82fe-d0bc2fe6c7db tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:48.247893 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-48d44fe5-bb5e-43d7-82fe-d0bc2fe6c7db tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 0.807810 Aug 03 02:07:48.263025 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2018/3909] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:47 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:48.328927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-653fdf3c-5121-4582-b5d7-72fef02a4c09 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:48.329444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-653fdf3c-5121-4582-b5d7-72fef02a4c09 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:48.347423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-653fdf3c-5121-4582-b5d7-72fef02a4c09 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:48.348426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-653fdf3c-5121-4582-b5d7-72fef02a4c09 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:48.349247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-653fdf3c-5121-4582-b5d7-72fef02a4c09 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:48.349693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-653fdf3c-5121-4582-b5d7-72fef02a4c09 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:48.409620 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-653fdf3c-5121-4582-b5d7-72fef02a4c09 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-653fdf3c-5121-4582-b5d7-72fef02a4c09 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe HTTP/1.1 Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'cca5751e-57cb-49b2-982e-0201e2a94ffe'} Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:48.411443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:48.417302 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:07:48.417302 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.417302 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:48.417302 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.417302 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:48.417302 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:48.417302 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:48.417302 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:48.417302 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:48.417302 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:07:48.417302 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.417302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-653fdf3c-5121-4582-b5d7-72fef02a4c09 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:48.417302 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-653fdf3c-5121-4582-b5d7-72fef02a4c09 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 404 len: 111 microversion: 2.1 time: 0.089920 Aug 03 02:07:48.427082 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1892/3910] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:07:48 2022] DELETE /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:48.435827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a0769400-872d-425a-b257-23f4f71cd224 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:48.436658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a0769400-872d-425a-b257-23f4f71cd224 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: cca5751e-57cb-49b2-982e-0201e2a94ffe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:48.451457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0769400-872d-425a-b257-23f4f71cd224 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:48.455311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0769400-872d-425a-b257-23f4f71cd224 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:48.456600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0769400-872d-425a-b257-23f4f71cd224 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:48.462525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0769400-872d-425a-b257-23f4f71cd224 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:48.499260 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-a0769400-872d-425a-b257-23f4f71cd224 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a0769400-872d-425a-b257-23f4f71cd224 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe HTTP/1.1 Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'cca5751e-57cb-49b2-982e-0201e2a94ffe'} Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:48.504164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.509222 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:48.509222 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:48.509222 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:48.509222 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:48.509222 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:48.509222 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. Aug 03 02:07:48.509222 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.515499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a0769400-872d-425a-b257-23f4f71cd224 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance cca5751e-57cb-49b2-982e-0201e2a94ffe could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:48.517460 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a0769400-872d-425a-b257-23f4f71cd224 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe" status: 404 len: 111 microversion: 2.1 time: 0.086565 Aug 03 02:07:48.522398 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2019/3911] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:48 2022] GET /compute/v2.1/servers/cca5751e-57cb-49b2-982e-0201e2a94ffe => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:48.532434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7f1f0bed-e150-4bd7-afd0-701568f62443 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:48.532945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7f1f0bed-e150-4bd7-afd0-701568f62443 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:48.536688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-52e10fde-7805-482d-9844-63519d2ac471 req-6dfdc0f8-8498-49ce-a8da-a7802f1517f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ead359f-4427-4285-9677-d3cac524d8b2", "name": "network-vif-plugged", "status": "completed", "tag": "4d3985fb-3a8f-49e3-b887-095a18ea295a"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:48.545984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f1f0bed-e150-4bd7-afd0-701568f62443 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:48.546451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f1f0bed-e150-4bd7-afd0-701568f62443 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:48.558735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f1f0bed-e150-4bd7-afd0-701568f62443 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:48.559846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f1f0bed-e150-4bd7-afd0-701568f62443 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:48.566140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-52e10fde-7805-482d-9844-63519d2ac471 req-6dfdc0f8-8498-49ce-a8da-a7802f1517f3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:48.580143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-52e10fde-7805-482d-9844-63519d2ac471 req-6dfdc0f8-8498-49ce-a8da-a7802f1517f3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:48.583146 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-7f1f0bed-e150-4bd7-afd0-701568f62443 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7f1f0bed-e150-4bd7-afd0-701568f62443 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba HTTP/1.1 Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '934e4649-81b8-4e89-b7a0-3897750957ba'} Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:48.588838 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:48.593912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. Aug 03 02:07:48.593912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.593912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:48.593912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.593912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:48.593912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:48.593912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:48.593912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:48.593912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:48.593912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. Aug 03 02:07:48.593912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.596338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7f1f0bed-e150-4bd7-afd0-701568f62443 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:48.597440 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7f1f0bed-e150-4bd7-afd0-701568f62443 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "DELETE /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 404 len: 111 microversion: 2.1 time: 0.069640 Aug 03 02:07:48.599263 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1893/3912] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:07:48 2022] DELETE /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:48.618720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d5d39d95-589a-4ea3-96aa-72e598ca24e6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:48.632924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d5d39d95-589a-4ea3-96aa-72e598ca24e6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] [instance: 934e4649-81b8-4e89-b7a0-3897750957ba] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:48.643432 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-52e10fde-7805-482d-9844-63519d2ac471 req-6dfdc0f8-8498-49ce-a8da-a7802f1517f3 service nova] Creating event network-vif-plugged:4d3985fb-3a8f-49e3-b887-095a18ea295a for instance 7ead359f-4427-4285-9677-d3cac524d8b2 on n-h2-826529-8 Aug 03 02:07:48.665876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5d39d95-589a-4ea3-96aa-72e598ca24e6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:48.668906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5d39d95-589a-4ea3-96aa-72e598ca24e6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:48.670195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5d39d95-589a-4ea3-96aa-72e598ca24e6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:48.673889 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-52e10fde-7805-482d-9844-63519d2ac471 req-6dfdc0f8-8498-49ce-a8da-a7802f1517f3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139892 Aug 03 02:07:48.674933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5d39d95-589a-4ea3-96aa-72e598ca24e6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:48.678701 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2020/3913] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:07:48.706539 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-d5d39d95-589a-4ea3-96aa-72e598ca24e6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] HTTP exception thrown: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d5d39d95-589a-4ea3-96aa-72e598ca24e6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Request method failure captured: Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba HTTP/1.1 Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6db7PEbmrZY23--5bnqO0RCIY3PVZMSd5O0eBEeoGAq2hOzl2eHfWYq6GzDZ-3w314DTNbbvlauYepcFFYLhx9ZH_eGMchPzzyq8zhcqK-wVnXsYIWIvyJNbnF1Egc7B0wstbsruF9QwSyUNDcWq1a2CjJsmHq-RBmQ9p542lRf64EY Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_01f1d9f8216e4f729a5e24aad713fe98", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/01f1d9f8216e4f729a5e24aad713fe98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/01f1d9f8216e4f729a5e24aad713fe98"}]}] Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 01f1d9f8216e4f729a5e24aad713fe98 Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-DeleteServersTestJSON-219703460 Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 0dc56b77862f410d82c8617f3d679775 Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-DeleteServersTestJSON-219703460-project Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '934e4649-81b8-4e89-b7a0-3897750957ba'} Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:48.709327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.715597 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:48.715597 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:48.715597 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:48.715597 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:48.715597 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:48.715597 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. Aug 03 02:07:48.715597 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:48.718353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d5d39d95-589a-4ea3-96aa-72e598ca24e6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] Returning 404 to user: Instance 934e4649-81b8-4e89-b7a0-3897750957ba could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:48.719551 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d5d39d95-589a-4ea3-96aa-72e598ca24e6 tempest-DeleteServersTestJSON-219703460 tempest-DeleteServersTestJSON-219703460-project] 10.222.0.67 "GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba" status: 404 len: 111 microversion: 2.1 time: 0.114372 Aug 03 02:07:48.720674 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1894/3914] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:48 2022] GET /compute/v2.1/servers/934e4649-81b8-4e89-b7a0-3897750957ba => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:07:49.158025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-be4e9ba6-0696-462f-93e1-dbae5470e110 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:49.161687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-be4e9ba6-0696-462f-93e1-dbae5470e110 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:49.174309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-be4e9ba6-0696-462f-93e1-dbae5470e110 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:49.174766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-be4e9ba6-0696-462f-93e1-dbae5470e110 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:49.175600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-be4e9ba6-0696-462f-93e1-dbae5470e110 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:49.178685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-be4e9ba6-0696-462f-93e1-dbae5470e110 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:49.278238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ef6a3655-b7e4-4db7-9d6e-2fb0d51a08bf tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:49.279311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ef6a3655-b7e4-4db7-9d6e-2fb0d51a08bf tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:49.315422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef6a3655-b7e4-4db7-9d6e-2fb0d51a08bf tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:49.315880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef6a3655-b7e4-4db7-9d6e-2fb0d51a08bf tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:49.317335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef6a3655-b7e4-4db7-9d6e-2fb0d51a08bf tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:49.335179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef6a3655-b7e4-4db7-9d6e-2fb0d51a08bf tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:50.877301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ef6a3655-b7e4-4db7-9d6e-2fb0d51a08bf tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:50.942919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ef6a3655-b7e4-4db7-9d6e-2fb0d51a08bf tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:50.951028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ef6a3655-b7e4-4db7-9d6e-2fb0d51a08bf tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:50.958646 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ef6a3655-b7e4-4db7-9d6e-2fb0d51a08bf tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.684868 Aug 03 02:07:50.966543 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1895/3915] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:49 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:07:50.991778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-59c94263-112e-4bec-8e20-c5d0803c4294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:50.994812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-59c94263-112e-4bec-8e20-c5d0803c4294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:51.039671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59c94263-112e-4bec-8e20-c5d0803c4294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:51.043535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59c94263-112e-4bec-8e20-c5d0803c4294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:51.047226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59c94263-112e-4bec-8e20-c5d0803c4294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:51.047938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59c94263-112e-4bec-8e20-c5d0803c4294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:51.115264 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-59c94263-112e-4bec-8e20-c5d0803c4294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] HTTP exception thrown: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-59c94263-112e-4bec-8e20-c5d0803c4294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Request method failure captured: Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 HTTP/1.1 Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dZfxZiFPysNXB16bIkMZ-7Cn3Km1a9HAWIfreNeUgh28J492cbxEOoO45TNvWVYIjM_-kJI7qB8Rjq_YL9i6dck-QJkcpmdKs-lu8MY59NuRi9m1ThcgH_s-Z12NV8EyT03_1vhmc7B6Kd_fnAY-0bH5gEh-wmfO4V_HDSUxJngFvE Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 9907ef20b17f42acb99a8b61502f29a3 Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9907ef20b17f42acb99a8b61502f29a3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9907ef20b17f42acb99a8b61502f29a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9907ef20b17f42acb99a8b61502f29a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9907ef20b17f42acb99a8b61502f29a3"}]}] Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 9907ef20b17f42acb99a8b61502f29a3 Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AttachVolumeShelveTestJSON-2134656059-project Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 81ae7aa9aed7440a8bdfd4595eae3be8 Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2134656059-project Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '7c7d0db2-f64d-4df7-b0dd-2ecf688290b0'} Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:51.117499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:51.125723 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. Aug 03 02:07:51.125723 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:51.125723 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:51.125723 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:51.125723 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:51.125723 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:51.125723 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:51.125723 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:51.125723 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:51.125723 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. Aug 03 02:07:51.125723 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:51.136992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-59c94263-112e-4bec-8e20-c5d0803c4294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Returning 404 to user: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:51.138760 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-59c94263-112e-4bec-8e20-c5d0803c4294 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 404 len: 111 microversion: 2.20 time: 0.168132 Aug 03 02:07:51.140742 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1896/3916] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:07:50 2022] DELETE /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:07:51.152628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-53271601-d609-4fc7-b624-4f0e7efbaa27 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:51.163850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-53271601-d609-4fc7-b624-4f0e7efbaa27 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] [instance: 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:51.187388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53271601-d609-4fc7-b624-4f0e7efbaa27 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:51.188163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53271601-d609-4fc7-b624-4f0e7efbaa27 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:51.189211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53271601-d609-4fc7-b624-4f0e7efbaa27 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:51.199796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53271601-d609-4fc7-b624-4f0e7efbaa27 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:51.225699 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-53271601-d609-4fc7-b624-4f0e7efbaa27 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] HTTP exception thrown: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-53271601-d609-4fc7-b624-4f0e7efbaa27 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Request method failure captured: Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 HTTP/1.1 Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dZfxZiFPysNXB16bIkMZ-7Cn3Km1a9HAWIfreNeUgh28J492cbxEOoO45TNvWVYIjM_-kJI7qB8Rjq_YL9i6dck-QJkcpmdKs-lu8MY59NuRi9m1ThcgH_s-Z12NV8EyT03_1vhmc7B6Kd_fnAY-0bH5gEh-wmfO4V_HDSUxJngFvE Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 9907ef20b17f42acb99a8b61502f29a3 Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9907ef20b17f42acb99a8b61502f29a3", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9907ef20b17f42acb99a8b61502f29a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9907ef20b17f42acb99a8b61502f29a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9907ef20b17f42acb99a8b61502f29a3"}]}] Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 9907ef20b17f42acb99a8b61502f29a3 Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2134656059 Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AttachVolumeShelveTestJSON-2134656059-project Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 81ae7aa9aed7440a8bdfd4595eae3be8 Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2134656059-project Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '7c7d0db2-f64d-4df7-b0dd-2ecf688290b0'} Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:51.227712 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:07:51.232415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:51.232415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:07:51.232415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:07:51.232415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:07:51.232415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:07:51.232415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:07:51.232415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. Aug 03 02:07:51.232415 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:07:51.236510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-53271601-d609-4fc7-b624-4f0e7efbaa27 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] Returning 404 to user: Instance 7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:07:51.237794 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-53271601-d609-4fc7-b624-4f0e7efbaa27 tempest-AttachVolumeShelveTestJSON-2134656059 tempest-AttachVolumeShelveTestJSON-2134656059-project] 10.222.0.67 "GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0" status: 404 len: 111 microversion: 2.20 time: 0.089134 Aug 03 02:07:51.240927 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1897/3917] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:51 2022] GET /compute/v2.1/servers/7c7d0db2-f64d-4df7-b0dd-2ecf688290b0 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:07:51.351540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-87599016-28f0-484e-bb27-fd4c861ca967 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1870919824", "availability_zone": "foo_zone"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:51.354820 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:07:51.354820 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 02:07:51.361736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.aggregate [None req-87599016-28f0-484e-bb27-fd4c861ca967 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Generated uuid 93c73e42-b59c-45bf-a554-8233675fccd3 for aggregate {{(pid=125942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 02:07:51.420454 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-87599016-28f0-484e-bb27-fd4c861ca967 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.167711 Aug 03 02:07:51.424766 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1898/3918] 10.222.0.67 () {60 vars in 1164 bytes} [Wed Aug 3 02:07:51 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:51.436133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9acbf51f-dd20-4180-a41d-7c59788d093d tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:51.445325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-be4e9ba6-0696-462f-93e1-dbae5470e110 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:51.456948 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:07:51.456948 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 02:07:51.469257 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-be4e9ba6-0696-462f-93e1-dbae5470e110 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1316 microversion: 2.1 time: 2.315193 Aug 03 02:07:51.478105 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2021/3919] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:49 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1316 bytes in 2325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:51.511550 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9acbf51f-dd20-4180-a41d-7c59788d093d tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.079146 Aug 03 02:07:51.518749 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1899/3920] 10.222.0.67 () {60 vars in 1194 bytes} [Wed Aug 3 02:07:51 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:51.527040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ee3dbae5-9efb-4bb0-8436-e379258d4816 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:51.531159 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:07:51.531159 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 02:07:51.539348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee3dbae5-9efb-4bb0-8436-e379258d4816 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:51.541845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee3dbae5-9efb-4bb0-8436-e379258d4816 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:51.542974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee3dbae5-9efb-4bb0-8436-e379258d4816 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:51.545369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee3dbae5-9efb-4bb0-8436-e379258d4816 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:51.630705 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ee3dbae5-9efb-4bb0-8436-e379258d4816 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] 10.222.0.67 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.109548 Aug 03 02:07:51.632259 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2022/3921] 10.222.0.67 () {58 vars in 1176 bytes} [Wed Aug 3 02:07:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:51.643807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eb343bfe-f6e7-4f8d-85f9-be5fa3826039 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:51.647297 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:07:51.647297 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 02:07:51.665481 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eb343bfe-f6e7-4f8d-85f9-be5fa3826039 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.025321 Aug 03 02:07:51.666064 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1900/3922] 10.222.0.67 () {58 vars in 1143 bytes} [Wed Aug 3 02:07:51 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:51.678314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ae54a77a-e5f9-4aef-ba6b-ee14ade8b128 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826529-8"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:51.681623 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:07:51.681623 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 02:07:51.701212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae54a77a-e5f9-4aef-ba6b-ee14ade8b128 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:51.703314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae54a77a-e5f9-4aef-ba6b-ee14ade8b128 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:52.000046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-49193004-81ff-4cd9-98e2-3557e3b1719a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:52.001693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-49193004-81ff-4cd9-98e2-3557e3b1719a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:52.022761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49193004-81ff-4cd9-98e2-3557e3b1719a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:52.026686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49193004-81ff-4cd9-98e2-3557e3b1719a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:52.029597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49193004-81ff-4cd9-98e2-3557e3b1719a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:52.040800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49193004-81ff-4cd9-98e2-3557e3b1719a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:52.647079 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ae54a77a-e5f9-4aef-ba6b-ee14ade8b128 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.973302 Aug 03 02:07:52.651018 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2023/3923] 10.222.0.67 () {60 vars in 1194 bytes} [Wed Aug 3 02:07:51 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:52.661978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5d2fa2fc-a620-405a-b66d-0f686cdae586 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:52.662711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5d2fa2fc-a620-405a-b66d-0f686cdae586 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:52.684464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d2fa2fc-a620-405a-b66d-0f686cdae586 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:52.689522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d2fa2fc-a620-405a-b66d-0f686cdae586 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:52.690460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d2fa2fc-a620-405a-b66d-0f686cdae586 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:52.691010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d2fa2fc-a620-405a-b66d-0f686cdae586 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:53.108954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-49193004-81ff-4cd9-98e2-3557e3b1719a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:53.120404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-49193004-81ff-4cd9-98e2-3557e3b1719a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:53.121944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-49193004-81ff-4cd9-98e2-3557e3b1719a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:53.123153 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-49193004-81ff-4cd9-98e2-3557e3b1719a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.127726 Aug 03 02:07:53.134185 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1901/3924] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:51 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:07:53.141251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d03d1fd2-76c7-43ab-b507-78206746c6d9 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:53.146327 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:07:53.146327 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 02:07:53.172887 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d03d1fd2-76c7-43ab-b507-78206746c6d9 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.037479 Aug 03 02:07:53.174122 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1902/3925] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 02:07:53 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:53.185812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-adb4b441-082b-4e67-b0c4-152c068f4e63 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-321595993", "availability_zone": "foo_zone"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:53.197218 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:07:53.197218 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 02:07:53.283852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5d2fa2fc-a620-405a-b66d-0f686cdae586 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:53.292200 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-adb4b441-082b-4e67-b0c4-152c068f4e63 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] 10.222.0.67 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.109560 Aug 03 02:07:53.299111 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5d2fa2fc-a620-405a-b66d-0f686cdae586 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1466 microversion: 2.1 time: 0.642451 Aug 03 02:07:53.299885 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1903/3926] 10.222.0.67 () {60 vars in 1173 bytes} [Wed Aug 3 02:07:53 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:07:53.314816 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2024/3927] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:52 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1466 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:53.321597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dbc75f2b-97f7-49a0-8b42-d26e04c5ee91 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:53.322473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dbc75f2b-97f7-49a0-8b42-d26e04c5ee91 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 4c93a8f4-a14e-4937-a7bd-641747f3b86b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:53.335892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbc75f2b-97f7-49a0-8b42-d26e04c5ee91 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:53.336722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4fffddcb-f847-490a-a6ee-48080548f4f4 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:53.339723 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:07:53.339723 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 02:07:53.340775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbc75f2b-97f7-49a0-8b42-d26e04c5ee91 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:53.342150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbc75f2b-97f7-49a0-8b42-d26e04c5ee91 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:53.342874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbc75f2b-97f7-49a0-8b42-d26e04c5ee91 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:53.390394 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4fffddcb-f847-490a-a6ee-48080548f4f4 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.063719 Aug 03 02:07:53.391664 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1904/3928] 10.222.0.67 () {60 vars in 1194 bytes} [Wed Aug 3 02:07:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:53.402969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-71de057c-81ac-4754-bb8c-5a8d699c3539 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:53.404040 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:07:53.404040 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 02:07:53.423623 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-71de057c-81ac-4754-bb8c-5a8d699c3539 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] 10.222.0.67 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.024205 Aug 03 02:07:53.424793 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1905/3929] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 02:07:53 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:53.437736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c77a7205-3850-4b41-8a37-33cba61dfdd6 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826529-8"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:53.440651 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:07:53.440651 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 02:07:53.464230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c77a7205-3850-4b41-8a37-33cba61dfdd6 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:53.465030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c77a7205-3850-4b41-8a37-33cba61dfdd6 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:53.478063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:07:53.909577 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c77a7205-3850-4b41-8a37-33cba61dfdd6 tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] 10.222.0.67 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.475386 Aug 03 02:07:53.917213 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1906/3930] 10.222.0.67 () {60 vars in 1194 bytes} [Wed Aug 3 02:07:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:07:53.922545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ebe154f8-88f9-434a-9de8-91d358a8c49b tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:53.923654 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:07:53.923654 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 02:07:53.971198 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ebe154f8-88f9-434a-9de8-91d358a8c49b tempest-TestAggregatesBasicOps-1807934296 tempest-TestAggregatesBasicOps-1807934296-project-admin] 10.222.0.67 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.051199 Aug 03 02:07:53.977355 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1907/3931] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 02:07:53 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 02:07:54.153440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e1b897ec-3c4c-4642-8c1f-9310ebb8dfcc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:54.154148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e1b897ec-3c4c-4642-8c1f-9310ebb8dfcc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:54.165236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1b897ec-3c4c-4642-8c1f-9310ebb8dfcc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:54.165716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1b897ec-3c4c-4642-8c1f-9310ebb8dfcc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:54.170534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1b897ec-3c4c-4642-8c1f-9310ebb8dfcc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:54.171159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1b897ec-3c4c-4642-8c1f-9310ebb8dfcc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:54.194302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dbc75f2b-97f7-49a0-8b42-d26e04c5ee91 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:54.211486 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dbc75f2b-97f7-49a0-8b42-d26e04c5ee91 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b" status: 200 len: 1471 microversion: 2.1 time: 0.894294 Aug 03 02:07:54.221857 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2025/3932] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:07:53 2022] GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b => generated 1471 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:54.252303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4706779b-8452-4228-a697-9ec35d8401a1 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-333365295"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:07:54.256611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4706779b-8452-4228-a697-9ec35d8401a1 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 4c93a8f4-a14e-4937-a7bd-641747f3b86b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:54.271988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4706779b-8452-4228-a697-9ec35d8401a1 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:54.276542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4706779b-8452-4228-a697-9ec35d8401a1 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:54.280097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4706779b-8452-4228-a697-9ec35d8401a1 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:54.280767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4706779b-8452-4228-a697-9ec35d8401a1 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:54.754427 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4706779b-8452-4228-a697-9ec35d8401a1 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "POST /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b/action" status: 202 len: 0 microversion: 2.1 time: 0.513820 Aug 03 02:07:54.761105 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2026/3933] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:07:54 2022] POST /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 03 02:07:54.773633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a65f1e34-fdf6-4449-8443-bfa68be3417b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b1233e430>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:54.875486 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a65f1e34-fdf6-4449-8443-bfa68be3417b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf" status: 200 len: 1454 microversion: 2.1 time: 0.112880 Aug 03 02:07:54.889165 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2027/3934] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:07:54 2022] GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:55.115376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e1b897ec-3c4c-4642-8c1f-9310ebb8dfcc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:55.137547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e1b897ec-3c4c-4642-8c1f-9310ebb8dfcc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:55.148591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e1b897ec-3c4c-4642-8c1f-9310ebb8dfcc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:55.149434 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e1b897ec-3c4c-4642-8c1f-9310ebb8dfcc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.000924 Aug 03 02:07:55.150262 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1908/3935] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:54 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:07:55.897083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-46d29e75-08ab-44f0-bf82-a76fa5aed5a4 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b123278b0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:55.994689 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-46d29e75-08ab-44f0-bf82-a76fa5aed5a4 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf" status: 200 len: 1454 microversion: 2.1 time: 0.101905 Aug 03 02:07:55.996303 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2028/3936] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:07:55 2022] GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:56.181619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-34421ce6-82e6-4614-b8be-24572330c8fe tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:56.183155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-34421ce6-82e6-4614-b8be-24572330c8fe tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:56.197921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34421ce6-82e6-4614-b8be-24572330c8fe tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:56.203243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34421ce6-82e6-4614-b8be-24572330c8fe tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:56.204376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34421ce6-82e6-4614-b8be-24572330c8fe tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:56.205010 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34421ce6-82e6-4614-b8be-24572330c8fe tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:57.012490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dd9be115-bec3-4e3b-b3e0-fed768d88758 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b122fff70>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:57.137288 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dd9be115-bec3-4e3b-b3e0-fed768d88758 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf" status: 200 len: 1454 microversion: 2.1 time: 0.130517 Aug 03 02:07:57.141882 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2029/3937] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:07:57 2022] GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:57.427895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-34421ce6-82e6-4614-b8be-24572330c8fe tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:57.448784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-34421ce6-82e6-4614-b8be-24572330c8fe tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:57.451357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-34421ce6-82e6-4614-b8be-24572330c8fe tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:07:57.454936 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-34421ce6-82e6-4614-b8be-24572330c8fe tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.283760 Aug 03 02:07:57.461587 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1909/3938] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:56 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:07:57.849713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dba058dc-3764-4697-8ecb-550390c8a8dc tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:57.850469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dba058dc-3764-4697-8ecb-550390c8a8dc tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:57.863570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dba058dc-3764-4697-8ecb-550390c8a8dc tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:57.864502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dba058dc-3764-4697-8ecb-550390c8a8dc tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:57.865654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dba058dc-3764-4697-8ecb-550390c8a8dc tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:57.866276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dba058dc-3764-4697-8ecb-550390c8a8dc tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:57.922474 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dba058dc-3764-4697-8ecb-550390c8a8dc tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/ips" status: 200 len: 148 microversion: 2.1 time: 0.348246 Aug 03 02:07:57.923486 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2030/3939] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 02:07:57 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/ips => generated 148 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:07:58.153729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6035b97a-ce8f-4209-8a60-21a4eca3b5d1 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b244da670>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:58.268784 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6035b97a-ce8f-4209-8a60-21a4eca3b5d1 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf" status: 200 len: 1454 microversion: 2.1 time: 0.117290 Aug 03 02:07:58.272775 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1910/3940] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:07:58 2022] GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:07:58.487663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8aad16a3-9586-4dd0-b057-cdfdd27b152a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:07:58.488464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8aad16a3-9586-4dd0-b057-cdfdd27b152a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:07:58.504986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8aad16a3-9586-4dd0-b057-cdfdd27b152a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:58.505438 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8aad16a3-9586-4dd0-b057-cdfdd27b152a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:58.509995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8aad16a3-9586-4dd0-b057-cdfdd27b152a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:07:58.512503 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8aad16a3-9586-4dd0-b057-cdfdd27b152a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:07:59.297045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c1eb5d53-7f5b-4db5-9067-f6d7b40f7e4d tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b12a53820>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:00.098870 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8aad16a3-9586-4dd0-b057-cdfdd27b152a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:00.109843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8aad16a3-9586-4dd0-b057-cdfdd27b152a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:00.135051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8aad16a3-9586-4dd0-b057-cdfdd27b152a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:00.144588 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8aad16a3-9586-4dd0-b057-cdfdd27b152a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.659518 Aug 03 02:08:00.160637 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2031/3941] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:07:58 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:00.754817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-73310d3d-7b1e-45ad-b3f6-13eeb07e8bf0 req-4f9d661d-4f19-48c4-a225-e34da1d2a85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c93a8f4-a14e-4937-a7bd-641747f3b86b", "name": "network-vif-plugged", "status": "completed", "tag": "a63917f9-9c39-45f8-a71c-b65c4056617d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:00.762697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:08:00.778774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-73310d3d-7b1e-45ad-b3f6-13eeb07e8bf0 req-4f9d661d-4f19-48c4-a225-e34da1d2a85a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:00.788519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-73310d3d-7b1e-45ad-b3f6-13eeb07e8bf0 req-4f9d661d-4f19-48c4-a225-e34da1d2a85a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:00.805711 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-73310d3d-7b1e-45ad-b3f6-13eeb07e8bf0 req-4f9d661d-4f19-48c4-a225-e34da1d2a85a service nova] Creating event network-vif-plugged:a63917f9-9c39-45f8-a71c-b65c4056617d for instance 4c93a8f4-a14e-4937-a7bd-641747f3b86b on n-h1-826529-8 Aug 03 02:08:00.818529 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-73310d3d-7b1e-45ad-b3f6-13eeb07e8bf0 req-4f9d661d-4f19-48c4-a225-e34da1d2a85a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077553 Aug 03 02:08:00.829074 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2032/3942] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:08:01.174588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-81f79d35-9067-41e6-bed5-e81d1851f187 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:01.176845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-81f79d35-9067-41e6-bed5-e81d1851f187 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:01.201208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81f79d35-9067-41e6-bed5-e81d1851f187 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:01.201974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81f79d35-9067-41e6-bed5-e81d1851f187 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:01.202971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81f79d35-9067-41e6-bed5-e81d1851f187 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:01.205168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81f79d35-9067-41e6-bed5-e81d1851f187 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:01.565301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:08:02.687004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-81f79d35-9067-41e6-bed5-e81d1851f187 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:02.714019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-81f79d35-9067-41e6-bed5-e81d1851f187 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:02.726287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-81f79d35-9067-41e6-bed5-e81d1851f187 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:02.732372 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-81f79d35-9067-41e6-bed5-e81d1851f187 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.558934 Aug 03 02:08:02.759094 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2033/3943] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:01 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:08:02.773996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f0c25bf2-4875-4d38-b53c-9eb2a03464a5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73d495e5-b5f3-41ab-b59e-ed8f3f48d150"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:02.782445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f0c25bf2-4875-4d38-b53c-9eb2a03464a5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:02.803569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f0c25bf2-4875-4d38-b53c-9eb2a03464a5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:02.804302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f0c25bf2-4875-4d38-b53c-9eb2a03464a5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:02.805301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f0c25bf2-4875-4d38-b53c-9eb2a03464a5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:02.805912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f0c25bf2-4875-4d38-b53c-9eb2a03464a5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:03.985828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:08:04.359415 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f0c25bf2-4875-4d38-b53c-9eb2a03464a5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "POST /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.592206 Aug 03 02:08:04.365611 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2034/3944] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:08:02 2022] POST /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments => generated 194 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:08:04.388853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2be1e01e-4aaf-4227-968e-657889cc98c5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:04.389559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2be1e01e-4aaf-4227-968e-657889cc98c5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:04.419776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2be1e01e-4aaf-4227-968e-657889cc98c5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:04.420231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2be1e01e-4aaf-4227-968e-657889cc98c5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:04.427540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2be1e01e-4aaf-4227-968e-657889cc98c5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:04.428002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2be1e01e-4aaf-4227-968e-657889cc98c5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:05.402151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2be1e01e-4aaf-4227-968e-657889cc98c5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:05.413390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2be1e01e-4aaf-4227-968e-657889cc98c5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:05.423432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2be1e01e-4aaf-4227-968e-657889cc98c5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:05.428062 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2be1e01e-4aaf-4227-968e-657889cc98c5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.060860 Aug 03 02:08:05.444579 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2035/3945] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:04 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:06.084406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-89b47c1d-4120-407e-8bc9-376300f3ebb2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:06.085027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-89b47c1d-4120-407e-8bc9-376300f3ebb2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:06.095728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89b47c1d-4120-407e-8bc9-376300f3ebb2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:06.096183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89b47c1d-4120-407e-8bc9-376300f3ebb2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:06.097690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89b47c1d-4120-407e-8bc9-376300f3ebb2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:06.098344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89b47c1d-4120-407e-8bc9-376300f3ebb2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:06.188888 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c1eb5d53-7f5b-4db5-9067-f6d7b40f7e4d tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf" status: 200 len: 1454 microversion: 2.1 time: 6.908336 Aug 03 02:08:06.189600 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1911/3946] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:07:59 2022] GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf => generated 1454 bytes in 6910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:06.454600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:08:06.460474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-77c7e400-2c15-452b-8bcb-3d808a00a838 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:06.460589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-77c7e400-2c15-452b-8bcb-3d808a00a838 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:06.473857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77c7e400-2c15-452b-8bcb-3d808a00a838 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:06.477604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77c7e400-2c15-452b-8bcb-3d808a00a838 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:06.479914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77c7e400-2c15-452b-8bcb-3d808a00a838 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:06.496405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77c7e400-2c15-452b-8bcb-3d808a00a838 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:06.962752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-89b47c1d-4120-407e-8bc9-376300f3ebb2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:06.984394 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-89b47c1d-4120-407e-8bc9-376300f3ebb2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1681 microversion: 2.1 time: 0.904309 Aug 03 02:08:07.000174 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2036/3947] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:08:06 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1681 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:07.205471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-38da2b11-2ce1-41ba-8bdb-188a2e29430f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b122d9e50>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:07.295401 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-38da2b11-2ce1-41ba-8bdb-188a2e29430f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf" status: 200 len: 1454 microversion: 2.1 time: 0.095007 Aug 03 02:08:07.295977 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2037/3948] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:07 2022] GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:08:07.686188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-77c7e400-2c15-452b-8bcb-3d808a00a838 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:07.705340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-77c7e400-2c15-452b-8bcb-3d808a00a838 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:07.712589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-77c7e400-2c15-452b-8bcb-3d808a00a838 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:07.717494 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-77c7e400-2c15-452b-8bcb-3d808a00a838 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.260112 Aug 03 02:08:07.719075 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1912/3949] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:06 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:08:08.007767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9598173d-0987-4d81-bbb7-3570e97a46fc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:08.008791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9598173d-0987-4d81-bbb7-3570e97a46fc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:08.024984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9598173d-0987-4d81-bbb7-3570e97a46fc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:08.026889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9598173d-0987-4d81-bbb7-3570e97a46fc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:08.028037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9598173d-0987-4d81-bbb7-3570e97a46fc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:08.028853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9598173d-0987-4d81-bbb7-3570e97a46fc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:08.310618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b758d453-1707-4bb9-91d1-e5c19b68c807 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b12a53160>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:08.432512 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b758d453-1707-4bb9-91d1-e5c19b68c807 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf" status: 200 len: 1454 microversion: 2.1 time: 0.125800 Aug 03 02:08:08.436014 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1913/3950] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:08 2022] GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:08.445125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9598173d-0987-4d81-bbb7-3570e97a46fc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:08.456261 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9598173d-0987-4d81-bbb7-3570e97a46fc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.452502 Aug 03 02:08:08.475106 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2038/3951] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:08:08 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:08.493822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-499abde6-41a2-4663-8fe6-43e124d83658 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1894929365"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:08.496180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-499abde6-41a2-4663-8fe6-43e124d83658 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:08.510813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-499abde6-41a2-4663-8fe6-43e124d83658 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:08.511289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-499abde6-41a2-4663-8fe6-43e124d83658 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:08.512080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-499abde6-41a2-4663-8fe6-43e124d83658 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:08.512528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-499abde6-41a2-4663-8fe6-43e124d83658 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:08.539867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=78 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:08:08.752082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-470c7502-e21c-4963-81fc-bae0da5c0d3b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:08.753042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-470c7502-e21c-4963-81fc-bae0da5c0d3b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:08.762554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-470c7502-e21c-4963-81fc-bae0da5c0d3b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:08.764899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-470c7502-e21c-4963-81fc-bae0da5c0d3b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:08.771601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-470c7502-e21c-4963-81fc-bae0da5c0d3b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:08.772309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-470c7502-e21c-4963-81fc-bae0da5c0d3b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:09.027382 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-499abde6-41a2-4663-8fe6-43e124d83658 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.538935 Aug 03 02:08:09.031906 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1914/3952] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:08:08 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 03 02:08:09.449670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-afd5b597-ca0b-4f24-bb58-a1612c5ec626 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b130381f0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:09.529637 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-afd5b597-ca0b-4f24-bb58-a1612c5ec626 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf" status: 200 len: 1454 microversion: 2.1 time: 0.084764 Aug 03 02:08:09.531528 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1915/3953] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:09 2022] GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:09.896213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-470c7502-e21c-4963-81fc-bae0da5c0d3b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:09.918533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-470c7502-e21c-4963-81fc-bae0da5c0d3b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:09.921998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-470c7502-e21c-4963-81fc-bae0da5c0d3b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:09.929192 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-470c7502-e21c-4963-81fc-bae0da5c0d3b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.187328 Aug 03 02:08:09.931555 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2039/3954] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:08 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:10.551606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8790e121-fd0c-4792-a3b5-dc04fd6c430d tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b1306b940>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:10.642094 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8790e121-fd0c-4792-a3b5-dc04fd6c430d tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf" status: 200 len: 1454 microversion: 2.1 time: 0.099740 Aug 03 02:08:10.650136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-bb44ea6b-671c-4715-ac9a-111b9081f669 req-76c3399f-7970-4640-b3ce-cef6f345dc94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9952a14-056b-4b74-ab8c-791d16592ddf", "name": "network-vif-unplugged", "status": "completed", "tag": "6377bbf1-10a0-437b-a4d1-7bd2f82f03fe"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:10.653682 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1916/3955] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:10 2022] GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:10.678885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bb44ea6b-671c-4715-ac9a-111b9081f669 req-76c3399f-7970-4640-b3ce-cef6f345dc94 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:10.685690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bb44ea6b-671c-4715-ac9a-111b9081f669 req-76c3399f-7970-4640-b3ce-cef6f345dc94 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:10.713511 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-bb44ea6b-671c-4715-ac9a-111b9081f669 req-76c3399f-7970-4640-b3ce-cef6f345dc94 service nova] Creating event network-vif-unplugged:6377bbf1-10a0-437b-a4d1-7bd2f82f03fe for instance b9952a14-056b-4b74-ab8c-791d16592ddf on n-h1-826529-8 Aug 03 02:08:10.725723 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-bb44ea6b-671c-4715-ac9a-111b9081f669 req-76c3399f-7970-4640-b3ce-cef6f345dc94 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077728 Aug 03 02:08:10.731839 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2040/3956] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:08:10.964701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7ac10b9e-dce9-4559-8428-559deeb493ff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:10.966227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7ac10b9e-dce9-4559-8428-559deeb493ff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:10.980231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ac10b9e-dce9-4559-8428-559deeb493ff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:10.980982 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ac10b9e-dce9-4559-8428-559deeb493ff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:10.984919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ac10b9e-dce9-4559-8428-559deeb493ff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:10.986227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ac10b9e-dce9-4559-8428-559deeb493ff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:11.665199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ff5b161c-0f96-49e4-bb72-806f628f1cf0 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b123d70d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:11.821889 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ff5b161c-0f96-49e4-bb72-806f628f1cf0 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf" status: 200 len: 1454 microversion: 2.1 time: 0.167468 Aug 03 02:08:11.822536 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2041/3957] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:11 2022] GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:08:11.980361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7ac10b9e-dce9-4559-8428-559deeb493ff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:11.991934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7ac10b9e-dce9-4559-8428-559deeb493ff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:12.012100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7ac10b9e-dce9-4559-8428-559deeb493ff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:12.030476 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7ac10b9e-dce9-4559-8428-559deeb493ff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.058029 Aug 03 02:08:12.031561 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1917/3958] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:10 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:12.839422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-239b138a-3281-4104-b7ec-5f28483ba558 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b12335f70>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:12.994785 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-239b138a-3281-4104-b7ec-5f28483ba558 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf" status: 200 len: 1454 microversion: 2.1 time: 0.161045 Aug 03 02:08:12.997090 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2042/3959] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:12 2022] GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:13.059759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-288faef1-6ef4-4fd4-ab00-51a43e16f41a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:13.060422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-288faef1-6ef4-4fd4-ab00-51a43e16f41a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:13.072059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-288faef1-6ef4-4fd4-ab00-51a43e16f41a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:13.091174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-288faef1-6ef4-4fd4-ab00-51a43e16f41a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:13.099612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-288faef1-6ef4-4fd4-ab00-51a43e16f41a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:13.103570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-288faef1-6ef4-4fd4-ab00-51a43e16f41a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:14.012071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-14c1e37d-e356-4c48-b8cb-9f0fa3c6a7d6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b123d74c0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:14.310834 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-14c1e37d-e356-4c48-b8cb-9f0fa3c6a7d6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf" status: 200 len: 1454 microversion: 2.1 time: 0.304441 Aug 03 02:08:14.311910 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2043/3960] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:14 2022] GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf => generated 1454 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:14.527893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-288faef1-6ef4-4fd4-ab00-51a43e16f41a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:14.548704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-288faef1-6ef4-4fd4-ab00-51a43e16f41a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:14.551631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-288faef1-6ef4-4fd4-ab00-51a43e16f41a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:14.570110 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-288faef1-6ef4-4fd4-ab00-51a43e16f41a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.514068 Aug 03 02:08:14.573845 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1918/3961] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:13 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:15.328504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b0c0dc77-3929-4af0-9c4e-cb77ae711fa0 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b12292e50>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:15.601728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8107b139-6e5b-495a-b2b7-53f0d018422d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:15.602461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8107b139-6e5b-495a-b2b7-53f0d018422d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:15.627018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8107b139-6e5b-495a-b2b7-53f0d018422d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:15.631318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8107b139-6e5b-495a-b2b7-53f0d018422d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:15.633379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8107b139-6e5b-495a-b2b7-53f0d018422d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:15.633856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8107b139-6e5b-495a-b2b7-53f0d018422d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:17.210117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8107b139-6e5b-495a-b2b7-53f0d018422d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:17.230282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8107b139-6e5b-495a-b2b7-53f0d018422d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:17.232016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8107b139-6e5b-495a-b2b7-53f0d018422d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:17.250358 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8107b139-6e5b-495a-b2b7-53f0d018422d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.653698 Aug 03 02:08:17.282329 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1919/3962] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:15 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:08:17.315777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-a6b274f7-b38f-4abc-b689-d9a46040eebb req-0fa1a1fb-9f7c-4137-850c-c354388cbe44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9952a14-056b-4b74-ab8c-791d16592ddf", "name": "network-vif-plugged", "status": "completed", "tag": "6377bbf1-10a0-437b-a4d1-7bd2f82f03fe"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:17.363232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a6b274f7-b38f-4abc-b689-d9a46040eebb req-0fa1a1fb-9f7c-4137-850c-c354388cbe44 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:17.363964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a6b274f7-b38f-4abc-b689-d9a46040eebb req-0fa1a1fb-9f7c-4137-850c-c354388cbe44 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:17.443844 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-a6b274f7-b38f-4abc-b689-d9a46040eebb req-0fa1a1fb-9f7c-4137-850c-c354388cbe44 service nova] Creating event network-vif-plugged:6377bbf1-10a0-437b-a4d1-7bd2f82f03fe for instance b9952a14-056b-4b74-ab8c-791d16592ddf on n-h1-826529-8 Aug 03 02:08:17.461124 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-a6b274f7-b38f-4abc-b689-d9a46040eebb req-0fa1a1fb-9f7c-4137-850c-c354388cbe44 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173802 Aug 03 02:08:17.465869 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1920/3963] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:08:18.285517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9d52e247-41fe-45ba-a08c-4da834f4604f tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:18.287850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9d52e247-41fe-45ba-a08c-4da834f4604f tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:18.358849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d52e247-41fe-45ba-a08c-4da834f4604f tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:18.360864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d52e247-41fe-45ba-a08c-4da834f4604f tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:18.368609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d52e247-41fe-45ba-a08c-4da834f4604f tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:18.370287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d52e247-41fe-45ba-a08c-4da834f4604f tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:19.076988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9d52e247-41fe-45ba-a08c-4da834f4604f tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:19.090329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9d52e247-41fe-45ba-a08c-4da834f4604f tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:19.100896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9d52e247-41fe-45ba-a08c-4da834f4604f tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:19.102182 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9d52e247-41fe-45ba-a08c-4da834f4604f tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 0.823163 Aug 03 02:08:19.106050 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1921/3964] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:18 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:20.127746 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ee54a652-9390-469e-8b99-b22a8952400a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:20.129988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ee54a652-9390-469e-8b99-b22a8952400a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:20.180569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee54a652-9390-469e-8b99-b22a8952400a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:20.181084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee54a652-9390-469e-8b99-b22a8952400a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:20.189653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee54a652-9390-469e-8b99-b22a8952400a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:20.190127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee54a652-9390-469e-8b99-b22a8952400a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:20.672340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=15 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:08:20.700217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:08:21.883544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ee54a652-9390-469e-8b99-b22a8952400a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:21.897766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ee54a652-9390-469e-8b99-b22a8952400a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:21.928107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ee54a652-9390-469e-8b99-b22a8952400a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:21.936250 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ee54a652-9390-469e-8b99-b22a8952400a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.810496 Aug 03 02:08:21.942037 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1922/3965] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:20 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:22.975139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-669996d8-7ca8-4f56-a548-418c6e3e4277 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:22.975760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-669996d8-7ca8-4f56-a548-418c6e3e4277 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:23.026789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-669996d8-7ca8-4f56-a548-418c6e3e4277 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:23.027309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-669996d8-7ca8-4f56-a548-418c6e3e4277 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:23.037652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-669996d8-7ca8-4f56-a548-418c6e3e4277 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:23.038217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-669996d8-7ca8-4f56-a548-418c6e3e4277 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:24.304493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-669996d8-7ca8-4f56-a548-418c6e3e4277 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:24.331893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-669996d8-7ca8-4f56-a548-418c6e3e4277 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:24.333418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-669996d8-7ca8-4f56-a548-418c6e3e4277 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:24.334806 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-669996d8-7ca8-4f56-a548-418c6e3e4277 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.368542 Aug 03 02:08:24.373390 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1923/3966] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:22 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:25.392930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-68597f92-3e0f-47a4-97cf-3fcdd33dd587 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:25.396241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-68597f92-3e0f-47a4-97cf-3fcdd33dd587 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:25.429813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68597f92-3e0f-47a4-97cf-3fcdd33dd587 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:25.431931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68597f92-3e0f-47a4-97cf-3fcdd33dd587 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:25.435362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68597f92-3e0f-47a4-97cf-3fcdd33dd587 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:25.437583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68597f92-3e0f-47a4-97cf-3fcdd33dd587 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:26.619482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-68597f92-3e0f-47a4-97cf-3fcdd33dd587 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:26.637101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-68597f92-3e0f-47a4-97cf-3fcdd33dd587 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:26.648008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-68597f92-3e0f-47a4-97cf-3fcdd33dd587 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:26.651984 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-68597f92-3e0f-47a4-97cf-3fcdd33dd587 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.264415 Aug 03 02:08:26.655613 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1924/3967] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:25 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:26.685269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9e86819c-92a1-4bb7-887a-6102a7fb1bd3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73d495e5-b5f3-41ab-b59e-ed8f3f48d150"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:26.698117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9e86819c-92a1-4bb7-887a-6102a7fb1bd3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:26.730645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e86819c-92a1-4bb7-887a-6102a7fb1bd3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:26.731509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e86819c-92a1-4bb7-887a-6102a7fb1bd3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:26.740104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e86819c-92a1-4bb7-887a-6102a7fb1bd3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:26.747367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e86819c-92a1-4bb7-887a-6102a7fb1bd3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:26.991888 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-9e86819c-92a1-4bb7-887a-6102a7fb1bd3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] HTTP exception thrown: Invalid volume: volume 73d495e5-b5f3-41ab-b59e-ed8f3f48d150 is already attached to instances: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9e86819c-92a1-4bb7-887a-6102a7fb1bd3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Request method failure captured: Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments HTTP/1.1 Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 74 Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dc0-Ae8If7bfOWI7RRBvc1phU63xlLSU5btj5ety_8fStzHcWU-vXHDYz4xfjE-ye9BJl2yypV_nSYHeeO1JR8qxTOON-NMvFY2KC116gH7mE5fGt58cYvDLyGtxXNTQSJt4xclgIAdKb4vD1HYJAxEQ3OrVusgb2MtJ9SsttIsaGA Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a5bc12da9a94f63bb71700bd01cf416", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}] Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4c1fb7af331344dcb26c43368a9daa6e Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: {"volumeAttachment": {"volumeId": "73d495e5-b5f3-41ab-b59e-ed8f3f48d150"}} Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid volume: volume 73d495e5-b5f3-41ab-b59e-ed8f3f48d150 is already attached to instances: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'server_id': '3f1ef30e-5b4e-43ac-84ce-2a3a69d77340', 'body': {'volumeAttachment': {'volumeId': '73d495e5-b5f3-41ab-b59e-ed8f3f48d150'}}} Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 73d495e5-b5f3-41ab-b59e-ed8f3f48d150 is already attached to instances: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:08:26.996719 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:08:27.000304 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:08:27.000304 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:08:27.000304 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 02:08:27.000304 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 02:08:27.000304 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 73d495e5-b5f3-41ab-b59e-ed8f3f48d150 is already attached to instances: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 Aug 03 02:08:27.000304 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:08:27.000304 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:08:27.000304 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:08:27.000304 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:08:27.000304 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:08:27.000304 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:08:27.000304 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:08:27.000304 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:08:27.000304 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 73d495e5-b5f3-41ab-b59e-ed8f3f48d150 is already attached to instances: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 Aug 03 02:08:27.000304 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:08:27.005298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9e86819c-92a1-4bb7-887a-6102a7fb1bd3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Returning 400 to user: Invalid volume: volume 73d495e5-b5f3-41ab-b59e-ed8f3f48d150 is already attached to instances: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:08:27.008964 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9e86819c-92a1-4bb7-887a-6102a7fb1bd3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "POST /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.344651 Aug 03 02:08:27.030625 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1925/3968] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:08:26 2022] POST /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments => generated 174 bytes in 374 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:08:27.916302 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b0c0dc77-3929-4af0-9c4e-cb77ae711fa0 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf" status: 200 len: 1463 microversion: 2.1 time: 12.593174 Aug 03 02:08:27.917317 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2044/3969] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:15 2022] GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf => generated 1463 bytes in 12595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:27.927271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5e7a8d69-cb02-4522-be00-a4aff50b3859 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:27.929978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5e7a8d69-cb02-4522-be00-a4aff50b3859 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:27.942410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e7a8d69-cb02-4522-be00-a4aff50b3859 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:27.943561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e7a8d69-cb02-4522-be00-a4aff50b3859 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:27.944790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e7a8d69-cb02-4522-be00-a4aff50b3859 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:27.945459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e7a8d69-cb02-4522-be00-a4aff50b3859 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:27.988851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1483009279", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "002d8f01-6162-4749-8661-bb73108d5b00"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:28.188294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] validate_networks() for [('002d8f01-6162-4749-8661-bb73108d5b00', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:08:28.257699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-5e7a8d69-cb02-4522-be00-a4aff50b3859 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lazy-loading 'services' on Instance uuid 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:08:28.457745 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5e7a8d69-cb02-4522-be00-a4aff50b3859 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments/73d495e5-b5f3-41ab-b59e-ed8f3f48d150" status: 202 len: 0 microversion: 2.1 time: 0.538974 Aug 03 02:08:28.458998 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2045/3970] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:08:27 2022] DELETE /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments/73d495e5-b5f3-41ab-b59e-ed8f3f48d150 => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:08:28.470838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7d4ae134-7142-4dbb-af16-3a1b0442a29c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:28.472319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7d4ae134-7142-4dbb-af16-3a1b0442a29c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:28.493158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d4ae134-7142-4dbb-af16-3a1b0442a29c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:28.496392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d4ae134-7142-4dbb-af16-3a1b0442a29c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:28.499757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d4ae134-7142-4dbb-af16-3a1b0442a29c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:28.500405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d4ae134-7142-4dbb-af16-3a1b0442a29c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:29.177998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7d4ae134-7142-4dbb-af16-3a1b0442a29c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:29.202995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7d4ae134-7142-4dbb-af16-3a1b0442a29c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:29.207817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7d4ae134-7142-4dbb-af16-3a1b0442a29c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:29.211798 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7d4ae134-7142-4dbb-af16-3a1b0442a29c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 0.751305 Aug 03 02:08:29.214957 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2046/3971] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:28 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:29.223797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ae698db4-9d2e-4719-a62b-80a9df5c12be tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b125d2040>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:29.318229 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ae698db4-9d2e-4719-a62b-80a9df5c12be tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf" status: 200 len: 1463 microversion: 2.1 time: 0.101849 Aug 03 02:08:29.325559 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2047/3972] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:29 2022] GET /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf => generated 1463 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:29.345850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-404a6d52-f272-4f4e-87b3-1028bd527243 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:29.356295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-404a6d52-f272-4f4e-87b3-1028bd527243 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:29.367159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-404a6d52-f272-4f4e-87b3-1028bd527243 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:29.379112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-404a6d52-f272-4f4e-87b3-1028bd527243 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:29.380774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-404a6d52-f272-4f4e-87b3-1028bd527243 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:29.381601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-404a6d52-f272-4f4e-87b3-1028bd527243 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:29.458191 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-404a6d52-f272-4f4e-87b3-1028bd527243 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130279 Aug 03 02:08:29.465018 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2048/3973] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:08:29 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:08:29.480745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5e08dd35-12b3-4435-8f3c-44a150c39739 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:29.495857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5e08dd35-12b3-4435-8f3c-44a150c39739 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 4c93a8f4-a14e-4937-a7bd-641747f3b86b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:29.501379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e08dd35-12b3-4435-8f3c-44a150c39739 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:29.503461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e08dd35-12b3-4435-8f3c-44a150c39739 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:29.504675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e08dd35-12b3-4435-8f3c-44a150c39739 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:29.507738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e08dd35-12b3-4435-8f3c-44a150c39739 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:30.398280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:08:30.399561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:08:30.400357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:08:30.400984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:08:30.401605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:08:30.419466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5e08dd35-12b3-4435-8f3c-44a150c39739 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:30.432763 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5e08dd35-12b3-4435-8f3c-44a150c39739 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b" status: 200 len: 1467 microversion: 2.1 time: 0.964916 Aug 03 02:08:30.438835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:30.452905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:30.453400 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2049/3974] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:08:29 2022] GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b => generated 1467 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:30.462989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:30.467497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5ebd608c-4d80-4394-9626-cfb5cf41d3f3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:30.468371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:30.473281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5ebd608c-4d80-4394-9626-cfb5cf41d3f3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:30.490710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ebd608c-4d80-4394-9626-cfb5cf41d3f3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:30.493198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ebd608c-4d80-4394-9626-cfb5cf41d3f3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:30.496565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ebd608c-4d80-4394-9626-cfb5cf41d3f3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:30.497338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ebd608c-4d80-4394-9626-cfb5cf41d3f3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:30.529179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Getting quotas for project 7860216e78de4669a9cca22c3ce50b46. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:08:30.546492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Getting quotas for user 25f6ae83e43943aba392814da0ac6fc2 and project 7860216e78de4669a9cca22c3ce50b46. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:08:30.596691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:08:30.599771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:08:30.736442 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-28fa1893-100f-4afb-9c01-125f9daac52a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.704038 Aug 03 02:08:30.738058 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1926/3975] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 02:08:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3706 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 02:08:30.749784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0cf645d1-8468-4df6-b818-310f3199fab4 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-202701040"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:30.753644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0cf645d1-8468-4df6-b818-310f3199fab4 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:30.767207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cf645d1-8468-4df6-b818-310f3199fab4 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:30.769752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cf645d1-8468-4df6-b818-310f3199fab4 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:30.771252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cf645d1-8468-4df6-b818-310f3199fab4 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:30.771865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cf645d1-8468-4df6-b818-310f3199fab4 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:31.106922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ebd608c-4d80-4394-9626-cfb5cf41d3f3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:31.120566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ebd608c-4d80-4394-9626-cfb5cf41d3f3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:31.124965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ebd608c-4d80-4394-9626-cfb5cf41d3f3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:31.128001 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5ebd608c-4d80-4394-9626-cfb5cf41d3f3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 0.673286 Aug 03 02:08:31.132383 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2050/3976] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:30 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:31.137994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-65a1dc36-639b-4349-9769-aa79f4b8c240 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:31.149943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-65a1dc36-639b-4349-9769-aa79f4b8c240 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:31.172752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65a1dc36-639b-4349-9769-aa79f4b8c240 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:31.173610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65a1dc36-639b-4349-9769-aa79f4b8c240 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:31.177832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65a1dc36-639b-4349-9769-aa79f4b8c240 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:31.180651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65a1dc36-639b-4349-9769-aa79f4b8c240 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:31.259341 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0cf645d1-8468-4df6-b818-310f3199fab4 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "POST /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2/action" status: 202 len: 0 microversion: 2.1 time: 0.518839 Aug 03 02:08:31.261850 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1927/3977] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:08:30 2022] POST /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 02:08:31.270860 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-65a1dc36-639b-4349-9769-aa79f4b8c240 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137055 Aug 03 02:08:31.275493 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2051/3978] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:08:31 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:08:31.289787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bb444a7a-9a3a-4f30-8ca7-78d4d8355f94 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b1228fc10>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:31.292635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0eb8c25a-e3fc-4c3b-b613-04ce6b603c12 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:31.293444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0eb8c25a-e3fc-4c3b-b613-04ce6b603c12 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:31.417432 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bb444a7a-9a3a-4f30-8ca7-78d4d8355f94 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5" status: 200 len: 1454 microversion: 2.1 time: 0.139629 Aug 03 02:08:31.418029 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2052/3979] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:31 2022] GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5 => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:31.463212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0eb8c25a-e3fc-4c3b-b613-04ce6b603c12 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:31.473687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0eb8c25a-e3fc-4c3b-b613-04ce6b603c12 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:31.475960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0eb8c25a-e3fc-4c3b-b613-04ce6b603c12 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:31.479698 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0eb8c25a-e3fc-4c3b-b613-04ce6b603c12 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 200 len: 1259 microversion: 2.21 time: 0.210218 Aug 03 02:08:31.482728 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1928/3980] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:31 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:32.159265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-363a2184-36c3-4dac-9c18-00135cf62b6d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:32.160557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-363a2184-36c3-4dac-9c18-00135cf62b6d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:32.184175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-363a2184-36c3-4dac-9c18-00135cf62b6d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:32.184887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-363a2184-36c3-4dac-9c18-00135cf62b6d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:32.185884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-363a2184-36c3-4dac-9c18-00135cf62b6d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:32.190856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-363a2184-36c3-4dac-9c18-00135cf62b6d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:32.287280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-359aa195-fcb7-43ba-8a75-1468c5b39da5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:32.290416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-359aa195-fcb7-43ba-8a75-1468c5b39da5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:32.310633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-359aa195-fcb7-43ba-8a75-1468c5b39da5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:32.315283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-359aa195-fcb7-43ba-8a75-1468c5b39da5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:32.317883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-359aa195-fcb7-43ba-8a75-1468c5b39da5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:32.318575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-359aa195-fcb7-43ba-8a75-1468c5b39da5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:32.419527 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-359aa195-fcb7-43ba-8a75-1468c5b39da5 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137045 Aug 03 02:08:32.421940 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1929/3981] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:08:32 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:08:32.432941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-77d79db1-e77b-4aba-9d70-fe1256ad4aca tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b244da9d0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:32.566315 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-77d79db1-e77b-4aba-9d70-fe1256ad4aca tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5" status: 200 len: 1454 microversion: 2.1 time: 0.122835 Aug 03 02:08:32.567752 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1930/3982] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:32 2022] GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5 => generated 1454 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:08:32.579217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a38d0bac-edba-48bf-ae68-d186947e7cad tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:32.589804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a38d0bac-edba-48bf-ae68-d186947e7cad tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:32.654479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a38d0bac-edba-48bf-ae68-d186947e7cad tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:32.657379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a38d0bac-edba-48bf-ae68-d186947e7cad tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:32.661147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a38d0bac-edba-48bf-ae68-d186947e7cad tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:32.661990 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a38d0bac-edba-48bf-ae68-d186947e7cad tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:33.217415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-363a2184-36c3-4dac-9c18-00135cf62b6d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:33.266870 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-363a2184-36c3-4dac-9c18-00135cf62b6d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:33.285094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-363a2184-36c3-4dac-9c18-00135cf62b6d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:33.288193 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-363a2184-36c3-4dac-9c18-00135cf62b6d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.132946 Aug 03 02:08:33.290219 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2053/3983] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:32 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:33.312357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a38d0bac-edba-48bf-ae68-d186947e7cad tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:33.339324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a38d0bac-edba-48bf-ae68-d186947e7cad tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:33.346333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a38d0bac-edba-48bf-ae68-d186947e7cad tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:33.357223 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a38d0bac-edba-48bf-ae68-d186947e7cad tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 200 len: 1263 microversion: 2.21 time: 0.782534 Aug 03 02:08:33.364191 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1931/3984] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:32 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 1263 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:33.436220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0fc66c41-3b1a-4d2b-8a9c-a0b5edb9a69c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:33.438714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0fc66c41-3b1a-4d2b-8a9c-a0b5edb9a69c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:33.457614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0fc66c41-3b1a-4d2b-8a9c-a0b5edb9a69c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:33.462687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0fc66c41-3b1a-4d2b-8a9c-a0b5edb9a69c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:33.463736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0fc66c41-3b1a-4d2b-8a9c-a0b5edb9a69c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:33.466276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0fc66c41-3b1a-4d2b-8a9c-a0b5edb9a69c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:33.582348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cebb4a23-4a42-47a5-89b4-f6790cd1b8d0 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b13729b80>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:33.608961 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0fc66c41-3b1a-4d2b-8a9c-a0b5edb9a69c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176929 Aug 03 02:08:33.618047 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2054/3985] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:08:33 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:08:33.687686 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cebb4a23-4a42-47a5-89b4-f6790cd1b8d0 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5" status: 200 len: 1454 microversion: 2.1 time: 0.105678 Aug 03 02:08:33.693043 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1932/3986] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:33 2022] GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:34.319148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6f422580-85d2-4d49-a889-29c1ca856e1d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:34.319901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6f422580-85d2-4d49-a889-29c1ca856e1d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:34.340214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f422580-85d2-4d49-a889-29c1ca856e1d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:34.351650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f422580-85d2-4d49-a889-29c1ca856e1d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:34.354451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f422580-85d2-4d49-a889-29c1ca856e1d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:34.355187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f422580-85d2-4d49-a889-29c1ca856e1d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:34.412127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1e5eeb62-3972-4700-ba6e-bb53c23ddf2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:34.414315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1e5eeb62-3972-4700-ba6e-bb53c23ddf2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:34.452847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e5eeb62-3972-4700-ba6e-bb53c23ddf2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:34.453742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e5eeb62-3972-4700-ba6e-bb53c23ddf2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:34.460652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e5eeb62-3972-4700-ba6e-bb53c23ddf2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:34.463279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e5eeb62-3972-4700-ba6e-bb53c23ddf2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:34.919324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1e5eeb62-3972-4700-ba6e-bb53c23ddf2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:34.931188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1e5eeb62-3972-4700-ba6e-bb53c23ddf2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:34.942094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1e5eeb62-3972-4700-ba6e-bb53c23ddf2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:34.944106 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1e5eeb62-3972-4700-ba6e-bb53c23ddf2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 200 len: 1317 microversion: 2.21 time: 0.550537 Aug 03 02:08:34.954442 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1933/3987] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:34 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:08:34.971647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-58755582-5a02-41ba-a7d5-a1ab99312f37 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:34.975330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-58755582-5a02-41ba-a7d5-a1ab99312f37 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:35.008924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58755582-5a02-41ba-a7d5-a1ab99312f37 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:35.009434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58755582-5a02-41ba-a7d5-a1ab99312f37 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:35.010293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58755582-5a02-41ba-a7d5-a1ab99312f37 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:35.010749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58755582-5a02-41ba-a7d5-a1ab99312f37 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:35.114484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:08:35.165704 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-58755582-5a02-41ba-a7d5-a1ab99312f37 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210033 Aug 03 02:08:35.177882 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1934/3988] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:08:34 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:08:35.186565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1dad2b02-cf9b-4d60-a175-29cb027e3f5c tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b243fdf70>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:35.294163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6f422580-85d2-4d49-a889-29c1ca856e1d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:35.310933 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1dad2b02-cf9b-4d60-a175-29cb027e3f5c tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5" status: 200 len: 1454 microversion: 2.1 time: 0.131926 Aug 03 02:08:35.317472 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1935/3989] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:35 2022] GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5 => generated 1454 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:35.328468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6f422580-85d2-4d49-a889-29c1ca856e1d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:35.331191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6f422580-85d2-4d49-a889-29c1ca856e1d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:35.344078 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6f422580-85d2-4d49-a889-29c1ca856e1d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.030059 Aug 03 02:08:35.367783 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2055/3990] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:34 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:08:35.972493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-595c0e68-5371-4e38-bd5d-9a7c8068bb2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:35.973480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-595c0e68-5371-4e38-bd5d-9a7c8068bb2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:35.991491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-595c0e68-5371-4e38-bd5d-9a7c8068bb2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:35.995446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-595c0e68-5371-4e38-bd5d-9a7c8068bb2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:36.003985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-595c0e68-5371-4e38-bd5d-9a7c8068bb2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:36.010632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-595c0e68-5371-4e38-bd5d-9a7c8068bb2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:36.184565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fbfb1ba8-06ef-4bb2-a843-a747218e0621 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:36.187158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fbfb1ba8-06ef-4bb2-a843-a747218e0621 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:36.205088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbfb1ba8-06ef-4bb2-a843-a747218e0621 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:36.205979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbfb1ba8-06ef-4bb2-a843-a747218e0621 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:36.207088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbfb1ba8-06ef-4bb2-a843-a747218e0621 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:36.207764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fbfb1ba8-06ef-4bb2-a843-a747218e0621 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:36.306439 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fbfb1ba8-06ef-4bb2-a843-a747218e0621 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125832 Aug 03 02:08:36.310974 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2056/3991] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:08:36 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:08:36.331888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c26456fb-d91e-44c9-aa93-05a89bc7fd22 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b12360ee0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:36.677396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-595c0e68-5371-4e38-bd5d-9a7c8068bb2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:36.689182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-595c0e68-5371-4e38-bd5d-9a7c8068bb2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:36.693172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-595c0e68-5371-4e38-bd5d-9a7c8068bb2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:36.696697 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-595c0e68-5371-4e38-bd5d-9a7c8068bb2f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 200 len: 1359 microversion: 2.21 time: 0.729494 Aug 03 02:08:36.699689 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1936/3992] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:35 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 1359 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:36.730877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-50537434-02ef-461e-b75e-e52f866dd522 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:36.731570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-50537434-02ef-461e-b75e-e52f866dd522 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:36.733630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:08:36.776860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50537434-02ef-461e-b75e-e52f866dd522 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:36.779177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50537434-02ef-461e-b75e-e52f866dd522 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:36.781239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50537434-02ef-461e-b75e-e52f866dd522 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:36.782436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50537434-02ef-461e-b75e-e52f866dd522 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:37.806490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-50537434-02ef-461e-b75e-e52f866dd522 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:37.821832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-50537434-02ef-461e-b75e-e52f866dd522 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:37.828400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-50537434-02ef-461e-b75e-e52f866dd522 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:37.844281 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-50537434-02ef-461e-b75e-e52f866dd522 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.143268 Aug 03 02:08:37.866229 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1937/3993] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:36 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:37.877960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1772919481", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "0fed526e-c88d-4627-93c0-5a58caa0f12c"}, {"uuid": "4a04f43e-55c9-4acf-8b57-50e5d8648312"}, {"uuid": "0fed526e-c88d-4627-93c0-5a58caa0f12c"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:40.495092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:08:41.471508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:08:43.531461 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c26456fb-d91e-44c9-aa93-05a89bc7fd22 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5" status: 200 len: 1454 microversion: 2.1 time: 7.204579 Aug 03 02:08:43.532663 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2057/3994] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:36 2022] GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5 => generated 1454 bytes in 7207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:08:43.659436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] validate_networks() for [('0fed526e-c88d-4627-93c0-5a58caa0f12c', None, None, None, None, None), ('4a04f43e-55c9-4acf-8b57-50e5d8648312', None, None, None, None, None), ('0fed526e-c88d-4627-93c0-5a58caa0f12c', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:08:43.782068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-ae94cf1a-10ab-417a-becb-563529f42059 req-5fd0af16-142d-4a13-8a05-9069a3f720d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c93a8f4-a14e-4937-a7bd-641747f3b86b", "name": "network-vif-unplugged", "status": "completed", "tag": "a63917f9-9c39-45f8-a71c-b65c4056617d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:43.853148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ae94cf1a-10ab-417a-becb-563529f42059 req-5fd0af16-142d-4a13-8a05-9069a3f720d4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:43.855441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ae94cf1a-10ab-417a-becb-563529f42059 req-5fd0af16-142d-4a13-8a05-9069a3f720d4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:43.900540 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-ae94cf1a-10ab-417a-becb-563529f42059 req-5fd0af16-142d-4a13-8a05-9069a3f720d4 service nova] Creating event network-vif-unplugged:a63917f9-9c39-45f8-a71c-b65c4056617d for instance 4c93a8f4-a14e-4937-a7bd-641747f3b86b on n-h1-826529-8 Aug 03 02:08:43.911074 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-ae94cf1a-10ab-417a-becb-563529f42059 req-5fd0af16-142d-4a13-8a05-9069a3f720d4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.374531 Aug 03 02:08:43.912642 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2058/3995] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:08:43.923320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b4be757e-9eb6-4db0-a2ab-678da0e38020 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:43.928061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b4be757e-9eb6-4db0-a2ab-678da0e38020 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:43.984737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4be757e-9eb6-4db0-a2ab-678da0e38020 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:43.985573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4be757e-9eb6-4db0-a2ab-678da0e38020 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:43.987604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4be757e-9eb6-4db0-a2ab-678da0e38020 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:43.988378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4be757e-9eb6-4db0-a2ab-678da0e38020 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:44.145469 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b4be757e-9eb6-4db0-a2ab-678da0e38020 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.230401 Aug 03 02:08:44.155379 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2059/3996] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:08:43 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340/os-volume_attachments => generated 25 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:08:44.167390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2977a141-ce65-47d3-bf28-088009443509 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:44.168287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2977a141-ce65-47d3-bf28-088009443509 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:44.176728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2977a141-ce65-47d3-bf28-088009443509 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:44.177413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2977a141-ce65-47d3-bf28-088009443509 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:44.178369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2977a141-ce65-47d3-bf28-088009443509 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:44.178991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2977a141-ce65-47d3-bf28-088009443509 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:44.677495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2977a141-ce65-47d3-bf28-088009443509 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:44.691334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2977a141-ce65-47d3-bf28-088009443509 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:44.693528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2977a141-ce65-47d3-bf28-088009443509 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:44.695825 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2977a141-ce65-47d3-bf28-088009443509 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 200 len: 1359 microversion: 2.21 time: 0.532101 Aug 03 02:08:44.716857 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2060/3997] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:44 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 1359 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:44.743436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4d28fe63-88d4-426f-9250-fc062a7be58d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:44.744262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4d28fe63-88d4-426f-9250-fc062a7be58d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:44.754099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d28fe63-88d4-426f-9250-fc062a7be58d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:44.756022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d28fe63-88d4-426f-9250-fc062a7be58d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:44.757626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d28fe63-88d4-426f-9250-fc062a7be58d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:44.758484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d28fe63-88d4-426f-9250-fc062a7be58d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:45.189894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4d28fe63-88d4-426f-9250-fc062a7be58d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:45.203167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4d28fe63-88d4-426f-9250-fc062a7be58d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:45.204708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4d28fe63-88d4-426f-9250-fc062a7be58d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:45.206999 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4d28fe63-88d4-426f-9250-fc062a7be58d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 0.488556 Aug 03 02:08:45.207771 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2061/3998] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:44 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:45.308299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-b6e3bfc4-7c0b-4fd6-80a9-b99b5de41c6d req-cc966176-9c6a-4e53-9903-b4147ddabfc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f252a17-d550-4e2e-8527-d6445dd64816", "tag": "1c02f82c-38b3-4ab1-adea-86e1b9b4a583"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:45.325106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b6e3bfc4-7c0b-4fd6-80a9-b99b5de41c6d req-cc966176-9c6a-4e53-9903-b4147ddabfc2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:45.329508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b6e3bfc4-7c0b-4fd6-80a9-b99b5de41c6d req-cc966176-9c6a-4e53-9903-b4147ddabfc2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:45.359777 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-b6e3bfc4-7c0b-4fd6-80a9-b99b5de41c6d req-cc966176-9c6a-4e53-9903-b4147ddabfc2 service nova] Creating event network-changed:1c02f82c-38b3-4ab1-adea-86e1b9b4a583 for instance 7f252a17-d550-4e2e-8527-d6445dd64816 on n-h1-826529-8 Aug 03 02:08:45.374247 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-b6e3bfc4-7c0b-4fd6-80a9-b99b5de41c6d req-cc966176-9c6a-4e53-9903-b4147ddabfc2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165343 Aug 03 02:08:45.377203 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2062/3999] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:08:45.405255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3371e3c9-9d6e-4309-8be0-d541361c4905 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:45.408081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3371e3c9-9d6e-4309-8be0-d541361c4905 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:45.423351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3371e3c9-9d6e-4309-8be0-d541361c4905 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:45.427344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3371e3c9-9d6e-4309-8be0-d541361c4905 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:45.428515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3371e3c9-9d6e-4309-8be0-d541361c4905 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:45.429293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3371e3c9-9d6e-4309-8be0-d541361c4905 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:45.760688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3371e3c9-9d6e-4309-8be0-d541361c4905 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:45.774483 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3371e3c9-9d6e-4309-8be0-d541361c4905 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.395689 Aug 03 02:08:45.793533 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2063/4000] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:08:45 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:45.801535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5ba31b2-fa0f-4802-a417-7fc0d2ca20c0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:45.801993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5ba31b2-fa0f-4802-a417-7fc0d2ca20c0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:45.812535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5ba31b2-fa0f-4802-a417-7fc0d2ca20c0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:45.813047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5ba31b2-fa0f-4802-a417-7fc0d2ca20c0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:45.813856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5ba31b2-fa0f-4802-a417-7fc0d2ca20c0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:45.814304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5ba31b2-fa0f-4802-a417-7fc0d2ca20c0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:45.819902 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:08:45.820838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:08:45.821470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:08:45.822109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:08:45.822730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:08:45.839804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:45.843786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:45.846400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:45.851199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:45.864275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5ba31b2-fa0f-4802-a417-7fc0d2ca20c0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:08:45.916083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Getting quotas for project 9fa7b92a26924225842a35fbdf0582be. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:08:45.931553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Getting quotas for user 37f3ee587f9e4e108351dd67cc6b7796 and project 9fa7b92a26924225842a35fbdf0582be. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:08:45.970376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:08:45.990477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:08:46.002000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:08:46.214547 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-16af10b9-fc95-4728-b766-4336f8944758 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.346265 Aug 03 02:08:46.222009 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5ba31b2-fa0f-4802-a417-7fc0d2ca20c0 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 204 len: 0 microversion: 2.1 time: 0.424785 Aug 03 02:08:46.222967 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1938/4001] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:08:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 8355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:08:46.232252 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2064/4002] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:08:45 2022] DELETE /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:08:46.254344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-29a5c634-b60e-454b-a16d-198841a5a588 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b1333aee0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:46.265119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ae4ba352-6bb4-45de-9535-21c10f776e0d tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:46.266188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ae4ba352-6bb4-45de-9535-21c10f776e0d tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:46.303681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae4ba352-6bb4-45de-9535-21c10f776e0d tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:46.304771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae4ba352-6bb4-45de-9535-21c10f776e0d tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:46.306685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae4ba352-6bb4-45de-9535-21c10f776e0d tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:46.307329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae4ba352-6bb4-45de-9535-21c10f776e0d tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:46.365608 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-29a5c634-b60e-454b-a16d-198841a5a588 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5" status: 200 len: 1454 microversion: 2.1 time: 0.140747 Aug 03 02:08:46.372198 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1939/4003] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:46 2022] GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:46.403295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a352d4cb-7c2e-4e04-ba55-5084411aee0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-442441505"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:46.417152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a352d4cb-7c2e-4e04-ba55-5084411aee0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:46.435808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a352d4cb-7c2e-4e04-ba55-5084411aee0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:46.436939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a352d4cb-7c2e-4e04-ba55-5084411aee0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:46.438503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a352d4cb-7c2e-4e04-ba55-5084411aee0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:46.439600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a352d4cb-7c2e-4e04-ba55-5084411aee0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:47.012743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ae4ba352-6bb4-45de-9535-21c10f776e0d tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:47.029430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ae4ba352-6bb4-45de-9535-21c10f776e0d tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:47.031769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ae4ba352-6bb4-45de-9535-21c10f776e0d tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:47.033045 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ae4ba352-6bb4-45de-9535-21c10f776e0d tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 200 len: 1359 microversion: 2.21 time: 0.793191 Aug 03 02:08:47.035085 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2065/4004] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:46 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 1359 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:47.040665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2bf8ed73-da9e-458c-a8b4-4175ea432008 req-f812926d-3586-414a-8745-0c9dca370f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-plugged", "status": "completed", "tag": "cd112bb2-d68e-45f9-8740-1a2cdf18bce8"}, {"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-plugged", "status": "completed", "tag": "fc6e33cc-8065-4dce-baf6-a0eed37f7c52"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:47.068855 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a352d4cb-7c2e-4e04-ba55-5084411aee0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.683526 Aug 03 02:08:47.071938 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1940/4005] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:08:46 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 03 02:08:47.082884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2bf8ed73-da9e-458c-a8b4-4175ea432008 req-f812926d-3586-414a-8745-0c9dca370f6e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:47.085542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-152b2214-dca3-4f15-a6b6-9dcf4df23753 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:47.089999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2bf8ed73-da9e-458c-a8b4-4175ea432008 req-f812926d-3586-414a-8745-0c9dca370f6e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:47.092176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-152b2214-dca3-4f15-a6b6-9dcf4df23753 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:47.137775 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2bf8ed73-da9e-458c-a8b4-4175ea432008 req-f812926d-3586-414a-8745-0c9dca370f6e service nova] Creating event network-vif-plugged:cd112bb2-d68e-45f9-8740-1a2cdf18bce8 for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:08:47.140328 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2bf8ed73-da9e-458c-a8b4-4175ea432008 req-f812926d-3586-414a-8745-0c9dca370f6e service nova] Creating event network-vif-plugged:fc6e33cc-8065-4dce-baf6-a0eed37f7c52 for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:08:47.150972 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2bf8ed73-da9e-458c-a8b4-4175ea432008 req-f812926d-3586-414a-8745-0c9dca370f6e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.113670 Aug 03 02:08:47.152190 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2066/4006] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:08:47.160704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7d7cfbba-c3bf-4f48-94af-2a2dc2cfe11b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:47.162282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7d7cfbba-c3bf-4f48-94af-2a2dc2cfe11b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:47.176432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d7cfbba-c3bf-4f48-94af-2a2dc2cfe11b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:47.177146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d7cfbba-c3bf-4f48-94af-2a2dc2cfe11b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:47.178674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d7cfbba-c3bf-4f48-94af-2a2dc2cfe11b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:47.179930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d7cfbba-c3bf-4f48-94af-2a2dc2cfe11b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:47.261479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-152b2214-dca3-4f15-a6b6-9dcf4df23753 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:47.282170 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-152b2214-dca3-4f15-a6b6-9dcf4df23753 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1213 microversion: 2.1 time: 0.204934 Aug 03 02:08:47.287508 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1941/4007] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:08:47 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1213 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:47.305535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-89dcf790-bcd5-4d2d-8c9f-3bf61692ea41 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:47.307228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-89dcf790-bcd5-4d2d-8c9f-3bf61692ea41 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:47.333527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89dcf790-bcd5-4d2d-8c9f-3bf61692ea41 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:47.334447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89dcf790-bcd5-4d2d-8c9f-3bf61692ea41 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:47.335791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89dcf790-bcd5-4d2d-8c9f-3bf61692ea41 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:47.339244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89dcf790-bcd5-4d2d-8c9f-3bf61692ea41 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:47.677033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7d7cfbba-c3bf-4f48-94af-2a2dc2cfe11b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:47.692909 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7d7cfbba-c3bf-4f48-94af-2a2dc2cfe11b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1680 microversion: 2.1 time: 0.539060 Aug 03 02:08:47.700582 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2067/4008] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:08:47 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1680 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:47.713653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-edeaad79-2dc6-48e5-9355-a4b4aa68441c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:47.714803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-edeaad79-2dc6-48e5-9355-a4b4aa68441c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:47.725191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edeaad79-2dc6-48e5-9355-a4b4aa68441c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:47.727027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edeaad79-2dc6-48e5-9355-a4b4aa68441c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:47.734776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edeaad79-2dc6-48e5-9355-a4b4aa68441c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:47.735920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-edeaad79-2dc6-48e5-9355-a4b4aa68441c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:47.828400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-89dcf790-bcd5-4d2d-8c9f-3bf61692ea41 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:47.856744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-89dcf790-bcd5-4d2d-8c9f-3bf61692ea41 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:47.906433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-89dcf790-bcd5-4d2d-8c9f-3bf61692ea41 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:47.909816 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-89dcf790-bcd5-4d2d-8c9f-3bf61692ea41 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 0.620735 Aug 03 02:08:47.931054 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1942/4009] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:47 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:47.931054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c9e27160-5f2f-4d32-b67c-a749e8dc1e09 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b1306b790>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:48.001394 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c9e27160-5f2f-4d32-b67c-a749e8dc1e09 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5" status: 200 len: 1454 microversion: 2.1 time: 0.081465 Aug 03 02:08:48.004838 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1943/4010] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:47 2022] GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:48.079763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7bad157d-a096-489a-bd01-876c229d6494 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:48.083708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7bad157d-a096-489a-bd01-876c229d6494 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:48.128490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7bad157d-a096-489a-bd01-876c229d6494 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:48.129808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7bad157d-a096-489a-bd01-876c229d6494 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:48.133756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7bad157d-a096-489a-bd01-876c229d6494 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:48.134742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7bad157d-a096-489a-bd01-876c229d6494 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:48.256808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-edeaad79-2dc6-48e5-9355-a4b4aa68441c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:48.284193 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-edeaad79-2dc6-48e5-9355-a4b4aa68441c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 0.581408 Aug 03 02:08:48.302937 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2068/4011] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:08:47 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:48.311661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5824de51-0ce7-450d-9302-76dd8dde9f3a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:48.312432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5824de51-0ce7-450d-9302-76dd8dde9f3a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:48.338630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5824de51-0ce7-450d-9302-76dd8dde9f3a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:48.339328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5824de51-0ce7-450d-9302-76dd8dde9f3a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:48.352080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5824de51-0ce7-450d-9302-76dd8dde9f3a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:48.352080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5824de51-0ce7-450d-9302-76dd8dde9f3a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:48.688386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5824de51-0ce7-450d-9302-76dd8dde9f3a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:48.725560 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5824de51-0ce7-450d-9302-76dd8dde9f3a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1265 microversion: 2.1 time: 0.417535 Aug 03 02:08:48.731734 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2069/4012] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:08:48 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1265 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:08:48.771754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f3a286d8-a47c-4f88-bba4-93079492a514 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:48.772852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f3a286d8-a47c-4f88-bba4-93079492a514 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:48.780268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f3a286d8-a47c-4f88-bba4-93079492a514 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:48.781282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f3a286d8-a47c-4f88-bba4-93079492a514 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:48.797877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f3a286d8-a47c-4f88-bba4-93079492a514 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:48.801671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f3a286d8-a47c-4f88-bba4-93079492a514 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:49.610502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f3a286d8-a47c-4f88-bba4-93079492a514 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:49.659630 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f3a286d8-a47c-4f88-bba4-93079492a514 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1680 microversion: 2.1 time: 0.902974 Aug 03 02:08:49.675052 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2070/4013] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:08:48 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1680 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:49.675052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6b3a163c-fbe5-4b5f-8b57-80c21fec140b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:49.675052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6b3a163c-fbe5-4b5f-8b57-80c21fec140b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:49.707164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b3a163c-fbe5-4b5f-8b57-80c21fec140b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:49.707674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b3a163c-fbe5-4b5f-8b57-80c21fec140b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:49.708747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b3a163c-fbe5-4b5f-8b57-80c21fec140b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:49.709219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b3a163c-fbe5-4b5f-8b57-80c21fec140b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:50.177141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7bad157d-a096-489a-bd01-876c229d6494 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:50.197387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7bad157d-a096-489a-bd01-876c229d6494 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:50.203996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7bad157d-a096-489a-bd01-876c229d6494 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:50.206659 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7bad157d-a096-489a-bd01-876c229d6494 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 200 len: 1359 microversion: 2.21 time: 2.136091 Aug 03 02:08:50.215832 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1944/4014] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:48 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 1359 bytes in 2146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:50.222870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d5bf5716-fc59-4e91-99f0-fd438f93f0e6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b2450a4c0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:50.338397 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d5bf5716-fc59-4e91-99f0-fd438f93f0e6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5" status: 200 len: 1454 microversion: 2.1 time: 0.121001 Aug 03 02:08:50.340251 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1945/4015] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:50 2022] GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:50.350922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6172b4d7-aae8-4fa8-83ce-2f09b6eeafd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:50.352640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6172b4d7-aae8-4fa8-83ce-2f09b6eeafd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:50.366310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6172b4d7-aae8-4fa8-83ce-2f09b6eeafd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:50.367279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6172b4d7-aae8-4fa8-83ce-2f09b6eeafd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:50.368301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6172b4d7-aae8-4fa8-83ce-2f09b6eeafd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:50.368930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6172b4d7-aae8-4fa8-83ce-2f09b6eeafd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:51.556169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6172b4d7-aae8-4fa8-83ce-2f09b6eeafd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:51.594086 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6172b4d7-aae8-4fa8-83ce-2f09b6eeafd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1686 microversion: 2.1 time: 1.247989 Aug 03 02:08:51.606928 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1946/4016] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:08:50 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1686 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:51.616628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cde01fdc-f098-40cb-93be-8f16b58e7f4c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:51.619195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cde01fdc-f098-40cb-93be-8f16b58e7f4c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:51.649064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cde01fdc-f098-40cb-93be-8f16b58e7f4c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:51.654566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cde01fdc-f098-40cb-93be-8f16b58e7f4c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:51.657894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cde01fdc-f098-40cb-93be-8f16b58e7f4c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:51.658799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cde01fdc-f098-40cb-93be-8f16b58e7f4c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:51.790727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6b3a163c-fbe5-4b5f-8b57-80c21fec140b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:51.820325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6b3a163c-fbe5-4b5f-8b57-80c21fec140b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:51.826977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6b3a163c-fbe5-4b5f-8b57-80c21fec140b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:51.829577 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6b3a163c-fbe5-4b5f-8b57-80c21fec140b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 2.166409 Aug 03 02:08:51.833806 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2071/4017] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:49 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:51.846563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-9e669a39-6292-4bc1-b4cf-79c25f8ff2e1 req-c9cbcc9f-6847-4de3-b95b-cb0e050c9e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-plugged", "status": "completed", "tag": "dd896678-ab80-49e5-8344-6b05edfc5dd4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:51.860927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:08:51.884407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9e669a39-6292-4bc1-b4cf-79c25f8ff2e1 req-c9cbcc9f-6847-4de3-b95b-cb0e050c9e33 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:51.884861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9e669a39-6292-4bc1-b4cf-79c25f8ff2e1 req-c9cbcc9f-6847-4de3-b95b-cb0e050c9e33 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:51.917004 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-9e669a39-6292-4bc1-b4cf-79c25f8ff2e1 req-c9cbcc9f-6847-4de3-b95b-cb0e050c9e33 service nova] Creating event network-vif-plugged:dd896678-ab80-49e5-8344-6b05edfc5dd4 for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:08:51.932956 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-9e669a39-6292-4bc1-b4cf-79c25f8ff2e1 req-c9cbcc9f-6847-4de3-b95b-cb0e050c9e33 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097524 Aug 03 02:08:51.937350 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2072/4018] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:08:51.950019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-45cb0664-5717-418f-9600-8d2532f77fe8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:51.951617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-45cb0664-5717-418f-9600-8d2532f77fe8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:51.974981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45cb0664-5717-418f-9600-8d2532f77fe8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:51.975899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45cb0664-5717-418f-9600-8d2532f77fe8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:51.977289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45cb0664-5717-418f-9600-8d2532f77fe8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:51.983130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45cb0664-5717-418f-9600-8d2532f77fe8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:55.571599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cde01fdc-f098-40cb-93be-8f16b58e7f4c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:55.623297 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cde01fdc-f098-40cb-93be-8f16b58e7f4c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1313 microversion: 2.1 time: 4.021519 Aug 03 02:08:55.643613 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1947/4019] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:08:51 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1313 bytes in 4047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:55.684106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f6d94253-b8c8-455d-bdba-9471a7802f68 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:55.685205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f6d94253-b8c8-455d-bdba-9471a7802f68 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:55.713952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6d94253-b8c8-455d-bdba-9471a7802f68 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:55.715137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6d94253-b8c8-455d-bdba-9471a7802f68 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:55.716884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6d94253-b8c8-455d-bdba-9471a7802f68 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:55.720251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6d94253-b8c8-455d-bdba-9471a7802f68 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:55.813090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-45cb0664-5717-418f-9600-8d2532f77fe8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:55.860413 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-45cb0664-5717-418f-9600-8d2532f77fe8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 200 len: 1680 microversion: 2.1 time: 3.920241 Aug 03 02:08:55.873700 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2073/4020] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:08:51 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 1680 bytes in 3936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:55.908263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6c1cc969-0029-4a4e-9b4f-a4bdfd9bb48a tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b12525160>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:56.000056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:08:56.748858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f6d94253-b8c8-455d-bdba-9471a7802f68 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:56.792785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f6d94253-b8c8-455d-bdba-9471a7802f68 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:56.806999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f6d94253-b8c8-455d-bdba-9471a7802f68 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:56.809084 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f6d94253-b8c8-455d-bdba-9471a7802f68 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 200 len: 1359 microversion: 2.21 time: 1.152841 Aug 03 02:08:56.866399 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1948/4021] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:55 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 1359 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:56.885742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a49dacb7-94ba-4861-8520-3c038bd669b9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:56.895469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a49dacb7-94ba-4861-8520-3c038bd669b9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:56.957332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a49dacb7-94ba-4861-8520-3c038bd669b9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:56.958147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a49dacb7-94ba-4861-8520-3c038bd669b9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:56.970243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a49dacb7-94ba-4861-8520-3c038bd669b9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:56.971826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a49dacb7-94ba-4861-8520-3c038bd669b9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:57.308724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:08:58.154672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a49dacb7-94ba-4861-8520-3c038bd669b9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:58.204976 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a49dacb7-94ba-4861-8520-3c038bd669b9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1681 microversion: 2.1 time: 1.339194 Aug 03 02:08:58.217440 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1949/4022] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:08:56 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1681 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:08:58.233243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0270753b-08b7-4d27-ac20-9308858e7d85 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:58.237215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0270753b-08b7-4d27-ac20-9308858e7d85 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:58.261886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0270753b-08b7-4d27-ac20-9308858e7d85 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:58.268415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0270753b-08b7-4d27-ac20-9308858e7d85 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:58.280875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0270753b-08b7-4d27-ac20-9308858e7d85 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:58.282074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0270753b-08b7-4d27-ac20-9308858e7d85 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:58.824214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0270753b-08b7-4d27-ac20-9308858e7d85 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:58.866090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0270753b-08b7-4d27-ac20-9308858e7d85 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:58.876342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0270753b-08b7-4d27-ac20-9308858e7d85 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:08:58.898491 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0270753b-08b7-4d27-ac20-9308858e7d85 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 0.672628 Aug 03 02:08:58.902161 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1950/4023] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:08:58 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:08:58.946358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-c4eba689-ba61-41c7-9679-84a57c77109d req-54835cb1-fb5e-4f07-8492-7bee77a0a7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9952a14-056b-4b74-ab8c-791d16592ddf", "name": "network-vif-unplugged", "status": "completed", "tag": "6377bbf1-10a0-437b-a4d1-7bd2f82f03fe"}, {"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-plugged", "status": "completed", "tag": "cce1ca4d-a384-4a7c-bc85-f44f966690b5"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:59.027250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c4eba689-ba61-41c7-9679-84a57c77109d req-54835cb1-fb5e-4f07-8492-7bee77a0a7e5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:59.029222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c4eba689-ba61-41c7-9679-84a57c77109d req-54835cb1-fb5e-4f07-8492-7bee77a0a7e5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:59.078538 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c4eba689-ba61-41c7-9679-84a57c77109d req-54835cb1-fb5e-4f07-8492-7bee77a0a7e5 service nova] Creating event network-vif-unplugged:6377bbf1-10a0-437b-a4d1-7bd2f82f03fe for instance b9952a14-056b-4b74-ab8c-791d16592ddf on n-h1-826529-8 Aug 03 02:08:59.080415 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c4eba689-ba61-41c7-9679-84a57c77109d req-54835cb1-fb5e-4f07-8492-7bee77a0a7e5 service nova] Creating event network-vif-plugged:cce1ca4d-a384-4a7c-bc85-f44f966690b5 for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:08:59.105196 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-c4eba689-ba61-41c7-9679-84a57c77109d req-54835cb1-fb5e-4f07-8492-7bee77a0a7e5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.197913 Aug 03 02:08:59.109006 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1951/4024] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:08:59.117861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-efdaae2d-52fd-49a1-9ebb-7e4107484bf9 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Action: 'create', calling method: .version_select at 0x7f5b13222940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2076847870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjTGpBsebBtrYXuH3NXrGw5Eqc17LZ/zCqM1svhR+k4XSb0QRbbj/CQcIggFe3McPNf+yseEOeuL1N91kcSBftnaKRyNElL8aPlEVUtLgoIjXVpHWY3hvOoXms2bw5P2A=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:08:59.148917 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-efdaae2d-52fd-49a1-9ebb-7e4107484bf9 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Getting quotas for project f90284be975b4e459cdc3e72c1664630. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:08:59.162313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-efdaae2d-52fd-49a1-9ebb-7e4107484bf9 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Getting quotas for user c1ab5d1fb4b1453b9ba37a2b1194ec79 and project f90284be975b4e459cdc3e72c1664630. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:08:59.246539 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-efdaae2d-52fd-49a1-9ebb-7e4107484bf9 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.133377 Aug 03 02:08:59.248815 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1952/4025] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:08:59 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:08:59.261872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fd36ad6e-65e6-4179-b894-09e4031f710f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:08:59.262649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fd36ad6e-65e6-4179-b894-09e4031f710f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:08:59.280155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd36ad6e-65e6-4179-b894-09e4031f710f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:59.280644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd36ad6e-65e6-4179-b894-09e4031f710f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:08:59.281475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd36ad6e-65e6-4179-b894-09e4031f710f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:08:59.281935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd36ad6e-65e6-4179-b894-09e4031f710f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:00.035371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fd36ad6e-65e6-4179-b894-09e4031f710f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:00.048872 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fd36ad6e-65e6-4179-b894-09e4031f710f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1355 microversion: 2.1 time: 0.791071 Aug 03 02:09:00.065010 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1953/4026] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:08:59 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1355 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:00.082382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4caa175f-2977-4f5c-bf7e-648140517728 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:00.085660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4caa175f-2977-4f5c-bf7e-648140517728 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:00.097216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4caa175f-2977-4f5c-bf7e-648140517728 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:00.097733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4caa175f-2977-4f5c-bf7e-648140517728 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:00.098488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4caa175f-2977-4f5c-bf7e-648140517728 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:00.112329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4caa175f-2977-4f5c-bf7e-648140517728 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:00.160383 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-4caa175f-2977-4f5c-bf7e-648140517728 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] HTTP exception thrown: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4caa175f-2977-4f5c-bf7e-648140517728 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Request method failure captured: Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 HTTP/1.1 Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dc0-Ae8If7bfOWI7RRBvc1phU63xlLSU5btj5ety_8fStzHcWU-vXHDYz4xfjE-ye9BJl2yypV_nSYHeeO1JR8qxTOON-NMvFY2KC116gH7mE5fGt58cYvDLyGtxXNTQSJt4xclgIAdKb4vD1HYJAxEQ3OrVusgb2MtJ9SsttIsaGA Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a5bc12da9a94f63bb71700bd01cf416", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}] Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4c1fb7af331344dcb26c43368a9daa6e Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '3f1ef30e-5b4e-43ac-84ce-2a3a69d77340'} Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:09:00.167142 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:00.178189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:00.178189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:09:00.178189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:09:00.178189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:09:00.178189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:09:00.178189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. Aug 03 02:09:00.178189 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:00.181563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4caa175f-2977-4f5c-bf7e-648140517728 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Returning 404 to user: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:09:00.184440 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4caa175f-2977-4f5c-bf7e-648140517728 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 404 len: 111 microversion: 2.1 time: 0.116464 Aug 03 02:09:00.187145 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1954/4027] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:00 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:09:00.197091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-da8714dd-a380-44e1-abe4-3c0f873b7e9e req-af63bf99-808f-4317-bd21-dcb06c0f7c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1ef30e-5b4e-43ac-84ce-2a3a69d77340", "name": "network-vif-deleted", "tag": "4d52422a-7324-4649-bc25-a65137f3fd9a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:00.231363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-da8714dd-a380-44e1-abe4-3c0f873b7e9e req-af63bf99-808f-4317-bd21-dcb06c0f7c21 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:00.233563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-da8714dd-a380-44e1-abe4-3c0f873b7e9e req-af63bf99-808f-4317-bd21-dcb06c0f7c21 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:00.277201 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-da8714dd-a380-44e1-abe4-3c0f873b7e9e req-af63bf99-808f-4317-bd21-dcb06c0f7c21 service nova] Creating event network-vif-deleted:4d52422a-7324-4649-bc25-a65137f3fd9a for instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 on n-h1-826529-8 Aug 03 02:09:00.292232 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-da8714dd-a380-44e1-abe4-3c0f873b7e9e req-af63bf99-808f-4317-bd21-dcb06c0f7c21 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100716 Aug 03 02:09:00.296465 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1955/4028] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:00.325943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fd0f9182-df02-4ee5-bade-8f438816235a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:00.332048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fd0f9182-df02-4ee5-bade-8f438816235a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:00.351000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd0f9182-df02-4ee5-bade-8f438816235a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:00.354838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd0f9182-df02-4ee5-bade-8f438816235a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:00.356452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd0f9182-df02-4ee5-bade-8f438816235a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:00.357689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd0f9182-df02-4ee5-bade-8f438816235a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:01.035845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fd0f9182-df02-4ee5-bade-8f438816235a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:01.071358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fd0f9182-df02-4ee5-bade-8f438816235a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:01.085161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fd0f9182-df02-4ee5-bade-8f438816235a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:01.092789 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fd0f9182-df02-4ee5-bade-8f438816235a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 200 len: 1359 microversion: 2.21 time: 0.783231 Aug 03 02:09:01.095190 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1956/4029] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:09:00 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 1359 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:09:01.104279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-48cf856c-585f-4e2d-9d0b-3914f701b3e1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:01.105203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-48cf856c-585f-4e2d-9d0b-3914f701b3e1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:01.139501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-48cf856c-585f-4e2d-9d0b-3914f701b3e1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:01.139951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-48cf856c-585f-4e2d-9d0b-3914f701b3e1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:01.144221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-48cf856c-585f-4e2d-9d0b-3914f701b3e1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:01.145431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-48cf856c-585f-4e2d-9d0b-3914f701b3e1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:01.654577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-48cf856c-585f-4e2d-9d0b-3914f701b3e1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:01.665204 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-48cf856c-585f-4e2d-9d0b-3914f701b3e1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1681 microversion: 2.1 time: 0.567587 Aug 03 02:09:01.684277 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1957/4030] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:01 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1681 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:01.918800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-f6a606df-50ab-4639-97ee-5e8a6816f223 req-839478a6-0869-4bd8-8f5c-343a9c4904f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8af391-3cba-4d7b-99e3-f3422e79c797", "tag": "bd718c95-db8c-43bd-b587-ee65f13b6145"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:01.954494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f6a606df-50ab-4639-97ee-5e8a6816f223 req-839478a6-0869-4bd8-8f5c-343a9c4904f7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:01.956166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f6a606df-50ab-4639-97ee-5e8a6816f223 req-839478a6-0869-4bd8-8f5c-343a9c4904f7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:01.969241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:01.995470 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-f6a606df-50ab-4639-97ee-5e8a6816f223 req-839478a6-0869-4bd8-8f5c-343a9c4904f7 service nova] Creating event network-changed:bd718c95-db8c-43bd-b587-ee65f13b6145 for instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 on n-h1-826529-8 Aug 03 02:09:02.011442 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-f6a606df-50ab-4639-97ee-5e8a6816f223 req-839478a6-0869-4bd8-8f5c-343a9c4904f7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325612 Aug 03 02:09:02.012440 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1958/4031] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:02.018829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1d8176be-dc04-406e-8171-2c9decc172a7 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:02.028167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1d8176be-dc04-406e-8171-2c9decc172a7 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:02.058541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d8176be-dc04-406e-8171-2c9decc172a7 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:02.069381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d8176be-dc04-406e-8171-2c9decc172a7 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:02.076509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d8176be-dc04-406e-8171-2c9decc172a7 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:02.077256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d8176be-dc04-406e-8171-2c9decc172a7 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:02.081040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:03.177409 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1d8176be-dc04-406e-8171-2c9decc172a7 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:03.195308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1d8176be-dc04-406e-8171-2c9decc172a7 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:03.204173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1d8176be-dc04-406e-8171-2c9decc172a7 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:03.207074 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1d8176be-dc04-406e-8171-2c9decc172a7 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.193060 Aug 03 02:09:03.217016 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1959/4032] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:09:02 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:09:03.229460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ae36ab56-4f6d-47f8-9ace-f6429db4ec8b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '.version_select at 0x7f5b13222940>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:03.315793 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ae36ab56-4f6d-47f8-9ace-f6429db4ec8b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-499360839" status: 202 len: 0 microversion: 2.1 time: 0.095460 Aug 03 02:09:03.318778 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1960/4033] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 3 02:09:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-499360839 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:09:03.339673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0966c67-d321-4d80-8198-47292c5f40dc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:03.346356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0966c67-d321-4d80-8198-47292c5f40dc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:03.372240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0966c67-d321-4d80-8198-47292c5f40dc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:03.377632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0966c67-d321-4d80-8198-47292c5f40dc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:03.386164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0966c67-d321-4d80-8198-47292c5f40dc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:03.390890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0966c67-d321-4d80-8198-47292c5f40dc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:04.006373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0966c67-d321-4d80-8198-47292c5f40dc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:04.017934 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0966c67-d321-4d80-8198-47292c5f40dc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1355 microversion: 2.1 time: 0.696402 Aug 03 02:09:04.036079 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1961/4034] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:03 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1355 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:04.043085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-3de3a0cf-77f2-4806-bc3e-9cc3d8959d9f req-b35911f1-be34-46da-80ec-41d9bd16fdba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-plugged", "status": "completed", "tag": "8cbd61f7-4c8d-4411-9cf8-c16e2c78580e"}, {"server_uuid": "7f252a17-d550-4e2e-8527-d6445dd64816", "name": "network-vif-plugged", "status": "completed", "tag": "1c02f82c-38b3-4ab1-adea-86e1b9b4a583"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:04.062347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3de3a0cf-77f2-4806-bc3e-9cc3d8959d9f req-b35911f1-be34-46da-80ec-41d9bd16fdba service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:04.063368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3de3a0cf-77f2-4806-bc3e-9cc3d8959d9f req-b35911f1-be34-46da-80ec-41d9bd16fdba service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:04.108819 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-3de3a0cf-77f2-4806-bc3e-9cc3d8959d9f req-b35911f1-be34-46da-80ec-41d9bd16fdba service nova] Creating event network-vif-plugged:8cbd61f7-4c8d-4411-9cf8-c16e2c78580e for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:09:04.109848 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-3de3a0cf-77f2-4806-bc3e-9cc3d8959d9f req-b35911f1-be34-46da-80ec-41d9bd16fdba service nova] Creating event network-vif-plugged:1c02f82c-38b3-4ab1-adea-86e1b9b4a583 for instance 7f252a17-d550-4e2e-8527-d6445dd64816 on n-h1-826529-8 Aug 03 02:09:04.166515 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-3de3a0cf-77f2-4806-bc3e-9cc3d8959d9f req-b35911f1-be34-46da-80ec-41d9bd16fdba service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.123748 Aug 03 02:09:04.167977 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1962/4035] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:04.178285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-59adf060-d3be-4829-956e-6dc677f4baa1 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:04.183555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-59adf060-d3be-4829-956e-6dc677f4baa1 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:04.211820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59adf060-d3be-4829-956e-6dc677f4baa1 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:04.212651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59adf060-d3be-4829-956e-6dc677f4baa1 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:04.214102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59adf060-d3be-4829-956e-6dc677f4baa1 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:04.214814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59adf060-d3be-4829-956e-6dc677f4baa1 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:04.537035 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6c1cc969-0029-4a4e-9b4f-a4bdfd9bb48a tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5" status: 200 len: 1463 microversion: 2.1 time: 8.660357 Aug 03 02:09:04.547957 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2074/4036] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:08:55 2022] GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5 => generated 1463 bytes in 8672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:04.556470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-673c3c85-e581-47e8-946e-d21c6409ecb8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:04.557437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-673c3c85-e581-47e8-946e-d21c6409ecb8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:04.582467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-673c3c85-e581-47e8-946e-d21c6409ecb8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:04.583395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-673c3c85-e581-47e8-946e-d21c6409ecb8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:04.586566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-673c3c85-e581-47e8-946e-d21c6409ecb8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:04.587417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-673c3c85-e581-47e8-946e-d21c6409ecb8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:05.165284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-673c3c85-e581-47e8-946e-d21c6409ecb8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:05.179698 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-673c3c85-e581-47e8-946e-d21c6409ecb8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1681 microversion: 2.1 time: 0.629355 Aug 03 02:09:05.180583 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2075/4037] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:04 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1681 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:05.187953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-304cf3d2-057b-4bb7-962c-875be0c0d851 req-e72e1c5e-5bd3-4530-854f-ba195a46251a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8af391-3cba-4d7b-99e3-f3422e79c797", "tag": "00a0c9ed-6d01-4cf2-8a56-b9714b610974"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:05.201889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-304cf3d2-057b-4bb7-962c-875be0c0d851 req-e72e1c5e-5bd3-4530-854f-ba195a46251a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:05.202673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-304cf3d2-057b-4bb7-962c-875be0c0d851 req-e72e1c5e-5bd3-4530-854f-ba195a46251a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:05.230810 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-304cf3d2-057b-4bb7-962c-875be0c0d851 req-e72e1c5e-5bd3-4530-854f-ba195a46251a service nova] Creating event network-changed:00a0c9ed-6d01-4cf2-8a56-b9714b610974 for instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 on n-h1-826529-8 Aug 03 02:09:05.238339 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-304cf3d2-057b-4bb7-962c-875be0c0d851 req-e72e1c5e-5bd3-4530-854f-ba195a46251a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056470 Aug 03 02:09:05.239645 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2076/4038] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:05.246681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-341c2b65-52ac-418a-99ca-a75ff9ae518a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:05.247618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-341c2b65-52ac-418a-99ca-a75ff9ae518a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:05.260991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-341c2b65-52ac-418a-99ca-a75ff9ae518a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:05.262353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-341c2b65-52ac-418a-99ca-a75ff9ae518a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:05.263591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-341c2b65-52ac-418a-99ca-a75ff9ae518a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:05.264207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-341c2b65-52ac-418a-99ca-a75ff9ae518a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:05.386356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-59adf060-d3be-4829-956e-6dc677f4baa1 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:05.404808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-59adf060-d3be-4829-956e-6dc677f4baa1 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:05.406719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-59adf060-d3be-4829-956e-6dc677f4baa1 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:05.408620 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-59adf060-d3be-4829-956e-6dc677f4baa1 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 200 len: 1359 microversion: 2.21 time: 1.239286 Aug 03 02:09:05.409839 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1963/4039] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:09:04 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 1359 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:09:05.423183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25d65d3c-eae5-4b47-99fa-63bc55a4b7d9 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b2450a550>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:05.538442 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-25d65d3c-eae5-4b47-99fa-63bc55a4b7d9 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5" status: 200 len: 1463 microversion: 2.1 time: 0.127431 Aug 03 02:09:05.541561 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1964/4040] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:05 2022] GET /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5 => generated 1463 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:05.552758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-258376b2-897e-4c18-9245-7c434a8598b4 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:05.554131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-258376b2-897e-4c18-9245-7c434a8598b4 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:05.567704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-258376b2-897e-4c18-9245-7c434a8598b4 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:05.570416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-258376b2-897e-4c18-9245-7c434a8598b4 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:05.571509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-258376b2-897e-4c18-9245-7c434a8598b4 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:05.574615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-258376b2-897e-4c18-9245-7c434a8598b4 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:06.275199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-341c2b65-52ac-418a-99ca-a75ff9ae518a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:06.297875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-341c2b65-52ac-418a-99ca-a75ff9ae518a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:06.301659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-341c2b65-52ac-418a-99ca-a75ff9ae518a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:06.304861 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-341c2b65-52ac-418a-99ca-a75ff9ae518a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 1.063891 Aug 03 02:09:06.321503 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2077/4041] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:09:05 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:09:06.343398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-426280407", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "b3995448-7f59-40dd-bf8c-3c1c213344df"}], "key_name": "tempest-TestNetworkBasicOps-2076847870", "security_groups": [{"name": "tempest-secgroup-smoke-1947587404"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:06.688082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-258376b2-897e-4c18-9245-7c434a8598b4 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:06.707535 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-258376b2-897e-4c18-9245-7c434a8598b4 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1355 microversion: 2.1 time: 1.164586 Aug 03 02:09:06.723622 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1965/4042] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:05 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1355 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:06.731182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9e1ef53b-f02b-49e1-bd71-51bfa55f125a tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:06.732123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9e1ef53b-f02b-49e1-bd71-51bfa55f125a tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:06.746169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e1ef53b-f02b-49e1-bd71-51bfa55f125a tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:06.746843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e1ef53b-f02b-49e1-bd71-51bfa55f125a tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:06.747962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e1ef53b-f02b-49e1-bd71-51bfa55f125a tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:06.748836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e1ef53b-f02b-49e1-bd71-51bfa55f125a tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:06.772869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] validate_networks() for [('b3995448-7f59-40dd-bf8c-3c1c213344df', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:09:07.154844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9e1ef53b-f02b-49e1-bd71-51bfa55f125a tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:07.174002 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9e1ef53b-f02b-49e1-bd71-51bfa55f125a tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1466 microversion: 2.1 time: 0.441268 Aug 03 02:09:07.178475 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1966/4043] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:06 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1466 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:07.209181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9648e471-6c67-460a-b6e8-1e662acc7b3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:07.213795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9648e471-6c67-460a-b6e8-1e662acc7b3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:07.218469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:07.230800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9648e471-6c67-460a-b6e8-1e662acc7b3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:07.239506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9648e471-6c67-460a-b6e8-1e662acc7b3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:07.245145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9648e471-6c67-460a-b6e8-1e662acc7b3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:07.245859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9648e471-6c67-460a-b6e8-1e662acc7b3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:08.005459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9648e471-6c67-460a-b6e8-1e662acc7b3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:08.027837 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9648e471-6c67-460a-b6e8-1e662acc7b3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1681 microversion: 2.1 time: 0.835212 Aug 03 02:09:08.032039 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1967/4044] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:07 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1681 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:08.090016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-62ac08aa-1d82-4b49-acf1-4c2e9f6d264a req-f48bc93a-7e26-47a2-8d9b-661e141f4131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-plugged", "status": "completed", "tag": "2d1a410d-29d6-424d-b7ce-91aa60713c2c"}, {"server_uuid": "b9952a14-056b-4b74-ab8c-791d16592ddf", "name": "network-vif-plugged", "status": "completed", "tag": "6377bbf1-10a0-437b-a4d1-7bd2f82f03fe"}, {"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-plugged", "status": "completed", "tag": "805da5ad-6ade-4a2c-94be-dc2a26fa060a"}, {"server_uuid": "7ead359f-4427-4285-9677-d3cac524d8b2", "name": "network-vif-plugged", "status": "completed", "tag": "4d3985fb-3a8f-49e3-b887-095a18ea295a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:08.125310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-62ac08aa-1d82-4b49-acf1-4c2e9f6d264a req-f48bc93a-7e26-47a2-8d9b-661e141f4131 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:08.127865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-62ac08aa-1d82-4b49-acf1-4c2e9f6d264a req-f48bc93a-7e26-47a2-8d9b-661e141f4131 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:08.174699 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-62ac08aa-1d82-4b49-acf1-4c2e9f6d264a req-f48bc93a-7e26-47a2-8d9b-661e141f4131 service nova] Creating event network-vif-plugged:2d1a410d-29d6-424d-b7ce-91aa60713c2c for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:09:08.175784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:09:08.176434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:09:08.176700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:09:08.177131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:09:08.177555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:09:08.191976 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-62ac08aa-1d82-4b49-acf1-4c2e9f6d264a req-f48bc93a-7e26-47a2-8d9b-661e141f4131 service nova] Creating event network-vif-plugged:6377bbf1-10a0-437b-a4d1-7bd2f82f03fe for instance b9952a14-056b-4b74-ab8c-791d16592ddf on n-h1-826529-8 Aug 03 02:09:08.199494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:08.199970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:08.200820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:08.201276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:08.201800 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-62ac08aa-1d82-4b49-acf1-4c2e9f6d264a req-f48bc93a-7e26-47a2-8d9b-661e141f4131 service nova] Creating event network-vif-plugged:805da5ad-6ade-4a2c-94be-dc2a26fa060a for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:09:08.203446 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-62ac08aa-1d82-4b49-acf1-4c2e9f6d264a req-f48bc93a-7e26-47a2-8d9b-661e141f4131 service nova] Creating event network-vif-plugged:4d3985fb-3a8f-49e3-b887-095a18ea295a for instance 7ead359f-4427-4285-9677-d3cac524d8b2 on n-h2-826529-8 Aug 03 02:09:08.233723 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-62ac08aa-1d82-4b49-acf1-4c2e9f6d264a req-f48bc93a-7e26-47a2-8d9b-661e141f4131 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.185280 Aug 03 02:09:08.238737 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1968/4045] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:08.249181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Getting quotas for project f90284be975b4e459cdc3e72c1664630. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:09:08.252505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d127ad06-b194-4b80-909a-b2c272adde36 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:08.253614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d127ad06-b194-4b80-909a-b2c272adde36 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:08.265682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Getting quotas for user c1ab5d1fb4b1453b9ba37a2b1194ec79 and project f90284be975b4e459cdc3e72c1664630. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:09:08.274258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d127ad06-b194-4b80-909a-b2c272adde36 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:08.276057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d127ad06-b194-4b80-909a-b2c272adde36 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:08.277768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d127ad06-b194-4b80-909a-b2c272adde36 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:08.278229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d127ad06-b194-4b80-909a-b2c272adde36 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:08.308848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:09:08.311241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:09:08.399813 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6251940a-5071-436e-802d-4394fa004343 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.076066 Aug 03 02:09:08.400828 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2078/4046] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:09:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 2079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:09:08.405921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-51c7e742-d5f4-4064-bc5e-1e09a7a51af3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Action: 'create', calling method: .version_select at 0x7f5b123d7430>, body: {"keypair": {"name": "tempest-keypair-234060522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdbt0kltP+6spSqxGU9Xde1RCzvHFuOA0ENlTg7dy2dm9hcBJuprJa9PbNbXXu1VGI/tTgekH+HEFqoESD2cBmu842au4DLjE0HfozDHI++ISesOZOYt7S99eYhOWiRaA=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:08.426214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-51c7e742-d5f4-4064-bc5e-1e09a7a51af3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:09:08.449163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-51c7e742-d5f4-4064-bc5e-1e09a7a51af3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for user 4c1fb7af331344dcb26c43368a9daa6e and project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:09:08.494489 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-51c7e742-d5f4-4064-bc5e-1e09a7a51af3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.092400 Aug 03 02:09:08.496609 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2079/4047] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:09:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:08.534277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e82864e2-3ff8-4acf-9daa-8c91cd33ddea tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-534111833"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:08.537204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e82864e2-3ff8-4acf-9daa-8c91cd33ddea tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 4c93a8f4-a14e-4937-a7bd-641747f3b86b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:08.558371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e82864e2-3ff8-4acf-9daa-8c91cd33ddea tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:08.560058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e82864e2-3ff8-4acf-9daa-8c91cd33ddea tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:08.565723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e82864e2-3ff8-4acf-9daa-8c91cd33ddea tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:08.567596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e82864e2-3ff8-4acf-9daa-8c91cd33ddea tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:08.969685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d127ad06-b194-4b80-909a-b2c272adde36 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:08.988420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d127ad06-b194-4b80-909a-b2c272adde36 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:08.993723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d127ad06-b194-4b80-909a-b2c272adde36 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:08.997884 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d127ad06-b194-4b80-909a-b2c272adde36 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 200 len: 1552 microversion: 2.21 time: 0.757878 Aug 03 02:09:09.002563 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1969/4048] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:09:08 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 1552 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:09:09.025941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-513d534e-a564-4b6a-ae41-4d311c0e6991 req-de911f86-6700-4a0c-a23d-e6a5ae8ca8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8af391-3cba-4d7b-99e3-f3422e79c797", "tag": "5d39a548-0726-4bce-be8c-755306d2bcb0"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:09.067355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-513d534e-a564-4b6a-ae41-4d311c0e6991 req-de911f86-6700-4a0c-a23d-e6a5ae8ca8b3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:09.067825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-513d534e-a564-4b6a-ae41-4d311c0e6991 req-de911f86-6700-4a0c-a23d-e6a5ae8ca8b3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:09.130200 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-513d534e-a564-4b6a-ae41-4d311c0e6991 req-de911f86-6700-4a0c-a23d-e6a5ae8ca8b3 service nova] Creating event network-changed:5d39a548-0726-4bce-be8c-755306d2bcb0 for instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 on n-h1-826529-8 Aug 03 02:09:09.148582 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-513d534e-a564-4b6a-ae41-4d311c0e6991 req-de911f86-6700-4a0c-a23d-e6a5ae8ca8b3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140100 Aug 03 02:09:09.155846 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1970/4049] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:09.166546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-63e711e9-fb4d-4e35-90b3-94a4ceda6d7b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:09.167371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-63e711e9-fb4d-4e35-90b3-94a4ceda6d7b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:09.202324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:09.222990 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63e711e9-fb4d-4e35-90b3-94a4ceda6d7b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:09.223563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63e711e9-fb4d-4e35-90b3-94a4ceda6d7b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:09.224426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63e711e9-fb4d-4e35-90b3-94a4ceda6d7b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:09.224889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63e711e9-fb4d-4e35-90b3-94a4ceda6d7b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:09.323865 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e82864e2-3ff8-4acf-9daa-8c91cd33ddea tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "POST /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b/action" status: 202 len: 0 microversion: 2.1 time: 0.821659 Aug 03 02:09:09.329410 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2080/4050] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:09:08 2022] POST /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 02:09:09.344562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bc16f937-1c94-4264-ba16-3c877b6247a2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:09.348165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bc16f937-1c94-4264-ba16-3c877b6247a2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:09.366234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc16f937-1c94-4264-ba16-3c877b6247a2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:09.369106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc16f937-1c94-4264-ba16-3c877b6247a2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:09.371486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc16f937-1c94-4264-ba16-3c877b6247a2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:09.374135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc16f937-1c94-4264-ba16-3c877b6247a2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:09.988236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bc16f937-1c94-4264-ba16-3c877b6247a2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:09.997018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-63e711e9-fb4d-4e35-90b3-94a4ceda6d7b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:10.004356 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bc16f937-1c94-4264-ba16-3c877b6247a2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1355 microversion: 2.1 time: 0.672266 Aug 03 02:09:10.005673 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2081/4051] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:09 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1355 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:10.011152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37c031ed-3537-427a-9d98-be2055eb5b08 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:10.012033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-37c031ed-3537-427a-9d98-be2055eb5b08 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:10.013287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-63e711e9-fb4d-4e35-90b3-94a4ceda6d7b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:10.019018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-63e711e9-fb4d-4e35-90b3-94a4ceda6d7b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:10.022773 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-63e711e9-fb4d-4e35-90b3-94a4ceda6d7b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1875 microversion: 2.42 time: 0.858780 Aug 03 02:09:10.030939 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1971/4052] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:09:09 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1875 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:09:10.031557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37c031ed-3537-427a-9d98-be2055eb5b08 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:10.032036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37c031ed-3537-427a-9d98-be2055eb5b08 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:10.034307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37c031ed-3537-427a-9d98-be2055eb5b08 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:10.034532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9f0375ad-1ea7-4276-a09f-c659789fe7df tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:10.035157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37c031ed-3537-427a-9d98-be2055eb5b08 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:10.038121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9f0375ad-1ea7-4276-a09f-c659789fe7df tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:10.054148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f0375ad-1ea7-4276-a09f-c659789fe7df tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:10.054605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f0375ad-1ea7-4276-a09f-c659789fe7df tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:10.055431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f0375ad-1ea7-4276-a09f-c659789fe7df tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:10.055911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f0375ad-1ea7-4276-a09f-c659789fe7df tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:10.111241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9f0375ad-1ea7-4276-a09f-c659789fe7df tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:09:10.195442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-37c031ed-3537-427a-9d98-be2055eb5b08 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:10.213570 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-37c031ed-3537-427a-9d98-be2055eb5b08 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 200 len: 1244 microversion: 2.1 time: 0.206243 Aug 03 02:09:10.214797 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2082/4053] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:10 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 1244 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:10.221126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fffcf0bc-fb14-495e-bc9b-55da07b5599a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:10.222377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fffcf0bc-fb14-495e-bc9b-55da07b5599a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:10.229581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fffcf0bc-fb14-495e-bc9b-55da07b5599a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:10.231198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fffcf0bc-fb14-495e-bc9b-55da07b5599a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:10.232489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fffcf0bc-fb14-495e-bc9b-55da07b5599a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:10.233134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fffcf0bc-fb14-495e-bc9b-55da07b5599a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:10.263194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:10.299840 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9f0375ad-1ea7-4276-a09f-c659789fe7df tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 204 len: 0 microversion: 2.21 time: 0.268592 Aug 03 02:09:10.302860 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1972/4054] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:09:10 2022] DELETE /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 02:09:10.315554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7dd2fee8-c057-4f39-a03f-6fe3a81919bb tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b13a608b0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:10.415650 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7dd2fee8-c057-4f39-a03f-6fe3a81919bb tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 200 len: 1454 microversion: 2.1 time: 0.111175 Aug 03 02:09:10.427714 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1973/4055] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:10 2022] GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:10.434070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-8748c711-f895-467d-a505-13f2c5bfcc76 req-e1d2d13a-9585-4a0b-817c-779ce0256fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ead359f-4427-4285-9677-d3cac524d8b2", "name": "network-vif-unplugged", "status": "completed", "tag": "4d3985fb-3a8f-49e3-b887-095a18ea295a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:10.450249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8748c711-f895-467d-a505-13f2c5bfcc76 req-e1d2d13a-9585-4a0b-817c-779ce0256fb4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:10.451022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8748c711-f895-467d-a505-13f2c5bfcc76 req-e1d2d13a-9585-4a0b-817c-779ce0256fb4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:10.465147 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-8748c711-f895-467d-a505-13f2c5bfcc76 req-e1d2d13a-9585-4a0b-817c-779ce0256fb4 service nova] Creating event network-vif-unplugged:4d3985fb-3a8f-49e3-b887-095a18ea295a for instance 7ead359f-4427-4285-9677-d3cac524d8b2 on n-h2-826529-8 Aug 03 02:09:10.472371 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-8748c711-f895-467d-a505-13f2c5bfcc76 req-e1d2d13a-9585-4a0b-817c-779ce0256fb4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042755 Aug 03 02:09:10.473229 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1974/4056] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:10.486625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-700211de-ccc3-48bd-b592-6e315cebc502 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:10.488829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-700211de-ccc3-48bd-b592-6e315cebc502 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:10.497444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-700211de-ccc3-48bd-b592-6e315cebc502 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:10.499121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-700211de-ccc3-48bd-b592-6e315cebc502 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:10.500146 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-700211de-ccc3-48bd-b592-6e315cebc502 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:10.500851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-700211de-ccc3-48bd-b592-6e315cebc502 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:10.618268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fffcf0bc-fb14-495e-bc9b-55da07b5599a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:10.628025 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fffcf0bc-fb14-495e-bc9b-55da07b5599a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1681 microversion: 2.1 time: 0.411872 Aug 03 02:09:10.642659 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2083/4057] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:10 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1681 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:10.710149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-700211de-ccc3-48bd-b592-6e315cebc502 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:10.719370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-700211de-ccc3-48bd-b592-6e315cebc502 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:10.722075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-700211de-ccc3-48bd-b592-6e315cebc502 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:10.723651 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-700211de-ccc3-48bd-b592-6e315cebc502 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 200 len: 1558 microversion: 2.21 time: 0.243340 Aug 03 02:09:10.724777 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1975/4058] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:09:10 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 1558 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:09:11.027842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cca6169a-b466-483f-a61d-6498dd03e1bd tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:11.029259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cca6169a-b466-483f-a61d-6498dd03e1bd tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:11.048102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cca6169a-b466-483f-a61d-6498dd03e1bd tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:11.048855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cca6169a-b466-483f-a61d-6498dd03e1bd tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:11.050353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cca6169a-b466-483f-a61d-6498dd03e1bd tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:11.051402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cca6169a-b466-483f-a61d-6498dd03e1bd tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:11.052585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c6eef9aa-1540-4359-a3b9-ed5b3deef19b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:11.053230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c6eef9aa-1540-4359-a3b9-ed5b3deef19b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:11.064025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c6eef9aa-1540-4359-a3b9-ed5b3deef19b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:11.064497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c6eef9aa-1540-4359-a3b9-ed5b3deef19b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:11.076108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c6eef9aa-1540-4359-a3b9-ed5b3deef19b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:11.076830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c6eef9aa-1540-4359-a3b9-ed5b3deef19b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:11.598792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cca6169a-b466-483f-a61d-6498dd03e1bd tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:11.612693 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cca6169a-b466-483f-a61d-6498dd03e1bd tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1355 microversion: 2.1 time: 0.588964 Aug 03 02:09:11.613483 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2084/4059] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:11 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1355 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:11.625273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7b2a580e-df41-420f-9cc6-412bae5bdf27 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:11.627146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7b2a580e-df41-420f-9cc6-412bae5bdf27 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:11.648135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b2a580e-df41-420f-9cc6-412bae5bdf27 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:11.649348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b2a580e-df41-420f-9cc6-412bae5bdf27 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:11.650404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b2a580e-df41-420f-9cc6-412bae5bdf27 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:11.653312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b2a580e-df41-420f-9cc6-412bae5bdf27 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:11.669114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c6eef9aa-1540-4359-a3b9-ed5b3deef19b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:11.707539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c6eef9aa-1540-4359-a3b9-ed5b3deef19b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:11.720919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c6eef9aa-1540-4359-a3b9-ed5b3deef19b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:11.725294 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c6eef9aa-1540-4359-a3b9-ed5b3deef19b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 2832 microversion: 2.42 time: 0.677606 Aug 03 02:09:11.741490 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1976/4060] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:09:11 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 2832 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:09:11.760594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-72bc17f4-fbb7-4efe-b338-97b7562f5dca tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b13222820>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:11.818562 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-72bc17f4-fbb7-4efe-b338-97b7562f5dca tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 200 len: 1454 microversion: 2.1 time: 0.075433 Aug 03 02:09:11.826750 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1977/4061] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:11 2022] GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:11.833533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2355394d-ffd7-4f33-bfe4-703eefb58030 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:11.834524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2355394d-ffd7-4f33-bfe4-703eefb58030 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:11.842076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2355394d-ffd7-4f33-bfe4-703eefb58030 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:11.842889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2355394d-ffd7-4f33-bfe4-703eefb58030 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:11.843971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2355394d-ffd7-4f33-bfe4-703eefb58030 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:11.844639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2355394d-ffd7-4f33-bfe4-703eefb58030 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:12.144627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7b2a580e-df41-420f-9cc6-412bae5bdf27 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:12.158217 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7b2a580e-df41-420f-9cc6-412bae5bdf27 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 200 len: 1306 microversion: 2.1 time: 0.541982 Aug 03 02:09:12.160228 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2085/4062] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:11 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 1306 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:12.175189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3927ccf1-aecf-4350-9855-8e631a473158 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:12.176428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3927ccf1-aecf-4350-9855-8e631a473158 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:12.193246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3927ccf1-aecf-4350-9855-8e631a473158 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:12.195531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3927ccf1-aecf-4350-9855-8e631a473158 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:12.196553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3927ccf1-aecf-4350-9855-8e631a473158 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:12.197151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3927ccf1-aecf-4350-9855-8e631a473158 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:12.717955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2355394d-ffd7-4f33-bfe4-703eefb58030 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:12.737098 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2355394d-ffd7-4f33-bfe4-703eefb58030 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1681 microversion: 2.1 time: 0.907757 Aug 03 02:09:12.737809 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1978/4063] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:11 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1681 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:12.744224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e87ffd7a-3970-45c3-abd1-ddbca4fe4064 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:12.750075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e87ffd7a-3970-45c3-abd1-ddbca4fe4064 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:12.773338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e87ffd7a-3970-45c3-abd1-ddbca4fe4064 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:12.776182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e87ffd7a-3970-45c3-abd1-ddbca4fe4064 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:12.777960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e87ffd7a-3970-45c3-abd1-ddbca4fe4064 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:12.791717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e87ffd7a-3970-45c3-abd1-ddbca4fe4064 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:12.981508 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e87ffd7a-3970-45c3-abd1-ddbca4fe4064 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.242550 Aug 03 02:09:12.982307 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1979/4064] 10.222.0.67 () {60 vars in 1316 bytes} [Wed Aug 3 02:09:12 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3/os-interface => generated 1831 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:09:12.990547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2113497721", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1bcbe413-2b5f-4286-84d0-26739a6b3703"}], "security_groups": [{"name": "tempest-securitygroup--797563687"}], "key_name": "tempest-keypair-234060522", "user_data": "}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:13.024870 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3927ccf1-aecf-4350-9855-8e631a473158 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:13.094947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3927ccf1-aecf-4350-9855-8e631a473158 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:13.114325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3927ccf1-aecf-4350-9855-8e631a473158 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:13.116126 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3927ccf1-aecf-4350-9855-8e631a473158 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 200 len: 1558 microversion: 2.21 time: 0.952465 Aug 03 02:09:13.131478 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2086/4065] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:09:12 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 1558 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:09:13.140578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f5fdbe2e-77ab-4d3a-882f-383d3af3087a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:13.141219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f5fdbe2e-77ab-4d3a-882f-383d3af3087a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:13.160366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5fdbe2e-77ab-4d3a-882f-383d3af3087a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:13.160829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5fdbe2e-77ab-4d3a-882f-383d3af3087a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:13.161644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5fdbe2e-77ab-4d3a-882f-383d3af3087a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:13.162094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5fdbe2e-77ab-4d3a-882f-383d3af3087a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:13.455229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] validate_networks() for [('1bcbe413-2b5f-4286-84d0-26739a6b3703', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:09:13.893675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f5fdbe2e-77ab-4d3a-882f-383d3af3087a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:13.902276 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f5fdbe2e-77ab-4d3a-882f-383d3af3087a tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1355 microversion: 2.1 time: 0.769340 Aug 03 02:09:13.902875 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2087/4066] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:13 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1355 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:13.921304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6b06de55-f5a1-4ce1-b80d-77741d39f201 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b123350d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:14.006519 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6b06de55-f5a1-4ce1-b80d-77741d39f201 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 200 len: 1454 microversion: 2.1 time: 0.097379 Aug 03 02:09:14.019216 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2088/4067] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:13 2022] GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:14.024724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9468c295-5ab9-419b-8408-32b1d0579d3b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:14.025842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9468c295-5ab9-419b-8408-32b1d0579d3b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:14.058259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9468c295-5ab9-419b-8408-32b1d0579d3b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:14.059055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9468c295-5ab9-419b-8408-32b1d0579d3b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:14.060105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9468c295-5ab9-419b-8408-32b1d0579d3b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:14.060980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9468c295-5ab9-419b-8408-32b1d0579d3b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:14.452058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9468c295-5ab9-419b-8408-32b1d0579d3b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:14.461496 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9468c295-5ab9-419b-8408-32b1d0579d3b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 200 len: 1374 microversion: 2.1 time: 0.448483 Aug 03 02:09:14.467521 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2089/4068] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:14 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 1374 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:14.487895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37208315-62ce-4ce0-bd9a-cda8dc5bfe19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:14.488697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-37208315-62ce-4ce0-bd9a-cda8dc5bfe19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:14.497074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37208315-62ce-4ce0-bd9a-cda8dc5bfe19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:14.497819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37208315-62ce-4ce0-bd9a-cda8dc5bfe19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:14.498858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37208315-62ce-4ce0-bd9a-cda8dc5bfe19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:14.499554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37208315-62ce-4ce0-bd9a-cda8dc5bfe19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:16.408414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-37208315-62ce-4ce0-bd9a-cda8dc5bfe19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:16.464668 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-37208315-62ce-4ce0-bd9a-cda8dc5bfe19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1681 microversion: 2.1 time: 1.963444 Aug 03 02:09:16.473820 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2090/4069] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:14 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1681 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:16.506367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bfb6e46d-3c08-4da1-a4d7-5db5cbc2774f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:16.511934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bfb6e46d-3c08-4da1-a4d7-5db5cbc2774f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:16.549029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfb6e46d-3c08-4da1-a4d7-5db5cbc2774f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:16.553887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfb6e46d-3c08-4da1-a4d7-5db5cbc2774f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:16.558118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfb6e46d-3c08-4da1-a4d7-5db5cbc2774f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:16.561182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfb6e46d-3c08-4da1-a4d7-5db5cbc2774f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:16.721131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfb6e46d-3c08-4da1-a4d7-5db5cbc2774f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:16.722243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfb6e46d-3c08-4da1-a4d7-5db5cbc2774f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:16.723385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-bfb6e46d-3c08-4da1-a4d7-5db5cbc2774f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lazy-loading 'fault' on Instance uuid 7f252a17-d550-4e2e-8527-d6445dd64816 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:09:17.149932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bfb6e46d-3c08-4da1-a4d7-5db5cbc2774f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:17.177176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bfb6e46d-3c08-4da1-a4d7-5db5cbc2774f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:17.185366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bfb6e46d-3c08-4da1-a4d7-5db5cbc2774f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25f6ae83e43943aba392814da0ac6fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7860216e78de4669a9cca22c3ce50b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:17.201273 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bfb6e46d-3c08-4da1-a4d7-5db5cbc2774f tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 200 len: 1349 microversion: 2.21 time: 0.723679 Aug 03 02:09:17.211012 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2091/4070] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:09:16 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 1349 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:09:17.230067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c2b3fd56-6fad-4bfb-9acd-4f728d949f2e req-f1c86676-a4b9-4501-a609-f691979821d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c93a8f4-a14e-4937-a7bd-641747f3b86b", "name": "network-vif-plugged", "status": "completed", "tag": "a63917f9-9c39-45f8-a71c-b65c4056617d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:17.291206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c2b3fd56-6fad-4bfb-9acd-4f728d949f2e req-f1c86676-a4b9-4501-a609-f691979821d8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:17.308633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c2b3fd56-6fad-4bfb-9acd-4f728d949f2e req-f1c86676-a4b9-4501-a609-f691979821d8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:17.327288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:09:17.329643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:09:17.331023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:09:17.332075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:09:17.333265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:09:17.390185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:17.393954 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c2b3fd56-6fad-4bfb-9acd-4f728d949f2e req-f1c86676-a4b9-4501-a609-f691979821d8 service nova] Creating event network-vif-plugged:a63917f9-9c39-45f8-a71c-b65c4056617d for instance 4c93a8f4-a14e-4937-a7bd-641747f3b86b on n-h1-826529-8 Aug 03 02:09:17.404018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:17.405991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:17.413567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:17.429071 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c2b3fd56-6fad-4bfb-9acd-4f728d949f2e req-f1c86676-a4b9-4501-a609-f691979821d8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208056 Aug 03 02:09:17.436456 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2092/4071] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:17.466500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2005ad44-6cb6-4270-9922-276f22babe5e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:17.480689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2005ad44-6cb6-4270-9922-276f22babe5e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:17.513019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:09:17.514507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2005ad44-6cb6-4270-9922-276f22babe5e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:17.515591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2005ad44-6cb6-4270-9922-276f22babe5e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:17.520554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2005ad44-6cb6-4270-9922-276f22babe5e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:17.521587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2005ad44-6cb6-4270-9922-276f22babe5e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:17.540852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Getting quotas for user 4c1fb7af331344dcb26c43368a9daa6e and project 9a5bc12da9a94f63bb71700bd01cf416. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:09:17.596906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:09:17.613020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:09:17.731321 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a281c36a-7713-4da7-8569-69d6e124c330 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.747133 Aug 03 02:09:17.743759 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1980/4072] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:09:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 4761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:09:17.756137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-872ae184-6902-4179-a853-19605e27beee tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b1317eaf0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:18.226733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:18.460946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=10 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:18.936173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2005ad44-6cb6-4270-9922-276f22babe5e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:18.968972 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2005ad44-6cb6-4270-9922-276f22babe5e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1355 microversion: 2.1 time: 1.530227 Aug 03 02:09:18.979043 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2093/4073] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:17 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1355 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:18.996087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b5b22a0f-2145-4746-81cc-1e8a5dcc0a85 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:18.997042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b5b22a0f-2145-4746-81cc-1e8a5dcc0a85 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:19.013232 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-872ae184-6902-4179-a853-19605e27beee tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 200 len: 1454 microversion: 2.1 time: 1.267326 Aug 03 02:09:19.032705 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1981/4074] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:17 2022] GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 1454 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:19.033767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5b22a0f-2145-4746-81cc-1e8a5dcc0a85 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:19.034498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5b22a0f-2145-4746-81cc-1e8a5dcc0a85 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:19.035608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5b22a0f-2145-4746-81cc-1e8a5dcc0a85 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:19.036291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5b22a0f-2145-4746-81cc-1e8a5dcc0a85 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:19.039655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-9d8a27f1-290b-44e6-a816-b202e4859ed4 req-a34892b1-2980-44bc-9f21-7bdce137aca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f252a17-d550-4e2e-8527-d6445dd64816", "name": "network-vif-deleted", "tag": "1c02f82c-38b3-4ab1-adea-86e1b9b4a583"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:19.060464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9d8a27f1-290b-44e6-a816-b202e4859ed4 req-a34892b1-2980-44bc-9f21-7bdce137aca2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:19.060926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9d8a27f1-290b-44e6-a816-b202e4859ed4 req-a34892b1-2980-44bc-9f21-7bdce137aca2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:19.085828 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-9d8a27f1-290b-44e6-a816-b202e4859ed4 req-a34892b1-2980-44bc-9f21-7bdce137aca2 service nova] Creating event network-vif-deleted:1c02f82c-38b3-4ab1-adea-86e1b9b4a583 for instance 7f252a17-d550-4e2e-8527-d6445dd64816 on n-h1-826529-8 Aug 03 02:09:19.095855 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-9d8a27f1-290b-44e6-a816-b202e4859ed4 req-a34892b1-2980-44bc-9f21-7bdce137aca2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060732 Aug 03 02:09:19.104548 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1982/4075] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:19.113767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-89f5fe87-3d96-40e5-8b25-5a934932ed30 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:19.114503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-89f5fe87-3d96-40e5-8b25-5a934932ed30 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:19.140106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89f5fe87-3d96-40e5-8b25-5a934932ed30 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:19.141437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89f5fe87-3d96-40e5-8b25-5a934932ed30 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:19.143275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89f5fe87-3d96-40e5-8b25-5a934932ed30 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:19.146238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89f5fe87-3d96-40e5-8b25-5a934932ed30 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:19.187092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:19.793031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b5b22a0f-2145-4746-81cc-1e8a5dcc0a85 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:19.811913 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b5b22a0f-2145-4746-81cc-1e8a5dcc0a85 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 200 len: 1374 microversion: 2.1 time: 0.830569 Aug 03 02:09:19.815302 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2094/4076] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:18 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 1374 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:19.829513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1294e9d1-0d53-4428-b991-29d45dec2e3b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:19.835884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1294e9d1-0d53-4428-b991-29d45dec2e3b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:19.848618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1294e9d1-0d53-4428-b991-29d45dec2e3b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:19.849245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1294e9d1-0d53-4428-b991-29d45dec2e3b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:19.850544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1294e9d1-0d53-4428-b991-29d45dec2e3b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:19.851243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1294e9d1-0d53-4428-b991-29d45dec2e3b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:19.933795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-89f5fe87-3d96-40e5-8b25-5a934932ed30 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:19.953799 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-89f5fe87-3d96-40e5-8b25-5a934932ed30 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1681 microversion: 2.1 time: 0.844749 Aug 03 02:09:19.966817 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1983/4077] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:19 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1681 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:19.996466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e993d0b8-f802-479b-aa8f-56804e255c2c tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:20.005245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e993d0b8-f802-479b-aa8f-56804e255c2c tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:20.027946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e993d0b8-f802-479b-aa8f-56804e255c2c tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:20.029433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e993d0b8-f802-479b-aa8f-56804e255c2c tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:20.033937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e993d0b8-f802-479b-aa8f-56804e255c2c tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:20.034419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e993d0b8-f802-479b-aa8f-56804e255c2c tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:20.078740 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-e993d0b8-f802-479b-aa8f-56804e255c2c tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] HTTP exception thrown: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e993d0b8-f802-479b-aa8f-56804e255c2c tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Request method failure captured: Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 HTTP/1.1 Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6diZ0ZbfHYlN5lIk81nOKLqUMbvxXbsQz7GWydsl9o2v62j0kv1MJhXt0L0qNcp_BMJ0cOEWPo5qz3mQWloL_32qoFZ7QkOD8A8HXflRaw_HvaR7aSoJnU6I6jEDD75LhLSnHpm7clU0Q-wsFqgYfJmeBb1xlHui_MYklnkvUpqqAtw Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.21 Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 7860216e78de4669a9cca22c3ce50b46 Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-InstanceActionsV221TestJSON-228728746 Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7860216e78de4669a9cca22c3ce50b46", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7860216e78de4669a9cca22c3ce50b46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7860216e78de4669a9cca22c3ce50b46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7860216e78de4669a9cca22c3ce50b46"}]}] Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-InstanceActionsV221TestJSON-228728746 Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 7860216e78de4669a9cca22c3ce50b46 Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-228728746 Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-InstanceActionsV221TestJSON-228728746-project Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 25f6ae83e43943aba392814da0ac6fc2 Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-InstanceActionsV221TestJSON-228728746-project Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '7f252a17-d550-4e2e-8527-d6445dd64816'} Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:20.089123 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:09:20.094474 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:20.094474 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:20.094474 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:09:20.094474 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:09:20.094474 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:09:20.094474 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:09:20.094474 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. Aug 03 02:09:20.094474 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:20.098699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e993d0b8-f802-479b-aa8f-56804e255c2c tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Returning 404 to user: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:09:20.100000 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e993d0b8-f802-479b-aa8f-56804e255c2c tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 404 len: 111 microversion: 2.21 time: 0.131598 Aug 03 02:09:20.101118 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1984/4078] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:09:19 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:09:20.112490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-89ef0ad4-2fce-4dfe-83fa-0f111556a66e req-41ec5b49-9aa3-45e0-9ee8-295c8ca3000f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8af391-3cba-4d7b-99e3-f3422e79c797", "name": "network-vif-plugged", "status": "completed", "tag": "00a0c9ed-6d01-4cf2-8a56-b9714b610974"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:20.148815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-89ef0ad4-2fce-4dfe-83fa-0f111556a66e req-41ec5b49-9aa3-45e0-9ee8-295c8ca3000f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:20.151282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-89ef0ad4-2fce-4dfe-83fa-0f111556a66e req-41ec5b49-9aa3-45e0-9ee8-295c8ca3000f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:20.196540 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-89ef0ad4-2fce-4dfe-83fa-0f111556a66e req-41ec5b49-9aa3-45e0-9ee8-295c8ca3000f service nova] Creating event network-vif-plugged:00a0c9ed-6d01-4cf2-8a56-b9714b610974 for instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 on n-h1-826529-8 Aug 03 02:09:20.213751 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-89ef0ad4-2fce-4dfe-83fa-0f111556a66e req-41ec5b49-9aa3-45e0-9ee8-295c8ca3000f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108331 Aug 03 02:09:20.215110 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1985/4079] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:20.236831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-83abede5-3279-449b-9c1a-16919b7aed37 req-a6a29450-929a-4e25-ad66-76a4fadeadcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882d5bbc-8687-4b59-9916-d1b5bd0089b0", "tag": "5e9f7741-aeb8-4dbb-aa33-c8c2fee4e59d"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:20.250644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-83abede5-3279-449b-9c1a-16919b7aed37 req-a6a29450-929a-4e25-ad66-76a4fadeadcf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:20.252592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-83abede5-3279-449b-9c1a-16919b7aed37 req-a6a29450-929a-4e25-ad66-76a4fadeadcf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:20.290466 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-83abede5-3279-449b-9c1a-16919b7aed37 req-a6a29450-929a-4e25-ad66-76a4fadeadcf service nova] Creating event network-changed:5e9f7741-aeb8-4dbb-aa33-c8c2fee4e59d for instance 882d5bbc-8687-4b59-9916-d1b5bd0089b0 on n-h2-826529-8 Aug 03 02:09:20.307719 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-83abede5-3279-449b-9c1a-16919b7aed37 req-a6a29450-929a-4e25-ad66-76a4fadeadcf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088610 Aug 03 02:09:20.309636 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1986/4080] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:20.325750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8e802ad6-796f-4d89-84e3-c6427447594d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:20.327314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8e802ad6-796f-4d89-84e3-c6427447594d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:20.341112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e802ad6-796f-4d89-84e3-c6427447594d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:20.342474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e802ad6-796f-4d89-84e3-c6427447594d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:20.344750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e802ad6-796f-4d89-84e3-c6427447594d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:20.347025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e802ad6-796f-4d89-84e3-c6427447594d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:20.566851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1294e9d1-0d53-4428-b991-29d45dec2e3b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:20.596909 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1294e9d1-0d53-4428-b991-29d45dec2e3b tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 200 len: 1293 microversion: 2.1 time: 0.779236 Aug 03 02:09:20.639595 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2095/4081] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:19 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 1293 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:20.654169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7246294f-cf78-4255-bcf2-ad66b780dcf4 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b12518430>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:20.890088 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7246294f-cf78-4255-bcf2-ad66b780dcf4 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 200 len: 1454 microversion: 2.1 time: 0.247606 Aug 03 02:09:20.896287 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2096/4082] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:20 2022] GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 1454 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:20.912043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a111bee2-8305-4fbd-b08b-c29953392bf3 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '.version_select at 0x7f5b12aba670>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:20.914301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a111bee2-8305-4fbd-b08b-c29953392bf3 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:20.928954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a111bee2-8305-4fbd-b08b-c29953392bf3 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:20.930109 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a111bee2-8305-4fbd-b08b-c29953392bf3 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:20.931984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a111bee2-8305-4fbd-b08b-c29953392bf3 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:20.933314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a111bee2-8305-4fbd-b08b-c29953392bf3 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:21.154951 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a111bee2-8305-4fbd-b08b-c29953392bf3 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.255458 Aug 03 02:09:21.156797 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2097/4083] 10.222.0.67 () {60 vars in 1337 bytes} [Wed Aug 3 02:09:20 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816/os-instance-actions => generated 611 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:09:21.175435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d57b0ddd-6033-4fac-8adb-f0abe99232b0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:21.176073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d57b0ddd-6033-4fac-8adb-f0abe99232b0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:21.183136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d57b0ddd-6033-4fac-8adb-f0abe99232b0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:21.183801 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d57b0ddd-6033-4fac-8adb-f0abe99232b0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:21.184839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d57b0ddd-6033-4fac-8adb-f0abe99232b0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:21.185456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d57b0ddd-6033-4fac-8adb-f0abe99232b0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:21.223428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8e802ad6-796f-4d89-84e3-c6427447594d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:21.237523 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8e802ad6-796f-4d89-84e3-c6427447594d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1355 microversion: 2.1 time: 0.923783 Aug 03 02:09:21.251164 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1987/4084] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:20 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1355 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:21.256936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aaab8642-eeb5-447e-a182-f92293c413f0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:21.257752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-aaab8642-eeb5-447e-a182-f92293c413f0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:21.265231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aaab8642-eeb5-447e-a182-f92293c413f0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:21.265965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aaab8642-eeb5-447e-a182-f92293c413f0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:21.267686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aaab8642-eeb5-447e-a182-f92293c413f0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:21.268601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aaab8642-eeb5-447e-a182-f92293c413f0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:21.804720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d57b0ddd-6033-4fac-8adb-f0abe99232b0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:21.819784 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d57b0ddd-6033-4fac-8adb-f0abe99232b0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 200 len: 1374 microversion: 2.1 time: 0.659642 Aug 03 02:09:21.837260 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2098/4085] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:21 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 1374 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:21.854218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-6e84856c-8ad4-4868-b97a-3f6d754b0525 req-29d31ff8-6493-47d5-a215-43b791d77f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "tag": "8cbd61f7-4c8d-4411-9cf8-c16e2c78580e"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:21.895402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6e84856c-8ad4-4868-b97a-3f6d754b0525 req-29d31ff8-6493-47d5-a215-43b791d77f29 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:21.898672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6e84856c-8ad4-4868-b97a-3f6d754b0525 req-29d31ff8-6493-47d5-a215-43b791d77f29 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:21.940974 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-6e84856c-8ad4-4868-b97a-3f6d754b0525 req-29d31ff8-6493-47d5-a215-43b791d77f29 service nova] Creating event network-changed:8cbd61f7-4c8d-4411-9cf8-c16e2c78580e for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:09:21.964231 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-6e84856c-8ad4-4868-b97a-3f6d754b0525 req-29d31ff8-6493-47d5-a215-43b791d77f29 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126142 Aug 03 02:09:21.966128 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2099/4086] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:21.978127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-21003fcf-0aee-4dd0-8e9a-52e8746f479a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:21.982754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-21003fcf-0aee-4dd0-8e9a-52e8746f479a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:22.006144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21003fcf-0aee-4dd0-8e9a-52e8746f479a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:22.021134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21003fcf-0aee-4dd0-8e9a-52e8746f479a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:22.022620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21003fcf-0aee-4dd0-8e9a-52e8746f479a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:22.024711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21003fcf-0aee-4dd0-8e9a-52e8746f479a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:22.060159 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-21003fcf-0aee-4dd0-8e9a-52e8746f479a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] HTTP exception thrown: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-21003fcf-0aee-4dd0-8e9a-52e8746f479a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Request method failure captured: Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 HTTP/1.1 Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6diZ0ZbfHYlN5lIk81nOKLqUMbvxXbsQz7GWydsl9o2v62j0kv1MJhXt0L0qNcp_BMJ0cOEWPo5qz3mQWloL_32qoFZ7QkOD8A8HXflRaw_HvaR7aSoJnU6I6jEDD75LhLSnHpm7clU0Q-wsFqgYfJmeBb1xlHui_MYklnkvUpqqAtw Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Openstack-Nova-Api-Version: 2.21 Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 7860216e78de4669a9cca22c3ce50b46 Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-InstanceActionsV221TestJSON-228728746 Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7860216e78de4669a9cca22c3ce50b46", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7860216e78de4669a9cca22c3ce50b46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7860216e78de4669a9cca22c3ce50b46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7860216e78de4669a9cca22c3ce50b46"}]}] Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-InstanceActionsV221TestJSON-228728746 Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 7860216e78de4669a9cca22c3ce50b46 Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-228728746 Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-InstanceActionsV221TestJSON-228728746-project Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 25f6ae83e43943aba392814da0ac6fc2 Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-InstanceActionsV221TestJSON-228728746-project Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '7f252a17-d550-4e2e-8527-d6445dd64816'} Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:09:22.062541 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:09:22.068534 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. Aug 03 02:09:22.068534 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:09:22.068534 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:09:22.068534 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:09:22.068534 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:22.068534 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:09:22.068534 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:09:22.068534 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:09:22.068534 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:09:22.068534 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. Aug 03 02:09:22.068534 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:09:22.070812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-21003fcf-0aee-4dd0-8e9a-52e8746f479a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Returning 404 to user: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:09:22.071959 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-21003fcf-0aee-4dd0-8e9a-52e8746f479a tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 404 len: 111 microversion: 2.21 time: 0.104455 Aug 03 02:09:22.077460 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2100/4087] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:09:21 2022] DELETE /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:09:22.084604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-aaab8642-eeb5-447e-a182-f92293c413f0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:22.098085 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aaab8642-eeb5-447e-a182-f92293c413f0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.844931 Aug 03 02:09:22.098717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4f2ef98d-8670-4c20-960f-cfab09e2429d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:22.100177 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1988/4088] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:21 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:22.100773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4f2ef98d-8670-4c20-960f-cfab09e2429d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:22.108582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0d8e26f8-6717-4207-97a9-a2a8b1b86863 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b12657dc0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:22.118255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f2ef98d-8670-4c20-960f-cfab09e2429d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:22.132779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f2ef98d-8670-4c20-960f-cfab09e2429d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:22.134046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f2ef98d-8670-4c20-960f-cfab09e2429d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:22.137916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f2ef98d-8670-4c20-960f-cfab09e2429d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:22.274699 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0d8e26f8-6717-4207-97a9-a2a8b1b86863 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 200 len: 1454 microversion: 2.1 time: 0.170772 Aug 03 02:09:22.279671 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1989/4089] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:22 2022] GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 1454 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:22.299487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-40ef70fd-6fe0-49b1-98e2-4866f7802970 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:22.300340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-40ef70fd-6fe0-49b1-98e2-4866f7802970 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] [instance: 7f252a17-d550-4e2e-8527-d6445dd64816] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:22.316652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40ef70fd-6fe0-49b1-98e2-4866f7802970 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:22.320992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40ef70fd-6fe0-49b1-98e2-4866f7802970 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:22.322970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4f2ef98d-8670-4c20-960f-cfab09e2429d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:22.323598 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40ef70fd-6fe0-49b1-98e2-4866f7802970 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:22.324692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40ef70fd-6fe0-49b1-98e2-4866f7802970 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:22.346841 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4f2ef98d-8670-4c20-960f-cfab09e2429d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 200 len: 1299 microversion: 2.1 time: 0.267575 Aug 03 02:09:22.347817 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2101/4090] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:22 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 1299 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:22.352538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ef83357a-91e2-48e7-a8dd-1466d186dcef tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:22.353164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ef83357a-91e2-48e7-a8dd-1466d186dcef tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:22.358619 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-40ef70fd-6fe0-49b1-98e2-4866f7802970 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] HTTP exception thrown: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-40ef70fd-6fe0-49b1-98e2-4866f7802970 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Request method failure captured: Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 HTTP/1.1 Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6diZ0ZbfHYlN5lIk81nOKLqUMbvxXbsQz7GWydsl9o2v62j0kv1MJhXt0L0qNcp_BMJ0cOEWPo5qz3mQWloL_32qoFZ7QkOD8A8HXflRaw_HvaR7aSoJnU6I6jEDD75LhLSnHpm7clU0Q-wsFqgYfJmeBb1xlHui_MYklnkvUpqqAtw Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.21 Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 7860216e78de4669a9cca22c3ce50b46 Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-InstanceActionsV221TestJSON-228728746 Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7860216e78de4669a9cca22c3ce50b46", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7860216e78de4669a9cca22c3ce50b46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7860216e78de4669a9cca22c3ce50b46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7860216e78de4669a9cca22c3ce50b46"}]}] Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-InstanceActionsV221TestJSON-228728746 Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 7860216e78de4669a9cca22c3ce50b46 Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-228728746 Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-InstanceActionsV221TestJSON-228728746-project Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 25f6ae83e43943aba392814da0ac6fc2 Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-InstanceActionsV221TestJSON-228728746-project Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '7f252a17-d550-4e2e-8527-d6445dd64816'} Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:22.364788 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:09:22.368704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:22.368704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:22.368704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:09:22.368704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:09:22.368704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:09:22.368704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:09:22.368704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. Aug 03 02:09:22.368704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:22.370592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-40ef70fd-6fe0-49b1-98e2-4866f7802970 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] Returning 404 to user: Instance 7f252a17-d550-4e2e-8527-d6445dd64816 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:09:22.371462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef83357a-91e2-48e7-a8dd-1466d186dcef tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:22.372273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef83357a-91e2-48e7-a8dd-1466d186dcef tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:22.373289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef83357a-91e2-48e7-a8dd-1466d186dcef tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:22.373289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef83357a-91e2-48e7-a8dd-1466d186dcef tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:22.374853 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-40ef70fd-6fe0-49b1-98e2-4866f7802970 tempest-InstanceActionsV221TestJSON-228728746 tempest-InstanceActionsV221TestJSON-228728746-project] 10.222.0.67 "GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816" status: 404 len: 111 microversion: 2.21 time: 0.088174 Aug 03 02:09:22.375488 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1990/4091] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:09:22 2022] GET /compute/v2.1/servers/7f252a17-d550-4e2e-8527-d6445dd64816 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:09:22.388712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-3963817c-a791-4ed2-a32f-0f66e3d3b763 req-c64d1717-6bc5-4eda-a585-3fe106993146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8af391-3cba-4d7b-99e3-f3422e79c797", "name": "network-vif-plugged", "status": "completed", "tag": "5d39a548-0726-4bce-be8c-755306d2bcb0"}, {"server_uuid": "6d8af391-3cba-4d7b-99e3-f3422e79c797", "name": "network-vif-plugged", "status": "completed", "tag": "bd718c95-db8c-43bd-b587-ee65f13b6145"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:22.408580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3963817c-a791-4ed2-a32f-0f66e3d3b763 req-c64d1717-6bc5-4eda-a585-3fe106993146 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:22.411500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3963817c-a791-4ed2-a32f-0f66e3d3b763 req-c64d1717-6bc5-4eda-a585-3fe106993146 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:22.444526 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-3963817c-a791-4ed2-a32f-0f66e3d3b763 req-c64d1717-6bc5-4eda-a585-3fe106993146 service nova] Creating event network-vif-plugged:5d39a548-0726-4bce-be8c-755306d2bcb0 for instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 on n-h1-826529-8 Aug 03 02:09:22.445793 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-3963817c-a791-4ed2-a32f-0f66e3d3b763 req-c64d1717-6bc5-4eda-a585-3fe106993146 service nova] Creating event network-vif-plugged:bd718c95-db8c-43bd-b587-ee65f13b6145 for instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 on n-h1-826529-8 Aug 03 02:09:22.461117 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-3963817c-a791-4ed2-a32f-0f66e3d3b763 req-c64d1717-6bc5-4eda-a585-3fe106993146 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076626 Aug 03 02:09:22.465916 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1991/4092] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:22.473539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a306e30a-835b-4d68-b273-fa464c4d5e23 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:22.474523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a306e30a-835b-4d68-b273-fa464c4d5e23 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:22.485073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a306e30a-835b-4d68-b273-fa464c4d5e23 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:22.494821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a306e30a-835b-4d68-b273-fa464c4d5e23 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:22.509391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a306e30a-835b-4d68-b273-fa464c4d5e23 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:22.513670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a306e30a-835b-4d68-b273-fa464c4d5e23 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:23.397994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ef83357a-91e2-48e7-a8dd-1466d186dcef tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:23.409524 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ef83357a-91e2-48e7-a8dd-1466d186dcef tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 1.060292 Aug 03 02:09:23.411040 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2102/4093] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:22 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:23.417625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-976464c0-a684-49d8-b815-db27ebc56409 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:23.418921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-976464c0-a684-49d8-b815-db27ebc56409 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:23.429899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-976464c0-a684-49d8-b815-db27ebc56409 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:23.431187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-976464c0-a684-49d8-b815-db27ebc56409 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:23.432349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-976464c0-a684-49d8-b815-db27ebc56409 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:23.432870 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-976464c0-a684-49d8-b815-db27ebc56409 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:23.852404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a306e30a-835b-4d68-b273-fa464c4d5e23 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:23.877690 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a306e30a-835b-4d68-b273-fa464c4d5e23 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1355 microversion: 2.1 time: 1.409680 Aug 03 02:09:23.897466 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1992/4094] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:22 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1355 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:23.906499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5c130b3c-0aac-4640-8cf6-80d0b02734f6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b132d19d0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:23.942806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-976464c0-a684-49d8-b815-db27ebc56409 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:23.947224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:23.952626 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-976464c0-a684-49d8-b815-db27ebc56409 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 200 len: 1374 microversion: 2.1 time: 0.539505 Aug 03 02:09:23.953218 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2103/4095] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:23 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 1374 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:23.973704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-890d6ae0-bbf0-4775-ae97-729c78de9a8d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:23.974670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-890d6ae0-bbf0-4775-ae97-729c78de9a8d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:23.992497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-890d6ae0-bbf0-4775-ae97-729c78de9a8d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:24.003781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-890d6ae0-bbf0-4775-ae97-729c78de9a8d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:24.004939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-890d6ae0-bbf0-4775-ae97-729c78de9a8d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:24.005609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-890d6ae0-bbf0-4775-ae97-729c78de9a8d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:24.342008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-890d6ae0-bbf0-4775-ae97-729c78de9a8d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:24.377175 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-890d6ae0-bbf0-4775-ae97-729c78de9a8d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 200 len: 1299 microversion: 2.1 time: 0.401724 Aug 03 02:09:24.381713 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2104/4096] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:23 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 1299 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:24.910831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2df8033c-c723-472b-bdad-49a05c68f6c1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:24.911578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2df8033c-c723-472b-bdad-49a05c68f6c1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:24.930434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2df8033c-c723-472b-bdad-49a05c68f6c1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:24.931178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2df8033c-c723-472b-bdad-49a05c68f6c1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:24.931858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2df8033c-c723-472b-bdad-49a05c68f6c1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:24.932359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2df8033c-c723-472b-bdad-49a05c68f6c1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:25.448048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2df8033c-c723-472b-bdad-49a05c68f6c1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:25.463085 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2df8033c-c723-472b-bdad-49a05c68f6c1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1805 microversion: 2.1 time: 0.558785 Aug 03 02:09:25.466606 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2105/4097] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:24 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1805 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:09:25.480358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-13c81986-7a96-477d-a0d6-38141e611850 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:25.482597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-13c81986-7a96-477d-a0d6-38141e611850 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:25.498536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13c81986-7a96-477d-a0d6-38141e611850 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:25.500112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13c81986-7a96-477d-a0d6-38141e611850 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:25.502671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13c81986-7a96-477d-a0d6-38141e611850 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:25.503857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13c81986-7a96-477d-a0d6-38141e611850 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:25.581799 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5c130b3c-0aac-4640-8cf6-80d0b02734f6 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 200 len: 1454 microversion: 2.1 time: 1.679480 Aug 03 02:09:25.582997 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1993/4098] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:23 2022] GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 1454 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:25.598560 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-eda4ba47-6575-4882-92d8-69622026a040 req-f200e9c6-e535-4cbd-80f4-4f99d12ce88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9952a14-056b-4b74-ab8c-791d16592ddf", "name": "network-vif-unplugged", "status": "completed", "tag": "6377bbf1-10a0-437b-a4d1-7bd2f82f03fe"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:25.617678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-eda4ba47-6575-4882-92d8-69622026a040 req-f200e9c6-e535-4cbd-80f4-4f99d12ce88b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:25.621397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-eda4ba47-6575-4882-92d8-69622026a040 req-f200e9c6-e535-4cbd-80f4-4f99d12ce88b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:25.645020 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-eda4ba47-6575-4882-92d8-69622026a040 req-f200e9c6-e535-4cbd-80f4-4f99d12ce88b service nova] Creating event network-vif-unplugged:6377bbf1-10a0-437b-a4d1-7bd2f82f03fe for instance b9952a14-056b-4b74-ab8c-791d16592ddf on n-h1-826529-8 Aug 03 02:09:25.653292 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-eda4ba47-6575-4882-92d8-69622026a040 req-f200e9c6-e535-4cbd-80f4-4f99d12ce88b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066261 Aug 03 02:09:25.656913 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1994/4099] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:25.666384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0630d82b-893d-43cb-af3f-7a8d876f9ef8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:25.667347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0630d82b-893d-43cb-af3f-7a8d876f9ef8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:25.675999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0630d82b-893d-43cb-af3f-7a8d876f9ef8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:25.676654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0630d82b-893d-43cb-af3f-7a8d876f9ef8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:25.677564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0630d82b-893d-43cb-af3f-7a8d876f9ef8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:25.678130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0630d82b-893d-43cb-af3f-7a8d876f9ef8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:26.009987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0630d82b-893d-43cb-af3f-7a8d876f9ef8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:26.035930 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0630d82b-893d-43cb-af3f-7a8d876f9ef8 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 200 len: 1366 microversion: 2.1 time: 0.370678 Aug 03 02:09:26.037169 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1995/4100] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:25 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 1366 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:26.050652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eaba4dc0-2d3a-45a8-98db-983fa30e6d66 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:26.055124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eaba4dc0-2d3a-45a8-98db-983fa30e6d66 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:26.075512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eaba4dc0-2d3a-45a8-98db-983fa30e6d66 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:26.075977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eaba4dc0-2d3a-45a8-98db-983fa30e6d66 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:26.076790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eaba4dc0-2d3a-45a8-98db-983fa30e6d66 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:26.083102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eaba4dc0-2d3a-45a8-98db-983fa30e6d66 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:26.120814 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eaba4dc0-2d3a-45a8-98db-983fa30e6d66 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797/ips" status: 200 len: 218 microversion: 2.1 time: 0.082299 Aug 03 02:09:26.122456 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1996/4101] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 02:09:26 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797/ips => generated 218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:26.130655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5ac36ff4-b91b-41f4-9ef3-fea5aeb7fbb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:26.131716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5ac36ff4-b91b-41f4-9ef3-fea5aeb7fbb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:26.139188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ac36ff4-b91b-41f4-9ef3-fea5aeb7fbb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:26.140004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ac36ff4-b91b-41f4-9ef3-fea5aeb7fbb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:26.141034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ac36ff4-b91b-41f4-9ef3-fea5aeb7fbb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:26.142521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ac36ff4-b91b-41f4-9ef3-fea5aeb7fbb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:26.244970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-13c81986-7a96-477d-a0d6-38141e611850 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:26.253727 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-13c81986-7a96-477d-a0d6-38141e611850 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 200 len: 1374 microversion: 2.1 time: 0.785755 Aug 03 02:09:26.254330 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2106/4102] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:25 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 1374 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:26.270807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-65c77bb6-25bf-4689-8906-3b7b60ad1af6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:26.271742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-65c77bb6-25bf-4689-8906-3b7b60ad1af6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:26.280717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65c77bb6-25bf-4689-8906-3b7b60ad1af6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:26.281301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65c77bb6-25bf-4689-8906-3b7b60ad1af6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:26.287093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65c77bb6-25bf-4689-8906-3b7b60ad1af6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:26.287093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65c77bb6-25bf-4689-8906-3b7b60ad1af6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:26.317333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-65c77bb6-25bf-4689-8906-3b7b60ad1af6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:09:26.454669 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-65c77bb6-25bf-4689-8906-3b7b60ad1af6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 204 len: 0 microversion: 2.1 time: 0.194576 Aug 03 02:09:26.458769 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2107/4103] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:09:26 2022] DELETE /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:09:26.472810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-effc313c-9ec1-4365-bd4b-2b8d37f94bf7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:26.474154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-effc313c-9ec1-4365-bd4b-2b8d37f94bf7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:26.481143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-effc313c-9ec1-4365-bd4b-2b8d37f94bf7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:26.481871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-effc313c-9ec1-4365-bd4b-2b8d37f94bf7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:26.483065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-effc313c-9ec1-4365-bd4b-2b8d37f94bf7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:26.483762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-effc313c-9ec1-4365-bd4b-2b8d37f94bf7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:26.845990 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5ac36ff4-b91b-41f4-9ef3-fea5aeb7fbb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:26.863943 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5ac36ff4-b91b-41f4-9ef3-fea5aeb7fbb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.740134 Aug 03 02:09:26.864535 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1997/4104] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:26 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:26.869757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9d07b809-3548-48d4-a8aa-23aad846593e tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b13203670>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:26.981785 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9d07b809-3548-48d4-a8aa-23aad846593e tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 200 len: 1454 microversion: 2.1 time: 0.116010 Aug 03 02:09:26.983592 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1998/4105] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:26 2022] GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:27.003948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d9bf5e6e-b115-44c8-86ff-6dd3d5a18bf1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:27.004624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d9bf5e6e-b115-44c8-86ff-6dd3d5a18bf1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:27.026112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9bf5e6e-b115-44c8-86ff-6dd3d5a18bf1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:27.027046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9bf5e6e-b115-44c8-86ff-6dd3d5a18bf1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:27.028940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9bf5e6e-b115-44c8-86ff-6dd3d5a18bf1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:27.029950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9bf5e6e-b115-44c8-86ff-6dd3d5a18bf1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:27.221799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-effc313c-9ec1-4365-bd4b-2b8d37f94bf7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:27.241429 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-effc313c-9ec1-4365-bd4b-2b8d37f94bf7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1811 microversion: 2.1 time: 0.775616 Aug 03 02:09:27.257131 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2108/4106] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:26 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1811 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:09:27.273474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-211b2c8a-085a-4557-ac4b-7f6e4255a4f2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:27.274084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-211b2c8a-085a-4557-ac4b-7f6e4255a4f2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:27.278003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:27.313928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-211b2c8a-085a-4557-ac4b-7f6e4255a4f2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:27.314182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-211b2c8a-085a-4557-ac4b-7f6e4255a4f2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:27.323973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-211b2c8a-085a-4557-ac4b-7f6e4255a4f2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:27.324604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-211b2c8a-085a-4557-ac4b-7f6e4255a4f2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:27.471298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:27.577222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:27.715379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d9bf5e6e-b115-44c8-86ff-6dd3d5a18bf1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:27.742468 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d9bf5e6e-b115-44c8-86ff-6dd3d5a18bf1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.755288 Aug 03 02:09:27.744127 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 1999/4107] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:26 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:27.769397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b2fd1706-1903-4c08-a4a7-f638160a640e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:27.770278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b2fd1706-1903-4c08-a4a7-f638160a640e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:27.788752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2fd1706-1903-4c08-a4a7-f638160a640e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:27.789477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2fd1706-1903-4c08-a4a7-f638160a640e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:27.790314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2fd1706-1903-4c08-a4a7-f638160a640e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:27.790761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2fd1706-1903-4c08-a4a7-f638160a640e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:28.690014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-211b2c8a-085a-4557-ac4b-7f6e4255a4f2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:28.706200 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-211b2c8a-085a-4557-ac4b-7f6e4255a4f2 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 200 len: 1366 microversion: 2.1 time: 1.447766 Aug 03 02:09:28.709807 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2109/4108] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:27 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 1366 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:28.728533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-85b28c8e-67ee-4e81-8601-edb171dbecd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:28.730990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-85b28c8e-67ee-4e81-8601-edb171dbecd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:28.757719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85b28c8e-67ee-4e81-8601-edb171dbecd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:28.758289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85b28c8e-67ee-4e81-8601-edb171dbecd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:28.759128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85b28c8e-67ee-4e81-8601-edb171dbecd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:28.759571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85b28c8e-67ee-4e81-8601-edb171dbecd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:29.142237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b2fd1706-1903-4c08-a4a7-f638160a640e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:29.158494 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b2fd1706-1903-4c08-a4a7-f638160a640e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 200 len: 1374 microversion: 2.1 time: 1.411337 Aug 03 02:09:29.169003 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2000/4109] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:27 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 1374 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:29.180556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cc0a38a0-ec18-4efb-9986-7312407b6367 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b132225e0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:29.299390 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cc0a38a0-ec18-4efb-9986-7312407b6367 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 200 len: 1454 microversion: 2.1 time: 0.128648 Aug 03 02:09:29.309329 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2001/4110] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:29 2022] GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 1454 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:29.322586 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f83999ed-5699-4069-a2a5-c951f0fb6c99 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:29.323290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f83999ed-5699-4069-a2a5-c951f0fb6c99 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:29.361919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f83999ed-5699-4069-a2a5-c951f0fb6c99 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:29.366790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f83999ed-5699-4069-a2a5-c951f0fb6c99 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:29.367686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f83999ed-5699-4069-a2a5-c951f0fb6c99 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:29.368150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f83999ed-5699-4069-a2a5-c951f0fb6c99 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:29.647761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-85b28c8e-67ee-4e81-8601-edb171dbecd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:29.666995 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-85b28c8e-67ee-4e81-8601-edb171dbecd6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.955833 Aug 03 02:09:29.670401 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2110/4111] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:28 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:29.698143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-5ccf27e4-0dc1-4aee-9e08-c89c0dc48c3a req-ee30f971-b541-4f2b-907c-c5d7e2a4dcb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8af391-3cba-4d7b-99e3-f3422e79c797", "name": "network-vif-deleted", "tag": "bd718c95-db8c-43bd-b587-ee65f13b6145"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:29.748511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5ccf27e4-0dc1-4aee-9e08-c89c0dc48c3a req-ee30f971-b541-4f2b-907c-c5d7e2a4dcb0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:29.750045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5ccf27e4-0dc1-4aee-9e08-c89c0dc48c3a req-ee30f971-b541-4f2b-907c-c5d7e2a4dcb0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:29.775280 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-5ccf27e4-0dc1-4aee-9e08-c89c0dc48c3a req-ee30f971-b541-4f2b-907c-c5d7e2a4dcb0 service nova] Creating event network-vif-deleted:bd718c95-db8c-43bd-b587-ee65f13b6145 for instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 on n-h1-826529-8 Aug 03 02:09:29.794881 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-5ccf27e4-0dc1-4aee-9e08-c89c0dc48c3a req-ee30f971-b541-4f2b-907c-c5d7e2a4dcb0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122227 Aug 03 02:09:29.798355 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2111/4112] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:29.814351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a27f151d-3f21-473b-b10b-ba31275cabdd req-a31949b4-365a-4bad-9e28-ed009b9d1775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b", "tag": "bee916fb-a434-4739-ac37-90caaee0b3c4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:29.837946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a27f151d-3f21-473b-b10b-ba31275cabdd req-a31949b4-365a-4bad-9e28-ed009b9d1775 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:29.839233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a27f151d-3f21-473b-b10b-ba31275cabdd req-a31949b4-365a-4bad-9e28-ed009b9d1775 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:29.879884 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a27f151d-3f21-473b-b10b-ba31275cabdd req-a31949b4-365a-4bad-9e28-ed009b9d1775 service nova] Creating event network-changed:bee916fb-a434-4739-ac37-90caaee0b3c4 for instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b on n-h1-826529-8 Aug 03 02:09:29.886712 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a27f151d-3f21-473b-b10b-ba31275cabdd req-a31949b4-365a-4bad-9e28-ed009b9d1775 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085175 Aug 03 02:09:29.893465 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2112/4113] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:29.912816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2fcc9fa5-3a3a-47d4-9725-ba7044afa7db req-e8e1aa3f-219b-4e44-8bd9-38ac7570ccbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882d5bbc-8687-4b59-9916-d1b5bd0089b0", "name": "network-vif-plugged", "status": "completed", "tag": "5e9f7741-aeb8-4dbb-aa33-c8c2fee4e59d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:29.947226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2fcc9fa5-3a3a-47d4-9725-ba7044afa7db req-e8e1aa3f-219b-4e44-8bd9-38ac7570ccbb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:29.953263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2fcc9fa5-3a3a-47d4-9725-ba7044afa7db req-e8e1aa3f-219b-4e44-8bd9-38ac7570ccbb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:29.980009 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2fcc9fa5-3a3a-47d4-9725-ba7044afa7db req-e8e1aa3f-219b-4e44-8bd9-38ac7570ccbb service nova] Creating event network-vif-plugged:5e9f7741-aeb8-4dbb-aa33-c8c2fee4e59d for instance 882d5bbc-8687-4b59-9916-d1b5bd0089b0 on n-h2-826529-8 Aug 03 02:09:29.997207 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2fcc9fa5-3a3a-47d4-9725-ba7044afa7db req-e8e1aa3f-219b-4e44-8bd9-38ac7570ccbb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102041 Aug 03 02:09:30.001643 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2113/4114] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:30.030287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a59b6983-5cb5-4760-a433-e523a064399c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:30.038168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a59b6983-5cb5-4760-a433-e523a064399c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:30.069192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a59b6983-5cb5-4760-a433-e523a064399c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:30.095315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a59b6983-5cb5-4760-a433-e523a064399c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:30.098423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a59b6983-5cb5-4760-a433-e523a064399c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:30.101116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f83999ed-5699-4069-a2a5-c951f0fb6c99 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:30.105028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a59b6983-5cb5-4760-a433-e523a064399c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:30.130177 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f83999ed-5699-4069-a2a5-c951f0fb6c99 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1790 microversion: 2.1 time: 0.825650 Aug 03 02:09:30.144066 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2002/4115] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:29 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1790 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:30.162114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ac04362d-b858-425d-98d2-c3029a83bc6d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:30.165956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ac04362d-b858-425d-98d2-c3029a83bc6d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:30.181098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac04362d-b858-425d-98d2-c3029a83bc6d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:30.182508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac04362d-b858-425d-98d2-c3029a83bc6d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:30.195743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac04362d-b858-425d-98d2-c3029a83bc6d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:30.196868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac04362d-b858-425d-98d2-c3029a83bc6d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:30.306083 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a59b6983-5cb5-4760-a433-e523a064399c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.302117 Aug 03 02:09:30.310468 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2114/4116] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:09:30 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:09:30.322537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bd8bc647-209b-4dfe-9cf5-3adcd2835a4f tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:30.323450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bd8bc647-209b-4dfe-9cf5-3adcd2835a4f tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:30.347656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd8bc647-209b-4dfe-9cf5-3adcd2835a4f tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:30.349213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd8bc647-209b-4dfe-9cf5-3adcd2835a4f tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:30.351092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd8bc647-209b-4dfe-9cf5-3adcd2835a4f tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:30.352515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd8bc647-209b-4dfe-9cf5-3adcd2835a4f tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:30.952798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ac04362d-b858-425d-98d2-c3029a83bc6d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:30.965572 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ac04362d-b858-425d-98d2-c3029a83bc6d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 200 len: 1366 microversion: 2.1 time: 0.817868 Aug 03 02:09:30.967519 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2003/4117] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:30 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 1366 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:30.977524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b752e479-a956-45a4-8641-a5ba3d9e507c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:30.978182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b752e479-a956-45a4-8641-a5ba3d9e507c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:31.007334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b752e479-a956-45a4-8641-a5ba3d9e507c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:31.007822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b752e479-a956-45a4-8641-a5ba3d9e507c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:31.008654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b752e479-a956-45a4-8641-a5ba3d9e507c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:31.009102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b752e479-a956-45a4-8641-a5ba3d9e507c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:31.339158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bd8bc647-209b-4dfe-9cf5-3adcd2835a4f tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:31.363691 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bd8bc647-209b-4dfe-9cf5-3adcd2835a4f tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 200 len: 1374 microversion: 2.1 time: 1.048359 Aug 03 02:09:31.383082 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2115/4118] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:30 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 1374 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:31.389777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f9f2b39a-7fb7-4710-8cbe-21c70c5b7225 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b12538af0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:31.496199 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f9f2b39a-7fb7-4710-8cbe-21c70c5b7225 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 200 len: 1454 microversion: 2.1 time: 0.111521 Aug 03 02:09:31.497872 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2116/4119] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:31 2022] GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:31.511300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-04e9581c-b47c-4c40-b5eb-fce9cc6f40e5 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:31.532800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-04e9581c-b47c-4c40-b5eb-fce9cc6f40e5 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:31.549893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04e9581c-b47c-4c40-b5eb-fce9cc6f40e5 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:31.550831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04e9581c-b47c-4c40-b5eb-fce9cc6f40e5 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:31.552025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04e9581c-b47c-4c40-b5eb-fce9cc6f40e5 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:31.552759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04e9581c-b47c-4c40-b5eb-fce9cc6f40e5 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:31.636169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04e9581c-b47c-4c40-b5eb-fce9cc6f40e5 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:31.636891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04e9581c-b47c-4c40-b5eb-fce9cc6f40e5 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:31.637434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-04e9581c-b47c-4c40-b5eb-fce9cc6f40e5 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lazy-loading 'fault' on Instance uuid 6d8af391-3cba-4d7b-99e3-f3422e79c797 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:09:31.670691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b752e479-a956-45a4-8641-a5ba3d9e507c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:31.693895 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b752e479-a956-45a4-8641-a5ba3d9e507c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1670 microversion: 2.1 time: 0.725125 Aug 03 02:09:31.695282 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2004/4120] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:30 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1670 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:31.723705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-04e9581c-b47c-4c40-b5eb-fce9cc6f40e5 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:31.743913 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-04e9581c-b47c-4c40-b5eb-fce9cc6f40e5 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1303 microversion: 2.1 time: 0.243551 Aug 03 02:09:31.768702 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2117/4121] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:31 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1303 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:31.841233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-111c60ac-718e-457e-9348-83eb7c309ec9 req-1aca087d-dfca-4ff6-a644-bd9b1691b2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8af391-3cba-4d7b-99e3-f3422e79c797", "name": "network-vif-deleted", "tag": "5d39a548-0726-4bce-be8c-755306d2bcb0"}, {"server_uuid": "6d8af391-3cba-4d7b-99e3-f3422e79c797", "name": "network-vif-deleted", "tag": "00a0c9ed-6d01-4cf2-8a56-b9714b610974"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:31.866524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-111c60ac-718e-457e-9348-83eb7c309ec9 req-1aca087d-dfca-4ff6-a644-bd9b1691b2c6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:31.867072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-111c60ac-718e-457e-9348-83eb7c309ec9 req-1aca087d-dfca-4ff6-a644-bd9b1691b2c6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:31.898630 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-111c60ac-718e-457e-9348-83eb7c309ec9 req-1aca087d-dfca-4ff6-a644-bd9b1691b2c6 service nova] Creating event network-vif-deleted:5d39a548-0726-4bce-be8c-755306d2bcb0 for instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 on n-h1-826529-8 Aug 03 02:09:31.905738 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-111c60ac-718e-457e-9348-83eb7c309ec9 req-1aca087d-dfca-4ff6-a644-bd9b1691b2c6 service nova] Creating event network-vif-deleted:00a0c9ed-6d01-4cf2-8a56-b9714b610974 for instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 on n-h1-826529-8 Aug 03 02:09:31.924118 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-111c60ac-718e-457e-9348-83eb7c309ec9 req-1aca087d-dfca-4ff6-a644-bd9b1691b2c6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087893 Aug 03 02:09:31.929204 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2005/4122] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:09:31.996263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7678bbc6-ad08-4646-b8c0-1c4cd48117fb tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:31.997062 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7678bbc6-ad08-4646-b8c0-1c4cd48117fb tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:32.014937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7678bbc6-ad08-4646-b8c0-1c4cd48117fb tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:32.015562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7678bbc6-ad08-4646-b8c0-1c4cd48117fb tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:32.017414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7678bbc6-ad08-4646-b8c0-1c4cd48117fb tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:32.017978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7678bbc6-ad08-4646-b8c0-1c4cd48117fb tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:32.268836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7678bbc6-ad08-4646-b8c0-1c4cd48117fb tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:32.280286 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7678bbc6-ad08-4646-b8c0-1c4cd48117fb tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 200 len: 1366 microversion: 2.1 time: 0.290961 Aug 03 02:09:32.282465 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2118/4123] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:31 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:32.405402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-549f3b3c-1bb4-45ad-9458-7469477b41b3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:32.409083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-549f3b3c-1bb4-45ad-9458-7469477b41b3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:32.417897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-549f3b3c-1bb4-45ad-9458-7469477b41b3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:32.418737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-549f3b3c-1bb4-45ad-9458-7469477b41b3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:32.420384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-549f3b3c-1bb4-45ad-9458-7469477b41b3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:32.421183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-549f3b3c-1bb4-45ad-9458-7469477b41b3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:32.515686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-db02805e-b617-466e-a300-dd5e6877334a tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b137a8670>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:32.646702 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-db02805e-b617-466e-a300-dd5e6877334a tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 200 len: 1454 microversion: 2.1 time: 0.137908 Aug 03 02:09:32.648814 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2119/4124] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:32 2022] GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 1454 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:09:32.721219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4be4210-9ae7-470f-b1d2-1b9623568392 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:32.721938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f4be4210-9ae7-470f-b1d2-1b9623568392 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:32.736586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4be4210-9ae7-470f-b1d2-1b9623568392 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:32.737174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4be4210-9ae7-470f-b1d2-1b9623568392 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:32.739890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4be4210-9ae7-470f-b1d2-1b9623568392 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:32.740860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4be4210-9ae7-470f-b1d2-1b9623568392 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:32.852854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-549f3b3c-1bb4-45ad-9458-7469477b41b3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:32.899999 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-549f3b3c-1bb4-45ad-9458-7469477b41b3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 200 len: 1374 microversion: 2.1 time: 0.507525 Aug 03 02:09:32.913036 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2006/4125] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:32 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 1374 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:32.925326 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e35fce36-9477-4677-81c0-7d4840a53976 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:32.929783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e35fce36-9477-4677-81c0-7d4840a53976 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:32.952534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e35fce36-9477-4677-81c0-7d4840a53976 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:32.955067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e35fce36-9477-4677-81c0-7d4840a53976 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:32.956342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e35fce36-9477-4677-81c0-7d4840a53976 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:32.959473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e35fce36-9477-4677-81c0-7d4840a53976 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:33.145775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e35fce36-9477-4677-81c0-7d4840a53976 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:33.149476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e35fce36-9477-4677-81c0-7d4840a53976 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:33.150818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-e35fce36-9477-4677-81c0-7d4840a53976 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lazy-loading 'fault' on Instance uuid 6d8af391-3cba-4d7b-99e3-f3422e79c797 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:09:33.343229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e35fce36-9477-4677-81c0-7d4840a53976 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:33.360673 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e35fce36-9477-4677-81c0-7d4840a53976 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 200 len: 1303 microversion: 2.1 time: 0.443694 Aug 03 02:09:33.361915 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2007/4126] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:32 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 1303 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:33.385248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bf75bdae-3861-471c-859b-0ee9ffdac5df tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:33.386334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bf75bdae-3861-471c-859b-0ee9ffdac5df tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:33.393767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf75bdae-3861-471c-859b-0ee9ffdac5df tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:33.394318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf75bdae-3861-471c-859b-0ee9ffdac5df tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:33.395496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf75bdae-3861-471c-859b-0ee9ffdac5df tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:33.396474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf75bdae-3861-471c-859b-0ee9ffdac5df tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:33.644754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f4be4210-9ae7-470f-b1d2-1b9623568392 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:33.656544 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f4be4210-9ae7-470f-b1d2-1b9623568392 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1670 microversion: 2.1 time: 0.939668 Aug 03 02:09:33.657801 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2120/4127] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:32 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1670 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:33.672124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ce6b0c75-8472-4bec-a23f-956f74d30708 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b125d2790>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:33.767959 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ce6b0c75-8472-4bec-a23f-956f74d30708 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 200 len: 1454 microversion: 2.1 time: 0.106437 Aug 03 02:09:33.777898 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2121/4128] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:33 2022] GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:33.805843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bf75bdae-3861-471c-859b-0ee9ffdac5df tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:33.808218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:33.818133 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bf75bdae-3861-471c-859b-0ee9ffdac5df tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 200 len: 1366 microversion: 2.1 time: 0.455048 Aug 03 02:09:33.824160 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2008/4129] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:33 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:33.940207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-230fdd09-2efb-413b-9fb1-aa3cfdb391d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:33.940849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-230fdd09-2efb-413b-9fb1-aa3cfdb391d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:33.954859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-230fdd09-2efb-413b-9fb1-aa3cfdb391d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:33.955357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-230fdd09-2efb-413b-9fb1-aa3cfdb391d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:33.956165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-230fdd09-2efb-413b-9fb1-aa3cfdb391d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:33.956613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-230fdd09-2efb-413b-9fb1-aa3cfdb391d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:34.002286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:34.358199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-230fdd09-2efb-413b-9fb1-aa3cfdb391d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:34.377734 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-230fdd09-2efb-413b-9fb1-aa3cfdb391d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 200 len: 1547 microversion: 2.1 time: 0.443238 Aug 03 02:09:34.391443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-162360f8-af2f-405a-b501-371b5b8dbf76 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:34.392901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-162360f8-af2f-405a-b501-371b5b8dbf76 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:34.401770 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2122/4130] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:33 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 1547 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:09:34.407679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1e3ff56d-7804-4acd-b034-c449a6f5e6d7 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:34.408587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1e3ff56d-7804-4acd-b034-c449a6f5e6d7 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:34.417040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e3ff56d-7804-4acd-b034-c449a6f5e6d7 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:34.417824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e3ff56d-7804-4acd-b034-c449a6f5e6d7 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:34.419251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e3ff56d-7804-4acd-b034-c449a6f5e6d7 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:34.419928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e3ff56d-7804-4acd-b034-c449a6f5e6d7 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:34.433760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-162360f8-af2f-405a-b501-371b5b8dbf76 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:34.434515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-162360f8-af2f-405a-b501-371b5b8dbf76 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:34.442021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-162360f8-af2f-405a-b501-371b5b8dbf76 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:34.442758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-162360f8-af2f-405a-b501-371b5b8dbf76 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:34.477408 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-162360f8-af2f-405a-b501-371b5b8dbf76 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] HTTP exception thrown: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-162360f8-af2f-405a-b501-371b5b8dbf76 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Request method failure captured: Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 HTTP/1.1 Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dibcUcVaK_83ByI97mmmgLtm8myGL-qUBxJSDDywnZTFWdmJ4ugcSImrtdE6-EJcb1nvxtsYFDGJ6EqDgLpicW4ylAyiohI4tXxqpNsjEc6RKRlVcBb0GrQXtqXJTu3sMEAPcMF1vK8eVo0Kyh_vJ5Lhy2xC8Fe0UgDahL2x0Nw4Cw Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 9fa7b92a26924225842a35fbdf0582be Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestMultiNic-238509208 Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9fa7b92a26924225842a35fbdf0582be", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9fa7b92a26924225842a35fbdf0582be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9fa7b92a26924225842a35fbdf0582be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9fa7b92a26924225842a35fbdf0582be"}]}] Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestMultiNic-238509208 Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 9fa7b92a26924225842a35fbdf0582be Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestMultiNic-238509208 Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestMultiNic-238509208-project Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 37f3ee587f9e4e108351dd67cc6b7796 Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestMultiNic-238509208-project Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '6d8af391-3cba-4d7b-99e3-f3422e79c797'} Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:09:34.479914 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:34.512521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:34.512521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:09:34.512521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:09:34.512521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:09:34.512521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:09:34.512521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. Aug 03 02:09:34.512521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:34.512521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-162360f8-af2f-405a-b501-371b5b8dbf76 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Returning 404 to user: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:09:34.512521 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-162360f8-af2f-405a-b501-371b5b8dbf76 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 404 len: 111 microversion: 2.1 time: 0.096105 Aug 03 02:09:34.512521 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2009/4131] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:34 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:09:34.694549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b4bf1747-746b-41fe-a5c2-00845eae98ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:34.697282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b4bf1747-746b-41fe-a5c2-00845eae98ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:34.713568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4bf1747-746b-41fe-a5c2-00845eae98ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:34.717093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4bf1747-746b-41fe-a5c2-00845eae98ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:34.717934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4bf1747-746b-41fe-a5c2-00845eae98ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:34.718827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4bf1747-746b-41fe-a5c2-00845eae98ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:35.946101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1e3ff56d-7804-4acd-b034-c449a6f5e6d7 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:35.970655 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1e3ff56d-7804-4acd-b034-c449a6f5e6d7 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 200 len: 1547 microversion: 2.1 time: 1.563399 Aug 03 02:09:35.972318 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2123/4132] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:34 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 1547 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:35.983313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d088744-3d60-4db2-8c58-8f5cb07eb897 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b125b6a60>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:36.112707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b4bf1747-746b-41fe-a5c2-00845eae98ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:36.135346 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6d088744-3d60-4db2-8c58-8f5cb07eb897 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 200 len: 1454 microversion: 2.1 time: 0.159645 Aug 03 02:09:36.147157 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2124/4133] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:35 2022] GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:36.151919 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b4bf1747-746b-41fe-a5c2-00845eae98ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1675 microversion: 2.1 time: 1.465308 Aug 03 02:09:36.153569 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2010/4134] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:34 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1675 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:36.162661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5794b0e7-5787-4e6c-8089-c2b60c971ae1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:36.176955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5794b0e7-5787-4e6c-8089-c2b60c971ae1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:36.199936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5794b0e7-5787-4e6c-8089-c2b60c971ae1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:36.200408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5794b0e7-5787-4e6c-8089-c2b60c971ae1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:36.201722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5794b0e7-5787-4e6c-8089-c2b60c971ae1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:36.205420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5794b0e7-5787-4e6c-8089-c2b60c971ae1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:36.964472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5794b0e7-5787-4e6c-8089-c2b60c971ae1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:37.031371 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5794b0e7-5787-4e6c-8089-c2b60c971ae1 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 200 len: 1366 microversion: 2.1 time: 0.876739 Aug 03 02:09:37.034152 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2125/4135] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:36 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 1366 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:37.167810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-547f5840-57c9-4268-9259-907c3c2d821e tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b1343ee50>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:37.179214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-912802f4-4f79-4c10-844c-07f77abc636c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:37.180871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-912802f4-4f79-4c10-844c-07f77abc636c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:37.197527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-912802f4-4f79-4c10-844c-07f77abc636c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:37.198883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-912802f4-4f79-4c10-844c-07f77abc636c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:37.199940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-912802f4-4f79-4c10-844c-07f77abc636c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:37.201320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-912802f4-4f79-4c10-844c-07f77abc636c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:37.323498 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-547f5840-57c9-4268-9259-907c3c2d821e tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 200 len: 1463 microversion: 2.1 time: 0.160075 Aug 03 02:09:37.325499 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2011/4136] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:37 2022] GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 1463 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:37.351956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-41c3deb8-8ab1-4411-810f-4b3ba216e982 req-b116662c-961b-407e-a152-fcdc5679e05e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b", "name": "network-vif-plugged", "status": "completed", "tag": "bee916fb-a434-4739-ac37-90caaee0b3c4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:37.390514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:37.400512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-41c3deb8-8ab1-4411-810f-4b3ba216e982 req-b116662c-961b-407e-a152-fcdc5679e05e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:37.401379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-41c3deb8-8ab1-4411-810f-4b3ba216e982 req-b116662c-961b-407e-a152-fcdc5679e05e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:37.423276 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-41c3deb8-8ab1-4411-810f-4b3ba216e982 req-b116662c-961b-407e-a152-fcdc5679e05e service nova] Creating event network-vif-plugged:bee916fb-a434-4739-ac37-90caaee0b3c4 for instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b on n-h1-826529-8 Aug 03 02:09:37.430511 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-41c3deb8-8ab1-4411-810f-4b3ba216e982 req-b116662c-961b-407e-a152-fcdc5679e05e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096017 Aug 03 02:09:37.437103 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2012/4137] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:37.445602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-af785b8d-11e8-4db7-b1df-aa491dfef251 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b132228b0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:37.530547 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-af785b8d-11e8-4db7-b1df-aa491dfef251 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 200 len: 1463 microversion: 2.1 time: 0.090710 Aug 03 02:09:37.531582 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2013/4138] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:37 2022] GET /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 1463 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:37.553527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-94a6c764-4a16-4018-bdf1-f6a8b2d79a97 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:37.555454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-94a6c764-4a16-4018-bdf1-f6a8b2d79a97 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 4c93a8f4-a14e-4937-a7bd-641747f3b86b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:37.568785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94a6c764-4a16-4018-bdf1-f6a8b2d79a97 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:37.570205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94a6c764-4a16-4018-bdf1-f6a8b2d79a97 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:37.571895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94a6c764-4a16-4018-bdf1-f6a8b2d79a97 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:37.572904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94a6c764-4a16-4018-bdf1-f6a8b2d79a97 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:37.857955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-912802f4-4f79-4c10-844c-07f77abc636c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:37.867799 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-912802f4-4f79-4c10-844c-07f77abc636c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.695522 Aug 03 02:09:37.883323 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2126/4139] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:37 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:37.893557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-152fab22-0fea-469c-b2f1-dacb951fbd9e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:37.896616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-152fab22-0fea-469c-b2f1-dacb951fbd9e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:37.904189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-152fab22-0fea-469c-b2f1-dacb951fbd9e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:37.905119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-152fab22-0fea-469c-b2f1-dacb951fbd9e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:37.906158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-152fab22-0fea-469c-b2f1-dacb951fbd9e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:37.907561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-152fab22-0fea-469c-b2f1-dacb951fbd9e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:38.005942 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-152fab22-0fea-469c-b2f1-dacb951fbd9e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 200 len: 323 microversion: 2.1 time: 0.116267 Aug 03 02:09:38.009485 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2127/4140] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:09:37 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 323 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:38.029049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7b2562f5-65cf-46a6-ae82-b7f5857b8b74 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:38.030190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7b2562f5-65cf-46a6-ae82-b7f5857b8b74 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:38.064221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b2562f5-65cf-46a6-ae82-b7f5857b8b74 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:38.074309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b2562f5-65cf-46a6-ae82-b7f5857b8b74 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:38.076769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b2562f5-65cf-46a6-ae82-b7f5857b8b74 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:38.085487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b2562f5-65cf-46a6-ae82-b7f5857b8b74 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:38.181621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-94a6c764-4a16-4018-bdf1-f6a8b2d79a97 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:38.194925 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-94a6c764-4a16-4018-bdf1-f6a8b2d79a97 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b" status: 200 len: 1467 microversion: 2.1 time: 0.649351 Aug 03 02:09:38.218230 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2014/4141] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:37 2022] GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b => generated 1467 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:38.224614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d274f640-7483-4af3-adce-0035fcdf4d7e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:38.226064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d274f640-7483-4af3-adce-0035fcdf4d7e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:38.233799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d274f640-7483-4af3-adce-0035fcdf4d7e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:38.234518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d274f640-7483-4af3-adce-0035fcdf4d7e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:38.236330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d274f640-7483-4af3-adce-0035fcdf4d7e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:38.236947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d274f640-7483-4af3-adce-0035fcdf4d7e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:38.814332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d274f640-7483-4af3-adce-0035fcdf4d7e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:38.829277 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d274f640-7483-4af3-adce-0035fcdf4d7e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 200 len: 1366 microversion: 2.1 time: 0.608590 Aug 03 02:09:38.830723 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2015/4142] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:38 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 1366 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:38.847534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-18f1bdaf-1fc5-4a5c-ab4f-2be2488a980b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b13e318b0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:38.849076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7b2562f5-65cf-46a6-ae82-b7f5857b8b74 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:38.861038 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7b2562f5-65cf-46a6-ae82-b7f5857b8b74 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.843247 Aug 03 02:09:38.863675 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2128/4143] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:38 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:09:38.891723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0d216cc9-78d4-4754-b8ad-362af15571b6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:38.892611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0d216cc9-78d4-4754-b8ad-362af15571b6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:38.904669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d216cc9-78d4-4754-b8ad-362af15571b6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:38.905153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d216cc9-78d4-4754-b8ad-362af15571b6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:38.906046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d216cc9-78d4-4754-b8ad-362af15571b6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:38.911645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d216cc9-78d4-4754-b8ad-362af15571b6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:39.093242 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-18f1bdaf-1fc5-4a5c-ab4f-2be2488a980b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images?changes-since=2022-08-03T02%3A07%3A12Z" status: 200 len: 1901 microversion: 2.1 time: 0.261128 Aug 03 02:09:39.094931 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2016/4144] 10.222.0.67 () {58 vars in 1199 bytes} [Wed Aug 3 02:09:38 2022] GET /compute/v2.1/images?changes-since=2022-08-03T02%3A07%3A12Z => generated 1901 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:39.111324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f4a60031-444c-48cf-a100-c975e081f3c0 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b13222700>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:39.283068 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f4a60031-444c-48cf-a100-c975e081f3c0 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-228831808" status: 200 len: 484 microversion: 2.1 time: 0.176231 Aug 03 02:09:39.285818 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2017/4145] 10.222.0.67 () {58 vars in 1229 bytes} [Wed Aug 3 02:09:39 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-228831808 => generated 484 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:39.300180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c657d169-2ba3-453d-a32b-fd8fa5cc6a5f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b13e318b0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:39.431545 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c657d169-2ba3-453d-a32b-fd8fa5cc6a5f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images?server=4c93a8f4-a14e-4937-a7bd-641747f3b86b" status: 200 len: 956 microversion: 2.1 time: 0.134862 Aug 03 02:09:39.432535 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2018/4146] 10.222.0.67 () {58 vars in 1209 bytes} [Wed Aug 3 02:09:39 2022] GET /compute/v2.1/images?server=4c93a8f4-a14e-4937-a7bd-641747f3b86b => generated 956 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:09:39.452143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-12b4d1ca-1714-4aee-8df3-3a921696c4a1 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b1317ef70>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:39.520944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0d216cc9-78d4-4754-b8ad-362af15571b6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:39.543760 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0d216cc9-78d4-4754-b8ad-362af15571b6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.656630 Aug 03 02:09:39.545219 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2129/4147] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:38 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:09:39.567994 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-12b4d1ca-1714-4aee-8df3-3a921696c4a1 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fv2.1%2Fservers%2F7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 484 microversion: 2.1 time: 0.120030 Aug 03 02:09:39.568928 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2019/4148] 10.222.0.67 () {58 vars in 1317 bytes} [Wed Aug 3 02:09:39 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fv2.1%2Fservers%2F7ead359f-4427-4285-9677-d3cac524d8b2 => generated 484 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:09:39.584370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3e09fc52-dda4-4a43-a260-f7c1b690f151 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b245c4820>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:39.585268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-77628d45-8c2b-4481-a4a6-bce9a33f90f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:39.586344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-77628d45-8c2b-4481-a4a6-bce9a33f90f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:39.596445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77628d45-8c2b-4481-a4a6-bce9a33f90f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:39.598567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77628d45-8c2b-4481-a4a6-bce9a33f90f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:39.599790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77628d45-8c2b-4481-a4a6-bce9a33f90f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:39.600263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77628d45-8c2b-4481-a4a6-bce9a33f90f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:39.664594 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3e09fc52-dda4-4a43-a260-f7c1b690f151 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fservers%2F7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 484 microversion: 2.1 time: 0.086952 Aug 03 02:09:39.665387 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2020/4149] 10.222.0.67 () {58 vars in 1303 bytes} [Wed Aug 3 02:09:39 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fservers%2F7ead359f-4427-4285-9677-d3cac524d8b2 => generated 484 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:09:39.679858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0a883e67-6691-4bf5-a3f8-ed1393dd5403 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b244cd040>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:39.817881 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0a883e67-6691-4bf5-a3f8-ed1393dd5403 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.141755 Aug 03 02:09:39.819566 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2021/4150] 10.222.0.67 () {58 vars in 1149 bytes} [Wed Aug 3 02:09:39 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:39.836596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bbba0813-38f7-4125-907e-b893f1e1e304 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b2450a280>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:39.951180 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bbba0813-38f7-4125-907e-b893f1e1e304 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.119101 Aug 03 02:09:39.962620 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2022/4151] 10.222.0.67 () {58 vars in 1149 bytes} [Wed Aug 3 02:09:39 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:39.968303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-03377570-ad0b-4017-9bd8-9f8b0db689c3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:39.968930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-03377570-ad0b-4017-9bd8-9f8b0db689c3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:39.978482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03377570-ad0b-4017-9bd8-9f8b0db689c3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:39.979365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03377570-ad0b-4017-9bd8-9f8b0db689c3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:39.980582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03377570-ad0b-4017-9bd8-9f8b0db689c3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:39.982218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03377570-ad0b-4017-9bd8-9f8b0db689c3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:40.016429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-77628d45-8c2b-4481-a4a6-bce9a33f90f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:40.032631 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-77628d45-8c2b-4481-a4a6-bce9a33f90f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.452874 Aug 03 02:09:40.040257 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2130/4152] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:39 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:40.046050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-39d67afe-1a3e-43d2-a29d-3c59ff406844 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b122d9160>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:40.142652 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-39d67afe-1a3e-43d2-a29d-3c59ff406844 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.099477 Aug 03 02:09:40.143428 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2131/4153] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 02:09:40 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:40.149868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b8e478ea-5575-43bd-8d9f-881208a3576d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:40.150688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b8e478ea-5575-43bd-8d9f-881208a3576d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:40.164517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8e478ea-5575-43bd-8d9f-881208a3576d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:40.165147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8e478ea-5575-43bd-8d9f-881208a3576d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:40.166478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8e478ea-5575-43bd-8d9f-881208a3576d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:40.168496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8e478ea-5575-43bd-8d9f-881208a3576d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:40.599465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-03377570-ad0b-4017-9bd8-9f8b0db689c3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:40.610402 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-03377570-ad0b-4017-9bd8-9f8b0db689c3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 200 len: 1556 microversion: 2.1 time: 0.646370 Aug 03 02:09:40.621655 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2023/4154] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:39 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 1556 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:40.636214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e5166332-51a2-4df1-b5ef-10eb91e84285 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b1317e160>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:40.752305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b8e478ea-5575-43bd-8d9f-881208a3576d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:40.781065 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b8e478ea-5575-43bd-8d9f-881208a3576d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.635789 Aug 03 02:09:40.794936 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2132/4155] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:40 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:40.794936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-da959ff4-968f-407f-a7a1-d0ed0f6f6cab tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:40.794936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-da959ff4-968f-407f-a7a1-d0ed0f6f6cab tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:40.799294 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e5166332-51a2-4df1-b5ef-10eb91e84285 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/detail?changes-since=2022-08-03T02%3A07%3A07Z" status: 200 len: 6332 microversion: 2.1 time: 0.168312 Aug 03 02:09:40.800370 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2024/4156] 10.222.0.67 () {58 vars in 1220 bytes} [Wed Aug 3 02:09:40 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-03T02%3A07%3A07Z => generated 6332 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:40.815029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da959ff4-968f-407f-a7a1-d0ed0f6f6cab tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:40.815792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da959ff4-968f-407f-a7a1-d0ed0f6f6cab tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:40.817033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da959ff4-968f-407f-a7a1-d0ed0f6f6cab tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:40.819303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da959ff4-968f-407f-a7a1-d0ed0f6f6cab tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:40.834295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-404559c4-ebc1-4501-85b0-bf595c9b8010 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b132223a0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:40.934302 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-404559c4-ebc1-4501-85b0-bf595c9b8010 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-228831808" status: 200 len: 664 microversion: 2.1 time: 0.103651 Aug 03 02:09:40.936549 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2025/4157] 10.222.0.67 () {58 vars in 1250 bytes} [Wed Aug 3 02:09:40 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-228831808 => generated 664 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:40.960570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6c423de8-1950-4ca8-a75b-f3b8948d0895 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b12fc9550>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:41.028578 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6c423de8-1950-4ca8-a75b-f3b8948d0895 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fv2.1%2Fservers%2F7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1466 microversion: 2.1 time: 0.071712 Aug 03 02:09:41.033315 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2026/4158] 10.222.0.67 () {58 vars in 1338 bytes} [Wed Aug 3 02:09:40 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fv2.1%2Fservers%2F7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1466 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:09:41.056775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2c72d121-b915-4661-9f38-df8d216f0230 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b13222c10>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:41.136018 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2c72d121-b915-4661-9f38-df8d216f0230 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fservers%2F7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1466 microversion: 2.1 time: 0.090924 Aug 03 02:09:41.137484 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2027/4159] 10.222.0.67 () {58 vars in 1324 bytes} [Wed Aug 3 02:09:41 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.67%2Fcompute%2Fservers%2F7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1466 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:41.144331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1870995712", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "b4f5b088-c1f1-4118-9137-86481e28c932"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:41.261859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] validate_networks() for [('b4f5b088-c1f1-4118-9137-86481e28c932', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:09:41.277778 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-da959ff4-968f-407f-a7a1-d0ed0f6f6cab tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.492453 Aug 03 02:09:41.278505 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2133/4160] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:09:40 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-interface => generated 285 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:41.286465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0e9dcf8a-a967-4bf4-b194-44be22f7a189 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b12678310>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:41.471919 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0e9dcf8a-a967-4bf4-b194-44be22f7a189 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.192086 Aug 03 02:09:41.472935 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2134/4161] 10.222.0.67 () {58 vars in 1170 bytes} [Wed Aug 3 02:09:41 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:41.504968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a39eaf89-f2eb-4d84-80a6-720f35ecac42 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b1254dca0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:41.657079 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a39eaf89-f2eb-4d84-80a6-720f35ecac42 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.163276 Aug 03 02:09:41.669235 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2135/4162] 10.222.0.67 () {58 vars in 1170 bytes} [Wed Aug 3 02:09:41 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:41.675380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e488a70-6dd1-4352-aaec-f68d5869f963 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b12518f70>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:41.770506 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e488a70-6dd1-4352-aaec-f68d5869f963 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/b851b45e-5c09-4153-a051-b8cb3fbe48b3" status: 200 len: 784 microversion: 2.1 time: 0.098460 Aug 03 02:09:41.797682 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2136/4163] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Aug 3 02:09:41 2022] GET /compute/v2.1/images/b851b45e-5c09-4153-a051-b8cb3fbe48b3 => generated 784 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:41.809819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2061a381-3ed4-4ac9-ac6b-027bf68b2c34 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b1267e430>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:41.949778 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2061a381-3ed4-4ac9-ac6b-027bf68b2c34 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.149427 Aug 03 02:09:41.950692 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2137/4164] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 02:09:41 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:41.969307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-7f90b686-c69b-4050-b721-1ba64c4bea63 req-c558c62e-8bec-4cdb-8369-4531d7231d35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c93a8f4-a14e-4937-a7bd-641747f3b86b", "name": "network-vif-unplugged", "status": "completed", "tag": "a63917f9-9c39-45f8-a71c-b65c4056617d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:41.993408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7f90b686-c69b-4050-b721-1ba64c4bea63 req-c558c62e-8bec-4cdb-8369-4531d7231d35 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:41.993874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7f90b686-c69b-4050-b721-1ba64c4bea63 req-c558c62e-8bec-4cdb-8369-4531d7231d35 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:42.035102 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-7f90b686-c69b-4050-b721-1ba64c4bea63 req-c558c62e-8bec-4cdb-8369-4531d7231d35 service nova] Creating event network-vif-unplugged:a63917f9-9c39-45f8-a71c-b65c4056617d for instance 4c93a8f4-a14e-4937-a7bd-641747f3b86b on n-h1-826529-8 Aug 03 02:09:42.041653 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-7f90b686-c69b-4050-b721-1ba64c4bea63 req-c558c62e-8bec-4cdb-8369-4531d7231d35 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076603 Aug 03 02:09:42.042283 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2138/4165] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:42.067688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c580399b-c402-47b2-82ca-039823d68856 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b122d94c0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:43.137902 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c580399b-c402-47b2-82ca-039823d68856 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "DELETE /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0" status: 204 len: 0 microversion: 2.1 time: 1.094228 Aug 03 02:09:43.139118 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2139/4166] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:42 2022] DELETE /compute/v2.1/images/9315ec41-d656-47c2-b7f9-ba5c689660b0 => generated 0 bytes in 1096 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:09:43.149536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-503370804", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "7987e53d-73a1-4f07-9410-30098afbe9fa"}, {"uuid": "19f4e915-03c6-4d6d-8215-f40edcdb2b8a"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:43.264289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] validate_networks() for [('7987e53d-73a1-4f07-9410-30098afbe9fa', None, None, None, None, None), ('19f4e915-03c6-4d6d-8215-f40edcdb2b8a', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:09:43.460808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:09:43.463369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:09:43.465013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:09:43.465877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:09:43.466722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:09:43.492737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:43.494590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:43.496996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:43.498975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:43.541911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Getting quotas for project 43ed3dcb7307452b965ee2d303ffaecd. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:09:43.551775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Getting quotas for user c6ac519db80b4ba99d67bd5db59be619 and project 43ed3dcb7307452b965ee2d303ffaecd. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:09:43.639333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:09:43.644550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:09:43.926976 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d8b17f1a-006d-429f-89bd-8a5453a89b65 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.787590 Aug 03 02:09:43.929497 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2028/4167] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:09:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:09:43.955549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aae77d40-15e3-4181-a2d8-2887da764345 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b13222c10>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:45.223500 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aae77d40-15e3-4181-a2d8-2887da764345 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "DELETE /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5" status: 204 len: 0 microversion: 2.1 time: 1.288689 Aug 03 02:09:45.228205 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2029/4168] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:43 2022] DELETE /compute/v2.1/images/00eca967-287b-4137-a693-fcd5d5574ef5 => generated 0 bytes in 1294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:09:45.241809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c7ad2fb5-c7b6-4064-ae38-25a26af391bd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:45.242842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c7ad2fb5-c7b6-4064-ae38-25a26af391bd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:45.465859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c7ad2fb5-c7b6-4064-ae38-25a26af391bd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:45.489896 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c7ad2fb5-c7b6-4064-ae38-25a26af391bd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1215 microversion: 2.1 time: 0.259426 Aug 03 02:09:45.503551 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2030/4169] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:45 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1215 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:45.522218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-67aae81c-ff1a-4226-a5f2-274f583d4bae tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b132efe50>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:46.474634 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-67aae81c-ff1a-4226-a5f2-274f583d4bae tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "DELETE /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf" status: 204 len: 0 microversion: 2.1 time: 0.961063 Aug 03 02:09:46.475912 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2031/4170] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:45 2022] DELETE /compute/v2.1/images/6b084764-70fb-4d3d-b384-d6c77ae41fdf => generated 0 bytes in 976 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:09:46.486449 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2b526747-b2f2-47d5-aca2-426eb7da0917 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:46.486955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2b526747-b2f2-47d5-aca2-426eb7da0917 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:46.500062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b526747-b2f2-47d5-aca2-426eb7da0917 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:46.500547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b526747-b2f2-47d5-aca2-426eb7da0917 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:46.503407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b526747-b2f2-47d5-aca2-426eb7da0917 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:46.503951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b526747-b2f2-47d5-aca2-426eb7da0917 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:46.574405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2b526747-b2f2-47d5-aca2-426eb7da0917 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:09:46.808787 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2b526747-b2f2-47d5-aca2-426eb7da0917 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 204 len: 0 microversion: 2.1 time: 0.325303 Aug 03 02:09:46.810431 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2032/4171] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:09:46 2022] DELETE /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:09:46.823889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aebf92a0-dbec-4a7b-9f92-c61fce085091 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:46.827054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-aebf92a0-dbec-4a7b-9f92-c61fce085091 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:46.839123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aebf92a0-dbec-4a7b-9f92-c61fce085091 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:46.839596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aebf92a0-dbec-4a7b-9f92-c61fce085091 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:46.840429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aebf92a0-dbec-4a7b-9f92-c61fce085091 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:46.840889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aebf92a0-dbec-4a7b-9f92-c61fce085091 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:47.450666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-aebf92a0-dbec-4a7b-9f92-c61fce085091 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:47.471187 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aebf92a0-dbec-4a7b-9f92-c61fce085091 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1275 microversion: 2.1 time: 0.657688 Aug 03 02:09:47.487925 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2033/4172] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:46 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1275 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:47.510677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-4d8425f9-0228-4f4c-9fe7-1004a6997dca req-6dd9728f-7cbc-4ceb-acad-0c18fe9277bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882d5bbc-8687-4b59-9916-d1b5bd0089b0", "tag": "5e9f7741-aeb8-4dbb-aa33-c8c2fee4e59d"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:47.552956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4d8425f9-0228-4f4c-9fe7-1004a6997dca req-6dd9728f-7cbc-4ceb-acad-0c18fe9277bb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:47.553763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4d8425f9-0228-4f4c-9fe7-1004a6997dca req-6dd9728f-7cbc-4ceb-acad-0c18fe9277bb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:47.600051 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-4d8425f9-0228-4f4c-9fe7-1004a6997dca req-6dd9728f-7cbc-4ceb-acad-0c18fe9277bb service nova] Creating event network-changed:5e9f7741-aeb8-4dbb-aa33-c8c2fee4e59d for instance 882d5bbc-8687-4b59-9916-d1b5bd0089b0 on n-h2-826529-8 Aug 03 02:09:47.622859 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-4d8425f9-0228-4f4c-9fe7-1004a6997dca req-6dd9728f-7cbc-4ceb-acad-0c18fe9277bb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126103 Aug 03 02:09:47.624287 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2034/4173] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:47.643150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-96cc2086-b359-489c-8256-4951515ed941 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:47.644456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-96cc2086-b359-489c-8256-4951515ed941 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:47.665480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-96cc2086-b359-489c-8256-4951515ed941 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:47.666436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-96cc2086-b359-489c-8256-4951515ed941 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:47.667124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-96cc2086-b359-489c-8256-4951515ed941 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:47.667580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-96cc2086-b359-489c-8256-4951515ed941 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:48.518295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-96cc2086-b359-489c-8256-4951515ed941 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:48.541722 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-96cc2086-b359-489c-8256-4951515ed941 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1472 microversion: 2.1 time: 0.916188 Aug 03 02:09:48.542317 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2035/4174] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:47 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1472 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:48.575809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2aedd63b-14d7-432b-af20-1044770d4ebf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:48.576790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2aedd63b-14d7-432b-af20-1044770d4ebf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:48.585128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2aedd63b-14d7-432b-af20-1044770d4ebf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:48.586054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2aedd63b-14d7-432b-af20-1044770d4ebf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:48.587185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2aedd63b-14d7-432b-af20-1044770d4ebf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:48.587859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2aedd63b-14d7-432b-af20-1044770d4ebf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:49.034274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2aedd63b-14d7-432b-af20-1044770d4ebf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:49.044693 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2aedd63b-14d7-432b-af20-1044770d4ebf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1273 microversion: 2.1 time: 0.498049 Aug 03 02:09:49.055669 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2036/4175] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:48 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1273 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:49.577411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-27b87608-7b96-4988-8928-62b0442bb8eb tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:49.580795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-27b87608-7b96-4988-8928-62b0442bb8eb tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:49.593177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27b87608-7b96-4988-8928-62b0442bb8eb tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:49.593636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27b87608-7b96-4988-8928-62b0442bb8eb tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:49.600000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27b87608-7b96-4988-8928-62b0442bb8eb tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:49.600141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27b87608-7b96-4988-8928-62b0442bb8eb tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:49.652644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:09:49.653575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:09:49.654441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:09:49.655230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:09:49.663321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:09:49.686479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:49.688016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:49.691217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:49.697829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:49.768370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Getting quotas for project 9fa7b92a26924225842a35fbdf0582be. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:09:49.778151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Getting quotas for user 37f3ee587f9e4e108351dd67cc6b7796 and project 9fa7b92a26924225842a35fbdf0582be. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:09:49.808554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:09:49.816305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:09:49.908414 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a75c57c8-63f9-4818-8695-b6dd45fada43 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.767828 Aug 03 02:09:49.931025 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2140/4176] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:09:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 6791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:09:49.956736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-df58b910-a940-48ec-9143-35e7af4aeee6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:49.961980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-df58b910-a940-48ec-9143-35e7af4aeee6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:50.381390 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-27b87608-7b96-4988-8928-62b0442bb8eb tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:50.384208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-df58b910-a940-48ec-9143-35e7af4aeee6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:50.400046 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-27b87608-7b96-4988-8928-62b0442bb8eb tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1472 microversion: 2.1 time: 0.828838 Aug 03 02:09:50.402692 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2037/4177] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:49 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1472 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:50.416604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d2547501-bb2e-4879-bd54-6b94dfc5f5ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:50.417221 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-df58b910-a940-48ec-9143-35e7af4aeee6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1212 microversion: 2.1 time: 0.473204 Aug 03 02:09:50.419069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d2547501-bb2e-4879-bd54-6b94dfc5f5ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:50.427719 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2141/4178] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:49 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1212 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:50.439653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2547501-bb2e-4879-bd54-6b94dfc5f5ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:50.440581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2547501-bb2e-4879-bd54-6b94dfc5f5ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:50.441845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2547501-bb2e-4879-bd54-6b94dfc5f5ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:50.443524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2547501-bb2e-4879-bd54-6b94dfc5f5ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:51.434326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fd1f6881-d0b9-4e01-87f3-64c2fdfa0367 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:51.435734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fd1f6881-d0b9-4e01-87f3-64c2fdfa0367 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:51.449173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd1f6881-d0b9-4e01-87f3-64c2fdfa0367 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:51.449973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd1f6881-d0b9-4e01-87f3-64c2fdfa0367 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:51.451052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd1f6881-d0b9-4e01-87f3-64c2fdfa0367 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:51.451754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd1f6881-d0b9-4e01-87f3-64c2fdfa0367 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:51.831468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d2547501-bb2e-4879-bd54-6b94dfc5f5ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:51.854130 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d2547501-bb2e-4879-bd54-6b94dfc5f5ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1315 microversion: 2.1 time: 1.447077 Aug 03 02:09:51.855924 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2038/4179] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:50 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1315 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:51.892221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0e8977a5-8f1a-4ef0-8275-deb60803be8f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:51.900597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0e8977a5-8f1a-4ef0-8275-deb60803be8f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:51.909789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0e8977a5-8f1a-4ef0-8275-deb60803be8f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:51.910498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0e8977a5-8f1a-4ef0-8275-deb60803be8f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:51.911481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0e8977a5-8f1a-4ef0-8275-deb60803be8f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:51.912074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0e8977a5-8f1a-4ef0-8275-deb60803be8f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:52.055743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0e8977a5-8f1a-4ef0-8275-deb60803be8f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:52.070510 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0e8977a5-8f1a-4ef0-8275-deb60803be8f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1264 microversion: 2.1 time: 0.182415 Aug 03 02:09:52.072411 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2039/4180] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:51 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:52.101258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-b2939968-1d98-4bbf-b312-dc2d179dae25 req-68013caf-03a1-48c8-b771-7d1513fa54dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b", "tag": "bee916fb-a434-4739-ac37-90caaee0b3c4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:52.122441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b2939968-1d98-4bbf-b312-dc2d179dae25 req-68013caf-03a1-48c8-b771-7d1513fa54dd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:52.124079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b2939968-1d98-4bbf-b312-dc2d179dae25 req-68013caf-03a1-48c8-b771-7d1513fa54dd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:52.142871 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-b2939968-1d98-4bbf-b312-dc2d179dae25 req-68013caf-03a1-48c8-b771-7d1513fa54dd service nova] Creating event network-changed:bee916fb-a434-4739-ac37-90caaee0b3c4 for instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b on n-h1-826529-8 Aug 03 02:09:52.152502 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-b2939968-1d98-4bbf-b312-dc2d179dae25 req-68013caf-03a1-48c8-b771-7d1513fa54dd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066381 Aug 03 02:09:52.155318 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2040/4181] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:52.901951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-64bb78a9-12d6-4e5f-b33e-051a72efe6c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:52.905401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-64bb78a9-12d6-4e5f-b33e-051a72efe6c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:52.932699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64bb78a9-12d6-4e5f-b33e-051a72efe6c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:52.933290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64bb78a9-12d6-4e5f-b33e-051a72efe6c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:52.936653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64bb78a9-12d6-4e5f-b33e-051a72efe6c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:52.937926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64bb78a9-12d6-4e5f-b33e-051a72efe6c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:53.197111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fd1f6881-d0b9-4e01-87f3-64c2fdfa0367 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:53.212334 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fd1f6881-d0b9-4e01-87f3-64c2fdfa0367 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1472 microversion: 2.1 time: 1.782420 Aug 03 02:09:53.213221 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2142/4182] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:51 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1472 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:53.233306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a914f661-d750-4c65-b185-0004ab454a6c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:53.234356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a914f661-d750-4c65-b185-0004ab454a6c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:53.243808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a914f661-d750-4c65-b185-0004ab454a6c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:53.244778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a914f661-d750-4c65-b185-0004ab454a6c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:53.245966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a914f661-d750-4c65-b185-0004ab454a6c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:53.246652 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a914f661-d750-4c65-b185-0004ab454a6c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:53.522696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:53.757267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a914f661-d750-4c65-b185-0004ab454a6c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:53.791829 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a914f661-d750-4c65-b185-0004ab454a6c tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1270 microversion: 2.1 time: 0.575514 Aug 03 02:09:53.792872 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2143/4183] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:53 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1270 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:53.807980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2c493d17-3584-47b6-8788-090593b58be1 req-4db6860f-55b8-4005-ba89-b71811d63596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ead359f-4427-4285-9677-d3cac524d8b2", "name": "network-vif-deleted", "tag": "4d3985fb-3a8f-49e3-b887-095a18ea295a"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:53.873694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2c493d17-3584-47b6-8788-090593b58be1 req-4db6860f-55b8-4005-ba89-b71811d63596 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:53.878607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2c493d17-3584-47b6-8788-090593b58be1 req-4db6860f-55b8-4005-ba89-b71811d63596 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:53.923525 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2c493d17-3584-47b6-8788-090593b58be1 req-4db6860f-55b8-4005-ba89-b71811d63596 service nova] Creating event network-vif-deleted:4d3985fb-3a8f-49e3-b887-095a18ea295a for instance 7ead359f-4427-4285-9677-d3cac524d8b2 on n-h2-826529-8 Aug 03 02:09:53.950002 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2c493d17-3584-47b6-8788-090593b58be1 req-4db6860f-55b8-4005-ba89-b71811d63596 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154915 Aug 03 02:09:53.957416 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2144/4184] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:09:54.120674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-64bb78a9-12d6-4e5f-b33e-051a72efe6c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:54.142818 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-64bb78a9-12d6-4e5f-b33e-051a72efe6c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1315 microversion: 2.1 time: 1.256391 Aug 03 02:09:54.147211 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2041/4185] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:52 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1315 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:54.244807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f2e021f9-c8f2-478f-acb3-124c8630301f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:54.245929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f2e021f9-c8f2-478f-acb3-124c8630301f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:54.265173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f2e021f9-c8f2-478f-acb3-124c8630301f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:54.266551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f2e021f9-c8f2-478f-acb3-124c8630301f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:54.270432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f2e021f9-c8f2-478f-acb3-124c8630301f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:54.271718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f2e021f9-c8f2-478f-acb3-124c8630301f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:54.412471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f2e021f9-c8f2-478f-acb3-124c8630301f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:54.413445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f2e021f9-c8f2-478f-acb3-124c8630301f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:54.414359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-f2e021f9-c8f2-478f-acb3-124c8630301f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lazy-loading 'fault' on Instance uuid 7ead359f-4427-4285-9677-d3cac524d8b2 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:09:54.713059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f2e021f9-c8f2-478f-acb3-124c8630301f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:54.751346 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f2e021f9-c8f2-478f-acb3-124c8630301f tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 200 len: 1306 microversion: 2.1 time: 0.518432 Aug 03 02:09:54.769114 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2145/4186] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:54 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 1306 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:09:54.862464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-27aa1e33-4021-47e4-8e10-4574b9385cfe tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:54.863156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-27aa1e33-4021-47e4-8e10-4574b9385cfe tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:54.881585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27aa1e33-4021-47e4-8e10-4574b9385cfe tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:54.882949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27aa1e33-4021-47e4-8e10-4574b9385cfe tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:54.886244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27aa1e33-4021-47e4-8e10-4574b9385cfe tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:54.887709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-27aa1e33-4021-47e4-8e10-4574b9385cfe tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:55.112208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-27aa1e33-4021-47e4-8e10-4574b9385cfe tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:55.123827 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-27aa1e33-4021-47e4-8e10-4574b9385cfe tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1270 microversion: 2.1 time: 0.272952 Aug 03 02:09:55.133924 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2042/4187] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:54 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1270 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:55.187147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-412ea65c-ab93-4eb0-bee5-9e371d430264 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:55.190143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-412ea65c-ab93-4eb0-bee5-9e371d430264 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:55.202580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-412ea65c-ab93-4eb0-bee5-9e371d430264 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:55.204351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-412ea65c-ab93-4eb0-bee5-9e371d430264 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:55.205504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-412ea65c-ab93-4eb0-bee5-9e371d430264 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:55.206197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-412ea65c-ab93-4eb0-bee5-9e371d430264 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:55.767044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-412ea65c-ab93-4eb0-bee5-9e371d430264 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:55.799387 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-412ea65c-ab93-4eb0-bee5-9e371d430264 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1315 microversion: 2.1 time: 0.620317 Aug 03 02:09:55.803579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-da8ef50a-7502-4189-addc-4c1a91c2cc5b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:55.804871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-da8ef50a-7502-4189-addc-4c1a91c2cc5b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 7ead359f-4427-4285-9677-d3cac524d8b2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:55.809556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:55.813668 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2146/4188] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:55 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:55.821738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da8ef50a-7502-4189-addc-4c1a91c2cc5b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:55.823320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da8ef50a-7502-4189-addc-4c1a91c2cc5b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:55.824800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da8ef50a-7502-4189-addc-4c1a91c2cc5b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:55.825605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da8ef50a-7502-4189-addc-4c1a91c2cc5b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:55.835339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:55.867263 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-da8ef50a-7502-4189-addc-4c1a91c2cc5b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] HTTP exception thrown: Instance 7ead359f-4427-4285-9677-d3cac524d8b2 could not be found. Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-da8ef50a-7502-4189-addc-4c1a91c2cc5b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Request method failure captured: Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 HTTP/1.1 Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dhJo8QLFAWBRx9n1dW1jZB00gRmB0yOAIphccQHnrGXm7QmEFg1G25NtbOyF1EK1H5YbLGtPZKmAt7oiQpDu34Br7ybh_TUmdTYlXEBzUaUi0TBnW0w15dp0HjaLsMD7rxBCuhJ1b5Uc7vokrF0EXNX9gdAi_q9auBnScyDizarSyQ Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: acd05a9fbfed458caf63ce7043ed2faa Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ListImageFiltersTestJSON-2048071293 Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_acd05a9fbfed458caf63ce7043ed2faa", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/acd05a9fbfed458caf63ce7043ed2faa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/acd05a9fbfed458caf63ce7043ed2faa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/acd05a9fbfed458caf63ce7043ed2faa"}]}] Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ListImageFiltersTestJSON-2048071293 Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: acd05a9fbfed458caf63ce7043ed2faa Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2048071293 Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ListImageFiltersTestJSON-2048071293-project Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: aeb4cc56d87a45209c7d3ec5381e341f Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ListImageFiltersTestJSON-2048071293-project Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 7ead359f-4427-4285-9677-d3cac524d8b2 could not be found. Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '7ead359f-4427-4285-9677-d3cac524d8b2'} Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ead359f-4427-4285-9677-d3cac524d8b2 could not be found. Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ead359f-4427-4285-9677-d3cac524d8b2 could not be found. Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:09:55.874153 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:55.884439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:09:55.884439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:09:55.884439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:09:55.884439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:09:55.884439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:09:55.884439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ead359f-4427-4285-9677-d3cac524d8b2 could not be found. Aug 03 02:09:55.884439 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:09:55.885722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-da8ef50a-7502-4189-addc-4c1a91c2cc5b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Returning 404 to user: Instance 7ead359f-4427-4285-9677-d3cac524d8b2 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:09:55.888104 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-da8ef50a-7502-4189-addc-4c1a91c2cc5b tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2" status: 404 len: 111 microversion: 2.1 time: 0.096179 Aug 03 02:09:55.895162 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2043/4189] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:55 2022] GET /compute/v2.1/servers/7ead359f-4427-4285-9677-d3cac524d8b2 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:09:55.912637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5cf51bd-2a1d-4934-8394-74793f7b8b7e tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:55.913938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5cf51bd-2a1d-4934-8394-74793f7b8b7e tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 4c93a8f4-a14e-4937-a7bd-641747f3b86b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:55.935662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5cf51bd-2a1d-4934-8394-74793f7b8b7e tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:55.937713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5cf51bd-2a1d-4934-8394-74793f7b8b7e tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:55.941226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5cf51bd-2a1d-4934-8394-74793f7b8b7e tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:55.942881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5cf51bd-2a1d-4934-8394-74793f7b8b7e tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:55.996336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5cf51bd-2a1d-4934-8394-74793f7b8b7e tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 4c93a8f4-a14e-4937-a7bd-641747f3b86b] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:09:56.045533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-df077c44-18a4-4b8b-9c9b-af8e7589eb0a req-543bc14f-0a95-421a-8025-3141a45d526c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671ba3e8-afd3-4e1c-be42-220dd485da4a", "tag": "109dc946-6e1d-4eb7-b1b0-67a1099e0972"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:09:56.081384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:56.087340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-df077c44-18a4-4b8b-9c9b-af8e7589eb0a req-543bc14f-0a95-421a-8025-3141a45d526c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:56.089975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-df077c44-18a4-4b8b-9c9b-af8e7589eb0a req-543bc14f-0a95-421a-8025-3141a45d526c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:56.131833 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-df077c44-18a4-4b8b-9c9b-af8e7589eb0a req-543bc14f-0a95-421a-8025-3141a45d526c service nova] Creating event network-changed:109dc946-6e1d-4eb7-b1b0-67a1099e0972 for instance 671ba3e8-afd3-4e1c-be42-220dd485da4a on n-h1-826529-8 Aug 03 02:09:56.139428 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-df077c44-18a4-4b8b-9c9b-af8e7589eb0a req-543bc14f-0a95-421a-8025-3141a45d526c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100684 Aug 03 02:09:56.141670 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2044/4190] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:09:56.157357 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5cf51bd-2a1d-4934-8394-74793f7b8b7e tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b" status: 204 len: 0 microversion: 2.1 time: 0.253818 Aug 03 02:09:56.163861 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2147/4191] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:09:55 2022] DELETE /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:09:56.174740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4713de31-7749-438d-834e-41e737b51cd2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:56.177932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9eae9ea6-79f4-4f7d-961d-5266658121d7 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:56.178804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4713de31-7749-438d-834e-41e737b51cd2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:56.180600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9eae9ea6-79f4-4f7d-961d-5266658121d7 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 4c93a8f4-a14e-4937-a7bd-641747f3b86b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:56.191509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4713de31-7749-438d-834e-41e737b51cd2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:56.192759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4713de31-7749-438d-834e-41e737b51cd2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:56.194941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4713de31-7749-438d-834e-41e737b51cd2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:56.196338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4713de31-7749-438d-834e-41e737b51cd2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:56.198173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9eae9ea6-79f4-4f7d-961d-5266658121d7 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:56.198713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9eae9ea6-79f4-4f7d-961d-5266658121d7 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:56.200391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9eae9ea6-79f4-4f7d-961d-5266658121d7 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:56.200862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9eae9ea6-79f4-4f7d-961d-5266658121d7 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:56.376246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4713de31-7749-438d-834e-41e737b51cd2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:56.394786 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4713de31-7749-438d-834e-41e737b51cd2 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1270 microversion: 2.1 time: 0.238737 Aug 03 02:09:56.411629 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2045/4192] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:56 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1270 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:56.728096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9eae9ea6-79f4-4f7d-961d-5266658121d7 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:56.760792 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9eae9ea6-79f4-4f7d-961d-5266658121d7 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b" status: 200 len: 1473 microversion: 2.1 time: 0.590741 Aug 03 02:09:56.762008 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2148/4193] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:56 2022] GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b => generated 1473 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:56.841936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-44a4568c-d568-4ea9-923b-f3e1e6751bad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:56.852974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-44a4568c-d568-4ea9-923b-f3e1e6751bad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:56.868580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44a4568c-d568-4ea9-923b-f3e1e6751bad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:56.870384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44a4568c-d568-4ea9-923b-f3e1e6751bad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:56.872422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44a4568c-d568-4ea9-923b-f3e1e6751bad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:56.876174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44a4568c-d568-4ea9-923b-f3e1e6751bad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:57.426945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-622965f8-eac9-4609-a9c4-7054e986ebc7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:57.428023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-622965f8-eac9-4609-a9c4-7054e986ebc7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:57.432190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:09:57.446533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-622965f8-eac9-4609-a9c4-7054e986ebc7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:57.447450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-622965f8-eac9-4609-a9c4-7054e986ebc7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:57.449764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-622965f8-eac9-4609-a9c4-7054e986ebc7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:57.449764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-622965f8-eac9-4609-a9c4-7054e986ebc7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:57.928779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-44a4568c-d568-4ea9-923b-f3e1e6751bad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:57.947842 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-44a4568c-d568-4ea9-923b-f3e1e6751bad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1315 microversion: 2.1 time: 1.112492 Aug 03 02:09:57.966818 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2046/4194] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:56 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1315 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:57.990271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6117213a-6fd9-486b-87f8-85917014e9ed tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:57.991889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6117213a-6fd9-486b-87f8-85917014e9ed tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 4c93a8f4-a14e-4937-a7bd-641747f3b86b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:57.998812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-622965f8-eac9-4609-a9c4-7054e986ebc7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:58.015156 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-622965f8-eac9-4609-a9c4-7054e986ebc7 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1312 microversion: 2.1 time: 0.593221 Aug 03 02:09:58.017029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6117213a-6fd9-486b-87f8-85917014e9ed tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:58.018694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6117213a-6fd9-486b-87f8-85917014e9ed tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:58.020032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6117213a-6fd9-486b-87f8-85917014e9ed tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:58.020760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6117213a-6fd9-486b-87f8-85917014e9ed tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:58.028205 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2149/4195] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:57 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1312 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:58.305472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6117213a-6fd9-486b-87f8-85917014e9ed tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:58.319673 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6117213a-6fd9-486b-87f8-85917014e9ed tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b" status: 200 len: 1473 microversion: 2.1 time: 0.350789 Aug 03 02:09:58.331407 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2047/4196] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:57 2022] GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b => generated 1473 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:58.991932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b8a0c543-c87b-4302-b487-974b05e9e1ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:58.993243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b8a0c543-c87b-4302-b487-974b05e9e1ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:59.063503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cfd52540-13ba-4c30-93e3-a4b9cddea774 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:59.065022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8a0c543-c87b-4302-b487-974b05e9e1ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:59.066966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8a0c543-c87b-4302-b487-974b05e9e1ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:59.074153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cfd52540-13ba-4c30-93e3-a4b9cddea774 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:59.074375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8a0c543-c87b-4302-b487-974b05e9e1ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:59.075121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8a0c543-c87b-4302-b487-974b05e9e1ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:59.137167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cfd52540-13ba-4c30-93e3-a4b9cddea774 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:59.139624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cfd52540-13ba-4c30-93e3-a4b9cddea774 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:59.147504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cfd52540-13ba-4c30-93e3-a4b9cddea774 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:59.148467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cfd52540-13ba-4c30-93e3-a4b9cddea774 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:59.655826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b8a0c543-c87b-4302-b487-974b05e9e1ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:09:59.680677 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b8a0c543-c87b-4302-b487-974b05e9e1ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1315 microversion: 2.1 time: 0.695333 Aug 03 02:09:59.684138 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2150/4197] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:58 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:09:59.704628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-48473845-aa3c-49fc-a9d6-c448b786badd tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:09:59.715137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-48473845-aa3c-49fc-a9d6-c448b786badd tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 4c93a8f4-a14e-4937-a7bd-641747f3b86b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:09:59.729331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48473845-aa3c-49fc-a9d6-c448b786badd tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:59.730122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48473845-aa3c-49fc-a9d6-c448b786badd tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:59.731144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48473845-aa3c-49fc-a9d6-c448b786badd tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:09:59.731863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48473845-aa3c-49fc-a9d6-c448b786badd tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:09:59.770695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:00.105738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cfd52540-13ba-4c30-93e3-a4b9cddea774 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:00.115503 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cfd52540-13ba-4c30-93e3-a4b9cddea774 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1333 microversion: 2.1 time: 1.060682 Aug 03 02:10:00.116417 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2048/4198] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:59 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1333 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:00.402353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:00.557374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-48473845-aa3c-49fc-a9d6-c448b786badd tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:00.607610 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-48473845-aa3c-49fc-a9d6-c448b786badd tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b" status: 200 len: 1473 microversion: 2.1 time: 0.920860 Aug 03 02:10:00.608815 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2151/4199] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:09:59 2022] GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b => generated 1473 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:00.709215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-962b0754-38ca-4006-a2a9-d61b5ef7c1fe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:00.712236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-962b0754-38ca-4006-a2a9-d61b5ef7c1fe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:00.719834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-962b0754-38ca-4006-a2a9-d61b5ef7c1fe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:00.720586 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-962b0754-38ca-4006-a2a9-d61b5ef7c1fe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:00.721617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-962b0754-38ca-4006-a2a9-d61b5ef7c1fe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:00.722227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-962b0754-38ca-4006-a2a9-d61b5ef7c1fe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:01.168597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1a42f35f-77b8-49b5-a766-1b1a72a45e32 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:01.170448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1a42f35f-77b8-49b5-a766-1b1a72a45e32 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:01.186886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a42f35f-77b8-49b5-a766-1b1a72a45e32 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:01.188813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a42f35f-77b8-49b5-a766-1b1a72a45e32 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:01.190614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a42f35f-77b8-49b5-a766-1b1a72a45e32 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:01.191707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a42f35f-77b8-49b5-a766-1b1a72a45e32 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:01.759334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-962b0754-38ca-4006-a2a9-d61b5ef7c1fe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:01.779294 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-962b0754-38ca-4006-a2a9-d61b5ef7c1fe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1315 microversion: 2.1 time: 1.074132 Aug 03 02:10:01.782480 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2049/4200] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:00 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1315 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:01.807037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7e97e6fc-bc3a-4fe1-ab86-eca70e8d32c2 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:01.808172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7e97e6fc-bc3a-4fe1-ab86-eca70e8d32c2 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 4c93a8f4-a14e-4937-a7bd-641747f3b86b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:01.826175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e97e6fc-bc3a-4fe1-ab86-eca70e8d32c2 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:01.826526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e97e6fc-bc3a-4fe1-ab86-eca70e8d32c2 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:01.834295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e97e6fc-bc3a-4fe1-ab86-eca70e8d32c2 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:01.834763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e97e6fc-bc3a-4fe1-ab86-eca70e8d32c2 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:02.059144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1a42f35f-77b8-49b5-a766-1b1a72a45e32 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:02.071104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7e97e6fc-bc3a-4fe1-ab86-eca70e8d32c2 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb4cc56d87a45209c7d3ec5381e341f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd05a9fbfed458caf63ce7043ed2faa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:02.077371 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1a42f35f-77b8-49b5-a766-1b1a72a45e32 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1333 microversion: 2.1 time: 0.930494 Aug 03 02:10:02.082587 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2152/4201] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:01 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1333 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:02.106814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f6fa9cfb-102b-4788-a1cf-1a0b0080e076 req-9452a733-7cf5-4700-b793-76f681f4f199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c93a8f4-a14e-4937-a7bd-641747f3b86b", "name": "network-vif-deleted", "tag": "a63917f9-9c39-45f8-a71c-b65c4056617d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:02.129854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f6fa9cfb-102b-4788-a1cf-1a0b0080e076 req-9452a733-7cf5-4700-b793-76f681f4f199 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:02.134838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f6fa9cfb-102b-4788-a1cf-1a0b0080e076 req-9452a733-7cf5-4700-b793-76f681f4f199 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:02.148258 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7e97e6fc-bc3a-4fe1-ab86-eca70e8d32c2 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b" status: 200 len: 1431 microversion: 2.1 time: 0.355649 Aug 03 02:10:02.154159 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2050/4202] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:01 2022] GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b => generated 1431 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:02.163462 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f6fa9cfb-102b-4788-a1cf-1a0b0080e076 req-9452a733-7cf5-4700-b793-76f681f4f199 service nova] Creating event network-vif-deleted:a63917f9-9c39-45f8-a71c-b65c4056617d for instance 4c93a8f4-a14e-4937-a7bd-641747f3b86b on n-h1-826529-8 Aug 03 02:10:02.181102 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f6fa9cfb-102b-4788-a1cf-1a0b0080e076 req-9452a733-7cf5-4700-b793-76f681f4f199 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089053 Aug 03 02:10:02.182252 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2153/4203] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:02.820314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7069e400-13c6-424a-b270-df2ddcb94042 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:02.826436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7069e400-13c6-424a-b270-df2ddcb94042 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:02.844784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7069e400-13c6-424a-b270-df2ddcb94042 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:02.848717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7069e400-13c6-424a-b270-df2ddcb94042 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:02.851567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7069e400-13c6-424a-b270-df2ddcb94042 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:02.852654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7069e400-13c6-424a-b270-df2ddcb94042 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:03.126494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-deccb67c-1618-449b-a9a7-2dba56f680be tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:03.138078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-deccb67c-1618-449b-a9a7-2dba56f680be tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:03.155575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-deccb67c-1618-449b-a9a7-2dba56f680be tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:03.156974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-deccb67c-1618-449b-a9a7-2dba56f680be tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:03.161725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-deccb67c-1618-449b-a9a7-2dba56f680be tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:03.162223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-deccb67c-1618-449b-a9a7-2dba56f680be tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:03.838214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7069e400-13c6-424a-b270-df2ddcb94042 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:03.850277 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7069e400-13c6-424a-b270-df2ddcb94042 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1315 microversion: 2.1 time: 1.038963 Aug 03 02:10:03.871035 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2051/4204] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:02 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1315 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:03.881742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-acf258ff-668b-4b07-a268-ac74749abd86 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:03.882886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-acf258ff-668b-4b07-a268-ac74749abd86 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] [instance: 4c93a8f4-a14e-4937-a7bd-641747f3b86b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:03.891628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-deccb67c-1618-449b-a9a7-2dba56f680be tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:03.911416 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-deccb67c-1618-449b-a9a7-2dba56f680be tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1333 microversion: 2.1 time: 0.799648 Aug 03 02:10:03.912425 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2154/4205] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:03 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1333 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:03.915658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acf258ff-668b-4b07-a268-ac74749abd86 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:03.916797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acf258ff-668b-4b07-a268-ac74749abd86 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:03.918377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acf258ff-668b-4b07-a268-ac74749abd86 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:03.919359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acf258ff-668b-4b07-a268-ac74749abd86 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:03.947367 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-acf258ff-668b-4b07-a268-ac74749abd86 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] HTTP exception thrown: Instance 4c93a8f4-a14e-4937-a7bd-641747f3b86b could not be found. Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-acf258ff-668b-4b07-a268-ac74749abd86 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Request method failure captured: Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b HTTP/1.1 Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dhJo8QLFAWBRx9n1dW1jZB00gRmB0yOAIphccQHnrGXm7QmEFg1G25NtbOyF1EK1H5YbLGtPZKmAt7oiQpDu34Br7ybh_TUmdTYlXEBzUaUi0TBnW0w15dp0HjaLsMD7rxBCuhJ1b5Uc7vokrF0EXNX9gdAi_q9auBnScyDizarSyQ Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: acd05a9fbfed458caf63ce7043ed2faa Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ListImageFiltersTestJSON-2048071293 Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_acd05a9fbfed458caf63ce7043ed2faa", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/acd05a9fbfed458caf63ce7043ed2faa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/acd05a9fbfed458caf63ce7043ed2faa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/acd05a9fbfed458caf63ce7043ed2faa"}]}] Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ListImageFiltersTestJSON-2048071293 Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: acd05a9fbfed458caf63ce7043ed2faa Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2048071293 Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ListImageFiltersTestJSON-2048071293-project Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: aeb4cc56d87a45209c7d3ec5381e341f Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ListImageFiltersTestJSON-2048071293-project Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 4c93a8f4-a14e-4937-a7bd-641747f3b86b could not be found. Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '4c93a8f4-a14e-4937-a7bd-641747f3b86b'} Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c93a8f4-a14e-4937-a7bd-641747f3b86b could not be found. Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c93a8f4-a14e-4937-a7bd-641747f3b86b could not be found. Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:03.952772 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:03.961458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:03.961458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:03.961458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:03.961458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:10:03.961458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:10:03.961458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c93a8f4-a14e-4937-a7bd-641747f3b86b could not be found. Aug 03 02:10:03.961458 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:03.964095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-acf258ff-668b-4b07-a268-ac74749abd86 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Returning 404 to user: Instance 4c93a8f4-a14e-4937-a7bd-641747f3b86b could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:10:03.966495 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-acf258ff-668b-4b07-a268-ac74749abd86 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b" status: 404 len: 111 microversion: 2.1 time: 0.093477 Aug 03 02:10:03.967925 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2052/4206] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:03 2022] GET /compute/v2.1/servers/4c93a8f4-a14e-4937-a7bd-641747f3b86b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:10:03.982757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-05aaf98f-9484-40c4-96e3-c474a98865d1 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b135b3ee0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:04.291201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1886063230", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "6e316679-0a8c-4dd3-a95b-4f32dad3bc33"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:04.399989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] validate_networks() for [('6e316679-0a8c-4dd3-a95b-4f32dad3bc33', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:10:04.498122 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-05aaf98f-9484-40c4-96e3-c474a98865d1 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "DELETE /compute/v2.1/images/1e4a1fa9-2b8f-4519-adc2-aa70d61ab881" status: 204 len: 0 microversion: 2.1 time: 0.522439 Aug 03 02:10:04.499358 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2155/4207] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:03 2022] DELETE /compute/v2.1/images/1e4a1fa9-2b8f-4519-adc2-aa70d61ab881 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:10:04.512178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-09a49e9a-f2a8-49c6-a80e-72a1fb92a63d req-d06f3c61-0927-40b6-be4a-ff43bdc92810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8276a9-ef19-47de-9fc3-f2723e39d7da", "tag": "7be64ecd-f5ad-45eb-9bbe-916f3694f1dd"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:04.528554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-09a49e9a-f2a8-49c6-a80e-72a1fb92a63d req-d06f3c61-0927-40b6-be4a-ff43bdc92810 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:04.529606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-09a49e9a-f2a8-49c6-a80e-72a1fb92a63d req-d06f3c61-0927-40b6-be4a-ff43bdc92810 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:04.549089 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-09a49e9a-f2a8-49c6-a80e-72a1fb92a63d req-d06f3c61-0927-40b6-be4a-ff43bdc92810 service nova] Creating event network-changed:7be64ecd-f5ad-45eb-9bbe-916f3694f1dd for instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da on n-h2-826529-8 Aug 03 02:10:04.555165 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-09a49e9a-f2a8-49c6-a80e-72a1fb92a63d req-d06f3c61-0927-40b6-be4a-ff43bdc92810 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053147 Aug 03 02:10:04.556047 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2156/4208] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:04.563502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-50d0352b-85f6-4162-b4cf-16d744456658 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b1259edc0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:04.959040 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-50d0352b-85f6-4162-b4cf-16d744456658 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "DELETE /compute/v2.1/images/3e6cf1b5-170b-48d6-9a99-ab963281062b" status: 204 len: 0 microversion: 2.1 time: 0.400919 Aug 03 02:10:04.960327 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2157/4209] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:04 2022] DELETE /compute/v2.1/images/3e6cf1b5-170b-48d6-9a99-ab963281062b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:10:04.970620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9591d644-439e-48a9-b0b6-f5357b54d4cd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:04.972393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9591d644-439e-48a9-b0b6-f5357b54d4cd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:04.984868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9591d644-439e-48a9-b0b6-f5357b54d4cd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:04.986549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9591d644-439e-48a9-b0b6-f5357b54d4cd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:04.990304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9591d644-439e-48a9-b0b6-f5357b54d4cd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:04.991038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9591d644-439e-48a9-b0b6-f5357b54d4cd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:05.753464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9591d644-439e-48a9-b0b6-f5357b54d4cd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:05.764782 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9591d644-439e-48a9-b0b6-f5357b54d4cd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1315 microversion: 2.1 time: 0.802874 Aug 03 02:10:05.766515 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2158/4210] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:04 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:05.772187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-945665ed-d427-4d23-b306-296183efb100 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:05.773044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-945665ed-d427-4d23-b306-296183efb100 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:05.786491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-945665ed-d427-4d23-b306-296183efb100 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:05.787017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-945665ed-d427-4d23-b306-296183efb100 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:05.787891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-945665ed-d427-4d23-b306-296183efb100 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:05.788571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-945665ed-d427-4d23-b306-296183efb100 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:06.391520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-945665ed-d427-4d23-b306-296183efb100 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:06.400791 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-945665ed-d427-4d23-b306-296183efb100 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1333 microversion: 2.1 time: 0.632773 Aug 03 02:10:06.401399 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2159/4211] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:05 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1333 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:06.407816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-12f5fad3-f441-4335-a701-e2dd088002b8 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] Calling method '.version_select at 0x7f5b125b6ee0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:06.567384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:10:06.569720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:10:06.570245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:10:06.570834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:10:06.571305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:10:06.584407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:06.584579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:06.585416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:06.586131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:06.613417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Getting quotas for project fc12b67e2b314d80ad1bf806764659e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:10:06.620758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Getting quotas for user e18f692444b34c4e91cb867faa16da69 and project fc12b67e2b314d80ad1bf806764659e6. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:10:06.649108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:10:06.654867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:10:06.752348 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-78335bbe-0946-40c8-970c-f684384e19db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.712014 Aug 03 02:10:06.759623 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2053/4212] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:10:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:10:06.777007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ae7fbed2-b483-4da1-9b05-c4a499f9e776 req-1ef42f63-94d6-4010-b7bc-ebcedf3a69c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671ba3e8-afd3-4e1c-be42-220dd485da4a", "name": "network-vif-plugged", "status": "completed", "tag": "109dc946-6e1d-4eb7-b1b0-67a1099e0972"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:06.800837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ae7fbed2-b483-4da1-9b05-c4a499f9e776 req-1ef42f63-94d6-4010-b7bc-ebcedf3a69c1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:06.801352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ae7fbed2-b483-4da1-9b05-c4a499f9e776 req-1ef42f63-94d6-4010-b7bc-ebcedf3a69c1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:06.824622 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ae7fbed2-b483-4da1-9b05-c4a499f9e776 req-1ef42f63-94d6-4010-b7bc-ebcedf3a69c1 service nova] Creating event network-vif-plugged:109dc946-6e1d-4eb7-b1b0-67a1099e0972 for instance 671ba3e8-afd3-4e1c-be42-220dd485da4a on n-h1-826529-8 Aug 03 02:10:06.833031 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ae7fbed2-b483-4da1-9b05-c4a499f9e776 req-1ef42f63-94d6-4010-b7bc-ebcedf3a69c1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072102 Aug 03 02:10:06.834045 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2054/4213] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:06.852742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-fe10092f-7461-403e-b835-dc220ea8b189 req-757151a8-2fce-4ed2-82cf-1e0a38439955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8276a9-ef19-47de-9fc3-f2723e39d7da", "tag": "00f06cda-2dbf-43a5-bc16-1086f93cfef9"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:06.886099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-fe10092f-7461-403e-b835-dc220ea8b189 req-757151a8-2fce-4ed2-82cf-1e0a38439955 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:06.887933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-fe10092f-7461-403e-b835-dc220ea8b189 req-757151a8-2fce-4ed2-82cf-1e0a38439955 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:06.895436 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-12f5fad3-f441-4335-a701-e2dd088002b8 tempest-ListImageFiltersTestJSON-2048071293 tempest-ListImageFiltersTestJSON-2048071293-project] 10.222.0.67 "DELETE /compute/v2.1/images/30e71a1e-0c70-4194-8bb9-1dfcd8230373" status: 204 len: 0 microversion: 2.1 time: 0.492477 Aug 03 02:10:06.896965 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2160/4214] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:06 2022] DELETE /compute/v2.1/images/30e71a1e-0c70-4194-8bb9-1dfcd8230373 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:10:06.906989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-079eefee-ac8a-45ea-a7a5-5935da53b873 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:06.908795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-079eefee-ac8a-45ea-a7a5-5935da53b873 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:06.930790 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-fe10092f-7461-403e-b835-dc220ea8b189 req-757151a8-2fce-4ed2-82cf-1e0a38439955 service nova] Creating event network-changed:00f06cda-2dbf-43a5-bc16-1086f93cfef9 for instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da on n-h2-826529-8 Aug 03 02:10:06.938768 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-fe10092f-7461-403e-b835-dc220ea8b189 req-757151a8-2fce-4ed2-82cf-1e0a38439955 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101372 Aug 03 02:10:06.940486 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2055/4215] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:06.948284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-47a9742c-ad82-4d49-bc00-79e7cf5f955c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:06.949813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-47a9742c-ad82-4d49-bc00-79e7cf5f955c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:06.963742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47a9742c-ad82-4d49-bc00-79e7cf5f955c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:06.964545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47a9742c-ad82-4d49-bc00-79e7cf5f955c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:06.966041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47a9742c-ad82-4d49-bc00-79e7cf5f955c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:06.967058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47a9742c-ad82-4d49-bc00-79e7cf5f955c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:07.113739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-079eefee-ac8a-45ea-a7a5-5935da53b873 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:07.130887 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-079eefee-ac8a-45ea-a7a5-5935da53b873 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1217 microversion: 2.1 time: 0.232598 Aug 03 02:10:07.136150 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2161/4216] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:06 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1217 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:07.431420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-47a9742c-ad82-4d49-bc00-79e7cf5f955c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:07.457497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-33318f1c-736c-4375-9874-ce5384c75ce1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:07.458988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-33318f1c-736c-4375-9874-ce5384c75ce1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:07.460753 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-47a9742c-ad82-4d49-bc00-79e7cf5f955c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1315 microversion: 2.1 time: 0.518571 Aug 03 02:10:07.465188 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2056/4217] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:06 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:07.508230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-33318f1c-736c-4375-9874-ce5384c75ce1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:07.510212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-33318f1c-736c-4375-9874-ce5384c75ce1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:07.511986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-33318f1c-736c-4375-9874-ce5384c75ce1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:07.513700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-33318f1c-736c-4375-9874-ce5384c75ce1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:07.753985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d7a414c0-5a52-4d50-88ba-c57d9e143894 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:07.756642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d7a414c0-5a52-4d50-88ba-c57d9e143894 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:07.760924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:07.774372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d7a414c0-5a52-4d50-88ba-c57d9e143894 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:07.781747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d7a414c0-5a52-4d50-88ba-c57d9e143894 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:07.784124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d7a414c0-5a52-4d50-88ba-c57d9e143894 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:07.784867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d7a414c0-5a52-4d50-88ba-c57d9e143894 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:07.931677 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d7a414c0-5a52-4d50-88ba-c57d9e143894 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "POST /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0/action" status: 200 len: 24564 microversion: 2.1 time: 0.181464 Aug 03 02:10:07.943920 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2057/4218] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:10:07 2022] POST /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0/action => generated 24564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:10:08.087011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-33318f1c-736c-4375-9874-ce5384c75ce1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:08.109368 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-33318f1c-736c-4375-9874-ce5384c75ce1 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1333 microversion: 2.1 time: 0.677101 Aug 03 02:10:08.115724 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2162/4219] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:07 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1333 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:08.160605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69765385-2201-4d00-b55d-b30671861980 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:08.162155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-69765385-2201-4d00-b55d-b30671861980 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:08.195331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69765385-2201-4d00-b55d-b30671861980 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:08.197556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69765385-2201-4d00-b55d-b30671861980 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:08.198710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69765385-2201-4d00-b55d-b30671861980 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:08.199383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69765385-2201-4d00-b55d-b30671861980 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:08.413017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-69765385-2201-4d00-b55d-b30671861980 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:08.463293 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-69765385-2201-4d00-b55d-b30671861980 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1221 microversion: 2.1 time: 0.307757 Aug 03 02:10:08.492972 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2058/4220] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:08 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1221 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:08.551781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9dac49f6-ec82-4e3b-be9e-de8097618eae tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:08.553260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9dac49f6-ec82-4e3b-be9e-de8097618eae tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:08.595235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dac49f6-ec82-4e3b-be9e-de8097618eae tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:08.595887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dac49f6-ec82-4e3b-be9e-de8097618eae tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:08.596775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dac49f6-ec82-4e3b-be9e-de8097618eae tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:08.597240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dac49f6-ec82-4e3b-be9e-de8097618eae tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:08.977958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9dac49f6-ec82-4e3b-be9e-de8097618eae tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:08.992834 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9dac49f6-ec82-4e3b-be9e-de8097618eae tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1502 microversion: 2.1 time: 0.493193 Aug 03 02:10:08.994008 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2163/4221] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:08 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1502 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:09.024944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-75635619-f2c0-453b-91aa-a0db38d8f653 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:09.043039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-75635619-f2c0-453b-91aa-a0db38d8f653 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:09.043994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-75635619-f2c0-453b-91aa-a0db38d8f653 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:09.083582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-75635619-f2c0-453b-91aa-a0db38d8f653 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Going to try to stop instance {{(pid=125942) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 02:10:09.140033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-afeba623-1318-4941-87fc-77f5e91d8e1b tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:09.142838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-afeba623-1318-4941-87fc-77f5e91d8e1b tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:09.148801 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-75635619-f2c0-453b-91aa-a0db38d8f653 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a/action" status: 202 len: 0 microversion: 2.1 time: 0.129614 Aug 03 02:10:09.150152 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2059/4222] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:10:09 2022] POST /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:10:09.153275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-afeba623-1318-4941-87fc-77f5e91d8e1b tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:09.154014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-afeba623-1318-4941-87fc-77f5e91d8e1b tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:09.156828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-afeba623-1318-4941-87fc-77f5e91d8e1b tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:09.158583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-afeba623-1318-4941-87fc-77f5e91d8e1b tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:09.163720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f4bc570e-853c-49c0-a86c-149764f4cd2d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:09.164259 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f4bc570e-853c-49c0-a86c-149764f4cd2d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:09.177112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4bc570e-853c-49c0-a86c-149764f4cd2d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:09.178267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4bc570e-853c-49c0-a86c-149764f4cd2d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:09.179698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4bc570e-853c-49c0-a86c-149764f4cd2d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:09.180220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4bc570e-853c-49c0-a86c-149764f4cd2d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:09.496402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-afeba623-1318-4941-87fc-77f5e91d8e1b tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:09.514297 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-afeba623-1318-4941-87fc-77f5e91d8e1b tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1333 microversion: 2.1 time: 0.379298 Aug 03 02:10:09.516982 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2164/4223] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:09 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1333 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:09.542528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9dd4581b-36ad-42ae-9ffd-dc63a332d327 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:09.542794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f4bc570e-853c-49c0-a86c-149764f4cd2d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:09.544619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9dd4581b-36ad-42ae-9ffd-dc63a332d327 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:09.560884 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f4bc570e-853c-49c0-a86c-149764f4cd2d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 0.404681 Aug 03 02:10:09.562987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dd4581b-36ad-42ae-9ffd-dc63a332d327 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:09.563960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dd4581b-36ad-42ae-9ffd-dc63a332d327 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:09.565351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dd4581b-36ad-42ae-9ffd-dc63a332d327 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:09.566226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dd4581b-36ad-42ae-9ffd-dc63a332d327 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:09.577974 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2060/4224] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:09 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:09.704375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9dd4581b-36ad-42ae-9ffd-dc63a332d327 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:09.723480 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9dd4581b-36ad-42ae-9ffd-dc63a332d327 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1277 microversion: 2.1 time: 0.203168 Aug 03 02:10:09.725200 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2165/4225] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:09 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:10.554016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-43ec44fa-c212-4d4f-bbd8-9ad703212d38 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:10.555162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-43ec44fa-c212-4d4f-bbd8-9ad703212d38 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:10.568758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43ec44fa-c212-4d4f-bbd8-9ad703212d38 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:10.569897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43ec44fa-c212-4d4f-bbd8-9ad703212d38 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:10.572364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43ec44fa-c212-4d4f-bbd8-9ad703212d38 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:10.573658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43ec44fa-c212-4d4f-bbd8-9ad703212d38 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:10.600490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-99090cb4-d7fd-43e4-a5e5-807fa1c1716a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:10.601650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-99090cb4-d7fd-43e4-a5e5-807fa1c1716a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:10.630932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99090cb4-d7fd-43e4-a5e5-807fa1c1716a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:10.631835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99090cb4-d7fd-43e4-a5e5-807fa1c1716a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:10.633263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99090cb4-d7fd-43e4-a5e5-807fa1c1716a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:10.634033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99090cb4-d7fd-43e4-a5e5-807fa1c1716a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:11.691967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-99090cb4-d7fd-43e4-a5e5-807fa1c1716a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:11.712370 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-99090cb4-d7fd-43e4-a5e5-807fa1c1716a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 1.125232 Aug 03 02:10:11.721090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-43ec44fa-c212-4d4f-bbd8-9ad703212d38 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:11.747819 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2166/4226] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:10 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:11.770252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f63c9af0-9d47-4eeb-a288-a39f61d748ac tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:11.772798 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-43ec44fa-c212-4d4f-bbd8-9ad703212d38 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1333 microversion: 2.1 time: 1.227790 Aug 03 02:10:11.774436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f63c9af0-9d47-4eeb-a288-a39f61d748ac tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:11.782331 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2061/4227] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:10 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1333 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:11.787506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f63c9af0-9d47-4eeb-a288-a39f61d748ac tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:11.791207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f63c9af0-9d47-4eeb-a288-a39f61d748ac tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:11.792216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f63c9af0-9d47-4eeb-a288-a39f61d748ac tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:11.793074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f63c9af0-9d47-4eeb-a288-a39f61d748ac tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:11.917079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f63c9af0-9d47-4eeb-a288-a39f61d748ac tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:11.930613 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f63c9af0-9d47-4eeb-a288-a39f61d748ac tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1275 microversion: 2.1 time: 0.171954 Aug 03 02:10:11.932614 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2167/4228] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:11 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:12.703281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8663bc1f-3c19-403a-bc58-8c1706b71ad1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:12.704306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8663bc1f-3c19-403a-bc58-8c1706b71ad1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:12.730447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8663bc1f-3c19-403a-bc58-8c1706b71ad1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:12.731749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8663bc1f-3c19-403a-bc58-8c1706b71ad1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:12.732934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8663bc1f-3c19-403a-bc58-8c1706b71ad1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:12.734717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8663bc1f-3c19-403a-bc58-8c1706b71ad1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:12.770174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-209682f2-f237-41b5-a445-1ccd4baf61c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:12.774386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-209682f2-f237-41b5-a445-1ccd4baf61c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:12.805198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-209682f2-f237-41b5-a445-1ccd4baf61c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:12.809094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-209682f2-f237-41b5-a445-1ccd4baf61c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:12.811190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-209682f2-f237-41b5-a445-1ccd4baf61c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:12.812589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-209682f2-f237-41b5-a445-1ccd4baf61c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:13.472780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8663bc1f-3c19-403a-bc58-8c1706b71ad1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:13.482488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8663bc1f-3c19-403a-bc58-8c1706b71ad1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:13.487075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8663bc1f-3c19-403a-bc58-8c1706b71ad1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:13.488740 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8663bc1f-3c19-403a-bc58-8c1706b71ad1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 2949 microversion: 2.42 time: 0.794053 Aug 03 02:10:13.489487 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2062/4229] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:10:12 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 2949 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:10:13.508544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ef6b8284-42e9-4f48-a04f-fd43e23366d3 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:13.520230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ef6b8284-42e9-4f48-a04f-fd43e23366d3 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:13.534061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef6b8284-42e9-4f48-a04f-fd43e23366d3 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:13.534777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef6b8284-42e9-4f48-a04f-fd43e23366d3 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:13.543243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef6b8284-42e9-4f48-a04f-fd43e23366d3 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:13.543718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef6b8284-42e9-4f48-a04f-fd43e23366d3 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:13.549103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:13.686375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-209682f2-f237-41b5-a445-1ccd4baf61c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:13.725322 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-209682f2-f237-41b5-a445-1ccd4baf61c0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 0.941658 Aug 03 02:10:13.727683 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2168/4230] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:12 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:13.734931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c348edb2-b5cd-43f6-a77c-bce607163be3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:13.736855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c348edb2-b5cd-43f6-a77c-bce607163be3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:13.750862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c348edb2-b5cd-43f6-a77c-bce607163be3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:13.753935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c348edb2-b5cd-43f6-a77c-bce607163be3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:13.755708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c348edb2-b5cd-43f6-a77c-bce607163be3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:13.761957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c348edb2-b5cd-43f6-a77c-bce607163be3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:14.198034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c348edb2-b5cd-43f6-a77c-bce607163be3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:14.205989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:14.227677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ef6b8284-42e9-4f48-a04f-fd43e23366d3 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:14.228887 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c348edb2-b5cd-43f6-a77c-bce607163be3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1317 microversion: 2.1 time: 0.498825 Aug 03 02:10:14.229979 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2169/4231] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:13 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:14.244520 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ef6b8284-42e9-4f48-a04f-fd43e23366d3 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1333 microversion: 2.1 time: 0.743634 Aug 03 02:10:14.244520 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2063/4232] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:13 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1333 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:14.266259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4d49cca2-a90e-4840-a0a9-bc036cd22ba4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:14.266778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4d49cca2-a90e-4840-a0a9-bc036cd22ba4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:14.281339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d49cca2-a90e-4840-a0a9-bc036cd22ba4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:14.281660 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d49cca2-a90e-4840-a0a9-bc036cd22ba4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:14.282700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d49cca2-a90e-4840-a0a9-bc036cd22ba4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:14.291427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d49cca2-a90e-4840-a0a9-bc036cd22ba4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:14.620703 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4d49cca2-a90e-4840-a0a9-bc036cd22ba4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.388794 Aug 03 02:10:14.621254 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2170/4233] 10.222.0.67 () {60 vars in 1316 bytes} [Wed Aug 3 02:10:14 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3/os-interface => generated 1831 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:10:14.753626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1c3ddc61-9252-4b8b-a1eb-a8d2fa2e2cbe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:14.755045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1c3ddc61-9252-4b8b-a1eb-a8d2fa2e2cbe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:14.773611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c3ddc61-9252-4b8b-a1eb-a8d2fa2e2cbe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:14.774299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c3ddc61-9252-4b8b-a1eb-a8d2fa2e2cbe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:14.775461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c3ddc61-9252-4b8b-a1eb-a8d2fa2e2cbe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:14.776558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c3ddc61-9252-4b8b-a1eb-a8d2fa2e2cbe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:15.277203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-18feed8d-5204-412b-9f4f-2dc4e1c6b920 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:15.278350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-18feed8d-5204-412b-9f4f-2dc4e1c6b920 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:15.306742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18feed8d-5204-412b-9f4f-2dc4e1c6b920 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:15.307228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18feed8d-5204-412b-9f4f-2dc4e1c6b920 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:15.308241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18feed8d-5204-412b-9f4f-2dc4e1c6b920 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:15.308854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18feed8d-5204-412b-9f4f-2dc4e1c6b920 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:15.974155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1c3ddc61-9252-4b8b-a1eb-a8d2fa2e2cbe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:15.987731 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1c3ddc61-9252-4b8b-a1eb-a8d2fa2e2cbe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 1.243368 Aug 03 02:10:16.007461 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2064/4234] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:14 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:16.041184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-18feed8d-5204-412b-9f4f-2dc4e1c6b920 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:16.048689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-125f7667-a650-4742-b7d5-7c3d6cb29f8c tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:16.052663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-125f7667-a650-4742-b7d5-7c3d6cb29f8c tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:16.078522 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-18feed8d-5204-412b-9f4f-2dc4e1c6b920 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1333 microversion: 2.1 time: 0.809520 Aug 03 02:10:16.081569 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2171/4235] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:15 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1333 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:16.098139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-125f7667-a650-4742-b7d5-7c3d6cb29f8c tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:16.099263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-125f7667-a650-4742-b7d5-7c3d6cb29f8c tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:16.100473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-125f7667-a650-4742-b7d5-7c3d6cb29f8c tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:16.101397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-125f7667-a650-4742-b7d5-7c3d6cb29f8c tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:16.214037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-fd910ff0-ba91-40a0-8ad3-ee10134e681e req-366f3501-02da-447a-ac5d-a4e389bae2bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "456a03bf-bc36-4bb0-8183-8d6e8dd237d9", "tag": "452be907-de41-41a6-adbd-93eff0db6b05"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:16.234518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-fd910ff0-ba91-40a0-8ad3-ee10134e681e req-366f3501-02da-447a-ac5d-a4e389bae2bc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:16.235659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-fd910ff0-ba91-40a0-8ad3-ee10134e681e req-366f3501-02da-447a-ac5d-a4e389bae2bc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:16.289869 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-fd910ff0-ba91-40a0-8ad3-ee10134e681e req-366f3501-02da-447a-ac5d-a4e389bae2bc service nova] Creating event network-changed:452be907-de41-41a6-adbd-93eff0db6b05 for instance 456a03bf-bc36-4bb0-8183-8d6e8dd237d9 on n-h2-826529-8 Aug 03 02:10:16.297943 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-fd910ff0-ba91-40a0-8ad3-ee10134e681e req-366f3501-02da-447a-ac5d-a4e389bae2bc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103203 Aug 03 02:10:16.299708 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2172/4236] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:10:16.601750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:16.643630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:16.674895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-125f7667-a650-4742-b7d5-7c3d6cb29f8c tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:16.702845 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-125f7667-a650-4742-b7d5-7c3d6cb29f8c tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1317 microversion: 2.1 time: 0.687398 Aug 03 02:10:16.706427 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2065/4237] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:16 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1317 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:17.035735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-29b14c06-640a-465c-a7d1-73acd5eae705 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:17.037822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-29b14c06-640a-465c-a7d1-73acd5eae705 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:17.058450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-29b14c06-640a-465c-a7d1-73acd5eae705 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:17.062369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-29b14c06-640a-465c-a7d1-73acd5eae705 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:17.064069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-29b14c06-640a-465c-a7d1-73acd5eae705 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:17.066351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-29b14c06-640a-465c-a7d1-73acd5eae705 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:17.110468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a1897b9f-ffa0-4550-888c-36b1610c3c42 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:17.119850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a1897b9f-ffa0-4550-888c-36b1610c3c42 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:17.137375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1897b9f-ffa0-4550-888c-36b1610c3c42 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:17.140337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1897b9f-ffa0-4550-888c-36b1610c3c42 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:17.144521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:17.150274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1897b9f-ffa0-4550-888c-36b1610c3c42 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:17.153928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1897b9f-ffa0-4550-888c-36b1610c3c42 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:18.180373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a1897b9f-ffa0-4550-888c-36b1610c3c42 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:18.196659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-29b14c06-640a-465c-a7d1-73acd5eae705 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:18.206260 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a1897b9f-ffa0-4550-888c-36b1610c3c42 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1333 microversion: 2.1 time: 1.103643 Aug 03 02:10:18.208591 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2066/4238] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:17 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1333 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:18.224938 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-29b14c06-640a-465c-a7d1-73acd5eae705 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 1.202643 Aug 03 02:10:18.225074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4fcd2512-02d2-4ab8-a8f8-c467912fe569 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:18.225545 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2173/4239] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:17 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:18.225912 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4fcd2512-02d2-4ab8-a8f8-c467912fe569 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:18.281056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4fcd2512-02d2-4ab8-a8f8-c467912fe569 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:18.282213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4fcd2512-02d2-4ab8-a8f8-c467912fe569 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:18.285351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4fcd2512-02d2-4ab8-a8f8-c467912fe569 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:18.286115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4fcd2512-02d2-4ab8-a8f8-c467912fe569 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:18.697468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-b0aa3b76-3821-4a95-9592-0d78c914118c req-5d4885d6-c002-4fa2-95c5-faed3ed752c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8276a9-ef19-47de-9fc3-f2723e39d7da", "name": "network-vif-plugged", "status": "completed", "tag": "00f06cda-2dbf-43a5-bc16-1086f93cfef9"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:18.753240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b0aa3b76-3821-4a95-9592-0d78c914118c req-5d4885d6-c002-4fa2-95c5-faed3ed752c3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:18.753899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b0aa3b76-3821-4a95-9592-0d78c914118c req-5d4885d6-c002-4fa2-95c5-faed3ed752c3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:18.772261 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-b0aa3b76-3821-4a95-9592-0d78c914118c req-5d4885d6-c002-4fa2-95c5-faed3ed752c3 service nova] Creating event network-vif-plugged:00f06cda-2dbf-43a5-bc16-1086f93cfef9 for instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da on n-h2-826529-8 Aug 03 02:10:18.789220 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-b0aa3b76-3821-4a95-9592-0d78c914118c req-5d4885d6-c002-4fa2-95c5-faed3ed752c3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102805 Aug 03 02:10:18.795467 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2174/4240] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:10:18.881349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4fcd2512-02d2-4ab8-a8f8-c467912fe569 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:18.892205 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4fcd2512-02d2-4ab8-a8f8-c467912fe569 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1317 microversion: 2.1 time: 0.682081 Aug 03 02:10:18.905840 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2067/4241] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:18 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1317 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:19.107492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-51632074", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "8e54913b-f114-470c-8cd0-a7ffafc78937"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:19.179578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] validate_networks() for [('8e54913b-f114-470c-8cd0-a7ffafc78937', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:10:19.232343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f7160f7a-2ed1-4074-941f-80122933f36d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:19.233425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f7160f7a-2ed1-4074-941f-80122933f36d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:19.245583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f7160f7a-2ed1-4074-941f-80122933f36d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:19.246586 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f7160f7a-2ed1-4074-941f-80122933f36d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:19.247714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f7160f7a-2ed1-4074-941f-80122933f36d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:19.248496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f7160f7a-2ed1-4074-941f-80122933f36d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:20.071095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f7160f7a-2ed1-4074-941f-80122933f36d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:20.086768 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f7160f7a-2ed1-4074-941f-80122933f36d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1333 microversion: 2.1 time: 0.859369 Aug 03 02:10:20.087783 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2068/4242] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:19 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1333 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:20.096544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d838804f-ba71-49de-81eb-b0b687705106 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:20.098512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d838804f-ba71-49de-81eb-b0b687705106 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:20.113037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d838804f-ba71-49de-81eb-b0b687705106 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:20.113936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d838804f-ba71-49de-81eb-b0b687705106 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:20.115426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d838804f-ba71-49de-81eb-b0b687705106 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:20.116235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d838804f-ba71-49de-81eb-b0b687705106 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:20.693184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d838804f-ba71-49de-81eb-b0b687705106 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:20.704213 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d838804f-ba71-49de-81eb-b0b687705106 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 0.614573 Aug 03 02:10:20.718966 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2069/4243] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:20 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:20.724171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d1fbfd9e-93a1-4177-a331-b4632df9f65d tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:20.725289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d1fbfd9e-93a1-4177-a331-b4632df9f65d tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:20.747668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1fbfd9e-93a1-4177-a331-b4632df9f65d tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:20.748339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1fbfd9e-93a1-4177-a331-b4632df9f65d tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:20.749550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1fbfd9e-93a1-4177-a331-b4632df9f65d tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:20.750408 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1fbfd9e-93a1-4177-a331-b4632df9f65d tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:21.080572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:10:21.081369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:10:21.082189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:10:21.083799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:10:21.084580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:10:21.109833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:21.111124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:21.112733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:21.113998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:21.147797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Getting quotas for project 200ccac980894bd1b38ff99ed17d72d7. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:10:21.158143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Getting quotas for user 17cc626663dd44b0927f5722434551eb and project 200ccac980894bd1b38ff99ed17d72d7. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:10:21.169870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d1fbfd9e-93a1-4177-a331-b4632df9f65d tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:21.177353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:10:21.180111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:10:21.192568 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d1fbfd9e-93a1-4177-a331-b4632df9f65d tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1317 microversion: 2.1 time: 0.482016 Aug 03 02:10:21.195369 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2070/4244] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:20 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:21.216883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d560e252-3229-485f-805c-0459f32ad5af req-6239f17a-c279-4d52-951e-eb83cb95cb36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8276a9-ef19-47de-9fc3-f2723e39d7da", "name": "network-vif-plugged", "status": "completed", "tag": "7be64ecd-f5ad-45eb-9bbe-916f3694f1dd"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:21.240442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d560e252-3229-485f-805c-0459f32ad5af req-6239f17a-c279-4d52-951e-eb83cb95cb36 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:21.241734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d560e252-3229-485f-805c-0459f32ad5af req-6239f17a-c279-4d52-951e-eb83cb95cb36 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:21.262968 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d560e252-3229-485f-805c-0459f32ad5af req-6239f17a-c279-4d52-951e-eb83cb95cb36 service nova] Creating event network-vif-plugged:7be64ecd-f5ad-45eb-9bbe-916f3694f1dd for instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da on n-h2-826529-8 Aug 03 02:10:21.267346 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ee7aed5b-1221-46dc-82d3-9e9861691f01 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.420800 Aug 03 02:10:21.272776 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d560e252-3229-485f-805c-0459f32ad5af req-6239f17a-c279-4d52-951e-eb83cb95cb36 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073828 Aug 03 02:10:21.274337 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2071/4246] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:21.274573 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2175/4246] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:10:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:10:21.297666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-74e2e1b9-e19f-4209-b0d9-9472bc998339 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:21.299878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-74e2e1b9-e19f-4209-b0d9-9472bc998339 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:21.300500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-815b3942-babd-4887-8854-789ac26a509d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:21.302110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-815b3942-babd-4887-8854-789ac26a509d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:21.325821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74e2e1b9-e19f-4209-b0d9-9472bc998339 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:21.326467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74e2e1b9-e19f-4209-b0d9-9472bc998339 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:21.328212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74e2e1b9-e19f-4209-b0d9-9472bc998339 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:21.332501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74e2e1b9-e19f-4209-b0d9-9472bc998339 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:21.607482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-815b3942-babd-4887-8854-789ac26a509d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:21.622922 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-815b3942-babd-4887-8854-789ac26a509d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1223 microversion: 2.1 time: 0.334964 Aug 03 02:10:21.623530 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2176/4247] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:21 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1223 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:21.739200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0356ab17-75e5-4fbe-ba54-bf48f12d43b3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:21.746730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0356ab17-75e5-4fbe-ba54-bf48f12d43b3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:21.769738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0356ab17-75e5-4fbe-ba54-bf48f12d43b3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:21.777230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0356ab17-75e5-4fbe-ba54-bf48f12d43b3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:21.778687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0356ab17-75e5-4fbe-ba54-bf48f12d43b3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:21.779417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0356ab17-75e5-4fbe-ba54-bf48f12d43b3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:21.814209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-74e2e1b9-e19f-4209-b0d9-9472bc998339 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:21.834294 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-74e2e1b9-e19f-4209-b0d9-9472bc998339 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1333 microversion: 2.1 time: 0.557857 Aug 03 02:10:21.835959 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2072/4248] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:21 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1333 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:22.015567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0356ab17-75e5-4fbe-ba54-bf48f12d43b3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:22.029958 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0356ab17-75e5-4fbe-ba54-bf48f12d43b3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 0.300674 Aug 03 02:10:22.032274 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2177/4249] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:21 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:22.240019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2191fb01-9fe9-4edc-ba5e-6b452412c0d9 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:22.240705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2191fb01-9fe9-4edc-ba5e-6b452412c0d9 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:22.258774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2191fb01-9fe9-4edc-ba5e-6b452412c0d9 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:22.261145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2191fb01-9fe9-4edc-ba5e-6b452412c0d9 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:22.265876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2191fb01-9fe9-4edc-ba5e-6b452412c0d9 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:22.267501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2191fb01-9fe9-4edc-ba5e-6b452412c0d9 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:22.556044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2191fb01-9fe9-4edc-ba5e-6b452412c0d9 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:22.592206 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2191fb01-9fe9-4edc-ba5e-6b452412c0d9 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1317 microversion: 2.1 time: 0.361965 Aug 03 02:10:22.597315 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2073/4250] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:22 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:22.666051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-439bfbf7-0446-497a-8f1e-c9da7db07f51 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:22.667241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-439bfbf7-0446-497a-8f1e-c9da7db07f51 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:22.679862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-439bfbf7-0446-497a-8f1e-c9da7db07f51 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:22.680853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-439bfbf7-0446-497a-8f1e-c9da7db07f51 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:22.682352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-439bfbf7-0446-497a-8f1e-c9da7db07f51 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:22.683126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-439bfbf7-0446-497a-8f1e-c9da7db07f51 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:22.787573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-439bfbf7-0446-497a-8f1e-c9da7db07f51 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:22.797599 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-439bfbf7-0446-497a-8f1e-c9da7db07f51 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1275 microversion: 2.1 time: 0.138023 Aug 03 02:10:22.799813 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2178/4251] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:22 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1275 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:22.868028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d0063d90-c456-40f8-96f9-ae6be1d9c4c6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:22.868799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d0063d90-c456-40f8-96f9-ae6be1d9c4c6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:22.888077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0063d90-c456-40f8-96f9-ae6be1d9c4c6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:22.888954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0063d90-c456-40f8-96f9-ae6be1d9c4c6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:22.891139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0063d90-c456-40f8-96f9-ae6be1d9c4c6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:22.897021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0063d90-c456-40f8-96f9-ae6be1d9c4c6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:23.081792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e4d5221d-f2ea-4d0c-bcdb-cbb80783a9d6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:23.084084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e4d5221d-f2ea-4d0c-bcdb-cbb80783a9d6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:23.101935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4d5221d-f2ea-4d0c-bcdb-cbb80783a9d6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:23.104906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4d5221d-f2ea-4d0c-bcdb-cbb80783a9d6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:23.107836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4d5221d-f2ea-4d0c-bcdb-cbb80783a9d6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:23.109191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e4d5221d-f2ea-4d0c-bcdb-cbb80783a9d6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:23.480249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d0063d90-c456-40f8-96f9-ae6be1d9c4c6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:23.490706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e4d5221d-f2ea-4d0c-bcdb-cbb80783a9d6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:23.499516 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d0063d90-c456-40f8-96f9-ae6be1d9c4c6 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1333 microversion: 2.1 time: 0.643072 Aug 03 02:10:23.504740 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e4d5221d-f2ea-4d0c-bcdb-cbb80783a9d6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 0.439472 Aug 03 02:10:23.512709 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2074/4252] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:22 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1333 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:23.520133 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2179/4253] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:23 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:23.539511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-e814f865-1d04-416e-88f2-e014af1dbd03 req-2a8ef34e-625d-4759-83ad-8a4f6f7f63a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "456a03bf-bc36-4bb0-8183-8d6e8dd237d9", "name": "network-vif-plugged", "status": "completed", "tag": "452be907-de41-41a6-adbd-93eff0db6b05"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:23.564112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e814f865-1d04-416e-88f2-e014af1dbd03 req-2a8ef34e-625d-4759-83ad-8a4f6f7f63a0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:23.565152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e814f865-1d04-416e-88f2-e014af1dbd03 req-2a8ef34e-625d-4759-83ad-8a4f6f7f63a0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:23.594354 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e814f865-1d04-416e-88f2-e014af1dbd03 req-2a8ef34e-625d-4759-83ad-8a4f6f7f63a0 service nova] Creating event network-vif-plugged:452be907-de41-41a6-adbd-93eff0db6b05 for instance 456a03bf-bc36-4bb0-8183-8d6e8dd237d9 on n-h2-826529-8 Aug 03 02:10:23.610772 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-e814f865-1d04-416e-88f2-e014af1dbd03 req-2a8ef34e-625d-4759-83ad-8a4f6f7f63a0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080800 Aug 03 02:10:23.612875 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2075/4254] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:23.639304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5a38d9fb-cd71-48be-a14a-c63b24b723f6 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:23.641605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5a38d9fb-cd71-48be-a14a-c63b24b723f6 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:23.656849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a38d9fb-cd71-48be-a14a-c63b24b723f6 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:23.657936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a38d9fb-cd71-48be-a14a-c63b24b723f6 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:23.661586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a38d9fb-cd71-48be-a14a-c63b24b723f6 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:23.663103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a38d9fb-cd71-48be-a14a-c63b24b723f6 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:23.828749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6702a22a-f515-485e-9678-f9647cd958b3 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:23.830671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6702a22a-f515-485e-9678-f9647cd958b3 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:23.840154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6702a22a-f515-485e-9678-f9647cd958b3 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:23.841015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6702a22a-f515-485e-9678-f9647cd958b3 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:23.842325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6702a22a-f515-485e-9678-f9647cd958b3 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:23.843817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6702a22a-f515-485e-9678-f9647cd958b3 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:24.059867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6702a22a-f515-485e-9678-f9647cd958b3 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:24.073449 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6702a22a-f515-485e-9678-f9647cd958b3 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1281 microversion: 2.1 time: 0.254780 Aug 03 02:10:24.081859 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2076/4255] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:23 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1281 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:24.097861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5a38d9fb-cd71-48be-a14a-c63b24b723f6 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:24.111073 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5a38d9fb-cd71-48be-a14a-c63b24b723f6 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1317 microversion: 2.1 time: 0.478757 Aug 03 02:10:24.116188 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2180/4256] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:23 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:24.421857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-232665f0-c279-41be-9842-9b5db2cf773d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:24.422677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-232665f0-c279-41be-9842-9b5db2cf773d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:24.435262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-232665f0-c279-41be-9842-9b5db2cf773d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:24.435772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-232665f0-c279-41be-9842-9b5db2cf773d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:24.437794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-232665f0-c279-41be-9842-9b5db2cf773d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:24.438411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-232665f0-c279-41be-9842-9b5db2cf773d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:24.485550 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-232665f0-c279-41be-9842-9b5db2cf773d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/ips" status: 200 len: 150 microversion: 2.1 time: 0.067415 Aug 03 02:10:24.486942 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2077/4257] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 02:10:24 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/ips => generated 150 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:10:24.554405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fd87d37a-d5d0-475c-b041-9d6ee546e725 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:24.555127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fd87d37a-d5d0-475c-b041-9d6ee546e725 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:24.557236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eb8f12e6-6a47-46a6-b573-1c8a1631deed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:24.560441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eb8f12e6-6a47-46a6-b573-1c8a1631deed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:24.566872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd87d37a-d5d0-475c-b041-9d6ee546e725 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:24.567199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd87d37a-d5d0-475c-b041-9d6ee546e725 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:24.568010 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd87d37a-d5d0-475c-b041-9d6ee546e725 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:24.568457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd87d37a-d5d0-475c-b041-9d6ee546e725 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:24.586679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eb8f12e6-6a47-46a6-b573-1c8a1631deed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:24.588070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eb8f12e6-6a47-46a6-b573-1c8a1631deed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:24.596523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eb8f12e6-6a47-46a6-b573-1c8a1631deed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:24.598464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eb8f12e6-6a47-46a6-b573-1c8a1631deed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:25.058267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-eb8f12e6-6a47-46a6-b573-1c8a1631deed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:25.070369 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eb8f12e6-6a47-46a6-b573-1c8a1631deed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 0.537159 Aug 03 02:10:25.073068 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2181/4258] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:24 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:25.115741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1994d3f-73a4-4883-a583-59a3754d4c0d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:25.116786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b1994d3f-73a4-4883-a583-59a3754d4c0d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:25.132777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1994d3f-73a4-4883-a583-59a3754d4c0d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:25.133325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1994d3f-73a4-4883-a583-59a3754d4c0d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:25.134234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1994d3f-73a4-4883-a583-59a3754d4c0d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:25.134691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1994d3f-73a4-4883-a583-59a3754d4c0d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:25.172945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fd87d37a-d5d0-475c-b041-9d6ee546e725 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:25.201469 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fd87d37a-d5d0-475c-b041-9d6ee546e725 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1670 microversion: 2.1 time: 0.657017 Aug 03 02:10:25.216050 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2078/4259] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:24 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1670 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:25.244648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-31ed6e38-5f96-4447-94d3-475b162f2dff tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:25.247830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-31ed6e38-5f96-4447-94d3-475b162f2dff tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:25.282226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31ed6e38-5f96-4447-94d3-475b162f2dff tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:25.282981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31ed6e38-5f96-4447-94d3-475b162f2dff tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:25.287804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31ed6e38-5f96-4447-94d3-475b162f2dff tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:25.289513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31ed6e38-5f96-4447-94d3-475b162f2dff tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:25.670800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b1994d3f-73a4-4883-a583-59a3754d4c0d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:25.725657 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b1994d3f-73a4-4883-a583-59a3754d4c0d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1323 microversion: 2.1 time: 0.596492 Aug 03 02:10:25.726755 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2182/4260] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:25 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1323 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:25.732198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2d3778c8-0415-41b0-b2b4-5cf1c811b72f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:25.732977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2d3778c8-0415-41b0-b2b4-5cf1c811b72f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:25.747558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d3778c8-0415-41b0-b2b4-5cf1c811b72f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:25.748279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d3778c8-0415-41b0-b2b4-5cf1c811b72f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:25.750149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d3778c8-0415-41b0-b2b4-5cf1c811b72f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:25.755763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d3778c8-0415-41b0-b2b4-5cf1c811b72f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:25.818663 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2d3778c8-0415-41b0-b2b4-5cf1c811b72f tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da/ips" status: 200 len: 181 microversion: 2.1 time: 0.090334 Aug 03 02:10:25.822275 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2183/4261] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 02:10:25 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da/ips => generated 181 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:25.840064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-167f420b-5b99-4a57-938e-df92c7f73651 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:25.840758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-167f420b-5b99-4a57-938e-df92c7f73651 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:25.849409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-167f420b-5b99-4a57-938e-df92c7f73651 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:25.850139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-167f420b-5b99-4a57-938e-df92c7f73651 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:25.851298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-167f420b-5b99-4a57-938e-df92c7f73651 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:25.853505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-167f420b-5b99-4a57-938e-df92c7f73651 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:25.867497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-31ed6e38-5f96-4447-94d3-475b162f2dff tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:25.907205 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-31ed6e38-5f96-4447-94d3-475b162f2dff tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1317 microversion: 2.1 time: 0.679137 Aug 03 02:10:25.909078 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2079/4262] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:25 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1317 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:25.941306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-167f420b-5b99-4a57-938e-df92c7f73651 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:10:26.115684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2267809b-b7f6-4b89-8014-3d467a261310 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:26.127683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2267809b-b7f6-4b89-8014-3d467a261310 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:26.148239 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-167f420b-5b99-4a57-938e-df92c7f73651 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 204 len: 0 microversion: 2.1 time: 0.307547 Aug 03 02:10:26.151370 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2184/4263] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:10:25 2022] DELETE /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:10:26.181083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b55ca9c8-2ffd-4a99-be1d-b5ea6d33049e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:26.182646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2267809b-b7f6-4b89-8014-3d467a261310 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:26.187950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2267809b-b7f6-4b89-8014-3d467a261310 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:26.189399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2267809b-b7f6-4b89-8014-3d467a261310 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:26.190216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2267809b-b7f6-4b89-8014-3d467a261310 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:26.195519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b55ca9c8-2ffd-4a99-be1d-b5ea6d33049e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:26.228902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b55ca9c8-2ffd-4a99-be1d-b5ea6d33049e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:26.229340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b55ca9c8-2ffd-4a99-be1d-b5ea6d33049e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:26.234045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b55ca9c8-2ffd-4a99-be1d-b5ea6d33049e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:26.234639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b55ca9c8-2ffd-4a99-be1d-b5ea6d33049e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:26.595540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b55ca9c8-2ffd-4a99-be1d-b5ea6d33049e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:26.611233 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b55ca9c8-2ffd-4a99-be1d-b5ea6d33049e tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1676 microversion: 2.1 time: 0.451613 Aug 03 02:10:26.612590 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2185/4264] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:26 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1676 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:26.648168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2267809b-b7f6-4b89-8014-3d467a261310 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:26.663819 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2267809b-b7f6-4b89-8014-3d467a261310 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 0.559657 Aug 03 02:10:26.665133 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2080/4265] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:26 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:26.773879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-73f61390-203d-4c6e-9663-bdb9e3b3a42a tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:26.774711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-73f61390-203d-4c6e-9663-bdb9e3b3a42a tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:26.784451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73f61390-203d-4c6e-9663-bdb9e3b3a42a tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:26.785267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73f61390-203d-4c6e-9663-bdb9e3b3a42a tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:26.786393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73f61390-203d-4c6e-9663-bdb9e3b3a42a tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:26.787007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73f61390-203d-4c6e-9663-bdb9e3b3a42a tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:26.954486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2fbead88-8665-44fa-93d0-728e2974e043 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:26.955719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2fbead88-8665-44fa-93d0-728e2974e043 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:26.968510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2fbead88-8665-44fa-93d0-728e2974e043 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:26.969603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2fbead88-8665-44fa-93d0-728e2974e043 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:26.971243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2fbead88-8665-44fa-93d0-728e2974e043 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:26.972053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2fbead88-8665-44fa-93d0-728e2974e043 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:27.012735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:27.082337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-73f61390-203d-4c6e-9663-bdb9e3b3a42a tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:27.119255 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-73f61390-203d-4c6e-9663-bdb9e3b3a42a tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1323 microversion: 2.1 time: 0.352056 Aug 03 02:10:27.122997 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2186/4266] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:26 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1323 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:27.247432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2fbead88-8665-44fa-93d0-728e2974e043 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:27.264229 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2fbead88-8665-44fa-93d0-728e2974e043 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1506 microversion: 2.1 time: 0.317625 Aug 03 02:10:27.268350 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2081/4267] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:26 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:27.298993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d1342fa7-b88b-4583-9fcd-8ce9ea877474 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:27.299759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d1342fa7-b88b-4583-9fcd-8ce9ea877474 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:27.307954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1342fa7-b88b-4583-9fcd-8ce9ea877474 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:27.309611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1342fa7-b88b-4583-9fcd-8ce9ea877474 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:27.312265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1342fa7-b88b-4583-9fcd-8ce9ea877474 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:27.314505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1342fa7-b88b-4583-9fcd-8ce9ea877474 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:27.363859 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d1342fa7-b88b-4583-9fcd-8ce9ea877474 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9/ips" status: 200 len: 109 microversion: 2.1 time: 0.076008 Aug 03 02:10:27.364723 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2187/4268] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 02:10:27 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9/ips => generated 109 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:27.388762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-18ee44d0-aa1b-4a4f-818d-80281163bb14 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:27.390521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-18ee44d0-aa1b-4a4f-818d-80281163bb14 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:27.401582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18ee44d0-aa1b-4a4f-818d-80281163bb14 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:27.402362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18ee44d0-aa1b-4a4f-818d-80281163bb14 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:27.404337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18ee44d0-aa1b-4a4f-818d-80281163bb14 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:27.405904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18ee44d0-aa1b-4a4f-818d-80281163bb14 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:27.487627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2f9c5745-34f0-4c63-b762-fb43072bff0c req-11ae564a-a834-4328-8b0a-a97b7b8a6d21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5a96da-f885-487e-b6eb-a5bc133e32d2", "tag": "313fdcfd-4ad0-431c-ac44-33c3d015c652"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:27.490811 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-18ee44d0-aa1b-4a4f-818d-80281163bb14 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9/ips" status: 200 len: 109 microversion: 2.1 time: 0.108266 Aug 03 02:10:27.492455 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2082/4269] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 02:10:27 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9/ips => generated 109 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:27.504115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:27.515891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4e8a87a0-9dcc-43bd-a442-f05154db73c5 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:27.516695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4e8a87a0-9dcc-43bd-a442-f05154db73c5 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:27.531389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e8a87a0-9dcc-43bd-a442-f05154db73c5 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:27.532337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e8a87a0-9dcc-43bd-a442-f05154db73c5 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:27.534771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e8a87a0-9dcc-43bd-a442-f05154db73c5 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:27.535835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e8a87a0-9dcc-43bd-a442-f05154db73c5 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:27.536713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2f9c5745-34f0-4c63-b762-fb43072bff0c req-11ae564a-a834-4328-8b0a-a97b7b8a6d21 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:27.537740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2f9c5745-34f0-4c63-b762-fb43072bff0c req-11ae564a-a834-4328-8b0a-a97b7b8a6d21 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:27.596421 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4e8a87a0-9dcc-43bd-a442-f05154db73c5 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9/ips/tempest-ServerAddressesTestJSON-1671187767-network" status: 200 len: 94 microversion: 2.1 time: 0.090185 Aug 03 02:10:27.597656 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2f9c5745-34f0-4c63-b762-fb43072bff0c req-11ae564a-a834-4328-8b0a-a97b7b8a6d21 service nova] Creating event network-changed:313fdcfd-4ad0-431c-ac44-33c3d015c652 for instance aa5a96da-f885-487e-b6eb-a5bc133e32d2 on n-h1-826529-8 Aug 03 02:10:27.598690 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2083/4270] 10.222.0.67 () {58 vars in 1401 bytes} [Wed Aug 3 02:10:27 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9/ips/tempest-ServerAddressesTestJSON-1671187767-network => generated 94 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 02:10:27.607499 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2f9c5745-34f0-4c63-b762-fb43072bff0c req-11ae564a-a834-4328-8b0a-a97b7b8a6d21 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127231 Aug 03 02:10:27.610031 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2188/4271] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:10:27.622469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-faf94a91-9e67-4475-95c9-ab90f1c976a3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:27.623430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-faf94a91-9e67-4475-95c9-ab90f1c976a3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:27.631352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e0eb8f6a-c318-4f20-b28d-a3c32a039f5e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60129b11-5490-49ce-aa98-4dd3d803c60f"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:27.636955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e0eb8f6a-c318-4f20-b28d-a3c32a039f5e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:27.640301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-faf94a91-9e67-4475-95c9-ab90f1c976a3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:27.641229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-faf94a91-9e67-4475-95c9-ab90f1c976a3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:27.643519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-faf94a91-9e67-4475-95c9-ab90f1c976a3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:27.644539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-faf94a91-9e67-4475-95c9-ab90f1c976a3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:27.650655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0eb8f6a-c318-4f20-b28d-a3c32a039f5e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:27.651451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0eb8f6a-c318-4f20-b28d-a3c32a039f5e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:27.652794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0eb8f6a-c318-4f20-b28d-a3c32a039f5e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:27.653392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0eb8f6a-c318-4f20-b28d-a3c32a039f5e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:27.692245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-faf94a91-9e67-4475-95c9-ab90f1c976a3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:10:27.702454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:27.831533 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-faf94a91-9e67-4475-95c9-ab90f1c976a3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "DELETE /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 204 len: 0 microversion: 2.1 time: 0.215613 Aug 03 02:10:27.832558 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2084/4272] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:10:27 2022] DELETE /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:10:27.841855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-934596b8-22f4-4657-969f-9eab3ce1a199 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:27.843441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-934596b8-22f4-4657-969f-9eab3ce1a199 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:27.853448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-934596b8-22f4-4657-969f-9eab3ce1a199 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:27.854499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-934596b8-22f4-4657-969f-9eab3ce1a199 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:27.855955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-934596b8-22f4-4657-969f-9eab3ce1a199 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:27.856587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-934596b8-22f4-4657-969f-9eab3ce1a199 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:28.110353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-934596b8-22f4-4657-969f-9eab3ce1a199 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:28.135580 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-934596b8-22f4-4657-969f-9eab3ce1a199 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1676 microversion: 2.1 time: 0.300448 Aug 03 02:10:28.137484 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2085/4273] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:27 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1676 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:28.152696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-884a4d67-c8af-4a5d-a315-45d0575bece8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:28.153805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-884a4d67-c8af-4a5d-a315-45d0575bece8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:28.164168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-884a4d67-c8af-4a5d-a315-45d0575bece8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:28.164868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-884a4d67-c8af-4a5d-a315-45d0575bece8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:28.166986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-884a4d67-c8af-4a5d-a315-45d0575bece8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:28.166986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-884a4d67-c8af-4a5d-a315-45d0575bece8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:28.198047 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e0eb8f6a-c318-4f20-b28d-a3c32a039f5e tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "POST /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578309 Aug 03 02:10:28.199368 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2189/4274] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:10:27 2022] POST /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments => generated 194 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:28.212667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b447f253-ae65-44a5-9b2b-39fa13b695db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:28.213861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b447f253-ae65-44a5-9b2b-39fa13b695db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:28.228992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b447f253-ae65-44a5-9b2b-39fa13b695db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:28.229567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b447f253-ae65-44a5-9b2b-39fa13b695db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:28.231202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b447f253-ae65-44a5-9b2b-39fa13b695db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:28.232600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b447f253-ae65-44a5-9b2b-39fa13b695db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:28.872626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-884a4d67-c8af-4a5d-a315-45d0575bece8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:28.901825 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-884a4d67-c8af-4a5d-a315-45d0575bece8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 0.755651 Aug 03 02:10:28.905175 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2086/4275] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:28 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:28.922888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-321fcd1f-7750-46e8-aa77-b7b540ee2776 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:28.926303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-321fcd1f-7750-46e8-aa77-b7b540ee2776 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:28.956671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-321fcd1f-7750-46e8-aa77-b7b540ee2776 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:28.958429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-321fcd1f-7750-46e8-aa77-b7b540ee2776 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:28.961722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-321fcd1f-7750-46e8-aa77-b7b540ee2776 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:28.963947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-321fcd1f-7750-46e8-aa77-b7b540ee2776 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:28.988308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b447f253-ae65-44a5-9b2b-39fa13b695db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:29.001246 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b447f253-ae65-44a5-9b2b-39fa13b695db tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1512 microversion: 2.1 time: 0.799680 Aug 03 02:10:29.002543 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2190/4276] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:28 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1512 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:29.174423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-88921376-a968-41c0-aa1b-6881992641db tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:29.175634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-88921376-a968-41c0-aa1b-6881992641db tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:29.185712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88921376-a968-41c0-aa1b-6881992641db tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:29.186590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88921376-a968-41c0-aa1b-6881992641db tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:29.187702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88921376-a968-41c0-aa1b-6881992641db tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:29.188400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-88921376-a968-41c0-aa1b-6881992641db tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:29.639038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-321fcd1f-7750-46e8-aa77-b7b540ee2776 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:29.647534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-88921376-a968-41c0-aa1b-6881992641db tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:29.653467 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-321fcd1f-7750-46e8-aa77-b7b540ee2776 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1323 microversion: 2.1 time: 0.745932 Aug 03 02:10:29.654571 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2087/4277] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:28 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1323 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:29.676367 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-88921376-a968-41c0-aa1b-6881992641db tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1676 microversion: 2.1 time: 0.510577 Aug 03 02:10:29.677382 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2191/4278] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:29 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1676 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:29.945266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7d136d1f-94e8-45e9-8cfd-01ee4b6041dc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:29.947470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7d136d1f-94e8-45e9-8cfd-01ee4b6041dc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:29.960181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d136d1f-94e8-45e9-8cfd-01ee4b6041dc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:29.961204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d136d1f-94e8-45e9-8cfd-01ee4b6041dc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:29.962795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d136d1f-94e8-45e9-8cfd-01ee4b6041dc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:29.964821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d136d1f-94e8-45e9-8cfd-01ee4b6041dc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:30.046462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7de24fdd-1132-454b-ba62-35b32e41e435 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:30.048945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7de24fdd-1132-454b-ba62-35b32e41e435 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:30.070433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7de24fdd-1132-454b-ba62-35b32e41e435 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:30.070891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7de24fdd-1132-454b-ba62-35b32e41e435 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:30.071804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7de24fdd-1132-454b-ba62-35b32e41e435 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:30.072255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7de24fdd-1132-454b-ba62-35b32e41e435 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:30.646795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7d136d1f-94e8-45e9-8cfd-01ee4b6041dc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:30.650627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7de24fdd-1132-454b-ba62-35b32e41e435 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:30.668664 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7d136d1f-94e8-45e9-8cfd-01ee4b6041dc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 0.729061 Aug 03 02:10:30.672883 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2088/4279] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:29 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:30.681302 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7de24fdd-1132-454b-ba62-35b32e41e435 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1512 microversion: 2.1 time: 0.640098 Aug 03 02:10:30.686127 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2192/4280] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:30 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1512 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:30.698834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-668da010-3490-4017-be00-2c356538dcf2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:30.703237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-668da010-3490-4017-be00-2c356538dcf2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:30.707265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a3791296-32c2-4ba7-8cfa-6cbcd8a787cc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:30.710375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a3791296-32c2-4ba7-8cfa-6cbcd8a787cc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:30.722707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3791296-32c2-4ba7-8cfa-6cbcd8a787cc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:30.724267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3791296-32c2-4ba7-8cfa-6cbcd8a787cc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:30.726242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3791296-32c2-4ba7-8cfa-6cbcd8a787cc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:30.727311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3791296-32c2-4ba7-8cfa-6cbcd8a787cc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:30.727535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-668da010-3490-4017-be00-2c356538dcf2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:30.728300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-668da010-3490-4017-be00-2c356538dcf2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:30.729775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-668da010-3490-4017-be00-2c356538dcf2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:30.730524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-668da010-3490-4017-be00-2c356538dcf2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:31.131178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:31.151896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-668da010-3490-4017-be00-2c356538dcf2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:31.181364 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-668da010-3490-4017-be00-2c356538dcf2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1323 microversion: 2.1 time: 0.498137 Aug 03 02:10:31.183666 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2089/4281] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:30 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1323 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:31.298689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a3791296-32c2-4ba7-8cfa-6cbcd8a787cc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:31.313482 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a3791296-32c2-4ba7-8cfa-6cbcd8a787cc tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1676 microversion: 2.1 time: 0.617378 Aug 03 02:10:31.314967 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2193/4282] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:30 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1676 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:31.679118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ac359147-3a25-4db4-a9ba-e03d512be592 req-5ae147ae-bed7-4728-8b51-a469be948906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8276a9-ef19-47de-9fc3-f2723e39d7da", "name": "network-vif-deleted", "tag": "00f06cda-2dbf-43a5-bc16-1086f93cfef9"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:31.712149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-92f25e0b-5793-49ff-9ce9-b6cf4b1c9fc4 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:31.713129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-92f25e0b-5793-49ff-9ce9-b6cf4b1c9fc4 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:31.719600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:31.737720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ac359147-3a25-4db4-a9ba-e03d512be592 req-5ae147ae-bed7-4728-8b51-a469be948906 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:31.740356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92f25e0b-5793-49ff-9ce9-b6cf4b1c9fc4 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:31.741567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ac359147-3a25-4db4-a9ba-e03d512be592 req-5ae147ae-bed7-4728-8b51-a469be948906 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:31.746212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92f25e0b-5793-49ff-9ce9-b6cf4b1c9fc4 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:31.748088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92f25e0b-5793-49ff-9ce9-b6cf4b1c9fc4 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:31.748903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92f25e0b-5793-49ff-9ce9-b6cf4b1c9fc4 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:31.791333 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ac359147-3a25-4db4-a9ba-e03d512be592 req-5ae147ae-bed7-4728-8b51-a469be948906 service nova] Creating event network-vif-deleted:00f06cda-2dbf-43a5-bc16-1086f93cfef9 for instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da on n-h2-826529-8 Aug 03 02:10:31.816201 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ac359147-3a25-4db4-a9ba-e03d512be592 req-5ae147ae-bed7-4728-8b51-a469be948906 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149366 Aug 03 02:10:31.819493 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2090/4283] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:31.843183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6e5aa536-eb56-4cd4-a3f9-76a8b7172e8a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:31.850557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6e5aa536-eb56-4cd4-a3f9-76a8b7172e8a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:31.874216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6e5aa536-eb56-4cd4-a3f9-76a8b7172e8a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:31.874216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6e5aa536-eb56-4cd4-a3f9-76a8b7172e8a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:31.875090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6e5aa536-eb56-4cd4-a3f9-76a8b7172e8a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:31.875540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6e5aa536-eb56-4cd4-a3f9-76a8b7172e8a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:32.015677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-92f25e0b-5793-49ff-9ce9-b6cf4b1c9fc4 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:32.031397 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-92f25e0b-5793-49ff-9ce9-b6cf4b1c9fc4 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1470 microversion: 2.1 time: 0.324123 Aug 03 02:10:32.032469 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2194/4284] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:31 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1470 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:32.219712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-adc0095b-9873-48a6-b89b-0da0c8032eec tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:32.227090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-adc0095b-9873-48a6-b89b-0da0c8032eec tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:32.252636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-adc0095b-9873-48a6-b89b-0da0c8032eec tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:32.253477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-adc0095b-9873-48a6-b89b-0da0c8032eec tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:32.261180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-adc0095b-9873-48a6-b89b-0da0c8032eec tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:32.262767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-adc0095b-9873-48a6-b89b-0da0c8032eec tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:32.352216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6e5aa536-eb56-4cd4-a3f9-76a8b7172e8a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:32.364661 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6e5aa536-eb56-4cd4-a3f9-76a8b7172e8a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 0.538279 Aug 03 02:10:32.379245 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2091/4285] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:31 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:32.401014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ef357f03-c1d2-45ff-a8a5-4c7e5578c329 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:32.401014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ef357f03-c1d2-45ff-a8a5-4c7e5578c329 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:32.417087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef357f03-c1d2-45ff-a8a5-4c7e5578c329 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:32.427637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef357f03-c1d2-45ff-a8a5-4c7e5578c329 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:32.428565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef357f03-c1d2-45ff-a8a5-4c7e5578c329 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:32.429019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef357f03-c1d2-45ff-a8a5-4c7e5578c329 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:32.958875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-adc0095b-9873-48a6-b89b-0da0c8032eec tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:32.978945 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-adc0095b-9873-48a6-b89b-0da0c8032eec tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1323 microversion: 2.1 time: 0.771855 Aug 03 02:10:32.981230 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2195/4286] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:32 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1323 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:32.996821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a51b12c9-e4a5-40c6-a502-749dca55426d req-b07cf3a2-1ed1-48e9-b6a0-f85ebc799410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "456a03bf-bc36-4bb0-8183-8d6e8dd237d9", "name": "network-vif-deleted", "tag": "452be907-de41-41a6-adbd-93eff0db6b05"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:33.048359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a51b12c9-e4a5-40c6-a502-749dca55426d req-b07cf3a2-1ed1-48e9-b6a0-f85ebc799410 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:33.048917 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a51b12c9-e4a5-40c6-a502-749dca55426d req-b07cf3a2-1ed1-48e9-b6a0-f85ebc799410 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:33.084151 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a51b12c9-e4a5-40c6-a502-749dca55426d req-b07cf3a2-1ed1-48e9-b6a0-f85ebc799410 service nova] Creating event network-vif-deleted:452be907-de41-41a6-adbd-93eff0db6b05 for instance 456a03bf-bc36-4bb0-8183-8d6e8dd237d9 on n-h2-826529-8 Aug 03 02:10:33.099183 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a51b12c9-e4a5-40c6-a502-749dca55426d req-b07cf3a2-1ed1-48e9-b6a0-f85ebc799410 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116421 Aug 03 02:10:33.100140 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2196/4287] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:33.115549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-aec2a052-6846-4fba-b53c-594b4dc01eaa req-b9e4db86-828a-43af-a2ba-25107299ca41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8276a9-ef19-47de-9fc3-f2723e39d7da", "name": "network-vif-unplugged", "status": "completed", "tag": "7be64ecd-f5ad-45eb-9bbe-916f3694f1dd"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:33.147728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-aec2a052-6846-4fba-b53c-594b4dc01eaa req-b9e4db86-828a-43af-a2ba-25107299ca41 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:33.149927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-aec2a052-6846-4fba-b53c-594b4dc01eaa req-b9e4db86-828a-43af-a2ba-25107299ca41 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:33.197559 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-aec2a052-6846-4fba-b53c-594b4dc01eaa req-b9e4db86-828a-43af-a2ba-25107299ca41 service nova] Creating event network-vif-unplugged:7be64ecd-f5ad-45eb-9bbe-916f3694f1dd for instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da on n-h2-826529-8 Aug 03 02:10:33.219876 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-aec2a052-6846-4fba-b53c-594b4dc01eaa req-b9e4db86-828a-43af-a2ba-25107299ca41 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116585 Aug 03 02:10:33.220828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ef357f03-c1d2-45ff-a8a5-4c7e5578c329 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:33.228481 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2197/4288] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:33.242646 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ef357f03-c1d2-45ff-a8a5-4c7e5578c329 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1496 microversion: 2.1 time: 0.860603 Aug 03 02:10:33.243269 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2092/4289] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:32 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1496 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:33.262705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e6a6fd46-c2e1-4d7a-8006-c01c6cda18e3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:33.265726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e6a6fd46-c2e1-4d7a-8006-c01c6cda18e3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:33.296776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6a6fd46-c2e1-4d7a-8006-c01c6cda18e3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:33.297979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6a6fd46-c2e1-4d7a-8006-c01c6cda18e3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:33.299463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6a6fd46-c2e1-4d7a-8006-c01c6cda18e3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:33.305783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6a6fd46-c2e1-4d7a-8006-c01c6cda18e3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:33.427681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6562724f-414f-4977-a067-cdec2f94c1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:33.429441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6562724f-414f-4977-a067-cdec2f94c1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:33.430172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6a6fd46-c2e1-4d7a-8006-c01c6cda18e3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:33.430669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6a6fd46-c2e1-4d7a-8006-c01c6cda18e3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:33.437525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-e6a6fd46-c2e1-4d7a-8006-c01c6cda18e3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lazy-loading 'fault' on Instance uuid 456a03bf-bc36-4bb0-8183-8d6e8dd237d9 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:10:33.454019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6562724f-414f-4977-a067-cdec2f94c1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:33.455085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6562724f-414f-4977-a067-cdec2f94c1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:33.457903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6562724f-414f-4977-a067-cdec2f94c1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:33.461588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6562724f-414f-4977-a067-cdec2f94c1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:33.510856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e6a6fd46-c2e1-4d7a-8006-c01c6cda18e3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18f692444b34c4e91cb867faa16da69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc12b67e2b314d80ad1bf806764659e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:33.520177 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e6a6fd46-c2e1-4d7a-8006-c01c6cda18e3 tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 200 len: 1307 microversion: 2.1 time: 0.289304 Aug 03 02:10:33.543418 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2198/4290] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:33 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 1307 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:33.612800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7f782943-0b7a-4d93-9fb4-2473be0b2ea2 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Action: 'create', calling method: .version_select at 0x7f5b12892ee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2045307261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJH/FP7uy/a5ojYK7ufekhLuwGTCSLA1Dlipuq76qZq//shPuEJMqPB8E7Z6dAgvzGvWLb5C6K8QVH1kAlLNyk3K6t677pMjpw68/nKI27aN/duLCqPtb466SXlhu35tJA=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:33.654799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-7f782943-0b7a-4d93-9fb4-2473be0b2ea2 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Getting quotas for project f90284be975b4e459cdc3e72c1664630. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:10:33.661559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-7f782943-0b7a-4d93-9fb4-2473be0b2ea2 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Getting quotas for user c1ab5d1fb4b1453b9ba37a2b1194ec79 and project f90284be975b4e459cdc3e72c1664630. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:10:33.713935 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7f782943-0b7a-4d93-9fb4-2473be0b2ea2 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.106186 Aug 03 02:10:33.722577 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2199/4291] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:10:33 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:34.021930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bfec1f16-01fd-4c0f-9acb-92c336beb3e0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:34.026841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bfec1f16-01fd-4c0f-9acb-92c336beb3e0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:34.053154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfec1f16-01fd-4c0f-9acb-92c336beb3e0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:34.053737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfec1f16-01fd-4c0f-9acb-92c336beb3e0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:34.056972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfec1f16-01fd-4c0f-9acb-92c336beb3e0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:34.057539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bfec1f16-01fd-4c0f-9acb-92c336beb3e0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:34.586854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6562724f-414f-4977-a067-cdec2f94c1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:34.615278 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6562724f-414f-4977-a067-cdec2f94c1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 1.196605 Aug 03 02:10:34.616862 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2093/4292] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:33 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:34.626077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-bd071bc2-1f0b-4f00-ad67-b7fff26ef97f req-d339d07a-70d8-4cab-8fe7-3afcd43188a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8276a9-ef19-47de-9fc3-f2723e39d7da", "name": "network-vif-deleted", "tag": "7be64ecd-f5ad-45eb-9bbe-916f3694f1dd"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:34.644297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bd071bc2-1f0b-4f00-ad67-b7fff26ef97f req-d339d07a-70d8-4cab-8fe7-3afcd43188a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:34.645964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bd071bc2-1f0b-4f00-ad67-b7fff26ef97f req-d339d07a-70d8-4cab-8fe7-3afcd43188a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:34.679641 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-bd071bc2-1f0b-4f00-ad67-b7fff26ef97f req-d339d07a-70d8-4cab-8fe7-3afcd43188a7 service nova] Creating event network-vif-deleted:7be64ecd-f5ad-45eb-9bbe-916f3694f1dd for instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da on n-h2-826529-8 Aug 03 02:10:34.696734 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-bd071bc2-1f0b-4f00-ad67-b7fff26ef97f req-d339d07a-70d8-4cab-8fe7-3afcd43188a7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077331 Aug 03 02:10:34.697989 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2094/4293] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:34.705641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a4497bda-1eef-49ce-965f-d3a6378b7aef tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:34.706658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a4497bda-1eef-49ce-965f-d3a6378b7aef tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:34.729718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4497bda-1eef-49ce-965f-d3a6378b7aef tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:34.734374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4497bda-1eef-49ce-965f-d3a6378b7aef tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:34.736102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4497bda-1eef-49ce-965f-d3a6378b7aef tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:34.737135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4497bda-1eef-49ce-965f-d3a6378b7aef tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:34.888430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4497bda-1eef-49ce-965f-d3a6378b7aef tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:34.890472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4497bda-1eef-49ce-965f-d3a6378b7aef tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:34.891557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-a4497bda-1eef-49ce-965f-d3a6378b7aef tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lazy-loading 'fault' on Instance uuid 8d8276a9-ef19-47de-9fc3-f2723e39d7da {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:10:34.965991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a4497bda-1eef-49ce-965f-d3a6378b7aef tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37f3ee587f9e4e108351dd67cc6b7796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa7b92a26924225842a35fbdf0582be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:34.977462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bfec1f16-01fd-4c0f-9acb-92c336beb3e0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:34.987050 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a4497bda-1eef-49ce-965f-d3a6378b7aef tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 200 len: 1302 microversion: 2.1 time: 0.285265 Aug 03 02:10:34.989789 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2095/4294] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:34 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 1302 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:35.003482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-530e6f7e-d81e-4505-8248-788d9b96c53a tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:35.003482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-530e6f7e-d81e-4505-8248-788d9b96c53a tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] [instance: 456a03bf-bc36-4bb0-8183-8d6e8dd237d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:35.018059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-530e6f7e-d81e-4505-8248-788d9b96c53a tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:35.019858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-530e6f7e-d81e-4505-8248-788d9b96c53a tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:35.021352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-530e6f7e-d81e-4505-8248-788d9b96c53a tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:35.023072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-530e6f7e-d81e-4505-8248-788d9b96c53a tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:35.023928 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bfec1f16-01fd-4c0f-9acb-92c336beb3e0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1323 microversion: 2.1 time: 1.011513 Aug 03 02:10:35.024590 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2200/4295] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:34 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1323 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:35.049778 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-530e6f7e-d81e-4505-8248-788d9b96c53a tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] HTTP exception thrown: Instance 456a03bf-bc36-4bb0-8183-8d6e8dd237d9 could not be found. Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-530e6f7e-d81e-4505-8248-788d9b96c53a tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Request method failure captured: Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 HTTP/1.1 Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dj7-jAWQg-sddb0rnCgjW6Xm15SHI775PywsbHvzArIU3Sk4DvrxlPQy9Xb4sEqN2GdbrhFctd87-yd2Op9q1gPgtehM0HzXjEdYazWy9KpYpHLUkw78LZ8iqt1lC1q9pHY4rThK3jVMdjs68DbM_hPBpL_3-D_xtGcd1YXQE_u8NQ Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: fc12b67e2b314d80ad1bf806764659e6 Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerAddressesTestJSON-1837928244 Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fc12b67e2b314d80ad1bf806764659e6", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fc12b67e2b314d80ad1bf806764659e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fc12b67e2b314d80ad1bf806764659e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fc12b67e2b314d80ad1bf806764659e6"}]}] Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerAddressesTestJSON-1837928244 Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: fc12b67e2b314d80ad1bf806764659e6 Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1837928244 Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerAddressesTestJSON-1837928244-project Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: e18f692444b34c4e91cb867faa16da69 Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerAddressesTestJSON-1837928244-project Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 456a03bf-bc36-4bb0-8183-8d6e8dd237d9 could not be found. Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '456a03bf-bc36-4bb0-8183-8d6e8dd237d9'} Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 456a03bf-bc36-4bb0-8183-8d6e8dd237d9 could not be found. Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 456a03bf-bc36-4bb0-8183-8d6e8dd237d9 could not be found. Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:35.052748 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:35.057070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:35.057070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:35.057070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:35.057070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:10:35.057070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:10:35.057070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 456a03bf-bc36-4bb0-8183-8d6e8dd237d9 could not be found. Aug 03 02:10:35.057070 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:35.059310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-530e6f7e-d81e-4505-8248-788d9b96c53a tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] Returning 404 to user: Instance 456a03bf-bc36-4bb0-8183-8d6e8dd237d9 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:10:35.060492 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-530e6f7e-d81e-4505-8248-788d9b96c53a tempest-ServerAddressesTestJSON-1837928244 tempest-ServerAddressesTestJSON-1837928244-project] 10.222.0.67 "GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9" status: 404 len: 111 microversion: 2.1 time: 0.067498 Aug 03 02:10:35.070831 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2096/4296] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:34 2022] GET /compute/v2.1/servers/456a03bf-bc36-4bb0-8183-8d6e8dd237d9 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:10:35.651265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9cda2d76-8782-4fdb-b4f6-09b6f38298b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:35.651945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9cda2d76-8782-4fdb-b4f6-09b6f38298b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:35.665545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cda2d76-8782-4fdb-b4f6-09b6f38298b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:35.667593 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cda2d76-8782-4fdb-b4f6-09b6f38298b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:35.671574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cda2d76-8782-4fdb-b4f6-09b6f38298b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:35.673349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cda2d76-8782-4fdb-b4f6-09b6f38298b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:35.995317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9cda2d76-8782-4fdb-b4f6-09b6f38298b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:36.019939 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9cda2d76-8782-4fdb-b4f6-09b6f38298b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 0.372865 Aug 03 02:10:36.021666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-55b30277-83ea-423d-b98c-a8628fe2c83d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:36.022380 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-55b30277-83ea-423d-b98c-a8628fe2c83d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:36.027544 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2201/4297] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:35 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:36.038741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55b30277-83ea-423d-b98c-a8628fe2c83d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:36.046856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55b30277-83ea-423d-b98c-a8628fe2c83d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:36.049536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55b30277-83ea-423d-b98c-a8628fe2c83d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:36.050000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55b30277-83ea-423d-b98c-a8628fe2c83d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:36.055305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e46d490-7c35-4d8f-81f1-69a94fbaa183 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:36.059519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3e46d490-7c35-4d8f-81f1-69a94fbaa183 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:36.077659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e46d490-7c35-4d8f-81f1-69a94fbaa183 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:36.079811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e46d490-7c35-4d8f-81f1-69a94fbaa183 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:36.082809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e46d490-7c35-4d8f-81f1-69a94fbaa183 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:36.084130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e46d490-7c35-4d8f-81f1-69a94fbaa183 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:36.122758 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-55b30277-83ea-423d-b98c-a8628fe2c83d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] HTTP exception thrown: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-55b30277-83ea-423d-b98c-a8628fe2c83d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Request method failure captured: Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da HTTP/1.1 Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dibcUcVaK_83ByI97mmmgLtm8myGL-qUBxJSDDywnZTFWdmJ4ugcSImrtdE6-EJcb1nvxtsYFDGJ6EqDgLpicW4ylAyiohI4tXxqpNsjEc6RKRlVcBb0GrQXtqXJTu3sMEAPcMF1vK8eVo0Kyh_vJ5Lhy2xC8Fe0UgDahL2x0Nw4Cw Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 9fa7b92a26924225842a35fbdf0582be Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestMultiNic-238509208 Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9fa7b92a26924225842a35fbdf0582be", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9fa7b92a26924225842a35fbdf0582be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9fa7b92a26924225842a35fbdf0582be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9fa7b92a26924225842a35fbdf0582be"}]}] Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestMultiNic-238509208 Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 9fa7b92a26924225842a35fbdf0582be Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestMultiNic-238509208 Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestMultiNic-238509208-project Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 37f3ee587f9e4e108351dd67cc6b7796 Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestMultiNic-238509208-project Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '8d8276a9-ef19-47de-9fc3-f2723e39d7da'} Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:36.133646 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:36.138047 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:36.138047 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:36.138047 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:36.138047 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:10:36.138047 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:10:36.138047 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. Aug 03 02:10:36.138047 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:36.138047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-55b30277-83ea-423d-b98c-a8628fe2c83d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Returning 404 to user: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:10:36.141544 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-55b30277-83ea-423d-b98c-a8628fe2c83d tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 404 len: 111 microversion: 2.1 time: 0.123703 Aug 03 02:10:36.147708 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2097/4298] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:36 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:10:36.750719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3e46d490-7c35-4d8f-81f1-69a94fbaa183 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:36.789036 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e46d490-7c35-4d8f-81f1-69a94fbaa183 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1323 microversion: 2.1 time: 0.742742 Aug 03 02:10:36.804054 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2202/4299] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:36 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1323 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:37.060059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25ad5a3a-febc-4ea9-ac19-1e8affdf110a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:37.063262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-25ad5a3a-febc-4ea9-ac19-1e8affdf110a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:37.094757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25ad5a3a-febc-4ea9-ac19-1e8affdf110a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:37.096056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25ad5a3a-febc-4ea9-ac19-1e8affdf110a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:37.098535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25ad5a3a-febc-4ea9-ac19-1e8affdf110a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:37.100060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25ad5a3a-febc-4ea9-ac19-1e8affdf110a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:37.695531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-25ad5a3a-febc-4ea9-ac19-1e8affdf110a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:37.716235 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-25ad5a3a-febc-4ea9-ac19-1e8affdf110a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 0.665939 Aug 03 02:10:37.732571 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2098/4300] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:37 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:37.840981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0a56103c-c916-45a3-a7e1-8239bf52fa48 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:37.848087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0a56103c-c916-45a3-a7e1-8239bf52fa48 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:37.907554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a56103c-c916-45a3-a7e1-8239bf52fa48 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:37.908512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a56103c-c916-45a3-a7e1-8239bf52fa48 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:37.914821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a56103c-c916-45a3-a7e1-8239bf52fa48 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:37.916493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a56103c-c916-45a3-a7e1-8239bf52fa48 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:38.402461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-194177e4-69ea-4a45-a0eb-793c3727ca04 req-ef24e57f-543a-4d4c-b714-5d3d66ee08a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5a96da-f885-487e-b6eb-a5bc133e32d2", "name": "network-vif-plugged", "status": "completed", "tag": "313fdcfd-4ad0-431c-ac44-33c3d015c652"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:38.425659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:38.430864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-194177e4-69ea-4a45-a0eb-793c3727ca04 req-ef24e57f-543a-4d4c-b714-5d3d66ee08a4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:38.431335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-194177e4-69ea-4a45-a0eb-793c3727ca04 req-ef24e57f-543a-4d4c-b714-5d3d66ee08a4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:38.453492 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-194177e4-69ea-4a45-a0eb-793c3727ca04 req-ef24e57f-543a-4d4c-b714-5d3d66ee08a4 service nova] Creating event network-vif-plugged:313fdcfd-4ad0-431c-ac44-33c3d015c652 for instance aa5a96da-f885-487e-b6eb-a5bc133e32d2 on n-h1-826529-8 Aug 03 02:10:38.476902 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-194177e4-69ea-4a45-a0eb-793c3727ca04 req-ef24e57f-543a-4d4c-b714-5d3d66ee08a4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078542 Aug 03 02:10:38.477955 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2099/4301] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:38.768758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7ce5ff45-d174-41f7-b001-13433e5b3a6b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:38.769585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7ce5ff45-d174-41f7-b001-13433e5b3a6b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:38.777042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a56103c-c916-45a3-a7e1-8239bf52fa48 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:38.790884 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0a56103c-c916-45a3-a7e1-8239bf52fa48 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1323 microversion: 2.1 time: 0.958270 Aug 03 02:10:38.791540 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2203/4302] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:37 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1323 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:38.803160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ce5ff45-d174-41f7-b001-13433e5b3a6b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:38.803936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ce5ff45-d174-41f7-b001-13433e5b3a6b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:38.806669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ce5ff45-d174-41f7-b001-13433e5b3a6b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:38.821852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ce5ff45-d174-41f7-b001-13433e5b3a6b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:38.825210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:39.824629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-50f8b817-d0de-42b7-91bd-58fe253eb581 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:39.825481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-50f8b817-d0de-42b7-91bd-58fe253eb581 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:39.851096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50f8b817-d0de-42b7-91bd-58fe253eb581 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:39.851545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50f8b817-d0de-42b7-91bd-58fe253eb581 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:39.852369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50f8b817-d0de-42b7-91bd-58fe253eb581 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:39.852825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50f8b817-d0de-42b7-91bd-58fe253eb581 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:39.956601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7ce5ff45-d174-41f7-b001-13433e5b3a6b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:39.979134 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7ce5ff45-d174-41f7-b001-13433e5b3a6b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1512 microversion: 2.1 time: 1.215673 Aug 03 02:10:39.993980 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2100/4303] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:38 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1512 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:40.023813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2059951782", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "72d6d8cb-26a0-4b26-bf96-96bbab6d5737"}], "key_name": "tempest-TestNetworkBasicOps-2045307261", "security_groups": [{"name": "tempest-secgroup-smoke-1487334938"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:40.357660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] validate_networks() for [('72d6d8cb-26a0-4b26-bf96-96bbab6d5737', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:10:40.698921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-50f8b817-d0de-42b7-91bd-58fe253eb581 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:40.736019 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-50f8b817-d0de-42b7-91bd-58fe253eb581 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1323 microversion: 2.1 time: 0.900699 Aug 03 02:10:40.746486 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2204/4304] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:39 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1323 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:41.018755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5316aefa-da62-40a4-b774-0efe0f6a1c3d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:41.019443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5316aefa-da62-40a4-b774-0efe0f6a1c3d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:41.028690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5316aefa-da62-40a4-b774-0efe0f6a1c3d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:41.029575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5316aefa-da62-40a4-b774-0efe0f6a1c3d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:41.032259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5316aefa-da62-40a4-b774-0efe0f6a1c3d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:41.033236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5316aefa-da62-40a4-b774-0efe0f6a1c3d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:41.921770 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5316aefa-da62-40a4-b774-0efe0f6a1c3d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:41.932690 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5316aefa-da62-40a4-b774-0efe0f6a1c3d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1489 microversion: 2.1 time: 0.919060 Aug 03 02:10:41.937792 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2205/4305] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:41 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1489 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:41.961964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fcef882c-6072-41b0-b3f0-1ea91f777f8b tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:41.965739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fcef882c-6072-41b0-b3f0-1ea91f777f8b tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:41.999643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fcef882c-6072-41b0-b3f0-1ea91f777f8b tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:42.006282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fcef882c-6072-41b0-b3f0-1ea91f777f8b tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:42.010368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fcef882c-6072-41b0-b3f0-1ea91f777f8b tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:42.013727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fcef882c-6072-41b0-b3f0-1ea91f777f8b tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:42.529832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:10:42.531338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:10:42.531983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:10:42.532502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:10:42.533198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:10:42.544980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:42.550001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:42.551738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:42.552266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:42.580513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Getting quotas for project f90284be975b4e459cdc3e72c1664630. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:10:42.588776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Getting quotas for user c1ab5d1fb4b1453b9ba37a2b1194ec79 and project f90284be975b4e459cdc3e72c1664630. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:10:42.605939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:10:42.608996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:10:42.641966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fcef882c-6072-41b0-b3f0-1ea91f777f8b tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:42.650046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:42.684008 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fcef882c-6072-41b0-b3f0-1ea91f777f8b tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1520 microversion: 2.1 time: 0.741811 Aug 03 02:10:42.688811 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2206/4306] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:41 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1520 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:42.699702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-39479e1a-3e7a-4066-b08d-3c3dbd0f45d3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:42.704592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-39479e1a-3e7a-4066-b08d-3c3dbd0f45d3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:42.739244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39479e1a-3e7a-4066-b08d-3c3dbd0f45d3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:42.739938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39479e1a-3e7a-4066-b08d-3c3dbd0f45d3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:42.741332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39479e1a-3e7a-4066-b08d-3c3dbd0f45d3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:42.741537 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a788e65c-e2fa-4236-bed6-44b1afab277b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.743778 Aug 03 02:10:42.742089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39479e1a-3e7a-4066-b08d-3c3dbd0f45d3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:42.751990 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2101/4307] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:10:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 2751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:10:42.790416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a9193e51-6d27-40c4-8966-2cc7c37758df tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:42.793540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a9193e51-6d27-40c4-8966-2cc7c37758df tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:42.812929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9193e51-6d27-40c4-8966-2cc7c37758df tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:42.818132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9193e51-6d27-40c4-8966-2cc7c37758df tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:42.820114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9193e51-6d27-40c4-8966-2cc7c37758df tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:42.820761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9193e51-6d27-40c4-8966-2cc7c37758df tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:42.839560 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-a9193e51-6d27-40c4-8966-2cc7c37758df tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] HTTP exception thrown: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a9193e51-6d27-40c4-8966-2cc7c37758df tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Request method failure captured: Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da HTTP/1.1 Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dibcUcVaK_83ByI97mmmgLtm8myGL-qUBxJSDDywnZTFWdmJ4ugcSImrtdE6-EJcb1nvxtsYFDGJ6EqDgLpicW4ylAyiohI4tXxqpNsjEc6RKRlVcBb0GrQXtqXJTu3sMEAPcMF1vK8eVo0Kyh_vJ5Lhy2xC8Fe0UgDahL2x0Nw4Cw Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 9fa7b92a26924225842a35fbdf0582be Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestMultiNic-238509208 Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9fa7b92a26924225842a35fbdf0582be", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9fa7b92a26924225842a35fbdf0582be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9fa7b92a26924225842a35fbdf0582be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9fa7b92a26924225842a35fbdf0582be"}]}] Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestMultiNic-238509208 Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 9fa7b92a26924225842a35fbdf0582be Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestMultiNic-238509208 Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestMultiNic-238509208-project Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 37f3ee587f9e4e108351dd67cc6b7796 Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestMultiNic-238509208-project Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '8d8276a9-ef19-47de-9fc3-f2723e39d7da'} Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:10:42.843314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:10:42.849522 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. Aug 03 02:10:42.849522 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:42.849522 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:42.849522 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:42.849522 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:42.849522 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:42.849522 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:42.849522 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:10:42.849522 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:10:42.849522 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. Aug 03 02:10:42.849522 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:42.854871 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-39479e1a-3e7a-4066-b08d-3c3dbd0f45d3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 200 len: 172 microversion: 2.1 time: 0.161872 Aug 03 02:10:42.856684 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2207/4308] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:10:42 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 172 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:42.863333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ce02b48e-eeb2-4271-9d54-12ced3a8f946 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:42.864374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a9193e51-6d27-40c4-8966-2cc7c37758df tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Returning 404 to user: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:10:42.865263 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a9193e51-6d27-40c4-8966-2cc7c37758df tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 404 len: 111 microversion: 2.1 time: 0.117598 Aug 03 02:10:42.866081 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2102/4309] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:10:42 2022] DELETE /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:10:42.868688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ce02b48e-eeb2-4271-9d54-12ced3a8f946 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:42.884844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f68f605b-ae0e-43bb-8c8f-540cfd531e96 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:42.885504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f68f605b-ae0e-43bb-8c8f-540cfd531e96 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:42.895071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce02b48e-eeb2-4271-9d54-12ced3a8f946 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:42.895599 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce02b48e-eeb2-4271-9d54-12ced3a8f946 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:42.899936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce02b48e-eeb2-4271-9d54-12ced3a8f946 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:42.900404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce02b48e-eeb2-4271-9d54-12ced3a8f946 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:42.997672 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-ce02b48e-eeb2-4271-9d54-12ced3a8f946 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] HTTP exception thrown: Action 999 not found Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ce02b48e-eeb2-4271-9d54-12ced3a8f946 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Request method failure captured: Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2/os-instance-actions/999 HTTP/1.1 Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dkK_cSDkXBALeC9Kj7ck2HxDPacH57y_akKwG41t2wZr7S-2pyhqTtyGfg1KNBYd0FB5b0ZPsRlCg-t2yY8_NhgjpdqzeH9EnOUqsDAIpkAbM6RS_pVAg-loZC3YMIHqBu5ayV8bW0aw2AqFRojBpGLlZxmZGYUjQsuEEMKlm1Ljlg Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 200ccac980894bd1b38ff99ed17d72d7 Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-104497859 Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_200ccac980894bd1b38ff99ed17d72d7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/200ccac980894bd1b38ff99ed17d72d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/200ccac980894bd1b38ff99ed17d72d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/200ccac980894bd1b38ff99ed17d72d7"}]}] Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-104497859 Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 200ccac980894bd1b38ff99ed17d72d7 Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-104497859 Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-InstanceActionsNegativeTestJSON-104497859-project Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 17cc626663dd44b0927f5722434551eb Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-104497859-project Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: exception: Action 999 not found Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'server_id': 'aa5a96da-f885-487e-b6eb-a5bc133e32d2', 'id': '999'} Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 03 02:10:43.009581 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.017739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ce02b48e-eeb2-4271-9d54-12ced3a8f946 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Returning 404 to user: Action 999 not found {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:10:43.019796 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ce02b48e-eeb2-4271-9d54-12ced3a8f946 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.160818 Aug 03 02:10:43.027267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f68f605b-ae0e-43bb-8c8f-540cfd531e96 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:43.027728 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2208/4310] 10.222.0.67 () {58 vars in 1308 bytes} [Wed Aug 3 02:10:42 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2/os-instance-actions/999 => generated 66 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:10:43.032994 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f68f605b-ae0e-43bb-8c8f-540cfd531e96 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1249 microversion: 2.1 time: 0.166040 Aug 03 02:10:43.033632 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2103/4311] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:42 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1249 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:43.033939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aa01d99a-9282-499f-bb6f-7dffa398402e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:43.035431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-aa01d99a-9282-499f-bb6f-7dffa398402e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:43.053658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa01d99a-9282-499f-bb6f-7dffa398402e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:43.055454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa01d99a-9282-499f-bb6f-7dffa398402e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:43.057309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa01d99a-9282-499f-bb6f-7dffa398402e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:43.057937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-048edb5a-34f3-474b-a8ad-055241c24779 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:43.058777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-048edb5a-34f3-474b-a8ad-055241c24779 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 8d8276a9-ef19-47de-9fc3-f2723e39d7da] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:43.059150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa01d99a-9282-499f-bb6f-7dffa398402e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:43.092849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-048edb5a-34f3-474b-a8ad-055241c24779 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:43.093271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-048edb5a-34f3-474b-a8ad-055241c24779 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:43.101039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-048edb5a-34f3-474b-a8ad-055241c24779 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:43.101472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-048edb5a-34f3-474b-a8ad-055241c24779 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:43.135907 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-048edb5a-34f3-474b-a8ad-055241c24779 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] HTTP exception thrown: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-048edb5a-34f3-474b-a8ad-055241c24779 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Request method failure captured: Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da HTTP/1.1 Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dibcUcVaK_83ByI97mmmgLtm8myGL-qUBxJSDDywnZTFWdmJ4ugcSImrtdE6-EJcb1nvxtsYFDGJ6EqDgLpicW4ylAyiohI4tXxqpNsjEc6RKRlVcBb0GrQXtqXJTu3sMEAPcMF1vK8eVo0Kyh_vJ5Lhy2xC8Fe0UgDahL2x0Nw4Cw Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 9fa7b92a26924225842a35fbdf0582be Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestMultiNic-238509208 Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9fa7b92a26924225842a35fbdf0582be", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9fa7b92a26924225842a35fbdf0582be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9fa7b92a26924225842a35fbdf0582be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9fa7b92a26924225842a35fbdf0582be"}]}] Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestMultiNic-238509208 Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 9fa7b92a26924225842a35fbdf0582be Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestMultiNic-238509208 Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestMultiNic-238509208-project Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 37f3ee587f9e4e108351dd67cc6b7796 Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestMultiNic-238509208-project Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '8d8276a9-ef19-47de-9fc3-f2723e39d7da'} Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:43.137614 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.145895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:43.145895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:43.145895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:43.145895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:10:43.145895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:10:43.145895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. Aug 03 02:10:43.145895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.145895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-048edb5a-34f3-474b-a8ad-055241c24779 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Returning 404 to user: Instance 8d8276a9-ef19-47de-9fc3-f2723e39d7da could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:10:43.145895 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-048edb5a-34f3-474b-a8ad-055241c24779 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da" status: 404 len: 111 microversion: 2.1 time: 0.104035 Aug 03 02:10:43.145895 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2104/4312] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:43 2022] GET /compute/v2.1/servers/8d8276a9-ef19-47de-9fc3-f2723e39d7da => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:10:43.159071 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0982efea-9452-4a37-9d2e-4828753055d3 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '.version_select at 0x7f5b12869280>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:43.159654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0982efea-9452-4a37-9d2e-4828753055d3 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: 3b5f25cc-092a-48d6-a53a-c61197301c91] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:43.195317 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-0982efea-9452-4a37-9d2e-4828753055d3 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] HTTP exception thrown: Instance 3b5f25cc-092a-48d6-a53a-c61197301c91 could not be found. Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0982efea-9452-4a37-9d2e-4828753055d3 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Request method failure captured: Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/3b5f25cc-092a-48d6-a53a-c61197301c91/os-instance-actions HTTP/1.1 Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dkK_cSDkXBALeC9Kj7ck2HxDPacH57y_akKwG41t2wZr7S-2pyhqTtyGfg1KNBYd0FB5b0ZPsRlCg-t2yY8_NhgjpdqzeH9EnOUqsDAIpkAbM6RS_pVAg-loZC3YMIHqBu5ayV8bW0aw2AqFRojBpGLlZxmZGYUjQsuEEMKlm1Ljlg Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 200ccac980894bd1b38ff99ed17d72d7 Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-104497859 Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_200ccac980894bd1b38ff99ed17d72d7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/200ccac980894bd1b38ff99ed17d72d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/200ccac980894bd1b38ff99ed17d72d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/200ccac980894bd1b38ff99ed17d72d7"}]}] Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-104497859 Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 200ccac980894bd1b38ff99ed17d72d7 Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-104497859 Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-InstanceActionsNegativeTestJSON-104497859-project Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 17cc626663dd44b0927f5722434551eb Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-104497859-project Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 3b5f25cc-092a-48d6-a53a-c61197301c91 could not be found. Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'server_id': '3b5f25cc-092a-48d6-a53a-c61197301c91'} Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b5f25cc-092a-48d6-a53a-c61197301c91 could not be found. Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:10:43.197501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:10:43.201816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b5f25cc-092a-48d6-a53a-c61197301c91 could not be found. Aug 03 02:10:43.201816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.201816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:43.201816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.201816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:43.201816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:43.201816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:43.201816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:10:43.201816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:10:43.201816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b5f25cc-092a-48d6-a53a-c61197301c91 could not be found. Aug 03 02:10:43.201816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.203932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0982efea-9452-4a37-9d2e-4828753055d3 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Returning 404 to user: Instance 3b5f25cc-092a-48d6-a53a-c61197301c91 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:10:43.205018 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0982efea-9452-4a37-9d2e-4828753055d3 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/3b5f25cc-092a-48d6-a53a-c61197301c91/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.058472 Aug 03 02:10:43.206096 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2105/4313] 10.222.0.67 () {58 vars in 1296 bytes} [Wed Aug 3 02:10:43 2022] GET /compute/v2.1/servers/3b5f25cc-092a-48d6-a53a-c61197301c91/os-instance-actions => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:10:43.211242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-02e7fb3f-9a5e-443f-8596-c6c2d6c71ca0 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:43.212177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-02e7fb3f-9a5e-443f-8596-c6c2d6c71ca0 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:43.224953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02e7fb3f-9a5e-443f-8596-c6c2d6c71ca0 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:43.225633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02e7fb3f-9a5e-443f-8596-c6c2d6c71ca0 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:43.226860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02e7fb3f-9a5e-443f-8596-c6c2d6c71ca0 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:43.227571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02e7fb3f-9a5e-443f-8596-c6c2d6c71ca0 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:43.245736 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-02e7fb3f-9a5e-443f-8596-c6c2d6c71ca0 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] HTTP exception thrown: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-02e7fb3f-9a5e-443f-8596-c6c2d6c71ca0 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Request method failure captured: Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 HTTP/1.1 Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dibcUcVaK_83ByI97mmmgLtm8myGL-qUBxJSDDywnZTFWdmJ4ugcSImrtdE6-EJcb1nvxtsYFDGJ6EqDgLpicW4ylAyiohI4tXxqpNsjEc6RKRlVcBb0GrQXtqXJTu3sMEAPcMF1vK8eVo0Kyh_vJ5Lhy2xC8Fe0UgDahL2x0Nw4Cw Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 9fa7b92a26924225842a35fbdf0582be Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestMultiNic-238509208 Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9fa7b92a26924225842a35fbdf0582be", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9fa7b92a26924225842a35fbdf0582be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9fa7b92a26924225842a35fbdf0582be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9fa7b92a26924225842a35fbdf0582be"}]}] Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestMultiNic-238509208 Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 9fa7b92a26924225842a35fbdf0582be Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestMultiNic-238509208 Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestMultiNic-238509208-project Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 37f3ee587f9e4e108351dd67cc6b7796 Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestMultiNic-238509208-project Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '6d8af391-3cba-4d7b-99e3-f3422e79c797'} Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:10:43.248520 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:10:43.252932 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. Aug 03 02:10:43.252932 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.252932 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:43.252932 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.252932 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:43.252932 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:43.252932 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:43.252932 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:10:43.252932 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:10:43.252932 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. Aug 03 02:10:43.252932 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.254718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-02e7fb3f-9a5e-443f-8596-c6c2d6c71ca0 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Returning 404 to user: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:10:43.256058 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-02e7fb3f-9a5e-443f-8596-c6c2d6c71ca0 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 404 len: 111 microversion: 2.1 time: 0.048743 Aug 03 02:10:43.256930 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2106/4314] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:10:43 2022] DELETE /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:10:43.266358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-479d6611-d400-40f8-9182-a53c9577b5b0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:43.268260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-479d6611-d400-40f8-9182-a53c9577b5b0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:43.300093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-479d6611-d400-40f8-9182-a53c9577b5b0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:43.303674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-479d6611-d400-40f8-9182-a53c9577b5b0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:43.305182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-479d6611-d400-40f8-9182-a53c9577b5b0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:43.308140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-479d6611-d400-40f8-9182-a53c9577b5b0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:43.422938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-479d6611-d400-40f8-9182-a53c9577b5b0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:10:43.646073 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-479d6611-d400-40f8-9182-a53c9577b5b0 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "DELETE /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 204 len: 0 microversion: 2.1 time: 0.385570 Aug 03 02:10:43.652858 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2107/4315] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:10:43 2022] DELETE /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:10:43.667108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c8a99986-8a78-489f-8c6c-58ef26812461 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:43.668989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c8a99986-8a78-489f-8c6c-58ef26812461 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] [instance: 6d8af391-3cba-4d7b-99e3-f3422e79c797] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:43.682494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:43.712709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8a99986-8a78-489f-8c6c-58ef26812461 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:43.714988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8a99986-8a78-489f-8c6c-58ef26812461 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:43.726763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8a99986-8a78-489f-8c6c-58ef26812461 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:43.727942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8a99986-8a78-489f-8c6c-58ef26812461 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:43.751025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-aa01d99a-9282-499f-bb6f-7dffa398402e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:43.767432 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-aa01d99a-9282-499f-bb6f-7dffa398402e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.744160 Aug 03 02:10:43.772434 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2209/4316] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:43 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:43.796222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-666bef09-eb27-4ff2-8414-8f6650acfb6d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:43.798232 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-c8a99986-8a78-489f-8c6c-58ef26812461 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] HTTP exception thrown: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. Aug 03 02:10:43.798785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-666bef09-eb27-4ff2-8414-8f6650acfb6d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c8a99986-8a78-489f-8c6c-58ef26812461 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Request method failure captured: Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 HTTP/1.1 Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dibcUcVaK_83ByI97mmmgLtm8myGL-qUBxJSDDywnZTFWdmJ4ugcSImrtdE6-EJcb1nvxtsYFDGJ6EqDgLpicW4ylAyiohI4tXxqpNsjEc6RKRlVcBb0GrQXtqXJTu3sMEAPcMF1vK8eVo0Kyh_vJ5Lhy2xC8Fe0UgDahL2x0Nw4Cw Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 9fa7b92a26924225842a35fbdf0582be Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestMultiNic-238509208 Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9fa7b92a26924225842a35fbdf0582be", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9fa7b92a26924225842a35fbdf0582be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9fa7b92a26924225842a35fbdf0582be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9fa7b92a26924225842a35fbdf0582be"}]}] Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestMultiNic-238509208 Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 9fa7b92a26924225842a35fbdf0582be Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestMultiNic-238509208 Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestMultiNic-238509208-project Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 37f3ee587f9e4e108351dd67cc6b7796 Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestMultiNic-238509208-project Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '6d8af391-3cba-4d7b-99e3-f3422e79c797'} Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:43.815793 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.824075 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:43.824075 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:43.824075 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:43.824075 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:10:43.824075 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:10:43.824075 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. Aug 03 02:10:43.824075 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:10:43.826709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c8a99986-8a78-489f-8c6c-58ef26812461 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] Returning 404 to user: Instance 6d8af391-3cba-4d7b-99e3-f3422e79c797 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:10:43.828655 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c8a99986-8a78-489f-8c6c-58ef26812461 tempest-ServersTestMultiNic-238509208 tempest-ServersTestMultiNic-238509208-project] 10.222.0.67 "GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797" status: 404 len: 111 microversion: 2.1 time: 0.173700 Aug 03 02:10:43.830082 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2108/4317] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:43 2022] GET /compute/v2.1/servers/6d8af391-3cba-4d7b-99e3-f3422e79c797 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:10:43.840364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b4e92dbd-a843-4b21-bac2-1b338d0b6317 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:43.843172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b4e92dbd-a843-4b21-bac2-1b338d0b6317 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:43.850028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-666bef09-eb27-4ff2-8414-8f6650acfb6d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:43.851966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-666bef09-eb27-4ff2-8414-8f6650acfb6d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:43.854224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-666bef09-eb27-4ff2-8414-8f6650acfb6d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:43.855074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-666bef09-eb27-4ff2-8414-8f6650acfb6d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:43.868795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4e92dbd-a843-4b21-bac2-1b338d0b6317 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:43.869778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4e92dbd-a843-4b21-bac2-1b338d0b6317 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:43.872311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4e92dbd-a843-4b21-bac2-1b338d0b6317 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:43.874064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4e92dbd-a843-4b21-bac2-1b338d0b6317 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:44.364513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-666bef09-eb27-4ff2-8414-8f6650acfb6d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:44.371230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b4e92dbd-a843-4b21-bac2-1b338d0b6317 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:44.384605 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b4e92dbd-a843-4b21-bac2-1b338d0b6317 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.552862 Aug 03 02:10:44.385537 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2109/4318] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:43 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:44.401299 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-666bef09-eb27-4ff2-8414-8f6650acfb6d tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1526 microversion: 2.1 time: 0.608165 Aug 03 02:10:44.406415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cfa4e69b-36f6-404b-b3d8-0db7fcf00a74 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:44.406717 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2210/4319] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:43 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1526 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:44.412607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cfa4e69b-36f6-404b-b3d8-0db7fcf00a74 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:44.425025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e9b6b3bc-8f63-4fa9-b530-c1622e333dc7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:44.425942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e9b6b3bc-8f63-4fa9-b530-c1622e333dc7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:44.429178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cfa4e69b-36f6-404b-b3d8-0db7fcf00a74 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:44.429820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cfa4e69b-36f6-404b-b3d8-0db7fcf00a74 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:44.433205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cfa4e69b-36f6-404b-b3d8-0db7fcf00a74 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:44.437653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9b6b3bc-8f63-4fa9-b530-c1622e333dc7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:44.438811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cfa4e69b-36f6-404b-b3d8-0db7fcf00a74 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:44.441709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9b6b3bc-8f63-4fa9-b530-c1622e333dc7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:44.444499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9b6b3bc-8f63-4fa9-b530-c1622e333dc7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:44.446923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9b6b3bc-8f63-4fa9-b530-c1622e333dc7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:44.611542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cfa4e69b-36f6-404b-b3d8-0db7fcf00a74 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:44.649798 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cfa4e69b-36f6-404b-b3d8-0db7fcf00a74 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1245 microversion: 2.1 time: 0.244536 Aug 03 02:10:44.652009 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2110/4320] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:44 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1245 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:44.990800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e9b6b3bc-8f63-4fa9-b530-c1622e333dc7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:45.016862 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e9b6b3bc-8f63-4fa9-b530-c1622e333dc7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.606046 Aug 03 02:10:45.019720 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2211/4321] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:44 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:45.047305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-764b7ee4-6b74-4a6b-bbaf-d79814fc1ddf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:45.048366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-764b7ee4-6b74-4a6b-bbaf-d79814fc1ddf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:45.070510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-764b7ee4-6b74-4a6b-bbaf-d79814fc1ddf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:45.071059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-764b7ee4-6b74-4a6b-bbaf-d79814fc1ddf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:45.073900 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-764b7ee4-6b74-4a6b-bbaf-d79814fc1ddf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:45.074360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-764b7ee4-6b74-4a6b-bbaf-d79814fc1ddf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:45.443948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f9b22614-e026-44ef-ac9e-8482eaef748c tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:45.446625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f9b22614-e026-44ef-ac9e-8482eaef748c tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:45.455413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9b22614-e026-44ef-ac9e-8482eaef748c tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:45.469976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9b22614-e026-44ef-ac9e-8482eaef748c tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:45.473252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9b22614-e026-44ef-ac9e-8482eaef748c tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:45.477878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9b22614-e026-44ef-ac9e-8482eaef748c tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:45.746129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-764b7ee4-6b74-4a6b-bbaf-d79814fc1ddf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:45.764808 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-764b7ee4-6b74-4a6b-bbaf-d79814fc1ddf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.723411 Aug 03 02:10:45.766731 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2111/4322] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:45 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:45.774819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-67d90165-bae3-41c7-84bc-0a7fb4828ec2 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:45.774819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-67d90165-bae3-41c7-84bc-0a7fb4828ec2 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:45.798621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67d90165-bae3-41c7-84bc-0a7fb4828ec2 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:45.800673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67d90165-bae3-41c7-84bc-0a7fb4828ec2 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:45.804421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67d90165-bae3-41c7-84bc-0a7fb4828ec2 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:45.806643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67d90165-bae3-41c7-84bc-0a7fb4828ec2 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:46.101842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-67d90165-bae3-41c7-84bc-0a7fb4828ec2 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:46.114206 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-67d90165-bae3-41c7-84bc-0a7fb4828ec2 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1307 microversion: 2.1 time: 0.344226 Aug 03 02:10:46.115220 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2112/4323] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:45 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1307 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:46.124533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-438413391", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "b4f5b088-c1f1-4118-9137-86481e28c932"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:46.211240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] validate_networks() for [('b4f5b088-c1f1-4118-9137-86481e28c932', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:10:46.367077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f9b22614-e026-44ef-ac9e-8482eaef748c tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:46.378202 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f9b22614-e026-44ef-ac9e-8482eaef748c tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1526 microversion: 2.1 time: 0.939436 Aug 03 02:10:46.379419 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2212/4324] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:45 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1526 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:46.986935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1a94b756-cee0-462b-a1af-c53c8f7620fd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:46.987476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1a94b756-cee0-462b-a1af-c53c8f7620fd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:46.996209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a94b756-cee0-462b-a1af-c53c8f7620fd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:46.997223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a94b756-cee0-462b-a1af-c53c8f7620fd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:46.998365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a94b756-cee0-462b-a1af-c53c8f7620fd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:46.999232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a94b756-cee0-462b-a1af-c53c8f7620fd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:47.151961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-1a94b756-cee0-462b-a1af-c53c8f7620fd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lazy-loading 'services' on Instance uuid a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:10:47.297273 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1a94b756-cee0-462b-a1af-c53c8f7620fd tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments/60129b11-5490-49ce-aa98-4dd3d803c60f" status: 202 len: 0 microversion: 2.1 time: 0.315569 Aug 03 02:10:47.297901 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2213/4325] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:10:46 2022] DELETE /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments/60129b11-5490-49ce-aa98-4dd3d803c60f => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 02:10:47.316197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b850a504-9148-4aa9-8a7f-40b9c1002857 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:47.317808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b850a504-9148-4aa9-8a7f-40b9c1002857 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:47.354340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b850a504-9148-4aa9-8a7f-40b9c1002857 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:47.355330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b850a504-9148-4aa9-8a7f-40b9c1002857 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:47.360521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b850a504-9148-4aa9-8a7f-40b9c1002857 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:47.361638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b850a504-9148-4aa9-8a7f-40b9c1002857 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:47.684549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b850a504-9148-4aa9-8a7f-40b9c1002857 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:47.716484 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b850a504-9148-4aa9-8a7f-40b9c1002857 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1307 microversion: 2.1 time: 0.407814 Aug 03 02:10:47.731000 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2214/4326] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:47 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1307 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:47.731000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d95b5c8a-2ebd-425c-9686-97c999f9f681 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:47.731000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d95b5c8a-2ebd-425c-9686-97c999f9f681 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:47.751181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d95b5c8a-2ebd-425c-9686-97c999f9f681 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:47.751941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d95b5c8a-2ebd-425c-9686-97c999f9f681 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:47.753225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d95b5c8a-2ebd-425c-9686-97c999f9f681 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:47.753760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d95b5c8a-2ebd-425c-9686-97c999f9f681 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:47.798462 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d95b5c8a-2ebd-425c-9686-97c999f9f681 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077856 Aug 03 02:10:47.800010 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2215/4327] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:10:47 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:47.814357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ee22871e-bd5d-4995-bc9d-612bff464f14 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:47.817148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ee22871e-bd5d-4995-bc9d-612bff464f14 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:47.833979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee22871e-bd5d-4995-bc9d-612bff464f14 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:47.834878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee22871e-bd5d-4995-bc9d-612bff464f14 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:47.836686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee22871e-bd5d-4995-bc9d-612bff464f14 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:47.839076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee22871e-bd5d-4995-bc9d-612bff464f14 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:48.471282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ee22871e-bd5d-4995-bc9d-612bff464f14 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:48.479767 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ee22871e-bd5d-4995-bc9d-612bff464f14 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1526 microversion: 2.1 time: 0.677740 Aug 03 02:10:48.480648 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2216/4328] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:47 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1526 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:48.745826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c02971cf-0b90-429b-98b0-c16773f5bfcc tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:48.747233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c02971cf-0b90-429b-98b0-c16773f5bfcc tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:48.761832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c02971cf-0b90-429b-98b0-c16773f5bfcc tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:48.762581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c02971cf-0b90-429b-98b0-c16773f5bfcc tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:48.764305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c02971cf-0b90-429b-98b0-c16773f5bfcc tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:48.765213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c02971cf-0b90-429b-98b0-c16773f5bfcc tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:48.799922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:10:48.801066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:10:48.802067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:10:48.803885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:10:48.806977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:10:48.827459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:48.828301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:48.829415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:48.837179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:48.897221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Getting quotas for project 43ed3dcb7307452b965ee2d303ffaecd. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:10:48.917861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Getting quotas for user c6ac519db80b4ba99d67bd5db59be619 and project 43ed3dcb7307452b965ee2d303ffaecd. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:10:48.936814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:10:48.944379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:10:49.017049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c02971cf-0b90-429b-98b0-c16773f5bfcc tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:49.028507 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c02971cf-0b90-429b-98b0-c16773f5bfcc tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1307 microversion: 2.1 time: 0.288829 Aug 03 02:10:49.047421 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2217/4329] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:48 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1307 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:49.056535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-436603c5-16b5-4a6f-9130-301b2764200a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:49.059242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-436603c5-16b5-4a6f-9130-301b2764200a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:49.066220 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-04dac01f-8ca1-475c-80ab-c38e0ff8d88f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.945320 Aug 03 02:10:49.067032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-436603c5-16b5-4a6f-9130-301b2764200a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:49.067762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-436603c5-16b5-4a6f-9130-301b2764200a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:49.068866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-436603c5-16b5-4a6f-9130-301b2764200a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:49.069552 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-436603c5-16b5-4a6f-9130-301b2764200a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:49.070839 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2113/4330] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:10:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:10:49.113904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-89ea7f4e-1daa-4d7c-8700-01ef252d3465 req-d8c22b77-4a8c-4079-9a66-e1920d57712a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5a96da-f885-487e-b6eb-a5bc133e32d2", "name": "network-vif-deleted", "tag": "313fdcfd-4ad0-431c-ac44-33c3d015c652"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:49.130377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-89ea7f4e-1daa-4d7c-8700-01ef252d3465 req-d8c22b77-4a8c-4079-9a66-e1920d57712a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:49.131026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-89ea7f4e-1daa-4d7c-8700-01ef252d3465 req-d8c22b77-4a8c-4079-9a66-e1920d57712a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:49.159520 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-436603c5-16b5-4a6f-9130-301b2764200a tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110351 Aug 03 02:10:49.163236 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2218/4331] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:10:49 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:49.168714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-18af365b-e9aa-4901-9b54-c57e01ae78e0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:49.175704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-18af365b-e9aa-4901-9b54-c57e01ae78e0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:49.179626 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-89ea7f4e-1daa-4d7c-8700-01ef252d3465 req-d8c22b77-4a8c-4079-9a66-e1920d57712a service nova] Creating event network-vif-deleted:313fdcfd-4ad0-431c-ac44-33c3d015c652 for instance aa5a96da-f885-487e-b6eb-a5bc133e32d2 on n-h1-826529-8 Aug 03 02:10:49.189661 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-89ea7f4e-1daa-4d7c-8700-01ef252d3465 req-d8c22b77-4a8c-4079-9a66-e1920d57712a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111863 Aug 03 02:10:49.196266 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2114/4332] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:49.506141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-140b86d3-9d06-4f78-8622-acc2c4f336a9 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:49.507384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-140b86d3-9d06-4f78-8622-acc2c4f336a9 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:49.527200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-140b86d3-9d06-4f78-8622-acc2c4f336a9 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:49.528488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-140b86d3-9d06-4f78-8622-acc2c4f336a9 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:49.532441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-140b86d3-9d06-4f78-8622-acc2c4f336a9 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:49.533591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-140b86d3-9d06-4f78-8622-acc2c4f336a9 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:49.664794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-140b86d3-9d06-4f78-8622-acc2c4f336a9 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:49.665176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-140b86d3-9d06-4f78-8622-acc2c4f336a9 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:49.665844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-140b86d3-9d06-4f78-8622-acc2c4f336a9 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lazy-loading 'fault' on Instance uuid aa5a96da-f885-487e-b6eb-a5bc133e32d2 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:10:49.863193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-18af365b-e9aa-4901-9b54-c57e01ae78e0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:49.874194 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-18af365b-e9aa-4901-9b54-c57e01ae78e0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1214 microversion: 2.1 time: 0.708117 Aug 03 02:10:49.875144 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2219/4333] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:49 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1214 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:49.879551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-140b86d3-9d06-4f78-8622-acc2c4f336a9 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17cc626663dd44b0927f5722434551eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200ccac980894bd1b38ff99ed17d72d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:49.898893 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-140b86d3-9d06-4f78-8622-acc2c4f336a9 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 200 len: 1313 microversion: 2.1 time: 0.399959 Aug 03 02:10:49.899610 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2115/4334] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:49 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:50.076990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-52bcfe49-1245-4675-b275-8bc0d0d2f724 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:50.081699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-52bcfe49-1245-4675-b275-8bc0d0d2f724 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:50.098343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52bcfe49-1245-4675-b275-8bc0d0d2f724 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:50.100678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52bcfe49-1245-4675-b275-8bc0d0d2f724 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:50.101933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52bcfe49-1245-4675-b275-8bc0d0d2f724 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:50.102598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52bcfe49-1245-4675-b275-8bc0d0d2f724 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:50.190259 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7abd8852-cce4-4716-9781-a1925f8a7984 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:50.197696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7abd8852-cce4-4716-9781-a1925f8a7984 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:50.243211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7abd8852-cce4-4716-9781-a1925f8a7984 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:50.247374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7abd8852-cce4-4716-9781-a1925f8a7984 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:50.248937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7abd8852-cce4-4716-9781-a1925f8a7984 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:50.251790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7abd8852-cce4-4716-9781-a1925f8a7984 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:50.360211 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7abd8852-cce4-4716-9781-a1925f8a7984 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185491 Aug 03 02:10:50.362876 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2116/4335] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:10:50 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:50.803219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-52bcfe49-1245-4675-b275-8bc0d0d2f724 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:50.829957 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-52bcfe49-1245-4675-b275-8bc0d0d2f724 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1375 microversion: 2.1 time: 0.766694 Aug 03 02:10:50.846951 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2220/4336] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:50 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1375 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:50.929356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-61caef96-5778-459b-91e6-31e0750431d2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:50.931261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-61caef96-5778-459b-91e6-31e0750431d2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] [instance: aa5a96da-f885-487e-b6eb-a5bc133e32d2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:50.970445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61caef96-5778-459b-91e6-31e0750431d2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:50.971179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61caef96-5778-459b-91e6-31e0750431d2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:50.975440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61caef96-5778-459b-91e6-31e0750431d2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:50.983554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61caef96-5778-459b-91e6-31e0750431d2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:51.058987 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-61caef96-5778-459b-91e6-31e0750431d2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] HTTP exception thrown: Instance aa5a96da-f885-487e-b6eb-a5bc133e32d2 could not be found. Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-61caef96-5778-459b-91e6-31e0750431d2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Request method failure captured: Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 HTTP/1.1 Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dkK_cSDkXBALeC9Kj7ck2HxDPacH57y_akKwG41t2wZr7S-2pyhqTtyGfg1KNBYd0FB5b0ZPsRlCg-t2yY8_NhgjpdqzeH9EnOUqsDAIpkAbM6RS_pVAg-loZC3YMIHqBu5ayV8bW0aw2AqFRojBpGLlZxmZGYUjQsuEEMKlm1Ljlg Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 200ccac980894bd1b38ff99ed17d72d7 Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-104497859 Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_200ccac980894bd1b38ff99ed17d72d7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/200ccac980894bd1b38ff99ed17d72d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/200ccac980894bd1b38ff99ed17d72d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/200ccac980894bd1b38ff99ed17d72d7"}]}] Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-104497859 Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 200ccac980894bd1b38ff99ed17d72d7 Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-104497859 Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-InstanceActionsNegativeTestJSON-104497859-project Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 17cc626663dd44b0927f5722434551eb Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-104497859-project Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance aa5a96da-f885-487e-b6eb-a5bc133e32d2 could not be found. Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'aa5a96da-f885-487e-b6eb-a5bc133e32d2'} Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5a96da-f885-487e-b6eb-a5bc133e32d2 could not be found. Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5a96da-f885-487e-b6eb-a5bc133e32d2 could not be found. Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:10:51.072689 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:10:51.078379 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:10:51.078379 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:10:51.078379 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:10:51.078379 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:10:51.078379 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:10:51.078379 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:10:51.078379 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5a96da-f885-487e-b6eb-a5bc133e32d2 could not be found. Aug 03 02:10:51.078379 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:10:51.083921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-61caef96-5778-459b-91e6-31e0750431d2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] Returning 404 to user: Instance aa5a96da-f885-487e-b6eb-a5bc133e32d2 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:10:51.091942 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-61caef96-5778-459b-91e6-31e0750431d2 tempest-InstanceActionsNegativeTestJSON-104497859 tempest-InstanceActionsNegativeTestJSON-104497859-project] 10.222.0.67 "GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2" status: 404 len: 111 microversion: 2.1 time: 0.165429 Aug 03 02:10:51.094374 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2221/4337] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:50 2022] GET /compute/v2.1/servers/aa5a96da-f885-487e-b6eb-a5bc133e32d2 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:10:51.345449 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-90f6bcc5-fd0c-409d-88af-ec324138f173 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:51.347098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-90f6bcc5-fd0c-409d-88af-ec324138f173 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:51.376220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dbc7ac1a-bd22-4cce-bb41-fdb2ee704757 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:51.379829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dbc7ac1a-bd22-4cce-bb41-fdb2ee704757 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:51.387595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90f6bcc5-fd0c-409d-88af-ec324138f173 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:51.391357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90f6bcc5-fd0c-409d-88af-ec324138f173 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:51.394995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90f6bcc5-fd0c-409d-88af-ec324138f173 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:51.397861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90f6bcc5-fd0c-409d-88af-ec324138f173 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:51.430553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbc7ac1a-bd22-4cce-bb41-fdb2ee704757 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:51.431235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbc7ac1a-bd22-4cce-bb41-fdb2ee704757 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:51.433836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbc7ac1a-bd22-4cce-bb41-fdb2ee704757 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:51.439198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbc7ac1a-bd22-4cce-bb41-fdb2ee704757 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:51.528221 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dbc7ac1a-bd22-4cce-bb41-fdb2ee704757 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157214 Aug 03 02:10:51.534714 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2222/4338] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:10:51 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:51.831048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-90f6bcc5-fd0c-409d-88af-ec324138f173 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:51.846883 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-90f6bcc5-fd0c-409d-88af-ec324138f173 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1272 microversion: 2.1 time: 0.946171 Aug 03 02:10:51.850869 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2117/4339] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:50 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1272 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:51.875691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d66d84a4-9a9b-4aaf-a885-18120b6e99e8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:51.876943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d66d84a4-9a9b-4aaf-a885-18120b6e99e8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:51.894099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d66d84a4-9a9b-4aaf-a885-18120b6e99e8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:51.895536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d66d84a4-9a9b-4aaf-a885-18120b6e99e8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:51.897385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d66d84a4-9a9b-4aaf-a885-18120b6e99e8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:51.900020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d66d84a4-9a9b-4aaf-a885-18120b6e99e8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:52.542980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-34077d9f-3cfe-4998-b855-880b4ee881e3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:52.545528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-34077d9f-3cfe-4998-b855-880b4ee881e3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:52.566536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34077d9f-3cfe-4998-b855-880b4ee881e3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:52.567469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34077d9f-3cfe-4998-b855-880b4ee881e3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:52.568491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34077d9f-3cfe-4998-b855-880b4ee881e3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:52.569132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34077d9f-3cfe-4998-b855-880b4ee881e3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:52.684565 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-34077d9f-3cfe-4998-b855-880b4ee881e3 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145801 Aug 03 02:10:52.686341 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2118/4340] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:10:52 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:10:52.892289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b4c5192d-fe68-406e-b75b-8432bf47b280 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:52.893443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b4c5192d-fe68-406e-b75b-8432bf47b280 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:52.929222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4c5192d-fe68-406e-b75b-8432bf47b280 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:52.929991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4c5192d-fe68-406e-b75b-8432bf47b280 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:52.933051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4c5192d-fe68-406e-b75b-8432bf47b280 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:52.936719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4c5192d-fe68-406e-b75b-8432bf47b280 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:53.114930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d66d84a4-9a9b-4aaf-a885-18120b6e99e8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:53.132598 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d66d84a4-9a9b-4aaf-a885-18120b6e99e8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1375 microversion: 2.1 time: 1.254975 Aug 03 02:10:53.147957 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2223/4341] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:51 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1375 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:53.521597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b4c5192d-fe68-406e-b75b-8432bf47b280 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:53.553727 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b4c5192d-fe68-406e-b75b-8432bf47b280 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1272 microversion: 2.1 time: 0.677348 Aug 03 02:10:53.568944 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2119/4342] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:52 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1272 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:53.700422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4f550d6a-65d9-4563-a215-1df3f8a87226 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:53.707163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4f550d6a-65d9-4563-a215-1df3f8a87226 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:53.724315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f550d6a-65d9-4563-a215-1df3f8a87226 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:53.731042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f550d6a-65d9-4563-a215-1df3f8a87226 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:53.732830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f550d6a-65d9-4563-a215-1df3f8a87226 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:53.733856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f550d6a-65d9-4563-a215-1df3f8a87226 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:53.842503 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:53.883036 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4f550d6a-65d9-4563-a215-1df3f8a87226 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184784 Aug 03 02:10:53.883715 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2224/4343] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:10:53 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:10:54.163577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0c50f7c4-6b0a-4182-a4c7-26c84c5b0ec6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:54.164209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0c50f7c4-6b0a-4182-a4c7-26c84c5b0ec6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:54.179919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c50f7c4-6b0a-4182-a4c7-26c84c5b0ec6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:54.180922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c50f7c4-6b0a-4182-a4c7-26c84c5b0ec6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:54.186250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c50f7c4-6b0a-4182-a4c7-26c84c5b0ec6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:54.199629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c50f7c4-6b0a-4182-a4c7-26c84c5b0ec6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:54.578788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0b53356f-a73a-4425-847f-252750f98aeb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:54.580419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0b53356f-a73a-4425-847f-252750f98aeb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:54.603600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b53356f-a73a-4425-847f-252750f98aeb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:54.604609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b53356f-a73a-4425-847f-252750f98aeb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:54.609245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b53356f-a73a-4425-847f-252750f98aeb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:54.610820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b53356f-a73a-4425-847f-252750f98aeb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:55.258245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0b53356f-a73a-4425-847f-252750f98aeb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:55.270253 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0b53356f-a73a-4425-847f-252750f98aeb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1272 microversion: 2.1 time: 0.696935 Aug 03 02:10:55.275066 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2225/4344] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:54 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1272 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:55.293635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bb31b329-9ee4-4978-8cdd-f40f96e20d21 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:55.297138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bb31b329-9ee4-4978-8cdd-f40f96e20d21 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:55.317147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0c50f7c4-6b0a-4182-a4c7-26c84c5b0ec6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:55.320680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb31b329-9ee4-4978-8cdd-f40f96e20d21 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:55.321145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb31b329-9ee4-4978-8cdd-f40f96e20d21 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:55.325686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb31b329-9ee4-4978-8cdd-f40f96e20d21 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:55.326787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb31b329-9ee4-4978-8cdd-f40f96e20d21 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:55.332123 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0c50f7c4-6b0a-4182-a4c7-26c84c5b0ec6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1375 microversion: 2.1 time: 1.172527 Aug 03 02:10:55.363101 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2120/4345] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:54 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1375 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:55.405747 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bb31b329-9ee4-4978-8cdd-f40f96e20d21 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126571 Aug 03 02:10:55.410506 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2226/4346] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:10:55 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:10:56.312826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b531da77-3941-4954-ae87-661ae6fcd1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:56.313483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b531da77-3941-4954-ae87-661ae6fcd1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:56.320962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b531da77-3941-4954-ae87-661ae6fcd1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:56.321719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b531da77-3941-4954-ae87-661ae6fcd1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:56.322314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b531da77-3941-4954-ae87-661ae6fcd1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:56.322797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b531da77-3941-4954-ae87-661ae6fcd1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:56.344971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:56.388106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-19b14cf6-efc5-4bf0-a98b-d81fee6c2834 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:56.389452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-19b14cf6-efc5-4bf0-a98b-d81fee6c2834 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:56.396143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19b14cf6-efc5-4bf0-a98b-d81fee6c2834 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:56.396890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19b14cf6-efc5-4bf0-a98b-d81fee6c2834 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:56.397690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19b14cf6-efc5-4bf0-a98b-d81fee6c2834 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:56.398135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19b14cf6-efc5-4bf0-a98b-d81fee6c2834 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:56.548265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b531da77-3941-4954-ae87-661ae6fcd1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:56.564562 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b531da77-3941-4954-ae87-661ae6fcd1ee tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1272 microversion: 2.1 time: 0.256063 Aug 03 02:10:56.578346 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2121/4347] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:56 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1272 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:56.585467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-535f85e7-065b-4479-8332-060d2c388770 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:56.589828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-535f85e7-065b-4479-8332-060d2c388770 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:56.597204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-535f85e7-065b-4479-8332-060d2c388770 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:56.597687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-535f85e7-065b-4479-8332-060d2c388770 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:56.599032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-535f85e7-065b-4479-8332-060d2c388770 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:56.599494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-535f85e7-065b-4479-8332-060d2c388770 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:56.641788 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-535f85e7-065b-4479-8332-060d2c388770 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061834 Aug 03 02:10:56.643091 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2122/4348] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:10:56 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:10:56.655428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-59be3104-e69d-45e1-8def-3045de6bc596 req-08e80e9f-8ef6-45cb-b132-01812300eefd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ed61492-84f4-4825-9ac8-4d13e3f52bd7", "tag": "eb32816b-ff25-406e-9a72-c85290dc832f"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:10:56.667103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-59be3104-e69d-45e1-8def-3045de6bc596 req-08e80e9f-8ef6-45cb-b132-01812300eefd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:56.667798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-59be3104-e69d-45e1-8def-3045de6bc596 req-08e80e9f-8ef6-45cb-b132-01812300eefd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:56.688587 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-59be3104-e69d-45e1-8def-3045de6bc596 req-08e80e9f-8ef6-45cb-b132-01812300eefd service nova] Creating event network-changed:eb32816b-ff25-406e-9a72-c85290dc832f for instance 2ed61492-84f4-4825-9ac8-4d13e3f52bd7 on n-h2-826529-8 Aug 03 02:10:56.695887 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-59be3104-e69d-45e1-8def-3045de6bc596 req-08e80e9f-8ef6-45cb-b132-01812300eefd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045701 Aug 03 02:10:56.696869 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2123/4349] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:10:56.754561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6802833b-cbc0-4e08-b67a-e47f27f519de tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:56.755811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6802833b-cbc0-4e08-b67a-e47f27f519de tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:56.769021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6802833b-cbc0-4e08-b67a-e47f27f519de tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:56.769917 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6802833b-cbc0-4e08-b67a-e47f27f519de tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:56.771414 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6802833b-cbc0-4e08-b67a-e47f27f519de tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:56.772305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6802833b-cbc0-4e08-b67a-e47f27f519de tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:56.812855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6802833b-cbc0-4e08-b67a-e47f27f519de tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:10:56.918380 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6802833b-cbc0-4e08-b67a-e47f27f519de tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 204 len: 0 microversion: 2.1 time: 0.175015 Aug 03 02:10:56.920130 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2124/4350] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:10:56 2022] DELETE /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:10:56.933591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-913b635d-e2fb-4c35-93f6-6b1ed9310095 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:56.937085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-913b635d-e2fb-4c35-93f6-6b1ed9310095 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:56.948054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-913b635d-e2fb-4c35-93f6-6b1ed9310095 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:56.949936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-913b635d-e2fb-4c35-93f6-6b1ed9310095 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:56.952505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-913b635d-e2fb-4c35-93f6-6b1ed9310095 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:56.953725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-913b635d-e2fb-4c35-93f6-6b1ed9310095 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:57.256825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-19b14cf6-efc5-4bf0-a98b-d81fee6c2834 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:57.270537 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-19b14cf6-efc5-4bf0-a98b-d81fee6c2834 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1375 microversion: 2.1 time: 0.885942 Aug 03 02:10:57.271501 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2227/4351] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:56 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1375 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:57.596229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4828ef9-652d-47c0-8377-5b98a8030f9c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:57.597028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f4828ef9-652d-47c0-8377-5b98a8030f9c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:57.605142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4828ef9-652d-47c0-8377-5b98a8030f9c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:57.606357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4828ef9-652d-47c0-8377-5b98a8030f9c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:57.607692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4828ef9-652d-47c0-8377-5b98a8030f9c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:57.608659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4828ef9-652d-47c0-8377-5b98a8030f9c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:57.798791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f4828ef9-652d-47c0-8377-5b98a8030f9c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:57.807164 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f4828ef9-652d-47c0-8377-5b98a8030f9c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1272 microversion: 2.1 time: 0.216052 Aug 03 02:10:57.808083 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2228/4352] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:57 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:57.976445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-913b635d-e2fb-4c35-93f6-6b1ed9310095 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:57.992530 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-913b635d-e2fb-4c35-93f6-6b1ed9310095 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 200 len: 1681 microversion: 2.1 time: 1.065166 Aug 03 02:10:57.994305 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2125/4353] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:56 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 1681 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:58.308957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-51c33ca5-16e1-42d3-a6fb-180447f074a4 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:58.311553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-51c33ca5-16e1-42d3-a6fb-180447f074a4 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:58.346047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:58.353878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51c33ca5-16e1-42d3-a6fb-180447f074a4 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:58.360632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51c33ca5-16e1-42d3-a6fb-180447f074a4 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:58.361942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51c33ca5-16e1-42d3-a6fb-180447f074a4 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:58.362666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51c33ca5-16e1-42d3-a6fb-180447f074a4 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:58.829695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cf55971a-e5bf-415c-b182-eb06e5a73356 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:58.830478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cf55971a-e5bf-415c-b182-eb06e5a73356 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:58.835676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:58.842704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf55971a-e5bf-415c-b182-eb06e5a73356 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:58.843569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf55971a-e5bf-415c-b182-eb06e5a73356 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:58.845090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf55971a-e5bf-415c-b182-eb06e5a73356 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:58.845662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf55971a-e5bf-415c-b182-eb06e5a73356 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:58.866878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:58.928984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=14 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:10:59.042998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-51c33ca5-16e1-42d3-a6fb-180447f074a4 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:59.060030 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-51c33ca5-16e1-42d3-a6fb-180447f074a4 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1375 microversion: 2.1 time: 0.755932 Aug 03 02:10:59.078358 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2229/4354] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:58 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1375 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:10:59.090516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-35f44a46-665f-40ed-b61d-2d0377570329 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:10:59.092225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-35f44a46-665f-40ed-b61d-2d0377570329 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:10:59.100838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35f44a46-665f-40ed-b61d-2d0377570329 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:59.101507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35f44a46-665f-40ed-b61d-2d0377570329 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:59.102407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35f44a46-665f-40ed-b61d-2d0377570329 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:10:59.103090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35f44a46-665f-40ed-b61d-2d0377570329 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:10:59.423617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cf55971a-e5bf-415c-b182-eb06e5a73356 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:10:59.437617 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cf55971a-e5bf-415c-b182-eb06e5a73356 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1314 microversion: 2.1 time: 0.612880 Aug 03 02:10:59.443052 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2126/4355] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:58 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:10:59.867778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:11:00.084905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e586dc08-7a1d-423c-ad55-df50402879e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:00.085526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e586dc08-7a1d-423c-ad55-df50402879e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:00.099775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e586dc08-7a1d-423c-ad55-df50402879e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:00.104960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e586dc08-7a1d-423c-ad55-df50402879e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:00.106241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e586dc08-7a1d-423c-ad55-df50402879e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:00.107678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e586dc08-7a1d-423c-ad55-df50402879e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:00.183954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-35f44a46-665f-40ed-b61d-2d0377570329 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:00.208745 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-35f44a46-665f-40ed-b61d-2d0377570329 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 200 len: 1681 microversion: 2.1 time: 1.126036 Aug 03 02:11:00.209806 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2230/4356] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:10:59 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 1681 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:00.458225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-514ad514-95b6-48c6-b492-65ef7f2312bb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:00.459162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-514ad514-95b6-48c6-b492-65ef7f2312bb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:00.473416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-514ad514-95b6-48c6-b492-65ef7f2312bb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:00.473891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-514ad514-95b6-48c6-b492-65ef7f2312bb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:00.474703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-514ad514-95b6-48c6-b492-65ef7f2312bb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:00.475391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-514ad514-95b6-48c6-b492-65ef7f2312bb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:01.175274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e586dc08-7a1d-423c-ad55-df50402879e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:01.188237 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e586dc08-7a1d-423c-ad55-df50402879e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1375 microversion: 2.1 time: 1.107188 Aug 03 02:11:01.207438 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2127/4357] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:00 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1375 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:11:01.225798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-71580823-713f-4396-a574-d48434e7001f req-99d49bb9-bcac-4ed0-9d42-b1e5a8cdcbdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b", "name": "network-vif-deleted", "tag": "bee916fb-a434-4739-ac37-90caaee0b3c4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:01.243008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-71580823-713f-4396-a574-d48434e7001f req-99d49bb9-bcac-4ed0-9d42-b1e5a8cdcbdc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:01.249718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-71580823-713f-4396-a574-d48434e7001f req-99d49bb9-bcac-4ed0-9d42-b1e5a8cdcbdc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:01.274601 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-71580823-713f-4396-a574-d48434e7001f req-99d49bb9-bcac-4ed0-9d42-b1e5a8cdcbdc service nova] Creating event network-vif-deleted:bee916fb-a434-4739-ac37-90caaee0b3c4 for instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b on n-h1-826529-8 Aug 03 02:11:01.290235 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-71580823-713f-4396-a574-d48434e7001f req-99d49bb9-bcac-4ed0-9d42-b1e5a8cdcbdc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068259 Aug 03 02:11:01.290868 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2128/4358] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:11:01.303332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-327253d5-375a-4296-87bd-6a8586d49d5c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:01.313146 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-327253d5-375a-4296-87bd-6a8586d49d5c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:01.328078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-327253d5-375a-4296-87bd-6a8586d49d5c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:01.332110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-327253d5-375a-4296-87bd-6a8586d49d5c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:01.334375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-327253d5-375a-4296-87bd-6a8586d49d5c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:01.338540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-327253d5-375a-4296-87bd-6a8586d49d5c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:01.453854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-514ad514-95b6-48c6-b492-65ef7f2312bb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:01.481415 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-514ad514-95b6-48c6-b492-65ef7f2312bb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1314 microversion: 2.1 time: 1.027035 Aug 03 02:11:01.486374 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2231/4359] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:00 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1314 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:01.699581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-327253d5-375a-4296-87bd-6a8586d49d5c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c1fb7af331344dcb26c43368a9daa6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5bc12da9a94f63bb71700bd01cf416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:01.717406 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-327253d5-375a-4296-87bd-6a8586d49d5c tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 200 len: 1326 microversion: 2.1 time: 0.418833 Aug 03 02:11:01.718713 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2129/4360] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:01 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 1326 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:02.213205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-30927705-049c-4e40-96e0-ee2053467934 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:02.213921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-30927705-049c-4e40-96e0-ee2053467934 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:02.224380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30927705-049c-4e40-96e0-ee2053467934 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:02.236335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30927705-049c-4e40-96e0-ee2053467934 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:02.240575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30927705-049c-4e40-96e0-ee2053467934 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:02.241590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30927705-049c-4e40-96e0-ee2053467934 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:02.508052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-de85aaaf-5aee-4119-9e31-9e96be8bda73 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:02.508726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-de85aaaf-5aee-4119-9e31-9e96be8bda73 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:02.526772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de85aaaf-5aee-4119-9e31-9e96be8bda73 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:02.527570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de85aaaf-5aee-4119-9e31-9e96be8bda73 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:02.528589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de85aaaf-5aee-4119-9e31-9e96be8bda73 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:02.529283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de85aaaf-5aee-4119-9e31-9e96be8bda73 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:03.601082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-30927705-049c-4e40-96e0-ee2053467934 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:03.615894 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-30927705-049c-4e40-96e0-ee2053467934 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1375 microversion: 2.1 time: 1.409230 Aug 03 02:11:03.617152 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2232/4361] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:02 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1375 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:03.625082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8e25622d-ce46-4923-9715-15450dd9ed3d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:03.626159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8e25622d-ce46-4923-9715-15450dd9ed3d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:03.637446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e25622d-ce46-4923-9715-15450dd9ed3d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:03.640264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e25622d-ce46-4923-9715-15450dd9ed3d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:03.642887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e25622d-ce46-4923-9715-15450dd9ed3d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:03.643745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e25622d-ce46-4923-9715-15450dd9ed3d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:03.672510 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-8e25622d-ce46-4923-9715-15450dd9ed3d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] HTTP exception thrown: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8e25622d-ce46-4923-9715-15450dd9ed3d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Request method failure captured: Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b HTTP/1.1 Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dc0-Ae8If7bfOWI7RRBvc1phU63xlLSU5btj5ety_8fStzHcWU-vXHDYz4xfjE-ye9BJl2yypV_nSYHeeO1JR8qxTOON-NMvFY2KC116gH7mE5fGt58cYvDLyGtxXNTQSJt4xclgIAdKb4vD1HYJAxEQ3OrVusgb2MtJ9SsttIsaGA Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a5bc12da9a94f63bb71700bd01cf416", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}] Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4c1fb7af331344dcb26c43368a9daa6e Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b'} Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:03.674421 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:03.679015 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:03.679015 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:03.679015 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:03.679015 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:03.679015 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:03.679015 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. Aug 03 02:11:03.679015 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:03.680987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8e25622d-ce46-4923-9715-15450dd9ed3d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Returning 404 to user: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:03.682281 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8e25622d-ce46-4923-9715-15450dd9ed3d tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 404 len: 111 microversion: 2.1 time: 0.063740 Aug 03 02:11:03.683105 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2233/4362] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:03 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:11:03.693117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-645929ae-cbfa-4393-83ab-290a094623e7 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '.version_select at 0x7f5b12940160>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:03.719892 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-645929ae-cbfa-4393-83ab-290a094623e7 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-234060522" status: 202 len: 0 microversion: 2.1 time: 0.030468 Aug 03 02:11:03.724892 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2234/4363] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 3 02:11:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-234060522 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:11:03.925043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-809cd187-bb16-4954-b1bd-9e11ee66321c req-271d7c99-debb-4ece-b809-178518e55214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af53bd56-06e6-4d0d-a71c-e2c35f0584a1", "tag": "05a73520-43b1-4015-bfc2-bdf5b241f69c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:03.940257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-809cd187-bb16-4954-b1bd-9e11ee66321c req-271d7c99-debb-4ece-b809-178518e55214 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:03.941117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-809cd187-bb16-4954-b1bd-9e11ee66321c req-271d7c99-debb-4ece-b809-178518e55214 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:03.958686 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-809cd187-bb16-4954-b1bd-9e11ee66321c req-271d7c99-debb-4ece-b809-178518e55214 service nova] Creating event network-changed:05a73520-43b1-4015-bfc2-bdf5b241f69c for instance af53bd56-06e6-4d0d-a71c-e2c35f0584a1 on n-h1-826529-8 Aug 03 02:11:03.985393 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-809cd187-bb16-4954-b1bd-9e11ee66321c req-271d7c99-debb-4ece-b809-178518e55214 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067827 Aug 03 02:11:03.987157 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2235/4364] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:11:04.169097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-de85aaaf-5aee-4119-9e31-9e96be8bda73 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:04.182702 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-de85aaaf-5aee-4119-9e31-9e96be8bda73 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1314 microversion: 2.1 time: 1.678692 Aug 03 02:11:04.201935 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2130/4365] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:02 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1314 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:04.647981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cada9a59-dcd9-437a-9fae-0a88ff1724b8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:04.649484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cada9a59-dcd9-437a-9fae-0a88ff1724b8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:04.667145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cada9a59-dcd9-437a-9fae-0a88ff1724b8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:04.667884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cada9a59-dcd9-437a-9fae-0a88ff1724b8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:04.670406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cada9a59-dcd9-437a-9fae-0a88ff1724b8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:04.671114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cada9a59-dcd9-437a-9fae-0a88ff1724b8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:05.209446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5f5f7b90-9033-4ee9-82ea-66ddf29090bf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:05.210223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5f5f7b90-9033-4ee9-82ea-66ddf29090bf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:05.222959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f5f7b90-9033-4ee9-82ea-66ddf29090bf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:05.223398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f5f7b90-9033-4ee9-82ea-66ddf29090bf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:05.224503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f5f7b90-9033-4ee9-82ea-66ddf29090bf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:05.224640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f5f7b90-9033-4ee9-82ea-66ddf29090bf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:05.618206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cada9a59-dcd9-437a-9fae-0a88ff1724b8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:05.632168 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cada9a59-dcd9-437a-9fae-0a88ff1724b8 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1375 microversion: 2.1 time: 0.990760 Aug 03 02:11:05.643789 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2236/4366] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:04 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1375 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:05.889664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5f5f7b90-9033-4ee9-82ea-66ddf29090bf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:05.916193 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5f5f7b90-9033-4ee9-82ea-66ddf29090bf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1314 microversion: 2.1 time: 0.711162 Aug 03 02:11:05.917778 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2131/4367] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:05 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:06.542637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-9db0c646-be1d-453e-8bd1-59c33204eec2 req-1980d27c-6d3c-4a25-b0f7-388cc05a4ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed61492-84f4-4825-9ac8-4d13e3f52bd7", "name": "network-vif-plugged", "status": "completed", "tag": "eb32816b-ff25-406e-9a72-c85290dc832f"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:06.563121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9db0c646-be1d-453e-8bd1-59c33204eec2 req-1980d27c-6d3c-4a25-b0f7-388cc05a4ff6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:06.563979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9db0c646-be1d-453e-8bd1-59c33204eec2 req-1980d27c-6d3c-4a25-b0f7-388cc05a4ff6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:06.584744 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-9db0c646-be1d-453e-8bd1-59c33204eec2 req-1980d27c-6d3c-4a25-b0f7-388cc05a4ff6 service nova] Creating event network-vif-plugged:eb32816b-ff25-406e-9a72-c85290dc832f for instance 2ed61492-84f4-4825-9ac8-4d13e3f52bd7 on n-h2-826529-8 Aug 03 02:11:06.599459 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-9db0c646-be1d-453e-8bd1-59c33204eec2 req-1980d27c-6d3c-4a25-b0f7-388cc05a4ff6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075987 Aug 03 02:11:06.601730 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2237/4368] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:11:06.684201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2a6846d4-ae50-4ccd-9b82-d490a01e0f30 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:06.686764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2a6846d4-ae50-4ccd-9b82-d490a01e0f30 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:06.732962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a6846d4-ae50-4ccd-9b82-d490a01e0f30 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:06.736361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a6846d4-ae50-4ccd-9b82-d490a01e0f30 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:06.737536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a6846d4-ae50-4ccd-9b82-d490a01e0f30 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:06.738740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a6846d4-ae50-4ccd-9b82-d490a01e0f30 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:06.960828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d194f215-ea8a-414b-9c9a-7f3d44f0b747 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:06.961675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d194f215-ea8a-414b-9c9a-7f3d44f0b747 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:06.986995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d194f215-ea8a-414b-9c9a-7f3d44f0b747 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:06.987522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d194f215-ea8a-414b-9c9a-7f3d44f0b747 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:06.988416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d194f215-ea8a-414b-9c9a-7f3d44f0b747 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:06.988928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d194f215-ea8a-414b-9c9a-7f3d44f0b747 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:08.303923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2a6846d4-ae50-4ccd-9b82-d490a01e0f30 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:08.321111 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2a6846d4-ae50-4ccd-9b82-d490a01e0f30 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1375 microversion: 2.1 time: 1.641986 Aug 03 02:11:08.321759 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2132/4369] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:06 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1375 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:11:08.610752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d194f215-ea8a-414b-9c9a-7f3d44f0b747 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:08.640918 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d194f215-ea8a-414b-9c9a-7f3d44f0b747 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1314 microversion: 2.1 time: 1.686156 Aug 03 02:11:08.644512 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2238/4370] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:06 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1314 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:09.344878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8d3a39ec-b8fb-4ee2-adda-bae3a40a0035 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:09.345520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8d3a39ec-b8fb-4ee2-adda-bae3a40a0035 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:09.355676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d3a39ec-b8fb-4ee2-adda-bae3a40a0035 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:09.358890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d3a39ec-b8fb-4ee2-adda-bae3a40a0035 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:09.361930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d3a39ec-b8fb-4ee2-adda-bae3a40a0035 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:09.363708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d3a39ec-b8fb-4ee2-adda-bae3a40a0035 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:09.664366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1842433516", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "5582670a-5513-4687-a4be-2162f4c8688b"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:09.822752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] validate_networks() for [('5582670a-5513-4687-a4be-2162f4c8688b', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:11:10.623463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8d3a39ec-b8fb-4ee2-adda-bae3a40a0035 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:10.643028 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8d3a39ec-b8fb-4ee2-adda-bae3a40a0035 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1375 microversion: 2.1 time: 1.302959 Aug 03 02:11:10.652788 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2239/4371] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:09 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1375 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:10.673110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e134edf7-96f5-4ac3-9241-d6bada42362b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:10.679986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e134edf7-96f5-4ac3-9241-d6bada42362b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:10.691727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e134edf7-96f5-4ac3-9241-d6bada42362b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:10.703039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e134edf7-96f5-4ac3-9241-d6bada42362b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:10.705118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e134edf7-96f5-4ac3-9241-d6bada42362b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:10.706008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e134edf7-96f5-4ac3-9241-d6bada42362b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:12.071652 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e134edf7-96f5-4ac3-9241-d6bada42362b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:12.087541 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e134edf7-96f5-4ac3-9241-d6bada42362b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1314 microversion: 2.1 time: 1.430214 Aug 03 02:11:12.090732 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2240/4372] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:10 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1314 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:12.103127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-950da6d9-145b-42a0-bd39-98ac4e88d0d0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:12.114553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-950da6d9-145b-42a0-bd39-98ac4e88d0d0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:12.149729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-950da6d9-145b-42a0-bd39-98ac4e88d0d0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:12.150199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-950da6d9-145b-42a0-bd39-98ac4e88d0d0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:12.151114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-950da6d9-145b-42a0-bd39-98ac4e88d0d0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:12.151478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-950da6d9-145b-42a0-bd39-98ac4e88d0d0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:12.473547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-950da6d9-145b-42a0-bd39-98ac4e88d0d0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:12.487650 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-950da6d9-145b-42a0-bd39-98ac4e88d0d0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1546 microversion: 2.1 time: 0.395038 Aug 03 02:11:12.488275 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2241/4373] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:12 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1546 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:12.513513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ade66402-76b3-4701-a639-3a0539717686 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:12.514287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ade66402-76b3-4701-a639-3a0539717686 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:12.544688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ade66402-76b3-4701-a639-3a0539717686 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:12.545280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ade66402-76b3-4701-a639-3a0539717686 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:12.546111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ade66402-76b3-4701-a639-3a0539717686 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:12.546565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ade66402-76b3-4701-a639-3a0539717686 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:12.671246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:11:12.672452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:11:12.673153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:11:12.673595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:11:12.674031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:11:12.698181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:12.698649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:12.703681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:12.704420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:12.762519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Getting quotas for project 4368b80ba680454aa4000902157f20f9. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:11:12.780912 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Getting quotas for user 33f1e10b841a4b7988ac28fac1b01673 and project 4368b80ba680454aa4000902157f20f9. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:11:12.815633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:11:12.827135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:11:12.941310 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-16c150a8-8c66-411d-acc5-a8cec704d01e tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.633329 Aug 03 02:11:12.950973 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2133/4374] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:11:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:11:12.962473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-709c494e-4db5-4ea9-8eff-e192239a7f40 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:12.968872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-709c494e-4db5-4ea9-8eff-e192239a7f40 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:13.310849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-709c494e-4db5-4ea9-8eff-e192239a7f40 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f1e10b841a4b7988ac28fac1b01673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4368b80ba680454aa4000902157f20f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:13.337917 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-709c494e-4db5-4ea9-8eff-e192239a7f40 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 200 len: 1224 microversion: 2.1 time: 0.384098 Aug 03 02:11:13.340164 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2134/4375] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:12 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 1224 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:13.359841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-17961016-3ca2-444a-be13-278f4d667b21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:13.360960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-17961016-3ca2-444a-be13-278f4d667b21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:13.363954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ade66402-76b3-4701-a639-3a0539717686 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:13.370695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17961016-3ca2-444a-be13-278f4d667b21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:13.371569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17961016-3ca2-444a-be13-278f4d667b21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:13.372883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17961016-3ca2-444a-be13-278f4d667b21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:13.373740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17961016-3ca2-444a-be13-278f4d667b21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:13.377841 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ade66402-76b3-4701-a639-3a0539717686 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1546 microversion: 2.1 time: 0.868715 Aug 03 02:11:13.394362 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2242/4376] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:12 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1546 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:11:14.003260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-17961016-3ca2-444a-be13-278f4d667b21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:14.032166 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-17961016-3ca2-444a-be13-278f4d667b21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1314 microversion: 2.1 time: 0.676328 Aug 03 02:11:14.032265 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2135/4377] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:13 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:14.239449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a80f1222-b403-40ec-80ed-415d29a28d4b req-128e20b8-7a31-4d5a-bfdf-ec5623e3bad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af53bd56-06e6-4d0d-a71c-e2c35f0584a1", "name": "network-vif-plugged", "status": "completed", "tag": "05a73520-43b1-4015-bfc2-bdf5b241f69c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:14.267514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a80f1222-b403-40ec-80ed-415d29a28d4b req-128e20b8-7a31-4d5a-bfdf-ec5623e3bad9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:14.277055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a80f1222-b403-40ec-80ed-415d29a28d4b req-128e20b8-7a31-4d5a-bfdf-ec5623e3bad9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:14.317062 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a80f1222-b403-40ec-80ed-415d29a28d4b req-128e20b8-7a31-4d5a-bfdf-ec5623e3bad9 service nova] Creating event network-vif-plugged:05a73520-43b1-4015-bfc2-bdf5b241f69c for instance af53bd56-06e6-4d0d-a71c-e2c35f0584a1 on n-h1-826529-8 Aug 03 02:11:14.328871 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a80f1222-b403-40ec-80ed-415d29a28d4b req-128e20b8-7a31-4d5a-bfdf-ec5623e3bad9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093056 Aug 03 02:11:14.334484 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2243/4378] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:11:14.362687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-526a21ea-3f19-42c4-a0c5-5d8abd8bf117 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:14.364210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-526a21ea-3f19-42c4-a0c5-5d8abd8bf117 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:14.384928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-526a21ea-3f19-42c4-a0c5-5d8abd8bf117 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:14.386606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-526a21ea-3f19-42c4-a0c5-5d8abd8bf117 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:14.389113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-526a21ea-3f19-42c4-a0c5-5d8abd8bf117 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:14.390634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-526a21ea-3f19-42c4-a0c5-5d8abd8bf117 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:14.744600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-13ba428d-2489-4a96-9473-9a4e697cabef tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:14.745407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-13ba428d-2489-4a96-9473-9a4e697cabef tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:14.770540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13ba428d-2489-4a96-9473-9a4e697cabef tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:14.772287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13ba428d-2489-4a96-9473-9a4e697cabef tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:14.777998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13ba428d-2489-4a96-9473-9a4e697cabef tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:14.779724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13ba428d-2489-4a96-9473-9a4e697cabef tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:14.846095 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-13ba428d-2489-4a96-9473-9a4e697cabef tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] HTTP exception thrown: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-13ba428d-2489-4a96-9473-9a4e697cabef tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Request method failure captured: Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b HTTP/1.1 Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dc0-Ae8If7bfOWI7RRBvc1phU63xlLSU5btj5ety_8fStzHcWU-vXHDYz4xfjE-ye9BJl2yypV_nSYHeeO1JR8qxTOON-NMvFY2KC116gH7mE5fGt58cYvDLyGtxXNTQSJt4xclgIAdKb4vD1HYJAxEQ3OrVusgb2MtJ9SsttIsaGA Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a5bc12da9a94f63bb71700bd01cf416", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}] Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4c1fb7af331344dcb26c43368a9daa6e Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b'} Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:11:14.853533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:11:14.862336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. Aug 03 02:11:14.862336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:14.862336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:14.862336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:14.862336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:14.862336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:14.862336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:14.862336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:14.862336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:14.862336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. Aug 03 02:11:14.862336 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:14.862336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-13ba428d-2489-4a96-9473-9a4e697cabef tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Returning 404 to user: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:14.868112 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-13ba428d-2489-4a96-9473-9a4e697cabef tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 404 len: 111 microversion: 2.1 time: 0.125541 Aug 03 02:11:14.874732 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2244/4379] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:11:14 2022] DELETE /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:11:14.891277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1d26e27a-86d2-4331-aeba-5384119a1fbf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:14.896459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1d26e27a-86d2-4331-aeba-5384119a1fbf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:14.917187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d26e27a-86d2-4331-aeba-5384119a1fbf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:14.923219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d26e27a-86d2-4331-aeba-5384119a1fbf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:14.924426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d26e27a-86d2-4331-aeba-5384119a1fbf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:14.936831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d26e27a-86d2-4331-aeba-5384119a1fbf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:14.992853 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-1d26e27a-86d2-4331-aeba-5384119a1fbf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] HTTP exception thrown: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1d26e27a-86d2-4331-aeba-5384119a1fbf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Request method failure captured: Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b HTTP/1.1 Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dc0-Ae8If7bfOWI7RRBvc1phU63xlLSU5btj5ety_8fStzHcWU-vXHDYz4xfjE-ye9BJl2yypV_nSYHeeO1JR8qxTOON-NMvFY2KC116gH7mE5fGt58cYvDLyGtxXNTQSJt4xclgIAdKb4vD1HYJAxEQ3OrVusgb2MtJ9SsttIsaGA Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a5bc12da9a94f63bb71700bd01cf416", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}] Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4c1fb7af331344dcb26c43368a9daa6e Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b'} Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:14.996264 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:15.000441 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:15.000441 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:15.000441 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:15.000441 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:15.000441 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:15.000441 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. Aug 03 02:11:15.000441 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:15.003200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1d26e27a-86d2-4331-aeba-5384119a1fbf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Returning 404 to user: Instance a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:15.004308 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1d26e27a-86d2-4331-aeba-5384119a1fbf tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b" status: 404 len: 111 microversion: 2.1 time: 0.128227 Aug 03 02:11:15.005103 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2245/4380] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:14 2022] GET /compute/v2.1/servers/a2cc4c45-caf7-4f43-bcb2-73b4b26ef01b => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:11:15.063091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-066dadea-4395-4a4e-a144-86437dd882cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:15.063837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-066dadea-4395-4a4e-a144-86437dd882cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:15.082535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-066dadea-4395-4a4e-a144-86437dd882cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:15.085398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-066dadea-4395-4a4e-a144-86437dd882cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:15.086494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-066dadea-4395-4a4e-a144-86437dd882cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:15.090685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-066dadea-4395-4a4e-a144-86437dd882cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:15.194117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:11:15.339802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-526a21ea-3f19-42c4-a0c5-5d8abd8bf117 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f1e10b841a4b7988ac28fac1b01673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4368b80ba680454aa4000902157f20f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:15.349893 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-526a21ea-3f19-42c4-a0c5-5d8abd8bf117 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 200 len: 1228 microversion: 2.1 time: 0.992262 Aug 03 02:11:15.359394 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2136/4381] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:14 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 1228 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:16.068196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-066dadea-4395-4a4e-a144-86437dd882cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:16.077825 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-066dadea-4395-4a4e-a144-86437dd882cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1314 microversion: 2.1 time: 1.018975 Aug 03 02:11:16.078473 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2246/4382] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:15 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1314 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:16.386262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1a14ce7e-c224-4d0b-8bd4-b60c23b868ff tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:16.388490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1a14ce7e-c224-4d0b-8bd4-b60c23b868ff tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:16.414097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a14ce7e-c224-4d0b-8bd4-b60c23b868ff tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:16.421620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a14ce7e-c224-4d0b-8bd4-b60c23b868ff tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:16.426525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a14ce7e-c224-4d0b-8bd4-b60c23b868ff tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:16.430762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a14ce7e-c224-4d0b-8bd4-b60c23b868ff tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:16.577091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-066dadea-4395-4a4e-a144-86437dd882cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:16.578058 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-066dadea-4395-4a4e-a144-86437dd882cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001435 Aug 03 02:11:16.578414 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2247/4383] 10.222.0.67 () {56 vars in 886 bytes} [Wed Aug 3 02:11:16 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 03 02:11:17.100058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4df0d1be-0947-4dfd-a506-7f7bfd46f88a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:17.101002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4df0d1be-0947-4dfd-a506-7f7bfd46f88a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:17.111240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1a14ce7e-c224-4d0b-8bd4-b60c23b868ff tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f1e10b841a4b7988ac28fac1b01673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4368b80ba680454aa4000902157f20f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:17.115891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4df0d1be-0947-4dfd-a506-7f7bfd46f88a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:17.116552 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4df0d1be-0947-4dfd-a506-7f7bfd46f88a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:17.117349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4df0d1be-0947-4dfd-a506-7f7bfd46f88a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:17.117797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4df0d1be-0947-4dfd-a506-7f7bfd46f88a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:17.119738 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1a14ce7e-c224-4d0b-8bd4-b60c23b868ff tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 200 len: 1282 microversion: 2.1 time: 0.739666 Aug 03 02:11:17.120341 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2137/4384] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:16 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 1282 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:17.632149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6d6e981b-491f-4b89-ac20-c8f0021d11cd tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-617568318", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:17.636524 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-6d6e981b-491f-4b89-ac20-c8f0021d11cd tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] HTTP exception thrown: min_count must be <= max_count Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6d6e981b-491f-4b89-ac20-c8f0021d11cd tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] Request method failure captured: Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 183 Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dlFqAKEGvwEr-ikE94gpJAShvHL8jjuak_Y1U1sGynMfwSUj_8r77ZEf4y1hTGz5xf1V8vP-6Zl3KAB6MJ7FS9pMuFrkc9Um8a5dXoxlhFELjafqvIZA0akU9LCsbPmkayGdFGOsx_hSzWvpT_UViRouqhhArT39Ef4FDH404973pM Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 7d5609dee9f541788dcd52612559c070 Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-70277347 Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7d5609dee9f541788dcd52612559c070", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7d5609dee9f541788dcd52612559c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7d5609dee9f541788dcd52612559c070"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7d5609dee9f541788dcd52612559c070"}]}] Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-70277347 Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 7d5609dee9f541788dcd52612559c070 Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-70277347 Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-MultipleCreateNegativeTestJSON-70277347-project Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: dc98ac1429c04789ad093cc210ba4fe3 Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-70277347-project Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-617568318", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: exception: min_count must be <= max_count Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-617568318', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 03 02:11:17.638792 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.644122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6d6e981b-491f-4b89-ac20-c8f0021d11cd tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] Returning 400 to user: min_count must be <= max_count {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:17.644122 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6d6e981b-491f-4b89-ac20-c8f0021d11cd tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.253458 Aug 03 02:11:17.647513 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2138/4385] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:11:17 2022] POST /compute/v2.1/servers => generated 74 bytes in 261 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 03 02:11:17.719558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7741edc0-919e-4b39-a88e-cd2e94b97360 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2126049389", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "max_count": 0}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7741edc0-919e-4b39-a88e-cd2e94b97360 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] Request method failure captured: Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 168 Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dlFqAKEGvwEr-ikE94gpJAShvHL8jjuak_Y1U1sGynMfwSUj_8r77ZEf4y1hTGz5xf1V8vP-6Zl3KAB6MJ7FS9pMuFrkc9Um8a5dXoxlhFELjafqvIZA0akU9LCsbPmkayGdFGOsx_hSzWvpT_UViRouqhhArT39Ef4FDH404973pM Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 7d5609dee9f541788dcd52612559c070 Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-70277347 Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7d5609dee9f541788dcd52612559c070", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7d5609dee9f541788dcd52612559c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7d5609dee9f541788dcd52612559c070"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7d5609dee9f541788dcd52612559c070"}]}] Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-70277347 Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 7d5609dee9f541788dcd52612559c070 Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-70277347 Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-MultipleCreateNegativeTestJSON-70277347-project Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: dc98ac1429c04789ad093cc210ba4fe3 Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-70277347-project Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2126049389", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "max_count": 0}} Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2126049389', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'max_count': 0}}} Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 0 Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:11:17.740347 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:11:17.745912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:11:17.745912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:11:17.745912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:11:17.745912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:11:17.745912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 03 02:11:17.745912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.745912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:17.745912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.745912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:17.745912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:17.745912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:17.745912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:11:17.745912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:11:17.745912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 03 02:11:17.745912 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.755520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7741edc0-919e-4b39-a88e-cd2e94b97360 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:17.760416 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7741edc0-919e-4b39-a88e-cd2e94b97360 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.041107 Aug 03 02:11:17.767933 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2139/4386] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:11:17 2022] POST /compute/v2.1/servers => generated 130 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:11:17.822104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4df0d1be-0947-4dfd-a506-7f7bfd46f88a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:17.837573 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4df0d1be-0947-4dfd-a506-7f7bfd46f88a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1501 microversion: 2.1 time: 0.741910 Aug 03 02:11:17.851861 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2248/4387] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:17 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1501 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:17.867225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dd0e56b8-2f7b-4c53-86bb-cb9ad87a4565 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-553086856", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "max_count": 2.5}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:17.887142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-62c1cdf7-ace5-4bd7-af43-1c74e281f94c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dd0e56b8-2f7b-4c53-86bb-cb9ad87a4565 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] Request method failure captured: Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 169 Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dlFqAKEGvwEr-ikE94gpJAShvHL8jjuak_Y1U1sGynMfwSUj_8r77ZEf4y1hTGz5xf1V8vP-6Zl3KAB6MJ7FS9pMuFrkc9Um8a5dXoxlhFELjafqvIZA0akU9LCsbPmkayGdFGOsx_hSzWvpT_UViRouqhhArT39Ef4FDH404973pM Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 7d5609dee9f541788dcd52612559c070 Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-70277347 Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7d5609dee9f541788dcd52612559c070", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7d5609dee9f541788dcd52612559c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7d5609dee9f541788dcd52612559c070"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7d5609dee9f541788dcd52612559c070"}]}] Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-70277347 Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 7d5609dee9f541788dcd52612559c070 Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-70277347 Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-MultipleCreateNegativeTestJSON-70277347-project Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: dc98ac1429c04789ad093cc210ba4fe3 Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-70277347-project Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-553086856", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "max_count": 2.5}} Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-553086856', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'max_count': 2.5}}} Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 2.5 Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:11:17.892040 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:11:17.896998 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:11:17.896998 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:11:17.896998 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:11:17.896998 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:11:17.896998 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 03 02:11:17.896998 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.896998 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:17.896998 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.896998 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:17.896998 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:17.896998 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:17.896998 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:11:17.896998 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:11:17.896998 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 03 02:11:17.896998 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:17.906214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dd0e56b8-2f7b-4c53-86bb-cb9ad87a4565 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:17.910092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-62c1cdf7-ace5-4bd7-af43-1c74e281f94c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:17.912555 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dd0e56b8-2f7b-4c53-86bb-cb9ad87a4565 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.048089 Aug 03 02:11:17.915715 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2140/4388] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:11:17 2022] POST /compute/v2.1/servers => generated 139 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:11:17.927795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62c1cdf7-ace5-4bd7-af43-1c74e281f94c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:17.928518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62c1cdf7-ace5-4bd7-af43-1c74e281f94c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:17.929487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62c1cdf7-ace5-4bd7-af43-1c74e281f94c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:17.930078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62c1cdf7-ace5-4bd7-af43-1c74e281f94c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:18.032007 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-62c1cdf7-ace5-4bd7-af43-1c74e281f94c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action" status: 200 len: 14 microversion: 2.1 time: 0.162352 Aug 03 02:11:18.032813 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2249/4389] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:17 2022] POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:11:18.059531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2d176e1e-98a7-47be-976a-2199a18cb243 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-725780712", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "min_count": 0}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2d176e1e-98a7-47be-976a-2199a18cb243 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] Request method failure captured: Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 167 Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dlFqAKEGvwEr-ikE94gpJAShvHL8jjuak_Y1U1sGynMfwSUj_8r77ZEf4y1hTGz5xf1V8vP-6Zl3KAB6MJ7FS9pMuFrkc9Um8a5dXoxlhFELjafqvIZA0akU9LCsbPmkayGdFGOsx_hSzWvpT_UViRouqhhArT39Ef4FDH404973pM Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 7d5609dee9f541788dcd52612559c070 Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-70277347 Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7d5609dee9f541788dcd52612559c070", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7d5609dee9f541788dcd52612559c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7d5609dee9f541788dcd52612559c070"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7d5609dee9f541788dcd52612559c070"}]}] Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-70277347 Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 7d5609dee9f541788dcd52612559c070 Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-70277347 Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-MultipleCreateNegativeTestJSON-70277347-project Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: dc98ac1429c04789ad093cc210ba4fe3 Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-70277347-project Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-725780712", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "min_count": 0}} Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-725780712', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'min_count': 0}}} Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 0 Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:11:18.073945 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2d176e1e-98a7-47be-976a-2199a18cb243 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2d176e1e-98a7-47be-976a-2199a18cb243 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.022425 Aug 03 02:11:18.079422 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2141/4390] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:11:18 2022] POST /compute/v2.1/servers => generated 130 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:11:18.146134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eb6ffb6e-2917-430f-ac80-66de9ea74830 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:18.146857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eb6ffb6e-2917-430f-ac80-66de9ea74830 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:18.173268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eb6ffb6e-2917-430f-ac80-66de9ea74830 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:18.174203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eb6ffb6e-2917-430f-ac80-66de9ea74830 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:18.175484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eb6ffb6e-2917-430f-ac80-66de9ea74830 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:18.176735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eb6ffb6e-2917-430f-ac80-66de9ea74830 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:18.205632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4e0d0792-ad57-4477-b1b4-22abc580de27 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2081883715", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "min_count": 2.5}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4e0d0792-ad57-4477-b1b4-22abc580de27 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] Request method failure captured: Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 170 Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dlFqAKEGvwEr-ikE94gpJAShvHL8jjuak_Y1U1sGynMfwSUj_8r77ZEf4y1hTGz5xf1V8vP-6Zl3KAB6MJ7FS9pMuFrkc9Um8a5dXoxlhFELjafqvIZA0akU9LCsbPmkayGdFGOsx_hSzWvpT_UViRouqhhArT39Ef4FDH404973pM Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 7d5609dee9f541788dcd52612559c070 Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-70277347 Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7d5609dee9f541788dcd52612559c070", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7d5609dee9f541788dcd52612559c070"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7d5609dee9f541788dcd52612559c070"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7d5609dee9f541788dcd52612559c070"}]}] Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-70277347 Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 7d5609dee9f541788dcd52612559c070 Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-70277347 Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-MultipleCreateNegativeTestJSON-70277347-project Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: dc98ac1429c04789ad093cc210ba4fe3 Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-70277347-project Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2081883715", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "min_count": 2.5}} Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2081883715', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'min_count': 2.5}}} Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 2.5 Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:11:18.220185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4e0d0792-ad57-4477-b1b4-22abc580de27 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:18.240000 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4e0d0792-ad57-4477-b1b4-22abc580de27 tempest-MultipleCreateNegativeTestJSON-70277347 tempest-MultipleCreateNegativeTestJSON-70277347-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.032109 Aug 03 02:11:18.244583 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2142/4391] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:11:18 2022] POST /compute/v2.1/servers => generated 139 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:11:18.387085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-eb6ffb6e-2917-430f-ac80-66de9ea74830 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f1e10b841a4b7988ac28fac1b01673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4368b80ba680454aa4000902157f20f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:18.407250 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eb6ffb6e-2917-430f-ac80-66de9ea74830 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 200 len: 1282 microversion: 2.1 time: 0.264848 Aug 03 02:11:18.422983 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2250/4392] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:18 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 1282 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:19.044713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-13877d0e-9ff6-4d4c-a365-21cad6da5da5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:19.049108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-13877d0e-9ff6-4d4c-a365-21cad6da5da5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:19.063345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13877d0e-9ff6-4d4c-a365-21cad6da5da5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:19.064056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13877d0e-9ff6-4d4c-a365-21cad6da5da5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:19.065051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13877d0e-9ff6-4d4c-a365-21cad6da5da5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:19.066103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13877d0e-9ff6-4d4c-a365-21cad6da5da5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:19.131753 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-13877d0e-9ff6-4d4c-a365-21cad6da5da5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action" status: 200 len: 14 microversion: 2.1 time: 0.087543 Aug 03 02:11:19.143531 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2143/4393] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:19 2022] POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:11:19.439774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d5d72a36-8094-4493-8ebe-b55f0c893aec tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:19.441040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d5d72a36-8094-4493-8ebe-b55f0c893aec tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:19.459464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5d72a36-8094-4493-8ebe-b55f0c893aec tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:19.460194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5d72a36-8094-4493-8ebe-b55f0c893aec tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:19.461211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5d72a36-8094-4493-8ebe-b55f0c893aec tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:19.461875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5d72a36-8094-4493-8ebe-b55f0c893aec tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:20.148329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d0b404ff-f79b-406b-b925-60967f89da07 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:20.150999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d0b404ff-f79b-406b-b925-60967f89da07 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:20.179029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0b404ff-f79b-406b-b925-60967f89da07 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:20.179561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0b404ff-f79b-406b-b925-60967f89da07 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:20.180401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0b404ff-f79b-406b-b925-60967f89da07 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:20.180852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0b404ff-f79b-406b-b925-60967f89da07 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:20.269719 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d0b404ff-f79b-406b-b925-60967f89da07 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action" status: 200 len: 14 microversion: 2.1 time: 0.124912 Aug 03 02:11:20.270738 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2144/4394] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:20 2022] POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:11:20.558401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d5d72a36-8094-4493-8ebe-b55f0c893aec tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f1e10b841a4b7988ac28fac1b01673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4368b80ba680454aa4000902157f20f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:20.582740 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d5d72a36-8094-4493-8ebe-b55f0c893aec tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 200 len: 1324 microversion: 2.1 time: 1.146810 Aug 03 02:11:20.583675 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2251/4395] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:19 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 1324 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:21.067069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-9cc1dc73-2308-4299-8b56-a0f861bbc3ef req-fc8e8989-b3ed-4448-963f-e1cd26c7ad53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb6497d-c422-4a88-b3f3-96d87624134e", "tag": "a202008a-35c3-41d3-885f-d0ebe073b501"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:21.103270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9cc1dc73-2308-4299-8b56-a0f861bbc3ef req-fc8e8989-b3ed-4448-963f-e1cd26c7ad53 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:21.104083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9cc1dc73-2308-4299-8b56-a0f861bbc3ef req-fc8e8989-b3ed-4448-963f-e1cd26c7ad53 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:21.141497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:11:21.143715 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-9cc1dc73-2308-4299-8b56-a0f861bbc3ef req-fc8e8989-b3ed-4448-963f-e1cd26c7ad53 service nova] Creating event network-changed:a202008a-35c3-41d3-885f-d0ebe073b501 for instance abb6497d-c422-4a88-b3f3-96d87624134e on n-h2-826529-8 Aug 03 02:11:21.157513 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-9cc1dc73-2308-4299-8b56-a0f861bbc3ef req-fc8e8989-b3ed-4448-963f-e1cd26c7ad53 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095150 Aug 03 02:11:21.158495 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2145/4396] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:11:21.283940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7ccde23f-8cf4-462c-8f57-26c9a9d4303e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:21.287523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7ccde23f-8cf4-462c-8f57-26c9a9d4303e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:21.312335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ccde23f-8cf4-462c-8f57-26c9a9d4303e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:21.313062 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ccde23f-8cf4-462c-8f57-26c9a9d4303e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:21.314691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ccde23f-8cf4-462c-8f57-26c9a9d4303e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:21.316934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ccde23f-8cf4-462c-8f57-26c9a9d4303e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:21.441756 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7ccde23f-8cf4-462c-8f57-26c9a9d4303e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action" status: 200 len: 14 microversion: 2.1 time: 0.163944 Aug 03 02:11:21.442954 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2252/4397] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:21 2022] POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:11:21.616555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-599ab8a6-7559-4ff6-adc5-727dc8905165 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:21.617361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-599ab8a6-7559-4ff6-adc5-727dc8905165 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:21.633582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-599ab8a6-7559-4ff6-adc5-727dc8905165 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:21.636318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-599ab8a6-7559-4ff6-adc5-727dc8905165 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:21.637416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-599ab8a6-7559-4ff6-adc5-727dc8905165 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:21.639795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-599ab8a6-7559-4ff6-adc5-727dc8905165 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:22.198098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2cc222f4-0174-43bd-b18f-047fb2c76349 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:22.198691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2cc222f4-0174-43bd-b18f-047fb2c76349 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:22.213833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2cc222f4-0174-43bd-b18f-047fb2c76349 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:22.218543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2cc222f4-0174-43bd-b18f-047fb2c76349 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:22.219588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2cc222f4-0174-43bd-b18f-047fb2c76349 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:22.220043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2cc222f4-0174-43bd-b18f-047fb2c76349 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:22.268769 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-2cc222f4-0174-43bd-b18f-047fb2c76349 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] HTTP exception thrown: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2cc222f4-0174-43bd-b18f-047fb2c76349 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Request method failure captured: Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 HTTP/1.1 Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dc0-Ae8If7bfOWI7RRBvc1phU63xlLSU5btj5ety_8fStzHcWU-vXHDYz4xfjE-ye9BJl2yypV_nSYHeeO1JR8qxTOON-NMvFY2KC116gH7mE5fGt58cYvDLyGtxXNTQSJt4xclgIAdKb4vD1HYJAxEQ3OrVusgb2MtJ9SsttIsaGA Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a5bc12da9a94f63bb71700bd01cf416", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}] Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4c1fb7af331344dcb26c43368a9daa6e Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '3f1ef30e-5b4e-43ac-84ce-2a3a69d77340'} Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:11:22.270423 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:11:22.275732 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. Aug 03 02:11:22.275732 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.275732 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:22.275732 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.275732 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:22.275732 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:22.275732 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:22.275732 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:22.275732 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:22.275732 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. Aug 03 02:11:22.275732 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.275732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2cc222f4-0174-43bd-b18f-047fb2c76349 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Returning 404 to user: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:22.275732 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2cc222f4-0174-43bd-b18f-047fb2c76349 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 404 len: 111 microversion: 2.1 time: 0.078346 Aug 03 02:11:22.275732 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2253/4398] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:11:22 2022] DELETE /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:11:22.281365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eeb865a1-4a30-454a-9229-bd7a79f9d0db tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:22.281983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eeb865a1-4a30-454a-9229-bd7a79f9d0db tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:22.295480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeb865a1-4a30-454a-9229-bd7a79f9d0db tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:22.302923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeb865a1-4a30-454a-9229-bd7a79f9d0db tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:22.306053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeb865a1-4a30-454a-9229-bd7a79f9d0db tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:22.306871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeb865a1-4a30-454a-9229-bd7a79f9d0db tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:22.347683 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-eeb865a1-4a30-454a-9229-bd7a79f9d0db tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] HTTP exception thrown: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eeb865a1-4a30-454a-9229-bd7a79f9d0db tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Request method failure captured: Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 HTTP/1.1 Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dc0-Ae8If7bfOWI7RRBvc1phU63xlLSU5btj5ety_8fStzHcWU-vXHDYz4xfjE-ye9BJl2yypV_nSYHeeO1JR8qxTOON-NMvFY2KC116gH7mE5fGt58cYvDLyGtxXNTQSJt4xclgIAdKb4vD1HYJAxEQ3OrVusgb2MtJ9SsttIsaGA Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a5bc12da9a94f63bb71700bd01cf416", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}] Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4c1fb7af331344dcb26c43368a9daa6e Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '3f1ef30e-5b4e-43ac-84ce-2a3a69d77340'} Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:22.354194 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.358064 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:22.358064 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:22.358064 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:22.358064 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:22.358064 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:22.358064 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. Aug 03 02:11:22.358064 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.360030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eeb865a1-4a30-454a-9229-bd7a79f9d0db tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Returning 404 to user: Instance 3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:22.361094 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eeb865a1-4a30-454a-9229-bd7a79f9d0db tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340" status: 404 len: 111 microversion: 2.1 time: 0.084414 Aug 03 02:11:22.361856 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2254/4399] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:22 2022] GET /compute/v2.1/servers/3f1ef30e-5b4e-43ac-84ce-2a3a69d77340 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:11:22.371951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-023714c3-fcf0-43fd-bc90-4e9c9527557f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:22.372801 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-023714c3-fcf0-43fd-bc90-4e9c9527557f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:22.380273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-023714c3-fcf0-43fd-bc90-4e9c9527557f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:22.381052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-023714c3-fcf0-43fd-bc90-4e9c9527557f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:22.382075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-023714c3-fcf0-43fd-bc90-4e9c9527557f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:22.382725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-023714c3-fcf0-43fd-bc90-4e9c9527557f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:22.413677 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-023714c3-fcf0-43fd-bc90-4e9c9527557f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] HTTP exception thrown: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-023714c3-fcf0-43fd-bc90-4e9c9527557f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Request method failure captured: Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 HTTP/1.1 Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dc0-Ae8If7bfOWI7RRBvc1phU63xlLSU5btj5ety_8fStzHcWU-vXHDYz4xfjE-ye9BJl2yypV_nSYHeeO1JR8qxTOON-NMvFY2KC116gH7mE5fGt58cYvDLyGtxXNTQSJt4xclgIAdKb4vD1HYJAxEQ3OrVusgb2MtJ9SsttIsaGA Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a5bc12da9a94f63bb71700bd01cf416", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}] Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4c1fb7af331344dcb26c43368a9daa6e Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'ccde6102-3858-4f7d-aa96-9d1a2527f9a2'} Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:11:22.415666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:11:22.419247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. Aug 03 02:11:22.419247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.419247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:22.419247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.419247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:22.419247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:22.419247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:22.419247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:22.419247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:22.419247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. Aug 03 02:11:22.419247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.424576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-023714c3-fcf0-43fd-bc90-4e9c9527557f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Returning 404 to user: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:22.436116 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-023714c3-fcf0-43fd-bc90-4e9c9527557f tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2" status: 404 len: 111 microversion: 2.1 time: 0.069032 Aug 03 02:11:22.438713 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2255/4400] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:11:22 2022] DELETE /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:11:22.452175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-11b2cf52-e0a6-4430-919e-2ff11aba6ba6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:22.459966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-11b2cf52-e0a6-4430-919e-2ff11aba6ba6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: ccde6102-3858-4f7d-aa96-9d1a2527f9a2] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:22.468118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11b2cf52-e0a6-4430-919e-2ff11aba6ba6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:22.468966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11b2cf52-e0a6-4430-919e-2ff11aba6ba6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:22.470159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11b2cf52-e0a6-4430-919e-2ff11aba6ba6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:22.470827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11b2cf52-e0a6-4430-919e-2ff11aba6ba6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:22.487939 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-11b2cf52-e0a6-4430-919e-2ff11aba6ba6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] HTTP exception thrown: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-11b2cf52-e0a6-4430-919e-2ff11aba6ba6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Request method failure captured: Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 HTTP/1.1 Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dc0-Ae8If7bfOWI7RRBvc1phU63xlLSU5btj5ety_8fStzHcWU-vXHDYz4xfjE-ye9BJl2yypV_nSYHeeO1JR8qxTOON-NMvFY2KC116gH7mE5fGt58cYvDLyGtxXNTQSJt4xclgIAdKb4vD1HYJAxEQ3OrVusgb2MtJ9SsttIsaGA Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a5bc12da9a94f63bb71700bd01cf416", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}] Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4c1fb7af331344dcb26c43368a9daa6e Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'ccde6102-3858-4f7d-aa96-9d1a2527f9a2'} Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:22.490145 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.494241 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:22.494241 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:22.494241 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:22.494241 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:22.494241 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:22.494241 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. Aug 03 02:11:22.494241 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:22.496537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-11b2cf52-e0a6-4430-919e-2ff11aba6ba6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Returning 404 to user: Instance ccde6102-3858-4f7d-aa96-9d1a2527f9a2 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:22.498560 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-11b2cf52-e0a6-4430-919e-2ff11aba6ba6 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2" status: 404 len: 111 microversion: 2.1 time: 0.053967 Aug 03 02:11:22.499827 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2256/4401] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:22 2022] GET /compute/v2.1/servers/ccde6102-3858-4f7d-aa96-9d1a2527f9a2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:11:22.507007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d25788a8-5f4a-4eec-ad2b-588d4184c16c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:22.509721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d25788a8-5f4a-4eec-ad2b-588d4184c16c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:22.516506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-599ab8a6-7559-4ff6-adc5-727dc8905165 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f1e10b841a4b7988ac28fac1b01673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4368b80ba680454aa4000902157f20f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:22.520497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d25788a8-5f4a-4eec-ad2b-588d4184c16c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:22.521170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d25788a8-5f4a-4eec-ad2b-588d4184c16c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:22.522414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d25788a8-5f4a-4eec-ad2b-588d4184c16c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:22.523139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d25788a8-5f4a-4eec-ad2b-588d4184c16c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:22.533138 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-599ab8a6-7559-4ff6-adc5-727dc8905165 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 200 len: 1324 microversion: 2.1 time: 0.924286 Aug 03 02:11:22.534076 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2146/4402] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:21 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 1324 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:22.582078 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d25788a8-5f4a-4eec-ad2b-588d4184c16c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action" status: 200 len: 14 microversion: 2.1 time: 0.080725 Aug 03 02:11:22.582721 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2257/4403] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:22 2022] POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:11:23.566380 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-acec1a54-2d3e-4776-ae54-2478cfd1d924 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:23.596146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b3571831-df3b-47bf-8f99-402b86a167cd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:23.602591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-acec1a54-2d3e-4776-ae54-2478cfd1d924 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:23.608113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b3571831-df3b-47bf-8f99-402b86a167cd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:23.624188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:11:23.630011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:11:23.660207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3571831-df3b-47bf-8f99-402b86a167cd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:23.661264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3571831-df3b-47bf-8f99-402b86a167cd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:23.663202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3571831-df3b-47bf-8f99-402b86a167cd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:23.665820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3571831-df3b-47bf-8f99-402b86a167cd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:23.679635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acec1a54-2d3e-4776-ae54-2478cfd1d924 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:23.680283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acec1a54-2d3e-4776-ae54-2478cfd1d924 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:23.681277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acec1a54-2d3e-4776-ae54-2478cfd1d924 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:23.681688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acec1a54-2d3e-4776-ae54-2478cfd1d924 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:23.855156 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b3571831-df3b-47bf-8f99-402b86a167cd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action" status: 200 len: 14 microversion: 2.1 time: 0.264152 Aug 03 02:11:23.857255 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2258/4404] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:23 2022] POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action => generated 14 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 02:11:24.558618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-acec1a54-2d3e-4776-ae54-2478cfd1d924 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f1e10b841a4b7988ac28fac1b01673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4368b80ba680454aa4000902157f20f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:24.570674 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-acec1a54-2d3e-4776-ae54-2478cfd1d924 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 200 len: 1324 microversion: 2.1 time: 1.016742 Aug 03 02:11:24.591294 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2147/4405] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:23 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 1324 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:24.868092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6800b1d5-8482-4bb9-9fa5-b39cf85dce35 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:24.870549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6800b1d5-8482-4bb9-9fa5-b39cf85dce35 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:24.893872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6800b1d5-8482-4bb9-9fa5-b39cf85dce35 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:24.896889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6800b1d5-8482-4bb9-9fa5-b39cf85dce35 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:24.897906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6800b1d5-8482-4bb9-9fa5-b39cf85dce35 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:24.899067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6800b1d5-8482-4bb9-9fa5-b39cf85dce35 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:25.024634 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6800b1d5-8482-4bb9-9fa5-b39cf85dce35 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action" status: 200 len: 14 microversion: 2.1 time: 0.160741 Aug 03 02:11:25.027380 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2259/4406] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:24 2022] POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:11:25.604489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-48f7fbf2-76f4-4338-92d8-70c707418c75 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:25.605241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-48f7fbf2-76f4-4338-92d8-70c707418c75 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:25.621231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-48f7fbf2-76f4-4338-92d8-70c707418c75 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:25.622748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-48f7fbf2-76f4-4338-92d8-70c707418c75 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:25.625591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-48f7fbf2-76f4-4338-92d8-70c707418c75 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:25.626164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-48f7fbf2-76f4-4338-92d8-70c707418c75 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:26.037356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0335712e-b5df-4930-adbc-385c97a7f5f5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:26.041036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0335712e-b5df-4930-adbc-385c97a7f5f5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:26.060672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0335712e-b5df-4930-adbc-385c97a7f5f5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:26.061143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0335712e-b5df-4930-adbc-385c97a7f5f5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:26.061957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0335712e-b5df-4930-adbc-385c97a7f5f5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:26.062407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0335712e-b5df-4930-adbc-385c97a7f5f5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:26.161252 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0335712e-b5df-4930-adbc-385c97a7f5f5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action" status: 200 len: 14 microversion: 2.1 time: 0.128152 Aug 03 02:11:26.164719 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2260/4407] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:26 2022] POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:11:26.256432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-48f7fbf2-76f4-4338-92d8-70c707418c75 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f1e10b841a4b7988ac28fac1b01673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4368b80ba680454aa4000902157f20f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:26.272780 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-48f7fbf2-76f4-4338-92d8-70c707418c75 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 200 len: 1324 microversion: 2.1 time: 0.672159 Aug 03 02:11:26.274027 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2148/4408] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:25 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 1324 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:27.175022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-36ad8ef9-884f-48bd-9f9b-2e250a2ad7ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:27.177426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-36ad8ef9-884f-48bd-9f9b-2e250a2ad7ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:27.196668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-36ad8ef9-884f-48bd-9f9b-2e250a2ad7ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:27.197145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-36ad8ef9-884f-48bd-9f9b-2e250a2ad7ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:27.198029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-36ad8ef9-884f-48bd-9f9b-2e250a2ad7ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:27.198388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-36ad8ef9-884f-48bd-9f9b-2e250a2ad7ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:27.305766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93cb6fb0-2abf-4ef0-9f2c-f8ab8f5d6171 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:27.309068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93cb6fb0-2abf-4ef0-9f2c-f8ab8f5d6171 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:27.342856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93cb6fb0-2abf-4ef0-9f2c-f8ab8f5d6171 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:27.349330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93cb6fb0-2abf-4ef0-9f2c-f8ab8f5d6171 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:27.350467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93cb6fb0-2abf-4ef0-9f2c-f8ab8f5d6171 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:27.351169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93cb6fb0-2abf-4ef0-9f2c-f8ab8f5d6171 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:27.378003 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-36ad8ef9-884f-48bd-9f9b-2e250a2ad7ad tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action" status: 200 len: 14 microversion: 2.1 time: 0.208971 Aug 03 02:11:27.390360 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2261/4409] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:27 2022] POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action => generated 14 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:11:28.386871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7176cc90-e55d-46ff-9114-1435cf111620 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:28.388388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7176cc90-e55d-46ff-9114-1435cf111620 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:28.403085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7176cc90-e55d-46ff-9114-1435cf111620 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:28.403522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7176cc90-e55d-46ff-9114-1435cf111620 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:28.404305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7176cc90-e55d-46ff-9114-1435cf111620 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:28.404757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7176cc90-e55d-46ff-9114-1435cf111620 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:28.438382 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-7176cc90-e55d-46ff-9114-1435cf111620 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] HTTP exception thrown: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7176cc90-e55d-46ff-9114-1435cf111620 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Request method failure captured: Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 HTTP/1.1 Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dc0-Ae8If7bfOWI7RRBvc1phU63xlLSU5btj5ety_8fStzHcWU-vXHDYz4xfjE-ye9BJl2yypV_nSYHeeO1JR8qxTOON-NMvFY2KC116gH7mE5fGt58cYvDLyGtxXNTQSJt4xclgIAdKb4vD1HYJAxEQ3OrVusgb2MtJ9SsttIsaGA Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a5bc12da9a94f63bb71700bd01cf416", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}] Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4c1fb7af331344dcb26c43368a9daa6e Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '99358f36-9bc7-4e58-8a98-70b4e391e244'} Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:11:28.440629 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:11:28.445953 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. Aug 03 02:11:28.445953 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:28.445953 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:28.445953 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:28.445953 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:28.445953 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:28.445953 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:28.445953 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:28.445953 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:28.445953 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. Aug 03 02:11:28.445953 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:28.445953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7176cc90-e55d-46ff-9114-1435cf111620 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Returning 404 to user: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:28.449964 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7176cc90-e55d-46ff-9114-1435cf111620 tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "DELETE /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 404 len: 111 microversion: 2.1 time: 0.067106 Aug 03 02:11:28.452835 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2262/4410] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:11:28 2022] DELETE /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:11:28.462426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-140ed50d-2fd5-4d09-9d5f-beac807bbddc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:28.464992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-140ed50d-2fd5-4d09-9d5f-beac807bbddc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:28.491330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:11:28.501957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-140ed50d-2fd5-4d09-9d5f-beac807bbddc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:28.503010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-140ed50d-2fd5-4d09-9d5f-beac807bbddc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:28.508679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-140ed50d-2fd5-4d09-9d5f-beac807bbddc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:28.509618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-140ed50d-2fd5-4d09-9d5f-beac807bbddc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:28.589264 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-140ed50d-2fd5-4d09-9d5f-beac807bbddc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action" status: 200 len: 14 microversion: 2.1 time: 0.134367 Aug 03 02:11:28.601933 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2263/4411] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:28 2022] POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:11:28.613290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bceab892-1fc4-43e7-b3f7-c56e3876c2ae tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:28.615266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bceab892-1fc4-43e7-b3f7-c56e3876c2ae tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] [instance: 99358f36-9bc7-4e58-8a98-70b4e391e244] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:28.630686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bceab892-1fc4-43e7-b3f7-c56e3876c2ae tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:28.631726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bceab892-1fc4-43e7-b3f7-c56e3876c2ae tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:28.633200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bceab892-1fc4-43e7-b3f7-c56e3876c2ae tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:28.634299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bceab892-1fc4-43e7-b3f7-c56e3876c2ae tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:28.647228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-93cb6fb0-2abf-4ef0-9f2c-f8ab8f5d6171 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f1e10b841a4b7988ac28fac1b01673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4368b80ba680454aa4000902157f20f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:28.653901 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-bceab892-1fc4-43e7-b3f7-c56e3876c2ae tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] HTTP exception thrown: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bceab892-1fc4-43e7-b3f7-c56e3876c2ae tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Request method failure captured: Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 HTTP/1.1 Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dc0-Ae8If7bfOWI7RRBvc1phU63xlLSU5btj5ety_8fStzHcWU-vXHDYz4xfjE-ye9BJl2yypV_nSYHeeO1JR8qxTOON-NMvFY2KC116gH7mE5fGt58cYvDLyGtxXNTQSJt4xclgIAdKb4vD1HYJAxEQ3OrVusgb2MtJ9SsttIsaGA Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9a5bc12da9a94f63bb71700bd01cf416", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9a5bc12da9a94f63bb71700bd01cf416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9a5bc12da9a94f63bb71700bd01cf416"}]}] Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 9a5bc12da9a94f63bb71700bd01cf416 Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-823980184 Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4c1fb7af331344dcb26c43368a9daa6e Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeNegativeTest-823980184-project Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '99358f36-9bc7-4e58-8a98-70b4e391e244'} Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:28.656303 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:28.661210 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:28.661210 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:28.661210 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:28.661210 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:28.661210 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:28.661210 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. Aug 03 02:11:28.661210 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:28.663668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bceab892-1fc4-43e7-b3f7-c56e3876c2ae tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] Returning 404 to user: Instance 99358f36-9bc7-4e58-8a98-70b4e391e244 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:28.664753 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bceab892-1fc4-43e7-b3f7-c56e3876c2ae tempest-AttachVolumeNegativeTest-823980184 tempest-AttachVolumeNegativeTest-823980184-project] 10.222.0.67 "GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244" status: 404 len: 111 microversion: 2.1 time: 0.060706 Aug 03 02:11:28.665884 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2264/4412] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:28 2022] GET /compute/v2.1/servers/99358f36-9bc7-4e58-8a98-70b4e391e244 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:11:28.693936 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93cb6fb0-2abf-4ef0-9f2c-f8ab8f5d6171 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 200 len: 1324 microversion: 2.1 time: 1.399440 Aug 03 02:11:28.695059 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2149/4413] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:27 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 1324 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:29.608314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cdb6a3ae-b7f1-4a10-a43c-fcd133f2fc9e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:29.611152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cdb6a3ae-b7f1-4a10-a43c-fcd133f2fc9e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:29.645579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cdb6a3ae-b7f1-4a10-a43c-fcd133f2fc9e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:29.646334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cdb6a3ae-b7f1-4a10-a43c-fcd133f2fc9e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:29.649157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cdb6a3ae-b7f1-4a10-a43c-fcd133f2fc9e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:29.649776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cdb6a3ae-b7f1-4a10-a43c-fcd133f2fc9e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:29.722028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-36c83927-3b8d-4f75-89c0-01e39d3cb926 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:29.723312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-36c83927-3b8d-4f75-89c0-01e39d3cb926 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:29.726588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:11:29.751821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36c83927-3b8d-4f75-89c0-01e39d3cb926 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:29.756090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36c83927-3b8d-4f75-89c0-01e39d3cb926 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:29.758007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36c83927-3b8d-4f75-89c0-01e39d3cb926 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:29.764389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36c83927-3b8d-4f75-89c0-01e39d3cb926 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:29.787999 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cdb6a3ae-b7f1-4a10-a43c-fcd133f2fc9e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action" status: 200 len: 14 microversion: 2.1 time: 0.181794 Aug 03 02:11:29.789025 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2265/4414] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:29 2022] POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:11:30.197927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-36c83927-3b8d-4f75-89c0-01e39d3cb926 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f1e10b841a4b7988ac28fac1b01673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4368b80ba680454aa4000902157f20f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:30.207169 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-36c83927-3b8d-4f75-89c0-01e39d3cb926 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 200 len: 1324 microversion: 2.1 time: 0.489122 Aug 03 02:11:30.208087 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2150/4415] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:29 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 1324 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:30.461253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a15f8afb-a6a9-4a31-a0fe-d19c80289c40 req-ffc74380-55c8-40d1-ac2d-8ecada946c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb6497d-c422-4a88-b3f3-96d87624134e", "name": "network-vif-plugged", "status": "completed", "tag": "a202008a-35c3-41d3-885f-d0ebe073b501"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:30.488967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a15f8afb-a6a9-4a31-a0fe-d19c80289c40 req-ffc74380-55c8-40d1-ac2d-8ecada946c55 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:30.489554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a15f8afb-a6a9-4a31-a0fe-d19c80289c40 req-ffc74380-55c8-40d1-ac2d-8ecada946c55 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:30.512113 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a15f8afb-a6a9-4a31-a0fe-d19c80289c40 req-ffc74380-55c8-40d1-ac2d-8ecada946c55 service nova] Creating event network-vif-plugged:a202008a-35c3-41d3-885f-d0ebe073b501 for instance abb6497d-c422-4a88-b3f3-96d87624134e on n-h2-826529-8 Aug 03 02:11:30.532691 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a15f8afb-a6a9-4a31-a0fe-d19c80289c40 req-ffc74380-55c8-40d1-ac2d-8ecada946c55 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070472 Aug 03 02:11:30.536229 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2266/4416] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:11:30.800714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5d8d1454-3a1f-4eeb-8374-e41a087ced0b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:30.803041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5d8d1454-3a1f-4eeb-8374-e41a087ced0b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:30.834234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d8d1454-3a1f-4eeb-8374-e41a087ced0b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:30.834726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d8d1454-3a1f-4eeb-8374-e41a087ced0b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:30.837677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d8d1454-3a1f-4eeb-8374-e41a087ced0b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:30.838370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d8d1454-3a1f-4eeb-8374-e41a087ced0b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:30.975677 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5d8d1454-3a1f-4eeb-8374-e41a087ced0b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action" status: 200 len: 14 microversion: 2.1 time: 0.178580 Aug 03 02:11:30.981044 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2151/4417] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:30 2022] POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:11:31.236658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-75c2c50c-d69d-4758-994e-9b625a8f1a99 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:31.238947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-75c2c50c-d69d-4758-994e-9b625a8f1a99 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:31.268737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75c2c50c-d69d-4758-994e-9b625a8f1a99 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:31.272306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75c2c50c-d69d-4758-994e-9b625a8f1a99 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:31.278638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75c2c50c-d69d-4758-994e-9b625a8f1a99 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:31.279361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75c2c50c-d69d-4758-994e-9b625a8f1a99 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:31.769921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-75c2c50c-d69d-4758-994e-9b625a8f1a99 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f1e10b841a4b7988ac28fac1b01673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4368b80ba680454aa4000902157f20f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:31.782817 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-75c2c50c-d69d-4758-994e-9b625a8f1a99 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 200 len: 1324 microversion: 2.1 time: 0.552884 Aug 03 02:11:31.783450 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2267/4418] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:31 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 1324 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:31.989676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4f99bfc9-b018-495b-a415-2038e662e4b5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:31.992391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4f99bfc9-b018-495b-a415-2038e662e4b5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:32.015892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f99bfc9-b018-495b-a415-2038e662e4b5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:32.017986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f99bfc9-b018-495b-a415-2038e662e4b5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:32.020974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f99bfc9-b018-495b-a415-2038e662e4b5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:32.022681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f99bfc9-b018-495b-a415-2038e662e4b5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:32.093550 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4f99bfc9-b018-495b-a415-2038e662e4b5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action" status: 200 len: 14 microversion: 2.1 time: 0.108439 Aug 03 02:11:32.095018 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2152/4419] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:31 2022] POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:11:32.804361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5bdee86d-204a-4f36-9b06-ca4f4e58fb60 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:32.805130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5bdee86d-204a-4f36-9b06-ca4f4e58fb60 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:32.832433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bdee86d-204a-4f36-9b06-ca4f4e58fb60 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:32.833212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bdee86d-204a-4f36-9b06-ca4f4e58fb60 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:32.834166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bdee86d-204a-4f36-9b06-ca4f4e58fb60 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:32.834556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bdee86d-204a-4f36-9b06-ca4f4e58fb60 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:33.051900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5bdee86d-204a-4f36-9b06-ca4f4e58fb60 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f1e10b841a4b7988ac28fac1b01673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4368b80ba680454aa4000902157f20f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:33.063807 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5bdee86d-204a-4f36-9b06-ca4f4e58fb60 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 200 len: 1520 microversion: 2.1 time: 0.263855 Aug 03 02:11:33.065128 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2268/4420] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:32 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:11:33.106486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f185cf8f-ee72-4e99-b05d-80987c139c5e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:33.113191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f185cf8f-ee72-4e99-b05d-80987c139c5e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:33.122983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f185cf8f-ee72-4e99-b05d-80987c139c5e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:33.123700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f185cf8f-ee72-4e99-b05d-80987c139c5e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:33.124771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f185cf8f-ee72-4e99-b05d-80987c139c5e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:33.125371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f185cf8f-ee72-4e99-b05d-80987c139c5e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:33.200411 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f185cf8f-ee72-4e99-b05d-80987c139c5e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action" status: 200 len: 8208 microversion: 2.1 time: 0.096612 Aug 03 02:11:33.213428 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2153/4421] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:33 2022] POST /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1/action => generated 8208 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:33.220568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3aefefdb-9223-4150-b2de-2d28bfe714a6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:33.222284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3aefefdb-9223-4150-b2de-2d28bfe714a6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:33.249387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3aefefdb-9223-4150-b2de-2d28bfe714a6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:33.250859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3aefefdb-9223-4150-b2de-2d28bfe714a6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:33.253712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3aefefdb-9223-4150-b2de-2d28bfe714a6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:33.254168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3aefefdb-9223-4150-b2de-2d28bfe714a6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:33.349318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c1d60770-a769-4bce-8d7f-fc29a5d0b0e2 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1421502161", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5582670a-5513-4687-a4be-2162f4c8688b"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c1d60770-a769-4bce-8d7f-fc29a5d0b0e2 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Request method failure captured: Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 243 Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dk9ByairQ-uAJLHOocDC9pMV6cRR-tOYxGGfGTyPdQk1BGSc1cwue6TokUDe_oMXt_NDYBeS640idkIVEmVelMUzXdtoXuAv7y8qtr20tuZfbsPShwW71lgmZz9Hjf3a-e-ZWatHrg4BzjFpMKwQxBDHSTjaSwMEmFrcHlJfetvDw0 Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4368b80ba680454aa4000902157f20f9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4368b80ba680454aa4000902157f20f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}] Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 33f1e10b841a4b7988ac28fac1b01673 Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1421502161", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5582670a-5513-4687-a4be-2162f4c8688b"}]}} Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1421502161', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '5582670a-5513-4687-a4be-2162f4c8688b'}]}}} Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:33.357578 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c1d60770-a769-4bce-8d7f-fc29a5d0b0e2 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:33.365038 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c1d60770-a769-4bce-8d7f-fc29a5d0b0e2 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.020074 Aug 03 02:11:33.379304 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2154/4422] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:11:33 2022] POST /compute/v2.1/servers => generated 175 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:11:33.390154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ca56f727-f04c-4558-9b0d-2222f8d5753b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:33.398016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ca56f727-f04c-4558-9b0d-2222f8d5753b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: 2f57b8d2-7a6d-41c0-ba13-148c960ec983] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:33.427115 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-ca56f727-f04c-4558-9b0d-2222f8d5753b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] HTTP exception thrown: Instance 2f57b8d2-7a6d-41c0-ba13-148c960ec983 could not be found. Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ca56f727-f04c-4558-9b0d-2222f8d5753b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Request method failure captured: Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/2f57b8d2-7a6d-41c0-ba13-148c960ec983/metadata HTTP/1.1 Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dk9ByairQ-uAJLHOocDC9pMV6cRR-tOYxGGfGTyPdQk1BGSc1cwue6TokUDe_oMXt_NDYBeS640idkIVEmVelMUzXdtoXuAv7y8qtr20tuZfbsPShwW71lgmZz9Hjf3a-e-ZWatHrg4BzjFpMKwQxBDHSTjaSwMEmFrcHlJfetvDw0 Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4368b80ba680454aa4000902157f20f9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4368b80ba680454aa4000902157f20f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}] Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 33f1e10b841a4b7988ac28fac1b01673 Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 2f57b8d2-7a6d-41c0-ba13-148c960ec983 could not be found. Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'server_id': '2f57b8d2-7a6d-41c0-ba13-148c960ec983'} Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f57b8d2-7a6d-41c0-ba13-148c960ec983 could not be found. Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f57b8d2-7a6d-41c0-ba13-148c960ec983 could not be found. Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:33.450499 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:33.455086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:33.455086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:33.455086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f57b8d2-7a6d-41c0-ba13-148c960ec983 could not be found. Aug 03 02:11:33.455086 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.459614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ca56f727-f04c-4558-9b0d-2222f8d5753b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Returning 404 to user: Instance 2f57b8d2-7a6d-41c0-ba13-148c960ec983 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:33.460928 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ca56f727-f04c-4558-9b0d-2222f8d5753b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/2f57b8d2-7a6d-41c0-ba13-148c960ec983/metadata" status: 404 len: 111 microversion: 2.1 time: 0.080505 Aug 03 02:11:33.465005 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2155/4423] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 02:11:33 2022] GET /compute/v2.1/servers/2f57b8d2-7a6d-41c0-ba13-148c960ec983/metadata => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:11:33.810636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b7747179-fd8b-479d-8517-3db29a07c88a tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1920531034", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5582670a-5513-4687-a4be-2162f4c8688b"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:33.826240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3aefefdb-9223-4150-b2de-2d28bfe714a6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b7747179-fd8b-479d-8517-3db29a07c88a tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Request method failure captured: Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 499 Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dk9ByairQ-uAJLHOocDC9pMV6cRR-tOYxGGfGTyPdQk1BGSc1cwue6TokUDe_oMXt_NDYBeS640idkIVEmVelMUzXdtoXuAv7y8qtr20tuZfbsPShwW71lgmZz9Hjf3a-e-ZWatHrg4BzjFpMKwQxBDHSTjaSwMEmFrcHlJfetvDw0 Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4368b80ba680454aa4000902157f20f9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4368b80ba680454aa4000902157f20f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}] Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 33f1e10b841a4b7988ac28fac1b01673 Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1920531034", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5582670a-5513-4687-a4be-2162f4c8688b"}]}} Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1920531034', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5582670a-5513-4687-a4be-2162f4c8688b'}]}}} Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 02:11:33.826833 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:33.829709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b7747179-fd8b-479d-8517-3db29a07c88a tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:33.834975 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b7747179-fd8b-479d-8517-3db29a07c88a tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.026599 Aug 03 02:11:33.845726 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2156/4424] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:11:33 2022] POST /compute/v2.1/servers => generated 687 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:11:33.847772 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3aefefdb-9223-4150-b2de-2d28bfe714a6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.639531 Aug 03 02:11:33.850613 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2269/4425] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:33 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:33.881391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d2a5afef-788d-4bdd-82cb-f05ed8842aaf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:33.883331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d2a5afef-788d-4bdd-82cb-f05ed8842aaf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:33.909873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2a5afef-788d-4bdd-82cb-f05ed8842aaf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:33.910331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2a5afef-788d-4bdd-82cb-f05ed8842aaf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:33.911182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2a5afef-788d-4bdd-82cb-f05ed8842aaf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:33.918263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2a5afef-788d-4bdd-82cb-f05ed8842aaf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:34.023524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fe2e164f-bd68-489f-90b1-a56295c179ba tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1845322156", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5582670a-5513-4687-a4be-2162f4c8688b"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fe2e164f-bd68-489f-90b1-a56295c179ba tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Request method failure captured: Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 500 Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dk9ByairQ-uAJLHOocDC9pMV6cRR-tOYxGGfGTyPdQk1BGSc1cwue6TokUDe_oMXt_NDYBeS640idkIVEmVelMUzXdtoXuAv7y8qtr20tuZfbsPShwW71lgmZz9Hjf3a-e-ZWatHrg4BzjFpMKwQxBDHSTjaSwMEmFrcHlJfetvDw0 Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4368b80ba680454aa4000902157f20f9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4368b80ba680454aa4000902157f20f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}] Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 33f1e10b841a4b7988ac28fac1b01673 Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1845322156", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5582670a-5513-4687-a4be-2162f4c8688b"}]}} Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1845322156', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5582670a-5513-4687-a4be-2162f4c8688b'}]}}} Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 02:11:34.035452 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.039471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fe2e164f-bd68-489f-90b1-a56295c179ba tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:34.042614 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fe2e164f-bd68-489f-90b1-a56295c179ba tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.022744 Aug 03 02:11:34.051115 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2270/4426] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:11:34 2022] POST /compute/v2.1/servers => generated 689 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:11:34.337321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d716975-a705-41d6-a5d6-268b22044cf0 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-967086309", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5582670a-5513-4687-a4be-2162f4c8688b"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d716975-a705-41d6-a5d6-268b22044cf0 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Request method failure captured: Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 753 Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dk9ByairQ-uAJLHOocDC9pMV6cRR-tOYxGGfGTyPdQk1BGSc1cwue6TokUDe_oMXt_NDYBeS640idkIVEmVelMUzXdtoXuAv7y8qtr20tuZfbsPShwW71lgmZz9Hjf3a-e-ZWatHrg4BzjFpMKwQxBDHSTjaSwMEmFrcHlJfetvDw0 Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4368b80ba680454aa4000902157f20f9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4368b80ba680454aa4000902157f20f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}] Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 33f1e10b841a4b7988ac28fac1b01673 Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-967086309", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5582670a-5513-4687-a4be-2162f4c8688b"}]}} Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-967086309', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5582670a-5513-4687-a4be-2162f4c8688b'}]}}} Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:11:34.346068 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:11:34.349016 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:11:34.351823 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:34.351823 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.358437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d716975-a705-41d6-a5d6-268b22044cf0 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:34.363930 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6d716975-a705-41d6-a5d6-268b22044cf0 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.029634 Aug 03 02:11:34.366282 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2271/4427] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:11:34 2022] POST /compute/v2.1/servers => generated 1197 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 03 02:11:34.497401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-41c8f839-06fd-49a0-ae4e-fc7a607f9265 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-421739669", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5582670a-5513-4687-a4be-2162f4c8688b"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-41c8f839-06fd-49a0-ae4e-fc7a607f9265 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Request method failure captured: Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 1265 Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dk9ByairQ-uAJLHOocDC9pMV6cRR-tOYxGGfGTyPdQk1BGSc1cwue6TokUDe_oMXt_NDYBeS640idkIVEmVelMUzXdtoXuAv7y8qtr20tuZfbsPShwW71lgmZz9Hjf3a-e-ZWatHrg4BzjFpMKwQxBDHSTjaSwMEmFrcHlJfetvDw0 Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4368b80ba680454aa4000902157f20f9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4368b80ba680454aa4000902157f20f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}] Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 33f1e10b841a4b7988ac28fac1b01673 Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-421739669", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5582670a-5513-4687-a4be-2162f4c8688b"}]}} Aug 03 02:11:34.510012 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-421739669', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5582670a-5513-4687-a4be-2162f4c8688b'}]}}} Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.513286 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:11:34.514598 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:11:34.516793 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 02:11:34.516793 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.520391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-41c8f839-06fd-49a0-ae4e-fc7a607f9265 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:34.523034 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-41c8f839-06fd-49a0-ae4e-fc7a607f9265 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.032721 Aug 03 02:11:34.525185 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2272/4428] 10.222.0.67 () {60 vars in 1148 bytes} [Wed Aug 3 02:11:34 2022] POST /compute/v2.1/servers => generated 2221 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 03 02:11:34.542275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0edb867b-6b4e-4be8-8126-cce658e0d5b5 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:34.543142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0edb867b-6b4e-4be8-8126-cce658e0d5b5 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: a33976f7-fbf1-4dd9-97e5-5a4c130ac436] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:34.552291 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-0edb867b-6b4e-4be8-8126-cce658e0d5b5 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] HTTP exception thrown: Instance a33976f7-fbf1-4dd9-97e5-5a4c130ac436 could not be found. Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0edb867b-6b4e-4be8-8126-cce658e0d5b5 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Request method failure captured: Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/a33976f7-fbf1-4dd9-97e5-5a4c130ac436/metadata/test2 HTTP/1.1 Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dk9ByairQ-uAJLHOocDC9pMV6cRR-tOYxGGfGTyPdQk1BGSc1cwue6TokUDe_oMXt_NDYBeS640idkIVEmVelMUzXdtoXuAv7y8qtr20tuZfbsPShwW71lgmZz9Hjf3a-e-ZWatHrg4BzjFpMKwQxBDHSTjaSwMEmFrcHlJfetvDw0 Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4368b80ba680454aa4000902157f20f9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4368b80ba680454aa4000902157f20f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}] Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 33f1e10b841a4b7988ac28fac1b01673 Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance a33976f7-fbf1-4dd9-97e5-5a4c130ac436 could not be found. Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'server_id': 'a33976f7-fbf1-4dd9-97e5-5a4c130ac436', 'id': 'test2'} Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a33976f7-fbf1-4dd9-97e5-5a4c130ac436 could not be found. Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a33976f7-fbf1-4dd9-97e5-5a4c130ac436 could not be found. Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:34.554467 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:34.558811 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:34.558811 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:34.558811 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a33976f7-fbf1-4dd9-97e5-5a4c130ac436 could not be found. Aug 03 02:11:34.558811 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:34.560968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0edb867b-6b4e-4be8-8126-cce658e0d5b5 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Returning 404 to user: Instance a33976f7-fbf1-4dd9-97e5-5a4c130ac436 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:34.562207 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0edb867b-6b4e-4be8-8126-cce658e0d5b5 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/a33976f7-fbf1-4dd9-97e5-5a4c130ac436/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.028411 Aug 03 02:11:34.563483 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2273/4429] 10.222.0.67 () {58 vars in 1281 bytes} [Wed Aug 3 02:11:34 2022] GET /compute/v2.1/servers/a33976f7-fbf1-4dd9-97e5-5a4c130ac436/metadata/test2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:11:34.601880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5b75cf02-0aeb-4e11-a2b3-8da6914df96a tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:34.603079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5b75cf02-0aeb-4e11-a2b3-8da6914df96a tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:34.614869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b75cf02-0aeb-4e11-a2b3-8da6914df96a tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:34.615696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b75cf02-0aeb-4e11-a2b3-8da6914df96a tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:34.616974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b75cf02-0aeb-4e11-a2b3-8da6914df96a tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:34.617874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b75cf02-0aeb-4e11-a2b3-8da6914df96a tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:34.662825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5b75cf02-0aeb-4e11-a2b3-8da6914df96a tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:11:34.757553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d2a5afef-788d-4bdd-82cb-f05ed8842aaf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:34.767592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:11:34.779213 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d2a5afef-788d-4bdd-82cb-f05ed8842aaf tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.901944 Aug 03 02:11:34.803458 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2157/4430] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:33 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:34.855341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7c7ec7c3-e72b-4f22-a204-7135bb2a37f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:34.866221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7c7ec7c3-e72b-4f22-a204-7135bb2a37f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:34.916688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c7ec7c3-e72b-4f22-a204-7135bb2a37f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:34.917541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c7ec7c3-e72b-4f22-a204-7135bb2a37f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:34.920028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c7ec7c3-e72b-4f22-a204-7135bb2a37f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:34.921145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c7ec7c3-e72b-4f22-a204-7135bb2a37f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:34.935932 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5b75cf02-0aeb-4e11-a2b3-8da6914df96a tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "DELETE /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 204 len: 0 microversion: 2.1 time: 0.351867 Aug 03 02:11:34.939888 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2274/4431] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:11:34 2022] DELETE /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:11:34.954158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-38d708a5-a322-4dbb-876a-4741d072fad7 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:34.966486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-38d708a5-a322-4dbb-876a-4741d072fad7 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:34.986767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38d708a5-a322-4dbb-876a-4741d072fad7 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:34.991507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38d708a5-a322-4dbb-876a-4741d072fad7 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:34.993033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38d708a5-a322-4dbb-876a-4741d072fad7 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:34.993725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38d708a5-a322-4dbb-876a-4741d072fad7 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:35.826289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-38d708a5-a322-4dbb-876a-4741d072fad7 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f1e10b841a4b7988ac28fac1b01673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4368b80ba680454aa4000902157f20f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:35.865083 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-38d708a5-a322-4dbb-876a-4741d072fad7 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 200 len: 1526 microversion: 2.1 time: 0.919288 Aug 03 02:11:35.865945 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2275/4432] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:34 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 1526 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:35.881253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7c7ec7c3-e72b-4f22-a204-7135bb2a37f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:35.903485 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7c7ec7c3-e72b-4f22-a204-7135bb2a37f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 1.095374 Aug 03 02:11:35.904407 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2158/4433] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:34 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:35.928152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-14e88a67-dfcc-4ac5-9f7f-83e0fd4ac900 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:35.928793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-14e88a67-dfcc-4ac5-9f7f-83e0fd4ac900 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:35.943697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-14e88a67-dfcc-4ac5-9f7f-83e0fd4ac900 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:35.947114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-14e88a67-dfcc-4ac5-9f7f-83e0fd4ac900 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:35.948173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-14e88a67-dfcc-4ac5-9f7f-83e0fd4ac900 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:35.948774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-14e88a67-dfcc-4ac5-9f7f-83e0fd4ac900 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:36.192433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-14e88a67-dfcc-4ac5-9f7f-83e0fd4ac900 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:36.223211 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-14e88a67-dfcc-4ac5-9f7f-83e0fd4ac900 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.298277 Aug 03 02:11:36.225036 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2159/4434] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:35 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:36.260711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d48c9c71-858b-4d89-a039-cf258a58bef2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:36.264136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d48c9c71-858b-4d89-a039-cf258a58bef2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:36.280760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d48c9c71-858b-4d89-a039-cf258a58bef2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:36.281494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d48c9c71-858b-4d89-a039-cf258a58bef2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:36.283408 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d48c9c71-858b-4d89-a039-cf258a58bef2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:36.284704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d48c9c71-858b-4d89-a039-cf258a58bef2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:36.411463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d48c9c71-858b-4d89-a039-cf258a58bef2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Locking {{(pid=125942) lock /opt/stack/nova/nova/compute/api.py:4781}} Aug 03 02:11:36.533071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-86240c3e-eb70-4491-a02e-351f75824a40 tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] Action: 'create', calling method: .version_select at 0x7f5b125d2a60>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:36.561031 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d48c9c71-858b-4d89-a039-cf258a58bef2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.316912 Aug 03 02:11:36.561884 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2160/4435] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:36 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:11:36.578784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8ad88b3-260c-4223-8d08-85432c264e21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:36.579657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b8ad88b3-260c-4223-8d08-85432c264e21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:36.587328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8ad88b3-260c-4223-8d08-85432c264e21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:36.591573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8ad88b3-260c-4223-8d08-85432c264e21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:36.592957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8ad88b3-260c-4223-8d08-85432c264e21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:36.593360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-86240c3e-eb70-4491-a02e-351f75824a40 tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] Getting quotas for project a26d89b59619411f9dad4eaca6494259. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:11:36.594649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8ad88b3-260c-4223-8d08-85432c264e21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:36.614255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-86240c3e-eb70-4491-a02e-351f75824a40 tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] Getting quotas for user 23f88edd59f44007a5f9d9bcbe5d46e1 and project a26d89b59619411f9dad4eaca6494259. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:11:36.744443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-86240c3e-eb70-4491-a02e-351f75824a40 tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] Getting quotas for project a26d89b59619411f9dad4eaca6494259. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:11:36.756589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-86240c3e-eb70-4491-a02e-351f75824a40 tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] Getting quotas for user 23f88edd59f44007a5f9d9bcbe5d46e1 and project a26d89b59619411f9dad4eaca6494259. Resources: {'server_groups'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:11:36.780597 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-86240c3e-eb70-4491-a02e-351f75824a40 tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] 10.222.0.67 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.899275 Aug 03 02:11:36.781932 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2276/4436] 10.222.0.67 () {62 vars in 1214 bytes} [Wed Aug 3 02:11:35 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:11:36.793877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2c45f358-c9bc-4b9e-878c-83b65617f2cb tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:36.811361 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2c45f358-c9bc-4b9e-878c-83b65617f2cb tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.021766 Aug 03 02:11:36.818443 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2277/4437] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 3 02:11:36 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 02:11:36.825126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-782494f0-cdb9-4101-a413-997a7dddd666 tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:36.839750 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-782494f0-cdb9-4101-a413-997a7dddd666 tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] 10.222.0.67 "GET /compute/v2.1/os-server-groups/4d07b917-1004-4eaf-8a91-f13b4ed5642c" status: 200 len: 235 microversion: 2.64 time: 0.019861 Aug 03 02:11:36.847085 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2278/4438] 10.222.0.67 () {60 vars in 1304 bytes} [Wed Aug 3 02:11:36 2022] GET /compute/v2.1/os-server-groups/4d07b917-1004-4eaf-8a91-f13b4ed5642c => generated 235 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:11:36.852817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03f25399-9063-4358-aab5-9443d406ca9e tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:36.887202 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03f25399-9063-4358-aab5-9443d406ca9e tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/4d07b917-1004-4eaf-8a91-f13b4ed5642c" status: 204 len: 0 microversion: 2.64 time: 0.037451 Aug 03 02:11:36.893753 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2279/4439] 10.222.0.67 () {60 vars in 1307 bytes} [Wed Aug 3 02:11:36 2022] DELETE /compute/v2.1/os-server-groups/4d07b917-1004-4eaf-8a91-f13b4ed5642c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 02:11:36.905317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0e8178f2-0a2d-400d-a406-13ab51f40ba1 tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:36.927180 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-0e8178f2-0a2d-400d-a406-13ab51f40ba1 tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] HTTP exception thrown: Instance group 4d07b917-1004-4eaf-8a91-f13b4ed5642c could not be found. Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0e8178f2-0a2d-400d-a406-13ab51f40ba1 tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] Request method failure captured: Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/os-server-groups/4d07b917-1004-4eaf-8a91-f13b4ed5642c HTTP/1.1 Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dlX1-r9WT2vccTte_jrctaI7QiBXleTiWeV61QAewrG_sCqz0nltoJdFmmFwOZJzspiZaudDtuaVPmbZJdaZnqwFDwJXj3lTNXVt9XO5KgElS-CufzA3QJgmcsjdSvOWS8rzSQBoKyZELM6M2dwfX3TeQ1pzG84cZUBSrZoDSfTuiU Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Openstack-Nova-Api-Version: 2.64 Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a26d89b59619411f9dad4eaca6494259 Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerGroup264TestJSON-586385374 Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a26d89b59619411f9dad4eaca6494259", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a26d89b59619411f9dad4eaca6494259"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a26d89b59619411f9dad4eaca6494259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a26d89b59619411f9dad4eaca6494259"}]}] Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerGroup264TestJSON-586385374 Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a26d89b59619411f9dad4eaca6494259 Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerGroup264TestJSON-586385374 Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerGroup264TestJSON-586385374-project Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 23f88edd59f44007a5f9d9bcbe5d46e1 Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerGroup264TestJSON-586385374-project Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance group 4d07b917-1004-4eaf-8a91-f13b4ed5642c could not be found. Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '4d07b917-1004-4eaf-8a91-f13b4ed5642c'} Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4d07b917-1004-4eaf-8a91-f13b4ed5642c could not be found. Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4d07b917-1004-4eaf-8a91-f13b4ed5642c could not be found. Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:36.934494 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:36.938551 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:36.938551 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:36.938551 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:36.938551 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:36.938551 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4d07b917-1004-4eaf-8a91-f13b4ed5642c could not be found. Aug 03 02:11:36.938551 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:36.938551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0e8178f2-0a2d-400d-a406-13ab51f40ba1 tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] Returning 404 to user: Instance group 4d07b917-1004-4eaf-8a91-f13b4ed5642c could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:36.938551 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0e8178f2-0a2d-400d-a406-13ab51f40ba1 tempest-ServerGroup264TestJSON-586385374 tempest-ServerGroup264TestJSON-586385374-project] 10.222.0.67 "DELETE /compute/v2.1/os-server-groups/4d07b917-1004-4eaf-8a91-f13b4ed5642c" status: 404 len: 117 microversion: 2.64 time: 0.043387 Aug 03 02:11:36.947373 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2280/4440] 10.222.0.67 () {60 vars in 1307 bytes} [Wed Aug 3 02:11:36 2022] DELETE /compute/v2.1/os-server-groups/4d07b917-1004-4eaf-8a91-f13b4ed5642c => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:11:36.966790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0bf0fef8-4577-492c-9c72-b82e1e025c70 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:36.968249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0bf0fef8-4577-492c-9c72-b82e1e025c70 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:36.982486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0bf0fef8-4577-492c-9c72-b82e1e025c70 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:36.984151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0bf0fef8-4577-492c-9c72-b82e1e025c70 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:36.986043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0bf0fef8-4577-492c-9c72-b82e1e025c70 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:36.987864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0bf0fef8-4577-492c-9c72-b82e1e025c70 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:37.192732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b8ad88b3-260c-4223-8d08-85432c264e21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:37.212349 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b8ad88b3-260c-4223-8d08-85432c264e21 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.645208 Aug 03 02:11:37.213946 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2161/4441] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:36 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:37.237990 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-57ea3bfe-f121-4806-9ce6-19c747e11d22 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:37.246040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57ea3bfe-f121-4806-9ce6-19c747e11d22 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:37.246976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57ea3bfe-f121-4806-9ce6-19c747e11d22 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:37.282967 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-57ea3bfe-f121-4806-9ce6-19c747e11d22 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] HTTP exception thrown: Instance b9952a14-056b-4b74-ab8c-791d16592ddf is locked Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-57ea3bfe-f121-4806-9ce6-19c747e11d22 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Request method failure captured: Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action HTTP/1.1 Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 15 Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6df8mzZ3op7XNnKY_UCFCR6MPbbyfjOys4kmOBvkKHV2qDe9Fyys3uKhJfh_39tezd9aHqonpFYZZGQSeJeTgK84SqB4Y74nmH4cxQ8rcI-W4Fn03C7HP3Ydy871oWmRtIwg7DG8sJHY1cKroLuk5OooXB-A6cxd4eXUP5RSU84l2rU Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 43ed3dcb7307452b965ee2d303ffaecd Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_43ed3dcb7307452b965ee2d303ffaecd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43ed3dcb7307452b965ee2d303ffaecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/43ed3dcb7307452b965ee2d303ffaecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43ed3dcb7307452b965ee2d303ffaecd"}]}] Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 43ed3dcb7307452b965ee2d303ffaecd Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerActionsTestJSON-2133022977-project Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: c6ac519db80b4ba99d67bd5db59be619 Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerActionsTestJSON-2133022977-project Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: {"os-stop": {}} Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance b9952a14-056b-4b74-ab8c-791d16592ddf is locked Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'b9952a14-056b-4b74-ab8c-791d16592ddf', 'body': {'os-stop': {}}} Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance b9952a14-056b-4b74-ab8c-791d16592ddf is locked Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance b9952a14-056b-4b74-ab8c-791d16592ddf is locked Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9952a14-056b-4b74-ab8c-791d16592ddf is locked Aug 03 02:11:37.285501 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:37.293200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-57ea3bfe-f121-4806-9ce6-19c747e11d22 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Returning 409 to user: Instance b9952a14-056b-4b74-ab8c-791d16592ddf is locked {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:37.295297 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-57ea3bfe-f121-4806-9ce6-19c747e11d22 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 409 len: 107 microversion: 2.1 time: 0.062886 Aug 03 02:11:37.302386 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2162/4442] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:37 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 107 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:11:37.312883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9e38abac-94c4-47f6-af97-ff8d6ab09e0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:37.315573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9e38abac-94c4-47f6-af97-ff8d6ab09e0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:37.327016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e38abac-94c4-47f6-af97-ff8d6ab09e0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:37.327835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e38abac-94c4-47f6-af97-ff8d6ab09e0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:37.328820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e38abac-94c4-47f6-af97-ff8d6ab09e0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:37.329474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e38abac-94c4-47f6-af97-ff8d6ab09e0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:37.416308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:11:37.436061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9e38abac-94c4-47f6-af97-ff8d6ab09e0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Unlocking {{(pid=125942) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 03 02:11:37.579965 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9e38abac-94c4-47f6-af97-ff8d6ab09e0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.275733 Aug 03 02:11:37.580723 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2163/4443] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:37 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:11:37.590419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7c0005a6-8f0e-4fc6-8b06-f31e09e3f97c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:37.600997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c0005a6-8f0e-4fc6-8b06-f31e09e3f97c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:37.607251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c0005a6-8f0e-4fc6-8b06-f31e09e3f97c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:37.671708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7c0005a6-8f0e-4fc6-8b06-f31e09e3f97c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Going to try to stop instance {{(pid=125942) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 02:11:37.803255 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7c0005a6-8f0e-4fc6-8b06-f31e09e3f97c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.216842 Aug 03 02:11:37.820199 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2164/4444] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:37 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 02:11:37.849625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5cb39a12-fbc2-4497-9573-6177dc764e3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:37.852048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5cb39a12-fbc2-4497-9573-6177dc764e3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:37.883174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cb39a12-fbc2-4497-9573-6177dc764e3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:37.883665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cb39a12-fbc2-4497-9573-6177dc764e3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:37.887980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cb39a12-fbc2-4497-9573-6177dc764e3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:37.888485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cb39a12-fbc2-4497-9573-6177dc764e3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:38.249564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0bf0fef8-4577-492c-9c72-b82e1e025c70 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f1e10b841a4b7988ac28fac1b01673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4368b80ba680454aa4000902157f20f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:38.276705 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0bf0fef8-4577-492c-9c72-b82e1e025c70 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 200 len: 1526 microversion: 2.1 time: 1.317535 Aug 03 02:11:38.279283 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2281/4445] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:36 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 1526 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:38.591684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5cb39a12-fbc2-4497-9573-6177dc764e3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:38.607668 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5cb39a12-fbc2-4497-9573-6177dc764e3f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 0.785717 Aug 03 02:11:38.612481 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2165/4446] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:37 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:39.306804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-efa196da-5cae-4910-80ba-e2d6e70d3600 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:39.308445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-efa196da-5cae-4910-80ba-e2d6e70d3600 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:39.332022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-efa196da-5cae-4910-80ba-e2d6e70d3600 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:39.332783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-efa196da-5cae-4910-80ba-e2d6e70d3600 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:39.333821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-efa196da-5cae-4910-80ba-e2d6e70d3600 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:39.334468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-efa196da-5cae-4910-80ba-e2d6e70d3600 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:39.634731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-efa196da-5cae-4910-80ba-e2d6e70d3600 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f1e10b841a4b7988ac28fac1b01673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4368b80ba680454aa4000902157f20f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:39.649428 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-efa196da-5cae-4910-80ba-e2d6e70d3600 tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 200 len: 1484 microversion: 2.1 time: 0.351918 Aug 03 02:11:39.651504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c681d9e6-e3b7-421b-a2d7-09792c564c4e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:39.652169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c681d9e6-e3b7-421b-a2d7-09792c564c4e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:39.656405 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2282/4447] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:39 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 1484 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:39.686851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c681d9e6-e3b7-421b-a2d7-09792c564c4e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:39.688365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c681d9e6-e3b7-421b-a2d7-09792c564c4e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:39.689703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c681d9e6-e3b7-421b-a2d7-09792c564c4e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:39.690336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c681d9e6-e3b7-421b-a2d7-09792c564c4e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:39.766027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-b64cd4e2-3197-4336-a663-b365ea5e0a6b req-a7a838d9-40c4-41bd-b570-3775d9b2e9ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb6497d-c422-4a88-b3f3-96d87624134e", "name": "network-vif-deleted", "tag": "a202008a-35c3-41d3-885f-d0ebe073b501"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:39.786746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b64cd4e2-3197-4336-a663-b365ea5e0a6b req-a7a838d9-40c4-41bd-b570-3775d9b2e9ef service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:39.789665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b64cd4e2-3197-4336-a663-b365ea5e0a6b req-a7a838d9-40c4-41bd-b570-3775d9b2e9ef service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:39.845893 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-b64cd4e2-3197-4336-a663-b365ea5e0a6b req-a7a838d9-40c4-41bd-b570-3775d9b2e9ef service nova] Creating event network-vif-deleted:a202008a-35c3-41d3-885f-d0ebe073b501 for instance abb6497d-c422-4a88-b3f3-96d87624134e on n-h2-826529-8 Aug 03 02:11:39.874295 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-b64cd4e2-3197-4336-a663-b365ea5e0a6b req-a7a838d9-40c4-41bd-b570-3775d9b2e9ef service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110733 Aug 03 02:11:39.883194 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2283/4448] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:11:40.209991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c681d9e6-e3b7-421b-a2d7-09792c564c4e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:40.232052 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c681d9e6-e3b7-421b-a2d7-09792c564c4e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 0.596458 Aug 03 02:11:40.233500 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2166/4449] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:39 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:40.707197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a9ad0afd-1639-417f-87f3-f1092468709b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:40.707197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a9ad0afd-1639-417f-87f3-f1092468709b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] [instance: abb6497d-c422-4a88-b3f3-96d87624134e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:40.741975 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9ad0afd-1639-417f-87f3-f1092468709b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:40.742958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9ad0afd-1639-417f-87f3-f1092468709b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:40.744049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9ad0afd-1639-417f-87f3-f1092468709b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:40.744593 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9ad0afd-1639-417f-87f3-f1092468709b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:40.776632 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-a9ad0afd-1639-417f-87f3-f1092468709b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] HTTP exception thrown: Instance abb6497d-c422-4a88-b3f3-96d87624134e could not be found. Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a9ad0afd-1639-417f-87f3-f1092468709b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Request method failure captured: Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e HTTP/1.1 Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dk9ByairQ-uAJLHOocDC9pMV6cRR-tOYxGGfGTyPdQk1BGSc1cwue6TokUDe_oMXt_NDYBeS640idkIVEmVelMUzXdtoXuAv7y8qtr20tuZfbsPShwW71lgmZz9Hjf3a-e-ZWatHrg4BzjFpMKwQxBDHSTjaSwMEmFrcHlJfetvDw0 Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4368b80ba680454aa4000902157f20f9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4368b80ba680454aa4000902157f20f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4368b80ba680454aa4000902157f20f9"}]}] Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 4368b80ba680454aa4000902157f20f9 Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-215652431 Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 33f1e10b841a4b7988ac28fac1b01673 Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-215652431-project Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance abb6497d-c422-4a88-b3f3-96d87624134e could not be found. Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'abb6497d-c422-4a88-b3f3-96d87624134e'} Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb6497d-c422-4a88-b3f3-96d87624134e could not be found. Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb6497d-c422-4a88-b3f3-96d87624134e could not be found. Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:40.787283 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:40.793111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:40.793111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:40.793111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:40.793111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:40.793111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:40.793111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:40.793111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb6497d-c422-4a88-b3f3-96d87624134e could not be found. Aug 03 02:11:40.793111 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:11:40.802822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a9ad0afd-1639-417f-87f3-f1092468709b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] Returning 404 to user: Instance abb6497d-c422-4a88-b3f3-96d87624134e could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:40.807896 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a9ad0afd-1639-417f-87f3-f1092468709b tempest-ServerMetadataNegativeTestJSON-215652431 tempest-ServerMetadataNegativeTestJSON-215652431-project] 10.222.0.67 "GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e" status: 404 len: 111 microversion: 2.1 time: 0.119198 Aug 03 02:11:40.812284 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2284/4450] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:40 2022] GET /compute/v2.1/servers/abb6497d-c422-4a88-b3f3-96d87624134e => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:11:41.271984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dfb1b56f-6c27-408b-b698-fc6693cdde53 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:41.272718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dfb1b56f-6c27-408b-b698-fc6693cdde53 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:41.295173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dfb1b56f-6c27-408b-b698-fc6693cdde53 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:41.295806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dfb1b56f-6c27-408b-b698-fc6693cdde53 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:41.301876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dfb1b56f-6c27-408b-b698-fc6693cdde53 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:41.303126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dfb1b56f-6c27-408b-b698-fc6693cdde53 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:41.832640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dfb1b56f-6c27-408b-b698-fc6693cdde53 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:41.842844 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dfb1b56f-6c27-408b-b698-fc6693cdde53 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 0.576476 Aug 03 02:11:41.843475 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2167/4451] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:41 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:42.868129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-266d02f0-cc89-4529-a7d3-7151c3a5541d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:42.869079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-266d02f0-cc89-4529-a7d3-7151c3a5541d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:42.884344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-266d02f0-cc89-4529-a7d3-7151c3a5541d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:42.885999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-266d02f0-cc89-4529-a7d3-7151c3a5541d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:42.890343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-266d02f0-cc89-4529-a7d3-7151c3a5541d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:42.890834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-266d02f0-cc89-4529-a7d3-7151c3a5541d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:42.894221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0a33a5fe-1947-4682-bc10-2d29ce80e8d0 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] Action: 'create', calling method: .version_select at 0x7f5b12a34700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-232636019", "metadata": {"Type": "work"}}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:44.043657 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0a33a5fe-1947-4682-bc10-2d29ce80e8d0 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.692047 Aug 03 02:11:44.066514 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2285/4452] 10.222.0.67 () {60 vars in 1156 bytes} [Wed Aug 3 02:11:42 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1722 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 03 02:11:44.086199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d3bd1200-7e26-4d05-acf7-2f0a5d14dad6 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] Calling method '.version_select at 0x7f5b243b93a0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:44.266001 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d3bd1200-7e26-4d05-acf7-2f0a5d14dad6 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36" status: 200 len: 352 microversion: 2.1 time: 0.197053 Aug 03 02:11:44.266774 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2286/4453] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:11:44 2022] GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36 => generated 352 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:11:44.401173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-266d02f0-cc89-4529-a7d3-7151c3a5541d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:44.417119 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-266d02f0-cc89-4529-a7d3-7151c3a5541d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 1.555564 Aug 03 02:11:44.432942 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2168/4454] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:42 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:11:45.289479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0b3d5256-b67d-464e-9ba0-02287fa34a79 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] Calling method '.version_select at 0x7f5b12538f70>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:45.417649 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0b3d5256-b67d-464e-9ba0-02287fa34a79 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36" status: 200 len: 352 microversion: 2.1 time: 0.132997 Aug 03 02:11:45.419284 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2287/4455] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:11:45 2022] GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36 => generated 352 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:11:45.442321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4e991dd6-c16a-44c4-8f92-1c6421f10cfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:45.444351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4e991dd6-c16a-44c4-8f92-1c6421f10cfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:45.461183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e991dd6-c16a-44c4-8f92-1c6421f10cfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:45.467701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e991dd6-c16a-44c4-8f92-1c6421f10cfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:45.469109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e991dd6-c16a-44c4-8f92-1c6421f10cfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:45.470348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e991dd6-c16a-44c4-8f92-1c6421f10cfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:46.073820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4e991dd6-c16a-44c4-8f92-1c6421f10cfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:46.092750 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4e991dd6-c16a-44c4-8f92-1c6421f10cfe tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 0.655368 Aug 03 02:11:46.093349 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2169/4456] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:45 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:46.438832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8898274-a4bf-47f2-bb8a-d1e0172e6e54 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] Calling method '.version_select at 0x7f5b128ced30>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:46.561442 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8898274-a4bf-47f2-bb8a-d1e0172e6e54 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36" status: 200 len: 353 microversion: 2.1 time: 0.128593 Aug 03 02:11:46.562295 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2288/4457] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:11:46 2022] GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36 => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:11:46.578136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-21492a94-e74b-4df7-95cc-f4127d65d102 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] Calling method '.version_select at 0x7f5b127c6700>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:46.690822 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-21492a94-e74b-4df7-95cc-f4127d65d102 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36" status: 200 len: 353 microversion: 2.1 time: 0.118828 Aug 03 02:11:46.691765 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2170/4458] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:11:46 2022] GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:11:46.707680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4adf3bb6-4aee-4fbb-afe0-30502c1cc243 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] Calling method '.version_select at 0x7f5b243b9940>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:46.769485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:11:46.945361 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4adf3bb6-4aee-4fbb-afe0-30502c1cc243 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36" status: 202 len: 0 microversion: 2.1 time: 0.243580 Aug 03 02:11:46.946339 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2289/4459] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 02:11:46 2022] DELETE /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:11:46.957351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-82440f9d-b06c-431c-bc76-95eeb98c0544 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] Calling method '.version_select at 0x7f5b12839e50>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:47.099962 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-82440f9d-b06c-431c-bc76-95eeb98c0544 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36" status: 200 len: 352 microversion: 2.1 time: 0.148951 Aug 03 02:11:47.100479 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2171/4460] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:11:46 2022] GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36 => generated 352 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:11:47.124195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-30e7e525-7d4e-491b-80ec-278752d43e9f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:47.124957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-30e7e525-7d4e-491b-80ec-278752d43e9f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:47.141640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30e7e525-7d4e-491b-80ec-278752d43e9f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:47.142105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30e7e525-7d4e-491b-80ec-278752d43e9f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:47.144096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30e7e525-7d4e-491b-80ec-278752d43e9f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:47.144557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30e7e525-7d4e-491b-80ec-278752d43e9f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:47.793105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-30e7e525-7d4e-491b-80ec-278752d43e9f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:47.801067 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-30e7e525-7d4e-491b-80ec-278752d43e9f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 0.683035 Aug 03 02:11:47.801666 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2290/4461] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:47 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:48.118588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-23d69333-7875-43ee-9559-409a331240c2 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] Calling method '.version_select at 0x7f5b132efe50>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:48.274833 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-23d69333-7875-43ee-9559-409a331240c2 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36" status: 200 len: 352 microversion: 2.1 time: 0.163522 Aug 03 02:11:48.276165 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2172/4462] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:11:48 2022] GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36 => generated 352 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:11:48.339373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-10355ebd-0cab-4aed-ba03-6067315aa07e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:48.340654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-10355ebd-0cab-4aed-ba03-6067315aa07e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:48.366863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10355ebd-0cab-4aed-ba03-6067315aa07e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:48.366863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10355ebd-0cab-4aed-ba03-6067315aa07e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:48.366863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10355ebd-0cab-4aed-ba03-6067315aa07e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:48.366863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10355ebd-0cab-4aed-ba03-6067315aa07e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:48.462494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-10355ebd-0cab-4aed-ba03-6067315aa07e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:11:48.698764 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-10355ebd-0cab-4aed-ba03-6067315aa07e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 204 len: 0 microversion: 2.1 time: 0.332876 Aug 03 02:11:48.700786 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2291/4463] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:11:48 2022] DELETE /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:11:48.711192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c8f42660-c498-47ee-866e-8b359675be06 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:48.712085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c8f42660-c498-47ee-866e-8b359675be06 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:48.736426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8f42660-c498-47ee-866e-8b359675be06 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:48.738867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8f42660-c498-47ee-866e-8b359675be06 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:48.739953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8f42660-c498-47ee-866e-8b359675be06 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:48.742160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8f42660-c498-47ee-866e-8b359675be06 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:48.825510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6a48868a-b57a-4172-8733-b8cb23f797dd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:48.827616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6a48868a-b57a-4172-8733-b8cb23f797dd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:48.857175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a48868a-b57a-4172-8733-b8cb23f797dd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:48.857939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a48868a-b57a-4172-8733-b8cb23f797dd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:48.863991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a48868a-b57a-4172-8733-b8cb23f797dd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:48.864917 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a48868a-b57a-4172-8733-b8cb23f797dd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:49.362137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c8f42660-c498-47ee-866e-8b359675be06 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:49.377080 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c8f42660-c498-47ee-866e-8b359675be06 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1552 microversion: 2.1 time: 0.670821 Aug 03 02:11:49.380547 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2173/4464] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:48 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1552 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:49.398080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4b5f77fe-276f-4301-af7e-34451dd4122f tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] Calling method '.version_select at 0x7f5b13029310>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:49.522897 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4b5f77fe-276f-4301-af7e-34451dd4122f tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36" status: 200 len: 352 microversion: 2.1 time: 0.137942 Aug 03 02:11:49.523728 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2174/4465] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:11:49 2022] GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36 => generated 352 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:11:49.563738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6a48868a-b57a-4172-8733-b8cb23f797dd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:49.583078 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6a48868a-b57a-4172-8733-b8cb23f797dd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 0.760499 Aug 03 02:11:49.583988 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2292/4466] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:48 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:50.405244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d635ad7-9521-43ff-8530-9c60569d7c63 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:50.405244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8d635ad7-9521-43ff-8530-9c60569d7c63 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:50.427314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d635ad7-9521-43ff-8530-9c60569d7c63 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:50.427886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d635ad7-9521-43ff-8530-9c60569d7c63 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:50.428722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d635ad7-9521-43ff-8530-9c60569d7c63 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:50.429316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d635ad7-9521-43ff-8530-9c60569d7c63 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:50.538049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd53649e-643a-4e85-bc80-6a342ead30d9 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] Calling method '.version_select at 0x7f5b12a349d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:50.678177 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cd53649e-643a-4e85-bc80-6a342ead30d9 tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36" status: 200 len: 352 microversion: 2.1 time: 0.144124 Aug 03 02:11:50.679394 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2293/4467] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:11:50 2022] GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36 => generated 352 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:11:50.688524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2b5eac1c-7f00-4dea-bad0-8575e03912e5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:50.690601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2b5eac1c-7f00-4dea-bad0-8575e03912e5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:50.718341 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b5eac1c-7f00-4dea-bad0-8575e03912e5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:50.719368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b5eac1c-7f00-4dea-bad0-8575e03912e5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:50.721070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b5eac1c-7f00-4dea-bad0-8575e03912e5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:50.721687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b5eac1c-7f00-4dea-bad0-8575e03912e5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:51.299160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8d635ad7-9521-43ff-8530-9c60569d7c63 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:51.317439 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8d635ad7-9521-43ff-8530-9c60569d7c63 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1552 microversion: 2.1 time: 0.919157 Aug 03 02:11:51.321088 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2175/4468] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:50 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1552 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:51.698066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8ec11d6c-013f-44df-9851-79df1e2c8c6b tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] Calling method '.version_select at 0x7f5b128498b0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:51.793873 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-8ec11d6c-013f-44df-9851-79df1e2c8c6b tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] HTTP exception thrown: Volume 712fad7d-5ec1-4870-a734-3ea62c31ad36 could not be found. Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8ec11d6c-013f-44df-9851-79df1e2c8c6b tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] Request method failure captured: Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36 HTTP/1.1 Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dleDM1qTFVp2hMlFYB_iGkQQ_qK-8s7G4Lf3Yo26Gzst491gvgBJ9HyxHrTzBLGLi8Z5OyOkPKxuvuiRZVrsFmuF9kZ339FyloA0b60juHP-AyBVhoBQEVUK4JxYjuEcbyLwBckPOm3PULUo8z-jrp7_X8HRR7nfv8fr9co0NkB_GI Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: cba90416b77848fca850db6f3ee1de81 Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-VolumesGetTestJSON-1843130523 Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cba90416b77848fca850db6f3ee1de81", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cba90416b77848fca850db6f3ee1de81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cba90416b77848fca850db6f3ee1de81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cba90416b77848fca850db6f3ee1de81"}]}] Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-VolumesGetTestJSON-1843130523 Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: cba90416b77848fca850db6f3ee1de81 Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-VolumesGetTestJSON-1843130523 Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-VolumesGetTestJSON-1843130523-project Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: eb7081a521484d5486eb622c27a7b6bb Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-VolumesGetTestJSON-1843130523-project Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: exception: Volume 712fad7d-5ec1-4870-a734-3ea62c31ad36 could not be found. Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '712fad7d-5ec1-4870-a734-3ea62c31ad36'} Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 712fad7d-5ec1-4870-a734-3ea62c31ad36 could not be found. (HTTP 404) (Request-ID: req-83b6a41a-999e-4d1d-803b-00a792e9b11c) Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 02:11:51.797789 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 712fad7d-5ec1-4870-a734-3ea62c31ad36 could not be found. Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 712fad7d-5ec1-4870-a734-3ea62c31ad36 could not be found. Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 712fad7d-5ec1-4870-a734-3ea62c31ad36 could not be found. Aug 03 02:11:51.802683 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:51.806884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8ec11d6c-013f-44df-9851-79df1e2c8c6b tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] Returning 404 to user: Volume 712fad7d-5ec1-4870-a734-3ea62c31ad36 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:51.809014 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8ec11d6c-013f-44df-9851-79df1e2c8c6b tempest-VolumesGetTestJSON-1843130523 tempest-VolumesGetTestJSON-1843130523-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36" status: 404 len: 109 microversion: 2.1 time: 0.117478 Aug 03 02:11:51.822521 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2176/4469] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:11:51 2022] GET /compute/v2.1/os-volumes/712fad7d-5ec1-4870-a734-3ea62c31ad36 => generated 109 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:11:52.015513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2b5eac1c-7f00-4dea-bad0-8575e03912e5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:52.023485 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2b5eac1c-7f00-4dea-bad0-8575e03912e5 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 1.342724 Aug 03 02:11:52.027616 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2294/4470] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:50 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:52.350794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-88850a72-c467-4811-afbc-d3086b413557 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:52.352282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-88850a72-c467-4811-afbc-d3086b413557 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:52.372864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88850a72-c467-4811-afbc-d3086b413557 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:52.373742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88850a72-c467-4811-afbc-d3086b413557 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:52.374944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88850a72-c467-4811-afbc-d3086b413557 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:52.375648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88850a72-c467-4811-afbc-d3086b413557 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:53.050500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2058c312-4011-4166-a4b4-44f6bf6db1a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:53.051809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2058c312-4011-4166-a4b4-44f6bf6db1a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:53.066656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2058c312-4011-4166-a4b4-44f6bf6db1a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:53.075966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2058c312-4011-4166-a4b4-44f6bf6db1a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:53.077229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2058c312-4011-4166-a4b4-44f6bf6db1a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:53.077916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2058c312-4011-4166-a4b4-44f6bf6db1a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:53.703968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-88850a72-c467-4811-afbc-d3086b413557 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:53.732342 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-88850a72-c467-4811-afbc-d3086b413557 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 200 len: 1552 microversion: 2.1 time: 1.377995 Aug 03 02:11:53.742832 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2177/4471] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:52 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 1552 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:53.907741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-db9feb6c-511a-40b3-8144-c7fb47897d8b req-a38d432a-f324-46c6-ac39-f4b7602ba6aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed61492-84f4-4825-9ac8-4d13e3f52bd7", "name": "network-vif-deleted", "tag": "eb32816b-ff25-406e-9a72-c85290dc832f"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:53.978255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-db9feb6c-511a-40b3-8144-c7fb47897d8b req-a38d432a-f324-46c6-ac39-f4b7602ba6aa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:53.978739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-db9feb6c-511a-40b3-8144-c7fb47897d8b req-a38d432a-f324-46c6-ac39-f4b7602ba6aa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:54.056521 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-db9feb6c-511a-40b3-8144-c7fb47897d8b req-a38d432a-f324-46c6-ac39-f4b7602ba6aa service nova] Creating event network-vif-deleted:eb32816b-ff25-406e-9a72-c85290dc832f for instance 2ed61492-84f4-4825-9ac8-4d13e3f52bd7 on n-h2-826529-8 Aug 03 02:11:54.059768 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2058c312-4011-4166-a4b4-44f6bf6db1a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:54.076322 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-db9feb6c-511a-40b3-8144-c7fb47897d8b req-a38d432a-f324-46c6-ac39-f4b7602ba6aa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176502 Aug 03 02:11:54.081007 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2178/4472] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:11:54.091370 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2058c312-4011-4166-a4b4-44f6bf6db1a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 1.037357 Aug 03 02:11:54.101744 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2295/4473] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:53 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:11:54.763577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c8df9792-511c-4016-b729-85b68ab72b77 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:54.764863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c8df9792-511c-4016-b729-85b68ab72b77 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 2ed61492-84f4-4825-9ac8-4d13e3f52bd7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:54.783209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8df9792-511c-4016-b729-85b68ab72b77 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:54.784060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8df9792-511c-4016-b729-85b68ab72b77 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:54.785132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8df9792-511c-4016-b729-85b68ab72b77 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:54.785849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8df9792-511c-4016-b729-85b68ab72b77 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:54.828554 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-c8df9792-511c-4016-b729-85b68ab72b77 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] HTTP exception thrown: Instance 2ed61492-84f4-4825-9ac8-4d13e3f52bd7 could not be found. Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c8df9792-511c-4016-b729-85b68ab72b77 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Request method failure captured: Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 HTTP/1.1 Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6diZeEEjiGzAcmk6N3GrsvuSSfJa8t-_aovLDCAXQm2xQTm33vEGpolDBlHiFlzKq6sp-ZuiHN5qDQ66gUJfha9nUxbNi-5TwYU5GrNfnPL9YtuBPdd8XVzKazw-zqiOhVbXgQyCFciFIcruufj-juJy4hSW-ROXyKVKRMqApPpv79g Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: f90284be975b4e459cdc3e72c1664630 Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestNetworkBasicOps-1604073491 Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f90284be975b4e459cdc3e72c1664630", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f90284be975b4e459cdc3e72c1664630"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f90284be975b4e459cdc3e72c1664630"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f90284be975b4e459cdc3e72c1664630"}]}] Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestNetworkBasicOps-1604073491 Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: f90284be975b4e459cdc3e72c1664630 Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestNetworkBasicOps-1604073491 Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestNetworkBasicOps-1604073491-project Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: c1ab5d1fb4b1453b9ba37a2b1194ec79 Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestNetworkBasicOps-1604073491-project Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 2ed61492-84f4-4825-9ac8-4d13e3f52bd7 could not be found. Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '2ed61492-84f4-4825-9ac8-4d13e3f52bd7'} Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed61492-84f4-4825-9ac8-4d13e3f52bd7 could not be found. Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed61492-84f4-4825-9ac8-4d13e3f52bd7 could not be found. Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:11:54.833847 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:54.838329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:11:54.838329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:11:54.838329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:11:54.838329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:11:54.838329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:11:54.838329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed61492-84f4-4825-9ac8-4d13e3f52bd7 could not be found. Aug 03 02:11:54.838329 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:11:54.841352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c8df9792-511c-4016-b729-85b68ab72b77 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Returning 404 to user: Instance 2ed61492-84f4-4825-9ac8-4d13e3f52bd7 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:11:54.842436 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c8df9792-511c-4016-b729-85b68ab72b77 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7" status: 404 len: 111 microversion: 2.1 time: 0.085401 Aug 03 02:11:54.848017 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2179/4474] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:54 2022] GET /compute/v2.1/servers/2ed61492-84f4-4825-9ac8-4d13e3f52bd7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:11:55.132846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6c6517d9-ac71-4c51-b9ae-f1cd853286d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:55.133492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6c6517d9-ac71-4c51-b9ae-f1cd853286d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:55.156507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c6517d9-ac71-4c51-b9ae-f1cd853286d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:55.162527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c6517d9-ac71-4c51-b9ae-f1cd853286d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:55.164437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c6517d9-ac71-4c51-b9ae-f1cd853286d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:55.167450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c6517d9-ac71-4c51-b9ae-f1cd853286d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:55.741026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cc860db2-ae7c-4a3f-8cd7-8fdb4189eaa4 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '.version_select at 0x7f5b1261cee0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:55.782247 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cc860db2-ae7c-4a3f-8cd7-8fdb4189eaa4 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2045307261" status: 202 len: 0 microversion: 2.1 time: 0.045431 Aug 03 02:11:55.784674 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2180/4475] 10.222.0.67 () {58 vars in 1257 bytes} [Wed Aug 3 02:11:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2045307261 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 02:11:56.013884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6c6517d9-ac71-4c51-b9ae-f1cd853286d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:56.034519 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6c6517d9-ac71-4c51-b9ae-f1cd853286d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1655 microversion: 2.1 time: 0.907691 Aug 03 02:11:56.037196 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2296/4476] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:55 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1655 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:56.065569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-645b605e-c902-4ce1-b0b0-74afafbe6048 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:11:56.083569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-645b605e-c902-4ce1-b0b0-74afafbe6048 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:56.084234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-645b605e-c902-4ce1-b0b0-74afafbe6048 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:56.134100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-645b605e-c902-4ce1-b0b0-74afafbe6048 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Going to try to start instance {{(pid=125942) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 02:11:56.222538 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-645b605e-c902-4ce1-b0b0-74afafbe6048 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.161298 Aug 03 02:11:56.223976 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2181/4477] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:11:56 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:11:56.232361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cec6ccf8-4e64-4412-a395-a297e5e7eb09 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:56.232990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cec6ccf8-4e64-4412-a395-a297e5e7eb09 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:56.255740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cec6ccf8-4e64-4412-a395-a297e5e7eb09 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:56.259042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cec6ccf8-4e64-4412-a395-a297e5e7eb09 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:56.260078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cec6ccf8-4e64-4412-a395-a297e5e7eb09 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:56.284270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cec6ccf8-4e64-4412-a395-a297e5e7eb09 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:57.362131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-645b605e-c902-4ce1-b0b0-74afafbe6048 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:57.363197 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-645b605e-c902-4ce1-b0b0-74afafbe6048 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001531 Aug 03 02:11:57.363553 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2182/4478] 10.222.0.67 () {56 vars in 886 bytes} [Wed Aug 3 02:11:57 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 03 02:11:57.984023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cec6ccf8-4e64-4412-a395-a297e5e7eb09 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:57.994716 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cec6ccf8-4e64-4412-a395-a297e5e7eb09 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1664 microversion: 2.1 time: 1.767162 Aug 03 02:11:57.998067 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2297/4479] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:56 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1664 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:11:59.021423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e77c8906-cd44-4614-a309-9f3f56dea892 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:11:59.022196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e77c8906-cd44-4614-a309-9f3f56dea892 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:11:59.035904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e77c8906-cd44-4614-a309-9f3f56dea892 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:59.036374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e77c8906-cd44-4614-a309-9f3f56dea892 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:59.037178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e77c8906-cd44-4614-a309-9f3f56dea892 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:11:59.048687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e77c8906-cd44-4614-a309-9f3f56dea892 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:11:59.733740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e77c8906-cd44-4614-a309-9f3f56dea892 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:11:59.751295 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e77c8906-cd44-4614-a309-9f3f56dea892 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1664 microversion: 2.1 time: 0.737947 Aug 03 02:11:59.752164 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2183/4480] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:11:59 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1664 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:00.776253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5fd039b4-bd60-44f3-bf3c-7a4633417494 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:00.778796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5fd039b4-bd60-44f3-bf3c-7a4633417494 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:00.781757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:00.800399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fd039b4-bd60-44f3-bf3c-7a4633417494 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:00.800867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fd039b4-bd60-44f3-bf3c-7a4633417494 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:00.801659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fd039b4-bd60-44f3-bf3c-7a4633417494 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:00.802280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fd039b4-bd60-44f3-bf3c-7a4633417494 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:01.633392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5fd039b4-bd60-44f3-bf3c-7a4633417494 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:01.645110 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5fd039b4-bd60-44f3-bf3c-7a4633417494 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.873536 Aug 03 02:12:01.658939 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2298/4481] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:00 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:12:01.671563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e6233775-0274-4629-aea2-1ffc4f1dd54e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:01.673532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e6233775-0274-4629-aea2-1ffc4f1dd54e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:01.681908 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:01.685496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6233775-0274-4629-aea2-1ffc4f1dd54e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:01.686219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6233775-0274-4629-aea2-1ffc4f1dd54e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:01.687527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6233775-0274-4629-aea2-1ffc4f1dd54e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:01.688847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6233775-0274-4629-aea2-1ffc4f1dd54e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:02.085027 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e6233775-0274-4629-aea2-1ffc4f1dd54e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:02.088628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:INSERT=3,nova_cell1:SELECT=91 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:02.120293 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e6233775-0274-4629-aea2-1ffc4f1dd54e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.450607 Aug 03 02:12:02.125197 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2184/4482] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:01 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:02.152877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-be048a4e-3bf6-44a5-9fa3-d3ccac0a9372 tempest-QuotasTestJSON-969313547 tempest-QuotasTestJSON-969313547-project] Calling method '.version_select at 0x7f5b131e5040>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:02.158656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dabaeebb-1ceb-43c9-87f0-0b4a479a979b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:02.161270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dabaeebb-1ceb-43c9-87f0-0b4a479a979b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:02.189902 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dabaeebb-1ceb-43c9-87f0-0b4a479a979b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:02.192316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dabaeebb-1ceb-43c9-87f0-0b4a479a979b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:02.198734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dabaeebb-1ceb-43c9-87f0-0b4a479a979b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:02.199893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dabaeebb-1ceb-43c9-87f0-0b4a479a979b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:02.331661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dabaeebb-1ceb-43c9-87f0-0b4a479a979b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Unlocking {{(pid=125942) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 03 02:12:02.449402 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dabaeebb-1ceb-43c9-87f0-0b4a479a979b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.303881 Aug 03 02:12:02.451769 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2185/4483] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:12:02 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:12:02.464817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2b66846a-fdc9-4e6a-994d-6d795833aa91 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:02.471039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2b66846a-fdc9-4e6a-994d-6d795833aa91 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:02.489139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b66846a-fdc9-4e6a-994d-6d795833aa91 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:02.491870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b66846a-fdc9-4e6a-994d-6d795833aa91 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:02.494281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b66846a-fdc9-4e6a-994d-6d795833aa91 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:02.496403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b66846a-fdc9-4e6a-994d-6d795833aa91 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:02.569483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2b66846a-fdc9-4e6a-994d-6d795833aa91 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:12:02.769040 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2b66846a-fdc9-4e6a-994d-6d795833aa91 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "DELETE /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 204 len: 0 microversion: 2.1 time: 0.312823 Aug 03 02:12:02.778203 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2186/4484] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:12:02 2022] DELETE /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:12:02.794762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-41518d99-1481-451e-99c8-0e235ba104d4 req-5c7222a4-cfde-4b1d-808c-93053f6536b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882d5bbc-8687-4b59-9916-d1b5bd0089b0", "tag": "5e9f7741-aeb8-4dbb-aa33-c8c2fee4e59d"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:02.813874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-41518d99-1481-451e-99c8-0e235ba104d4 req-5c7222a4-cfde-4b1d-808c-93053f6536b3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:02.814762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-41518d99-1481-451e-99c8-0e235ba104d4 req-5c7222a4-cfde-4b1d-808c-93053f6536b3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:02.832842 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-41518d99-1481-451e-99c8-0e235ba104d4 req-5c7222a4-cfde-4b1d-808c-93053f6536b3 service nova] Creating event network-changed:5e9f7741-aeb8-4dbb-aa33-c8c2fee4e59d for instance 882d5bbc-8687-4b59-9916-d1b5bd0089b0 on n-h2-826529-8 Aug 03 02:12:02.839398 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-41518d99-1481-451e-99c8-0e235ba104d4 req-5c7222a4-cfde-4b1d-808c-93053f6536b3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057871 Aug 03 02:12:02.841177 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2187/4485] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:02.847829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d2e495cc-a46a-49a8-9731-e558894aeca8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:02.848926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d2e495cc-a46a-49a8-9731-e558894aeca8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:02.858079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2e495cc-a46a-49a8-9731-e558894aeca8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:02.858921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2e495cc-a46a-49a8-9731-e558894aeca8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:02.861186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2e495cc-a46a-49a8-9731-e558894aeca8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:02.862065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2e495cc-a46a-49a8-9731-e558894aeca8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:02.968255 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-be048a4e-3bf6-44a5-9fa3-d3ccac0a9372 tempest-QuotasTestJSON-969313547 tempest-QuotasTestJSON-969313547-project] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/50351aac0ea34d8cbd2dd2a748c1c040/defaults" status: 200 len: 371 microversion: 2.1 time: 1.188835 Aug 03 02:12:02.969113 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2299/4486] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 02:12:01 2022] GET /compute/v2.1/os-quota-sets/50351aac0ea34d8cbd2dd2a748c1c040/defaults => generated 371 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:02.984809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c7cd5a38-7464-408f-bf6b-8a24fa6f2c38 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:02.985453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c7cd5a38-7464-408f-bf6b-8a24fa6f2c38 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:03.018869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7cd5a38-7464-408f-bf6b-8a24fa6f2c38 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:03.021153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7cd5a38-7464-408f-bf6b-8a24fa6f2c38 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:03.022172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7cd5a38-7464-408f-bf6b-8a24fa6f2c38 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:03.023749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7cd5a38-7464-408f-bf6b-8a24fa6f2c38 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:03.345985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d2e495cc-a46a-49a8-9731-e558894aeca8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:03.354465 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d2e495cc-a46a-49a8-9731-e558894aeca8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.511720 Aug 03 02:12:03.355901 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2188/4487] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:02 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:03.376305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ff12fc38-1ae6-4107-9957-4f3b6edf4d9f tempest-QuotasTestJSON-969313547 tempest-QuotasTestJSON-969313547-project] Calling method '.version_select at 0x7f5b13c79ca0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:03.523523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c7cd5a38-7464-408f-bf6b-8a24fa6f2c38 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:03.532945 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c7cd5a38-7464-408f-bf6b-8a24fa6f2c38 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 200 len: 1672 microversion: 2.1 time: 0.559338 Aug 03 02:12:03.537155 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2300/4488] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:02 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 1672 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:03.552883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5148b5db-8fb0-421c-98e7-547d404bbc59 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:03.563408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5148b5db-8fb0-421c-98e7-547d404bbc59 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:03.587543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5148b5db-8fb0-421c-98e7-547d404bbc59 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:03.588673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5148b5db-8fb0-421c-98e7-547d404bbc59 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:03.590214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5148b5db-8fb0-421c-98e7-547d404bbc59 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:03.594191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5148b5db-8fb0-421c-98e7-547d404bbc59 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:04.006604 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ff12fc38-1ae6-4107-9957-4f3b6edf4d9f tempest-QuotasTestJSON-969313547 tempest-QuotasTestJSON-969313547-project] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/50351aac0ea34d8cbd2dd2a748c1c040" status: 200 len: 371 microversion: 2.1 time: 0.649404 Aug 03 02:12:04.029446 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2189/4489] 10.222.0.67 () {58 vars in 1242 bytes} [Wed Aug 3 02:12:03 2022] GET /compute/v2.1/os-quota-sets/50351aac0ea34d8cbd2dd2a748c1c040 => generated 371 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:04.041859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5148b5db-8fb0-421c-98e7-547d404bbc59 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:04.047352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9f809803-2bf1-4115-8bc2-39ead5d0967b tempest-QuotasTestJSON-969313547 tempest-QuotasTestJSON-969313547-project] Calling method '.version_select at 0x7f5b13383ca0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:04.097398 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5148b5db-8fb0-421c-98e7-547d404bbc59 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.553983 Aug 03 02:12:04.103284 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2301/4490] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:03 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:04.135807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-67271d9e-12b3-4ac3-8830-df542cee6aa1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:04.155079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-67271d9e-12b3-4ac3-8830-df542cee6aa1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:04.200707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67271d9e-12b3-4ac3-8830-df542cee6aa1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:04.204669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67271d9e-12b3-4ac3-8830-df542cee6aa1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:04.207154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67271d9e-12b3-4ac3-8830-df542cee6aa1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:04.209246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67271d9e-12b3-4ac3-8830-df542cee6aa1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:04.296168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:04.594310 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9f809803-2bf1-4115-8bc2-39ead5d0967b tempest-QuotasTestJSON-969313547 tempest-QuotasTestJSON-969313547-project] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/50351aac0ea34d8cbd2dd2a748c1c040/defaults" status: 200 len: 371 microversion: 2.1 time: 0.563410 Aug 03 02:12:04.595484 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2190/4491] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 02:12:04 2022] GET /compute/v2.1/os-quota-sets/50351aac0ea34d8cbd2dd2a748c1c040/defaults => generated 371 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:04.610211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-05ef3e81-5838-44b8-9ef0-4b11e3d119cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:04.612983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-05ef3e81-5838-44b8-9ef0-4b11e3d119cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:04.628674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05ef3e81-5838-44b8-9ef0-4b11e3d119cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:04.628674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05ef3e81-5838-44b8-9ef0-4b11e3d119cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:04.629483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05ef3e81-5838-44b8-9ef0-4b11e3d119cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:04.634023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05ef3e81-5838-44b8-9ef0-4b11e3d119cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:05.232312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-67271d9e-12b3-4ac3-8830-df542cee6aa1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:05.262006 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-67271d9e-12b3-4ac3-8830-df542cee6aa1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 1.128663 Aug 03 02:12:05.263256 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2302/4492] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:04 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:05.268390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d7f8cfa3-d097-417a-b954-8ec70c87da30 tempest-QuotasTestJSON-969313547 tempest-QuotasTestJSON-969313547-project] Calling method '.version_select at 0x7f5b13f9e430>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:05.565450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-05ef3e81-5838-44b8-9ef0-4b11e3d119cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:05.571916 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-05ef3e81-5838-44b8-9ef0-4b11e3d119cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 200 len: 1672 microversion: 2.1 time: 0.974099 Aug 03 02:12:05.572514 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2191/4493] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:04 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 1672 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:05.592295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3f1ce143-8de1-4cf1-857c-e39fe8f74d2e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:05.592850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3f1ce143-8de1-4cf1-857c-e39fe8f74d2e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:05.619648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f1ce143-8de1-4cf1-857c-e39fe8f74d2e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:05.620115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f1ce143-8de1-4cf1-857c-e39fe8f74d2e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:05.622996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f1ce143-8de1-4cf1-857c-e39fe8f74d2e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:05.622996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f1ce143-8de1-4cf1-857c-e39fe8f74d2e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:05.818320 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d7f8cfa3-d097-417a-b954-8ec70c87da30 tempest-QuotasTestJSON-969313547 tempest-QuotasTestJSON-969313547-project] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/50351aac0ea34d8cbd2dd2a748c1c040" status: 200 len: 371 microversion: 2.1 time: 0.553910 Aug 03 02:12:05.828970 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3f1ce143-8de1-4cf1-857c-e39fe8f74d2e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.255046 Aug 03 02:12:05.829804 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2192/4494] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:12:05 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:12:05.835258 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2303/4495] 10.222.0.67 () {58 vars in 1242 bytes} [Wed Aug 3 02:12:05 2022] GET /compute/v2.1/os-quota-sets/50351aac0ea34d8cbd2dd2a748c1c040 => generated 371 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:05.874080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2805c60f-be4a-479d-a0a5-e75db69559d7 tempest-QuotasTestJSON-969313547 tempest-QuotasTestJSON-969313547-project] Calling method '.version_select at 0x7f5b1261cdc0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:05.877687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0e4a3307-2025-4265-8dc2-2bb11134545c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:05.880714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0e4a3307-2025-4265-8dc2-2bb11134545c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:05.922116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e4a3307-2025-4265-8dc2-2bb11134545c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:05.922527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e4a3307-2025-4265-8dc2-2bb11134545c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:05.923404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e4a3307-2025-4265-8dc2-2bb11134545c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:05.923874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e4a3307-2025-4265-8dc2-2bb11134545c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:06.396584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0e4a3307-2025-4265-8dc2-2bb11134545c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:06.425193 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0e4a3307-2025-4265-8dc2-2bb11134545c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1673 microversion: 2.1 time: 0.588487 Aug 03 02:12:06.425804 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2304/4496] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:05 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1673 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:06.606940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-df372040-0ed2-4ea1-907c-2daeee95f85e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:06.610164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-df372040-0ed2-4ea1-907c-2daeee95f85e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:06.624750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df372040-0ed2-4ea1-907c-2daeee95f85e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:06.627847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df372040-0ed2-4ea1-907c-2daeee95f85e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:06.629786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df372040-0ed2-4ea1-907c-2daeee95f85e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:06.631294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df372040-0ed2-4ea1-907c-2daeee95f85e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:06.884369 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2805c60f-be4a-479d-a0a5-e75db69559d7 tempest-QuotasTestJSON-969313547 tempest-QuotasTestJSON-969313547-project] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/50351aac0ea34d8cbd2dd2a748c1c040?user_id=ed2dbf76319442ee90f88afdf5ab3a36" status: 200 len: 371 microversion: 2.1 time: 1.052317 Aug 03 02:12:06.887096 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2193/4497] 10.222.0.67 () {58 vars in 1323 bytes} [Wed Aug 3 02:12:05 2022] GET /compute/v2.1/os-quota-sets/50351aac0ea34d8cbd2dd2a748c1c040?user_id=ed2dbf76319442ee90f88afdf5ab3a36 => generated 371 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:07.451312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c86104d9-a7a0-41ba-865c-eeb1a6eaefed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:07.452075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c86104d9-a7a0-41ba-865c-eeb1a6eaefed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:07.472098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c86104d9-a7a0-41ba-865c-eeb1a6eaefed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:07.472568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c86104d9-a7a0-41ba-865c-eeb1a6eaefed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:07.473554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c86104d9-a7a0-41ba-865c-eeb1a6eaefed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:07.473872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c86104d9-a7a0-41ba-865c-eeb1a6eaefed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:08.185789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-df372040-0ed2-4ea1-907c-2daeee95f85e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:08.206024 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-df372040-0ed2-4ea1-907c-2daeee95f85e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 200 len: 1672 microversion: 2.1 time: 1.608613 Aug 03 02:12:08.222534 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2305/4498] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:06 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 1672 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:08.237716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-d07dc436-b463-4116-8e41-a26fdbec8d8f req-3fd45f0e-8a62-48f5-bc39-dbf2adde54ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882d5bbc-8687-4b59-9916-d1b5bd0089b0", "name": "network-vif-deleted", "tag": "5e9f7741-aeb8-4dbb-aa33-c8c2fee4e59d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:08.257964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d07dc436-b463-4116-8e41-a26fdbec8d8f req-3fd45f0e-8a62-48f5-bc39-dbf2adde54ea service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:08.261802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d07dc436-b463-4116-8e41-a26fdbec8d8f req-3fd45f0e-8a62-48f5-bc39-dbf2adde54ea service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:08.303033 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-d07dc436-b463-4116-8e41-a26fdbec8d8f req-3fd45f0e-8a62-48f5-bc39-dbf2adde54ea service nova] Creating event network-vif-deleted:5e9f7741-aeb8-4dbb-aa33-c8c2fee4e59d for instance 882d5bbc-8687-4b59-9916-d1b5bd0089b0 on n-h2-826529-8 Aug 03 02:12:08.312013 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-d07dc436-b463-4116-8e41-a26fdbec8d8f req-3fd45f0e-8a62-48f5-bc39-dbf2adde54ea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087440 Aug 03 02:12:08.313186 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2306/4499] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:08.457878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c86104d9-a7a0-41ba-865c-eeb1a6eaefed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:08.473568 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c86104d9-a7a0-41ba-865c-eeb1a6eaefed tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1653 microversion: 2.1 time: 1.025755 Aug 03 02:12:08.475928 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2194/4500] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:07 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1653 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:08.508799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-345217d8-b606-44b5-be1d-0222008f773d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:08.510539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-345217d8-b606-44b5-be1d-0222008f773d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:08.528481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-345217d8-b606-44b5-be1d-0222008f773d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:08.528928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-345217d8-b606-44b5-be1d-0222008f773d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:08.529656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-345217d8-b606-44b5-be1d-0222008f773d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:08.532579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-345217d8-b606-44b5-be1d-0222008f773d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:08.561142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1109285802", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "d26ca69a-a338-40ed-9e04-7c6942285689"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:08.686553 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-345217d8-b606-44b5-be1d-0222008f773d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.193975 Aug 03 02:12:08.690370 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2195/4501] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:12:08 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:12:08.702089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b3f3dc07-95d7-4f74-9759-3f3a11ffb7ce tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:08.703295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b3f3dc07-95d7-4f74-9759-3f3a11ffb7ce tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:08.706582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] validate_networks() for [('d26ca69a-a338-40ed-9e04-7c6942285689', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:12:08.717543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3f3dc07-95d7-4f74-9759-3f3a11ffb7ce tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:08.726036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3f3dc07-95d7-4f74-9759-3f3a11ffb7ce tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:08.727396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3f3dc07-95d7-4f74-9759-3f3a11ffb7ce tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:08.728455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3f3dc07-95d7-4f74-9759-3f3a11ffb7ce tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:09.177129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b3f3dc07-95d7-4f74-9759-3f3a11ffb7ce tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:09.194342 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b3f3dc07-95d7-4f74-9759-3f3a11ffb7ce tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1660 microversion: 2.1 time: 0.502393 Aug 03 02:12:09.208761 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2196/4502] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:08 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1660 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:09.236726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-750247a3-fa2b-4f11-a9a5-2617452791f0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:09.237099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-750247a3-fa2b-4f11-a9a5-2617452791f0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 882d5bbc-8687-4b59-9916-d1b5bd0089b0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:09.258772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-750247a3-fa2b-4f11-a9a5-2617452791f0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:09.260901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-750247a3-fa2b-4f11-a9a5-2617452791f0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:09.263301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-750247a3-fa2b-4f11-a9a5-2617452791f0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:09.266113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-750247a3-fa2b-4f11-a9a5-2617452791f0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:09.376212 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-750247a3-fa2b-4f11-a9a5-2617452791f0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] HTTP exception thrown: Instance 882d5bbc-8687-4b59-9916-d1b5bd0089b0 could not be found. Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-750247a3-fa2b-4f11-a9a5-2617452791f0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Request method failure captured: Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 HTTP/1.1 Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6diZeEEjiGzAcmk6N3GrsvuSSfJa8t-_aovLDCAXQm2xQTm33vEGpolDBlHiFlzKq6sp-ZuiHN5qDQ66gUJfha9nUxbNi-5TwYU5GrNfnPL9YtuBPdd8XVzKazw-zqiOhVbXgQyCFciFIcruufj-juJy4hSW-ROXyKVKRMqApPpv79g Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: f90284be975b4e459cdc3e72c1664630 Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestNetworkBasicOps-1604073491 Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f90284be975b4e459cdc3e72c1664630", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f90284be975b4e459cdc3e72c1664630"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f90284be975b4e459cdc3e72c1664630"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f90284be975b4e459cdc3e72c1664630"}]}] Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestNetworkBasicOps-1604073491 Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: f90284be975b4e459cdc3e72c1664630 Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestNetworkBasicOps-1604073491 Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestNetworkBasicOps-1604073491-project Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: c1ab5d1fb4b1453b9ba37a2b1194ec79 Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestNetworkBasicOps-1604073491-project Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 882d5bbc-8687-4b59-9916-d1b5bd0089b0 could not be found. Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '882d5bbc-8687-4b59-9916-d1b5bd0089b0'} Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 882d5bbc-8687-4b59-9916-d1b5bd0089b0 could not be found. Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 882d5bbc-8687-4b59-9916-d1b5bd0089b0 could not be found. Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:12:09.384461 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:12:09.389327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:12:09.389327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:12:09.389327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:12:09.389327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:12:09.389327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:12:09.389327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 882d5bbc-8687-4b59-9916-d1b5bd0089b0 could not be found. Aug 03 02:12:09.389327 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:12:09.393631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-750247a3-fa2b-4f11-a9a5-2617452791f0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Returning 404 to user: Instance 882d5bbc-8687-4b59-9916-d1b5bd0089b0 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:12:09.397436 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-750247a3-fa2b-4f11-a9a5-2617452791f0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0" status: 404 len: 111 microversion: 2.1 time: 0.167554 Aug 03 02:12:09.403109 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2197/4503] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:09 2022] GET /compute/v2.1/servers/882d5bbc-8687-4b59-9916-d1b5bd0089b0 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:12:09.728738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7474917d-eaa3-488a-af59-3e3a0137db5e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '.version_select at 0x7f5b12856c10>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:09.758406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:12:09.758930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:12:09.759326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:12:09.759740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:12:09.760155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:12:09.777851 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7474917d-eaa3-488a-af59-3e3a0137db5e tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2076847870" status: 202 len: 0 microversion: 2.1 time: 0.054422 Aug 03 02:12:09.779490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:09.784932 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2198/4504] 10.222.0.67 () {58 vars in 1257 bytes} [Wed Aug 3 02:12:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2076847870 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 02:12:09.786168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:09.791249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:09.792794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:09.853017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:12:09.869563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for user 2721f67579e542718483193be7515d6b and project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:12:09.911295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:12:09.918175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:12:10.039470 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5a3b1267-6415-4224-bba1-c5c735c383a0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.722475 Aug 03 02:12:10.040001 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2307/4505] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:12:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:12:10.054287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3a2a156f-8d59-477b-b684-85e8c185f10b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:10.054979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3a2a156f-8d59-477b-b684-85e8c185f10b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:10.198098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3a2a156f-8d59-477b-b684-85e8c185f10b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:10.225961 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3a2a156f-8d59-477b-b684-85e8c185f10b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1193 microversion: 2.1 time: 0.161157 Aug 03 02:12:10.225961 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2199/4506] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:10 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1193 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:10.226348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c9d0d32e-ccb6-421e-980a-46b913814748 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:10.226348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c9d0d32e-ccb6-421e-980a-46b913814748 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:10.226348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9d0d32e-ccb6-421e-980a-46b913814748 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:10.226348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9d0d32e-ccb6-421e-980a-46b913814748 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:10.233687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9d0d32e-ccb6-421e-980a-46b913814748 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:10.233687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9d0d32e-ccb6-421e-980a-46b913814748 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:10.680708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c9d0d32e-ccb6-421e-980a-46b913814748 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:10.699901 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c9d0d32e-ccb6-421e-980a-46b913814748 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.482867 Aug 03 02:12:10.700996 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2308/4507] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:10 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:12:10.735362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e2510f91-7f0e-4f2b-9c3d-69a8a6ff46e2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:10.735955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e2510f91-7f0e-4f2b-9c3d-69a8a6ff46e2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:10.756880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2510f91-7f0e-4f2b-9c3d-69a8a6ff46e2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:10.759467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2510f91-7f0e-4f2b-9c3d-69a8a6ff46e2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:10.760278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2510f91-7f0e-4f2b-9c3d-69a8a6ff46e2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:10.760769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2510f91-7f0e-4f2b-9c3d-69a8a6ff46e2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:11.127610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e2510f91-7f0e-4f2b-9c3d-69a8a6ff46e2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:11.136647 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e2510f91-7f0e-4f2b-9c3d-69a8a6ff46e2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.404577 Aug 03 02:12:11.150939 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2200/4508] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:10 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:11.164383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-941324ed-777d-40be-826f-eaafe7656471 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:11.165342 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-941324ed-777d-40be-826f-eaafe7656471 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:11.178443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-941324ed-777d-40be-826f-eaafe7656471 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:11.189261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-941324ed-777d-40be-826f-eaafe7656471 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:11.192244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-941324ed-777d-40be-826f-eaafe7656471 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:11.196051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-941324ed-777d-40be-826f-eaafe7656471 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:11.240110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e3604e2f-c580-41d0-8e33-3c5e232feb6d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:11.241296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e3604e2f-c580-41d0-8e33-3c5e232feb6d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:11.267917 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3604e2f-c580-41d0-8e33-3c5e232feb6d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:11.268824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3604e2f-c580-41d0-8e33-3c5e232feb6d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:11.272174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3604e2f-c580-41d0-8e33-3c5e232feb6d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:11.274214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e3604e2f-c580-41d0-8e33-3c5e232feb6d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:11.409317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:11.550829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e3604e2f-c580-41d0-8e33-3c5e232feb6d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:11.560992 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e3604e2f-c580-41d0-8e33-3c5e232feb6d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1197 microversion: 2.1 time: 0.325758 Aug 03 02:12:11.570605 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2201/4509] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:11 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1197 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:11.691196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-941324ed-777d-40be-826f-eaafe7656471 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:11.703696 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-941324ed-777d-40be-826f-eaafe7656471 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.543864 Aug 03 02:12:11.704583 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2309/4510] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:11 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:11.729609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bfaf90a0-8682-46d2-a4e5-74f916a9482a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:11.733815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bfaf90a0-8682-46d2-a4e5-74f916a9482a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:11.746383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfaf90a0-8682-46d2-a4e5-74f916a9482a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:11.750679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfaf90a0-8682-46d2-a4e5-74f916a9482a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:11.759751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfaf90a0-8682-46d2-a4e5-74f916a9482a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:11.760456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfaf90a0-8682-46d2-a4e5-74f916a9482a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:12.496708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bfaf90a0-8682-46d2-a4e5-74f916a9482a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:12.506621 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bfaf90a0-8682-46d2-a4e5-74f916a9482a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.783707 Aug 03 02:12:12.511928 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2202/4511] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:11 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:12.558366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-45f12369-d8d1-4540-b4f7-58f31cb48983 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:12.564286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-45f12369-d8d1-4540-b4f7-58f31cb48983 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:12.594596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-082a28b5-02a3-472a-9cbc-9637805a5d72 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:12.595565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-082a28b5-02a3-472a-9cbc-9637805a5d72 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:12.611720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45f12369-d8d1-4540-b4f7-58f31cb48983 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:12.613034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45f12369-d8d1-4540-b4f7-58f31cb48983 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:12.615145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45f12369-d8d1-4540-b4f7-58f31cb48983 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:12.615313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-082a28b5-02a3-472a-9cbc-9637805a5d72 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:12.615762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-082a28b5-02a3-472a-9cbc-9637805a5d72 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:12.616539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45f12369-d8d1-4540-b4f7-58f31cb48983 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:12.616701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-082a28b5-02a3-472a-9cbc-9637805a5d72 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:12.616996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-082a28b5-02a3-472a-9cbc-9637805a5d72 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:12.809555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-082a28b5-02a3-472a-9cbc-9637805a5d72 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:12.824072 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-082a28b5-02a3-472a-9cbc-9637805a5d72 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1251 microversion: 2.1 time: 0.231472 Aug 03 02:12:12.835728 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2203/4512] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:12 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1251 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:13.325717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-45f12369-d8d1-4540-b4f7-58f31cb48983 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:13.342173 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-45f12369-d8d1-4540-b4f7-58f31cb48983 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.798287 Aug 03 02:12:13.344244 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2310/4513] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:12 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:13.373448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0b9906b3-94fe-4e9a-a3dc-d06778c393ff tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:13.374377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0b9906b3-94fe-4e9a-a3dc-d06778c393ff tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:13.390886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b9906b3-94fe-4e9a-a3dc-d06778c393ff tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:13.398168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b9906b3-94fe-4e9a-a3dc-d06778c393ff tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:13.402602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b9906b3-94fe-4e9a-a3dc-d06778c393ff tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:13.404272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b9906b3-94fe-4e9a-a3dc-d06778c393ff tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:13.850782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1bfeea79-c5bb-4194-bb56-7c5e43d920bc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:13.851482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1bfeea79-c5bb-4194-bb56-7c5e43d920bc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:13.866814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bfeea79-c5bb-4194-bb56-7c5e43d920bc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:13.867301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bfeea79-c5bb-4194-bb56-7c5e43d920bc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:13.868106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bfeea79-c5bb-4194-bb56-7c5e43d920bc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:13.868548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bfeea79-c5bb-4194-bb56-7c5e43d920bc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:14.157055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1bfeea79-c5bb-4194-bb56-7c5e43d920bc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:14.166066 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1bfeea79-c5bb-4194-bb56-7c5e43d920bc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1251 microversion: 2.1 time: 0.320631 Aug 03 02:12:14.171294 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2311/4514] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:13 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1251 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:14.227253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0b9906b3-94fe-4e9a-a3dc-d06778c393ff tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:14.239660 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0b9906b3-94fe-4e9a-a3dc-d06778c393ff tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.871815 Aug 03 02:12:14.256486 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2204/4515] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:13 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:15.201644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03c942e9-50c8-4496-bb48-1000be1f94c7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:15.202413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-03c942e9-50c8-4496-bb48-1000be1f94c7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:15.222581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03c942e9-50c8-4496-bb48-1000be1f94c7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:15.223458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03c942e9-50c8-4496-bb48-1000be1f94c7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:15.224303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03c942e9-50c8-4496-bb48-1000be1f94c7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:15.224747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03c942e9-50c8-4496-bb48-1000be1f94c7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:15.827222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03c942e9-50c8-4496-bb48-1000be1f94c7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:15.844836 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03c942e9-50c8-4496-bb48-1000be1f94c7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1293 microversion: 2.1 time: 0.651692 Aug 03 02:12:15.846013 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2312/4516] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:15 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1293 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:16.873631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-603354e1-870d-43e1-a273-e78b70f8b291 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:16.874360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-603354e1-870d-43e1-a273-e78b70f8b291 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:16.889165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-603354e1-870d-43e1-a273-e78b70f8b291 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:16.889783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-603354e1-870d-43e1-a273-e78b70f8b291 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:16.893639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-603354e1-870d-43e1-a273-e78b70f8b291 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:16.895484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-603354e1-870d-43e1-a273-e78b70f8b291 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:17.532440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-1a54d5e2-fc58-4272-ac73-207fd7e8d274 req-3f05153b-6d19-4a4c-9248-58d70783d687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1991a8b-4afc-462d-942e-ab208c8a151c", "tag": "666aaf85-743d-4b80-a07c-9c8c9d054602"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:17.552339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-603354e1-870d-43e1-a273-e78b70f8b291 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:17.576812 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-603354e1-870d-43e1-a273-e78b70f8b291 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1293 microversion: 2.1 time: 0.704554 Aug 03 02:12:17.581134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1a54d5e2-fc58-4272-ac73-207fd7e8d274 req-3f05153b-6d19-4a4c-9248-58d70783d687 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:17.581450 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2205/4517] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:16 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1293 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:17.582023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1a54d5e2-fc58-4272-ac73-207fd7e8d274 req-3f05153b-6d19-4a4c-9248-58d70783d687 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:17.610297 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-1a54d5e2-fc58-4272-ac73-207fd7e8d274 req-3f05153b-6d19-4a4c-9248-58d70783d687 service nova] Creating event network-changed:666aaf85-743d-4b80-a07c-9c8c9d054602 for instance c1991a8b-4afc-462d-942e-ab208c8a151c on n-h2-826529-8 Aug 03 02:12:17.619050 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-1a54d5e2-fc58-4272-ac73-207fd7e8d274 req-3f05153b-6d19-4a4c-9248-58d70783d687 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093140 Aug 03 02:12:17.621181 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2313/4518] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:18.605413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-94a8f474-c9b1-4f8e-b09e-a8d69f348129 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:18.606220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-94a8f474-c9b1-4f8e-b09e-a8d69f348129 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:18.630212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94a8f474-c9b1-4f8e-b09e-a8d69f348129 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:18.632217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94a8f474-c9b1-4f8e-b09e-a8d69f348129 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:18.636200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94a8f474-c9b1-4f8e-b09e-a8d69f348129 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:18.638407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-94a8f474-c9b1-4f8e-b09e-a8d69f348129 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:18.991140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-94a8f474-c9b1-4f8e-b09e-a8d69f348129 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:19.008598 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-94a8f474-c9b1-4f8e-b09e-a8d69f348129 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1293 microversion: 2.1 time: 0.407908 Aug 03 02:12:19.009195 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2206/4519] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:18 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1293 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:20.031591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5358d110-d552-4f3b-a3d9-164c8497969b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:20.032298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5358d110-d552-4f3b-a3d9-164c8497969b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:20.050377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:20.051152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:20.053018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5358d110-d552-4f3b-a3d9-164c8497969b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:20.053662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5358d110-d552-4f3b-a3d9-164c8497969b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:20.054632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5358d110-d552-4f3b-a3d9-164c8497969b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:20.055255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5358d110-d552-4f3b-a3d9-164c8497969b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:20.334949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5358d110-d552-4f3b-a3d9-164c8497969b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:20.350265 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5358d110-d552-4f3b-a3d9-164c8497969b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1293 microversion: 2.1 time: 0.324160 Aug 03 02:12:20.357628 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2314/4520] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:20 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1293 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:21.003219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:21.378525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1fa1710c-0ea6-4430-b31a-27878c289134 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:21.380255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1fa1710c-0ea6-4430-b31a-27878c289134 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:21.391962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fa1710c-0ea6-4430-b31a-27878c289134 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:21.402922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fa1710c-0ea6-4430-b31a-27878c289134 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:21.403928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fa1710c-0ea6-4430-b31a-27878c289134 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:21.404398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fa1710c-0ea6-4430-b31a-27878c289134 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:21.543064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-71c17af8-bc25-4156-bc8a-1db20cd43437 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:21.543687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-71c17af8-bc25-4156-bc8a-1db20cd43437 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:21.560168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71c17af8-bc25-4156-bc8a-1db20cd43437 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:21.560905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71c17af8-bc25-4156-bc8a-1db20cd43437 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:21.562843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71c17af8-bc25-4156-bc8a-1db20cd43437 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:21.563596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71c17af8-bc25-4156-bc8a-1db20cd43437 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:21.620095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-71c17af8-bc25-4156-bc8a-1db20cd43437 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:12:21.787532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1fa1710c-0ea6-4430-b31a-27878c289134 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:21.801785 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1fa1710c-0ea6-4430-b31a-27878c289134 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1293 microversion: 2.1 time: 0.427823 Aug 03 02:12:21.803150 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2315/4521] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:21 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1293 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:21.873556 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-71c17af8-bc25-4156-bc8a-1db20cd43437 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 204 len: 0 microversion: 2.42 time: 0.877229 Aug 03 02:12:21.875100 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2207/4522] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:12:20 2022] DELETE /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 0 bytes in 880 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 02:12:21.889573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b7d0b2be-92c3-4af7-826f-1addd7db72b1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:21.891093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b7d0b2be-92c3-4af7-826f-1addd7db72b1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:21.904298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7d0b2be-92c3-4af7-826f-1addd7db72b1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:21.905298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7d0b2be-92c3-4af7-826f-1addd7db72b1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:21.906196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7d0b2be-92c3-4af7-826f-1addd7db72b1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:21.906715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b7d0b2be-92c3-4af7-826f-1addd7db72b1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:22.294495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b7d0b2be-92c3-4af7-826f-1addd7db72b1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:22.306529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b7d0b2be-92c3-4af7-826f-1addd7db72b1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:22.309894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b7d0b2be-92c3-4af7-826f-1addd7db72b1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:22.311596 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b7d0b2be-92c3-4af7-826f-1addd7db72b1 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 2955 microversion: 2.42 time: 0.431479 Aug 03 02:12:22.312416 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2316/4523] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:21 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 2955 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:12:22.827776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e80019cd-bf39-466f-95d1-20720c6c9c4c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:22.828621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e80019cd-bf39-466f-95d1-20720c6c9c4c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:22.857505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e80019cd-bf39-466f-95d1-20720c6c9c4c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:22.862951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e80019cd-bf39-466f-95d1-20720c6c9c4c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:22.864790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e80019cd-bf39-466f-95d1-20720c6c9c4c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:22.868524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e80019cd-bf39-466f-95d1-20720c6c9c4c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:23.081508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e80019cd-bf39-466f-95d1-20720c6c9c4c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:23.090619 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e80019cd-bf39-466f-95d1-20720c6c9c4c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1293 microversion: 2.1 time: 0.268540 Aug 03 02:12:23.103895 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2208/4524] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:22 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1293 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:23.342195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ff7d168a-0cc3-4a67-9442-c3d8c2a840f6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:23.342814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ff7d168a-0cc3-4a67-9442-c3d8c2a840f6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:23.361087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff7d168a-0cc3-4a67-9442-c3d8c2a840f6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:23.361535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff7d168a-0cc3-4a67-9442-c3d8c2a840f6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:23.362324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff7d168a-0cc3-4a67-9442-c3d8c2a840f6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:23.363090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff7d168a-0cc3-4a67-9442-c3d8c2a840f6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:23.781240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ff7d168a-0cc3-4a67-9442-c3d8c2a840f6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:23.803376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ff7d168a-0cc3-4a67-9442-c3d8c2a840f6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:23.806065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ff7d168a-0cc3-4a67-9442-c3d8c2a840f6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:23.808866 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ff7d168a-0cc3-4a67-9442-c3d8c2a840f6 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 2955 microversion: 2.42 time: 0.471228 Aug 03 02:12:23.810113 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2317/4525] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:23 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 2955 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:12:24.114860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-096f8188-2956-454c-aca5-43548fc5e7be tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:24.116270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-096f8188-2956-454c-aca5-43548fc5e7be tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:24.135600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-096f8188-2956-454c-aca5-43548fc5e7be tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:24.137748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-096f8188-2956-454c-aca5-43548fc5e7be tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:24.139883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-096f8188-2956-454c-aca5-43548fc5e7be tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:24.140372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-096f8188-2956-454c-aca5-43548fc5e7be tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:24.380202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-096f8188-2956-454c-aca5-43548fc5e7be tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:24.396532 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-096f8188-2956-454c-aca5-43548fc5e7be tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1293 microversion: 2.1 time: 0.286597 Aug 03 02:12:24.397459 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2209/4526] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:24 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1293 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:24.842070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1a68a0df-65b4-4910-a017-6d97d0143703 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:24.843223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1a68a0df-65b4-4910-a017-6d97d0143703 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:24.860020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a68a0df-65b4-4910-a017-6d97d0143703 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:24.866278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a68a0df-65b4-4910-a017-6d97d0143703 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:24.887738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a68a0df-65b4-4910-a017-6d97d0143703 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:24.888263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a68a0df-65b4-4910-a017-6d97d0143703 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:25.332323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1a68a0df-65b4-4910-a017-6d97d0143703 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:25.349786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1a68a0df-65b4-4910-a017-6d97d0143703 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:25.351949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1a68a0df-65b4-4910-a017-6d97d0143703 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:25.358488 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1a68a0df-65b4-4910-a017-6d97d0143703 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 2955 microversion: 2.42 time: 0.523746 Aug 03 02:12:25.362475 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2318/4527] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:24 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 2955 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:12:25.430855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e7839833-9242-4436-9b99-e9cd8fa0b520 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:25.432320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e7839833-9242-4436-9b99-e9cd8fa0b520 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:25.455571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7839833-9242-4436-9b99-e9cd8fa0b520 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:25.458394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7839833-9242-4436-9b99-e9cd8fa0b520 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:25.462939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7839833-9242-4436-9b99-e9cd8fa0b520 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:25.465472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e7839833-9242-4436-9b99-e9cd8fa0b520 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:25.793779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-94cf299e-5951-4745-9842-25caaf5a6c13 req-57dd75f7-67ef-41b3-8b99-3e1c2d1e4684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1991a8b-4afc-462d-942e-ab208c8a151c", "name": "network-vif-plugged", "status": "completed", "tag": "666aaf85-743d-4b80-a07c-9c8c9d054602"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:25.829750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e7839833-9242-4436-9b99-e9cd8fa0b520 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:25.841577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-94cf299e-5951-4745-9842-25caaf5a6c13 req-57dd75f7-67ef-41b3-8b99-3e1c2d1e4684 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:25.845930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-94cf299e-5951-4745-9842-25caaf5a6c13 req-57dd75f7-67ef-41b3-8b99-3e1c2d1e4684 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:25.865379 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e7839833-9242-4436-9b99-e9cd8fa0b520 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1293 microversion: 2.1 time: 0.444759 Aug 03 02:12:25.871121 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2210/4528] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:25 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1293 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:25.879385 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-94cf299e-5951-4745-9842-25caaf5a6c13 req-57dd75f7-67ef-41b3-8b99-3e1c2d1e4684 service nova] Creating event network-vif-plugged:666aaf85-743d-4b80-a07c-9c8c9d054602 for instance c1991a8b-4afc-462d-942e-ab208c8a151c on n-h2-826529-8 Aug 03 02:12:25.891315 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-94cf299e-5951-4745-9842-25caaf5a6c13 req-57dd75f7-67ef-41b3-8b99-3e1c2d1e4684 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116549 Aug 03 02:12:25.892685 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2319/4529] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:26.396270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8f1f1678-74b6-4d25-a770-662dd4ab0413 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:26.397069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8f1f1678-74b6-4d25-a770-662dd4ab0413 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:26.415334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f1f1678-74b6-4d25-a770-662dd4ab0413 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:26.415858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f1f1678-74b6-4d25-a770-662dd4ab0413 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:26.417374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f1f1678-74b6-4d25-a770-662dd4ab0413 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:26.418078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f1f1678-74b6-4d25-a770-662dd4ab0413 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:26.892286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-be0c8603-17be-4930-9257-0fc21b019c4e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:26.892939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-be0c8603-17be-4930-9257-0fc21b019c4e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:26.913231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-be0c8603-17be-4930-9257-0fc21b019c4e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:26.913804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-be0c8603-17be-4930-9257-0fc21b019c4e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:26.914623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-be0c8603-17be-4930-9257-0fc21b019c4e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:26.915159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-be0c8603-17be-4930-9257-0fc21b019c4e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:27.079969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8f1f1678-74b6-4d25-a770-662dd4ab0413 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:27.102653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8f1f1678-74b6-4d25-a770-662dd4ab0413 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:27.114055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8f1f1678-74b6-4d25-a770-662dd4ab0413 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:27.115729 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8f1f1678-74b6-4d25-a770-662dd4ab0413 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 2955 microversion: 2.42 time: 0.727465 Aug 03 02:12:27.143219 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2211/4530] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:26 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 2955 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:12:27.380524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-be0c8603-17be-4930-9257-0fc21b019c4e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:27.398578 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-be0c8603-17be-4930-9257-0fc21b019c4e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1293 microversion: 2.1 time: 0.510455 Aug 03 02:12:27.399137 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2320/4531] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:26 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1293 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:12:28.147042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b2abd4bb-c1b6-4469-8a36-1040bf2c0089 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:28.148668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b2abd4bb-c1b6-4469-8a36-1040bf2c0089 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:28.169216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2abd4bb-c1b6-4469-8a36-1040bf2c0089 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:28.171282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3d95f8df-a1dc-4068-82b9-2fcce109f7c3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Action: 'create', calling method: .version_select at 0x7f5b136045e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1186470048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjHoolDYvzKJ5DNSE6ODSgUP6bk60s0SXmkXtnBbKBIVeDP10kCkPAm4zH3UhZXW5IrEp9qU8eiMV1rlqruGPJtiyynXrOu/vOhnTtqZDdZXr8OMzdFQMjq4qzcccOQsg=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:28.182139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2abd4bb-c1b6-4469-8a36-1040bf2c0089 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:28.185459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2abd4bb-c1b6-4469-8a36-1040bf2c0089 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:28.186228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2abd4bb-c1b6-4469-8a36-1040bf2c0089 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:28.203852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-3d95f8df-a1dc-4068-82b9-2fcce109f7c3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Getting quotas for project f90284be975b4e459cdc3e72c1664630. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:12:28.230521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-3d95f8df-a1dc-4068-82b9-2fcce109f7c3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Getting quotas for user c1ab5d1fb4b1453b9ba37a2b1194ec79 and project f90284be975b4e459cdc3e72c1664630. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:12:28.284065 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3d95f8df-a1dc-4068-82b9-2fcce109f7c3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.120006 Aug 03 02:12:28.285666 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2321/4532] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:12:28 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:28.425874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9a5b9429-f020-4288-b174-4ecdfff1e32c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:28.426761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9a5b9429-f020-4288-b174-4ecdfff1e32c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:28.438620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9a5b9429-f020-4288-b174-4ecdfff1e32c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:28.442345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9a5b9429-f020-4288-b174-4ecdfff1e32c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:28.444101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9a5b9429-f020-4288-b174-4ecdfff1e32c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:28.444987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9a5b9429-f020-4288-b174-4ecdfff1e32c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:29.026439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9a5b9429-f020-4288-b174-4ecdfff1e32c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:29.048189 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9a5b9429-f020-4288-b174-4ecdfff1e32c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1474 microversion: 2.1 time: 0.629941 Aug 03 02:12:29.053547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b2abd4bb-c1b6-4469-8a36-1040bf2c0089 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:29.059502 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2322/4533] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:28 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1474 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:29.070696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b2abd4bb-c1b6-4469-8a36-1040bf2c0089 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:29.073380 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b2abd4bb-c1b6-4469-8a36-1040bf2c0089 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:29.081550 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b2abd4bb-c1b6-4469-8a36-1040bf2c0089 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 2934 microversion: 2.42 time: 0.931880 Aug 03 02:12:29.082569 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2212/4534] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:28 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 2934 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:12:29.740218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-265861239", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:29.786683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-7605c9d7-152b-4fbc-b4ba-c1ef6f4a0131 req-d4b97216-292f-4583-b90e-dd87cb9cfe22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-unplugged", "status": "completed", "tag": "8cbd61f7-4c8d-4411-9cf8-c16e2c78580e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:29.825630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7605c9d7-152b-4fbc-b4ba-c1ef6f4a0131 req-d4b97216-292f-4583-b90e-dd87cb9cfe22 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:29.826403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7605c9d7-152b-4fbc-b4ba-c1ef6f4a0131 req-d4b97216-292f-4583-b90e-dd87cb9cfe22 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:29.864199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] validate_networks() for [('d26ca69a-a338-40ed-9e04-7c6942285689', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:12:29.887934 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-7605c9d7-152b-4fbc-b4ba-c1ef6f4a0131 req-d4b97216-292f-4583-b90e-dd87cb9cfe22 service nova] Creating event network-vif-unplugged:8cbd61f7-4c8d-4411-9cf8-c16e2c78580e for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:12:29.894919 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-7605c9d7-152b-4fbc-b4ba-c1ef6f4a0131 req-d4b97216-292f-4583-b90e-dd87cb9cfe22 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112346 Aug 03 02:12:29.896291 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2213/4535] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:30.143060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c5ba8e7e-9cef-48f4-af77-5135398994fd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:30.144402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c5ba8e7e-9cef-48f4-af77-5135398994fd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:30.175631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5ba8e7e-9cef-48f4-af77-5135398994fd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:30.178092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5ba8e7e-9cef-48f4-af77-5135398994fd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:30.181279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5ba8e7e-9cef-48f4-af77-5135398994fd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:30.183862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5ba8e7e-9cef-48f4-af77-5135398994fd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:31.200174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c5ba8e7e-9cef-48f4-af77-5135398994fd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:31.221566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c5ba8e7e-9cef-48f4-af77-5135398994fd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:31.224723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c5ba8e7e-9cef-48f4-af77-5135398994fd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:31.226508 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c5ba8e7e-9cef-48f4-af77-5135398994fd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 2913 microversion: 2.42 time: 1.093830 Aug 03 02:12:31.228093 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2214/4536] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:30 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 2913 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:12:31.980395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-1b05bd2d-e421-4d75-aeb9-c30e06cfc030 req-8a3e0297-f21e-437a-a5c2-35ebd0375585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-unplugged", "status": "completed", "tag": "cd112bb2-d68e-45f9-8740-1a2cdf18bce8"}, {"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-unplugged", "status": "completed", "tag": "2d1a410d-29d6-424d-b7ce-91aa60713c2c"}, {"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-unplugged", "status": "completed", "tag": "dd896678-ab80-49e5-8344-6b05edfc5dd4"}, {"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-unplugged", "status": "completed", "tag": "805da5ad-6ade-4a2c-94be-dc2a26fa060a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:31.998564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:32.039875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1b05bd2d-e421-4d75-aeb9-c30e06cfc030 req-8a3e0297-f21e-437a-a5c2-35ebd0375585 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:32.040538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1b05bd2d-e421-4d75-aeb9-c30e06cfc030 req-8a3e0297-f21e-437a-a5c2-35ebd0375585 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:32.085561 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-1b05bd2d-e421-4d75-aeb9-c30e06cfc030 req-8a3e0297-f21e-437a-a5c2-35ebd0375585 service nova] Creating event network-vif-unplugged:cd112bb2-d68e-45f9-8740-1a2cdf18bce8 for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:12:32.090788 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-1b05bd2d-e421-4d75-aeb9-c30e06cfc030 req-8a3e0297-f21e-437a-a5c2-35ebd0375585 service nova] Creating event network-vif-unplugged:2d1a410d-29d6-424d-b7ce-91aa60713c2c for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:12:32.095312 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-1b05bd2d-e421-4d75-aeb9-c30e06cfc030 req-8a3e0297-f21e-437a-a5c2-35ebd0375585 service nova] Creating event network-vif-unplugged:dd896678-ab80-49e5-8344-6b05edfc5dd4 for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:12:32.097424 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-1b05bd2d-e421-4d75-aeb9-c30e06cfc030 req-8a3e0297-f21e-437a-a5c2-35ebd0375585 service nova] Creating event network-vif-unplugged:805da5ad-6ade-4a2c-94be-dc2a26fa060a for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:12:32.116431 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-1b05bd2d-e421-4d75-aeb9-c30e06cfc030 req-8a3e0297-f21e-437a-a5c2-35ebd0375585 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.141067 Aug 03 02:12:32.122323 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2215/4537] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:12:32.268207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-436d94fe-54fa-42a0-b10d-4ebc56a083e4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:32.271381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-436d94fe-54fa-42a0-b10d-4ebc56a083e4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:32.296407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-436d94fe-54fa-42a0-b10d-4ebc56a083e4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:32.296895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-436d94fe-54fa-42a0-b10d-4ebc56a083e4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:32.297748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-436d94fe-54fa-42a0-b10d-4ebc56a083e4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:32.298202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-436d94fe-54fa-42a0-b10d-4ebc56a083e4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:32.359977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:12:32.361389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:12:32.362514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:12:32.363221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:12:32.364519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:12:32.368581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:32.383789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:32.384810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:32.386444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:32.387185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:32.426464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:12:32.453473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for user 2721f67579e542718483193be7515d6b and project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:12:32.475782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:12:32.480192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:12:32.597674 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-37d8997a-f6fa-4148-8a35-1273f06e0391 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.864199 Aug 03 02:12:32.599695 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2323/4538] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:12:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:12:32.615431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f248bd90-53be-426a-9237-cf8a73dcf938 req-204695c9-00a4-49a7-8cd5-25cf40c1d480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-deleted", "tag": "dd896678-ab80-49e5-8344-6b05edfc5dd4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:32.661696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f248bd90-53be-426a-9237-cf8a73dcf938 req-204695c9-00a4-49a7-8cd5-25cf40c1d480 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:32.662412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f248bd90-53be-426a-9237-cf8a73dcf938 req-204695c9-00a4-49a7-8cd5-25cf40c1d480 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:32.680931 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f248bd90-53be-426a-9237-cf8a73dcf938 req-204695c9-00a4-49a7-8cd5-25cf40c1d480 service nova] Creating event network-vif-deleted:dd896678-ab80-49e5-8344-6b05edfc5dd4 for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:12:32.689618 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f248bd90-53be-426a-9237-cf8a73dcf938 req-204695c9-00a4-49a7-8cd5-25cf40c1d480 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088129 Aug 03 02:12:32.691325 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2324/4539] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:32.697780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8fe8849-3988-47e5-b6a2-1d3e4c92362d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:32.699972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8fe8849-3988-47e5-b6a2-1d3e4c92362d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:32.727387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8fe8849-3988-47e5-b6a2-1d3e4c92362d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:12:33.579905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-436d94fe-54fa-42a0-b10d-4ebc56a083e4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:33.590159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-436d94fe-54fa-42a0-b10d-4ebc56a083e4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:33.592937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-436d94fe-54fa-42a0-b10d-4ebc56a083e4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:33.594124 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-436d94fe-54fa-42a0-b10d-4ebc56a083e4 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 2867 microversion: 2.42 time: 1.341949 Aug 03 02:12:33.598361 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2216/4540] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:32 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 2867 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:12:34.089100 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.compute.api [None req-e8fe8849-3988-47e5-b6a2-1d3e4c92362d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd] Instance Mapping does not exist while attempting local delete cleanup. Aug 03 02:12:34.099385 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8fe8849-3988-47e5-b6a2-1d3e4c92362d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9d8a7c53-fcee-435e-acd4-f6b0ea63bacd" status: 204 len: 0 microversion: 2.1 time: 1.405469 Aug 03 02:12:34.105750 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2325/4541] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:12:32 2022] DELETE /compute/v2.1/servers/9d8a7c53-fcee-435e-acd4-f6b0ea63bacd => generated 0 bytes in 1413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:12:34.118044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d551b802-f853-4bae-83a5-ecc0c262dd1b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:34.118243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d551b802-f853-4bae-83a5-ecc0c262dd1b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:34.125564 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-d551b802-f853-4bae-83a5-ecc0c262dd1b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d551b802-f853-4bae-83a5-ecc0c262dd1b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/9d8a7c53-fcee-435e-acd4-f6b0ea63bacd HTTP/1.1 Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '9d8a7c53-fcee-435e-acd4-f6b0ea63bacd'} Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:12:34.132266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:12:34.137246 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:12:34.137246 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:12:34.137246 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:12:34.137246 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. Aug 03 02:12:34.137246 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:12:34.137246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d551b802-f853-4bae-83a5-ecc0c262dd1b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:12:34.137246 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d551b802-f853-4bae-83a5-ecc0c262dd1b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/9d8a7c53-fcee-435e-acd4-f6b0ea63bacd" status: 404 len: 111 microversion: 2.1 time: 0.023821 Aug 03 02:12:34.137246 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2217/4542] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:34 2022] GET /compute/v2.1/servers/9d8a7c53-fcee-435e-acd4-f6b0ea63bacd => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:12:34.197923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-503225958", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "4ba8655a-786e-4526-8691-c49633863216"}], "key_name": "tempest-TestNetworkBasicOps-1186470048", "security_groups": [{"name": "tempest-secgroup-smoke-215320638"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:34.630247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e5dd481a-b17e-42f3-a59f-19a8b7a4a1fc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:34.631773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e5dd481a-b17e-42f3-a59f-19a8b7a4a1fc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:34.654489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5dd481a-b17e-42f3-a59f-19a8b7a4a1fc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:34.658741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5dd481a-b17e-42f3-a59f-19a8b7a4a1fc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:34.662745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5dd481a-b17e-42f3-a59f-19a8b7a4a1fc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:34.665968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5dd481a-b17e-42f3-a59f-19a8b7a4a1fc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:34.877057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] validate_networks() for [('4ba8655a-786e-4526-8691-c49633863216', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:12:35.258008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e5dd481a-b17e-42f3-a59f-19a8b7a4a1fc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:35.263513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:35.285988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e5dd481a-b17e-42f3-a59f-19a8b7a4a1fc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:35.292735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e5dd481a-b17e-42f3-a59f-19a8b7a4a1fc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:35.301105 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e5dd481a-b17e-42f3-a59f-19a8b7a4a1fc tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 2707 microversion: 2.42 time: 0.674956 Aug 03 02:12:35.302653 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2218/4543] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:34 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 2707 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:12:35.324913 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-834603505", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "d26ca69a-a338-40ed-9e04-7c6942285689"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:35.458131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] validate_networks() for [('d26ca69a-a338-40ed-9e04-7c6942285689', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:12:36.660921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:12:36.661500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:12:36.662041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:12:36.662776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:12:36.663431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:12:36.683823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:36.684532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:36.686431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:36.687081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:36.722367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:12:36.731153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for user 2721f67579e542718483193be7515d6b and project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:12:36.771097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:12:36.775395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:12:36.827837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:12:36.828791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:12:36.829601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:12:36.830220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:12:36.830994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:12:36.864812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:36.865882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:36.868155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:36.868846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:36.897299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=99 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:36.921351 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d786ac84-b279-4fa9-ac62-ebe0897ebd7e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.616625 Aug 03 02:12:36.928564 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2219/4544] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:12:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:12:36.933485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Getting quotas for project f90284be975b4e459cdc3e72c1664630. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:12:36.935484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-19ec2024-bd02-45d1-ac7f-eca286ef31bc req-db65effe-eb4e-403f-a646-4146c4f61fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-deleted", "tag": "cd112bb2-d68e-45f9-8740-1a2cdf18bce8"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:36.953183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-19ec2024-bd02-45d1-ac7f-eca286ef31bc req-db65effe-eb4e-403f-a646-4146c4f61fad service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:36.953790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-19ec2024-bd02-45d1-ac7f-eca286ef31bc req-db65effe-eb4e-403f-a646-4146c4f61fad service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:36.965326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Getting quotas for user c1ab5d1fb4b1453b9ba37a2b1194ec79 and project f90284be975b4e459cdc3e72c1664630. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:12:36.972550 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-19ec2024-bd02-45d1-ac7f-eca286ef31bc req-db65effe-eb4e-403f-a646-4146c4f61fad service nova] Creating event network-vif-deleted:cd112bb2-d68e-45f9-8740-1a2cdf18bce8 for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:12:36.983147 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-19ec2024-bd02-45d1-ac7f-eca286ef31bc req-db65effe-eb4e-403f-a646-4146c4f61fad service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053104 Aug 03 02:12:36.985858 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2220/4545] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:37.014135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ce1db62c-b1ea-4c56-934f-377b33887072 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:37.015024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ce1db62c-b1ea-4c56-934f-377b33887072 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:37.019664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:12:37.025076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:12:37.043675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ce1db62c-b1ea-4c56-934f-377b33887072 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:37.048128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ce1db62c-b1ea-4c56-934f-377b33887072 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:37.051351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ce1db62c-b1ea-4c56-934f-377b33887072 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:37.051989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ce1db62c-b1ea-4c56-934f-377b33887072 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:37.152625 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1428fe9d-c764-4df3-a527-4465f0a56fdb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.959591 Aug 03 02:12:37.156584 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2326/4546] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:12:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 2963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:12:37.170696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2ca79325-b65c-40c0-8081-2000d8b5b94b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:37.172244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2ca79325-b65c-40c0-8081-2000d8b5b94b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:38.451964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2ca79325-b65c-40c0-8081-2000d8b5b94b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:38.473423 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2ca79325-b65c-40c0-8081-2000d8b5b94b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 200 len: 1220 microversion: 2.1 time: 1.312353 Aug 03 02:12:38.487718 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2327/4547] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:37 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 1220 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:38.516308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-82912484-0e01-4cb1-9ce9-2357c44da7a5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:38.516949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-82912484-0e01-4cb1-9ce9-2357c44da7a5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:38.528878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82912484-0e01-4cb1-9ce9-2357c44da7a5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:38.530621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82912484-0e01-4cb1-9ce9-2357c44da7a5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:38.536347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82912484-0e01-4cb1-9ce9-2357c44da7a5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:38.539033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82912484-0e01-4cb1-9ce9-2357c44da7a5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:38.913868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-82912484-0e01-4cb1-9ce9-2357c44da7a5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:38.938310 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-82912484-0e01-4cb1-9ce9-2357c44da7a5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1300 microversion: 2.1 time: 0.457971 Aug 03 02:12:38.941173 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2328/4548] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:38 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1300 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:39.024327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-4fe6b7cc-9b21-42c3-9b64-0ada8c654ac2 req-650ab336-6922-48f1-98b2-c68c91faa282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-deleted", "tag": "8cbd61f7-4c8d-4411-9cf8-c16e2c78580e"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:39.039892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ce1db62c-b1ea-4c56-934f-377b33887072 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:39.068038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ce1db62c-b1ea-4c56-934f-377b33887072 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:39.074298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ce1db62c-b1ea-4c56-934f-377b33887072 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:39.075291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4fe6b7cc-9b21-42c3-9b64-0ada8c654ac2 req-650ab336-6922-48f1-98b2-c68c91faa282 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:39.075751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4fe6b7cc-9b21-42c3-9b64-0ada8c654ac2 req-650ab336-6922-48f1-98b2-c68c91faa282 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:39.079818 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ce1db62c-b1ea-4c56-934f-377b33887072 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 2547 microversion: 2.42 time: 2.090334 Aug 03 02:12:39.099677 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2221/4549] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:36 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 2547 bytes in 2095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:12:39.128463 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-4fe6b7cc-9b21-42c3-9b64-0ada8c654ac2 req-650ab336-6922-48f1-98b2-c68c91faa282 service nova] Creating event network-vif-deleted:8cbd61f7-4c8d-4411-9cf8-c16e2c78580e for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:12:39.148769 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-4fe6b7cc-9b21-42c3-9b64-0ada8c654ac2 req-650ab336-6922-48f1-98b2-c68c91faa282 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129579 Aug 03 02:12:39.151470 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2329/4550] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:39.499352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1c122fa9-378b-44fd-80a5-a447cd753fc6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:39.500413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1c122fa9-378b-44fd-80a5-a447cd753fc6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:39.513424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c122fa9-378b-44fd-80a5-a447cd753fc6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:39.520063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c122fa9-378b-44fd-80a5-a447cd753fc6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:39.524166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c122fa9-378b-44fd-80a5-a447cd753fc6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:39.524794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c122fa9-378b-44fd-80a5-a447cd753fc6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:39.956901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1c122fa9-378b-44fd-80a5-a447cd753fc6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:39.966638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6dcfee2c-260e-4eb5-9aca-d84ba2ba74e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:39.973999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6dcfee2c-260e-4eb5-9aca-d84ba2ba74e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:39.979599 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1c122fa9-378b-44fd-80a5-a447cd753fc6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 200 len: 1280 microversion: 2.1 time: 0.484158 Aug 03 02:12:39.993464 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2222/4551] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:39 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 1280 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:39.996407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dcfee2c-260e-4eb5-9aca-d84ba2ba74e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:39.997877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dcfee2c-260e-4eb5-9aca-d84ba2ba74e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:39.999128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dcfee2c-260e-4eb5-9aca-d84ba2ba74e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:40.003244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dcfee2c-260e-4eb5-9aca-d84ba2ba74e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:40.112841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-de2837b1-e987-4978-b0f8-68ae68df3364 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:40.113726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-de2837b1-e987-4978-b0f8-68ae68df3364 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:40.133222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de2837b1-e987-4978-b0f8-68ae68df3364 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:40.133678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de2837b1-e987-4978-b0f8-68ae68df3364 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:40.134476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de2837b1-e987-4978-b0f8-68ae68df3364 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:40.140254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de2837b1-e987-4978-b0f8-68ae68df3364 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:40.608888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6dcfee2c-260e-4eb5-9aca-d84ba2ba74e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:40.624577 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6dcfee2c-260e-4eb5-9aca-d84ba2ba74e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1306 microversion: 2.1 time: 0.663649 Aug 03 02:12:40.625187 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2330/4552] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:39 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1306 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:41.002214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-762aaf50-b51a-4ee6-9644-aeaa1b4ff504 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:41.004138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-762aaf50-b51a-4ee6-9644-aeaa1b4ff504 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:41.032028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-762aaf50-b51a-4ee6-9644-aeaa1b4ff504 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:41.035765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-762aaf50-b51a-4ee6-9644-aeaa1b4ff504 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:41.042818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-762aaf50-b51a-4ee6-9644-aeaa1b4ff504 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:41.048679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-762aaf50-b51a-4ee6-9644-aeaa1b4ff504 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:41.208971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-de2837b1-e987-4978-b0f8-68ae68df3364 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:41.220770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-de2837b1-e987-4978-b0f8-68ae68df3364 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:41.241657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-de2837b1-e987-4978-b0f8-68ae68df3364 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:41.243420 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-de2837b1-e987-4978-b0f8-68ae68df3364 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 2257 microversion: 2.42 time: 1.135508 Aug 03 02:12:41.254032 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2223/4553] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:40 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 2257 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:12:41.282712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-8cf591a7-61be-4753-9819-ae4dcf63b3f6 req-9088a721-d825-4748-abed-855ee8f33ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-deleted", "tag": "805da5ad-6ade-4a2c-94be-dc2a26fa060a"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:41.335930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8cf591a7-61be-4753-9819-ae4dcf63b3f6 req-9088a721-d825-4748-abed-855ee8f33ab1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:41.346607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8cf591a7-61be-4753-9819-ae4dcf63b3f6 req-9088a721-d825-4748-abed-855ee8f33ab1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:41.421532 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-8cf591a7-61be-4753-9819-ae4dcf63b3f6 req-9088a721-d825-4748-abed-855ee8f33ab1 service nova] Creating event network-vif-deleted:805da5ad-6ade-4a2c-94be-dc2a26fa060a for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:12:41.474135 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-8cf591a7-61be-4753-9819-ae4dcf63b3f6 req-9088a721-d825-4748-abed-855ee8f33ab1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191773 Aug 03 02:12:41.477846 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2224/4554] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:41.665866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ab54d87-2e0c-4b0d-a60f-866420fc16d3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:41.667241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2ab54d87-2e0c-4b0d-a60f-866420fc16d3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:41.706510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ab54d87-2e0c-4b0d-a60f-866420fc16d3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:41.714312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ab54d87-2e0c-4b0d-a60f-866420fc16d3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:41.717288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ab54d87-2e0c-4b0d-a60f-866420fc16d3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:41.718112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ab54d87-2e0c-4b0d-a60f-866420fc16d3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:42.342383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2ab54d87-2e0c-4b0d-a60f-866420fc16d3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:42.359520 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2ab54d87-2e0c-4b0d-a60f-866420fc16d3 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1306 microversion: 2.1 time: 0.714383 Aug 03 02:12:42.360200 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2225/4555] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:41 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1306 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:12:42.379115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e05657e6-42df-4885-8d10-bff318fd1d3a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:42.380055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e05657e6-42df-4885-8d10-bff318fd1d3a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:42.391342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e05657e6-42df-4885-8d10-bff318fd1d3a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:42.392022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e05657e6-42df-4885-8d10-bff318fd1d3a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:42.393212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e05657e6-42df-4885-8d10-bff318fd1d3a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:42.393999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e05657e6-42df-4885-8d10-bff318fd1d3a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:42.589604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-762aaf50-b51a-4ee6-9644-aeaa1b4ff504 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:42.599229 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-762aaf50-b51a-4ee6-9644-aeaa1b4ff504 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 200 len: 1320 microversion: 2.1 time: 1.601658 Aug 03 02:12:42.599819 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2331/4556] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:40 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 1320 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:43.392426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9ba31411-396e-445d-9a35-69a7ab63b2cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:43.394464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9ba31411-396e-445d-9a35-69a7ab63b2cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:43.421784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ba31411-396e-445d-9a35-69a7ab63b2cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:43.423299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ba31411-396e-445d-9a35-69a7ab63b2cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:43.424175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ba31411-396e-445d-9a35-69a7ab63b2cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:43.429352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ba31411-396e-445d-9a35-69a7ab63b2cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:43.498847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e05657e6-42df-4885-8d10-bff318fd1d3a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:43.532882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e05657e6-42df-4885-8d10-bff318fd1d3a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:43.535336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e05657e6-42df-4885-8d10-bff318fd1d3a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:43.537236 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e05657e6-42df-4885-8d10-bff318fd1d3a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 2097 microversion: 2.42 time: 1.175863 Aug 03 02:12:43.538381 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2226/4557] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:42 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 2097 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:12:43.547452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-21fdded9-e03c-4b3f-b048-2881ffbc71b4 req-64ee4fe0-1a54-41a7-b757-3ebf8546ecd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477b4b57-926f-4ea1-aef2-f6e50b9d22ab", "tag": "4b523644-b819-46af-958f-77c546598f70"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:43.561357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-21fdded9-e03c-4b3f-b048-2881ffbc71b4 req-64ee4fe0-1a54-41a7-b757-3ebf8546ecd7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:43.562508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-21fdded9-e03c-4b3f-b048-2881ffbc71b4 req-64ee4fe0-1a54-41a7-b757-3ebf8546ecd7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:43.611988 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-21fdded9-e03c-4b3f-b048-2881ffbc71b4 req-64ee4fe0-1a54-41a7-b757-3ebf8546ecd7 service nova] Creating event network-changed:4b523644-b819-46af-958f-77c546598f70 for instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab on n-h1-826529-8 Aug 03 02:12:43.630293 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-21fdded9-e03c-4b3f-b048-2881ffbc71b4 req-64ee4fe0-1a54-41a7-b757-3ebf8546ecd7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088306 Aug 03 02:12:43.633017 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2227/4558] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:43.644867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-30a52d65-a75a-4d50-bd30-c132a6acaf6a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:43.645596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-30a52d65-a75a-4d50-bd30-c132a6acaf6a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:43.669934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30a52d65-a75a-4d50-bd30-c132a6acaf6a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:43.673372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30a52d65-a75a-4d50-bd30-c132a6acaf6a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:43.674961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30a52d65-a75a-4d50-bd30-c132a6acaf6a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:43.675475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30a52d65-a75a-4d50-bd30-c132a6acaf6a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:43.860914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9ba31411-396e-445d-9a35-69a7ab63b2cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:43.878619 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9ba31411-396e-445d-9a35-69a7ab63b2cb tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1373 microversion: 2.1 time: 0.494418 Aug 03 02:12:43.880517 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2332/4559] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:43 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1373 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:44.456684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-47ba6f6f-fc93-4021-a0ca-0f900818daa7 req-37441532-8bb5-41ab-96c8-1f25966892c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb1d773-208d-437e-9e60-fc1ef93623c3", "name": "network-vif-deleted", "tag": "2d1a410d-29d6-424d-b7ce-91aa60713c2c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:44.476839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-47ba6f6f-fc93-4021-a0ca-0f900818daa7 req-37441532-8bb5-41ab-96c8-1f25966892c4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:44.477297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-47ba6f6f-fc93-4021-a0ca-0f900818daa7 req-37441532-8bb5-41ab-96c8-1f25966892c4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:44.521606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-30a52d65-a75a-4d50-bd30-c132a6acaf6a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:44.529944 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-30a52d65-a75a-4d50-bd30-c132a6acaf6a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 200 len: 1320 microversion: 2.1 time: 0.894301 Aug 03 02:12:44.532288 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2228/4560] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:43 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 1320 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:44.549250 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-47ba6f6f-fc93-4021-a0ca-0f900818daa7 req-37441532-8bb5-41ab-96c8-1f25966892c4 service nova] Creating event network-vif-deleted:2d1a410d-29d6-424d-b7ce-91aa60713c2c for instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 on n-h2-826529-8 Aug 03 02:12:44.559029 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-47ba6f6f-fc93-4021-a0ca-0f900818daa7 req-37441532-8bb5-41ab-96c8-1f25966892c4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113699 Aug 03 02:12:44.560165 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2333/4561] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 03 02:12:44.588001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69222c2d-eb17-4cc8-a150-f6c2e03a027e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:44.588965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-69222c2d-eb17-4cc8-a150-f6c2e03a027e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:44.620269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69222c2d-eb17-4cc8-a150-f6c2e03a027e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:44.620840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69222c2d-eb17-4cc8-a150-f6c2e03a027e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:44.621938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69222c2d-eb17-4cc8-a150-f6c2e03a027e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:44.625083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69222c2d-eb17-4cc8-a150-f6c2e03a027e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:44.867341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-69222c2d-eb17-4cc8-a150-f6c2e03a027e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:44.886027 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-69222c2d-eb17-4cc8-a150-f6c2e03a027e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:44.903714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2835cc41-37e9-4f23-b803-e24b58ec18e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:44.904481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2835cc41-37e9-4f23-b803-e24b58ec18e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:44.904942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-69222c2d-eb17-4cc8-a150-f6c2e03a027e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:44.911492 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-69222c2d-eb17-4cc8-a150-f6c2e03a027e tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.347308 Aug 03 02:12:44.920537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2835cc41-37e9-4f23-b803-e24b58ec18e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:44.920912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2835cc41-37e9-4f23-b803-e24b58ec18e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:44.921707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2835cc41-37e9-4f23-b803-e24b58ec18e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:44.922148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2835cc41-37e9-4f23-b803-e24b58ec18e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:44.935659 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2229/4562] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:44 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:12:45.425798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2835cc41-37e9-4f23-b803-e24b58ec18e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:45.438868 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2835cc41-37e9-4f23-b803-e24b58ec18e1 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1373 microversion: 2.1 time: 0.539400 Aug 03 02:12:45.441232 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2334/4563] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:44 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1373 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:12:45.554052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-96fcf56e-d260-4ead-8495-9bac501fd851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:45.556020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-96fcf56e-d260-4ead-8495-9bac501fd851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:45.571671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-96fcf56e-d260-4ead-8495-9bac501fd851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:45.574485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-96fcf56e-d260-4ead-8495-9bac501fd851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:45.577388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-96fcf56e-d260-4ead-8495-9bac501fd851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:45.579172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-96fcf56e-d260-4ead-8495-9bac501fd851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:45.923313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-96fcf56e-d260-4ead-8495-9bac501fd851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:45.934040 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-96fcf56e-d260-4ead-8495-9bac501fd851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 200 len: 1320 microversion: 2.1 time: 0.384939 Aug 03 02:12:45.934549 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2230/4564] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:45 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 1320 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:45.941888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4f79149e-edfc-4218-abab-e33a78a1eaff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:45.942503 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4f79149e-edfc-4218-abab-e33a78a1eaff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:45.954687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f79149e-edfc-4218-abab-e33a78a1eaff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:45.955445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f79149e-edfc-4218-abab-e33a78a1eaff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:45.956702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f79149e-edfc-4218-abab-e33a78a1eaff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:45.957790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f79149e-edfc-4218-abab-e33a78a1eaff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:46.070527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4f79149e-edfc-4218-abab-e33a78a1eaff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:46.090054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4f79149e-edfc-4218-abab-e33a78a1eaff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:46.094878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4f79149e-edfc-4218-abab-e33a78a1eaff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:46.100945 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4f79149e-edfc-4218-abab-e33a78a1eaff tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.161124 Aug 03 02:12:46.102375 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2335/4565] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:45 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:12:46.461829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3e2a3b87-96ee-4b0b-80bc-f280215cc7fe tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:46.462467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3e2a3b87-96ee-4b0b-80bc-f280215cc7fe tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:46.475316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e2a3b87-96ee-4b0b-80bc-f280215cc7fe tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:46.477003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e2a3b87-96ee-4b0b-80bc-f280215cc7fe tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:46.479711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e2a3b87-96ee-4b0b-80bc-f280215cc7fe tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:46.481943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e2a3b87-96ee-4b0b-80bc-f280215cc7fe tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:46.589504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-25a9d866-a180-4942-98b9-e4c291d7f110 req-288a7db7-7993-4f77-a323-68709177f20b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa69891-6222-4604-83b3-e4f33dc43728", "tag": "41484393-ec38-4692-a586-0b483604ca69"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:46.606862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-25a9d866-a180-4942-98b9-e4c291d7f110 req-288a7db7-7993-4f77-a323-68709177f20b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:46.606862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-25a9d866-a180-4942-98b9-e4c291d7f110 req-288a7db7-7993-4f77-a323-68709177f20b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:46.639312 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-25a9d866-a180-4942-98b9-e4c291d7f110 req-288a7db7-7993-4f77-a323-68709177f20b service nova] Creating event network-changed:41484393-ec38-4692-a586-0b483604ca69 for instance 9fa69891-6222-4604-83b3-e4f33dc43728 on n-h1-826529-8 Aug 03 02:12:46.651011 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-25a9d866-a180-4942-98b9-e4c291d7f110 req-288a7db7-7993-4f77-a323-68709177f20b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065208 Aug 03 02:12:46.652146 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2336/4566] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:12:46.707444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:46.750284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:46.961515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-02c0a3e6-da46-4cb5-9a1a-6d285c123a4b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:46.966404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-02c0a3e6-da46-4cb5-9a1a-6d285c123a4b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:46.994415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:47.004498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02c0a3e6-da46-4cb5-9a1a-6d285c123a4b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:47.015812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02c0a3e6-da46-4cb5-9a1a-6d285c123a4b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:47.018233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02c0a3e6-da46-4cb5-9a1a-6d285c123a4b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:47.019448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02c0a3e6-da46-4cb5-9a1a-6d285c123a4b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:47.188198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3e2a3b87-96ee-4b0b-80bc-f280215cc7fe tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:47.205801 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3e2a3b87-96ee-4b0b-80bc-f280215cc7fe tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1373 microversion: 2.1 time: 0.748093 Aug 03 02:12:47.219402 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2231/4567] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:46 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1373 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:47.225322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-765074ca-4ad9-4ee2-b45b-f435adac1662 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:47.225962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-765074ca-4ad9-4ee2-b45b-f435adac1662 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:47.246980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-765074ca-4ad9-4ee2-b45b-f435adac1662 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:47.247460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-765074ca-4ad9-4ee2-b45b-f435adac1662 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:47.248270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-765074ca-4ad9-4ee2-b45b-f435adac1662 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:47.248722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-765074ca-4ad9-4ee2-b45b-f435adac1662 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:47.499480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-765074ca-4ad9-4ee2-b45b-f435adac1662 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:47.513210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-765074ca-4ad9-4ee2-b45b-f435adac1662 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:47.514573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-765074ca-4ad9-4ee2-b45b-f435adac1662 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:47.518020 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-765074ca-4ad9-4ee2-b45b-f435adac1662 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.297473 Aug 03 02:12:47.518609 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2232/4568] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:47 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:12:47.661352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-02c0a3e6-da46-4cb5-9a1a-6d285c123a4b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:47.671781 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-02c0a3e6-da46-4cb5-9a1a-6d285c123a4b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 200 len: 1320 microversion: 2.1 time: 0.718438 Aug 03 02:12:47.673505 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2337/4569] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:46 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 1320 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:48.232227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-76f1c20c-36cd-423c-8894-51f83b645fbd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:48.232863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-76f1c20c-36cd-423c-8894-51f83b645fbd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:48.247743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76f1c20c-36cd-423c-8894-51f83b645fbd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:48.248128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76f1c20c-36cd-423c-8894-51f83b645fbd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:48.248944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76f1c20c-36cd-423c-8894-51f83b645fbd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:48.249390 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76f1c20c-36cd-423c-8894-51f83b645fbd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:48.548518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a098da49-1118-4196-8ff4-fb1316b83739 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:48.549256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a098da49-1118-4196-8ff4-fb1316b83739 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:48.556378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=20 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:48.588129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a098da49-1118-4196-8ff4-fb1316b83739 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:48.588606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a098da49-1118-4196-8ff4-fb1316b83739 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:48.589461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a098da49-1118-4196-8ff4-fb1316b83739 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:48.600394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a098da49-1118-4196-8ff4-fb1316b83739 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:49.347211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a098da49-1118-4196-8ff4-fb1316b83739 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:49.362221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a098da49-1118-4196-8ff4-fb1316b83739 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:49.364040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a098da49-1118-4196-8ff4-fb1316b83739 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:49.365293 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a098da49-1118-4196-8ff4-fb1316b83739 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.821045 Aug 03 02:12:49.397113 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2338/4570] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:48 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:12:49.405304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1477ee4b-8451-41fa-9f38-46fa60c3c721 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:49.405949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1477ee4b-8451-41fa-9f38-46fa60c3c721 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:49.440202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1477ee4b-8451-41fa-9f38-46fa60c3c721 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:49.448476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1477ee4b-8451-41fa-9f38-46fa60c3c721 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:49.449757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1477ee4b-8451-41fa-9f38-46fa60c3c721 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:49.452123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1477ee4b-8451-41fa-9f38-46fa60c3c721 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:49.478252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-76f1c20c-36cd-423c-8894-51f83b645fbd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:49.487917 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-76f1c20c-36cd-423c-8894-51f83b645fbd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1373 microversion: 2.1 time: 1.260106 Aug 03 02:12:49.507843 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2233/4571] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:48 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1373 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:49.601285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9f3c5966-d944-437f-b9a0-2462d067ce1b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:49.606811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9f3c5966-d944-437f-b9a0-2462d067ce1b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:49.619818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f3c5966-d944-437f-b9a0-2462d067ce1b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:49.620588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f3c5966-d944-437f-b9a0-2462d067ce1b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:49.621846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f3c5966-d944-437f-b9a0-2462d067ce1b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:49.622489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f3c5966-d944-437f-b9a0-2462d067ce1b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:49.823980 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9f3c5966-d944-437f-b9a0-2462d067ce1b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.226850 Aug 03 02:12:49.825513 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2234/4572] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:12:49 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:12:49.839383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-39937a8e-9470-4d06-ac6e-c904b027edb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:49.841341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-39937a8e-9470-4d06-ac6e-c904b027edb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:49.867762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39937a8e-9470-4d06-ac6e-c904b027edb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:49.868808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39937a8e-9470-4d06-ac6e-c904b027edb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:49.874144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39937a8e-9470-4d06-ac6e-c904b027edb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:49.875543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-39937a8e-9470-4d06-ac6e-c904b027edb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:50.097794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-39937a8e-9470-4d06-ac6e-c904b027edb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:50.113220 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-39937a8e-9470-4d06-ac6e-c904b027edb6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1670 microversion: 2.1 time: 0.282966 Aug 03 02:12:50.161539 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2235/4573] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:49 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1670 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:50.396295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-03d127d4-e07e-4e15-9b96-0329fd48b404 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:50.397121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-03d127d4-e07e-4e15-9b96-0329fd48b404 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:50.421103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03d127d4-e07e-4e15-9b96-0329fd48b404 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:50.421877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03d127d4-e07e-4e15-9b96-0329fd48b404 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:50.423305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03d127d4-e07e-4e15-9b96-0329fd48b404 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:50.424274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03d127d4-e07e-4e15-9b96-0329fd48b404 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:50.449084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1477ee4b-8451-41fa-9f38-46fa60c3c721 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:50.476242 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1477ee4b-8451-41fa-9f38-46fa60c3c721 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 200 len: 1320 microversion: 2.1 time: 1.077557 Aug 03 02:12:50.476854 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2339/4574] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:49 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 1320 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:50.516074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9e0581f8-287b-4092-a6ae-0cac572838d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:50.516694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9e0581f8-287b-4092-a6ae-0cac572838d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:50.525880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e0581f8-287b-4092-a6ae-0cac572838d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:50.526333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e0581f8-287b-4092-a6ae-0cac572838d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:50.532724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e0581f8-287b-4092-a6ae-0cac572838d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:50.534199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e0581f8-287b-4092-a6ae-0cac572838d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:50.745241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-03d127d4-e07e-4e15-9b96-0329fd48b404 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:50.767299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-03d127d4-e07e-4e15-9b96-0329fd48b404 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:50.782015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-03d127d4-e07e-4e15-9b96-0329fd48b404 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:50.794732 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-03d127d4-e07e-4e15-9b96-0329fd48b404 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.394872 Aug 03 02:12:50.795503 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2236/4575] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:50 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:12:50.811243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-da7c9b8f-51dc-4bc1-8cab-42f3aa812894 req-d96aacfa-3930-48f2-b8b1-57ba255087d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477b4b57-926f-4ea1-aef2-f6e50b9d22ab", "name": "network-vif-plugged", "status": "completed", "tag": "4b523644-b819-46af-958f-77c546598f70"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:50.849874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-da7c9b8f-51dc-4bc1-8cab-42f3aa812894 req-d96aacfa-3930-48f2-b8b1-57ba255087d0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:50.851349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-da7c9b8f-51dc-4bc1-8cab-42f3aa812894 req-d96aacfa-3930-48f2-b8b1-57ba255087d0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:50.871226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:50.900981 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-da7c9b8f-51dc-4bc1-8cab-42f3aa812894 req-d96aacfa-3930-48f2-b8b1-57ba255087d0 service nova] Creating event network-vif-plugged:4b523644-b819-46af-958f-77c546598f70 for instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab on n-h1-826529-8 Aug 03 02:12:50.918134 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-da7c9b8f-51dc-4bc1-8cab-42f3aa812894 req-d96aacfa-3930-48f2-b8b1-57ba255087d0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121295 Aug 03 02:12:50.926857 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2237/4576] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:51.029079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9e0581f8-287b-4092-a6ae-0cac572838d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:51.039284 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9e0581f8-287b-4092-a6ae-0cac572838d5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1373 microversion: 2.1 time: 0.527077 Aug 03 02:12:51.045940 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2340/4577] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:50 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1373 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:12:51.138415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2c082ffa-b356-491d-b519-572c7bd94e82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:51.139200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2c082ffa-b356-491d-b519-572c7bd94e82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:51.159699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2c082ffa-b356-491d-b519-572c7bd94e82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:51.162623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2c082ffa-b356-491d-b519-572c7bd94e82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:51.165333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2c082ffa-b356-491d-b519-572c7bd94e82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:51.166598 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2c082ffa-b356-491d-b519-572c7bd94e82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:51.462688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2c082ffa-b356-491d-b519-572c7bd94e82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:51.476450 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2c082ffa-b356-491d-b519-572c7bd94e82 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1670 microversion: 2.1 time: 0.342495 Aug 03 02:12:51.487684 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2238/4578] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:51 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1670 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:51.520846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2ada908a-bfce-46ff-8cdb-b592f21f8b1b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:51.522459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2ada908a-bfce-46ff-8cdb-b592f21f8b1b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:51.536751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ada908a-bfce-46ff-8cdb-b592f21f8b1b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:51.538826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ada908a-bfce-46ff-8cdb-b592f21f8b1b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:51.542884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ada908a-bfce-46ff-8cdb-b592f21f8b1b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:51.545119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ada908a-bfce-46ff-8cdb-b592f21f8b1b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:51.822826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8bc8332d-65df-4ed0-a213-c258866ae866 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:51.823522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8bc8332d-65df-4ed0-a213-c258866ae866 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:51.834083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bc8332d-65df-4ed0-a213-c258866ae866 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:51.834549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bc8332d-65df-4ed0-a213-c258866ae866 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:51.846991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bc8332d-65df-4ed0-a213-c258866ae866 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:51.847533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bc8332d-65df-4ed0-a213-c258866ae866 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:51.982774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2ada908a-bfce-46ff-8cdb-b592f21f8b1b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:52.006017 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2ada908a-bfce-46ff-8cdb-b592f21f8b1b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 200 len: 1320 microversion: 2.1 time: 0.490684 Aug 03 02:12:52.007768 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2341/4579] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:51 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 1320 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:52.026340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8bc8332d-65df-4ed0-a213-c258866ae866 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:52.043457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8bc8332d-65df-4ed0-a213-c258866ae866 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:52.046343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8bc8332d-65df-4ed0-a213-c258866ae866 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:52.047897 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8bc8332d-65df-4ed0-a213-c258866ae866 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.230045 Aug 03 02:12:52.059015 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2239/4580] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:51 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:12:52.074554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1e8b4579-e06c-4b38-8bd6-95e2640f877b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:52.077005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1e8b4579-e06c-4b38-8bd6-95e2640f877b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:52.088272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e8b4579-e06c-4b38-8bd6-95e2640f877b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:52.089654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e8b4579-e06c-4b38-8bd6-95e2640f877b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:52.091276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e8b4579-e06c-4b38-8bd6-95e2640f877b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:52.092156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e8b4579-e06c-4b38-8bd6-95e2640f877b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:52.506420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0f478c6b-287f-4798-9c00-857b29aca7a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:52.510700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0f478c6b-287f-4798-9c00-857b29aca7a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:52.531642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f478c6b-287f-4798-9c00-857b29aca7a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:52.535495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f478c6b-287f-4798-9c00-857b29aca7a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:52.536631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f478c6b-287f-4798-9c00-857b29aca7a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:52.539452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f478c6b-287f-4798-9c00-857b29aca7a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:52.565793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1e8b4579-e06c-4b38-8bd6-95e2640f877b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:52.580228 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1e8b4579-e06c-4b38-8bd6-95e2640f877b tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1373 microversion: 2.1 time: 0.510056 Aug 03 02:12:52.595371 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2342/4581] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:52 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1373 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:53.022123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0f478c6b-287f-4798-9c00-857b29aca7a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:53.030636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2d609d22-7901-4dd4-bff3-00c1b8854667 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:53.031305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2d609d22-7901-4dd4-bff3-00c1b8854667 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:53.041530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d609d22-7901-4dd4-bff3-00c1b8854667 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:53.041883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d609d22-7901-4dd4-bff3-00c1b8854667 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:53.053241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d609d22-7901-4dd4-bff3-00c1b8854667 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:53.053929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d609d22-7901-4dd4-bff3-00c1b8854667 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:53.063336 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0f478c6b-287f-4798-9c00-857b29aca7a9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1670 microversion: 2.1 time: 0.565845 Aug 03 02:12:53.066431 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2240/4582] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:52 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1670 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:53.090384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-841948e4-9aca-4c0d-a32a-f70e0be7cecb tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:53.092831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-841948e4-9aca-4c0d-a32a-f70e0be7cecb tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:53.127003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-841948e4-9aca-4c0d-a32a-f70e0be7cecb tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:53.128919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-841948e4-9aca-4c0d-a32a-f70e0be7cecb tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:53.132426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-841948e4-9aca-4c0d-a32a-f70e0be7cecb tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:53.134487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-841948e4-9aca-4c0d-a32a-f70e0be7cecb tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:53.398595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-841948e4-9aca-4c0d-a32a-f70e0be7cecb tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:53.426791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-841948e4-9aca-4c0d-a32a-f70e0be7cecb tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:53.433270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-841948e4-9aca-4c0d-a32a-f70e0be7cecb tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:53.434842 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-841948e4-9aca-4c0d-a32a-f70e0be7cecb tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.356108 Aug 03 02:12:53.437145 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2241/4583] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:53 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:12:53.438268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2d609d22-7901-4dd4-bff3-00c1b8854667 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:53.458570 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2d609d22-7901-4dd4-bff3-00c1b8854667 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 200 len: 1500 microversion: 2.1 time: 0.432595 Aug 03 02:12:53.459604 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2343/4584] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:53 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 1500 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:12:53.487749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e2e84a90-2d06-4e5b-a1b1-6d28c8c21545 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:53.488775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e2e84a90-2d06-4e5b-a1b1-6d28c8c21545 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:53.501731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2e84a90-2d06-4e5b-a1b1-6d28c8c21545 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:53.505099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2e84a90-2d06-4e5b-a1b1-6d28c8c21545 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:53.510654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2e84a90-2d06-4e5b-a1b1-6d28c8c21545 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:53.512866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2e84a90-2d06-4e5b-a1b1-6d28c8c21545 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:53.611471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7f0b9b83-50b4-4079-a35b-3ee2614fa043 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:53.612291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7f0b9b83-50b4-4079-a35b-3ee2614fa043 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:53.640386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f0b9b83-50b4-4079-a35b-3ee2614fa043 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:53.647947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f0b9b83-50b4-4079-a35b-3ee2614fa043 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:53.652376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f0b9b83-50b4-4079-a35b-3ee2614fa043 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:53.652852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f0b9b83-50b4-4079-a35b-3ee2614fa043 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:54.121897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e2e84a90-2d06-4e5b-a1b1-6d28c8c21545 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:54.156988 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e2e84a90-2d06-4e5b-a1b1-6d28c8c21545 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 200 len: 1500 microversion: 2.1 time: 0.673339 Aug 03 02:12:54.164067 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2242/4585] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:53 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 1500 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:54.214443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a4d82464-e567-4765-8ba3-52cb3248828e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:54.216031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a4d82464-e567-4765-8ba3-52cb3248828e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:54.283499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4d82464-e567-4765-8ba3-52cb3248828e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:54.285332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4d82464-e567-4765-8ba3-52cb3248828e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:54.288509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4d82464-e567-4765-8ba3-52cb3248828e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:54.292124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4d82464-e567-4765-8ba3-52cb3248828e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:54.385241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7f0b9b83-50b4-4079-a35b-3ee2614fa043 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:54.400461 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7f0b9b83-50b4-4079-a35b-3ee2614fa043 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1373 microversion: 2.1 time: 0.793681 Aug 03 02:12:54.401990 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2344/4586] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:53 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1373 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:54.413994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d4283a65-6e62-412e-90b4-daba5332884e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:54.414878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d4283a65-6e62-412e-90b4-daba5332884e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:54.433470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4283a65-6e62-412e-90b4-daba5332884e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:54.435135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4283a65-6e62-412e-90b4-daba5332884e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:54.436867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4283a65-6e62-412e-90b4-daba5332884e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:54.438629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4283a65-6e62-412e-90b4-daba5332884e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:54.503035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d4283a65-6e62-412e-90b4-daba5332884e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:12:54.550679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:54.674916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a4d82464-e567-4765-8ba3-52cb3248828e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:54.695339 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a4d82464-e567-4765-8ba3-52cb3248828e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.528781 Aug 03 02:12:54.698253 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2243/4587] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:54 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:54.713690 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d4283a65-6e62-412e-90b4-daba5332884e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 204 len: 0 microversion: 2.1 time: 0.308221 Aug 03 02:12:54.717291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-06b630b4-48fc-489b-945d-672ed9d3ad59 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:54.718824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-06b630b4-48fc-489b-945d-672ed9d3ad59 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:54.719344 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2345/4588] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:12:54 2022] DELETE /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:12:54.732352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b5fb5f05-45bc-46d8-88ba-baad4db96ec8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:54.734838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06b630b4-48fc-489b-945d-672ed9d3ad59 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:54.735915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b5fb5f05-45bc-46d8-88ba-baad4db96ec8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:54.738625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06b630b4-48fc-489b-945d-672ed9d3ad59 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:54.740783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06b630b4-48fc-489b-945d-672ed9d3ad59 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:54.743073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06b630b4-48fc-489b-945d-672ed9d3ad59 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:54.762053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5fb5f05-45bc-46d8-88ba-baad4db96ec8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:54.767835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5fb5f05-45bc-46d8-88ba-baad4db96ec8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:54.768810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5fb5f05-45bc-46d8-88ba-baad4db96ec8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:54.771880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5fb5f05-45bc-46d8-88ba-baad4db96ec8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:55.016622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-06b630b4-48fc-489b-945d-672ed9d3ad59 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:55.057391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-06b630b4-48fc-489b-945d-672ed9d3ad59 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:55.067440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-06b630b4-48fc-489b-945d-672ed9d3ad59 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:55.075792 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-06b630b4-48fc-489b-945d-672ed9d3ad59 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.369002 Aug 03 02:12:55.076447 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2244/4589] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:54 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:12:55.416717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b5fb5f05-45bc-46d8-88ba-baad4db96ec8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:55.448690 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b5fb5f05-45bc-46d8-88ba-baad4db96ec8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 200 len: 1506 microversion: 2.1 time: 0.718645 Aug 03 02:12:55.450671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-065c20b4-019b-420d-9b08-4acd01069936 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:55.451815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-065c20b4-019b-420d-9b08-4acd01069936 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:55.468772 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2346/4590] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:54 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 1506 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:55.481090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-065c20b4-019b-420d-9b08-4acd01069936 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:55.483718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-065c20b4-019b-420d-9b08-4acd01069936 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:55.490557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-065c20b4-019b-420d-9b08-4acd01069936 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:55.492122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-065c20b4-019b-420d-9b08-4acd01069936 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:55.705147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-3046eb9a-ab1f-4e4b-8849-32641487ae2f req-e32b243d-0190-49a8-9212-d9b870d92ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa69891-6222-4604-83b3-e4f33dc43728", "name": "network-vif-plugged", "status": "completed", "tag": "41484393-ec38-4692-a586-0b483604ca69"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:55.795137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3046eb9a-ab1f-4e4b-8849-32641487ae2f req-e32b243d-0190-49a8-9212-d9b870d92ba9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:55.799744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3046eb9a-ab1f-4e4b-8849-32641487ae2f req-e32b243d-0190-49a8-9212-d9b870d92ba9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:55.824279 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-3046eb9a-ab1f-4e4b-8849-32641487ae2f req-e32b243d-0190-49a8-9212-d9b870d92ba9 service nova] Creating event network-vif-plugged:41484393-ec38-4692-a586-0b483604ca69 for instance 9fa69891-6222-4604-83b3-e4f33dc43728 on n-h1-826529-8 Aug 03 02:12:55.841612 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-3046eb9a-ab1f-4e4b-8849-32641487ae2f req-e32b243d-0190-49a8-9212-d9b870d92ba9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146859 Aug 03 02:12:55.845769 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2347/4591] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:12:55.920695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-065c20b4-019b-420d-9b08-4acd01069936 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:55.937299 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-065c20b4-019b-420d-9b08-4acd01069936 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1373 microversion: 2.1 time: 0.495131 Aug 03 02:12:55.974742 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2245/4592] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:55 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1373 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:56.128614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3373166d-df9b-42f5-a2e8-0ab56198dffd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:56.131727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3373166d-df9b-42f5-a2e8-0ab56198dffd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:56.155592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3373166d-df9b-42f5-a2e8-0ab56198dffd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:56.157127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3373166d-df9b-42f5-a2e8-0ab56198dffd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:56.163175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3373166d-df9b-42f5-a2e8-0ab56198dffd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:56.166165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3373166d-df9b-42f5-a2e8-0ab56198dffd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:56.430425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3373166d-df9b-42f5-a2e8-0ab56198dffd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:56.473787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3373166d-df9b-42f5-a2e8-0ab56198dffd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:56.479778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3373166d-df9b-42f5-a2e8-0ab56198dffd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:56.481326 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3373166d-df9b-42f5-a2e8-0ab56198dffd tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.372013 Aug 03 02:12:56.482810 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2348/4593] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:56 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:12:56.525770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-626a0943-ea12-45bc-9c1e-3c19c319b3d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:56.528891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-626a0943-ea12-45bc-9c1e-3c19c319b3d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:56.549314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-626a0943-ea12-45bc-9c1e-3c19c319b3d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:56.551228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-626a0943-ea12-45bc-9c1e-3c19c319b3d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:56.552915 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-626a0943-ea12-45bc-9c1e-3c19c319b3d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:56.554182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-626a0943-ea12-45bc-9c1e-3c19c319b3d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:56.976112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ea5d4897-2860-4c7c-b02b-bfc7d3b30265 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:56.976750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ea5d4897-2860-4c7c-b02b-bfc7d3b30265 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:56.997013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea5d4897-2860-4c7c-b02b-bfc7d3b30265 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:56.997484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea5d4897-2860-4c7c-b02b-bfc7d3b30265 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:56.998291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea5d4897-2860-4c7c-b02b-bfc7d3b30265 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:56.998947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea5d4897-2860-4c7c-b02b-bfc7d3b30265 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:57.120934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-626a0943-ea12-45bc-9c1e-3c19c319b3d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:57.138969 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-626a0943-ea12-45bc-9c1e-3c19c319b3d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 200 len: 1506 microversion: 2.1 time: 0.649278 Aug 03 02:12:57.143579 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2246/4594] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:56 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 1506 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:57.349129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ea5d4897-2860-4c7c-b02b-bfc7d3b30265 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:57.380631 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ea5d4897-2860-4c7c-b02b-bfc7d3b30265 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1373 microversion: 2.1 time: 0.407735 Aug 03 02:12:57.397598 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2349/4595] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:56 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1373 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:12:57.546100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-950c8e6c-9b02-4273-8a35-d8ff16dc6aaa tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:57.554116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-950c8e6c-9b02-4273-8a35-d8ff16dc6aaa tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:57.571772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-950c8e6c-9b02-4273-8a35-d8ff16dc6aaa tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:57.571772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-950c8e6c-9b02-4273-8a35-d8ff16dc6aaa tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:57.575085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-950c8e6c-9b02-4273-8a35-d8ff16dc6aaa tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:57.575085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-950c8e6c-9b02-4273-8a35-d8ff16dc6aaa tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:57.837582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-950c8e6c-9b02-4273-8a35-d8ff16dc6aaa tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:57.850096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-950c8e6c-9b02-4273-8a35-d8ff16dc6aaa tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:57.888560 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-950c8e6c-9b02-4273-8a35-d8ff16dc6aaa tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:57.897377 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-950c8e6c-9b02-4273-8a35-d8ff16dc6aaa tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.371066 Aug 03 02:12:57.898666 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2247/4596] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:57 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:12:58.165082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e2029d7-0756-48b9-8c97-60e4836b3851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:58.166401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3e2029d7-0756-48b9-8c97-60e4836b3851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:58.182866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:12:58.188260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e2029d7-0756-48b9-8c97-60e4836b3851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:58.192901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e2029d7-0756-48b9-8c97-60e4836b3851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:58.193999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e2029d7-0756-48b9-8c97-60e4836b3851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:58.200530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e2029d7-0756-48b9-8c97-60e4836b3851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:58.391425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3e2029d7-0756-48b9-8c97-60e4836b3851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:58.402287 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e2029d7-0756-48b9-8c97-60e4836b3851 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 200 len: 1464 microversion: 2.1 time: 0.240904 Aug 03 02:12:58.419202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e10bb895-8f6a-4386-bb04-e0d0ad780292 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:58.420478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e10bb895-8f6a-4386-bb04-e0d0ad780292 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:58.427016 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2350/4597] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:58 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 1464 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:58.438126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e10bb895-8f6a-4386-bb04-e0d0ad780292 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:58.438696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e10bb895-8f6a-4386-bb04-e0d0ad780292 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:58.441102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e10bb895-8f6a-4386-bb04-e0d0ad780292 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:58.441561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e10bb895-8f6a-4386-bb04-e0d0ad780292 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:58.536970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f7bea463-f533-4947-8b2b-cd763e71e4e8 req-517270d3-658a-4db8-b72b-be417871d7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477b4b57-926f-4ea1-aef2-f6e50b9d22ab", "name": "network-vif-deleted", "tag": "4b523644-b819-46af-958f-77c546598f70"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:12:58.601373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f7bea463-f533-4947-8b2b-cd763e71e4e8 req-517270d3-658a-4db8-b72b-be417871d7e5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:58.617560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f7bea463-f533-4947-8b2b-cd763e71e4e8 req-517270d3-658a-4db8-b72b-be417871d7e5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:58.798647 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f7bea463-f533-4947-8b2b-cd763e71e4e8 req-517270d3-658a-4db8-b72b-be417871d7e5 service nova] Creating event network-vif-deleted:4b523644-b819-46af-958f-77c546598f70 for instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab on n-h1-826529-8 Aug 03 02:12:58.808003 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f7bea463-f533-4947-8b2b-cd763e71e4e8 req-517270d3-658a-4db8-b72b-be417871d7e5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.273645 Aug 03 02:12:58.809686 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2351/4598] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:12:58.959188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3a37cf46-a4b7-46d6-9ca7-cb1b2d24990d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:58.963297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3a37cf46-a4b7-46d6-9ca7-cb1b2d24990d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:59.036192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a37cf46-a4b7-46d6-9ca7-cb1b2d24990d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:59.038506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a37cf46-a4b7-46d6-9ca7-cb1b2d24990d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:59.045556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a37cf46-a4b7-46d6-9ca7-cb1b2d24990d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:59.052395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a37cf46-a4b7-46d6-9ca7-cb1b2d24990d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:59.086503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e10bb895-8f6a-4386-bb04-e0d0ad780292 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:59.101967 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e10bb895-8f6a-4386-bb04-e0d0ad780292 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1373 microversion: 2.1 time: 0.702477 Aug 03 02:12:59.102608 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2248/4599] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:58 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1373 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:12:59.307863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3a37cf46-a4b7-46d6-9ca7-cb1b2d24990d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:59.349180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3a37cf46-a4b7-46d6-9ca7-cb1b2d24990d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:59.361656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3a37cf46-a4b7-46d6-9ca7-cb1b2d24990d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:59.370087 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3a37cf46-a4b7-46d6-9ca7-cb1b2d24990d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.424352 Aug 03 02:12:59.376791 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2352/4600] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:12:58 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:12:59.426692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-173a7be1-c5fe-4ee6-be86-20140d4ac147 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:12:59.427356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-173a7be1-c5fe-4ee6-be86-20140d4ac147 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:12:59.452281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-173a7be1-c5fe-4ee6-be86-20140d4ac147 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:59.454660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-173a7be1-c5fe-4ee6-be86-20140d4ac147 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:59.456182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-173a7be1-c5fe-4ee6-be86-20140d4ac147 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:59.456992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-173a7be1-c5fe-4ee6-be86-20140d4ac147 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:59.547717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-173a7be1-c5fe-4ee6-be86-20140d4ac147 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:12:59.548454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-173a7be1-c5fe-4ee6-be86-20140d4ac147 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:12:59.550024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-173a7be1-c5fe-4ee6-be86-20140d4ac147 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lazy-loading 'fault' on Instance uuid 477b4b57-926f-4ea1-aef2-f6e50b9d22ab {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:12:59.685236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-173a7be1-c5fe-4ee6-be86-20140d4ac147 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:12:59.694944 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-173a7be1-c5fe-4ee6-be86-20140d4ac147 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 200 len: 1310 microversion: 2.1 time: 0.274088 Aug 03 02:12:59.700568 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2249/4601] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:12:59 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 1310 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:00.172491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5342d9b0-a9cd-4f10-badb-af299175e7d6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:00.173164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5342d9b0-a9cd-4f10-badb-af299175e7d6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:00.190779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5342d9b0-a9cd-4f10-badb-af299175e7d6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:00.190779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5342d9b0-a9cd-4f10-badb-af299175e7d6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:00.190779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5342d9b0-a9cd-4f10-badb-af299175e7d6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:00.190779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5342d9b0-a9cd-4f10-badb-af299175e7d6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:00.442349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ea6258b-894e-489b-96d8-a4506b4aacba tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:00.448643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2ea6258b-894e-489b-96d8-a4506b4aacba tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:00.486510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ea6258b-894e-489b-96d8-a4506b4aacba tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:00.491312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ea6258b-894e-489b-96d8-a4506b4aacba tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:00.494667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ea6258b-894e-489b-96d8-a4506b4aacba tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:00.501323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ea6258b-894e-489b-96d8-a4506b4aacba tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:00.618453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5342d9b0-a9cd-4f10-badb-af299175e7d6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:00.636300 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5342d9b0-a9cd-4f10-badb-af299175e7d6 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1545 microversion: 2.1 time: 0.464682 Aug 03 02:13:00.637033 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2353/4602] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:00 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1545 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:13:00.661916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0e493981-7532-4362-af67-bddc3de94345 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:00.663849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0e493981-7532-4362-af67-bddc3de94345 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:00.683284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e493981-7532-4362-af67-bddc3de94345 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:00.686219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e493981-7532-4362-af67-bddc3de94345 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:00.687335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e493981-7532-4362-af67-bddc3de94345 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:00.693301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e493981-7532-4362-af67-bddc3de94345 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:00.723174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2ea6258b-894e-489b-96d8-a4506b4aacba tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:00.777188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2ea6258b-894e-489b-96d8-a4506b4aacba tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:00.784613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2ea6258b-894e-489b-96d8-a4506b4aacba tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:00.786175 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2ea6258b-894e-489b-96d8-a4506b4aacba tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.355665 Aug 03 02:13:00.789407 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2250/4603] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:13:00 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:13:00.798470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e959e2c5-8abe-49e4-a4ee-0c0eeeeaa0c1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:00.805697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e959e2c5-8abe-49e4-a4ee-0c0eeeeaa0c1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:00.829381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e959e2c5-8abe-49e4-a4ee-0c0eeeeaa0c1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:00.830349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e959e2c5-8abe-49e4-a4ee-0c0eeeeaa0c1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:00.831398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e959e2c5-8abe-49e4-a4ee-0c0eeeeaa0c1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:00.836772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e959e2c5-8abe-49e4-a4ee-0c0eeeeaa0c1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:00.883183 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-e959e2c5-8abe-49e4-a4ee-0c0eeeeaa0c1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e959e2c5-8abe-49e4-a4ee-0c0eeeeaa0c1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab HTTP/1.1 Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '477b4b57-926f-4ea1-aef2-f6e50b9d22ab'} Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:13:00.889455 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:13:00.894167 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:13:00.894167 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:13:00.894167 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:13:00.894167 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:13:00.894167 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:13:00.894167 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. Aug 03 02:13:00.894167 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:13:00.896464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e959e2c5-8abe-49e4-a4ee-0c0eeeeaa0c1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:13:00.897715 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e959e2c5-8abe-49e4-a4ee-0c0eeeeaa0c1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 404 len: 111 microversion: 2.1 time: 0.106677 Aug 03 02:13:00.898494 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2251/4604] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:00 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:13:00.929006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-caecc178-1d39-4f85-8031-76c07aadbd22 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Action: 'create', calling method: .version_select at 0x7f5b12515f70>, body: {"keypair": {"name": "tempest-key-1149644200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIdwMA6F93kveUsXkDCk/bsJcqLaSFgt3fnxvEXJXpsdPNiP4Qy1SVBEl7Kfw7ycNNxT/u8TRfiV5yq1r2N1xL7zrIrDf3NEJZK9UE1Dtw5DelF2iDBotJOHxbgdfuK2g=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:13:00.987488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-caecc178-1d39-4f85-8031-76c07aadbd22 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:13:00.995754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-caecc178-1d39-4f85-8031-76c07aadbd22 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for user 2721f67579e542718483193be7515d6b and project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:13:01.070590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:01.088233 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-caecc178-1d39-4f85-8031-76c07aadbd22 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.167537 Aug 03 02:13:01.089215 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2252/4605] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:13:00 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:13:01.102204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0e493981-7532-4362-af67-bddc3de94345 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:01.108761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bbc73489-e447-4234-b29d-a45ea798ae62 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '.version_select at 0x7f5b12515040>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:01.115229 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0e493981-7532-4362-af67-bddc3de94345 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1545 microversion: 2.1 time: 0.457553 Aug 03 02:13:01.116667 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2354/4606] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:00 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1545 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:13:01.120987 n-d-826529-8 devstack@n-api.service[125942]: WARNING oslo_db.sqlalchemy.utils [None req-bbc73489-e447-4234-b29d-a45ea798ae62 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 03 02:13:01.130799 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bbc73489-e447-4234-b29d-a45ea798ae62 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.030585 Aug 03 02:13:01.142276 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2253/4607] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 02:13:01 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:13:01.642628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1886532722", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "key_name": "tempest-key-1149644200", "networks": [{"uuid": "d26ca69a-a338-40ed-9e04-7c6942285689"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:13:01.777105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] validate_networks() for [('d26ca69a-a338-40ed-9e04-7c6942285689', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:13:01.904665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2beed516-7f7c-4bea-a0dc-172d3297da9a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:01.908276 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2beed516-7f7c-4bea-a0dc-172d3297da9a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:01.942635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2beed516-7f7c-4bea-a0dc-172d3297da9a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:01.944093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2beed516-7f7c-4bea-a0dc-172d3297da9a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:01.945821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2beed516-7f7c-4bea-a0dc-172d3297da9a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:01.946992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2beed516-7f7c-4bea-a0dc-172d3297da9a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:02.379305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2beed516-7f7c-4bea-a0dc-172d3297da9a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:02.411755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2beed516-7f7c-4bea-a0dc-172d3297da9a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:02.421775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2beed516-7f7c-4bea-a0dc-172d3297da9a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:02.435969 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2beed516-7f7c-4bea-a0dc-172d3297da9a tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.530226 Aug 03 02:13:02.437687 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2254/4608] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:13:01 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:13:03.248779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:13:03.249498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:13:03.249684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:13:03.250302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:13:03.251169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:13:03.279326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:03.281721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:03.283449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:03.284206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:03.310249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:13:03.317310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for user 2721f67579e542718483193be7515d6b and project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:13:03.336890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:13:03.340763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:13:03.402548 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1e4f6d08-22d0-40bf-a631-b6a180ec58d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.764549 Aug 03 02:13:03.403537 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2355/4609] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:13:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:13:03.417188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69f66f89-0f35-437f-9027-7089efa12ef7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:03.418528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-69f66f89-0f35-437f-9027-7089efa12ef7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:03.501045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-46302c59-e44e-4854-9970-de47ff7d5d9c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:03.508741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-46302c59-e44e-4854-9970-de47ff7d5d9c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:03.520761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-69f66f89-0f35-437f-9027-7089efa12ef7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:03.537362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46302c59-e44e-4854-9970-de47ff7d5d9c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:03.538392 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-69f66f89-0f35-437f-9027-7089efa12ef7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1229 microversion: 2.1 time: 0.127324 Aug 03 02:13:03.539361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46302c59-e44e-4854-9970-de47ff7d5d9c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:03.542850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46302c59-e44e-4854-9970-de47ff7d5d9c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:03.544448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46302c59-e44e-4854-9970-de47ff7d5d9c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:03.555299 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2255/4610] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:03 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1229 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:03.717966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-46302c59-e44e-4854-9970-de47ff7d5d9c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:03.756100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-46302c59-e44e-4854-9970-de47ff7d5d9c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:03.771746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-46302c59-e44e-4854-9970-de47ff7d5d9c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:03.788214 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-46302c59-e44e-4854-9970-de47ff7d5d9c tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.297529 Aug 03 02:13:03.789688 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2356/4611] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:13:03 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:13:04.563929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9293ad56-4d5a-4d14-896a-73908c99b1cc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:04.565237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9293ad56-4d5a-4d14-896a-73908c99b1cc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:04.578332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9293ad56-4d5a-4d14-896a-73908c99b1cc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:04.591854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9293ad56-4d5a-4d14-896a-73908c99b1cc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:04.593126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9293ad56-4d5a-4d14-896a-73908c99b1cc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:04.593804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9293ad56-4d5a-4d14-896a-73908c99b1cc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:04.811417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9293ad56-4d5a-4d14-896a-73908c99b1cc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:04.825226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1c3678fd-572b-44f0-88b9-4c618b4ff2c3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:04.825935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1c3678fd-572b-44f0-88b9-4c618b4ff2c3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:04.837846 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9293ad56-4d5a-4d14-896a-73908c99b1cc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1233 microversion: 2.1 time: 0.272508 Aug 03 02:13:04.842226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c3678fd-572b-44f0-88b9-4c618b4ff2c3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:04.844377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c3678fd-572b-44f0-88b9-4c618b4ff2c3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:04.846282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c3678fd-572b-44f0-88b9-4c618b4ff2c3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:04.848522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c3678fd-572b-44f0-88b9-4c618b4ff2c3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:04.851960 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2256/4612] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:04 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1233 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:05.052327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1c3678fd-572b-44f0-88b9-4c618b4ff2c3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:05.071266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1c3678fd-572b-44f0-88b9-4c618b4ff2c3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:05.076217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1c3678fd-572b-44f0-88b9-4c618b4ff2c3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:05.090124 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1c3678fd-572b-44f0-88b9-4c618b4ff2c3 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.262397 Aug 03 02:13:05.110956 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2357/4613] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:13:04 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:13:05.863695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a1d2a890-8da2-43c7-b47e-5133d602dde7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:05.864802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a1d2a890-8da2-43c7-b47e-5133d602dde7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:05.879578 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1d2a890-8da2-43c7-b47e-5133d602dde7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:05.882457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1d2a890-8da2-43c7-b47e-5133d602dde7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:05.883554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1d2a890-8da2-43c7-b47e-5133d602dde7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:05.887534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1d2a890-8da2-43c7-b47e-5133d602dde7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:06.041143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-71b0724d-9baa-4384-8a44-879673ac07e6 req-4fe4644b-0416-41a1-b2dc-906e14f7eafa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa69891-6222-4604-83b3-e4f33dc43728", "tag": "41484393-ec38-4692-a586-0b483604ca69"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:13:06.099397 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-71b0724d-9baa-4384-8a44-879673ac07e6 req-4fe4644b-0416-41a1-b2dc-906e14f7eafa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:06.104322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-71b0724d-9baa-4384-8a44-879673ac07e6 req-4fe4644b-0416-41a1-b2dc-906e14f7eafa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:06.183065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a1d2a890-8da2-43c7-b47e-5133d602dde7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:06.186969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:06.200291 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a1d2a890-8da2-43c7-b47e-5133d602dde7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1299 microversion: 2.1 time: 0.341749 Aug 03 02:13:06.201873 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-71b0724d-9baa-4384-8a44-879673ac07e6 req-4fe4644b-0416-41a1-b2dc-906e14f7eafa service nova] Creating event network-changed:41484393-ec38-4692-a586-0b483604ca69 for instance 9fa69891-6222-4604-83b3-e4f33dc43728 on n-h1-826529-8 Aug 03 02:13:06.203667 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2257/4614] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:05 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1299 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:06.220614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-995f4231-57ff-46ea-b576-94bd1190f4d8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:06.221764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-995f4231-57ff-46ea-b576-94bd1190f4d8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:06.234756 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-71b0724d-9baa-4384-8a44-879673ac07e6 req-4fe4644b-0416-41a1-b2dc-906e14f7eafa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194763 Aug 03 02:13:06.236005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-995f4231-57ff-46ea-b576-94bd1190f4d8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:06.237013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-995f4231-57ff-46ea-b576-94bd1190f4d8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:06.238267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-995f4231-57ff-46ea-b576-94bd1190f4d8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:06.238976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-995f4231-57ff-46ea-b576-94bd1190f4d8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:06.260033 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2358/4615] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:13:06.517243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-995f4231-57ff-46ea-b576-94bd1190f4d8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:06.560171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-995f4231-57ff-46ea-b576-94bd1190f4d8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:06.564710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-995f4231-57ff-46ea-b576-94bd1190f4d8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:06.574371 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-995f4231-57ff-46ea-b576-94bd1190f4d8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.364732 Aug 03 02:13:06.580763 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2258/4616] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:13:06 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:13:07.228895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-311625d9-9ae6-4ef7-a068-8e8778fa3af3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:07.229625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-311625d9-9ae6-4ef7-a068-8e8778fa3af3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:07.243270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-311625d9-9ae6-4ef7-a068-8e8778fa3af3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:07.243773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-311625d9-9ae6-4ef7-a068-8e8778fa3af3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:07.244599 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-311625d9-9ae6-4ef7-a068-8e8778fa3af3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:07.245228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-311625d9-9ae6-4ef7-a068-8e8778fa3af3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:07.577206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-311625d9-9ae6-4ef7-a068-8e8778fa3af3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:07.590315 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-311625d9-9ae6-4ef7-a068-8e8778fa3af3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1329 microversion: 2.1 time: 0.369394 Aug 03 02:13:07.596769 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2359/4617] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:07 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1329 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:07.634194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-40c3426b-4b5e-4da4-adce-e51d72407985 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:07.635064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-40c3426b-4b5e-4da4-adce-e51d72407985 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:07.659263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40c3426b-4b5e-4da4-adce-e51d72407985 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:07.660070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40c3426b-4b5e-4da4-adce-e51d72407985 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:07.662703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40c3426b-4b5e-4da4-adce-e51d72407985 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:07.664170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40c3426b-4b5e-4da4-adce-e51d72407985 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:07.960978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-40c3426b-4b5e-4da4-adce-e51d72407985 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:07.987975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-40c3426b-4b5e-4da4-adce-e51d72407985 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:07.992367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-40c3426b-4b5e-4da4-adce-e51d72407985 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:07.995632 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-40c3426b-4b5e-4da4-adce-e51d72407985 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.367016 Aug 03 02:13:08.019670 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2259/4618] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:13:07 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:13:08.631525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1bb8782a-ecc2-4ef6-a518-7f023f8264a4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:08.633981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1bb8782a-ecc2-4ef6-a518-7f023f8264a4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:08.701864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bb8782a-ecc2-4ef6-a518-7f023f8264a4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:08.705788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bb8782a-ecc2-4ef6-a518-7f023f8264a4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:08.706721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bb8782a-ecc2-4ef6-a518-7f023f8264a4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:08.707211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1bb8782a-ecc2-4ef6-a518-7f023f8264a4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:09.047023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c77fe3c0-407e-454a-ab2a-7b1b9fbfec6b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:09.047678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c77fe3c0-407e-454a-ab2a-7b1b9fbfec6b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:09.067755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c77fe3c0-407e-454a-ab2a-7b1b9fbfec6b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:09.068287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c77fe3c0-407e-454a-ab2a-7b1b9fbfec6b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:09.069241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c77fe3c0-407e-454a-ab2a-7b1b9fbfec6b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:09.069757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c77fe3c0-407e-454a-ab2a-7b1b9fbfec6b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:09.478074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c77fe3c0-407e-454a-ab2a-7b1b9fbfec6b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:09.497189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c77fe3c0-407e-454a-ab2a-7b1b9fbfec6b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:09.500258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c77fe3c0-407e-454a-ab2a-7b1b9fbfec6b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:09.509173 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c77fe3c0-407e-454a-ab2a-7b1b9fbfec6b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.466157 Aug 03 02:13:09.511669 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2260/4619] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:13:09 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:13:09.700288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1bb8782a-ecc2-4ef6-a518-7f023f8264a4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:09.714680 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1bb8782a-ecc2-4ef6-a518-7f023f8264a4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1329 microversion: 2.1 time: 1.087818 Aug 03 02:13:09.722606 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2360/4620] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:08 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1329 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:13:09.764879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-9cecf840-0322-4a19-aa6c-fe7f905fea87 req-45c3e622-eef1-4d4b-b39b-962b3c6e6775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f4f68d0-a0b5-4f99-9026-2fbe72c857fe", "tag": "3adbabed-b320-48e9-a305-3a6d563cd61d"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:13:09.795207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9cecf840-0322-4a19-aa6c-fe7f905fea87 req-45c3e622-eef1-4d4b-b39b-962b3c6e6775 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:09.798565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9cecf840-0322-4a19-aa6c-fe7f905fea87 req-45c3e622-eef1-4d4b-b39b-962b3c6e6775 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:09.839507 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-9cecf840-0322-4a19-aa6c-fe7f905fea87 req-45c3e622-eef1-4d4b-b39b-962b3c6e6775 service nova] Creating event network-changed:3adbabed-b320-48e9-a305-3a6d563cd61d for instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe on n-h2-826529-8 Aug 03 02:13:09.845805 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-9cecf840-0322-4a19-aa6c-fe7f905fea87 req-45c3e622-eef1-4d4b-b39b-962b3c6e6775 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087351 Aug 03 02:13:09.847775 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2261/4621] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:13:10.540821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-014d2c46-08d5-461d-a803-c6b13025bc5d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:10.541666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-014d2c46-08d5-461d-a803-c6b13025bc5d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:10.559670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-014d2c46-08d5-461d-a803-c6b13025bc5d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:10.560664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-014d2c46-08d5-461d-a803-c6b13025bc5d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:10.562015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-014d2c46-08d5-461d-a803-c6b13025bc5d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:10.565826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-014d2c46-08d5-461d-a803-c6b13025bc5d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:10.737846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-014d2c46-08d5-461d-a803-c6b13025bc5d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:10.745871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-560182c2-cd04-461e-82a0-502652da3fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:10.746627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-560182c2-cd04-461e-82a0-502652da3fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:10.763998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-560182c2-cd04-461e-82a0-502652da3fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:10.764471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-560182c2-cd04-461e-82a0-502652da3fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:10.767203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-560182c2-cd04-461e-82a0-502652da3fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:10.767985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-560182c2-cd04-461e-82a0-502652da3fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:10.774681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-014d2c46-08d5-461d-a803-c6b13025bc5d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:10.777428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-014d2c46-08d5-461d-a803-c6b13025bc5d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:10.778960 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-014d2c46-08d5-461d-a803-c6b13025bc5d tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.243201 Aug 03 02:13:10.779865 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2361/4622] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:13:10 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:13:11.075343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-560182c2-cd04-461e-82a0-502652da3fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:11.103273 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-560182c2-cd04-461e-82a0-502652da3fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1329 microversion: 2.1 time: 0.359894 Aug 03 02:13:11.104139 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2262/4623] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:10 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1329 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:13:11.814313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b5b7005f-0f2c-4840-9928-947d45c94cb5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:11.816910 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b5b7005f-0f2c-4840-9928-947d45c94cb5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:11.834476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5b7005f-0f2c-4840-9928-947d45c94cb5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:11.836698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5b7005f-0f2c-4840-9928-947d45c94cb5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:11.839326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5b7005f-0f2c-4840-9928-947d45c94cb5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:11.840411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b5b7005f-0f2c-4840-9928-947d45c94cb5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:12.031226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b5b7005f-0f2c-4840-9928-947d45c94cb5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:12.067045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b5b7005f-0f2c-4840-9928-947d45c94cb5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:12.078878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b5b7005f-0f2c-4840-9928-947d45c94cb5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:12.081585 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b5b7005f-0f2c-4840-9928-947d45c94cb5 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.276555 Aug 03 02:13:12.084078 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2362/4624] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:13:11 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:13:12.132777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fe45cbe8-37af-480b-bd75-184333f0bdda tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:12.133854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fe45cbe8-37af-480b-bd75-184333f0bdda tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:12.163714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe45cbe8-37af-480b-bd75-184333f0bdda tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:12.164549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe45cbe8-37af-480b-bd75-184333f0bdda tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:12.166622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe45cbe8-37af-480b-bd75-184333f0bdda tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:12.167279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe45cbe8-37af-480b-bd75-184333f0bdda tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:12.748233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fe45cbe8-37af-480b-bd75-184333f0bdda tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:12.778046 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fe45cbe8-37af-480b-bd75-184333f0bdda tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1329 microversion: 2.1 time: 0.652973 Aug 03 02:13:12.779533 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2263/4625] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:12 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1329 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:13.117278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2fa7c50a-7cff-4968-924d-0515e2b36932 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:13.119024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2fa7c50a-7cff-4968-924d-0515e2b36932 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:13.147950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fa7c50a-7cff-4968-924d-0515e2b36932 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:13.152126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fa7c50a-7cff-4968-924d-0515e2b36932 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:13.153716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fa7c50a-7cff-4968-924d-0515e2b36932 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:13.154718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2fa7c50a-7cff-4968-924d-0515e2b36932 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:13.297954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:13.328627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:13.378823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2fa7c50a-7cff-4968-924d-0515e2b36932 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:13.394583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2fa7c50a-7cff-4968-924d-0515e2b36932 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:13.396663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2fa7c50a-7cff-4968-924d-0515e2b36932 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aebcddd50c8948c898aa660b214c18ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fae5f26896141139f4ce396d92a1999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:13.398433 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2fa7c50a-7cff-4968-924d-0515e2b36932 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 200 len: 1873 microversion: 2.42 time: 0.288999 Aug 03 02:13:13.400890 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2363/4626] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:13:13 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 1873 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:13:13.804345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-034b3331-f7cf-47f3-ae32-6e4581fdd73f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:13.806615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-034b3331-f7cf-47f3-ae32-6e4581fdd73f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:13.811375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:13.845693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-034b3331-f7cf-47f3-ae32-6e4581fdd73f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:13.847251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-034b3331-f7cf-47f3-ae32-6e4581fdd73f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:13.860663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-034b3331-f7cf-47f3-ae32-6e4581fdd73f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:13.866112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-034b3331-f7cf-47f3-ae32-6e4581fdd73f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:14.272720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-034b3331-f7cf-47f3-ae32-6e4581fdd73f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:14.297001 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-034b3331-f7cf-47f3-ae32-6e4581fdd73f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1329 microversion: 2.1 time: 0.498608 Aug 03 02:13:14.298243 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2264/4627] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:13 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1329 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:14.432963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5165c074-17a0-473c-8606-7c24017acaf8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:14.434431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5165c074-17a0-473c-8606-7c24017acaf8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:14.452514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5165c074-17a0-473c-8606-7c24017acaf8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:14.453265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5165c074-17a0-473c-8606-7c24017acaf8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:14.454565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5165c074-17a0-473c-8606-7c24017acaf8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:14.455318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5165c074-17a0-473c-8606-7c24017acaf8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:14.470836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:14.530848 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-5165c074-17a0-473c-8606-7c24017acaf8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] HTTP exception thrown: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5165c074-17a0-473c-8606-7c24017acaf8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Request method failure captured: Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 HTTP/1.1 Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dfQfKnm3vC0fCy7w0OoLCSYFRNcvFf6Z-_8tyvkwDAu-2rYyeaDittB_EzcjHxVPxUCyfSQqCUe8odWkGIyo2uawpDuOf6iHHjxRflORY94JOz0N9RNvbgvQRm2qgDeuDMyVrD7mB5WOcq3kov7TJHoN4kIcjA6MD8EqrwYjYtziB4 Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Openstack-Nova-Api-Version: 2.42 Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 7fae5f26896141139f4ce396d92a1999 Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-12351329 Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7fae5f26896141139f4ce396d92a1999", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7fae5f26896141139f4ce396d92a1999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7fae5f26896141139f4ce396d92a1999"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7fae5f26896141139f4ce396d92a1999"}]}] Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TaggedBootDevicesTest_v242-12351329 Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 7fae5f26896141139f4ce396d92a1999 Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-12351329 Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TaggedBootDevicesTest_v242-12351329-project Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: aebcddd50c8948c898aa660b214c18ea Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TaggedBootDevicesTest_v242-12351329-project Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '6bb1d773-208d-437e-9e60-fc1ef93623c3'} Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:13:14.534148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:13:14.543587 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:13:14.543587 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:13:14.543587 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:13:14.543587 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:13:14.543587 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:13:14.543587 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:13:14.543587 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. Aug 03 02:13:14.543587 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:13:14.543587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5165c074-17a0-473c-8606-7c24017acaf8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Returning 404 to user: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:13:14.543587 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5165c074-17a0-473c-8606-7c24017acaf8 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 404 len: 111 microversion: 2.42 time: 0.111252 Aug 03 02:13:14.546177 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2364/4628] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:13:14 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:13:14.550391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-086db4b2-69a7-4565-b388-524d03b2663b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '.version_select at 0x7f5b133d4ca0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:14.599620 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-086db4b2-69a7-4565-b388-524d03b2663b tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998967340" status: 204 len: 0 microversion: 2.42 time: 0.051306 Aug 03 02:13:14.600529 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2265/4629] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 3 02:13:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998967340 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 03 02:13:15.333943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c846ca8e-26fc-4e4a-aee7-5a2b0b19393b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:15.342938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c846ca8e-26fc-4e4a-aee7-5a2b0b19393b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:15.371142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c846ca8e-26fc-4e4a-aee7-5a2b0b19393b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:15.372334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c846ca8e-26fc-4e4a-aee7-5a2b0b19393b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:15.373969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c846ca8e-26fc-4e4a-aee7-5a2b0b19393b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:15.376960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c846ca8e-26fc-4e4a-aee7-5a2b0b19393b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:16.263389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c846ca8e-26fc-4e4a-aee7-5a2b0b19393b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:16.274017 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c846ca8e-26fc-4e4a-aee7-5a2b0b19393b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1329 microversion: 2.1 time: 0.947105 Aug 03 02:13:16.275961 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2365/4630] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:15 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1329 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:17.306016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f4f8b82f-0f82-4c19-9ae1-3531682fe1ce tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:17.307502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f4f8b82f-0f82-4c19-9ae1-3531682fe1ce tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:17.315829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4f8b82f-0f82-4c19-9ae1-3531682fe1ce tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:17.316666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4f8b82f-0f82-4c19-9ae1-3531682fe1ce tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:17.317749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4f8b82f-0f82-4c19-9ae1-3531682fe1ce tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:17.318634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4f8b82f-0f82-4c19-9ae1-3531682fe1ce tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:17.708284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f4f8b82f-0f82-4c19-9ae1-3531682fe1ce tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:17.733886 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f4f8b82f-0f82-4c19-9ae1-3531682fe1ce tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1329 microversion: 2.1 time: 0.432769 Aug 03 02:13:17.735337 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2266/4631] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:17 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1329 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:18.031896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-70a6b9a3-202a-4443-8122-1672a9bffd7b req-781dab94-c7e9-4dd0-a1a8-ecb4bba71b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f4f68d0-a0b5-4f99-9026-2fbe72c857fe", "name": "network-vif-plugged", "status": "completed", "tag": "3adbabed-b320-48e9-a305-3a6d563cd61d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:13:18.062298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-70a6b9a3-202a-4443-8122-1672a9bffd7b req-781dab94-c7e9-4dd0-a1a8-ecb4bba71b6f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:18.062790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-70a6b9a3-202a-4443-8122-1672a9bffd7b req-781dab94-c7e9-4dd0-a1a8-ecb4bba71b6f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:18.101666 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-70a6b9a3-202a-4443-8122-1672a9bffd7b req-781dab94-c7e9-4dd0-a1a8-ecb4bba71b6f service nova] Creating event network-vif-plugged:3adbabed-b320-48e9-a305-3a6d563cd61d for instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe on n-h2-826529-8 Aug 03 02:13:18.111902 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-70a6b9a3-202a-4443-8122-1672a9bffd7b req-781dab94-c7e9-4dd0-a1a8-ecb4bba71b6f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082902 Aug 03 02:13:18.112685 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2366/4632] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:13:18.763960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-abb3e40b-3b5a-462f-9f2c-09b60ccd592f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:18.764595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-abb3e40b-3b5a-462f-9f2c-09b60ccd592f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:18.777125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abb3e40b-3b5a-462f-9f2c-09b60ccd592f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:18.781889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abb3e40b-3b5a-462f-9f2c-09b60ccd592f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:18.783067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abb3e40b-3b5a-462f-9f2c-09b60ccd592f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:18.783721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abb3e40b-3b5a-462f-9f2c-09b60ccd592f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:19.332523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-abb3e40b-3b5a-462f-9f2c-09b60ccd592f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:19.343959 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-abb3e40b-3b5a-462f-9f2c-09b60ccd592f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1329 microversion: 2.1 time: 0.584248 Aug 03 02:13:19.344560 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2267/4633] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:18 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1329 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:13:20.391364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-23cd7a03-25ea-45f4-89f6-4b16aa578125 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:20.392849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-23cd7a03-25ea-45f4-89f6-4b16aa578125 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:20.425280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23cd7a03-25ea-45f4-89f6-4b16aa578125 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:20.425599 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23cd7a03-25ea-45f4-89f6-4b16aa578125 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:20.426405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23cd7a03-25ea-45f4-89f6-4b16aa578125 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:20.426852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23cd7a03-25ea-45f4-89f6-4b16aa578125 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:21.176572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-23cd7a03-25ea-45f4-89f6-4b16aa578125 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:21.189261 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-23cd7a03-25ea-45f4-89f6-4b16aa578125 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1329 microversion: 2.1 time: 0.823440 Aug 03 02:13:21.203462 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2367/4634] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:20 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1329 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:22.222250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1987df78-a03a-4419-841f-431e149c3f1f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:22.222971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1987df78-a03a-4419-841f-431e149c3f1f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:22.245243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1987df78-a03a-4419-841f-431e149c3f1f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:22.250148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1987df78-a03a-4419-841f-431e149c3f1f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:22.251883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1987df78-a03a-4419-841f-431e149c3f1f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:22.254244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1987df78-a03a-4419-841f-431e149c3f1f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:22.732384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1987df78-a03a-4419-841f-431e149c3f1f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:22.746669 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1987df78-a03a-4419-841f-431e149c3f1f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1510 microversion: 2.1 time: 0.536770 Aug 03 02:13:22.759236 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2268/4635] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:22 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1510 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:22.771422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-87caec2c-787b-439b-97bd-46512c7902ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:22.773080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-87caec2c-787b-439b-97bd-46512c7902ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:22.809661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87caec2c-787b-439b-97bd-46512c7902ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:22.811470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87caec2c-787b-439b-97bd-46512c7902ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:22.814483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87caec2c-787b-439b-97bd-46512c7902ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:22.816980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87caec2c-787b-439b-97bd-46512c7902ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:23.208464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-87caec2c-787b-439b-97bd-46512c7902ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:23.226846 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-87caec2c-787b-439b-97bd-46512c7902ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1510 microversion: 2.1 time: 0.460354 Aug 03 02:13:23.240905 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2368/4636] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:22 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1510 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:23.253022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-33008c5a-9317-4efc-ae5d-8681b53a06b6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:23.254075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-33008c5a-9317-4efc-ae5d-8681b53a06b6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:23.267920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33008c5a-9317-4efc-ae5d-8681b53a06b6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:23.268582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33008c5a-9317-4efc-ae5d-8681b53a06b6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:23.269802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33008c5a-9317-4efc-ae5d-8681b53a06b6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:23.270543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-33008c5a-9317-4efc-ae5d-8681b53a06b6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:23.320404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-33008c5a-9317-4efc-ae5d-8681b53a06b6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:13:23.500755 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-33008c5a-9317-4efc-ae5d-8681b53a06b6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 204 len: 0 microversion: 2.1 time: 0.252115 Aug 03 02:13:23.503684 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2269/4637] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:13:23 2022] DELETE /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:13:23.519252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e96f496c-3c2b-4069-8acd-d5d18f87dff7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:23.520169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e96f496c-3c2b-4069-8acd-d5d18f87dff7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:23.529251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e96f496c-3c2b-4069-8acd-d5d18f87dff7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:23.530080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e96f496c-3c2b-4069-8acd-d5d18f87dff7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:23.531336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e96f496c-3c2b-4069-8acd-d5d18f87dff7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:23.531947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e96f496c-3c2b-4069-8acd-d5d18f87dff7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:23.875295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e96f496c-3c2b-4069-8acd-d5d18f87dff7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:23.886275 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e96f496c-3c2b-4069-8acd-d5d18f87dff7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1516 microversion: 2.1 time: 0.375835 Aug 03 02:13:23.887241 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2369/4638] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:23 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1516 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:13:24.413108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-034ab12c-5d89-4a34-b6a3-4b9b1b801a70 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:24.416161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-034ab12c-5d89-4a34-b6a3-4b9b1b801a70 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:24.424723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-034ab12c-5d89-4a34-b6a3-4b9b1b801a70 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:24.425389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-034ab12c-5d89-4a34-b6a3-4b9b1b801a70 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:24.427557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-034ab12c-5d89-4a34-b6a3-4b9b1b801a70 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:24.428211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-034ab12c-5d89-4a34-b6a3-4b9b1b801a70 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:24.481623 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-034ab12c-5d89-4a34-b6a3-4b9b1b801a70 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] HTTP exception thrown: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-034ab12c-5d89-4a34-b6a3-4b9b1b801a70 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Request method failure captured: Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 HTTP/1.1 Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dfQfKnm3vC0fCy7w0OoLCSYFRNcvFf6Z-_8tyvkwDAu-2rYyeaDittB_EzcjHxVPxUCyfSQqCUe8odWkGIyo2uawpDuOf6iHHjxRflORY94JOz0N9RNvbgvQRm2qgDeuDMyVrD7mB5WOcq3kov7TJHoN4kIcjA6MD8EqrwYjYtziB4 Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.42 Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 7fae5f26896141139f4ce396d92a1999 Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-12351329 Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7fae5f26896141139f4ce396d92a1999", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7fae5f26896141139f4ce396d92a1999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7fae5f26896141139f4ce396d92a1999"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7fae5f26896141139f4ce396d92a1999"}]}] Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TaggedBootDevicesTest_v242-12351329 Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 7fae5f26896141139f4ce396d92a1999 Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-12351329 Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TaggedBootDevicesTest_v242-12351329-project Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: aebcddd50c8948c898aa660b214c18ea Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TaggedBootDevicesTest_v242-12351329-project Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '6bb1d773-208d-437e-9e60-fc1ef93623c3'} Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:13:24.484284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:13:24.488536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. Aug 03 02:13:24.488536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:13:24.488536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:13:24.488536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:13:24.488536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:13:24.488536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:13:24.488536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:13:24.488536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:13:24.488536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:13:24.488536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. Aug 03 02:13:24.488536 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:13:24.488536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-034ab12c-5d89-4a34-b6a3-4b9b1b801a70 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Returning 404 to user: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:13:24.488536 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-034ab12c-5d89-4a34-b6a3-4b9b1b801a70 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 404 len: 111 microversion: 2.42 time: 0.082719 Aug 03 02:13:24.490303 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2270/4639] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:13:24 2022] DELETE /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:13:24.496313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-737e18d9-3faa-450a-8f67-85680bc15990 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:24.496943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-737e18d9-3faa-450a-8f67-85680bc15990 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] [instance: 6bb1d773-208d-437e-9e60-fc1ef93623c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:24.506259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-737e18d9-3faa-450a-8f67-85680bc15990 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:24.507148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-737e18d9-3faa-450a-8f67-85680bc15990 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:24.510173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-737e18d9-3faa-450a-8f67-85680bc15990 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:24.511406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-737e18d9-3faa-450a-8f67-85680bc15990 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:24.552778 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-737e18d9-3faa-450a-8f67-85680bc15990 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] HTTP exception thrown: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-737e18d9-3faa-450a-8f67-85680bc15990 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Request method failure captured: Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 HTTP/1.1 Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dfQfKnm3vC0fCy7w0OoLCSYFRNcvFf6Z-_8tyvkwDAu-2rYyeaDittB_EzcjHxVPxUCyfSQqCUe8odWkGIyo2uawpDuOf6iHHjxRflORY94JOz0N9RNvbgvQRm2qgDeuDMyVrD7mB5WOcq3kov7TJHoN4kIcjA6MD8EqrwYjYtziB4 Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Openstack-Nova-Api-Version: 2.42 Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 7fae5f26896141139f4ce396d92a1999 Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-12351329 Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7fae5f26896141139f4ce396d92a1999", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7fae5f26896141139f4ce396d92a1999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7fae5f26896141139f4ce396d92a1999"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7fae5f26896141139f4ce396d92a1999"}]}] Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TaggedBootDevicesTest_v242-12351329 Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 7fae5f26896141139f4ce396d92a1999 Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-12351329 Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TaggedBootDevicesTest_v242-12351329-project Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: aebcddd50c8948c898aa660b214c18ea Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TaggedBootDevicesTest_v242-12351329-project Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '6bb1d773-208d-437e-9e60-fc1ef93623c3'} Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:13:24.558647 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:13:24.562869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:13:24.562869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:13:24.562869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:13:24.562869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:13:24.562869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:13:24.562869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:13:24.562869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. Aug 03 02:13:24.562869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:13:24.567062 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-737e18d9-3faa-450a-8f67-85680bc15990 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] Returning 404 to user: Instance 6bb1d773-208d-437e-9e60-fc1ef93623c3 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:13:24.569100 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-737e18d9-3faa-450a-8f67-85680bc15990 tempest-TaggedBootDevicesTest_v242-12351329 tempest-TaggedBootDevicesTest_v242-12351329-project] 10.222.0.67 "GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3" status: 404 len: 111 microversion: 2.42 time: 0.078385 Aug 03 02:13:24.573938 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2370/4640] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:13:24 2022] GET /compute/v2.1/servers/6bb1d773-208d-437e-9e60-fc1ef93623c3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 03 02:13:24.910766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2f40735b-becd-48ad-85dd-124ef0c3c03b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:24.911870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2f40735b-becd-48ad-85dd-124ef0c3c03b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:24.920168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f40735b-becd-48ad-85dd-124ef0c3c03b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:24.920905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f40735b-becd-48ad-85dd-124ef0c3c03b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:24.922081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f40735b-becd-48ad-85dd-124ef0c3c03b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:24.923017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f40735b-becd-48ad-85dd-124ef0c3c03b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:25.184837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2f40735b-becd-48ad-85dd-124ef0c3c03b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:25.194086 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2f40735b-becd-48ad-85dd-124ef0c3c03b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1516 microversion: 2.1 time: 0.287256 Aug 03 02:13:25.209503 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2271/4641] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:24 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1516 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:26.219538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-40c32018-22d1-4530-8feb-1b5217294639 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:26.220133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-40c32018-22d1-4530-8feb-1b5217294639 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:26.246054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40c32018-22d1-4530-8feb-1b5217294639 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:26.247793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40c32018-22d1-4530-8feb-1b5217294639 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:26.251313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40c32018-22d1-4530-8feb-1b5217294639 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:26.253069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40c32018-22d1-4530-8feb-1b5217294639 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:26.933163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-40c32018-22d1-4530-8feb-1b5217294639 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:26.959755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-8a18f050-10d1-4aeb-a70b-91c2c6ffddf7 req-ffd6594f-8482-41f9-b92b-515555a80129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f4f68d0-a0b5-4f99-9026-2fbe72c857fe", "name": "network-vif-deleted", "tag": "3adbabed-b320-48e9-a305-3a6d563cd61d"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:13:26.964775 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-40c32018-22d1-4530-8feb-1b5217294639 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 200 len: 1516 microversion: 2.1 time: 0.751387 Aug 03 02:13:26.968530 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2371/4642] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:26 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 1516 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:27.035879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8a18f050-10d1-4aeb-a70b-91c2c6ffddf7 req-ffd6594f-8482-41f9-b92b-515555a80129 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:27.037379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8a18f050-10d1-4aeb-a70b-91c2c6ffddf7 req-ffd6594f-8482-41f9-b92b-515555a80129 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:27.077618 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-8a18f050-10d1-4aeb-a70b-91c2c6ffddf7 req-ffd6594f-8482-41f9-b92b-515555a80129 service nova] Creating event network-vif-deleted:3adbabed-b320-48e9-a305-3a6d563cd61d for instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe on n-h2-826529-8 Aug 03 02:13:27.088650 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-8a18f050-10d1-4aeb-a70b-91c2c6ffddf7 req-ffd6594f-8482-41f9-b92b-515555a80129 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136429 Aug 03 02:13:27.089838 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2272/4643] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:13:27.996821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d73d348-8146-4071-ac3a-b77c73fd232f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:27.997654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6d73d348-8146-4071-ac3a-b77c73fd232f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:28.018979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d73d348-8146-4071-ac3a-b77c73fd232f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:28.024852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d73d348-8146-4071-ac3a-b77c73fd232f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:28.025989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d73d348-8146-4071-ac3a-b77c73fd232f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:28.029094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d73d348-8146-4071-ac3a-b77c73fd232f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:28.062959 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-6d73d348-8146-4071-ac3a-b77c73fd232f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d73d348-8146-4071-ac3a-b77c73fd232f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe HTTP/1.1 Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '0f4f68d0-a0b5-4f99-9026-2fbe72c857fe'} Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:13:28.064563 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:13:28.069013 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:13:28.069013 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:13:28.069013 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:13:28.069013 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:13:28.069013 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:13:28.069013 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. Aug 03 02:13:28.069013 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:13:28.077580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d73d348-8146-4071-ac3a-b77c73fd232f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:13:28.079841 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6d73d348-8146-4071-ac3a-b77c73fd232f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 404 len: 111 microversion: 2.1 time: 0.087872 Aug 03 02:13:28.082706 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2372/4644] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:27 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:13:28.094856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-26756917-d99d-492f-bb9e-0d7e9cc2da64 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '.version_select at 0x7f5b133d4dc0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:28.133098 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-26756917-d99d-492f-bb9e-0d7e9cc2da64 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-key-1149644200" status: 202 len: 0 microversion: 2.1 time: 0.043664 Aug 03 02:13:28.138331 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2273/4645] 10.222.0.67 () {58 vars in 1209 bytes} [Wed Aug 3 02:13:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1149644200 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 02:13:28.701412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1580599469", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "d26ca69a-a338-40ed-9e04-7c6942285689"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:13:28.721705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:28.866186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] validate_networks() for [('d26ca69a-a338-40ed-9e04-7c6942285689', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:13:29.695435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:13:29.696428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:13:29.697401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:13:29.698077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:13:29.698818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:13:29.732989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:29.738432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:29.741232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:29.745739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:29.833789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:13:29.852988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for user 2721f67579e542718483193be7515d6b and project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:13:29.933483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:13:29.951382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:13:30.138132 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-127124db-374f-407f-851d-0af3791201f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.445650 Aug 03 02:13:30.140624 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2373/4646] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:13:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:13:30.151440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-36de4241-5cba-4aa4-81cc-74d9dd0fb436 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:30.152776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-36de4241-5cba-4aa4-81cc-74d9dd0fb436 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:30.321007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-36de4241-5cba-4aa4-81cc-74d9dd0fb436 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:30.331979 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-36de4241-5cba-4aa4-81cc-74d9dd0fb436 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1209 microversion: 2.1 time: 0.182743 Aug 03 02:13:30.346945 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2274/4647] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:30 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1209 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:31.303916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dee96fb7-4a5b-44b1-bb26-db1f77c4d7ce tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254-project-admin] Calling method '.version_select at 0x7f5b1255c040>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:31.306891 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:13:31.306891 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 02:13:31.308532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dee96fb7-4a5b-44b1-bb26-db1f77c4d7ce tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:31.309168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dee96fb7-4a5b-44b1-bb26-db1f77c4d7ce tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:31.379169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-714c5c4d-5796-44be-b51e-756524db43ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:31.384557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-714c5c4d-5796-44be-b51e-756524db43ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:31.433522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dee96fb7-4a5b-44b1-bb26-db1f77c4d7ce tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:31.469328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dee96fb7-4a5b-44b1-bb26-db1f77c4d7ce tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:31.566035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-714c5c4d-5796-44be-b51e-756524db43ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:31.569522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-714c5c4d-5796-44be-b51e-756524db43ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:31.575054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-714c5c4d-5796-44be-b51e-756524db43ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:31.576009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-714c5c4d-5796-44be-b51e-756524db43ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:31.583187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dee96fb7-4a5b-44b1-bb26-db1f77c4d7ce tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:31.584450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dee96fb7-4a5b-44b1-bb26-db1f77c4d7ce tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:31.622940 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dee96fb7-4a5b-44b1-bb26-db1f77c4d7ce tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1846181254-project-admin] 10.222.0.67 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.890930 Aug 03 02:13:31.626991 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2374/4648] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 02:13:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:13:31.918476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-714c5c4d-5796-44be-b51e-756524db43ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:31.934272 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-714c5c4d-5796-44be-b51e-756524db43ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1213 microversion: 2.1 time: 0.568916 Aug 03 02:13:31.946847 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2275/4649] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:31 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1213 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:32.997629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4a545641-81ff-42e1-85c3-90756cd159a8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:33.000375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4a545641-81ff-42e1-85c3-90756cd159a8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:33.019626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a545641-81ff-42e1-85c3-90756cd159a8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:33.024861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a545641-81ff-42e1-85c3-90756cd159a8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:33.028257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a545641-81ff-42e1-85c3-90756cd159a8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:33.029040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a545641-81ff-42e1-85c3-90756cd159a8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:33.197459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4a545641-81ff-42e1-85c3-90756cd159a8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:33.221258 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4a545641-81ff-42e1-85c3-90756cd159a8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1279 microversion: 2.1 time: 0.227427 Aug 03 02:13:33.226504 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2375/4650] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:32 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1279 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:34.248608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-21574efc-16f1-4aeb-96a1-202afc2a3ace tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:34.249309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-21574efc-16f1-4aeb-96a1-202afc2a3ace tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:34.260070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21574efc-16f1-4aeb-96a1-202afc2a3ace tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:34.260859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21574efc-16f1-4aeb-96a1-202afc2a3ace tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:34.261940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21574efc-16f1-4aeb-96a1-202afc2a3ace tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:34.262589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21574efc-16f1-4aeb-96a1-202afc2a3ace tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:34.554614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6d1ccf04-1b62-48ba-9ff7-c5b6645ac081 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:13:34.559956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6d1ccf04-1b62-48ba-9ff7-c5b6645ac081 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:34.568398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=62,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:34.588076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d1ccf04-1b62-48ba-9ff7-c5b6645ac081 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:34.588574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d1ccf04-1b62-48ba-9ff7-c5b6645ac081 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:34.591588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d1ccf04-1b62-48ba-9ff7-c5b6645ac081 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:34.595635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d1ccf04-1b62-48ba-9ff7-c5b6645ac081 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:34.730488 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6d1ccf04-1b62-48ba-9ff7-c5b6645ac081 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "POST /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728/action" status: 200 len: 24532 microversion: 2.1 time: 1.175325 Aug 03 02:13:34.732160 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2276/4651] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:13:33 2022] POST /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728/action => generated 24532 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:13:34.818830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-21574efc-16f1-4aeb-96a1-202afc2a3ace tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:34.827546 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-21574efc-16f1-4aeb-96a1-202afc2a3ace tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1267 microversion: 2.1 time: 0.586026 Aug 03 02:13:34.828139 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2376/4652] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:34 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1267 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:35.869092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6507c054-0972-4dcb-9cac-195e1177b3c9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:35.871788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6507c054-0972-4dcb-9cac-195e1177b3c9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:35.890059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6507c054-0972-4dcb-9cac-195e1177b3c9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:35.908679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6507c054-0972-4dcb-9cac-195e1177b3c9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:35.913287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6507c054-0972-4dcb-9cac-195e1177b3c9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:35.916372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6507c054-0972-4dcb-9cac-195e1177b3c9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:36.655103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6507c054-0972-4dcb-9cac-195e1177b3c9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:36.657819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:36.676244 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6507c054-0972-4dcb-9cac-195e1177b3c9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1309 microversion: 2.1 time: 0.830038 Aug 03 02:13:36.683065 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2277/4653] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:35 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1309 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:37.724130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-487e5e45-0366-4eaf-8818-6ac23bc202f9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:37.724769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-487e5e45-0366-4eaf-8818-6ac23bc202f9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:37.751812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-487e5e45-0366-4eaf-8818-6ac23bc202f9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:37.760578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-487e5e45-0366-4eaf-8818-6ac23bc202f9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:37.761725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-487e5e45-0366-4eaf-8818-6ac23bc202f9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:37.762344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-487e5e45-0366-4eaf-8818-6ac23bc202f9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:37.849488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-4ec6fe82-4b54-43b0-bd44-dee07ee193b4 req-64ccdd28-e3c8-4a03-8d5a-88fc9362461d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7030597f-afd4-4953-b80f-2ad5e6974e61", "tag": "1cd0f785-0d00-4bc1-ad85-157893921bad"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:13:37.867146 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4ec6fe82-4b54-43b0-bd44-dee07ee193b4 req-64ccdd28-e3c8-4a03-8d5a-88fc9362461d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:37.867910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4ec6fe82-4b54-43b0-bd44-dee07ee193b4 req-64ccdd28-e3c8-4a03-8d5a-88fc9362461d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:37.882643 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-4ec6fe82-4b54-43b0-bd44-dee07ee193b4 req-64ccdd28-e3c8-4a03-8d5a-88fc9362461d service nova] Creating event network-changed:1cd0f785-0d00-4bc1-ad85-157893921bad for instance 7030597f-afd4-4953-b80f-2ad5e6974e61 on n-h2-826529-8 Aug 03 02:13:37.889693 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-4ec6fe82-4b54-43b0-bd44-dee07ee193b4 req-64ccdd28-e3c8-4a03-8d5a-88fc9362461d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053593 Aug 03 02:13:37.890867 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2278/4654] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:13:38.635718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-487e5e45-0366-4eaf-8818-6ac23bc202f9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:38.645811 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-487e5e45-0366-4eaf-8818-6ac23bc202f9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1309 microversion: 2.1 time: 0.927936 Aug 03 02:13:38.646678 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2377/4655] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:37 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1309 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:39.677323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0147871-a5aa-4454-8305-544bad61352f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:39.678660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0147871-a5aa-4454-8305-544bad61352f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:39.689526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0147871-a5aa-4454-8305-544bad61352f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:39.701278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0147871-a5aa-4454-8305-544bad61352f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:39.702427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0147871-a5aa-4454-8305-544bad61352f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:39.703071 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0147871-a5aa-4454-8305-544bad61352f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:40.027800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0147871-a5aa-4454-8305-544bad61352f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:40.047452 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0147871-a5aa-4454-8305-544bad61352f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1309 microversion: 2.1 time: 0.370138 Aug 03 02:13:40.049470 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2279/4656] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:39 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1309 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:40.859507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-472e27dc-fd67-4d4c-9f47-6bc2896feb01 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:40.863960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-472e27dc-fd67-4d4c-9f47-6bc2896feb01 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:40.870478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:40.877776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:40.901635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-472e27dc-fd67-4d4c-9f47-6bc2896feb01 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:40.903719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-472e27dc-fd67-4d4c-9f47-6bc2896feb01 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:40.904846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-472e27dc-fd67-4d4c-9f47-6bc2896feb01 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:40.910877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-472e27dc-fd67-4d4c-9f47-6bc2896feb01 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:41.097125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0088ce2e-1f8b-4953-a1fd-7fe8b8717f57 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:41.098527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0088ce2e-1f8b-4953-a1fd-7fe8b8717f57 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:41.114247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:41.118314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0088ce2e-1f8b-4953-a1fd-7fe8b8717f57 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:41.136052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0088ce2e-1f8b-4953-a1fd-7fe8b8717f57 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:41.137985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0088ce2e-1f8b-4953-a1fd-7fe8b8717f57 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:41.142791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0088ce2e-1f8b-4953-a1fd-7fe8b8717f57 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:42.138967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0088ce2e-1f8b-4953-a1fd-7fe8b8717f57 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:42.149819 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0088ce2e-1f8b-4953-a1fd-7fe8b8717f57 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1309 microversion: 2.1 time: 1.073852 Aug 03 02:13:42.150745 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2280/4657] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:41 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1309 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:42.319238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-472e27dc-fd67-4d4c-9f47-6bc2896feb01 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:42.336413 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-472e27dc-fd67-4d4c-9f47-6bc2896feb01 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 1.488457 Aug 03 02:13:42.337890 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2378/4658] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:40 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:42.372043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d613609a-77df-42b8-956d-218543d35c43 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:42.372958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d613609a-77df-42b8-956d-218543d35c43 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:42.380568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d613609a-77df-42b8-956d-218543d35c43 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:42.381381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d613609a-77df-42b8-956d-218543d35c43 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:42.382892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d613609a-77df-42b8-956d-218543d35c43 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:42.383745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d613609a-77df-42b8-956d-218543d35c43 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:43.184742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f36eb612-cd2a-4deb-a76e-f33a025d2543 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:43.192200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f36eb612-cd2a-4deb-a76e-f33a025d2543 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:43.215825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f36eb612-cd2a-4deb-a76e-f33a025d2543 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:43.216783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f36eb612-cd2a-4deb-a76e-f33a025d2543 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:43.219454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f36eb612-cd2a-4deb-a76e-f33a025d2543 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:43.223397 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f36eb612-cd2a-4deb-a76e-f33a025d2543 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:44.128524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d613609a-77df-42b8-956d-218543d35c43 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:44.156739 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d613609a-77df-42b8-956d-218543d35c43 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 1.788494 Aug 03 02:13:44.158177 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2281/4659] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:42 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:44.189936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-85f0e541-4139-4c34-9cbb-7382bfef71ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:44.191124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-85f0e541-4139-4c34-9cbb-7382bfef71ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:44.210084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85f0e541-4139-4c34-9cbb-7382bfef71ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:44.212706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85f0e541-4139-4c34-9cbb-7382bfef71ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:44.215927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85f0e541-4139-4c34-9cbb-7382bfef71ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:44.217429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-85f0e541-4139-4c34-9cbb-7382bfef71ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:44.603035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-85f0e541-4139-4c34-9cbb-7382bfef71ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:44.623052 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-85f0e541-4139-4c34-9cbb-7382bfef71ac tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.444897 Aug 03 02:13:44.626793 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2282/4660] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:44 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:13:44.629631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f36eb612-cd2a-4deb-a76e-f33a025d2543 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:44.668298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7111c0ac-0362-414c-b4a7-706ffa583c19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:44.669274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7111c0ac-0362-414c-b4a7-706ffa583c19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:44.669402 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f36eb612-cd2a-4deb-a76e-f33a025d2543 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1309 microversion: 2.1 time: 1.486679 Aug 03 02:13:44.675398 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2379/4661] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:43 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1309 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:13:44.688119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7111c0ac-0362-414c-b4a7-706ffa583c19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:44.689572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7111c0ac-0362-414c-b4a7-706ffa583c19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:44.691979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7111c0ac-0362-414c-b4a7-706ffa583c19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:44.692589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7111c0ac-0362-414c-b4a7-706ffa583c19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:45.129676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7111c0ac-0362-414c-b4a7-706ffa583c19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:45.139821 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7111c0ac-0362-414c-b4a7-706ffa583c19 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.481446 Aug 03 02:13:45.142054 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2283/4662] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:44 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:13:45.450182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1705899347", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "b4f5b088-c1f1-4118-9137-86481e28c932"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:13:45.575992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] validate_networks() for [('b4f5b088-c1f1-4118-9137-86481e28c932', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:13:45.700845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1344b584-d93a-4b14-a4a4-951b688a073e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:45.702125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1344b584-d93a-4b14-a4a4-951b688a073e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:45.715704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1344b584-d93a-4b14-a4a4-951b688a073e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:45.716540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1344b584-d93a-4b14-a4a4-951b688a073e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:45.719952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1344b584-d93a-4b14-a4a4-951b688a073e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:45.720611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1344b584-d93a-4b14-a4a4-951b688a073e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:46.232813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1344b584-d93a-4b14-a4a4-951b688a073e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:46.244508 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1344b584-d93a-4b14-a4a4-951b688a073e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1309 microversion: 2.1 time: 0.546355 Aug 03 02:13:46.245576 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2284/4663] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:45 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1309 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:13:46.253314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f15b3e10-6874-4148-a0cd-4660a03e9b28 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:13:46.257358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f15b3e10-6874-4148-a0cd-4660a03e9b28 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:46.265783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f15b3e10-6874-4148-a0cd-4660a03e9b28 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:46.266460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f15b3e10-6874-4148-a0cd-4660a03e9b28 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:46.267483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f15b3e10-6874-4148-a0cd-4660a03e9b28 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:46.268099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f15b3e10-6874-4148-a0cd-4660a03e9b28 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:46.327491 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f15b3e10-6874-4148-a0cd-4660a03e9b28 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "POST /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728/action" status: 200 len: 32605 microversion: 2.1 time: 0.079586 Aug 03 02:13:46.328224 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2285/4664] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:13:46 2022] POST /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728/action => generated 32605 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:13:46.986492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:13:46.987110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:13:46.987445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:13:46.987859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:13:46.988329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:13:47.000697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:47.001208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:47.002025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:47.003165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:47.053106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=76 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:47.091867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Getting quotas for project 43ed3dcb7307452b965ee2d303ffaecd. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:13:47.107417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Getting quotas for user c6ac519db80b4ba99d67bd5db59be619 and project 43ed3dcb7307452b965ee2d303ffaecd. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:13:47.143880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:13:47.157542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:13:47.224571 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-334bf163-0a7a-4f63-a69b-df1991ab8923 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.779821 Aug 03 02:13:47.225754 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2380/4665] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:13:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:13:47.238352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-734aed0a-3b55-48ad-9b70-0688b13d7be1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:47.239370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-734aed0a-3b55-48ad-9b70-0688b13d7be1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:47.269849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-026de9df-d61e-4cc6-a40a-6eef83b877fc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:47.277712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-026de9df-d61e-4cc6-a40a-6eef83b877fc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:47.298129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-026de9df-d61e-4cc6-a40a-6eef83b877fc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:47.298597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-026de9df-d61e-4cc6-a40a-6eef83b877fc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:47.301619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-026de9df-d61e-4cc6-a40a-6eef83b877fc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:47.302105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-026de9df-d61e-4cc6-a40a-6eef83b877fc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:47.428982 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-734aed0a-3b55-48ad-9b70-0688b13d7be1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:47.441036 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-734aed0a-3b55-48ad-9b70-0688b13d7be1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1215 microversion: 2.1 time: 0.207393 Aug 03 02:13:47.442793 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2286/4666] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:47 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1215 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:48.152778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-026de9df-d61e-4cc6-a40a-6eef83b877fc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:48.165397 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-026de9df-d61e-4cc6-a40a-6eef83b877fc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1309 microversion: 2.1 time: 0.900028 Aug 03 02:13:48.170747 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2381/4667] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:47 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1309 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:48.466780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-76d5ef13-2c10-4942-84fd-4daef8e51288 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:48.467530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-76d5ef13-2c10-4942-84fd-4daef8e51288 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:48.491073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76d5ef13-2c10-4942-84fd-4daef8e51288 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:48.491552 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76d5ef13-2c10-4942-84fd-4daef8e51288 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:48.500039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76d5ef13-2c10-4942-84fd-4daef8e51288 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:48.503934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76d5ef13-2c10-4942-84fd-4daef8e51288 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:48.697625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-87023588-fc67-4624-a0e7-897d3df06d9d req-77510052-9d4b-465f-8fbd-b67950407d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7030597f-afd4-4953-b80f-2ad5e6974e61", "name": "network-vif-plugged", "status": "completed", "tag": "1cd0f785-0d00-4bc1-ad85-157893921bad"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:13:48.731329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-87023588-fc67-4624-a0e7-897d3df06d9d req-77510052-9d4b-465f-8fbd-b67950407d58 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:48.732044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-87023588-fc67-4624-a0e7-897d3df06d9d req-77510052-9d4b-465f-8fbd-b67950407d58 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:48.748132 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-87023588-fc67-4624-a0e7-897d3df06d9d req-77510052-9d4b-465f-8fbd-b67950407d58 service nova] Creating event network-vif-plugged:1cd0f785-0d00-4bc1-ad85-157893921bad for instance 7030597f-afd4-4953-b80f-2ad5e6974e61 on n-h2-826529-8 Aug 03 02:13:48.755392 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-87023588-fc67-4624-a0e7-897d3df06d9d req-77510052-9d4b-465f-8fbd-b67950407d58 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.340733 Aug 03 02:13:48.756755 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2287/4668] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:13:48.869500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-76d5ef13-2c10-4942-84fd-4daef8e51288 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:48.885712 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-76d5ef13-2c10-4942-84fd-4daef8e51288 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1211 microversion: 2.1 time: 0.420670 Aug 03 02:13:48.888801 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2382/4669] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:48 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1211 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:13:49.202703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-36876599-f5ba-4d14-8e7b-4998861af031 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:49.205051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-36876599-f5ba-4d14-8e7b-4998861af031 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:49.224642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36876599-f5ba-4d14-8e7b-4998861af031 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:49.230633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36876599-f5ba-4d14-8e7b-4998861af031 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:49.233171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36876599-f5ba-4d14-8e7b-4998861af031 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:49.234673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36876599-f5ba-4d14-8e7b-4998861af031 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:49.914544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ce2276ee-315b-4e50-a981-eec8d5180ec8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:49.920587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ce2276ee-315b-4e50-a981-eec8d5180ec8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:49.931367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce2276ee-315b-4e50-a981-eec8d5180ec8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:49.932247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce2276ee-315b-4e50-a981-eec8d5180ec8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:49.933445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce2276ee-315b-4e50-a981-eec8d5180ec8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:49.934184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce2276ee-315b-4e50-a981-eec8d5180ec8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:50.612066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ce2276ee-315b-4e50-a981-eec8d5180ec8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:50.629050 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ce2276ee-315b-4e50-a981-eec8d5180ec8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1273 microversion: 2.1 time: 0.717549 Aug 03 02:13:50.635864 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2383/4670] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:49 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1273 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:50.691707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-36876599-f5ba-4d14-8e7b-4998861af031 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:50.700681 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-36876599-f5ba-4d14-8e7b-4998861af031 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1309 microversion: 2.1 time: 1.511663 Aug 03 02:13:50.710130 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2288/4671] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:49 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1309 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:51.657789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-610dc60b-7b6f-415c-8578-ae9afdcef358 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:51.659145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-610dc60b-7b6f-415c-8578-ae9afdcef358 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:51.672620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-610dc60b-7b6f-415c-8578-ae9afdcef358 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:51.677126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-610dc60b-7b6f-415c-8578-ae9afdcef358 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:51.678249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-610dc60b-7b6f-415c-8578-ae9afdcef358 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:51.678970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-610dc60b-7b6f-415c-8578-ae9afdcef358 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:51.731939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-86ba98b7-a810-4357-aaa4-e2fdc3ffb701 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:51.732732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-86ba98b7-a810-4357-aaa4-e2fdc3ffb701 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:51.747623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86ba98b7-a810-4357-aaa4-e2fdc3ffb701 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:51.748337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86ba98b7-a810-4357-aaa4-e2fdc3ffb701 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:51.749360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86ba98b7-a810-4357-aaa4-e2fdc3ffb701 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:51.762281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86ba98b7-a810-4357-aaa4-e2fdc3ffb701 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:52.617677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-86ba98b7-a810-4357-aaa4-e2fdc3ffb701 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:52.627023 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-86ba98b7-a810-4357-aaa4-e2fdc3ffb701 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1309 microversion: 2.1 time: 0.901388 Aug 03 02:13:52.631180 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2289/4672] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:51 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1309 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:52.645077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b47d2df9-24a2-4ba9-b825-3cb74048ece5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:52.646033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b47d2df9-24a2-4ba9-b825-3cb74048ece5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:52.657825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-610dc60b-7b6f-415c-8578-ae9afdcef358 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:52.661071 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b47d2df9-24a2-4ba9-b825-3cb74048ece5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:52.667455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b47d2df9-24a2-4ba9-b825-3cb74048ece5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:52.669346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b47d2df9-24a2-4ba9-b825-3cb74048ece5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:52.670062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b47d2df9-24a2-4ba9-b825-3cb74048ece5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:52.678888 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-610dc60b-7b6f-415c-8578-ae9afdcef358 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1273 microversion: 2.1 time: 1.024939 Aug 03 02:13:52.693469 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2384/4673] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:51 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1273 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:52.702598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-783e61ee-94a3-4eb1-a507-45f0177a0d82 req-41e0ed08-2fec-4a24-9115-74f6aa5b045b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa69891-6222-4604-83b3-e4f33dc43728", "tag": "41484393-ec38-4692-a586-0b483604ca69"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:13:52.737983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b47d2df9-24a2-4ba9-b825-3cb74048ece5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:13:52.777986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-783e61ee-94a3-4eb1-a507-45f0177a0d82 req-41e0ed08-2fec-4a24-9115-74f6aa5b045b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:52.778448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-783e61ee-94a3-4eb1-a507-45f0177a0d82 req-41e0ed08-2fec-4a24-9115-74f6aa5b045b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:52.826967 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-783e61ee-94a3-4eb1-a507-45f0177a0d82 req-41e0ed08-2fec-4a24-9115-74f6aa5b045b service nova] Creating event network-changed:41484393-ec38-4692-a586-0b483604ca69 for instance 9fa69891-6222-4604-83b3-e4f33dc43728 on n-h1-826529-8 Aug 03 02:13:52.838532 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-783e61ee-94a3-4eb1-a507-45f0177a0d82 req-41e0ed08-2fec-4a24-9115-74f6aa5b045b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143670 Aug 03 02:13:52.866098 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2385/4674] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:13:52.930922 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b47d2df9-24a2-4ba9-b825-3cb74048ece5 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 204 len: 0 microversion: 2.1 time: 0.293160 Aug 03 02:13:52.933477 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2290/4675] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:13:52 2022] DELETE /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:13:52.944183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7824be27-5eb0-4cba-b9b5-199ee0283d03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:52.946068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7824be27-5eb0-4cba-b9b5-199ee0283d03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:52.964927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7824be27-5eb0-4cba-b9b5-199ee0283d03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:52.968428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7824be27-5eb0-4cba-b9b5-199ee0283d03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:52.970077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7824be27-5eb0-4cba-b9b5-199ee0283d03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:52.970690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7824be27-5eb0-4cba-b9b5-199ee0283d03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:53.657972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-da82a395-b1ef-411a-bf10-9892722712ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:53.661279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-da82a395-b1ef-411a-bf10-9892722712ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:53.676656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da82a395-b1ef-411a-bf10-9892722712ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:53.680415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da82a395-b1ef-411a-bf10-9892722712ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:53.681780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da82a395-b1ef-411a-bf10-9892722712ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:53.685647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da82a395-b1ef-411a-bf10-9892722712ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:54.199128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7824be27-5eb0-4cba-b9b5-199ee0283d03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:54.220107 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7824be27-5eb0-4cba-b9b5-199ee0283d03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1670 microversion: 2.1 time: 1.280998 Aug 03 02:13:54.220706 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2386/4676] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:52 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1670 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:54.230711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2d6f42bb-0483-437a-b121-5c3bf03a59ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:54.256628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2d6f42bb-0483-437a-b121-5c3bf03a59ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:54.291313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d6f42bb-0483-437a-b121-5c3bf03a59ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:54.298015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d6f42bb-0483-437a-b121-5c3bf03a59ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:54.299066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d6f42bb-0483-437a-b121-5c3bf03a59ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:54.299439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d6f42bb-0483-437a-b121-5c3bf03a59ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:54.379553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-da82a395-b1ef-411a-bf10-9892722712ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:54.389607 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-da82a395-b1ef-411a-bf10-9892722712ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1489 microversion: 2.1 time: 0.737663 Aug 03 02:13:54.400133 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2291/4677] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:53 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1489 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:13:54.694485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1580599469", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "d26ca69a-a338-40ed-9e04-7c6942285689"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:13:54.818594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] validate_networks() for [('d26ca69a-a338-40ed-9e04-7c6942285689', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:13:55.417189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2d6f42bb-0483-437a-b121-5c3bf03a59ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:55.436227 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2d6f42bb-0483-437a-b121-5c3bf03a59ea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1315 microversion: 2.1 time: 1.211442 Aug 03 02:13:55.449828 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2387/4678] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:54 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1315 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:55.455410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2012e4e7-095a-41d9-943e-f73abd8a9dcd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:55.456346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2012e4e7-095a-41d9-943e-f73abd8a9dcd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:55.474572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2012e4e7-095a-41d9-943e-f73abd8a9dcd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:55.475071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2012e4e7-095a-41d9-943e-f73abd8a9dcd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:55.476602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2012e4e7-095a-41d9-943e-f73abd8a9dcd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:55.477341 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2012e4e7-095a-41d9-943e-f73abd8a9dcd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:56.872247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2012e4e7-095a-41d9-943e-f73abd8a9dcd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:56.881428 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2012e4e7-095a-41d9-943e-f73abd8a9dcd tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1670 microversion: 2.1 time: 1.430423 Aug 03 02:13:56.888024 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2388/4679] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:55 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1670 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:56.903261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5c7c9328-c8c4-4ac1-8605-5b2010a38c0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:56.904253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5c7c9328-c8c4-4ac1-8605-5b2010a38c0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:56.919024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c7c9328-c8c4-4ac1-8605-5b2010a38c0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:56.919767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c7c9328-c8c4-4ac1-8605-5b2010a38c0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:56.920308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c7c9328-c8c4-4ac1-8605-5b2010a38c0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:56.920750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c7c9328-c8c4-4ac1-8605-5b2010a38c0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:57.053616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:57.125036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:57.434706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:13:58.309200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5c7c9328-c8c4-4ac1-8605-5b2010a38c0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:58.317505 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5c7c9328-c8c4-4ac1-8605-5b2010a38c0e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1315 microversion: 2.1 time: 1.428059 Aug 03 02:13:58.320779 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2389/4680] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:56 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1315 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:58.338300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e0a421d9-654a-4725-810a-d876624f6f03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:58.339295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e0a421d9-654a-4725-810a-d876624f6f03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:58.356807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0a421d9-654a-4725-810a-d876624f6f03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:58.359607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0a421d9-654a-4725-810a-d876624f6f03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:58.360459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0a421d9-654a-4725-810a-d876624f6f03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:58.360919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0a421d9-654a-4725-810a-d876624f6f03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:59.123280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e0a421d9-654a-4725-810a-d876624f6f03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ab5d1fb4b1453b9ba37a2b1194ec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f90284be975b4e459cdc3e72c1664630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:13:59.133824 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e0a421d9-654a-4725-810a-d876624f6f03 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 200 len: 1484 microversion: 2.1 time: 0.808197 Aug 03 02:13:59.152287 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2390/4681] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:58 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 1484 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:13:59.431584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:13:59.432647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:13:59.433393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:13:59.434305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:13:59.435087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:13:59.459190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:59.459987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:59.465879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:59.469303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:59.539257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:13:59.569352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for user 2721f67579e542718483193be7515d6b and project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:13:59.625291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:13:59.631058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:13:59.790265 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8c07330d-4e8d-4a42-b719-c36921220fa5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.106953 Aug 03 02:13:59.795789 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2292/4682] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:13:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 5113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:13:59.815718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-468a52ef-a1b9-4697-9816-409af996c6f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:13:59.816776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-468a52ef-a1b9-4697-9816-409af996c6f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:13:59.844600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-468a52ef-a1b9-4697-9816-409af996c6f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:59.852906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-468a52ef-a1b9-4697-9816-409af996c6f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:13:59.859052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-468a52ef-a1b9-4697-9816-409af996c6f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:13:59.862411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-468a52ef-a1b9-4697-9816-409af996c6f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:00.030936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-e376b045-18fd-47f7-833a-4c241bbcc4d3 req-2f54f49b-9548-487f-a567-c511d7a62922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa69891-6222-4604-83b3-e4f33dc43728", "name": "network-vif-deleted", "tag": "41484393-ec38-4692-a586-0b483604ca69"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:00.048867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:00.075031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e376b045-18fd-47f7-833a-4c241bbcc4d3 req-2f54f49b-9548-487f-a567-c511d7a62922 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:00.077449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e376b045-18fd-47f7-833a-4c241bbcc4d3 req-2f54f49b-9548-487f-a567-c511d7a62922 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:00.144846 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-e376b045-18fd-47f7-833a-4c241bbcc4d3 req-2f54f49b-9548-487f-a567-c511d7a62922 service nova] Creating event network-vif-deleted:41484393-ec38-4692-a586-0b483604ca69 for instance 9fa69891-6222-4604-83b3-e4f33dc43728 on n-h1-826529-8 Aug 03 02:14:00.166539 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-e376b045-18fd-47f7-833a-4c241bbcc4d3 req-2f54f49b-9548-487f-a567-c511d7a62922 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.012827 Aug 03 02:14:00.171496 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2391/4683] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:14:00.192892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9608b9ed-75b8-4bdb-8153-bca2f37bded6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:00.193621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9608b9ed-75b8-4bdb-8153-bca2f37bded6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:00.511956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9608b9ed-75b8-4bdb-8153-bca2f37bded6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:00.535468 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9608b9ed-75b8-4bdb-8153-bca2f37bded6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1209 microversion: 2.1 time: 0.362151 Aug 03 02:14:00.548949 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2392/4684] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:00 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1209 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:00.567056 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-22d8baee-56b0-48ad-a1fa-9fc86b3bf4e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:00.567959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-22d8baee-56b0-48ad-a1fa-9fc86b3bf4e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] [instance: 9fa69891-6222-4604-83b3-e4f33dc43728] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:00.582861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22d8baee-56b0-48ad-a1fa-9fc86b3bf4e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:00.583616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22d8baee-56b0-48ad-a1fa-9fc86b3bf4e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:00.584620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22d8baee-56b0-48ad-a1fa-9fc86b3bf4e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:00.585971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22d8baee-56b0-48ad-a1fa-9fc86b3bf4e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:00.622528 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-22d8baee-56b0-48ad-a1fa-9fc86b3bf4e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] HTTP exception thrown: Instance 9fa69891-6222-4604-83b3-e4f33dc43728 could not be found. Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-22d8baee-56b0-48ad-a1fa-9fc86b3bf4e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Request method failure captured: Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 HTTP/1.1 Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6diZeEEjiGzAcmk6N3GrsvuSSfJa8t-_aovLDCAXQm2xQTm33vEGpolDBlHiFlzKq6sp-ZuiHN5qDQ66gUJfha9nUxbNi-5TwYU5GrNfnPL9YtuBPdd8XVzKazw-zqiOhVbXgQyCFciFIcruufj-juJy4hSW-ROXyKVKRMqApPpv79g Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: f90284be975b4e459cdc3e72c1664630 Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestNetworkBasicOps-1604073491 Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f90284be975b4e459cdc3e72c1664630", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f90284be975b4e459cdc3e72c1664630"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f90284be975b4e459cdc3e72c1664630"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f90284be975b4e459cdc3e72c1664630"}]}] Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestNetworkBasicOps-1604073491 Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: f90284be975b4e459cdc3e72c1664630 Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestNetworkBasicOps-1604073491 Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestNetworkBasicOps-1604073491-project Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: c1ab5d1fb4b1453b9ba37a2b1194ec79 Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestNetworkBasicOps-1604073491-project Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 9fa69891-6222-4604-83b3-e4f33dc43728 could not be found. Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '9fa69891-6222-4604-83b3-e4f33dc43728'} Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fa69891-6222-4604-83b3-e4f33dc43728 could not be found. Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fa69891-6222-4604-83b3-e4f33dc43728 could not be found. Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:14:00.634428 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:14:00.642475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:14:00.642475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:14:00.642475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:14:00.642475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:14:00.642475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:14:00.642475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fa69891-6222-4604-83b3-e4f33dc43728 could not be found. Aug 03 02:14:00.642475 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:14:00.646490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-22d8baee-56b0-48ad-a1fa-9fc86b3bf4e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Returning 404 to user: Instance 9fa69891-6222-4604-83b3-e4f33dc43728 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:14:00.653079 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-22d8baee-56b0-48ad-a1fa-9fc86b3bf4e0 tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728" status: 404 len: 111 microversion: 2.1 time: 0.102663 Aug 03 02:14:00.655655 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2393/4685] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:00 2022] GET /compute/v2.1/servers/9fa69891-6222-4604-83b3-e4f33dc43728 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:14:00.987534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-468a52ef-a1b9-4697-9816-409af996c6f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:01.012721 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-468a52ef-a1b9-4697-9816-409af996c6f1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1315 microversion: 2.1 time: 1.215495 Aug 03 02:14:01.013763 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2293/4686] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:13:59 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1315 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:01.295982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c00dbd10-5ac7-4e13-ad13-8d7456234dbf tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] Calling method '.version_select at 0x7f5b12363c10>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:01.346096 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c00dbd10-5ac7-4e13-ad13-8d7456234dbf tempest-TestNetworkBasicOps-1604073491 tempest-TestNetworkBasicOps-1604073491-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1186470048" status: 202 len: 0 microversion: 2.1 time: 0.055366 Aug 03 02:14:01.351628 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2394/4687] 10.222.0.67 () {58 vars in 1257 bytes} [Wed Aug 3 02:14:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1186470048 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:14:01.572764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-97f94c85-d1fa-459b-b0a4-b427ad52d753 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:01.576044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-97f94c85-d1fa-459b-b0a4-b427ad52d753 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:01.610855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97f94c85-d1fa-459b-b0a4-b427ad52d753 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:01.612087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97f94c85-d1fa-459b-b0a4-b427ad52d753 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:01.613005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97f94c85-d1fa-459b-b0a4-b427ad52d753 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:01.619360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97f94c85-d1fa-459b-b0a4-b427ad52d753 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:02.003958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-97f94c85-d1fa-459b-b0a4-b427ad52d753 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:02.021212 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-97f94c85-d1fa-459b-b0a4-b427ad52d753 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1269 microversion: 2.1 time: 0.455249 Aug 03 02:14:02.022035 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2294/4688] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:01 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1269 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:02.045529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-56e0ee95-3504-4d6d-b06f-4d709ce5326d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:02.046294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-56e0ee95-3504-4d6d-b06f-4d709ce5326d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:02.075656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56e0ee95-3504-4d6d-b06f-4d709ce5326d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:02.079081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56e0ee95-3504-4d6d-b06f-4d709ce5326d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:02.082713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56e0ee95-3504-4d6d-b06f-4d709ce5326d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:02.084155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56e0ee95-3504-4d6d-b06f-4d709ce5326d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:02.293225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-f3f7689a-bbc8-4102-a79b-eeeedabdf41f req-01302f4e-f6b9-45d0-a48a-58ee035011f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "865dd2e4-70af-4152-92d8-8b7e65f6925a", "tag": "d9c19332-bece-4894-bc20-72c950b09199"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:02.325041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f3f7689a-bbc8-4102-a79b-eeeedabdf41f req-01302f4e-f6b9-45d0-a48a-58ee035011f3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:02.331116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f3f7689a-bbc8-4102-a79b-eeeedabdf41f req-01302f4e-f6b9-45d0-a48a-58ee035011f3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:02.379754 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-f3f7689a-bbc8-4102-a79b-eeeedabdf41f req-01302f4e-f6b9-45d0-a48a-58ee035011f3 service nova] Creating event network-changed:d9c19332-bece-4894-bc20-72c950b09199 for instance 865dd2e4-70af-4152-92d8-8b7e65f6925a on n-h2-826529-8 Aug 03 02:14:02.391661 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-f3f7689a-bbc8-4102-a79b-eeeedabdf41f req-01302f4e-f6b9-45d0-a48a-58ee035011f3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110370 Aug 03 02:14:02.394517 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2295/4689] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:14:02.917280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-56e0ee95-3504-4d6d-b06f-4d709ce5326d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:02.929956 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-56e0ee95-3504-4d6d-b06f-4d709ce5326d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1315 microversion: 2.1 time: 0.889339 Aug 03 02:14:02.937875 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2395/4690] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:02 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1315 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:03.052537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0805f5ff-205e-49f5-bcb6-a2baa5abc76e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:03.053190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0805f5ff-205e-49f5-bcb6-a2baa5abc76e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:03.066063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0805f5ff-205e-49f5-bcb6-a2baa5abc76e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:03.066806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0805f5ff-205e-49f5-bcb6-a2baa5abc76e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:03.068420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0805f5ff-205e-49f5-bcb6-a2baa5abc76e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:03.069071 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0805f5ff-205e-49f5-bcb6-a2baa5abc76e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:03.207983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0805f5ff-205e-49f5-bcb6-a2baa5abc76e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:03.211081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:03.229053 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0805f5ff-205e-49f5-bcb6-a2baa5abc76e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1267 microversion: 2.1 time: 0.183973 Aug 03 02:14:03.231287 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2296/4691] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:03 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:03.969328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aba2ced9-4da9-4edc-b7d7-994efa56959b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:03.970495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-aba2ced9-4da9-4edc-b7d7-994efa56959b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:04.014047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aba2ced9-4da9-4edc-b7d7-994efa56959b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:04.017154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aba2ced9-4da9-4edc-b7d7-994efa56959b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:04.018267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aba2ced9-4da9-4edc-b7d7-994efa56959b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:04.021396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aba2ced9-4da9-4edc-b7d7-994efa56959b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:04.254971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4c035459-4541-497f-8152-8504820c4652 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:04.256228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4c035459-4541-497f-8152-8504820c4652 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:04.277019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c035459-4541-497f-8152-8504820c4652 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:04.277475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c035459-4541-497f-8152-8504820c4652 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:04.278281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c035459-4541-497f-8152-8504820c4652 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:04.278721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c035459-4541-497f-8152-8504820c4652 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:04.564214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4c035459-4541-497f-8152-8504820c4652 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:04.593896 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4c035459-4541-497f-8152-8504820c4652 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1267 microversion: 2.1 time: 0.339379 Aug 03 02:14:04.608967 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2297/4692] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:04 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1267 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:05.073393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-aba2ced9-4da9-4edc-b7d7-994efa56959b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:05.088277 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-aba2ced9-4da9-4edc-b7d7-994efa56959b tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1315 microversion: 2.1 time: 1.133267 Aug 03 02:14:05.090118 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2396/4693] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:03 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1315 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:05.618778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5ae89f6b-51fd-488d-ab9c-bf3c33b6ada0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:05.619437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5ae89f6b-51fd-488d-ab9c-bf3c33b6ada0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:05.623388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:05.636387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ae89f6b-51fd-488d-ab9c-bf3c33b6ada0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:05.646534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ae89f6b-51fd-488d-ab9c-bf3c33b6ada0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:05.648394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ae89f6b-51fd-488d-ab9c-bf3c33b6ada0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:05.657731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ae89f6b-51fd-488d-ab9c-bf3c33b6ada0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:06.115481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-149286ec-1083-4fb0-b5d9-0f2b60030205 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:06.116027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-149286ec-1083-4fb0-b5d9-0f2b60030205 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:06.131622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-149286ec-1083-4fb0-b5d9-0f2b60030205 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:06.132658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-149286ec-1083-4fb0-b5d9-0f2b60030205 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:06.133785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-149286ec-1083-4fb0-b5d9-0f2b60030205 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:06.135532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-149286ec-1083-4fb0-b5d9-0f2b60030205 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:07.271421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5ae89f6b-51fd-488d-ab9c-bf3c33b6ada0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:07.273640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-149286ec-1083-4fb0-b5d9-0f2b60030205 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:07.283950 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-149286ec-1083-4fb0-b5d9-0f2b60030205 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1315 microversion: 2.1 time: 1.170479 Aug 03 02:14:07.284580 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2397/4694] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:06 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1315 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:07.285763 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5ae89f6b-51fd-488d-ab9c-bf3c33b6ada0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1309 microversion: 2.1 time: 1.670470 Aug 03 02:14:07.287581 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2298/4695] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:05 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1309 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:08.322824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-63d70d5c-65b6-4169-bee1-4f4a6d8627e9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:08.323736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f55ca309-c8a0-47ac-a57f-eca4ce409627 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:08.324885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-63d70d5c-65b6-4169-bee1-4f4a6d8627e9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:08.326210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f55ca309-c8a0-47ac-a57f-eca4ce409627 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:08.352159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63d70d5c-65b6-4169-bee1-4f4a6d8627e9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:08.353828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f55ca309-c8a0-47ac-a57f-eca4ce409627 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:08.354472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f55ca309-c8a0-47ac-a57f-eca4ce409627 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:08.354933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63d70d5c-65b6-4169-bee1-4f4a6d8627e9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:08.358491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63d70d5c-65b6-4169-bee1-4f4a6d8627e9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:08.359871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f55ca309-c8a0-47ac-a57f-eca4ce409627 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:08.361490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63d70d5c-65b6-4169-bee1-4f4a6d8627e9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:08.362075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f55ca309-c8a0-47ac-a57f-eca4ce409627 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:09.511542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:09.591770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:09.811940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f55ca309-c8a0-47ac-a57f-eca4ce409627 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:09.839074 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f55ca309-c8a0-47ac-a57f-eca4ce409627 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1309 microversion: 2.1 time: 1.526559 Aug 03 02:14:09.861399 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2398/4696] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:08 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1309 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:09.899728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-63d70d5c-65b6-4169-bee1-4f4a6d8627e9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:09.915270 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-63d70d5c-65b6-4169-bee1-4f4a6d8627e9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1315 microversion: 2.1 time: 1.595716 Aug 03 02:14:09.915931 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2299/4697] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:08 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1315 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:10.498588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f5eb0f88-fe45-4012-b45e-32a4c5fd0ebb req-5593f017-f1bf-493c-91fa-b79adc719ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865dd2e4-70af-4152-92d8-8b7e65f6925a", "name": "network-vif-plugged", "status": "completed", "tag": "d9c19332-bece-4894-bc20-72c950b09199"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:10.521565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:10.529109 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f5eb0f88-fe45-4012-b45e-32a4c5fd0ebb req-5593f017-f1bf-493c-91fa-b79adc719ada service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:10.531974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f5eb0f88-fe45-4012-b45e-32a4c5fd0ebb req-5593f017-f1bf-493c-91fa-b79adc719ada service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:10.590793 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f5eb0f88-fe45-4012-b45e-32a4c5fd0ebb req-5593f017-f1bf-493c-91fa-b79adc719ada service nova] Creating event network-vif-plugged:d9c19332-bece-4894-bc20-72c950b09199 for instance 865dd2e4-70af-4152-92d8-8b7e65f6925a on n-h2-826529-8 Aug 03 02:14:10.614512 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f5eb0f88-fe45-4012-b45e-32a4c5fd0ebb req-5593f017-f1bf-493c-91fa-b79adc719ada service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118737 Aug 03 02:14:10.622127 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2399/4698] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:14:10.894757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6439a506-7201-4b8b-a206-d805f706534e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:10.895486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6439a506-7201-4b8b-a206-d805f706534e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:10.915281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6439a506-7201-4b8b-a206-d805f706534e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:10.916010 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6439a506-7201-4b8b-a206-d805f706534e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:10.917164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6439a506-7201-4b8b-a206-d805f706534e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:10.924281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6439a506-7201-4b8b-a206-d805f706534e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:10.942122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-56ca631e-4e0e-4297-8e3e-07fa2a76f78e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:10.943791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-56ca631e-4e0e-4297-8e3e-07fa2a76f78e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:10.977815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56ca631e-4e0e-4297-8e3e-07fa2a76f78e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:10.981655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56ca631e-4e0e-4297-8e3e-07fa2a76f78e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:10.983747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56ca631e-4e0e-4297-8e3e-07fa2a76f78e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:10.984296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56ca631e-4e0e-4297-8e3e-07fa2a76f78e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:12.024176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6439a506-7201-4b8b-a206-d805f706534e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:12.042305 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6439a506-7201-4b8b-a206-d805f706534e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1309 microversion: 2.1 time: 1.152010 Aug 03 02:14:12.056937 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2300/4699] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:10 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1309 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:12.056937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-37ef4488-8a48-4986-be81-7db391b15ec4 req-0483d378-4aa8-4a15-a206-f90be5754ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "999a174f-1170-4039-86a0-8f498b7341c3", "tag": "ee146b00-8f24-4c07-b300-fbde44441459"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:12.084044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-37ef4488-8a48-4986-be81-7db391b15ec4 req-0483d378-4aa8-4a15-a206-f90be5754ed7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:12.085648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-37ef4488-8a48-4986-be81-7db391b15ec4 req-0483d378-4aa8-4a15-a206-f90be5754ed7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:12.115434 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-37ef4488-8a48-4986-be81-7db391b15ec4 req-0483d378-4aa8-4a15-a206-f90be5754ed7 service nova] Creating event network-changed:ee146b00-8f24-4c07-b300-fbde44441459 for instance 999a174f-1170-4039-86a0-8f498b7341c3 on n-h1-826529-8 Aug 03 02:14:12.127875 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-37ef4488-8a48-4986-be81-7db391b15ec4 req-0483d378-4aa8-4a15-a206-f90be5754ed7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082424 Aug 03 02:14:12.135002 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2301/4700] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:14:12.220048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-56ca631e-4e0e-4297-8e3e-07fa2a76f78e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:12.237212 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-56ca631e-4e0e-4297-8e3e-07fa2a76f78e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1315 microversion: 2.1 time: 1.301908 Aug 03 02:14:12.247141 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2400/4701] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:10 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1315 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:13.079497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6cfc2fbd-20e8-452f-b342-3e312ae33863 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:13.080922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6cfc2fbd-20e8-452f-b342-3e312ae33863 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:13.090676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6cfc2fbd-20e8-452f-b342-3e312ae33863 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:13.091701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6cfc2fbd-20e8-452f-b342-3e312ae33863 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:13.092747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6cfc2fbd-20e8-452f-b342-3e312ae33863 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:13.093384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6cfc2fbd-20e8-452f-b342-3e312ae33863 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:13.261483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d0749259-afa0-44bb-81ac-9c29f6ca0a04 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:13.263133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d0749259-afa0-44bb-81ac-9c29f6ca0a04 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:13.299128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0749259-afa0-44bb-81ac-9c29f6ca0a04 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:13.300617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0749259-afa0-44bb-81ac-9c29f6ca0a04 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:13.307548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0749259-afa0-44bb-81ac-9c29f6ca0a04 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:13.312178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0749259-afa0-44bb-81ac-9c29f6ca0a04 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:13.958206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6cfc2fbd-20e8-452f-b342-3e312ae33863 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:13.970804 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6cfc2fbd-20e8-452f-b342-3e312ae33863 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1309 microversion: 2.1 time: 0.900580 Aug 03 02:14:13.973772 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2302/4702] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:13 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1309 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:13.985020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d0749259-afa0-44bb-81ac-9c29f6ca0a04 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:14.000770 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d0749259-afa0-44bb-81ac-9c29f6ca0a04 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1315 microversion: 2.1 time: 0.743680 Aug 03 02:14:14.001734 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2401/4703] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:13 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1315 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:15.006950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e9df3d0a-6fde-44a0-b9f4-6cf72fdac421 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:15.007991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e9df3d0a-6fde-44a0-b9f4-6cf72fdac421 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:15.020925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9df3d0a-6fde-44a0-b9f4-6cf72fdac421 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:15.021400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9df3d0a-6fde-44a0-b9f4-6cf72fdac421 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:15.022244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9df3d0a-6fde-44a0-b9f4-6cf72fdac421 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:15.022942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9df3d0a-6fde-44a0-b9f4-6cf72fdac421 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:15.030561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-faedf21a-f48f-4653-8f2e-acc10eb75ec9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:15.031283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-faedf21a-f48f-4653-8f2e-acc10eb75ec9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:15.051272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faedf21a-f48f-4653-8f2e-acc10eb75ec9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:15.054948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faedf21a-f48f-4653-8f2e-acc10eb75ec9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:15.057176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faedf21a-f48f-4653-8f2e-acc10eb75ec9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:15.059337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faedf21a-f48f-4653-8f2e-acc10eb75ec9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:15.079525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:15.605797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e9df3d0a-6fde-44a0-b9f4-6cf72fdac421 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:15.618052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-faedf21a-f48f-4653-8f2e-acc10eb75ec9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:15.625891 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e9df3d0a-6fde-44a0-b9f4-6cf72fdac421 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1309 microversion: 2.1 time: 0.624896 Aug 03 02:14:15.626483 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2303/4704] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:14 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1309 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:15.639673 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-faedf21a-f48f-4653-8f2e-acc10eb75ec9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1501 microversion: 2.1 time: 0.605348 Aug 03 02:14:15.639673 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2402/4705] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:15 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1501 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:15.656504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b3f1d9c5-cdd9-4d1b-93c1-ed0cd1e52f54 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:15.657047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b3f1d9c5-cdd9-4d1b-93c1-ed0cd1e52f54 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:15.674571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3f1d9c5-cdd9-4d1b-93c1-ed0cd1e52f54 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:15.675064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3f1d9c5-cdd9-4d1b-93c1-ed0cd1e52f54 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:15.675916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3f1d9c5-cdd9-4d1b-93c1-ed0cd1e52f54 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:15.676289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3f1d9c5-cdd9-4d1b-93c1-ed0cd1e52f54 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:15.970715 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.network.security_group_api [None req-b3f1d9c5-cdd9-4d1b-93c1-ed0cd1e52f54 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Removing security group 5efa2ab7-581a-420e-ae00-ccad413c1148 from port d9c19332-bece-4894-bc20-72c950b09199 Aug 03 02:14:16.652840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2b1f8f09-94b2-4c03-8885-0c3e04b1a7d5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:16.654083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2b1f8f09-94b2-4c03-8885-0c3e04b1a7d5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:16.664292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b1f8f09-94b2-4c03-8885-0c3e04b1a7d5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:16.670096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b1f8f09-94b2-4c03-8885-0c3e04b1a7d5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:16.670879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b1f8f09-94b2-4c03-8885-0c3e04b1a7d5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:16.671348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b1f8f09-94b2-4c03-8885-0c3e04b1a7d5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:16.748716 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b3f1d9c5-cdd9-4d1b-93c1-ed0cd1e52f54 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a/action" status: 202 len: 0 microversion: 2.1 time: 1.096070 Aug 03 02:14:16.752978 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2304/4706] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:14:15 2022] POST /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a/action => generated 0 bytes in 1101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:14:16.763770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5462a40b-07df-490b-9d24-bfd86ccf78f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:16.764671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5462a40b-07df-490b-9d24-bfd86ccf78f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:16.776122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5462a40b-07df-490b-9d24-bfd86ccf78f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:16.776719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5462a40b-07df-490b-9d24-bfd86ccf78f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:16.780498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5462a40b-07df-490b-9d24-bfd86ccf78f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:16.781002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5462a40b-07df-490b-9d24-bfd86ccf78f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:17.099660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5462a40b-07df-490b-9d24-bfd86ccf78f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:17.110266 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5462a40b-07df-490b-9d24-bfd86ccf78f6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1459 microversion: 2.1 time: 0.350678 Aug 03 02:14:17.112836 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2305/4707] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:16 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1459 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:17.120865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-dac6b644-84e1-426b-a9dd-60c97307d6f9 req-619f79eb-beab-4da6-b28f-3b536b76f3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "865dd2e4-70af-4152-92d8-8b7e65f6925a", "tag": "d9c19332-bece-4894-bc20-72c950b09199"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:17.150711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-dac6b644-84e1-426b-a9dd-60c97307d6f9 req-619f79eb-beab-4da6-b28f-3b536b76f3c1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:17.151485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-dac6b644-84e1-426b-a9dd-60c97307d6f9 req-619f79eb-beab-4da6-b28f-3b536b76f3c1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:17.191927 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-dac6b644-84e1-426b-a9dd-60c97307d6f9 req-619f79eb-beab-4da6-b28f-3b536b76f3c1 service nova] Creating event network-changed:d9c19332-bece-4894-bc20-72c950b09199 for instance 865dd2e4-70af-4152-92d8-8b7e65f6925a on n-h2-826529-8 Aug 03 02:14:17.204057 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-dac6b644-84e1-426b-a9dd-60c97307d6f9 req-619f79eb-beab-4da6-b28f-3b536b76f3c1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089536 Aug 03 02:14:17.206767 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2306/4708] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:14:17.228644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1cfa66f9-3ca8-4b27-b307-c55d2cef7bfc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:17.234515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1cfa66f9-3ca8-4b27-b307-c55d2cef7bfc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:17.247110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1cfa66f9-3ca8-4b27-b307-c55d2cef7bfc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:17.248256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1cfa66f9-3ca8-4b27-b307-c55d2cef7bfc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:17.252100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1cfa66f9-3ca8-4b27-b307-c55d2cef7bfc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:17.253778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1cfa66f9-3ca8-4b27-b307-c55d2cef7bfc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:17.802233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2b1f8f09-94b2-4c03-8885-0c3e04b1a7d5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:17.819655 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2b1f8f09-94b2-4c03-8885-0c3e04b1a7d5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1309 microversion: 2.1 time: 1.170303 Aug 03 02:14:17.835543 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2403/4709] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:16 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1309 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:18.211196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1cfa66f9-3ca8-4b27-b307-c55d2cef7bfc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:18.222464 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1cfa66f9-3ca8-4b27-b307-c55d2cef7bfc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 1.012281 Aug 03 02:14:18.235050 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2307/4710] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:17 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:18.249911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8ca28190-81b7-4853-8074-943eb432987a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:18.250530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8ca28190-81b7-4853-8074-943eb432987a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:18.259609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ca28190-81b7-4853-8074-943eb432987a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:18.260063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ca28190-81b7-4853-8074-943eb432987a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:18.260856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ca28190-81b7-4853-8074-943eb432987a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:18.261298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ca28190-81b7-4853-8074-943eb432987a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:18.739961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8ca28190-81b7-4853-8074-943eb432987a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:18.766490 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8ca28190-81b7-4853-8074-943eb432987a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.520451 Aug 03 02:14:18.769596 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2404/4711] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:18 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:18.794842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5556ed0e-8558-489f-b736-2d1ebc1da893 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:18.796116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5556ed0e-8558-489f-b736-2d1ebc1da893 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:18.809713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5556ed0e-8558-489f-b736-2d1ebc1da893 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:18.813242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5556ed0e-8558-489f-b736-2d1ebc1da893 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:18.815613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5556ed0e-8558-489f-b736-2d1ebc1da893 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:18.817929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5556ed0e-8558-489f-b736-2d1ebc1da893 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:18.856438 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4a92fe51-27de-49c4-9ade-e14525a89e9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:18.857201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4a92fe51-27de-49c4-9ade-e14525a89e9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:18.870967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a92fe51-27de-49c4-9ade-e14525a89e9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:18.871577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a92fe51-27de-49c4-9ade-e14525a89e9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:18.873796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a92fe51-27de-49c4-9ade-e14525a89e9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:18.875534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a92fe51-27de-49c4-9ade-e14525a89e9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:19.329346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4a92fe51-27de-49c4-9ade-e14525a89e9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:19.337894 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4a92fe51-27de-49c4-9ade-e14525a89e9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1309 microversion: 2.1 time: 0.485983 Aug 03 02:14:19.352512 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2405/4712] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:18 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1309 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:19.395580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5556ed0e-8558-489f-b736-2d1ebc1da893 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:19.407142 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5556ed0e-8558-489f-b736-2d1ebc1da893 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.617274 Aug 03 02:14:19.408153 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2308/4713] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:18 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:19.433798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-af233fff-b382-4f8a-95aa-e86d56df44f4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:19.435024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-af233fff-b382-4f8a-95aa-e86d56df44f4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:19.450622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af233fff-b382-4f8a-95aa-e86d56df44f4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:19.451398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af233fff-b382-4f8a-95aa-e86d56df44f4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:19.452451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af233fff-b382-4f8a-95aa-e86d56df44f4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:19.453172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af233fff-b382-4f8a-95aa-e86d56df44f4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:19.893369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-af233fff-b382-4f8a-95aa-e86d56df44f4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:19.912461 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-af233fff-b382-4f8a-95aa-e86d56df44f4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.481775 Aug 03 02:14:19.914326 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2406/4714] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:19 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:20.219178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-981452102", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "b4f5b088-c1f1-4118-9137-86481e28c932"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:20.324102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] validate_networks() for [('b4f5b088-c1f1-4118-9137-86481e28c932', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:14:20.362822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1732ab83-00ec-4591-b8b0-6e887977a79c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:20.363489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1732ab83-00ec-4591-b8b0-6e887977a79c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:20.379235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1732ab83-00ec-4591-b8b0-6e887977a79c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:20.379993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1732ab83-00ec-4591-b8b0-6e887977a79c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:20.381002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1732ab83-00ec-4591-b8b0-6e887977a79c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:20.382532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1732ab83-00ec-4591-b8b0-6e887977a79c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:20.936707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1732ab83-00ec-4591-b8b0-6e887977a79c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:20.949808 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1732ab83-00ec-4591-b8b0-6e887977a79c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1309 microversion: 2.1 time: 0.591828 Aug 03 02:14:20.966498 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2407/4715] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:20 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1309 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:20.974186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-dd4061e9-a2f8-44fe-95cf-827094963cd8 req-69acf8c6-57fa-45eb-a7c5-474aecfeb9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999a174f-1170-4039-86a0-8f498b7341c3", "name": "network-vif-plugged", "status": "completed", "tag": "ee146b00-8f24-4c07-b300-fbde44441459"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:20.990310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-dd4061e9-a2f8-44fe-95cf-827094963cd8 req-69acf8c6-57fa-45eb-a7c5-474aecfeb9a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:20.991349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-dd4061e9-a2f8-44fe-95cf-827094963cd8 req-69acf8c6-57fa-45eb-a7c5-474aecfeb9a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:21.004999 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-dd4061e9-a2f8-44fe-95cf-827094963cd8 req-69acf8c6-57fa-45eb-a7c5-474aecfeb9a7 service nova] Creating event network-vif-plugged:ee146b00-8f24-4c07-b300-fbde44441459 for instance 999a174f-1170-4039-86a0-8f498b7341c3 on n-h1-826529-8 Aug 03 02:14:21.016150 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-dd4061e9-a2f8-44fe-95cf-827094963cd8 req-69acf8c6-57fa-45eb-a7c5-474aecfeb9a7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047986 Aug 03 02:14:21.018226 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2408/4716] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:14:21.977916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8d9710e4-8460-4bad-a7e3-60bd781d82d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:21.979273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8d9710e4-8460-4bad-a7e3-60bd781d82d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:21.997523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d9710e4-8460-4bad-a7e3-60bd781d82d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:22.000351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d9710e4-8460-4bad-a7e3-60bd781d82d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:22.002417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d9710e4-8460-4bad-a7e3-60bd781d82d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:22.008737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d9710e4-8460-4bad-a7e3-60bd781d82d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:22.030588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:14:22.031276 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:14:22.031882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:14:22.032429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:14:22.033017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:14:22.046631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:22.049648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:22.051889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:22.052589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:22.129749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Getting quotas for project 43ed3dcb7307452b965ee2d303ffaecd. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:14:22.147843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Getting quotas for user c6ac519db80b4ba99d67bd5db59be619 and project 43ed3dcb7307452b965ee2d303ffaecd. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:14:22.177133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:14:22.183196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:14:22.281329 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-81ba87ee-b4fb-4f00-92f4-7ac51eb88045 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.067654 Aug 03 02:14:22.282319 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2309/4717] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:14:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 02:14:22.301555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d47b15bb-9a96-4dc5-a6b4-daf038985797 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:22.302167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d47b15bb-9a96-4dc5-a6b4-daf038985797 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:22.304805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8d9710e4-8460-4bad-a7e3-60bd781d82d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:22.326048 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8d9710e4-8460-4bad-a7e3-60bd781d82d3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1309 microversion: 2.1 time: 0.356315 Aug 03 02:14:22.329530 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2409/4718] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:21 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:22.546492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d47b15bb-9a96-4dc5-a6b4-daf038985797 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:22.560312 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d47b15bb-9a96-4dc5-a6b4-daf038985797 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1214 microversion: 2.1 time: 0.260625 Aug 03 02:14:22.561305 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2310/4719] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:22 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1214 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:23.363199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dc74492e-3f8d-4f12-a045-67a6104883bd tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:23.363832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dc74492e-3f8d-4f12-a045-67a6104883bd tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:23.375033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc74492e-3f8d-4f12-a045-67a6104883bd tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:23.375648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc74492e-3f8d-4f12-a045-67a6104883bd tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:23.378630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc74492e-3f8d-4f12-a045-67a6104883bd tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:23.379182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc74492e-3f8d-4f12-a045-67a6104883bd tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:23.584577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-433fe5f6-395a-4697-a956-15bd7c6e5139 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:23.585368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-433fe5f6-395a-4697-a956-15bd7c6e5139 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:23.604317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-433fe5f6-395a-4697-a956-15bd7c6e5139 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:23.605124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-433fe5f6-395a-4697-a956-15bd7c6e5139 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:23.606230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-433fe5f6-395a-4697-a956-15bd7c6e5139 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:23.606977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-433fe5f6-395a-4697-a956-15bd7c6e5139 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:23.848399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-433fe5f6-395a-4697-a956-15bd7c6e5139 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:23.863309 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-433fe5f6-395a-4697-a956-15bd7c6e5139 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1210 microversion: 2.1 time: 0.282665 Aug 03 02:14:23.870662 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2311/4720] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:23 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1210 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:24.128651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dc74492e-3f8d-4f12-a045-67a6104883bd tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:24.140255 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dc74492e-3f8d-4f12-a045-67a6104883bd tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1489 microversion: 2.1 time: 0.793762 Aug 03 02:14:24.141065 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2410/4721] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:23 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1489 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:24.182204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b6528934-983a-4c21-a038-6787a9e99a2a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:24.183149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b6528934-983a-4c21-a038-6787a9e99a2a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:24.217679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6528934-983a-4c21-a038-6787a9e99a2a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:24.218199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6528934-983a-4c21-a038-6787a9e99a2a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:24.220912 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6528934-983a-4c21-a038-6787a9e99a2a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:24.221377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6528934-983a-4c21-a038-6787a9e99a2a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:24.892632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-492ee4bd-de1e-448a-9407-a870e97bf6d7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:24.893850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-492ee4bd-de1e-448a-9407-a870e97bf6d7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:24.908411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-492ee4bd-de1e-448a-9407-a870e97bf6d7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:24.910749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-492ee4bd-de1e-448a-9407-a870e97bf6d7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:24.912122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-492ee4bd-de1e-448a-9407-a870e97bf6d7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:24.914937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-492ee4bd-de1e-448a-9407-a870e97bf6d7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:25.316035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b6528934-983a-4c21-a038-6787a9e99a2a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:25.335365 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b6528934-983a-4c21-a038-6787a9e99a2a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1489 microversion: 2.1 time: 1.172727 Aug 03 02:14:25.356955 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2312/4722] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:24 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1489 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:25.362877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5564cc6d-baa8-414e-a670-22faa4e76e22 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:25.364061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5564cc6d-baa8-414e-a670-22faa4e76e22 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:25.395770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5564cc6d-baa8-414e-a670-22faa4e76e22 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:25.397050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5564cc6d-baa8-414e-a670-22faa4e76e22 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:25.400216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5564cc6d-baa8-414e-a670-22faa4e76e22 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:25.400939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5564cc6d-baa8-414e-a670-22faa4e76e22 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:25.482060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-492ee4bd-de1e-448a-9407-a870e97bf6d7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:25.494440 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-492ee4bd-de1e-448a-9407-a870e97bf6d7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1272 microversion: 2.1 time: 0.606203 Aug 03 02:14:25.509119 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2411/4723] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:24 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1272 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:26.186184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5564cc6d-baa8-414e-a670-22faa4e76e22 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:26.199214 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5564cc6d-baa8-414e-a670-22faa4e76e22 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1489 microversion: 2.1 time: 0.839427 Aug 03 02:14:26.212296 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2313/4724] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:25 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1489 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:26.222424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4377b537-be3d-45aa-b7ac-4eef9482ecd5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:26.223611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4377b537-be3d-45aa-b7ac-4eef9482ecd5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:26.233074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4377b537-be3d-45aa-b7ac-4eef9482ecd5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:26.233970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4377b537-be3d-45aa-b7ac-4eef9482ecd5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:26.235055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4377b537-be3d-45aa-b7ac-4eef9482ecd5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:26.235662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4377b537-be3d-45aa-b7ac-4eef9482ecd5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:26.272513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4377b537-be3d-45aa-b7ac-4eef9482ecd5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:14:26.418107 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4377b537-be3d-45aa-b7ac-4eef9482ecd5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 204 len: 0 microversion: 2.1 time: 0.199175 Aug 03 02:14:26.422418 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2412/4725] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:14:26 2022] DELETE /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:14:26.430416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7426ef01-959b-4bd2-b49e-0fa2fc4e8cfb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:26.432059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7426ef01-959b-4bd2-b49e-0fa2fc4e8cfb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:26.440821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7426ef01-959b-4bd2-b49e-0fa2fc4e8cfb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:26.441736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7426ef01-959b-4bd2-b49e-0fa2fc4e8cfb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:26.442998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7426ef01-959b-4bd2-b49e-0fa2fc4e8cfb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:26.445121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7426ef01-959b-4bd2-b49e-0fa2fc4e8cfb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:26.535569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7d9c64f8-968f-47ba-8315-208d0d600989 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:26.536768 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7d9c64f8-968f-47ba-8315-208d0d600989 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:26.546480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d9c64f8-968f-47ba-8315-208d0d600989 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:26.548145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d9c64f8-968f-47ba-8315-208d0d600989 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:26.549433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d9c64f8-968f-47ba-8315-208d0d600989 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:26.550542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d9c64f8-968f-47ba-8315-208d0d600989 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:26.749614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7d9c64f8-968f-47ba-8315-208d0d600989 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:26.765525 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7d9c64f8-968f-47ba-8315-208d0d600989 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1272 microversion: 2.1 time: 0.236347 Aug 03 02:14:26.770243 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2413/4726] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:26 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:26.889549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7426ef01-959b-4bd2-b49e-0fa2fc4e8cfb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:26.902325 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7426ef01-959b-4bd2-b49e-0fa2fc4e8cfb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1495 microversion: 2.1 time: 0.478063 Aug 03 02:14:26.907513 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2314/4727] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:26 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1495 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:27.799680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0838ea44-7060-4005-b7e0-4c93f50fe3d9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:27.801068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0838ea44-7060-4005-b7e0-4c93f50fe3d9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:27.830008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0838ea44-7060-4005-b7e0-4c93f50fe3d9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:27.838393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0838ea44-7060-4005-b7e0-4c93f50fe3d9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:27.847452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0838ea44-7060-4005-b7e0-4c93f50fe3d9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:27.848247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0838ea44-7060-4005-b7e0-4c93f50fe3d9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:27.934655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-897f35a9-2b31-4a83-9713-efece003a8e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:27.940121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-897f35a9-2b31-4a83-9713-efece003a8e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:27.980577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-897f35a9-2b31-4a83-9713-efece003a8e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:27.985146 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-897f35a9-2b31-4a83-9713-efece003a8e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:27.986576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-897f35a9-2b31-4a83-9713-efece003a8e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:28.000943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-897f35a9-2b31-4a83-9713-efece003a8e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:28.076420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0838ea44-7060-4005-b7e0-4c93f50fe3d9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:28.094695 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0838ea44-7060-4005-b7e0-4c93f50fe3d9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1272 microversion: 2.1 time: 0.303725 Aug 03 02:14:28.114891 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2414/4728] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:27 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1272 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:28.998551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-897f35a9-2b31-4a83-9713-efece003a8e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:29.008895 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-897f35a9-2b31-4a83-9713-efece003a8e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1495 microversion: 2.1 time: 1.082787 Aug 03 02:14:29.014727 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2315/4729] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:27 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1495 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:29.123849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-177dafc1-350b-4d83-834a-cde4dccfc947 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:29.124487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-177dafc1-350b-4d83-834a-cde4dccfc947 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:29.140204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-177dafc1-350b-4d83-834a-cde4dccfc947 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:29.143076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-177dafc1-350b-4d83-834a-cde4dccfc947 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:29.145007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-177dafc1-350b-4d83-834a-cde4dccfc947 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:29.147476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-177dafc1-350b-4d83-834a-cde4dccfc947 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:30.039706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-277f9b40-fd05-44da-98ff-f53177289cee tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:30.041290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-277f9b40-fd05-44da-98ff-f53177289cee tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:30.062036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-277f9b40-fd05-44da-98ff-f53177289cee tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:30.065087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-277f9b40-fd05-44da-98ff-f53177289cee tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:30.067951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-277f9b40-fd05-44da-98ff-f53177289cee tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:30.074458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-277f9b40-fd05-44da-98ff-f53177289cee tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:30.586855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-177dafc1-350b-4d83-834a-cde4dccfc947 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:30.596595 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-177dafc1-350b-4d83-834a-cde4dccfc947 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1314 microversion: 2.1 time: 1.477425 Aug 03 02:14:30.597760 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2415/4730] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:29 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1314 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:31.013551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-277f9b40-fd05-44da-98ff-f53177289cee tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:31.016395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:31.030057 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-277f9b40-fd05-44da-98ff-f53177289cee tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 200 len: 1495 microversion: 2.1 time: 0.996169 Aug 03 02:14:31.034682 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2316/4731] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:30 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 1495 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:31.330922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-41d48a33-4912-4e54-89f5-3b354c7d7661 req-d277f834-9cad-4205-8be7-8dd8876792e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999a174f-1170-4039-86a0-8f498b7341c3", "name": "network-vif-deleted", "tag": "ee146b00-8f24-4c07-b300-fbde44441459"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:31.338125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:31.400861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-41d48a33-4912-4e54-89f5-3b354c7d7661 req-d277f834-9cad-4205-8be7-8dd8876792e1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:31.403259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-41d48a33-4912-4e54-89f5-3b354c7d7661 req-d277f834-9cad-4205-8be7-8dd8876792e1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:31.456402 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-41d48a33-4912-4e54-89f5-3b354c7d7661 req-d277f834-9cad-4205-8be7-8dd8876792e1 service nova] Creating event network-vif-deleted:ee146b00-8f24-4c07-b300-fbde44441459 for instance 999a174f-1170-4039-86a0-8f498b7341c3 on n-h1-826529-8 Aug 03 02:14:31.473455 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-41d48a33-4912-4e54-89f5-3b354c7d7661 req-d277f834-9cad-4205-8be7-8dd8876792e1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145737 Aug 03 02:14:31.476204 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2416/4732] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:14:31.619117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7f81b60d-ab9b-4981-be6a-3cb2eb1d3389 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:31.620011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7f81b60d-ab9b-4981-be6a-3cb2eb1d3389 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:31.632341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f81b60d-ab9b-4981-be6a-3cb2eb1d3389 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:31.639354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f81b60d-ab9b-4981-be6a-3cb2eb1d3389 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:31.640481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f81b60d-ab9b-4981-be6a-3cb2eb1d3389 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:31.641076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f81b60d-ab9b-4981-be6a-3cb2eb1d3389 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:32.066529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2377b248-bf77-4dec-93fa-7beb37a87106 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:32.072282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2377b248-bf77-4dec-93fa-7beb37a87106 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:32.090569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:32.095350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2377b248-bf77-4dec-93fa-7beb37a87106 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:32.096659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2377b248-bf77-4dec-93fa-7beb37a87106 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:32.098284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2377b248-bf77-4dec-93fa-7beb37a87106 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:32.100527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2377b248-bf77-4dec-93fa-7beb37a87106 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:32.151351 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-2377b248-bf77-4dec-93fa-7beb37a87106 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2377b248-bf77-4dec-93fa-7beb37a87106 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 HTTP/1.1 Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '999a174f-1170-4039-86a0-8f498b7341c3'} Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:14:32.156418 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:14:32.166358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:14:32.166358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:14:32.166358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:14:32.166358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:14:32.166358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:14:32.166358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. Aug 03 02:14:32.166358 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:14:32.171165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2377b248-bf77-4dec-93fa-7beb37a87106 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:14:32.171165 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2377b248-bf77-4dec-93fa-7beb37a87106 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 404 len: 111 microversion: 2.1 time: 0.117574 Aug 03 02:14:32.176199 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2417/4733] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:32 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:14:32.191888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-56629413-b3bb-4471-826b-4f3073805277 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:32.209412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-56629413-b3bb-4471-826b-4f3073805277 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:32.232296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56629413-b3bb-4471-826b-4f3073805277 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:32.238260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56629413-b3bb-4471-826b-4f3073805277 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:32.241683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56629413-b3bb-4471-826b-4f3073805277 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:32.242488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56629413-b3bb-4471-826b-4f3073805277 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:32.369613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-56629413-b3bb-4471-826b-4f3073805277 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:14:32.463721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:32.552567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:32.613263 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-56629413-b3bb-4471-826b-4f3073805277 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 204 len: 0 microversion: 2.1 time: 0.431816 Aug 03 02:14:32.614206 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2418/4734] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:14:32 2022] DELETE /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:14:32.626408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-84bb0c66-0f80-4110-a20e-9e63e6e4532e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:32.628289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-84bb0c66-0f80-4110-a20e-9e63e6e4532e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:32.643690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84bb0c66-0f80-4110-a20e-9e63e6e4532e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:32.644149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84bb0c66-0f80-4110-a20e-9e63e6e4532e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:32.644939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84bb0c66-0f80-4110-a20e-9e63e6e4532e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:32.645375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84bb0c66-0f80-4110-a20e-9e63e6e4532e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:32.663372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7f81b60d-ab9b-4981-be6a-3cb2eb1d3389 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:32.690964 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7f81b60d-ab9b-4981-be6a-3cb2eb1d3389 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1314 microversion: 2.1 time: 1.073649 Aug 03 02:14:32.692277 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2317/4735] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:31 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1314 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:33.326562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-84bb0c66-0f80-4110-a20e-9e63e6e4532e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:33.335613 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-84bb0c66-0f80-4110-a20e-9e63e6e4532e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1495 microversion: 2.1 time: 0.715572 Aug 03 02:14:33.345473 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2419/4736] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:32 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1495 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:33.716132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-46697da5-6f4d-4a9b-9eac-d2c04f63ee2b req-3471521a-4bf2-4e94-bd1f-3892c5740fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5258d568-7952-4040-8f17-07036a19c06a", "tag": "4b0e94f3-e0c9-45de-ac3f-b4aba0330f65"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:33.737504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e3b17607-320f-4973-95a4-644863ce4cd2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:33.738176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e3b17607-320f-4973-95a4-644863ce4cd2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:33.746864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3b17607-320f-4973-95a4-644863ce4cd2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:33.747419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3b17607-320f-4973-95a4-644863ce4cd2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:33.748302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3b17607-320f-4973-95a4-644863ce4cd2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:33.748742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3b17607-320f-4973-95a4-644863ce4cd2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:33.753176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-46697da5-6f4d-4a9b-9eac-d2c04f63ee2b req-3471521a-4bf2-4e94-bd1f-3892c5740fc2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:33.753848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-46697da5-6f4d-4a9b-9eac-d2c04f63ee2b req-3471521a-4bf2-4e94-bd1f-3892c5740fc2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:33.768432 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-46697da5-6f4d-4a9b-9eac-d2c04f63ee2b req-3471521a-4bf2-4e94-bd1f-3892c5740fc2 service nova] Creating event network-changed:4b0e94f3-e0c9-45de-ac3f-b4aba0330f65 for instance 5258d568-7952-4040-8f17-07036a19c06a on n-h2-826529-8 Aug 03 02:14:33.775735 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-46697da5-6f4d-4a9b-9eac-d2c04f63ee2b req-3471521a-4bf2-4e94-bd1f-3892c5740fc2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063409 Aug 03 02:14:33.776898 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2318/4737] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:14:34.012005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3b17607-320f-4973-95a4-644863ce4cd2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:34.026038 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e3b17607-320f-4973-95a4-644863ce4cd2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1314 microversion: 2.1 time: 0.293477 Aug 03 02:14:34.026633 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2420/4738] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:33 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:34.382619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1919dd53-d283-4a76-b34d-d462ba7e9571 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:34.383294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1919dd53-d283-4a76-b34d-d462ba7e9571 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:34.397097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1919dd53-d283-4a76-b34d-d462ba7e9571 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:34.397097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1919dd53-d283-4a76-b34d-d462ba7e9571 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:34.398069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1919dd53-d283-4a76-b34d-d462ba7e9571 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:34.398861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1919dd53-d283-4a76-b34d-d462ba7e9571 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:35.029651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1919dd53-d283-4a76-b34d-d462ba7e9571 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:35.043681 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1919dd53-d283-4a76-b34d-d462ba7e9571 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1495 microversion: 2.1 time: 0.667232 Aug 03 02:14:35.045702 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2319/4739] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:34 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1495 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:35.061389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a63f954f-8a8d-4323-87d1-8e1e89312e37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:35.062668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a63f954f-8a8d-4323-87d1-8e1e89312e37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:35.071670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a63f954f-8a8d-4323-87d1-8e1e89312e37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:35.072483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a63f954f-8a8d-4323-87d1-8e1e89312e37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:35.073470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a63f954f-8a8d-4323-87d1-8e1e89312e37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:35.074084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a63f954f-8a8d-4323-87d1-8e1e89312e37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:35.938355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1247498281", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "69b64e9a-4561-417b-8cc4-06f6cdef9e73"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:36.005509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:36.086603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] validate_networks() for [('69b64e9a-4561-417b-8cc4-06f6cdef9e73', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:14:37.435405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a63f954f-8a8d-4323-87d1-8e1e89312e37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:37.483369 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a63f954f-8a8d-4323-87d1-8e1e89312e37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1314 microversion: 2.1 time: 2.439420 Aug 03 02:14:37.483989 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2421/4740] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:35 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1314 bytes in 2441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:37.512657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-da6c4f5a-6f8f-47e7-a7d5-96c5356523b3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:37.513944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-da6c4f5a-6f8f-47e7-a7d5-96c5356523b3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:37.524994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da6c4f5a-6f8f-47e7-a7d5-96c5356523b3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:37.526393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da6c4f5a-6f8f-47e7-a7d5-96c5356523b3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:37.527869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da6c4f5a-6f8f-47e7-a7d5-96c5356523b3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:37.528483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da6c4f5a-6f8f-47e7-a7d5-96c5356523b3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:37.704764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-da6c4f5a-6f8f-47e7-a7d5-96c5356523b3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:37.716839 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-da6c4f5a-6f8f-47e7-a7d5-96c5356523b3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 200 len: 1453 microversion: 2.1 time: 0.228982 Aug 03 02:14:37.742276 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2422/4741] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:37 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 1453 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:37.749454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-09addcd0-a04c-4d94-9641-59d517a48206 req-6ba87280-ace1-4899-9356-574e9ebb6947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7030597f-afd4-4953-b80f-2ad5e6974e61", "name": "network-vif-deleted", "tag": "1cd0f785-0d00-4bc1-ad85-157893921bad"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:37.764828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-09addcd0-a04c-4d94-9641-59d517a48206 req-6ba87280-ace1-4899-9356-574e9ebb6947 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:37.766084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-09addcd0-a04c-4d94-9641-59d517a48206 req-6ba87280-ace1-4899-9356-574e9ebb6947 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:37.786433 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-09addcd0-a04c-4d94-9641-59d517a48206 req-6ba87280-ace1-4899-9356-574e9ebb6947 service nova] Creating event network-vif-deleted:1cd0f785-0d00-4bc1-ad85-157893921bad for instance 7030597f-afd4-4953-b80f-2ad5e6974e61 on n-h2-826529-8 Aug 03 02:14:37.796989 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-09addcd0-a04c-4d94-9641-59d517a48206 req-6ba87280-ace1-4899-9356-574e9ebb6947 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052711 Aug 03 02:14:37.800832 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2423/4742] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:14:38.334752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:14:38.336056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:14:38.336724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:14:38.337295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:14:38.337869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:14:38.352116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:38.352116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:38.352116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:38.352116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:38.429333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Getting quotas for project dd9b137660a84e1bb2faa6301d569b57. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:14:38.435829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Getting quotas for user 19e7dbdb6aef40abba7ba06046b87c95 and project dd9b137660a84e1bb2faa6301d569b57. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:14:38.456842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:14:38.460281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:14:38.514741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-85e29f52-5b04-480b-968f-6e44ea88a6c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:38.518694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-85e29f52-5b04-480b-968f-6e44ea88a6c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:38.543455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85e29f52-5b04-480b-968f-6e44ea88a6c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:38.544318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85e29f52-5b04-480b-968f-6e44ea88a6c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:38.545560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85e29f52-5b04-480b-968f-6e44ea88a6c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:38.548832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85e29f52-5b04-480b-968f-6e44ea88a6c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:38.581492 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e85f2c8f-1f41-482c-9e0e-a93c4281392f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.850536 Aug 03 02:14:38.588963 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2320/4743] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:14:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:14:38.621621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5e5b7eae-81ef-4ad3-99ba-f012e4ad0e4f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:38.621621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5e5b7eae-81ef-4ad3-99ba-f012e4ad0e4f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:38.864685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5e5b7eae-81ef-4ad3-99ba-f012e4ad0e4f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:38.879643 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5e5b7eae-81ef-4ad3-99ba-f012e4ad0e4f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1218 microversion: 2.1 time: 0.282165 Aug 03 02:14:38.880230 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2321/4744] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:38 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1218 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:38.888669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8547052d-db57-47e0-9c69-b9327d2a92f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:38.889282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8547052d-db57-47e0-9c69-b9327d2a92f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:38.903321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8547052d-db57-47e0-9c69-b9327d2a92f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:38.903786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8547052d-db57-47e0-9c69-b9327d2a92f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:38.904571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8547052d-db57-47e0-9c69-b9327d2a92f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:38.905012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8547052d-db57-47e0-9c69-b9327d2a92f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:38.934771 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-8547052d-db57-47e0-9c69-b9327d2a92f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8547052d-db57-47e0-9c69-b9327d2a92f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 HTTP/1.1 Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '7030597f-afd4-4953-b80f-2ad5e6974e61'} Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:14:38.947925 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:14:38.953030 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:14:38.953030 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:14:38.953030 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:14:38.953030 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:14:38.953030 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:14:38.953030 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. Aug 03 02:14:38.953030 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:14:38.953030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8547052d-db57-47e0-9c69-b9327d2a92f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:14:38.953030 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8547052d-db57-47e0-9c69-b9327d2a92f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 404 len: 111 microversion: 2.1 time: 0.068050 Aug 03 02:14:38.971383 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2322/4745] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:38 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:14:39.213133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1955172687", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "d26ca69a-a338-40ed-9e04-7c6942285689"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:39.215733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-85e29f52-5b04-480b-968f-6e44ea88a6c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:39.224961 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-85e29f52-5b04-480b-968f-6e44ea88a6c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1314 microversion: 2.1 time: 0.722752 Aug 03 02:14:39.228272 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2424/4746] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:38 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:39.391559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] validate_networks() for [('d26ca69a-a338-40ed-9e04-7c6942285689', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:14:39.921701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9c40e7df-a06b-42ba-9cb6-6e9e6d498332 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:39.923391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9c40e7df-a06b-42ba-9cb6-6e9e6d498332 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:39.943113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c40e7df-a06b-42ba-9cb6-6e9e6d498332 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:39.944360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c40e7df-a06b-42ba-9cb6-6e9e6d498332 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:39.945375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c40e7df-a06b-42ba-9cb6-6e9e6d498332 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:39.946514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c40e7df-a06b-42ba-9cb6-6e9e6d498332 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:40.248157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9c40e7df-a06b-42ba-9cb6-6e9e6d498332 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:40.264003 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9c40e7df-a06b-42ba-9cb6-6e9e6d498332 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1222 microversion: 2.1 time: 0.348263 Aug 03 02:14:40.268494 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2425/4747] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:39 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1222 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:40.286076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4b24920c-d149-4172-a589-df419bec6d96 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:40.288735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4b24920c-d149-4172-a589-df419bec6d96 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:40.322891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b24920c-d149-4172-a589-df419bec6d96 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:40.337035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b24920c-d149-4172-a589-df419bec6d96 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:40.339267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b24920c-d149-4172-a589-df419bec6d96 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:40.340292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b24920c-d149-4172-a589-df419bec6d96 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:40.703485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4b24920c-d149-4172-a589-df419bec6d96 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:40.712456 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4b24920c-d149-4172-a589-df419bec6d96 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1314 microversion: 2.1 time: 0.441859 Aug 03 02:14:40.722532 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2426/4748] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:40 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:41.289445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4192d4b9-8f50-42b8-acc5-bb9f6544fea0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:41.290075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4192d4b9-8f50-42b8-acc5-bb9f6544fea0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:41.305491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4192d4b9-8f50-42b8-acc5-bb9f6544fea0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:41.306291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4192d4b9-8f50-42b8-acc5-bb9f6544fea0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:41.309886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4192d4b9-8f50-42b8-acc5-bb9f6544fea0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:41.310661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4192d4b9-8f50-42b8-acc5-bb9f6544fea0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:41.316350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:14:41.317339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:14:41.318297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:14:41.318948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:14:41.319504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:14:41.347953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:41.348929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:41.350347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:41.351165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:41.421009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:14:41.444964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for user 2721f67579e542718483193be7515d6b and project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:14:41.464400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:14:41.467668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:14:41.594112 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ce9f7e9b-34f1-4d6d-9354-22d4f395ea95 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.382552 Aug 03 02:14:41.595629 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2323/4749] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:14:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 02:14:41.613869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f9bd876e-aafe-463c-9572-7b795185a45c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:41.630070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f9bd876e-aafe-463c-9572-7b795185a45c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:41.707848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4192d4b9-8f50-42b8-acc5-bb9f6544fea0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:41.742675 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4192d4b9-8f50-42b8-acc5-bb9f6544fea0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1276 microversion: 2.1 time: 0.457734 Aug 03 02:14:41.748319 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2427/4750] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:41 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1276 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:41.760455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1fbfdeeb-a062-4fe7-93ce-859edc5dbd76 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:41.766308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1fbfdeeb-a062-4fe7-93ce-859edc5dbd76 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:41.809992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fbfdeeb-a062-4fe7-93ce-859edc5dbd76 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:41.810500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fbfdeeb-a062-4fe7-93ce-859edc5dbd76 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:41.811419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fbfdeeb-a062-4fe7-93ce-859edc5dbd76 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:41.811876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fbfdeeb-a062-4fe7-93ce-859edc5dbd76 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:41.902479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f9bd876e-aafe-463c-9572-7b795185a45c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:41.916112 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f9bd876e-aafe-463c-9572-7b795185a45c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1209 microversion: 2.1 time: 0.313147 Aug 03 02:14:41.923934 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2324/4751] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:41 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1209 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:42.781776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4ab3832b-0b43-4ae5-a4cb-a09837b54586 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:42.782438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4ab3832b-0b43-4ae5-a4cb-a09837b54586 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:42.806946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ab3832b-0b43-4ae5-a4cb-a09837b54586 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:42.807428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ab3832b-0b43-4ae5-a4cb-a09837b54586 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:42.808752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ab3832b-0b43-4ae5-a4cb-a09837b54586 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:42.809214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ab3832b-0b43-4ae5-a4cb-a09837b54586 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:43.141431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1fbfdeeb-a062-4fe7-93ce-859edc5dbd76 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:43.151935 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1fbfdeeb-a062-4fe7-93ce-859edc5dbd76 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1314 microversion: 2.1 time: 1.402308 Aug 03 02:14:43.153619 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2428/4752] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:41 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1314 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:43.155046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4ab3832b-0b43-4ae5-a4cb-a09837b54586 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:43.158749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0705d399-3409-4f7c-a6cf-c0ca7ae16308 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:43.159779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0705d399-3409-4f7c-a6cf-c0ca7ae16308 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:43.166768 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4ab3832b-0b43-4ae5-a4cb-a09837b54586 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1276 microversion: 2.1 time: 0.391678 Aug 03 02:14:43.167917 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0705d399-3409-4f7c-a6cf-c0ca7ae16308 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:43.178949 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2325/4753] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:42 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1276 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:43.179737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0705d399-3409-4f7c-a6cf-c0ca7ae16308 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:43.181220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0705d399-3409-4f7c-a6cf-c0ca7ae16308 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:43.184718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0705d399-3409-4f7c-a6cf-c0ca7ae16308 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:43.448749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0705d399-3409-4f7c-a6cf-c0ca7ae16308 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:43.462248 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0705d399-3409-4f7c-a6cf-c0ca7ae16308 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1261 microversion: 2.1 time: 0.307283 Aug 03 02:14:43.466165 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2429/4754] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:43 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1261 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:44.179327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-64f1b35c-61b1-4ffc-a565-ddcbb3eff118 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:44.180137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-64f1b35c-61b1-4ffc-a565-ddcbb3eff118 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:44.192368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e0d673c0-8008-4480-a9df-0109fd7f2f9d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:44.193608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e0d673c0-8008-4480-a9df-0109fd7f2f9d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:44.212092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0d673c0-8008-4480-a9df-0109fd7f2f9d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:44.212964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64f1b35c-61b1-4ffc-a565-ddcbb3eff118 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:44.215954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0d673c0-8008-4480-a9df-0109fd7f2f9d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:44.216857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64f1b35c-61b1-4ffc-a565-ddcbb3eff118 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:44.218562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64f1b35c-61b1-4ffc-a565-ddcbb3eff118 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:44.219161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0d673c0-8008-4480-a9df-0109fd7f2f9d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:44.220424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0d673c0-8008-4480-a9df-0109fd7f2f9d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:44.221160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64f1b35c-61b1-4ffc-a565-ddcbb3eff118 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:45.404846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e0d673c0-8008-4480-a9df-0109fd7f2f9d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:45.422869 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e0d673c0-8008-4480-a9df-0109fd7f2f9d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1318 microversion: 2.1 time: 1.234251 Aug 03 02:14:45.424194 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2430/4755] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:44 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1318 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:45.430395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-23df191e-811c-4209-a7b3-d8aeaa2d940c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:45.431355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-23df191e-811c-4209-a7b3-d8aeaa2d940c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:45.444368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23df191e-811c-4209-a7b3-d8aeaa2d940c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:45.445255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23df191e-811c-4209-a7b3-d8aeaa2d940c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:45.447207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23df191e-811c-4209-a7b3-d8aeaa2d940c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:45.447849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23df191e-811c-4209-a7b3-d8aeaa2d940c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:45.532555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-64f1b35c-61b1-4ffc-a565-ddcbb3eff118 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:45.571828 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-64f1b35c-61b1-4ffc-a565-ddcbb3eff118 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1314 microversion: 2.1 time: 1.398163 Aug 03 02:14:45.572768 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2326/4756] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:44 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1314 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:45.587541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-dda65449-2723-4588-a08b-25cccfa86ea3 req-2f1930ee-857b-4cfe-95bd-5bbc0473f270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5258d568-7952-4040-8f17-07036a19c06a", "name": "network-vif-plugged", "status": "completed", "tag": "4b0e94f3-e0c9-45de-ac3f-b4aba0330f65"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:45.610220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-dda65449-2723-4588-a08b-25cccfa86ea3 req-2f1930ee-857b-4cfe-95bd-5bbc0473f270 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:45.610974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-dda65449-2723-4588-a08b-25cccfa86ea3 req-2f1930ee-857b-4cfe-95bd-5bbc0473f270 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:45.637829 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-dda65449-2723-4588-a08b-25cccfa86ea3 req-2f1930ee-857b-4cfe-95bd-5bbc0473f270 service nova] Creating event network-vif-plugged:4b0e94f3-e0c9-45de-ac3f-b4aba0330f65 for instance 5258d568-7952-4040-8f17-07036a19c06a on n-h2-826529-8 Aug 03 02:14:45.647564 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-dda65449-2723-4588-a08b-25cccfa86ea3 req-2f1930ee-857b-4cfe-95bd-5bbc0473f270 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072409 Aug 03 02:14:45.651597 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2327/4757] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:14:45.723155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-23df191e-811c-4209-a7b3-d8aeaa2d940c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:45.734831 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-23df191e-811c-4209-a7b3-d8aeaa2d940c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1267 microversion: 2.1 time: 0.309171 Aug 03 02:14:45.742588 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2431/4758] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:45 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:46.450566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0499415a-7634-4846-8af6-bd2efde47499 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:46.452338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0499415a-7634-4846-8af6-bd2efde47499 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:46.475470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0499415a-7634-4846-8af6-bd2efde47499 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:46.479735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0499415a-7634-4846-8af6-bd2efde47499 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:46.484117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0499415a-7634-4846-8af6-bd2efde47499 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:46.484980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0499415a-7634-4846-8af6-bd2efde47499 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:46.596088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a51bd18e-2620-4213-9954-bccc4452dfca tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:46.596714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a51bd18e-2620-4213-9954-bccc4452dfca tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:46.617670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a51bd18e-2620-4213-9954-bccc4452dfca tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:46.618124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a51bd18e-2620-4213-9954-bccc4452dfca tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:46.618951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a51bd18e-2620-4213-9954-bccc4452dfca tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:46.619378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a51bd18e-2620-4213-9954-bccc4452dfca tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:47.147768 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a51bd18e-2620-4213-9954-bccc4452dfca tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:47.161400 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a51bd18e-2620-4213-9954-bccc4452dfca tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1314 microversion: 2.1 time: 0.569436 Aug 03 02:14:47.173496 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2432/4759] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:46 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:47.178032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2d698e14-536a-46f3-8da5-863b3a9f13f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:47.179576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2d698e14-536a-46f3-8da5-863b3a9f13f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:47.198601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d698e14-536a-46f3-8da5-863b3a9f13f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:47.199539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d698e14-536a-46f3-8da5-863b3a9f13f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:47.203001 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d698e14-536a-46f3-8da5-863b3a9f13f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:47.204025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d698e14-536a-46f3-8da5-863b3a9f13f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:47.314536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0499415a-7634-4846-8af6-bd2efde47499 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:47.341691 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0499415a-7634-4846-8af6-bd2efde47499 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1318 microversion: 2.1 time: 0.900216 Aug 03 02:14:47.345280 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2328/4760] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:46 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1318 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:47.404119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-9189fdbc-40d2-4b45-aa36-cb0a61082030 req-b825fdd5-ff46-480b-b6ee-75ffa74cf297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fab028e-e051-4211-8db2-a9b9c38481f3", "tag": "318b5b96-bc6c-430f-a6ca-ed4d571d1267"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:47.428721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9189fdbc-40d2-4b45-aa36-cb0a61082030 req-b825fdd5-ff46-480b-b6ee-75ffa74cf297 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:47.429200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9189fdbc-40d2-4b45-aa36-cb0a61082030 req-b825fdd5-ff46-480b-b6ee-75ffa74cf297 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:47.465112 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-9189fdbc-40d2-4b45-aa36-cb0a61082030 req-b825fdd5-ff46-480b-b6ee-75ffa74cf297 service nova] Creating event network-changed:318b5b96-bc6c-430f-a6ca-ed4d571d1267 for instance 4fab028e-e051-4211-8db2-a9b9c38481f3 on n-h1-826529-8 Aug 03 02:14:47.480444 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-9189fdbc-40d2-4b45-aa36-cb0a61082030 req-b825fdd5-ff46-480b-b6ee-75ffa74cf297 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080725 Aug 03 02:14:47.481285 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2329/4761] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:14:47.764010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2d698e14-536a-46f3-8da5-863b3a9f13f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:47.779864 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2d698e14-536a-46f3-8da5-863b3a9f13f3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1309 microversion: 2.1 time: 0.613235 Aug 03 02:14:47.780475 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2433/4762] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:47 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1309 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:48.184603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4b5279d9-79b8-4e6e-ac94-6fc6d7ee4cfd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:48.186128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4b5279d9-79b8-4e6e-ac94-6fc6d7ee4cfd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:48.193976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b5279d9-79b8-4e6e-ac94-6fc6d7ee4cfd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:48.194800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b5279d9-79b8-4e6e-ac94-6fc6d7ee4cfd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:48.196423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b5279d9-79b8-4e6e-ac94-6fc6d7ee4cfd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:48.197130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b5279d9-79b8-4e6e-ac94-6fc6d7ee4cfd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:48.366277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f8404f3d-3da2-45b4-823f-e2105224673f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:48.367204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f8404f3d-3da2-45b4-823f-e2105224673f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:48.388825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8404f3d-3da2-45b4-823f-e2105224673f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:48.390510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8404f3d-3da2-45b4-823f-e2105224673f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:48.391670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8404f3d-3da2-45b4-823f-e2105224673f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:48.392161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8404f3d-3da2-45b4-823f-e2105224673f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:48.419271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4b5279d9-79b8-4e6e-ac94-6fc6d7ee4cfd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:48.435662 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4b5279d9-79b8-4e6e-ac94-6fc6d7ee4cfd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1501 microversion: 2.1 time: 0.253393 Aug 03 02:14:48.436306 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2330/4763] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:48 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1501 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:48.459424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2f1ef531-38eb-402c-a36b-fb561390c421 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:48.459998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2f1ef531-38eb-402c-a36b-fb561390c421 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:48.477937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f1ef531-38eb-402c-a36b-fb561390c421 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:48.479751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f1ef531-38eb-402c-a36b-fb561390c421 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:48.481057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f1ef531-38eb-402c-a36b-fb561390c421 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:48.481686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f1ef531-38eb-402c-a36b-fb561390c421 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:48.639400 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2f1ef531-38eb-402c-a36b-fb561390c421 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a/action" status: 202 len: 0 microversion: 2.1 time: 0.184630 Aug 03 02:14:48.640997 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2331/4764] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:14:48 2022] POST /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:14:48.651556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ccc7f942-56ff-492b-a2ed-75114d06996e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:48.652296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ccc7f942-56ff-492b-a2ed-75114d06996e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:48.660985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ccc7f942-56ff-492b-a2ed-75114d06996e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:48.662272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ccc7f942-56ff-492b-a2ed-75114d06996e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:48.663384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ccc7f942-56ff-492b-a2ed-75114d06996e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:48.664214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ccc7f942-56ff-492b-a2ed-75114d06996e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:48.735547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f8404f3d-3da2-45b4-823f-e2105224673f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:48.740117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:48.752894 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f8404f3d-3da2-45b4-823f-e2105224673f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1318 microversion: 2.1 time: 0.390802 Aug 03 02:14:48.756497 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2434/4765] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:48 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:48.804993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dfaac631-15e4-4fef-bf8b-9c699aa97644 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:48.805680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dfaac631-15e4-4fef-bf8b-9c699aa97644 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:48.826361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfaac631-15e4-4fef-bf8b-9c699aa97644 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:48.826812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfaac631-15e4-4fef-bf8b-9c699aa97644 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:48.827646 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfaac631-15e4-4fef-bf8b-9c699aa97644 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:48.828088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfaac631-15e4-4fef-bf8b-9c699aa97644 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:49.103772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ccc7f942-56ff-492b-a2ed-75114d06996e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:49.117685 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ccc7f942-56ff-492b-a2ed-75114d06996e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1506 microversion: 2.1 time: 0.472556 Aug 03 02:14:49.118597 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2332/4766] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:48 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:49.362638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dfaac631-15e4-4fef-bf8b-9c699aa97644 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:49.371627 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dfaac631-15e4-4fef-bf8b-9c699aa97644 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1309 microversion: 2.1 time: 0.570803 Aug 03 02:14:49.387245 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2435/4767] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:48 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1309 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:49.784021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9e2da134-9a11-4c40-8138-3c63991d3936 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:49.785471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9e2da134-9a11-4c40-8138-3c63991d3936 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:49.799130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e2da134-9a11-4c40-8138-3c63991d3936 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:49.800299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e2da134-9a11-4c40-8138-3c63991d3936 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:49.801249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e2da134-9a11-4c40-8138-3c63991d3936 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:49.801808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e2da134-9a11-4c40-8138-3c63991d3936 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:50.171824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-aa217fcd-fe3e-41aa-8916-f8cc7a36d613 req-c241d74c-97b5-4479-af4f-a31474e74b39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f048d8ef-2daf-421d-b5b6-e75402c0251d", "tag": "780ba778-0b96-4290-9f20-7aa99aed29fd"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:50.200930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-aa217fcd-fe3e-41aa-8916-f8cc7a36d613 req-c241d74c-97b5-4479-af4f-a31474e74b39 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:50.201396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-aa217fcd-fe3e-41aa-8916-f8cc7a36d613 req-c241d74c-97b5-4479-af4f-a31474e74b39 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:50.235908 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-aa217fcd-fe3e-41aa-8916-f8cc7a36d613 req-c241d74c-97b5-4479-af4f-a31474e74b39 service nova] Creating event network-changed:780ba778-0b96-4290-9f20-7aa99aed29fd for instance f048d8ef-2daf-421d-b5b6-e75402c0251d on n-h1-826529-8 Aug 03 02:14:50.244999 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-aa217fcd-fe3e-41aa-8916-f8cc7a36d613 req-c241d74c-97b5-4479-af4f-a31474e74b39 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272404 Aug 03 02:14:50.250622 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2436/4768] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:14:50.262710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a2df53c6-74e7-4678-b22c-953a756fc026 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:50.267585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a2df53c6-74e7-4678-b22c-953a756fc026 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:50.296058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2df53c6-74e7-4678-b22c-953a756fc026 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:50.296976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2df53c6-74e7-4678-b22c-953a756fc026 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:50.297998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2df53c6-74e7-4678-b22c-953a756fc026 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:50.298760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2df53c6-74e7-4678-b22c-953a756fc026 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:50.479256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9e2da134-9a11-4c40-8138-3c63991d3936 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:50.488694 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9e2da134-9a11-4c40-8138-3c63991d3936 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1318 microversion: 2.1 time: 0.708674 Aug 03 02:14:50.491850 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2333/4769] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:49 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1318 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:50.515492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93d931a9-2df8-4822-a3c5-35870459f4b2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:50.516431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93d931a9-2df8-4822-a3c5-35870459f4b2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:50.524804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d931a9-2df8-4822-a3c5-35870459f4b2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:50.525507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d931a9-2df8-4822-a3c5-35870459f4b2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:50.526543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d931a9-2df8-4822-a3c5-35870459f4b2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:50.527266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d931a9-2df8-4822-a3c5-35870459f4b2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:50.823906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a2df53c6-74e7-4678-b22c-953a756fc026 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:50.843409 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a2df53c6-74e7-4678-b22c-953a756fc026 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1486 microversion: 2.1 time: 0.585656 Aug 03 02:14:50.845629 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2437/4770] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:50 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1486 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:50.869936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c29b0dc8-cfba-4e95-b9c9-52dce45b27be tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:50.870763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c29b0dc8-cfba-4e95-b9c9-52dce45b27be tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:50.884823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c29b0dc8-cfba-4e95-b9c9-52dce45b27be tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:50.885713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c29b0dc8-cfba-4e95-b9c9-52dce45b27be tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:50.898457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c29b0dc8-cfba-4e95-b9c9-52dce45b27be tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:50.899762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c29b0dc8-cfba-4e95-b9c9-52dce45b27be tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:50.946331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-c29b0dc8-cfba-4e95-b9c9-52dce45b27be tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lazy-loading 'flavor' on Instance uuid 5258d568-7952-4040-8f17-07036a19c06a {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:14:51.279704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-93d931a9-2df8-4822-a3c5-35870459f4b2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:51.297619 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93d931a9-2df8-4822-a3c5-35870459f4b2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1309 microversion: 2.1 time: 0.785421 Aug 03 02:14:51.301588 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2334/4771] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:50 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1309 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:51.331194 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c29b0dc8-cfba-4e95-b9c9-52dce45b27be tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a/action" status: 202 len: 0 microversion: 2.1 time: 0.465791 Aug 03 02:14:51.334388 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2438/4772] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:14:50 2022] POST /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 02:14:51.348357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fec33bb0-a81a-441b-bf48-fe9bf8d25ef6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:51.350965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fec33bb0-a81a-441b-bf48-fe9bf8d25ef6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:51.366045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fec33bb0-a81a-441b-bf48-fe9bf8d25ef6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:51.366776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fec33bb0-a81a-441b-bf48-fe9bf8d25ef6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:51.370051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fec33bb0-a81a-441b-bf48-fe9bf8d25ef6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:51.371231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fec33bb0-a81a-441b-bf48-fe9bf8d25ef6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:51.391380 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:51.514671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7c2e4e75-942a-4aa1-a7bd-a9ca40de1b9a tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:51.515425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7c2e4e75-942a-4aa1-a7bd-a9ca40de1b9a tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:51.532264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c2e4e75-942a-4aa1-a7bd-a9ca40de1b9a tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:51.533244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c2e4e75-942a-4aa1-a7bd-a9ca40de1b9a tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:51.534207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c2e4e75-942a-4aa1-a7bd-a9ca40de1b9a tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:51.534814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c2e4e75-942a-4aa1-a7bd-a9ca40de1b9a tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:51.908277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=16 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:52.033536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fec33bb0-a81a-441b-bf48-fe9bf8d25ef6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:52.042682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7c2e4e75-942a-4aa1-a7bd-a9ca40de1b9a tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:52.048131 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fec33bb0-a81a-441b-bf48-fe9bf8d25ef6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1492 microversion: 2.1 time: 0.709294 Aug 03 02:14:52.048951 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2335/4773] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:51 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1492 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:52.059639 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7c2e4e75-942a-4aa1-a7bd-a9ca40de1b9a tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1318 microversion: 2.1 time: 0.548272 Aug 03 02:14:52.070926 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2439/4774] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:51 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:52.327586 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-43c05d63-e1aa-4693-8f6c-8f111830fd09 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:52.328811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-43c05d63-e1aa-4693-8f6c-8f111830fd09 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:52.346897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43c05d63-e1aa-4693-8f6c-8f111830fd09 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:52.347419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43c05d63-e1aa-4693-8f6c-8f111830fd09 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:52.348243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43c05d63-e1aa-4693-8f6c-8f111830fd09 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:52.348948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43c05d63-e1aa-4693-8f6c-8f111830fd09 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:53.086605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-48feb39f-1932-4639-9497-5855fb4ebd90 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:53.087267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-48feb39f-1932-4639-9497-5855fb4ebd90 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:53.103888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48feb39f-1932-4639-9497-5855fb4ebd90 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:53.104346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48feb39f-1932-4639-9497-5855fb4ebd90 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:53.105308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48feb39f-1932-4639-9497-5855fb4ebd90 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:53.105753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48feb39f-1932-4639-9497-5855fb4ebd90 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:53.584189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-43c05d63-e1aa-4693-8f6c-8f111830fd09 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:53.597451 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-43c05d63-e1aa-4693-8f6c-8f111830fd09 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1309 microversion: 2.1 time: 1.275361 Aug 03 02:14:53.599368 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2336/4775] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:52 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1309 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:53.610029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-411d8149-1904-4946-9eef-7ebb90e784e8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:53.611185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-411d8149-1904-4946-9eef-7ebb90e784e8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:53.632136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-411d8149-1904-4946-9eef-7ebb90e784e8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:53.632915 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-411d8149-1904-4946-9eef-7ebb90e784e8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:53.633934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-411d8149-1904-4946-9eef-7ebb90e784e8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:53.634939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-411d8149-1904-4946-9eef-7ebb90e784e8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:53.781683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-48feb39f-1932-4639-9497-5855fb4ebd90 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:53.803044 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-48feb39f-1932-4639-9497-5855fb4ebd90 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1318 microversion: 2.1 time: 0.720349 Aug 03 02:14:53.807984 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2440/4776] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:53 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1318 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:54.197768 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f1d07e5a-7db0-4bef-8829-8768e46b2e2f req-43ef4be2-07fe-4b98-a396-9f76a52275c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fab028e-e051-4211-8db2-a9b9c38481f3", "name": "network-vif-plugged", "status": "completed", "tag": "318b5b96-bc6c-430f-a6ca-ed4d571d1267"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:54.198459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-411d8149-1904-4946-9eef-7ebb90e784e8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:54.210245 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-411d8149-1904-4946-9eef-7ebb90e784e8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1513 microversion: 2.1 time: 0.609453 Aug 03 02:14:54.211140 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2337/4777] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:53 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1513 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:54.227675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f1d07e5a-7db0-4bef-8829-8768e46b2e2f req-43ef4be2-07fe-4b98-a396-9f76a52275c3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:54.228361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f1d07e5a-7db0-4bef-8829-8768e46b2e2f req-43ef4be2-07fe-4b98-a396-9f76a52275c3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:54.272250 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f1d07e5a-7db0-4bef-8829-8768e46b2e2f req-43ef4be2-07fe-4b98-a396-9f76a52275c3 service nova] Creating event network-vif-plugged:318b5b96-bc6c-430f-a6ca-ed4d571d1267 for instance 4fab028e-e051-4211-8db2-a9b9c38481f3 on n-h1-826529-8 Aug 03 02:14:54.296602 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f1d07e5a-7db0-4bef-8829-8768e46b2e2f req-43ef4be2-07fe-4b98-a396-9f76a52275c3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100174 Aug 03 02:14:54.311457 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2441/4778] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:14:54.626312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-786b978c-6692-4b6c-a350-15294aac4027 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:54.626966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-786b978c-6692-4b6c-a350-15294aac4027 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:54.640942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-786b978c-6692-4b6c-a350-15294aac4027 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:54.641525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-786b978c-6692-4b6c-a350-15294aac4027 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:54.642347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-786b978c-6692-4b6c-a350-15294aac4027 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:54.642797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-786b978c-6692-4b6c-a350-15294aac4027 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:54.713091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:14:54.834714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4390e469-6227-4d65-bf20-8aa1d7ff0090 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:54.835774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4390e469-6227-4d65-bf20-8aa1d7ff0090 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:54.864495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4390e469-6227-4d65-bf20-8aa1d7ff0090 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:54.867530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4390e469-6227-4d65-bf20-8aa1d7ff0090 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:54.872776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4390e469-6227-4d65-bf20-8aa1d7ff0090 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:54.874627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4390e469-6227-4d65-bf20-8aa1d7ff0090 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:55.267540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-786b978c-6692-4b6c-a350-15294aac4027 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:55.291238 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-786b978c-6692-4b6c-a350-15294aac4027 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1309 microversion: 2.1 time: 0.668197 Aug 03 02:14:55.293154 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2338/4779] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:54 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1309 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:55.319785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-66937a29-7d4e-40ef-b852-c543f92ca79f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:55.320476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-66937a29-7d4e-40ef-b852-c543f92ca79f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:55.351663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66937a29-7d4e-40ef-b852-c543f92ca79f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:55.352138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66937a29-7d4e-40ef-b852-c543f92ca79f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:55.356998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66937a29-7d4e-40ef-b852-c543f92ca79f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:55.357477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66937a29-7d4e-40ef-b852-c543f92ca79f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:55.738027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4390e469-6227-4d65-bf20-8aa1d7ff0090 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:55.756472 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4390e469-6227-4d65-bf20-8aa1d7ff0090 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1318 microversion: 2.1 time: 0.923829 Aug 03 02:14:55.756700 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2442/4780] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:54 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1318 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:56.071643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-66937a29-7d4e-40ef-b852-c543f92ca79f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:56.111439 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-66937a29-7d4e-40ef-b852-c543f92ca79f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 0.815278 Aug 03 02:14:56.115691 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2339/4781] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:55 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:56.321869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9ecc81be-88ac-4bd7-80b2-eba6534bbc50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:56.333919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9ecc81be-88ac-4bd7-80b2-eba6534bbc50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:56.386933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ecc81be-88ac-4bd7-80b2-eba6534bbc50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:56.395305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ecc81be-88ac-4bd7-80b2-eba6534bbc50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:56.403572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ecc81be-88ac-4bd7-80b2-eba6534bbc50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:56.407963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ecc81be-88ac-4bd7-80b2-eba6534bbc50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:56.780898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-64684d7a-03ad-4731-aab3-567fe28acf8d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:56.781528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-64684d7a-03ad-4731-aab3-567fe28acf8d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:56.791128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64684d7a-03ad-4731-aab3-567fe28acf8d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:56.791586 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64684d7a-03ad-4731-aab3-567fe28acf8d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:56.797894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64684d7a-03ad-4731-aab3-567fe28acf8d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:56.799829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64684d7a-03ad-4731-aab3-567fe28acf8d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:57.521773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9ecc81be-88ac-4bd7-80b2-eba6534bbc50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:57.533474 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9ecc81be-88ac-4bd7-80b2-eba6534bbc50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1309 microversion: 2.1 time: 1.219178 Aug 03 02:14:57.536735 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2443/4782] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:56 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1309 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:57.544468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e24b4ba6-d832-4b40-8eb3-26a3126f168f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:57.551411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e24b4ba6-d832-4b40-8eb3-26a3126f168f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:57.568587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e24b4ba6-d832-4b40-8eb3-26a3126f168f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:57.569157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e24b4ba6-d832-4b40-8eb3-26a3126f168f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:57.571803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e24b4ba6-d832-4b40-8eb3-26a3126f168f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:57.572320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e24b4ba6-d832-4b40-8eb3-26a3126f168f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:57.609955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-64684d7a-03ad-4731-aab3-567fe28acf8d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:57.622846 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-64684d7a-03ad-4731-aab3-567fe28acf8d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1508 microversion: 2.1 time: 0.845855 Aug 03 02:14:57.635521 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2340/4783] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:56 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1508 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:57.650828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ea76cc27-731c-40aa-8869-00380f122d08 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:57.653950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ea76cc27-731c-40aa-8869-00380f122d08 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:57.671231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ea76cc27-731c-40aa-8869-00380f122d08 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:57.671710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ea76cc27-731c-40aa-8869-00380f122d08 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:57.674363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ea76cc27-731c-40aa-8869-00380f122d08 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:57.674830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ea76cc27-731c-40aa-8869-00380f122d08 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:58.956540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ea76cc27-731c-40aa-8869-00380f122d08 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:58.963005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e24b4ba6-d832-4b40-8eb3-26a3126f168f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:58.971403 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ea76cc27-731c-40aa-8869-00380f122d08 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1508 microversion: 2.1 time: 1.325987 Aug 03 02:14:58.972015 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2341/4784] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:57 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1508 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:14:58.975239 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e24b4ba6-d832-4b40-8eb3-26a3126f168f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 1.437165 Aug 03 02:14:58.982121 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2444/4785] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:57 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:59.007580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-17450ac3-dbc8-4e1b-b98e-62c327a1bbbc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:59.008372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-17450ac3-dbc8-4e1b-b98e-62c327a1bbbc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:59.027900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-576ea9d9-1e0b-47dd-b096-d9d8cb1f2d9b req-e16e3977-dea6-4080-b390-c132a9968787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5258d568-7952-4040-8f17-07036a19c06a", "name": "network-vif-plugged", "status": "completed", "tag": "4b0e94f3-e0c9-45de-ac3f-b4aba0330f65"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:59.032813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17450ac3-dbc8-4e1b-b98e-62c327a1bbbc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:59.033281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17450ac3-dbc8-4e1b-b98e-62c327a1bbbc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:59.034090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17450ac3-dbc8-4e1b-b98e-62c327a1bbbc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:59.034534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17450ac3-dbc8-4e1b-b98e-62c327a1bbbc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:59.085213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-576ea9d9-1e0b-47dd-b096-d9d8cb1f2d9b req-e16e3977-dea6-4080-b390-c132a9968787 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:59.086136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-576ea9d9-1e0b-47dd-b096-d9d8cb1f2d9b req-e16e3977-dea6-4080-b390-c132a9968787 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:59.106212 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-576ea9d9-1e0b-47dd-b096-d9d8cb1f2d9b req-e16e3977-dea6-4080-b390-c132a9968787 service nova] Creating event network-vif-plugged:4b0e94f3-e0c9-45de-ac3f-b4aba0330f65 for instance 5258d568-7952-4040-8f17-07036a19c06a on n-h2-826529-8 Aug 03 02:14:59.113675 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-576ea9d9-1e0b-47dd-b096-d9d8cb1f2d9b req-e16e3977-dea6-4080-b390-c132a9968787 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129727 Aug 03 02:14:59.115675 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2445/4786] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:14:59.124127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "OS-DCF:diskConfig": "AUTO"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:14:59.125798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:59.134605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:59.135349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:59.136606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:59.137580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:59.279665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:14:59.280588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:14:59.281953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:14:59.286645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:14:59.287560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:14:59.423576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:59.452775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-17450ac3-dbc8-4e1b-b98e-62c327a1bbbc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:14:59.463521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:59.466115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:59.470051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:59.472438 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-17450ac3-dbc8-4e1b-b98e-62c327a1bbbc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1309 microversion: 2.1 time: 0.481369 Aug 03 02:14:59.473412 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2342/4787] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:58 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1309 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:14:59.476466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:59.624950 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fff6ef10-3461-4f01-8f1d-823be198a9c0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "POST /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3/action" status: 202 len: 1110 microversion: 2.1 time: 0.506164 Aug 03 02:14:59.626033 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2446/4788] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:14:59 2022] POST /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3/action => generated 1110 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 03 02:14:59.646459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69e691dc-915f-405c-8a51-7338570e1b31 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:14:59.647138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-69e691dc-915f-405c-8a51-7338570e1b31 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:14:59.658508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69e691dc-915f-405c-8a51-7338570e1b31 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:59.660692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69e691dc-915f-405c-8a51-7338570e1b31 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:14:59.665690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69e691dc-915f-405c-8a51-7338570e1b31 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:14:59.666745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69e691dc-915f-405c-8a51-7338570e1b31 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:00.018035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31778557-74c2-4b55-8f74-1150b117516e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:00.019940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-31778557-74c2-4b55-8f74-1150b117516e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:00.030003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31778557-74c2-4b55-8f74-1150b117516e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:00.030831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31778557-74c2-4b55-8f74-1150b117516e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:00.032158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31778557-74c2-4b55-8f74-1150b117516e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:00.032895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31778557-74c2-4b55-8f74-1150b117516e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:00.403048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-69e691dc-915f-405c-8a51-7338570e1b31 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:00.417431 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-69e691dc-915f-405c-8a51-7338570e1b31 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 0.774185 Aug 03 02:15:00.418999 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2343/4789] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:14:59 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:00.557637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-31778557-74c2-4b55-8f74-1150b117516e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:00.569730 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-31778557-74c2-4b55-8f74-1150b117516e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 0.565173 Aug 03 02:15:00.570662 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2447/4790] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:00 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:00.587793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-effee22e-2484-412c-a2c5-b629a916f3e9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:00.588783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-effee22e-2484-412c-a2c5-b629a916f3e9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:00.606454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-effee22e-2484-412c-a2c5-b629a916f3e9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:00.607480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-effee22e-2484-412c-a2c5-b629a916f3e9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:00.608610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-effee22e-2484-412c-a2c5-b629a916f3e9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:00.612491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-effee22e-2484-412c-a2c5-b629a916f3e9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:01.178656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3b6108be-5126-4c8c-8a1e-e392d4ae467c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'create', calling method: .version_select at 0x7f5b1249e040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-312773581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKElowXWQYGRzgJ18vQzpPVIagjXA3f2a4jaaftn83E/H27T1kWs6RHCMh61VHcOStlGb0GO/YbwDlgrcU1c11B7ZTOBxCACdHkN13B/6OapL0wRgfDNrrQJFjLIBTib8A=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:01.208893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3b6108be-5126-4c8c-8a1e-e392d4ae467c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for project f6179959e78b438cb68680f694190a8c. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:15:01.218334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-3b6108be-5126-4c8c-8a1e-e392d4ae467c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for user adca21bc340d440e91e4d856a625cd3a and project f6179959e78b438cb68680f694190a8c. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:15:01.268267 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3b6108be-5126-4c8c-8a1e-e392d4ae467c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.847857 Aug 03 02:15:01.269232 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2344/4791] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:15:00 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:15:01.295487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-435ee0d4-c4c6-46c0-b5ce-2dcea3c83664 req-d3c4a4b3-fe07-4a0d-8bba-bab4eb3aed79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f048d8ef-2daf-421d-b5b6-e75402c0251d", "name": "network-vif-plugged", "status": "completed", "tag": "780ba778-0b96-4290-9f20-7aa99aed29fd"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:01.320176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-435ee0d4-c4c6-46c0-b5ce-2dcea3c83664 req-d3c4a4b3-fe07-4a0d-8bba-bab4eb3aed79 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:01.321012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-435ee0d4-c4c6-46c0-b5ce-2dcea3c83664 req-d3c4a4b3-fe07-4a0d-8bba-bab4eb3aed79 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:01.349518 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-435ee0d4-c4c6-46c0-b5ce-2dcea3c83664 req-d3c4a4b3-fe07-4a0d-8bba-bab4eb3aed79 service nova] Creating event network-vif-plugged:780ba778-0b96-4290-9f20-7aa99aed29fd for instance f048d8ef-2daf-421d-b5b6-e75402c0251d on n-h1-826529-8 Aug 03 02:15:01.395213 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-435ee0d4-c4c6-46c0-b5ce-2dcea3c83664 req-d3c4a4b3-fe07-4a0d-8bba-bab4eb3aed79 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106712 Aug 03 02:15:01.398257 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2345/4792] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:15:01.445007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93d34bcb-2be3-44ef-8fc5-587ecedce3b4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:01.445744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93d34bcb-2be3-44ef-8fc5-587ecedce3b4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:01.456929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d34bcb-2be3-44ef-8fc5-587ecedce3b4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:01.457424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d34bcb-2be3-44ef-8fc5-587ecedce3b4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:01.458485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d34bcb-2be3-44ef-8fc5-587ecedce3b4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:01.458863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d34bcb-2be3-44ef-8fc5-587ecedce3b4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:02.013193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-effee22e-2484-412c-a2c5-b629a916f3e9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:02.035342 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-effee22e-2484-412c-a2c5-b629a916f3e9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1309 microversion: 2.1 time: 1.452084 Aug 03 02:15:02.037746 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2448/4793] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:00 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1309 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:02.063396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bf08cb37-5492-4389-b00e-9d76933e3c37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:02.064105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bf08cb37-5492-4389-b00e-9d76933e3c37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:02.075392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:02.088379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bf08cb37-5492-4389-b00e-9d76933e3c37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:02.089313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bf08cb37-5492-4389-b00e-9d76933e3c37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:02.091895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bf08cb37-5492-4389-b00e-9d76933e3c37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:02.092839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bf08cb37-5492-4389-b00e-9d76933e3c37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:02.141422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:02.312595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-93d34bcb-2be3-44ef-8fc5-587ecedce3b4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:02.335059 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93d34bcb-2be3-44ef-8fc5-587ecedce3b4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 0.890455 Aug 03 02:15:02.337343 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2346/4794] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:01 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:02.842008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bf08cb37-5492-4389-b00e-9d76933e3c37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:02.859320 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bf08cb37-5492-4389-b00e-9d76933e3c37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 0.820071 Aug 03 02:15:02.863371 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2449/4795] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:02 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:03.061544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3c549d7b-7123-4836-89da-f30c90a4e85a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:03.063020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3c549d7b-7123-4836-89da-f30c90a4e85a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:03.077445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c549d7b-7123-4836-89da-f30c90a4e85a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:03.078285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c549d7b-7123-4836-89da-f30c90a4e85a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:03.080245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c549d7b-7123-4836-89da-f30c90a4e85a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:03.082704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c549d7b-7123-4836-89da-f30c90a4e85a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:03.356410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3c549d7b-7123-4836-89da-f30c90a4e85a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:03.362571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-da156810-5f7b-46b9-9f43-1c6c5b81b10b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:03.368120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-da156810-5f7b-46b9-9f43-1c6c5b81b10b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:03.379075 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3c549d7b-7123-4836-89da-f30c90a4e85a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1489 microversion: 2.1 time: 0.321929 Aug 03 02:15:03.380930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da156810-5f7b-46b9-9f43-1c6c5b81b10b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:03.381586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da156810-5f7b-46b9-9f43-1c6c5b81b10b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:03.382743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da156810-5f7b-46b9-9f43-1c6c5b81b10b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:03.383442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da156810-5f7b-46b9-9f43-1c6c5b81b10b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:03.398646 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2347/4796] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:03 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1489 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:03.413420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3b78b166-f944-4098-99e8-5611e330d478 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:03.419730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3b78b166-f944-4098-99e8-5611e330d478 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:03.448133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b78b166-f944-4098-99e8-5611e330d478 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:03.449212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b78b166-f944-4098-99e8-5611e330d478 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:03.453168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b78b166-f944-4098-99e8-5611e330d478 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:03.454091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b78b166-f944-4098-99e8-5611e330d478 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:03.627338 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3b78b166-f944-4098-99e8-5611e330d478 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "PUT /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1084 microversion: 2.1 time: 0.225621 Aug 03 02:15:03.629169 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2348/4797] 10.222.0.67 () {60 vars in 1256 bytes} [Wed Aug 3 02:15:03 2022] PUT /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1084 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:03.648802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a5af6b98-b04a-4c18-be35-e89e3c63d366 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:03.651321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a5af6b98-b04a-4c18-be35-e89e3c63d366 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:03.658008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:03.660322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5af6b98-b04a-4c18-be35-e89e3c63d366 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:03.661674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5af6b98-b04a-4c18-be35-e89e3c63d366 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:03.663865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5af6b98-b04a-4c18-be35-e89e3c63d366 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:03.664663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5af6b98-b04a-4c18-be35-e89e3c63d366 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:03.919500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-da156810-5f7b-46b9-9f43-1c6c5b81b10b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:03.932688 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-da156810-5f7b-46b9-9f43-1c6c5b81b10b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 0.573960 Aug 03 02:15:03.933934 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2450/4798] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:03 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:03.943813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a0559b08-9e1d-4b87-a414-c1bf9e60dd44 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:03.946499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a0559b08-9e1d-4b87-a414-c1bf9e60dd44 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:03.968824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0559b08-9e1d-4b87-a414-c1bf9e60dd44 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:03.969877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0559b08-9e1d-4b87-a414-c1bf9e60dd44 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:03.971075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0559b08-9e1d-4b87-a414-c1bf9e60dd44 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:03.971692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0559b08-9e1d-4b87-a414-c1bf9e60dd44 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:04.068272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a5af6b98-b04a-4c18-be35-e89e3c63d366 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:04.086810 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a5af6b98-b04a-4c18-be35-e89e3c63d366 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1510 microversion: 2.1 time: 0.444262 Aug 03 02:15:04.089121 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2349/4799] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:03 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1510 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:04.109661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eedb347b-1df5-4604-9019-847a7f895897 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:04.110284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eedb347b-1df5-4604-9019-847a7f895897 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:04.142305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eedb347b-1df5-4604-9019-847a7f895897 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:04.143532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eedb347b-1df5-4604-9019-847a7f895897 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:04.150700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eedb347b-1df5-4604-9019-847a7f895897 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:04.155054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eedb347b-1df5-4604-9019-847a7f895897 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:04.285004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a0559b08-9e1d-4b87-a414-c1bf9e60dd44 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:04.294210 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a0559b08-9e1d-4b87-a414-c1bf9e60dd44 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 0.358912 Aug 03 02:15:04.308889 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2451/4800] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:03 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:04.463349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eedb347b-1df5-4604-9019-847a7f895897 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:04.480631 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eedb347b-1df5-4604-9019-847a7f895897 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1510 microversion: 2.1 time: 0.375567 Aug 03 02:15:04.497665 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2350/4801] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:04 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1510 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:04.502622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bd5fbabe-1b97-4056-bb4f-dab8127cfdf2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:04.503373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bd5fbabe-1b97-4056-bb4f-dab8127cfdf2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:04.534773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd5fbabe-1b97-4056-bb4f-dab8127cfdf2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:04.538131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd5fbabe-1b97-4056-bb4f-dab8127cfdf2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:04.539027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd5fbabe-1b97-4056-bb4f-dab8127cfdf2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:04.539665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd5fbabe-1b97-4056-bb4f-dab8127cfdf2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:04.620022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bd5fbabe-1b97-4056-bb4f-dab8127cfdf2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:15:04.834244 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bd5fbabe-1b97-4056-bb4f-dab8127cfdf2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 204 len: 0 microversion: 2.1 time: 0.334248 Aug 03 02:15:04.835038 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2452/4802] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:15:04 2022] DELETE /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:15:04.846648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e5bed91e-6e99-4255-8d4b-713e8db03a6e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:04.847309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e5bed91e-6e99-4255-8d4b-713e8db03a6e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:04.860269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5bed91e-6e99-4255-8d4b-713e8db03a6e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:04.860977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5bed91e-6e99-4255-8d4b-713e8db03a6e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:04.862384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5bed91e-6e99-4255-8d4b-713e8db03a6e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:04.863049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5bed91e-6e99-4255-8d4b-713e8db03a6e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:04.961821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f155ac50-993d-47d9-8582-4bcb585b3dc9 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:04.963142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f155ac50-993d-47d9-8582-4bcb585b3dc9 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:04.976027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f155ac50-993d-47d9-8582-4bcb585b3dc9 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:04.980972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f155ac50-993d-47d9-8582-4bcb585b3dc9 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:04.982198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f155ac50-993d-47d9-8582-4bcb585b3dc9 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:04.985120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f155ac50-993d-47d9-8582-4bcb585b3dc9 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:05.203557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e5bed91e-6e99-4255-8d4b-713e8db03a6e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:05.211707 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e5bed91e-6e99-4255-8d4b-713e8db03a6e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1516 microversion: 2.1 time: 0.369734 Aug 03 02:15:05.215899 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2351/4803] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:04 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1516 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:05.316651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ad044a2-c229-4e27-a886-1ca3f893b877 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:05.320704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2ad044a2-c229-4e27-a886-1ca3f893b877 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:05.320914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f155ac50-993d-47d9-8582-4bcb585b3dc9 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:05.329471 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f155ac50-993d-47d9-8582-4bcb585b3dc9 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 0.374632 Aug 03 02:15:05.330453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ad044a2-c229-4e27-a886-1ca3f893b877 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:05.330640 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2453/4804] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:04 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:05.331305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ad044a2-c229-4e27-a886-1ca3f893b877 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:05.334364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ad044a2-c229-4e27-a886-1ca3f893b877 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:05.334810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ad044a2-c229-4e27-a886-1ca3f893b877 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:05.543714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2ad044a2-c229-4e27-a886-1ca3f893b877 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:05.559007 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2ad044a2-c229-4e27-a886-1ca3f893b877 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 0.246566 Aug 03 02:15:05.567199 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2352/4805] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:05 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:06.241744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7a77ad45-86cf-4f5b-9308-4b28746cbde4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:06.244748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7a77ad45-86cf-4f5b-9308-4b28746cbde4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:06.277103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a77ad45-86cf-4f5b-9308-4b28746cbde4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:06.279763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a77ad45-86cf-4f5b-9308-4b28746cbde4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:06.282505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a77ad45-86cf-4f5b-9308-4b28746cbde4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:06.283711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a77ad45-86cf-4f5b-9308-4b28746cbde4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:06.373636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7de2c69c-a5db-4b44-b91b-bd97e03a1688 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:06.378541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7de2c69c-a5db-4b44-b91b-bd97e03a1688 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:06.423468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7de2c69c-a5db-4b44-b91b-bd97e03a1688 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:06.424072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7de2c69c-a5db-4b44-b91b-bd97e03a1688 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:06.425817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7de2c69c-a5db-4b44-b91b-bd97e03a1688 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:06.427733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7de2c69c-a5db-4b44-b91b-bd97e03a1688 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:06.846350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7a77ad45-86cf-4f5b-9308-4b28746cbde4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:06.859326 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7a77ad45-86cf-4f5b-9308-4b28746cbde4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1516 microversion: 2.1 time: 0.624119 Aug 03 02:15:06.862281 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2454/4806] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:06 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1516 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:06.883124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4ab601e7-6046-4a3a-a49e-b51beb5e5822 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:06.883854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4ab601e7-6046-4a3a-a49e-b51beb5e5822 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:06.897815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4ab601e7-6046-4a3a-a49e-b51beb5e5822 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:06.899958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4ab601e7-6046-4a3a-a49e-b51beb5e5822 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:06.901092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4ab601e7-6046-4a3a-a49e-b51beb5e5822 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:06.901951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4ab601e7-6046-4a3a-a49e-b51beb5e5822 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:07.565209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4ab601e7-6046-4a3a-a49e-b51beb5e5822 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:07.573909 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4ab601e7-6046-4a3a-a49e-b51beb5e5822 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 0.710224 Aug 03 02:15:07.584283 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2455/4807] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:06 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:07.677044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7de2c69c-a5db-4b44-b91b-bd97e03a1688 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:07.693870 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7de2c69c-a5db-4b44-b91b-bd97e03a1688 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 1.334959 Aug 03 02:15:07.694533 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2353/4808] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:06 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:07.885798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-66464fba-a2d6-4fb1-a964-4453aa7ad46a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:07.886429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-66464fba-a2d6-4fb1-a964-4453aa7ad46a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:07.899869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66464fba-a2d6-4fb1-a964-4453aa7ad46a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:07.900325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66464fba-a2d6-4fb1-a964-4453aa7ad46a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:07.901125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66464fba-a2d6-4fb1-a964-4453aa7ad46a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:07.901574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66464fba-a2d6-4fb1-a964-4453aa7ad46a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:08.472657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-66464fba-a2d6-4fb1-a964-4453aa7ad46a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:08.489998 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-66464fba-a2d6-4fb1-a964-4453aa7ad46a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1516 microversion: 2.1 time: 0.601474 Aug 03 02:15:08.491148 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2456/4809] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:07 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1516 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:08.597350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-91949287-1974-4233-819a-59c190b36af9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:08.597980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-91949287-1974-4233-819a-59c190b36af9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:08.610177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91949287-1974-4233-819a-59c190b36af9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:08.615624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91949287-1974-4233-819a-59c190b36af9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:08.616775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91949287-1974-4233-819a-59c190b36af9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:08.618207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91949287-1974-4233-819a-59c190b36af9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:08.717623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1e2cc4e4-4352-4b45-b6dd-31a7dc4c02ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:08.718273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1e2cc4e4-4352-4b45-b6dd-31a7dc4c02ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:08.731219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e2cc4e4-4352-4b45-b6dd-31a7dc4c02ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:08.731711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e2cc4e4-4352-4b45-b6dd-31a7dc4c02ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:08.732533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e2cc4e4-4352-4b45-b6dd-31a7dc4c02ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:08.732978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e2cc4e4-4352-4b45-b6dd-31a7dc4c02ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:09.319576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1e2cc4e4-4352-4b45-b6dd-31a7dc4c02ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:09.319904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-91949287-1974-4233-819a-59c190b36af9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:09.333970 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1e2cc4e4-4352-4b45-b6dd-31a7dc4c02ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 0.621223 Aug 03 02:15:09.335698 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2457/4810] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:08 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:09.353698 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-91949287-1974-4233-819a-59c190b36af9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 0.760347 Aug 03 02:15:09.359675 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2354/4811] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:08 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:09.511547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-59f8725f-7c0e-492c-999a-a113f1a73adb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:09.512794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-59f8725f-7c0e-492c-999a-a113f1a73adb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:09.525233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59f8725f-7c0e-492c-999a-a113f1a73adb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:09.525699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59f8725f-7c0e-492c-999a-a113f1a73adb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:09.526506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59f8725f-7c0e-492c-999a-a113f1a73adb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:09.527006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59f8725f-7c0e-492c-999a-a113f1a73adb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:10.163445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-59f8725f-7c0e-492c-999a-a113f1a73adb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:10.184070 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-59f8725f-7c0e-492c-999a-a113f1a73adb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1516 microversion: 2.1 time: 0.676238 Aug 03 02:15:10.184689 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2458/4812] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:09 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1516 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:10.361734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-40bb6c39-5acb-4f14-b4e3-0354606eb468 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:10.362536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-40bb6c39-5acb-4f14-b4e3-0354606eb468 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:10.377481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c1d27200-36df-4b08-b2a8-bd961942bdd9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:10.379258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c1d27200-36df-4b08-b2a8-bd961942bdd9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:10.386459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40bb6c39-5acb-4f14-b4e3-0354606eb468 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:10.394588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d27200-36df-4b08-b2a8-bd961942bdd9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:10.395968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40bb6c39-5acb-4f14-b4e3-0354606eb468 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:10.397165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40bb6c39-5acb-4f14-b4e3-0354606eb468 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:10.397717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d27200-36df-4b08-b2a8-bd961942bdd9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:10.399413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d27200-36df-4b08-b2a8-bd961942bdd9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:10.401336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40bb6c39-5acb-4f14-b4e3-0354606eb468 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:10.406463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d27200-36df-4b08-b2a8-bd961942bdd9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:11.231125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:11.496218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c1d27200-36df-4b08-b2a8-bd961942bdd9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:11.541603 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c1d27200-36df-4b08-b2a8-bd961942bdd9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 1.165044 Aug 03 02:15:11.542681 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2459/4813] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:10 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:11.562596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e0994a9c-197e-4523-85c5-38f6f6a8419c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:11.563644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e0994a9c-197e-4523-85c5-38f6f6a8419c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:11.586574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0994a9c-197e-4523-85c5-38f6f6a8419c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:11.589622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0994a9c-197e-4523-85c5-38f6f6a8419c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:11.590610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0994a9c-197e-4523-85c5-38f6f6a8419c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:11.591235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0994a9c-197e-4523-85c5-38f6f6a8419c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:11.607894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-40bb6c39-5acb-4f14-b4e3-0354606eb468 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:11.631715 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-40bb6c39-5acb-4f14-b4e3-0354606eb468 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 1.271542 Aug 03 02:15:11.648050 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2355/4814] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:10 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:11.669629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-b56270da-6227-4306-8884-b7b388925de6 req-f5817628-969b-408d-9283-6f9f242fb8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f048d8ef-2daf-421d-b5b6-e75402c0251d", "name": "network-vif-deleted", "tag": "780ba778-0b96-4290-9f20-7aa99aed29fd"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:11.734975 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0994a9c-197e-4523-85c5-38f6f6a8419c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:11.735656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0994a9c-197e-4523-85c5-38f6f6a8419c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:11.740326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-e0994a9c-197e-4523-85c5-38f6f6a8419c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lazy-loading 'fault' on Instance uuid f048d8ef-2daf-421d-b5b6-e75402c0251d {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:15:11.756426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b56270da-6227-4306-8884-b7b388925de6 req-f5817628-969b-408d-9283-6f9f242fb8cf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:11.758127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b56270da-6227-4306-8884-b7b388925de6 req-f5817628-969b-408d-9283-6f9f242fb8cf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:11.780320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:11.783515 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-b56270da-6227-4306-8884-b7b388925de6 req-f5817628-969b-408d-9283-6f9f242fb8cf service nova] Creating event network-vif-deleted:780ba778-0b96-4290-9f20-7aa99aed29fd for instance f048d8ef-2daf-421d-b5b6-e75402c0251d on n-h1-826529-8 Aug 03 02:15:11.799237 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-b56270da-6227-4306-8884-b7b388925de6 req-f5817628-969b-408d-9283-6f9f242fb8cf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147645 Aug 03 02:15:11.800001 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2356/4815] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:15:12.011197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e0994a9c-197e-4523-85c5-38f6f6a8419c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:12.024008 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e0994a9c-197e-4523-85c5-38f6f6a8419c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 200 len: 1320 microversion: 2.1 time: 0.479773 Aug 03 02:15:12.050967 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2460/4816] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:11 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 1320 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:12.566870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5cd68091-681f-4ca6-b851-5a0ffcc154bd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:12.568303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5cd68091-681f-4ca6-b851-5a0ffcc154bd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:12.583142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cd68091-681f-4ca6-b851-5a0ffcc154bd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:12.584287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cd68091-681f-4ca6-b851-5a0ffcc154bd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:12.585407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cd68091-681f-4ca6-b851-5a0ffcc154bd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:12.586107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5cd68091-681f-4ca6-b851-5a0ffcc154bd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:12.669762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ce2ec29a-0af7-44a2-b32d-27939fecf6f2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:12.670414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ce2ec29a-0af7-44a2-b32d-27939fecf6f2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:12.681278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce2ec29a-0af7-44a2-b32d-27939fecf6f2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:12.681753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce2ec29a-0af7-44a2-b32d-27939fecf6f2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:12.682562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce2ec29a-0af7-44a2-b32d-27939fecf6f2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:12.683050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ce2ec29a-0af7-44a2-b32d-27939fecf6f2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:13.234871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5cd68091-681f-4ca6-b851-5a0ffcc154bd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:13.248939 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5cd68091-681f-4ca6-b851-5a0ffcc154bd tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 0.688169 Aug 03 02:15:13.251963 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2357/4817] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:12 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:13.271687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69277313-b5b7-43f1-9e9d-3e1b1edb8ed4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:13.277902 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-69277313-b5b7-43f1-9e9d-3e1b1edb8ed4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:13.314079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ce2ec29a-0af7-44a2-b32d-27939fecf6f2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:13.323340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69277313-b5b7-43f1-9e9d-3e1b1edb8ed4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:13.329233 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ce2ec29a-0af7-44a2-b32d-27939fecf6f2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 0.664396 Aug 03 02:15:13.335068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69277313-b5b7-43f1-9e9d-3e1b1edb8ed4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:13.337288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69277313-b5b7-43f1-9e9d-3e1b1edb8ed4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:13.340843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69277313-b5b7-43f1-9e9d-3e1b1edb8ed4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:13.347974 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2461/4818] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:12 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:13.409171 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-69277313-b5b7-43f1-9e9d-3e1b1edb8ed4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69277313-b5b7-43f1-9e9d-3e1b1edb8ed4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d HTTP/1.1 Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'f048d8ef-2daf-421d-b5b6-e75402c0251d'} Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:15:13.411605 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:15:13.416119 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:15:13.416119 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:15:13.416119 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:15:13.416119 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:15:13.416119 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:15:13.416119 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. Aug 03 02:15:13.416119 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:15:13.418274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69277313-b5b7-43f1-9e9d-3e1b1edb8ed4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:15:13.419427 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-69277313-b5b7-43f1-9e9d-3e1b1edb8ed4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 404 len: 111 microversion: 2.1 time: 0.163576 Aug 03 02:15:13.421322 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2358/4819] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:13 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:15:13.712241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-807254258", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "d26ca69a-a338-40ed-9e04-7c6942285689"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:13.855558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] validate_networks() for [('d26ca69a-a338-40ed-9e04-7c6942285689', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:15:14.275875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8575d5c6-1a53-4c5d-b1f6-fd2cd0c1dea0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:14.277626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8575d5c6-1a53-4c5d-b1f6-fd2cd0c1dea0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:14.289867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8575d5c6-1a53-4c5d-b1f6-fd2cd0c1dea0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:14.290337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8575d5c6-1a53-4c5d-b1f6-fd2cd0c1dea0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:14.295245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8575d5c6-1a53-4c5d-b1f6-fd2cd0c1dea0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:14.295779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8575d5c6-1a53-4c5d-b1f6-fd2cd0c1dea0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:14.734565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8575d5c6-1a53-4c5d-b1f6-fd2cd0c1dea0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:14.758799 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8575d5c6-1a53-4c5d-b1f6-fd2cd0c1dea0 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 0.488343 Aug 03 02:15:14.772325 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2359/4820] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:14 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:14.780085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bb5669da-89f7-449d-9128-16f4f9101903 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:14.780913 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bb5669da-89f7-449d-9128-16f4f9101903 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:14.789106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bb5669da-89f7-449d-9128-16f4f9101903 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:14.789809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bb5669da-89f7-449d-9128-16f4f9101903 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:14.790787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bb5669da-89f7-449d-9128-16f4f9101903 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:14.791437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bb5669da-89f7-449d-9128-16f4f9101903 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:15.368988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bb5669da-89f7-449d-9128-16f4f9101903 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:15.383584 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bb5669da-89f7-449d-9128-16f4f9101903 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 0.607480 Aug 03 02:15:15.399913 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2360/4821] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:14 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:15.435999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:15:15.437153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:15:15.437877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:15:15.438735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:15:15.439419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:15:15.459115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:15.467980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:15.469402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:15.470100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:15.522006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:15:15.537242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Getting quotas for user 2721f67579e542718483193be7515d6b and project d6f9e14c4d544763bb0d94b60a40ef54. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:15:15.577832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:15:15.581460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:15:15.783893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e83cc942-98b1-4aab-907d-fe129e8cbde4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:15.784823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e83cc942-98b1-4aab-907d-fe129e8cbde4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:15.792204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e83cc942-98b1-4aab-907d-fe129e8cbde4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:15.792639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e83cc942-98b1-4aab-907d-fe129e8cbde4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:15.793449 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e83cc942-98b1-4aab-907d-fe129e8cbde4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:15.794012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e83cc942-98b1-4aab-907d-fe129e8cbde4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:15.807720 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a8adfe4b-f45d-4408-b09e-b5a30493df13 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.100854 Aug 03 02:15:15.815634 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2462/4822] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:15:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:15:15.836153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-163b899c-a8a7-4a53-b476-49bff2acc4b7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:15.839908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-163b899c-a8a7-4a53-b476-49bff2acc4b7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:16.955351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-163b899c-a8a7-4a53-b476-49bff2acc4b7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:16.969838 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-163b899c-a8a7-4a53-b476-49bff2acc4b7 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1208 microversion: 2.1 time: 1.148971 Aug 03 02:15:16.972921 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2463/4823] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:15 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1208 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:16.989733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5fea357-9cfd-4d6c-a310-b90384e02679 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:16.992394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5fea357-9cfd-4d6c-a310-b90384e02679 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:17.014756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5fea357-9cfd-4d6c-a310-b90384e02679 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:17.015751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5fea357-9cfd-4d6c-a310-b90384e02679 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:17.018784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5fea357-9cfd-4d6c-a310-b90384e02679 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:17.019620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5fea357-9cfd-4d6c-a310-b90384e02679 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:17.311333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e83cc942-98b1-4aab-907d-fe129e8cbde4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:17.321159 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e83cc942-98b1-4aab-907d-fe129e8cbde4 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 1.541061 Aug 03 02:15:17.332067 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2361/4824] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:15 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:17.440825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c5fea357-9cfd-4d6c-a310-b90384e02679 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:17.461869 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5fea357-9cfd-4d6c-a310-b90384e02679 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 0.482795 Aug 03 02:15:17.462830 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2464/4825] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:16 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:17.994197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c02194d6-0492-4e0a-9d85-e7bb32a0a83b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:17.994822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c02194d6-0492-4e0a-9d85-e7bb32a0a83b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:18.021547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c02194d6-0492-4e0a-9d85-e7bb32a0a83b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:18.023902 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c02194d6-0492-4e0a-9d85-e7bb32a0a83b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:18.024771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c02194d6-0492-4e0a-9d85-e7bb32a0a83b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:18.025231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c02194d6-0492-4e0a-9d85-e7bb32a0a83b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:18.212358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c02194d6-0492-4e0a-9d85-e7bb32a0a83b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:18.226374 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c02194d6-0492-4e0a-9d85-e7bb32a0a83b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1266 microversion: 2.1 time: 0.232906 Aug 03 02:15:18.227317 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2362/4826] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:17 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:18.355464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2a6c26ee-524d-4054-83c5-3e5adb759b37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:18.356106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2a6c26ee-524d-4054-83c5-3e5adb759b37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:18.388858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2a6c26ee-524d-4054-83c5-3e5adb759b37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:18.389267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2a6c26ee-524d-4054-83c5-3e5adb759b37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:18.390099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2a6c26ee-524d-4054-83c5-3e5adb759b37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:18.390560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2a6c26ee-524d-4054-83c5-3e5adb759b37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:18.492001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9bb52f5f-6aeb-4237-8ea6-a52947762fcd tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:18.492640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9bb52f5f-6aeb-4237-8ea6-a52947762fcd tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:18.525283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9bb52f5f-6aeb-4237-8ea6-a52947762fcd tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:18.529235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9bb52f5f-6aeb-4237-8ea6-a52947762fcd tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:18.534691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9bb52f5f-6aeb-4237-8ea6-a52947762fcd tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:18.540662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9bb52f5f-6aeb-4237-8ea6-a52947762fcd tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:18.854233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2a6c26ee-524d-4054-83c5-3e5adb759b37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:18.857079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:18.875524 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2a6c26ee-524d-4054-83c5-3e5adb759b37 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 0.524943 Aug 03 02:15:18.876398 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2465/4827] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:18 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:19.254015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-53911d0d-d08c-4659-81dc-78265edf195b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:19.255528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-53911d0d-d08c-4659-81dc-78265edf195b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:19.267862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53911d0d-d08c-4659-81dc-78265edf195b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:19.276870 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53911d0d-d08c-4659-81dc-78265edf195b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:19.287531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53911d0d-d08c-4659-81dc-78265edf195b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:19.288158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53911d0d-d08c-4659-81dc-78265edf195b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:19.368415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9bb52f5f-6aeb-4237-8ea6-a52947762fcd tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:19.407935 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9bb52f5f-6aeb-4237-8ea6-a52947762fcd tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 0.915668 Aug 03 02:15:19.432030 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2363/4828] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:18 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:19.481024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-53911d0d-d08c-4659-81dc-78265edf195b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:19.501274 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-53911d0d-d08c-4659-81dc-78265edf195b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1266 microversion: 2.1 time: 0.251256 Aug 03 02:15:19.507949 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2466/4829] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:19 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:19.899558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4a50bbd6-cc24-4ae9-bbb7-508f54b7a960 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:19.900834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4a50bbd6-cc24-4ae9-bbb7-508f54b7a960 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:19.923667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a50bbd6-cc24-4ae9-bbb7-508f54b7a960 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:19.924134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a50bbd6-cc24-4ae9-bbb7-508f54b7a960 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:19.924945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a50bbd6-cc24-4ae9-bbb7-508f54b7a960 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:19.925389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a50bbd6-cc24-4ae9-bbb7-508f54b7a960 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:20.401118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4a50bbd6-cc24-4ae9-bbb7-508f54b7a960 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:20.413252 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4a50bbd6-cc24-4ae9-bbb7-508f54b7a960 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 0.518920 Aug 03 02:15:20.429747 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2364/4830] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:19 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:20.441361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-26780d4a-d43b-43cb-a3e7-7bcb89ddc48f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:20.443029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-26780d4a-d43b-43cb-a3e7-7bcb89ddc48f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:20.467568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26780d4a-d43b-43cb-a3e7-7bcb89ddc48f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:20.469440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26780d4a-d43b-43cb-a3e7-7bcb89ddc48f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:20.470466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26780d4a-d43b-43cb-a3e7-7bcb89ddc48f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:20.471935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26780d4a-d43b-43cb-a3e7-7bcb89ddc48f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:20.530005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-52aa3642-8cdf-4bd0-a8ba-e660853fc15d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:20.531240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-52aa3642-8cdf-4bd0-a8ba-e660853fc15d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:20.545840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52aa3642-8cdf-4bd0-a8ba-e660853fc15d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:20.546686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52aa3642-8cdf-4bd0-a8ba-e660853fc15d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:20.547818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52aa3642-8cdf-4bd0-a8ba-e660853fc15d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:20.548811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52aa3642-8cdf-4bd0-a8ba-e660853fc15d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:21.222490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-26780d4a-d43b-43cb-a3e7-7bcb89ddc48f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:21.235525 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-26780d4a-d43b-43cb-a3e7-7bcb89ddc48f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 0.797407 Aug 03 02:15:21.243431 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2467/4831] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:20 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:21.439698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cbee61c3-ec3f-4665-a312-164fe069f63d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:21.440588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cbee61c3-ec3f-4665-a312-164fe069f63d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:21.453264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbee61c3-ec3f-4665-a312-164fe069f63d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:21.458739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbee61c3-ec3f-4665-a312-164fe069f63d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:21.459993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbee61c3-ec3f-4665-a312-164fe069f63d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:21.460680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cbee61c3-ec3f-4665-a312-164fe069f63d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:21.516998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-52aa3642-8cdf-4bd0-a8ba-e660853fc15d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:21.529979 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-52aa3642-8cdf-4bd0-a8ba-e660853fc15d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1308 microversion: 2.1 time: 1.004852 Aug 03 02:15:21.532345 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2365/4832] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:20 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1308 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:21.987613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cbee61c3-ec3f-4665-a312-164fe069f63d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:22.007089 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cbee61c3-ec3f-4665-a312-164fe069f63d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 0.568655 Aug 03 02:15:22.023204 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2468/4833] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:21 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:22.266418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-551f0f3f-7534-4c9e-9913-b0f6d2cadd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:22.267168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-551f0f3f-7534-4c9e-9913-b0f6d2cadd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:22.291049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-551f0f3f-7534-4c9e-9913-b0f6d2cadd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:22.291523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-551f0f3f-7534-4c9e-9913-b0f6d2cadd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:22.292556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-551f0f3f-7534-4c9e-9913-b0f6d2cadd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:22.293175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-551f0f3f-7534-4c9e-9913-b0f6d2cadd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:22.555496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0876d3cf-a2f6-4813-a3c0-6aba4baa9cdc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:22.556835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0876d3cf-a2f6-4813-a3c0-6aba4baa9cdc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:22.569553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0876d3cf-a2f6-4813-a3c0-6aba4baa9cdc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:22.571955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0876d3cf-a2f6-4813-a3c0-6aba4baa9cdc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:22.574944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0876d3cf-a2f6-4813-a3c0-6aba4baa9cdc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:22.577930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0876d3cf-a2f6-4813-a3c0-6aba4baa9cdc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:23.521770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-551f0f3f-7534-4c9e-9913-b0f6d2cadd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:23.541405 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-551f0f3f-7534-4c9e-9913-b0f6d2cadd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 1.286834 Aug 03 02:15:23.542671 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2366/4834] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:22 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:23.549359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f407d6bf-5d5c-4be0-b590-071bce72206d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:23.554193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f407d6bf-5d5c-4be0-b590-071bce72206d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:23.610719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f407d6bf-5d5c-4be0-b590-071bce72206d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:23.611234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f407d6bf-5d5c-4be0-b590-071bce72206d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:23.614837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f407d6bf-5d5c-4be0-b590-071bce72206d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:23.615331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f407d6bf-5d5c-4be0-b590-071bce72206d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:23.665622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0876d3cf-a2f6-4813-a3c0-6aba4baa9cdc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:23.688458 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0876d3cf-a2f6-4813-a3c0-6aba4baa9cdc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1308 microversion: 2.1 time: 1.138796 Aug 03 02:15:23.691387 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2469/4835] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:22 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1308 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:23.704130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-3c264f62-8514-4a0c-9f91-cc4414915d4a req-cb4424a7-c082-4502-ac06-89abbd3097ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e5a93f-301f-4ed4-bc34-b6dadb6c4644", "tag": "c2fc9c75-7f7d-4eb4-a140-8cd5487bac65"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:23.762704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3c264f62-8514-4a0c-9f91-cc4414915d4a req-cb4424a7-c082-4502-ac06-89abbd3097ee service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:23.767450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3c264f62-8514-4a0c-9f91-cc4414915d4a req-cb4424a7-c082-4502-ac06-89abbd3097ee service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:23.813856 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-3c264f62-8514-4a0c-9f91-cc4414915d4a req-cb4424a7-c082-4502-ac06-89abbd3097ee service nova] Creating event network-changed:c2fc9c75-7f7d-4eb4-a140-8cd5487bac65 for instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 on n-h2-826529-8 Aug 03 02:15:23.825364 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-3c264f62-8514-4a0c-9f91-cc4414915d4a req-cb4424a7-c082-4502-ac06-89abbd3097ee service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132050 Aug 03 02:15:23.825993 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2470/4836] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:15:24.568576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3b30aa39-6797-4e49-889c-13f46c1a507f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:24.571574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3b30aa39-6797-4e49-889c-13f46c1a507f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:24.587403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b30aa39-6797-4e49-889c-13f46c1a507f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:24.590868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b30aa39-6797-4e49-889c-13f46c1a507f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:24.591998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b30aa39-6797-4e49-889c-13f46c1a507f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:24.592674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b30aa39-6797-4e49-889c-13f46c1a507f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:24.654662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f407d6bf-5d5c-4be0-b590-071bce72206d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:24.668123 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f407d6bf-5d5c-4be0-b590-071bce72206d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1508 microversion: 2.1 time: 1.124071 Aug 03 02:15:24.669009 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2367/4837] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:23 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1508 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:24.718048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d957d216-9e55-49e1-9ad6-c0892b705bdb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:24.719182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d957d216-9e55-49e1-9ad6-c0892b705bdb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:24.767627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d957d216-9e55-49e1-9ad6-c0892b705bdb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:24.768038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d957d216-9e55-49e1-9ad6-c0892b705bdb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:24.768859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d957d216-9e55-49e1-9ad6-c0892b705bdb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:24.774425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d957d216-9e55-49e1-9ad6-c0892b705bdb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:25.491881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:25.585403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d957d216-9e55-49e1-9ad6-c0892b705bdb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:25.592407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3b30aa39-6797-4e49-889c-13f46c1a507f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:25.606085 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d957d216-9e55-49e1-9ad6-c0892b705bdb tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1308 microversion: 2.1 time: 0.894986 Aug 03 02:15:25.609000 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3b30aa39-6797-4e49-889c-13f46c1a507f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 1.046094 Aug 03 02:15:25.612813 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2368/4838] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:24 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1308 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:25.626484 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2471/4839] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:24 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:25.717992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4603c635-4932-4200-90ee-dbd1b03d24b1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:25.733893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4603c635-4932-4200-90ee-dbd1b03d24b1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:25.787337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4603c635-4932-4200-90ee-dbd1b03d24b1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:25.793330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4603c635-4932-4200-90ee-dbd1b03d24b1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:25.802370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4603c635-4932-4200-90ee-dbd1b03d24b1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:25.803849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4603c635-4932-4200-90ee-dbd1b03d24b1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:26.159727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4603c635-4932-4200-90ee-dbd1b03d24b1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:26.170063 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4603c635-4932-4200-90ee-dbd1b03d24b1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1505 microversion: 2.1 time: 0.482426 Aug 03 02:15:26.171315 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2369/4840] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:25 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:26.642657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-845340d2-a786-450b-a4be-d110e9ea0638 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:26.644008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8b340be-e24e-4422-9d59-c23edac9786d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:26.647217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-845340d2-a786-450b-a4be-d110e9ea0638 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:26.648961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b8b340be-e24e-4422-9d59-c23edac9786d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:26.671894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-845340d2-a786-450b-a4be-d110e9ea0638 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:26.674440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-845340d2-a786-450b-a4be-d110e9ea0638 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:26.675260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8b340be-e24e-4422-9d59-c23edac9786d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:26.678569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8b340be-e24e-4422-9d59-c23edac9786d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:26.679076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-845340d2-a786-450b-a4be-d110e9ea0638 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:26.680145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8b340be-e24e-4422-9d59-c23edac9786d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:26.680832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-845340d2-a786-450b-a4be-d110e9ea0638 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:26.683229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8b340be-e24e-4422-9d59-c23edac9786d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:26.966538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:27.795826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-845340d2-a786-450b-a4be-d110e9ea0638 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:27.809919 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-845340d2-a786-450b-a4be-d110e9ea0638 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1308 microversion: 2.1 time: 1.176813 Aug 03 02:15:27.811540 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2472/4841] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:26 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1308 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:27.830974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-5b8174e1-b55e-4d14-bbb8-c570a254dd2d req-8ac95895-6472-43ee-87dd-49cd8684213f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5258d568-7952-4040-8f17-07036a19c06a", "name": "network-vif-unplugged", "status": "completed", "tag": "4b0e94f3-e0c9-45de-ac3f-b4aba0330f65"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:27.859128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5b8174e1-b55e-4d14-bbb8-c570a254dd2d req-8ac95895-6472-43ee-87dd-49cd8684213f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:27.872385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5b8174e1-b55e-4d14-bbb8-c570a254dd2d req-8ac95895-6472-43ee-87dd-49cd8684213f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:27.901951 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-5b8174e1-b55e-4d14-bbb8-c570a254dd2d req-8ac95895-6472-43ee-87dd-49cd8684213f service nova] Creating event network-vif-unplugged:4b0e94f3-e0c9-45de-ac3f-b4aba0330f65 for instance 5258d568-7952-4040-8f17-07036a19c06a on n-h2-826529-8 Aug 03 02:15:27.913615 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-5b8174e1-b55e-4d14-bbb8-c570a254dd2d req-8ac95895-6472-43ee-87dd-49cd8684213f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095405 Aug 03 02:15:27.915189 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2473/4842] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:15:27.930389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1f275876-3ae9-45dc-8247-1aae9a2f50b7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:27.935328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1f275876-3ae9-45dc-8247-1aae9a2f50b7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:27.954023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f275876-3ae9-45dc-8247-1aae9a2f50b7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:27.955311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f275876-3ae9-45dc-8247-1aae9a2f50b7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:27.956279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f275876-3ae9-45dc-8247-1aae9a2f50b7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:27.956880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1f275876-3ae9-45dc-8247-1aae9a2f50b7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:28.118844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b8b340be-e24e-4422-9d59-c23edac9786d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:28.147444 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b8b340be-e24e-4422-9d59-c23edac9786d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 1.507704 Aug 03 02:15:28.155013 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2370/4843] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:26 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:28.174440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-155003417", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "b71f1d4b-c388-4443-a3fe-c0eb80744006"}], "key_name": "tempest-TestNetworkAdvancedServerOps-312773581", "security_groups": [{"name": "tempest-secgroup-smoke-1867582461"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:28.440099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1f275876-3ae9-45dc-8247-1aae9a2f50b7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:28.458922 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1f275876-3ae9-45dc-8247-1aae9a2f50b7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1505 microversion: 2.1 time: 0.539849 Aug 03 02:15:28.484913 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2474/4844] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:27 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1505 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:28.833399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a4d02084-66c1-4bb6-9b28-c1a99fde06d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:28.834966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a4d02084-66c1-4bb6-9b28-c1a99fde06d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:28.873370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4d02084-66c1-4bb6-9b28-c1a99fde06d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:28.878127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4d02084-66c1-4bb6-9b28-c1a99fde06d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:28.881548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4d02084-66c1-4bb6-9b28-c1a99fde06d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:28.888507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4d02084-66c1-4bb6-9b28-c1a99fde06d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:29.182714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] validate_networks() for [('b71f1d4b-c388-4443-a3fe-c0eb80744006', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:15:29.571741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a4d02084-66c1-4bb6-9b28-c1a99fde06d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:29.582597 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a4d02084-66c1-4bb6-9b28-c1a99fde06d4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1308 microversion: 2.1 time: 0.754044 Aug 03 02:15:29.602226 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2475/4845] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:28 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1308 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:29.619594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-89219480-0649-42ca-8bc5-a468197266ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:29.624594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-89219480-0649-42ca-8bc5-a468197266ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:29.633099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89219480-0649-42ca-8bc5-a468197266ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:29.634240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89219480-0649-42ca-8bc5-a468197266ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:29.636376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89219480-0649-42ca-8bc5-a468197266ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:29.636991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89219480-0649-42ca-8bc5-a468197266ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:30.319308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-89219480-0649-42ca-8bc5-a468197266ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:30.333985 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-89219480-0649-42ca-8bc5-a468197266ca tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1515 microversion: 2.1 time: 0.723993 Aug 03 02:15:30.338124 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2476/4846] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:29 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1515 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:30.357145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-41c0f4a2-e382-4970-aaa8-bad44983acea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:30.362745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-41c0f4a2-e382-4970-aaa8-bad44983acea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:30.387831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41c0f4a2-e382-4970-aaa8-bad44983acea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:30.388580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41c0f4a2-e382-4970-aaa8-bad44983acea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:30.390361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41c0f4a2-e382-4970-aaa8-bad44983acea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:30.393205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41c0f4a2-e382-4970-aaa8-bad44983acea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:30.870872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-41c0f4a2-e382-4970-aaa8-bad44983acea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:30.887769 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-41c0f4a2-e382-4970-aaa8-bad44983acea tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1505 microversion: 2.1 time: 0.545699 Aug 03 02:15:30.904942 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2477/4847] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:30 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1505 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:30.912734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e021f31e-3812-4899-979b-1091556657f1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:30.915516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e021f31e-3812-4899-979b-1091556657f1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:30.931214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e021f31e-3812-4899-979b-1091556657f1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:30.932122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e021f31e-3812-4899-979b-1091556657f1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:30.933196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e021f31e-3812-4899-979b-1091556657f1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:30.933975 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e021f31e-3812-4899-979b-1091556657f1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:31.838007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:15:31.839708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:15:31.840706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:15:31.841475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:15:31.843032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:15:31.882947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:31.884403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:31.888001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:31.891457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:31.970565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for project f6179959e78b438cb68680f694190a8c. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:15:31.999815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e021f31e-3812-4899-979b-1091556657f1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:32.001267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for user adca21bc340d440e91e4d856a625cd3a and project f6179959e78b438cb68680f694190a8c. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:15:32.010022 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e021f31e-3812-4899-979b-1091556657f1 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1308 microversion: 2.1 time: 1.103395 Aug 03 02:15:32.021415 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2478/4848] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:30 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1308 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:32.037969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-165863ee-9faa-4514-8dbc-6b6b2e7f3320 req-c34dcb0e-9f26-4746-b6fc-57b83f5b87da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e5a93f-301f-4ed4-bc34-b6dadb6c4644", "name": "network-vif-plugged", "status": "completed", "tag": "c2fc9c75-7f7d-4eb4-a140-8cd5487bac65"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:32.075568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:15:32.094805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:15:32.099022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-165863ee-9faa-4514-8dbc-6b6b2e7f3320 req-c34dcb0e-9f26-4746-b6fc-57b83f5b87da service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:32.103227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-165863ee-9faa-4514-8dbc-6b6b2e7f3320 req-c34dcb0e-9f26-4746-b6fc-57b83f5b87da service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:32.172026 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-165863ee-9faa-4514-8dbc-6b6b2e7f3320 req-c34dcb0e-9f26-4746-b6fc-57b83f5b87da service nova] Creating event network-vif-plugged:c2fc9c75-7f7d-4eb4-a140-8cd5487bac65 for instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 on n-h2-826529-8 Aug 03 02:15:32.191888 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-165863ee-9faa-4514-8dbc-6b6b2e7f3320 req-c34dcb0e-9f26-4746-b6fc-57b83f5b87da service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164237 Aug 03 02:15:32.193693 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2479/4849] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:15:32.205583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b91dc574-12a8-4dfe-a73d-0bd64565da33 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:32.206321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b91dc574-12a8-4dfe-a73d-0bd64565da33 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:32.230152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:32.234979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b91dc574-12a8-4dfe-a73d-0bd64565da33 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:32.237273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b91dc574-12a8-4dfe-a73d-0bd64565da33 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:32.241718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b91dc574-12a8-4dfe-a73d-0bd64565da33 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:32.242473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b91dc574-12a8-4dfe-a73d-0bd64565da33 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:32.254789 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fa761d87-33fc-48b4-b597-a7e6428b42a6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.093857 Aug 03 02:15:32.263650 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2371/4850] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:15:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 4108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:15:32.278577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8aa8629f-334f-4381-8faf-a2426c1132d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:32.281436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8aa8629f-334f-4381-8faf-a2426c1132d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:32.317835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8aa8629f-334f-4381-8faf-a2426c1132d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:32.319534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8aa8629f-334f-4381-8faf-a2426c1132d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:32.320577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8aa8629f-334f-4381-8faf-a2426c1132d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:32.321067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8aa8629f-334f-4381-8faf-a2426c1132d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:33.149413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8aa8629f-334f-4381-8faf-a2426c1132d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:33.167837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b91dc574-12a8-4dfe-a73d-0bd64565da33 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:33.174632 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8aa8629f-334f-4381-8faf-a2426c1132d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 200 len: 1448 microversion: 2.1 time: 0.907731 Aug 03 02:15:33.179855 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b91dc574-12a8-4dfe-a73d-0bd64565da33 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1521 microversion: 2.1 time: 0.984690 Aug 03 02:15:33.180458 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2480/4851] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:32 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1521 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:33.185538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2406d220-7ebb-4e5e-83fe-3c403e28d12e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:33.187314 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2372/4852] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:32 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 1448 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:33.195706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-35d7ac97-e5dd-4f76-853f-6354be19cc6f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:33.208177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2406d220-7ebb-4e5e-83fe-3c403e28d12e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:33.209130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-35d7ac97-e5dd-4f76-853f-6354be19cc6f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:33.231028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35d7ac97-e5dd-4f76-853f-6354be19cc6f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:33.231660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35d7ac97-e5dd-4f76-853f-6354be19cc6f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:33.233881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35d7ac97-e5dd-4f76-853f-6354be19cc6f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:33.236094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35d7ac97-e5dd-4f76-853f-6354be19cc6f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:33.377416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2406d220-7ebb-4e5e-83fe-3c403e28d12e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:33.388081 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2406d220-7ebb-4e5e-83fe-3c403e28d12e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1265 microversion: 2.1 time: 0.206356 Aug 03 02:15:33.390988 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2481/4853] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:33 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:33.402143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7b7b2bf5-c860-4f77-8be9-86ebbd8d44d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:33.405261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7b7b2bf5-c860-4f77-8be9-86ebbd8d44d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:33.427126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b7b2bf5-c860-4f77-8be9-86ebbd8d44d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:33.428034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b7b2bf5-c860-4f77-8be9-86ebbd8d44d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:33.429083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b7b2bf5-c860-4f77-8be9-86ebbd8d44d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:33.429689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b7b2bf5-c860-4f77-8be9-86ebbd8d44d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:33.768126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-35d7ac97-e5dd-4f76-853f-6354be19cc6f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:33.779636 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-35d7ac97-e5dd-4f76-853f-6354be19cc6f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1308 microversion: 2.1 time: 0.591024 Aug 03 02:15:33.795883 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2373/4854] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:33 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1308 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:33.873743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7b7b2bf5-c860-4f77-8be9-86ebbd8d44d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:33.888671 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7b7b2bf5-c860-4f77-8be9-86ebbd8d44d1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.493639 Aug 03 02:15:33.889952 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2482/4855] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:33 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:33.919475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f1d1e20d-f0d0-4c1d-a924-5aae53c46271 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:33.920424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f1d1e20d-f0d0-4c1d-a924-5aae53c46271 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:33.922740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:33.937369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1d1e20d-f0d0-4c1d-a924-5aae53c46271 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:33.937837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1d1e20d-f0d0-4c1d-a924-5aae53c46271 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:33.938634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1d1e20d-f0d0-4c1d-a924-5aae53c46271 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:33.939186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1d1e20d-f0d0-4c1d-a924-5aae53c46271 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:34.229523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5c69cede-2db2-4d45-92e0-2e3c5823c7eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:34.230897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5c69cede-2db2-4d45-92e0-2e3c5823c7eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:34.259992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c69cede-2db2-4d45-92e0-2e3c5823c7eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:34.260441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c69cede-2db2-4d45-92e0-2e3c5823c7eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:34.261335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c69cede-2db2-4d45-92e0-2e3c5823c7eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:34.261856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c69cede-2db2-4d45-92e0-2e3c5823c7eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:34.647547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f1d1e20d-f0d0-4c1d-a924-5aae53c46271 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:34.650778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:34.664560 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f1d1e20d-f0d0-4c1d-a924-5aae53c46271 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.749248 Aug 03 02:15:34.666495 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2374/4856] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:33 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:34.682412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dfef0748-f071-48d3-8e16-3b778a17a61f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:34.683443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dfef0748-f071-48d3-8e16-3b778a17a61f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:34.703877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dfef0748-f071-48d3-8e16-3b778a17a61f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:34.706014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dfef0748-f071-48d3-8e16-3b778a17a61f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:34.708240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dfef0748-f071-48d3-8e16-3b778a17a61f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:34.711543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dfef0748-f071-48d3-8e16-3b778a17a61f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:34.859237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5c69cede-2db2-4d45-92e0-2e3c5823c7eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:34.870373 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5c69cede-2db2-4d45-92e0-2e3c5823c7eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1521 microversion: 2.1 time: 0.650134 Aug 03 02:15:34.871952 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2483/4857] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:34 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1521 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:34.880007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f93584c3-11ec-4a05-9f06-292c5afdff2e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:34.883244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f93584c3-11ec-4a05-9f06-292c5afdff2e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:34.891902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f93584c3-11ec-4a05-9f06-292c5afdff2e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:34.892996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f93584c3-11ec-4a05-9f06-292c5afdff2e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:34.894654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f93584c3-11ec-4a05-9f06-292c5afdff2e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:34.895895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f93584c3-11ec-4a05-9f06-292c5afdff2e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:34.909963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dfef0748-f071-48d3-8e16-3b778a17a61f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:34.932586 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dfef0748-f071-48d3-8e16-3b778a17a61f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1325 microversion: 2.1 time: 0.261537 Aug 03 02:15:34.943092 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2375/4858] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:34 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1325 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:34.961045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1eaf22fa-d010-40bd-a0e4-9bc3ccd5b080 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:34.962069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1eaf22fa-d010-40bd-a0e4-9bc3ccd5b080 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:34.977156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1eaf22fa-d010-40bd-a0e4-9bc3ccd5b080 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:34.979672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1eaf22fa-d010-40bd-a0e4-9bc3ccd5b080 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:34.984163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1eaf22fa-d010-40bd-a0e4-9bc3ccd5b080 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:34.984925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1eaf22fa-d010-40bd-a0e4-9bc3ccd5b080 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:35.383897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f93584c3-11ec-4a05-9f06-292c5afdff2e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:35.393758 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f93584c3-11ec-4a05-9f06-292c5afdff2e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.520265 Aug 03 02:15:35.396290 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2484/4859] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:34 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:35.424272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-19605abf-a469-452b-bc65-1b6c80393a03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:35.424907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-19605abf-a469-452b-bc65-1b6c80393a03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:35.432667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19605abf-a469-452b-bc65-1b6c80393a03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:35.433136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19605abf-a469-452b-bc65-1b6c80393a03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:35.433943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19605abf-a469-452b-bc65-1b6c80393a03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:35.434387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19605abf-a469-452b-bc65-1b6c80393a03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:35.462424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:35.668704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1eaf22fa-d010-40bd-a0e4-9bc3ccd5b080 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:35.684939 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1eaf22fa-d010-40bd-a0e4-9bc3ccd5b080 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1488 microversion: 2.1 time: 0.737846 Aug 03 02:15:35.686170 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2376/4860] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:34 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1488 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:35.709759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4ec34e78-323d-44dc-9c64-92e9bf156a39 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1622179151"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:35.713246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4ec34e78-323d-44dc-9c64-92e9bf156a39 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:35.727381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ec34e78-323d-44dc-9c64-92e9bf156a39 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:35.728101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ec34e78-323d-44dc-9c64-92e9bf156a39 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:35.729170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ec34e78-323d-44dc-9c64-92e9bf156a39 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:35.733206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ec34e78-323d-44dc-9c64-92e9bf156a39 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:35.824161 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4ec34e78-323d-44dc-9c64-92e9bf156a39 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "PUT /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1074 microversion: 2.1 time: 0.119334 Aug 03 02:15:35.825192 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2377/4861] 10.222.0.67 () {60 vars in 1256 bytes} [Wed Aug 3 02:15:35 2022] PUT /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1074 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:35.844528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eb4d126c-a820-44af-9694-f252c26fde50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:35.846976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eb4d126c-a820-44af-9694-f252c26fde50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:35.854668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb4d126c-a820-44af-9694-f252c26fde50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:35.855327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb4d126c-a820-44af-9694-f252c26fde50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:35.856131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb4d126c-a820-44af-9694-f252c26fde50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:35.856794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb4d126c-a820-44af-9694-f252c26fde50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:35.903744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-19605abf-a469-452b-bc65-1b6c80393a03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:35.918652 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-19605abf-a469-452b-bc65-1b6c80393a03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.503147 Aug 03 02:15:35.920276 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2485/4862] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:35 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:35.929426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-efb12c52-7d7b-4766-a7ef-51d355bd689e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:35.931179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-efb12c52-7d7b-4766-a7ef-51d355bd689e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:35.943907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-efb12c52-7d7b-4766-a7ef-51d355bd689e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:35.948249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-efb12c52-7d7b-4766-a7ef-51d355bd689e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:35.950982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-efb12c52-7d7b-4766-a7ef-51d355bd689e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:35.951896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-efb12c52-7d7b-4766-a7ef-51d355bd689e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:36.196811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eb4d126c-a820-44af-9694-f252c26fde50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:36.208923 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eb4d126c-a820-44af-9694-f252c26fde50 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1500 microversion: 2.1 time: 0.369046 Aug 03 02:15:36.209553 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2378/4863] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:35 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1500 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:36.214307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8039248e-c9c7-4e29-9c3b-67e3dd3da807 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:36.234186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8039248e-c9c7-4e29-9c3b-67e3dd3da807 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:36.234642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8039248e-c9c7-4e29-9c3b-67e3dd3da807 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:36.276041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8039248e-c9c7-4e29-9c3b-67e3dd3da807 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Going to try to stop instance {{(pid=125942) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 02:15:36.407892 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8039248e-c9c7-4e29-9c3b-67e3dd3da807 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.196933 Aug 03 02:15:36.411816 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2379/4864] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:15:36 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:15:36.432352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-027416f3-5d3a-49e2-a683-87b633512da9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:36.434287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-027416f3-5d3a-49e2-a683-87b633512da9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:36.452559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-027416f3-5d3a-49e2-a683-87b633512da9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:36.454198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-027416f3-5d3a-49e2-a683-87b633512da9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:36.455279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-027416f3-5d3a-49e2-a683-87b633512da9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:36.456155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-027416f3-5d3a-49e2-a683-87b633512da9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:36.528292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-efb12c52-7d7b-4766-a7ef-51d355bd689e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:36.552047 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-efb12c52-7d7b-4766-a7ef-51d355bd689e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1521 microversion: 2.1 time: 0.629765 Aug 03 02:15:36.553125 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2486/4865] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:35 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1521 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:36.558592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9df52c10-fa78-4210-a89b-d23edd3f593b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:36.561545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9df52c10-fa78-4210-a89b-d23edd3f593b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:36.573251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9df52c10-fa78-4210-a89b-d23edd3f593b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:36.574116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9df52c10-fa78-4210-a89b-d23edd3f593b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:36.583675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9df52c10-fa78-4210-a89b-d23edd3f593b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:36.584521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9df52c10-fa78-4210-a89b-d23edd3f593b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:36.608517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-027416f3-5d3a-49e2-a683-87b633512da9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:36.621456 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-027416f3-5d3a-49e2-a683-87b633512da9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1323 microversion: 2.1 time: 0.201296 Aug 03 02:15:36.621456 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2380/4866] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:36 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:36.651855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-1327b52b-2ea6-42ea-8960-51b85eda8126 req-c33108fe-be86-469c-956a-cf8e299bb655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fab028e-e051-4211-8db2-a9b9c38481f3", "name": "network-vif-unplugged", "status": "completed", "tag": "318b5b96-bc6c-430f-a6ca-ed4d571d1267"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:36.675154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1327b52b-2ea6-42ea-8960-51b85eda8126 req-c33108fe-be86-469c-956a-cf8e299bb655 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:36.676640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1327b52b-2ea6-42ea-8960-51b85eda8126 req-c33108fe-be86-469c-956a-cf8e299bb655 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:36.728831 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-1327b52b-2ea6-42ea-8960-51b85eda8126 req-c33108fe-be86-469c-956a-cf8e299bb655 service nova] Creating event network-vif-unplugged:318b5b96-bc6c-430f-a6ca-ed4d571d1267 for instance 4fab028e-e051-4211-8db2-a9b9c38481f3 on n-h1-826529-8 Aug 03 02:15:36.740127 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-1327b52b-2ea6-42ea-8960-51b85eda8126 req-c33108fe-be86-469c-956a-cf8e299bb655 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100057 Aug 03 02:15:36.747383 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2381/4867] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:15:36.762558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cded87c9-cbaf-4bba-b68c-05e7f5aeead3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:36.763299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cded87c9-cbaf-4bba-b68c-05e7f5aeead3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:36.789417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cded87c9-cbaf-4bba-b68c-05e7f5aeead3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:36.789974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cded87c9-cbaf-4bba-b68c-05e7f5aeead3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:36.792305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cded87c9-cbaf-4bba-b68c-05e7f5aeead3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:36.793027 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cded87c9-cbaf-4bba-b68c-05e7f5aeead3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:37.185677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cded87c9-cbaf-4bba-b68c-05e7f5aeead3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:37.202573 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cded87c9-cbaf-4bba-b68c-05e7f5aeead3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 0.451457 Aug 03 02:15:37.213218 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2382/4868] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:36 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:37.228173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9df52c10-fa78-4210-a89b-d23edd3f593b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:37.243572 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9df52c10-fa78-4210-a89b-d23edd3f593b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1500 microversion: 2.1 time: 0.686940 Aug 03 02:15:37.248288 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2487/4869] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:36 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1500 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:37.273953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-78faa8f1-55f7-4345-8f05-dc3f5b13f1ab tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:37.289734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78faa8f1-55f7-4345-8f05-dc3f5b13f1ab tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:37.290197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78faa8f1-55f7-4345-8f05-dc3f5b13f1ab tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:37.411643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-78faa8f1-55f7-4345-8f05-dc3f5b13f1ab tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Going to try to stop instance {{(pid=125942) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 02:15:37.506280 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-78faa8f1-55f7-4345-8f05-dc3f5b13f1ab tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "POST /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644/action" status: 202 len: 0 microversion: 2.1 time: 0.218467 Aug 03 02:15:37.509989 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2383/4870] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:15:37 2022] POST /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:15:37.523838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fd0c17a1-b80b-4bff-8de7-330793d89809 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:37.523838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fd0c17a1-b80b-4bff-8de7-330793d89809 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:37.540105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd0c17a1-b80b-4bff-8de7-330793d89809 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:37.540800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd0c17a1-b80b-4bff-8de7-330793d89809 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:37.541339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd0c17a1-b80b-4bff-8de7-330793d89809 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:37.541778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd0c17a1-b80b-4bff-8de7-330793d89809 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:37.574412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-546a3ba9-b0b0-4cac-8563-a1b9b0a6ed62 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:37.575101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-546a3ba9-b0b0-4cac-8563-a1b9b0a6ed62 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:37.594575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-546a3ba9-b0b0-4cac-8563-a1b9b0a6ed62 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:37.595077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-546a3ba9-b0b0-4cac-8563-a1b9b0a6ed62 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:37.605883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-546a3ba9-b0b0-4cac-8563-a1b9b0a6ed62 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:37.606461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-546a3ba9-b0b0-4cac-8563-a1b9b0a6ed62 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:38.033685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-546a3ba9-b0b0-4cac-8563-a1b9b0a6ed62 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:38.051805 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-546a3ba9-b0b0-4cac-8563-a1b9b0a6ed62 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1521 microversion: 2.1 time: 0.481483 Aug 03 02:15:38.073765 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2384/4871] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:37 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1521 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:38.086619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fd0c17a1-b80b-4bff-8de7-330793d89809 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:38.088155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f0d3d504-2a3c-4d2a-adbf-8fee4bee4474 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:38.088790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f0d3d504-2a3c-4d2a-adbf-8fee4bee4474 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:38.096036 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fd0c17a1-b80b-4bff-8de7-330793d89809 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 0.581264 Aug 03 02:15:38.099522 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2488/4872] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:37 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:38.110120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f0d3d504-2a3c-4d2a-adbf-8fee4bee4474 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:38.110589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f0d3d504-2a3c-4d2a-adbf-8fee4bee4474 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:38.113662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f0d3d504-2a3c-4d2a-adbf-8fee4bee4474 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:38.115053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f0d3d504-2a3c-4d2a-adbf-8fee4bee4474 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:38.239467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-96df14d4-1c06-4d8e-bfd3-20aba3d3c78c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:38.240629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-96df14d4-1c06-4d8e-bfd3-20aba3d3c78c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:38.255918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96df14d4-1c06-4d8e-bfd3-20aba3d3c78c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:38.257019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96df14d4-1c06-4d8e-bfd3-20aba3d3c78c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:38.258169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96df14d4-1c06-4d8e-bfd3-20aba3d3c78c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:38.263831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96df14d4-1c06-4d8e-bfd3-20aba3d3c78c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:38.772317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-96df14d4-1c06-4d8e-bfd3-20aba3d3c78c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:38.782032 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-96df14d4-1c06-4d8e-bfd3-20aba3d3c78c tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 0.548131 Aug 03 02:15:38.787980 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2489/4873] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:38 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:38.799516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f0d3d504-2a3c-4d2a-adbf-8fee4bee4474 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:38.813926 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f0d3d504-2a3c-4d2a-adbf-8fee4bee4474 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1391 microversion: 2.1 time: 0.737900 Aug 03 02:15:38.826930 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2385/4874] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:38 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1391 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:39.077295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-39fbf110-a9ae-4ac5-bcc0-9e77afac65a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:39.078280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-39fbf110-a9ae-4ac5-bcc0-9e77afac65a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:39.101078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39fbf110-a9ae-4ac5-bcc0-9e77afac65a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:39.102478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39fbf110-a9ae-4ac5-bcc0-9e77afac65a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:39.104453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39fbf110-a9ae-4ac5-bcc0-9e77afac65a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:39.107915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39fbf110-a9ae-4ac5-bcc0-9e77afac65a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:39.122895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0afdf33e-b6e6-4d2b-8836-90d854d808af tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:39.123657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0afdf33e-b6e6-4d2b-8836-90d854d808af tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:39.143429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0afdf33e-b6e6-4d2b-8836-90d854d808af tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:39.143903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0afdf33e-b6e6-4d2b-8836-90d854d808af tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:39.148733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0afdf33e-b6e6-4d2b-8836-90d854d808af tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:39.149207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0afdf33e-b6e6-4d2b-8836-90d854d808af tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:39.714112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0afdf33e-b6e6-4d2b-8836-90d854d808af tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:39.730106 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0afdf33e-b6e6-4d2b-8836-90d854d808af tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 0.613163 Aug 03 02:15:39.734139 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2386/4875] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:39 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:39.781277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-39fbf110-a9ae-4ac5-bcc0-9e77afac65a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:39.793311 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-39fbf110-a9ae-4ac5-bcc0-9e77afac65a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1521 microversion: 2.1 time: 0.720052 Aug 03 02:15:39.796189 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2490/4876] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:39 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1521 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:39.811036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-62d32d13-5fd7-4ebe-b849-eaa794346075 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:39.812037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-62d32d13-5fd7-4ebe-b849-eaa794346075 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:39.828443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62d32d13-5fd7-4ebe-b849-eaa794346075 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:39.828999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62d32d13-5fd7-4ebe-b849-eaa794346075 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:39.831563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62d32d13-5fd7-4ebe-b849-eaa794346075 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:39.833047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62d32d13-5fd7-4ebe-b849-eaa794346075 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:39.837992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3751904e-cb1b-4ceb-a097-af98d0d05ae3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:39.838630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3751904e-cb1b-4ceb-a097-af98d0d05ae3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:39.845243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3751904e-cb1b-4ceb-a097-af98d0d05ae3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:39.854103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3751904e-cb1b-4ceb-a097-af98d0d05ae3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:39.862654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3751904e-cb1b-4ceb-a097-af98d0d05ae3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:39.864138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3751904e-cb1b-4ceb-a097-af98d0d05ae3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:40.819376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-62d32d13-5fd7-4ebe-b849-eaa794346075 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:40.821016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3751904e-cb1b-4ceb-a097-af98d0d05ae3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:40.831492 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3751904e-cb1b-4ceb-a097-af98d0d05ae3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1391 microversion: 2.1 time: 0.997952 Aug 03 02:15:40.837084 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2491/4877] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:39 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1391 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:40.846678 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-62d32d13-5fd7-4ebe-b849-eaa794346075 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 1.039481 Aug 03 02:15:40.848586 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2387/4878] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:39 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:40.849862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-6c9952fb-407b-4e18-83e3-339e8f593d80 req-533abcfe-b5e8-465a-b727-b6f294395bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fab028e-e051-4211-8db2-a9b9c38481f3", "name": "network-vif-plugged", "status": "completed", "tag": "318b5b96-bc6c-430f-a6ca-ed4d571d1267"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:40.866240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6c9952fb-407b-4e18-83e3-339e8f593d80 req-533abcfe-b5e8-465a-b727-b6f294395bac service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:40.867773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-51765c79-955a-4ec9-8aa3-a24e1044d52c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:40.869450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6c9952fb-407b-4e18-83e3-339e8f593d80 req-533abcfe-b5e8-465a-b727-b6f294395bac service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:40.872913 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-51765c79-955a-4ec9-8aa3-a24e1044d52c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:40.884755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51765c79-955a-4ec9-8aa3-a24e1044d52c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:40.885525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51765c79-955a-4ec9-8aa3-a24e1044d52c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:40.886719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51765c79-955a-4ec9-8aa3-a24e1044d52c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:40.887355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51765c79-955a-4ec9-8aa3-a24e1044d52c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:40.892411 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-6c9952fb-407b-4e18-83e3-339e8f593d80 req-533abcfe-b5e8-465a-b727-b6f294395bac service nova] Creating event network-vif-plugged:318b5b96-bc6c-430f-a6ca-ed4d571d1267 for instance 4fab028e-e051-4211-8db2-a9b9c38481f3 on n-h1-826529-8 Aug 03 02:15:40.900212 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-6c9952fb-407b-4e18-83e3-339e8f593d80 req-533abcfe-b5e8-465a-b727-b6f294395bac service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061351 Aug 03 02:15:40.901455 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2492/4879] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:15:40.909206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-13a3fc25-4ad0-44cd-8924-3d7596940169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:40.910277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-13a3fc25-4ad0-44cd-8924-3d7596940169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:40.917309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13a3fc25-4ad0-44cd-8924-3d7596940169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:40.918451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13a3fc25-4ad0-44cd-8924-3d7596940169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:40.919482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13a3fc25-4ad0-44cd-8924-3d7596940169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:40.920099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13a3fc25-4ad0-44cd-8924-3d7596940169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:41.881461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-13a3fc25-4ad0-44cd-8924-3d7596940169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:41.905707 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-13a3fc25-4ad0-44cd-8924-3d7596940169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1521 microversion: 2.1 time: 1.000847 Aug 03 02:15:41.908459 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2493/4880] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:40 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1521 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:41.924406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-37014261-3e99-471a-9e1b-604e91920903 req-4c33f526-61e0-4aa5-bb9b-d63f69751387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e4bbb0-7656-402a-9305-ade9e15781fa", "tag": "b6a555d7-75da-4324-9c4c-c241c08c8aad"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:41.924653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:41.944069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-51765c79-955a-4ec9-8aa3-a24e1044d52c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:41.952758 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-51765c79-955a-4ec9-8aa3-a24e1044d52c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 1.101662 Aug 03 02:15:41.955484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-37014261-3e99-471a-9e1b-604e91920903 req-4c33f526-61e0-4aa5-bb9b-d63f69751387 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:41.958590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-37014261-3e99-471a-9e1b-604e91920903 req-4c33f526-61e0-4aa5-bb9b-d63f69751387 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:41.959532 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2388/4881] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:40 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:41.964998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5d1cd23d-d307-479f-91c3-8ff775befe90 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:41.973238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5d1cd23d-d307-479f-91c3-8ff775befe90 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:41.989676 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-37014261-3e99-471a-9e1b-604e91920903 req-4c33f526-61e0-4aa5-bb9b-d63f69751387 service nova] Creating event network-changed:b6a555d7-75da-4324-9c4c-c241c08c8aad for instance b1e4bbb0-7656-402a-9305-ade9e15781fa on n-h2-826529-8 Aug 03 02:15:41.992515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d1cd23d-d307-479f-91c3-8ff775befe90 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:41.993108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d1cd23d-d307-479f-91c3-8ff775befe90 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:41.994024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d1cd23d-d307-479f-91c3-8ff775befe90 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:41.994574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d1cd23d-d307-479f-91c3-8ff775befe90 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:41.998318 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-37014261-3e99-471a-9e1b-604e91920903 req-4c33f526-61e0-4aa5-bb9b-d63f69751387 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086004 Aug 03 02:15:41.999629 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2494/4882] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:15:42.010095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-55f6ccc3-ac10-460d-80b2-118b23ab4c7d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:42.011654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-55f6ccc3-ac10-460d-80b2-118b23ab4c7d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:42.024865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55f6ccc3-ac10-460d-80b2-118b23ab4c7d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:42.031868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:42.042691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:42.045102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55f6ccc3-ac10-460d-80b2-118b23ab4c7d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:42.049953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55f6ccc3-ac10-460d-80b2-118b23ab4c7d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:42.051072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55f6ccc3-ac10-460d-80b2-118b23ab4c7d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:42.881914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5d1cd23d-d307-479f-91c3-8ff775befe90 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:42.895355 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5d1cd23d-d307-479f-91c3-8ff775befe90 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1391 microversion: 2.1 time: 0.932951 Aug 03 02:15:42.898164 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2389/4883] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:41 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1391 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:42.906249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-55f6ccc3-ac10-460d-80b2-118b23ab4c7d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:42.918329 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-55f6ccc3-ac10-460d-80b2-118b23ab4c7d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 0.917278 Aug 03 02:15:42.919981 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2495/4884] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:41 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:42.937846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-52a586ef-ced7-4487-96fb-c6edd3a2132b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:42.937846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-52a586ef-ced7-4487-96fb-c6edd3a2132b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:42.951047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52a586ef-ced7-4487-96fb-c6edd3a2132b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:42.951636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52a586ef-ced7-4487-96fb-c6edd3a2132b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:42.952737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52a586ef-ced7-4487-96fb-c6edd3a2132b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:42.953399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52a586ef-ced7-4487-96fb-c6edd3a2132b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:42.986433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-00bbcaf5-46d3-452e-a681-78c086b4a8f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:42.987306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-00bbcaf5-46d3-452e-a681-78c086b4a8f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:43.002310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00bbcaf5-46d3-452e-a681-78c086b4a8f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:43.008175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00bbcaf5-46d3-452e-a681-78c086b4a8f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:43.009379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00bbcaf5-46d3-452e-a681-78c086b4a8f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:43.011006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00bbcaf5-46d3-452e-a681-78c086b4a8f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:43.386855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:43.529167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-00bbcaf5-46d3-452e-a681-78c086b4a8f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:43.542041 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-00bbcaf5-46d3-452e-a681-78c086b4a8f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 0.559782 Aug 03 02:15:43.543861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-52a586ef-ced7-4487-96fb-c6edd3a2132b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:43.560676 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2496/4885] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:42 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:43.561363 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-52a586ef-ced7-4487-96fb-c6edd3a2132b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1506 microversion: 2.1 time: 0.628542 Aug 03 02:15:43.562839 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2390/4886] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:42 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1506 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:43.600585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dfde49b6-685d-47d4-93a2-58924bd1b64c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:43.601280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dfde49b6-685d-47d4-93a2-58924bd1b64c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:43.628272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfde49b6-685d-47d4-93a2-58924bd1b64c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:43.636340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfde49b6-685d-47d4-93a2-58924bd1b64c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:43.637273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfde49b6-685d-47d4-93a2-58924bd1b64c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:43.637743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfde49b6-685d-47d4-93a2-58924bd1b64c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:43.924322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ee1bb070-70c1-4f2c-9bb4-8f82b0926f37 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:43.925048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ee1bb070-70c1-4f2c-9bb4-8f82b0926f37 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:43.943997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee1bb070-70c1-4f2c-9bb4-8f82b0926f37 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:43.949190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee1bb070-70c1-4f2c-9bb4-8f82b0926f37 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:43.963844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee1bb070-70c1-4f2c-9bb4-8f82b0926f37 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:43.966253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee1bb070-70c1-4f2c-9bb4-8f82b0926f37 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:44.028863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dfde49b6-685d-47d4-93a2-58924bd1b64c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:44.044243 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dfde49b6-685d-47d4-93a2-58924bd1b64c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 200 len: 1506 microversion: 2.1 time: 0.460821 Aug 03 02:15:44.087475 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2497/4887] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:43 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:44.101069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-48e8f2a3-5679-47b6-b72f-a862179235f3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:44.101582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-48e8f2a3-5679-47b6-b72f-a862179235f3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:44.113522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48e8f2a3-5679-47b6-b72f-a862179235f3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:44.114452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48e8f2a3-5679-47b6-b72f-a862179235f3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:44.115503 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48e8f2a3-5679-47b6-b72f-a862179235f3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:44.116125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48e8f2a3-5679-47b6-b72f-a862179235f3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:44.433929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ee1bb070-70c1-4f2c-9bb4-8f82b0926f37 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:44.451226 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ee1bb070-70c1-4f2c-9bb4-8f82b0926f37 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1391 microversion: 2.1 time: 0.533024 Aug 03 02:15:44.490720 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2391/4888] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:43 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1391 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:44.494817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4f590a7d-1d07-485f-9de5-ea63e0a50eaf tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:44.495588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4f590a7d-1d07-485f-9de5-ea63e0a50eaf tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:44.513449 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f590a7d-1d07-485f-9de5-ea63e0a50eaf tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:44.514190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f590a7d-1d07-485f-9de5-ea63e0a50eaf tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:44.515690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f590a7d-1d07-485f-9de5-ea63e0a50eaf tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:44.516338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4f590a7d-1d07-485f-9de5-ea63e0a50eaf tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:44.548698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-48e8f2a3-5679-47b6-b72f-a862179235f3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:44.575932 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-48e8f2a3-5679-47b6-b72f-a862179235f3 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 0.487162 Aug 03 02:15:44.578674 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2498/4889] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:44 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:44.592111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9c3e1da6-deba-4e8a-990d-4f9d3a218b80 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:44.594854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9c3e1da6-deba-4e8a-990d-4f9d3a218b80 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:44.601639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4f590a7d-1d07-485f-9de5-ea63e0a50eaf tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:15:44.627626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c3e1da6-deba-4e8a-990d-4f9d3a218b80 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:44.634075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c3e1da6-deba-4e8a-990d-4f9d3a218b80 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:44.638470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c3e1da6-deba-4e8a-990d-4f9d3a218b80 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:44.648414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c3e1da6-deba-4e8a-990d-4f9d3a218b80 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:44.837699 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4f590a7d-1d07-485f-9de5-ea63e0a50eaf tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 204 len: 0 microversion: 2.1 time: 0.353286 Aug 03 02:15:44.838726 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2392/4890] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:15:44 2022] DELETE /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:15:45.211796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9c3e1da6-deba-4e8a-990d-4f9d3a218b80 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:45.246993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1534763168", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "69b64e9a-4561-417b-8cc4-06f6cdef9e73"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:45.263764 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9c3e1da6-deba-4e8a-990d-4f9d3a218b80 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 0.676724 Aug 03 02:15:45.269546 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2499/4891] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:44 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:45.420398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] validate_networks() for [('69b64e9a-4561-417b-8cc4-06f6cdef9e73', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:15:45.527861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-73036267-5617-4c62-b5ae-77ab73df1fea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:45.528656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-73036267-5617-4c62-b5ae-77ab73df1fea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:45.542382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73036267-5617-4c62-b5ae-77ab73df1fea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:45.542982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73036267-5617-4c62-b5ae-77ab73df1fea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:45.545374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73036267-5617-4c62-b5ae-77ab73df1fea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:45.546061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73036267-5617-4c62-b5ae-77ab73df1fea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:46.028999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-73036267-5617-4c62-b5ae-77ab73df1fea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:46.038044 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-73036267-5617-4c62-b5ae-77ab73df1fea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1391 microversion: 2.1 time: 0.516202 Aug 03 02:15:46.051471 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2500/4892] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:45 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1391 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:46.051471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c368b2f0-0a12-4a66-a19a-a8434b07901d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:46.051471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c368b2f0-0a12-4a66-a19a-a8434b07901d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:46.073122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c368b2f0-0a12-4a66-a19a-a8434b07901d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:46.073580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c368b2f0-0a12-4a66-a19a-a8434b07901d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:46.074535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c368b2f0-0a12-4a66-a19a-a8434b07901d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:46.075425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c368b2f0-0a12-4a66-a19a-a8434b07901d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:47.419389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:15:47.420775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:15:47.421646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:15:47.422534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:15:47.423345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:15:47.448279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:47.452965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:47.455705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:47.457627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:47.532219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Getting quotas for project dd9b137660a84e1bb2faa6301d569b57. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:15:47.545643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c368b2f0-0a12-4a66-a19a-a8434b07901d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:47.547658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Getting quotas for user 19e7dbdb6aef40abba7ba06046b87c95 and project dd9b137660a84e1bb2faa6301d569b57. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:15:47.573213 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c368b2f0-0a12-4a66-a19a-a8434b07901d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1678 microversion: 2.1 time: 1.526402 Aug 03 02:15:47.574853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:15:47.589253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:15:47.603385 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2501/4893] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:46 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1678 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:47.609927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7184a1b4-4021-4ad4-8a59-74347e8c6ff6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:47.610547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7184a1b4-4021-4ad4-8a59-74347e8c6ff6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:47.637910 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7184a1b4-4021-4ad4-8a59-74347e8c6ff6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:47.638426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7184a1b4-4021-4ad4-8a59-74347e8c6ff6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:47.645821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7184a1b4-4021-4ad4-8a59-74347e8c6ff6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:47.646637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7184a1b4-4021-4ad4-8a59-74347e8c6ff6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:47.723506 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e4792773-d0b9-443a-925d-069df9499e7d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.480526 Aug 03 02:15:47.730857 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2393/4894] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:15:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 02:15:47.744304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0d32e875-44e4-481f-8c20-fe8b33ecfb6a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:47.756576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0d32e875-44e4-481f-8c20-fe8b33ecfb6a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:47.780946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d32e875-44e4-481f-8c20-fe8b33ecfb6a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:47.781788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d32e875-44e4-481f-8c20-fe8b33ecfb6a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:47.782955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d32e875-44e4-481f-8c20-fe8b33ecfb6a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:47.783648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d32e875-44e4-481f-8c20-fe8b33ecfb6a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:48.891797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0d32e875-44e4-481f-8c20-fe8b33ecfb6a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:48.905710 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0d32e875-44e4-481f-8c20-fe8b33ecfb6a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1391 microversion: 2.1 time: 1.173247 Aug 03 02:15:48.906316 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2394/4895] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:47 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1391 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:48.916908 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a11d7cdf-a954-4115-8111-1bf61adeed97 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:48.922415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a11d7cdf-a954-4115-8111-1bf61adeed97 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:48.944682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a11d7cdf-a954-4115-8111-1bf61adeed97 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:48.946567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a11d7cdf-a954-4115-8111-1bf61adeed97 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:48.947707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a11d7cdf-a954-4115-8111-1bf61adeed97 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:48.948383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a11d7cdf-a954-4115-8111-1bf61adeed97 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:49.084367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7184a1b4-4021-4ad4-8a59-74347e8c6ff6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:49.130696 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7184a1b4-4021-4ad4-8a59-74347e8c6ff6 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 1.519256 Aug 03 02:15:49.135144 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2502/4896] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:47 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:49.152877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-019992df-f7ac-40cb-b4fe-866eff1f7244 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:49.155218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-019992df-f7ac-40cb-b4fe-866eff1f7244 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:49.184977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-019992df-f7ac-40cb-b4fe-866eff1f7244 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:49.186162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-019992df-f7ac-40cb-b4fe-866eff1f7244 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:49.189151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-019992df-f7ac-40cb-b4fe-866eff1f7244 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:49.193580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-019992df-f7ac-40cb-b4fe-866eff1f7244 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:49.204918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a11d7cdf-a954-4115-8111-1bf61adeed97 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:49.227681 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a11d7cdf-a954-4115-8111-1bf61adeed97 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1222 microversion: 2.1 time: 0.312839 Aug 03 02:15:49.228532 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2395/4897] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:48 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1222 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:49.233512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-7baa0d45-15ab-4e0f-812c-cb7481f7556b req-809d4508-e26f-4a6b-8112-11981af2616a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fab028e-e051-4211-8db2-a9b9c38481f3", "name": "network-vif-deleted", "tag": "318b5b96-bc6c-430f-a6ca-ed4d571d1267"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:49.242797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:49.286934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7baa0d45-15ab-4e0f-812c-cb7481f7556b req-809d4508-e26f-4a6b-8112-11981af2616a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:49.294306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7baa0d45-15ab-4e0f-812c-cb7481f7556b req-809d4508-e26f-4a6b-8112-11981af2616a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:49.356734 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-7baa0d45-15ab-4e0f-812c-cb7481f7556b req-809d4508-e26f-4a6b-8112-11981af2616a service nova] Creating event network-vif-deleted:318b5b96-bc6c-430f-a6ca-ed4d571d1267 for instance 4fab028e-e051-4211-8db2-a9b9c38481f3 on n-h1-826529-8 Aug 03 02:15:49.399432 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-7baa0d45-15ab-4e0f-812c-cb7481f7556b req-809d4508-e26f-4a6b-8112-11981af2616a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169341 Aug 03 02:15:49.402408 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2396/4898] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:15:49.461230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-019992df-f7ac-40cb-b4fe-866eff1f7244 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:49.477147 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-019992df-f7ac-40cb-b4fe-866eff1f7244 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1655 microversion: 2.1 time: 0.339694 Aug 03 02:15:49.491073 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2503/4899] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:49 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1655 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:49.511453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e8754728-1976-40ff-8683-4d02eb89d1e6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:49.525679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8754728-1976-40ff-8683-4d02eb89d1e6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:49.526376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8754728-1976-40ff-8683-4d02eb89d1e6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:49.575928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e8754728-1976-40ff-8683-4d02eb89d1e6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Going to try to start instance {{(pid=125942) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 02:15:49.662371 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e8754728-1976-40ff-8683-4d02eb89d1e6 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.156191 Aug 03 02:15:49.666935 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2397/4900] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:15:49 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:15:49.671842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-09595603-a71d-4b01-925f-061aba1baf81 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:49.672465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-09595603-a71d-4b01-925f-061aba1baf81 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:49.685828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-09595603-a71d-4b01-925f-061aba1baf81 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:49.687036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-09595603-a71d-4b01-925f-061aba1baf81 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:49.688035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-09595603-a71d-4b01-925f-061aba1baf81 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:49.688478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-09595603-a71d-4b01-925f-061aba1baf81 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:49.940831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-abd85d18-9754-46c8-aa20-4e6b192e0000 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:49.941678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-abd85d18-9754-46c8-aa20-4e6b192e0000 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:49.954476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abd85d18-9754-46c8-aa20-4e6b192e0000 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:49.955295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abd85d18-9754-46c8-aa20-4e6b192e0000 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:49.963647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abd85d18-9754-46c8-aa20-4e6b192e0000 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:49.963905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abd85d18-9754-46c8-aa20-4e6b192e0000 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:50.178208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-09595603-a71d-4b01-925f-061aba1baf81 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:50.193596 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-09595603-a71d-4b01-925f-061aba1baf81 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1664 microversion: 2.1 time: 0.525671 Aug 03 02:15:50.201854 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2504/4901] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:49 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1664 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:50.226103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0fcb0d03-29f9-4c6a-975b-dff78b106b70 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:50.232500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0fcb0d03-29f9-4c6a-975b-dff78b106b70 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:50.247954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0fcb0d03-29f9-4c6a-975b-dff78b106b70 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:50.248422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0fcb0d03-29f9-4c6a-975b-dff78b106b70 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:50.249227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0fcb0d03-29f9-4c6a-975b-dff78b106b70 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:50.249676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0fcb0d03-29f9-4c6a-975b-dff78b106b70 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:50.354771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-abd85d18-9754-46c8-aa20-4e6b192e0000 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:50.375920 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-abd85d18-9754-46c8-aa20-4e6b192e0000 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1391 microversion: 2.1 time: 0.449075 Aug 03 02:15:50.396571 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2398/4902] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:49 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1391 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:50.415437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-386d4a83-9456-406f-8fb4-afd056a85ac8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:50.417661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-386d4a83-9456-406f-8fb4-afd056a85ac8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:50.436051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-386d4a83-9456-406f-8fb4-afd056a85ac8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:50.439541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-386d4a83-9456-406f-8fb4-afd056a85ac8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:50.442971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-386d4a83-9456-406f-8fb4-afd056a85ac8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:50.444392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-386d4a83-9456-406f-8fb4-afd056a85ac8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:50.734131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-386d4a83-9456-406f-8fb4-afd056a85ac8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:50.754030 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-386d4a83-9456-406f-8fb4-afd056a85ac8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1278 microversion: 2.1 time: 0.353854 Aug 03 02:15:50.755280 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2399/4903] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:50 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1278 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:50.795313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0fcb0d03-29f9-4c6a-975b-dff78b106b70 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:50.804683 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0fcb0d03-29f9-4c6a-975b-dff78b106b70 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 0.601650 Aug 03 02:15:50.811746 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2505/4904] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:50 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:51.406350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9f83d016-ae25-40dd-a14b-fba80d051b95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:51.408216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9f83d016-ae25-40dd-a14b-fba80d051b95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:51.429331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f83d016-ae25-40dd-a14b-fba80d051b95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:51.429794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f83d016-ae25-40dd-a14b-fba80d051b95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:51.430818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f83d016-ae25-40dd-a14b-fba80d051b95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:51.431310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f83d016-ae25-40dd-a14b-fba80d051b95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:51.668519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bca79f88-dab4-414e-bd0d-2a0d4fb57915 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:51.669031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bca79f88-dab4-414e-bd0d-2a0d4fb57915 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:51.686421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bca79f88-dab4-414e-bd0d-2a0d4fb57915 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:51.687164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bca79f88-dab4-414e-bd0d-2a0d4fb57915 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:51.691112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bca79f88-dab4-414e-bd0d-2a0d4fb57915 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:51.693932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bca79f88-dab4-414e-bd0d-2a0d4fb57915 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:51.873779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9f83d016-ae25-40dd-a14b-fba80d051b95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:51.889023 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9f83d016-ae25-40dd-a14b-fba80d051b95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1391 microversion: 2.1 time: 0.487133 Aug 03 02:15:51.889953 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2506/4905] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:51 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1391 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:51.897748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-e10721c1-69fc-44be-bf27-06f6bf5100b7 req-ece48c05-d031-4a8a-9e2e-deb8afa24375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e4bbb0-7656-402a-9305-ade9e15781fa", "name": "network-vif-plugged", "status": "completed", "tag": "b6a555d7-75da-4324-9c4c-c241c08c8aad"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:51.919382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e10721c1-69fc-44be-bf27-06f6bf5100b7 req-ece48c05-d031-4a8a-9e2e-deb8afa24375 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:51.919771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e10721c1-69fc-44be-bf27-06f6bf5100b7 req-ece48c05-d031-4a8a-9e2e-deb8afa24375 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:51.949356 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-e10721c1-69fc-44be-bf27-06f6bf5100b7 req-ece48c05-d031-4a8a-9e2e-deb8afa24375 service nova] Creating event network-vif-plugged:b6a555d7-75da-4324-9c4c-c241c08c8aad for instance b1e4bbb0-7656-402a-9305-ade9e15781fa on n-h2-826529-8 Aug 03 02:15:51.964373 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-e10721c1-69fc-44be-bf27-06f6bf5100b7 req-ece48c05-d031-4a8a-9e2e-deb8afa24375 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073164 Aug 03 02:15:51.965768 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2507/4906] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:15:51.975697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bca79f88-dab4-414e-bd0d-2a0d4fb57915 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:51.998387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f10711df-a363-4551-bc1f-d9251cbe3b7c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:51.999654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f10711df-a363-4551-bc1f-d9251cbe3b7c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:52.004680 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bca79f88-dab4-414e-bd0d-2a0d4fb57915 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1664 microversion: 2.1 time: 0.783094 Aug 03 02:15:52.007634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f10711df-a363-4551-bc1f-d9251cbe3b7c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:52.008418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f10711df-a363-4551-bc1f-d9251cbe3b7c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:52.009595 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f10711df-a363-4551-bc1f-d9251cbe3b7c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:52.010873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f10711df-a363-4551-bc1f-d9251cbe3b7c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:52.019738 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2400/4907] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:51 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1664 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:52.030181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0210d9bd-eec1-4a75-b6df-59c902e97ec9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:52.030799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0210d9bd-eec1-4a75-b6df-59c902e97ec9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:52.055236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0210d9bd-eec1-4a75-b6df-59c902e97ec9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:52.055690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0210d9bd-eec1-4a75-b6df-59c902e97ec9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:52.056490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0210d9bd-eec1-4a75-b6df-59c902e97ec9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:52.056931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0210d9bd-eec1-4a75-b6df-59c902e97ec9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:52.148276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f10711df-a363-4551-bc1f-d9251cbe3b7c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:52.161394 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f10711df-a363-4551-bc1f-d9251cbe3b7c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1276 microversion: 2.1 time: 0.194063 Aug 03 02:15:52.163595 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2508/4908] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:51 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1276 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:52.320636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0210d9bd-eec1-4a75-b6df-59c902e97ec9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:52.332201 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0210d9bd-eec1-4a75-b6df-59c902e97ec9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 0.310452 Aug 03 02:15:52.333192 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2401/4909] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:52 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:52.914235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8c13affe-f4e5-4f2d-a358-38107bc2c75d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:52.915368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8c13affe-f4e5-4f2d-a358-38107bc2c75d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:52.928526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c13affe-f4e5-4f2d-a358-38107bc2c75d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:52.929056 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c13affe-f4e5-4f2d-a358-38107bc2c75d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:52.931958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c13affe-f4e5-4f2d-a358-38107bc2c75d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:52.932411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c13affe-f4e5-4f2d-a358-38107bc2c75d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:53.047722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-023b976c-c631-493b-b8dc-917404a49360 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:53.049121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-023b976c-c631-493b-b8dc-917404a49360 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:53.057820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-023b976c-c631-493b-b8dc-917404a49360 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:53.058650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-023b976c-c631-493b-b8dc-917404a49360 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:53.059790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-023b976c-c631-493b-b8dc-917404a49360 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:53.060455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-023b976c-c631-493b-b8dc-917404a49360 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:53.151384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8c13affe-f4e5-4f2d-a358-38107bc2c75d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:53.164147 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8c13affe-f4e5-4f2d-a358-38107bc2c75d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1391 microversion: 2.1 time: 0.257427 Aug 03 02:15:53.182550 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2509/4910] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:52 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1391 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:53.197905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7bc1bc61-342d-42e4-a037-0ea0829aea1f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:53.198542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7bc1bc61-342d-42e4-a037-0ea0829aea1f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:53.209988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bc1bc61-342d-42e4-a037-0ea0829aea1f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:53.210765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bc1bc61-342d-42e4-a037-0ea0829aea1f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:53.211769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bc1bc61-342d-42e4-a037-0ea0829aea1f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:53.212380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bc1bc61-342d-42e4-a037-0ea0829aea1f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:53.325241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7bc1bc61-342d-42e4-a037-0ea0829aea1f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:53.336151 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7bc1bc61-342d-42e4-a037-0ea0829aea1f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1276 microversion: 2.1 time: 0.152116 Aug 03 02:15:53.351237 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2510/4911] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:53 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:53.357053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-326b8cc3-cabb-4511-b597-5e711017e736 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:53.357367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-326b8cc3-cabb-4511-b597-5e711017e736 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:53.365382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-326b8cc3-cabb-4511-b597-5e711017e736 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:53.365849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-326b8cc3-cabb-4511-b597-5e711017e736 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:53.367459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-326b8cc3-cabb-4511-b597-5e711017e736 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:53.367643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-326b8cc3-cabb-4511-b597-5e711017e736 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:53.373074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-023b976c-c631-493b-b8dc-917404a49360 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:53.385237 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-023b976c-c631-493b-b8dc-917404a49360 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.341738 Aug 03 02:15:53.386722 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2402/4912] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:53 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:53.413754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-95c0a41c-bf50-4d11-a0ba-bb4fd10d6210 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:53.414831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-95c0a41c-bf50-4d11-a0ba-bb4fd10d6210 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:53.422176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95c0a41c-bf50-4d11-a0ba-bb4fd10d6210 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:53.422978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95c0a41c-bf50-4d11-a0ba-bb4fd10d6210 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:53.423952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95c0a41c-bf50-4d11-a0ba-bb4fd10d6210 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:53.424577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95c0a41c-bf50-4d11-a0ba-bb4fd10d6210 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:53.675960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-95c0a41c-bf50-4d11-a0ba-bb4fd10d6210 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:53.683088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-326b8cc3-cabb-4511-b597-5e711017e736 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:53.693197 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-326b8cc3-cabb-4511-b597-5e711017e736 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 0.340648 Aug 03 02:15:53.694844 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2511/4913] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:53 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:53.696233 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-95c0a41c-bf50-4d11-a0ba-bb4fd10d6210 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.289167 Aug 03 02:15:53.696840 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2403/4914] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:53 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:53.721344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f1960bdf-0362-4d06-8937-0b87c01e386f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:53.730210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f1960bdf-0362-4d06-8937-0b87c01e386f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:53.736964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1960bdf-0362-4d06-8937-0b87c01e386f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:53.739011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1960bdf-0362-4d06-8937-0b87c01e386f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:53.739251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1960bdf-0362-4d06-8937-0b87c01e386f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:53.747342 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1960bdf-0362-4d06-8937-0b87c01e386f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:53.961477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f1960bdf-0362-4d06-8937-0b87c01e386f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:53.969809 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f1960bdf-0362-4d06-8937-0b87c01e386f tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.252918 Aug 03 02:15:53.970421 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2512/4915] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:53 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:53.999546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6e20a5b5-cdc4-4fed-b6a0-c72df3dcef5e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:54.000324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6e20a5b5-cdc4-4fed-b6a0-c72df3dcef5e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:54.010169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6e20a5b5-cdc4-4fed-b6a0-c72df3dcef5e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:54.012597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6e20a5b5-cdc4-4fed-b6a0-c72df3dcef5e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:54.013551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6e20a5b5-cdc4-4fed-b6a0-c72df3dcef5e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:54.020397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6e20a5b5-cdc4-4fed-b6a0-c72df3dcef5e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:54.208694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ec1cdf43-c535-4f73-8bf1-edefc8f013b6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:54.212577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ec1cdf43-c535-4f73-8bf1-edefc8f013b6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:54.233307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec1cdf43-c535-4f73-8bf1-edefc8f013b6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:54.234829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec1cdf43-c535-4f73-8bf1-edefc8f013b6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:54.236083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec1cdf43-c535-4f73-8bf1-edefc8f013b6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:54.236766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec1cdf43-c535-4f73-8bf1-edefc8f013b6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:54.393354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6e20a5b5-cdc4-4fed-b6a0-c72df3dcef5e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:54.398732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:54.415915 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6e20a5b5-cdc4-4fed-b6a0-c72df3dcef5e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.420282 Aug 03 02:15:54.421623 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2404/4916] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:53 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:54.428477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-038decd0-3d20-4ed2-a067-6fc6079b4d04 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:54.440296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-038decd0-3d20-4ed2-a067-6fc6079b4d04 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:54.454593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-038decd0-3d20-4ed2-a067-6fc6079b4d04 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:54.459437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-038decd0-3d20-4ed2-a067-6fc6079b4d04 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:54.460455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-038decd0-3d20-4ed2-a067-6fc6079b4d04 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:54.460879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-038decd0-3d20-4ed2-a067-6fc6079b4d04 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:54.553513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ec1cdf43-c535-4f73-8bf1-edefc8f013b6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:54.563982 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ec1cdf43-c535-4f73-8bf1-edefc8f013b6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1563 microversion: 2.1 time: 0.368737 Aug 03 02:15:54.565033 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2513/4917] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:54 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1563 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:54.571664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-203ef5d6-0f75-4fae-93fa-77f584af32fb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:54.572380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-203ef5d6-0f75-4fae-93fa-77f584af32fb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:54.579302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-203ef5d6-0f75-4fae-93fa-77f584af32fb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:54.579847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-203ef5d6-0f75-4fae-93fa-77f584af32fb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:54.581040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-203ef5d6-0f75-4fae-93fa-77f584af32fb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:54.582327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-203ef5d6-0f75-4fae-93fa-77f584af32fb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:54.695593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-038decd0-3d20-4ed2-a067-6fc6079b4d04 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:54.714476 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-038decd0-3d20-4ed2-a067-6fc6079b4d04 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1318 microversion: 2.1 time: 0.290689 Aug 03 02:15:54.719830 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2405/4918] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:54 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:54.730895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2d6018ec-47f9-4d0c-b21b-915227b10308 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:54.732197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2d6018ec-47f9-4d0c-b21b-915227b10308 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:54.742502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d6018ec-47f9-4d0c-b21b-915227b10308 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:54.744352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d6018ec-47f9-4d0c-b21b-915227b10308 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:54.745421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d6018ec-47f9-4d0c-b21b-915227b10308 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:54.746082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2d6018ec-47f9-4d0c-b21b-915227b10308 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:54.765399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-203ef5d6-0f75-4fae-93fa-77f584af32fb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:54.774631 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-203ef5d6-0f75-4fae-93fa-77f584af32fb tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.207655 Aug 03 02:15:54.779322 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2514/4919] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:54 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:54.792802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3f06f45f-455a-4b28-b3fb-5ded8a0dd740 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:54.793527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3f06f45f-455a-4b28-b3fb-5ded8a0dd740 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:54.801749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f06f45f-455a-4b28-b3fb-5ded8a0dd740 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:54.803476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f06f45f-455a-4b28-b3fb-5ded8a0dd740 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:54.804706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f06f45f-455a-4b28-b3fb-5ded8a0dd740 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:54.805389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f06f45f-455a-4b28-b3fb-5ded8a0dd740 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:54.983119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2d6018ec-47f9-4d0c-b21b-915227b10308 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:55.043504 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2d6018ec-47f9-4d0c-b21b-915227b10308 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1563 microversion: 2.1 time: 0.320361 Aug 03 02:15:55.044106 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2406/4920] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:54 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1563 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:55.049017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-52dc6485-edf8-4825-84ad-b23f892b144e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:55.051657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-52dc6485-edf8-4825-84ad-b23f892b144e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:55.064590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52dc6485-edf8-4825-84ad-b23f892b144e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:55.065811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52dc6485-edf8-4825-84ad-b23f892b144e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:55.066819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52dc6485-edf8-4825-84ad-b23f892b144e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:55.067613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52dc6485-edf8-4825-84ad-b23f892b144e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:55.068203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3f06f45f-455a-4b28-b3fb-5ded8a0dd740 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:55.086251 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3f06f45f-455a-4b28-b3fb-5ded8a0dd740 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 0.298671 Aug 03 02:15:55.087104 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2515/4921] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:54 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:55.115090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-52dc6485-edf8-4825-84ad-b23f892b144e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lazy-loading 'flavor' on Instance uuid b9952a14-056b-4b74-ab8c-791d16592ddf {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:15:55.199734 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-52dc6485-edf8-4825-84ad-b23f892b144e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.154162 Aug 03 02:15:55.200885 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2407/4922] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:15:55 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:15:55.211663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-41ecbe27-e2f7-4ceb-be98-f530c66c8000 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:55.212300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-41ecbe27-e2f7-4ceb-be98-f530c66c8000 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:55.221239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41ecbe27-e2f7-4ceb-be98-f530c66c8000 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:55.222932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41ecbe27-e2f7-4ceb-be98-f530c66c8000 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:55.224014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41ecbe27-e2f7-4ceb-be98-f530c66c8000 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:55.224625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41ecbe27-e2f7-4ceb-be98-f530c66c8000 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:55.424178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-41ecbe27-e2f7-4ceb-be98-f530c66c8000 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:55.434144 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-41ecbe27-e2f7-4ceb-be98-f530c66c8000 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1676 microversion: 2.1 time: 0.228147 Aug 03 02:15:55.452833 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2516/4923] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:55 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:55.743991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2514a4c4-f79e-45de-aaf0-2e9aa31f830d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:55.744716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2514a4c4-f79e-45de-aaf0-2e9aa31f830d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:55.752331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2514a4c4-f79e-45de-aaf0-2e9aa31f830d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:55.753352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2514a4c4-f79e-45de-aaf0-2e9aa31f830d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:55.754385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2514a4c4-f79e-45de-aaf0-2e9aa31f830d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:55.756785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2514a4c4-f79e-45de-aaf0-2e9aa31f830d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:55.927439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2514a4c4-f79e-45de-aaf0-2e9aa31f830d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:55.941284 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2514a4c4-f79e-45de-aaf0-2e9aa31f830d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1318 microversion: 2.1 time: 0.200902 Aug 03 02:15:55.942833 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2408/4924] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:55 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:56.110332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9f30c100-85d2-4335-87bf-c2d716e27fcc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:56.111437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9f30c100-85d2-4335-87bf-c2d716e27fcc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:56.121175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f30c100-85d2-4335-87bf-c2d716e27fcc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:56.121675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f30c100-85d2-4335-87bf-c2d716e27fcc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:56.122800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f30c100-85d2-4335-87bf-c2d716e27fcc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:56.123770 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f30c100-85d2-4335-87bf-c2d716e27fcc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:56.272779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9f30c100-85d2-4335-87bf-c2d716e27fcc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:56.283356 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9f30c100-85d2-4335-87bf-c2d716e27fcc tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 0.176227 Aug 03 02:15:56.285057 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2517/4925] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:56 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:56.460735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93446473-94da-436a-a78b-7f109c13ae68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:56.461589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93446473-94da-436a-a78b-7f109c13ae68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:56.476170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93446473-94da-436a-a78b-7f109c13ae68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:56.477579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93446473-94da-436a-a78b-7f109c13ae68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:56.478393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93446473-94da-436a-a78b-7f109c13ae68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:56.479045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93446473-94da-436a-a78b-7f109c13ae68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:56.781317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-42c71434-0103-4e9f-9478-6e3d4d505526 req-9661d28d-f4c8-4d6c-a5c8-1cec54d04a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ebf6377-6b2d-437d-b7b9-15d48d084420", "tag": "0a1e75bd-2f9b-4dd3-b10c-503f365f0667"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:56.805113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-42c71434-0103-4e9f-9478-6e3d4d505526 req-9661d28d-f4c8-4d6c-a5c8-1cec54d04a94 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:56.805876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-42c71434-0103-4e9f-9478-6e3d4d505526 req-9661d28d-f4c8-4d6c-a5c8-1cec54d04a94 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:56.841737 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-42c71434-0103-4e9f-9478-6e3d4d505526 req-9661d28d-f4c8-4d6c-a5c8-1cec54d04a94 service nova] Creating event network-changed:0a1e75bd-2f9b-4dd3-b10c-503f365f0667 for instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 on n-h1-826529-8 Aug 03 02:15:56.853724 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-42c71434-0103-4e9f-9478-6e3d4d505526 req-9661d28d-f4c8-4d6c-a5c8-1cec54d04a94 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077286 Aug 03 02:15:56.856478 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2518/4926] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:15:56.955193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-93446473-94da-436a-a78b-7f109c13ae68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:56.974834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9b5dacb3-f93e-4d4c-a4f0-e2579d1b8ab3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:56.976269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9b5dacb3-f93e-4d4c-a4f0-e2579d1b8ab3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:56.982937 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93446473-94da-436a-a78b-7f109c13ae68 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1659 microversion: 2.1 time: 0.526830 Aug 03 02:15:56.989497 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2409/4927] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:56 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1659 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:57.002386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b5dacb3-f93e-4d4c-a4f0-e2579d1b8ab3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:57.006220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b5dacb3-f93e-4d4c-a4f0-e2579d1b8ab3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:57.016689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b5dacb3-f93e-4d4c-a4f0-e2579d1b8ab3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:57.024549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9b5dacb3-f93e-4d4c-a4f0-e2579d1b8ab3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:57.033729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-01e6825f-51d7-463f-92cc-96fc9be754ef tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:15:57.044205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-01e6825f-51d7-463f-92cc-96fc9be754ef tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:57.083401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01e6825f-51d7-463f-92cc-96fc9be754ef tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:57.086362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01e6825f-51d7-463f-92cc-96fc9be754ef tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:57.088140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01e6825f-51d7-463f-92cc-96fc9be754ef tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:57.101307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01e6825f-51d7-463f-92cc-96fc9be754ef tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:57.279356 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-01e6825f-51d7-463f-92cc-96fc9be754ef tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action" status: 202 len: 0 microversion: 2.1 time: 0.267293 Aug 03 02:15:57.283715 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2410/4928] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:15:57 2022] POST /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:15:57.296088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0f87bb62-7a0f-4386-a116-57bf85414c61 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:57.298053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0f87bb62-7a0f-4386-a116-57bf85414c61 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:57.332709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f87bb62-7a0f-4386-a116-57bf85414c61 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:57.333350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f87bb62-7a0f-4386-a116-57bf85414c61 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:57.334293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f87bb62-7a0f-4386-a116-57bf85414c61 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:57.334893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0f87bb62-7a0f-4386-a116-57bf85414c61 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:57.483262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:57.505782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9b5dacb3-f93e-4d4c-a4f0-e2579d1b8ab3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:57.519776 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9b5dacb3-f93e-4d4c-a4f0-e2579d1b8ab3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1318 microversion: 2.1 time: 0.553523 Aug 03 02:15:57.520604 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2519/4929] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:56 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:57.536607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eae573cf-9bf3-4ca1-85a7-8c56d56a61e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:57.537342 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eae573cf-9bf3-4ca1-85a7-8c56d56a61e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:57.544013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eae573cf-9bf3-4ca1-85a7-8c56d56a61e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:57.544475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eae573cf-9bf3-4ca1-85a7-8c56d56a61e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:57.545273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eae573cf-9bf3-4ca1-85a7-8c56d56a61e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:57.545721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eae573cf-9bf3-4ca1-85a7-8c56d56a61e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:57.564014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:57.642824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0f87bb62-7a0f-4386-a116-57bf85414c61 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:57.656101 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0f87bb62-7a0f-4386-a116-57bf85414c61 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1665 microversion: 2.1 time: 0.370713 Aug 03 02:15:57.673048 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2411/4930] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:57 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1665 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:58.123222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-eae573cf-9bf3-4ca1-85a7-8c56d56a61e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:58.139148 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eae573cf-9bf3-4ca1-85a7-8c56d56a61e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 0.607560 Aug 03 02:15:58.139803 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2520/4931] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:57 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:15:58.542417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bfa96dae-3bcb-4c01-ae45-74d597cbdd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:58.543697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bfa96dae-3bcb-4c01-ae45-74d597cbdd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:58.552138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfa96dae-3bcb-4c01-ae45-74d597cbdd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:58.552837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfa96dae-3bcb-4c01-ae45-74d597cbdd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:58.553801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfa96dae-3bcb-4c01-ae45-74d597cbdd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:58.554417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfa96dae-3bcb-4c01-ae45-74d597cbdd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:58.684415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a3eddee3-d774-48f3-8ac4-673a69bde832 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:58.685569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a3eddee3-d774-48f3-8ac4-673a69bde832 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:58.693704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3eddee3-d774-48f3-8ac4-673a69bde832 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:58.694441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3eddee3-d774-48f3-8ac4-673a69bde832 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:58.695437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3eddee3-d774-48f3-8ac4-673a69bde832 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:58.696034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3eddee3-d774-48f3-8ac4-673a69bde832 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:58.716223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:15:59.568287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a3eddee3-d774-48f3-8ac4-673a69bde832 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:59.586026 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a3eddee3-d774-48f3-8ac4-673a69bde832 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1665 microversion: 2.1 time: 0.905573 Aug 03 02:15:59.588636 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2521/4932] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:58 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1665 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:15:59.605435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6eef7107-6b4c-4e49-b6bd-8b3f5b813854 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:15:59.607194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6eef7107-6b4c-4e49-b6bd-8b3f5b813854 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:15:59.620385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6eef7107-6b4c-4e49-b6bd-8b3f5b813854 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:59.626740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6eef7107-6b4c-4e49-b6bd-8b3f5b813854 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:59.634475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6eef7107-6b4c-4e49-b6bd-8b3f5b813854 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:15:59.635447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6eef7107-6b4c-4e49-b6bd-8b3f5b813854 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:15:59.638930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bfa96dae-3bcb-4c01-ae45-74d597cbdd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:15:59.657141 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bfa96dae-3bcb-4c01-ae45-74d597cbdd6c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1318 microversion: 2.1 time: 1.118392 Aug 03 02:15:59.661520 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2412/4933] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:58 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1318 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:00.161411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6eef7107-6b4c-4e49-b6bd-8b3f5b813854 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:00.176753 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6eef7107-6b4c-4e49-b6bd-8b3f5b813854 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 0.581491 Aug 03 02:16:00.190402 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2522/4934] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:15:59 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:00.611174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7da0d3e4-3944-46e4-acfa-a534ab9e17a7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:00.612057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7da0d3e4-3944-46e4-acfa-a534ab9e17a7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:00.631155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7da0d3e4-3944-46e4-acfa-a534ab9e17a7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:00.631746 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7da0d3e4-3944-46e4-acfa-a534ab9e17a7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:00.632728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7da0d3e4-3944-46e4-acfa-a534ab9e17a7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:00.633324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7da0d3e4-3944-46e4-acfa-a534ab9e17a7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:00.684234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8460ee84-0f3f-4ec8-979a-e644650e8e82 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:00.685139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8460ee84-0f3f-4ec8-979a-e644650e8e82 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:00.700851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8460ee84-0f3f-4ec8-979a-e644650e8e82 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:00.701314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8460ee84-0f3f-4ec8-979a-e644650e8e82 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:00.702108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8460ee84-0f3f-4ec8-979a-e644650e8e82 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:00.702551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8460ee84-0f3f-4ec8-979a-e644650e8e82 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:01.143908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8460ee84-0f3f-4ec8-979a-e644650e8e82 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:01.159957 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8460ee84-0f3f-4ec8-979a-e644650e8e82 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1318 microversion: 2.1 time: 0.481519 Aug 03 02:16:01.160814 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2523/4935] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:00 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:01.177656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7da0d3e4-3944-46e4-acfa-a534ab9e17a7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:01.186869 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7da0d3e4-3944-46e4-acfa-a534ab9e17a7 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1665 microversion: 2.1 time: 0.578975 Aug 03 02:16:01.194759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7695de75-9668-42fc-bb94-ae1cced66e4a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:01.197173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7695de75-9668-42fc-bb94-ae1cced66e4a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:01.203101 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2413/4936] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:00 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1665 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:01.204877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7695de75-9668-42fc-bb94-ae1cced66e4a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:01.205374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7695de75-9668-42fc-bb94-ae1cced66e4a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:01.207631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7695de75-9668-42fc-bb94-ae1cced66e4a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:01.208312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7695de75-9668-42fc-bb94-ae1cced66e4a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:01.590881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7695de75-9668-42fc-bb94-ae1cced66e4a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:01.600423 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7695de75-9668-42fc-bb94-ae1cced66e4a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 0.410563 Aug 03 02:16:01.601375 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2524/4937] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:01 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:02.008876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6fe78fff-533e-4a9d-a892-6faf0cc3b13d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:02.009512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6fe78fff-533e-4a9d-a892-6faf0cc3b13d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:02.020352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-7b92ced0-e865-4d1d-893e-da549f029003 req-dbaf9fb0-2fbf-47d6-9ec2-adb08619e1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e4bbb0-7656-402a-9305-ade9e15781fa", "tag": "b6a555d7-75da-4324-9c4c-c241c08c8aad"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:02.037057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:16:02.038679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fe78fff-533e-4a9d-a892-6faf0cc3b13d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:02.041579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fe78fff-533e-4a9d-a892-6faf0cc3b13d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:02.044231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fe78fff-533e-4a9d-a892-6faf0cc3b13d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:02.044696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fe78fff-533e-4a9d-a892-6faf0cc3b13d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:02.064794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7b92ced0-e865-4d1d-893e-da549f029003 req-dbaf9fb0-2fbf-47d6-9ec2-adb08619e1ca service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:02.067563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7b92ced0-e865-4d1d-893e-da549f029003 req-dbaf9fb0-2fbf-47d6-9ec2-adb08619e1ca service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:02.086360 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-7b92ced0-e865-4d1d-893e-da549f029003 req-dbaf9fb0-2fbf-47d6-9ec2-adb08619e1ca service nova] Creating event network-changed:b6a555d7-75da-4324-9c4c-c241c08c8aad for instance b1e4bbb0-7656-402a-9305-ade9e15781fa on n-h2-826529-8 Aug 03 02:16:02.097024 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-7b92ced0-e865-4d1d-893e-da549f029003 req-dbaf9fb0-2fbf-47d6-9ec2-adb08619e1ca service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080945 Aug 03 02:16:02.102602 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2525/4938] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:16:02.183633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-539bb5f2-295f-44da-a549-eecea4d5a89d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:02.184651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-539bb5f2-295f-44da-a549-eecea4d5a89d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:02.200078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-539bb5f2-295f-44da-a549-eecea4d5a89d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:02.201243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-539bb5f2-295f-44da-a549-eecea4d5a89d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:02.202066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-539bb5f2-295f-44da-a549-eecea4d5a89d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:02.202518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-539bb5f2-295f-44da-a549-eecea4d5a89d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:03.090681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6fe78fff-533e-4a9d-a892-6faf0cc3b13d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:03.110126 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6fe78fff-533e-4a9d-a892-6faf0cc3b13d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1563 microversion: 2.1 time: 1.105612 Aug 03 02:16:03.111527 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2414/4939] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:02 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1563 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:03.121536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e5b3b546-3fad-46ea-a83f-c0b62fc452cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:03.122502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e5b3b546-3fad-46ea-a83f-c0b62fc452cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:03.135593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5b3b546-3fad-46ea-a83f-c0b62fc452cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:03.136355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5b3b546-3fad-46ea-a83f-c0b62fc452cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:03.137535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5b3b546-3fad-46ea-a83f-c0b62fc452cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:03.138366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e5b3b546-3fad-46ea-a83f-c0b62fc452cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:03.305050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-539bb5f2-295f-44da-a549-eecea4d5a89d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:03.314576 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-539bb5f2-295f-44da-a549-eecea4d5a89d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1318 microversion: 2.1 time: 1.134267 Aug 03 02:16:03.332643 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2526/4940] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:02 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1318 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:16:03.342014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e71cacdf-7f82-466b-b177-0f5303bcc678 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:03.343360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e71cacdf-7f82-466b-b177-0f5303bcc678 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:03.350580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=96 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:16:03.353506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e71cacdf-7f82-466b-b177-0f5303bcc678 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:03.354381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e71cacdf-7f82-466b-b177-0f5303bcc678 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:03.355474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e71cacdf-7f82-466b-b177-0f5303bcc678 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:03.356116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e71cacdf-7f82-466b-b177-0f5303bcc678 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:03.845818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e5b3b546-3fad-46ea-a83f-c0b62fc452cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:03.864997 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e5b3b546-3fad-46ea-a83f-c0b62fc452cc tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.750565 Aug 03 02:16:03.865921 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2415/4941] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:03 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:03.895537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-74d973cc-7418-4618-a6df-f0ef83811031 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:03.896626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-74d973cc-7418-4618-a6df-f0ef83811031 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:03.914105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74d973cc-7418-4618-a6df-f0ef83811031 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:03.914873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74d973cc-7418-4618-a6df-f0ef83811031 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:03.915957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74d973cc-7418-4618-a6df-f0ef83811031 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:03.916609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-74d973cc-7418-4618-a6df-f0ef83811031 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:04.019467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e71cacdf-7f82-466b-b177-0f5303bcc678 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:04.031463 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e71cacdf-7f82-466b-b177-0f5303bcc678 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 0.696946 Aug 03 02:16:04.047343 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2527/4942] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:03 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:04.313098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-74d973cc-7418-4618-a6df-f0ef83811031 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:04.325412 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-74d973cc-7418-4618-a6df-f0ef83811031 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1668 microversion: 2.1 time: 0.436806 Aug 03 02:16:04.337723 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2416/4943] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:03 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1668 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:04.345162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5d2018db-082e-46ba-9c25-7db17beddfab tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:04.345738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5d2018db-082e-46ba-9c25-7db17beddfab tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:04.354631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-36119f84-2c28-4df9-b15b-745ae4a0d584 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:04.360455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-36119f84-2c28-4df9-b15b-745ae4a0d584 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:04.365928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d2018db-082e-46ba-9c25-7db17beddfab tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:04.366396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d2018db-082e-46ba-9c25-7db17beddfab tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:04.372223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d2018db-082e-46ba-9c25-7db17beddfab tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:04.377532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d2018db-082e-46ba-9c25-7db17beddfab tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:04.430486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36119f84-2c28-4df9-b15b-745ae4a0d584 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:04.431338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36119f84-2c28-4df9-b15b-745ae4a0d584 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:04.432425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36119f84-2c28-4df9-b15b-745ae4a0d584 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:04.433231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36119f84-2c28-4df9-b15b-745ae4a0d584 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:04.510171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-36119f84-2c28-4df9-b15b-745ae4a0d584 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:16:04.533616 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.compute.api [None req-36119f84-2c28-4df9-b15b-745ae4a0d584 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Working on deleting snapshot aa03fb9c-2016-4178-8c36-0d7048d5c14d from shelved instance... Aug 03 02:16:05.036748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5d2018db-082e-46ba-9c25-7db17beddfab tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:05.054937 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5d2018db-082e-46ba-9c25-7db17beddfab tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1318 microversion: 2.1 time: 0.708110 Aug 03 02:16:05.069825 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2528/4944] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:04 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1318 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:05.078519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-08f0bfd2-6f3a-44fe-baad-b28929d6a14d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:05.079609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-08f0bfd2-6f3a-44fe-baad-b28929d6a14d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:05.089102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08f0bfd2-6f3a-44fe-baad-b28929d6a14d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:05.089852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08f0bfd2-6f3a-44fe-baad-b28929d6a14d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:05.090861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08f0bfd2-6f3a-44fe-baad-b28929d6a14d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:05.091556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08f0bfd2-6f3a-44fe-baad-b28929d6a14d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:05.661454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-08f0bfd2-6f3a-44fe-baad-b28929d6a14d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:05.672566 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-08f0bfd2-6f3a-44fe-baad-b28929d6a14d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 0.601174 Aug 03 02:16:05.676545 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2529/4945] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:05 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:06.088339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:16:06.097263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5dc4e0df-4901-4928-bdeb-6fd0653f76a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:06.098922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5dc4e0df-4901-4928-bdeb-6fd0653f76a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:06.110527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5dc4e0df-4901-4928-bdeb-6fd0653f76a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:06.111310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5dc4e0df-4901-4928-bdeb-6fd0653f76a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:06.113465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5dc4e0df-4901-4928-bdeb-6fd0653f76a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:06.120530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-36119f84-2c28-4df9-b15b-745ae4a0d584 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Doing local delete in cell 812a442e-24ba-4152-b2b0-f99907b19272(cell1) {{(pid=125942) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 03 02:16:06.122091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36119f84-2c28-4df9-b15b-745ae4a0d584 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:06.124225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5dc4e0df-4901-4928-bdeb-6fd0653f76a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:06.124425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36119f84-2c28-4df9-b15b-745ae4a0d584 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:06.124850 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.compute.api [None req-36119f84-2c28-4df9-b15b-745ae4a0d584 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 03 02:16:06.136773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-36119f84-2c28-4df9-b15b-745ae4a0d584 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] deallocate_for_instance() {{(pid=125942) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 03 02:16:06.532405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5dc4e0df-4901-4928-bdeb-6fd0653f76a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:06.574643 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5dc4e0df-4901-4928-bdeb-6fd0653f76a5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1318 microversion: 2.1 time: 0.485673 Aug 03 02:16:06.578856 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2530/4946] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:06 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:06.701795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bbfbc7f6-20c2-474d-a206-3a39c5189409 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:06.702825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bbfbc7f6-20c2-474d-a206-3a39c5189409 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:06.726856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbfbc7f6-20c2-474d-a206-3a39c5189409 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:06.733656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbfbc7f6-20c2-474d-a206-3a39c5189409 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:06.738132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbfbc7f6-20c2-474d-a206-3a39c5189409 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:06.739027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbfbc7f6-20c2-474d-a206-3a39c5189409 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:07.324333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bbfbc7f6-20c2-474d-a206-3a39c5189409 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:07.339690 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bbfbc7f6-20c2-474d-a206-3a39c5189409 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1510 microversion: 2.1 time: 0.643915 Aug 03 02:16:07.340295 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2531/4947] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:06 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1510 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:16:07.359888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-bf9079ac-5c66-4c88-ac48-68c2f7f031c7 req-4afa24a4-1d62-4d9d-b3c9-403a670e1eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebf6377-6b2d-437d-b7b9-15d48d084420", "name": "network-vif-plugged", "status": "completed", "tag": "0a1e75bd-2f9b-4dd3-b10c-503f365f0667"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:07.392020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bf9079ac-5c66-4c88-ac48-68c2f7f031c7 req-4afa24a4-1d62-4d9d-b3c9-403a670e1eea service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:07.400737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bf9079ac-5c66-4c88-ac48-68c2f7f031c7 req-4afa24a4-1d62-4d9d-b3c9-403a670e1eea service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:07.429555 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-bf9079ac-5c66-4c88-ac48-68c2f7f031c7 req-4afa24a4-1d62-4d9d-b3c9-403a670e1eea service nova] Creating event network-vif-plugged:0a1e75bd-2f9b-4dd3-b10c-503f365f0667 for instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 on n-h1-826529-8 Aug 03 02:16:07.436908 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-bf9079ac-5c66-4c88-ac48-68c2f7f031c7 req-4afa24a4-1d62-4d9d-b3c9-403a670e1eea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080410 Aug 03 02:16:07.438456 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2532/4948] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:16:07.497311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-36119f84-2c28-4df9-b15b-745ae4a0d584 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Updating instance_info_cache with network_info: [] {{(pid=125942) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 02:16:07.534634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-b0a83dc6-89c9-4c94-b678-199069425733 req-e4a5732c-2694-4cfd-96f7-7593b20667a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5258d568-7952-4040-8f17-07036a19c06a", "name": "network-vif-deleted", "tag": "4b0e94f3-e0c9-45de-ac3f-b4aba0330f65"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:07.575509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b0a83dc6-89c9-4c94-b678-199069425733 req-e4a5732c-2694-4cfd-96f7-7593b20667a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:07.580758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b0a83dc6-89c9-4c94-b678-199069425733 req-e4a5732c-2694-4cfd-96f7-7593b20667a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:07.614137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.compute.server_external_events [req-b0a83dc6-89c9-4c94-b678-199069425733 req-e4a5732c-2694-4cfd-96f7-7593b20667a7 service nova] Unable to find a host for instance 5258d568-7952-4040-8f17-07036a19c06a. Dropping event network-vif-deleted {{(pid=125941) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 02:16:07.619532 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-b0a83dc6-89c9-4c94-b678-199069425733 req-e4a5732c-2694-4cfd-96f7-7593b20667a7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.090932 Aug 03 02:16:07.633256 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2533/4949] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 105 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 03 02:16:07.639223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b350ca18-35cd-46c9-af00-8cb2acd8aae8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:07.640125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b350ca18-35cd-46c9-af00-8cb2acd8aae8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:07.655614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b350ca18-35cd-46c9-af00-8cb2acd8aae8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:07.656427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b350ca18-35cd-46c9-af00-8cb2acd8aae8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:07.658357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b350ca18-35cd-46c9-af00-8cb2acd8aae8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:07.661432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b350ca18-35cd-46c9-af00-8cb2acd8aae8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:08.027729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b350ca18-35cd-46c9-af00-8cb2acd8aae8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:08.049198 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b350ca18-35cd-46c9-af00-8cb2acd8aae8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1318 microversion: 2.1 time: 0.414315 Aug 03 02:16:08.051689 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2534/4950] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:07 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:08.134099 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-36119f84-2c28-4df9-b15b-745ae4a0d584 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 204 len: 0 microversion: 2.1 time: 3.784072 Aug 03 02:16:08.138010 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2417/4951] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:16:04 2022] DELETE /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 0 bytes in 3786 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:16:08.145074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d9ac624f-09d3-4845-a139-23a91cbf1691 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:08.145944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d9ac624f-09d3-4845-a139-23a91cbf1691 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 5258d568-7952-4040-8f17-07036a19c06a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:08.159762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9ac624f-09d3-4845-a139-23a91cbf1691 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:08.160912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9ac624f-09d3-4845-a139-23a91cbf1691 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:08.163486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9ac624f-09d3-4845-a139-23a91cbf1691 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:08.164418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9ac624f-09d3-4845-a139-23a91cbf1691 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:08.183051 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-d9ac624f-09d3-4845-a139-23a91cbf1691 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] HTTP exception thrown: Instance 5258d568-7952-4040-8f17-07036a19c06a could not be found. Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d9ac624f-09d3-4845-a139-23a91cbf1691 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Request method failure captured: Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a HTTP/1.1 Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6df8mzZ3op7XNnKY_UCFCR6MPbbyfjOys4kmOBvkKHV2qDe9Fyys3uKhJfh_39tezd9aHqonpFYZZGQSeJeTgK84SqB4Y74nmH4cxQ8rcI-W4Fn03C7HP3Ydy871oWmRtIwg7DG8sJHY1cKroLuk5OooXB-A6cxd4eXUP5RSU84l2rU Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 43ed3dcb7307452b965ee2d303ffaecd Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_43ed3dcb7307452b965ee2d303ffaecd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43ed3dcb7307452b965ee2d303ffaecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/43ed3dcb7307452b965ee2d303ffaecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43ed3dcb7307452b965ee2d303ffaecd"}]}] Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 43ed3dcb7307452b965ee2d303ffaecd Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerActionsTestJSON-2133022977-project Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: c6ac519db80b4ba99d67bd5db59be619 Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerActionsTestJSON-2133022977-project Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 5258d568-7952-4040-8f17-07036a19c06a could not be found. Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '5258d568-7952-4040-8f17-07036a19c06a'} Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5258d568-7952-4040-8f17-07036a19c06a could not be found. Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5258d568-7952-4040-8f17-07036a19c06a could not be found. Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:08.184825 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:08.190438 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:08.190438 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:08.190438 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:08.190438 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:08.190438 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:08.190438 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5258d568-7952-4040-8f17-07036a19c06a could not be found. Aug 03 02:16:08.190438 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:08.190438 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d9ac624f-09d3-4845-a139-23a91cbf1691 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Returning 404 to user: Instance 5258d568-7952-4040-8f17-07036a19c06a could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:08.190438 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d9ac624f-09d3-4845-a139-23a91cbf1691 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a" status: 404 len: 111 microversion: 2.1 time: 0.046880 Aug 03 02:16:08.190438 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2535/4952] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:08 2022] GET /compute/v2.1/servers/5258d568-7952-4040-8f17-07036a19c06a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:08.198102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-466906be-1004-44b7-8d85-5e2923815185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:08.198616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-466906be-1004-44b7-8d85-5e2923815185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:08.205268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-466906be-1004-44b7-8d85-5e2923815185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:08.207025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-466906be-1004-44b7-8d85-5e2923815185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:08.208495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-466906be-1004-44b7-8d85-5e2923815185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:08.210069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-466906be-1004-44b7-8d85-5e2923815185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:08.247794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-466906be-1004-44b7-8d85-5e2923815185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:16:08.362768 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2d3f0f75-c2dd-4459-815a-5a13f415589f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:08.369277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2d3f0f75-c2dd-4459-815a-5a13f415589f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:08.388755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d3f0f75-c2dd-4459-815a-5a13f415589f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:08.390526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d3f0f75-c2dd-4459-815a-5a13f415589f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:08.392467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d3f0f75-c2dd-4459-815a-5a13f415589f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:08.393337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d3f0f75-c2dd-4459-815a-5a13f415589f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:08.394349 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-466906be-1004-44b7-8d85-5e2923815185 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "DELETE /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 204 len: 0 microversion: 2.1 time: 0.200597 Aug 03 02:16:08.395253 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2418/4953] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:16:08 2022] DELETE /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:16:08.407037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-76ed28c9-d375-435c-97c3-dd2788792545 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:08.408307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-76ed28c9-d375-435c-97c3-dd2788792545 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:08.415573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76ed28c9-d375-435c-97c3-dd2788792545 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:08.416717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76ed28c9-d375-435c-97c3-dd2788792545 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:08.418004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76ed28c9-d375-435c-97c3-dd2788792545 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:08.420013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76ed28c9-d375-435c-97c3-dd2788792545 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:08.576488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-76ed28c9-d375-435c-97c3-dd2788792545 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:08.588436 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-76ed28c9-d375-435c-97c3-dd2788792545 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1465 microversion: 2.1 time: 0.186121 Aug 03 02:16:08.609457 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2419/4954] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:08 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1465 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:08.726434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2d3f0f75-c2dd-4459-815a-5a13f415589f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:08.738755 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2d3f0f75-c2dd-4459-815a-5a13f415589f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1487 microversion: 2.1 time: 0.380593 Aug 03 02:16:08.740004 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2536/4955] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:08 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1487 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:16:08.765459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2c8c6b4d-fbd6-42e4-8808-7b2bcd7df783 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-148770038"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:08.769255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2c8c6b4d-fbd6-42e4-8808-7b2bcd7df783 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:08.781373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2c8c6b4d-fbd6-42e4-8808-7b2bcd7df783 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:08.781831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2c8c6b4d-fbd6-42e4-8808-7b2bcd7df783 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:08.785507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2c8c6b4d-fbd6-42e4-8808-7b2bcd7df783 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:08.786378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2c8c6b4d-fbd6-42e4-8808-7b2bcd7df783 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:08.907107 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2c8c6b4d-fbd6-42e4-8808-7b2bcd7df783 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "PUT /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1059 microversion: 2.1 time: 0.146800 Aug 03 02:16:08.922952 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2420/4956] 10.222.0.67 () {60 vars in 1256 bytes} [Wed Aug 3 02:16:08 2022] PUT /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1059 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:08.945508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0cb2a830-94ae-424e-9be9-7a671f86ec25 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:08.950407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0cb2a830-94ae-424e-9be9-7a671f86ec25 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:08.966564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cb2a830-94ae-424e-9be9-7a671f86ec25 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:08.971690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cb2a830-94ae-424e-9be9-7a671f86ec25 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:08.974524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cb2a830-94ae-424e-9be9-7a671f86ec25 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:08.975930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cb2a830-94ae-424e-9be9-7a671f86ec25 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:09.079348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-284d231f-8831-44e7-ba97-c5e6e7372302 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:09.080271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-284d231f-8831-44e7-ba97-c5e6e7372302 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:09.109582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-284d231f-8831-44e7-ba97-c5e6e7372302 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:09.110539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-284d231f-8831-44e7-ba97-c5e6e7372302 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:09.115335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-284d231f-8831-44e7-ba97-c5e6e7372302 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:09.116181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-284d231f-8831-44e7-ba97-c5e6e7372302 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:09.580391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0cb2a830-94ae-424e-9be9-7a671f86ec25 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:09.601740 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0cb2a830-94ae-424e-9be9-7a671f86ec25 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1486 microversion: 2.1 time: 0.664949 Aug 03 02:16:09.602995 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2537/4957] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:08 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1486 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:09.632802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ccd4431c-7d5e-4d4d-a47b-d4613585ee87 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:09.636469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ccd4431c-7d5e-4d4d-a47b-d4613585ee87 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:09.650111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccd4431c-7d5e-4d4d-a47b-d4613585ee87 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:09.651643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccd4431c-7d5e-4d4d-a47b-d4613585ee87 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:09.652935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccd4431c-7d5e-4d4d-a47b-d4613585ee87 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:09.653554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccd4431c-7d5e-4d4d-a47b-d4613585ee87 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:09.805128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-284d231f-8831-44e7-ba97-c5e6e7372302 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:09.819011 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-284d231f-8831-44e7-ba97-c5e6e7372302 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1318 microversion: 2.1 time: 0.745250 Aug 03 02:16:09.835039 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2421/4958] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:09 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1318 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:09.842128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f75fe344-4368-4988-a10a-1bf81e2073ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:09.843309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f75fe344-4368-4988-a10a-1bf81e2073ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:09.851327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f75fe344-4368-4988-a10a-1bf81e2073ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:09.852279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f75fe344-4368-4988-a10a-1bf81e2073ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:09.853781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f75fe344-4368-4988-a10a-1bf81e2073ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:09.854655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ccd4431c-7d5e-4d4d-a47b-d4613585ee87 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:09.856963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f75fe344-4368-4988-a10a-1bf81e2073ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:09.869083 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ccd4431c-7d5e-4d4d-a47b-d4613585ee87 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1465 microversion: 2.1 time: 0.248538 Aug 03 02:16:09.869691 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2538/4959] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:09 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1465 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:16:10.416509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f75fe344-4368-4988-a10a-1bf81e2073ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:10.432578 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f75fe344-4368-4988-a10a-1bf81e2073ca tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1486 microversion: 2.1 time: 0.596091 Aug 03 02:16:10.448660 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2422/4960] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:09 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1486 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:10.463272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e9643fee-02b7-4ec4-8616-634e29139f1e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:10.468901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e9643fee-02b7-4ec4-8616-634e29139f1e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:10.509566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9643fee-02b7-4ec4-8616-634e29139f1e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:10.510601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9643fee-02b7-4ec4-8616-634e29139f1e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:10.525229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9643fee-02b7-4ec4-8616-634e29139f1e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:10.526117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9643fee-02b7-4ec4-8616-634e29139f1e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:10.576665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e9643fee-02b7-4ec4-8616-634e29139f1e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:16:10.686350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:16:10.780290 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e9643fee-02b7-4ec4-8616-634e29139f1e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 204 len: 0 microversion: 2.1 time: 0.323391 Aug 03 02:16:10.783045 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2539/4961] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:16:10 2022] DELETE /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:16:10.792987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dc8d3cb2-bcc8-4b7e-975d-e51ca4e47fbf tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:10.793635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dc8d3cb2-bcc8-4b7e-975d-e51ca4e47fbf tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:10.803523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc8d3cb2-bcc8-4b7e-975d-e51ca4e47fbf tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:10.803999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc8d3cb2-bcc8-4b7e-975d-e51ca4e47fbf tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:10.804833 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc8d3cb2-bcc8-4b7e-975d-e51ca4e47fbf tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:10.805289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc8d3cb2-bcc8-4b7e-975d-e51ca4e47fbf tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:10.852569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-65b9e457-a7ae-4587-9365-55734e31a579 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:10.853441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-65b9e457-a7ae-4587-9365-55734e31a579 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:10.870524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65b9e457-a7ae-4587-9365-55734e31a579 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:10.874572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65b9e457-a7ae-4587-9365-55734e31a579 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:10.876558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65b9e457-a7ae-4587-9365-55734e31a579 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:10.884754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65b9e457-a7ae-4587-9365-55734e31a579 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:11.525985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dc8d3cb2-bcc8-4b7e-975d-e51ca4e47fbf tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:11.536983 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dc8d3cb2-bcc8-4b7e-975d-e51ca4e47fbf tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1492 microversion: 2.1 time: 0.748477 Aug 03 02:16:11.547970 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2423/4962] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:10 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1492 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:11.552883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-316de73b-fa1f-4721-a02a-f4ed533f8a8d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:11.553801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-316de73b-fa1f-4721-a02a-f4ed533f8a8d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:11.570699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-316de73b-fa1f-4721-a02a-f4ed533f8a8d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:11.570699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-316de73b-fa1f-4721-a02a-f4ed533f8a8d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:11.581672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-316de73b-fa1f-4721-a02a-f4ed533f8a8d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:11.582310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-316de73b-fa1f-4721-a02a-f4ed533f8a8d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:12.254551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-65b9e457-a7ae-4587-9365-55734e31a579 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:12.267339 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-65b9e457-a7ae-4587-9365-55734e31a579 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1507 microversion: 2.1 time: 1.422259 Aug 03 02:16:12.273964 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2540/4963] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:10 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1507 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:16:12.295090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5b9642f7-d145-4d3c-92c3-42df4bcba41d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:12.295754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5b9642f7-d145-4d3c-92c3-42df4bcba41d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:12.306120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-316de73b-fa1f-4721-a02a-f4ed533f8a8d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:12.307629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b9642f7-d145-4d3c-92c3-42df4bcba41d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:12.308136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b9642f7-d145-4d3c-92c3-42df4bcba41d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:12.308955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b9642f7-d145-4d3c-92c3-42df4bcba41d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:12.309406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5b9642f7-d145-4d3c-92c3-42df4bcba41d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:12.325221 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-316de73b-fa1f-4721-a02a-f4ed533f8a8d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 200 len: 1465 microversion: 2.1 time: 0.776524 Aug 03 02:16:12.332060 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2424/4964] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:11 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 1465 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:12.372818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-fafd086d-854a-4f07-aa3d-dfa23c94d104 req-391c3252-08f7-4418-ba30-51d03e3c871d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865dd2e4-70af-4152-92d8-8b7e65f6925a", "name": "network-vif-deleted", "tag": "d9c19332-bece-4894-bc20-72c950b09199"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:12.397817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-fafd086d-854a-4f07-aa3d-dfa23c94d104 req-391c3252-08f7-4418-ba30-51d03e3c871d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:12.398688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-fafd086d-854a-4f07-aa3d-dfa23c94d104 req-391c3252-08f7-4418-ba30-51d03e3c871d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:12.420252 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-fafd086d-854a-4f07-aa3d-dfa23c94d104 req-391c3252-08f7-4418-ba30-51d03e3c871d service nova] Creating event network-vif-deleted:d9c19332-bece-4894-bc20-72c950b09199 for instance 865dd2e4-70af-4152-92d8-8b7e65f6925a on n-h2-826529-8 Aug 03 02:16:12.433837 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-fafd086d-854a-4f07-aa3d-dfa23c94d104 req-391c3252-08f7-4418-ba30-51d03e3c871d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064732 Aug 03 02:16:12.434589 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2425/4965] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:16:12.564279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-37046ab3-d2e3-436f-bd94-309b5ef9d1ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:12.566101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-37046ab3-d2e3-436f-bd94-309b5ef9d1ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:12.579251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37046ab3-d2e3-436f-bd94-309b5ef9d1ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:12.584229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37046ab3-d2e3-436f-bd94-309b5ef9d1ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:12.585900 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37046ab3-d2e3-436f-bd94-309b5ef9d1ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:12.588434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37046ab3-d2e3-436f-bd94-309b5ef9d1ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:12.856676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5b9642f7-d145-4d3c-92c3-42df4bcba41d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:12.869760 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5b9642f7-d145-4d3c-92c3-42df4bcba41d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1507 microversion: 2.1 time: 0.580552 Aug 03 02:16:12.882939 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2541/4966] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:12 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1507 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:16:12.898818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-94f2bd5a-ef33-41f5-a2a8-e8fb40d1d424 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:12.902032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-94f2bd5a-ef33-41f5-a2a8-e8fb40d1d424 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:12.938225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94f2bd5a-ef33-41f5-a2a8-e8fb40d1d424 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:12.941423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94f2bd5a-ef33-41f5-a2a8-e8fb40d1d424 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:12.942478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94f2bd5a-ef33-41f5-a2a8-e8fb40d1d424 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:12.942953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94f2bd5a-ef33-41f5-a2a8-e8fb40d1d424 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:13.149520 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-94f2bd5a-ef33-41f5-a2a8-e8fb40d1d424 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "PUT /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1079 microversion: 2.1 time: 0.250548 Aug 03 02:16:13.151707 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2542/4967] 10.222.0.67 () {60 vars in 1256 bytes} [Wed Aug 3 02:16:12 2022] PUT /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1079 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:13.179663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-018ccf64-868d-4fb5-bc88-49e03e885f28 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:13.182819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-018ccf64-868d-4fb5-bc88-49e03e885f28 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:13.207504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-018ccf64-868d-4fb5-bc88-49e03e885f28 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:13.209159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-018ccf64-868d-4fb5-bc88-49e03e885f28 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:13.212492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-018ccf64-868d-4fb5-bc88-49e03e885f28 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:13.213911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-018ccf64-868d-4fb5-bc88-49e03e885f28 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:13.281162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-37046ab3-d2e3-436f-bd94-309b5ef9d1ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:13.292212 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-37046ab3-d2e3-436f-bd94-309b5ef9d1ef tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1492 microversion: 2.1 time: 0.732730 Aug 03 02:16:13.319359 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2426/4968] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:12 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1492 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:16:13.365234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a12d5f32-b480-45da-82b6-ae278aa1a8c9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:13.367374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a12d5f32-b480-45da-82b6-ae278aa1a8c9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 865dd2e4-70af-4152-92d8-8b7e65f6925a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:13.398302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a12d5f32-b480-45da-82b6-ae278aa1a8c9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:13.399930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a12d5f32-b480-45da-82b6-ae278aa1a8c9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:13.407998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a12d5f32-b480-45da-82b6-ae278aa1a8c9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:13.412571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a12d5f32-b480-45da-82b6-ae278aa1a8c9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:13.507597 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-a12d5f32-b480-45da-82b6-ae278aa1a8c9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] HTTP exception thrown: Instance 865dd2e4-70af-4152-92d8-8b7e65f6925a could not be found. Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a12d5f32-b480-45da-82b6-ae278aa1a8c9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Request method failure captured: Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a HTTP/1.1 Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6df8mzZ3op7XNnKY_UCFCR6MPbbyfjOys4kmOBvkKHV2qDe9Fyys3uKhJfh_39tezd9aHqonpFYZZGQSeJeTgK84SqB4Y74nmH4cxQ8rcI-W4Fn03C7HP3Ydy871oWmRtIwg7DG8sJHY1cKroLuk5OooXB-A6cxd4eXUP5RSU84l2rU Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 43ed3dcb7307452b965ee2d303ffaecd Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_43ed3dcb7307452b965ee2d303ffaecd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43ed3dcb7307452b965ee2d303ffaecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/43ed3dcb7307452b965ee2d303ffaecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43ed3dcb7307452b965ee2d303ffaecd"}]}] Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 43ed3dcb7307452b965ee2d303ffaecd Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerActionsTestJSON-2133022977-project Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: c6ac519db80b4ba99d67bd5db59be619 Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerActionsTestJSON-2133022977-project Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 865dd2e4-70af-4152-92d8-8b7e65f6925a could not be found. Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '865dd2e4-70af-4152-92d8-8b7e65f6925a'} Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 865dd2e4-70af-4152-92d8-8b7e65f6925a could not be found. Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 865dd2e4-70af-4152-92d8-8b7e65f6925a could not be found. Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:13.513704 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:13.525386 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:13.525386 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:13.525386 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:13.525386 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:13.525386 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:13.525386 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 865dd2e4-70af-4152-92d8-8b7e65f6925a could not be found. Aug 03 02:16:13.525386 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:13.525386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a12d5f32-b480-45da-82b6-ae278aa1a8c9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Returning 404 to user: Instance 865dd2e4-70af-4152-92d8-8b7e65f6925a could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:13.525386 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a12d5f32-b480-45da-82b6-ae278aa1a8c9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a" status: 404 len: 111 microversion: 2.1 time: 0.164975 Aug 03 02:16:13.525386 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2427/4969] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:13 2022] GET /compute/v2.1/servers/865dd2e4-70af-4152-92d8-8b7e65f6925a => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:13.546454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dca02cee-092a-48dd-acc6-d0750cdc93a1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:13.547052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dca02cee-092a-48dd-acc6-d0750cdc93a1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:13.570316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dca02cee-092a-48dd-acc6-d0750cdc93a1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:13.570786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dca02cee-092a-48dd-acc6-d0750cdc93a1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:13.573415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dca02cee-092a-48dd-acc6-d0750cdc93a1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:13.574515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dca02cee-092a-48dd-acc6-d0750cdc93a1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:13.651564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:16:13.660195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dca02cee-092a-48dd-acc6-d0750cdc93a1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:16:13.901697 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dca02cee-092a-48dd-acc6-d0750cdc93a1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "DELETE /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 204 len: 0 microversion: 2.1 time: 0.368684 Aug 03 02:16:13.903057 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2428/4970] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:16:13 2022] DELETE /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:16:13.914095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b35c490c-5d73-4af8-9a7b-83cf470f4200 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:13.915608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b35c490c-5d73-4af8-9a7b-83cf470f4200 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:13.928513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b35c490c-5d73-4af8-9a7b-83cf470f4200 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:13.928980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b35c490c-5d73-4af8-9a7b-83cf470f4200 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:13.929793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b35c490c-5d73-4af8-9a7b-83cf470f4200 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:13.930234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b35c490c-5d73-4af8-9a7b-83cf470f4200 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:14.024162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-018ccf64-868d-4fb5-bc88-49e03e885f28 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:14.037994 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-018ccf64-868d-4fb5-bc88-49e03e885f28 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1505 microversion: 2.1 time: 0.870625 Aug 03 02:16:14.038664 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2543/4971] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:13 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1505 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:14.076684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0ee3f8f4-3ad7-4c4c-beed-46c9444a8ea3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:14.077550 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0ee3f8f4-3ad7-4c4c-beed-46c9444a8ea3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:14.106599 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0ee3f8f4-3ad7-4c4c-beed-46c9444a8ea3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:14.107367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0ee3f8f4-3ad7-4c4c-beed-46c9444a8ea3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:14.110103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0ee3f8f4-3ad7-4c4c-beed-46c9444a8ea3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:14.111211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0ee3f8f4-3ad7-4c4c-beed-46c9444a8ea3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:14.491311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b35c490c-5d73-4af8-9a7b-83cf470f4200 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:14.507528 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b35c490c-5d73-4af8-9a7b-83cf470f4200 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1507 microversion: 2.1 time: 0.598067 Aug 03 02:16:14.511569 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2429/4972] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:13 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1507 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:14.516420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0ee3f8f4-3ad7-4c4c-beed-46c9444a8ea3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:14.554608 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0ee3f8f4-3ad7-4c4c-beed-46c9444a8ea3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1505 microversion: 2.1 time: 0.484149 Aug 03 02:16:14.556492 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2544/4973] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:14 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1505 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:14.557264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4281bf85-ba50-4d1b-a8bb-0f8bed29d34e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:14.558339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4281bf85-ba50-4d1b-a8bb-0f8bed29d34e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:14.572535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4281bf85-ba50-4d1b-a8bb-0f8bed29d34e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:14.573535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4281bf85-ba50-4d1b-a8bb-0f8bed29d34e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:14.574765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4281bf85-ba50-4d1b-a8bb-0f8bed29d34e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:14.575427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4281bf85-ba50-4d1b-a8bb-0f8bed29d34e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:14.586856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:14.590700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:14.605129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:14.605697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:14.606604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:14.607187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:14.772052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:16:14.776504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:16:14.777160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:16:14.777885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:16:14.778445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:16:14.862753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4281bf85-ba50-4d1b-a8bb-0f8bed29d34e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:14.879813 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4281bf85-ba50-4d1b-a8bb-0f8bed29d34e tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1450 microversion: 2.1 time: 0.362025 Aug 03 02:16:14.885218 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2430/4974] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:14 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1450 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:14.919549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:14.938530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:14.939193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:14.940984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:14.945081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:15.011735 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ecc636aa-3220-4c0b-8c41-032f66a2bcc5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "POST /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420/action" status: 202 len: 1111 microversion: 2.1 time: 0.429031 Aug 03 02:16:15.025659 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2545/4975] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:16:14 2022] POST /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420/action => generated 1111 bytes in 431 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 03 02:16:15.031560 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b178b1fa-240b-4802-92b7-83763ec3d4f5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:15.032401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b178b1fa-240b-4802-92b7-83763ec3d4f5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:15.047398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b178b1fa-240b-4802-92b7-83763ec3d4f5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:15.047994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b178b1fa-240b-4802-92b7-83763ec3d4f5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:15.048922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b178b1fa-240b-4802-92b7-83763ec3d4f5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:15.050105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b178b1fa-240b-4802-92b7-83763ec3d4f5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:15.074022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-ba1bd268-07bb-4b5f-8c36-b94367770653 req-83cff9fd-9a33-4ca3-a38d-3f4efd3c1b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e5a93f-301f-4ed4-bc34-b6dadb6c4644", "name": "network-vif-deleted", "tag": "c2fc9c75-7f7d-4eb4-a140-8cd5487bac65"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:15.106478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ba1bd268-07bb-4b5f-8c36-b94367770653 req-83cff9fd-9a33-4ca3-a38d-3f4efd3c1b10 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:15.110067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ba1bd268-07bb-4b5f-8c36-b94367770653 req-83cff9fd-9a33-4ca3-a38d-3f4efd3c1b10 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:15.145840 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-ba1bd268-07bb-4b5f-8c36-b94367770653 req-83cff9fd-9a33-4ca3-a38d-3f4efd3c1b10 service nova] Creating event network-vif-deleted:c2fc9c75-7f7d-4eb4-a140-8cd5487bac65 for instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 on n-h2-826529-8 Aug 03 02:16:15.174187 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-ba1bd268-07bb-4b5f-8c36-b94367770653 req-83cff9fd-9a33-4ca3-a38d-3f4efd3c1b10 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104979 Aug 03 02:16:15.179011 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2546/4976] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:16:15.534853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aff3f06e-5e72-43b2-9af3-75a34556c6b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:15.535882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-aff3f06e-5e72-43b2-9af3-75a34556c6b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:15.552793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aff3f06e-5e72-43b2-9af3-75a34556c6b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:15.554027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aff3f06e-5e72-43b2-9af3-75a34556c6b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:15.555308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aff3f06e-5e72-43b2-9af3-75a34556c6b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:15.555971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aff3f06e-5e72-43b2-9af3-75a34556c6b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:15.640607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b178b1fa-240b-4802-92b7-83763ec3d4f5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:15.661729 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b178b1fa-240b-4802-92b7-83763ec3d4f5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 0.634282 Aug 03 02:16:15.663079 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2431/4977] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:15 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:15.819729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-aff3f06e-5e72-43b2-9af3-75a34556c6b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:15.835015 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-aff3f06e-5e72-43b2-9af3-75a34556c6b8 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1507 microversion: 2.1 time: 0.305309 Aug 03 02:16:15.835873 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2547/4978] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:15 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:15.910398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6f17e4fd-75d2-4162-b8d1-6a501eb062f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:15.911662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6f17e4fd-75d2-4162-b8d1-6a501eb062f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:15.929809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f17e4fd-75d2-4162-b8d1-6a501eb062f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:15.931094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f17e4fd-75d2-4162-b8d1-6a501eb062f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:15.932285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f17e4fd-75d2-4162-b8d1-6a501eb062f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:15.932889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f17e4fd-75d2-4162-b8d1-6a501eb062f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:15.989658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f17e4fd-75d2-4162-b8d1-6a501eb062f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:15.990638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f17e4fd-75d2-4162-b8d1-6a501eb062f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:15.991573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-6f17e4fd-75d2-4162-b8d1-6a501eb062f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lazy-loading 'fault' on Instance uuid 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:16:16.101430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6f17e4fd-75d2-4162-b8d1-6a501eb062f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:16.120962 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6f17e4fd-75d2-4162-b8d1-6a501eb062f5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 200 len: 1309 microversion: 2.1 time: 0.218900 Aug 03 02:16:16.123090 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2432/4979] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:15 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 1309 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:16.629753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-cc7c6a8b-67c9-4bf5-976f-c9fc4b131ab9 req-8a06fbcd-c004-4572-90bf-ae2a656b98d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af53bd56-06e6-4d0d-a71c-e2c35f0584a1", "name": "network-vif-deleted", "tag": "05a73520-43b1-4015-bfc2-bdf5b241f69c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:16.654577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-cc7c6a8b-67c9-4bf5-976f-c9fc4b131ab9 req-8a06fbcd-c004-4572-90bf-ae2a656b98d1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:16.658594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-cc7c6a8b-67c9-4bf5-976f-c9fc4b131ab9 req-8a06fbcd-c004-4572-90bf-ae2a656b98d1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:16.691526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c4f093b7-490b-4017-8c5a-6f2ecc7fa81e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:16.693607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c4f093b7-490b-4017-8c5a-6f2ecc7fa81e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:16.697144 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-cc7c6a8b-67c9-4bf5-976f-c9fc4b131ab9 req-8a06fbcd-c004-4572-90bf-ae2a656b98d1 service nova] Creating event network-vif-deleted:05a73520-43b1-4015-bfc2-bdf5b241f69c for instance af53bd56-06e6-4d0d-a71c-e2c35f0584a1 on n-h1-826529-8 Aug 03 02:16:16.709951 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-cc7c6a8b-67c9-4bf5-976f-c9fc4b131ab9 req-8a06fbcd-c004-4572-90bf-ae2a656b98d1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087190 Aug 03 02:16:16.712834 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2548/4980] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:16:16.714643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4f093b7-490b-4017-8c5a-6f2ecc7fa81e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:16.727082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4f093b7-490b-4017-8c5a-6f2ecc7fa81e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:16.732687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4f093b7-490b-4017-8c5a-6f2ecc7fa81e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:16.733285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4f093b7-490b-4017-8c5a-6f2ecc7fa81e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:16.898965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-827748cb-186f-4880-b164-87dc0597456e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:16.901414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-827748cb-186f-4880-b164-87dc0597456e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:16.937606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-827748cb-186f-4880-b164-87dc0597456e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:16.941291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-827748cb-186f-4880-b164-87dc0597456e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:16.942259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-827748cb-186f-4880-b164-87dc0597456e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:16.942714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-827748cb-186f-4880-b164-87dc0597456e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.067361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-827748cb-186f-4880-b164-87dc0597456e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:17.070851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-827748cb-186f-4880-b164-87dc0597456e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.072465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-827748cb-186f-4880-b164-87dc0597456e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lazy-loading 'fault' on Instance uuid af53bd56-06e6-4d0d-a71c-e2c35f0584a1 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:16:17.261720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-827748cb-186f-4880-b164-87dc0597456e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:17.275457 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-827748cb-186f-4880-b164-87dc0597456e tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 200 len: 1304 microversion: 2.1 time: 0.402126 Aug 03 02:16:17.276109 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2549/4981] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:16 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 1304 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:17.323165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-78c2455c-7b1d-4542-bc7b-5bcc2273f81f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:17.323789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-78c2455c-7b1d-4542-bc7b-5bcc2273f81f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:17.338456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-78c2455c-7b1d-4542-bc7b-5bcc2273f81f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:17.338937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-78c2455c-7b1d-4542-bc7b-5bcc2273f81f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.339728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-78c2455c-7b1d-4542-bc7b-5bcc2273f81f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:17.340168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-78c2455c-7b1d-4542-bc7b-5bcc2273f81f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.340329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c4f093b7-490b-4017-8c5a-6f2ecc7fa81e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:17.352795 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c4f093b7-490b-4017-8c5a-6f2ecc7fa81e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 0.673104 Aug 03 02:16:17.353401 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2433/4982] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:16 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:16:17.398374 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-78c2455c-7b1d-4542-bc7b-5bcc2273f81f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-78c2455c-7b1d-4542-bc7b-5bcc2273f81f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 HTTP/1.1 Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '41e5a93f-301f-4ed4-bc34-b6dadb6c4644'} Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:17.404086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.411783 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.411783 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:17.411783 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:17.411783 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:17.411783 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:17.411783 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. Aug 03 02:16:17.411783 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.411783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-78c2455c-7b1d-4542-bc7b-5bcc2273f81f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:17.411783 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-78c2455c-7b1d-4542-bc7b-5bcc2273f81f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 404 len: 111 microversion: 2.1 time: 0.110921 Aug 03 02:16:17.412513 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2550/4983] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:17 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:17.429666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-691f1dad-0d0e-46ee-8d48-4d63c4529b77 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:17.430878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-691f1dad-0d0e-46ee-8d48-4d63c4529b77 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:17.445024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-691f1dad-0d0e-46ee-8d48-4d63c4529b77 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:17.446037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-691f1dad-0d0e-46ee-8d48-4d63c4529b77 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.450734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-691f1dad-0d0e-46ee-8d48-4d63c4529b77 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:17.451503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-691f1dad-0d0e-46ee-8d48-4d63c4529b77 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.489356 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-691f1dad-0d0e-46ee-8d48-4d63c4529b77 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-691f1dad-0d0e-46ee-8d48-4d63c4529b77 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 HTTP/1.1 Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '41e5a93f-301f-4ed4-bc34-b6dadb6c4644'} Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:17.492659 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. Aug 03 02:16:17.498114 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.498114 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:17.498114 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.498114 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.498114 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:17.498114 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:17.498114 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:17.498114 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:17.498114 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. Aug 03 02:16:17.498114 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.504345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-691f1dad-0d0e-46ee-8d48-4d63c4529b77 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:17.505536 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-691f1dad-0d0e-46ee-8d48-4d63c4529b77 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 404 len: 111 microversion: 2.1 time: 0.081846 Aug 03 02:16:17.506671 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2434/4984] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:16:17 2022] DELETE /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:17.515326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5abbb617-ba80-4fda-b0f3-b46d553800f4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:17.515947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5abbb617-ba80-4fda-b0f3-b46d553800f4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 41e5a93f-301f-4ed4-bc34-b6dadb6c4644] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:17.527232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5abbb617-ba80-4fda-b0f3-b46d553800f4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:17.532792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5abbb617-ba80-4fda-b0f3-b46d553800f4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.534835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5abbb617-ba80-4fda-b0f3-b46d553800f4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:17.535344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5abbb617-ba80-4fda-b0f3-b46d553800f4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.568962 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-5abbb617-ba80-4fda-b0f3-b46d553800f4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5abbb617-ba80-4fda-b0f3-b46d553800f4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 HTTP/1.1 Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '41e5a93f-301f-4ed4-bc34-b6dadb6c4644'} Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:17.570861 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.577431 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.577431 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:17.577431 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:17.577431 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:17.577431 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:17.577431 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. Aug 03 02:16:17.577431 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.579322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5abbb617-ba80-4fda-b0f3-b46d553800f4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 41e5a93f-301f-4ed4-bc34-b6dadb6c4644 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:17.582025 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5abbb617-ba80-4fda-b0f3-b46d553800f4 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644" status: 404 len: 111 microversion: 2.1 time: 0.071449 Aug 03 02:16:17.583296 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2551/4985] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:17 2022] GET /compute/v2.1/servers/41e5a93f-301f-4ed4-bc34-b6dadb6c4644 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:17.591466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4a50a5eb-9bb9-4d27-a3c8-844290473436 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:17.592432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4a50a5eb-9bb9-4d27-a3c8-844290473436 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:17.604201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a50a5eb-9bb9-4d27-a3c8-844290473436 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:17.605532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a50a5eb-9bb9-4d27-a3c8-844290473436 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.609080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a50a5eb-9bb9-4d27-a3c8-844290473436 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:17.610521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a50a5eb-9bb9-4d27-a3c8-844290473436 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.656288 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-4a50a5eb-9bb9-4d27-a3c8-844290473436 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4a50a5eb-9bb9-4d27-a3c8-844290473436 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d HTTP/1.1 Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'f048d8ef-2daf-421d-b5b6-e75402c0251d'} Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:17.658478 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. Aug 03 02:16:17.664229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.664229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:17.664229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.664229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.664229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:17.664229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:17.664229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:17.664229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:17.664229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. Aug 03 02:16:17.664229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.667286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4a50a5eb-9bb9-4d27-a3c8-844290473436 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:17.668347 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4a50a5eb-9bb9-4d27-a3c8-844290473436 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 404 len: 111 microversion: 2.1 time: 0.081224 Aug 03 02:16:17.670272 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2435/4986] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:16:17 2022] DELETE /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:17.678383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a2650f01-f113-476a-a25b-23ca060d151b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:17.680749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a2650f01-f113-476a-a25b-23ca060d151b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: f048d8ef-2daf-421d-b5b6-e75402c0251d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:17.693570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2650f01-f113-476a-a25b-23ca060d151b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:17.694305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2650f01-f113-476a-a25b-23ca060d151b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.695393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2650f01-f113-476a-a25b-23ca060d151b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:17.696049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a2650f01-f113-476a-a25b-23ca060d151b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.754241 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-a2650f01-f113-476a-a25b-23ca060d151b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a2650f01-f113-476a-a25b-23ca060d151b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d HTTP/1.1 Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'f048d8ef-2daf-421d-b5b6-e75402c0251d'} Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:17.761774 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.767146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.767146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:17.767146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:17.767146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:17.767146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:17.767146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. Aug 03 02:16:17.767146 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.771031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a2650f01-f113-476a-a25b-23ca060d151b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance f048d8ef-2daf-421d-b5b6-e75402c0251d could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:17.771933 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a2650f01-f113-476a-a25b-23ca060d151b tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d" status: 404 len: 111 microversion: 2.1 time: 0.097983 Aug 03 02:16:17.772512 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2552/4987] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:17 2022] GET /compute/v2.1/servers/f048d8ef-2daf-421d-b5b6-e75402c0251d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:17.787327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-018f6914-c1fc-4414-97c8-5d2f80dbdfec tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:17.787995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-018f6914-c1fc-4414-97c8-5d2f80dbdfec tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:17.820618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-018f6914-c1fc-4414-97c8-5d2f80dbdfec tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:17.821454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-018f6914-c1fc-4414-97c8-5d2f80dbdfec tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.822598 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-018f6914-c1fc-4414-97c8-5d2f80dbdfec tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:17.823263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-018f6914-c1fc-4414-97c8-5d2f80dbdfec tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.855824 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-018f6914-c1fc-4414-97c8-5d2f80dbdfec tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-018f6914-c1fc-4414-97c8-5d2f80dbdfec tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 HTTP/1.1 Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '999a174f-1170-4039-86a0-8f498b7341c3'} Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:17.857574 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. Aug 03 02:16:17.866389 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.866389 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:17.866389 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.866389 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.866389 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:17.866389 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:17.866389 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:17.866389 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:17.866389 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. Aug 03 02:16:17.866389 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.866389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-018f6914-c1fc-4414-97c8-5d2f80dbdfec tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:17.866389 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-018f6914-c1fc-4414-97c8-5d2f80dbdfec tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 404 len: 111 microversion: 2.1 time: 0.079874 Aug 03 02:16:17.866389 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2436/4988] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:16:17 2022] DELETE /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:17.868946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a70b4dff-3fb3-4533-9b28-9736af0f42f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:17.869761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a70b4dff-3fb3-4533-9b28-9736af0f42f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 999a174f-1170-4039-86a0-8f498b7341c3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:17.891191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a70b4dff-3fb3-4533-9b28-9736af0f42f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:17.902839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a70b4dff-3fb3-4533-9b28-9736af0f42f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.903959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a70b4dff-3fb3-4533-9b28-9736af0f42f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:17.904423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a70b4dff-3fb3-4533-9b28-9736af0f42f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:17.965738 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-a70b4dff-3fb3-4533-9b28-9736af0f42f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a70b4dff-3fb3-4533-9b28-9736af0f42f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 HTTP/1.1 Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '999a174f-1170-4039-86a0-8f498b7341c3'} Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:17.973888 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.984148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:17.984148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:17.984148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:17.984148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:17.984148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:17.984148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. Aug 03 02:16:17.984148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:17.992654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a70b4dff-3fb3-4533-9b28-9736af0f42f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 999a174f-1170-4039-86a0-8f498b7341c3 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:17.993414 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a70b4dff-3fb3-4533-9b28-9736af0f42f2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3" status: 404 len: 111 microversion: 2.1 time: 0.128733 Aug 03 02:16:17.999902 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2553/4989] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:17 2022] GET /compute/v2.1/servers/999a174f-1170-4039-86a0-8f498b7341c3 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:16:18.006147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-175dd35b-9e6e-48d4-a906-f78786db4e8c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:18.007293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-175dd35b-9e6e-48d4-a906-f78786db4e8c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:18.026793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-175dd35b-9e6e-48d4-a906-f78786db4e8c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.028948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-175dd35b-9e6e-48d4-a906-f78786db4e8c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.029835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-175dd35b-9e6e-48d4-a906-f78786db4e8c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.030279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-175dd35b-9e6e-48d4-a906-f78786db4e8c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.075911 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-175dd35b-9e6e-48d4-a906-f78786db4e8c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-175dd35b-9e6e-48d4-a906-f78786db4e8c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 HTTP/1.1 Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '7030597f-afd4-4953-b80f-2ad5e6974e61'} Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:18.077603 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. Aug 03 02:16:18.083729 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.083729 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:18.083729 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.083729 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.083729 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:18.083729 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:18.083729 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:18.083729 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:18.083729 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. Aug 03 02:16:18.083729 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.083729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-175dd35b-9e6e-48d4-a906-f78786db4e8c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:18.085042 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-175dd35b-9e6e-48d4-a906-f78786db4e8c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 404 len: 111 microversion: 2.1 time: 0.080503 Aug 03 02:16:18.089467 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2437/4990] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:16:17 2022] DELETE /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:18.100262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e44214de-8b29-42a5-aca2-a8b074772fa3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:18.100903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e44214de-8b29-42a5-aca2-a8b074772fa3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 7030597f-afd4-4953-b80f-2ad5e6974e61] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:18.108170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e44214de-8b29-42a5-aca2-a8b074772fa3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.108665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e44214de-8b29-42a5-aca2-a8b074772fa3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.109420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e44214de-8b29-42a5-aca2-a8b074772fa3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.110103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e44214de-8b29-42a5-aca2-a8b074772fa3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.133816 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-e44214de-8b29-42a5-aca2-a8b074772fa3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e44214de-8b29-42a5-aca2-a8b074772fa3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 HTTP/1.1 Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '7030597f-afd4-4953-b80f-2ad5e6974e61'} Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:18.142491 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.152160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.152160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:18.152160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:18.152160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:18.152160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:18.152160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. Aug 03 02:16:18.152160 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.152160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e44214de-8b29-42a5-aca2-a8b074772fa3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 7030597f-afd4-4953-b80f-2ad5e6974e61 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:18.152160 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e44214de-8b29-42a5-aca2-a8b074772fa3 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61" status: 404 len: 111 microversion: 2.1 time: 0.042943 Aug 03 02:16:18.152160 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2554/4991] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:18 2022] GET /compute/v2.1/servers/7030597f-afd4-4953-b80f-2ad5e6974e61 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:16:18.155423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5254b1e6-aef0-4f60-b13e-4b4bc0068de2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:18.157129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5254b1e6-aef0-4f60-b13e-4b4bc0068de2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:18.170174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5254b1e6-aef0-4f60-b13e-4b4bc0068de2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.170672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5254b1e6-aef0-4f60-b13e-4b4bc0068de2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.171541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5254b1e6-aef0-4f60-b13e-4b4bc0068de2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.173716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5254b1e6-aef0-4f60-b13e-4b4bc0068de2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.245770 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-5254b1e6-aef0-4f60-b13e-4b4bc0068de2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5254b1e6-aef0-4f60-b13e-4b4bc0068de2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe HTTP/1.1 Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '0f4f68d0-a0b5-4f99-9026-2fbe72c857fe'} Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:18.250532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. Aug 03 02:16:18.256184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.256184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:18.256184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.256184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.256184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:18.256184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:18.256184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:18.256184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:18.256184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. Aug 03 02:16:18.256184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.256184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5254b1e6-aef0-4f60-b13e-4b4bc0068de2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:18.256184 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5254b1e6-aef0-4f60-b13e-4b4bc0068de2 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 404 len: 111 microversion: 2.1 time: 0.111988 Aug 03 02:16:18.262307 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2438/4992] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:16:18 2022] DELETE /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:16:18.264666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f8dfa30a-5c03-45b4-bb21-08fc048332b0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:18.265291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f8dfa30a-5c03-45b4-bb21-08fc048332b0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:18.279375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8dfa30a-5c03-45b4-bb21-08fc048332b0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.279841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8dfa30a-5c03-45b4-bb21-08fc048332b0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.280654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8dfa30a-5c03-45b4-bb21-08fc048332b0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.281103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8dfa30a-5c03-45b4-bb21-08fc048332b0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.303688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fd32ba3d-e5e5-4352-99ff-da85014d8be9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:18.305483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fd32ba3d-e5e5-4352-99ff-da85014d8be9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: af53bd56-06e6-4d0d-a71c-e2c35f0584a1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:18.326112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd32ba3d-e5e5-4352-99ff-da85014d8be9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.327204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd32ba3d-e5e5-4352-99ff-da85014d8be9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.331828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd32ba3d-e5e5-4352-99ff-da85014d8be9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.333988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd32ba3d-e5e5-4352-99ff-da85014d8be9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.349135 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-f8dfa30a-5c03-45b4-bb21-08fc048332b0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f8dfa30a-5c03-45b4-bb21-08fc048332b0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe HTTP/1.1 Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '0f4f68d0-a0b5-4f99-9026-2fbe72c857fe'} Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:18.353209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.359354 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.359354 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:18.359354 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:18.359354 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:18.359354 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:18.359354 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. Aug 03 02:16:18.359354 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.360389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f8dfa30a-5c03-45b4-bb21-08fc048332b0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 0f4f68d0-a0b5-4f99-9026-2fbe72c857fe could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:18.363731 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f8dfa30a-5c03-45b4-bb21-08fc048332b0 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe" status: 404 len: 111 microversion: 2.1 time: 0.100524 Aug 03 02:16:18.365413 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2555/4993] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:18 2022] GET /compute/v2.1/servers/0f4f68d0-a0b5-4f99-9026-2fbe72c857fe => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:16:18.387067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c0a7fe6b-b7c7-4753-a2db-e3ad5266df9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:18.394553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c0a7fe6b-b7c7-4753-a2db-e3ad5266df9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:18.405654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0a7fe6b-b7c7-4753-a2db-e3ad5266df9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.405654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0a7fe6b-b7c7-4753-a2db-e3ad5266df9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.405654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0a7fe6b-b7c7-4753-a2db-e3ad5266df9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.410950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0a7fe6b-b7c7-4753-a2db-e3ad5266df9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.414622 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-fd32ba3d-e5e5-4352-99ff-da85014d8be9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] HTTP exception thrown: Instance af53bd56-06e6-4d0d-a71c-e2c35f0584a1 could not be found. Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fd32ba3d-e5e5-4352-99ff-da85014d8be9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Request method failure captured: Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 HTTP/1.1 Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6df8mzZ3op7XNnKY_UCFCR6MPbbyfjOys4kmOBvkKHV2qDe9Fyys3uKhJfh_39tezd9aHqonpFYZZGQSeJeTgK84SqB4Y74nmH4cxQ8rcI-W4Fn03C7HP3Ydy871oWmRtIwg7DG8sJHY1cKroLuk5OooXB-A6cxd4eXUP5RSU84l2rU Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 43ed3dcb7307452b965ee2d303ffaecd Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_43ed3dcb7307452b965ee2d303ffaecd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43ed3dcb7307452b965ee2d303ffaecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/43ed3dcb7307452b965ee2d303ffaecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43ed3dcb7307452b965ee2d303ffaecd"}]}] Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 43ed3dcb7307452b965ee2d303ffaecd Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerActionsTestJSON-2133022977-project Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: c6ac519db80b4ba99d67bd5db59be619 Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerActionsTestJSON-2133022977-project Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance af53bd56-06e6-4d0d-a71c-e2c35f0584a1 could not be found. Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'af53bd56-06e6-4d0d-a71c-e2c35f0584a1'} Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af53bd56-06e6-4d0d-a71c-e2c35f0584a1 could not be found. Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af53bd56-06e6-4d0d-a71c-e2c35f0584a1 could not be found. Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:18.416428 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.422066 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.422066 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:18.422066 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:18.422066 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:18.422066 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:18.422066 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af53bd56-06e6-4d0d-a71c-e2c35f0584a1 could not be found. Aug 03 02:16:18.422066 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.422066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fd32ba3d-e5e5-4352-99ff-da85014d8be9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Returning 404 to user: Instance af53bd56-06e6-4d0d-a71c-e2c35f0584a1 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:18.424667 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fd32ba3d-e5e5-4352-99ff-da85014d8be9 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1" status: 404 len: 111 microversion: 2.1 time: 0.128147 Aug 03 02:16:18.431195 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2439/4994] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:18 2022] GET /compute/v2.1/servers/af53bd56-06e6-4d0d-a71c-e2c35f0584a1 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:18.449726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-803079e6-566c-43d9-b139-8cbf163cf08e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:18.450345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-803079e6-566c-43d9-b139-8cbf163cf08e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:18.463525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-803079e6-566c-43d9-b139-8cbf163cf08e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.465774 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-c0a7fe6b-b7c7-4753-a2db-e3ad5266df9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. Aug 03 02:16:18.467365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-803079e6-566c-43d9-b139-8cbf163cf08e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.471724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-803079e6-566c-43d9-b139-8cbf163cf08e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.472417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-803079e6-566c-43d9-b139-8cbf163cf08e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c0a7fe6b-b7c7-4753-a2db-e3ad5266df9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab HTTP/1.1 Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '477b4b57-926f-4ea1-aef2-f6e50b9d22ab'} Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:18.473377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. Aug 03 02:16:18.488289 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.488289 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:18.488289 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.488289 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:18.488289 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:18.488289 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:18.488289 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:18.488289 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:18.488289 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. Aug 03 02:16:18.488289 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:18.488289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c0a7fe6b-b7c7-4753-a2db-e3ad5266df9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:18.488289 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c0a7fe6b-b7c7-4753-a2db-e3ad5266df9f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 404 len: 111 microversion: 2.1 time: 0.112923 Aug 03 02:16:18.488289 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2556/4995] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:16:18 2022] DELETE /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:18.510787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-16225693-ca58-4443-a7fc-86580c9dbc4d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:18.512918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-16225693-ca58-4443-a7fc-86580c9dbc4d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:18.536196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16225693-ca58-4443-a7fc-86580c9dbc4d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.540063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16225693-ca58-4443-a7fc-86580c9dbc4d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.541987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16225693-ca58-4443-a7fc-86580c9dbc4d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.550400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16225693-ca58-4443-a7fc-86580c9dbc4d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.662986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-16225693-ca58-4443-a7fc-86580c9dbc4d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:16:18.777899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:16:18.889046 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-16225693-ca58-4443-a7fc-86580c9dbc4d tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "DELETE /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 204 len: 0 microversion: 2.1 time: 0.387050 Aug 03 02:16:18.891001 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2557/4996] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:16:18 2022] DELETE /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:16:18.915830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd117033-f579-4852-8c85-a2f53b3613e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:18.934639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cd117033-f579-4852-8c85-a2f53b3613e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 477b4b57-926f-4ea1-aef2-f6e50b9d22ab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:18.964969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd117033-f579-4852-8c85-a2f53b3613e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.968179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd117033-f579-4852-8c85-a2f53b3613e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:18.971455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd117033-f579-4852-8c85-a2f53b3613e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:18.973235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd117033-f579-4852-8c85-a2f53b3613e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:19.046736 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-cd117033-f579-4852-8c85-a2f53b3613e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd117033-f579-4852-8c85-a2f53b3613e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab HTTP/1.1 Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '477b4b57-926f-4ea1-aef2-f6e50b9d22ab'} Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:19.058189 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:19.067941 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:19.067941 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:19.067941 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:19.067941 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:19.067941 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:19.067941 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. Aug 03 02:16:19.067941 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:16:19.071888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd117033-f579-4852-8c85-a2f53b3613e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 477b4b57-926f-4ea1-aef2-f6e50b9d22ab could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:19.074459 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cd117033-f579-4852-8c85-a2f53b3613e5 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab" status: 404 len: 111 microversion: 2.1 time: 0.180175 Aug 03 02:16:19.076148 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2558/4997] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:18 2022] GET /compute/v2.1/servers/477b4b57-926f-4ea1-aef2-f6e50b9d22ab => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:19.093209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-249ca158-5c2b-412d-8033-3d13fd192418 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:19.095987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-249ca158-5c2b-412d-8033-3d13fd192418 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:19.117231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-249ca158-5c2b-412d-8033-3d13fd192418 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:19.118243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-249ca158-5c2b-412d-8033-3d13fd192418 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:19.119682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-249ca158-5c2b-412d-8033-3d13fd192418 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:19.121601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-249ca158-5c2b-412d-8033-3d13fd192418 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:19.371845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-803079e6-566c-43d9-b139-8cbf163cf08e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:19.395163 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-803079e6-566c-43d9-b139-8cbf163cf08e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 0.962105 Aug 03 02:16:19.399920 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2440/4998] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:18 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:19.428334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aa24a240-1e3a-4dde-ba65-3528b345c93d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:19.432292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-aa24a240-1e3a-4dde-ba65-3528b345c93d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:19.458719 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-aa24a240-1e3a-4dde-ba65-3528b345c93d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aa24a240-1e3a-4dde-ba65-3528b345c93d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/9d8a7c53-fcee-435e-acd4-f6b0ea63bacd HTTP/1.1 Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '9d8a7c53-fcee-435e-acd4-f6b0ea63bacd'} Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:19.465457 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:19.470419 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:19.470419 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:19.470419 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:19.470419 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:19.470419 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:19.470419 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. Aug 03 02:16:19.470419 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:19.470419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aa24a240-1e3a-4dde-ba65-3528b345c93d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:19.472696 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aa24a240-1e3a-4dde-ba65-3528b345c93d tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9d8a7c53-fcee-435e-acd4-f6b0ea63bacd" status: 404 len: 111 microversion: 2.1 time: 0.066306 Aug 03 02:16:19.476257 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2441/4999] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:16:19 2022] DELETE /compute/v2.1/servers/9d8a7c53-fcee-435e-acd4-f6b0ea63bacd => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:19.507846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ecd4c82a-d707-485e-90f1-d417601b01c9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:19.511849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ecd4c82a-d707-485e-90f1-d417601b01c9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:19.533441 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-ecd4c82a-d707-485e-90f1-d417601b01c9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ecd4c82a-d707-485e-90f1-d417601b01c9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/9d8a7c53-fcee-435e-acd4-f6b0ea63bacd HTTP/1.1 Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '9d8a7c53-fcee-435e-acd4-f6b0ea63bacd'} Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:19.535223 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:19.540966 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:19.540966 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:19.540966 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:19.540966 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. Aug 03 02:16:19.540966 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:19.540966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ecd4c82a-d707-485e-90f1-d417601b01c9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance 9d8a7c53-fcee-435e-acd4-f6b0ea63bacd could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:19.541806 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ecd4c82a-d707-485e-90f1-d417601b01c9 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/9d8a7c53-fcee-435e-acd4-f6b0ea63bacd" status: 404 len: 111 microversion: 2.1 time: 0.052179 Aug 03 02:16:19.547825 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2442/5000] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:19 2022] GET /compute/v2.1/servers/9d8a7c53-fcee-435e-acd4-f6b0ea63bacd => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:19.558085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8c19734e-916a-4b34-8757-2b544bb8acc8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:19.558600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8c19734e-916a-4b34-8757-2b544bb8acc8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:19.576021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c19734e-916a-4b34-8757-2b544bb8acc8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:19.576639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c19734e-916a-4b34-8757-2b544bb8acc8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:19.577617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c19734e-916a-4b34-8757-2b544bb8acc8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:19.578064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c19734e-916a-4b34-8757-2b544bb8acc8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:19.648016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8c19734e-916a-4b34-8757-2b544bb8acc8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:16:19.787496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-249ca158-5c2b-412d-8033-3d13fd192418 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:19.799680 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-249ca158-5c2b-412d-8033-3d13fd192418 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1495 microversion: 2.1 time: 0.721096 Aug 03 02:16:19.800510 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2559/5001] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:19 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1495 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:19.875742 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8c19734e-916a-4b34-8757-2b544bb8acc8 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 204 len: 0 microversion: 2.1 time: 0.320564 Aug 03 02:16:19.878757 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2443/5002] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:16:19 2022] DELETE /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:16:19.889681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-448d04c3-05fe-489e-b868-4c20f1c06a5a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:19.890596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-448d04c3-05fe-489e-b868-4c20f1c06a5a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:19.905761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-448d04c3-05fe-489e-b868-4c20f1c06a5a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:19.906463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-448d04c3-05fe-489e-b868-4c20f1c06a5a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:19.909646 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-448d04c3-05fe-489e-b868-4c20f1c06a5a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:19.913277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-448d04c3-05fe-489e-b868-4c20f1c06a5a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:20.436868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a5b25d12-f93f-42ca-ad54-f2d930bd1c60 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:20.438104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a5b25d12-f93f-42ca-ad54-f2d930bd1c60 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:20.459690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5b25d12-f93f-42ca-ad54-f2d930bd1c60 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:20.460371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5b25d12-f93f-42ca-ad54-f2d930bd1c60 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:20.463896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5b25d12-f93f-42ca-ad54-f2d930bd1c60 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:20.464981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5b25d12-f93f-42ca-ad54-f2d930bd1c60 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:20.980781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-448d04c3-05fe-489e-b868-4c20f1c06a5a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:20.992821 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-448d04c3-05fe-489e-b868-4c20f1c06a5a tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1480 microversion: 2.1 time: 1.109615 Aug 03 02:16:21.008337 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2560/5003] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:19 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1480 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:16:21.015272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e7d9251b-e9db-43dd-958f-ad82f4e3c849 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:21.019574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e7d9251b-e9db-43dd-958f-ad82f4e3c849 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:21.030635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7d9251b-e9db-43dd-958f-ad82f4e3c849 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:21.031569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7d9251b-e9db-43dd-958f-ad82f4e3c849 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:21.032695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7d9251b-e9db-43dd-958f-ad82f4e3c849 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:21.033453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7d9251b-e9db-43dd-958f-ad82f4e3c849 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:21.057838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a5b25d12-f93f-42ca-ad54-f2d930bd1c60 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:21.073474 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a5b25d12-f93f-42ca-ad54-f2d930bd1c60 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 0.642455 Aug 03 02:16:21.077625 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2444/5004] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:20 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:21.791478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-2fe84b3c-28ca-43aa-9858-8868342fe553 req-888e2da5-7746-4246-865b-bf1a594b77bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671ba3e8-afd3-4e1c-be42-220dd485da4a", "name": "network-vif-deleted", "tag": "109dc946-6e1d-4eb7-b1b0-67a1099e0972"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:21.829793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2fe84b3c-28ca-43aa-9858-8868342fe553 req-888e2da5-7746-4246-865b-bf1a594b77bb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:21.831398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2fe84b3c-28ca-43aa-9858-8868342fe553 req-888e2da5-7746-4246-865b-bf1a594b77bb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:21.868897 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-2fe84b3c-28ca-43aa-9858-8868342fe553 req-888e2da5-7746-4246-865b-bf1a594b77bb service nova] Creating event network-vif-deleted:109dc946-6e1d-4eb7-b1b0-67a1099e0972 for instance 671ba3e8-afd3-4e1c-be42-220dd485da4a on n-h1-826529-8 Aug 03 02:16:21.887572 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-2fe84b3c-28ca-43aa-9858-8868342fe553 req-888e2da5-7746-4246-865b-bf1a594b77bb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098412 Aug 03 02:16:21.891915 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2445/5005] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:16:22.026554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-529c1540-82df-4f60-9c50-0b3e66c5488c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:22.027793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-529c1540-82df-4f60-9c50-0b3e66c5488c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:22.037789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-529c1540-82df-4f60-9c50-0b3e66c5488c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:22.038634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-529c1540-82df-4f60-9c50-0b3e66c5488c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:22.041289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-529c1540-82df-4f60-9c50-0b3e66c5488c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:22.042601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-529c1540-82df-4f60-9c50-0b3e66c5488c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:22.202716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e7d9251b-e9db-43dd-958f-ad82f4e3c849 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:22.215903 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e7d9251b-e9db-43dd-958f-ad82f4e3c849 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 200 len: 1453 microversion: 2.1 time: 1.205650 Aug 03 02:16:22.225448 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2561/5006] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:21 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 1453 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:22.237138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-409be661-c3d3-48f4-b893-cd468e80a82d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:22.247217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-409be661-c3d3-48f4-b893-cd468e80a82d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:22.296276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-409be661-c3d3-48f4-b893-cd468e80a82d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:22.297007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-409be661-c3d3-48f4-b893-cd468e80a82d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:22.300164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-409be661-c3d3-48f4-b893-cd468e80a82d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:22.300864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-409be661-c3d3-48f4-b893-cd468e80a82d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:22.969286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-529c1540-82df-4f60-9c50-0b3e66c5488c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:22.982783 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-529c1540-82df-4f60-9c50-0b3e66c5488c tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1480 microversion: 2.1 time: 0.965727 Aug 03 02:16:22.987918 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2446/5007] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:22 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1480 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:16:23.245479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-83860815-f272-4862-8e7d-84c26559a6a2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:23.251305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-83860815-f272-4862-8e7d-84c26559a6a2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: 671ba3e8-afd3-4e1c-be42-220dd485da4a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:23.296791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83860815-f272-4862-8e7d-84c26559a6a2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:23.297942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83860815-f272-4862-8e7d-84c26559a6a2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:23.301417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83860815-f272-4862-8e7d-84c26559a6a2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:23.302452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83860815-f272-4862-8e7d-84c26559a6a2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:23.308599 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-409be661-c3d3-48f4-b893-cd468e80a82d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:23.340179 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-409be661-c3d3-48f4-b893-cd468e80a82d tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 1.110456 Aug 03 02:16:23.341492 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2562/5008] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:22 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:23.348861 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-83860815-f272-4862-8e7d-84c26559a6a2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] HTTP exception thrown: Instance 671ba3e8-afd3-4e1c-be42-220dd485da4a could not be found. Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-83860815-f272-4862-8e7d-84c26559a6a2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Request method failure captured: Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a HTTP/1.1 Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6df8mzZ3op7XNnKY_UCFCR6MPbbyfjOys4kmOBvkKHV2qDe9Fyys3uKhJfh_39tezd9aHqonpFYZZGQSeJeTgK84SqB4Y74nmH4cxQ8rcI-W4Fn03C7HP3Ydy871oWmRtIwg7DG8sJHY1cKroLuk5OooXB-A6cxd4eXUP5RSU84l2rU Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 43ed3dcb7307452b965ee2d303ffaecd Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_43ed3dcb7307452b965ee2d303ffaecd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43ed3dcb7307452b965ee2d303ffaecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/43ed3dcb7307452b965ee2d303ffaecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43ed3dcb7307452b965ee2d303ffaecd"}]}] Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 43ed3dcb7307452b965ee2d303ffaecd Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerActionsTestJSON-2133022977-project Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: c6ac519db80b4ba99d67bd5db59be619 Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerActionsTestJSON-2133022977-project Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 671ba3e8-afd3-4e1c-be42-220dd485da4a could not be found. Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '671ba3e8-afd3-4e1c-be42-220dd485da4a'} Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671ba3e8-afd3-4e1c-be42-220dd485da4a could not be found. Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671ba3e8-afd3-4e1c-be42-220dd485da4a could not be found. Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:23.354834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:23.360964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:23.360964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:23.360964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:23.360964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:23.360964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:23.360964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671ba3e8-afd3-4e1c-be42-220dd485da4a could not be found. Aug 03 02:16:23.360964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:23.364061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-83860815-f272-4862-8e7d-84c26559a6a2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Returning 404 to user: Instance 671ba3e8-afd3-4e1c-be42-220dd485da4a could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:23.369315 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-83860815-f272-4862-8e7d-84c26559a6a2 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a" status: 404 len: 111 microversion: 2.1 time: 0.128658 Aug 03 02:16:23.371211 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2447/5009] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:23 2022] GET /compute/v2.1/servers/671ba3e8-afd3-4e1c-be42-220dd485da4a => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:23.387242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7bf203c2-4afb-4d52-a94f-ff0238d512c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:23.390223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7bf203c2-4afb-4d52-a94f-ff0238d512c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:23.417900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bf203c2-4afb-4d52-a94f-ff0238d512c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:23.422481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bf203c2-4afb-4d52-a94f-ff0238d512c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:23.424468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bf203c2-4afb-4d52-a94f-ff0238d512c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:23.425623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7bf203c2-4afb-4d52-a94f-ff0238d512c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:23.474738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7bf203c2-4afb-4d52-a94f-ff0238d512c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:16:23.631589 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7bf203c2-4afb-4d52-a94f-ff0238d512c1 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 204 len: 0 microversion: 2.1 time: 0.253823 Aug 03 02:16:23.632483 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2563/5010] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:16:23 2022] DELETE /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:16:23.641863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-adbc4a5f-9bab-4e9d-910e-f0df55f87f03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:23.643474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-adbc4a5f-9bab-4e9d-910e-f0df55f87f03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:23.660148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adbc4a5f-9bab-4e9d-910e-f0df55f87f03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:23.661015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adbc4a5f-9bab-4e9d-910e-f0df55f87f03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:23.662196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adbc4a5f-9bab-4e9d-910e-f0df55f87f03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:23.662643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-adbc4a5f-9bab-4e9d-910e-f0df55f87f03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:23.725594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:16:24.014862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-768e0601-5cc5-4b47-a98e-53c466a47192 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:24.015935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-768e0601-5cc5-4b47-a98e-53c466a47192 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:24.024701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-768e0601-5cc5-4b47-a98e-53c466a47192 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:24.025457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-768e0601-5cc5-4b47-a98e-53c466a47192 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:24.026576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-768e0601-5cc5-4b47-a98e-53c466a47192 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:24.027237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-768e0601-5cc5-4b47-a98e-53c466a47192 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:24.130038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-adbc4a5f-9bab-4e9d-910e-f0df55f87f03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:24.156362 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-adbc4a5f-9bab-4e9d-910e-f0df55f87f03 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1674 microversion: 2.1 time: 0.519572 Aug 03 02:16:24.160717 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2448/5011] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:23 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1674 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:24.187726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-768e0601-5cc5-4b47-a98e-53c466a47192 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:24.202715 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-768e0601-5cc5-4b47-a98e-53c466a47192 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1438 microversion: 2.1 time: 0.187240 Aug 03 02:16:24.217880 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2564/5012] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:24 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1438 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:24.311114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-29d028cd-f85c-4e5c-b570-0849f5cd3855 req-29ef5b2d-22fb-4bfa-ae9f-1c9d6c9f23aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1991a8b-4afc-462d-942e-ab208c8a151c", "name": "network-vif-deleted", "tag": "666aaf85-743d-4b80-a07c-9c8c9d054602"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:24.335052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-29d028cd-f85c-4e5c-b570-0849f5cd3855 req-29ef5b2d-22fb-4bfa-ae9f-1c9d6c9f23aa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:24.337212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-29d028cd-f85c-4e5c-b570-0849f5cd3855 req-29ef5b2d-22fb-4bfa-ae9f-1c9d6c9f23aa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:24.394048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d67e371-2207-42ac-b9b5-41afdf98889e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:24.396104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6d67e371-2207-42ac-b9b5-41afdf98889e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:24.420216 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-29d028cd-f85c-4e5c-b570-0849f5cd3855 req-29ef5b2d-22fb-4bfa-ae9f-1c9d6c9f23aa service nova] Creating event network-vif-deleted:666aaf85-743d-4b80-a07c-9c8c9d054602 for instance c1991a8b-4afc-462d-942e-ab208c8a151c on n-h2-826529-8 Aug 03 02:16:24.469611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:16:24.474588 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-29d028cd-f85c-4e5c-b570-0849f5cd3855 req-29ef5b2d-22fb-4bfa-ae9f-1c9d6c9f23aa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168642 Aug 03 02:16:24.483655 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2449/5013] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:16:24.488470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d67e371-2207-42ac-b9b5-41afdf98889e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:24.491865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d67e371-2207-42ac-b9b5-41afdf98889e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:24.496653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d67e371-2207-42ac-b9b5-41afdf98889e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:24.498105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d67e371-2207-42ac-b9b5-41afdf98889e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:24.931339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6d67e371-2207-42ac-b9b5-41afdf98889e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:24.941718 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6d67e371-2207-42ac-b9b5-41afdf98889e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 0.556838 Aug 03 02:16:24.946771 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2565/5014] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:24 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:25.190747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5a5e7775-324a-417a-baf9-f9fa6d0852df tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:25.190747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5a5e7775-324a-417a-baf9-f9fa6d0852df tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:25.202118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:16:25.209803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a5e7775-324a-417a-baf9-f9fa6d0852df tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:25.210269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a5e7775-324a-417a-baf9-f9fa6d0852df tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:25.211669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a5e7775-324a-417a-baf9-f9fa6d0852df tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:25.212286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a5e7775-324a-417a-baf9-f9fa6d0852df tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:25.237296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5243fbee-5620-4a52-b912-4c997ee94b2f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:25.240078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5243fbee-5620-4a52-b912-4c997ee94b2f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:25.258249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5243fbee-5620-4a52-b912-4c997ee94b2f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:25.259137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5243fbee-5620-4a52-b912-4c997ee94b2f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:25.262529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5243fbee-5620-4a52-b912-4c997ee94b2f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:25.263939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5243fbee-5620-4a52-b912-4c997ee94b2f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:25.354400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5243fbee-5620-4a52-b912-4c997ee94b2f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:25.355099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5243fbee-5620-4a52-b912-4c997ee94b2f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:25.355580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-5243fbee-5620-4a52-b912-4c997ee94b2f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lazy-loading 'fault' on Instance uuid c1991a8b-4afc-462d-942e-ab208c8a151c {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:16:25.462401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5243fbee-5620-4a52-b912-4c997ee94b2f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2721f67579e542718483193be7515d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f9e14c4d544763bb0d94b60a40ef54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:25.480374 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5243fbee-5620-4a52-b912-4c997ee94b2f tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 200 len: 1283 microversion: 2.1 time: 0.250502 Aug 03 02:16:25.481208 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2566/5015] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:25 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 1283 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:25.699007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5a5e7775-324a-417a-baf9-f9fa6d0852df tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:25.712893 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5a5e7775-324a-417a-baf9-f9fa6d0852df tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1674 microversion: 2.1 time: 0.528007 Aug 03 02:16:25.717401 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2450/5016] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:25 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1674 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:25.974891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5912845d-0789-4f37-b8cb-9a93b9901dd3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:25.978667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5912845d-0789-4f37-b8cb-9a93b9901dd3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:26.015453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5912845d-0789-4f37-b8cb-9a93b9901dd3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:26.016788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5912845d-0789-4f37-b8cb-9a93b9901dd3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:26.025647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5912845d-0789-4f37-b8cb-9a93b9901dd3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:26.026420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5912845d-0789-4f37-b8cb-9a93b9901dd3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:26.346394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5912845d-0789-4f37-b8cb-9a93b9901dd3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:26.368760 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5912845d-0789-4f37-b8cb-9a93b9901dd3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 0.404018 Aug 03 02:16:26.371500 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2567/5017] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:25 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:16:26.514285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fa5fe389-25ee-40b8-89f4-b1805a917e63 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:26.516469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fa5fe389-25ee-40b8-89f4-b1805a917e63 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] [instance: c1991a8b-4afc-462d-942e-ab208c8a151c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:26.546668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fa5fe389-25ee-40b8-89f4-b1805a917e63 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:26.547522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fa5fe389-25ee-40b8-89f4-b1805a917e63 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:26.555252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fa5fe389-25ee-40b8-89f4-b1805a917e63 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:26.555252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fa5fe389-25ee-40b8-89f4-b1805a917e63 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:26.592311 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-fa5fe389-25ee-40b8-89f4-b1805a917e63 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] HTTP exception thrown: Instance c1991a8b-4afc-462d-942e-ab208c8a151c could not be found. Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fa5fe389-25ee-40b8-89f4-b1805a917e63 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Request method failure captured: Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c HTTP/1.1 Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dl4PnmzYgzZlhKuyVaFqB2lhUz176VRxLvIqgQV_-EX7rHdwsXR_OZZeQdDQ2hqJC_p23HN1wkj_GkKNiyY-gr4cIju9WoVJDqX4pGR9K3wUxVw8oVAiY_cFHGMlAKp6ZW96PQfUaxo7jJfx8-NX3Fczo441LgWIPuTxjuboWGjKuQ Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6f9e14c4d544763bb0d94b60a40ef54", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6f9e14c4d544763bb0d94b60a40ef54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6f9e14c4d544763bb0d94b60a40ef54"}]}] Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersTestJSON-1845519760 Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: d6f9e14c4d544763bb0d94b60a40ef54 Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersTestJSON-1845519760 Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 2721f67579e542718483193be7515d6b Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersTestJSON-1845519760-project Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance c1991a8b-4afc-462d-942e-ab208c8a151c could not be found. Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'c1991a8b-4afc-462d-942e-ab208c8a151c'} Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1991a8b-4afc-462d-942e-ab208c8a151c could not be found. Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1991a8b-4afc-462d-942e-ab208c8a151c could not be found. Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:26.599810 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:26.604993 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:26.604993 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:26.604993 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:26.604993 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:26.604993 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:26.604993 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1991a8b-4afc-462d-942e-ab208c8a151c could not be found. Aug 03 02:16:26.604993 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:26.607058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fa5fe389-25ee-40b8-89f4-b1805a917e63 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] Returning 404 to user: Instance c1991a8b-4afc-462d-942e-ab208c8a151c could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:26.609142 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fa5fe389-25ee-40b8-89f4-b1805a917e63 tempest-ServersTestJSON-1845519760 tempest-ServersTestJSON-1845519760-project] 10.222.0.67 "GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c" status: 404 len: 111 microversion: 2.1 time: 0.108635 Aug 03 02:16:26.618109 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2451/5018] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:26 2022] GET /compute/v2.1/servers/c1991a8b-4afc-462d-942e-ab208c8a151c => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:16:26.735722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5dec0a61-05db-48ca-b667-109d72b36487 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:26.737443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5dec0a61-05db-48ca-b667-109d72b36487 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:26.746896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5dec0a61-05db-48ca-b667-109d72b36487 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:26.747682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5dec0a61-05db-48ca-b667-109d72b36487 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:26.748783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5dec0a61-05db-48ca-b667-109d72b36487 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:26.749625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5dec0a61-05db-48ca-b667-109d72b36487 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:27.393843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ecb90bfb-598f-4766-9914-ce4000e0f5a8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:27.394079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5dec0a61-05db-48ca-b667-109d72b36487 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:27.394484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ecb90bfb-598f-4766-9914-ce4000e0f5a8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:27.406477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecb90bfb-598f-4766-9914-ce4000e0f5a8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:27.408828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecb90bfb-598f-4766-9914-ce4000e0f5a8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:27.409915 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecb90bfb-598f-4766-9914-ce4000e0f5a8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:27.410380 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecb90bfb-598f-4766-9914-ce4000e0f5a8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:27.411610 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5dec0a61-05db-48ca-b667-109d72b36487 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1674 microversion: 2.1 time: 0.680485 Aug 03 02:16:27.413094 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2568/5019] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:26 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1674 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:28.151612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8efe37fe-29e7-4ee9-adae-dff5442a5ad1 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:28.154067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8efe37fe-29e7-4ee9-adae-dff5442a5ad1 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:28.185711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8efe37fe-29e7-4ee9-adae-dff5442a5ad1 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:28.190875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8efe37fe-29e7-4ee9-adae-dff5442a5ad1 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:28.196439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8efe37fe-29e7-4ee9-adae-dff5442a5ad1 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:28.197103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8efe37fe-29e7-4ee9-adae-dff5442a5ad1 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:28.271425 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8efe37fe-29e7-4ee9-adae-dff5442a5ad1 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa/action" status: 200 len: 24571 microversion: 2.1 time: 0.124114 Aug 03 02:16:28.272612 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2569/5020] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:16:28 2022] POST /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa/action => generated 24571 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:16:28.434562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a0c6be50-aecf-43f0-8581-8afa7c2c4998 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:28.435751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a0c6be50-aecf-43f0-8581-8afa7c2c4998 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:28.465851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ecb90bfb-598f-4766-9914-ce4000e0f5a8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:28.484431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0c6be50-aecf-43f0-8581-8afa7c2c4998 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:28.484908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0c6be50-aecf-43f0-8581-8afa7c2c4998 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:28.489089 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ecb90bfb-598f-4766-9914-ce4000e0f5a8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 1.099448 Aug 03 02:16:28.491903 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2452/5021] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:27 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:28.492443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0c6be50-aecf-43f0-8581-8afa7c2c4998 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:28.493193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a0c6be50-aecf-43f0-8581-8afa7c2c4998 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:28.674336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a0c6be50-aecf-43f0-8581-8afa7c2c4998 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ac519db80b4ba99d67bd5db59be619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ed3dcb7307452b965ee2d303ffaecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:28.687686 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a0c6be50-aecf-43f0-8581-8afa7c2c4998 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 200 len: 1606 microversion: 2.1 time: 0.257499 Aug 03 02:16:28.703578 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2570/5022] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:28 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 1606 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:16:28.874604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-dcc0f7eb-9648-4eaf-aa2f-fa59ecd809d6 req-2090428a-ac51-4293-900c-deaee7328bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9952a14-056b-4b74-ab8c-791d16592ddf", "name": "network-vif-deleted", "tag": "6377bbf1-10a0-437b-a4d1-7bd2f82f03fe"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:28.902597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-dcc0f7eb-9648-4eaf-aa2f-fa59ecd809d6 req-2090428a-ac51-4293-900c-deaee7328bb6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:28.907671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-dcc0f7eb-9648-4eaf-aa2f-fa59ecd809d6 req-2090428a-ac51-4293-900c-deaee7328bb6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:28.949574 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-dcc0f7eb-9648-4eaf-aa2f-fa59ecd809d6 req-2090428a-ac51-4293-900c-deaee7328bb6 service nova] Creating event network-vif-deleted:6377bbf1-10a0-437b-a4d1-7bd2f82f03fe for instance b9952a14-056b-4b74-ab8c-791d16592ddf on n-h1-826529-8 Aug 03 02:16:28.974308 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-dcc0f7eb-9648-4eaf-aa2f-fa59ecd809d6 req-2090428a-ac51-4293-900c-deaee7328bb6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106243 Aug 03 02:16:28.975374 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2453/5023] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:16:29.514818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d501c8a8-ebf3-4d3e-8861-96fb83920169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:29.515489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d501c8a8-ebf3-4d3e-8861-96fb83920169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:29.535724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d501c8a8-ebf3-4d3e-8861-96fb83920169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:29.538834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d501c8a8-ebf3-4d3e-8861-96fb83920169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:29.541458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d501c8a8-ebf3-4d3e-8861-96fb83920169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:29.544567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d501c8a8-ebf3-4d3e-8861-96fb83920169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:29.730171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-22762633-8017-4489-a03b-483edef5f978 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:29.737608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-22762633-8017-4489-a03b-483edef5f978 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] [instance: b9952a14-056b-4b74-ab8c-791d16592ddf] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:29.769082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22762633-8017-4489-a03b-483edef5f978 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:29.770754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22762633-8017-4489-a03b-483edef5f978 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:29.775898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22762633-8017-4489-a03b-483edef5f978 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:29.778829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22762633-8017-4489-a03b-483edef5f978 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:29.821187 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-22762633-8017-4489-a03b-483edef5f978 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] HTTP exception thrown: Instance b9952a14-056b-4b74-ab8c-791d16592ddf could not be found. Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-22762633-8017-4489-a03b-483edef5f978 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Request method failure captured: Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf HTTP/1.1 Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6df8mzZ3op7XNnKY_UCFCR6MPbbyfjOys4kmOBvkKHV2qDe9Fyys3uKhJfh_39tezd9aHqonpFYZZGQSeJeTgK84SqB4Y74nmH4cxQ8rcI-W4Fn03C7HP3Ydy871oWmRtIwg7DG8sJHY1cKroLuk5OooXB-A6cxd4eXUP5RSU84l2rU Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 43ed3dcb7307452b965ee2d303ffaecd Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_43ed3dcb7307452b965ee2d303ffaecd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43ed3dcb7307452b965ee2d303ffaecd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/43ed3dcb7307452b965ee2d303ffaecd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/43ed3dcb7307452b965ee2d303ffaecd"}]}] Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 43ed3dcb7307452b965ee2d303ffaecd Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerActionsTestJSON-2133022977 Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerActionsTestJSON-2133022977-project Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: c6ac519db80b4ba99d67bd5db59be619 Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerActionsTestJSON-2133022977-project Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance b9952a14-056b-4b74-ab8c-791d16592ddf could not be found. Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'b9952a14-056b-4b74-ab8c-791d16592ddf'} Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9952a14-056b-4b74-ab8c-791d16592ddf could not be found. Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9952a14-056b-4b74-ab8c-791d16592ddf could not be found. Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:16:29.824541 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:29.831225 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:16:29.831225 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:16:29.831225 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:16:29.831225 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:16:29.831225 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:16:29.831225 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9952a14-056b-4b74-ab8c-791d16592ddf could not be found. Aug 03 02:16:29.831225 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:16:29.831225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-22762633-8017-4489-a03b-483edef5f978 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Returning 404 to user: Instance b9952a14-056b-4b74-ab8c-791d16592ddf could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:16:29.831225 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-22762633-8017-4489-a03b-483edef5f978 tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf" status: 404 len: 111 microversion: 2.1 time: 0.114707 Aug 03 02:16:29.832655 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2454/5024] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:29 2022] GET /compute/v2.1/servers/b9952a14-056b-4b74-ab8c-791d16592ddf => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:16:29.852457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2daca803-b7f9-422b-a8db-2b983243c87a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] Calling method '.version_select at 0x7f5b12823160>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:29.899185 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2daca803-b7f9-422b-a8db-2b983243c87a tempest-ServerActionsTestJSON-2133022977 tempest-ServerActionsTestJSON-2133022977-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908956651" status: 202 len: 0 microversion: 2.1 time: 0.060967 Aug 03 02:16:29.904614 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2455/5025] 10.222.0.67 () {58 vars in 1221 bytes} [Wed Aug 3 02:16:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908956651 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:16:30.080623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d501c8a8-ebf3-4d3e-8861-96fb83920169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:30.091272 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d501c8a8-ebf3-4d3e-8861-96fb83920169 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 0.582386 Aug 03 02:16:30.096550 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2571/5026] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:29 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:16:31.150450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f57f93bc-6615-4fba-8c41-5950424fb4a4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:31.151236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f57f93bc-6615-4fba-8c41-5950424fb4a4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:31.172827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f57f93bc-6615-4fba-8c41-5950424fb4a4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:31.173794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f57f93bc-6615-4fba-8c41-5950424fb4a4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:31.176682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f57f93bc-6615-4fba-8c41-5950424fb4a4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:31.178794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f57f93bc-6615-4fba-8c41-5950424fb4a4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:31.737109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f57f93bc-6615-4fba-8c41-5950424fb4a4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:31.748586 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f57f93bc-6615-4fba-8c41-5950424fb4a4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 0.604477 Aug 03 02:16:31.769138 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2456/5027] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:31 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:32.792232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f5ffd275-51de-4039-85c3-6c79a7b2b88f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:32.793588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f5ffd275-51de-4039-85c3-6c79a7b2b88f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:32.814922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5ffd275-51de-4039-85c3-6c79a7b2b88f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:32.819880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5ffd275-51de-4039-85c3-6c79a7b2b88f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:32.820909 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5ffd275-51de-4039-85c3-6c79a7b2b88f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:32.821448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5ffd275-51de-4039-85c3-6c79a7b2b88f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:33.434417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f5ffd275-51de-4039-85c3-6c79a7b2b88f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:33.437487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:16:33.455853 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f5ffd275-51de-4039-85c3-6c79a7b2b88f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 0.663551 Aug 03 02:16:33.456520 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2572/5028] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:32 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:34.499744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6bb3963b-83be-4276-9dc8-58239b33e899 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:34.505798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6bb3963b-83be-4276-9dc8-58239b33e899 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:34.540736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6bb3963b-83be-4276-9dc8-58239b33e899 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:34.541448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6bb3963b-83be-4276-9dc8-58239b33e899 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:34.542458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6bb3963b-83be-4276-9dc8-58239b33e899 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:34.545483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6bb3963b-83be-4276-9dc8-58239b33e899 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:35.268804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6bb3963b-83be-4276-9dc8-58239b33e899 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:35.282595 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6bb3963b-83be-4276-9dc8-58239b33e899 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 0.801395 Aug 03 02:16:35.296845 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2457/5029] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:34 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:36.319246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-079eaef1-5bbf-40a7-8bbf-2fbc9d506ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:36.324230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-079eaef1-5bbf-40a7-8bbf-2fbc9d506ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:36.358498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-079eaef1-5bbf-40a7-8bbf-2fbc9d506ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:36.359015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-079eaef1-5bbf-40a7-8bbf-2fbc9d506ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:36.360744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-079eaef1-5bbf-40a7-8bbf-2fbc9d506ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:36.364402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-079eaef1-5bbf-40a7-8bbf-2fbc9d506ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:37.300726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-079eaef1-5bbf-40a7-8bbf-2fbc9d506ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:37.313288 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-079eaef1-5bbf-40a7-8bbf-2fbc9d506ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 1.005017 Aug 03 02:16:37.320368 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2573/5030] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:36 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:38.340184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aedb2e5d-708c-479f-9aeb-72f940cd5158 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:38.341098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-aedb2e5d-708c-479f-9aeb-72f940cd5158 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:38.364101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aedb2e5d-708c-479f-9aeb-72f940cd5158 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:38.364565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aedb2e5d-708c-479f-9aeb-72f940cd5158 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:38.365381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aedb2e5d-708c-479f-9aeb-72f940cd5158 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:38.365824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aedb2e5d-708c-479f-9aeb-72f940cd5158 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:38.853286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-aedb2e5d-708c-479f-9aeb-72f940cd5158 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:38.862380 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aedb2e5d-708c-479f-9aeb-72f940cd5158 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 0.529019 Aug 03 02:16:38.876117 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2458/5031] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:38 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:39.239092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4120fa4f-1e6c-4bf6-99df-424f31b48e60 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:39.242434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4120fa4f-1e6c-4bf6-99df-424f31b48e60 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:39.270400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4120fa4f-1e6c-4bf6-99df-424f31b48e60 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:39.274803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4120fa4f-1e6c-4bf6-99df-424f31b48e60 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:39.276590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4120fa4f-1e6c-4bf6-99df-424f31b48e60 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:39.281667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4120fa4f-1e6c-4bf6-99df-424f31b48e60 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:39.886602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1586a69b-ee93-40a2-9491-e140538c4e4f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:39.887590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1586a69b-ee93-40a2-9491-e140538c4e4f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:39.916102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1586a69b-ee93-40a2-9491-e140538c4e4f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:39.918218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1586a69b-ee93-40a2-9491-e140538c4e4f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:39.922137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1586a69b-ee93-40a2-9491-e140538c4e4f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:39.922853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1586a69b-ee93-40a2-9491-e140538c4e4f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:40.529571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1586a69b-ee93-40a2-9491-e140538c4e4f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:40.582087 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1586a69b-ee93-40a2-9491-e140538c4e4f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 0.697038 Aug 03 02:16:40.584779 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2459/5032] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:39 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:40.919752 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4120fa4f-1e6c-4bf6-99df-424f31b48e60 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1833 microversion: 2.1 time: 1.691270 Aug 03 02:16:40.921676 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2574/5033] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:39 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1833 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:40.950424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9e367996-cb9d-472f-8984-c5d265645028 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:40.951358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9e367996-cb9d-472f-8984-c5d265645028 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:41.004201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e367996-cb9d-472f-8984-c5d265645028 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:41.006404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e367996-cb9d-472f-8984-c5d265645028 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:41.008635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e367996-cb9d-472f-8984-c5d265645028 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:41.009299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e367996-cb9d-472f-8984-c5d265645028 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:41.705640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9e367996-cb9d-472f-8984-c5d265645028 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:41.747340 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9e367996-cb9d-472f-8984-c5d265645028 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1682 microversion: 2.1 time: 0.803902 Aug 03 02:16:41.753750 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2460/5034] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:40 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1682 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:41.780983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f84f2a06-c6e0-4105-9012-2ae7353eaf55 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:41.782162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f84f2a06-c6e0-4105-9012-2ae7353eaf55 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:41.799321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f84f2a06-c6e0-4105-9012-2ae7353eaf55 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:41.800093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f84f2a06-c6e0-4105-9012-2ae7353eaf55 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:41.815958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f84f2a06-c6e0-4105-9012-2ae7353eaf55 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:41.816691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f84f2a06-c6e0-4105-9012-2ae7353eaf55 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:41.959758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-04f7df99-247a-4a60-9516-0f754056fb09 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-393174511", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": "none"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:42.216545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-04f7df99-247a-4a60-9516-0f754056fb09 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:16:42.218140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-04f7df99-247a-4a60-9516-0f754056fb09 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:16:42.222672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-04f7df99-247a-4a60-9516-0f754056fb09 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:16:42.225667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-04f7df99-247a-4a60-9516-0f754056fb09 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:16:42.226640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-04f7df99-247a-4a60-9516-0f754056fb09 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:16:42.271624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04f7df99-247a-4a60-9516-0f754056fb09 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:42.284964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04f7df99-247a-4a60-9516-0f754056fb09 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:42.286273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04f7df99-247a-4a60-9516-0f754056fb09 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:42.290135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04f7df99-247a-4a60-9516-0f754056fb09 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:42.374665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-04f7df99-247a-4a60-9516-0f754056fb09 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Getting quotas for project 7b187cc73a014678bad535929887003f. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:16:42.389984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-04f7df99-247a-4a60-9516-0f754056fb09 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Getting quotas for user 02f0373ce0954e78a70f9fecfba6b583 and project 7b187cc73a014678bad535929887003f. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:16:42.441788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-04f7df99-247a-4a60-9516-0f754056fb09 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:16:42.454070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-04f7df99-247a-4a60-9516-0f754056fb09 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:16:42.513086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f84f2a06-c6e0-4105-9012-2ae7353eaf55 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:42.528789 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f84f2a06-c6e0-4105-9012-2ae7353eaf55 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1516 microversion: 2.1 time: 0.769917 Aug 03 02:16:42.545987 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2461/5035] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:41 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1516 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:42.555479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7b4463ef-2a86-425a-a3a9-ac710da9d9b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:42.578076 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-04f7df99-247a-4a60-9516-0f754056fb09 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.172965 Aug 03 02:16:42.578748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7b4463ef-2a86-425a-a3a9-ac710da9d9b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:42.587190 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2575/5036] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 02:16:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 02:16:42.592399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2cb71303-5b06-4341-ab3c-1927bca118b8 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:42.622450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2cb71303-5b06-4341-ab3c-1927bca118b8 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:42.641688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b4463ef-2a86-425a-a3a9-ac710da9d9b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:42.644065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b4463ef-2a86-425a-a3a9-ac710da9d9b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:42.647235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b4463ef-2a86-425a-a3a9-ac710da9d9b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:42.649585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7b4463ef-2a86-425a-a3a9-ac710da9d9b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:42.759653 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7b4463ef-2a86-425a-a3a9-ac710da9d9b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa/action" status: 200 len: 32644 microversion: 2.1 time: 0.207207 Aug 03 02:16:42.768945 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2462/5037] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:16:42 2022] POST /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa/action => generated 32644 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:16:42.888890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2cb71303-5b06-4341-ab3c-1927bca118b8 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:42.911577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2cb71303-5b06-4341-ab3c-1927bca118b8 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:42.916040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2cb71303-5b06-4341-ab3c-1927bca118b8 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:42.931145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a42f6454-6b95-4708-9ff8-2f6bcee0a867 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:42.932128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a42f6454-6b95-4708-9ff8-2f6bcee0a867 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:42.932605 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2cb71303-5b06-4341-ab3c-1927bca118b8 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1277 microversion: 2.54 time: 0.337380 Aug 03 02:16:42.938718 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2576/5038] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:16:42 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1277 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:16:42.991624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a42f6454-6b95-4708-9ff8-2f6bcee0a867 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:42.992222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a42f6454-6b95-4708-9ff8-2f6bcee0a867 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:43.002622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a42f6454-6b95-4708-9ff8-2f6bcee0a867 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:43.012886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a42f6454-6b95-4708-9ff8-2f6bcee0a867 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:43.137405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a42f6454-6b95-4708-9ff8-2f6bcee0a867 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fa41ed04e41440349d97150eec5cda93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc74eb87957b455ea415c59a57adc886', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:43.138836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a42f6454-6b95-4708-9ff8-2f6bcee0a867 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] flavor_id is None. Assuming migration. {{(pid=125942) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 03 02:16:43.140188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a42f6454-6b95-4708-9ff8-2f6bcee0a867 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125942) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 02:16:43.560618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-05df4ce9-8a8a-41e4-a3c2-428d673c2da7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:43.563590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-05df4ce9-8a8a-41e4-a3c2-428d673c2da7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:43.598380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05df4ce9-8a8a-41e4-a3c2-428d673c2da7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:43.604388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05df4ce9-8a8a-41e4-a3c2-428d673c2da7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:43.611295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05df4ce9-8a8a-41e4-a3c2-428d673c2da7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:43.612740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05df4ce9-8a8a-41e4-a3c2-428d673c2da7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:44.004363 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a42f6454-6b95-4708-9ff8-2f6bcee0a867 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa/action" status: 202 len: 0 microversion: 2.1 time: 1.074714 Aug 03 02:16:44.007490 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2463/5039] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:16:42 2022] POST /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa/action => generated 0 bytes in 1083 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:16:44.023788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-905869f0-c5de-4cfa-8745-993203b5a112 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:44.028780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-905869f0-c5de-4cfa-8745-993203b5a112 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:44.052310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-905869f0-c5de-4cfa-8745-993203b5a112 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:44.056169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-905869f0-c5de-4cfa-8745-993203b5a112 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:44.059200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-905869f0-c5de-4cfa-8745-993203b5a112 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:44.063878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-905869f0-c5de-4cfa-8745-993203b5a112 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:44.479993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-905869f0-c5de-4cfa-8745-993203b5a112 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:44.550015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-905869f0-c5de-4cfa-8745-993203b5a112 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:44.559600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-905869f0-c5de-4cfa-8745-993203b5a112 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:44.565706 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-905869f0-c5de-4cfa-8745-993203b5a112 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1281 microversion: 2.54 time: 0.554830 Aug 03 02:16:44.570016 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2464/5040] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:16:44 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1281 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:16:44.593400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-05df4ce9-8a8a-41e4-a3c2-428d673c2da7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:44.603591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-21e87813-0884-410e-84ce-cc01d4961fc8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:44.605049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-21e87813-0884-410e-84ce-cc01d4961fc8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:44.627015 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-05df4ce9-8a8a-41e4-a3c2-428d673c2da7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1522 microversion: 2.1 time: 1.076525 Aug 03 02:16:44.628221 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2577/5041] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:43 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1522 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:16:44.654610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21e87813-0884-410e-84ce-cc01d4961fc8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:44.655187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21e87813-0884-410e-84ce-cc01d4961fc8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:44.662160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21e87813-0884-410e-84ce-cc01d4961fc8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:44.662160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21e87813-0884-410e-84ce-cc01d4961fc8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:45.602790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-21e87813-0884-410e-84ce-cc01d4961fc8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:45.604581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f265ae89-5c82-4087-b87b-b6de45e44ce6 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:45.605270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f265ae89-5c82-4087-b87b-b6de45e44ce6 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:45.627382 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-21e87813-0884-410e-84ce-cc01d4961fc8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1691 microversion: 2.1 time: 1.054209 Aug 03 02:16:45.628938 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2465/5042] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:44 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1691 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:45.652447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f265ae89-5c82-4087-b87b-b6de45e44ce6 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:45.654038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6f28bdca-dfda-48fe-a165-2a017e022b07 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:45.655229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6f28bdca-dfda-48fe-a165-2a017e022b07 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:45.655354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f265ae89-5c82-4087-b87b-b6de45e44ce6 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:45.660422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f265ae89-5c82-4087-b87b-b6de45e44ce6 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:45.660827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f265ae89-5c82-4087-b87b-b6de45e44ce6 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:45.664367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f28bdca-dfda-48fe-a165-2a017e022b07 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:45.665906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f28bdca-dfda-48fe-a165-2a017e022b07 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:45.667692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f28bdca-dfda-48fe-a165-2a017e022b07 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:45.668326 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f28bdca-dfda-48fe-a165-2a017e022b07 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:45.896524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f265ae89-5c82-4087-b87b-b6de45e44ce6 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:45.912224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f265ae89-5c82-4087-b87b-b6de45e44ce6 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:45.913839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f265ae89-5c82-4087-b87b-b6de45e44ce6 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:45.915091 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f265ae89-5c82-4087-b87b-b6de45e44ce6 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1335 microversion: 2.54 time: 0.314895 Aug 03 02:16:45.951098 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2578/5043] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:16:45 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1335 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:16:46.153602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6f28bdca-dfda-48fe-a165-2a017e022b07 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:46.179300 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6f28bdca-dfda-48fe-a165-2a017e022b07 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1522 microversion: 2.1 time: 0.524446 Aug 03 02:16:46.179300 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2466/5044] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:45 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1522 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:46.660268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-475f264f-a15f-445e-9c9a-2a5dd1f3f5ea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:46.661793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-475f264f-a15f-445e-9c9a-2a5dd1f3f5ea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:46.692455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-57326c54-476b-4387-a0d9-223d0a1cade0 req-d2b6ddc9-8f41-4e51-b4d9-41740faab5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebf6377-6b2d-437d-b7b9-15d48d084420", "name": "network-vif-unplugged", "status": "completed", "tag": "0a1e75bd-2f9b-4dd3-b10c-503f365f0667"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:46.697141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-475f264f-a15f-445e-9c9a-2a5dd1f3f5ea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:46.698108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-475f264f-a15f-445e-9c9a-2a5dd1f3f5ea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:46.699439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-475f264f-a15f-445e-9c9a-2a5dd1f3f5ea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:46.701567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-475f264f-a15f-445e-9c9a-2a5dd1f3f5ea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:46.760251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-57326c54-476b-4387-a0d9-223d0a1cade0 req-d2b6ddc9-8f41-4e51-b4d9-41740faab5d2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:46.770933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-57326c54-476b-4387-a0d9-223d0a1cade0 req-d2b6ddc9-8f41-4e51-b4d9-41740faab5d2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:46.823759 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-57326c54-476b-4387-a0d9-223d0a1cade0 req-d2b6ddc9-8f41-4e51-b4d9-41740faab5d2 service nova] Creating event network-vif-unplugged:0a1e75bd-2f9b-4dd3-b10c-503f365f0667 for instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 on n-h1-826529-8 Aug 03 02:16:46.845871 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-57326c54-476b-4387-a0d9-223d0a1cade0 req-d2b6ddc9-8f41-4e51-b4d9-41740faab5d2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156426 Aug 03 02:16:46.850408 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2467/5045] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:16:46.955226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8afa0590-810b-49f7-a747-8a034d4d7180 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:46.956391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8afa0590-810b-49f7-a747-8a034d4d7180 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:46.973264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8afa0590-810b-49f7-a747-8a034d4d7180 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:46.973848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8afa0590-810b-49f7-a747-8a034d4d7180 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:46.993029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8afa0590-810b-49f7-a747-8a034d4d7180 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:46.993547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8afa0590-810b-49f7-a747-8a034d4d7180 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:47.038345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:16:47.128216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-475f264f-a15f-445e-9c9a-2a5dd1f3f5ea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:47.156667 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-475f264f-a15f-445e-9c9a-2a5dd1f3f5ea tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1691 microversion: 2.1 time: 0.504556 Aug 03 02:16:47.158234 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2579/5046] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:46 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1691 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:16:47.185733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8afa0590-810b-49f7-a747-8a034d4d7180 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:47.202087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-caa190a4-27a8-4065-859c-122e7fec936f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:47.203497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-caa190a4-27a8-4065-859c-122e7fec936f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:47.214369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8afa0590-810b-49f7-a747-8a034d4d7180 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:47.216526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-caa190a4-27a8-4065-859c-122e7fec936f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:47.216999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-caa190a4-27a8-4065-859c-122e7fec936f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:47.217831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-caa190a4-27a8-4065-859c-122e7fec936f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:47.218289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-caa190a4-27a8-4065-859c-122e7fec936f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:47.225382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8afa0590-810b-49f7-a747-8a034d4d7180 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:47.235395 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8afa0590-810b-49f7-a747-8a034d4d7180 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1335 microversion: 2.54 time: 0.285831 Aug 03 02:16:47.240425 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2468/5047] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:16:46 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1335 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:16:47.567028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-caa190a4-27a8-4065-859c-122e7fec936f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:47.584488 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-caa190a4-27a8-4065-859c-122e7fec936f tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1522 microversion: 2.1 time: 0.388746 Aug 03 02:16:47.602595 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2580/5048] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:47 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:48.180488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0b053c08-8f7d-4bcd-849f-bda6055249cb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:48.181929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0b053c08-8f7d-4bcd-849f-bda6055249cb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:48.202001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b053c08-8f7d-4bcd-849f-bda6055249cb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:48.211625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b053c08-8f7d-4bcd-849f-bda6055249cb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:48.216295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b053c08-8f7d-4bcd-849f-bda6055249cb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:48.221118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b053c08-8f7d-4bcd-849f-bda6055249cb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:48.274061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e01c1e59-a4d3-4cfb-a7c0-df5c7398d9df tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:48.275573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e01c1e59-a4d3-4cfb-a7c0-df5c7398d9df tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:48.296468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e01c1e59-a4d3-4cfb-a7c0-df5c7398d9df tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:48.300899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e01c1e59-a4d3-4cfb-a7c0-df5c7398d9df tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:48.304127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e01c1e59-a4d3-4cfb-a7c0-df5c7398d9df tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:48.307814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e01c1e59-a4d3-4cfb-a7c0-df5c7398d9df tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:48.539771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e01c1e59-a4d3-4cfb-a7c0-df5c7398d9df tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:48.556487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e01c1e59-a4d3-4cfb-a7c0-df5c7398d9df tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:48.560534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e01c1e59-a4d3-4cfb-a7c0-df5c7398d9df tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:48.560534 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e01c1e59-a4d3-4cfb-a7c0-df5c7398d9df tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1356 microversion: 2.54 time: 0.296446 Aug 03 02:16:48.576345 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2581/5049] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:16:48 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1356 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:16:48.592706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-469027d5-3701-45c3-9e08-a837796f24c5 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Action: 'create', calling method: .version_select at 0x7f5b124eba60>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1352306632", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAi8ApCq406+kg7N/MxrTHxXxGDI/vLIJmMiMuKeBnFBp9cBVxHlIpb3QEQopq6C9DIPtA/Gmns7svpxL1Jcqnkpf0zoMJ5VY2bAeK5/VG/fgxCMVXIvEHWESe/JzV83w=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:48.629487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-469027d5-3701-45c3-9e08-a837796f24c5 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Getting quotas for project 7b187cc73a014678bad535929887003f. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:16:48.649202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-469027d5-3701-45c3-9e08-a837796f24c5 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Getting quotas for user 02f0373ce0954e78a70f9fecfba6b583 and project 7b187cc73a014678bad535929887003f. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:16:48.690946 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-469027d5-3701-45c3-9e08-a837796f24c5 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.106888 Aug 03 02:16:48.691653 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2582/5050] 10.222.0.67 () {62 vars in 1200 bytes} [Wed Aug 3 02:16:48 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 03 02:16:48.708296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-af10fded-8ba2-4119-b3d2-bea182fd8c44 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:48.709181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-af10fded-8ba2-4119-b3d2-bea182fd8c44 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:48.731925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af10fded-8ba2-4119-b3d2-bea182fd8c44 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:48.733051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af10fded-8ba2-4119-b3d2-bea182fd8c44 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:48.734127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af10fded-8ba2-4119-b3d2-bea182fd8c44 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:48.735128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-af10fded-8ba2-4119-b3d2-bea182fd8c44 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:48.938547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0b053c08-8f7d-4bcd-849f-bda6055249cb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:48.960257 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0b053c08-8f7d-4bcd-849f-bda6055249cb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1691 microversion: 2.1 time: 0.783697 Aug 03 02:16:48.990998 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2469/5051] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:48 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1691 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:49.013715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1352306632", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:49.018609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:49.037558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:49.038187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:49.039233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:49.039682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:49.386090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:16:49.387242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:16:49.388668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:16:49.392577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:16:49.394398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:16:49.569359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:49.581620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:49.586368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:49.589407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:49.589965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:49.674493 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3ef9ca96-1785-4c88-82b0-973730844175 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "POST /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb/action" status: 202 len: 1139 microversion: 2.54 time: 0.681957 Aug 03 02:16:49.677766 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2470/5052] 10.222.0.67 () {62 vars in 1320 bytes} [Wed Aug 3 02:16:48 2022] POST /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb/action => generated 1139 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 03 02:16:49.696693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-64d823f5-5b2a-4b52-8d20-91171e32b629 req-f66345e7-d3a2-45c0-a381-92c08e9c6b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebf6377-6b2d-437d-b7b9-15d48d084420", "name": "network-vif-plugged", "status": "completed", "tag": "0a1e75bd-2f9b-4dd3-b10c-503f365f0667"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:49.727008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-64d823f5-5b2a-4b52-8d20-91171e32b629 req-f66345e7-d3a2-45c0-a381-92c08e9c6b9f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:49.728524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-64d823f5-5b2a-4b52-8d20-91171e32b629 req-f66345e7-d3a2-45c0-a381-92c08e9c6b9f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:49.778266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-af10fded-8ba2-4119-b3d2-bea182fd8c44 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:49.791192 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-af10fded-8ba2-4119-b3d2-bea182fd8c44 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1522 microversion: 2.1 time: 1.096115 Aug 03 02:16:49.793013 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-64d823f5-5b2a-4b52-8d20-91171e32b629 req-f66345e7-d3a2-45c0-a381-92c08e9c6b9f service nova] Creating event network-vif-plugged:0a1e75bd-2f9b-4dd3-b10c-503f365f0667 for instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 on n-h1-826529-8 Aug 03 02:16:49.793825 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2583/5053] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:48 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1522 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:49.807319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-09050b86-3d4d-4409-bdf0-2c435b618c57 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:49.808238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-09050b86-3d4d-4409-bdf0-2c435b618c57 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:49.819512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-09050b86-3d4d-4409-bdf0-2c435b618c57 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:49.820178 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-64d823f5-5b2a-4b52-8d20-91171e32b629 req-f66345e7-d3a2-45c0-a381-92c08e9c6b9f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134604 Aug 03 02:16:49.820743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-09050b86-3d4d-4409-bdf0-2c435b618c57 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:49.821208 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2471/5054] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:16:49.822366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-09050b86-3d4d-4409-bdf0-2c435b618c57 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:49.823132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-09050b86-3d4d-4409-bdf0-2c435b618c57 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:50.025723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b3a830bb-8b91-4343-b698-c46fd0b32abd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:50.030828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b3a830bb-8b91-4343-b698-c46fd0b32abd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:50.057011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3a830bb-8b91-4343-b698-c46fd0b32abd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:50.061379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3a830bb-8b91-4343-b698-c46fd0b32abd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:50.062497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3a830bb-8b91-4343-b698-c46fd0b32abd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:50.070570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3a830bb-8b91-4343-b698-c46fd0b32abd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:50.101900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-09050b86-3d4d-4409-bdf0-2c435b618c57 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:50.137406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-09050b86-3d4d-4409-bdf0-2c435b618c57 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:50.153775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-09050b86-3d4d-4409-bdf0-2c435b618c57 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:50.156422 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-09050b86-3d4d-4409-bdf0-2c435b618c57 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.359762 Aug 03 02:16:50.163364 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2584/5055] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:16:49 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:16:50.644428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b3a830bb-8b91-4343-b698-c46fd0b32abd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:50.672448 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b3a830bb-8b91-4343-b698-c46fd0b32abd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1696 microversion: 2.1 time: 0.677722 Aug 03 02:16:50.676339 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2472/5056] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:49 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1696 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:50.822089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f7c94d77-6ff4-4c24-bf54-373ef221b895 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:50.822824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f7c94d77-6ff4-4c24-bf54-373ef221b895 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:50.838936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7c94d77-6ff4-4c24-bf54-373ef221b895 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:50.839544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7c94d77-6ff4-4c24-bf54-373ef221b895 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:50.840478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7c94d77-6ff4-4c24-bf54-373ef221b895 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:50.840989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7c94d77-6ff4-4c24-bf54-373ef221b895 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:51.188888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c5f0837c-680b-42b6-b42c-1e47f6336e76 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:51.190076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c5f0837c-680b-42b6-b42c-1e47f6336e76 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:51.210685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5f0837c-680b-42b6-b42c-1e47f6336e76 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:51.211525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5f0837c-680b-42b6-b42c-1e47f6336e76 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:51.214423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5f0837c-680b-42b6-b42c-1e47f6336e76 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:51.215703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5f0837c-680b-42b6-b42c-1e47f6336e76 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:51.319205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f7c94d77-6ff4-4c24-bf54-373ef221b895 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:51.333032 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f7c94d77-6ff4-4c24-bf54-373ef221b895 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1522 microversion: 2.1 time: 0.515276 Aug 03 02:16:51.347005 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2585/5057] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:50 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:51.396926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c5f0837c-680b-42b6-b42c-1e47f6336e76 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:51.411401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c5f0837c-680b-42b6-b42c-1e47f6336e76 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:51.413404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c5f0837c-680b-42b6-b42c-1e47f6336e76 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:51.418143 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c5f0837c-680b-42b6-b42c-1e47f6336e76 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.236484 Aug 03 02:16:51.424495 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2473/5058] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:16:51 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:16:51.699329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0a5342bf-e910-4789-87a9-5ef9ed09cab2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:51.700967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0a5342bf-e910-4789-87a9-5ef9ed09cab2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:51.718249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a5342bf-e910-4789-87a9-5ef9ed09cab2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:51.724003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a5342bf-e910-4789-87a9-5ef9ed09cab2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:51.744998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a5342bf-e910-4789-87a9-5ef9ed09cab2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:51.745828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a5342bf-e910-4789-87a9-5ef9ed09cab2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:52.328202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:16:52.337711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a5342bf-e910-4789-87a9-5ef9ed09cab2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:52.359142 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0a5342bf-e910-4789-87a9-5ef9ed09cab2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1696 microversion: 2.1 time: 0.664806 Aug 03 02:16:52.361595 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2586/5059] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:51 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1696 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:52.367096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-05c5b226-d3f9-4e28-b7c1-5f71e74da744 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:52.368221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-05c5b226-d3f9-4e28-b7c1-5f71e74da744 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:52.401644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05c5b226-d3f9-4e28-b7c1-5f71e74da744 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:52.424606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05c5b226-d3f9-4e28-b7c1-5f71e74da744 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:52.430291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05c5b226-d3f9-4e28-b7c1-5f71e74da744 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:52.433407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05c5b226-d3f9-4e28-b7c1-5f71e74da744 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:52.470143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-48cc8946-1f3b-45c1-b78b-a6fbd2aa8bd9 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:52.470785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-48cc8946-1f3b-45c1-b78b-a6fbd2aa8bd9 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:52.499422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48cc8946-1f3b-45c1-b78b-a6fbd2aa8bd9 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:52.499789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48cc8946-1f3b-45c1-b78b-a6fbd2aa8bd9 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:52.513846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48cc8946-1f3b-45c1-b78b-a6fbd2aa8bd9 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:52.514633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48cc8946-1f3b-45c1-b78b-a6fbd2aa8bd9 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:52.827621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-48cc8946-1f3b-45c1-b78b-a6fbd2aa8bd9 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:52.886562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-48cc8946-1f3b-45c1-b78b-a6fbd2aa8bd9 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:52.893634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-48cc8946-1f3b-45c1-b78b-a6fbd2aa8bd9 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:52.898289 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-48cc8946-1f3b-45c1-b78b-a6fbd2aa8bd9 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.437201 Aug 03 02:16:52.900453 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2587/5060] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:16:52 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:16:53.157994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-05c5b226-d3f9-4e28-b7c1-5f71e74da744 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:53.187164 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-05c5b226-d3f9-4e28-b7c1-5f71e74da744 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1507 microversion: 2.1 time: 0.830423 Aug 03 02:16:53.191768 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2474/5061] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:52 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1507 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:53.219187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-843e31e1-7c92-4f46-a2fb-d235207c7355 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:53.221192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-843e31e1-7c92-4f46-a2fb-d235207c7355 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:53.258259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-843e31e1-7c92-4f46-a2fb-d235207c7355 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:53.262470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-843e31e1-7c92-4f46-a2fb-d235207c7355 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:53.263774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-843e31e1-7c92-4f46-a2fb-d235207c7355 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:53.264410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-843e31e1-7c92-4f46-a2fb-d235207c7355 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:53.384549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-02cecb33-f3c2-4198-8fc9-a7cbdffa22e5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:53.390649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-02cecb33-f3c2-4198-8fc9-a7cbdffa22e5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:53.410725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02cecb33-f3c2-4198-8fc9-a7cbdffa22e5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:53.420467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02cecb33-f3c2-4198-8fc9-a7cbdffa22e5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:53.428864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02cecb33-f3c2-4198-8fc9-a7cbdffa22e5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:53.431605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-02cecb33-f3c2-4198-8fc9-a7cbdffa22e5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:54.097561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-843e31e1-7c92-4f46-a2fb-d235207c7355 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:54.110953 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-843e31e1-7c92-4f46-a2fb-d235207c7355 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 200 len: 1507 microversion: 2.1 time: 0.897670 Aug 03 02:16:54.125805 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2588/5062] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:53 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 1507 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:54.149188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-617a1d9e-3b1a-48d8-b5d9-c50189fc1fca tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:54.150052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-617a1d9e-3b1a-48d8-b5d9-c50189fc1fca tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:54.156783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-617a1d9e-3b1a-48d8-b5d9-c50189fc1fca tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:54.158079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-617a1d9e-3b1a-48d8-b5d9-c50189fc1fca tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:54.159434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-617a1d9e-3b1a-48d8-b5d9-c50189fc1fca tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:54.160050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-617a1d9e-3b1a-48d8-b5d9-c50189fc1fca tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:54.291256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-02cecb33-f3c2-4198-8fc9-a7cbdffa22e5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:54.315591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-617a1d9e-3b1a-48d8-b5d9-c50189fc1fca tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:54.333341 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-02cecb33-f3c2-4198-8fc9-a7cbdffa22e5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1696 microversion: 2.1 time: 0.954546 Aug 03 02:16:54.333683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-617a1d9e-3b1a-48d8-b5d9-c50189fc1fca tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:54.335263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-617a1d9e-3b1a-48d8-b5d9-c50189fc1fca tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:54.340447 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-617a1d9e-3b1a-48d8-b5d9-c50189fc1fca tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.199402 Aug 03 02:16:54.347898 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2475/5063] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:53 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1696 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:54.354190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-26de7144-e738-4a92-b080-2849a58b976e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:54.354782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-26de7144-e738-4a92-b080-2849a58b976e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:54.361585 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2589/5064] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:16:54 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:16:54.371901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26de7144-e738-4a92-b080-2849a58b976e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:54.373698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26de7144-e738-4a92-b080-2849a58b976e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:54.376802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26de7144-e738-4a92-b080-2849a58b976e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:54.378644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26de7144-e738-4a92-b080-2849a58b976e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:54.415800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-26de7144-e738-4a92-b080-2849a58b976e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:16:54.613166 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-26de7144-e738-4a92-b080-2849a58b976e tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 204 len: 0 microversion: 2.1 time: 0.262409 Aug 03 02:16:54.615331 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2476/5065] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:16:54 2022] DELETE /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:16:55.026683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-674035456", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "69b64e9a-4561-417b-8cc4-06f6cdef9e73"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:55.094804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:16:55.201785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] validate_networks() for [('69b64e9a-4561-417b-8cc4-06f6cdef9e73', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:16:55.371711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a348257a-a122-4114-ac6c-56ee046994de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:55.372849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a348257a-a122-4114-ac6c-56ee046994de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:55.388199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:16:55.390895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a348257a-a122-4114-ac6c-56ee046994de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:55.393675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a348257a-a122-4114-ac6c-56ee046994de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:55.395744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a348257a-a122-4114-ac6c-56ee046994de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:55.397132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a348257a-a122-4114-ac6c-56ee046994de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:55.956543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a348257a-a122-4114-ac6c-56ee046994de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:56.005467 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a348257a-a122-4114-ac6c-56ee046994de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1696 microversion: 2.1 time: 0.646059 Aug 03 02:16:56.008320 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2477/5066] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:55 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1696 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:56.021331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-16eecd25-f49c-4114-965b-e6250fffd7b0 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:56.030385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-16eecd25-f49c-4114-965b-e6250fffd7b0 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:56.049703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16eecd25-f49c-4114-965b-e6250fffd7b0 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:56.050556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16eecd25-f49c-4114-965b-e6250fffd7b0 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:56.066318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16eecd25-f49c-4114-965b-e6250fffd7b0 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:56.066861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-16eecd25-f49c-4114-965b-e6250fffd7b0 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:56.349406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-16eecd25-f49c-4114-965b-e6250fffd7b0 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:56.406315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-16eecd25-f49c-4114-965b-e6250fffd7b0 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:56.432794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-16eecd25-f49c-4114-965b-e6250fffd7b0 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:56.434044 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-16eecd25-f49c-4114-965b-e6250fffd7b0 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.424751 Aug 03 02:16:56.439559 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2478/5067] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:16:56 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:16:57.053115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8ec32d48-f7d2-4020-85cc-07eb8dfbb427 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:57.053748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8ec32d48-f7d2-4020-85cc-07eb8dfbb427 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:57.072569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8ec32d48-f7d2-4020-85cc-07eb8dfbb427 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:57.076544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8ec32d48-f7d2-4020-85cc-07eb8dfbb427 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:57.083761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8ec32d48-f7d2-4020-85cc-07eb8dfbb427 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:57.084969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8ec32d48-f7d2-4020-85cc-07eb8dfbb427 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:58.568494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:16:58.569251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:16:58.570172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:16:58.570992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:16:58.572090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:16:58.606150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:58.607338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:58.614030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:58.615033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:58.678189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Getting quotas for project dd9b137660a84e1bb2faa6301d569b57. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:16:58.711634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Getting quotas for user 19e7dbdb6aef40abba7ba06046b87c95 and project dd9b137660a84e1bb2faa6301d569b57. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:16:58.770357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:16:58.772981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:16:58.833212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8ec32d48-f7d2-4020-85cc-07eb8dfbb427 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:58.848049 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8ec32d48-f7d2-4020-85cc-07eb8dfbb427 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1696 microversion: 2.1 time: 1.797602 Aug 03 02:16:58.849566 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2479/5068] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:57 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1696 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:58.863713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-11422963-c634-473e-b696-8407739fbd48 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:58.869260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-11422963-c634-473e-b696-8407739fbd48 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:58.885390 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11422963-c634-473e-b696-8407739fbd48 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:58.894878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11422963-c634-473e-b696-8407739fbd48 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:58.896452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11422963-c634-473e-b696-8407739fbd48 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:58.898333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11422963-c634-473e-b696-8407739fbd48 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:58.904542 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bb782042-48e5-4bce-8773-da69b84c71b3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.887802 Aug 03 02:16:58.913411 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2590/5069] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:16:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:16:58.928425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-7846a38b-1282-4a88-bec6-fa7b7ae9f4e8 req-4171d91a-7626-487c-bccc-23ff7edadd1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ebf6377-6b2d-437d-b7b9-15d48d084420", "name": "network-vif-deleted", "tag": "0a1e75bd-2f9b-4dd3-b10c-503f365f0667"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:16:58.981351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7846a38b-1282-4a88-bec6-fa7b7ae9f4e8 req-4171d91a-7626-487c-bccc-23ff7edadd1d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:58.992783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7846a38b-1282-4a88-bec6-fa7b7ae9f4e8 req-4171d91a-7626-487c-bccc-23ff7edadd1d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:59.046790 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-7846a38b-1282-4a88-bec6-fa7b7ae9f4e8 req-4171d91a-7626-487c-bccc-23ff7edadd1d service nova] Creating event network-vif-deleted:0a1e75bd-2f9b-4dd3-b10c-503f365f0667 for instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 on n-h1-826529-8 Aug 03 02:16:59.066229 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-7846a38b-1282-4a88-bec6-fa7b7ae9f4e8 req-4171d91a-7626-487c-bccc-23ff7edadd1d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150697 Aug 03 02:16:59.071118 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2591/5070] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:16:59.096408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5ee5eb04-77fd-4b24-8948-d93ec982fed0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:59.098232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5ee5eb04-77fd-4b24-8948-d93ec982fed0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:59.310047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ee5eb04-77fd-4b24-8948-d93ec982fed0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:59.321268 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5ee5eb04-77fd-4b24-8948-d93ec982fed0 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1217 microversion: 2.1 time: 0.239290 Aug 03 02:16:59.321892 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2592/5071] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:59 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1217 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:16:59.671238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-11422963-c634-473e-b696-8407739fbd48 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:59.702832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-11422963-c634-473e-b696-8407739fbd48 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:59.711017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-11422963-c634-473e-b696-8407739fbd48 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:16:59.718547 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-11422963-c634-473e-b696-8407739fbd48 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.865502 Aug 03 02:16:59.725858 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2480/5072] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:16:58 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:16:59.879406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ca529ce2-8cff-4926-92a1-d5c08cb6f66d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:16:59.883837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ca529ce2-8cff-4926-92a1-d5c08cb6f66d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:16:59.898613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca529ce2-8cff-4926-92a1-d5c08cb6f66d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:59.899777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca529ce2-8cff-4926-92a1-d5c08cb6f66d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:16:59.901058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca529ce2-8cff-4926-92a1-d5c08cb6f66d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:16:59.902515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ca529ce2-8cff-4926-92a1-d5c08cb6f66d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:00.348804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2f22dade-4f2c-44a2-8d9f-36c88dda79cc tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:00.350131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2f22dade-4f2c-44a2-8d9f-36c88dda79cc tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:00.379730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f22dade-4f2c-44a2-8d9f-36c88dda79cc tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:00.380202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f22dade-4f2c-44a2-8d9f-36c88dda79cc tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:00.381027 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f22dade-4f2c-44a2-8d9f-36c88dda79cc tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:00.381482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f22dade-4f2c-44a2-8d9f-36c88dda79cc tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:00.467206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:00.671797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2f22dade-4f2c-44a2-8d9f-36c88dda79cc tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:00.693522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ca529ce2-8cff-4926-92a1-d5c08cb6f66d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:00.697443 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2f22dade-4f2c-44a2-8d9f-36c88dda79cc tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1213 microversion: 2.1 time: 0.354315 Aug 03 02:17:00.708751 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ca529ce2-8cff-4926-92a1-d5c08cb6f66d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1696 microversion: 2.1 time: 0.835848 Aug 03 02:17:00.724683 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2593/5073] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:16:59 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1696 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:00.746043 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2481/5074] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:00 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1213 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:17:00.770280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-948680a9-af87-427b-bb39-a319368e465e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:00.772476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-948680a9-af87-427b-bb39-a319368e465e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:00.790607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-948680a9-af87-427b-bb39-a319368e465e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:00.791775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-948680a9-af87-427b-bb39-a319368e465e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:00.793118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-948680a9-af87-427b-bb39-a319368e465e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:00.793959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-948680a9-af87-427b-bb39-a319368e465e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:00.847558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:00.976350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-948680a9-af87-427b-bb39-a319368e465e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:01.003913 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-948680a9-af87-427b-bb39-a319368e465e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:01.006480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-948680a9-af87-427b-bb39-a319368e465e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:01.009616 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-948680a9-af87-427b-bb39-a319368e465e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.252726 Aug 03 02:17:01.028499 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2594/5075] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:00 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:01.742724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e88f25aa-767b-43de-9976-b12ad9e5e58c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:01.743389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e88f25aa-767b-43de-9976-b12ad9e5e58c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:01.757224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-729eda87-301f-4a2b-8dd3-7ab9a9a9bf15 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:01.761508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e88f25aa-767b-43de-9976-b12ad9e5e58c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:01.762248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-729eda87-301f-4a2b-8dd3-7ab9a9a9bf15 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:01.765967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e88f25aa-767b-43de-9976-b12ad9e5e58c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:01.767946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e88f25aa-767b-43de-9976-b12ad9e5e58c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:01.771952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e88f25aa-767b-43de-9976-b12ad9e5e58c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:01.785422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-729eda87-301f-4a2b-8dd3-7ab9a9a9bf15 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:01.795862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-729eda87-301f-4a2b-8dd3-7ab9a9a9bf15 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:01.798264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-729eda87-301f-4a2b-8dd3-7ab9a9a9bf15 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:01.803960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-729eda87-301f-4a2b-8dd3-7ab9a9a9bf15 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:02.483739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-729eda87-301f-4a2b-8dd3-7ab9a9a9bf15 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:02.497369 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-729eda87-301f-4a2b-8dd3-7ab9a9a9bf15 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1275 microversion: 2.1 time: 0.748405 Aug 03 02:17:02.514870 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2595/5076] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:01 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1275 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:02.522349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-17255be7-3838-426e-9d3e-b54573b1aa72 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:02.523188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-17255be7-3838-426e-9d3e-b54573b1aa72 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:02.530106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-17255be7-3838-426e-9d3e-b54573b1aa72 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:02.531034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-17255be7-3838-426e-9d3e-b54573b1aa72 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:02.532068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-17255be7-3838-426e-9d3e-b54573b1aa72 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:02.532850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-17255be7-3838-426e-9d3e-b54573b1aa72 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:03.215073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-17255be7-3838-426e-9d3e-b54573b1aa72 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:03.233445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-17255be7-3838-426e-9d3e-b54573b1aa72 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:03.241334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-17255be7-3838-426e-9d3e-b54573b1aa72 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:03.246116 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-17255be7-3838-426e-9d3e-b54573b1aa72 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.729743 Aug 03 02:17:03.258955 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2596/5077] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:02 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:03.288635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e88f25aa-767b-43de-9976-b12ad9e5e58c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:03.298028 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e88f25aa-767b-43de-9976-b12ad9e5e58c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1696 microversion: 2.1 time: 1.561418 Aug 03 02:17:03.311106 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2482/5078] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:01 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1696 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:03.523048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-43ed012f-d895-4d17-a7d7-c842d4c9b71b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:03.523930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-43ed012f-d895-4d17-a7d7-c842d4c9b71b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:03.541399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43ed012f-d895-4d17-a7d7-c842d4c9b71b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:03.542071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43ed012f-d895-4d17-a7d7-c842d4c9b71b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:03.545956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43ed012f-d895-4d17-a7d7-c842d4c9b71b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:03.546822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43ed012f-d895-4d17-a7d7-c842d4c9b71b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:03.787323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-43ed012f-d895-4d17-a7d7-c842d4c9b71b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:03.802019 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-43ed012f-d895-4d17-a7d7-c842d4c9b71b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1275 microversion: 2.1 time: 0.283252 Aug 03 02:17:03.818938 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2597/5079] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:03 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1275 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:04.305842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f1bdbe74-ee53-4416-afce-512d39aba286 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:04.307865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f1bdbe74-ee53-4416-afce-512d39aba286 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:04.321590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-125c9e8a-1934-4b7e-a39c-7598c4ef1dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:04.322577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-125c9e8a-1934-4b7e-a39c-7598c4ef1dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:04.339610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-125c9e8a-1934-4b7e-a39c-7598c4ef1dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:04.342352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-125c9e8a-1934-4b7e-a39c-7598c4ef1dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:04.345306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-125c9e8a-1934-4b7e-a39c-7598c4ef1dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:04.346148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-125c9e8a-1934-4b7e-a39c-7598c4ef1dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:04.346290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1bdbe74-ee53-4416-afce-512d39aba286 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:04.347347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1bdbe74-ee53-4416-afce-512d39aba286 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:04.352402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1bdbe74-ee53-4416-afce-512d39aba286 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:04.356310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f1bdbe74-ee53-4416-afce-512d39aba286 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:04.768532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f1bdbe74-ee53-4416-afce-512d39aba286 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:04.789410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f1bdbe74-ee53-4416-afce-512d39aba286 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:04.795119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f1bdbe74-ee53-4416-afce-512d39aba286 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:04.799028 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f1bdbe74-ee53-4416-afce-512d39aba286 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.505787 Aug 03 02:17:04.799529 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2483/5080] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:04 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:04.838791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5444353b-92ec-4ede-b2f3-9c3041ee7934 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:04.839496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5444353b-92ec-4ede-b2f3-9c3041ee7934 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:04.853246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5444353b-92ec-4ede-b2f3-9c3041ee7934 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:04.853738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5444353b-92ec-4ede-b2f3-9c3041ee7934 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:04.854618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5444353b-92ec-4ede-b2f3-9c3041ee7934 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:04.855123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5444353b-92ec-4ede-b2f3-9c3041ee7934 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:05.860276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-125c9e8a-1934-4b7e-a39c-7598c4ef1dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:05.877618 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-125c9e8a-1934-4b7e-a39c-7598c4ef1dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1695 microversion: 2.1 time: 1.554208 Aug 03 02:17:05.879032 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2598/5081] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:04 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1695 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:05.888896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a810aa06-f78b-4be8-a15d-ff9b9bb2bcb1 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:05.893083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a810aa06-f78b-4be8-a15d-ff9b9bb2bcb1 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:05.909528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a810aa06-f78b-4be8-a15d-ff9b9bb2bcb1 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:05.912853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a810aa06-f78b-4be8-a15d-ff9b9bb2bcb1 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:05.919523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a810aa06-f78b-4be8-a15d-ff9b9bb2bcb1 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:05.920289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a810aa06-f78b-4be8-a15d-ff9b9bb2bcb1 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:06.254666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a810aa06-f78b-4be8-a15d-ff9b9bb2bcb1 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:06.272721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a810aa06-f78b-4be8-a15d-ff9b9bb2bcb1 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:06.274885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a810aa06-f78b-4be8-a15d-ff9b9bb2bcb1 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:06.276764 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a810aa06-f78b-4be8-a15d-ff9b9bb2bcb1 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.396258 Aug 03 02:17:06.291298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5444353b-92ec-4ede-b2f3-9c3041ee7934 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:06.311429 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2599/5082] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:05 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:06.316417 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5444353b-92ec-4ede-b2f3-9c3041ee7934 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1317 microversion: 2.1 time: 1.481780 Aug 03 02:17:06.322489 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2484/5083] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:04 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1317 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:17:06.953729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ab6b363b-47b3-456d-88bf-0cc2debdc36f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:06.958608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ab6b363b-47b3-456d-88bf-0cc2debdc36f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:06.967600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab6b363b-47b3-456d-88bf-0cc2debdc36f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:06.968247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab6b363b-47b3-456d-88bf-0cc2debdc36f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:06.971496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab6b363b-47b3-456d-88bf-0cc2debdc36f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:06.972255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab6b363b-47b3-456d-88bf-0cc2debdc36f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:06.977184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-e37b4075-aa1b-440c-90f1-cbd7bf0d3a96 req-13c9c830-bcd3-417f-b042-a01d1ced887a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e4bbb0-7656-402a-9305-ade9e15781fa", "name": "network-vif-unplugged", "status": "completed", "tag": "b6a555d7-75da-4324-9c4c-c241c08c8aad"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:07.022708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e37b4075-aa1b-440c-90f1-cbd7bf0d3a96 req-13c9c830-bcd3-417f-b042-a01d1ced887a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:07.023733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e37b4075-aa1b-440c-90f1-cbd7bf0d3a96 req-13c9c830-bcd3-417f-b042-a01d1ced887a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:07.098532 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e37b4075-aa1b-440c-90f1-cbd7bf0d3a96 req-13c9c830-bcd3-417f-b042-a01d1ced887a service nova] Creating event network-vif-unplugged:b6a555d7-75da-4324-9c4c-c241c08c8aad for instance b1e4bbb0-7656-402a-9305-ade9e15781fa on n-h1-826529-8 Aug 03 02:17:07.118009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-e37b4075-aa1b-440c-90f1-cbd7bf0d3a96 req-13c9c830-bcd3-417f-b042-a01d1ced887a service nova] Instance b1e4bbb0-7656-402a-9305-ade9e15781fa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:17:07.144645 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-e37b4075-aa1b-440c-90f1-cbd7bf0d3a96 req-13c9c830-bcd3-417f-b042-a01d1ced887a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171355 Aug 03 02:17:07.148813 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2485/5084] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:17:07.345057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-78398d42-fbf9-459e-b076-2a46399fce8a tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:07.346206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-78398d42-fbf9-459e-b076-2a46399fce8a tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:07.361183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78398d42-fbf9-459e-b076-2a46399fce8a tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:07.365789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78398d42-fbf9-459e-b076-2a46399fce8a tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:07.367307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78398d42-fbf9-459e-b076-2a46399fce8a tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:07.368213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-78398d42-fbf9-459e-b076-2a46399fce8a tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:07.656317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-78398d42-fbf9-459e-b076-2a46399fce8a tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:07.688846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-78398d42-fbf9-459e-b076-2a46399fce8a tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:07.692518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-78398d42-fbf9-459e-b076-2a46399fce8a tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:07.693947 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-78398d42-fbf9-459e-b076-2a46399fce8a tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.354249 Aug 03 02:17:07.694518 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2486/5085] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:07 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:17:07.738311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-22b6fa1f-bd46-4d5c-99b8-be08de9034c5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:07.739658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-22b6fa1f-bd46-4d5c-99b8-be08de9034c5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:07.757426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22b6fa1f-bd46-4d5c-99b8-be08de9034c5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:07.758359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22b6fa1f-bd46-4d5c-99b8-be08de9034c5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:07.760630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22b6fa1f-bd46-4d5c-99b8-be08de9034c5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:07.761325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22b6fa1f-bd46-4d5c-99b8-be08de9034c5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:08.305472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ab6b363b-47b3-456d-88bf-0cc2debdc36f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:08.325427 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ab6b363b-47b3-456d-88bf-0cc2debdc36f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1695 microversion: 2.1 time: 1.401893 Aug 03 02:17:08.337002 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2600/5086] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:06 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1695 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:08.532522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-22b6fa1f-bd46-4d5c-99b8-be08de9034c5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:08.542403 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-22b6fa1f-bd46-4d5c-99b8-be08de9034c5 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1317 microversion: 2.1 time: 0.828759 Aug 03 02:17:08.556898 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2487/5087] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:07 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1317 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:08.740608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-24e8442a-1ead-41d4-ace6-fffe5f34e449 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:08.741462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-24e8442a-1ead-41d4-ace6-fffe5f34e449 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:08.757635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:08.760049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24e8442a-1ead-41d4-ace6-fffe5f34e449 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:08.760974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24e8442a-1ead-41d4-ace6-fffe5f34e449 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:08.762008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24e8442a-1ead-41d4-ace6-fffe5f34e449 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:08.762717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24e8442a-1ead-41d4-ace6-fffe5f34e449 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:09.238622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-79e129d8-e8ce-4604-898f-84acf2916218 req-f1a632e9-3ab2-4e0e-9b2a-6d414c861ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02c3c095-a72b-4678-bc5b-b28cc58f5745", "tag": "68f07348-cd86-45a1-a0a3-452bddb788ac"}, {"name": "network-changed", "server_uuid": "b1e4bbb0-7656-402a-9305-ade9e15781fa", "tag": "b6a555d7-75da-4324-9c4c-c241c08c8aad"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:09.292626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-79e129d8-e8ce-4604-898f-84acf2916218 req-f1a632e9-3ab2-4e0e-9b2a-6d414c861ed4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:09.295436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-79e129d8-e8ce-4604-898f-84acf2916218 req-f1a632e9-3ab2-4e0e-9b2a-6d414c861ed4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:09.319856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=20 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:09.348123 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-79e129d8-e8ce-4604-898f-84acf2916218 req-f1a632e9-3ab2-4e0e-9b2a-6d414c861ed4 service nova] Creating event network-changed:68f07348-cd86-45a1-a0a3-452bddb788ac for instance 02c3c095-a72b-4678-bc5b-b28cc58f5745 on n-h1-826529-8 Aug 03 02:17:09.349208 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-79e129d8-e8ce-4604-898f-84acf2916218 req-f1a632e9-3ab2-4e0e-9b2a-6d414c861ed4 service nova] Creating event network-changed:b6a555d7-75da-4324-9c4c-c241c08c8aad for instance b1e4bbb0-7656-402a-9305-ade9e15781fa on n-h1-826529-8 Aug 03 02:17:09.364378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-79e129d8-e8ce-4604-898f-84acf2916218 req-f1a632e9-3ab2-4e0e-9b2a-6d414c861ed4 service nova] Instance b1e4bbb0-7656-402a-9305-ade9e15781fa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:17:09.388912 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-79e129d8-e8ce-4604-898f-84acf2916218 req-f1a632e9-3ab2-4e0e-9b2a-6d414c861ed4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.159713 Aug 03 02:17:09.393924 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2488/5088] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:17:09.403296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-44b56ba5-7139-4726-b40c-6e9c22b43dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:09.404192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-44b56ba5-7139-4726-b40c-6e9c22b43dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:09.412906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44b56ba5-7139-4726-b40c-6e9c22b43dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:09.413277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44b56ba5-7139-4726-b40c-6e9c22b43dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:09.416531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44b56ba5-7139-4726-b40c-6e9c22b43dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:09.417263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-44b56ba5-7139-4726-b40c-6e9c22b43dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:09.579540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-24e8442a-1ead-41d4-ace6-fffe5f34e449 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:09.589265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-24e8442a-1ead-41d4-ace6-fffe5f34e449 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:09.591258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-24e8442a-1ead-41d4-ace6-fffe5f34e449 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:09.593372 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-24e8442a-1ead-41d4-ace6-fffe5f34e449 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.856906 Aug 03 02:17:09.608483 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2601/5089] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:08 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:09.624150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0546c923-79bc-4f00-a3cd-bc14b1064ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:09.624946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0546c923-79bc-4f00-a3cd-bc14b1064ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:09.634044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0546c923-79bc-4f00-a3cd-bc14b1064ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:09.634761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0546c923-79bc-4f00-a3cd-bc14b1064ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:09.636212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0546c923-79bc-4f00-a3cd-bc14b1064ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:09.636915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0546c923-79bc-4f00-a3cd-bc14b1064ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:10.348830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-44b56ba5-7139-4726-b40c-6e9c22b43dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:10.364822 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-44b56ba5-7139-4726-b40c-6e9c22b43dff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1695 microversion: 2.1 time: 0.969167 Aug 03 02:17:10.366827 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2489/5090] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:09 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1695 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:10.533918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0546c923-79bc-4f00-a3cd-bc14b1064ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:10.543815 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0546c923-79bc-4f00-a3cd-bc14b1064ee2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1317 microversion: 2.1 time: 0.933878 Aug 03 02:17:10.544841 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2602/5091] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:09 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1317 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:10.644552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5dbcf0bb-a0ba-470c-89bd-b4459572e73e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:10.646199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5dbcf0bb-a0ba-470c-89bd-b4459572e73e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:10.665429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dbcf0bb-a0ba-470c-89bd-b4459572e73e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:10.666700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dbcf0bb-a0ba-470c-89bd-b4459572e73e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:10.669304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dbcf0bb-a0ba-470c-89bd-b4459572e73e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:10.670432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dbcf0bb-a0ba-470c-89bd-b4459572e73e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:11.200914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5dbcf0bb-a0ba-470c-89bd-b4459572e73e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:11.228691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5dbcf0bb-a0ba-470c-89bd-b4459572e73e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:11.240596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5dbcf0bb-a0ba-470c-89bd-b4459572e73e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:11.243563 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5dbcf0bb-a0ba-470c-89bd-b4459572e73e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.622279 Aug 03 02:17:11.245625 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2490/5092] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:10 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:11.394628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-beb28568-c602-441b-8adc-d2ceaa4b9756 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:11.395390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-beb28568-c602-441b-8adc-d2ceaa4b9756 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:11.418609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-beb28568-c602-441b-8adc-d2ceaa4b9756 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:11.419161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-beb28568-c602-441b-8adc-d2ceaa4b9756 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:11.420019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-beb28568-c602-441b-8adc-d2ceaa4b9756 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:11.420477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-beb28568-c602-441b-8adc-d2ceaa4b9756 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:11.588568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a6f3355d-dcf1-4e44-b5c0-5664f59df841 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:11.594805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a6f3355d-dcf1-4e44-b5c0-5664f59df841 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:11.610501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6f3355d-dcf1-4e44-b5c0-5664f59df841 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:11.612744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6f3355d-dcf1-4e44-b5c0-5664f59df841 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:11.616579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6f3355d-dcf1-4e44-b5c0-5664f59df841 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:11.617965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6f3355d-dcf1-4e44-b5c0-5664f59df841 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:12.512539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-beb28568-c602-441b-8adc-d2ceaa4b9756 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:12.529785 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-beb28568-c602-441b-8adc-d2ceaa4b9756 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1695 microversion: 2.1 time: 1.144012 Aug 03 02:17:12.531618 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2603/5093] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:11 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1695 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:12.543080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f55e4c48-73bc-480a-96a2-62376a080377 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:12.544482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f55e4c48-73bc-480a-96a2-62376a080377 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:12.561097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f55e4c48-73bc-480a-96a2-62376a080377 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:12.563046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f55e4c48-73bc-480a-96a2-62376a080377 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:12.565093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f55e4c48-73bc-480a-96a2-62376a080377 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:12.566173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f55e4c48-73bc-480a-96a2-62376a080377 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:12.732374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a6f3355d-dcf1-4e44-b5c0-5664f59df841 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:12.751857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f55e4c48-73bc-480a-96a2-62376a080377 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:12.762217 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a6f3355d-dcf1-4e44-b5c0-5664f59df841 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1317 microversion: 2.1 time: 1.181944 Aug 03 02:17:12.766731 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2491/5094] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:11 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1317 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:12.769014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f55e4c48-73bc-480a-96a2-62376a080377 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:12.770920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f55e4c48-73bc-480a-96a2-62376a080377 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:12.772691 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f55e4c48-73bc-480a-96a2-62376a080377 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.239667 Aug 03 02:17:12.773857 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2604/5095] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:12 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:13.592867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-01a17fc4-13e8-4e69-849c-eb9373f85215 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:13.598227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-01a17fc4-13e8-4e69-849c-eb9373f85215 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:13.638062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01a17fc4-13e8-4e69-849c-eb9373f85215 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:13.638528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01a17fc4-13e8-4e69-849c-eb9373f85215 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:13.642157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01a17fc4-13e8-4e69-849c-eb9373f85215 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:13.642736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01a17fc4-13e8-4e69-849c-eb9373f85215 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:13.792654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-910961d9-77c1-472a-973c-a7a67fc33e67 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:13.793287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-910961d9-77c1-472a-973c-a7a67fc33e67 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:13.848063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-910961d9-77c1-472a-973c-a7a67fc33e67 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:13.850039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-910961d9-77c1-472a-973c-a7a67fc33e67 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:13.856125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-910961d9-77c1-472a-973c-a7a67fc33e67 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:13.858126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-910961d9-77c1-472a-973c-a7a67fc33e67 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:14.168989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-01a17fc4-13e8-4e69-849c-eb9373f85215 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:14.192982 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-01a17fc4-13e8-4e69-849c-eb9373f85215 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1693 microversion: 2.1 time: 0.631706 Aug 03 02:17:14.211385 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2492/5096] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:13 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1693 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:14.230367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-581009ff-0821-4d6a-9005-a314e2e4a212 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:14.231041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-581009ff-0821-4d6a-9005-a314e2e4a212 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:14.241394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-581009ff-0821-4d6a-9005-a314e2e4a212 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:14.241909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-581009ff-0821-4d6a-9005-a314e2e4a212 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:14.242854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-581009ff-0821-4d6a-9005-a314e2e4a212 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:14.243331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-581009ff-0821-4d6a-9005-a314e2e4a212 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:14.360833 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-581009ff-0821-4d6a-9005-a314e2e4a212 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:14.370768 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-910961d9-77c1-472a-973c-a7a67fc33e67 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:14.380216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-581009ff-0821-4d6a-9005-a314e2e4a212 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:14.381554 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-910961d9-77c1-472a-973c-a7a67fc33e67 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1317 microversion: 2.1 time: 0.593798 Aug 03 02:17:14.383222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-581009ff-0821-4d6a-9005-a314e2e4a212 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:14.388335 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-581009ff-0821-4d6a-9005-a314e2e4a212 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.175473 Aug 03 02:17:14.393033 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2493/5097] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:14 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:14.393938 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2605/5098] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:13 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1317 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:14.837810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-855331288", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "a64c0d9e-3475-446a-93eb-4a93bf4606f8"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:14.917300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] validate_networks() for [('a64c0d9e-3475-446a-93eb-4a93bf4606f8', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:17:15.226336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-930a1298-32f4-40fe-a136-23363af55175 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:15.227596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-930a1298-32f4-40fe-a136-23363af55175 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:15.238152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-930a1298-32f4-40fe-a136-23363af55175 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:15.238967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-930a1298-32f4-40fe-a136-23363af55175 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:15.239993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-930a1298-32f4-40fe-a136-23363af55175 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:15.240652 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-930a1298-32f4-40fe-a136-23363af55175 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:15.970748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:17:15.971529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:17:15.972362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:17:15.973070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:17:15.973994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:17:16.010739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:16.011554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:16.012979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:16.013730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:16.103407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Getting quotas for project 6141ae88ee4b4a82bd6251e49a6f4de8. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:17:16.125993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Getting quotas for user e8e131b018f141fc8b02c44e7fc8067e and project 6141ae88ee4b4a82bd6251e49a6f4de8. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:17:16.177251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-930a1298-32f4-40fe-a136-23363af55175 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:16.184274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:17:16.192514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:17:16.206680 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-930a1298-32f4-40fe-a136-23363af55175 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1690 microversion: 2.1 time: 0.984509 Aug 03 02:17:16.211022 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2606/5099] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:15 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1690 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:16.228909 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-231c1aab-3670-40ba-afac-a254d3114783 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:16.232965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-231c1aab-3670-40ba-afac-a254d3114783 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:16.267171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-231c1aab-3670-40ba-afac-a254d3114783 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:16.270592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-231c1aab-3670-40ba-afac-a254d3114783 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:16.273479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-231c1aab-3670-40ba-afac-a254d3114783 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:16.277899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-231c1aab-3670-40ba-afac-a254d3114783 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:16.289038 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ae734849-52bc-4307-b41b-029555b7241d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.686165 Aug 03 02:17:16.294955 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2494/5100] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:17:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 02:17:16.310674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0f4b75b-4d0c-45b4-8b82-3668c930dc05 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:16.311508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0f4b75b-4d0c-45b4-8b82-3668c930dc05 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:16.321427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0f4b75b-4d0c-45b4-8b82-3668c930dc05 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:16.322179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0f4b75b-4d0c-45b4-8b82-3668c930dc05 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:16.323458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0f4b75b-4d0c-45b4-8b82-3668c930dc05 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:16.324715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0f4b75b-4d0c-45b4-8b82-3668c930dc05 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:16.643387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0f4b75b-4d0c-45b4-8b82-3668c930dc05 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:16.664378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0f4b75b-4d0c-45b4-8b82-3668c930dc05 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:16.669048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0f4b75b-4d0c-45b4-8b82-3668c930dc05 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:16.672636 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0f4b75b-4d0c-45b4-8b82-3668c930dc05 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.374224 Aug 03 02:17:16.673528 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2495/5101] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:16 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:16.691132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-1641ef62-b9dc-427b-9c2d-ef997ff950e2 req-5b83f5e1-b3fd-4d5e-9663-4452fa579b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c3c095-a72b-4678-bc5b-b28cc58f5745", "name": "network-vif-plugged", "status": "completed", "tag": "68f07348-cd86-45a1-a0a3-452bddb788ac"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:16.717072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1641ef62-b9dc-427b-9c2d-ef997ff950e2 req-5b83f5e1-b3fd-4d5e-9663-4452fa579b6d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:16.718226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1641ef62-b9dc-427b-9c2d-ef997ff950e2 req-5b83f5e1-b3fd-4d5e-9663-4452fa579b6d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:16.788420 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-1641ef62-b9dc-427b-9c2d-ef997ff950e2 req-5b83f5e1-b3fd-4d5e-9663-4452fa579b6d service nova] Creating event network-vif-plugged:68f07348-cd86-45a1-a0a3-452bddb788ac for instance 02c3c095-a72b-4678-bc5b-b28cc58f5745 on n-h1-826529-8 Aug 03 02:17:16.800937 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-1641ef62-b9dc-427b-9c2d-ef997ff950e2 req-5b83f5e1-b3fd-4d5e-9663-4452fa579b6d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123855 Aug 03 02:17:16.806453 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2496/5102] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:17:16.818468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8e14890e-501b-484d-9500-6f4c45b12029 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:16.819841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8e14890e-501b-484d-9500-6f4c45b12029 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:16.842820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e14890e-501b-484d-9500-6f4c45b12029 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:16.844917 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e14890e-501b-484d-9500-6f4c45b12029 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:16.846763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e14890e-501b-484d-9500-6f4c45b12029 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:16.847889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e14890e-501b-484d-9500-6f4c45b12029 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:16.985128 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8e14890e-501b-484d-9500-6f4c45b12029 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa/action" status: 204 len: 0 microversion: 2.1 time: 0.175819 Aug 03 02:17:16.993513 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2497/5103] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:17:16 2022] POST /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa/action => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:17:17.008634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0f30efb4-e9bb-478e-b90e-86ec18249901 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:17.010259 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0f30efb4-e9bb-478e-b90e-86ec18249901 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:17.110936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-231c1aab-3670-40ba-afac-a254d3114783 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:17.139423 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-231c1aab-3670-40ba-afac-a254d3114783 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1317 microversion: 2.1 time: 0.921725 Aug 03 02:17:17.144394 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2607/5104] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:16 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1317 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:17.166306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-336389f1-3d1c-4fab-8bc7-ad2b42fb512c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:17.169868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-336389f1-3d1c-4fab-8bc7-ad2b42fb512c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:17.197022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-336389f1-3d1c-4fab-8bc7-ad2b42fb512c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:17.197617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-336389f1-3d1c-4fab-8bc7-ad2b42fb512c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:17.198268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-336389f1-3d1c-4fab-8bc7-ad2b42fb512c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:17.204727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-336389f1-3d1c-4fab-8bc7-ad2b42fb512c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:17.427498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0f30efb4-e9bb-478e-b90e-86ec18249901 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:17.444976 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0f30efb4-e9bb-478e-b90e-86ec18249901 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1224 microversion: 2.1 time: 0.448686 Aug 03 02:17:17.448965 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2498/5105] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:16 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1224 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:17.713825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-35bfcff5-c036-40ee-a6b5-63b3d0c134c3 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:17.716573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-35bfcff5-c036-40ee-a6b5-63b3d0c134c3 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:17.740235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35bfcff5-c036-40ee-a6b5-63b3d0c134c3 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:17.741121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35bfcff5-c036-40ee-a6b5-63b3d0c134c3 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:17.742199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35bfcff5-c036-40ee-a6b5-63b3d0c134c3 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:17.743233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35bfcff5-c036-40ee-a6b5-63b3d0c134c3 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:17.756046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-336389f1-3d1c-4fab-8bc7-ad2b42fb512c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:17.768544 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-336389f1-3d1c-4fab-8bc7-ad2b42fb512c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1690 microversion: 2.1 time: 0.622251 Aug 03 02:17:17.771724 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2608/5106] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:17 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1690 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:18.009227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-35bfcff5-c036-40ee-a6b5-63b3d0c134c3 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:18.025675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:18.075599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-35bfcff5-c036-40ee-a6b5-63b3d0c134c3 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:18.083189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-35bfcff5-c036-40ee-a6b5-63b3d0c134c3 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:18.095879 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-35bfcff5-c036-40ee-a6b5-63b3d0c134c3 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.396903 Aug 03 02:17:18.098284 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2499/5107] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:17 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:18.173405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc2d3f20-689d-4508-bf55-d143f199122c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:18.174114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fc2d3f20-689d-4508-bf55-d143f199122c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:18.189658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2d3f20-689d-4508-bf55-d143f199122c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:18.190127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2d3f20-689d-4508-bf55-d143f199122c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:18.190983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2d3f20-689d-4508-bf55-d143f199122c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:18.191442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2d3f20-689d-4508-bf55-d143f199122c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:18.471978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-79129c6e-4570-43f3-be68-0440d22b38ca tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:18.472872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-79129c6e-4570-43f3-be68-0440d22b38ca tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:18.484852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79129c6e-4570-43f3-be68-0440d22b38ca tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:18.489217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79129c6e-4570-43f3-be68-0440d22b38ca tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:18.490712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79129c6e-4570-43f3-be68-0440d22b38ca tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:18.491413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79129c6e-4570-43f3-be68-0440d22b38ca tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:18.871822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-79129c6e-4570-43f3-be68-0440d22b38ca tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:18.899387 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-79129c6e-4570-43f3-be68-0440d22b38ca tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1276 microversion: 2.1 time: 0.428762 Aug 03 02:17:18.903856 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2500/5108] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:18 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1276 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:17:18.940133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5d8e15de-1696-4171-bd8f-34ec9992a394 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:18.947731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5d8e15de-1696-4171-bd8f-34ec9992a394 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:18.990927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d8e15de-1696-4171-bd8f-34ec9992a394 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:18.996621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d8e15de-1696-4171-bd8f-34ec9992a394 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:19.001076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d8e15de-1696-4171-bd8f-34ec9992a394 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:19.006106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d8e15de-1696-4171-bd8f-34ec9992a394 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:19.459988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fc2d3f20-689d-4508-bf55-d143f199122c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:19.478408 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fc2d3f20-689d-4508-bf55-d143f199122c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1317 microversion: 2.1 time: 1.309151 Aug 03 02:17:19.481515 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2609/5109] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:18 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1317 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:19.490234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-11f4e0f7-b667-4fde-85cf-1d8f6682558d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:19.491269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-11f4e0f7-b667-4fde-85cf-1d8f6682558d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:19.499612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11f4e0f7-b667-4fde-85cf-1d8f6682558d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:19.500673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11f4e0f7-b667-4fde-85cf-1d8f6682558d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:19.503673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11f4e0f7-b667-4fde-85cf-1d8f6682558d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:19.507279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11f4e0f7-b667-4fde-85cf-1d8f6682558d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:19.686318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-11f4e0f7-b667-4fde-85cf-1d8f6682558d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:19.716023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5d8e15de-1696-4171-bd8f-34ec9992a394 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:19.730168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-11f4e0f7-b667-4fde-85cf-1d8f6682558d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:19.744385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-11f4e0f7-b667-4fde-85cf-1d8f6682558d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:19.749267 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-11f4e0f7-b667-4fde-85cf-1d8f6682558d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.263961 Aug 03 02:17:19.757745 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5d8e15de-1696-4171-bd8f-34ec9992a394 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1690 microversion: 2.1 time: 0.847993 Aug 03 02:17:19.758503 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2610/5110] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:19 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:19.758694 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2501/5111] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:18 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1690 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:19.948825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e27b59d7-29a4-4519-b1e6-62d2a198eb1d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:19.950796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e27b59d7-29a4-4519-b1e6-62d2a198eb1d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:19.966411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e27b59d7-29a4-4519-b1e6-62d2a198eb1d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:19.967565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e27b59d7-29a4-4519-b1e6-62d2a198eb1d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:19.970549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e27b59d7-29a4-4519-b1e6-62d2a198eb1d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:19.972810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e27b59d7-29a4-4519-b1e6-62d2a198eb1d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:20.214742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e27b59d7-29a4-4519-b1e6-62d2a198eb1d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:20.259691 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e27b59d7-29a4-4519-b1e6-62d2a198eb1d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1282 microversion: 2.1 time: 0.318501 Aug 03 02:17:20.263441 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2502/5112] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:19 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1282 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:20.521119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-62427159-c268-466c-b1a2-5682b4ba204c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:20.522392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-62427159-c268-466c-b1a2-5682b4ba204c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:20.542752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62427159-c268-466c-b1a2-5682b4ba204c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:20.543908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62427159-c268-466c-b1a2-5682b4ba204c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:20.549930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62427159-c268-466c-b1a2-5682b4ba204c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:20.553140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62427159-c268-466c-b1a2-5682b4ba204c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:20.590618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:20.787432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-64e4a0fb-ff97-461d-ad21-ac58917ee1e7 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:20.788935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-64e4a0fb-ff97-461d-ad21-ac58917ee1e7 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:20.799875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64e4a0fb-ff97-461d-ad21-ac58917ee1e7 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:20.800867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64e4a0fb-ff97-461d-ad21-ac58917ee1e7 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:20.803510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64e4a0fb-ff97-461d-ad21-ac58917ee1e7 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:20.804321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64e4a0fb-ff97-461d-ad21-ac58917ee1e7 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:21.045547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-62427159-c268-466c-b1a2-5682b4ba204c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:21.061419 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-62427159-c268-466c-b1a2-5682b4ba204c tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1507 microversion: 2.1 time: 0.547193 Aug 03 02:17:21.083513 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2611/5113] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:20 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1507 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:17:21.091428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20a29d76-cf2a-4231-9a19-d79e268af909 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:21.092559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-20a29d76-cf2a-4231-9a19-d79e268af909 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:21.109862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20a29d76-cf2a-4231-9a19-d79e268af909 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:21.111442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20a29d76-cf2a-4231-9a19-d79e268af909 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:21.113876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20a29d76-cf2a-4231-9a19-d79e268af909 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:21.114866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20a29d76-cf2a-4231-9a19-d79e268af909 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:21.318178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-20a29d76-cf2a-4231-9a19-d79e268af909 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:21.342173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-20a29d76-cf2a-4231-9a19-d79e268af909 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:21.349551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-20a29d76-cf2a-4231-9a19-d79e268af909 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:21.353352 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-20a29d76-cf2a-4231-9a19-d79e268af909 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1408 microversion: 2.54 time: 0.268485 Aug 03 02:17:21.355668 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2612/5114] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:21 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:21.382184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-68f6890a-2b38-4415-9195-33279206c241 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:21.382832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-68f6890a-2b38-4415-9195-33279206c241 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:21.398574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68f6890a-2b38-4415-9195-33279206c241 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:21.399960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68f6890a-2b38-4415-9195-33279206c241 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:21.403050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68f6890a-2b38-4415-9195-33279206c241 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:21.404098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68f6890a-2b38-4415-9195-33279206c241 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:21.907682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-64e4a0fb-ff97-461d-ad21-ac58917ee1e7 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:21.951144 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-64e4a0fb-ff97-461d-ad21-ac58917ee1e7 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1690 microversion: 2.1 time: 1.165730 Aug 03 02:17:21.953968 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2503/5115] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:20 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1690 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:17:21.990001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-289a249b-0953-4b18-bd94-0edfd673cb80 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:21.991045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-289a249b-0953-4b18-bd94-0edfd673cb80 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:22.010791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-289a249b-0953-4b18-bd94-0edfd673cb80 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:22.011609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-289a249b-0953-4b18-bd94-0edfd673cb80 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:22.014632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-289a249b-0953-4b18-bd94-0edfd673cb80 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:22.018406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-289a249b-0953-4b18-bd94-0edfd673cb80 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:22.029772 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-68f6890a-2b38-4415-9195-33279206c241 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:22.040301 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-68f6890a-2b38-4415-9195-33279206c241 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1507 microversion: 2.1 time: 0.681761 Aug 03 02:17:22.042347 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2613/5116] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:21 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1507 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:22.050541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-bf98226b-1a8a-4428-9aab-151d86ab768a req-89b52351-d30a-44e5-82d3-c328447681df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e4bbb0-7656-402a-9305-ade9e15781fa", "name": "network-vif-plugged", "status": "completed", "tag": "b6a555d7-75da-4324-9c4c-c241c08c8aad"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:22.069624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bf98226b-1a8a-4428-9aab-151d86ab768a req-89b52351-d30a-44e5-82d3-c328447681df service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:22.070192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bf98226b-1a8a-4428-9aab-151d86ab768a req-89b52351-d30a-44e5-82d3-c328447681df service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:22.110067 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-bf98226b-1a8a-4428-9aab-151d86ab768a req-89b52351-d30a-44e5-82d3-c328447681df service nova] Creating event network-vif-plugged:b6a555d7-75da-4324-9c4c-c241c08c8aad for instance b1e4bbb0-7656-402a-9305-ade9e15781fa on n-h1-826529-8 Aug 03 02:17:22.131416 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-bf98226b-1a8a-4428-9aab-151d86ab768a req-89b52351-d30a-44e5-82d3-c328447681df service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083258 Aug 03 02:17:22.132536 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2614/5117] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:17:22.144854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ecffe0c7-6fed-41e9-a748-1df3a69a73e8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:22.164258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ecffe0c7-6fed-41e9-a748-1df3a69a73e8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:22.172456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecffe0c7-6fed-41e9-a748-1df3a69a73e8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:22.175658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecffe0c7-6fed-41e9-a748-1df3a69a73e8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:22.177595 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecffe0c7-6fed-41e9-a748-1df3a69a73e8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:22.178635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ecffe0c7-6fed-41e9-a748-1df3a69a73e8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:22.320505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-289a249b-0953-4b18-bd94-0edfd673cb80 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:22.338466 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-289a249b-0953-4b18-bd94-0edfd673cb80 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1282 microversion: 2.1 time: 0.371916 Aug 03 02:17:22.342574 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2504/5118] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:21 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1282 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:22.382838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-81f6f4ef-e2cd-4f12-852d-a5da5bcc507d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:22.383892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-81f6f4ef-e2cd-4f12-852d-a5da5bcc507d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:22.422435 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ecffe0c7-6fed-41e9-a748-1df3a69a73e8 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "PUT /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1079 microversion: 2.1 time: 0.287676 Aug 03 02:17:22.431210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81f6f4ef-e2cd-4f12-852d-a5da5bcc507d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:22.432108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81f6f4ef-e2cd-4f12-852d-a5da5bcc507d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:22.438472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81f6f4ef-e2cd-4f12-852d-a5da5bcc507d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:22.439315 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2615/5119] 10.222.0.67 () {60 vars in 1256 bytes} [Wed Aug 3 02:17:22 2022] PUT /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1079 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:22.440388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81f6f4ef-e2cd-4f12-852d-a5da5bcc507d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:22.465894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d083d4e0-5c15-440b-8bdb-67af1b1fb020 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:22.466569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d083d4e0-5c15-440b-8bdb-67af1b1fb020 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:22.496491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d083d4e0-5c15-440b-8bdb-67af1b1fb020 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:22.496972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d083d4e0-5c15-440b-8bdb-67af1b1fb020 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:22.497798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d083d4e0-5c15-440b-8bdb-67af1b1fb020 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:22.500433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d083d4e0-5c15-440b-8bdb-67af1b1fb020 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:22.628090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-81f6f4ef-e2cd-4f12-852d-a5da5bcc507d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:22.641730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-81f6f4ef-e2cd-4f12-852d-a5da5bcc507d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:22.652538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-81f6f4ef-e2cd-4f12-852d-a5da5bcc507d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:22.654220 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-81f6f4ef-e2cd-4f12-852d-a5da5bcc507d tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1426 microversion: 2.54 time: 0.276822 Aug 03 02:17:22.659182 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2505/5120] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:22 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1426 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:22.983413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4accc4c0-a97c-41f4-b9bf-a3c88f98fd95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:22.987188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4accc4c0-a97c-41f4-b9bf-a3c88f98fd95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:23.015717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4accc4c0-a97c-41f4-b9bf-a3c88f98fd95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:23.018383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4accc4c0-a97c-41f4-b9bf-a3c88f98fd95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:23.023154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4accc4c0-a97c-41f4-b9bf-a3c88f98fd95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:23.026287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d083d4e0-5c15-440b-8bdb-67af1b1fb020 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:23.026552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4accc4c0-a97c-41f4-b9bf-a3c88f98fd95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:23.044601 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d083d4e0-5c15-440b-8bdb-67af1b1fb020 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1505 microversion: 2.1 time: 0.587414 Aug 03 02:17:23.066744 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2616/5121] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:22 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1505 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:23.082569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3f5da35c-f86f-4be3-8759-d3459f44b404 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:23.083736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3f5da35c-f86f-4be3-8759-d3459f44b404 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:23.091084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f5da35c-f86f-4be3-8759-d3459f44b404 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:23.091895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f5da35c-f86f-4be3-8759-d3459f44b404 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:23.092992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f5da35c-f86f-4be3-8759-d3459f44b404 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:23.094321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f5da35c-f86f-4be3-8759-d3459f44b404 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:23.755116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4accc4c0-a97c-41f4-b9bf-a3c88f98fd95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:23.788506 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4accc4c0-a97c-41f4-b9bf-a3c88f98fd95 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1682 microversion: 2.1 time: 0.809356 Aug 03 02:17:23.798834 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2506/5122] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:22 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1682 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:17:23.813339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eab3f2d0-1c13-4eae-b26f-07cbd5b73616 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:23.832755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eab3f2d0-1c13-4eae-b26f-07cbd5b73616 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:23.854755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eab3f2d0-1c13-4eae-b26f-07cbd5b73616 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:23.855754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eab3f2d0-1c13-4eae-b26f-07cbd5b73616 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:23.859275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eab3f2d0-1c13-4eae-b26f-07cbd5b73616 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:23.860197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eab3f2d0-1c13-4eae-b26f-07cbd5b73616 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:24.035356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3f5da35c-f86f-4be3-8759-d3459f44b404 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:24.050171 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3f5da35c-f86f-4be3-8759-d3459f44b404 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1505 microversion: 2.1 time: 0.980027 Aug 03 02:17:24.051713 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2617/5123] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:23 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1505 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:17:24.060309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9cfcd56f-30cd-4906-8018-5dabd51500b2 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:24.061433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9cfcd56f-30cd-4906-8018-5dabd51500b2 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:24.070985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cfcd56f-30cd-4906-8018-5dabd51500b2 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:24.073443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cfcd56f-30cd-4906-8018-5dabd51500b2 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:24.075239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cfcd56f-30cd-4906-8018-5dabd51500b2 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:24.076053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cfcd56f-30cd-4906-8018-5dabd51500b2 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:24.331307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9cfcd56f-30cd-4906-8018-5dabd51500b2 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:24.360418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9cfcd56f-30cd-4906-8018-5dabd51500b2 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:24.369779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9cfcd56f-30cd-4906-8018-5dabd51500b2 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:24.371812 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9cfcd56f-30cd-4906-8018-5dabd51500b2 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1414 microversion: 2.54 time: 0.317780 Aug 03 02:17:24.376661 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2618/5124] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:24 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1414 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:24.393182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f32e866b-348d-46d2-bac0-70a0bd0b90e3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:24.405721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f32e866b-348d-46d2-bac0-70a0bd0b90e3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:24.425088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f32e866b-348d-46d2-bac0-70a0bd0b90e3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:24.427634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f32e866b-348d-46d2-bac0-70a0bd0b90e3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:24.436305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f32e866b-348d-46d2-bac0-70a0bd0b90e3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:24.437978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f32e866b-348d-46d2-bac0-70a0bd0b90e3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:24.574500 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f32e866b-348d-46d2-bac0-70a0bd0b90e3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "PUT /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1081 microversion: 2.1 time: 0.192902 Aug 03 02:17:24.575598 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2619/5125] 10.222.0.67 () {60 vars in 1256 bytes} [Wed Aug 3 02:17:24 2022] PUT /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1081 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:24.626924 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f08931eb-8739-4674-97f6-bd24da1bd4e3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:24.627705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f08931eb-8739-4674-97f6-bd24da1bd4e3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:24.634972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eab3f2d0-1c13-4eae-b26f-07cbd5b73616 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:24.644855 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eab3f2d0-1c13-4eae-b26f-07cbd5b73616 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1324 microversion: 2.1 time: 0.843591 Aug 03 02:17:24.645439 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2507/5126] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:23 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1324 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:24.654662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f08931eb-8739-4674-97f6-bd24da1bd4e3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:24.655753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f08931eb-8739-4674-97f6-bd24da1bd4e3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:24.657848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f08931eb-8739-4674-97f6-bd24da1bd4e3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:24.659568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f08931eb-8739-4674-97f6-bd24da1bd4e3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:25.082388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f08931eb-8739-4674-97f6-bd24da1bd4e3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:25.104037 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f08931eb-8739-4674-97f6-bd24da1bd4e3 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1507 microversion: 2.1 time: 0.496182 Aug 03 02:17:25.106038 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2620/5127] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:24 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1507 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:25.128742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a8893eda-76f8-4274-a6ea-cdf72fe09bb7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:25.129669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a8893eda-76f8-4274-a6ea-cdf72fe09bb7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:25.155515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8893eda-76f8-4274-a6ea-cdf72fe09bb7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:25.156343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8893eda-76f8-4274-a6ea-cdf72fe09bb7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:25.157839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8893eda-76f8-4274-a6ea-cdf72fe09bb7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:25.162981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8893eda-76f8-4274-a6ea-cdf72fe09bb7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:25.415782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4e320c72-4eee-480b-907f-66f3cacd9b0e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:25.427027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4e320c72-4eee-480b-907f-66f3cacd9b0e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:25.437802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:25.441504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e320c72-4eee-480b-907f-66f3cacd9b0e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:25.442836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e320c72-4eee-480b-907f-66f3cacd9b0e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:25.444202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e320c72-4eee-480b-907f-66f3cacd9b0e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:25.444946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e320c72-4eee-480b-907f-66f3cacd9b0e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:25.575044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a8893eda-76f8-4274-a6ea-cdf72fe09bb7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:25.591672 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a8893eda-76f8-4274-a6ea-cdf72fe09bb7 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1507 microversion: 2.1 time: 0.460973 Aug 03 02:17:25.606941 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2508/5128] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:25 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:25.618297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-306aa01d-5b94-4209-a2a0-c11a006ac498 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:25.618873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-306aa01d-5b94-4209-a2a0-c11a006ac498 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:25.621879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:25.663201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-306aa01d-5b94-4209-a2a0-c11a006ac498 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:25.663201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-306aa01d-5b94-4209-a2a0-c11a006ac498 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:25.663201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-306aa01d-5b94-4209-a2a0-c11a006ac498 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:25.663201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-306aa01d-5b94-4209-a2a0-c11a006ac498 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:25.711007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4e320c72-4eee-480b-907f-66f3cacd9b0e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:25.735733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-306aa01d-5b94-4209-a2a0-c11a006ac498 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:17:25.740428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4e320c72-4eee-480b-907f-66f3cacd9b0e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:25.757027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4e320c72-4eee-480b-907f-66f3cacd9b0e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:25.762584 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4e320c72-4eee-480b-907f-66f3cacd9b0e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1414 microversion: 2.54 time: 0.359876 Aug 03 02:17:25.805882 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2621/5129] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:25 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1414 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:17:25.808315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6d4081f5-59c6-4c95-bd8f-5b7026f9cdd6 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:25.808315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6d4081f5-59c6-4c95-bd8f-5b7026f9cdd6 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:25.817708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d4081f5-59c6-4c95-bd8f-5b7026f9cdd6 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:25.818434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d4081f5-59c6-4c95-bd8f-5b7026f9cdd6 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:25.819751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d4081f5-59c6-4c95-bd8f-5b7026f9cdd6 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:25.823279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6d4081f5-59c6-4c95-bd8f-5b7026f9cdd6 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:25.924329 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-306aa01d-5b94-4209-a2a0-c11a006ac498 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 204 len: 0 microversion: 2.1 time: 0.310083 Aug 03 02:17:25.926409 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2509/5130] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:17:25 2022] DELETE /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:17:25.952577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-866e58b5-f15c-459a-8395-c3f325ffb7f4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:25.955012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-866e58b5-f15c-459a-8395-c3f325ffb7f4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:25.973157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-866e58b5-f15c-459a-8395-c3f325ffb7f4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:25.978733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-866e58b5-f15c-459a-8395-c3f325ffb7f4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:25.981144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-866e58b5-f15c-459a-8395-c3f325ffb7f4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:25.981817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-866e58b5-f15c-459a-8395-c3f325ffb7f4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:26.054043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-866e58b5-f15c-459a-8395-c3f325ffb7f4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:17:26.082304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:26.189880 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.compute.api [None req-866e58b5-f15c-459a-8395-c3f325ffb7f4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Instance is already in deleting state, ignoring this request Aug 03 02:17:26.190356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6d4081f5-59c6-4c95-bd8f-5b7026f9cdd6 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:26.191612 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-866e58b5-f15c-459a-8395-c3f325ffb7f4 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "DELETE /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 204 len: 0 microversion: 2.1 time: 0.258814 Aug 03 02:17:26.193002 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2510/5131] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:17:25 2022] DELETE /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:17:26.199456 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6d4081f5-59c6-4c95-bd8f-5b7026f9cdd6 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1324 microversion: 2.1 time: 0.415399 Aug 03 02:17:26.213881 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2622/5132] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:25 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1324 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:26.214283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1aa16c5b-3690-4c64-b9de-1322866309eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:26.214283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1aa16c5b-3690-4c64-b9de-1322866309eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:26.219782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1aa16c5b-3690-4c64-b9de-1322866309eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:26.220062 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-fdeac8da-4965-4552-a00c-69fb64ad246f req-fb0b30e8-c2d2-4d48-8ce2-6f3978ddb34f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e431190-b850-4b95-81d8-8e0e41283945", "tag": "aefbc0ce-4327-4185-a1b0-46d877ce3409"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:26.220429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1aa16c5b-3690-4c64-b9de-1322866309eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:26.221608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1aa16c5b-3690-4c64-b9de-1322866309eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:26.222275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1aa16c5b-3690-4c64-b9de-1322866309eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:26.244183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-fdeac8da-4965-4552-a00c-69fb64ad246f req-fb0b30e8-c2d2-4d48-8ce2-6f3978ddb34f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:26.245431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-fdeac8da-4965-4552-a00c-69fb64ad246f req-fb0b30e8-c2d2-4d48-8ce2-6f3978ddb34f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:26.282425 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-fdeac8da-4965-4552-a00c-69fb64ad246f req-fb0b30e8-c2d2-4d48-8ce2-6f3978ddb34f service nova] Creating event network-changed:aefbc0ce-4327-4185-a1b0-46d877ce3409 for instance 5e431190-b850-4b95-81d8-8e0e41283945 on n-h1-826529-8 Aug 03 02:17:26.289893 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-fdeac8da-4965-4552-a00c-69fb64ad246f req-fb0b30e8-c2d2-4d48-8ce2-6f3978ddb34f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073547 Aug 03 02:17:26.290918 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2623/5133] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:17:26.529596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1aa16c5b-3690-4c64-b9de-1322866309eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:26.559784 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1aa16c5b-3690-4c64-b9de-1322866309eb tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1513 microversion: 2.1 time: 0.360139 Aug 03 02:17:26.562805 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2511/5134] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:26 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1513 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:26.816022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-27ed9e44-c676-4d81-8c01-a406e4aec94c tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:26.817098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-27ed9e44-c676-4d81-8c01-a406e4aec94c tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:26.830160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27ed9e44-c676-4d81-8c01-a406e4aec94c tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:26.830828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27ed9e44-c676-4d81-8c01-a406e4aec94c tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:26.831668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27ed9e44-c676-4d81-8c01-a406e4aec94c tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:26.832113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27ed9e44-c676-4d81-8c01-a406e4aec94c tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:27.055293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-27ed9e44-c676-4d81-8c01-a406e4aec94c tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:27.071170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-27ed9e44-c676-4d81-8c01-a406e4aec94c tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:27.073066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-27ed9e44-c676-4d81-8c01-a406e4aec94c tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:27.077398 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-27ed9e44-c676-4d81-8c01-a406e4aec94c tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1399 microversion: 2.54 time: 0.267804 Aug 03 02:17:27.080602 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2624/5135] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:26 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1399 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:27.106445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69ea2642-c479-4948-b79e-28d3e19caea6 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '.version_select at 0x7f5b13dd20d0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:27.137904 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-69ea2642-c479-4948-b79e-28d3e19caea6 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1352306632" status: 204 len: 0 microversion: 2.54 time: 0.033200 Aug 03 02:17:27.138548 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2512/5136] 10.222.0.67 () {60 vars in 1319 bytes} [Wed Aug 3 02:17:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1352306632 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 02:17:27.168446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bb0a9b78-c556-4c9c-9854-07ccce2b53d7 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:27.169125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bb0a9b78-c556-4c9c-9854-07ccce2b53d7 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:27.177954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb0a9b78-c556-4c9c-9854-07ccce2b53d7 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:27.178437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb0a9b78-c556-4c9c-9854-07ccce2b53d7 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:27.179649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb0a9b78-c556-4c9c-9854-07ccce2b53d7 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:27.180326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb0a9b78-c556-4c9c-9854-07ccce2b53d7 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:27.219088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bb0a9b78-c556-4c9c-9854-07ccce2b53d7 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:17:27.227052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9b03fd3e-cf9d-4930-a5fb-6309c5bbb49f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:27.227723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9b03fd3e-cf9d-4930-a5fb-6309c5bbb49f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:27.241674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b03fd3e-cf9d-4930-a5fb-6309c5bbb49f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:27.246030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b03fd3e-cf9d-4930-a5fb-6309c5bbb49f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:27.247197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b03fd3e-cf9d-4930-a5fb-6309c5bbb49f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:27.252415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b03fd3e-cf9d-4930-a5fb-6309c5bbb49f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:27.433684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:27.540267 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bb0a9b78-c556-4c9c-9854-07ccce2b53d7 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 204 len: 0 microversion: 2.54 time: 0.390956 Aug 03 02:17:27.542148 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2625/5137] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:17:27 2022] DELETE /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 02:17:27.571485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-24684d9b-cae1-47e5-9015-169c0bc93f54 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:27.571485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-24684d9b-cae1-47e5-9015-169c0bc93f54 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:27.592319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24684d9b-cae1-47e5-9015-169c0bc93f54 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:27.598510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24684d9b-cae1-47e5-9015-169c0bc93f54 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:27.600053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24684d9b-cae1-47e5-9015-169c0bc93f54 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:27.601152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24684d9b-cae1-47e5-9015-169c0bc93f54 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:27.666108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:27.963931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-24684d9b-cae1-47e5-9015-169c0bc93f54 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:27.979580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-24684d9b-cae1-47e5-9015-169c0bc93f54 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:27.982971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-24684d9b-cae1-47e5-9015-169c0bc93f54 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:27.987473 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-24684d9b-cae1-47e5-9015-169c0bc93f54 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1405 microversion: 2.54 time: 0.440042 Aug 03 02:17:28.007894 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2626/5138] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:27 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:17:28.015777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-83bcf2b2-30fa-45ff-8a2d-1e72d183e5c6 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:28.016760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-83bcf2b2-30fa-45ff-8a2d-1e72d183e5c6 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:28.025777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83bcf2b2-30fa-45ff-8a2d-1e72d183e5c6 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:28.026781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83bcf2b2-30fa-45ff-8a2d-1e72d183e5c6 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:28.027958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83bcf2b2-30fa-45ff-8a2d-1e72d183e5c6 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:28.029093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83bcf2b2-30fa-45ff-8a2d-1e72d183e5c6 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:28.121690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9b03fd3e-cf9d-4930-a5fb-6309c5bbb49f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:28.149598 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9b03fd3e-cf9d-4930-a5fb-6309c5bbb49f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1324 microversion: 2.1 time: 0.930542 Aug 03 02:17:28.165733 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2513/5139] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:27 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1324 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:28.307344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-83bcf2b2-30fa-45ff-8a2d-1e72d183e5c6 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:28.325905 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-83bcf2b2-30fa-45ff-8a2d-1e72d183e5c6 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1513 microversion: 2.1 time: 0.316541 Aug 03 02:17:28.339749 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2627/5140] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:28 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1513 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:29.017297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f8756148-4e97-4236-a5a1-06d26f984478 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:29.017930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f8756148-4e97-4236-a5a1-06d26f984478 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:29.028696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8756148-4e97-4236-a5a1-06d26f984478 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:29.033713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8756148-4e97-4236-a5a1-06d26f984478 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:29.035132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8756148-4e97-4236-a5a1-06d26f984478 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:29.035796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8756148-4e97-4236-a5a1-06d26f984478 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:29.089251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:29.184431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-08b4fa34-7a21-486c-aef4-f6094489ac6c tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:29.189075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-08b4fa34-7a21-486c-aef4-f6094489ac6c tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:29.209731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08b4fa34-7a21-486c-aef4-f6094489ac6c tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:29.211312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08b4fa34-7a21-486c-aef4-f6094489ac6c tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:29.212383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08b4fa34-7a21-486c-aef4-f6094489ac6c tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:29.213010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08b4fa34-7a21-486c-aef4-f6094489ac6c tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:29.226407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f8756148-4e97-4236-a5a1-06d26f984478 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:29.242550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f8756148-4e97-4236-a5a1-06d26f984478 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:29.250813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f8756148-4e97-4236-a5a1-06d26f984478 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:29.254400 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f8756148-4e97-4236-a5a1-06d26f984478 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1405 microversion: 2.54 time: 0.243130 Aug 03 02:17:29.262700 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2514/5141] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:29 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:29.349596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-70df7ac9-45c2-470a-8bca-11fa5fd4de95 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:29.350690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-70df7ac9-45c2-470a-8bca-11fa5fd4de95 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:29.363372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-70df7ac9-45c2-470a-8bca-11fa5fd4de95 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:29.364204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-70df7ac9-45c2-470a-8bca-11fa5fd4de95 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:29.365291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-70df7ac9-45c2-470a-8bca-11fa5fd4de95 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:29.366288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-70df7ac9-45c2-470a-8bca-11fa5fd4de95 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:29.635868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-08b4fa34-7a21-486c-aef4-f6094489ac6c tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:29.670485 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-08b4fa34-7a21-486c-aef4-f6094489ac6c tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1324 microversion: 2.1 time: 0.502280 Aug 03 02:17:29.692964 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2628/5142] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:29 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1324 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:29.914782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-70df7ac9-45c2-470a-8bca-11fa5fd4de95 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e7dbdb6aef40abba7ba06046b87c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9b137660a84e1bb2faa6301d569b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:29.946659 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-70df7ac9-45c2-470a-8bca-11fa5fd4de95 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 200 len: 1513 microversion: 2.1 time: 0.592494 Aug 03 02:17:29.947582 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2515/5143] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:29 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 1513 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:17:30.290079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4878ec1b-7d74-4b2d-91cd-c97888668261 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:30.291271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4878ec1b-7d74-4b2d-91cd-c97888668261 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:30.301065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4878ec1b-7d74-4b2d-91cd-c97888668261 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:30.302047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4878ec1b-7d74-4b2d-91cd-c97888668261 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:30.303061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4878ec1b-7d74-4b2d-91cd-c97888668261 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:30.303762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4878ec1b-7d74-4b2d-91cd-c97888668261 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:30.381521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4878ec1b-7d74-4b2d-91cd-c97888668261 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:30.382839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4878ec1b-7d74-4b2d-91cd-c97888668261 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:30.383929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-4878ec1b-7d74-4b2d-91cd-c97888668261 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lazy-loading 'fault' on Instance uuid 1c7991a2-3054-4a78-b7bf-aad6136f87eb {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:17:30.486592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4878ec1b-7d74-4b2d-91cd-c97888668261 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:30.504627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4878ec1b-7d74-4b2d-91cd-c97888668261 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:30.506008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-a4827ff6-ae1a-42b3-82ed-7de81aee308f req-616e4afa-338e-447e-a99c-2ce6e8df132b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c3c095-a72b-4678-bc5b-b28cc58f5745", "name": "network-vif-deleted", "tag": "68f07348-cd86-45a1-a0a3-452bddb788ac"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:30.512334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4878ec1b-7d74-4b2d-91cd-c97888668261 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02f0373ce0954e78a70f9fecfba6b583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b187cc73a014678bad535929887003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:30.538402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a4827ff6-ae1a-42b3-82ed-7de81aee308f req-616e4afa-338e-447e-a99c-2ce6e8df132b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:30.541411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a4827ff6-ae1a-42b3-82ed-7de81aee308f req-616e4afa-338e-447e-a99c-2ce6e8df132b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:30.551070 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4878ec1b-7d74-4b2d-91cd-c97888668261 tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 200 len: 1410 microversion: 2.54 time: 0.265215 Aug 03 02:17:30.552807 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2629/5144] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:30 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 1410 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:30.572062 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-a4827ff6-ae1a-42b3-82ed-7de81aee308f req-616e4afa-338e-447e-a99c-2ce6e8df132b service nova] Creating event network-vif-deleted:68f07348-cd86-45a1-a0a3-452bddb788ac for instance 02c3c095-a72b-4678-bc5b-b28cc58f5745 on n-h1-826529-8 Aug 03 02:17:30.600101 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-a4827ff6-ae1a-42b3-82ed-7de81aee308f req-616e4afa-338e-447e-a99c-2ce6e8df132b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100724 Aug 03 02:17:30.601588 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2516/5145] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:17:30.700446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-69fca44c-d36c-41e3-931e-4b48f148e0d2 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:30.702129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-69fca44c-d36c-41e3-931e-4b48f148e0d2 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:30.710697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69fca44c-d36c-41e3-931e-4b48f148e0d2 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:30.711523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69fca44c-d36c-41e3-931e-4b48f148e0d2 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:30.712536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69fca44c-d36c-41e3-931e-4b48f148e0d2 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:30.713165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69fca44c-d36c-41e3-931e-4b48f148e0d2 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:30.975351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-69fca44c-d36c-41e3-931e-4b48f148e0d2 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:30.979272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4110af7d-0463-4ea6-9c16-2226e4244cf2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:30.981705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4110af7d-0463-4ea6-9c16-2226e4244cf2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 02c3c095-a72b-4678-bc5b-b28cc58f5745] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:30.995229 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-69fca44c-d36c-41e3-931e-4b48f148e0d2 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1324 microversion: 2.1 time: 0.293566 Aug 03 02:17:30.995890 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2630/5146] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:30 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1324 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:31.014261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4110af7d-0463-4ea6-9c16-2226e4244cf2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:31.014726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4110af7d-0463-4ea6-9c16-2226e4244cf2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:31.015961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4110af7d-0463-4ea6-9c16-2226e4244cf2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:31.016417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4110af7d-0463-4ea6-9c16-2226e4244cf2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:31.050191 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-4110af7d-0463-4ea6-9c16-2226e4244cf2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] HTTP exception thrown: Instance 02c3c095-a72b-4678-bc5b-b28cc58f5745 could not be found. Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4110af7d-0463-4ea6-9c16-2226e4244cf2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Request method failure captured: Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 HTTP/1.1 Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6doLtUnDmNIB7ogDYG9tIX-0tws4wepDHMrOCbB6SArrGvlKJ34kpD2EtoyKvPIaDeo2BmeKEdlWQMGh1LzB4b0I7mjUV_UNX-2O83WDvpvE3_p9rYfuPVDkv35BECJys1yaKLCg8zJrbHvcGevQ9Dq4y9H1mfCq3xkKnCmejgRcdIw Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: dd9b137660a84e1bb2faa6301d569b57 Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerDiskConfigTestJSON-586436250 Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dd9b137660a84e1bb2faa6301d569b57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd9b137660a84e1bb2faa6301d569b57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dd9b137660a84e1bb2faa6301d569b57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd9b137660a84e1bb2faa6301d569b57"}]}] Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerDiskConfigTestJSON-586436250 Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: dd9b137660a84e1bb2faa6301d569b57 Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-586436250 Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerDiskConfigTestJSON-586436250-project Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 19e7dbdb6aef40abba7ba06046b87c95 Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerDiskConfigTestJSON-586436250-project Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 02c3c095-a72b-4678-bc5b-b28cc58f5745 could not be found. Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '02c3c095-a72b-4678-bc5b-b28cc58f5745'} Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02c3c095-a72b-4678-bc5b-b28cc58f5745 could not be found. Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02c3c095-a72b-4678-bc5b-b28cc58f5745 could not be found. Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:31.068492 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.075431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.075431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:31.075431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:31.075431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:17:31.075431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:17:31.075431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02c3c095-a72b-4678-bc5b-b28cc58f5745 could not be found. Aug 03 02:17:31.075431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.075431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4110af7d-0463-4ea6-9c16-2226e4244cf2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Returning 404 to user: Instance 02c3c095-a72b-4678-bc5b-b28cc58f5745 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:17:31.075431 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4110af7d-0463-4ea6-9c16-2226e4244cf2 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745" status: 404 len: 111 microversion: 2.1 time: 0.104617 Aug 03 02:17:31.075431 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2517/5147] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:30 2022] GET /compute/v2.1/servers/02c3c095-a72b-4678-bc5b-b28cc58f5745 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:17:31.086629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c462163e-f1a7-4d6b-9788-f04dd387a485 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:31.087822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c462163e-f1a7-4d6b-9788-f04dd387a485 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:31.099501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c462163e-f1a7-4d6b-9788-f04dd387a485 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:31.100160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c462163e-f1a7-4d6b-9788-f04dd387a485 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:31.102093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c462163e-f1a7-4d6b-9788-f04dd387a485 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:31.103096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c462163e-f1a7-4d6b-9788-f04dd387a485 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:31.127124 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-c462163e-f1a7-4d6b-9788-f04dd387a485 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] HTTP exception thrown: Instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 could not be found. Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c462163e-f1a7-4d6b-9788-f04dd387a485 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Request method failure captured: Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 HTTP/1.1 Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6doLtUnDmNIB7ogDYG9tIX-0tws4wepDHMrOCbB6SArrGvlKJ34kpD2EtoyKvPIaDeo2BmeKEdlWQMGh1LzB4b0I7mjUV_UNX-2O83WDvpvE3_p9rYfuPVDkv35BECJys1yaKLCg8zJrbHvcGevQ9Dq4y9H1mfCq3xkKnCmejgRcdIw Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: dd9b137660a84e1bb2faa6301d569b57 Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerDiskConfigTestJSON-586436250 Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dd9b137660a84e1bb2faa6301d569b57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd9b137660a84e1bb2faa6301d569b57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dd9b137660a84e1bb2faa6301d569b57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd9b137660a84e1bb2faa6301d569b57"}]}] Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerDiskConfigTestJSON-586436250 Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: dd9b137660a84e1bb2faa6301d569b57 Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-586436250 Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerDiskConfigTestJSON-586436250-project Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 19e7dbdb6aef40abba7ba06046b87c95 Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerDiskConfigTestJSON-586436250-project Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 could not be found. Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '2ebf6377-6b2d-437d-b7b9-15d48d084420'} Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 could not be found. Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:17:31.129772 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:17:31.134500 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 could not be found. Aug 03 02:17:31.134500 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.134500 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:31.134500 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.134500 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.134500 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:31.134500 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:31.134500 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:17:31.134500 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:17:31.134500 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 could not be found. Aug 03 02:17:31.134500 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.137323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c462163e-f1a7-4d6b-9788-f04dd387a485 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Returning 404 to user: Instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:17:31.139916 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c462163e-f1a7-4d6b-9788-f04dd387a485 tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 404 len: 111 microversion: 2.1 time: 0.058581 Aug 03 02:17:31.141982 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2631/5148] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:17:31 2022] DELETE /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:17:31.150112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d9b4343c-38d9-4e11-a78b-367d1dd7f0ec tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:31.150731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d9b4343c-38d9-4e11-a78b-367d1dd7f0ec tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 2ebf6377-6b2d-437d-b7b9-15d48d084420] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:31.159039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9b4343c-38d9-4e11-a78b-367d1dd7f0ec tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:31.159496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9b4343c-38d9-4e11-a78b-367d1dd7f0ec tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:31.160404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9b4343c-38d9-4e11-a78b-367d1dd7f0ec tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:31.160938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9b4343c-38d9-4e11-a78b-367d1dd7f0ec tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:31.189115 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-d9b4343c-38d9-4e11-a78b-367d1dd7f0ec tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] HTTP exception thrown: Instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 could not be found. Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d9b4343c-38d9-4e11-a78b-367d1dd7f0ec tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Request method failure captured: Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 HTTP/1.1 Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6doLtUnDmNIB7ogDYG9tIX-0tws4wepDHMrOCbB6SArrGvlKJ34kpD2EtoyKvPIaDeo2BmeKEdlWQMGh1LzB4b0I7mjUV_UNX-2O83WDvpvE3_p9rYfuPVDkv35BECJys1yaKLCg8zJrbHvcGevQ9Dq4y9H1mfCq3xkKnCmejgRcdIw Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: dd9b137660a84e1bb2faa6301d569b57 Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerDiskConfigTestJSON-586436250 Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dd9b137660a84e1bb2faa6301d569b57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd9b137660a84e1bb2faa6301d569b57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dd9b137660a84e1bb2faa6301d569b57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd9b137660a84e1bb2faa6301d569b57"}]}] Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerDiskConfigTestJSON-586436250 Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: dd9b137660a84e1bb2faa6301d569b57 Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-586436250 Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerDiskConfigTestJSON-586436250-project Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 19e7dbdb6aef40abba7ba06046b87c95 Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerDiskConfigTestJSON-586436250-project Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 could not be found. Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '2ebf6377-6b2d-437d-b7b9-15d48d084420'} Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 could not be found. Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 could not be found. Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:31.190716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.196215 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.196215 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:31.196215 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:31.196215 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:17:31.196215 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:17:31.196215 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 could not be found. Aug 03 02:17:31.196215 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.196215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d9b4343c-38d9-4e11-a78b-367d1dd7f0ec tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Returning 404 to user: Instance 2ebf6377-6b2d-437d-b7b9-15d48d084420 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:17:31.196215 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d9b4343c-38d9-4e11-a78b-367d1dd7f0ec tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420" status: 404 len: 111 microversion: 2.1 time: 0.048330 Aug 03 02:17:31.209961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-570ffa1f-1c20-4ba3-89d5-a10cacfcdefe tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:31.210497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-570ffa1f-1c20-4ba3-89d5-a10cacfcdefe tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:31.214081 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2518/5149] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:31 2022] GET /compute/v2.1/servers/2ebf6377-6b2d-437d-b7b9-15d48d084420 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:17:31.218728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-570ffa1f-1c20-4ba3-89d5-a10cacfcdefe tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:31.220022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-570ffa1f-1c20-4ba3-89d5-a10cacfcdefe tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:31.221083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-570ffa1f-1c20-4ba3-89d5-a10cacfcdefe tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:31.221704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-570ffa1f-1c20-4ba3-89d5-a10cacfcdefe tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:31.240043 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-570ffa1f-1c20-4ba3-89d5-a10cacfcdefe tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] HTTP exception thrown: Instance 4fab028e-e051-4211-8db2-a9b9c38481f3 could not be found. Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-570ffa1f-1c20-4ba3-89d5-a10cacfcdefe tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Request method failure captured: Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 HTTP/1.1 Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6doLtUnDmNIB7ogDYG9tIX-0tws4wepDHMrOCbB6SArrGvlKJ34kpD2EtoyKvPIaDeo2BmeKEdlWQMGh1LzB4b0I7mjUV_UNX-2O83WDvpvE3_p9rYfuPVDkv35BECJys1yaKLCg8zJrbHvcGevQ9Dq4y9H1mfCq3xkKnCmejgRcdIw Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: dd9b137660a84e1bb2faa6301d569b57 Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerDiskConfigTestJSON-586436250 Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dd9b137660a84e1bb2faa6301d569b57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd9b137660a84e1bb2faa6301d569b57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dd9b137660a84e1bb2faa6301d569b57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd9b137660a84e1bb2faa6301d569b57"}]}] Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerDiskConfigTestJSON-586436250 Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: dd9b137660a84e1bb2faa6301d569b57 Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-586436250 Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerDiskConfigTestJSON-586436250-project Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 19e7dbdb6aef40abba7ba06046b87c95 Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerDiskConfigTestJSON-586436250-project Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 4fab028e-e051-4211-8db2-a9b9c38481f3 could not be found. Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '4fab028e-e051-4211-8db2-a9b9c38481f3'} Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fab028e-e051-4211-8db2-a9b9c38481f3 could not be found. Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:17:31.242721 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:17:31.247265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fab028e-e051-4211-8db2-a9b9c38481f3 could not be found. Aug 03 02:17:31.247265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.247265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:31.247265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.247265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.247265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:31.247265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:31.247265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:17:31.247265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:17:31.247265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fab028e-e051-4211-8db2-a9b9c38481f3 could not be found. Aug 03 02:17:31.247265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.252263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-570ffa1f-1c20-4ba3-89d5-a10cacfcdefe tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Returning 404 to user: Instance 4fab028e-e051-4211-8db2-a9b9c38481f3 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:17:31.254386 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-570ffa1f-1c20-4ba3-89d5-a10cacfcdefe tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 404 len: 111 microversion: 2.1 time: 0.051911 Aug 03 02:17:31.265885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fcf8c999-21f7-4fcb-8d63-3dc5074cea9b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:31.267605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fcf8c999-21f7-4fcb-8d63-3dc5074cea9b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] [instance: 4fab028e-e051-4211-8db2-a9b9c38481f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:31.272300 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2632/5150] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:17:31 2022] DELETE /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:17:31.277944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcf8c999-21f7-4fcb-8d63-3dc5074cea9b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:31.279372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcf8c999-21f7-4fcb-8d63-3dc5074cea9b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:31.280542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcf8c999-21f7-4fcb-8d63-3dc5074cea9b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:31.281352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcf8c999-21f7-4fcb-8d63-3dc5074cea9b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:31.299997 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-fcf8c999-21f7-4fcb-8d63-3dc5074cea9b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] HTTP exception thrown: Instance 4fab028e-e051-4211-8db2-a9b9c38481f3 could not be found. Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fcf8c999-21f7-4fcb-8d63-3dc5074cea9b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Request method failure captured: Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 HTTP/1.1 Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6doLtUnDmNIB7ogDYG9tIX-0tws4wepDHMrOCbB6SArrGvlKJ34kpD2EtoyKvPIaDeo2BmeKEdlWQMGh1LzB4b0I7mjUV_UNX-2O83WDvpvE3_p9rYfuPVDkv35BECJys1yaKLCg8zJrbHvcGevQ9Dq4y9H1mfCq3xkKnCmejgRcdIw Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: dd9b137660a84e1bb2faa6301d569b57 Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerDiskConfigTestJSON-586436250 Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dd9b137660a84e1bb2faa6301d569b57", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd9b137660a84e1bb2faa6301d569b57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dd9b137660a84e1bb2faa6301d569b57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dd9b137660a84e1bb2faa6301d569b57"}]}] Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerDiskConfigTestJSON-586436250 Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: dd9b137660a84e1bb2faa6301d569b57 Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-586436250 Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerDiskConfigTestJSON-586436250-project Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 19e7dbdb6aef40abba7ba06046b87c95 Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerDiskConfigTestJSON-586436250-project Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 4fab028e-e051-4211-8db2-a9b9c38481f3 could not be found. Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '4fab028e-e051-4211-8db2-a9b9c38481f3'} Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fab028e-e051-4211-8db2-a9b9c38481f3 could not be found. Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fab028e-e051-4211-8db2-a9b9c38481f3 could not be found. Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:31.301977 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.307506 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.307506 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:31.307506 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:31.307506 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:17:31.307506 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:17:31.307506 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fab028e-e051-4211-8db2-a9b9c38481f3 could not be found. Aug 03 02:17:31.307506 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.309205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fcf8c999-21f7-4fcb-8d63-3dc5074cea9b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] Returning 404 to user: Instance 4fab028e-e051-4211-8db2-a9b9c38481f3 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:17:31.310662 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fcf8c999-21f7-4fcb-8d63-3dc5074cea9b tempest-ServerDiskConfigTestJSON-586436250 tempest-ServerDiskConfigTestJSON-586436250-project] 10.222.0.67 "GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3" status: 404 len: 111 microversion: 2.1 time: 0.050115 Aug 03 02:17:31.324286 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2519/5151] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:31 2022] GET /compute/v2.1/servers/4fab028e-e051-4211-8db2-a9b9c38481f3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:17:31.582885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-456351ab-161d-4713-ac60-f6b1a1061a9e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:31.584148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-456351ab-161d-4713-ac60-f6b1a1061a9e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] [instance: 1c7991a2-3054-4a78-b7bf-aad6136f87eb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:31.594513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-456351ab-161d-4713-ac60-f6b1a1061a9e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:31.595478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-456351ab-161d-4713-ac60-f6b1a1061a9e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:31.596703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-456351ab-161d-4713-ac60-f6b1a1061a9e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:31.597388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-456351ab-161d-4713-ac60-f6b1a1061a9e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:31.622447 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-456351ab-161d-4713-ac60-f6b1a1061a9e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] HTTP exception thrown: Instance 1c7991a2-3054-4a78-b7bf-aad6136f87eb could not be found. Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-456351ab-161d-4713-ac60-f6b1a1061a9e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Request method failure captured: Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb HTTP/1.1 Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dqJHD5y_hh7T35-AFFaAWU8_aZQIU0A5uWlfA0RPi08_SJ4o7aW_lVgAbWVCR-URMqDYk3cB8HbYvX6DsUc-SodfcLDoeuj79tb7xkDdpBRZriS4gYW2SZ_-JU7w0tlpz4XdXZAt28lJ3wSRAfBFtYS2izVhUkvgK3d8LJ1o91z85g Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Openstack-Nova-Api-Version: 2.54 Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 7b187cc73a014678bad535929887003f Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerShowV254Test-655284506 Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7b187cc73a014678bad535929887003f", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7b187cc73a014678bad535929887003f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7b187cc73a014678bad535929887003f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7b187cc73a014678bad535929887003f"}]}] Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerShowV254Test-655284506 Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 7b187cc73a014678bad535929887003f Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerShowV254Test-655284506 Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerShowV254Test-655284506-project Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 02f0373ce0954e78a70f9fecfba6b583 Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerShowV254Test-655284506-project Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 1c7991a2-3054-4a78-b7bf-aad6136f87eb could not be found. Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '1c7991a2-3054-4a78-b7bf-aad6136f87eb'} Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c7991a2-3054-4a78-b7bf-aad6136f87eb could not be found. Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c7991a2-3054-4a78-b7bf-aad6136f87eb could not be found. Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:31.626764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.632876 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:31.632876 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:31.632876 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:31.632876 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:17:31.632876 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:17:31.632876 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c7991a2-3054-4a78-b7bf-aad6136f87eb could not be found. Aug 03 02:17:31.632876 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:31.632876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-456351ab-161d-4713-ac60-f6b1a1061a9e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] Returning 404 to user: Instance 1c7991a2-3054-4a78-b7bf-aad6136f87eb could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:17:31.632876 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-456351ab-161d-4713-ac60-f6b1a1061a9e tempest-ServerShowV254Test-655284506 tempest-ServerShowV254Test-655284506-project] 10.222.0.67 "GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb" status: 404 len: 111 microversion: 2.54 time: 0.052887 Aug 03 02:17:31.632876 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2633/5152] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:31 2022] GET /compute/v2.1/servers/1c7991a2-3054-4a78-b7bf-aad6136f87eb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:17:32.020772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0d466a7-d17a-4c85-9060-fa15295dbc8a tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:32.022068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0d466a7-d17a-4c85-9060-fa15295dbc8a tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:32.040896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0d466a7-d17a-4c85-9060-fa15295dbc8a tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:32.041582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0d466a7-d17a-4c85-9060-fa15295dbc8a tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:32.042673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0d466a7-d17a-4c85-9060-fa15295dbc8a tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:32.043483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0d466a7-d17a-4c85-9060-fa15295dbc8a tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:32.522818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0d466a7-d17a-4c85-9060-fa15295dbc8a tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:32.536835 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0d466a7-d17a-4c85-9060-fa15295dbc8a tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1324 microversion: 2.1 time: 0.520246 Aug 03 02:17:32.537453 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2520/5153] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:32 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1324 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:33.578295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5ad2748a-95d3-4930-97e4-1a00313ade20 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:33.584013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5ad2748a-95d3-4930-97e4-1a00313ade20 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:33.607100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ad2748a-95d3-4930-97e4-1a00313ade20 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:33.607501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ad2748a-95d3-4930-97e4-1a00313ade20 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:33.608949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ad2748a-95d3-4930-97e4-1a00313ade20 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:33.610068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ad2748a-95d3-4930-97e4-1a00313ade20 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:34.337096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ad2748a-95d3-4930-97e4-1a00313ade20 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:34.349283 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5ad2748a-95d3-4930-97e4-1a00313ade20 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1324 microversion: 2.1 time: 0.780164 Aug 03 02:17:34.362160 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2634/5154] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:33 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1324 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:34.876125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-984f7510-19e8-4b7f-b17d-c2f5e3349861 req-10b78cae-3762-4bb1-a337-ee5c6f4a166a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e431190-b850-4b95-81d8-8e0e41283945", "name": "network-vif-plugged", "status": "completed", "tag": "aefbc0ce-4327-4185-a1b0-46d877ce3409"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:34.903473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-984f7510-19e8-4b7f-b17d-c2f5e3349861 req-10b78cae-3762-4bb1-a337-ee5c6f4a166a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:34.906284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-984f7510-19e8-4b7f-b17d-c2f5e3349861 req-10b78cae-3762-4bb1-a337-ee5c6f4a166a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:34.934674 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-984f7510-19e8-4b7f-b17d-c2f5e3349861 req-10b78cae-3762-4bb1-a337-ee5c6f4a166a service nova] Creating event network-vif-plugged:aefbc0ce-4327-4185-a1b0-46d877ce3409 for instance 5e431190-b850-4b95-81d8-8e0e41283945 on n-h1-826529-8 Aug 03 02:17:34.947550 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-984f7510-19e8-4b7f-b17d-c2f5e3349861 req-10b78cae-3762-4bb1-a337-ee5c6f4a166a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079764 Aug 03 02:17:34.950411 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2521/5155] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:17:35.375487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b4b3aa1b-29e1-4a43-abe2-90a31d27917f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:35.376736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b4b3aa1b-29e1-4a43-abe2-90a31d27917f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:35.405298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4b3aa1b-29e1-4a43-abe2-90a31d27917f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:35.406438 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4b3aa1b-29e1-4a43-abe2-90a31d27917f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:35.411739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4b3aa1b-29e1-4a43-abe2-90a31d27917f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:35.412522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b4b3aa1b-29e1-4a43-abe2-90a31d27917f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:35.917891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b4b3aa1b-29e1-4a43-abe2-90a31d27917f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:35.933260 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b4b3aa1b-29e1-4a43-abe2-90a31d27917f tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1324 microversion: 2.1 time: 0.565646 Aug 03 02:17:35.937390 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2635/5156] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:35 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1324 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:36.357365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4da94207-d53a-4034-a3e5-bfae0605f172 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1328452497", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": "none"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:36.612494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-4da94207-d53a-4034-a3e5-bfae0605f172 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:17:36.615262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-4da94207-d53a-4034-a3e5-bfae0605f172 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:17:36.619386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-4da94207-d53a-4034-a3e5-bfae0605f172 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:17:36.620983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-4da94207-d53a-4034-a3e5-bfae0605f172 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:17:36.623210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-4da94207-d53a-4034-a3e5-bfae0605f172 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:17:36.662858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4da94207-d53a-4034-a3e5-bfae0605f172 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:36.665114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4da94207-d53a-4034-a3e5-bfae0605f172 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:36.668976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4da94207-d53a-4034-a3e5-bfae0605f172 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:36.670633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4da94207-d53a-4034-a3e5-bfae0605f172 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:36.719683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-4da94207-d53a-4034-a3e5-bfae0605f172 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Getting quotas for project 73b2348fca424ab09f5962d15a9bd831. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:17:36.735920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-4da94207-d53a-4034-a3e5-bfae0605f172 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Getting quotas for user 34af06f891864dc39aa62000f73afe64 and project 73b2348fca424ab09f5962d15a9bd831. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:17:36.771419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4da94207-d53a-4034-a3e5-bfae0605f172 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:17:36.776980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4da94207-d53a-4034-a3e5-bfae0605f172 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:17:36.933990 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4da94207-d53a-4034-a3e5-bfae0605f172 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.204867 Aug 03 02:17:36.950681 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2522/5157] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 3 02:17:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 02:17:36.951943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8690542-6274-43fe-8a6d-1a870e44d20a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:36.954207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8690542-6274-43fe-8a6d-1a870e44d20a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:36.975368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3c9a9fef-b79c-4177-9e64-539734a8392d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:36.983496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3c9a9fef-b79c-4177-9e64-539734a8392d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:37.022378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c9a9fef-b79c-4177-9e64-539734a8392d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:37.023845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c9a9fef-b79c-4177-9e64-539734a8392d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:37.025589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c9a9fef-b79c-4177-9e64-539734a8392d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:37.026704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c9a9fef-b79c-4177-9e64-539734a8392d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:37.210375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8690542-6274-43fe-8a6d-1a870e44d20a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:37.223316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8690542-6274-43fe-8a6d-1a870e44d20a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:37.225282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8690542-6274-43fe-8a6d-1a870e44d20a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:37.228271 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8690542-6274-43fe-8a6d-1a870e44d20a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1278 microversion: 2.57 time: 0.280842 Aug 03 02:17:37.229193 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2636/5158] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:36 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1278 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:17:37.726064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3c9a9fef-b79c-4177-9e64-539734a8392d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:37.787184 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3c9a9fef-b79c-4177-9e64-539734a8392d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1324 microversion: 2.1 time: 0.833454 Aug 03 02:17:37.790345 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2523/5159] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:36 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1324 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:38.257284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-377aca95-5ffc-40f4-b41b-ac8b699b8224 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:38.259106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-377aca95-5ffc-40f4-b41b-ac8b699b8224 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:38.269970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-377aca95-5ffc-40f4-b41b-ac8b699b8224 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:38.270831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-377aca95-5ffc-40f4-b41b-ac8b699b8224 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:38.272017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-377aca95-5ffc-40f4-b41b-ac8b699b8224 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:38.272706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-377aca95-5ffc-40f4-b41b-ac8b699b8224 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:38.453522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-377aca95-5ffc-40f4-b41b-ac8b699b8224 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:38.472775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-377aca95-5ffc-40f4-b41b-ac8b699b8224 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:38.476607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-377aca95-5ffc-40f4-b41b-ac8b699b8224 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:38.478230 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-377aca95-5ffc-40f4-b41b-ac8b699b8224 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1274 microversion: 2.57 time: 0.227587 Aug 03 02:17:38.480739 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2637/5160] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:38 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1274 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:38.809735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-71dd0bdb-0dc7-461e-a4e2-343dcd67d461 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:38.810274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-71dd0bdb-0dc7-461e-a4e2-343dcd67d461 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:38.844344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71dd0bdb-0dc7-461e-a4e2-343dcd67d461 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:38.845147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71dd0bdb-0dc7-461e-a4e2-343dcd67d461 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:38.847583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71dd0bdb-0dc7-461e-a4e2-343dcd67d461 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:38.848220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71dd0bdb-0dc7-461e-a4e2-343dcd67d461 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:39.397559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-71dd0bdb-0dc7-461e-a4e2-343dcd67d461 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:39.412654 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-71dd0bdb-0dc7-461e-a4e2-343dcd67d461 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1521 microversion: 2.1 time: 0.606809 Aug 03 02:17:39.413939 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2524/5161] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:38 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1521 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:39.445273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b9016b9b-2773-44e5-b5ab-c990ac5fa557 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:39.446577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b9016b9b-2773-44e5-b5ab-c990ac5fa557 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:39.473064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9016b9b-2773-44e5-b5ab-c990ac5fa557 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:39.473960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9016b9b-2773-44e5-b5ab-c990ac5fa557 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:39.475462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9016b9b-2773-44e5-b5ab-c990ac5fa557 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:39.476379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9016b9b-2773-44e5-b5ab-c990ac5fa557 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:39.512940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0f37cba-80c6-421a-b2af-548f6e943da1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:39.514558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0f37cba-80c6-421a-b2af-548f6e943da1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:39.546358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0f37cba-80c6-421a-b2af-548f6e943da1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:39.551497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0f37cba-80c6-421a-b2af-548f6e943da1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:39.555494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0f37cba-80c6-421a-b2af-548f6e943da1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:39.556343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0f37cba-80c6-421a-b2af-548f6e943da1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:39.591783 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-b9016b9b-2773-44e5-b5ab-c990ac5fa557 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] HTTP exception thrown: Instance is not a member of specified network Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b9016b9b-2773-44e5-b5ab-c990ac5fa557 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Request method failure captured: Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945/ips/invalid HTTP/1.1 Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dqqG05QjF90orOvkki_kgEB32NBsur3IDtin92ImjALOk2GQcPDtUttGCcwE3MrIGUqRThnEK8SJTanWV45cwXszOf4qUICfaaNLcCH7WgVDWtyja2jIlGiE6Ev_rXKN9r3-VY6wVJfpwIC08uOpPhSWEAEXEV9KKl3l0PQr6dGbxY Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 6141ae88ee4b4a82bd6251e49a6f4de8 Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-372180791 Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6141ae88ee4b4a82bd6251e49a6f4de8", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6141ae88ee4b4a82bd6251e49a6f4de8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6141ae88ee4b4a82bd6251e49a6f4de8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6141ae88ee4b4a82bd6251e49a6f4de8"}]}] Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-372180791 Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 6141ae88ee4b4a82bd6251e49a6f4de8 Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-372180791 Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerAddressesNegativeTestJSON-372180791-project Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e8e131b018f141fc8b02c44e7fc8067e Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-372180791-project Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance is not a member of specified network Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'server_id': '5e431190-b850-4b95-81d8-8e0e41283945', 'id': 'invalid'} Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 03 02:17:39.599950 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:39.605289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b9016b9b-2773-44e5-b5ab-c990ac5fa557 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Returning 404 to user: Instance is not a member of specified network {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:17:39.605289 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b9016b9b-2773-44e5-b5ab-c990ac5fa557 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.163411 Aug 03 02:17:39.605289 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2638/5162] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 02:17:39 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945/ips/invalid => generated 91 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:17:39.623000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d36192ff-e60d-49b3-ad64-e25152f03c72 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:39.623491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d36192ff-e60d-49b3-ad64-e25152f03c72 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Failed to fetch instance by id 999 {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 03 02:17:39.631482 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-d36192ff-e60d-49b3-ad64-e25152f03c72 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] HTTP exception thrown: Instance 999 could not be found. Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d36192ff-e60d-49b3-ad64-e25152f03c72 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Request method failure captured: Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dqqG05QjF90orOvkki_kgEB32NBsur3IDtin92ImjALOk2GQcPDtUttGCcwE3MrIGUqRThnEK8SJTanWV45cwXszOf4qUICfaaNLcCH7WgVDWtyja2jIlGiE6Ev_rXKN9r3-VY6wVJfpwIC08uOpPhSWEAEXEV9KKl3l0PQr6dGbxY Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 6141ae88ee4b4a82bd6251e49a6f4de8 Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-372180791 Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6141ae88ee4b4a82bd6251e49a6f4de8", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6141ae88ee4b4a82bd6251e49a6f4de8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6141ae88ee4b4a82bd6251e49a6f4de8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6141ae88ee4b4a82bd6251e49a6f4de8"}]}] Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-372180791 Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 6141ae88ee4b4a82bd6251e49a6f4de8 Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-372180791 Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerAddressesNegativeTestJSON-372180791-project Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e8e131b018f141fc8b02c44e7fc8067e Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-372180791-project Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 999 could not be found. Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'server_id': '999'} Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 03 02:17:39.633309 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:17:39.645612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d36192ff-e60d-49b3-ad64-e25152f03c72 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Returning 404 to user: Instance 999 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:17:39.645612 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d36192ff-e60d-49b3-ad64-e25152f03c72 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.024424 Aug 03 02:17:39.645612 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2639/5163] 10.222.0.67 () {58 vars in 1149 bytes} [Wed Aug 3 02:17:39 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:17:39.663318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4803ae0c-7488-4ae3-b8ee-911703a7e62d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:39.663318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4803ae0c-7488-4ae3-b8ee-911703a7e62d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:39.675243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4803ae0c-7488-4ae3-b8ee-911703a7e62d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:39.675881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4803ae0c-7488-4ae3-b8ee-911703a7e62d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:39.676712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4803ae0c-7488-4ae3-b8ee-911703a7e62d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:39.677171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4803ae0c-7488-4ae3-b8ee-911703a7e62d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:39.755465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4803ae0c-7488-4ae3-b8ee-911703a7e62d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:17:39.884906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0f37cba-80c6-421a-b2af-548f6e943da1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:39.908275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0f37cba-80c6-421a-b2af-548f6e943da1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:39.910565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0f37cba-80c6-421a-b2af-548f6e943da1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:39.912841 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0f37cba-80c6-421a-b2af-548f6e943da1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1336 microversion: 2.57 time: 0.408650 Aug 03 02:17:39.914547 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2525/5164] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:39 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1336 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:40.053633 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4803ae0c-7488-4ae3-b8ee-911703a7e62d tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 204 len: 0 microversion: 2.1 time: 0.406675 Aug 03 02:17:40.062607 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2640/5165] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:17:39 2022] DELETE /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:17:40.079500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e8352d6c-410d-461c-bfe8-51d148be9687 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:40.080503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e8352d6c-410d-461c-bfe8-51d148be9687 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:40.102548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8352d6c-410d-461c-bfe8-51d148be9687 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:40.105213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8352d6c-410d-461c-bfe8-51d148be9687 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:40.106381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8352d6c-410d-461c-bfe8-51d148be9687 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:40.111029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8352d6c-410d-461c-bfe8-51d148be9687 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:40.646286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e8352d6c-410d-461c-bfe8-51d148be9687 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:40.664726 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e8352d6c-410d-461c-bfe8-51d148be9687 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1527 microversion: 2.1 time: 0.593171 Aug 03 02:17:40.666310 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2526/5166] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:40 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1527 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:40.977676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1b6ee28a-dbd8-4b54-b71d-c2d82954cc0a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:40.978618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1b6ee28a-dbd8-4b54-b71d-c2d82954cc0a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:40.990847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b6ee28a-dbd8-4b54-b71d-c2d82954cc0a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:40.992377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b6ee28a-dbd8-4b54-b71d-c2d82954cc0a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:40.993230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b6ee28a-dbd8-4b54-b71d-c2d82954cc0a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:40.993713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b6ee28a-dbd8-4b54-b71d-c2d82954cc0a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:41.253282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1b6ee28a-dbd8-4b54-b71d-c2d82954cc0a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:41.264530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1b6ee28a-dbd8-4b54-b71d-c2d82954cc0a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:41.269628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1b6ee28a-dbd8-4b54-b71d-c2d82954cc0a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:41.280992 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1b6ee28a-dbd8-4b54-b71d-c2d82954cc0a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1336 microversion: 2.57 time: 0.325184 Aug 03 02:17:41.289803 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2641/5167] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:40 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1336 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:41.693137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c3f79454-7f08-4203-86a9-bf4929b16815 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:41.698602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c3f79454-7f08-4203-86a9-bf4929b16815 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:41.757913 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3f79454-7f08-4203-86a9-bf4929b16815 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:41.763846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3f79454-7f08-4203-86a9-bf4929b16815 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:41.765906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3f79454-7f08-4203-86a9-bf4929b16815 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:41.771939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3f79454-7f08-4203-86a9-bf4929b16815 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:42.319401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3cf2d162-f849-4e98-90c3-2878a07e57b7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:42.321863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3cf2d162-f849-4e98-90c3-2878a07e57b7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:42.347260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3cf2d162-f849-4e98-90c3-2878a07e57b7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:42.347824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3cf2d162-f849-4e98-90c3-2878a07e57b7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:42.348894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3cf2d162-f849-4e98-90c3-2878a07e57b7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:42.349611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3cf2d162-f849-4e98-90c3-2878a07e57b7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:42.588603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c3f79454-7f08-4203-86a9-bf4929b16815 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:42.604524 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c3f79454-7f08-4203-86a9-bf4929b16815 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1527 microversion: 2.1 time: 0.919177 Aug 03 02:17:42.614934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3cf2d162-f849-4e98-90c3-2878a07e57b7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:42.616241 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2527/5168] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:41 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1527 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:42.627415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3cf2d162-f849-4e98-90c3-2878a07e57b7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:42.639451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3cf2d162-f849-4e98-90c3-2878a07e57b7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:42.647870 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3cf2d162-f849-4e98-90c3-2878a07e57b7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1357 microversion: 2.57 time: 0.340150 Aug 03 02:17:42.649010 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2642/5169] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:42 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1357 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:42.692589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:42.696723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:42.716692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:42.717513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:42.720323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:42.724383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:42.927361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:17:42.933240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:17:42.934169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:17:42.935271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:17:42.938249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:17:43.081554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-90ef4878-7af5-45f2-a8f5-df4ec9dbe50e req-8b9dbfb5-5420-4a93-bdf0-bd9e3254c8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e431190-b850-4b95-81d8-8e0e41283945", "name": "network-vif-deleted", "tag": "aefbc0ce-4327-4185-a1b0-46d877ce3409"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:43.121069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-90ef4878-7af5-45f2-a8f5-df4ec9dbe50e req-8b9dbfb5-5420-4a93-bdf0-bd9e3254c8aa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:43.132672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-90ef4878-7af5-45f2-a8f5-df4ec9dbe50e req-8b9dbfb5-5420-4a93-bdf0-bd9e3254c8aa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:43.142011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:43.173017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:43.173664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:43.178211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:43.178806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:43.213959 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-90ef4878-7af5-45f2-a8f5-df4ec9dbe50e req-8b9dbfb5-5420-4a93-bdf0-bd9e3254c8aa service nova] Creating event network-vif-deleted:aefbc0ce-4327-4185-a1b0-46d877ce3409 for instance 5e431190-b850-4b95-81d8-8e0e41283945 on n-h1-826529-8 Aug 03 02:17:43.240750 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-90ef4878-7af5-45f2-a8f5-df4ec9dbe50e req-8b9dbfb5-5420-4a93-bdf0-bd9e3254c8aa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165111 Aug 03 02:17:43.244984 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2643/5170] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 03 02:17:43.302570 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-50111b75-fe65-4dde-ab3e-29e1c896ab07 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "POST /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d/action" status: 202 len: 1138 microversion: 2.57 time: 0.614842 Aug 03 02:17:43.346143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3920efc6-daeb-4e0d-b6a3-916734f306f9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:43.346917 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3920efc6-daeb-4e0d-b6a3-916734f306f9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:43.352875 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2528/5171] 10.222.0.67 () {62 vars in 1320 bytes} [Wed Aug 3 02:17:42 2022] POST /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d/action => generated 1138 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 03 02:17:43.404975 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3920efc6-daeb-4e0d-b6a3-916734f306f9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:43.406629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3920efc6-daeb-4e0d-b6a3-916734f306f9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:43.408968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3920efc6-daeb-4e0d-b6a3-916734f306f9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:43.414540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3920efc6-daeb-4e0d-b6a3-916734f306f9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:43.654721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f18e7ae2-ac19-487f-8754-a86fba8da7a7 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:43.663812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f18e7ae2-ac19-487f-8754-a86fba8da7a7 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:43.712464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f18e7ae2-ac19-487f-8754-a86fba8da7a7 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:43.721380 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f18e7ae2-ac19-487f-8754-a86fba8da7a7 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:43.733200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f18e7ae2-ac19-487f-8754-a86fba8da7a7 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:43.740822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f18e7ae2-ac19-487f-8754-a86fba8da7a7 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:43.767090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3920efc6-daeb-4e0d-b6a3-916734f306f9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:43.808822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3920efc6-daeb-4e0d-b6a3-916734f306f9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:43.818714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3920efc6-daeb-4e0d-b6a3-916734f306f9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:43.820172 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3920efc6-daeb-4e0d-b6a3-916734f306f9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.488457 Aug 03 02:17:43.823306 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2644/5172] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:43 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:43.878999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f18e7ae2-ac19-487f-8754-a86fba8da7a7 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:43.890888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f18e7ae2-ac19-487f-8754-a86fba8da7a7 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:43.893467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-f18e7ae2-ac19-487f-8754-a86fba8da7a7 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lazy-loading 'fault' on Instance uuid 5e431190-b850-4b95-81d8-8e0e41283945 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:17:44.556714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-de304e2d-0738-4738-a627-d3b550b20865 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:44.560242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-de304e2d-0738-4738-a627-d3b550b20865 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:44.568898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de304e2d-0738-4738-a627-d3b550b20865 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:44.569791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de304e2d-0738-4738-a627-d3b550b20865 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:44.570775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de304e2d-0738-4738-a627-d3b550b20865 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:44.571424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de304e2d-0738-4738-a627-d3b550b20865 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:44.700323 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-de304e2d-0738-4738-a627-d3b550b20865 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa/action" status: 200 len: 24581 microversion: 2.1 time: 0.153268 Aug 03 02:17:44.711100 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2645/5173] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:17:44 2022] POST /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa/action => generated 24581 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 02:17:44.752594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f18e7ae2-ac19-487f-8754-a86fba8da7a7 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8e131b018f141fc8b02c44e7fc8067e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6141ae88ee4b4a82bd6251e49a6f4de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:44.779721 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f18e7ae2-ac19-487f-8754-a86fba8da7a7 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 200 len: 1314 microversion: 2.1 time: 1.153704 Aug 03 02:17:44.793740 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2529/5174] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:43 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 1314 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:44.853817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-178dd49a-17be-4940-a916-48f9e997de32 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:44.854871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-178dd49a-17be-4940-a916-48f9e997de32 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:44.868501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-178dd49a-17be-4940-a916-48f9e997de32 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:44.868728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-178dd49a-17be-4940-a916-48f9e997de32 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:44.869805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-178dd49a-17be-4940-a916-48f9e997de32 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:44.870937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-178dd49a-17be-4940-a916-48f9e997de32 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:44.880098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:45.053475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-178dd49a-17be-4940-a916-48f9e997de32 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:45.074788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-178dd49a-17be-4940-a916-48f9e997de32 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:45.082982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-178dd49a-17be-4940-a916-48f9e997de32 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:45.101676 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-178dd49a-17be-4940-a916-48f9e997de32 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.250530 Aug 03 02:17:45.134144 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2646/5175] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:44 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:45.803146 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-390fe73b-3f19-403f-bd98-deae6d7f7a83 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:45.803801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-390fe73b-3f19-403f-bd98-deae6d7f7a83 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] [instance: 5e431190-b850-4b95-81d8-8e0e41283945] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:45.819544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-390fe73b-3f19-403f-bd98-deae6d7f7a83 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:45.825254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-390fe73b-3f19-403f-bd98-deae6d7f7a83 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:45.826690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-390fe73b-3f19-403f-bd98-deae6d7f7a83 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:45.837313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-390fe73b-3f19-403f-bd98-deae6d7f7a83 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:45.887750 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-390fe73b-3f19-403f-bd98-deae6d7f7a83 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] HTTP exception thrown: Instance 5e431190-b850-4b95-81d8-8e0e41283945 could not be found. Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-390fe73b-3f19-403f-bd98-deae6d7f7a83 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Request method failure captured: Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 HTTP/1.1 Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dqqG05QjF90orOvkki_kgEB32NBsur3IDtin92ImjALOk2GQcPDtUttGCcwE3MrIGUqRThnEK8SJTanWV45cwXszOf4qUICfaaNLcCH7WgVDWtyja2jIlGiE6Ev_rXKN9r3-VY6wVJfpwIC08uOpPhSWEAEXEV9KKl3l0PQr6dGbxY Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 6141ae88ee4b4a82bd6251e49a6f4de8 Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-372180791 Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6141ae88ee4b4a82bd6251e49a6f4de8", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6141ae88ee4b4a82bd6251e49a6f4de8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6141ae88ee4b4a82bd6251e49a6f4de8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6141ae88ee4b4a82bd6251e49a6f4de8"}]}] Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-372180791 Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 6141ae88ee4b4a82bd6251e49a6f4de8 Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-372180791 Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerAddressesNegativeTestJSON-372180791-project Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: e8e131b018f141fc8b02c44e7fc8067e Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-372180791-project Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 5e431190-b850-4b95-81d8-8e0e41283945 could not be found. Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '5e431190-b850-4b95-81d8-8e0e41283945'} Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e431190-b850-4b95-81d8-8e0e41283945 could not be found. Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e431190-b850-4b95-81d8-8e0e41283945 could not be found. Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:45.893707 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:17:45.899057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:45.899057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:17:45.899057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:17:45.899057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:17:45.899057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:17:45.899057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:17:45.899057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e431190-b850-4b95-81d8-8e0e41283945 could not be found. Aug 03 02:17:45.899057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:17:45.901006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-390fe73b-3f19-403f-bd98-deae6d7f7a83 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] Returning 404 to user: Instance 5e431190-b850-4b95-81d8-8e0e41283945 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:17:45.902794 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-390fe73b-3f19-403f-bd98-deae6d7f7a83 tempest-ServerAddressesNegativeTestJSON-372180791 tempest-ServerAddressesNegativeTestJSON-372180791-project] 10.222.0.67 "GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945" status: 404 len: 111 microversion: 2.1 time: 0.104760 Aug 03 02:17:45.907583 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2530/5176] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:45 2022] GET /compute/v2.1/servers/5e431190-b850-4b95-81d8-8e0e41283945 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:17:46.158303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5f9cb8b-fae8-4041-a8fe-5fa39ebffbb2 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:46.162224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5f9cb8b-fae8-4041-a8fe-5fa39ebffbb2 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:46.192342 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5f9cb8b-fae8-4041-a8fe-5fa39ebffbb2 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:46.199425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5f9cb8b-fae8-4041-a8fe-5fa39ebffbb2 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:46.200801 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5f9cb8b-fae8-4041-a8fe-5fa39ebffbb2 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:46.207125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5f9cb8b-fae8-4041-a8fe-5fa39ebffbb2 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:46.605403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c5f9cb8b-fae8-4041-a8fe-5fa39ebffbb2 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:46.619457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c5f9cb8b-fae8-4041-a8fe-5fa39ebffbb2 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:46.625842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c5f9cb8b-fae8-4041-a8fe-5fa39ebffbb2 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:46.629454 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5f9cb8b-fae8-4041-a8fe-5fa39ebffbb2 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.479222 Aug 03 02:17:46.629921 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2647/5177] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:46 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:17:47.693297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-40e902e3-e34b-4224-91d1-3cc47342d8a1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:47.693953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-40e902e3-e34b-4224-91d1-3cc47342d8a1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:47.709671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:47.721416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:47.737365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40e902e3-e34b-4224-91d1-3cc47342d8a1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:47.740467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40e902e3-e34b-4224-91d1-3cc47342d8a1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:47.742312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40e902e3-e34b-4224-91d1-3cc47342d8a1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:47.743946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40e902e3-e34b-4224-91d1-3cc47342d8a1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:48.023552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-40e902e3-e34b-4224-91d1-3cc47342d8a1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:48.041978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-40e902e3-e34b-4224-91d1-3cc47342d8a1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:48.044191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-40e902e3-e34b-4224-91d1-3cc47342d8a1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:48.046073 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-40e902e3-e34b-4224-91d1-3cc47342d8a1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.366008 Aug 03 02:17:48.060586 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2531/5178] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:47 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:49.080356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ec43cc35-772e-49fb-8335-c74d73077ab4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:49.082761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ec43cc35-772e-49fb-8335-c74d73077ab4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:49.094444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:49.098246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec43cc35-772e-49fb-8335-c74d73077ab4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:49.099584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec43cc35-772e-49fb-8335-c74d73077ab4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:49.101434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec43cc35-772e-49fb-8335-c74d73077ab4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:49.102588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec43cc35-772e-49fb-8335-c74d73077ab4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:49.294840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ec43cc35-772e-49fb-8335-c74d73077ab4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:49.313178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ec43cc35-772e-49fb-8335-c74d73077ab4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:49.317377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ec43cc35-772e-49fb-8335-c74d73077ab4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:49.320138 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ec43cc35-772e-49fb-8335-c74d73077ab4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.248132 Aug 03 02:17:49.321612 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2648/5179] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:49 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:50.365719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-99ef1702-59b4-467b-a1f2-25a1156a9689 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:50.366527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-99ef1702-59b4-467b-a1f2-25a1156a9689 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:50.390316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-99ef1702-59b4-467b-a1f2-25a1156a9689 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:50.392060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-99ef1702-59b4-467b-a1f2-25a1156a9689 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:50.393237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-99ef1702-59b4-467b-a1f2-25a1156a9689 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:50.396375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-99ef1702-59b4-467b-a1f2-25a1156a9689 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:50.703147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-283048725", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "07fdfbc7-41fb-4d85-88f0-239f44d6da09"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:50.805696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-99ef1702-59b4-467b-a1f2-25a1156a9689 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:50.832684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-99ef1702-59b4-467b-a1f2-25a1156a9689 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:50.844573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-99ef1702-59b4-467b-a1f2-25a1156a9689 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:50.855409 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-99ef1702-59b4-467b-a1f2-25a1156a9689 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.495098 Aug 03 02:17:50.860309 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2532/5180] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:50 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:51.024625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-758a31dd-ead1-42fc-b7a2-d9192c944e6f tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:51.025476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-758a31dd-ead1-42fc-b7a2-d9192c944e6f tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:51.051608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-758a31dd-ead1-42fc-b7a2-d9192c944e6f tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:51.052774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-758a31dd-ead1-42fc-b7a2-d9192c944e6f tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:51.057658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-758a31dd-ead1-42fc-b7a2-d9192c944e6f tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:51.058554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-758a31dd-ead1-42fc-b7a2-d9192c944e6f tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:51.142450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:51.319563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] validate_networks() for [('07fdfbc7-41fb-4d85-88f0-239f44d6da09', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:17:52.672910 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-758a31dd-ead1-42fc-b7a2-d9192c944e6f tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1833 microversion: 2.1 time: 1.651645 Aug 03 02:17:52.689203 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2533/5181] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:51 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1833 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:17:52.714831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-689dd379-7042-4361-91ae-8416aaa900c9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:52.719583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-689dd379-7042-4361-91ae-8416aaa900c9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:52.747830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-689dd379-7042-4361-91ae-8416aaa900c9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:52.751201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-689dd379-7042-4361-91ae-8416aaa900c9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:52.755773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-689dd379-7042-4361-91ae-8416aaa900c9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:52.756738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-689dd379-7042-4361-91ae-8416aaa900c9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:53.203120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-689dd379-7042-4361-91ae-8416aaa900c9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:53.223774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-689dd379-7042-4361-91ae-8416aaa900c9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:53.230168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-689dd379-7042-4361-91ae-8416aaa900c9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:53.240922 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-689dd379-7042-4361-91ae-8416aaa900c9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.550110 Aug 03 02:17:53.257930 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2534/5182] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:52 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:54.097361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:17:54.098526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:17:54.098526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:17:54.098874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:17:54.100343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:17:54.122860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:54.123369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:54.124836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:54.125292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:54.178751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Getting quotas for project 007e4e43091e44698e83ce1051480be4. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:17:54.191373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Getting quotas for user e439f3311e644d69839fe02978d20f2b and project 007e4e43091e44698e83ce1051480be4. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:17:54.242725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:17:54.245633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:17:54.268486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a8c66faa-d770-4aa7-afa3-f396900c85c0 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:54.269554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a8c66faa-d770-4aa7-afa3-f396900c85c0 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:54.307142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8c66faa-d770-4aa7-afa3-f396900c85c0 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:54.308407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8c66faa-d770-4aa7-afa3-f396900c85c0 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:54.317896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8c66faa-d770-4aa7-afa3-f396900c85c0 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:54.319231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8c66faa-d770-4aa7-afa3-f396900c85c0 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:54.351438 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-308776ca-aaaa-4485-bf99-2b1590fd63cb tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.892255 Aug 03 02:17:54.372793 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2649/5183] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:17:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:17:54.674417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1260653660", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "07fdfbc7-41fb-4d85-88f0-239f44d6da09"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:54.798062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a8c66faa-d770-4aa7-afa3-f396900c85c0 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:54.806584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a8c66faa-d770-4aa7-afa3-f396900c85c0 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:54.808182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a8c66faa-d770-4aa7-afa3-f396900c85c0 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:54.809331 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a8c66faa-d770-4aa7-afa3-f396900c85c0 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.547585 Aug 03 02:17:54.809901 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2535/5184] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:54 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:17:54.841311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] validate_networks() for [('07fdfbc7-41fb-4d85-88f0-239f44d6da09', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:17:55.840731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f9dc7ed7-7a9a-4672-b835-67541cef616b tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:55.844696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f9dc7ed7-7a9a-4672-b835-67541cef616b tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:55.867873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:55.869559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9dc7ed7-7a9a-4672-b835-67541cef616b tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:55.880016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9dc7ed7-7a9a-4672-b835-67541cef616b tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:55.882181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9dc7ed7-7a9a-4672-b835-67541cef616b tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:55.883370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9dc7ed7-7a9a-4672-b835-67541cef616b tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:56.965609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f9dc7ed7-7a9a-4672-b835-67541cef616b tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:56.991493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f9dc7ed7-7a9a-4672-b835-67541cef616b tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:56.996171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f9dc7ed7-7a9a-4672-b835-67541cef616b tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:57.000565 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f9dc7ed7-7a9a-4672-b835-67541cef616b tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 1.166080 Aug 03 02:17:57.001803 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2536/5185] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:55 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:17:58.042760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-58d09a21-fee6-4786-b5ba-4a653296816f tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:58.045810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-58d09a21-fee6-4786-b5ba-4a653296816f tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:58.072036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58d09a21-fee6-4786-b5ba-4a653296816f tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:58.079627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58d09a21-fee6-4786-b5ba-4a653296816f tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:58.083549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58d09a21-fee6-4786-b5ba-4a653296816f tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:58.084502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58d09a21-fee6-4786-b5ba-4a653296816f tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:58.266140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:17:58.266690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:17:58.267599 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:17:58.268290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:17:58.268822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:17:58.271684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:17:58.298079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-58d09a21-fee6-4786-b5ba-4a653296816f tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:58.314946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-58d09a21-fee6-4786-b5ba-4a653296816f tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:58.316574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-58d09a21-fee6-4786-b5ba-4a653296816f tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:17:58.317822 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-58d09a21-fee6-4786-b5ba-4a653296816f tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.285520 Aug 03 02:17:58.318414 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2537/5186] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:17:58 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:17:58.325221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:58.328223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:58.331020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:58.332280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:58.376472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Getting quotas for project 007e4e43091e44698e83ce1051480be4. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:17:58.384043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Getting quotas for user e439f3311e644d69839fe02978d20f2b and project 007e4e43091e44698e83ce1051480be4. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:17:58.403344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:17:58.407906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: d51f27ee-4c64-44a6-b46b-da2c369aacd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:17:58.494634 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-68e64df6-2051-4e59-9608-4350d4de5761 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.833388 Aug 03 02:17:58.495894 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2650/5187] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:17:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:17:58.742993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1178147604", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "451", "networks": [{"uuid": "07fdfbc7-41fb-4d85-88f0-239f44d6da09"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:58.815095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-716db301-f43d-4e1f-bd18-2a056997a7d2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:58.816087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-716db301-f43d-4e1f-bd18-2a056997a7d2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:58.821135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] validate_networks() for [('07fdfbc7-41fb-4d85-88f0-239f44d6da09', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:17:58.853446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-716db301-f43d-4e1f-bd18-2a056997a7d2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:58.856191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-716db301-f43d-4e1f-bd18-2a056997a7d2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:58.857405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-716db301-f43d-4e1f-bd18-2a056997a7d2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:58.861554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-716db301-f43d-4e1f-bd18-2a056997a7d2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:58.946261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-716db301-f43d-4e1f-bd18-2a056997a7d2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:17:59.158729 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-716db301-f43d-4e1f-bd18-2a056997a7d2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 204 len: 0 microversion: 2.1 time: 0.351100 Aug 03 02:17:59.162579 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2651/5188] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:17:58 2022] DELETE /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:17:59.176050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a11e08a0-1a03-4629-8b28-67a34979e878 req-99a7f475-6350-421b-9182-c23849e40a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e4bbb0-7656-402a-9305-ade9e15781fa", "tag": "b6a555d7-75da-4324-9c4c-c241c08c8aad"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:17:59.191297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a11e08a0-1a03-4629-8b28-67a34979e878 req-99a7f475-6350-421b-9182-c23849e40a0f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:59.204041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a11e08a0-1a03-4629-8b28-67a34979e878 req-99a7f475-6350-421b-9182-c23849e40a0f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:59.247852 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a11e08a0-1a03-4629-8b28-67a34979e878 req-99a7f475-6350-421b-9182-c23849e40a0f service nova] Creating event network-changed:b6a555d7-75da-4324-9c4c-c241c08c8aad for instance b1e4bbb0-7656-402a-9305-ade9e15781fa on n-h1-826529-8 Aug 03 02:17:59.269300 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a11e08a0-1a03-4629-8b28-67a34979e878 req-99a7f475-6350-421b-9182-c23849e40a0f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106790 Aug 03 02:17:59.270549 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2652/5189] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:17:59.280987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f25dbdfb-519c-435f-a81a-452b037d6438 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:17:59.281633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f25dbdfb-519c-435f-a81a-452b037d6438 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:17:59.300723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f25dbdfb-519c-435f-a81a-452b037d6438 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:59.301219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f25dbdfb-519c-435f-a81a-452b037d6438 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:17:59.302042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f25dbdfb-519c-435f-a81a-452b037d6438 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:17:59.302564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f25dbdfb-519c-435f-a81a-452b037d6438 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:00.107197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f25dbdfb-519c-435f-a81a-452b037d6438 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:00.130360 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f25dbdfb-519c-435f-a81a-452b037d6438 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1688 microversion: 2.1 time: 0.856179 Aug 03 02:18:00.132286 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2653/5190] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:17:59 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1688 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:00.160492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fdf138f2-42c9-4fee-8ee0-892195352732 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:00.165721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fdf138f2-42c9-4fee-8ee0-892195352732 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:00.194253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fdf138f2-42c9-4fee-8ee0-892195352732 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:00.195722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fdf138f2-42c9-4fee-8ee0-892195352732 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:00.199759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fdf138f2-42c9-4fee-8ee0-892195352732 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:00.200988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fdf138f2-42c9-4fee-8ee0-892195352732 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:01.122374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fdf138f2-42c9-4fee-8ee0-892195352732 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:01.145728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fdf138f2-42c9-4fee-8ee0-892195352732 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:01.148732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fdf138f2-42c9-4fee-8ee0-892195352732 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:01.150066 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fdf138f2-42c9-4fee-8ee0-892195352732 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 1.005419 Aug 03 02:18:01.154936 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2654/5191] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:00 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:18:01.173815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b249c1e7-be7d-48ed-abbd-9b7a9b2e6f68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:01.176964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b249c1e7-be7d-48ed-abbd-9b7a9b2e6f68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:01.190226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b249c1e7-be7d-48ed-abbd-9b7a9b2e6f68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:01.191174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b249c1e7-be7d-48ed-abbd-9b7a9b2e6f68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:01.193684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b249c1e7-be7d-48ed-abbd-9b7a9b2e6f68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:01.195184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b249c1e7-be7d-48ed-abbd-9b7a9b2e6f68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:01.834430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b249c1e7-be7d-48ed-abbd-9b7a9b2e6f68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:01.847846 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b249c1e7-be7d-48ed-abbd-9b7a9b2e6f68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1688 microversion: 2.1 time: 0.679127 Aug 03 02:18:01.850995 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2655/5192] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:01 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1688 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:01.869429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:18:01.870026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:18:01.870367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:18:01.871231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:18:01.872050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:18:01.895528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:01.896948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:01.899465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:01.901581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:01.960662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Getting quotas for project 007e4e43091e44698e83ce1051480be4. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:18:01.979518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Getting quotas for user e439f3311e644d69839fe02978d20f2b and project 007e4e43091e44698e83ce1051480be4. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:18:02.015395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:18:02.021439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:18:02.106225 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f8ff3f57-5490-4180-8664-42535d4f3af7 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.367304 Aug 03 02:18:02.108218 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2538/5193] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:17:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:18:02.121020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0f3c2622-411c-465a-b517-b155b8823386 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:02.122316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0f3c2622-411c-465a-b517-b155b8823386 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:02.177193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8db632d4-0dcd-4186-8d32-9182ea12d316 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:02.177935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8db632d4-0dcd-4186-8d32-9182ea12d316 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:02.209809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8db632d4-0dcd-4186-8d32-9182ea12d316 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:02.214568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8db632d4-0dcd-4186-8d32-9182ea12d316 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:02.215638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8db632d4-0dcd-4186-8d32-9182ea12d316 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:02.216549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8db632d4-0dcd-4186-8d32-9182ea12d316 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:02.312638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0f3c2622-411c-465a-b517-b155b8823386 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:02.325070 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0f3c2622-411c-465a-b517-b155b8823386 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1221 microversion: 2.1 time: 0.209807 Aug 03 02:18:02.325826 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2656/5194] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:02 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1221 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:02.432637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8db632d4-0dcd-4186-8d32-9182ea12d316 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:02.446392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8db632d4-0dcd-4186-8d32-9182ea12d316 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:02.448292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8db632d4-0dcd-4186-8d32-9182ea12d316 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:02.449618 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8db632d4-0dcd-4186-8d32-9182ea12d316 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.279326 Aug 03 02:18:02.463760 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2539/5195] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:02 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:18:02.690664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-29bc4b89-5202-41ba-97bb-ebd61e34c536 req-77f8eed5-c363-47cf-bf3b-0e80e30f9e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e4bbb0-7656-402a-9305-ade9e15781fa", "name": "network-vif-deleted", "tag": "b6a555d7-75da-4324-9c4c-c241c08c8aad"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:02.720222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-29bc4b89-5202-41ba-97bb-ebd61e34c536 req-77f8eed5-c363-47cf-bf3b-0e80e30f9e6e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:02.721194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-29bc4b89-5202-41ba-97bb-ebd61e34c536 req-77f8eed5-c363-47cf-bf3b-0e80e30f9e6e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:02.739786 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-29bc4b89-5202-41ba-97bb-ebd61e34c536 req-77f8eed5-c363-47cf-bf3b-0e80e30f9e6e service nova] Creating event network-vif-deleted:b6a555d7-75da-4324-9c4c-c241c08c8aad for instance b1e4bbb0-7656-402a-9305-ade9e15781fa on n-h1-826529-8 Aug 03 02:18:02.768981 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-29bc4b89-5202-41ba-97bb-ebd61e34c536 req-77f8eed5-c363-47cf-bf3b-0e80e30f9e6e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083392 Aug 03 02:18:02.770000 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2657/5196] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:18:02.875855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-876f5fc8-1c30-4e9a-9246-d37c2cca7787 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:02.876647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-876f5fc8-1c30-4e9a-9246-d37c2cca7787 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:02.891604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-876f5fc8-1c30-4e9a-9246-d37c2cca7787 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:02.893445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-876f5fc8-1c30-4e9a-9246-d37c2cca7787 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:02.895228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-876f5fc8-1c30-4e9a-9246-d37c2cca7787 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:02.897904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-876f5fc8-1c30-4e9a-9246-d37c2cca7787 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:02.971223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-876f5fc8-1c30-4e9a-9246-d37c2cca7787 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:02.972310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-876f5fc8-1c30-4e9a-9246-d37c2cca7787 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:02.972935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-876f5fc8-1c30-4e9a-9246-d37c2cca7787 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lazy-loading 'fault' on Instance uuid b1e4bbb0-7656-402a-9305-ade9e15781fa {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:18:03.069820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-876f5fc8-1c30-4e9a-9246-d37c2cca7787 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:03.107054 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-876f5fc8-1c30-4e9a-9246-d37c2cca7787 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 200 len: 1355 microversion: 2.1 time: 0.235517 Aug 03 02:18:03.112109 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2540/5197] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:02 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 1355 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:03.347372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9f7e8736-ecd4-4cfa-8685-11f16116f8b6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:03.348914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9f7e8736-ecd4-4cfa-8685-11f16116f8b6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:03.364206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f7e8736-ecd4-4cfa-8685-11f16116f8b6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:03.365325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f7e8736-ecd4-4cfa-8685-11f16116f8b6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:03.366288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f7e8736-ecd4-4cfa-8685-11f16116f8b6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:03.367175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9f7e8736-ecd4-4cfa-8685-11f16116f8b6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:03.477154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e44f99b3-a6f1-42f4-a8f3-6a3aa6ccd017 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:03.477996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e44f99b3-a6f1-42f4-a8f3-6a3aa6ccd017 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:03.493302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e44f99b3-a6f1-42f4-a8f3-6a3aa6ccd017 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:03.494298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e44f99b3-a6f1-42f4-a8f3-6a3aa6ccd017 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:03.495622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e44f99b3-a6f1-42f4-a8f3-6a3aa6ccd017 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:03.496319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e44f99b3-a6f1-42f4-a8f3-6a3aa6ccd017 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:03.573351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9f7e8736-ecd4-4cfa-8685-11f16116f8b6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:03.589380 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9f7e8736-ecd4-4cfa-8685-11f16116f8b6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1273 microversion: 2.1 time: 0.247136 Aug 03 02:18:03.591482 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2658/5198] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:03 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1273 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:03.646740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e44f99b3-a6f1-42f4-a8f3-6a3aa6ccd017 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:03.658396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e44f99b3-a6f1-42f4-a8f3-6a3aa6ccd017 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:03.661319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e44f99b3-a6f1-42f4-a8f3-6a3aa6ccd017 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:03.665862 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e44f99b3-a6f1-42f4-a8f3-6a3aa6ccd017 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.193528 Aug 03 02:18:03.673089 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2541/5199] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:03 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:18:04.139754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9a644af6-6cf7-4c46-87d4-d2b4d2ec20b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:04.140082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9a644af6-6cf7-4c46-87d4-d2b4d2ec20b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: b1e4bbb0-7656-402a-9305-ade9e15781fa] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:04.157999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9a644af6-6cf7-4c46-87d4-d2b4d2ec20b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:04.158475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9a644af6-6cf7-4c46-87d4-d2b4d2ec20b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:04.159427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9a644af6-6cf7-4c46-87d4-d2b4d2ec20b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:04.163257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9a644af6-6cf7-4c46-87d4-d2b4d2ec20b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:04.234057 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-9a644af6-6cf7-4c46-87d4-d2b4d2ec20b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] HTTP exception thrown: Instance b1e4bbb0-7656-402a-9305-ade9e15781fa could not be found. Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9a644af6-6cf7-4c46-87d4-d2b4d2ec20b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Request method failure captured: Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa HTTP/1.1 Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6doi9mhvS1ouiIhMAao9U5FMCKoCDK2Svh-rN38K6LLUL5Jz46cjohY4VinMjw8nEITcvufUHSTuoEsFDcuvi9KweDemmvXVR2Y50H-XN3XOCzqBlRtzMafBlbAgN_igQZKGETPhyc3zhVKXRP1svhEgFnKivuflt3X2jd-ilbL3xBI Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: f6179959e78b438cb68680f694190a8c Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-160243142 Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f6179959e78b438cb68680f694190a8c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6179959e78b438cb68680f694190a8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f6179959e78b438cb68680f694190a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6179959e78b438cb68680f694190a8c"}]}] Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestNetworkAdvancedServerOps-160243142 Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: f6179959e78b438cb68680f694190a8c Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-160243142 Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestNetworkAdvancedServerOps-160243142-project Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: adca21bc340d440e91e4d856a625cd3a Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestNetworkAdvancedServerOps-160243142-project Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance b1e4bbb0-7656-402a-9305-ade9e15781fa could not be found. Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'b1e4bbb0-7656-402a-9305-ade9e15781fa'} Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1e4bbb0-7656-402a-9305-ade9e15781fa could not be found. Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1e4bbb0-7656-402a-9305-ade9e15781fa could not be found. Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:18:04.238374 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:18:04.243945 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:18:04.243945 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:18:04.243945 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:18:04.243945 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:18:04.243945 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:18:04.243945 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:18:04.243945 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1e4bbb0-7656-402a-9305-ade9e15781fa could not be found. Aug 03 02:18:04.243945 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:18:04.245968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9a644af6-6cf7-4c46-87d4-d2b4d2ec20b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Returning 404 to user: Instance b1e4bbb0-7656-402a-9305-ade9e15781fa could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:18:04.253563 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9a644af6-6cf7-4c46-87d4-d2b4d2ec20b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa" status: 404 len: 111 microversion: 2.1 time: 0.118990 Aug 03 02:18:04.254475 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2659/5200] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:04 2022] GET /compute/v2.1/servers/b1e4bbb0-7656-402a-9305-ade9e15781fa => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:18:04.619588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-552fef92-53cc-4a8f-a504-62d834a19f7a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:04.620921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-552fef92-53cc-4a8f-a504-62d834a19f7a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:04.660950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552fef92-53cc-4a8f-a504-62d834a19f7a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:04.661934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552fef92-53cc-4a8f-a504-62d834a19f7a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:04.664014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552fef92-53cc-4a8f-a504-62d834a19f7a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:04.665344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552fef92-53cc-4a8f-a504-62d834a19f7a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:04.697919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2af37f8e-413c-498b-a81e-e707b114dc0c tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:04.698534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2af37f8e-413c-498b-a81e-e707b114dc0c tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:04.711508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2af37f8e-413c-498b-a81e-e707b114dc0c tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:04.711967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2af37f8e-413c-498b-a81e-e707b114dc0c tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:04.728721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2af37f8e-413c-498b-a81e-e707b114dc0c tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:04.729230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2af37f8e-413c-498b-a81e-e707b114dc0c tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:04.823044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-552fef92-53cc-4a8f-a504-62d834a19f7a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:04.844214 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-552fef92-53cc-4a8f-a504-62d834a19f7a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1279 microversion: 2.1 time: 0.225567 Aug 03 02:18:04.849440 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2542/5201] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:04 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1279 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:05.035786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2af37f8e-413c-498b-a81e-e707b114dc0c tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:05.065190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2af37f8e-413c-498b-a81e-e707b114dc0c tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:05.076217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2af37f8e-413c-498b-a81e-e707b114dc0c tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:05.084157 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2af37f8e-413c-498b-a81e-e707b114dc0c tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.390113 Aug 03 02:18:05.088019 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2660/5202] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:04 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:18:05.868686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d24bf7e3-8c8c-44c1-a561-76d297d54722 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:05.870333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d24bf7e3-8c8c-44c1-a561-76d297d54722 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:05.888133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d24bf7e3-8c8c-44c1-a561-76d297d54722 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:05.891267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d24bf7e3-8c8c-44c1-a561-76d297d54722 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:05.892501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d24bf7e3-8c8c-44c1-a561-76d297d54722 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:05.895288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d24bf7e3-8c8c-44c1-a561-76d297d54722 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:06.114871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d0f625e1-b720-4eb3-b71f-580149d43b82 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:06.116767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d0f625e1-b720-4eb3-b71f-580149d43b82 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:06.130029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0f625e1-b720-4eb3-b71f-580149d43b82 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:06.132467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0f625e1-b720-4eb3-b71f-580149d43b82 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:06.136138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0f625e1-b720-4eb3-b71f-580149d43b82 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:06.136717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0f625e1-b720-4eb3-b71f-580149d43b82 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:06.384918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d0f625e1-b720-4eb3-b71f-580149d43b82 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:06.412120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d0f625e1-b720-4eb3-b71f-580149d43b82 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:06.414793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d0f625e1-b720-4eb3-b71f-580149d43b82 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:06.426952 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d0f625e1-b720-4eb3-b71f-580149d43b82 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.310548 Aug 03 02:18:06.428540 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2661/5203] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:06 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:18:06.873088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d24bf7e3-8c8c-44c1-a561-76d297d54722 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:06.888296 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d24bf7e3-8c8c-44c1-a561-76d297d54722 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1321 microversion: 2.1 time: 1.023622 Aug 03 02:18:06.898436 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2543/5204] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:05 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1321 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:07.455232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8dcb0bc1-4b69-4f23-8aef-a918ed66ce74 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:07.458679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8dcb0bc1-4b69-4f23-8aef-a918ed66ce74 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:07.478505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dcb0bc1-4b69-4f23-8aef-a918ed66ce74 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:07.481207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dcb0bc1-4b69-4f23-8aef-a918ed66ce74 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:07.483268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dcb0bc1-4b69-4f23-8aef-a918ed66ce74 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:07.484908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8dcb0bc1-4b69-4f23-8aef-a918ed66ce74 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:07.595996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-f9fb459c-6740-467d-a518-0171d2959e33 req-e2c32f49-f991-4a36-953b-3b8b82930d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "334229c5-e563-4c00-bccd-90b703d542d9", "tag": "9ca601fb-8136-46c2-9f4f-e88601950fe0"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:07.635724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f9fb459c-6740-467d-a518-0171d2959e33 req-e2c32f49-f991-4a36-953b-3b8b82930d06 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:07.636373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f9fb459c-6740-467d-a518-0171d2959e33 req-e2c32f49-f991-4a36-953b-3b8b82930d06 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:07.670493 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-f9fb459c-6740-467d-a518-0171d2959e33 req-e2c32f49-f991-4a36-953b-3b8b82930d06 service nova] Creating event network-changed:9ca601fb-8136-46c2-9f4f-e88601950fe0 for instance 334229c5-e563-4c00-bccd-90b703d542d9 on n-h1-826529-8 Aug 03 02:18:07.680351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8dcb0bc1-4b69-4f23-8aef-a918ed66ce74 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:07.689511 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-f9fb459c-6740-467d-a518-0171d2959e33 req-e2c32f49-f991-4a36-953b-3b8b82930d06 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100127 Aug 03 02:18:07.690455 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2544/5205] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:18:07.709113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8dcb0bc1-4b69-4f23-8aef-a918ed66ce74 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:07.724206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8dcb0bc1-4b69-4f23-8aef-a918ed66ce74 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:07.726480 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8dcb0bc1-4b69-4f23-8aef-a918ed66ce74 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.277589 Aug 03 02:18:07.731341 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2662/5206] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:07 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:18:07.922287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e8142d42-e23d-4cad-9e2e-06f550282542 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:07.923675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e8142d42-e23d-4cad-9e2e-06f550282542 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:07.944798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8142d42-e23d-4cad-9e2e-06f550282542 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:07.945271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8142d42-e23d-4cad-9e2e-06f550282542 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:07.946094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8142d42-e23d-4cad-9e2e-06f550282542 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:07.946546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8142d42-e23d-4cad-9e2e-06f550282542 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:08.603889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e8142d42-e23d-4cad-9e2e-06f550282542 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:08.625417 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e8142d42-e23d-4cad-9e2e-06f550282542 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1321 microversion: 2.1 time: 0.709007 Aug 03 02:18:08.629009 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2545/5207] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:07 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1321 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:08.760062 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c3a445c0-a7bc-4005-813e-62089b638e64 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:08.760806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c3a445c0-a7bc-4005-813e-62089b638e64 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:08.769588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:08.780451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3a445c0-a7bc-4005-813e-62089b638e64 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:08.780922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3a445c0-a7bc-4005-813e-62089b638e64 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:08.783116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3a445c0-a7bc-4005-813e-62089b638e64 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:08.787014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3a445c0-a7bc-4005-813e-62089b638e64 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:09.097288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c3a445c0-a7bc-4005-813e-62089b638e64 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:09.117816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c3a445c0-a7bc-4005-813e-62089b638e64 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:09.128921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c3a445c0-a7bc-4005-813e-62089b638e64 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:09.130153 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c3a445c0-a7bc-4005-813e-62089b638e64 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.379396 Aug 03 02:18:09.144786 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2663/5208] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:08 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:18:09.665927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4ade4444-08b4-4690-99b9-9f672e077d9b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:09.666539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4ade4444-08b4-4690-99b9-9f672e077d9b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:09.682885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ade4444-08b4-4690-99b9-9f672e077d9b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:09.683514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ade4444-08b4-4690-99b9-9f672e077d9b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:09.684747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ade4444-08b4-4690-99b9-9f672e077d9b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:09.685346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ade4444-08b4-4690-99b9-9f672e077d9b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:09.913321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-9c7c616c-76d3-4c45-9597-1f1b79375c08 req-c5535bef-0a21-4c0e-9e30-9ccccae1b182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c00b72-7f8e-4c03-85a2-2b2daa80bbc7", "tag": "585f12bf-d0be-4ebb-bc4f-fae943b4351f"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:09.936675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9c7c616c-76d3-4c45-9597-1f1b79375c08 req-c5535bef-0a21-4c0e-9e30-9ccccae1b182 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:09.939869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9c7c616c-76d3-4c45-9597-1f1b79375c08 req-c5535bef-0a21-4c0e-9e30-9ccccae1b182 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:09.969231 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-9c7c616c-76d3-4c45-9597-1f1b79375c08 req-c5535bef-0a21-4c0e-9e30-9ccccae1b182 service nova] Creating event network-changed:585f12bf-d0be-4ebb-bc4f-fae943b4351f for instance 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 on n-h2-826529-8 Aug 03 02:18:09.987193 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-9c7c616c-76d3-4c45-9597-1f1b79375c08 req-c5535bef-0a21-4c0e-9e30-9ccccae1b182 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083230 Aug 03 02:18:09.989477 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2664/5209] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:18:10.174756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d4cd3aa0-1f0e-4309-b14a-9fd986e2adf9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:10.176079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d4cd3aa0-1f0e-4309-b14a-9fd986e2adf9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:10.192875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4cd3aa0-1f0e-4309-b14a-9fd986e2adf9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:10.194020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4cd3aa0-1f0e-4309-b14a-9fd986e2adf9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:10.195190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4cd3aa0-1f0e-4309-b14a-9fd986e2adf9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:10.195880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4cd3aa0-1f0e-4309-b14a-9fd986e2adf9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:10.560284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4ade4444-08b4-4690-99b9-9f672e077d9b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:10.571354 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4ade4444-08b4-4690-99b9-9f672e077d9b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1321 microversion: 2.1 time: 0.911204 Aug 03 02:18:10.577127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d4cd3aa0-1f0e-4309-b14a-9fd986e2adf9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:10.577686 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2546/5210] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:09 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1321 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:10.609439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d4cd3aa0-1f0e-4309-b14a-9fd986e2adf9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:10.616580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d4cd3aa0-1f0e-4309-b14a-9fd986e2adf9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:10.619892 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d4cd3aa0-1f0e-4309-b14a-9fd986e2adf9 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.449789 Aug 03 02:18:10.621740 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2665/5211] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:10 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:18:11.598205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4e09f9a4-4897-4025-8693-34f8e989b1b2 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:11.599462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4e09f9a4-4897-4025-8693-34f8e989b1b2 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:11.631453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e09f9a4-4897-4025-8693-34f8e989b1b2 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:11.631922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e09f9a4-4897-4025-8693-34f8e989b1b2 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:11.632791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e09f9a4-4897-4025-8693-34f8e989b1b2 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:11.633234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e09f9a4-4897-4025-8693-34f8e989b1b2 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:11.646874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5c20c588-bf31-4065-b651-4f4108565ef1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:11.648663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5c20c588-bf31-4065-b651-4f4108565ef1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:11.661988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c20c588-bf31-4065-b651-4f4108565ef1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:11.663907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c20c588-bf31-4065-b651-4f4108565ef1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:11.664961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c20c588-bf31-4065-b651-4f4108565ef1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:11.668065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c20c588-bf31-4065-b651-4f4108565ef1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:11.750600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:11.932786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:11.994500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:12.036932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5c20c588-bf31-4065-b651-4f4108565ef1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:12.051140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5c20c588-bf31-4065-b651-4f4108565ef1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:12.053410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5c20c588-bf31-4065-b651-4f4108565ef1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:12.057183 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5c20c588-bf31-4065-b651-4f4108565ef1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.413545 Aug 03 02:18:12.058454 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2666/5212] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:11 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:18:12.067854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-e10d6ab0-5378-42ea-bccf-c3e3ec2d0ca2 req-fec16036-522f-46ca-b790-cad9f1b6edbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d51f27ee-4c64-44a6-b46b-da2c369aacd0", "tag": "f1186d59-0d81-4562-8183-90c576b9c232"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:12.093262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e10d6ab0-5378-42ea-bccf-c3e3ec2d0ca2 req-fec16036-522f-46ca-b790-cad9f1b6edbb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:12.096105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e10d6ab0-5378-42ea-bccf-c3e3ec2d0ca2 req-fec16036-522f-46ca-b790-cad9f1b6edbb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:12.124001 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-e10d6ab0-5378-42ea-bccf-c3e3ec2d0ca2 req-fec16036-522f-46ca-b790-cad9f1b6edbb service nova] Creating event network-changed:f1186d59-0d81-4562-8183-90c576b9c232 for instance d51f27ee-4c64-44a6-b46b-da2c369aacd0 on n-h1-826529-8 Aug 03 02:18:12.138369 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-e10d6ab0-5378-42ea-bccf-c3e3ec2d0ca2 req-fec16036-522f-46ca-b790-cad9f1b6edbb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078205 Aug 03 02:18:12.149663 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2667/5213] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:18:12.366771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4e09f9a4-4897-4025-8693-34f8e989b1b2 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:12.385104 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4e09f9a4-4897-4025-8693-34f8e989b1b2 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1321 microversion: 2.1 time: 0.790754 Aug 03 02:18:12.387377 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2547/5214] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:11 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1321 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:13.089611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-52228030-be9f-4d90-ae7e-166b9fe057f7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:13.091068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-52228030-be9f-4d90-ae7e-166b9fe057f7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:13.109798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=14 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:13.116728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52228030-be9f-4d90-ae7e-166b9fe057f7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:13.117609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52228030-be9f-4d90-ae7e-166b9fe057f7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:13.120625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52228030-be9f-4d90-ae7e-166b9fe057f7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:13.121721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52228030-be9f-4d90-ae7e-166b9fe057f7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:13.335016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-52228030-be9f-4d90-ae7e-166b9fe057f7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:13.352270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-52228030-be9f-4d90-ae7e-166b9fe057f7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:13.358726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-52228030-be9f-4d90-ae7e-166b9fe057f7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:13.367380 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-52228030-be9f-4d90-ae7e-166b9fe057f7 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.287667 Aug 03 02:18:13.368819 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2668/5215] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:13 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:18:13.411335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e6372c17-135f-49ee-a170-cc4ee268e88e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:13.412729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e6372c17-135f-49ee-a170-cc4ee268e88e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:13.425180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6372c17-135f-49ee-a170-cc4ee268e88e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:13.425933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6372c17-135f-49ee-a170-cc4ee268e88e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:13.433849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6372c17-135f-49ee-a170-cc4ee268e88e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:13.434625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6372c17-135f-49ee-a170-cc4ee268e88e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:13.797745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e6372c17-135f-49ee-a170-cc4ee268e88e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:13.815806 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e6372c17-135f-49ee-a170-cc4ee268e88e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1321 microversion: 2.1 time: 0.408689 Aug 03 02:18:13.816772 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2548/5216] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:13 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1321 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:14.400212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4d0c24f4-fc01-4743-afa6-a847a50bed54 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:14.400854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4d0c24f4-fc01-4743-afa6-a847a50bed54 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:14.423748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d0c24f4-fc01-4743-afa6-a847a50bed54 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:14.424334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d0c24f4-fc01-4743-afa6-a847a50bed54 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:14.425193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d0c24f4-fc01-4743-afa6-a847a50bed54 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:14.425879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d0c24f4-fc01-4743-afa6-a847a50bed54 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:14.840859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-552e86d6-5b74-4233-af2f-156bee576254 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:14.843456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-552e86d6-5b74-4233-af2f-156bee576254 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:14.859962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552e86d6-5b74-4233-af2f-156bee576254 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:14.861792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552e86d6-5b74-4233-af2f-156bee576254 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:14.862841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552e86d6-5b74-4233-af2f-156bee576254 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:14.864597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552e86d6-5b74-4233-af2f-156bee576254 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:14.962483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4d0c24f4-fc01-4743-afa6-a847a50bed54 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:14.977821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4d0c24f4-fc01-4743-afa6-a847a50bed54 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:14.987118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4d0c24f4-fc01-4743-afa6-a847a50bed54 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:14.995728 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4d0c24f4-fc01-4743-afa6-a847a50bed54 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1366 microversion: 2.57 time: 0.600096 Aug 03 02:18:14.996577 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2669/5217] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:14 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1366 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:18:15.505311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-552e86d6-5b74-4233-af2f-156bee576254 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:15.526128 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-552e86d6-5b74-4233-af2f-156bee576254 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1321 microversion: 2.1 time: 0.690095 Aug 03 02:18:15.544275 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2549/5218] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:14 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1321 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:16.025117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7d02054c-9283-43b0-9796-8ef6a5ea7fae tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:16.025744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7d02054c-9283-43b0-9796-8ef6a5ea7fae tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:16.047347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d02054c-9283-43b0-9796-8ef6a5ea7fae tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:16.056226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d02054c-9283-43b0-9796-8ef6a5ea7fae tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:16.057409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d02054c-9283-43b0-9796-8ef6a5ea7fae tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:16.064808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d02054c-9283-43b0-9796-8ef6a5ea7fae tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:16.501811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7d02054c-9283-43b0-9796-8ef6a5ea7fae tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:16.522185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7d02054c-9283-43b0-9796-8ef6a5ea7fae tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:16.526743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7d02054c-9283-43b0-9796-8ef6a5ea7fae tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:16.534005 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7d02054c-9283-43b0-9796-8ef6a5ea7fae tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1372 microversion: 2.57 time: 0.512355 Aug 03 02:18:16.539784 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2670/5219] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:16 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1372 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 02:18:16.550712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a2b5b8bf-e77a-40fd-a678-01915a2d6791 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:16.552516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a2b5b8bf-e77a-40fd-a678-01915a2d6791 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:16.571617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2b5b8bf-e77a-40fd-a678-01915a2d6791 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:16.572370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2b5b8bf-e77a-40fd-a678-01915a2d6791 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:16.573203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2b5b8bf-e77a-40fd-a678-01915a2d6791 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:16.573647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2b5b8bf-e77a-40fd-a678-01915a2d6791 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:17.118617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a2b5b8bf-e77a-40fd-a678-01915a2d6791 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:17.130082 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a2b5b8bf-e77a-40fd-a678-01915a2d6791 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1321 microversion: 2.1 time: 0.584706 Aug 03 02:18:17.145611 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2550/5220] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:16 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1321 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:17.567020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f2c1282b-0d69-4dec-bcbf-92f4c9fe1021 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:17.573602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f2c1282b-0d69-4dec-bcbf-92f4c9fe1021 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:17.603167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f2c1282b-0d69-4dec-bcbf-92f4c9fe1021 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:17.603576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f2c1282b-0d69-4dec-bcbf-92f4c9fe1021 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:17.617369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f2c1282b-0d69-4dec-bcbf-92f4c9fe1021 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:17.621315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f2c1282b-0d69-4dec-bcbf-92f4c9fe1021 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:17.869351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f2c1282b-0d69-4dec-bcbf-92f4c9fe1021 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:17.914349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f2c1282b-0d69-4dec-bcbf-92f4c9fe1021 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:17.924306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f2c1282b-0d69-4dec-bcbf-92f4c9fe1021 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:17.929561 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f2c1282b-0d69-4dec-bcbf-92f4c9fe1021 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1372 microversion: 2.57 time: 0.366653 Aug 03 02:18:17.949572 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2671/5221] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:17 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1372 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:18:18.166364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-95c93947-bc95-449e-aec8-148cac42034e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:18.168063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-95c93947-bc95-449e-aec8-148cac42034e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:18.181033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95c93947-bc95-449e-aec8-148cac42034e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:18.181857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95c93947-bc95-449e-aec8-148cac42034e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:18.187306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95c93947-bc95-449e-aec8-148cac42034e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:18.188432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95c93947-bc95-449e-aec8-148cac42034e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:18.194297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:18.992776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-61b98046-5787-49ce-bd65-824a87df64de tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:18.993939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-61b98046-5787-49ce-bd65-824a87df64de tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:19.005493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61b98046-5787-49ce-bd65-824a87df64de tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:19.006156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61b98046-5787-49ce-bd65-824a87df64de tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:19.007189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61b98046-5787-49ce-bd65-824a87df64de tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:19.019177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-61b98046-5787-49ce-bd65-824a87df64de tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:19.074439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-95c93947-bc95-449e-aec8-148cac42034e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:19.095614 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-95c93947-bc95-449e-aec8-148cac42034e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1321 microversion: 2.1 time: 0.925750 Aug 03 02:18:19.097442 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2551/5222] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:18 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1321 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:19.392420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-61b98046-5787-49ce-bd65-824a87df64de tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:19.404364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-61b98046-5787-49ce-bd65-824a87df64de tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:19.412746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-61b98046-5787-49ce-bd65-824a87df64de tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:19.414295 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-61b98046-5787-49ce-bd65-824a87df64de tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1357 microversion: 2.57 time: 0.428232 Aug 03 02:18:19.416472 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2672/5223] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:18 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1357 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:18:19.449819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-86ccd392-bd2c-444d-a0b8-79efbcbcdeb1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:19.452382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-86ccd392-bd2c-444d-a0b8-79efbcbcdeb1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:19.470276 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86ccd392-bd2c-444d-a0b8-79efbcbcdeb1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:19.470792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86ccd392-bd2c-444d-a0b8-79efbcbcdeb1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:19.472443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86ccd392-bd2c-444d-a0b8-79efbcbcdeb1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:19.472988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-86ccd392-bd2c-444d-a0b8-79efbcbcdeb1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:19.548955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-86ccd392-bd2c-444d-a0b8-79efbcbcdeb1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:18:19.687737 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-86ccd392-bd2c-444d-a0b8-79efbcbcdeb1 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 204 len: 0 microversion: 2.57 time: 0.242078 Aug 03 02:18:19.689495 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2552/5224] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 3 02:18:19 2022] DELETE /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 02:18:19.702549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2e9efb47-731d-47e6-9079-b4812b8c1ef6 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:19.702549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2e9efb47-731d-47e6-9079-b4812b8c1ef6 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:19.722997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e9efb47-731d-47e6-9079-b4812b8c1ef6 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:19.725035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e9efb47-731d-47e6-9079-b4812b8c1ef6 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:19.725035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e9efb47-731d-47e6-9079-b4812b8c1ef6 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:19.725498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e9efb47-731d-47e6-9079-b4812b8c1ef6 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:19.988569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2e9efb47-731d-47e6-9079-b4812b8c1ef6 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:20.001729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2e9efb47-731d-47e6-9079-b4812b8c1ef6 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:20.012175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2e9efb47-731d-47e6-9079-b4812b8c1ef6 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:20.014980 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2e9efb47-731d-47e6-9079-b4812b8c1ef6 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1363 microversion: 2.57 time: 0.320218 Aug 03 02:18:20.016411 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2673/5225] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:19 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:18:20.122459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2745d7e3-850d-4b5a-9e77-93dae46bf60f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:20.123760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2745d7e3-850d-4b5a-9e77-93dae46bf60f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:20.135525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2745d7e3-850d-4b5a-9e77-93dae46bf60f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:20.135779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2745d7e3-850d-4b5a-9e77-93dae46bf60f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:20.136475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2745d7e3-850d-4b5a-9e77-93dae46bf60f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:20.136927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2745d7e3-850d-4b5a-9e77-93dae46bf60f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:20.187714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7cbe814b-855a-42d6-871c-2c37afb5562c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '.version_select at 0x7f5b129409d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:20.235925 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7cbe814b-855a-42d6-871c-2c37afb5562c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-312773581" status: 202 len: 0 microversion: 2.1 time: 0.053113 Aug 03 02:18:20.236857 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2674/5226] 10.222.0.67 () {58 vars in 1281 bytes} [Wed Aug 3 02:18:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-312773581 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 02:18:20.282925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f2bd09ef-d26c-4249-bfd3-280018e46df7 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'create', calling method: .version_select at 0x7f5b1255cdc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1619238817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk84CZZ9UCSvYk34brFRCcaskRBimQCMQxhg0YOlLT4mBDDOLc1qPpzYh/yBOz2vkJ1PDy+k+qNDma7VvhlNIVPba5agWEzPix8pRJYRZyHhayVIJUJPAVtE3naZfMbow=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:20.322023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-f2bd09ef-d26c-4249-bfd3-280018e46df7 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for project f6179959e78b438cb68680f694190a8c. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:18:20.339425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-f2bd09ef-d26c-4249-bfd3-280018e46df7 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for user adca21bc340d440e91e4d856a625cd3a and project f6179959e78b438cb68680f694190a8c. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:18:20.395409 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f2bd09ef-d26c-4249-bfd3-280018e46df7 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.116513 Aug 03 02:18:20.396543 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2675/5227] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:18:20 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:18:20.532715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-1f51c389-ffba-442f-a79b-b2f580d58f51 req-55a6a47d-6e9b-453d-8d3d-50183d784f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334229c5-e563-4c00-bccd-90b703d542d9", "name": "network-vif-plugged", "status": "completed", "tag": "9ca601fb-8136-46c2-9f4f-e88601950fe0"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:20.565778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1f51c389-ffba-442f-a79b-b2f580d58f51 req-55a6a47d-6e9b-453d-8d3d-50183d784f0c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:20.571942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1f51c389-ffba-442f-a79b-b2f580d58f51 req-55a6a47d-6e9b-453d-8d3d-50183d784f0c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:20.598612 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-1f51c389-ffba-442f-a79b-b2f580d58f51 req-55a6a47d-6e9b-453d-8d3d-50183d784f0c service nova] Creating event network-vif-plugged:9ca601fb-8136-46c2-9f4f-e88601950fe0 for instance 334229c5-e563-4c00-bccd-90b703d542d9 on n-h1-826529-8 Aug 03 02:18:20.608625 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-1f51c389-ffba-442f-a79b-b2f580d58f51 req-55a6a47d-6e9b-453d-8d3d-50183d784f0c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080820 Aug 03 02:18:20.610390 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2676/5228] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:18:20.737874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2745d7e3-850d-4b5a-9e77-93dae46bf60f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:20.777702 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2745d7e3-850d-4b5a-9e77-93dae46bf60f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1321 microversion: 2.1 time: 0.659621 Aug 03 02:18:20.786647 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2553/5229] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:20 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1321 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:21.051233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c1644c74-8541-4d53-be3c-3808373fc9e4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:21.053462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c1644c74-8541-4d53-be3c-3808373fc9e4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:21.069999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1644c74-8541-4d53-be3c-3808373fc9e4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:21.074363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1644c74-8541-4d53-be3c-3808373fc9e4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:21.076796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1644c74-8541-4d53-be3c-3808373fc9e4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:21.079081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1644c74-8541-4d53-be3c-3808373fc9e4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:21.302533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c1644c74-8541-4d53-be3c-3808373fc9e4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:21.321712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c1644c74-8541-4d53-be3c-3808373fc9e4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:21.326653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c1644c74-8541-4d53-be3c-3808373fc9e4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:21.329132 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c1644c74-8541-4d53-be3c-3808373fc9e4 tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1363 microversion: 2.57 time: 0.293577 Aug 03 02:18:21.334696 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2677/5230] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:21 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:18:21.809411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-22aba2c7-4202-42d9-aa71-2d1b22459951 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:21.811050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-22aba2c7-4202-42d9-aa71-2d1b22459951 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:21.830284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22aba2c7-4202-42d9-aa71-2d1b22459951 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:21.831534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22aba2c7-4202-42d9-aa71-2d1b22459951 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:21.834577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22aba2c7-4202-42d9-aa71-2d1b22459951 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:21.837077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22aba2c7-4202-42d9-aa71-2d1b22459951 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:22.359658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-80ad1a51-c776-4024-bf28-723c6a17b5aa tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:22.360976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-80ad1a51-c776-4024-bf28-723c6a17b5aa tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:22.383789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80ad1a51-c776-4024-bf28-723c6a17b5aa tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:22.393735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80ad1a51-c776-4024-bf28-723c6a17b5aa tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:22.407312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80ad1a51-c776-4024-bf28-723c6a17b5aa tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:22.407762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80ad1a51-c776-4024-bf28-723c6a17b5aa tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:23.251115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-80ad1a51-c776-4024-bf28-723c6a17b5aa tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:23.262782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-80ad1a51-c776-4024-bf28-723c6a17b5aa tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:23.268032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-80ad1a51-c776-4024-bf28-723c6a17b5aa tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '34af06f891864dc39aa62000f73afe64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b2348fca424ab09f5962d15a9bd831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:23.275037 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-80ad1a51-c776-4024-bf28-723c6a17b5aa tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 200 len: 1363 microversion: 2.57 time: 0.921247 Aug 03 02:18:23.275840 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2678/5231] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:22 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 1363 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 02:18:23.289333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-fa041952-266f-4ad5-aa0e-c16bc5683856 req-5e27d57b-49b1-45e0-9f91-f153d1ee718a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51f27ee-4c64-44a6-b46b-da2c369aacd0", "name": "network-vif-plugged", "status": "completed", "tag": "f1186d59-0d81-4562-8183-90c576b9c232"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:23.303201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-22aba2c7-4202-42d9-aa71-2d1b22459951 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:23.322877 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-22aba2c7-4202-42d9-aa71-2d1b22459951 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1321 microversion: 2.1 time: 1.518169 Aug 03 02:18:23.324066 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2554/5232] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:21 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1321 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:23.340104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-fa041952-266f-4ad5-aa0e-c16bc5683856 req-5e27d57b-49b1-45e0-9f91-f153d1ee718a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:23.340850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-fa041952-266f-4ad5-aa0e-c16bc5683856 req-5e27d57b-49b1-45e0-9f91-f153d1ee718a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:23.353940 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-fa041952-266f-4ad5-aa0e-c16bc5683856 req-5e27d57b-49b1-45e0-9f91-f153d1ee718a service nova] Creating event network-vif-plugged:f1186d59-0d81-4562-8183-90c576b9c232 for instance d51f27ee-4c64-44a6-b46b-da2c369aacd0 on n-h1-826529-8 Aug 03 02:18:23.361122 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-fa041952-266f-4ad5-aa0e-c16bc5683856 req-5e27d57b-49b1-45e0-9f91-f153d1ee718a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083739 Aug 03 02:18:23.363998 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2679/5233] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:18:24.304734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-80e0c298-1e7e-4dc8-bde8-da52e96b240a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:24.306154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-80e0c298-1e7e-4dc8-bde8-da52e96b240a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] [instance: d6030557-9cf7-4c91-bcb2-572aa8def57d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:24.325939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80e0c298-1e7e-4dc8-bde8-da52e96b240a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:24.331960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80e0c298-1e7e-4dc8-bde8-da52e96b240a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:24.337539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80e0c298-1e7e-4dc8-bde8-da52e96b240a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:24.338138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80e0c298-1e7e-4dc8-bde8-da52e96b240a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:24.346487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-90d5d220-095e-493b-a729-73735d3a6b3b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:24.347440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-90d5d220-095e-493b-a729-73735d3a6b3b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:24.360854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90d5d220-095e-493b-a729-73735d3a6b3b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:24.380003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90d5d220-095e-493b-a729-73735d3a6b3b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:24.382932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90d5d220-095e-493b-a729-73735d3a6b3b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:24.384909 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90d5d220-095e-493b-a729-73735d3a6b3b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:24.449766 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-80e0c298-1e7e-4dc8-bde8-da52e96b240a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] HTTP exception thrown: Instance d6030557-9cf7-4c91-bcb2-572aa8def57d could not be found. Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-80e0c298-1e7e-4dc8-bde8-da52e96b240a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Request method failure captured: Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d HTTP/1.1 Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dq_eIx6TLs3NEhSaM_peuEfku9-wAydgwcG7Cd2HlAN21nRVjSR4N6Xlo7O8JFqJrhYzDs9NP2ObPgA3VpCsEraolCay1R3HgQXait7Yed9UM6zbauhPIuAbjKdOkSw29FiMfjUWh-jdWRUYZKnmrgH0UTgtYX7lB3mmScjmAtZk24 Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Openstack-Nova-Api-Version: 2.57 Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 73b2348fca424ab09f5962d15a9bd831 Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerShowV257Test-1823966258 Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_73b2348fca424ab09f5962d15a9bd831", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/73b2348fca424ab09f5962d15a9bd831"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/73b2348fca424ab09f5962d15a9bd831"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/73b2348fca424ab09f5962d15a9bd831"}]}] Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerShowV257Test-1823966258 Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 73b2348fca424ab09f5962d15a9bd831 Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerShowV257Test-1823966258 Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerShowV257Test-1823966258-project Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 34af06f891864dc39aa62000f73afe64 Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerShowV257Test-1823966258-project Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance d6030557-9cf7-4c91-bcb2-572aa8def57d could not be found. Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'd6030557-9cf7-4c91-bcb2-572aa8def57d'} Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6030557-9cf7-4c91-bcb2-572aa8def57d could not be found. Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6030557-9cf7-4c91-bcb2-572aa8def57d could not be found. Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:18:24.456994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:18:24.463156 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:18:24.463156 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:18:24.463156 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:18:24.463156 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:18:24.463156 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:18:24.463156 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6030557-9cf7-4c91-bcb2-572aa8def57d could not be found. Aug 03 02:18:24.463156 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:18:24.463156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-80e0c298-1e7e-4dc8-bde8-da52e96b240a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] Returning 404 to user: Instance d6030557-9cf7-4c91-bcb2-572aa8def57d could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:18:24.463156 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-80e0c298-1e7e-4dc8-bde8-da52e96b240a tempest-ServerShowV257Test-1823966258 tempest-ServerShowV257Test-1823966258-project] 10.222.0.67 "GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d" status: 404 len: 111 microversion: 2.57 time: 0.159904 Aug 03 02:18:24.464804 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2555/5234] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 3 02:18:24 2022] GET /compute/v2.1/servers/d6030557-9cf7-4c91-bcb2-572aa8def57d => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:18:25.113787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-90d5d220-095e-493b-a729-73735d3a6b3b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:25.130404 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-90d5d220-095e-493b-a729-73735d3a6b3b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1321 microversion: 2.1 time: 0.788761 Aug 03 02:18:25.134599 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2680/5235] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:24 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1321 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:18:25.617530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-66dd58db-cb5d-4f46-8ba2-922096a1edbb req-7251adc7-d44e-45b9-8ce8-128240599240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c00b72-7f8e-4c03-85a2-2b2daa80bbc7", "name": "network-vif-plugged", "status": "completed", "tag": "585f12bf-d0be-4ebb-bc4f-fae943b4351f"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:25.637285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-66dd58db-cb5d-4f46-8ba2-922096a1edbb req-7251adc7-d44e-45b9-8ce8-128240599240 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:25.637778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-66dd58db-cb5d-4f46-8ba2-922096a1edbb req-7251adc7-d44e-45b9-8ce8-128240599240 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:25.673537 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-66dd58db-cb5d-4f46-8ba2-922096a1edbb req-7251adc7-d44e-45b9-8ce8-128240599240 service nova] Creating event network-vif-plugged:585f12bf-d0be-4ebb-bc4f-fae943b4351f for instance 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 on n-h2-826529-8 Aug 03 02:18:25.685871 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-66dd58db-cb5d-4f46-8ba2-922096a1edbb req-7251adc7-d44e-45b9-8ce8-128240599240 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071941 Aug 03 02:18:25.706052 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2556/5236] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:18:26.160450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4e00cd7e-f991-4930-9e18-9a6084d91771 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:26.161075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4e00cd7e-f991-4930-9e18-9a6084d91771 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:26.178505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e00cd7e-f991-4930-9e18-9a6084d91771 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:26.178997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e00cd7e-f991-4930-9e18-9a6084d91771 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:26.179794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e00cd7e-f991-4930-9e18-9a6084d91771 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:26.180234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4e00cd7e-f991-4930-9e18-9a6084d91771 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:27.097411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4e00cd7e-f991-4930-9e18-9a6084d91771 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:27.122017 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4e00cd7e-f991-4930-9e18-9a6084d91771 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1321 microversion: 2.1 time: 0.965359 Aug 03 02:18:27.123954 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2681/5237] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:26 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1321 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:18:28.149548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b0d7da92-7c16-43b8-a4a6-b198a849c626 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:28.150490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b0d7da92-7c16-43b8-a4a6-b198a849c626 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:28.164446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:28.168853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0d7da92-7c16-43b8-a4a6-b198a849c626 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:28.169870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0d7da92-7c16-43b8-a4a6-b198a849c626 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:28.177142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0d7da92-7c16-43b8-a4a6-b198a849c626 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:28.178140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b0d7da92-7c16-43b8-a4a6-b198a849c626 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:28.645934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b0d7da92-7c16-43b8-a4a6-b198a849c626 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:28.657921 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b0d7da92-7c16-43b8-a4a6-b198a849c626 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1513 microversion: 2.1 time: 0.516079 Aug 03 02:18:28.659120 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2557/5238] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:28 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1513 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:28.687907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cb6ad89a-b54d-4a73-8233-68036b2623d5 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:28.688700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cb6ad89a-b54d-4a73-8233-68036b2623d5 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:28.708841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:28.713069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cb6ad89a-b54d-4a73-8233-68036b2623d5 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:28.715798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cb6ad89a-b54d-4a73-8233-68036b2623d5 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:28.717620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cb6ad89a-b54d-4a73-8233-68036b2623d5 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:28.720113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cb6ad89a-b54d-4a73-8233-68036b2623d5 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:29.015113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cb6ad89a-b54d-4a73-8233-68036b2623d5 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:29.050645 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cb6ad89a-b54d-4a73-8233-68036b2623d5 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1511 microversion: 2.1 time: 0.369241 Aug 03 02:18:29.053983 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2682/5239] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:28 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1511 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:29.073797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-65491c16-cfe2-487d-b885-9b544678bcbc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:29.074744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-65491c16-cfe2-487d-b885-9b544678bcbc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: d51f27ee-4c64-44a6-b46b-da2c369aacd0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:29.087103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65491c16-cfe2-487d-b885-9b544678bcbc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:29.087899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65491c16-cfe2-487d-b885-9b544678bcbc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:29.090628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65491c16-cfe2-487d-b885-9b544678bcbc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:29.092019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65491c16-cfe2-487d-b885-9b544678bcbc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:29.114796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25876b24-65a1-47b1-8e44-4c64cb4bfca7 tempest-ExtensionsTest-2050443973 tempest-ExtensionsTest-2050443973-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:29.117667 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-25876b24-65a1-47b1-8e44-4c64cb4bfca7 tempest-ExtensionsTest-2050443973 tempest-ExtensionsTest-2050443973-project] 10.222.0.67 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.258309 Aug 03 02:18:29.118814 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2558/5240] 10.222.0.67 () {58 vars in 1170 bytes} [Wed Aug 3 02:18:28 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:18:29.130536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f8968414-38e6-4de2-bcda-d2dc7613198e tempest-ExtensionsTest-2050443973 tempest-ExtensionsTest-2050443973-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:29.133505 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f8968414-38e6-4de2-bcda-d2dc7613198e tempest-ExtensionsTest-2050443973 tempest-ExtensionsTest-2050443973-project] 10.222.0.67 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.009619 Aug 03 02:18:29.134723 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2559/5241] 10.222.0.67 () {58 vars in 1134 bytes} [Wed Aug 3 02:18:29 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:18:29.338473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-65491c16-cfe2-487d-b885-9b544678bcbc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:29.349609 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-65491c16-cfe2-487d-b885-9b544678bcbc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0" status: 200 len: 1512 microversion: 2.1 time: 0.279898 Aug 03 02:18:29.350821 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2683/5242] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:29 2022] GET /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0 => generated 1512 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:29.375662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6ae72878-c980-4989-8af1-7ed88affa366 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:29.386176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6ae72878-c980-4989-8af1-7ed88affa366 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:29.387597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6ae72878-c980-4989-8af1-7ed88affa366 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:18:29.431576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ae72878-c980-4989-8af1-7ed88affa366 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:29.434066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ae72878-c980-4989-8af1-7ed88affa366 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:29.435923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ae72878-c980-4989-8af1-7ed88affa366 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:29.437152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ae72878-c980-4989-8af1-7ed88affa366 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:29.663518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-6ae72878-c980-4989-8af1-7ed88affa366 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:18:29.805676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6ae72878-c980-4989-8af1-7ed88affa366 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:29.814482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ae72878-c980-4989-8af1-7ed88affa366 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:29.815230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ae72878-c980-4989-8af1-7ed88affa366 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:30.035976 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6ae72878-c980-4989-8af1-7ed88affa366 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.665550 Aug 03 02:18:30.036584 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2560/5243] 10.222.0.67 () {58 vars in 1167 bytes} [Wed Aug 3 02:18:29 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:30.063410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3186f297-59ba-488e-96e5-a8d535c3d006 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:30.072272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3186f297-59ba-488e-96e5-a8d535c3d006 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:30.073733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3186f297-59ba-488e-96e5-a8d535c3d006 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-283048725', 'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:18:30.082072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3186f297-59ba-488e-96e5-a8d535c3d006 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:30.082893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3186f297-59ba-488e-96e5-a8d535c3d006 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:30.083958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3186f297-59ba-488e-96e5-a8d535c3d006 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:30.084692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3186f297-59ba-488e-96e5-a8d535c3d006 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:30.297631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-3186f297-59ba-488e-96e5-a8d535c3d006 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:18:30.357033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:30.515141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3186f297-59ba-488e-96e5-a8d535c3d006 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:30.524497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3186f297-59ba-488e-96e5-a8d535c3d006 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:30.524958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3186f297-59ba-488e-96e5-a8d535c3d006 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:30.834545 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3186f297-59ba-488e-96e5-a8d535c3d006 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-283048725" status: 200 len: 1514 microversion: 2.1 time: 0.776532 Aug 03 02:18:30.837068 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2684/5244] 10.222.0.67 () {58 vars in 1261 bytes} [Wed Aug 3 02:18:30 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-283048725 => generated 1514 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:18:30.868837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f28c6796-ad02-4211-8106-d7cff55e094b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:30.873962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f28c6796-ad02-4211-8106-d7cff55e094b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:30.874819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f28c6796-ad02-4211-8106-d7cff55e094b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:18:30.886185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f28c6796-ad02-4211-8106-d7cff55e094b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:30.886834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f28c6796-ad02-4211-8106-d7cff55e094b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:30.887513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f28c6796-ad02-4211-8106-d7cff55e094b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:30.890735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f28c6796-ad02-4211-8106-d7cff55e094b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:31.030552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-f28c6796-ad02-4211-8106-d7cff55e094b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:18:31.229106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f28c6796-ad02-4211-8106-d7cff55e094b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:31.272664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f28c6796-ad02-4211-8106-d7cff55e094b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:31.276723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f28c6796-ad02-4211-8106-d7cff55e094b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:31.596720 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f28c6796-ad02-4211-8106-d7cff55e094b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.736382 Aug 03 02:18:31.597335 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2561/5245] 10.222.0.67 () {58 vars in 1173 bytes} [Wed Aug 3 02:18:30 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:31.634111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c4a6246e-3c1c-4d4b-81f2-db49169e0464 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:31.649398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c4a6246e-3c1c-4d4b-81f2-db49169e0464 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:31.649884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.compute.servers [None req-c4a6246e-3c1c-4d4b-81f2-db49169e0464 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Removing options 'limit' from query {{(pid=125941) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 03 02:18:31.650661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c4a6246e-3c1c-4d4b-81f2-db49169e0464 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:18:31.674347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a6246e-3c1c-4d4b-81f2-db49169e0464 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:31.674806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a6246e-3c1c-4d4b-81f2-db49169e0464 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:31.675661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a6246e-3c1c-4d4b-81f2-db49169e0464 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:31.676135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a6246e-3c1c-4d4b-81f2-db49169e0464 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:31.793513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c4a6246e-3c1c-4d4b-81f2-db49169e0464 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:31.825718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a6246e-3c1c-4d4b-81f2-db49169e0464 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:31.827793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a6246e-3c1c-4d4b-81f2-db49169e0464 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:32.140360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-245335982", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:32.204347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] validate_networks() for [('e9abcdb9-8f1c-4817-860f-de5d48418323', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:18:32.323339 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c4a6246e-3c1c-4d4b-81f2-db49169e0464 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.699711 Aug 03 02:18:32.324538 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2685/5246] 10.222.0.67 () {58 vars in 1161 bytes} [Wed Aug 3 02:18:31 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:18:32.348843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5a762d9e-4109-4815-aab4-f6afacca0f91 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:32.359743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5a762d9e-4109-4815-aab4-f6afacca0f91 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:32.360509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5a762d9e-4109-4815-aab4-f6afacca0f91 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:18:32.381439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a762d9e-4109-4815-aab4-f6afacca0f91 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:32.381973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a762d9e-4109-4815-aab4-f6afacca0f91 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:32.382897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a762d9e-4109-4815-aab4-f6afacca0f91 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:32.383370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a762d9e-4109-4815-aab4-f6afacca0f91 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:32.441875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:32.463705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-5a762d9e-4109-4815-aab4-f6afacca0f91 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:18:32.533761 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5a762d9e-4109-4815-aab4-f6afacca0f91 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.180881 Aug 03 02:18:32.544951 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2686/5247] 10.222.0.67 () {58 vars in 1152 bytes} [Wed Aug 3 02:18:32 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:18:32.551055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3793863e-5aac-4abf-ac24-af3f1827cdb1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:32.560922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3793863e-5aac-4abf-ac24-af3f1827cdb1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:32.566422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.compute.servers [None req-3793863e-5aac-4abf-ac24-af3f1827cdb1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Removing options 'limit' from query {{(pid=125941) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 03 02:18:32.567370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3793863e-5aac-4abf-ac24-af3f1827cdb1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:18:32.576491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3793863e-5aac-4abf-ac24-af3f1827cdb1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:32.577323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3793863e-5aac-4abf-ac24-af3f1827cdb1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:32.578422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3793863e-5aac-4abf-ac24-af3f1827cdb1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:32.579140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3793863e-5aac-4abf-ac24-af3f1827cdb1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:32.620489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-3793863e-5aac-4abf-ac24-af3f1827cdb1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:18:32.695366 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3793863e-5aac-4abf-ac24-af3f1827cdb1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.148714 Aug 03 02:18:32.705286 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2687/5248] 10.222.0.67 () {58 vars in 1150 bytes} [Wed Aug 3 02:18:32 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:32.711426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f9037a94-7b4b-4c99-9488-ca6092604239 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:32.722010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f9037a94-7b4b-4c99-9488-ca6092604239 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:32.723026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f9037a94-7b4b-4c99-9488-ca6092604239 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:18:32.734474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9037a94-7b4b-4c99-9488-ca6092604239 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:32.734974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9037a94-7b4b-4c99-9488-ca6092604239 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:32.735815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9037a94-7b4b-4c99-9488-ca6092604239 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:32.736268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9037a94-7b4b-4c99-9488-ca6092604239 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:32.807640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-f9037a94-7b4b-4c99-9488-ca6092604239 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:18:32.888121 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f9037a94-7b4b-4c99-9488-ca6092604239 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.175017 Aug 03 02:18:32.888839 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2688/5249] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 3 02:18:32 2022] GET /compute/v2.1/servers => generated 1011 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:32.902293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4d10199d-000b-4f90-98ce-44aec3e90097 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:32.922215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4d10199d-000b-4f90-98ce-44aec3e90097 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:32.922799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4d10199d-000b-4f90-98ce-44aec3e90097 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:18:32.953883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d10199d-000b-4f90-98ce-44aec3e90097 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:32.955954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d10199d-000b-4f90-98ce-44aec3e90097 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:32.957786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d10199d-000b-4f90-98ce-44aec3e90097 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:32.960055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d10199d-000b-4f90-98ce-44aec3e90097 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:33.067669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:18:33.076902 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:18:33.077588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:18:33.080924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:18:33.083789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:18:33.119202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:33.130146 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:33.131129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:33.131561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:33.158656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-4d10199d-000b-4f90-98ce-44aec3e90097 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:18:33.192369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Getting quotas for project b4e00bbd702c4262ae98540dbc2c2440. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:18:33.209027 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Getting quotas for user 20d3a802377f42d5b23e38a4bb19584e and project b4e00bbd702c4262ae98540dbc2c2440. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:18:33.247395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:18:33.250215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:18:33.273743 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4d10199d-000b-4f90-98ce-44aec3e90097 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.375443 Aug 03 02:18:33.284086 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2689/5250] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 02:18:32 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:18:33.324433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fe06883e-e4c4-4b65-a1fe-1b64608fab92 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:33.335466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fe06883e-e4c4-4b65-a1fe-1b64608fab92 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:33.337820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.compute.servers [None req-fe06883e-e4c4-4b65-a1fe-1b64608fab92 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Removing options 'limit' from query {{(pid=125941) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 03 02:18:33.338543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fe06883e-e4c4-4b65-a1fe-1b64608fab92 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:18:33.349806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe06883e-e4c4-4b65-a1fe-1b64608fab92 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:33.350558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe06883e-e4c4-4b65-a1fe-1b64608fab92 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:33.351648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe06883e-e4c4-4b65-a1fe-1b64608fab92 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:33.352320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe06883e-e4c4-4b65-a1fe-1b64608fab92 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:33.392888 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fe06883e-e4c4-4b65-a1fe-1b64608fab92 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.106415 Aug 03 02:18:33.393876 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2690/5251] 10.222.0.67 () {58 vars in 1140 bytes} [Wed Aug 3 02:18:33 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:18:33.408870 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c0326891-265c-4810-b2be-7d7d21a274da tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:33.425466 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9c65252b-b11f-4024-9aa9-59b38e537c7f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.776118 Aug 03 02:18:33.427024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c0326891-265c-4810-b2be-7d7d21a274da tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:33.433439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c0326891-265c-4810-b2be-7d7d21a274da tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-283048725', 'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:18:33.436255 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2562/5252] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:18:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 02:18:33.441554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0326891-265c-4810-b2be-7d7d21a274da tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:33.442016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0326891-265c-4810-b2be-7d7d21a274da tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:33.442841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0326891-265c-4810-b2be-7d7d21a274da tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:33.449786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-417c1e1a-58b2-489e-ae1c-38c620be97dc tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:33.450743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-417c1e1a-58b2-489e-ae1c-38c620be97dc tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:33.452137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0326891-265c-4810-b2be-7d7d21a274da tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:33.637192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-c0326891-265c-4810-b2be-7d7d21a274da tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:18:33.669662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-417c1e1a-58b2-489e-ae1c-38c620be97dc tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:33.681865 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-417c1e1a-58b2-489e-ae1c-38c620be97dc tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1222 microversion: 2.1 time: 0.244222 Aug 03 02:18:33.684273 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2563/5253] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:33 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1222 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:33.767732 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c0326891-265c-4810-b2be-7d7d21a274da tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-283048725" status: 200 len: 345 microversion: 2.1 time: 0.364854 Aug 03 02:18:33.778836 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2691/5254] 10.222.0.67 () {58 vars in 1240 bytes} [Wed Aug 3 02:18:33 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-283048725 => generated 345 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:18:33.783698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9ad53321-7e49-49b9-9264-ac473bc96510 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:33.796323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9ad53321-7e49-49b9-9264-ac473bc96510 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:33.796781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9ad53321-7e49-49b9-9264-ac473bc96510 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:33.859428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9ad53321-7e49-49b9-9264-ac473bc96510 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Going to try to stop instance {{(pid=125942) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 02:18:33.974139 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9ad53321-7e49-49b9-9264-ac473bc96510 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "POST /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9/action" status: 202 len: 0 microversion: 2.1 time: 0.195914 Aug 03 02:18:33.975204 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2564/5255] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:18:33 2022] POST /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:18:33.989061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b112a065-3e0d-4de4-9c78-2e5bed58f26b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:33.989692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b112a065-3e0d-4de4-9c78-2e5bed58f26b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:34.020026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b112a065-3e0d-4de4-9c78-2e5bed58f26b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:34.020492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b112a065-3e0d-4de4-9c78-2e5bed58f26b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:34.027545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b112a065-3e0d-4de4-9c78-2e5bed58f26b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:34.033055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b112a065-3e0d-4de4-9c78-2e5bed58f26b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:34.370237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b112a065-3e0d-4de4-9c78-2e5bed58f26b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:34.382653 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b112a065-3e0d-4de4-9c78-2e5bed58f26b tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1521 microversion: 2.1 time: 0.400947 Aug 03 02:18:34.383289 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2692/5256] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:33 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:34.712897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8761ba45-2c8e-465a-8bf6-b6deae785187 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:34.713753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8761ba45-2c8e-465a-8bf6-b6deae785187 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:34.804247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8761ba45-2c8e-465a-8bf6-b6deae785187 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:34.807315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8761ba45-2c8e-465a-8bf6-b6deae785187 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:34.817413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8761ba45-2c8e-465a-8bf6-b6deae785187 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:34.821299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8761ba45-2c8e-465a-8bf6-b6deae785187 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:35.405345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4d3f49a-2e17-4cb2-a759-afbd0002efd6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:35.406080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f4d3f49a-2e17-4cb2-a759-afbd0002efd6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:35.432502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4d3f49a-2e17-4cb2-a759-afbd0002efd6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:35.433888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4d3f49a-2e17-4cb2-a759-afbd0002efd6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:35.435946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4d3f49a-2e17-4cb2-a759-afbd0002efd6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:35.439165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4d3f49a-2e17-4cb2-a759-afbd0002efd6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:35.857538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8761ba45-2c8e-465a-8bf6-b6deae785187 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:35.874805 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8761ba45-2c8e-465a-8bf6-b6deae785187 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1218 microversion: 2.1 time: 1.174325 Aug 03 02:18:35.883612 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2565/5257] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:34 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1218 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:36.155189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f4d3f49a-2e17-4cb2-a759-afbd0002efd6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:36.172226 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f4d3f49a-2e17-4cb2-a759-afbd0002efd6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1521 microversion: 2.1 time: 0.763198 Aug 03 02:18:36.172941 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2693/5258] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:35 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1521 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:18:36.908224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-348c48ee-fc45-470d-a9bc-77abeaf52dfa tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:36.909084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-348c48ee-fc45-470d-a9bc-77abeaf52dfa tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:36.923996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-348c48ee-fc45-470d-a9bc-77abeaf52dfa tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:36.924834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-348c48ee-fc45-470d-a9bc-77abeaf52dfa tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:36.938087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-348c48ee-fc45-470d-a9bc-77abeaf52dfa tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:36.938849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-348c48ee-fc45-470d-a9bc-77abeaf52dfa tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:37.196979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed2294da-90c8-4013-b3b4-90f9d09b6fba tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:37.198402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ed2294da-90c8-4013-b3b4-90f9d09b6fba tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:37.213178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed2294da-90c8-4013-b3b4-90f9d09b6fba tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:37.218721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed2294da-90c8-4013-b3b4-90f9d09b6fba tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:37.219672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed2294da-90c8-4013-b3b4-90f9d09b6fba tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:37.220130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed2294da-90c8-4013-b3b4-90f9d09b6fba tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:37.278656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-348c48ee-fc45-470d-a9bc-77abeaf52dfa tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:37.286646 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-348c48ee-fc45-470d-a9bc-77abeaf52dfa tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1280 microversion: 2.1 time: 0.382733 Aug 03 02:18:37.287283 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2566/5259] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:36 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1280 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:38.138373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ed2294da-90c8-4013-b3b4-90f9d09b6fba tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:38.156017 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed2294da-90c8-4013-b3b4-90f9d09b6fba tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1521 microversion: 2.1 time: 0.962847 Aug 03 02:18:38.157161 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2694/5260] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:37 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1521 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:18:38.313138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4519e6f7-e448-4698-a008-b4bda20710c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:38.313974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4519e6f7-e448-4698-a008-b4bda20710c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:38.329472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4519e6f7-e448-4698-a008-b4bda20710c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:38.329942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4519e6f7-e448-4698-a008-b4bda20710c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:38.330753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4519e6f7-e448-4698-a008-b4bda20710c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:38.334811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4519e6f7-e448-4698-a008-b4bda20710c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:38.949622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4519e6f7-e448-4698-a008-b4bda20710c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:38.967774 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4519e6f7-e448-4698-a008-b4bda20710c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1280 microversion: 2.1 time: 0.658504 Aug 03 02:18:38.982940 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2567/5261] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:38 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1280 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:39.179071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f9c95fc7-f93e-44ab-bd6c-68f22d484f60 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:39.179706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f9c95fc7-f93e-44ab-bd6c-68f22d484f60 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:39.198097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9c95fc7-f93e-44ab-bd6c-68f22d484f60 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:39.198576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9c95fc7-f93e-44ab-bd6c-68f22d484f60 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:39.199420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9c95fc7-f93e-44ab-bd6c-68f22d484f60 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:39.199873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9c95fc7-f93e-44ab-bd6c-68f22d484f60 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:39.976301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f9c95fc7-f93e-44ab-bd6c-68f22d484f60 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:39.991594 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f9c95fc7-f93e-44ab-bd6c-68f22d484f60 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1521 microversion: 2.1 time: 0.815938 Aug 03 02:18:40.001974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e04147e8-b048-4b99-b079-4ad00820cbdc tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:40.004941 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2695/5262] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:39 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1521 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:40.018224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e04147e8-b048-4b99-b079-4ad00820cbdc tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:40.064037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e04147e8-b048-4b99-b079-4ad00820cbdc tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:40.064037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e04147e8-b048-4b99-b079-4ad00820cbdc tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:40.064037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e04147e8-b048-4b99-b079-4ad00820cbdc tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:40.064037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e04147e8-b048-4b99-b079-4ad00820cbdc tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:40.551353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e04147e8-b048-4b99-b079-4ad00820cbdc tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:40.573237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:40.590418 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e04147e8-b048-4b99-b079-4ad00820cbdc tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1322 microversion: 2.1 time: 0.596338 Aug 03 02:18:40.594280 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2568/5263] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:39 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:18:41.024752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3ec31d38-865c-4ae7-8707-df8af95e95fc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:41.025946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3ec31d38-865c-4ae7-8707-df8af95e95fc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:41.042400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ec31d38-865c-4ae7-8707-df8af95e95fc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:41.042787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ec31d38-865c-4ae7-8707-df8af95e95fc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:41.043728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ec31d38-865c-4ae7-8707-df8af95e95fc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:41.044791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ec31d38-865c-4ae7-8707-df8af95e95fc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:41.612340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f7a5ed6b-0c25-4ac0-a20e-6296b04401cf tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:41.613076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f7a5ed6b-0c25-4ac0-a20e-6296b04401cf tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:41.630518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f7a5ed6b-0c25-4ac0-a20e-6296b04401cf tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:41.631106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f7a5ed6b-0c25-4ac0-a20e-6296b04401cf tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:41.631992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f7a5ed6b-0c25-4ac0-a20e-6296b04401cf tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:41.632509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f7a5ed6b-0c25-4ac0-a20e-6296b04401cf tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:41.789834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:42.012495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3ec31d38-865c-4ae7-8707-df8af95e95fc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:42.022726 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3ec31d38-865c-4ae7-8707-df8af95e95fc tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1521 microversion: 2.1 time: 1.003126 Aug 03 02:18:42.029710 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2696/5264] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:41 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1521 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:42.237678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f7a5ed6b-0c25-4ac0-a20e-6296b04401cf tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:42.247975 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f7a5ed6b-0c25-4ac0-a20e-6296b04401cf tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1322 microversion: 2.1 time: 0.639558 Aug 03 02:18:42.261844 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2569/5265] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:41 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1322 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:18:43.050366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-963c1c1d-226b-41c8-bae5-bb7a81abe948 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:43.051184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-963c1c1d-226b-41c8-bae5-bb7a81abe948 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:43.061649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-963c1c1d-226b-41c8-bae5-bb7a81abe948 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:43.063365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-963c1c1d-226b-41c8-bae5-bb7a81abe948 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:43.064337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-963c1c1d-226b-41c8-bae5-bb7a81abe948 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:43.067265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-963c1c1d-226b-41c8-bae5-bb7a81abe948 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:43.270499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-67cfcbe3-85cb-44df-9ac6-09ce3345d311 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:43.271337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-67cfcbe3-85cb-44df-9ac6-09ce3345d311 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:43.274562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:43.292231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67cfcbe3-85cb-44df-9ac6-09ce3345d311 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:43.293056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67cfcbe3-85cb-44df-9ac6-09ce3345d311 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:43.294167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67cfcbe3-85cb-44df-9ac6-09ce3345d311 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:43.295456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67cfcbe3-85cb-44df-9ac6-09ce3345d311 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:43.530081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=16 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:43.678713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=12 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:44.144063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-963c1c1d-226b-41c8-bae5-bb7a81abe948 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:44.159107 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-963c1c1d-226b-41c8-bae5-bb7a81abe948 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1521 microversion: 2.1 time: 1.112439 Aug 03 02:18:44.177245 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2697/5266] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:43 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1521 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:44.319479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-07e1076f-68b9-47a7-9f6d-899cc5eceab4 req-63dbdc90-d542-4773-ae09-ac994f6b30e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd", "tag": "bd81ca4e-3810-41d6-9cae-2ad76a762ddb"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:44.334330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-07e1076f-68b9-47a7-9f6d-899cc5eceab4 req-63dbdc90-d542-4773-ae09-ac994f6b30e6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:44.334778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-07e1076f-68b9-47a7-9f6d-899cc5eceab4 req-63dbdc90-d542-4773-ae09-ac994f6b30e6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:44.355554 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-07e1076f-68b9-47a7-9f6d-899cc5eceab4 req-63dbdc90-d542-4773-ae09-ac994f6b30e6 service nova] Creating event network-changed:bd81ca4e-3810-41d6-9cae-2ad76a762ddb for instance 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd on n-h2-826529-8 Aug 03 02:18:44.395575 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-07e1076f-68b9-47a7-9f6d-899cc5eceab4 req-63dbdc90-d542-4773-ae09-ac994f6b30e6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079242 Aug 03 02:18:44.402288 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2698/5267] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:18:44.611898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-67cfcbe3-85cb-44df-9ac6-09ce3345d311 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:44.631740 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-67cfcbe3-85cb-44df-9ac6-09ce3345d311 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1322 microversion: 2.1 time: 1.365580 Aug 03 02:18:44.643518 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2570/5268] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:43 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1322 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:45.189246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bc3d0ad4-9a33-4367-b0dc-365a66f2c36c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:45.189948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bc3d0ad4-9a33-4367-b0dc-365a66f2c36c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:45.207807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc3d0ad4-9a33-4367-b0dc-365a66f2c36c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:45.210274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc3d0ad4-9a33-4367-b0dc-365a66f2c36c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:45.211310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc3d0ad4-9a33-4367-b0dc-365a66f2c36c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:45.214941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc3d0ad4-9a33-4367-b0dc-365a66f2c36c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:45.666378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d0ae4cd7-f6ad-4bf4-825a-71d010115047 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:45.667067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d0ae4cd7-f6ad-4bf4-825a-71d010115047 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:45.697893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0ae4cd7-f6ad-4bf4-825a-71d010115047 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:45.698360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0ae4cd7-f6ad-4bf4-825a-71d010115047 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:45.702762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0ae4cd7-f6ad-4bf4-825a-71d010115047 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:45.705654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0ae4cd7-f6ad-4bf4-825a-71d010115047 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:46.618375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bc3d0ad4-9a33-4367-b0dc-365a66f2c36c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:46.634490 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bc3d0ad4-9a33-4367-b0dc-365a66f2c36c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1521 microversion: 2.1 time: 1.453191 Aug 03 02:18:46.635427 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2699/5269] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:45 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1521 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:46.734293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d0ae4cd7-f6ad-4bf4-825a-71d010115047 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:46.761504 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d0ae4cd7-f6ad-4bf4-825a-71d010115047 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1322 microversion: 2.1 time: 1.102244 Aug 03 02:18:46.762100 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2571/5270] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:45 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1322 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:47.639478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-209909211", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "959e11a5-48fb-41a4-945f-90d5060237a4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1619238817", "security_groups": [{"name": "tempest-secgroup-smoke-1024192292"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:47.721257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1ad09175-da52-47b4-a850-63a1231f3a02 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:47.730675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1ad09175-da52-47b4-a850-63a1231f3a02 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:47.751636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ad09175-da52-47b4-a850-63a1231f3a02 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:47.753456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ad09175-da52-47b4-a850-63a1231f3a02 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:47.758510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ad09175-da52-47b4-a850-63a1231f3a02 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:47.759244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ad09175-da52-47b4-a850-63a1231f3a02 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:48.458344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] validate_networks() for [('959e11a5-48fb-41a4-945f-90d5060237a4', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:18:49.438251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1ad09175-da52-47b4-a850-63a1231f3a02 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:49.454109 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1ad09175-da52-47b4-a850-63a1231f3a02 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1521 microversion: 2.1 time: 1.756610 Aug 03 02:18:49.456063 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2572/5271] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:47 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1521 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:49.477524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e54ea798-7bd8-4923-8835-5c3239de119a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:49.478726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e54ea798-7bd8-4923-8835-5c3239de119a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:49.488242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e54ea798-7bd8-4923-8835-5c3239de119a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:49.489467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e54ea798-7bd8-4923-8835-5c3239de119a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:49.491488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e54ea798-7bd8-4923-8835-5c3239de119a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:49.492142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e54ea798-7bd8-4923-8835-5c3239de119a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:50.325892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e54ea798-7bd8-4923-8835-5c3239de119a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:50.334651 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e54ea798-7bd8-4923-8835-5c3239de119a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1322 microversion: 2.1 time: 0.863174 Aug 03 02:18:50.335654 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2573/5272] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:49 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1322 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:50.477457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3e031437-d69f-4442-9ea4-564ffbbcdd53 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:50.478849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3e031437-d69f-4442-9ea4-564ffbbcdd53 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:50.491273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e031437-d69f-4442-9ea4-564ffbbcdd53 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:50.507414 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e031437-d69f-4442-9ea4-564ffbbcdd53 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:50.510522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e031437-d69f-4442-9ea4-564ffbbcdd53 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:50.511144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e031437-d69f-4442-9ea4-564ffbbcdd53 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:50.882053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:18:50.882546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:18:50.883189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:18:50.883719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:18:50.884222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:18:50.913272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:50.916207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:50.917426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:50.918417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:50.942811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for project f6179959e78b438cb68680f694190a8c. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:18:50.949735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for user adca21bc340d440e91e4d856a625cd3a and project f6179959e78b438cb68680f694190a8c. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:18:50.979191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:18:50.984016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:18:51.064687 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-988b0691-7801-403f-9259-e86710b07a16 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.443146 Aug 03 02:18:51.072056 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2700/5273] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:18:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 3451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:18:51.078295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9cf23343-1a68-4dc5-a29e-39e8329b5e81 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:51.079696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9cf23343-1a68-4dc5-a29e-39e8329b5e81 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:51.534451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9cf23343-1a68-4dc5-a29e-39e8329b5e81 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:51.546186 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9cf23343-1a68-4dc5-a29e-39e8329b5e81 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1266 microversion: 2.1 time: 0.472494 Aug 03 02:18:51.563966 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2701/5274] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:51 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1266 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:51.581400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bedc3f86-8f26-4f51-9228-1e23b8029d8c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:51.582163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bedc3f86-8f26-4f51-9228-1e23b8029d8c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:51.599664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bedc3f86-8f26-4f51-9228-1e23b8029d8c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:51.600242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bedc3f86-8f26-4f51-9228-1e23b8029d8c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:51.601686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bedc3f86-8f26-4f51-9228-1e23b8029d8c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:51.602074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bedc3f86-8f26-4f51-9228-1e23b8029d8c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:51.690974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3e031437-d69f-4442-9ea4-564ffbbcdd53 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:51.711238 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3e031437-d69f-4442-9ea4-564ffbbcdd53 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1521 microversion: 2.1 time: 1.237652 Aug 03 02:18:51.712747 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2574/5275] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:50 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1521 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:52.552730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bedc3f86-8f26-4f51-9228-1e23b8029d8c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:52.561583 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bedc3f86-8f26-4f51-9228-1e23b8029d8c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1322 microversion: 2.1 time: 0.993654 Aug 03 02:18:52.567977 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2702/5276] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:51 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1322 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:52.573358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ecb04856-92e1-4bca-843e-9ccda7c0469b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:52.575774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ecb04856-92e1-4bca-843e-9ccda7c0469b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:52.604271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecb04856-92e1-4bca-843e-9ccda7c0469b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:52.605304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecb04856-92e1-4bca-843e-9ccda7c0469b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:52.608237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecb04856-92e1-4bca-843e-9ccda7c0469b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:52.616108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecb04856-92e1-4bca-843e-9ccda7c0469b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:52.737469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc2b8f10-2744-4123-8bf7-ea1cd80805df tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:52.738342 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fc2b8f10-2744-4123-8bf7-ea1cd80805df tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:52.763994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2b8f10-2744-4123-8bf7-ea1cd80805df tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:52.769020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2b8f10-2744-4123-8bf7-ea1cd80805df tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:52.770040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2b8f10-2744-4123-8bf7-ea1cd80805df tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:52.774425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc2b8f10-2744-4123-8bf7-ea1cd80805df tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:53.574343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ecb04856-92e1-4bca-843e-9ccda7c0469b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:53.588025 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ecb04856-92e1-4bca-843e-9ccda7c0469b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1262 microversion: 2.1 time: 1.021613 Aug 03 02:18:53.599013 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2575/5277] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:52 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1262 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:53.819784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fc2b8f10-2744-4123-8bf7-ea1cd80805df tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:53.834332 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fc2b8f10-2744-4123-8bf7-ea1cd80805df tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1521 microversion: 2.1 time: 1.102076 Aug 03 02:18:53.844882 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2703/5278] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:52 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1521 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:53.861250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d0ed43bc-7c2f-43c4-a8ca-921ad5031d73 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:53.868585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d0ed43bc-7c2f-43c4-a8ca-921ad5031d73 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:53.913132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0ed43bc-7c2f-43c4-a8ca-921ad5031d73 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:53.914864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0ed43bc-7c2f-43c4-a8ca-921ad5031d73 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:53.915970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0ed43bc-7c2f-43c4-a8ca-921ad5031d73 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:53.924368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0ed43bc-7c2f-43c4-a8ca-921ad5031d73 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:53.962049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:54.088850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-fca1956e-897d-4909-9adf-e72767e99d48 req-f06488ff-580a-4524-b984-234c4b95e01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd", "name": "network-vif-plugged", "status": "completed", "tag": "bd81ca4e-3810-41d6-9cae-2ad76a762ddb"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:54.103854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-fca1956e-897d-4909-9adf-e72767e99d48 req-f06488ff-580a-4524-b984-234c4b95e01d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:54.104319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-fca1956e-897d-4909-9adf-e72767e99d48 req-f06488ff-580a-4524-b984-234c4b95e01d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:54.133007 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-fca1956e-897d-4909-9adf-e72767e99d48 req-f06488ff-580a-4524-b984-234c4b95e01d service nova] Creating event network-vif-plugged:bd81ca4e-3810-41d6-9cae-2ad76a762ddb for instance 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd on n-h2-826529-8 Aug 03 02:18:54.145319 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-fca1956e-897d-4909-9adf-e72767e99d48 req-f06488ff-580a-4524-b984-234c4b95e01d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.553218 Aug 03 02:18:54.146363 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2576/5279] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:18:54.393412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0dc8619d-4bad-44eb-98d4-1f1133921d55 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Action: 'create', calling method: .version_select at 0x7f5b130380d0>, body: {"keypair": {"name": "tempest-keypair-1557350195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByuLQPAYSLfSJ8evgvxGCmsE3qeYet3YjnTMiC8rZZoTskAMyh3UbZPRvdutaJJW/0ycxynYr2rcZcojUOAgb/bpUot3juVo5AN4LSvkjKJQTKZluyzNc6HBZyqMNk/ow=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:54.427104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-0dc8619d-4bad-44eb-98d4-1f1133921d55 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Getting quotas for project 8c9cb361c2db46cd80e1d83c2706d91a. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:18:54.441421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-0dc8619d-4bad-44eb-98d4-1f1133921d55 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Getting quotas for user 4ab11af44ce14dbabafaf0136a3f2847 and project 8c9cb361c2db46cd80e1d83c2706d91a. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:18:54.477698 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0dc8619d-4bad-44eb-98d4-1f1133921d55 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.165720 Aug 03 02:18:54.478549 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2577/5280] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:18:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:18:54.615743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-445c79b1-4439-4d58-8df8-4cb46b290728 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:54.616507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-445c79b1-4439-4d58-8df8-4cb46b290728 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:54.631098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-445c79b1-4439-4d58-8df8-4cb46b290728 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:54.631568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-445c79b1-4439-4d58-8df8-4cb46b290728 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:54.632389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-445c79b1-4439-4d58-8df8-4cb46b290728 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:54.639192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-445c79b1-4439-4d58-8df8-4cb46b290728 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:54.665725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d0ed43bc-7c2f-43c4-a8ca-921ad5031d73 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:54.679861 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d0ed43bc-7c2f-43c4-a8ca-921ad5031d73 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1322 microversion: 2.1 time: 0.833750 Aug 03 02:18:54.684652 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2704/5281] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:53 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1322 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:54.867442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f846f9e3-9c86-417b-8736-6eeb28092790 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:54.868098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f846f9e3-9c86-417b-8736-6eeb28092790 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:54.895547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f846f9e3-9c86-417b-8736-6eeb28092790 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:54.896200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f846f9e3-9c86-417b-8736-6eeb28092790 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:54.897146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f846f9e3-9c86-417b-8736-6eeb28092790 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:54.897799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f846f9e3-9c86-417b-8736-6eeb28092790 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:54.963789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-445c79b1-4439-4d58-8df8-4cb46b290728 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:54.979596 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-445c79b1-4439-4d58-8df8-4cb46b290728 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1324 microversion: 2.1 time: 0.369673 Aug 03 02:18:54.981275 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2578/5282] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:54 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1324 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:18:55.522204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f846f9e3-9c86-417b-8736-6eeb28092790 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:55.534135 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f846f9e3-9c86-417b-8736-6eeb28092790 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1498 microversion: 2.1 time: 0.671865 Aug 03 02:18:55.537091 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2705/5283] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:54 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1498 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:18:55.561858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b21080c2-4d6c-465e-9c9a-fef227bec997 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:55.567863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b21080c2-4d6c-465e-9c9a-fef227bec997 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:55.569120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b21080c2-4d6c-465e-9c9a-fef227bec997 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:18:55.576828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b21080c2-4d6c-465e-9c9a-fef227bec997 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:55.577290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b21080c2-4d6c-465e-9c9a-fef227bec997 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:55.578192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b21080c2-4d6c-465e-9c9a-fef227bec997 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:55.578795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b21080c2-4d6c-465e-9c9a-fef227bec997 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:55.708497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ff735177-c0be-4bdb-adac-5a49ef95662b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:55.709536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ff735177-c0be-4bdb-adac-5a49ef95662b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:55.731476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff735177-c0be-4bdb-adac-5a49ef95662b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:55.734030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff735177-c0be-4bdb-adac-5a49ef95662b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:55.738729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff735177-c0be-4bdb-adac-5a49ef95662b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:55.740440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff735177-c0be-4bdb-adac-5a49ef95662b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:55.786764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-b21080c2-4d6c-465e-9c9a-fef227bec997 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:18:55.936489 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b21080c2-4d6c-465e-9c9a-fef227bec997 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.380756 Aug 03 02:18:55.938669 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2579/5284] 10.222.0.67 () {58 vars in 1154 bytes} [Wed Aug 3 02:18:55 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:18:55.952543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2c2c182e-3bbc-46e5-8647-b75abf704bd6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:55.961471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2c2c182e-3bbc-46e5-8647-b75abf704bd6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:55.962386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2c2c182e-3bbc-46e5-8647-b75abf704bd6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:56.018392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2c2c182e-3bbc-46e5-8647-b75abf704bd6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Going to try to start instance {{(pid=125942) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 02:18:56.154705 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2c2c182e-3bbc-46e5-8647-b75abf704bd6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "POST /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9/action" status: 202 len: 0 microversion: 2.1 time: 0.208103 Aug 03 02:18:56.155841 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2580/5285] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:18:55 2022] POST /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:18:56.161487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b384be20-ca71-43e2-8069-164f6f4da424 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:56.178518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b384be20-ca71-43e2-8069-164f6f4da424 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:56.186243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b384be20-ca71-43e2-8069-164f6f4da424 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:56.186975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b384be20-ca71-43e2-8069-164f6f4da424 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:56.190257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b384be20-ca71-43e2-8069-164f6f4da424 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:56.192179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b384be20-ca71-43e2-8069-164f6f4da424 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:56.331013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b384be20-ca71-43e2-8069-164f6f4da424 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:56.341922 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b384be20-ca71-43e2-8069-164f6f4da424 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1324 microversion: 2.1 time: 0.182203 Aug 03 02:18:56.342748 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2581/5286] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:56 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1324 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:56.357529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d2e7afa0-10a2-44d1-b4da-49b88e423ab8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:56.358555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d2e7afa0-10a2-44d1-b4da-49b88e423ab8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:56.368284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2e7afa0-10a2-44d1-b4da-49b88e423ab8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:56.372065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2e7afa0-10a2-44d1-b4da-49b88e423ab8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:56.374882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2e7afa0-10a2-44d1-b4da-49b88e423ab8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:56.375928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2e7afa0-10a2-44d1-b4da-49b88e423ab8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:56.664479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ff735177-c0be-4bdb-adac-5a49ef95662b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:56.681986 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ff735177-c0be-4bdb-adac-5a49ef95662b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1322 microversion: 2.1 time: 0.978565 Aug 03 02:18:56.683051 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2706/5287] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:55 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1322 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:18:56.835475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d2e7afa0-10a2-44d1-b4da-49b88e423ab8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:56.855705 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d2e7afa0-10a2-44d1-b4da-49b88e423ab8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1507 microversion: 2.1 time: 0.505994 Aug 03 02:18:56.858218 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2582/5288] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:56 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1507 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:57.365170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6b69b3c1-ddfe-4c78-ac06-9d59864acf66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:57.366142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6b69b3c1-ddfe-4c78-ac06-9d59864acf66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:57.390014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b69b3c1-ddfe-4c78-ac06-9d59864acf66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:57.393270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b69b3c1-ddfe-4c78-ac06-9d59864acf66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:57.396191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b69b3c1-ddfe-4c78-ac06-9d59864acf66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:57.396815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b69b3c1-ddfe-4c78-ac06-9d59864acf66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:57.711926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-63ebe67f-cefd-4786-b5b6-d2dcc5dd1f54 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:57.713395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-63ebe67f-cefd-4786-b5b6-d2dcc5dd1f54 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:57.725379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63ebe67f-cefd-4786-b5b6-d2dcc5dd1f54 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:57.726471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63ebe67f-cefd-4786-b5b6-d2dcc5dd1f54 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:57.728188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63ebe67f-cefd-4786-b5b6-d2dcc5dd1f54 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:57.730274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63ebe67f-cefd-4786-b5b6-d2dcc5dd1f54 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:58.073891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6b69b3c1-ddfe-4c78-ac06-9d59864acf66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:58.091096 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6b69b3c1-ddfe-4c78-ac06-9d59864acf66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1392 microversion: 2.1 time: 0.728406 Aug 03 02:18:58.092740 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2707/5289] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:57 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1392 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:58.103611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0d117dd4-6599-4f31-b3db-2869cea7134a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:58.104644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0d117dd4-6599-4f31-b3db-2869cea7134a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:58.124614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d117dd4-6599-4f31-b3db-2869cea7134a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:58.128803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d117dd4-6599-4f31-b3db-2869cea7134a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:58.130519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d117dd4-6599-4f31-b3db-2869cea7134a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:58.131255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d117dd4-6599-4f31-b3db-2869cea7134a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:58.305499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-63ebe67f-cefd-4786-b5b6-d2dcc5dd1f54 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:58.315966 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-63ebe67f-cefd-4786-b5b6-d2dcc5dd1f54 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1518 microversion: 2.1 time: 0.610368 Aug 03 02:18:58.345519 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2583/5290] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:57 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1518 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:58.362168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6f51dad7-e003-474a-9809-8445f8a2b6b3 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:18:58.365552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6f51dad7-e003-474a-9809-8445f8a2b6b3 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:58.382503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:58.389131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f51dad7-e003-474a-9809-8445f8a2b6b3 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:58.392298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f51dad7-e003-474a-9809-8445f8a2b6b3 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:58.393600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f51dad7-e003-474a-9809-8445f8a2b6b3 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:58.396492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f51dad7-e003-474a-9809-8445f8a2b6b3 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:58.463786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0d117dd4-6599-4f31-b3db-2869cea7134a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:18:58.470533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-6f51dad7-e003-474a-9809-8445f8a2b6b3 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lazy-loading 'flavor' on Instance uuid 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:18:58.474712 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0d117dd4-6599-4f31-b3db-2869cea7134a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1507 microversion: 2.1 time: 0.380645 Aug 03 02:18:58.488662 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2708/5291] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:58 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1507 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:18:58.563151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:18:58.619763 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6f51dad7-e003-474a-9809-8445f8a2b6b3 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "POST /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd/action" status: 200 len: 32 microversion: 2.1 time: 0.272394 Aug 03 02:18:58.626262 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2584/5292] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:18:58 2022] POST /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd/action => generated 32 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:18:58.635128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-71c05c79-9039-4133-aa08-29fc61b9b67f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:58.639023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-71c05c79-9039-4133-aa08-29fc61b9b67f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:58.669316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-71c05c79-9039-4133-aa08-29fc61b9b67f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:58.670508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-71c05c79-9039-4133-aa08-29fc61b9b67f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:58.671665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-71c05c79-9039-4133-aa08-29fc61b9b67f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:58.672609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-71c05c79-9039-4133-aa08-29fc61b9b67f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:59.118647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b3fb167a-9145-45f1-8f52-3c36b27fb57e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:18:59.119443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b3fb167a-9145-45f1-8f52-3c36b27fb57e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:18:59.128828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3fb167a-9145-45f1-8f52-3c36b27fb57e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:59.129253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3fb167a-9145-45f1-8f52-3c36b27fb57e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:18:59.130055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3fb167a-9145-45f1-8f52-3c36b27fb57e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:18:59.130498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3fb167a-9145-45f1-8f52-3c36b27fb57e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:00.025506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-71c05c79-9039-4133-aa08-29fc61b9b67f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:00.035834 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-71c05c79-9039-4133-aa08-29fc61b9b67f tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 1.408876 Aug 03 02:19:00.036450 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2709/5293] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:58 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:00.065030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ae3bed51-162c-49e4-8eeb-fb3928c19071 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:00.065659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ae3bed51-162c-49e4-8eeb-fb3928c19071 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:00.091725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:00.100734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae3bed51-162c-49e4-8eeb-fb3928c19071 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:00.105130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae3bed51-162c-49e4-8eeb-fb3928c19071 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:00.110093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae3bed51-162c-49e4-8eeb-fb3928c19071 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:00.117388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae3bed51-162c-49e4-8eeb-fb3928c19071 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:00.207104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b3fb167a-9145-45f1-8f52-3c36b27fb57e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:00.215639 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b3fb167a-9145-45f1-8f52-3c36b27fb57e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1392 microversion: 2.1 time: 1.105002 Aug 03 02:19:00.231163 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2585/5294] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:18:59 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1392 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:00.725998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-2964e2f7-1111-4768-a550-9d2e267a9f28 req-3b9d43d6-70bf-43b6-a605-f7420a31efac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2c8dd50-04d8-4c90-8de9-81ab009cd56d", "tag": "98bf134d-7968-4dd0-b846-f2029a0e70d1"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:00.812986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2964e2f7-1111-4768-a550-9d2e267a9f28 req-3b9d43d6-70bf-43b6-a605-f7420a31efac service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:00.813800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2964e2f7-1111-4768-a550-9d2e267a9f28 req-3b9d43d6-70bf-43b6-a605-f7420a31efac service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:00.851432 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-2964e2f7-1111-4768-a550-9d2e267a9f28 req-3b9d43d6-70bf-43b6-a605-f7420a31efac service nova] Creating event network-changed:98bf134d-7968-4dd0-b846-f2029a0e70d1 for instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d on n-h1-826529-8 Aug 03 02:19:00.866105 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-2964e2f7-1111-4768-a550-9d2e267a9f28 req-3b9d43d6-70bf-43b6-a605-f7420a31efac service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146753 Aug 03 02:19:00.867697 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2586/5295] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:00.929899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:01.071091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b4502d02-79bd-44eb-8002-6f91f1c2b4d2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:01.073612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b4502d02-79bd-44eb-8002-6f91f1c2b4d2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:01.116901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4502d02-79bd-44eb-8002-6f91f1c2b4d2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:01.119612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4502d02-79bd-44eb-8002-6f91f1c2b4d2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:01.120478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4502d02-79bd-44eb-8002-6f91f1c2b4d2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:01.120931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4502d02-79bd-44eb-8002-6f91f1c2b4d2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:01.543957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:02.519059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ae3bed51-162c-49e4-8eeb-fb3928c19071 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:02.521113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b4502d02-79bd-44eb-8002-6f91f1c2b4d2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:02.536385 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ae3bed51-162c-49e4-8eeb-fb3928c19071 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1511 microversion: 2.1 time: 2.498815 Aug 03 02:19:02.542705 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b4502d02-79bd-44eb-8002-6f91f1c2b4d2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 1.484861 Aug 03 02:19:02.543966 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2587/5296] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:01 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:02.556456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-11c00351-c219-4fb0-b055-27d31ddc866b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:02.557676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-11c00351-c219-4fb0-b055-27d31ddc866b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:02.566756 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2710/5297] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:00 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1511 bytes in 2530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:02.599517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0e21ba38-8a41-44ec-ad99-ac02fd68a4c1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:02.611482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0e21ba38-8a41-44ec-ad99-ac02fd68a4c1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:02.612145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.compute.servers [None req-0e21ba38-8a41-44ec-ad99-ac02fd68a4c1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Removing options 'limit' from query {{(pid=125941) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 03 02:19:02.613280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0e21ba38-8a41-44ec-ad99-ac02fd68a4c1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:19:02.616649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e21ba38-8a41-44ec-ad99-ac02fd68a4c1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:02.617334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e21ba38-8a41-44ec-ad99-ac02fd68a4c1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:02.618401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e21ba38-8a41-44ec-ad99-ac02fd68a4c1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:02.618979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e21ba38-8a41-44ec-ad99-ac02fd68a4c1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:02.620799 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0e21ba38-8a41-44ec-ad99-ac02fd68a4c1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.025970 Aug 03 02:19:02.622423 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2711/5298] 10.222.0.67 () {58 vars in 1140 bytes} [Wed Aug 3 02:19:02 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:19:02.633636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11c00351-c219-4fb0-b055-27d31ddc866b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:02.634118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11c00351-c219-4fb0-b055-27d31ddc866b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:02.634998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11c00351-c219-4fb0-b055-27d31ddc866b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:02.635473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11c00351-c219-4fb0-b055-27d31ddc866b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:02.667105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8446e01-8705-4c7b-b796-72bf8d1da3a9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:02.668439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8446e01-8705-4c7b-b796-72bf8d1da3a9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:02.701539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8446e01-8705-4c7b-b796-72bf8d1da3a9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:02.702099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8446e01-8705-4c7b-b796-72bf8d1da3a9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:02.703292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8446e01-8705-4c7b-b796-72bf8d1da3a9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:02.704492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8446e01-8705-4c7b-b796-72bf8d1da3a9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:03.312226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-11c00351-c219-4fb0-b055-27d31ddc866b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:03.330130 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-11c00351-c219-4fb0-b055-27d31ddc866b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1392 microversion: 2.1 time: 0.783893 Aug 03 02:19:03.334071 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2588/5299] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:02 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1392 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:03.506081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8446e01-8705-4c7b-b796-72bf8d1da3a9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:03.518419 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8446e01-8705-4c7b-b796-72bf8d1da3a9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1511 microversion: 2.1 time: 0.879253 Aug 03 02:19:03.519217 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2712/5300] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:02 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1511 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:03.543963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-745b2994-fcd5-45c9-80b0-9519c910aaa3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:03.558025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-745b2994-fcd5-45c9-80b0-9519c910aaa3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: d51f27ee-4c64-44a6-b46b-da2c369aacd0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:03.585140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8d1b0605-642b-497a-885b-1faf631f5919 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:03.586521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8d1b0605-642b-497a-885b-1faf631f5919 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:03.605541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-745b2994-fcd5-45c9-80b0-9519c910aaa3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:03.607507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-745b2994-fcd5-45c9-80b0-9519c910aaa3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:03.619440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-745b2994-fcd5-45c9-80b0-9519c910aaa3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:03.636898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-745b2994-fcd5-45c9-80b0-9519c910aaa3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:03.645954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d1b0605-642b-497a-885b-1faf631f5919 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:03.646722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d1b0605-642b-497a-885b-1faf631f5919 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:03.664707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d1b0605-642b-497a-885b-1faf631f5919 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:03.664707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d1b0605-642b-497a-885b-1faf631f5919 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:04.338143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-745b2994-fcd5-45c9-80b0-9519c910aaa3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:04.348906 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-745b2994-fcd5-45c9-80b0-9519c910aaa3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0" status: 200 len: 1512 microversion: 2.1 time: 0.812633 Aug 03 02:19:04.360074 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2589/5301] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:03 2022] GET /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0 => generated 1512 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:04.365767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e72a3d1e-9ed2-4085-8c11-76d7572977a1 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:04.366617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e72a3d1e-9ed2-4085-8c11-76d7572977a1 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:04.381572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e72a3d1e-9ed2-4085-8c11-76d7572977a1 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:04.383295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e72a3d1e-9ed2-4085-8c11-76d7572977a1 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:04.385541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e72a3d1e-9ed2-4085-8c11-76d7572977a1 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:04.392453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e72a3d1e-9ed2-4085-8c11-76d7572977a1 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:04.461046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:04.705044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8d1b0605-642b-497a-885b-1faf631f5919 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:04.752667 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8d1b0605-642b-497a-885b-1faf631f5919 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 1.185399 Aug 03 02:19:04.753814 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2713/5302] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:03 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:04.777270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-680f79ff-cdd5-4991-9243-008776115ba9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:04.779664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-680f79ff-cdd5-4991-9243-008776115ba9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:04.794851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e72a3d1e-9ed2-4085-8c11-76d7572977a1 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:04.797564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-680f79ff-cdd5-4991-9243-008776115ba9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:04.798032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-680f79ff-cdd5-4991-9243-008776115ba9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:04.800710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-680f79ff-cdd5-4991-9243-008776115ba9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:04.801779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-680f79ff-cdd5-4991-9243-008776115ba9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:04.804806 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e72a3d1e-9ed2-4085-8c11-76d7572977a1 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1392 microversion: 2.1 time: 0.443321 Aug 03 02:19:04.805405 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2590/5303] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:04 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1392 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:04.829175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1890157072", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "227e6bed-9572-4faa-aec4-655325b93bdb"}], "security_groups": [{"name": "tempest-securitygroup--1443088584"}], "key_name": "tempest-keypair-1557350195", "user_data": "}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:05.553854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] validate_networks() for [('227e6bed-9572-4faa-aec4-655325b93bdb', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:19:05.555369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-680f79ff-cdd5-4991-9243-008776115ba9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:05.586213 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-680f79ff-cdd5-4991-9243-008776115ba9 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1513 microversion: 2.1 time: 0.823706 Aug 03 02:19:05.588665 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2714/5304] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:04 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1513 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:05.614401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0b7931ee-eef9-464b-a98c-0147b656989c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:05.622482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0b7931ee-eef9-464b-a98c-0147b656989c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:05.623637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0b7931ee-eef9-464b-a98c-0147b656989c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:19:05.636330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:05.963014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b7931ee-eef9-464b-a98c-0147b656989c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:05.963517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b7931ee-eef9-464b-a98c-0147b656989c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:05.971352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b7931ee-eef9-464b-a98c-0147b656989c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:05.973168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b7931ee-eef9-464b-a98c-0147b656989c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:06.158877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-0b7931ee-eef9-464b-a98c-0147b656989c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:19:06.266810 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0b7931ee-eef9-464b-a98c-0147b656989c tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.658381 Aug 03 02:19:06.271076 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2715/5305] 10.222.0.67 () {58 vars in 1154 bytes} [Wed Aug 3 02:19:05 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:19:06.288703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4302bbcd-5bee-413f-bceb-3652767f9c7a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:06.292121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4302bbcd-5bee-413f-bceb-3652767f9c7a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:06.302727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4302bbcd-5bee-413f-bceb-3652767f9c7a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:06.303235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4302bbcd-5bee-413f-bceb-3652767f9c7a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:06.304024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4302bbcd-5bee-413f-bceb-3652767f9c7a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:06.304670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4302bbcd-5bee-413f-bceb-3652767f9c7a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:06.640233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4302bbcd-5bee-413f-bceb-3652767f9c7a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:06.651258 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4302bbcd-5bee-413f-bceb-3652767f9c7a tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 0.377380 Aug 03 02:19:06.653825 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2716/5306] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:06 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:06.659627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f2e37355-2ebc-4013-ba4f-f4047c7ea847 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:06.660555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f2e37355-2ebc-4013-ba4f-f4047c7ea847 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:06.672860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f2e37355-2ebc-4013-ba4f-f4047c7ea847 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:06.673780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f2e37355-2ebc-4013-ba4f-f4047c7ea847 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:06.676617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f2e37355-2ebc-4013-ba4f-f4047c7ea847 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:06.677374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f2e37355-2ebc-4013-ba4f-f4047c7ea847 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:07.117408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f2e37355-2ebc-4013-ba4f-f4047c7ea847 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:07.128816 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f2e37355-2ebc-4013-ba4f-f4047c7ea847 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1392 microversion: 2.1 time: 0.474817 Aug 03 02:19:07.130285 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2717/5307] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:06 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1392 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:07.136496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bdf7f9a9-7a31-4aef-b217-3242eed58354 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:07.140722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bdf7f9a9-7a31-4aef-b217-3242eed58354 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:07.151743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdf7f9a9-7a31-4aef-b217-3242eed58354 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:07.153185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdf7f9a9-7a31-4aef-b217-3242eed58354 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:07.154150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdf7f9a9-7a31-4aef-b217-3242eed58354 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:07.155408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdf7f9a9-7a31-4aef-b217-3242eed58354 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:07.218981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:19:07.220107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:19:07.220908 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:19:07.221474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:19:07.222040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:19:07.232552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:07.233256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:07.234267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:07.234862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:07.266575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Getting quotas for project 8c9cb361c2db46cd80e1d83c2706d91a. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:19:07.274066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Getting quotas for user 4ab11af44ce14dbabafaf0136a3f2847 and project 8c9cb361c2db46cd80e1d83c2706d91a. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:19:07.296043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:19:07.303945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:19:07.390836 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f403c36e-038e-4fb8-8d9d-ec07e72aa9d0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.578320 Aug 03 02:19:07.399949 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2591/5308] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:19:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 2588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:19:07.429302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bdf7f9a9-7a31-4aef-b217-3242eed58354 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:07.433056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8bd78283-747a-49ff-bce7-9c762ad1cba2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:07.435697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8bd78283-747a-49ff-bce7-9c762ad1cba2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:07.439947 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bdf7f9a9-7a31-4aef-b217-3242eed58354 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1511 microversion: 2.1 time: 0.307655 Aug 03 02:19:07.440558 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2718/5309] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:07 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1511 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:07.473166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2142aa0a-7544-443e-bc04-f5f6c50efaca req-f02f01cb-894b-4449-9a67-1934a2a02a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c8dd50-04d8-4c90-8de9-81ab009cd56d", "name": "network-vif-plugged", "status": "completed", "tag": "98bf134d-7968-4dd0-b846-f2029a0e70d1"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:07.499907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2142aa0a-7544-443e-bc04-f5f6c50efaca req-f02f01cb-894b-4449-9a67-1934a2a02a32 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:07.500356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2142aa0a-7544-443e-bc04-f5f6c50efaca req-f02f01cb-894b-4449-9a67-1934a2a02a32 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:07.522255 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2142aa0a-7544-443e-bc04-f5f6c50efaca req-f02f01cb-894b-4449-9a67-1934a2a02a32 service nova] Creating event network-vif-plugged:98bf134d-7968-4dd0-b846-f2029a0e70d1 for instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d on n-h1-826529-8 Aug 03 02:19:07.530126 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2142aa0a-7544-443e-bc04-f5f6c50efaca req-f02f01cb-894b-4449-9a67-1934a2a02a32 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088364 Aug 03 02:19:07.530744 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2719/5310] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:07.547347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c4955841-ae39-467e-9673-9f85934ae82a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:07.548066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c4955841-ae39-467e-9673-9f85934ae82a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: d51f27ee-4c64-44a6-b46b-da2c369aacd0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:07.562507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4955841-ae39-467e-9673-9f85934ae82a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:07.562986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4955841-ae39-467e-9673-9f85934ae82a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:07.563783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4955841-ae39-467e-9673-9f85934ae82a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:07.570470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4955841-ae39-467e-9673-9f85934ae82a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:07.801027 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8bd78283-747a-49ff-bce7-9c762ad1cba2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:07.813018 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8bd78283-747a-49ff-bce7-9c762ad1cba2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1238 microversion: 2.1 time: 0.411877 Aug 03 02:19:07.813617 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2592/5311] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:07 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1238 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:07.818418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c69e39fa-7f0e-4e54-8046-94dd18c2bda2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:07.828239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c69e39fa-7f0e-4e54-8046-94dd18c2bda2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:07.838566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c69e39fa-7f0e-4e54-8046-94dd18c2bda2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:07.839086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c69e39fa-7f0e-4e54-8046-94dd18c2bda2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:07.840704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c69e39fa-7f0e-4e54-8046-94dd18c2bda2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:07.841218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c69e39fa-7f0e-4e54-8046-94dd18c2bda2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:08.288964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c4955841-ae39-467e-9673-9f85934ae82a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:08.299977 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c4955841-ae39-467e-9673-9f85934ae82a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0" status: 200 len: 1512 microversion: 2.1 time: 0.757617 Aug 03 02:19:08.300886 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2720/5312] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:07 2022] GET /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0 => generated 1512 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:08.305616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-53519429-5d99-467a-b71e-c8e8afee2580 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:08.312971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-53519429-5d99-467a-b71e-c8e8afee2580 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:08.327393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53519429-5d99-467a-b71e-c8e8afee2580 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:08.328903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53519429-5d99-467a-b71e-c8e8afee2580 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:08.329872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53519429-5d99-467a-b71e-c8e8afee2580 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:08.331425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53519429-5d99-467a-b71e-c8e8afee2580 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:08.396580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c69e39fa-7f0e-4e54-8046-94dd18c2bda2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:08.407281 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c69e39fa-7f0e-4e54-8046-94dd18c2bda2 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 0.592216 Aug 03 02:19:08.419333 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2593/5313] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:07 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:08.427633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0fd68ef1-6d65-48a8-af53-c65ea7a367d1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:08.428259 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0fd68ef1-6d65-48a8-af53-c65ea7a367d1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:08.438717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0fd68ef1-6d65-48a8-af53-c65ea7a367d1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:08.439686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0fd68ef1-6d65-48a8-af53-c65ea7a367d1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:08.441137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0fd68ef1-6d65-48a8-af53-c65ea7a367d1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:08.441642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0fd68ef1-6d65-48a8-af53-c65ea7a367d1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:09.227975 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-53519429-5d99-467a-b71e-c8e8afee2580 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:09.239024 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-53519429-5d99-467a-b71e-c8e8afee2580 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1392 microversion: 2.1 time: 0.936870 Aug 03 02:19:09.239789 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2721/5314] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:08 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1392 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:09.244542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-14ddb2fc-7e05-4d06-9ae2-52344b6105f0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:09.245317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-14ddb2fc-7e05-4d06-9ae2-52344b6105f0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:09.252665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-14ddb2fc-7e05-4d06-9ae2-52344b6105f0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:09.253393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-14ddb2fc-7e05-4d06-9ae2-52344b6105f0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:09.254258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-14ddb2fc-7e05-4d06-9ae2-52344b6105f0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:09.254700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-14ddb2fc-7e05-4d06-9ae2-52344b6105f0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:09.257734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:09.430594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-14ddb2fc-7e05-4d06-9ae2-52344b6105f0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:09.440152 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-14ddb2fc-7e05-4d06-9ae2-52344b6105f0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1308 microversion: 2.1 time: 0.199154 Aug 03 02:19:09.440736 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2722/5315] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:09 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1308 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:09.446836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5a6687f1-cdfb-4cca-8850-75fa8c09ba72 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:09.447674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5a6687f1-cdfb-4cca-8850-75fa8c09ba72 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:09.454089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a6687f1-cdfb-4cca-8850-75fa8c09ba72 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:09.454745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a6687f1-cdfb-4cca-8850-75fa8c09ba72 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:09.455859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a6687f1-cdfb-4cca-8850-75fa8c09ba72 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:09.456365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5a6687f1-cdfb-4cca-8850-75fa8c09ba72 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:09.472807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0fd68ef1-6d65-48a8-af53-c65ea7a367d1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:09.490371 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0fd68ef1-6d65-48a8-af53-c65ea7a367d1 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1513 microversion: 2.1 time: 1.071646 Aug 03 02:19:09.491631 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2594/5316] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:08 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1513 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:09.521441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d2a9bce9-5b80-47c2-97ce-da82ca8f477a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:09.526840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d2a9bce9-5b80-47c2-97ce-da82ca8f477a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:09.529247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d2a9bce9-5b80-47c2-97ce-da82ca8f477a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:19:09.538363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2a9bce9-5b80-47c2-97ce-da82ca8f477a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:09.538820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2a9bce9-5b80-47c2-97ce-da82ca8f477a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:09.539712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2a9bce9-5b80-47c2-97ce-da82ca8f477a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:09.540153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2a9bce9-5b80-47c2-97ce-da82ca8f477a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:09.592816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-d2a9bce9-5b80-47c2-97ce-da82ca8f477a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:19:09.652794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d2a9bce9-5b80-47c2-97ce-da82ca8f477a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:09.676871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2a9bce9-5b80-47c2-97ce-da82ca8f477a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:09.677685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2a9bce9-5b80-47c2-97ce-da82ca8f477a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:09.954840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5a6687f1-cdfb-4cca-8850-75fa8c09ba72 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:09.968272 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5a6687f1-cdfb-4cca-8850-75fa8c09ba72 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 0.524490 Aug 03 02:19:09.978936 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2723/5317] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:09 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:10.096197 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d2a9bce9-5b80-47c2-97ce-da82ca8f477a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.586255 Aug 03 02:19:10.098012 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2595/5318] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 02:19:09 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:10.132000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fa984183-34c9-440b-94f9-2559d34c4476 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:10.142683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fa984183-34c9-440b-94f9-2559d34c4476 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:10.144282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fa984183-34c9-440b-94f9-2559d34c4476 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:19:10.246731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa984183-34c9-440b-94f9-2559d34c4476 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:10.247392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa984183-34c9-440b-94f9-2559d34c4476 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:10.248396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa984183-34c9-440b-94f9-2559d34c4476 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:10.248891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa984183-34c9-440b-94f9-2559d34c4476 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:10.263786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-75efc194-dbd5-49c5-8d29-ac5230e52aeb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:10.264838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-75efc194-dbd5-49c5-8d29-ac5230e52aeb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:10.279654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-75efc194-dbd5-49c5-8d29-ac5230e52aeb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:10.281271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-75efc194-dbd5-49c5-8d29-ac5230e52aeb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:10.285799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-75efc194-dbd5-49c5-8d29-ac5230e52aeb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:10.287073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-75efc194-dbd5-49c5-8d29-ac5230e52aeb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:10.322141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-fa984183-34c9-440b-94f9-2559d34c4476 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:19:10.406366 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fa984183-34c9-440b-94f9-2559d34c4476 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.272611 Aug 03 02:19:10.408094 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2724/5319] 10.222.0.67 () {58 vars in 1150 bytes} [Wed Aug 3 02:19:10 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:10.423576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-90c0d09f-6adc-4ded-8ae4-3c71b20e2de6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:10.441043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-90c0d09f-6adc-4ded-8ae4-3c71b20e2de6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:10.442499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-90c0d09f-6adc-4ded-8ae4-3c71b20e2de6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:19:10.460225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90c0d09f-6adc-4ded-8ae4-3c71b20e2de6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:10.463541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90c0d09f-6adc-4ded-8ae4-3c71b20e2de6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:10.467738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90c0d09f-6adc-4ded-8ae4-3c71b20e2de6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:10.468835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90c0d09f-6adc-4ded-8ae4-3c71b20e2de6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:10.609154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-75efc194-dbd5-49c5-8d29-ac5230e52aeb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:10.617061 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-75efc194-dbd5-49c5-8d29-ac5230e52aeb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1565 microversion: 2.1 time: 0.359384 Aug 03 02:19:10.632170 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2596/5320] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:10 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1565 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:19:10.648037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3c55856f-6c56-4b78-b5e5-6baac8a937e7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:10.648673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3c55856f-6c56-4b78-b5e5-6baac8a937e7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:10.649910 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-90c0d09f-6adc-4ded-8ae4-3c71b20e2de6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:19:10.674021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c55856f-6c56-4b78-b5e5-6baac8a937e7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:10.677153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c55856f-6c56-4b78-b5e5-6baac8a937e7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:10.678531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c55856f-6c56-4b78-b5e5-6baac8a937e7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:10.679206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c55856f-6c56-4b78-b5e5-6baac8a937e7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:10.826517 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-90c0d09f-6adc-4ded-8ae4-3c71b20e2de6 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.407655 Aug 03 02:19:10.827614 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2725/5321] 10.222.0.67 () {58 vars in 1212 bytes} [Wed Aug 3 02:19:10 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:10.832163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3c55856f-6c56-4b78-b5e5-6baac8a937e7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:10.848980 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3c55856f-6c56-4b78-b5e5-6baac8a937e7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1296 microversion: 2.1 time: 0.205540 Aug 03 02:19:10.850240 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2597/5322] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:10 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1296 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:10.851369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-62acc816-720b-491c-b71e-cd27c7f71009 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:10.852005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-62acc816-720b-491c-b71e-cd27c7f71009 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:10.861217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e416b1ac-c11c-40dc-9bf4-9ae9b28a8c6e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:10.862498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62acc816-720b-491c-b71e-cd27c7f71009 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:10.862990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62acc816-720b-491c-b71e-cd27c7f71009 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:10.863789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62acc816-720b-491c-b71e-cd27c7f71009 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:10.864235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62acc816-720b-491c-b71e-cd27c7f71009 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:10.868635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e416b1ac-c11c-40dc-9bf4-9ae9b28a8c6e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:10.869656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e416b1ac-c11c-40dc-9bf4-9ae9b28a8c6e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125942) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:19:10.877196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e416b1ac-c11c-40dc-9bf4-9ae9b28a8c6e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:10.878207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e416b1ac-c11c-40dc-9bf4-9ae9b28a8c6e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:10.879306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e416b1ac-c11c-40dc-9bf4-9ae9b28a8c6e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:10.879903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e416b1ac-c11c-40dc-9bf4-9ae9b28a8c6e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:11.047462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.multi_cell_list [None req-e416b1ac-c11c-40dc-9bf4-9ae9b28a8c6e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:19:11.153969 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e416b1ac-c11c-40dc-9bf4-9ae9b28a8c6e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.296589 Aug 03 02:19:11.159410 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2598/5323] 10.222.0.67 () {58 vars in 1196 bytes} [Wed Aug 3 02:19:10 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:11.169548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a4134ec5-227a-4a36-93cc-9fbc37a43b69 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:11.171557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a4134ec5-227a-4a36-93cc-9fbc37a43b69 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:11.185858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4134ec5-227a-4a36-93cc-9fbc37a43b69 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:11.186687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4134ec5-227a-4a36-93cc-9fbc37a43b69 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:11.189403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4134ec5-227a-4a36-93cc-9fbc37a43b69 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:11.190234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4134ec5-227a-4a36-93cc-9fbc37a43b69 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:11.390497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-62acc816-720b-491c-b71e-cd27c7f71009 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:11.411665 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-62acc816-720b-491c-b71e-cd27c7f71009 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1565 microversion: 2.1 time: 0.582328 Aug 03 02:19:11.426391 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2726/5324] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:10 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1565 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:11.441063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0252ac42-8383-45d1-bf31-2d28db3cd33d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:11.471558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0252ac42-8383-45d1-bf31-2d28db3cd33d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:11.472938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0252ac42-8383-45d1-bf31-2d28db3cd33d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'name': '-283048725', 'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:19:11.489434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0252ac42-8383-45d1-bf31-2d28db3cd33d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:11.491501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0252ac42-8383-45d1-bf31-2d28db3cd33d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:11.496402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0252ac42-8383-45d1-bf31-2d28db3cd33d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:11.497163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0252ac42-8383-45d1-bf31-2d28db3cd33d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:11.696374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-0252ac42-8383-45d1-bf31-2d28db3cd33d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:19:11.815780 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0252ac42-8383-45d1-bf31-2d28db3cd33d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers?name=-283048725" status: 200 len: 345 microversion: 2.1 time: 0.387363 Aug 03 02:19:11.816745 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2727/5325] 10.222.0.67 () {58 vars in 1156 bytes} [Wed Aug 3 02:19:11 2022] GET /compute/v2.1/servers?name=-283048725 => generated 345 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:11.840532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5e34c246-edd2-4344-8eac-a99bbff41a34 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:11.850180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5e34c246-edd2-4344-8eac-a99bbff41a34 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:11.851721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5e34c246-edd2-4344-8eac-a99bbff41a34 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:19:11.860971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e34c246-edd2-4344-8eac-a99bbff41a34 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:11.861433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e34c246-edd2-4344-8eac-a99bbff41a34 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:11.862419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e34c246-edd2-4344-8eac-a99bbff41a34 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:11.863020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e34c246-edd2-4344-8eac-a99bbff41a34 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:11.905055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a4134ec5-227a-4a36-93cc-9fbc37a43b69 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:11.926198 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a4134ec5-227a-4a36-93cc-9fbc37a43b69 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 0.764602 Aug 03 02:19:11.949556 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2599/5326] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:11 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:11.966486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-432226af-5971-43bc-a78d-efcd79e6d9a5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:11.967947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-432226af-5971-43bc-a78d-efcd79e6d9a5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:11.977190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-432226af-5971-43bc-a78d-efcd79e6d9a5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:11.977903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-432226af-5971-43bc-a78d-efcd79e6d9a5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:11.979095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-432226af-5971-43bc-a78d-efcd79e6d9a5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:11.979712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-432226af-5971-43bc-a78d-efcd79e6d9a5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:12.008621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-5e34c246-edd2-4344-8eac-a99bbff41a34 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:19:12.120306 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5e34c246-edd2-4344-8eac-a99bbff41a34 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.292436 Aug 03 02:19:12.129328 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2728/5327] 10.222.0.67 () {58 vars in 1154 bytes} [Wed Aug 3 02:19:11 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:12.134833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fd5c24d7-52fa-457b-b958-fccfa3367f4f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:12.141049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fd5c24d7-52fa-457b-b958-fccfa3367f4f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:12.141733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fd5c24d7-52fa-457b-b958-fccfa3367f4f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-28304872', 'deleted': False, 'project_id': '007e4e43091e44698e83ce1051480be4'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 02:19:12.157366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd5c24d7-52fa-457b-b958-fccfa3367f4f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:12.157366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd5c24d7-52fa-457b-b958-fccfa3367f4f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:12.157758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd5c24d7-52fa-457b-b958-fccfa3367f4f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:12.158172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd5c24d7-52fa-457b-b958-fccfa3367f4f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:12.333461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-fd5c24d7-52fa-457b-b958-fccfa3367f4f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 02:19:12.439066 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fd5c24d7-52fa-457b-b958-fccfa3367f4f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-28304872" status: 200 len: 345 microversion: 2.1 time: 0.307705 Aug 03 02:19:12.440368 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2729/5328] 10.222.0.67 () {58 vars in 1226 bytes} [Wed Aug 3 02:19:12 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-28304872 => generated 345 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:12.454383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ec568c26-cf15-4ed0-9a04-363d45c076cf tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:12.457904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ec568c26-cf15-4ed0-9a04-363d45c076cf tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:12.477449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec568c26-cf15-4ed0-9a04-363d45c076cf tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:12.478200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec568c26-cf15-4ed0-9a04-363d45c076cf tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:12.482451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec568c26-cf15-4ed0-9a04-363d45c076cf tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:12.483371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec568c26-cf15-4ed0-9a04-363d45c076cf tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:12.555149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ec568c26-cf15-4ed0-9a04-363d45c076cf tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:19:12.616519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-432226af-5971-43bc-a78d-efcd79e6d9a5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:12.632856 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-432226af-5971-43bc-a78d-efcd79e6d9a5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1364 microversion: 2.1 time: 0.676732 Aug 03 02:19:12.634265 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2600/5329] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:11 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1364 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:12.760643 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ec568c26-cf15-4ed0-9a04-363d45c076cf tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "DELETE /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 204 len: 0 microversion: 2.1 time: 0.311344 Aug 03 02:19:12.767013 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2730/5330] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:19:12 2022] DELETE /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:19:12.772897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d32f49ca-f980-4fca-b6d1-59b1b93e9889 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:12.773516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d32f49ca-f980-4fca-b6d1-59b1b93e9889 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:12.785004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d32f49ca-f980-4fca-b6d1-59b1b93e9889 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:12.785528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d32f49ca-f980-4fca-b6d1-59b1b93e9889 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:12.787863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d32f49ca-f980-4fca-b6d1-59b1b93e9889 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:12.788322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d32f49ca-f980-4fca-b6d1-59b1b93e9889 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:12.969306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5ebb74a7-ed14-4eeb-a5d5-0273e7753038 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:12.970348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5ebb74a7-ed14-4eeb-a5d5-0273e7753038 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:12.980081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ebb74a7-ed14-4eeb-a5d5-0273e7753038 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:12.983392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ebb74a7-ed14-4eeb-a5d5-0273e7753038 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:12.985418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ebb74a7-ed14-4eeb-a5d5-0273e7753038 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:12.987643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ebb74a7-ed14-4eeb-a5d5-0273e7753038 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:13.184523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d32f49ca-f980-4fca-b6d1-59b1b93e9889 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:13.189469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:13.201517 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d32f49ca-f980-4fca-b6d1-59b1b93e9889 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1519 microversion: 2.1 time: 0.430226 Aug 03 02:19:13.202213 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2601/5331] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:12 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1519 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:19:13.600541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ebb74a7-ed14-4eeb-a5d5-0273e7753038 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:13.613792 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5ebb74a7-ed14-4eeb-a5d5-0273e7753038 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 0.648995 Aug 03 02:19:13.630052 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2731/5332] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:12 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:13.663857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-01b491bf-9f68-4b8d-8a83-e0d8a39bef2e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:13.665081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-01b491bf-9f68-4b8d-8a83-e0d8a39bef2e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:13.675563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01b491bf-9f68-4b8d-8a83-e0d8a39bef2e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:13.676280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01b491bf-9f68-4b8d-8a83-e0d8a39bef2e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:13.678049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01b491bf-9f68-4b8d-8a83-e0d8a39bef2e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:13.679064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01b491bf-9f68-4b8d-8a83-e0d8a39bef2e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:13.971834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-01b491bf-9f68-4b8d-8a83-e0d8a39bef2e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:13.989531 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-01b491bf-9f68-4b8d-8a83-e0d8a39bef2e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1364 microversion: 2.1 time: 0.333769 Aug 03 02:19:13.990989 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2602/5333] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:13 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1364 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:14.237839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d13cdf85-3731-4267-9369-8ee52c1b4065 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:14.238751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d13cdf85-3731-4267-9369-8ee52c1b4065 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:14.247170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d13cdf85-3731-4267-9369-8ee52c1b4065 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:14.247943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d13cdf85-3731-4267-9369-8ee52c1b4065 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:14.249062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d13cdf85-3731-4267-9369-8ee52c1b4065 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:14.249709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d13cdf85-3731-4267-9369-8ee52c1b4065 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:14.471055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-60ef04f1-2e2c-42c6-a3d9-4f4249234536 req-d0e144f4-8ff1-4230-8e23-50174e6c4112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583e3553-3343-4c37-b5f9-df334dd4f27e", "tag": "bf635720-a428-419f-81ec-7da68ab65057"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:14.502448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-60ef04f1-2e2c-42c6-a3d9-4f4249234536 req-d0e144f4-8ff1-4230-8e23-50174e6c4112 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:14.504145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-60ef04f1-2e2c-42c6-a3d9-4f4249234536 req-d0e144f4-8ff1-4230-8e23-50174e6c4112 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:14.535080 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-60ef04f1-2e2c-42c6-a3d9-4f4249234536 req-d0e144f4-8ff1-4230-8e23-50174e6c4112 service nova] Creating event network-changed:bf635720-a428-419f-81ec-7da68ab65057 for instance 583e3553-3343-4c37-b5f9-df334dd4f27e on n-h2-826529-8 Aug 03 02:19:14.543330 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-60ef04f1-2e2c-42c6-a3d9-4f4249234536 req-d0e144f4-8ff1-4230-8e23-50174e6c4112 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.406891 Aug 03 02:19:14.544759 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2732/5334] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:14.646650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-96a2a1b4-e53a-4b39-ae84-4580d3281d85 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:14.650697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-96a2a1b4-e53a-4b39-ae84-4580d3281d85 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:14.666196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96a2a1b4-e53a-4b39-ae84-4580d3281d85 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:14.666646 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96a2a1b4-e53a-4b39-ae84-4580d3281d85 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:14.667782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96a2a1b4-e53a-4b39-ae84-4580d3281d85 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:14.668393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96a2a1b4-e53a-4b39-ae84-4580d3281d85 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:15.274958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d13cdf85-3731-4267-9369-8ee52c1b4065 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:15.285139 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d13cdf85-3731-4267-9369-8ee52c1b4065 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1519 microversion: 2.1 time: 1.051229 Aug 03 02:19:15.287907 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2603/5335] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:14 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1519 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:15.295196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fce2fb71-54d1-467e-b12e-5adc479ec4ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:15.300588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fce2fb71-54d1-467e-b12e-5adc479ec4ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:15.314426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fce2fb71-54d1-467e-b12e-5adc479ec4ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:15.315208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fce2fb71-54d1-467e-b12e-5adc479ec4ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:15.316933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fce2fb71-54d1-467e-b12e-5adc479ec4ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:15.317598 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fce2fb71-54d1-467e-b12e-5adc479ec4ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:15.717963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-96a2a1b4-e53a-4b39-ae84-4580d3281d85 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:15.741847 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-96a2a1b4-e53a-4b39-ae84-4580d3281d85 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 1.100822 Aug 03 02:19:15.744181 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2733/5336] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:14 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:19:15.926868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fce2fb71-54d1-467e-b12e-5adc479ec4ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:15.958824 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fce2fb71-54d1-467e-b12e-5adc479ec4ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1364 microversion: 2.1 time: 0.667938 Aug 03 02:19:15.966957 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2604/5337] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:15 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1364 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:16.310713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2ddafb5c-6cbc-477d-818c-83942dab315f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:16.311627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2ddafb5c-6cbc-477d-818c-83942dab315f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:16.336786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ddafb5c-6cbc-477d-818c-83942dab315f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:16.338190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ddafb5c-6cbc-477d-818c-83942dab315f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:16.339811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ddafb5c-6cbc-477d-818c-83942dab315f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:16.340538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ddafb5c-6cbc-477d-818c-83942dab315f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:16.765773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d3497290-9541-473d-bff7-9a4f847239d7 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:16.767717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d3497290-9541-473d-bff7-9a4f847239d7 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:16.783910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d3497290-9541-473d-bff7-9a4f847239d7 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:16.784340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d3497290-9541-473d-bff7-9a4f847239d7 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:16.785140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d3497290-9541-473d-bff7-9a4f847239d7 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:16.785577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d3497290-9541-473d-bff7-9a4f847239d7 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:17.178971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2ddafb5c-6cbc-477d-818c-83942dab315f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:17.192688 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2ddafb5c-6cbc-477d-818c-83942dab315f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1519 microversion: 2.1 time: 0.888604 Aug 03 02:19:17.215403 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2734/5338] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:16 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1519 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:17.225796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7df175c9-1afa-4940-873f-804dcd26097a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:17.226807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7df175c9-1afa-4940-873f-804dcd26097a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:17.234516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7df175c9-1afa-4940-873f-804dcd26097a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:17.235460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7df175c9-1afa-4940-873f-804dcd26097a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:17.236494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7df175c9-1afa-4940-873f-804dcd26097a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:17.237150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7df175c9-1afa-4940-873f-804dcd26097a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:17.709711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d3497290-9541-473d-bff7-9a4f847239d7 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:17.732510 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d3497290-9541-473d-bff7-9a4f847239d7 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 0.971725 Aug 03 02:19:17.747786 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2605/5339] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:16 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:19:17.753400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-382d1078-8919-46c1-89f9-d34363398a56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:17.754300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-382d1078-8919-46c1-89f9-d34363398a56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:17.780570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-382d1078-8919-46c1-89f9-d34363398a56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:17.781425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-382d1078-8919-46c1-89f9-d34363398a56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:17.784742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-382d1078-8919-46c1-89f9-d34363398a56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:17.785782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-382d1078-8919-46c1-89f9-d34363398a56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:18.046540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7df175c9-1afa-4940-873f-804dcd26097a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:18.072148 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7df175c9-1afa-4940-873f-804dcd26097a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1364 microversion: 2.1 time: 0.854833 Aug 03 02:19:18.078476 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2735/5340] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:17 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1364 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:18.098238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-5e1971fd-59a5-4320-9387-976937e26a26 req-e3e488fb-16eb-408a-8ee1-8e606869e86f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2c8dd50-04d8-4c90-8de9-81ab009cd56d", "tag": "98bf134d-7968-4dd0-b846-f2029a0e70d1"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:18.140120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5e1971fd-59a5-4320-9387-976937e26a26 req-e3e488fb-16eb-408a-8ee1-8e606869e86f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:18.140720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5e1971fd-59a5-4320-9387-976937e26a26 req-e3e488fb-16eb-408a-8ee1-8e606869e86f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:18.152723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:18.187468 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-5e1971fd-59a5-4320-9387-976937e26a26 req-e3e488fb-16eb-408a-8ee1-8e606869e86f service nova] Creating event network-changed:98bf134d-7968-4dd0-b846-f2029a0e70d1 for instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d on n-h1-826529-8 Aug 03 02:19:18.201880 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-5e1971fd-59a5-4320-9387-976937e26a26 req-e3e488fb-16eb-408a-8ee1-8e606869e86f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119382 Aug 03 02:19:18.212382 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2736/5341] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:18.230629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-0f3d0e8f-41c4-4e26-b5a5-b9de0ac0a2fb req-d17891a0-df95-4a9d-99f6-7b5a3b526aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c00b72-7f8e-4c03-85a2-2b2daa80bbc7", "name": "network-vif-deleted", "tag": "585f12bf-d0be-4ebb-bc4f-fae943b4351f"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:18.260289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-0f3d0e8f-41c4-4e26-b5a5-b9de0ac0a2fb req-d17891a0-df95-4a9d-99f6-7b5a3b526aca service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:18.264142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-0f3d0e8f-41c4-4e26-b5a5-b9de0ac0a2fb req-d17891a0-df95-4a9d-99f6-7b5a3b526aca service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:18.301602 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-0f3d0e8f-41c4-4e26-b5a5-b9de0ac0a2fb req-d17891a0-df95-4a9d-99f6-7b5a3b526aca service nova] Creating event network-vif-deleted:585f12bf-d0be-4ebb-bc4f-fae943b4351f for instance 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 on n-h2-826529-8 Aug 03 02:19:18.313648 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-0f3d0e8f-41c4-4e26-b5a5-b9de0ac0a2fb req-d17891a0-df95-4a9d-99f6-7b5a3b526aca service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099009 Aug 03 02:19:18.320440 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2737/5342] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:18.349094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37876ac7-9e8c-495a-89fc-1125ce744d78 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:18.351401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-37876ac7-9e8c-495a-89fc-1125ce744d78 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:18.374749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37876ac7-9e8c-495a-89fc-1125ce744d78 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:18.375625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37876ac7-9e8c-495a-89fc-1125ce744d78 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:18.376771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37876ac7-9e8c-495a-89fc-1125ce744d78 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:18.380015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37876ac7-9e8c-495a-89fc-1125ce744d78 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:18.476203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37876ac7-9e8c-495a-89fc-1125ce744d78 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:18.477300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37876ac7-9e8c-495a-89fc-1125ce744d78 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:18.478079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-37876ac7-9e8c-495a-89fc-1125ce744d78 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lazy-loading 'fault' on Instance uuid 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:19:18.790257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-382d1078-8919-46c1-89f9-d34363398a56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:18.807604 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-382d1078-8919-46c1-89f9-d34363398a56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1565 microversion: 2.1 time: 1.057818 Aug 03 02:19:18.809557 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2606/5343] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:17 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1565 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:18.821373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d1969653-e1c5-4d01-8e50-1642da852a64 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:18.822965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d1969653-e1c5-4d01-8e50-1642da852a64 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:18.836734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1969653-e1c5-4d01-8e50-1642da852a64 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:18.837502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1969653-e1c5-4d01-8e50-1642da852a64 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:18.839153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1969653-e1c5-4d01-8e50-1642da852a64 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:18.841285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1969653-e1c5-4d01-8e50-1642da852a64 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:18.911691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-37876ac7-9e8c-495a-89fc-1125ce744d78 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:18.920623 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-37876ac7-9e8c-495a-89fc-1125ce744d78 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 200 len: 1311 microversion: 2.1 time: 0.589489 Aug 03 02:19:18.927603 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2738/5344] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:18 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 1311 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:19.115886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-85405be0-50f8-44c1-a5d4-19108f5ba3ad tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:19.117190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-85405be0-50f8-44c1-a5d4-19108f5ba3ad tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:19.152650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85405be0-50f8-44c1-a5d4-19108f5ba3ad tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:19.153179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85405be0-50f8-44c1-a5d4-19108f5ba3ad tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:19.154095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85405be0-50f8-44c1-a5d4-19108f5ba3ad tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:19.154533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85405be0-50f8-44c1-a5d4-19108f5ba3ad tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:19.212953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d1969653-e1c5-4d01-8e50-1642da852a64 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:19.225263 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d1969653-e1c5-4d01-8e50-1642da852a64 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 0.413069 Aug 03 02:19:19.229473 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2607/5345] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:18 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:19.589255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-85405be0-50f8-44c1-a5d4-19108f5ba3ad tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:19.632942 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-85405be0-50f8-44c1-a5d4-19108f5ba3ad tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1364 microversion: 2.1 time: 0.524320 Aug 03 02:19:19.635637 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2739/5346] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:19 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1364 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:19.970883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-52f56ba7-46fc-4431-8301-f6b666c7a3f3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:19.972054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-52f56ba7-46fc-4431-8301-f6b666c7a3f3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:19.982445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=10 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:20.020303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52f56ba7-46fc-4431-8301-f6b666c7a3f3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:20.020985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52f56ba7-46fc-4431-8301-f6b666c7a3f3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:20.022212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52f56ba7-46fc-4431-8301-f6b666c7a3f3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:20.022858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52f56ba7-46fc-4431-8301-f6b666c7a3f3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:20.070194 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-52f56ba7-46fc-4431-8301-f6b666c7a3f3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] HTTP exception thrown: Instance 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 could not be found. Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-52f56ba7-46fc-4431-8301-f6b666c7a3f3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Request method failure captured: Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 HTTP/1.1 Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6drNIZGYvM_ZCcTHBOctec7tjoEK-bJ22uRaECAmVGyylxuoPNQF6W_sK4THsjRYFyZ79AcjX4snNdS7vkgOJbHcP4ySlcNs7p5g4byn9UrgjS8hNQqWxT0Z62-5N_8OsSgwF-i8ygI2gkJjdigv4C1mpn803HlnCLPTWBa7DIC4VVo Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 007e4e43091e44698e83ce1051480be4 Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ListServerFiltersTestJSON-334956141 Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_007e4e43091e44698e83ce1051480be4", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/007e4e43091e44698e83ce1051480be4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/007e4e43091e44698e83ce1051480be4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/007e4e43091e44698e83ce1051480be4"}]}] Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ListServerFiltersTestJSON-334956141 Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 007e4e43091e44698e83ce1051480be4 Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-334956141 Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ListServerFiltersTestJSON-334956141-project Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: e439f3311e644d69839fe02978d20f2b Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ListServerFiltersTestJSON-334956141-project Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 could not be found. Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '60c00b72-7f8e-4c03-85a2-2b2daa80bbc7'} Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 could not be found. Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 could not be found. Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:19:20.075858 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:19:20.082266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:19:20.082266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:19:20.082266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:19:20.082266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:19:20.082266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:19:20.082266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 could not be found. Aug 03 02:19:20.082266 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:19:20.084101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-52f56ba7-46fc-4431-8301-f6b666c7a3f3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Returning 404 to user: Instance 60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:19:20.085047 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-52f56ba7-46fc-4431-8301-f6b666c7a3f3 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7" status: 404 len: 111 microversion: 2.1 time: 0.120671 Aug 03 02:19:20.086148 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2608/5347] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:19 2022] GET /compute/v2.1/servers/60c00b72-7f8e-4c03-85a2-2b2daa80bbc7 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:19:20.118659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d2d3e77e-4bae-435e-9b01-1c93d4a6443d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:20.119511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d2d3e77e-4bae-435e-9b01-1c93d4a6443d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: d51f27ee-4c64-44a6-b46b-da2c369aacd0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:20.131012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2d3e77e-4bae-435e-9b01-1c93d4a6443d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:20.132937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2d3e77e-4bae-435e-9b01-1c93d4a6443d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:20.134117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2d3e77e-4bae-435e-9b01-1c93d4a6443d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:20.134717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2d3e77e-4bae-435e-9b01-1c93d4a6443d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:20.193307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d2d3e77e-4bae-435e-9b01-1c93d4a6443d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: d51f27ee-4c64-44a6-b46b-da2c369aacd0] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:19:20.264862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3be98109-4572-43ef-ba84-c9aa8ffa037b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:20.265934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3be98109-4572-43ef-ba84-c9aa8ffa037b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:20.278416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3be98109-4572-43ef-ba84-c9aa8ffa037b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:20.283110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3be98109-4572-43ef-ba84-c9aa8ffa037b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:20.301034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3be98109-4572-43ef-ba84-c9aa8ffa037b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:20.305378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3be98109-4572-43ef-ba84-c9aa8ffa037b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:20.420340 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d2d3e77e-4bae-435e-9b01-1c93d4a6443d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0" status: 204 len: 0 microversion: 2.1 time: 0.329115 Aug 03 02:19:20.427006 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2740/5348] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:19:20 2022] DELETE /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:19:20.443578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8cc3387-124e-4103-b4ed-0dbaf9deae4d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:20.446873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8cc3387-124e-4103-b4ed-0dbaf9deae4d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: d51f27ee-4c64-44a6-b46b-da2c369aacd0] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:20.458535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8cc3387-124e-4103-b4ed-0dbaf9deae4d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:20.461144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8cc3387-124e-4103-b4ed-0dbaf9deae4d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:20.468408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8cc3387-124e-4103-b4ed-0dbaf9deae4d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:20.469458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8cc3387-124e-4103-b4ed-0dbaf9deae4d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:20.952402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:21.104069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8cc3387-124e-4103-b4ed-0dbaf9deae4d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:21.124949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3be98109-4572-43ef-ba84-c9aa8ffa037b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:21.154707 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8cc3387-124e-4103-b4ed-0dbaf9deae4d tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0" status: 200 len: 1518 microversion: 2.1 time: 0.721019 Aug 03 02:19:21.155878 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2741/5349] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:20 2022] GET /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0 => generated 1518 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:21.170356 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3be98109-4572-43ef-ba84-c9aa8ffa037b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 0.895262 Aug 03 02:19:21.171759 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2609/5350] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:20 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:21.198317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4c90fa8d-ac7d-4586-8d0e-8a8661aff5ff tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:21.212427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4c90fa8d-ac7d-4586-8d0e-8a8661aff5ff tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:21.223796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4c90fa8d-ac7d-4586-8d0e-8a8661aff5ff tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:21.224819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4c90fa8d-ac7d-4586-8d0e-8a8661aff5ff tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:21.225854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4c90fa8d-ac7d-4586-8d0e-8a8661aff5ff tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:21.226531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4c90fa8d-ac7d-4586-8d0e-8a8661aff5ff tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:21.553110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4c90fa8d-ac7d-4586-8d0e-8a8661aff5ff tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:21.579284 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4c90fa8d-ac7d-4586-8d0e-8a8661aff5ff tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1364 microversion: 2.1 time: 0.394198 Aug 03 02:19:21.579284 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2742/5351] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:21 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1364 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:22.195062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-38a96253-3fcf-446e-9192-955a5cfbd48a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:22.197901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-38a96253-3fcf-446e-9192-955a5cfbd48a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: d51f27ee-4c64-44a6-b46b-da2c369aacd0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:22.209143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-49a89d64-3662-404a-ac42-83fef0cec0da tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:22.211618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-49a89d64-3662-404a-ac42-83fef0cec0da tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:22.212056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38a96253-3fcf-446e-9192-955a5cfbd48a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:22.213255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38a96253-3fcf-446e-9192-955a5cfbd48a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:22.215459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38a96253-3fcf-446e-9192-955a5cfbd48a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:22.216221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38a96253-3fcf-446e-9192-955a5cfbd48a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:22.228169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=12 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:22.231461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49a89d64-3662-404a-ac42-83fef0cec0da tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:22.232324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49a89d64-3662-404a-ac42-83fef0cec0da tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:22.241728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49a89d64-3662-404a-ac42-83fef0cec0da tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:22.248172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49a89d64-3662-404a-ac42-83fef0cec0da tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:22.868460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-38a96253-3fcf-446e-9192-955a5cfbd48a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:22.892541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-49a89d64-3662-404a-ac42-83fef0cec0da tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:22.906167 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-49a89d64-3662-404a-ac42-83fef0cec0da tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 0.702048 Aug 03 02:19:22.907303 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-38a96253-3fcf-446e-9192-955a5cfbd48a tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0" status: 200 len: 1518 microversion: 2.1 time: 0.719386 Aug 03 02:19:22.908554 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2610/5352] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:22 2022] GET /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0 => generated 1518 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:22.911860 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2743/5353] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:22 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:19:22.924012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4e88c4dd-594d-40fb-a6b0-0386415d9133 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:22.925255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4e88c4dd-594d-40fb-a6b0-0386415d9133 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:22.935826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e88c4dd-594d-40fb-a6b0-0386415d9133 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:22.936529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e88c4dd-594d-40fb-a6b0-0386415d9133 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:22.937463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e88c4dd-594d-40fb-a6b0-0386415d9133 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:22.938033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e88c4dd-594d-40fb-a6b0-0386415d9133 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:23.331957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4e88c4dd-594d-40fb-a6b0-0386415d9133 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:23.360341 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4e88c4dd-594d-40fb-a6b0-0386415d9133 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1364 microversion: 2.1 time: 0.449869 Aug 03 02:19:23.362134 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2611/5354] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:22 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1364 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:23.817502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-6ef0b908-cc0a-429f-a04a-72e6de8c475b req-77e83e1d-497e-43f1-822e-0b709deca830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51f27ee-4c64-44a6-b46b-da2c369aacd0", "name": "network-vif-deleted", "tag": "f1186d59-0d81-4562-8183-90c576b9c232"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:23.865440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6ef0b908-cc0a-429f-a04a-72e6de8c475b req-77e83e1d-497e-43f1-822e-0b709deca830 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:23.866961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6ef0b908-cc0a-429f-a04a-72e6de8c475b req-77e83e1d-497e-43f1-822e-0b709deca830 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:23.889994 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-6ef0b908-cc0a-429f-a04a-72e6de8c475b req-77e83e1d-497e-43f1-822e-0b709deca830 service nova] Creating event network-vif-deleted:f1186d59-0d81-4562-8183-90c576b9c232 for instance d51f27ee-4c64-44a6-b46b-da2c369aacd0 on n-h1-826529-8 Aug 03 02:19:23.899072 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-6ef0b908-cc0a-429f-a04a-72e6de8c475b req-77e83e1d-497e-43f1-822e-0b709deca830 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085014 Aug 03 02:19:23.906467 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2744/5355] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:23.942697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-92eb8fbb-585b-4077-b9d8-7007f256c622 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:23.943449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-92eb8fbb-585b-4077-b9d8-7007f256c622 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:23.946865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f4e3c6ae-ceb6-4d2b-a352-b61ab23dede8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:23.947770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f4e3c6ae-ceb6-4d2b-a352-b61ab23dede8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: d51f27ee-4c64-44a6-b46b-da2c369aacd0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:23.973561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92eb8fbb-585b-4077-b9d8-7007f256c622 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:23.975320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4e3c6ae-ceb6-4d2b-a352-b61ab23dede8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:23.975926 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92eb8fbb-585b-4077-b9d8-7007f256c622 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:23.978003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92eb8fbb-585b-4077-b9d8-7007f256c622 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:23.978451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92eb8fbb-585b-4077-b9d8-7007f256c622 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:23.982893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4e3c6ae-ceb6-4d2b-a352-b61ab23dede8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:23.983875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4e3c6ae-ceb6-4d2b-a352-b61ab23dede8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:23.984603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4e3c6ae-ceb6-4d2b-a352-b61ab23dede8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:24.136453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4e3c6ae-ceb6-4d2b-a352-b61ab23dede8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:24.138167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4e3c6ae-ceb6-4d2b-a352-b61ab23dede8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:24.141943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-f4e3c6ae-ceb6-4d2b-a352-b61ab23dede8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lazy-loading 'fault' on Instance uuid d51f27ee-4c64-44a6-b46b-da2c369aacd0 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:19:24.315092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f4e3c6ae-ceb6-4d2b-a352-b61ab23dede8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:24.328551 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f4e3c6ae-ceb6-4d2b-a352-b61ab23dede8 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0" status: 200 len: 1311 microversion: 2.1 time: 0.400011 Aug 03 02:19:24.337079 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2612/5356] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:23 2022] GET /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0 => generated 1311 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:24.400541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d35c2e33-1220-4305-a2af-8f0f99a2836c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:24.402584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d35c2e33-1220-4305-a2af-8f0f99a2836c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:24.424713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d35c2e33-1220-4305-a2af-8f0f99a2836c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:24.427727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d35c2e33-1220-4305-a2af-8f0f99a2836c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:24.436382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d35c2e33-1220-4305-a2af-8f0f99a2836c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:24.437002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d35c2e33-1220-4305-a2af-8f0f99a2836c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:24.544007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-92eb8fbb-585b-4077-b9d8-7007f256c622 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:24.560170 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-92eb8fbb-585b-4077-b9d8-7007f256c622 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 0.625856 Aug 03 02:19:24.577805 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2745/5357] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:23 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:19:24.844066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d35c2e33-1220-4305-a2af-8f0f99a2836c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:24.856691 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d35c2e33-1220-4305-a2af-8f0f99a2836c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1364 microversion: 2.1 time: 0.461961 Aug 03 02:19:24.857387 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2613/5358] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:24 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1364 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:25.065714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-347d4381-37fb-464e-8542-ab83af0d81f1 req-043bc444-c42e-4f1f-8048-c11b0ae1c2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583e3553-3343-4c37-b5f9-df334dd4f27e", "name": "network-vif-plugged", "status": "completed", "tag": "bf635720-a428-419f-81ec-7da68ab65057"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:25.092918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-347d4381-37fb-464e-8542-ab83af0d81f1 req-043bc444-c42e-4f1f-8048-c11b0ae1c2c5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:25.093802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-347d4381-37fb-464e-8542-ab83af0d81f1 req-043bc444-c42e-4f1f-8048-c11b0ae1c2c5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:25.124665 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-347d4381-37fb-464e-8542-ab83af0d81f1 req-043bc444-c42e-4f1f-8048-c11b0ae1c2c5 service nova] Creating event network-vif-plugged:bf635720-a428-419f-81ec-7da68ab65057 for instance 583e3553-3343-4c37-b5f9-df334dd4f27e on n-h2-826529-8 Aug 03 02:19:25.139354 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-347d4381-37fb-464e-8542-ab83af0d81f1 req-043bc444-c42e-4f1f-8048-c11b0ae1c2c5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077912 Aug 03 02:19:25.141971 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2746/5359] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:19:25.373465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c0e767f2-ac6f-4153-90f6-be7562c4aadd tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:25.374664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c0e767f2-ac6f-4153-90f6-be7562c4aadd tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: d51f27ee-4c64-44a6-b46b-da2c369aacd0] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:25.385044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0e767f2-ac6f-4153-90f6-be7562c4aadd tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:25.387568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0e767f2-ac6f-4153-90f6-be7562c4aadd tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:25.389292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0e767f2-ac6f-4153-90f6-be7562c4aadd tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:25.389969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c0e767f2-ac6f-4153-90f6-be7562c4aadd tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:25.414856 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-c0e767f2-ac6f-4153-90f6-be7562c4aadd tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] HTTP exception thrown: Instance d51f27ee-4c64-44a6-b46b-da2c369aacd0 could not be found. Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c0e767f2-ac6f-4153-90f6-be7562c4aadd tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Request method failure captured: Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0 HTTP/1.1 Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6drNIZGYvM_ZCcTHBOctec7tjoEK-bJ22uRaECAmVGyylxuoPNQF6W_sK4THsjRYFyZ79AcjX4snNdS7vkgOJbHcP4ySlcNs7p5g4byn9UrgjS8hNQqWxT0Z62-5N_8OsSgwF-i8ygI2gkJjdigv4C1mpn803HlnCLPTWBa7DIC4VVo Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 007e4e43091e44698e83ce1051480be4 Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ListServerFiltersTestJSON-334956141 Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_007e4e43091e44698e83ce1051480be4", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/007e4e43091e44698e83ce1051480be4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/007e4e43091e44698e83ce1051480be4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/007e4e43091e44698e83ce1051480be4"}]}] Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ListServerFiltersTestJSON-334956141 Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 007e4e43091e44698e83ce1051480be4 Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-334956141 Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ListServerFiltersTestJSON-334956141-project Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: e439f3311e644d69839fe02978d20f2b Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ListServerFiltersTestJSON-334956141-project Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance d51f27ee-4c64-44a6-b46b-da2c369aacd0 could not be found. Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'd51f27ee-4c64-44a6-b46b-da2c369aacd0'} Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d51f27ee-4c64-44a6-b46b-da2c369aacd0 could not be found. Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d51f27ee-4c64-44a6-b46b-da2c369aacd0 could not be found. Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:19:25.418314 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:19:25.427229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:19:25.427229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:19:25.427229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:19:25.427229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:19:25.427229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:19:25.427229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d51f27ee-4c64-44a6-b46b-da2c369aacd0 could not be found. Aug 03 02:19:25.427229 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:19:25.427229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c0e767f2-ac6f-4153-90f6-be7562c4aadd tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Returning 404 to user: Instance d51f27ee-4c64-44a6-b46b-da2c369aacd0 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:19:25.427229 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c0e767f2-ac6f-4153-90f6-be7562c4aadd tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0" status: 404 len: 111 microversion: 2.1 time: 0.053750 Aug 03 02:19:25.429511 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2614/5360] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:25 2022] GET /compute/v2.1/servers/d51f27ee-4c64-44a6-b46b-da2c369aacd0 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:19:25.449034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9e623bd2-2878-4a04-9622-02b536a89612 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:25.450201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9e623bd2-2878-4a04-9622-02b536a89612 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:25.478854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e623bd2-2878-4a04-9622-02b536a89612 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:25.480015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e623bd2-2878-4a04-9622-02b536a89612 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:25.482134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e623bd2-2878-4a04-9622-02b536a89612 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:25.483175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9e623bd2-2878-4a04-9622-02b536a89612 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:25.552388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9e623bd2-2878-4a04-9622-02b536a89612 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:19:25.586728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-552919a0-b25b-4170-94df-8d20af65b977 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:25.587442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-552919a0-b25b-4170-94df-8d20af65b977 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:25.599554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552919a0-b25b-4170-94df-8d20af65b977 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:25.603029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552919a0-b25b-4170-94df-8d20af65b977 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:25.604036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552919a0-b25b-4170-94df-8d20af65b977 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:25.604691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-552919a0-b25b-4170-94df-8d20af65b977 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:25.827515 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9e623bd2-2878-4a04-9622-02b536a89612 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "DELETE /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 204 len: 0 microversion: 2.1 time: 0.394602 Aug 03 02:19:25.830196 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2747/5361] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:19:25 2022] DELETE /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:19:25.842617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f718c538-b2fc-4309-b7f0-6dad6ff27707 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:25.843790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f718c538-b2fc-4309-b7f0-6dad6ff27707 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:25.852092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f718c538-b2fc-4309-b7f0-6dad6ff27707 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:25.852865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f718c538-b2fc-4309-b7f0-6dad6ff27707 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:25.855037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f718c538-b2fc-4309-b7f0-6dad6ff27707 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:25.856784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f718c538-b2fc-4309-b7f0-6dad6ff27707 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:26.619247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-552919a0-b25b-4170-94df-8d20af65b977 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:26.632902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f718c538-b2fc-4309-b7f0-6dad6ff27707 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:26.637294 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-552919a0-b25b-4170-94df-8d20af65b977 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 1.055470 Aug 03 02:19:26.638734 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2615/5362] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:25 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:19:26.645750 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f718c538-b2fc-4309-b7f0-6dad6ff27707 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1517 microversion: 2.1 time: 0.807177 Aug 03 02:19:26.659648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-20dbd882-bf6f-458f-bc1e-05aefad171c7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:26.664142 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2748/5363] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:25 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1517 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:19:26.665348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-20dbd882-bf6f-458f-bc1e-05aefad171c7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:26.687353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20dbd882-bf6f-458f-bc1e-05aefad171c7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:26.688265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20dbd882-bf6f-458f-bc1e-05aefad171c7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:26.691364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20dbd882-bf6f-458f-bc1e-05aefad171c7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:26.692684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20dbd882-bf6f-458f-bc1e-05aefad171c7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:27.206072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-20dbd882-bf6f-458f-bc1e-05aefad171c7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:27.217839 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-20dbd882-bf6f-458f-bc1e-05aefad171c7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1364 microversion: 2.1 time: 0.574199 Aug 03 02:19:27.218847 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2616/5364] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:26 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1364 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:27.664904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7ee4d648-746d-44e7-8e83-06c7fe7d5287 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:27.674542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7230fab1-1c42-4697-944e-c5cf927d623e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:27.675225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7230fab1-1c42-4697-944e-c5cf927d623e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:27.676795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7ee4d648-746d-44e7-8e83-06c7fe7d5287 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:27.699848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7230fab1-1c42-4697-944e-c5cf927d623e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:27.700719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7230fab1-1c42-4697-944e-c5cf927d623e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:27.701584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7230fab1-1c42-4697-944e-c5cf927d623e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:27.702039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7230fab1-1c42-4697-944e-c5cf927d623e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:27.704521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ee4d648-746d-44e7-8e83-06c7fe7d5287 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:27.710558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ee4d648-746d-44e7-8e83-06c7fe7d5287 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:27.716224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ee4d648-746d-44e7-8e83-06c7fe7d5287 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:27.716703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ee4d648-746d-44e7-8e83-06c7fe7d5287 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:28.174958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7ee4d648-746d-44e7-8e83-06c7fe7d5287 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:28.195288 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7ee4d648-746d-44e7-8e83-06c7fe7d5287 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 0.535337 Aug 03 02:19:28.196237 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2749/5365] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:27 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:28.238161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7230fab1-1c42-4697-944e-c5cf927d623e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:28.253586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-339a05db-9d85-4a36-8b65-b6953cb74c6e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:28.254551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-339a05db-9d85-4a36-8b65-b6953cb74c6e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:28.275392 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7230fab1-1c42-4697-944e-c5cf927d623e tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1517 microversion: 2.1 time: 0.604881 Aug 03 02:19:28.275952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-339a05db-9d85-4a36-8b65-b6953cb74c6e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:28.276975 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-339a05db-9d85-4a36-8b65-b6953cb74c6e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:28.277794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-339a05db-9d85-4a36-8b65-b6953cb74c6e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:28.278242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-339a05db-9d85-4a36-8b65-b6953cb74c6e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:28.294877 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2617/5366] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:27 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1517 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:28.577584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-339a05db-9d85-4a36-8b65-b6953cb74c6e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:28.588484 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-339a05db-9d85-4a36-8b65-b6953cb74c6e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1549 microversion: 2.1 time: 0.341540 Aug 03 02:19:28.602932 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2750/5367] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:28 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1549 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:28.612392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-495cc9b5-e01c-46e4-9dff-81ed44b9e948 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:28.613220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-495cc9b5-e01c-46e4-9dff-81ed44b9e948 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:28.622722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:28.625606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-495cc9b5-e01c-46e4-9dff-81ed44b9e948 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:28.626329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-495cc9b5-e01c-46e4-9dff-81ed44b9e948 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:28.629909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-495cc9b5-e01c-46e4-9dff-81ed44b9e948 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:28.630603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-495cc9b5-e01c-46e4-9dff-81ed44b9e948 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:28.816191 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-495cc9b5-e01c-46e4-9dff-81ed44b9e948 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.207755 Aug 03 02:19:28.818406 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2618/5368] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:19:28 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/os-interface => generated 284 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:29.236876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a8f10be0-1541-48c2-b95c-51ab4b48568d tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:29.240495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a8f10be0-1541-48c2-b95c-51ab4b48568d tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:29.262681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8f10be0-1541-48c2-b95c-51ab4b48568d tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:29.263734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8f10be0-1541-48c2-b95c-51ab4b48568d tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:29.264895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8f10be0-1541-48c2-b95c-51ab4b48568d tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:29.265565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8f10be0-1541-48c2-b95c-51ab4b48568d tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:29.311986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e745bca7-50e2-46fd-99fd-fb6ecd18831f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:29.312864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e745bca7-50e2-46fd-99fd-fb6ecd18831f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:29.329879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e745bca7-50e2-46fd-99fd-fb6ecd18831f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:29.330765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e745bca7-50e2-46fd-99fd-fb6ecd18831f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:29.331971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e745bca7-50e2-46fd-99fd-fb6ecd18831f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:29.332521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e745bca7-50e2-46fd-99fd-fb6ecd18831f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:29.564605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e745bca7-50e2-46fd-99fd-fb6ecd18831f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e439f3311e644d69839fe02978d20f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007e4e43091e44698e83ce1051480be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:29.570782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:29.585252 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e745bca7-50e2-46fd-99fd-fb6ecd18831f tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 200 len: 1475 microversion: 2.1 time: 0.278295 Aug 03 02:19:29.592727 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2619/5369] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:29 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 1475 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:29.612280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-dfc14cc5-af34-4f9b-850a-4e1a0bf91d37 req-cbab3928-0828-46f3-91e8-0af05ee4bf19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334229c5-e563-4c00-bccd-90b703d542d9", "name": "network-vif-deleted", "tag": "9ca601fb-8136-46c2-9f4f-e88601950fe0"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:29.645179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-dfc14cc5-af34-4f9b-850a-4e1a0bf91d37 req-cbab3928-0828-46f3-91e8-0af05ee4bf19 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:29.645799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-dfc14cc5-af34-4f9b-850a-4e1a0bf91d37 req-cbab3928-0828-46f3-91e8-0af05ee4bf19 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:29.661388 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-dfc14cc5-af34-4f9b-850a-4e1a0bf91d37 req-cbab3928-0828-46f3-91e8-0af05ee4bf19 service nova] Creating event network-vif-deleted:9ca601fb-8136-46c2-9f4f-e88601950fe0 for instance 334229c5-e563-4c00-bccd-90b703d542d9 on n-h1-826529-8 Aug 03 02:19:29.680102 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-dfc14cc5-af34-4f9b-850a-4e1a0bf91d37 req-cbab3928-0828-46f3-91e8-0af05ee4bf19 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085427 Aug 03 02:19:29.681301 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2620/5370] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:30.078489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a8f10be0-1541-48c2-b95c-51ab4b48568d tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:30.081597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:30.098076 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a8f10be0-1541-48c2-b95c-51ab4b48568d tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 0.877193 Aug 03 02:19:30.110959 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2751/5371] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:29 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:19:30.625215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25d8bd10-78d4-4594-91a9-692e62d10025 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:30.632558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-25d8bd10-78d4-4594-91a9-692e62d10025 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] [instance: 334229c5-e563-4c00-bccd-90b703d542d9] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:30.663771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25d8bd10-78d4-4594-91a9-692e62d10025 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:30.665053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25d8bd10-78d4-4594-91a9-692e62d10025 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:30.666385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25d8bd10-78d4-4594-91a9-692e62d10025 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:30.668967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25d8bd10-78d4-4594-91a9-692e62d10025 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:30.693719 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-25d8bd10-78d4-4594-91a9-692e62d10025 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] HTTP exception thrown: Instance 334229c5-e563-4c00-bccd-90b703d542d9 could not be found. Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25d8bd10-78d4-4594-91a9-692e62d10025 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Request method failure captured: Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 HTTP/1.1 Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6drNIZGYvM_ZCcTHBOctec7tjoEK-bJ22uRaECAmVGyylxuoPNQF6W_sK4THsjRYFyZ79AcjX4snNdS7vkgOJbHcP4ySlcNs7p5g4byn9UrgjS8hNQqWxT0Z62-5N_8OsSgwF-i8ygI2gkJjdigv4C1mpn803HlnCLPTWBa7DIC4VVo Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 007e4e43091e44698e83ce1051480be4 Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ListServerFiltersTestJSON-334956141 Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_007e4e43091e44698e83ce1051480be4", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/007e4e43091e44698e83ce1051480be4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/007e4e43091e44698e83ce1051480be4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/007e4e43091e44698e83ce1051480be4"}]}] Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ListServerFiltersTestJSON-334956141 Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 007e4e43091e44698e83ce1051480be4 Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-334956141 Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ListServerFiltersTestJSON-334956141-project Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: e439f3311e644d69839fe02978d20f2b Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ListServerFiltersTestJSON-334956141-project Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 334229c5-e563-4c00-bccd-90b703d542d9 could not be found. Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '334229c5-e563-4c00-bccd-90b703d542d9'} Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334229c5-e563-4c00-bccd-90b703d542d9 could not be found. Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334229c5-e563-4c00-bccd-90b703d542d9 could not be found. Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:19:30.696181 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:19:30.703141 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:19:30.703141 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:19:30.703141 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:19:30.703141 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:19:30.703141 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:19:30.703141 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334229c5-e563-4c00-bccd-90b703d542d9 could not be found. Aug 03 02:19:30.703141 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:19:30.703796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25d8bd10-78d4-4594-91a9-692e62d10025 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] Returning 404 to user: Instance 334229c5-e563-4c00-bccd-90b703d542d9 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:19:30.705359 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-25d8bd10-78d4-4594-91a9-692e62d10025 tempest-ListServerFiltersTestJSON-334956141 tempest-ListServerFiltersTestJSON-334956141-project] 10.222.0.67 "GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9" status: 404 len: 111 microversion: 2.1 time: 0.092620 Aug 03 02:19:30.706393 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2621/5372] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:30 2022] GET /compute/v2.1/servers/334229c5-e563-4c00-bccd-90b703d542d9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:19:31.129836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-67393c3c-fd35-4f76-b9bb-3a8fbe448ea1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:31.131116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-67393c3c-fd35-4f76-b9bb-3a8fbe448ea1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:31.139672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:31.175446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67393c3c-fd35-4f76-b9bb-3a8fbe448ea1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:31.177303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67393c3c-fd35-4f76-b9bb-3a8fbe448ea1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:31.178887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67393c3c-fd35-4f76-b9bb-3a8fbe448ea1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:31.179624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67393c3c-fd35-4f76-b9bb-3a8fbe448ea1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:31.576048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-67393c3c-fd35-4f76-b9bb-3a8fbe448ea1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:31.585401 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-67393c3c-fd35-4f76-b9bb-3a8fbe448ea1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 0.462547 Aug 03 02:19:31.596127 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2752/5373] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:31 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:32.624377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7bed8afe-b477-4737-926e-4be86ad2ab6b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:32.626154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7bed8afe-b477-4737-926e-4be86ad2ab6b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:32.647729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7bed8afe-b477-4737-926e-4be86ad2ab6b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:32.649311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7bed8afe-b477-4737-926e-4be86ad2ab6b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:32.652857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7bed8afe-b477-4737-926e-4be86ad2ab6b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:32.654019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7bed8afe-b477-4737-926e-4be86ad2ab6b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:33.021270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f3b19b9a-3f86-4258-9cd6-9663b705a00d req-d192b97a-6f7c-4952-bc67-ad318ae73371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583e3553-3343-4c37-b5f9-df334dd4f27e", "tag": "bf635720-a428-419f-81ec-7da68ab65057"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:33.049436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f3b19b9a-3f86-4258-9cd6-9663b705a00d req-d192b97a-6f7c-4952-bc67-ad318ae73371 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:33.050258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f3b19b9a-3f86-4258-9cd6-9663b705a00d req-d192b97a-6f7c-4952-bc67-ad318ae73371 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:33.089175 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f3b19b9a-3f86-4258-9cd6-9663b705a00d req-d192b97a-6f7c-4952-bc67-ad318ae73371 service nova] Creating event network-changed:bf635720-a428-419f-81ec-7da68ab65057 for instance 583e3553-3343-4c37-b5f9-df334dd4f27e on n-h2-826529-8 Aug 03 02:19:33.099332 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f3b19b9a-3f86-4258-9cd6-9663b705a00d req-d192b97a-6f7c-4952-bc67-ad318ae73371 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083029 Aug 03 02:19:33.101404 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2753/5374] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:33.261141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7bed8afe-b477-4737-926e-4be86ad2ab6b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:33.273474 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7bed8afe-b477-4737-926e-4be86ad2ab6b tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 0.655580 Aug 03 02:19:33.274356 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2622/5375] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:32 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:34.331807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-367efed7-a2fe-42d5-9d41-fa182193b169 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:34.335123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-367efed7-a2fe-42d5-9d41-fa182193b169 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:34.358586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-367efed7-a2fe-42d5-9d41-fa182193b169 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:34.359602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-367efed7-a2fe-42d5-9d41-fa182193b169 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:34.364069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-367efed7-a2fe-42d5-9d41-fa182193b169 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:34.365548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-367efed7-a2fe-42d5-9d41-fa182193b169 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:34.951072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-367efed7-a2fe-42d5-9d41-fa182193b169 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:34.974730 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-367efed7-a2fe-42d5-9d41-fa182193b169 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 0.663025 Aug 03 02:19:34.981523 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2754/5376] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:34 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:36.014320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-928e0140-4888-4486-a265-e918bccbf27c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:36.015410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-928e0140-4888-4486-a265-e918bccbf27c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:36.046990 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-928e0140-4888-4486-a265-e918bccbf27c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:36.049134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-928e0140-4888-4486-a265-e918bccbf27c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:36.057142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-928e0140-4888-4486-a265-e918bccbf27c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:36.059290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-928e0140-4888-4486-a265-e918bccbf27c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:37.141931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5bb127a-d787-42d3-b565-932cc519bd85 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Action: 'create', calling method: .version_select at 0x7f5b125388b0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1904189166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9D/kHOY7+bwk3MtMIHh76tTNVPCoXQzsPX2gNsFUMFEFImdP5asbYkfMClP2RmhdEI4ENWOzMcw5qYhOhdy9vJrbKmB/qXLCq97OI+F3M1TtBm+2z1iXJYd3fExu8lrA=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:37.284311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-c5bb127a-d787-42d3-b565-932cc519bd85 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Getting quotas for project 7548c1d33d8843adb6ee18ab605dce49. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:19:37.382434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-c5bb127a-d787-42d3-b565-932cc519bd85 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Getting quotas for user 54d46abfe97b454e88b51d6cb9255b50 and project 7548c1d33d8843adb6ee18ab605dce49. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:19:37.443996 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5bb127a-d787-42d3-b565-932cc519bd85 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.818869 Aug 03 02:19:37.445794 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2755/5377] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:19:36 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:37.488245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-928e0140-4888-4486-a265-e918bccbf27c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:37.519905 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-928e0140-4888-4486-a265-e918bccbf27c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1524 microversion: 2.1 time: 1.514252 Aug 03 02:19:37.535275 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2623/5378] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:36 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1524 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:38.561722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4fa6f9eb-f045-42a6-a2e0-3d68ce42edc9 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:38.562879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4fa6f9eb-f045-42a6-a2e0-3d68ce42edc9 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:38.580757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4fa6f9eb-f045-42a6-a2e0-3d68ce42edc9 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:38.585962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4fa6f9eb-f045-42a6-a2e0-3d68ce42edc9 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:38.587756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4fa6f9eb-f045-42a6-a2e0-3d68ce42edc9 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:38.588743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4fa6f9eb-f045-42a6-a2e0-3d68ce42edc9 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:39.055447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4fa6f9eb-f045-42a6-a2e0-3d68ce42edc9 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:39.077839 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4fa6f9eb-f045-42a6-a2e0-3d68ce42edc9 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1504 microversion: 2.1 time: 0.525862 Aug 03 02:19:39.078516 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2756/5379] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:38 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1504 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:39.105855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-58849fce-44cc-4d54-a72f-2ed4f1239511 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Action: 'create', calling method: .version_select at 0x7f5b244da820>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1100546061", "description": "tempest-description-457033131"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:39.979619 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-58849fce-44cc-4d54-a72f-2ed4f1239511 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.880182 Aug 03 02:19:39.980979 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2624/5380] 10.222.0.67 () {60 vars in 1180 bytes} [Wed Aug 3 02:19:39 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:40.028090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-73fdac7f-4d1c-4474-8d0a-4911cdfdbfa4 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1100546061"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:40.028537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-73fdac7f-4d1c-4474-8d0a-4911cdfdbfa4 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:40.058493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73fdac7f-4d1c-4474-8d0a-4911cdfdbfa4 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:40.062099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73fdac7f-4d1c-4474-8d0a-4911cdfdbfa4 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:40.064498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73fdac7f-4d1c-4474-8d0a-4911cdfdbfa4 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:40.065866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-73fdac7f-4d1c-4474-8d0a-4911cdfdbfa4 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:40.298484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-759489420", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1904189166", "security_groups": [{"name": "tempest-secgroup-smoke-2006919408"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "1512917a-ceb1-4ea4-a7b6-445f17bb0551"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:40.488691 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.network.security_group_api [None req-73fdac7f-4d1c-4474-8d0a-4911cdfdbfa4 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Adding security group aedd2827-76b3-4f37-9de7-e4c8f758e19f to port bd81ca4e-3810-41d6-9cae-2ad76a762ddb Aug 03 02:19:40.580446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] validate_networks() for [('1512917a-ceb1-4ea4-a7b6-445f17bb0551', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:19:41.633183 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-73fdac7f-4d1c-4474-8d0a-4911cdfdbfa4 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "POST /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd/action" status: 202 len: 0 microversion: 2.1 time: 1.642495 Aug 03 02:19:41.633815 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2757/5381] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:19:39 2022] POST /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd/action => generated 0 bytes in 1644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:19:41.642295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ea2ff7ff-f23c-4e39-a7a0-392c1d07e2b0 tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] Calling method '.version_select at 0x7f5b125389d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:41.814727 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ea2ff7ff-f23c-4e39-a7a0-392c1d07e2b0 tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/b2a0dcca-78ec-46f9-84eb-cd643aa5a400" status: 200 len: 350 microversion: 2.1 time: 0.179402 Aug 03 02:19:41.823128 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2758/5382] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:19:41 2022] GET /compute/v2.1/os-volumes/b2a0dcca-78ec-46f9-84eb-cd643aa5a400 => generated 350 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:41.828417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-21860c09-3c0a-40a6-9faf-ecc05e0e3886 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1100546061"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:41.828962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-21860c09-3c0a-40a6-9faf-ecc05e0e3886 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:41.851884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21860c09-3c0a-40a6-9faf-ecc05e0e3886 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:41.860212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21860c09-3c0a-40a6-9faf-ecc05e0e3886 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:41.861434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21860c09-3c0a-40a6-9faf-ecc05e0e3886 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:41.862048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21860c09-3c0a-40a6-9faf-ecc05e0e3886 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:42.782251 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.network.security_group_api [None req-21860c09-3c0a-40a6-9faf-ecc05e0e3886 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Removing security group aedd2827-76b3-4f37-9de7-e4c8f758e19f from port bd81ca4e-3810-41d6-9cae-2ad76a762ddb Aug 03 02:19:42.806238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Getting quotas for project 7548c1d33d8843adb6ee18ab605dce49. Resources: dict_keys(['metadata_items']) {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:19:42.832719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Getting quotas for user 54d46abfe97b454e88b51d6cb9255b50 and project 7548c1d33d8843adb6ee18ab605dce49. Resources: dict_keys(['metadata_items']) {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:19:42.878757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:19:42.881105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:19:42.881914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:19:42.883609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:19:42.884094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:19:42.915179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:42.915948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:42.920602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:42.921353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:42.986190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Getting quotas for project 7548c1d33d8843adb6ee18ab605dce49. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:19:43.010405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Getting quotas for user 54d46abfe97b454e88b51d6cb9255b50 and project 7548c1d33d8843adb6ee18ab605dce49. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:19:43.060816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:19:43.068181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:19:43.169297 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-358abdcc-d5dc-4d43-baff-9f322f1fb46a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.877380 Aug 03 02:19:43.175749 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2625/5383] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:19:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 2879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:19:43.187877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-adc3a046-ba15-43cc-8db9-dc5fd0a567e5 req-09adb5a1-f5cc-4c3c-97c7-97eb27f504ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd", "tag": "bd81ca4e-3810-41d6-9cae-2ad76a762ddb"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:43.208358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-adc3a046-ba15-43cc-8db9-dc5fd0a567e5 req-09adb5a1-f5cc-4c3c-97c7-97eb27f504ed service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:43.209625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-adc3a046-ba15-43cc-8db9-dc5fd0a567e5 req-09adb5a1-f5cc-4c3c-97c7-97eb27f504ed service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:43.238350 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-adc3a046-ba15-43cc-8db9-dc5fd0a567e5 req-09adb5a1-f5cc-4c3c-97c7-97eb27f504ed service nova] Creating event network-changed:bd81ca4e-3810-41d6-9cae-2ad76a762ddb for instance 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd on n-h2-826529-8 Aug 03 02:19:43.260168 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-adc3a046-ba15-43cc-8db9-dc5fd0a567e5 req-09adb5a1-f5cc-4c3c-97c7-97eb27f504ed service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078583 Aug 03 02:19:43.263026 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2626/5384] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:43.331311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cd5f5864-beeb-45aa-8abd-95747f0fd5c9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:43.350783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cd5f5864-beeb-45aa-8abd-95747f0fd5c9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:43.423321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd5f5864-beeb-45aa-8abd-95747f0fd5c9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:43.427933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd5f5864-beeb-45aa-8abd-95747f0fd5c9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:43.428859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd5f5864-beeb-45aa-8abd-95747f0fd5c9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:43.438710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd5f5864-beeb-45aa-8abd-95747f0fd5c9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:43.672444 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cd5f5864-beeb-45aa-8abd-95747f0fd5c9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d/action" status: 200 len: 24553 microversion: 2.1 time: 0.383697 Aug 03 02:19:43.681322 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2627/5385] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:19:43 2022] POST /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d/action => generated 24553 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:19:43.694271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f55b986c-76e2-4872-a60a-b3042cfe9f38 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:43.695085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f55b986c-76e2-4872-a60a-b3042cfe9f38 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:44.047168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f55b986c-76e2-4872-a60a-b3042cfe9f38 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:44.070668 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f55b986c-76e2-4872-a60a-b3042cfe9f38 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1302 microversion: 2.1 time: 0.385514 Aug 03 02:19:44.080670 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2628/5386] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:43 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1302 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:45.115185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a9d6780d-e930-43b1-a8ac-89cc7e8d712e tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:45.116611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a9d6780d-e930-43b1-a8ac-89cc7e8d712e tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:45.431155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a9d6780d-e930-43b1-a8ac-89cc7e8d712e tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:45.450986 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a9d6780d-e930-43b1-a8ac-89cc7e8d712e tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1302 microversion: 2.1 time: 0.340077 Aug 03 02:19:45.456253 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2629/5387] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:45 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1302 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:19:45.941298 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-21860c09-3c0a-40a6-9faf-ecc05e0e3886 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "POST /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd/action" status: 202 len: 0 microversion: 2.1 time: 4.116149 Aug 03 02:19:45.943020 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2759/5388] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:19:41 2022] POST /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd/action => generated 0 bytes in 4119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:19:45.953524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ab96e374-87e2-432f-b22a-aa0afd5b1a51 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Action: 'create', calling method: .version_select at 0x7f5b1263c040>, body: {"pool": null} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:46.187590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-42064353-ecf7-46c3-bc61-ba810a1a899a req-ee1c10f3-19a9-4cb0-bd2d-891e8349575b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd", "tag": "bd81ca4e-3810-41d6-9cae-2ad76a762ddb"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:46.218412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-42064353-ecf7-46c3-bc61-ba810a1a899a req-ee1c10f3-19a9-4cb0-bd2d-891e8349575b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:46.219289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-42064353-ecf7-46c3-bc61-ba810a1a899a req-ee1c10f3-19a9-4cb0-bd2d-891e8349575b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:46.263208 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-42064353-ecf7-46c3-bc61-ba810a1a899a req-ee1c10f3-19a9-4cb0-bd2d-891e8349575b service nova] Creating event network-changed:bd81ca4e-3810-41d6-9cae-2ad76a762ddb for instance 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd on n-h2-826529-8 Aug 03 02:19:46.277231 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-42064353-ecf7-46c3-bc61-ba810a1a899a req-ee1c10f3-19a9-4cb0-bd2d-891e8349575b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091268 Aug 03 02:19:46.277540 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2760/5389] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:19:46.479311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b37401b5-efcc-439a-a5d7-bccaae7f6827 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:46.481574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b37401b5-efcc-439a-a5d7-bccaae7f6827 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:46.498696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b37401b5-efcc-439a-a5d7-bccaae7f6827 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:46.499389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b37401b5-efcc-439a-a5d7-bccaae7f6827 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:46.503938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b37401b5-efcc-439a-a5d7-bccaae7f6827 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:46.504596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b37401b5-efcc-439a-a5d7-bccaae7f6827 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:46.703708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b37401b5-efcc-439a-a5d7-bccaae7f6827 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:46.741411 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b37401b5-efcc-439a-a5d7-bccaae7f6827 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1354 microversion: 2.1 time: 0.266751 Aug 03 02:19:46.742957 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2761/5390] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:46 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1354 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:47.157204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-018602b7-c46d-42db-99d4-ba076864fd90 tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] Calling method '.version_select at 0x7f5b123c89d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:47.276951 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-018602b7-c46d-42db-99d4-ba076864fd90 tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ff8b2ef1-88b8-43ba-b1dc-a4264637a6df" status: 200 len: 350 microversion: 2.1 time: 0.124188 Aug 03 02:19:47.277871 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2762/5391] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:19:47 2022] GET /compute/v2.1/os-volumes/ff8b2ef1-88b8-43ba-b1dc-a4264637a6df => generated 350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:47.776077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-65bcaf8b-3e63-4228-a931-d1cd9e7953fa tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:47.776998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-65bcaf8b-3e63-4228-a931-d1cd9e7953fa tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:47.781105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:47.807651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65bcaf8b-3e63-4228-a931-d1cd9e7953fa tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:47.812749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65bcaf8b-3e63-4228-a931-d1cd9e7953fa tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:47.813877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65bcaf8b-3e63-4228-a931-d1cd9e7953fa tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:47.814563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-65bcaf8b-3e63-4228-a931-d1cd9e7953fa tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:48.272708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-65bcaf8b-3e63-4228-a931-d1cd9e7953fa tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:48.284396 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-65bcaf8b-3e63-4228-a931-d1cd9e7953fa tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1360 microversion: 2.1 time: 0.514292 Aug 03 02:19:48.289867 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2763/5392] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:47 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1360 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:19:49.325906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6203e97f-2d41-4fa4-9cf5-ce3c4ede11e1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:49.326655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6203e97f-2d41-4fa4-9cf5-ce3c4ede11e1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:49.342770 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6203e97f-2d41-4fa4-9cf5-ce3c4ede11e1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:49.343447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6203e97f-2d41-4fa4-9cf5-ce3c4ede11e1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:49.349098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6203e97f-2d41-4fa4-9cf5-ce3c4ede11e1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:49.350139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6203e97f-2d41-4fa4-9cf5-ce3c4ede11e1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:49.893930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6203e97f-2d41-4fa4-9cf5-ce3c4ede11e1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:49.932904 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6203e97f-2d41-4fa4-9cf5-ce3c4ede11e1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1428 microversion: 2.1 time: 0.611737 Aug 03 02:19:49.937838 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2764/5393] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:49 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1428 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:19:50.111618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3037ab6a-61ab-4aac-814f-4209eef1544e tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:50.112160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3037ab6a-61ab-4aac-814f-4209eef1544e tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:50.129293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3037ab6a-61ab-4aac-814f-4209eef1544e tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:50.130056 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3037ab6a-61ab-4aac-814f-4209eef1544e tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:50.131039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3037ab6a-61ab-4aac-814f-4209eef1544e tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:50.131875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3037ab6a-61ab-4aac-814f-4209eef1544e tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:50.702373 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3037ab6a-61ab-4aac-814f-4209eef1544e tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1834 microversion: 2.1 time: 0.594457 Aug 03 02:19:50.703521 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2765/5394] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:50 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1834 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:50.711413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-65c72e92-908f-455c-b06e-8c77436c9507 tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] Calling method '.version_select at 0x7f5b123358b0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:50.827454 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-65c72e92-908f-455c-b06e-8c77436c9507 tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/9de9e057-7dbf-4f13-b7ad-e9b8487acd13" status: 200 len: 350 microversion: 2.1 time: 0.120505 Aug 03 02:19:50.828408 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2766/5395] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:19:50 2022] GET /compute/v2.1/os-volumes/9de9e057-7dbf-4f13-b7ad-e9b8487acd13 => generated 350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:50.838857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-21bcf7b0-0c56-493c-9fed-2f80ba283270 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:50.841491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-21bcf7b0-0c56-493c-9fed-2f80ba283270 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:50.864657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21bcf7b0-0c56-493c-9fed-2f80ba283270 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:50.868894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21bcf7b0-0c56-493c-9fed-2f80ba283270 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:50.875620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21bcf7b0-0c56-493c-9fed-2f80ba283270 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:50.876651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21bcf7b0-0c56-493c-9fed-2f80ba283270 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:51.230235 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ab96e374-87e2-432f-b22a-aa0afd5b1a51 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.280757 Aug 03 02:19:51.242933 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2630/5396] 10.222.0.67 () {60 vars in 1170 bytes} [Wed Aug 3 02:19:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:19:51.248691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ece8f5d3-3b91-4599-b9b3-32993862a5c4 tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] Calling method '.version_select at 0x7f5b12a5a4c0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:51.501356 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ece8f5d3-3b91-4599-b9b3-32993862a5c4 tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.267492 Aug 03 02:19:51.502350 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2631/5397] 10.222.0.67 () {58 vars in 1134 bytes} [Wed Aug 3 02:19:51 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:51.514621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3ff713bc-869d-4b7c-af0a-4821820c7a35 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:51.515719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3ff713bc-869d-4b7c-af0a-4821820c7a35 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:51.532251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ff713bc-869d-4b7c-af0a-4821820c7a35 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:51.533135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ff713bc-869d-4b7c-af0a-4821820c7a35 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:51.534822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ff713bc-869d-4b7c-af0a-4821820c7a35 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:51.535671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ff713bc-869d-4b7c-af0a-4821820c7a35 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:51.922239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-21bcf7b0-0c56-493c-9fed-2f80ba283270 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:51.950250 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-21bcf7b0-0c56-493c-9fed-2f80ba283270 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1683 microversion: 2.1 time: 1.117002 Aug 03 02:19:51.953397 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2767/5398] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:50 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1683 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:51.981783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-039c8395-3cc7-40b9-98a5-236876e153b1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.169"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:51.989541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-039c8395-3cc7-40b9-98a5-236876e153b1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:52.012247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-039c8395-3cc7-40b9-98a5-236876e153b1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:52.014776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-039c8395-3cc7-40b9-98a5-236876e153b1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:52.019498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-039c8395-3cc7-40b9-98a5-236876e153b1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:52.020725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-039c8395-3cc7-40b9-98a5-236876e153b1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:52.103856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-039c8395-3cc7-40b9-98a5-236876e153b1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Acquired lock "refresh_cache-74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" {{(pid=125941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 02:19:52.558109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3ff713bc-869d-4b7c-af0a-4821820c7a35 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:52.569485 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3ff713bc-869d-4b7c-af0a-4821820c7a35 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1428 microversion: 2.1 time: 1.065233 Aug 03 02:19:52.570477 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2632/5399] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:51 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1428 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:52.820196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-e6f328ad-f43a-41a0-ba32-21f1c96beb75 req-08cc9929-5ad1-4a4f-9561-208e42949837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a", "tag": "569a4598-8a31-4c72-bdf1-8a8ce109284c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:52.839444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e6f328ad-f43a-41a0-ba32-21f1c96beb75 req-08cc9929-5ad1-4a4f-9561-208e42949837 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:52.840162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e6f328ad-f43a-41a0-ba32-21f1c96beb75 req-08cc9929-5ad1-4a4f-9561-208e42949837 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:52.857426 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e6f328ad-f43a-41a0-ba32-21f1c96beb75 req-08cc9929-5ad1-4a4f-9561-208e42949837 service nova] Creating event network-changed:569a4598-8a31-4c72-bdf1-8a8ce109284c for instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a on n-h1-826529-8 Aug 03 02:19:52.866436 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-e6f328ad-f43a-41a0-ba32-21f1c96beb75 req-08cc9929-5ad1-4a4f-9561-208e42949837 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.293268 Aug 03 02:19:52.867338 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2633/5400] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:52.878327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-09c649f5-65b1-47a1-86b4-681970bc8ba3 tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] Calling method '.version_select at 0x7f5b125bea60>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:52.954275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:53.028696 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-09c649f5-65b1-47a1-86b4-681970bc8ba3 tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.159182 Aug 03 02:19:53.029413 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2634/5401] 10.222.0.67 () {58 vars in 1149 bytes} [Wed Aug 3 02:19:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:53.035103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6be2847a-5d1f-44dc-b010-1161d4739f0c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:53.038674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6be2847a-5d1f-44dc-b010-1161d4739f0c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:53.048043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6be2847a-5d1f-44dc-b010-1161d4739f0c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:53.048840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6be2847a-5d1f-44dc-b010-1161d4739f0c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:53.049739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6be2847a-5d1f-44dc-b010-1161d4739f0c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:53.050304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6be2847a-5d1f-44dc-b010-1161d4739f0c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:53.225510 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6be2847a-5d1f-44dc-b010-1161d4739f0c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d/action" status: 200 len: 32629 microversion: 2.1 time: 0.193929 Aug 03 02:19:53.227628 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2635/5402] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:19:53 2022] POST /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d/action => generated 32629 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:19:53.238273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c9bac617-d650-4831-bc0a-3a07f48d172b tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] Calling method '.version_select at 0x7f5b125beaf0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:53.361715 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c9bac617-d650-4831-bc0a-3a07f48d172b tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.131428 Aug 03 02:19:53.371592 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2636/5403] 10.222.0.67 () {58 vars in 1134 bytes} [Wed Aug 3 02:19:53 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:53.382497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0a14c184-0449-438d-acb1-50e45645417b tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] Calling method '.version_select at 0x7f5b12657c10>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:53.477780 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0a14c184-0449-438d-acb1-50e45645417b tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.102781 Aug 03 02:19:53.480403 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2637/5404] 10.222.0.67 () {58 vars in 1167 bytes} [Wed Aug 3 02:19:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:19:53.486387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fdca84dc-d366-4ebc-8cd8-8cefbb0beaec tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:53.487178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fdca84dc-d366-4ebc-8cd8-8cefbb0beaec tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:53.496254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fdca84dc-d366-4ebc-8cd8-8cefbb0beaec tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:53.496722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fdca84dc-d366-4ebc-8cd8-8cefbb0beaec tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:53.497507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fdca84dc-d366-4ebc-8cd8-8cefbb0beaec tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:53.497956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fdca84dc-d366-4ebc-8cd8-8cefbb0beaec tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:53.538485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fdca84dc-d366-4ebc-8cd8-8cefbb0beaec tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fa41ed04e41440349d97150eec5cda93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc74eb87957b455ea415c59a57adc886', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:53.539512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fdca84dc-d366-4ebc-8cd8-8cefbb0beaec tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] flavor_id is None. Assuming migration. {{(pid=125942) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 03 02:19:53.540075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fdca84dc-d366-4ebc-8cd8-8cefbb0beaec tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125942) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 02:19:53.815753 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fdca84dc-d366-4ebc-8cd8-8cefbb0beaec tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d/action" status: 202 len: 0 microversion: 2.1 time: 0.334125 Aug 03 02:19:53.816623 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2638/5405] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:19:53 2022] POST /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:19:53.840048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e35466ba-a807-4116-b972-1f77a68d7d31 tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] Calling method '.version_select at 0x7f5b244da820>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:53.997637 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e35466ba-a807-4116-b972-1f77a68d7d31 tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.166821 Aug 03 02:19:53.999117 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2639/5406] 10.222.0.67 () {58 vars in 1170 bytes} [Wed Aug 3 02:19:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:54.005546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eafd8234-cb55-4a5c-a5e2-f9f0f2988c47 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:54.006691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eafd8234-cb55-4a5c-a5e2-f9f0f2988c47 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:54.015893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eafd8234-cb55-4a5c-a5e2-f9f0f2988c47 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:54.016731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eafd8234-cb55-4a5c-a5e2-f9f0f2988c47 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:54.018103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eafd8234-cb55-4a5c-a5e2-f9f0f2988c47 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:54.018785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eafd8234-cb55-4a5c-a5e2-f9f0f2988c47 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:54.402839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eafd8234-cb55-4a5c-a5e2-f9f0f2988c47 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:54.429446 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eafd8234-cb55-4a5c-a5e2-f9f0f2988c47 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1428 microversion: 2.1 time: 0.427985 Aug 03 02:19:54.437240 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2640/5407] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:53 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1428 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:54.453465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3a31290d-b0b3-4c58-bdfe-4d648bf79b64 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:54.454808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3a31290d-b0b3-4c58-bdfe-4d648bf79b64 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:54.475559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a31290d-b0b3-4c58-bdfe-4d648bf79b64 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:54.480429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a31290d-b0b3-4c58-bdfe-4d648bf79b64 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:54.484335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a31290d-b0b3-4c58-bdfe-4d648bf79b64 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:54.489644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a31290d-b0b3-4c58-bdfe-4d648bf79b64 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:54.876639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3a31290d-b0b3-4c58-bdfe-4d648bf79b64 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:54.895229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-039c8395-3cc7-40b9-98a5-236876e153b1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Building network info cache for instance {{(pid=125941) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 02:19:54.905794 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3a31290d-b0b3-4c58-bdfe-4d648bf79b64 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1692 microversion: 2.1 time: 0.455112 Aug 03 02:19:54.908734 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2641/5408] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:54 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1692 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:54.942614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6503e473-dd78-4443-851f-4440575a0eda tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] Calling method '.version_select at 0x7f5b1263cca0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:55.190525 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6503e473-dd78-4443-851f-4440575a0eda tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.263075 Aug 03 02:19:55.192546 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2642/5409] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 02:19:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:55.200505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-15f7cd00-4fe9-4ee4-bd59-30f2a5a10368 req-dc1fb3da-ad77-4600-afb5-725087e6fe93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd", "tag": "bd81ca4e-3810-41d6-9cae-2ad76a762ddb"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:55.230471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-15f7cd00-4fe9-4ee4-bd59-30f2a5a10368 req-dc1fb3da-ad77-4600-afb5-725087e6fe93 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:55.231342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-15f7cd00-4fe9-4ee4-bd59-30f2a5a10368 req-dc1fb3da-ad77-4600-afb5-725087e6fe93 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:55.249902 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-15f7cd00-4fe9-4ee4-bd59-30f2a5a10368 req-dc1fb3da-ad77-4600-afb5-725087e6fe93 service nova] Creating event network-changed:bd81ca4e-3810-41d6-9cae-2ad76a762ddb for instance 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd on n-h2-826529-8 Aug 03 02:19:55.280239 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-15f7cd00-4fe9-4ee4-bd59-30f2a5a10368 req-dc1fb3da-ad77-4600-afb5-725087e6fe93 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080706 Aug 03 02:19:55.283002 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2643/5410] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:55.312361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b522dfeb-0319-41ca-a265-d24c2fda60d6 tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] Calling method '.version_select at 0x7f5b12805b80>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:55.450186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=14 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:19:55.468760 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b522dfeb-0319-41ca-a265-d24c2fda60d6 tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.180270 Aug 03 02:19:55.470250 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2644/5411] 10.222.0.67 () {58 vars in 1188 bytes} [Wed Aug 3 02:19:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:19:55.476854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2788b670-16ec-4566-9410-06d18b636a6b tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:55.478178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2788b670-16ec-4566-9410-06d18b636a6b tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:55.539836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2788b670-16ec-4566-9410-06d18b636a6b tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:55.543327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2788b670-16ec-4566-9410-06d18b636a6b tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:55.545116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2788b670-16ec-4566-9410-06d18b636a6b tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:55.545820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2788b670-16ec-4566-9410-06d18b636a6b tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:56.079927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2788b670-16ec-4566-9410-06d18b636a6b tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:56.111038 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2788b670-16ec-4566-9410-06d18b636a6b tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1428 microversion: 2.1 time: 0.639040 Aug 03 02:19:56.115783 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2645/5412] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:55 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1428 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:56.125411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0f420f20-592b-4734-920a-99121ba612cb tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] Calling method '.version_select at 0x7f5b13dd2550>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:56.362155 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0f420f20-592b-4734-920a-99121ba612cb tempest-VolumesTestJSON-758083278 tempest-VolumesTestJSON-758083278-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.244386 Aug 03 02:19:56.363705 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2646/5413] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 3 02:19:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:56.374406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8bf46f3e-b334-4326-af2e-d5dba8713a12 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:56.375954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8bf46f3e-b334-4326-af2e-d5dba8713a12 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:56.404368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bf46f3e-b334-4326-af2e-d5dba8713a12 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:56.405240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bf46f3e-b334-4326-af2e-d5dba8713a12 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:56.406361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bf46f3e-b334-4326-af2e-d5dba8713a12 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:56.407682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8bf46f3e-b334-4326-af2e-d5dba8713a12 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:56.888884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8bf46f3e-b334-4326-af2e-d5dba8713a12 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:56.897627 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8bf46f3e-b334-4326-af2e-d5dba8713a12 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1692 microversion: 2.1 time: 0.532431 Aug 03 02:19:56.903324 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2647/5414] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:56 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1692 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:57.134117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-20db209a-7529-44b0-bd31-85ec4b40637c tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:57.135648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-20db209a-7529-44b0-bd31-85ec4b40637c tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:57.150944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20db209a-7529-44b0-bd31-85ec4b40637c tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:57.151817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20db209a-7529-44b0-bd31-85ec4b40637c tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:57.152450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20db209a-7529-44b0-bd31-85ec4b40637c tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:57.155349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-20db209a-7529-44b0-bd31-85ec4b40637c tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:57.907259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-039c8395-3cc7-40b9-98a5-236876e153b1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Updating instance_info_cache with network_info: [{"id": "bd81ca4e-3810-41d6-9cae-2ad76a762ddb", "address": "fa:16:3e:82:a7:7f", "network": {"id": "e9abcdb9-8f1c-4817-860f-de5d48418323", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1725839173-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4e00bbd702c4262ae98540dbc2c2440", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd81ca4e-38", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125941) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 02:19:57.929416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-039c8395-3cc7-40b9-98a5-236876e153b1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Releasing lock "refresh_cache-74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" {{(pid=125941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 02:19:57.930319 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-039c8395-3cc7-40b9-98a5-236876e153b1 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "POST /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd/action" status: 202 len: 0 microversion: 2.1 time: 5.971447 Aug 03 02:19:57.931786 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2768/5415] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:19:51 2022] POST /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd/action => generated 0 bytes in 5978 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 02:19:57.937819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-91c95dae-e6eb-4d11-bd6b-bb71bf9b9e36 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:57.938707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-91c95dae-e6eb-4d11-bd6b-bb71bf9b9e36 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:57.957607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91c95dae-e6eb-4d11-bd6b-bb71bf9b9e36 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:57.958361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91c95dae-e6eb-4d11-bd6b-bb71bf9b9e36 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:57.959359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91c95dae-e6eb-4d11-bd6b-bb71bf9b9e36 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:57.959958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91c95dae-e6eb-4d11-bd6b-bb71bf9b9e36 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:57.971406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-20db209a-7529-44b0-bd31-85ec4b40637c tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:57.993270 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-20db209a-7529-44b0-bd31-85ec4b40637c tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1428 microversion: 2.1 time: 0.862981 Aug 03 02:19:57.998990 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2648/5416] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:57 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1428 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:19:58.019157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fb3a4cfa-16df-41c8-92c1-e7524c55ec6c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.169"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:19:58.375544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fb3a4cfa-16df-41c8-92c1-e7524c55ec6c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:58.383688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb3a4cfa-16df-41c8-92c1-e7524c55ec6c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:58.384384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb3a4cfa-16df-41c8-92c1-e7524c55ec6c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:58.385834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb3a4cfa-16df-41c8-92c1-e7524c55ec6c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:58.386454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb3a4cfa-16df-41c8-92c1-e7524c55ec6c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:58.501554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-91c95dae-e6eb-4d11-bd6b-bb71bf9b9e36 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:19:58.511089 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-91c95dae-e6eb-4d11-bd6b-bb71bf9b9e36 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1692 microversion: 2.1 time: 0.577233 Aug 03 02:19:58.516624 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2769/5417] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:57 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1692 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:19:59.027186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-053efdea-7e97-49ee-9935-f567c390731f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:19:59.028675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-053efdea-7e97-49ee-9935-f567c390731f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:19:59.050787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-053efdea-7e97-49ee-9935-f567c390731f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:59.051560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-053efdea-7e97-49ee-9935-f567c390731f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:59.052658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-053efdea-7e97-49ee-9935-f567c390731f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:19:59.053262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-053efdea-7e97-49ee-9935-f567c390731f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:19:59.122448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb3a4cfa-16df-41c8-92c1-e7524c55ec6c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Acquired lock "refresh_cache-74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" {{(pid=125942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 02:20:00.714017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-053efdea-7e97-49ee-9935-f567c390731f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:00.722604 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-053efdea-7e97-49ee-9935-f567c390731f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1428 microversion: 2.1 time: 1.701553 Aug 03 02:20:00.739921 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2770/5418] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:19:59 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1428 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:00.943167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7c4f12ff-112d-4fb5-b77a-67c9b57e74a0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:00.944145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7c4f12ff-112d-4fb5-b77a-67c9b57e74a0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:00.965787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c4f12ff-112d-4fb5-b77a-67c9b57e74a0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:00.968273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c4f12ff-112d-4fb5-b77a-67c9b57e74a0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:00.970747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c4f12ff-112d-4fb5-b77a-67c9b57e74a0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:00.971422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c4f12ff-112d-4fb5-b77a-67c9b57e74a0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:01.514210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7c4f12ff-112d-4fb5-b77a-67c9b57e74a0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:01.518444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-fb3a4cfa-16df-41c8-92c1-e7524c55ec6c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Building network info cache for instance {{(pid=125942) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 02:20:01.529467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:20:01.547274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:20:01.550280 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7c4f12ff-112d-4fb5-b77a-67c9b57e74a0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1697 microversion: 2.1 time: 0.809012 Aug 03 02:20:01.567985 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2771/5419] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:00 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1697 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:01.581130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-38c48124-32e2-484d-bb63-1986e88ca13f req-4f2799e6-4c3c-4abe-9ee1-e4746f689288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a", "name": "network-vif-plugged", "status": "completed", "tag": "569a4598-8a31-4c72-bdf1-8a8ce109284c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:01.602327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:20:01.617535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-38c48124-32e2-484d-bb63-1986e88ca13f req-4f2799e6-4c3c-4abe-9ee1-e4746f689288 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:01.618274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-38c48124-32e2-484d-bb63-1986e88ca13f req-4f2799e6-4c3c-4abe-9ee1-e4746f689288 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:01.657073 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-38c48124-32e2-484d-bb63-1986e88ca13f req-4f2799e6-4c3c-4abe-9ee1-e4746f689288 service nova] Creating event network-vif-plugged:569a4598-8a31-4c72-bdf1-8a8ce109284c for instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a on n-h1-826529-8 Aug 03 02:20:01.681088 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-38c48124-32e2-484d-bb63-1986e88ca13f req-4f2799e6-4c3c-4abe-9ee1-e4746f689288 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094182 Aug 03 02:20:01.684203 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2772/5420] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:20:01.705384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-1e58ccf8-9f67-4380-b046-6287f4a30d10 req-a0f857e4-7aac-4135-871c-04595df361b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd", "tag": "bd81ca4e-3810-41d6-9cae-2ad76a762ddb"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:01.738609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1e58ccf8-9f67-4380-b046-6287f4a30d10 req-a0f857e4-7aac-4135-871c-04595df361b8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:01.740146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1e58ccf8-9f67-4380-b046-6287f4a30d10 req-a0f857e4-7aac-4135-871c-04595df361b8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:01.781778 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-1e58ccf8-9f67-4380-b046-6287f4a30d10 req-a0f857e4-7aac-4135-871c-04595df361b8 service nova] Creating event network-changed:bd81ca4e-3810-41d6-9cae-2ad76a762ddb for instance 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd on n-h2-826529-8 Aug 03 02:20:01.794342 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-1e58ccf8-9f67-4380-b046-6287f4a30d10 req-a0f857e4-7aac-4135-871c-04595df361b8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104238 Aug 03 02:20:01.797053 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2773/5421] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:20:01.808411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b6153c4-6860-4c19-a31f-843b13014725 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:01.809127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8b6153c4-6860-4c19-a31f-843b13014725 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:01.828654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b6153c4-6860-4c19-a31f-843b13014725 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:01.832747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b6153c4-6860-4c19-a31f-843b13014725 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:01.834915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b6153c4-6860-4c19-a31f-843b13014725 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:01.839326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b6153c4-6860-4c19-a31f-843b13014725 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:02.683535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8b6153c4-6860-4c19-a31f-843b13014725 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:02.698925 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8b6153c4-6860-4c19-a31f-843b13014725 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1428 microversion: 2.1 time: 0.899996 Aug 03 02:20:02.705000 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2774/5422] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:01 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1428 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:02.739214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-516eae39-855d-4e51-ae17-6d4b92d3fa43 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:02.740240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-516eae39-855d-4e51-ae17-6d4b92d3fa43 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:02.771528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-516eae39-855d-4e51-ae17-6d4b92d3fa43 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:02.775518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-516eae39-855d-4e51-ae17-6d4b92d3fa43 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:02.777077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-516eae39-855d-4e51-ae17-6d4b92d3fa43 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:02.782850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-516eae39-855d-4e51-ae17-6d4b92d3fa43 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:03.297897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-516eae39-855d-4e51-ae17-6d4b92d3fa43 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:03.317714 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-516eae39-855d-4e51-ae17-6d4b92d3fa43 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1697 microversion: 2.1 time: 0.603017 Aug 03 02:20:03.318320 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2775/5423] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:02 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1697 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:03.429119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-fb3a4cfa-16df-41c8-92c1-e7524c55ec6c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Updating instance_info_cache with network_info: [{"id": "bd81ca4e-3810-41d6-9cae-2ad76a762ddb", "address": "fa:16:3e:82:a7:7f", "network": {"id": "e9abcdb9-8f1c-4817-860f-de5d48418323", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1725839173-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b4e00bbd702c4262ae98540dbc2c2440", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd81ca4e-38", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125942) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 02:20:03.447649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb3a4cfa-16df-41c8-92c1-e7524c55ec6c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Releasing lock "refresh_cache-74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" {{(pid=125942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 02:20:03.450646 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fb3a4cfa-16df-41c8-92c1-e7524c55ec6c tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "POST /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd/action" status: 202 len: 0 microversion: 2.1 time: 5.434974 Aug 03 02:20:03.451482 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2649/5424] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:19:58 2022] POST /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd/action => generated 0 bytes in 5450 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 02:20:03.460245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eaabd590-2d77-42d6-98a8-59114013ff75 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '.version_select at 0x7f5b24423040>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:03.732718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ab2eb02c-8809-4f44-9e56-50eb2d61522f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:03.733648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ab2eb02c-8809-4f44-9e56-50eb2d61522f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:03.743106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:20:03.746159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab2eb02c-8809-4f44-9e56-50eb2d61522f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:03.751548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab2eb02c-8809-4f44-9e56-50eb2d61522f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:03.752567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab2eb02c-8809-4f44-9e56-50eb2d61522f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:03.753215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ab2eb02c-8809-4f44-9e56-50eb2d61522f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:05.065980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ab2eb02c-8809-4f44-9e56-50eb2d61522f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:05.081020 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ab2eb02c-8809-4f44-9e56-50eb2d61522f tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1607 microversion: 2.1 time: 1.355462 Aug 03 02:20:05.096100 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2650/5425] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:03 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1607 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:05.100353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dd853539-e645-4dcc-a69d-f1800babc2ba tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:05.110799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dd853539-e645-4dcc-a69d-f1800babc2ba tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:05.135533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd853539-e645-4dcc-a69d-f1800babc2ba tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:05.140323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd853539-e645-4dcc-a69d-f1800babc2ba tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:05.141999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd853539-e645-4dcc-a69d-f1800babc2ba tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:05.149130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd853539-e645-4dcc-a69d-f1800babc2ba tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:06.009968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dd853539-e645-4dcc-a69d-f1800babc2ba tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:06.028830 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dd853539-e645-4dcc-a69d-f1800babc2ba tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1697 microversion: 2.1 time: 0.936997 Aug 03 02:20:06.029788 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2651/5426] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:05 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1697 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:06.036234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e96bbf7c-ea88-4b7a-b5a4-8dc8d8eaaac1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:06.037831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e96bbf7c-ea88-4b7a-b5a4-8dc8d8eaaac1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:06.052820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e96bbf7c-ea88-4b7a-b5a4-8dc8d8eaaac1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:06.059886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e96bbf7c-ea88-4b7a-b5a4-8dc8d8eaaac1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:06.060834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e96bbf7c-ea88-4b7a-b5a4-8dc8d8eaaac1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:06.061293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e96bbf7c-ea88-4b7a-b5a4-8dc8d8eaaac1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:07.129966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e96bbf7c-ea88-4b7a-b5a4-8dc8d8eaaac1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:07.153883 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e96bbf7c-ea88-4b7a-b5a4-8dc8d8eaaac1 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1607 microversion: 2.1 time: 1.122438 Aug 03 02:20:07.175758 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2652/5427] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:06 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1607 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:07.199723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4d7a3d14-faaf-4188-90d9-b6149d5cc792 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:07.201050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4d7a3d14-faaf-4188-90d9-b6149d5cc792 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:07.222714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d7a3d14-faaf-4188-90d9-b6149d5cc792 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:07.223521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d7a3d14-faaf-4188-90d9-b6149d5cc792 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:07.224872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d7a3d14-faaf-4188-90d9-b6149d5cc792 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:07.225641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4d7a3d14-faaf-4188-90d9-b6149d5cc792 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:07.968626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4d7a3d14-faaf-4188-90d9-b6149d5cc792 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:07.977458 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4d7a3d14-faaf-4188-90d9-b6149d5cc792 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1697 microversion: 2.1 time: 0.800054 Aug 03 02:20:07.978397 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2653/5428] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:07 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1697 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:07.984743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-10423b4a-9eee-48d2-8cea-31f1af13aff8 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:07.986381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-10423b4a-9eee-48d2-8cea-31f1af13aff8 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:07.994571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-10423b4a-9eee-48d2-8cea-31f1af13aff8 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:07.995428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-10423b4a-9eee-48d2-8cea-31f1af13aff8 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:07.996499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-10423b4a-9eee-48d2-8cea-31f1af13aff8 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:07.997179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-10423b4a-9eee-48d2-8cea-31f1af13aff8 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:08.064624 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eaabd590-2d77-42d6-98a8-59114013ff75 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "DELETE /compute/v2.1/os-floating-ips/8a1173ad-668f-4762-9c7f-7d3eebb161d9" status: 202 len: 0 microversion: 2.1 time: 4.607463 Aug 03 02:20:08.069565 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2776/5429] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 02:20:03 2022] DELETE /compute/v2.1/os-floating-ips/8a1173ad-668f-4762-9c7f-7d3eebb161d9 => generated 0 bytes in 4614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:20:08.081797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5c3ee9d5-3f99-4ef2-a47e-b21737fcb734 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '.version_select at 0x7f5b1228f8b0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:08.456581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-10423b4a-9eee-48d2-8cea-31f1af13aff8 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:08.471317 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-10423b4a-9eee-48d2-8cea-31f1af13aff8 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1607 microversion: 2.1 time: 0.491001 Aug 03 02:20:08.480112 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2654/5430] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:07 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1607 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:08.774090 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5c3ee9d5-3f99-4ef2-a47e-b21737fcb734 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "DELETE /compute/v2.1/os-security-groups/aedd2827-76b3-4f37-9de7-e4c8f758e19f" status: 202 len: 0 microversion: 2.1 time: 0.696640 Aug 03 02:20:08.776112 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2777/5431] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 02:20:08 2022] DELETE /compute/v2.1/os-security-groups/aedd2827-76b3-4f37-9de7-e4c8f758e19f => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:20:08.792028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-299c0580-72f2-4bc3-85d0-32bdb069b0ab tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:08.792774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-299c0580-72f2-4bc3-85d0-32bdb069b0ab tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:08.820784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-299c0580-72f2-4bc3-85d0-32bdb069b0ab tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:08.822379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-299c0580-72f2-4bc3-85d0-32bdb069b0ab tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:08.827444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-299c0580-72f2-4bc3-85d0-32bdb069b0ab tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:08.833009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-299c0580-72f2-4bc3-85d0-32bdb069b0ab tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:08.944056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-299c0580-72f2-4bc3-85d0-32bdb069b0ab tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:20:09.008115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b248c195-254c-4dda-8856-b1a65c7a78bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:09.008747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b248c195-254c-4dda-8856-b1a65c7a78bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:09.023473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b248c195-254c-4dda-8856-b1a65c7a78bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:09.032239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b248c195-254c-4dda-8856-b1a65c7a78bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:09.032569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b248c195-254c-4dda-8856-b1a65c7a78bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:09.032926 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b248c195-254c-4dda-8856-b1a65c7a78bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:09.171699 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-299c0580-72f2-4bc3-85d0-32bdb069b0ab tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "DELETE /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 204 len: 0 microversion: 2.1 time: 0.389349 Aug 03 02:20:09.178872 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2655/5432] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:20:08 2022] DELETE /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:20:09.186883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8a9bdffe-97b4-4c4a-af88-2a4d974ffcee tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:09.187631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8a9bdffe-97b4-4c4a-af88-2a4d974ffcee tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:09.204387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8a9bdffe-97b4-4c4a-af88-2a4d974ffcee tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:09.205374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8a9bdffe-97b4-4c4a-af88-2a4d974ffcee tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:09.209927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8a9bdffe-97b4-4c4a-af88-2a4d974ffcee tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:09.210418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8a9bdffe-97b4-4c4a-af88-2a4d974ffcee tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:09.531456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b248c195-254c-4dda-8856-b1a65c7a78bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:09.544237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8a9bdffe-97b4-4c4a-af88-2a4d974ffcee tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:09.554649 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8a9bdffe-97b4-4c4a-af88-2a4d974ffcee tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1510 microversion: 2.1 time: 0.373738 Aug 03 02:20:09.556210 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2656/5433] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:09 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1510 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:09.564089 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b248c195-254c-4dda-8856-b1a65c7a78bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1697 microversion: 2.1 time: 0.561970 Aug 03 02:20:09.564992 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2778/5434] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:09 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1697 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:10.586619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a80b776c-6252-4b10-aa5f-3cab8f042253 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:10.590374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f7461efd-cc46-4935-bea1-b8c9bbc0279e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:10.591305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a80b776c-6252-4b10-aa5f-3cab8f042253 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:10.591701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f7461efd-cc46-4935-bea1-b8c9bbc0279e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:10.599470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7461efd-cc46-4935-bea1-b8c9bbc0279e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:10.600315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7461efd-cc46-4935-bea1-b8c9bbc0279e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:10.601281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7461efd-cc46-4935-bea1-b8c9bbc0279e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:10.601890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7461efd-cc46-4935-bea1-b8c9bbc0279e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:10.619742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a80b776c-6252-4b10-aa5f-3cab8f042253 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:10.621057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a80b776c-6252-4b10-aa5f-3cab8f042253 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:10.623854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a80b776c-6252-4b10-aa5f-3cab8f042253 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:10.625646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a80b776c-6252-4b10-aa5f-3cab8f042253 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:11.172270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f7461efd-cc46-4935-bea1-b8c9bbc0279e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:11.197803 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f7461efd-cc46-4935-bea1-b8c9bbc0279e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1697 microversion: 2.1 time: 0.612058 Aug 03 02:20:11.215650 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2779/5435] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:10 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1697 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:11.222018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a80b776c-6252-4b10-aa5f-3cab8f042253 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:11.238629 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a80b776c-6252-4b10-aa5f-3cab8f042253 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1510 microversion: 2.1 time: 0.663550 Aug 03 02:20:11.242130 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2657/5436] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:10 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1510 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:12.225629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-93816f44-292a-4411-bcf6-aa1aaa751ae5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:12.225629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-93816f44-292a-4411-bcf6-aa1aaa751ae5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:12.237828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93816f44-292a-4411-bcf6-aa1aaa751ae5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:12.238296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93816f44-292a-4411-bcf6-aa1aaa751ae5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:12.239143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93816f44-292a-4411-bcf6-aa1aaa751ae5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:12.239779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93816f44-292a-4411-bcf6-aa1aaa751ae5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:12.279956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-de4bcf14-9090-4d50-afff-33cdc9261224 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:12.281569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-de4bcf14-9090-4d50-afff-33cdc9261224 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:12.301867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de4bcf14-9090-4d50-afff-33cdc9261224 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:12.303850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de4bcf14-9090-4d50-afff-33cdc9261224 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:12.306248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de4bcf14-9090-4d50-afff-33cdc9261224 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:12.307964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de4bcf14-9090-4d50-afff-33cdc9261224 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:12.884516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-de4bcf14-9090-4d50-afff-33cdc9261224 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:12.901527 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-de4bcf14-9090-4d50-afff-33cdc9261224 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1510 microversion: 2.1 time: 0.632432 Aug 03 02:20:12.902048 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2658/5437] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:12 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1510 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:13.237004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-93816f44-292a-4411-bcf6-aa1aaa751ae5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:13.250856 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-93816f44-292a-4411-bcf6-aa1aaa751ae5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1696 microversion: 2.1 time: 1.030889 Aug 03 02:20:13.251740 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2780/5438] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:12 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1696 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:13.364728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-9d6dc7d4-dc5f-4f31-aed9-7b06866e621f req-e3f17a08-eb5f-48f9-bcc3-276b0b76fa33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a", "tag": "569a4598-8a31-4c72-bdf1-8a8ce109284c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:13.401476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9d6dc7d4-dc5f-4f31-aed9-7b06866e621f req-e3f17a08-eb5f-48f9-bcc3-276b0b76fa33 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:13.402281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9d6dc7d4-dc5f-4f31-aed9-7b06866e621f req-e3f17a08-eb5f-48f9-bcc3-276b0b76fa33 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:13.421094 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-9d6dc7d4-dc5f-4f31-aed9-7b06866e621f req-e3f17a08-eb5f-48f9-bcc3-276b0b76fa33 service nova] Creating event network-changed:569a4598-8a31-4c72-bdf1-8a8ce109284c for instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a on n-h1-826529-8 Aug 03 02:20:13.427323 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-9d6dc7d4-dc5f-4f31-aed9-7b06866e621f req-e3f17a08-eb5f-48f9-bcc3-276b0b76fa33 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070386 Aug 03 02:20:13.429747 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2659/5439] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:20:13.864103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2f25d538-b94c-4fbc-bf81-6435b83552a3 req-12d54063-d32a-4947-8869-b8f1edc7c6be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c8dd50-04d8-4c90-8de9-81ab009cd56d", "name": "network-vif-unplugged", "status": "completed", "tag": "98bf134d-7968-4dd0-b846-f2029a0e70d1"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:13.891010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2f25d538-b94c-4fbc-bf81-6435b83552a3 req-12d54063-d32a-4947-8869-b8f1edc7c6be service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:13.891820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2f25d538-b94c-4fbc-bf81-6435b83552a3 req-12d54063-d32a-4947-8869-b8f1edc7c6be service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:13.924011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7fdfd4f5-1dfe-49bb-874b-0f38ff86e0a5 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:13.926469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7fdfd4f5-1dfe-49bb-874b-0f38ff86e0a5 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:13.940670 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2f25d538-b94c-4fbc-bf81-6435b83552a3 req-12d54063-d32a-4947-8869-b8f1edc7c6be service nova] Creating event network-vif-unplugged:98bf134d-7968-4dd0-b846-f2029a0e70d1 for instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d on n-h2-826529-8 Aug 03 02:20:13.943391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fdfd4f5-1dfe-49bb-874b-0f38ff86e0a5 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:13.945431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fdfd4f5-1dfe-49bb-874b-0f38ff86e0a5 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:13.950122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fdfd4f5-1dfe-49bb-874b-0f38ff86e0a5 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:13.951362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fdfd4f5-1dfe-49bb-874b-0f38ff86e0a5 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:13.976154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-2f25d538-b94c-4fbc-bf81-6435b83552a3 req-12d54063-d32a-4947-8869-b8f1edc7c6be service nova] Instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:20:14.027908 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2f25d538-b94c-4fbc-bf81-6435b83552a3 req-12d54063-d32a-4947-8869-b8f1edc7c6be service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.169942 Aug 03 02:20:14.033796 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2781/5440] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:20:14.277908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-de06022e-21c7-4b98-9aec-9e643cd8612e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:14.280301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-de06022e-21c7-4b98-9aec-9e643cd8612e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:14.300114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de06022e-21c7-4b98-9aec-9e643cd8612e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:14.302827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de06022e-21c7-4b98-9aec-9e643cd8612e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:14.307128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de06022e-21c7-4b98-9aec-9e643cd8612e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:14.307942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de06022e-21c7-4b98-9aec-9e643cd8612e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:15.224028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7fdfd4f5-1dfe-49bb-874b-0f38ff86e0a5 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d3a802377f42d5b23e38a4bb19584e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e00bbd702c4262ae98540dbc2c2440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:15.242554 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7fdfd4f5-1dfe-49bb-874b-0f38ff86e0a5 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 200 len: 1510 microversion: 2.1 time: 1.323463 Aug 03 02:20:15.248541 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2660/5441] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:13 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 1510 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:15.288465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-de06022e-21c7-4b98-9aec-9e643cd8612e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:15.297757 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-de06022e-21c7-4b98-9aec-9e643cd8612e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1696 microversion: 2.1 time: 1.027771 Aug 03 02:20:15.311721 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2782/5442] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:14 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1696 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:16.100108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-8ebd3af8-0d70-4a6e-a362-8d075835ebc3 req-406f9411-6b5b-4ab3-acd8-8ab6c8bea6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd", "name": "network-vif-deleted", "tag": "bd81ca4e-3810-41d6-9cae-2ad76a762ddb"}, {"name": "network-changed", "server_uuid": "a2c8dd50-04d8-4c90-8de9-81ab009cd56d", "tag": "98bf134d-7968-4dd0-b846-f2029a0e70d1"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:16.131797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8ebd3af8-0d70-4a6e-a362-8d075835ebc3 req-406f9411-6b5b-4ab3-acd8-8ab6c8bea6ee service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:16.132316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8ebd3af8-0d70-4a6e-a362-8d075835ebc3 req-406f9411-6b5b-4ab3-acd8-8ab6c8bea6ee service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:16.165293 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-8ebd3af8-0d70-4a6e-a362-8d075835ebc3 req-406f9411-6b5b-4ab3-acd8-8ab6c8bea6ee service nova] Creating event network-vif-deleted:bd81ca4e-3810-41d6-9cae-2ad76a762ddb for instance 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd on n-h2-826529-8 Aug 03 02:20:16.166063 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-8ebd3af8-0d70-4a6e-a362-8d075835ebc3 req-406f9411-6b5b-4ab3-acd8-8ab6c8bea6ee service nova] Creating event network-changed:98bf134d-7968-4dd0-b846-f2029a0e70d1 for instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d on n-h2-826529-8 Aug 03 02:20:16.186569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-8ebd3af8-0d70-4a6e-a362-8d075835ebc3 req-406f9411-6b5b-4ab3-acd8-8ab6c8bea6ee service nova] Instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:20:16.220153 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-8ebd3af8-0d70-4a6e-a362-8d075835ebc3 req-406f9411-6b5b-4ab3-acd8-8ab6c8bea6ee service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.124788 Aug 03 02:20:16.220931 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2661/5443] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:20:16.283745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b0b97513-58fd-43bc-b1bb-464d696c83c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:16.284622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b0b97513-58fd-43bc-b1bb-464d696c83c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] [instance: 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:16.297578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0b97513-58fd-43bc-b1bb-464d696c83c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:16.301271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0b97513-58fd-43bc-b1bb-464d696c83c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:16.302385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0b97513-58fd-43bc-b1bb-464d696c83c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:16.305018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0b97513-58fd-43bc-b1bb-464d696c83c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:16.328436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-778a8a7c-b0e3-49eb-9a51-3a81d707ecfd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:16.329944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-778a8a7c-b0e3-49eb-9a51-3a81d707ecfd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:16.359054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-778a8a7c-b0e3-49eb-9a51-3a81d707ecfd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:16.360259 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-778a8a7c-b0e3-49eb-9a51-3a81d707ecfd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:16.361350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-778a8a7c-b0e3-49eb-9a51-3a81d707ecfd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:16.362815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-778a8a7c-b0e3-49eb-9a51-3a81d707ecfd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:16.372068 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-b0b97513-58fd-43bc-b1bb-464d696c83c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] HTTP exception thrown: Instance 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd could not be found. Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b0b97513-58fd-43bc-b1bb-464d696c83c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Request method failure captured: Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd HTTP/1.1 Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dr3ZqpuSwqKllDMdzhBXlevCzWt5JA4m2bbLJNC8OEQk7HT5YqbzYiwrDzEQKZnOZrBGv3JTfhXwS8uvO2efiAM14M0ta9DTYx6kPknn4ifZ8wvrjl_E9wjfnBR7zhtmW1qfzjlBDtElAtBTurCgcN8TFImMldB2vmyA-4OkiQ0KII Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: b4e00bbd702c4262ae98540dbc2c2440 Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1526493907 Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b4e00bbd702c4262ae98540dbc2c2440", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4e00bbd702c4262ae98540dbc2c2440"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b4e00bbd702c4262ae98540dbc2c2440"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4e00bbd702c4262ae98540dbc2c2440"}]}] Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1526493907 Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: b4e00bbd702c4262ae98540dbc2c2440 Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1526493907 Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerRescueTestJSONUnderV235-1526493907-project Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 20d3a802377f42d5b23e38a4bb19584e Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1526493907-project Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd could not be found. Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd'} Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd could not be found. Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd could not be found. Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:20:16.376754 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:20:16.380812 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:20:16.380812 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:20:16.380812 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:20:16.380812 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:20:16.380812 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:20:16.380812 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:20:16.380812 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd could not be found. Aug 03 02:20:16.380812 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:20:16.380812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b0b97513-58fd-43bc-b1bb-464d696c83c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] Returning 404 to user: Instance 74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:20:16.380812 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b0b97513-58fd-43bc-b1bb-464d696c83c8 tempest-ServerRescueTestJSONUnderV235-1526493907 tempest-ServerRescueTestJSONUnderV235-1526493907-project] 10.222.0.67 "GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd" status: 404 len: 111 microversion: 2.1 time: 0.099339 Aug 03 02:20:16.395422 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2783/5444] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:16 2022] GET /compute/v2.1/servers/74f9b9e3-0d3c-4e8e-8aa3-bd3d784e54bd => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:20:16.912986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-778a8a7c-b0e3-49eb-9a51-3a81d707ecfd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:16.940191 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-778a8a7c-b0e3-49eb-9a51-3a81d707ecfd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1696 microversion: 2.1 time: 0.618461 Aug 03 02:20:16.940817 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2662/5445] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:16 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1696 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:17.424011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0a027253-0c56-4db0-8d16-f518be8eceef tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:17.424838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0a027253-0c56-4db0-8d16-f518be8eceef tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:17.447399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a027253-0c56-4db0-8d16-f518be8eceef tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:17.450490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a027253-0c56-4db0-8d16-f518be8eceef tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:17.451452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a027253-0c56-4db0-8d16-f518be8eceef tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:17.461067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a027253-0c56-4db0-8d16-f518be8eceef tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:17.522850 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0a027253-0c56-4db0-8d16-f518be8eceef tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/ips" status: 200 len: 144 microversion: 2.1 time: 0.107661 Aug 03 02:20:17.533860 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2784/5446] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 02:20:17 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/ips => generated 144 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:20:17.967285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-141fba0d-7f37-49a8-9887-77c2459335f5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:17.969580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-141fba0d-7f37-49a8-9887-77c2459335f5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:18.003200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-141fba0d-7f37-49a8-9887-77c2459335f5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:18.004053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-141fba0d-7f37-49a8-9887-77c2459335f5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:18.005173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-141fba0d-7f37-49a8-9887-77c2459335f5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:18.009927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-141fba0d-7f37-49a8-9887-77c2459335f5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:18.778073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-141fba0d-7f37-49a8-9887-77c2459335f5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:18.791294 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-141fba0d-7f37-49a8-9887-77c2459335f5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1694 microversion: 2.1 time: 0.827636 Aug 03 02:20:18.802943 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2663/5447] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:17 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1694 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:19.829271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-00bbfdb1-d233-4d8c-92ec-977c2eaec0d5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:19.829899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-00bbfdb1-d233-4d8c-92ec-977c2eaec0d5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:19.844812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00bbfdb1-d233-4d8c-92ec-977c2eaec0d5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:19.845275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00bbfdb1-d233-4d8c-92ec-977c2eaec0d5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:19.846091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00bbfdb1-d233-4d8c-92ec-977c2eaec0d5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:19.846529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00bbfdb1-d233-4d8c-92ec-977c2eaec0d5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:21.030222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-00bbfdb1-d233-4d8c-92ec-977c2eaec0d5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:21.061674 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-00bbfdb1-d233-4d8c-92ec-977c2eaec0d5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1694 microversion: 2.1 time: 1.215436 Aug 03 02:20:21.071970 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2785/5448] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:19 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1694 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:22.095271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-400db92f-4e23-429a-aeb8-5758b45cef66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:22.095938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-400db92f-4e23-429a-aeb8-5758b45cef66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:22.114289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-400db92f-4e23-429a-aeb8-5758b45cef66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:22.128211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-400db92f-4e23-429a-aeb8-5758b45cef66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:22.138272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-400db92f-4e23-429a-aeb8-5758b45cef66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:22.140042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-400db92f-4e23-429a-aeb8-5758b45cef66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:22.611698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-400db92f-4e23-429a-aeb8-5758b45cef66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:22.618875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:20:22.628343 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-400db92f-4e23-429a-aeb8-5758b45cef66 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1691 microversion: 2.1 time: 0.536257 Aug 03 02:20:22.629725 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2664/5449] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:22 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1691 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:22.663352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ad6f0524-642d-4f74-95b7-790fe14dd68a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:22.663926 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ad6f0524-642d-4f74-95b7-790fe14dd68a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:22.693344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad6f0524-642d-4f74-95b7-790fe14dd68a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:22.694082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad6f0524-642d-4f74-95b7-790fe14dd68a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:22.700802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad6f0524-642d-4f74-95b7-790fe14dd68a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:22.701304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad6f0524-642d-4f74-95b7-790fe14dd68a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:22.768636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d93bc8ac-1205-433d-b4c4-f4381819a431 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d474dbea-b13f-4db8-963d-110a7a2f1724"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:22.780263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d93bc8ac-1205-433d-b4c4-f4381819a431 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:22.807838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d93bc8ac-1205-433d-b4c4-f4381819a431 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:22.808311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d93bc8ac-1205-433d-b4c4-f4381819a431 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:22.809164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d93bc8ac-1205-433d-b4c4-f4381819a431 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:22.817641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d93bc8ac-1205-433d-b4c4-f4381819a431 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:22.920190 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ad6f0524-642d-4f74-95b7-790fe14dd68a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d/action" status: 202 len: 0 microversion: 2.1 time: 0.255728 Aug 03 02:20:22.928664 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2786/5450] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:20:22 2022] POST /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:20:22.947634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-38f766d0-f818-4fc0-9e86-4649fe530d77 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:22.949190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-38f766d0-f818-4fc0-9e86-4649fe530d77 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:22.982131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38f766d0-f818-4fc0-9e86-4649fe530d77 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:22.982629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38f766d0-f818-4fc0-9e86-4649fe530d77 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:22.983509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38f766d0-f818-4fc0-9e86-4649fe530d77 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:22.983952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38f766d0-f818-4fc0-9e86-4649fe530d77 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:23.548943 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d93bc8ac-1205-433d-b4c4-f4381819a431 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "POST /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.796607 Aug 03 02:20:23.564726 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2665/5451] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:20:22 2022] POST /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/os-volume_attachments => generated 194 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:20:23.763444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-38f766d0-f818-4fc0-9e86-4649fe530d77 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:23.779464 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-38f766d0-f818-4fc0-9e86-4649fe530d77 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1690 microversion: 2.1 time: 0.843875 Aug 03 02:20:23.780733 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2787/5452] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:22 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1690 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:23.892613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-59f4b590-eafe-4da3-8f9d-0a34bcff0868 req-4b4898aa-d4b6-45f7-a117-fe3b5e3bc76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c8dd50-04d8-4c90-8de9-81ab009cd56d", "name": "network-vif-plugged", "status": "completed", "tag": "98bf134d-7968-4dd0-b846-f2029a0e70d1"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:23.939481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-59f4b590-eafe-4da3-8f9d-0a34bcff0868 req-4b4898aa-d4b6-45f7-a117-fe3b5e3bc76c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:23.940172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-59f4b590-eafe-4da3-8f9d-0a34bcff0868 req-4b4898aa-d4b6-45f7-a117-fe3b5e3bc76c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:23.975651 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-59f4b590-eafe-4da3-8f9d-0a34bcff0868 req-4b4898aa-d4b6-45f7-a117-fe3b5e3bc76c service nova] Creating event network-vif-plugged:98bf134d-7968-4dd0-b846-f2029a0e70d1 for instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d on n-h2-826529-8 Aug 03 02:20:23.996603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-59f4b590-eafe-4da3-8f9d-0a34bcff0868 req-4b4898aa-d4b6-45f7-a117-fe3b5e3bc76c service nova] Instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:20:24.021443 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-59f4b590-eafe-4da3-8f9d-0a34bcff0868 req-4b4898aa-d4b6-45f7-a117-fe3b5e3bc76c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132766 Aug 03 02:20:24.024849 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2666/5453] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:20:24.804903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0a69ff80-ec33-4375-97ce-caa0815ca3fb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:24.807930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0a69ff80-ec33-4375-97ce-caa0815ca3fb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:24.819360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a69ff80-ec33-4375-97ce-caa0815ca3fb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:24.820140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a69ff80-ec33-4375-97ce-caa0815ca3fb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:24.821375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a69ff80-ec33-4375-97ce-caa0815ca3fb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:24.822476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a69ff80-ec33-4375-97ce-caa0815ca3fb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:25.405731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a69ff80-ec33-4375-97ce-caa0815ca3fb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:25.421278 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0a69ff80-ec33-4375-97ce-caa0815ca3fb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1690 microversion: 2.1 time: 0.623103 Aug 03 02:20:25.422000 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2788/5454] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:24 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1690 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:26.449005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bd9b479c-bde8-4d31-b02f-70dcd98cec56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:26.449754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bd9b479c-bde8-4d31-b02f-70dcd98cec56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:26.467499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd9b479c-bde8-4d31-b02f-70dcd98cec56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:26.468215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd9b479c-bde8-4d31-b02f-70dcd98cec56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:26.469277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd9b479c-bde8-4d31-b02f-70dcd98cec56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:26.469900 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd9b479c-bde8-4d31-b02f-70dcd98cec56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:26.981136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bd9b479c-bde8-4d31-b02f-70dcd98cec56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:26.990977 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bd9b479c-bde8-4d31-b02f-70dcd98cec56 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1690 microversion: 2.1 time: 0.547164 Aug 03 02:20:26.991526 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2667/5455] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:26 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1690 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:28.014341 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7014f916-448e-41e8-b69f-2f90037731f0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:28.015863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7014f916-448e-41e8-b69f-2f90037731f0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:28.028538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7014f916-448e-41e8-b69f-2f90037731f0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:28.034491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7014f916-448e-41e8-b69f-2f90037731f0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:28.036531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7014f916-448e-41e8-b69f-2f90037731f0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:28.037032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7014f916-448e-41e8-b69f-2f90037731f0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:28.631101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7014f916-448e-41e8-b69f-2f90037731f0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:28.654293 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7014f916-448e-41e8-b69f-2f90037731f0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1690 microversion: 2.1 time: 0.643710 Aug 03 02:20:28.672482 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2789/5456] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:28 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1690 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:29.677762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ebeb9640-e7dd-4c0d-8144-16e440c363bd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:29.681738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ebeb9640-e7dd-4c0d-8144-16e440c363bd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:29.695222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebeb9640-e7dd-4c0d-8144-16e440c363bd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:29.696404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebeb9640-e7dd-4c0d-8144-16e440c363bd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:29.718293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebeb9640-e7dd-4c0d-8144-16e440c363bd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:29.718880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ebeb9640-e7dd-4c0d-8144-16e440c363bd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:30.043517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ebeb9640-e7dd-4c0d-8144-16e440c363bd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:30.056022 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ebeb9640-e7dd-4c0d-8144-16e440c363bd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1690 microversion: 2.1 time: 0.381105 Aug 03 02:20:30.067138 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2668/5457] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:29 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1690 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:30.566641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-b0436cce-9df6-48dd-846d-e2761147ba03 req-9a8a1ed0-75d0-4931-bdc9-63ca9d948f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c8dd50-04d8-4c90-8de9-81ab009cd56d", "name": "network-vif-unplugged", "status": "completed", "tag": "98bf134d-7968-4dd0-b846-f2029a0e70d1"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:30.589386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b0436cce-9df6-48dd-846d-e2761147ba03 req-9a8a1ed0-75d0-4931-bdc9-63ca9d948f40 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:30.593515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b0436cce-9df6-48dd-846d-e2761147ba03 req-9a8a1ed0-75d0-4931-bdc9-63ca9d948f40 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:30.641200 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-b0436cce-9df6-48dd-846d-e2761147ba03 req-9a8a1ed0-75d0-4931-bdc9-63ca9d948f40 service nova] Creating event network-vif-unplugged:98bf134d-7968-4dd0-b846-f2029a0e70d1 for instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d on n-h1-826529-8 Aug 03 02:20:30.657490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-b0436cce-9df6-48dd-846d-e2761147ba03 req-9a8a1ed0-75d0-4931-bdc9-63ca9d948f40 service nova] Instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:20:30.696814 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-b0436cce-9df6-48dd-846d-e2761147ba03 req-9a8a1ed0-75d0-4931-bdc9-63ca9d948f40 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128812 Aug 03 02:20:30.701430 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2790/5458] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:20:31.080743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0d665838-c2e8-43f2-8812-82982e81c073 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:31.081518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0d665838-c2e8-43f2-8812-82982e81c073 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:31.101881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d665838-c2e8-43f2-8812-82982e81c073 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:31.105349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d665838-c2e8-43f2-8812-82982e81c073 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:31.107538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d665838-c2e8-43f2-8812-82982e81c073 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:31.110129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d665838-c2e8-43f2-8812-82982e81c073 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:32.047673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0d665838-c2e8-43f2-8812-82982e81c073 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:32.062589 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0d665838-c2e8-43f2-8812-82982e81c073 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1690 microversion: 2.1 time: 0.986859 Aug 03 02:20:32.070423 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2669/5459] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:31 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1690 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:32.777867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-11f0d74e-b2d4-494f-9be2-53a6d84294fb req-a522b4d2-0cf3-4724-9b10-d054844a7ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2c8dd50-04d8-4c90-8de9-81ab009cd56d", "tag": "98bf134d-7968-4dd0-b846-f2029a0e70d1"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:32.797818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=38 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:20:32.801083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-11f0d74e-b2d4-494f-9be2-53a6d84294fb req-a522b4d2-0cf3-4724-9b10-d054844a7ca7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:32.803560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-11f0d74e-b2d4-494f-9be2-53a6d84294fb req-a522b4d2-0cf3-4724-9b10-d054844a7ca7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:32.813609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:20:32.847050 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-11f0d74e-b2d4-494f-9be2-53a6d84294fb req-a522b4d2-0cf3-4724-9b10-d054844a7ca7 service nova] Creating event network-changed:98bf134d-7968-4dd0-b846-f2029a0e70d1 for instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d on n-h1-826529-8 Aug 03 02:20:32.868200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-11f0d74e-b2d4-494f-9be2-53a6d84294fb req-a522b4d2-0cf3-4724-9b10-d054844a7ca7 service nova] Instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:20:32.891080 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-11f0d74e-b2d4-494f-9be2-53a6d84294fb req-a522b4d2-0cf3-4724-9b10-d054844a7ca7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120219 Aug 03 02:20:32.914829 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2791/5460] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:20:33.089470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5dff0c2c-38aa-4743-8f37-937398924c7d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:33.090941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5dff0c2c-38aa-4743-8f37-937398924c7d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:33.105086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dff0c2c-38aa-4743-8f37-937398924c7d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:33.116129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dff0c2c-38aa-4743-8f37-937398924c7d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:33.118314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dff0c2c-38aa-4743-8f37-937398924c7d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:33.119698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5dff0c2c-38aa-4743-8f37-937398924c7d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:33.767672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5dff0c2c-38aa-4743-8f37-937398924c7d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:33.784351 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5dff0c2c-38aa-4743-8f37-937398924c7d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1690 microversion: 2.1 time: 0.699828 Aug 03 02:20:33.786068 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2670/5461] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:33 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1690 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:34.810480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-78400b83-0689-4642-aa39-370d19997aa3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:34.811464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-78400b83-0689-4642-aa39-370d19997aa3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:34.825802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-78400b83-0689-4642-aa39-370d19997aa3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:34.833553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-78400b83-0689-4642-aa39-370d19997aa3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:34.834894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-78400b83-0689-4642-aa39-370d19997aa3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:34.835536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-78400b83-0689-4642-aa39-370d19997aa3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:35.565497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-78400b83-0689-4642-aa39-370d19997aa3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:35.575880 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-78400b83-0689-4642-aa39-370d19997aa3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1690 microversion: 2.1 time: 0.770896 Aug 03 02:20:35.577261 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2792/5462] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:34 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1690 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:36.597553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4b3f7b97-b33c-41af-b19c-cfc591803c79 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:36.598185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4b3f7b97-b33c-41af-b19c-cfc591803c79 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:36.613475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:20:36.615186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b3f7b97-b33c-41af-b19c-cfc591803c79 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:36.621903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b3f7b97-b33c-41af-b19c-cfc591803c79 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:36.622770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b3f7b97-b33c-41af-b19c-cfc591803c79 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:36.623255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b3f7b97-b33c-41af-b19c-cfc591803c79 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:36.918566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4b3f7b97-b33c-41af-b19c-cfc591803c79 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:36.936657 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4b3f7b97-b33c-41af-b19c-cfc591803c79 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1683 microversion: 2.1 time: 0.342877 Aug 03 02:20:36.937271 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2671/5463] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:36 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1683 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:38.052184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-42745630-cd87-4695-ba79-42054732c0de req-eefaa73c-8f42-4b50-b3cc-9017c86ce5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c8dd50-04d8-4c90-8de9-81ab009cd56d", "name": "network-vif-plugged", "status": "completed", "tag": "98bf134d-7968-4dd0-b846-f2029a0e70d1"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:38.070120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-42745630-cd87-4695-ba79-42054732c0de req-eefaa73c-8f42-4b50-b3cc-9017c86ce5ff service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:38.072193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-42745630-cd87-4695-ba79-42054732c0de req-eefaa73c-8f42-4b50-b3cc-9017c86ce5ff service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:38.087311 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-42745630-cd87-4695-ba79-42054732c0de req-eefaa73c-8f42-4b50-b3cc-9017c86ce5ff service nova] Creating event network-vif-plugged:98bf134d-7968-4dd0-b846-f2029a0e70d1 for instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d on n-h1-826529-8 Aug 03 02:20:38.093468 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-42745630-cd87-4695-ba79-42054732c0de req-eefaa73c-8f42-4b50-b3cc-9017c86ce5ff service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045536 Aug 03 02:20:38.094954 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2793/5464] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:20:39.812765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-799cf2e9-6f85-4832-843b-d81ef8592ac5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:39.829563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-799cf2e9-6f85-4832-843b-d81ef8592ac5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:39.831934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-799cf2e9-6f85-4832-843b-d81ef8592ac5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:39.897190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-799cf2e9-6f85-4832-843b-d81ef8592ac5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Going to try to stop instance {{(pid=125942) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 02:20:39.997395 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-799cf2e9-6f85-4832-843b-d81ef8592ac5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "POST /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/action" status: 202 len: 0 microversion: 2.1 time: 0.189324 Aug 03 02:20:39.999077 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2672/5465] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:20:39 2022] POST /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:20:40.008880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-86c41007-55d0-40e4-9ae7-b986f3eaf77a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:40.010071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-86c41007-55d0-40e4-9ae7-b986f3eaf77a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:40.025227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-86c41007-55d0-40e4-9ae7-b986f3eaf77a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:40.025414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-86c41007-55d0-40e4-9ae7-b986f3eaf77a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:40.026339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-86c41007-55d0-40e4-9ae7-b986f3eaf77a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:40.026782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-86c41007-55d0-40e4-9ae7-b986f3eaf77a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:40.591020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-86c41007-55d0-40e4-9ae7-b986f3eaf77a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:40.614802 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-86c41007-55d0-40e4-9ae7-b986f3eaf77a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1723 microversion: 2.1 time: 0.611651 Aug 03 02:20:40.632608 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2794/5466] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:40 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1723 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:41.641607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c432aad0-8a9f-4fb2-b163-c6f92d0f4d1b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:41.642337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c432aad0-8a9f-4fb2-b163-c6f92d0f4d1b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:41.659151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c432aad0-8a9f-4fb2-b163-c6f92d0f4d1b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:41.659648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c432aad0-8a9f-4fb2-b163-c6f92d0f4d1b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:41.667504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c432aad0-8a9f-4fb2-b163-c6f92d0f4d1b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:41.668006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c432aad0-8a9f-4fb2-b163-c6f92d0f4d1b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:42.030604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c432aad0-8a9f-4fb2-b163-c6f92d0f4d1b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:42.040103 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c432aad0-8a9f-4fb2-b163-c6f92d0f4d1b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1723 microversion: 2.1 time: 0.403185 Aug 03 02:20:42.040761 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2673/5467] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:41 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1723 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:43.062812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3b76d56d-bb77-49a7-8cda-905c81cf38d5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:43.063641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3b76d56d-bb77-49a7-8cda-905c81cf38d5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:43.085077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b76d56d-bb77-49a7-8cda-905c81cf38d5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:43.088810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b76d56d-bb77-49a7-8cda-905c81cf38d5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:43.089972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b76d56d-bb77-49a7-8cda-905c81cf38d5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:43.091763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b76d56d-bb77-49a7-8cda-905c81cf38d5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:43.406776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3b76d56d-bb77-49a7-8cda-905c81cf38d5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:43.419715 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3b76d56d-bb77-49a7-8cda-905c81cf38d5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1723 microversion: 2.1 time: 0.361211 Aug 03 02:20:43.438990 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2674/5468] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:43 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:43.508249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-578053492", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:43.585389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] validate_networks() for [('d5928fc2-6005-4eab-90c9-c57e9fce7e40', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:20:44.446130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-161e2fa6-18e2-43ec-aa46-e0265f246bf9 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:44.446944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-161e2fa6-18e2-43ec-aa46-e0265f246bf9 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:44.458043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-161e2fa6-18e2-43ec-aa46-e0265f246bf9 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:44.458413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-161e2fa6-18e2-43ec-aa46-e0265f246bf9 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:44.463119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-161e2fa6-18e2-43ec-aa46-e0265f246bf9 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:44.463926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-161e2fa6-18e2-43ec-aa46-e0265f246bf9 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:44.506868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:20:44.507332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:20:44.507844 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:20:44.508333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:20:44.508928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:20:44.526102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:44.528765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:44.529734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:44.530192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:44.573316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Getting quotas for project 33f2f72e230c40a98899206f4a0b2d29. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:20:44.585421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Getting quotas for user 7273f3ccd4d9469aa16eba259eae7eda and project 33f2f72e230c40a98899206f4a0b2d29. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:20:44.623710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:20:44.630570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:20:44.697164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-161e2fa6-18e2-43ec-aa46-e0265f246bf9 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:44.707952 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-161e2fa6-18e2-43ec-aa46-e0265f246bf9 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1723 microversion: 2.1 time: 0.265238 Aug 03 02:20:44.708547 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2675/5469] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:44 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:44.734274 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-592e64b8-229d-4fae-8075-de1d62207888 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.829278 Aug 03 02:20:44.743405 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2795/5470] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:20:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:20:44.751281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7e694afc-d568-4bf4-a0ce-66675940c766 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:44.751978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7e694afc-d568-4bf4-a0ce-66675940c766 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:44.874248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7e694afc-d568-4bf4-a0ce-66675940c766 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:44.884878 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7e694afc-d568-4bf4-a0ce-66675940c766 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1216 microversion: 2.1 time: 0.139043 Aug 03 02:20:44.886554 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2676/5471] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:44 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1216 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:45.743584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-85bc7d58-5934-4a31-b3a2-5d79a07d81dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:45.745104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-85bc7d58-5934-4a31-b3a2-5d79a07d81dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:45.775254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85bc7d58-5934-4a31-b3a2-5d79a07d81dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:45.778598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85bc7d58-5934-4a31-b3a2-5d79a07d81dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:45.780105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85bc7d58-5934-4a31-b3a2-5d79a07d81dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:45.781050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85bc7d58-5934-4a31-b3a2-5d79a07d81dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:45.911202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e24350fc-7684-4f3a-918e-27492c2f5f1f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:45.912240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e24350fc-7684-4f3a-918e-27492c2f5f1f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:45.944370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e24350fc-7684-4f3a-918e-27492c2f5f1f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:45.945775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e24350fc-7684-4f3a-918e-27492c2f5f1f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:45.946790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e24350fc-7684-4f3a-918e-27492c2f5f1f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:45.951699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e24350fc-7684-4f3a-918e-27492c2f5f1f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:46.090749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e24350fc-7684-4f3a-918e-27492c2f5f1f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:46.102952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-85bc7d58-5934-4a31-b3a2-5d79a07d81dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:46.103540 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e24350fc-7684-4f3a-918e-27492c2f5f1f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1212 microversion: 2.1 time: 0.201240 Aug 03 02:20:46.105878 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2677/5472] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:45 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1212 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:46.120097 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-85bc7d58-5934-4a31-b3a2-5d79a07d81dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1723 microversion: 2.1 time: 0.382320 Aug 03 02:20:46.126070 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2796/5473] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:45 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1723 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:47.125872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9de3ee1f-5868-4f01-bcf3-c5c39f29f09e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:47.126503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9de3ee1f-5868-4f01-bcf3-c5c39f29f09e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:47.139428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9de3ee1f-5868-4f01-bcf3-c5c39f29f09e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:47.140837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9de3ee1f-5868-4f01-bcf3-c5c39f29f09e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:47.143774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9de3ee1f-5868-4f01-bcf3-c5c39f29f09e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:47.144329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9de3ee1f-5868-4f01-bcf3-c5c39f29f09e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:47.153407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-892e3309-c7e5-4dee-ac1b-0a7205c56445 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:47.154695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-892e3309-c7e5-4dee-ac1b-0a7205c56445 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:47.177107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-892e3309-c7e5-4dee-ac1b-0a7205c56445 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:47.177921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-892e3309-c7e5-4dee-ac1b-0a7205c56445 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:47.179280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-892e3309-c7e5-4dee-ac1b-0a7205c56445 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:47.180110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-892e3309-c7e5-4dee-ac1b-0a7205c56445 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:47.381200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9de3ee1f-5868-4f01-bcf3-c5c39f29f09e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:47.395503 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9de3ee1f-5868-4f01-bcf3-c5c39f29f09e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1274 microversion: 2.1 time: 0.273346 Aug 03 02:20:47.396558 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2678/5474] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:47 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1274 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:47.725348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-892e3309-c7e5-4dee-ac1b-0a7205c56445 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:47.767809 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-892e3309-c7e5-4dee-ac1b-0a7205c56445 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1723 microversion: 2.1 time: 0.615139 Aug 03 02:20:47.768978 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2797/5475] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:47 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1723 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:48.419432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7e948bc4-ebfd-481b-92fc-a6d15e12484f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:48.420133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7e948bc4-ebfd-481b-92fc-a6d15e12484f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:48.442721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e948bc4-ebfd-481b-92fc-a6d15e12484f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:48.448812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e948bc4-ebfd-481b-92fc-a6d15e12484f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:48.455514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e948bc4-ebfd-481b-92fc-a6d15e12484f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:48.456032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7e948bc4-ebfd-481b-92fc-a6d15e12484f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:48.793847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-749e025e-d92f-46be-90ab-05f19234b82f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:48.794479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-749e025e-d92f-46be-90ab-05f19234b82f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:48.816846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-749e025e-d92f-46be-90ab-05f19234b82f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:48.822024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-749e025e-d92f-46be-90ab-05f19234b82f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:48.825673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-749e025e-d92f-46be-90ab-05f19234b82f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:48.826364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-749e025e-d92f-46be-90ab-05f19234b82f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:49.358465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7e948bc4-ebfd-481b-92fc-a6d15e12484f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:49.387338 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7e948bc4-ebfd-481b-92fc-a6d15e12484f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1316 microversion: 2.1 time: 0.973570 Aug 03 02:20:49.391229 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2679/5476] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:48 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1316 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:49.408423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-113bf461-bdbe-401d-9cb8-f02bd166bc04 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:49.409716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-113bf461-bdbe-401d-9cb8-f02bd166bc04 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:49.434209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-113bf461-bdbe-401d-9cb8-f02bd166bc04 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:49.437763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-113bf461-bdbe-401d-9cb8-f02bd166bc04 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:49.440037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-113bf461-bdbe-401d-9cb8-f02bd166bc04 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:49.440900 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-113bf461-bdbe-401d-9cb8-f02bd166bc04 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:49.470256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:20:49.488261 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-113bf461-bdbe-401d-9cb8-f02bd166bc04 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.093652 Aug 03 02:20:49.489239 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2680/5477] 10.222.0.67 () {58 vars in 1293 bytes} [Wed Aug 3 02:20:49 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a/os-server-password => generated 116 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:20:49.564489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-749e025e-d92f-46be-90ab-05f19234b82f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:49.581033 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-749e025e-d92f-46be-90ab-05f19234b82f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1723 microversion: 2.1 time: 0.790817 Aug 03 02:20:49.584228 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2798/5478] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:48 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1723 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:50.432006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bf6b8b67-5c8f-4479-821e-89734fe6c15a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:50.434240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bf6b8b67-5c8f-4479-821e-89734fe6c15a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:50.489483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf6b8b67-5c8f-4479-821e-89734fe6c15a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:50.490234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf6b8b67-5c8f-4479-821e-89734fe6c15a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:50.505668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf6b8b67-5c8f-4479-821e-89734fe6c15a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:50.507568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf6b8b67-5c8f-4479-821e-89734fe6c15a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:50.610472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6425f3a4-c50e-4208-bd0e-68c67d5985a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:50.611615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6425f3a4-c50e-4208-bd0e-68c67d5985a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:50.636067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6425f3a4-c50e-4208-bd0e-68c67d5985a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:50.637336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6425f3a4-c50e-4208-bd0e-68c67d5985a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:50.639751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6425f3a4-c50e-4208-bd0e-68c67d5985a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:50.640937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6425f3a4-c50e-4208-bd0e-68c67d5985a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:51.456281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6425f3a4-c50e-4208-bd0e-68c67d5985a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:51.494031 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6425f3a4-c50e-4208-bd0e-68c67d5985a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1700 microversion: 2.1 time: 0.886220 Aug 03 02:20:51.495734 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2799/5479] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:50 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1700 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:51.505180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-de7868c3-f3b0-478f-8fa0-1b32b922e284 req-b04cbefa-5519-4a28-b8a8-61f33b7aca99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4dcb4b-0945-49cb-b946-0fe75f053c37", "tag": "3d7ec981-7632-4ce7-8a7a-4b8453f3e081"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:51.519984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-de7868c3-f3b0-478f-8fa0-1b32b922e284 req-b04cbefa-5519-4a28-b8a8-61f33b7aca99 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:51.521820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bf6b8b67-5c8f-4479-821e-89734fe6c15a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:51.522547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-de7868c3-f3b0-478f-8fa0-1b32b922e284 req-b04cbefa-5519-4a28-b8a8-61f33b7aca99 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:51.533952 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bf6b8b67-5c8f-4479-821e-89734fe6c15a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1316 microversion: 2.1 time: 1.114836 Aug 03 02:20:51.544568 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-de7868c3-f3b0-478f-8fa0-1b32b922e284 req-b04cbefa-5519-4a28-b8a8-61f33b7aca99 service nova] Creating event network-changed:3d7ec981-7632-4ce7-8a7a-4b8453f3e081 for instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 on n-h2-826529-8 Aug 03 02:20:51.553381 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-de7868c3-f3b0-478f-8fa0-1b32b922e284 req-b04cbefa-5519-4a28-b8a8-61f33b7aca99 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054616 Aug 03 02:20:51.555494 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2800/5480] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:20:51.566543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-99a12628-02db-4e94-b539-da8f8bb8ed76 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:51.566703 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2681/5481] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:50 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1316 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:51.578105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99a12628-02db-4e94-b539-da8f8bb8ed76 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:51.578954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99a12628-02db-4e94-b539-da8f8bb8ed76 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:51.699849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-99a12628-02db-4e94-b539-da8f8bb8ed76 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Going to try to start instance {{(pid=125941) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 02:20:51.797915 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-99a12628-02db-4e94-b539-da8f8bb8ed76 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "POST /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/action" status: 202 len: 0 microversion: 2.1 time: 0.237217 Aug 03 02:20:51.800459 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2801/5482] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:20:51 2022] POST /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:20:51.811005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b4f60830-421b-4f0f-9fee-2a7f97b486b3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:51.812153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b4f60830-421b-4f0f-9fee-2a7f97b486b3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:51.833077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4f60830-421b-4f0f-9fee-2a7f97b486b3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:51.833537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4f60830-421b-4f0f-9fee-2a7f97b486b3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:51.834344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4f60830-421b-4f0f-9fee-2a7f97b486b3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:51.834791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4f60830-421b-4f0f-9fee-2a7f97b486b3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:52.571169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8e91dd8d-e330-4a87-b517-9a2eef3c646b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:52.571954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8e91dd8d-e330-4a87-b517-9a2eef3c646b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:52.585234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e91dd8d-e330-4a87-b517-9a2eef3c646b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:52.586519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e91dd8d-e330-4a87-b517-9a2eef3c646b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:52.587663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e91dd8d-e330-4a87-b517-9a2eef3c646b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:52.588233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e91dd8d-e330-4a87-b517-9a2eef3c646b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:52.592551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b4f60830-421b-4f0f-9fee-2a7f97b486b3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:52.613766 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b4f60830-421b-4f0f-9fee-2a7f97b486b3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1709 microversion: 2.1 time: 0.807976 Aug 03 02:20:52.629394 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2682/5483] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:51 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1709 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:52.955507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8e91dd8d-e330-4a87-b517-9a2eef3c646b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:52.965932 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8e91dd8d-e330-4a87-b517-9a2eef3c646b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1316 microversion: 2.1 time: 0.403450 Aug 03 02:20:52.972619 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2802/5484] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:52 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:53.644133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93d5a07f-b25a-4284-a617-16d999deef40 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:53.644876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93d5a07f-b25a-4284-a617-16d999deef40 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:53.657800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d5a07f-b25a-4284-a617-16d999deef40 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:53.658260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d5a07f-b25a-4284-a617-16d999deef40 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:53.663008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d5a07f-b25a-4284-a617-16d999deef40 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:53.663717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93d5a07f-b25a-4284-a617-16d999deef40 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:53.996080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0892b95e-e534-40d7-a6f4-c687bbd05f70 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:53.997978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0892b95e-e534-40d7-a6f4-c687bbd05f70 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:54.010574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0892b95e-e534-40d7-a6f4-c687bbd05f70 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:54.011234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0892b95e-e534-40d7-a6f4-c687bbd05f70 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:54.012749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0892b95e-e534-40d7-a6f4-c687bbd05f70 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:54.015730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0892b95e-e534-40d7-a6f4-c687bbd05f70 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:54.537642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:20:54.611406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:20:54.834447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-93d5a07f-b25a-4284-a617-16d999deef40 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:54.851985 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93d5a07f-b25a-4284-a617-16d999deef40 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1709 microversion: 2.1 time: 1.216219 Aug 03 02:20:54.859392 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2683/5485] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:53 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1709 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:54.927822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0892b95e-e534-40d7-a6f4-c687bbd05f70 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:54.944000 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0892b95e-e534-40d7-a6f4-c687bbd05f70 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1316 microversion: 2.1 time: 0.949663 Aug 03 02:20:54.945759 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2803/5486] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:53 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1316 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:20:55.887233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cfd3eb21-862b-45d6-a95d-7f2ccef42e3a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:55.888239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cfd3eb21-862b-45d6-a95d-7f2ccef42e3a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:55.916372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:20:55.928768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cfd3eb21-862b-45d6-a95d-7f2ccef42e3a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:55.929970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cfd3eb21-862b-45d6-a95d-7f2ccef42e3a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:55.931613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cfd3eb21-862b-45d6-a95d-7f2ccef42e3a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:55.932309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cfd3eb21-862b-45d6-a95d-7f2ccef42e3a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:55.975743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2d4d719c-726f-4685-bb53-14898dd353e8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:55.976686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2d4d719c-726f-4685-bb53-14898dd353e8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:55.985694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d4d719c-726f-4685-bb53-14898dd353e8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:55.989615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d4d719c-726f-4685-bb53-14898dd353e8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:55.990446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d4d719c-726f-4685-bb53-14898dd353e8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:55.991510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d4d719c-726f-4685-bb53-14898dd353e8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:56.200095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cfd3eb21-862b-45d6-a95d-7f2ccef42e3a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:56.211078 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cfd3eb21-862b-45d6-a95d-7f2ccef42e3a tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1709 microversion: 2.1 time: 0.328160 Aug 03 02:20:56.213520 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2684/5487] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:55 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1709 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:56.308893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2d4d719c-726f-4685-bb53-14898dd353e8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:56.326492 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2d4d719c-726f-4685-bb53-14898dd353e8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1316 microversion: 2.1 time: 0.354815 Aug 03 02:20:56.349917 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2804/5488] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:55 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:57.043475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ec18aacc-6a95-42d7-87e1-3d28d31e674a req-0ea4de9b-a201-4892-9448-1e2c4f7d03d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4dcb4b-0945-49cb-b946-0fe75f053c37", "name": "network-vif-plugged", "status": "completed", "tag": "3d7ec981-7632-4ce7-8a7a-4b8453f3e081"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:20:57.074090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ec18aacc-6a95-42d7-87e1-3d28d31e674a req-0ea4de9b-a201-4892-9448-1e2c4f7d03d4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:57.075591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ec18aacc-6a95-42d7-87e1-3d28d31e674a req-0ea4de9b-a201-4892-9448-1e2c4f7d03d4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:57.109767 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ec18aacc-6a95-42d7-87e1-3d28d31e674a req-0ea4de9b-a201-4892-9448-1e2c4f7d03d4 service nova] Creating event network-vif-plugged:3d7ec981-7632-4ce7-8a7a-4b8453f3e081 for instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 on n-h2-826529-8 Aug 03 02:20:57.119515 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ec18aacc-6a95-42d7-87e1-3d28d31e674a req-0ea4de9b-a201-4892-9448-1e2c4f7d03d4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081071 Aug 03 02:20:57.121139 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2685/5489] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:20:57.245055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a922e8bf-21e8-4654-b86d-c25ccfb3a138 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:57.245674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a922e8bf-21e8-4654-b86d-c25ccfb3a138 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:57.254351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a922e8bf-21e8-4654-b86d-c25ccfb3a138 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:57.256891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a922e8bf-21e8-4654-b86d-c25ccfb3a138 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:57.258850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a922e8bf-21e8-4654-b86d-c25ccfb3a138 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:57.262840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a922e8bf-21e8-4654-b86d-c25ccfb3a138 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:57.356260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4a0206f1-6dd1-43ae-9e48-4d338a392929 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:57.357236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4a0206f1-6dd1-43ae-9e48-4d338a392929 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:57.371433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a0206f1-6dd1-43ae-9e48-4d338a392929 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:57.372747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a0206f1-6dd1-43ae-9e48-4d338a392929 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:57.374452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a0206f1-6dd1-43ae-9e48-4d338a392929 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:57.375343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a0206f1-6dd1-43ae-9e48-4d338a392929 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:57.798166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a922e8bf-21e8-4654-b86d-c25ccfb3a138 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:57.813461 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a922e8bf-21e8-4654-b86d-c25ccfb3a138 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1713 microversion: 2.1 time: 0.573938 Aug 03 02:20:57.834042 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2805/5490] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:57 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1713 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:57.878596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4a0206f1-6dd1-43ae-9e48-4d338a392929 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:57.899357 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4a0206f1-6dd1-43ae-9e48-4d338a392929 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1316 microversion: 2.1 time: 0.542308 Aug 03 02:20:57.919696 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2686/5491] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:57 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1316 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:20:58.923983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-72613063-3a9d-4fad-ba28-9a3427d4e135 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:20:58.926052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-72613063-3a9d-4fad-ba28-9a3427d4e135 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:20:58.937732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72613063-3a9d-4fad-ba28-9a3427d4e135 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:58.938451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72613063-3a9d-4fad-ba28-9a3427d4e135 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:58.939963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72613063-3a9d-4fad-ba28-9a3427d4e135 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:20:58.940513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-72613063-3a9d-4fad-ba28-9a3427d4e135 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:20:59.238365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-72613063-3a9d-4fad-ba28-9a3427d4e135 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:20:59.256160 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-72613063-3a9d-4fad-ba28-9a3427d4e135 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1316 microversion: 2.1 time: 0.338578 Aug 03 02:20:59.258066 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2806/5492] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:20:58 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:00.279260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c89a6f51-410a-4b75-b0ce-bedbae251672 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:00.279776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c89a6f51-410a-4b75-b0ce-bedbae251672 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:00.294616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c89a6f51-410a-4b75-b0ce-bedbae251672 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:00.295120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c89a6f51-410a-4b75-b0ce-bedbae251672 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:00.295945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c89a6f51-410a-4b75-b0ce-bedbae251672 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:00.296618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c89a6f51-410a-4b75-b0ce-bedbae251672 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:00.598538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c89a6f51-410a-4b75-b0ce-bedbae251672 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:00.610438 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c89a6f51-410a-4b75-b0ce-bedbae251672 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.335976 Aug 03 02:21:00.613134 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2687/5493] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:00 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:00.840477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-293984897", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:00.958707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] validate_networks() for [('d5928fc2-6005-4eab-90c9-c57e9fce7e40', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:21:01.262474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-73368faa-7015-4782-bbdd-873bbad4ade3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:01.277389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-73368faa-7015-4782-bbdd-873bbad4ade3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:01.298848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73368faa-7015-4782-bbdd-873bbad4ade3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:01.299556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73368faa-7015-4782-bbdd-873bbad4ade3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:01.306466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73368faa-7015-4782-bbdd-873bbad4ade3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:01.307232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73368faa-7015-4782-bbdd-873bbad4ade3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:01.422196 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-73368faa-7015-4782-bbdd-873bbad4ade3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d/action" status: 200 len: 63165 microversion: 2.1 time: 0.172812 Aug 03 02:21:01.424179 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2688/5494] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:21:01 2022] POST /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d/action => generated 63165 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 02:21:01.683578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:21:01.684076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:21:01.684568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:21:01.684997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:21:01.685421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:21:01.702456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:01.702851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:01.703680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:01.704246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:01.767204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Getting quotas for project 33f2f72e230c40a98899206f4a0b2d29. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:21:01.784281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Getting quotas for user 7273f3ccd4d9469aa16eba259eae7eda and project 33f2f72e230c40a98899206f4a0b2d29. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:21:01.827868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:21:01.831207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:21:01.945711 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-362d6715-157b-4592-a138-b938d7512229 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.133906 Aug 03 02:21:01.948581 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2807/5495] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:21:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:21:01.958696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a4920d8d-b81f-45ba-9491-0642af0ee60d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:01.959734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a4920d8d-b81f-45ba-9491-0642af0ee60d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:02.099560 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a4920d8d-b81f-45ba-9491-0642af0ee60d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:02.130542 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a4920d8d-b81f-45ba-9491-0642af0ee60d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 200 len: 1216 microversion: 2.1 time: 0.175670 Aug 03 02:21:02.133130 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2689/5496] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:01 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 1216 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:03.168031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-84056997-8192-4475-b14b-1905636920ed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:03.170784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-84056997-8192-4475-b14b-1905636920ed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:03.192553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:03.207052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84056997-8192-4475-b14b-1905636920ed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:03.207918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84056997-8192-4475-b14b-1905636920ed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:03.213016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84056997-8192-4475-b14b-1905636920ed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:03.230461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84056997-8192-4475-b14b-1905636920ed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:03.261952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:03.410284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-84056997-8192-4475-b14b-1905636920ed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:03.424877 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-84056997-8192-4475-b14b-1905636920ed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 200 len: 1268 microversion: 2.1 time: 0.271257 Aug 03 02:21:03.435561 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2808/5497] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:03 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 1268 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:04.462123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ad11a073-5df9-4082-bb95-83465f4ea0a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:04.462770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ad11a073-5df9-4082-bb95-83465f4ea0a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:04.476820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ad11a073-5df9-4082-bb95-83465f4ea0a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:04.478495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ad11a073-5df9-4082-bb95-83465f4ea0a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:04.479664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ad11a073-5df9-4082-bb95-83465f4ea0a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:04.480318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ad11a073-5df9-4082-bb95-83465f4ea0a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:04.599943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ad11a073-5df9-4082-bb95-83465f4ea0a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:04.613132 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ad11a073-5df9-4082-bb95-83465f4ea0a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 200 len: 1274 microversion: 2.1 time: 0.165735 Aug 03 02:21:04.614002 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2690/5498] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:04 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 1274 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:05.638375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3691499b-12e6-4b6b-9edb-a1471d5aaaed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:05.639051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3691499b-12e6-4b6b-9edb-a1471d5aaaed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:05.657652 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3691499b-12e6-4b6b-9edb-a1471d5aaaed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:05.658256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3691499b-12e6-4b6b-9edb-a1471d5aaaed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:05.659147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3691499b-12e6-4b6b-9edb-a1471d5aaaed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:05.659590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3691499b-12e6-4b6b-9edb-a1471d5aaaed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:06.073308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3691499b-12e6-4b6b-9edb-a1471d5aaaed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:06.091457 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3691499b-12e6-4b6b-9edb-a1471d5aaaed tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 200 len: 1316 microversion: 2.1 time: 0.457740 Aug 03 02:21:06.115919 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2809/5499] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:05 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 1316 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:07.127171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-962181ab-7a0a-4781-8897-4568ce5bc08a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:07.128081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-962181ab-7a0a-4781-8897-4568ce5bc08a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:07.132758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=44 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:07.145824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-962181ab-7a0a-4781-8897-4568ce5bc08a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:07.146278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-962181ab-7a0a-4781-8897-4568ce5bc08a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:07.152420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-962181ab-7a0a-4781-8897-4568ce5bc08a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:07.153158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-962181ab-7a0a-4781-8897-4568ce5bc08a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:07.219014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-ac43b4fe-f013-4e64-9125-3d557ea77994 req-d05eb9a8-ac51-426d-9c5c-cb6579f3a8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ba4e52-bfcc-4b75-8d15-dec1bafa54f3", "tag": "b08fcfcf-8a22-4942-b3ee-ee2b02f50cc1"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:07.254370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ac43b4fe-f013-4e64-9125-3d557ea77994 req-d05eb9a8-ac51-426d-9c5c-cb6579f3a8b0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:07.255457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ac43b4fe-f013-4e64-9125-3d557ea77994 req-d05eb9a8-ac51-426d-9c5c-cb6579f3a8b0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:07.306427 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-ac43b4fe-f013-4e64-9125-3d557ea77994 req-d05eb9a8-ac51-426d-9c5c-cb6579f3a8b0 service nova] Creating event network-changed:b08fcfcf-8a22-4942-b3ee-ee2b02f50cc1 for instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 on n-h1-826529-8 Aug 03 02:21:07.326677 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-ac43b4fe-f013-4e64-9125-3d557ea77994 req-d05eb9a8-ac51-426d-9c5c-cb6579f3a8b0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110701 Aug 03 02:21:07.329589 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2810/5500] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:21:07.464877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-962181ab-7a0a-4781-8897-4568ce5bc08a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:07.486780 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-962181ab-7a0a-4781-8897-4568ce5bc08a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 200 len: 1316 microversion: 2.1 time: 0.367974 Aug 03 02:21:07.487420 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2691/5501] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:07 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:08.229838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-57e3688f-12b7-454e-aa90-9e3815f46b83 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:08.230977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-57e3688f-12b7-454e-aa90-9e3815f46b83 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:08.237845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57e3688f-12b7-454e-aa90-9e3815f46b83 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:08.238363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57e3688f-12b7-454e-aa90-9e3815f46b83 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:08.239313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57e3688f-12b7-454e-aa90-9e3815f46b83 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:08.239967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57e3688f-12b7-454e-aa90-9e3815f46b83 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:08.498119 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-57e3688f-12b7-454e-aa90-9e3815f46b83 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1834 microversion: 2.1 time: 0.701932 Aug 03 02:21:08.499705 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2811/5502] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:07 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1834 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:08.510010 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bf1dad6b-83db-44f8-b3d8-642b5ed013f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:08.511298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bf1dad6b-83db-44f8-b3d8-642b5ed013f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:08.521582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf1dad6b-83db-44f8-b3d8-642b5ed013f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:08.523258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf1dad6b-83db-44f8-b3d8-642b5ed013f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:08.526796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf1dad6b-83db-44f8-b3d8-642b5ed013f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:08.528160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf1dad6b-83db-44f8-b3d8-642b5ed013f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:09.349583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bf1dad6b-83db-44f8-b3d8-642b5ed013f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:09.357965 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bf1dad6b-83db-44f8-b3d8-642b5ed013f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 200 len: 1316 microversion: 2.1 time: 0.853148 Aug 03 02:21:09.359251 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2692/5503] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:08 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 1316 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:10.389029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2e2b632a-54aa-412c-95c5-483ed65f5be5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:10.397249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2e2b632a-54aa-412c-95c5-483ed65f5be5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:10.417455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e2b632a-54aa-412c-95c5-483ed65f5be5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:10.418631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e2b632a-54aa-412c-95c5-483ed65f5be5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:10.420308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e2b632a-54aa-412c-95c5-483ed65f5be5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:10.421212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e2b632a-54aa-412c-95c5-483ed65f5be5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:10.775425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2e2b632a-54aa-412c-95c5-483ed65f5be5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:10.787898 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2e2b632a-54aa-412c-95c5-483ed65f5be5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 200 len: 1316 microversion: 2.1 time: 0.409606 Aug 03 02:21:10.789043 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2812/5504] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:10 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:11.110803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f4baef1e-7bd1-4080-92a9-ae75fca7e635 req-1ebbe256-9c9a-46e5-a6e6-3cc1c854b282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2c8dd50-04d8-4c90-8de9-81ab009cd56d", "tag": "98bf134d-7968-4dd0-b846-f2029a0e70d1"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:11.114762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c616d5f6-3efb-494b-9d41-47aaa962291f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:11.118007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c616d5f6-3efb-494b-9d41-47aaa962291f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:11.165734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c616d5f6-3efb-494b-9d41-47aaa962291f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:11.166498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c616d5f6-3efb-494b-9d41-47aaa962291f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:11.167502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c616d5f6-3efb-494b-9d41-47aaa962291f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:11.167943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c616d5f6-3efb-494b-9d41-47aaa962291f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:11.176943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f4baef1e-7bd1-4080-92a9-ae75fca7e635 req-1ebbe256-9c9a-46e5-a6e6-3cc1c854b282 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:11.177522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f4baef1e-7bd1-4080-92a9-ae75fca7e635 req-1ebbe256-9c9a-46e5-a6e6-3cc1c854b282 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:11.203153 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f4baef1e-7bd1-4080-92a9-ae75fca7e635 req-1ebbe256-9c9a-46e5-a6e6-3cc1c854b282 service nova] Creating event network-changed:98bf134d-7968-4dd0-b846-f2029a0e70d1 for instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d on n-h1-826529-8 Aug 03 02:21:11.219137 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f4baef1e-7bd1-4080-92a9-ae75fca7e635 req-1ebbe256-9c9a-46e5-a6e6-3cc1c854b282 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114047 Aug 03 02:21:11.220156 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2813/5505] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:21:11.329761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c616d5f6-3efb-494b-9d41-47aaa962291f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:21:11.599766 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c616d5f6-3efb-494b-9d41-47aaa962291f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 204 len: 0 microversion: 2.1 time: 0.499329 Aug 03 02:21:11.605734 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2693/5506] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:21:11 2022] DELETE /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:21:11.612638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3a39bfb6-2bcb-457a-bce7-3600480d339e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:11.613471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3a39bfb6-2bcb-457a-bce7-3600480d339e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:11.629415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a39bfb6-2bcb-457a-bce7-3600480d339e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:11.629872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a39bfb6-2bcb-457a-bce7-3600480d339e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:11.630675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a39bfb6-2bcb-457a-bce7-3600480d339e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:11.631149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3a39bfb6-2bcb-457a-bce7-3600480d339e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:11.727777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:11.811268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b4a2f556-8c94-4b3b-bf3c-96727113ddf5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:11.811975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b4a2f556-8c94-4b3b-bf3c-96727113ddf5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:11.814017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:11.831108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4a2f556-8c94-4b3b-bf3c-96727113ddf5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:11.831563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4a2f556-8c94-4b3b-bf3c-96727113ddf5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:11.832344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4a2f556-8c94-4b3b-bf3c-96727113ddf5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:11.834428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4a2f556-8c94-4b3b-bf3c-96727113ddf5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:12.078836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3a39bfb6-2bcb-457a-bce7-3600480d339e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:12.089263 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3a39bfb6-2bcb-457a-bce7-3600480d339e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1689 microversion: 2.1 time: 0.481645 Aug 03 02:21:12.091318 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2814/5507] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:11 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1689 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:21:12.126687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:12.229942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b4a2f556-8c94-4b3b-bf3c-96727113ddf5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:12.239065 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b4a2f556-8c94-4b3b-bf3c-96727113ddf5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 200 len: 1316 microversion: 2.1 time: 0.431866 Aug 03 02:21:12.239681 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2694/5508] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:11 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:12.969597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-6891735a-bd0a-4aa5-af96-b920589399dc req-8dd4ad56-873f-451f-a3ab-8e4bd37f68e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ba4e52-bfcc-4b75-8d15-dec1bafa54f3", "name": "network-vif-plugged", "status": "completed", "tag": "b08fcfcf-8a22-4942-b3ee-ee2b02f50cc1"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:12.998366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6891735a-bd0a-4aa5-af96-b920589399dc req-8dd4ad56-873f-451f-a3ab-8e4bd37f68e5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:12.999512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6891735a-bd0a-4aa5-af96-b920589399dc req-8dd4ad56-873f-451f-a3ab-8e4bd37f68e5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:13.022103 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-6891735a-bd0a-4aa5-af96-b920589399dc req-8dd4ad56-873f-451f-a3ab-8e4bd37f68e5 service nova] Creating event network-vif-plugged:b08fcfcf-8a22-4942-b3ee-ee2b02f50cc1 for instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 on n-h1-826529-8 Aug 03 02:21:13.042466 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-6891735a-bd0a-4aa5-af96-b920589399dc req-8dd4ad56-873f-451f-a3ab-8e4bd37f68e5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078232 Aug 03 02:21:13.047194 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2815/5509] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:21:13.118244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c43563aa-a602-4ba7-8de6-ac7e49014176 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:13.119165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c43563aa-a602-4ba7-8de6-ac7e49014176 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:13.127154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c43563aa-a602-4ba7-8de6-ac7e49014176 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:13.128559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c43563aa-a602-4ba7-8de6-ac7e49014176 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:13.129614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c43563aa-a602-4ba7-8de6-ac7e49014176 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:13.130267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c43563aa-a602-4ba7-8de6-ac7e49014176 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:13.267486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9cbb42c8-1b7c-4da7-b8e2-12223215a3c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:13.268610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9cbb42c8-1b7c-4da7-b8e2-12223215a3c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:13.276674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cbb42c8-1b7c-4da7-b8e2-12223215a3c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:13.277579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cbb42c8-1b7c-4da7-b8e2-12223215a3c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:13.278653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cbb42c8-1b7c-4da7-b8e2-12223215a3c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:13.279336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9cbb42c8-1b7c-4da7-b8e2-12223215a3c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:13.486783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c43563aa-a602-4ba7-8de6-ac7e49014176 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:13.497275 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c43563aa-a602-4ba7-8de6-ac7e49014176 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1689 microversion: 2.1 time: 0.384516 Aug 03 02:21:13.511760 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2695/5510] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:13 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1689 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:13.670324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9cbb42c8-1b7c-4da7-b8e2-12223215a3c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:13.678265 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9cbb42c8-1b7c-4da7-b8e2-12223215a3c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 200 len: 1316 microversion: 2.1 time: 0.417051 Aug 03 02:21:13.680323 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2816/5511] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:13 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:14.524065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-211a56e1-b00a-4551-b20b-833fc7d3acc3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:14.524849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-211a56e1-b00a-4551-b20b-833fc7d3acc3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:14.540659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-211a56e1-b00a-4551-b20b-833fc7d3acc3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:14.541699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-211a56e1-b00a-4551-b20b-833fc7d3acc3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:14.543009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-211a56e1-b00a-4551-b20b-833fc7d3acc3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:14.543823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-211a56e1-b00a-4551-b20b-833fc7d3acc3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:14.605525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-3af8463b-a62a-42bb-9815-5e1344b2056a req-4a035dc9-7a0e-4b85-b621-b846158f35bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c8dd50-04d8-4c90-8de9-81ab009cd56d", "name": "network-vif-deleted", "tag": "98bf134d-7968-4dd0-b846-f2029a0e70d1"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:14.636617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3af8463b-a62a-42bb-9815-5e1344b2056a req-4a035dc9-7a0e-4b85-b621-b846158f35bb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:14.637075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3af8463b-a62a-42bb-9815-5e1344b2056a req-4a035dc9-7a0e-4b85-b621-b846158f35bb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:14.669981 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-3af8463b-a62a-42bb-9815-5e1344b2056a req-4a035dc9-7a0e-4b85-b621-b846158f35bb service nova] Creating event network-vif-deleted:98bf134d-7968-4dd0-b846-f2029a0e70d1 for instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d on n-h1-826529-8 Aug 03 02:21:14.686740 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-3af8463b-a62a-42bb-9815-5e1344b2056a req-4a035dc9-7a0e-4b85-b621-b846158f35bb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088817 Aug 03 02:21:14.687838 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2817/5512] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:21:14.702771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3956b58f-9705-4813-9ce9-f50416899e35 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:14.703820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3956b58f-9705-4813-9ce9-f50416899e35 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:14.717423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3956b58f-9705-4813-9ce9-f50416899e35 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:14.719759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3956b58f-9705-4813-9ce9-f50416899e35 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:14.728726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3956b58f-9705-4813-9ce9-f50416899e35 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:14.728726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3956b58f-9705-4813-9ce9-f50416899e35 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:14.729008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-211a56e1-b00a-4551-b20b-833fc7d3acc3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:14.757408 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-211a56e1-b00a-4551-b20b-833fc7d3acc3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 200 len: 1621 microversion: 2.1 time: 0.237387 Aug 03 02:21:14.777617 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2696/5513] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:14 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 1621 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:15.112769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3956b58f-9705-4813-9ce9-f50416899e35 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:15.124931 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3956b58f-9705-4813-9ce9-f50416899e35 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 200 len: 1316 microversion: 2.1 time: 0.426465 Aug 03 02:21:15.125821 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2818/5514] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:14 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:21:15.786740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c08366e0-368d-4928-921e-8d6d36a14b9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:15.787402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c08366e0-368d-4928-921e-8d6d36a14b9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: a2c8dd50-04d8-4c90-8de9-81ab009cd56d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:15.802204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c08366e0-368d-4928-921e-8d6d36a14b9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:15.803032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c08366e0-368d-4928-921e-8d6d36a14b9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:15.808385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c08366e0-368d-4928-921e-8d6d36a14b9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:15.809369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c08366e0-368d-4928-921e-8d6d36a14b9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:15.833589 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-c08366e0-368d-4928-921e-8d6d36a14b9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] HTTP exception thrown: Instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d could not be found. Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c08366e0-368d-4928-921e-8d6d36a14b9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Request method failure captured: Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d HTTP/1.1 Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6doi9mhvS1ouiIhMAao9U5FMCKoCDK2Svh-rN38K6LLUL5Jz46cjohY4VinMjw8nEITcvufUHSTuoEsFDcuvi9KweDemmvXVR2Y50H-XN3XOCzqBlRtzMafBlbAgN_igQZKGETPhyc3zhVKXRP1svhEgFnKivuflt3X2jd-ilbL3xBI Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: f6179959e78b438cb68680f694190a8c Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-160243142 Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f6179959e78b438cb68680f694190a8c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6179959e78b438cb68680f694190a8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f6179959e78b438cb68680f694190a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6179959e78b438cb68680f694190a8c"}]}] Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestNetworkAdvancedServerOps-160243142 Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: f6179959e78b438cb68680f694190a8c Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-160243142 Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestNetworkAdvancedServerOps-160243142-project Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: adca21bc340d440e91e4d856a625cd3a Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestNetworkAdvancedServerOps-160243142-project Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d could not be found. Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'a2c8dd50-04d8-4c90-8de9-81ab009cd56d'} Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d could not be found. Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d could not be found. Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:15.849815 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:15.856850 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:15.856850 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:15.856850 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:15.856850 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:15.856850 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:15.856850 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:15.856850 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d could not be found. Aug 03 02:21:15.856850 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:15.859978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c08366e0-368d-4928-921e-8d6d36a14b9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Returning 404 to user: Instance a2c8dd50-04d8-4c90-8de9-81ab009cd56d could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:15.861928 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c08366e0-368d-4928-921e-8d6d36a14b9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d" status: 404 len: 111 microversion: 2.1 time: 0.079409 Aug 03 02:21:15.863705 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2697/5515] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:15 2022] GET /compute/v2.1/servers/a2c8dd50-04d8-4c90-8de9-81ab009cd56d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:21:16.157847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bbe77670-42d7-480e-b1cf-1148b962b6ff tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:16.158487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bbe77670-42d7-480e-b1cf-1148b962b6ff tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:16.175276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbe77670-42d7-480e-b1cf-1148b962b6ff tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:16.175751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbe77670-42d7-480e-b1cf-1148b962b6ff tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:16.176561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbe77670-42d7-480e-b1cf-1148b962b6ff tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:16.179648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbe77670-42d7-480e-b1cf-1148b962b6ff tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:16.680115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bbe77670-42d7-480e-b1cf-1148b962b6ff tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:16.701064 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bbe77670-42d7-480e-b1cf-1148b962b6ff tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 200 len: 1504 microversion: 2.1 time: 0.549406 Aug 03 02:21:16.702583 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2819/5516] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:16 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 1504 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:21:16.730050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-983224ed-335e-491c-8946-6e11b5709460 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:16.730825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-983224ed-335e-491c-8946-6e11b5709460 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:16.737439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-983224ed-335e-491c-8946-6e11b5709460 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:16.738125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-983224ed-335e-491c-8946-6e11b5709460 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:16.739151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-983224ed-335e-491c-8946-6e11b5709460 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:16.739764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-983224ed-335e-491c-8946-6e11b5709460 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:16.834530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:16.841919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-983224ed-335e-491c-8946-6e11b5709460 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:21:17.015637 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-983224ed-335e-491c-8946-6e11b5709460 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "DELETE /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 204 len: 0 microversion: 2.1 time: 0.290600 Aug 03 02:21:17.016882 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2698/5517] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:21:16 2022] DELETE /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:21:17.039520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1c10b622-768f-482b-af40-1d73d37b0738 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:17.044144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1c10b622-768f-482b-af40-1d73d37b0738 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:17.073951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c10b622-768f-482b-af40-1d73d37b0738 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:17.075363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c10b622-768f-482b-af40-1d73d37b0738 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:17.078727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c10b622-768f-482b-af40-1d73d37b0738 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:17.088456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c10b622-768f-482b-af40-1d73d37b0738 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:17.464006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1c10b622-768f-482b-af40-1d73d37b0738 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:17.480092 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1c10b622-768f-482b-af40-1d73d37b0738 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 200 len: 1510 microversion: 2.1 time: 0.454039 Aug 03 02:21:17.482273 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2820/5518] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:17 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 1510 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:18.505773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9850331a-a1bf-456f-8427-aa4161853fe9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:18.506685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9850331a-a1bf-456f-8427-aa4161853fe9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:18.525351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9850331a-a1bf-456f-8427-aa4161853fe9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:18.525812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9850331a-a1bf-456f-8427-aa4161853fe9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:18.526685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9850331a-a1bf-456f-8427-aa4161853fe9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:18.527179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9850331a-a1bf-456f-8427-aa4161853fe9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:18.881053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9850331a-a1bf-456f-8427-aa4161853fe9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:18.894591 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9850331a-a1bf-456f-8427-aa4161853fe9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 200 len: 1510 microversion: 2.1 time: 0.395870 Aug 03 02:21:18.896952 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2699/5519] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:18 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 1510 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:19.356336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f4a23b5d-fcd3-4c77-97f1-078eb5f0d9df req-9e3aca82-2247-48c9-baa4-a4cfa7cb6bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ba4e52-bfcc-4b75-8d15-dec1bafa54f3", "name": "network-vif-deleted", "tag": "b08fcfcf-8a22-4942-b3ee-ee2b02f50cc1"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:19.391238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f4a23b5d-fcd3-4c77-97f1-078eb5f0d9df req-9e3aca82-2247-48c9-baa4-a4cfa7cb6bed service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:19.395262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f4a23b5d-fcd3-4c77-97f1-078eb5f0d9df req-9e3aca82-2247-48c9-baa4-a4cfa7cb6bed service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:19.444738 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f4a23b5d-fcd3-4c77-97f1-078eb5f0d9df req-9e3aca82-2247-48c9-baa4-a4cfa7cb6bed service nova] Creating event network-vif-deleted:b08fcfcf-8a22-4942-b3ee-ee2b02f50cc1 for instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 on n-h1-826529-8 Aug 03 02:21:19.466124 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f4a23b5d-fcd3-4c77-97f1-078eb5f0d9df req-9e3aca82-2247-48c9-baa4-a4cfa7cb6bed service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123509 Aug 03 02:21:19.472471 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2821/5520] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:21:19.919659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e098f658-66a0-442d-9041-26d5d02e029a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:19.920362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e098f658-66a0-442d-9041-26d5d02e029a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:19.943750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e098f658-66a0-442d-9041-26d5d02e029a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:19.944394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e098f658-66a0-442d-9041-26d5d02e029a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:19.950131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e098f658-66a0-442d-9041-26d5d02e029a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:19.952802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e098f658-66a0-442d-9041-26d5d02e029a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:20.067214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e098f658-66a0-442d-9041-26d5d02e029a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:20.068037 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e098f658-66a0-442d-9041-26d5d02e029a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:20.072113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-e098f658-66a0-442d-9041-26d5d02e029a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lazy-loading 'fault' on Instance uuid 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:21:20.207928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e098f658-66a0-442d-9041-26d5d02e029a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:20.230921 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e098f658-66a0-442d-9041-26d5d02e029a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 200 len: 1306 microversion: 2.1 time: 0.310397 Aug 03 02:21:20.231582 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2700/5521] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:19 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 1306 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:21.260094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-334e84d0-d3b5-4c38-87ce-9dc700ced027 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:21.261667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-334e84d0-d3b5-4c38-87ce-9dc700ced027 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:21.270431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-334e84d0-d3b5-4c38-87ce-9dc700ced027 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:21.271074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-334e84d0-d3b5-4c38-87ce-9dc700ced027 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:21.272005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-334e84d0-d3b5-4c38-87ce-9dc700ced027 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:21.273388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-334e84d0-d3b5-4c38-87ce-9dc700ced027 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:21.305653 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-334e84d0-d3b5-4c38-87ce-9dc700ced027 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-334e84d0-d3b5-4c38-87ce-9dc700ced027 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 HTTP/1.1 Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '80ba4e52-bfcc-4b75-8d15-dec1bafa54f3'} Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:21.307700 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:21.312669 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:21.312669 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:21.312669 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:21.312669 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:21.312669 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:21.312669 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:21:21.312669 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:21.312669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-334e84d0-d3b5-4c38-87ce-9dc700ced027 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:21.312669 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-334e84d0-d3b5-4c38-87ce-9dc700ced027 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 404 len: 111 microversion: 2.1 time: 0.054658 Aug 03 02:21:21.312669 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2822/5522] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:21 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:21:21.333303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3b719436-3c4a-425f-86c4-c2084e0b75ae tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:21.334228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3b719436-3c4a-425f-86c4-c2084e0b75ae tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:21.351854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b719436-3c4a-425f-86c4-c2084e0b75ae tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:21.352341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b719436-3c4a-425f-86c4-c2084e0b75ae tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:21.353251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b719436-3c4a-425f-86c4-c2084e0b75ae tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:21.353704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b719436-3c4a-425f-86c4-c2084e0b75ae tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:22.146725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3b719436-3c4a-425f-86c4-c2084e0b75ae tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:22.172429 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3b719436-3c4a-425f-86c4-c2084e0b75ae tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.850101 Aug 03 02:21:22.173384 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2701/5523] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:21 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:22.392480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e6d4de18-a806-4eb2-bcd9-5852cd0c64f3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '.version_select at 0x7f5b12292280>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:22.438974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1b592bc9-7345-43e7-a061-e1bf7376a92d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1b592bc9-7345-43e7-a061-e1bf7376a92d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 163 Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": 12345, "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'networks': [{'uuid': 'd5928fc2-6005-4eab-90c9-c57e9fce7e40'}]}}} Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 12345 Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:21:22.445117 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:21:22.449098 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:21:22.449098 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 03 02:21:22.449098 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:22.449098 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:22.449098 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:22.449098 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:22.449098 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:22.449098 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:22.449098 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:21:22.449098 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:21:22.449098 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 03 02:21:22.449098 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:22.451445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1b592bc9-7345-43e7-a061-e1bf7376a92d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:22.452573 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1b592bc9-7345-43e7-a061-e1bf7376a92d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.020170 Aug 03 02:21:22.453355 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2702/5524] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:21:22 2022] POST /compute/v2.1/servers => generated 127 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:21:22.471661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-98745e66-299e-48cf-9d80-d0a516d774af tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:22.475773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-98745e66-299e-48cf-9d80-d0a516d774af tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:22.489329 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e6d4de18-a806-4eb2-bcd9-5852cd0c64f3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1619238817" status: 202 len: 0 microversion: 2.1 time: 0.102533 Aug 03 02:21:22.489934 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2823/5525] 10.222.0.67 () {58 vars in 1284 bytes} [Wed Aug 3 02:21:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1619238817 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:21:22.519347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98745e66-299e-48cf-9d80-d0a516d774af tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:22.520179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98745e66-299e-48cf-9d80-d0a516d774af tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:22.521254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98745e66-299e-48cf-9d80-d0a516d774af tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:22.522613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98745e66-299e-48cf-9d80-d0a516d774af tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:22.551123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7c173cd2-f77e-4434-8b98-7bbebcff87f5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'create', calling method: .version_select at 0x7f5b12a993a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1075978888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6rjV17WOSfefI3hpx+Xv+V+vc5nmN0gLz5YGul5Bn5x/vpXphveqXSP1Kkl494q6wUOZ+muNgWCH/qMvd9VubCbFMp34xfGRi+qYB9Ld43HjWlllZWntnzPN9BhL/WuQ=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:22.580448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-7c173cd2-f77e-4434-8b98-7bbebcff87f5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for project f6179959e78b438cb68680f694190a8c. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:21:22.588889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-7c173cd2-f77e-4434-8b98-7bbebcff87f5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for user adca21bc340d440e91e4d856a625cd3a and project f6179959e78b438cb68680f694190a8c. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:21:22.621148 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7c173cd2-f77e-4434-8b98-7bbebcff87f5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.085503 Aug 03 02:21:22.622317 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2824/5526] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:21:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:21:22.871607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-98745e66-299e-48cf-9d80-d0a516d774af tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:22.887518 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-98745e66-299e-48cf-9d80-d0a516d774af tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.427755 Aug 03 02:21:22.889438 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2703/5527] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:22 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:21:22.913232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9bc89ae2-dc10-4454-92cb-c67f0fe3e86c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:22.914086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9bc89ae2-dc10-4454-92cb-c67f0fe3e86c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:22.925958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bc89ae2-dc10-4454-92cb-c67f0fe3e86c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:22.927363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bc89ae2-dc10-4454-92cb-c67f0fe3e86c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:22.928299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bc89ae2-dc10-4454-92cb-c67f0fe3e86c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:22.931658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bc89ae2-dc10-4454-92cb-c67f0fe3e86c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:23.254315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9bc89ae2-dc10-4454-92cb-c67f0fe3e86c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:23.271559 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9bc89ae2-dc10-4454-92cb-c67f0fe3e86c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.358723 Aug 03 02:21:23.275051 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2825/5528] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:22 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:26.666838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8514411-907c-4033-983a-1616586c929d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-637019414", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5cdbdb51-8bea-4b5f-91e6-80ed8b4a550a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:26.759817 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-b8514411-907c-4033-983a-1616586c929d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Block Device 5cdbdb51-8bea-4b5f-91e6-80ed8b4a550a is not bootable. Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8514411-907c-4033-983a-1616586c929d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 357 Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-637019414", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5cdbdb51-8bea-4b5f-91e6-80ed8b4a550a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: exception: Block Device 5cdbdb51-8bea-4b5f-91e6-80ed8b4a550a is not bootable. Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-637019414', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '5cdbdb51-8bea-4b5f-91e6-80ed8b4a550a'}], 'networks': [{'uuid': 'd5928fc2-6005-4eab-90c9-c57e9fce7e40'}]}}} Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1624, in _create_instance Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 5cdbdb51-8bea-4b5f-91e6-80ed8b4a550a is not bootable. Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:26.780964 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 5cdbdb51-8bea-4b5f-91e6-80ed8b4a550a is not bootable. Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 5cdbdb51-8bea-4b5f-91e6-80ed8b4a550a is not bootable. Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8514411-907c-4033-983a-1616586c929d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 400 to user: Block Device 5cdbdb51-8bea-4b5f-91e6-80ed8b4a550a is not bootable. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:26.784753 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b8514411-907c-4033-983a-1616586c929d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.158313 Aug 03 02:21:26.788977 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2704/5529] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:21:26 2022] POST /compute/v2.1/servers => generated 110 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:21:26.799455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ea5d50b9-b987-4f1f-b1d3-8b714649097b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:26.800702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ea5d50b9-b987-4f1f-b1d3-8b714649097b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:26.808575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea5d50b9-b987-4f1f-b1d3-8b714649097b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:26.809720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea5d50b9-b987-4f1f-b1d3-8b714649097b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:26.810852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea5d50b9-b987-4f1f-b1d3-8b714649097b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:26.811500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea5d50b9-b987-4f1f-b1d3-8b714649097b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:27.161544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ea5d50b9-b987-4f1f-b1d3-8b714649097b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:27.183897 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ea5d50b9-b987-4f1f-b1d3-8b714649097b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.389030 Aug 03 02:21:27.185692 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2826/5530] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:26 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:27.208415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7d882264-4836-4e0d-bec5-7b4ebf63104c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:27.210019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7d882264-4836-4e0d-bec5-7b4ebf63104c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:27.230289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d882264-4836-4e0d-bec5-7b4ebf63104c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:27.230741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d882264-4836-4e0d-bec5-7b4ebf63104c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:27.231645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d882264-4836-4e0d-bec5-7b4ebf63104c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:27.232174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d882264-4836-4e0d-bec5-7b4ebf63104c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:27.523818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7d882264-4836-4e0d-bec5-7b4ebf63104c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:27.539703 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7d882264-4836-4e0d-bec5-7b4ebf63104c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.335387 Aug 03 02:21:27.543114 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2705/5531] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:27 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:30.364221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3b85af0f-cec2-43d4-868a-446a19b6a998 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2104532103", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "destination_type": "local"}, {"source_type": "volume", "uuid": "c8b8b9da-1d0d-463d-b560-340d12e4347c", "destination_type": "invalid"}], "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3b85af0f-cec2-43d4-868a-446a19b6a998 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 495 Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2104532103", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "destination_type": "local"}, {"source_type": "volume", "uuid": "c8b8b9da-1d0d-463d-b560-340d12e4347c", "destination_type": "invalid"}], "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2104532103', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'c8b8b9da-1d0d-463d-b560-340d12e4347c', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'd5928fc2-6005-4eab-90c9-c57e9fce7e40'}]}}} Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'invalid' Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:30.371486 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 03 02:21:30.375597 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:30.378550 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3b85af0f-cec2-43d4-868a-446a19b6a998 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:30.380013 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3b85af0f-cec2-43d4-868a-446a19b6a998 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.019850 Aug 03 02:21:30.390956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0982e296-7c4e-42d4-9221-1ee67eb22ead tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:30.392253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0982e296-7c4e-42d4-9221-1ee67eb22ead tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:30.398546 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2827/5532] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:21:30 2022] POST /compute/v2.1/servers => generated 155 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:21:30.402965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0982e296-7c4e-42d4-9221-1ee67eb22ead tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:30.403787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0982e296-7c4e-42d4-9221-1ee67eb22ead tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:30.404838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0982e296-7c4e-42d4-9221-1ee67eb22ead tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:30.405520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0982e296-7c4e-42d4-9221-1ee67eb22ead tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:30.890388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0982e296-7c4e-42d4-9221-1ee67eb22ead tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:30.901105 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0982e296-7c4e-42d4-9221-1ee67eb22ead tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.514655 Aug 03 02:21:30.902385 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2706/5533] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:30 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:30.964313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0ee9412d-6b7e-4ccd-bb52-1b2cd2689183 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:30.972570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0ee9412d-6b7e-4ccd-bb52-1b2cd2689183 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:31.012822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0ee9412d-6b7e-4ccd-bb52-1b2cd2689183 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:31.013415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0ee9412d-6b7e-4ccd-bb52-1b2cd2689183 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:31.014317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0ee9412d-6b7e-4ccd-bb52-1b2cd2689183 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:31.014859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0ee9412d-6b7e-4ccd-bb52-1b2cd2689183 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:31.679967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0ee9412d-6b7e-4ccd-bb52-1b2cd2689183 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:31.691026 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0ee9412d-6b7e-4ccd-bb52-1b2cd2689183 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.752538 Aug 03 02:21:31.699931 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2828/5534] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:30 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:31.886153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bd829f13-f948-481f-baab-8af0415975e6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-847232833", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bd829f13-f948-481f-baab-8af0415975e6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 491 Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-847232833", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-847232833', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'd5928fc2-6005-4eab-90c9-c57e9fce7e40'}]}}} Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:31.892890 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 03 02:21:31.895974 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:31.902204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bd829f13-f948-481f-baab-8af0415975e6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:31.904011 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bd829f13-f948-481f-baab-8af0415975e6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.022996 Aug 03 02:21:31.908689 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2707/5535] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:21:31 2022] POST /compute/v2.1/servers => generated 624 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:21:31.914395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b61e8ebd-08a1-44d1-876e-d27d3962bcf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:31.915284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b61e8ebd-08a1-44d1-876e-d27d3962bcf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:31.925355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b61e8ebd-08a1-44d1-876e-d27d3962bcf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:31.926026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b61e8ebd-08a1-44d1-876e-d27d3962bcf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:31.929815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b61e8ebd-08a1-44d1-876e-d27d3962bcf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:31.935013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b61e8ebd-08a1-44d1-876e-d27d3962bcf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:32.375074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b61e8ebd-08a1-44d1-876e-d27d3962bcf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:32.387973 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b61e8ebd-08a1-44d1-876e-d27d3962bcf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.477677 Aug 03 02:21:32.408251 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2829/5536] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:31 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:32.418725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-42805740-bb70-4e53-9214-0b867af5e6d0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:32.418725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-42805740-bb70-4e53-9214-0b867af5e6d0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:32.430853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42805740-bb70-4e53-9214-0b867af5e6d0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:32.431426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42805740-bb70-4e53-9214-0b867af5e6d0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:32.432301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42805740-bb70-4e53-9214-0b867af5e6d0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:32.432752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-42805740-bb70-4e53-9214-0b867af5e6d0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:32.983777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-42805740-bb70-4e53-9214-0b867af5e6d0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:33.004966 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-42805740-bb70-4e53-9214-0b867af5e6d0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.592795 Aug 03 02:21:33.006625 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2708/5537] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:32 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:21:33.121512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d8b6c1b9-a6c2-481c-8894-de94b40a6c73 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d8b6c1b9-a6c2-481c-8894-de94b40a6c73 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 416 Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'networks': [{'uuid': 'd5928fc2-6005-4eab-90c9-c57e9fce7e40'}]}}} Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:33.132474 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:33.137056 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d8b6c1b9-a6c2-481c-8894-de94b40a6c73 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:33.140570 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d8b6c1b9-a6c2-481c-8894-de94b40a6c73 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.027534 Aug 03 02:21:33.141215 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2830/5538] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:21:33 2022] POST /compute/v2.1/servers => generated 619 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 02:21:33.151811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-40f37002-12c2-4cdc-9ad3-acc6c5455fbf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:33.152508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-40f37002-12c2-4cdc-9ad3-acc6c5455fbf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:33.169940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40f37002-12c2-4cdc-9ad3-acc6c5455fbf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:33.170922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40f37002-12c2-4cdc-9ad3-acc6c5455fbf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:33.171986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40f37002-12c2-4cdc-9ad3-acc6c5455fbf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:33.172741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40f37002-12c2-4cdc-9ad3-acc6c5455fbf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:34.067362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-40f37002-12c2-4cdc-9ad3-acc6c5455fbf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:34.081901 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-40f37002-12c2-4cdc-9ad3-acc6c5455fbf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.935931 Aug 03 02:21:34.108851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8a8f009f-547c-48b3-bd2f-ba8065c3905f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:34.109238 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2709/5539] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:33 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:34.110013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8a8f009f-547c-48b3-bd2f-ba8065c3905f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:34.113994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:34.123777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:34.146664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a8f009f-547c-48b3-bd2f-ba8065c3905f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:34.147477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a8f009f-547c-48b3-bd2f-ba8065c3905f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:34.151378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a8f009f-547c-48b3-bd2f-ba8065c3905f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:34.152055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a8f009f-547c-48b3-bd2f-ba8065c3905f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:34.274065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=90 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:35.248816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8a8f009f-547c-48b3-bd2f-ba8065c3905f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:35.261979 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8a8f009f-547c-48b3-bd2f-ba8065c3905f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 1.158556 Aug 03 02:21:35.266936 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2831/5540] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:34 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:35.470595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d7303980-ee79-4015-bff5-8d3404630a1d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1740441038", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": -1, "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:35.507333 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-d7303980-ee79-4015-bff5-8d3404630a1d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Flavor -1 could not be found. Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d7303980-ee79-4015-bff5-8d3404630a1d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 206 Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1740441038", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": -1, "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: exception: Flavor -1 could not be found. Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1740441038', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': -1, 'networks': [{'uuid': 'd5928fc2-6005-4eab-90c9-c57e9fce7e40'}]}}} Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:35.533694 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 03 02:21:35.538377 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:35.551235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d7303980-ee79-4015-bff5-8d3404630a1d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:35.551235 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d7303980-ee79-4015-bff5-8d3404630a1d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.085713 Aug 03 02:21:35.552645 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2710/5541] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:21:35 2022] POST /compute/v2.1/servers => generated 73 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 02:21:35.565404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cb0ccd63-5204-42fb-984b-107328880e0c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:35.567157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cb0ccd63-5204-42fb-984b-107328880e0c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:35.584498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cb0ccd63-5204-42fb-984b-107328880e0c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:35.585268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cb0ccd63-5204-42fb-984b-107328880e0c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:35.589516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cb0ccd63-5204-42fb-984b-107328880e0c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:35.590136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cb0ccd63-5204-42fb-984b-107328880e0c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:35.801400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1560941681", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "84f3186c-b18c-49a2-b765-dc728bd673c6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1075978888", "security_groups": [{"name": "tempest-secgroup-smoke-345608060"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:35.963142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cb0ccd63-5204-42fb-984b-107328880e0c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:35.976476 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cb0ccd63-5204-42fb-984b-107328880e0c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.418607 Aug 03 02:21:35.998629 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2832/5542] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:35 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:36.013045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a88aab03-53a8-4f1f-89e6-5c2fc3feec34 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:36.015170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a88aab03-53a8-4f1f-89e6-5c2fc3feec34 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:36.036848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a88aab03-53a8-4f1f-89e6-5c2fc3feec34 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:36.039430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a88aab03-53a8-4f1f-89e6-5c2fc3feec34 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:36.040451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a88aab03-53a8-4f1f-89e6-5c2fc3feec34 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:36.042087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a88aab03-53a8-4f1f-89e6-5c2fc3feec34 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:36.165725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] validate_networks() for [('84f3186c-b18c-49a2-b765-dc728bd673c6', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:21:36.416187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a88aab03-53a8-4f1f-89e6-5c2fc3feec34 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:36.430094 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a88aab03-53a8-4f1f-89e6-5c2fc3feec34 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.430317 Aug 03 02:21:36.436008 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2833/5543] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:35 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:36.588023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b92351d5-3465-4105-bd2b-bad46b5f7616 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-91297983", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b92351d5-3465-4105-bd2b-bad46b5f7616 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 171 Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-91297983", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-91297983', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'd5928fc2-6005-4eab-90c9-c57e9fce7e40'}]}}} Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi -1 Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:21:36.595060 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:21:36.601148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:21:36.601148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:21:36.601148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:21:36.601148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 03 02:21:36.601148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:36.601148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:36.601148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:36.601148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:36.601148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:36.601148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:36.601148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:21:36.601148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:21:36.601148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 03 02:21:36.601148 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:36.608809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b92351d5-3465-4105-bd2b-bad46b5f7616 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:36.611320 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b92351d5-3465-4105-bd2b-bad46b5f7616 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.029100 Aug 03 02:21:36.619313 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2834/5544] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:21:36 2022] POST /compute/v2.1/servers => generated 145 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:21:36.626612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-db094913-0366-4be7-9b19-f662c1d6a0a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:36.627304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-db094913-0366-4be7-9b19-f662c1d6a0a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:36.670559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-db094913-0366-4be7-9b19-f662c1d6a0a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:36.671033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-db094913-0366-4be7-9b19-f662c1d6a0a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:36.672082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-db094913-0366-4be7-9b19-f662c1d6a0a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:36.678507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-db094913-0366-4be7-9b19-f662c1d6a0a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:37.227804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-db094913-0366-4be7-9b19-f662c1d6a0a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:37.244523 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-db094913-0366-4be7-9b19-f662c1d6a0a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.623713 Aug 03 02:21:37.245432 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2835/5545] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:36 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:37.268237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:21:37.268705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:21:37.269137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:21:37.269551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:21:37.270062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:21:37.272793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-124587be-b063-4daf-b688-0534a192c73c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:37.276164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-124587be-b063-4daf-b688-0534a192c73c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:37.281710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:37.302267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:37.302502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-124587be-b063-4daf-b688-0534a192c73c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:37.303410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:37.303805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-124587be-b063-4daf-b688-0534a192c73c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:37.304973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:37.306285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:37.307147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-124587be-b063-4daf-b688-0534a192c73c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:37.307630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-124587be-b063-4daf-b688-0534a192c73c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:37.332386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for project f6179959e78b438cb68680f694190a8c. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:21:37.341688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for user adca21bc340d440e91e4d856a625cd3a and project f6179959e78b438cb68680f694190a8c. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:21:37.409464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:21:37.411773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:21:37.507585 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0bc952e7-1c45-4d55-a82e-6c60fd9e4a88 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.711229 Aug 03 02:21:37.519054 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2711/5546] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:21:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:21:37.537802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6ef09da5-638f-47ef-a667-d7cd4a06b5f9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:37.543867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6ef09da5-638f-47ef-a667-d7cd4a06b5f9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:37.689870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6ef09da5-638f-47ef-a667-d7cd4a06b5f9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:37.739661 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6ef09da5-638f-47ef-a667-d7cd4a06b5f9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1267 microversion: 2.1 time: 0.190434 Aug 03 02:21:37.743212 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2712/5547] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:37 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:21:37.760675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-124587be-b063-4daf-b688-0534a192c73c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:37.783368 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-124587be-b063-4daf-b688-0534a192c73c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.518389 Aug 03 02:21:37.796938 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2836/5548] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:37 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:38.057341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f31b22ad-5913-4a2f-83fe-5f719779cbda tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1281764030", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:38.065090 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-f31b22ad-5913-4a2f-83fe-5f719779cbda tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f31b22ad-5913-4a2f-83fe-5f719779cbda tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 216 Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1281764030", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1281764030', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:38.068677 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:38.073498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:38.073498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:38.073498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:38.073498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:38.073498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:38.073498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:38.073498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 03 02:21:38.073498 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:38.073498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f31b22ad-5913-4a2f-83fe-5f719779cbda tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:38.073498 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f31b22ad-5913-4a2f-83fe-5f719779cbda tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.020396 Aug 03 02:21:38.077553 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2713/5549] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:21:38 2022] POST /compute/v2.1/servers => generated 123 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:21:38.090104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-434dd25c-2720-4584-8410-a546bcebfc29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:38.090758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-434dd25c-2720-4584-8410-a546bcebfc29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:38.104306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-434dd25c-2720-4584-8410-a546bcebfc29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:38.104773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-434dd25c-2720-4584-8410-a546bcebfc29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:38.105595 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-434dd25c-2720-4584-8410-a546bcebfc29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:38.106048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-434dd25c-2720-4584-8410-a546bcebfc29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:38.486958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-434dd25c-2720-4584-8410-a546bcebfc29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:38.506868 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-434dd25c-2720-4584-8410-a546bcebfc29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.423260 Aug 03 02:21:38.508251 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2837/5550] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:38 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:38.534191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-76af5f90-c36d-40b4-9138-01c73b42c59b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:38.535517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-76af5f90-c36d-40b4-9138-01c73b42c59b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:38.547455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76af5f90-c36d-40b4-9138-01c73b42c59b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:38.549970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76af5f90-c36d-40b4-9138-01c73b42c59b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:38.551912 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76af5f90-c36d-40b4-9138-01c73b42c59b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:38.552539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76af5f90-c36d-40b4-9138-01c73b42c59b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:38.763781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-41893a8e-d358-403c-abe5-94ccbb1f3c0c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:38.765183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-41893a8e-d358-403c-abe5-94ccbb1f3c0c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:38.774488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41893a8e-d358-403c-abe5-94ccbb1f3c0c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:38.783265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41893a8e-d358-403c-abe5-94ccbb1f3c0c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:38.785915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41893a8e-d358-403c-abe5-94ccbb1f3c0c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:38.786382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-41893a8e-d358-403c-abe5-94ccbb1f3c0c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:38.838082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-76af5f90-c36d-40b4-9138-01c73b42c59b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:38.863323 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-76af5f90-c36d-40b4-9138-01c73b42c59b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.332673 Aug 03 02:21:38.884777 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2714/5551] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:38 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:38.930139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-41893a8e-d358-403c-abe5-94ccbb1f3c0c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:38.945282 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-41893a8e-d358-403c-abe5-94ccbb1f3c0c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1263 microversion: 2.1 time: 0.184975 Aug 03 02:21:38.946881 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2838/5552] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:38 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1263 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:21:39.075923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2e1c7fb2-a355-4c71-86da-fbae00bd37d0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-733412679", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "key_name": "tempest-key-528211619", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:39.142531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-2e1c7fb2-a355-4c71-86da-fbae00bd37d0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] validate_networks() for [('d5928fc2-6005-4eab-90c9-c57e9fce7e40', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:21:39.673448 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-2e1c7fb2-a355-4c71-86da-fbae00bd37d0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Invalid key_name provided. Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2e1c7fb2-a355-4c71-86da-fbae00bd37d0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 245 Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-733412679", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "key_name": "tempest-key-528211619", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid key_name provided. Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-733412679', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'key_name': 'tempest-key-528211619', 'networks': [{'uuid': 'd5928fc2-6005-4eab-90c9-c57e9fce7e40'}]}}} Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1077, in _validate_and_build_base_options Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-528211619 not found for user 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:39.678490 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2e1c7fb2-a355-4c71-86da-fbae00bd37d0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 400 to user: Invalid key_name provided. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:39.682421 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2e1c7fb2-a355-4c71-86da-fbae00bd37d0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.609884 Aug 03 02:21:39.694154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d4d7667b-5b54-49c5-86d9-ec56760a81b9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:39.694793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d4d7667b-5b54-49c5-86d9-ec56760a81b9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:39.701049 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2715/5553] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:21:39 2022] POST /compute/v2.1/servers => generated 70 bytes in 630 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 02:21:39.710916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4d7667b-5b54-49c5-86d9-ec56760a81b9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:39.711310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4d7667b-5b54-49c5-86d9-ec56760a81b9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:39.712119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4d7667b-5b54-49c5-86d9-ec56760a81b9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:39.715618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4d7667b-5b54-49c5-86d9-ec56760a81b9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:39.973639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7122fc6b-aace-4701-89fd-a6fe4529a77e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:39.974345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7122fc6b-aace-4701-89fd-a6fe4529a77e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:39.990337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7122fc6b-aace-4701-89fd-a6fe4529a77e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:39.990816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7122fc6b-aace-4701-89fd-a6fe4529a77e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:40.004168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7122fc6b-aace-4701-89fd-a6fe4529a77e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:40.004644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7122fc6b-aace-4701-89fd-a6fe4529a77e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:40.242276 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7122fc6b-aace-4701-89fd-a6fe4529a77e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:40.253053 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7122fc6b-aace-4701-89fd-a6fe4529a77e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1325 microversion: 2.1 time: 0.286994 Aug 03 02:21:40.262816 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2716/5554] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:39 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1325 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:21:40.316210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d4d7667b-5b54-49c5-86d9-ec56760a81b9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:40.339326 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d4d7667b-5b54-49c5-86d9-ec56760a81b9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.651796 Aug 03 02:21:40.343234 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2839/5555] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:39 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:40.361755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b94da00c-0518-4117-acdc-a83d8550b1a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:40.362392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b94da00c-0518-4117-acdc-a83d8550b1a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:40.380900 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b94da00c-0518-4117-acdc-a83d8550b1a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:40.381383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b94da00c-0518-4117-acdc-a83d8550b1a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:40.382189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b94da00c-0518-4117-acdc-a83d8550b1a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:40.382639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b94da00c-0518-4117-acdc-a83d8550b1a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:40.685558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b94da00c-0518-4117-acdc-a83d8550b1a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:40.695973 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b94da00c-0518-4117-acdc-a83d8550b1a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.338424 Aug 03 02:21:40.696571 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2717/5556] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:40 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:41.016345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-581e7238-4d83-49ba-874f-38ac02a3cd21 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-26437854", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:41.283182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.security_group_api [None req-581e7238-4d83-49ba-874f-38ac02a3cd21 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Neutron security group does_not_exist not found {{(pid=125941) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 03 02:21:41.284016 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-581e7238-4d83-49ba-874f-38ac02a3cd21 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 03 02:21:41.293149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-98cdf924-c1ba-48d7-ad56-a540e8bb289c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:41.295040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-98cdf924-c1ba-48d7-ad56-a540e8bb289c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-581e7238-4d83-49ba-874f-38ac02a3cd21 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 256 Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-26437854", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-26437854', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'd5928fc2-6005-4eab-90c9-c57e9fce7e40'}]}}} Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 03 02:21:41.311816 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1062, in _validate_and_build_base_options Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 509, in _check_requested_secgroups Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:41.319518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-581e7238-4d83-49ba-874f-38ac02a3cd21 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:41.329805 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-581e7238-4d83-49ba-874f-38ac02a3cd21 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.297139 Aug 03 02:21:41.329805 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2840/5557] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:21:41 2022] POST /compute/v2.1/servers => generated 106 bytes in 302 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:21:41.329805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a9d2fde1-ec70-45f6-9643-1457bd3ab62e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:41.329805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a9d2fde1-ec70-45f6-9643-1457bd3ab62e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:41.341813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98cdf924-c1ba-48d7-ad56-a540e8bb289c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:41.342560 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98cdf924-c1ba-48d7-ad56-a540e8bb289c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:41.353372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98cdf924-c1ba-48d7-ad56-a540e8bb289c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:41.354170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98cdf924-c1ba-48d7-ad56-a540e8bb289c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:41.355790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9d2fde1-ec70-45f6-9643-1457bd3ab62e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:41.360511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9d2fde1-ec70-45f6-9643-1457bd3ab62e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:41.361024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9d2fde1-ec70-45f6-9643-1457bd3ab62e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:41.362800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9d2fde1-ec70-45f6-9643-1457bd3ab62e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:41.696849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-98cdf924-c1ba-48d7-ad56-a540e8bb289c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:41.710614 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-98cdf924-c1ba-48d7-ad56-a540e8bb289c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1392 microversion: 2.1 time: 0.424684 Aug 03 02:21:41.711242 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2718/5558] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:41 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1392 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:41.740860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a9d2fde1-ec70-45f6-9643-1457bd3ab62e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:41.749378 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a9d2fde1-ec70-45f6-9643-1457bd3ab62e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.434792 Aug 03 02:21:41.750404 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2841/5559] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:41 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:41.784610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6900ef4a-fbe0-41ff-9475-b6bc46f6a63e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:41.788777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6900ef4a-fbe0-41ff-9475-b6bc46f6a63e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:41.806083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6900ef4a-fbe0-41ff-9475-b6bc46f6a63e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:41.806558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6900ef4a-fbe0-41ff-9475-b6bc46f6a63e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:41.807675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6900ef4a-fbe0-41ff-9475-b6bc46f6a63e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:41.808824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6900ef4a-fbe0-41ff-9475-b6bc46f6a63e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:42.128745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2fd9796b-2bd8-441e-9ff4-b88cfdf574aa req-d75b71ec-9c44-45b3-9bdb-945e35504483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e9f5029-1b4c-4764-87a8-e7df5950154a", "tag": "2c175fa6-c779-4716-992f-2b2d4e374e11"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:42.159317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2fd9796b-2bd8-441e-9ff4-b88cfdf574aa req-d75b71ec-9c44-45b3-9bdb-945e35504483 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:42.159689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2fd9796b-2bd8-441e-9ff4-b88cfdf574aa req-d75b71ec-9c44-45b3-9bdb-945e35504483 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:42.186074 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2fd9796b-2bd8-441e-9ff4-b88cfdf574aa req-d75b71ec-9c44-45b3-9bdb-945e35504483 service nova] Creating event network-changed:2c175fa6-c779-4716-992f-2b2d4e374e11 for instance 0e9f5029-1b4c-4764-87a8-e7df5950154a on n-h1-826529-8 Aug 03 02:21:42.192814 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2fd9796b-2bd8-441e-9ff4-b88cfdf574aa req-d75b71ec-9c44-45b3-9bdb-945e35504483 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070752 Aug 03 02:21:42.194463 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2842/5560] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:21:42.196825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6900ef4a-fbe0-41ff-9475-b6bc46f6a63e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:42.208431 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6900ef4a-fbe0-41ff-9475-b6bc46f6a63e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.438025 Aug 03 02:21:42.209064 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2719/5561] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:41 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:42.236222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4307bf93-ddba-46f3-88b6-b79cfcc75078 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:42.238422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4307bf93-ddba-46f3-88b6-b79cfcc75078 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 2464e4a8-5216-4395-94aa-41925108025b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:42.245935 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-4307bf93-ddba-46f3-88b6-b79cfcc75078 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance 2464e4a8-5216-4395-94aa-41925108025b could not be found. Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4307bf93-ddba-46f3-88b6-b79cfcc75078 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/2464e4a8-5216-4395-94aa-41925108025b HTTP/1.1 Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 2464e4a8-5216-4395-94aa-41925108025b could not be found. Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '2464e4a8-5216-4395-94aa-41925108025b'} Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2464e4a8-5216-4395-94aa-41925108025b could not be found. Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2464e4a8-5216-4395-94aa-41925108025b could not be found. Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:42.250003 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:42.256097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:42.256097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:42.256097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:42.256097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:42.256097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:42.256097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:42.256097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2464e4a8-5216-4395-94aa-41925108025b could not be found. Aug 03 02:21:42.256097 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:42.259893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4307bf93-ddba-46f3-88b6-b79cfcc75078 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance 2464e4a8-5216-4395-94aa-41925108025b could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:42.261115 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4307bf93-ddba-46f3-88b6-b79cfcc75078 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2464e4a8-5216-4395-94aa-41925108025b" status: 404 len: 111 microversion: 2.1 time: 0.031871 Aug 03 02:21:42.262335 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2843/5562] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:21:42 2022] DELETE /compute/v2.1/servers/2464e4a8-5216-4395-94aa-41925108025b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:21:42.273571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ca50873a-6daa-4141-98fa-b0467b78f19a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:42.274500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ca50873a-6daa-4141-98fa-b0467b78f19a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:42.284314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca50873a-6daa-4141-98fa-b0467b78f19a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:42.285174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca50873a-6daa-4141-98fa-b0467b78f19a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:42.286237 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca50873a-6daa-4141-98fa-b0467b78f19a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:42.287739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca50873a-6daa-4141-98fa-b0467b78f19a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:42.692527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ca50873a-6daa-4141-98fa-b0467b78f19a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:42.697607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:42.705841 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ca50873a-6daa-4141-98fa-b0467b78f19a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.438396 Aug 03 02:21:42.706733 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2720/5563] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:42 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:42.730427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-647c04c3-0f43-4781-8526-266bcac25832 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:42.736370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4bd4f777-95ab-4191-b4ee-1f4b254db97b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:42.737732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4bd4f777-95ab-4191-b4ee-1f4b254db97b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:42.741124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-647c04c3-0f43-4781-8526-266bcac25832 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:42.758612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-647c04c3-0f43-4781-8526-266bcac25832 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:42.759454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-647c04c3-0f43-4781-8526-266bcac25832 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:42.761178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4bd4f777-95ab-4191-b4ee-1f4b254db97b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:42.762072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-647c04c3-0f43-4781-8526-266bcac25832 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:42.762749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-647c04c3-0f43-4781-8526-266bcac25832 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:42.766694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4bd4f777-95ab-4191-b4ee-1f4b254db97b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:42.768088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4bd4f777-95ab-4191-b4ee-1f4b254db97b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:42.768817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4bd4f777-95ab-4191-b4ee-1f4b254db97b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:43.139621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4bd4f777-95ab-4191-b4ee-1f4b254db97b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:43.151767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-647c04c3-0f43-4781-8526-266bcac25832 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:43.166204 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4bd4f777-95ab-4191-b4ee-1f4b254db97b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1392 microversion: 2.1 time: 0.429425 Aug 03 02:21:43.166683 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-647c04c3-0f43-4781-8526-266bcac25832 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.439924 Aug 03 02:21:43.166863 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2721/5564] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:42 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1392 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:43.168523 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2844/5565] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:42 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:43.188742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0c0d071-c8e6-4135-94fc-2f997e28df11 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:43.189238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0c0d071-c8e6-4135-94fc-2f997e28df11 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Failed to fetch instance by id 9223372036854775808 {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 03 02:21:43.189767 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-a0c0d071-c8e6-4135-94fc-2f997e28df11 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0c0d071-c8e6-4135-94fc-2f997e28df11 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 9223372036854775808 could not be found. Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '9223372036854775808'} Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:43.191484 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:43.196376 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:43.196376 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:43.196376 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:43.196376 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 03 02:21:43.196376 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:43.196376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0c0d071-c8e6-4135-94fc-2f997e28df11 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:43.196376 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0c0d071-c8e6-4135-94fc-2f997e28df11 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008219 Aug 03 02:21:43.196376 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2722/5566] 10.222.0.67 () {58 vars in 1188 bytes} [Wed Aug 3 02:21:43 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:21:43.203606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fedad582-10a5-41ef-a553-1b1beb8f6a94 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:43.204388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fedad582-10a5-41ef-a553-1b1beb8f6a94 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:43.211549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fedad582-10a5-41ef-a553-1b1beb8f6a94 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:43.212013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fedad582-10a5-41ef-a553-1b1beb8f6a94 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:43.212818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fedad582-10a5-41ef-a553-1b1beb8f6a94 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:43.213262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fedad582-10a5-41ef-a553-1b1beb8f6a94 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:43.429507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fedad582-10a5-41ef-a553-1b1beb8f6a94 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:43.448358 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fedad582-10a5-41ef-a553-1b1beb8f6a94 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.248814 Aug 03 02:21:43.451048 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2845/5567] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:43 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:43.472930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1b088d08-9536-42c9-9370-603fcd65dcc0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:43.473493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1b088d08-9536-42c9-9370-603fcd65dcc0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:43.485914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b088d08-9536-42c9-9370-603fcd65dcc0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:43.486700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b088d08-9536-42c9-9370-603fcd65dcc0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:43.487736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b088d08-9536-42c9-9370-603fcd65dcc0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:43.488419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b088d08-9536-42c9-9370-603fcd65dcc0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:43.736807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1b088d08-9536-42c9-9370-603fcd65dcc0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:43.755261 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1b088d08-9536-42c9-9370-603fcd65dcc0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.286993 Aug 03 02:21:43.756591 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2723/5568] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:43 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:43.779854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d00d5aa0-4f48-49d1-94b5-6f428c5559b7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:43.780704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d00d5aa0-4f48-49d1-94b5-6f428c5559b7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Failed to fetch instance by id -1 {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 03 02:21:43.781430 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-d00d5aa0-4f48-49d1-94b5-6f428c5559b7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance -1 could not be found. Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d00d5aa0-4f48-49d1-94b5-6f428c5559b7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance -1 could not be found. Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '-1'} Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:43.783977 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:43.788299 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:43.788299 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:43.788299 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 03 02:21:43.788299 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:43.791053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d00d5aa0-4f48-49d1-94b5-6f428c5559b7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance -1 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:43.792451 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d00d5aa0-4f48-49d1-94b5-6f428c5559b7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.017589 Aug 03 02:21:43.793412 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2846/5569] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 02:21:43 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 03 02:21:43.807120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6f788703-ef0c-41cd-893c-2664a16ad12e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:43.807744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6f788703-ef0c-41cd-893c-2664a16ad12e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:43.817614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f788703-ef0c-41cd-893c-2664a16ad12e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:43.819311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f788703-ef0c-41cd-893c-2664a16ad12e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:43.820523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f788703-ef0c-41cd-893c-2664a16ad12e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:43.821029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f788703-ef0c-41cd-893c-2664a16ad12e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:44.089975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6f788703-ef0c-41cd-893c-2664a16ad12e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:44.098814 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6f788703-ef0c-41cd-893c-2664a16ad12e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.300214 Aug 03 02:21:44.104571 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2724/5570] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:43 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:44.130362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0d39e592-a30d-4da0-92eb-d6f2064de9e0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:44.136612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0d39e592-a30d-4da0-92eb-d6f2064de9e0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:44.169881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d39e592-a30d-4da0-92eb-d6f2064de9e0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:44.170341 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d39e592-a30d-4da0-92eb-d6f2064de9e0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:44.172821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d39e592-a30d-4da0-92eb-d6f2064de9e0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:44.173866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d39e592-a30d-4da0-92eb-d6f2064de9e0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:44.189126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a2873b5a-7153-4ba6-9311-994bf520a867 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:44.190193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a2873b5a-7153-4ba6-9311-994bf520a867 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:44.206225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2873b5a-7153-4ba6-9311-994bf520a867 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:44.212232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2873b5a-7153-4ba6-9311-994bf520a867 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:44.214268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2873b5a-7153-4ba6-9311-994bf520a867 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:44.218138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2873b5a-7153-4ba6-9311-994bf520a867 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:44.831330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a2873b5a-7153-4ba6-9311-994bf520a867 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:44.856892 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a2873b5a-7153-4ba6-9311-994bf520a867 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1392 microversion: 2.1 time: 0.672149 Aug 03 02:21:44.860231 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2725/5571] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:44 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1392 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:44.866092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0d39e592-a30d-4da0-92eb-d6f2064de9e0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:44.877612 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0d39e592-a30d-4da0-92eb-d6f2064de9e0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.752385 Aug 03 02:21:44.879457 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2847/5572] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:44 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:44.904837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-236ed7f4-6067-4c83-b2b7-7e05d7035a82 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:44.905425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-236ed7f4-6067-4c83-b2b7-7e05d7035a82 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: d9fc7394-c95e-48ed-a6eb-3b948c0b4904] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:44.930215 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-236ed7f4-6067-4c83-b2b7-7e05d7035a82 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance d9fc7394-c95e-48ed-a6eb-3b948c0b4904 could not be found. Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-236ed7f4-6067-4c83-b2b7-7e05d7035a82 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/d9fc7394-c95e-48ed-a6eb-3b948c0b4904/action HTTP/1.1 Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 19 Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: {"forceDelete": {}} Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance d9fc7394-c95e-48ed-a6eb-3b948c0b4904 could not be found. Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'd9fc7394-c95e-48ed-a6eb-3b948c0b4904', 'body': {'forceDelete': {}}} Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9fc7394-c95e-48ed-a6eb-3b948c0b4904 could not be found. Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9fc7394-c95e-48ed-a6eb-3b948c0b4904 could not be found. Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:44.947372 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:44.952155 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:44.952155 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:44.952155 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9fc7394-c95e-48ed-a6eb-3b948c0b4904 could not be found. Aug 03 02:21:44.952155 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:44.954173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-236ed7f4-6067-4c83-b2b7-7e05d7035a82 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance d9fc7394-c95e-48ed-a6eb-3b948c0b4904 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:44.956301 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-236ed7f4-6067-4c83-b2b7-7e05d7035a82 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/d9fc7394-c95e-48ed-a6eb-3b948c0b4904/action" status: 404 len: 111 microversion: 2.1 time: 0.060151 Aug 03 02:21:44.957633 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2726/5573] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:21:44 2022] POST /compute/v2.1/servers/d9fc7394-c95e-48ed-a6eb-3b948c0b4904/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:21:44.966663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a68b5ede-a345-4764-a3dd-a1678bf6d0bf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:44.967318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a68b5ede-a345-4764-a3dd-a1678bf6d0bf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:44.973455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a68b5ede-a345-4764-a3dd-a1678bf6d0bf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:44.974089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a68b5ede-a345-4764-a3dd-a1678bf6d0bf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:44.975431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a68b5ede-a345-4764-a3dd-a1678bf6d0bf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:44.976039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a68b5ede-a345-4764-a3dd-a1678bf6d0bf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:45.248508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a68b5ede-a345-4764-a3dd-a1678bf6d0bf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:45.258955 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a68b5ede-a345-4764-a3dd-a1678bf6d0bf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.296273 Aug 03 02:21:45.275582 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2848/5574] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:44 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:45.282632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7d38e327-398b-4a89-ad5b-247c411018c7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:45.285069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7d38e327-398b-4a89-ad5b-247c411018c7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:45.297713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d38e327-398b-4a89-ad5b-247c411018c7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:45.298455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d38e327-398b-4a89-ad5b-247c411018c7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:45.299878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d38e327-398b-4a89-ad5b-247c411018c7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:45.300622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d38e327-398b-4a89-ad5b-247c411018c7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:45.540761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7d38e327-398b-4a89-ad5b-247c411018c7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:45.551663 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7d38e327-398b-4a89-ad5b-247c411018c7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.274089 Aug 03 02:21:45.575259 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2727/5575] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:45 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:45.591882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f2ee5307-b074-4c96-8d9b-6b6887ed16b5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:45.594570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f2ee5307-b074-4c96-8d9b-6b6887ed16b5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 81ce42f5-83a0-41ce-9bcf-92096e1e6130] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:45.603748 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-f2ee5307-b074-4c96-8d9b-6b6887ed16b5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance 81ce42f5-83a0-41ce-9bcf-92096e1e6130 could not be found. Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f2ee5307-b074-4c96-8d9b-6b6887ed16b5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/81ce42f5-83a0-41ce-9bcf-92096e1e6130/action HTTP/1.1 Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 39 Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: {"os-getConsoleOutput": {"length": 10}} Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 81ce42f5-83a0-41ce-9bcf-92096e1e6130 could not be found. Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '81ce42f5-83a0-41ce-9bcf-92096e1e6130', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ce42f5-83a0-41ce-9bcf-92096e1e6130 could not be found. Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ce42f5-83a0-41ce-9bcf-92096e1e6130 could not be found. Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:45.616341 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:45.621064 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:45.621064 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:45.621064 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:45.621064 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:45.621064 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ce42f5-83a0-41ce-9bcf-92096e1e6130 could not be found. Aug 03 02:21:45.621064 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:45.621064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f2ee5307-b074-4c96-8d9b-6b6887ed16b5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance 81ce42f5-83a0-41ce-9bcf-92096e1e6130 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:45.621064 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f2ee5307-b074-4c96-8d9b-6b6887ed16b5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/81ce42f5-83a0-41ce-9bcf-92096e1e6130/action" status: 404 len: 111 microversion: 2.1 time: 0.030896 Aug 03 02:21:45.621064 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2849/5576] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:21:45 2022] POST /compute/v2.1/servers/81ce42f5-83a0-41ce-9bcf-92096e1e6130/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:21:45.628847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-83efba2a-6e54-47d3-a855-51c66352bf5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:45.629464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-83efba2a-6e54-47d3-a855-51c66352bf5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:45.639985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83efba2a-6e54-47d3-a855-51c66352bf5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:45.640781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83efba2a-6e54-47d3-a855-51c66352bf5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:45.644950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83efba2a-6e54-47d3-a855-51c66352bf5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:45.645597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83efba2a-6e54-47d3-a855-51c66352bf5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:45.884475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b68a2218-ceca-403e-a230-79e323eed2bf tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:45.885094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b68a2218-ceca-403e-a230-79e323eed2bf tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:45.904508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b68a2218-ceca-403e-a230-79e323eed2bf tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:45.904967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b68a2218-ceca-403e-a230-79e323eed2bf tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:45.905786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b68a2218-ceca-403e-a230-79e323eed2bf tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:45.906226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b68a2218-ceca-403e-a230-79e323eed2bf tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:45.974746 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-83efba2a-6e54-47d3-a855-51c66352bf5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:45.991500 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-83efba2a-6e54-47d3-a855-51c66352bf5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.368230 Aug 03 02:21:45.993411 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2728/5577] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:45 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:46.006118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-da549b24-801a-433f-937e-e0987be4293f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:46.006826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-da549b24-801a-433f-937e-e0987be4293f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:46.022324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da549b24-801a-433f-937e-e0987be4293f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:46.025537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da549b24-801a-433f-937e-e0987be4293f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:46.038497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da549b24-801a-433f-937e-e0987be4293f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:46.046281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da549b24-801a-433f-937e-e0987be4293f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:46.206971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-da549b24-801a-433f-937e-e0987be4293f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lazy-loading 'services' on Instance uuid 583e3553-3343-4c37-b5f9-df334dd4f27e {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:21:46.274009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b68a2218-ceca-403e-a230-79e323eed2bf tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:46.284754 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b68a2218-ceca-403e-a230-79e323eed2bf tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1392 microversion: 2.1 time: 0.405522 Aug 03 02:21:46.287150 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2850/5578] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:45 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1392 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:46.294675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c0365327-6028-40ef-805a-7277a6e8e842 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:46.296723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c0365327-6028-40ef-805a-7277a6e8e842 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:46.312139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0365327-6028-40ef-805a-7277a6e8e842 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:46.315086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0365327-6028-40ef-805a-7277a6e8e842 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:46.316783 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-da549b24-801a-433f-937e-e0987be4293f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "DELETE /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/os-volume_attachments/d474dbea-b13f-4db8-963d-110a7a2f1724" status: 202 len: 0 microversion: 2.1 time: 0.321267 Aug 03 02:21:46.317437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0365327-6028-40ef-805a-7277a6e8e842 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:46.319135 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2729/5579] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:21:45 2022] DELETE /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/os-volume_attachments/d474dbea-b13f-4db8-963d-110a7a2f1724 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:21:46.320009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0365327-6028-40ef-805a-7277a6e8e842 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:46.655956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c0365327-6028-40ef-805a-7277a6e8e842 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:46.665896 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c0365327-6028-40ef-805a-7277a6e8e842 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.377388 Aug 03 02:21:46.666501 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2851/5580] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:46 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:46.692483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-36e80415-6e3d-402f-aa37-da5c23fd3f20 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:46.693800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-36e80415-6e3d-402f-aa37-da5c23fd3f20 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: c15de065-a468-4946-befb-5e6322f8efed] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:46.703746 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-36e80415-6e3d-402f-aa37-da5c23fd3f20 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance c15de065-a468-4946-befb-5e6322f8efed could not be found. Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-36e80415-6e3d-402f-aa37-da5c23fd3f20 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/c15de065-a468-4946-befb-5e6322f8efed HTTP/1.1 Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance c15de065-a468-4946-befb-5e6322f8efed could not be found. Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'c15de065-a468-4946-befb-5e6322f8efed'} Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c15de065-a468-4946-befb-5e6322f8efed could not be found. Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c15de065-a468-4946-befb-5e6322f8efed could not be found. Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:46.712764 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:46.716582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:46.716582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:46.716582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:46.716582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c15de065-a468-4946-befb-5e6322f8efed could not be found. Aug 03 02:21:46.716582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:46.716582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-36e80415-6e3d-402f-aa37-da5c23fd3f20 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance c15de065-a468-4946-befb-5e6322f8efed could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:46.716582 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-36e80415-6e3d-402f-aa37-da5c23fd3f20 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/c15de065-a468-4946-befb-5e6322f8efed" status: 404 len: 111 microversion: 2.1 time: 0.028024 Aug 03 02:21:46.721077 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2730/5581] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:46 2022] GET /compute/v2.1/servers/c15de065-a468-4946-befb-5e6322f8efed => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:21:46.731529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e0bdfb69-0dae-47f2-b82f-0b54cd66c510 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:46.732361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e0bdfb69-0dae-47f2-b82f-0b54cd66c510 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:46.746285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0bdfb69-0dae-47f2-b82f-0b54cd66c510 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:46.746763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0bdfb69-0dae-47f2-b82f-0b54cd66c510 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:46.749956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0bdfb69-0dae-47f2-b82f-0b54cd66c510 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:46.762435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0bdfb69-0dae-47f2-b82f-0b54cd66c510 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:47.110492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e0bdfb69-0dae-47f2-b82f-0b54cd66c510 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:47.128077 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e0bdfb69-0dae-47f2-b82f-0b54cd66c510 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.401729 Aug 03 02:21:47.143686 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2852/5582] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:46 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:47.153431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9422d400-a605-41ea-be4f-03d682e08dad tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:47.154069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9422d400-a605-41ea-be4f-03d682e08dad tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:47.163864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9422d400-a605-41ea-be4f-03d682e08dad tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:47.164907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9422d400-a605-41ea-be4f-03d682e08dad tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:47.165194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9422d400-a605-41ea-be4f-03d682e08dad tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:47.165539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9422d400-a605-41ea-be4f-03d682e08dad tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:47.308898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b6ed2d81-03ec-4bb9-b748-a6d249226320 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:47.310513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b6ed2d81-03ec-4bb9-b748-a6d249226320 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:47.322011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:47.324934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6ed2d81-03ec-4bb9-b748-a6d249226320 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:47.325681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6ed2d81-03ec-4bb9-b748-a6d249226320 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:47.331172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6ed2d81-03ec-4bb9-b748-a6d249226320 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:47.331851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6ed2d81-03ec-4bb9-b748-a6d249226320 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:47.374396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:47.701669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:48.094355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9422d400-a605-41ea-be4f-03d682e08dad tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:48.107778 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9422d400-a605-41ea-be4f-03d682e08dad tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.958650 Aug 03 02:21:48.108363 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2731/5583] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:47 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:48.135591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b6ed2d81-03ec-4bb9-b748-a6d249226320 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:48.137616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-c1cc3b86-68d1-412e-849e-d2bc382dc7e8 req-62b2815f-ee70-4473-a10a-59f73d18271b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e9f5029-1b4c-4764-87a8-e7df5950154a", "name": "network-vif-plugged", "status": "completed", "tag": "2c175fa6-c779-4716-992f-2b2d4e374e11"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:48.152751 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b6ed2d81-03ec-4bb9-b748-a6d249226320 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1392 microversion: 2.1 time: 0.844359 Aug 03 02:21:48.157647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c1cc3b86-68d1-412e-849e-d2bc382dc7e8 req-62b2815f-ee70-4473-a10a-59f73d18271b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:48.158680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c1cc3b86-68d1-412e-849e-d2bc382dc7e8 req-62b2815f-ee70-4473-a10a-59f73d18271b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:48.158824 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2853/5584] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:47 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1392 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:21:48.174148 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c1cc3b86-68d1-412e-849e-d2bc382dc7e8 req-62b2815f-ee70-4473-a10a-59f73d18271b service nova] Creating event network-vif-plugged:2c175fa6-c779-4716-992f-2b2d4e374e11 for instance 0e9f5029-1b4c-4764-87a8-e7df5950154a on n-h1-826529-8 Aug 03 02:21:48.180480 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-c1cc3b86-68d1-412e-849e-d2bc382dc7e8 req-62b2815f-ee70-4473-a10a-59f73d18271b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055452 Aug 03 02:21:48.183105 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2732/5585] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:21:48.357187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-207437bd-de84-40d2-b42e-af5100f784e8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-626738550", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-207437bd-de84-40d2-b42e-af5100f784e8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 237 Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-626738550", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-626738550', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'd5928fc2-6005-4eab-90c9-c57e9fce7e40'}]}}} Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:48.375285 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 03 02:21:48.381429 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:48.385619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-207437bd-de84-40d2-b42e-af5100f784e8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:48.386951 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-207437bd-de84-40d2-b42e-af5100f784e8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.035031 Aug 03 02:21:48.388096 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2854/5586] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:21:48 2022] POST /compute/v2.1/servers => generated 139 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:21:48.397936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-129b4cbd-e4ad-46d1-a939-f4321cde9d5c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:48.398668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-129b4cbd-e4ad-46d1-a939-f4321cde9d5c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:48.439277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-129b4cbd-e4ad-46d1-a939-f4321cde9d5c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:48.440114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-129b4cbd-e4ad-46d1-a939-f4321cde9d5c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:48.440937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-129b4cbd-e4ad-46d1-a939-f4321cde9d5c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:48.443430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-129b4cbd-e4ad-46d1-a939-f4321cde9d5c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:48.956606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-129b4cbd-e4ad-46d1-a939-f4321cde9d5c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:48.968889 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-129b4cbd-e4ad-46d1-a939-f4321cde9d5c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.576132 Aug 03 02:21:48.986933 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2733/5587] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:48 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:49.017090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ea904636-0126-4775-a859-3aa5b9e903b5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:49.017720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ea904636-0126-4775-a859-3aa5b9e903b5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:49.035717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea904636-0126-4775-a859-3aa5b9e903b5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:49.036288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea904636-0126-4775-a859-3aa5b9e903b5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:49.037693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea904636-0126-4775-a859-3aa5b9e903b5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:49.038150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea904636-0126-4775-a859-3aa5b9e903b5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:49.177854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-604ad394-471a-42d1-a162-25df1da1d750 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:49.178658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-604ad394-471a-42d1-a162-25df1da1d750 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:49.190629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-604ad394-471a-42d1-a162-25df1da1d750 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:49.193343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-604ad394-471a-42d1-a162-25df1da1d750 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:49.198651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-604ad394-471a-42d1-a162-25df1da1d750 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:49.201471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-604ad394-471a-42d1-a162-25df1da1d750 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:49.488454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ea904636-0126-4775-a859-3aa5b9e903b5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:49.501526 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ea904636-0126-4775-a859-3aa5b9e903b5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.489353 Aug 03 02:21:49.502384 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2855/5588] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:49 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:49.588108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-604ad394-471a-42d1-a162-25df1da1d750 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:49.610961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-356ccae3-b171-402b-a800-62e722d88014 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1231567539", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:49.630173 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-604ad394-471a-42d1-a162-25df1da1d750 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1392 microversion: 2.1 time: 0.456821 Aug 03 02:21:49.631218 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2734/5589] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:49 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1392 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-356ccae3-b171-402b-a800-62e722d88014 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 235 Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1231567539", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1231567539', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'd5928fc2-6005-4eab-90c9-c57e9fce7e40'}]}}} Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:49.634014 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 03 02:21:49.639229 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:49.643496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-356ccae3-b171-402b-a800-62e722d88014 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:49.643496 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-356ccae3-b171-402b-a800-62e722d88014 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.049064 Aug 03 02:21:49.643496 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2856/5590] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:21:49 2022] POST /compute/v2.1/servers => generated 133 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:21:49.653806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-38a878ce-8976-4458-980a-92fe7138233a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:49.654696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-38a878ce-8976-4458-980a-92fe7138233a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:49.663073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38a878ce-8976-4458-980a-92fe7138233a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:49.663816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38a878ce-8976-4458-980a-92fe7138233a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:49.664626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38a878ce-8976-4458-980a-92fe7138233a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:49.665073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38a878ce-8976-4458-980a-92fe7138233a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:50.027064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-38a878ce-8976-4458-980a-92fe7138233a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:50.042943 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-38a878ce-8976-4458-980a-92fe7138233a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.392442 Aug 03 02:21:50.048011 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2857/5591] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:49 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:50.070525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6a9be056-90ab-489f-9316-4a9b64da733f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:50.071522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6a9be056-90ab-489f-9316-4a9b64da733f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:50.080652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a9be056-90ab-489f-9316-4a9b64da733f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:50.081637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a9be056-90ab-489f-9316-4a9b64da733f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:50.082627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a9be056-90ab-489f-9316-4a9b64da733f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:50.083284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a9be056-90ab-489f-9316-4a9b64da733f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:50.364015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6a9be056-90ab-489f-9316-4a9b64da733f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:50.401437 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6a9be056-90ab-489f-9316-4a9b64da733f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.333054 Aug 03 02:21:50.404089 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2735/5592] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:50 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:50.424770 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d8417742-ac2c-4466-8a65-fdfba553fdf2 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:50.425306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d8417742-ac2c-4466-8a65-fdfba553fdf2 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: c94779e9-ef27-47dd-b52e-c98ba119aa5e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:50.431495 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-d8417742-ac2c-4466-8a65-fdfba553fdf2 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance c94779e9-ef27-47dd-b52e-c98ba119aa5e could not be found. Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d8417742-ac2c-4466-8a65-fdfba553fdf2 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/c94779e9-ef27-47dd-b52e-c98ba119aa5e/action HTTP/1.1 Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 13 Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: {"pause": {}} Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance c94779e9-ef27-47dd-b52e-c98ba119aa5e could not be found. Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'c94779e9-ef27-47dd-b52e-c98ba119aa5e', 'body': {'pause': {}}} Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c94779e9-ef27-47dd-b52e-c98ba119aa5e could not be found. Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c94779e9-ef27-47dd-b52e-c98ba119aa5e could not be found. Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:50.439485 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:50.445411 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:50.445411 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:50.445411 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c94779e9-ef27-47dd-b52e-c98ba119aa5e could not be found. Aug 03 02:21:50.445411 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:50.445411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d8417742-ac2c-4466-8a65-fdfba553fdf2 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance c94779e9-ef27-47dd-b52e-c98ba119aa5e could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:50.445411 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d8417742-ac2c-4466-8a65-fdfba553fdf2 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/c94779e9-ef27-47dd-b52e-c98ba119aa5e/action" status: 404 len: 111 microversion: 2.1 time: 0.021272 Aug 03 02:21:50.445411 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2858/5593] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:21:50 2022] POST /compute/v2.1/servers/c94779e9-ef27-47dd-b52e-c98ba119aa5e/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:21:50.450378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-465d86c4-2408-4eff-8358-60d7a153fc43 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:50.451425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-465d86c4-2408-4eff-8358-60d7a153fc43 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:50.462298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-465d86c4-2408-4eff-8358-60d7a153fc43 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:50.462846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-465d86c4-2408-4eff-8358-60d7a153fc43 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:50.463984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-465d86c4-2408-4eff-8358-60d7a153fc43 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:50.464452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-465d86c4-2408-4eff-8358-60d7a153fc43 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:50.655629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-85937163-cd1a-432f-9168-10b9b7cdfc91 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:50.656257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-85937163-cd1a-432f-9168-10b9b7cdfc91 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:50.667439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85937163-cd1a-432f-9168-10b9b7cdfc91 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:50.668201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85937163-cd1a-432f-9168-10b9b7cdfc91 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:50.669172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85937163-cd1a-432f-9168-10b9b7cdfc91 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:50.669850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85937163-cd1a-432f-9168-10b9b7cdfc91 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:50.883133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-465d86c4-2408-4eff-8358-60d7a153fc43 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:50.897620 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-465d86c4-2408-4eff-8358-60d7a153fc43 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.450809 Aug 03 02:21:50.917825 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2736/5594] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:50 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:50.924030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ffa5aada-9f82-4740-865c-0db5b5cd0a8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:50.924839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ffa5aada-9f82-4740-865c-0db5b5cd0a8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:50.982468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffa5aada-9f82-4740-865c-0db5b5cd0a8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:50.982961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffa5aada-9f82-4740-865c-0db5b5cd0a8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:50.986520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffa5aada-9f82-4740-865c-0db5b5cd0a8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:50.987030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffa5aada-9f82-4740-865c-0db5b5cd0a8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:51.376688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-85937163-cd1a-432f-9168-10b9b7cdfc91 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:51.392228 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-85937163-cd1a-432f-9168-10b9b7cdfc91 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1564 microversion: 2.1 time: 0.740046 Aug 03 02:21:51.393324 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2859/5595] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:50 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1564 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:51.417658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dfe53c0b-ecfa-4db2-89f5-e6650cd9aa41 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:51.419138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dfe53c0b-ecfa-4db2-89f5-e6650cd9aa41 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:51.433224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfe53c0b-ecfa-4db2-89f5-e6650cd9aa41 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:51.433930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfe53c0b-ecfa-4db2-89f5-e6650cd9aa41 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:51.435457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfe53c0b-ecfa-4db2-89f5-e6650cd9aa41 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:51.437967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfe53c0b-ecfa-4db2-89f5-e6650cd9aa41 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:51.662113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ffa5aada-9f82-4740-865c-0db5b5cd0a8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:51.677707 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ffa5aada-9f82-4740-865c-0db5b5cd0a8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.753616 Aug 03 02:21:51.678840 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2737/5596] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:50 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:51.715096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-68e49d03-0cd7-4c4c-9479-169b4497ec58 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:51.715657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-68e49d03-0cd7-4c4c-9479-169b4497ec58 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:51.744908 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68e49d03-0cd7-4c4c-9479-169b4497ec58 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:51.746098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68e49d03-0cd7-4c4c-9479-169b4497ec58 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:51.747173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68e49d03-0cd7-4c4c-9479-169b4497ec58 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:51.747970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68e49d03-0cd7-4c4c-9479-169b4497ec58 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:51.859769 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-68e49d03-0cd7-4c4c-9479-169b4497ec58 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action" status: 202 len: 0 microversion: 2.1 time: 0.162495 Aug 03 02:21:51.861128 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2738/5597] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:21:51 2022] POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:21:51.884080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-00082ac3-1a59-48d9-b68b-b0247d07d735 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:51.888422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-00082ac3-1a59-48d9-b68b-b0247d07d735 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:51.909019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00082ac3-1a59-48d9-b68b-b0247d07d735 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:51.911720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00082ac3-1a59-48d9-b68b-b0247d07d735 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:51.916303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00082ac3-1a59-48d9-b68b-b0247d07d735 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:51.923736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-00082ac3-1a59-48d9-b68b-b0247d07d735 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:51.973305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:52.012945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dfe53c0b-ecfa-4db2-89f5-e6650cd9aa41 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:52.041348 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dfe53c0b-ecfa-4db2-89f5-e6650cd9aa41 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1564 microversion: 2.1 time: 0.629245 Aug 03 02:21:52.063490 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2860/5598] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:51 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1564 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:52.590956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-00082ac3-1a59-48d9-b68b-b0247d07d735 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:52.602940 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-00082ac3-1a59-48d9-b68b-b0247d07d735 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1509 microversion: 2.1 time: 0.736521 Aug 03 02:21:52.627167 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2739/5599] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:51 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1509 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:53.632578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a045fe60-34f0-487a-b313-6b517ce97992 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:53.635234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a045fe60-34f0-487a-b313-6b517ce97992 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:53.663581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a045fe60-34f0-487a-b313-6b517ce97992 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:53.664341 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a045fe60-34f0-487a-b313-6b517ce97992 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:53.665373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a045fe60-34f0-487a-b313-6b517ce97992 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:53.667925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a045fe60-34f0-487a-b313-6b517ce97992 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:53.903829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a045fe60-34f0-487a-b313-6b517ce97992 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:53.913826 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a045fe60-34f0-487a-b313-6b517ce97992 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1489 microversion: 2.1 time: 0.287519 Aug 03 02:21:53.915145 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2861/5600] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:53 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1489 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:53.939722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-63ddda33-d2bf-4c2c-8d4c-7b185ab8c1f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:53.940279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-63ddda33-d2bf-4c2c-8d4c-7b185ab8c1f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:53.955838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63ddda33-d2bf-4c2c-8d4c-7b185ab8c1f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:53.957138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63ddda33-d2bf-4c2c-8d4c-7b185ab8c1f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:53.958140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63ddda33-d2bf-4c2c-8d4c-7b185ab8c1f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:53.959860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63ddda33-d2bf-4c2c-8d4c-7b185ab8c1f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:53.994803 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-63ddda33-d2bf-4c2c-8d4c-7b185ab8c1f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Cannot 'pause' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state paused Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-63ddda33-d2bf-4c2c-8d4c-7b185ab8c1f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action HTTP/1.1 Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 13 Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: {"pause": {}} Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: exception: Cannot 'pause' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state paused Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'cc4dcb4b-0945-49cb-b946-0fe75f053c37', 'body': {'pause': {}}} Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 in vm_state paused. Cannot pause while the instance is in this state. Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state paused Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:53.997540 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:54.002359 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:54.002359 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:54.002359 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:54.002359 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state paused Aug 03 02:21:54.002359 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:54.004072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-63ddda33-d2bf-4c2c-8d4c-7b185ab8c1f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 409 to user: Cannot 'pause' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state paused {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:54.005491 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-63ddda33-d2bf-4c2c-8d4c-7b185ab8c1f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action" status: 409 len: 143 microversion: 2.1 time: 0.071014 Aug 03 02:21:54.016715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2d61af86-4679-46ab-a98f-cad59ffcc22b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:54.017608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2d61af86-4679-46ab-a98f-cad59ffcc22b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:54.025084 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2740/5601] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:21:53 2022] POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action => generated 143 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:21:54.027095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d61af86-4679-46ab-a98f-cad59ffcc22b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:54.027813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d61af86-4679-46ab-a98f-cad59ffcc22b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:54.028829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d61af86-4679-46ab-a98f-cad59ffcc22b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:54.029471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d61af86-4679-46ab-a98f-cad59ffcc22b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:54.119653 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2d61af86-4679-46ab-a98f-cad59ffcc22b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action" status: 202 len: 0 microversion: 2.1 time: 0.107230 Aug 03 02:21:54.124013 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2862/5602] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:21:54 2022] POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:21:54.132695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-05234334-b500-45d2-8f79-31dbed45ee8e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:54.134065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-05234334-b500-45d2-8f79-31dbed45ee8e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:54.142561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05234334-b500-45d2-8f79-31dbed45ee8e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:54.144460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05234334-b500-45d2-8f79-31dbed45ee8e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:54.145733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05234334-b500-45d2-8f79-31dbed45ee8e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:54.147393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05234334-b500-45d2-8f79-31dbed45ee8e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:54.539034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-05234334-b500-45d2-8f79-31dbed45ee8e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:54.553096 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-05234334-b500-45d2-8f79-31dbed45ee8e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1496 microversion: 2.1 time: 0.424570 Aug 03 02:21:54.569874 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2741/5603] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:54 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1496 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:55.398194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-da260b6a-a7a8-4108-b43d-7fb85290bd2c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:55.415959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da260b6a-a7a8-4108-b43d-7fb85290bd2c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:55.416422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-da260b6a-a7a8-4108-b43d-7fb85290bd2c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:55.463516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-da260b6a-a7a8-4108-b43d-7fb85290bd2c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Going to try to stop instance {{(pid=125941) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 02:21:55.533632 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-da260b6a-a7a8-4108-b43d-7fb85290bd2c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "POST /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/action" status: 202 len: 0 microversion: 2.1 time: 0.148555 Aug 03 02:21:55.534792 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2863/5604] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:21:55 2022] POST /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:21:55.544599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d9ae8d00-2850-4988-8e4b-4a0b50ccf28d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:55.545164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d9ae8d00-2850-4988-8e4b-4a0b50ccf28d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:55.556953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9ae8d00-2850-4988-8e4b-4a0b50ccf28d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:55.558142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9ae8d00-2850-4988-8e4b-4a0b50ccf28d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:55.559177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9ae8d00-2850-4988-8e4b-4a0b50ccf28d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:55.559850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9ae8d00-2850-4988-8e4b-4a0b50ccf28d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:55.578099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e6f7de4-5e6c-482a-927f-170ffa6e1cf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:55.579761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3e6f7de4-5e6c-482a-927f-170ffa6e1cf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:55.593013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e6f7de4-5e6c-482a-927f-170ffa6e1cf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:55.596044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e6f7de4-5e6c-482a-927f-170ffa6e1cf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:55.597136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e6f7de4-5e6c-482a-927f-170ffa6e1cf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:55.600651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e6f7de4-5e6c-482a-927f-170ffa6e1cf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:55.867904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3e6f7de4-5e6c-482a-927f-170ffa6e1cf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:55.876537 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e6f7de4-5e6c-482a-927f-170ffa6e1cf3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.302639 Aug 03 02:21:55.877133 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2864/5605] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:55 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:21:55.891748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d9ae8d00-2850-4988-8e4b-4a0b50ccf28d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:55.904055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b1b7e31-d5dc-4417-b1e0-990020c23fbd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:55.904661 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d9ae8d00-2850-4988-8e4b-4a0b50ccf28d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1677 microversion: 2.1 time: 0.364647 Aug 03 02:21:55.904796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8b1b7e31-d5dc-4417-b1e0-990020c23fbd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:55.906015 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2742/5606] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:55 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1677 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:55.915441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b1b7e31-d5dc-4417-b1e0-990020c23fbd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:55.916563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b1b7e31-d5dc-4417-b1e0-990020c23fbd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:55.918022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b1b7e31-d5dc-4417-b1e0-990020c23fbd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:55.918826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b1b7e31-d5dc-4417-b1e0-990020c23fbd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:56.110037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8b1b7e31-d5dc-4417-b1e0-990020c23fbd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:56.119715 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8b1b7e31-d5dc-4417-b1e0-990020c23fbd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.220286 Aug 03 02:21:56.120984 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2865/5607] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:55 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:56.141878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-15e5471f-c1e9-46f0-90bd-6e5c11c5e144 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:56.144530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-15e5471f-c1e9-46f0-90bd-6e5c11c5e144 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:56.159599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-15e5471f-c1e9-46f0-90bd-6e5c11c5e144 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:56.161031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-15e5471f-c1e9-46f0-90bd-6e5c11c5e144 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:56.163102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-15e5471f-c1e9-46f0-90bd-6e5c11c5e144 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:56.164013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-15e5471f-c1e9-46f0-90bd-6e5c11c5e144 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:56.185379 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-15e5471f-c1e9-46f0-90bd-6e5c11c5e144 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-15e5471f-c1e9-46f0-90bd-6e5c11c5e144 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3/action HTTP/1.1 Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 28 Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: {"reboot": {"type": "SOFT"}} Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '80ba4e52-bfcc-4b75-8d15-dec1bafa54f3', 'body': {'reboot': {'type': 'SOFT'}}} Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:21:56.187067 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:21:56.192366 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:21:56.192366 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:56.192366 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:56.192366 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:56.192366 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:56.192366 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:56.192366 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:56.192366 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:56.192366 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:56.192366 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:21:56.192366 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:56.192366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-15e5471f-c1e9-46f0-90bd-6e5c11c5e144 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:56.192366 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-15e5471f-c1e9-46f0-90bd-6e5c11c5e144 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3/action" status: 404 len: 111 microversion: 2.1 time: 0.050645 Aug 03 02:21:56.192366 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2743/5608] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:21:56 2022] POST /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:21:56.200874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-95844c27-5a3d-43ec-ae1f-7d17ece1da45 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:56.201653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-95844c27-5a3d-43ec-ae1f-7d17ece1da45 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:56.210041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95844c27-5a3d-43ec-ae1f-7d17ece1da45 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:56.210613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95844c27-5a3d-43ec-ae1f-7d17ece1da45 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:56.211553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95844c27-5a3d-43ec-ae1f-7d17ece1da45 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:56.212105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95844c27-5a3d-43ec-ae1f-7d17ece1da45 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:56.400799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-95844c27-5a3d-43ec-ae1f-7d17ece1da45 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:56.409104 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-95844c27-5a3d-43ec-ae1f-7d17ece1da45 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.214579 Aug 03 02:21:56.423450 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2866/5609] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:56 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:56.439282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-17890b5f-6fce-4792-97ac-e31d349e9d85 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:56.440218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-17890b5f-6fce-4792-97ac-e31d349e9d85 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:56.449292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17890b5f-6fce-4792-97ac-e31d349e9d85 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:56.449761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17890b5f-6fce-4792-97ac-e31d349e9d85 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:56.450571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17890b5f-6fce-4792-97ac-e31d349e9d85 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:56.451053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17890b5f-6fce-4792-97ac-e31d349e9d85 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:56.642925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-86884a3c-d8e4-42f0-9c90-46e654ac34ff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:56.643752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-86884a3c-d8e4-42f0-9c90-46e654ac34ff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:56.652395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-86884a3c-d8e4-42f0-9c90-46e654ac34ff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:56.653135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-86884a3c-d8e4-42f0-9c90-46e654ac34ff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:56.654118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-86884a3c-d8e4-42f0-9c90-46e654ac34ff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:56.654793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-86884a3c-d8e4-42f0-9c90-46e654ac34ff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:56.808500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-17890b5f-6fce-4792-97ac-e31d349e9d85 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:56.819099 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-17890b5f-6fce-4792-97ac-e31d349e9d85 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.387528 Aug 03 02:21:56.819688 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2744/5610] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:56 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:56.847405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-f73b1696-0c0e-4034-8b15-861c4d0397ed req-df22d109-d938-4b07-a366-a8c9b33ba9bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e9f5029-1b4c-4764-87a8-e7df5950154a", "tag": "2c175fa6-c779-4716-992f-2b2d4e374e11"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:56.876416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f73b1696-0c0e-4034-8b15-861c4d0397ed req-df22d109-d938-4b07-a366-a8c9b33ba9bf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:56.878177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f73b1696-0c0e-4034-8b15-861c4d0397ed req-df22d109-d938-4b07-a366-a8c9b33ba9bf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:56.899794 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-f73b1696-0c0e-4034-8b15-861c4d0397ed req-df22d109-d938-4b07-a366-a8c9b33ba9bf service nova] Creating event network-changed:2c175fa6-c779-4716-992f-2b2d4e374e11 for instance 0e9f5029-1b4c-4764-87a8-e7df5950154a on n-h1-826529-8 Aug 03 02:21:56.907064 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-f73b1696-0c0e-4034-8b15-861c4d0397ed req-df22d109-d938-4b07-a366-a8c9b33ba9bf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068276 Aug 03 02:21:56.908182 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2745/5611] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:21:56.916993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a9981728-dcd5-4bf0-a9e5-eeec48acd74e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:56.920313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a9981728-dcd5-4bf0-a9e5-eeec48acd74e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 65ed7b80-d3fe-4106-8a3b-8e60aee6ec5b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:56.928510 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-a9981728-dcd5-4bf0-a9e5-eeec48acd74e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance 65ed7b80-d3fe-4106-8a3b-8e60aee6ec5b could not be found. Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a9981728-dcd5-4bf0-a9e5-eeec48acd74e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/65ed7b80-d3fe-4106-8a3b-8e60aee6ec5b/action HTTP/1.1 Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 28 Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: {"reboot": {"type": "SOFT"}} Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 65ed7b80-d3fe-4106-8a3b-8e60aee6ec5b could not be found. Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '65ed7b80-d3fe-4106-8a3b-8e60aee6ec5b', 'body': {'reboot': {'type': 'SOFT'}}} Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65ed7b80-d3fe-4106-8a3b-8e60aee6ec5b could not be found. Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65ed7b80-d3fe-4106-8a3b-8e60aee6ec5b could not be found. Aug 03 02:21:56.931057 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:56.935879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:56.935879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:56.935879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:56.935879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:56.935879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:56.935879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:56.935879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:56.935879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65ed7b80-d3fe-4106-8a3b-8e60aee6ec5b could not be found. Aug 03 02:21:56.935879 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:56.938185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a9981728-dcd5-4bf0-a9e5-eeec48acd74e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance 65ed7b80-d3fe-4106-8a3b-8e60aee6ec5b could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:56.940022 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a9981728-dcd5-4bf0-a9e5-eeec48acd74e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/65ed7b80-d3fe-4106-8a3b-8e60aee6ec5b/action" status: 404 len: 111 microversion: 2.1 time: 0.029879 Aug 03 02:21:56.941288 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2746/5612] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:21:56 2022] POST /compute/v2.1/servers/65ed7b80-d3fe-4106-8a3b-8e60aee6ec5b/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:21:56.948160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e8c16acd-ad82-4e4d-97aa-74039ff5c79e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:56.949081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e8c16acd-ad82-4e4d-97aa-74039ff5c79e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:56.959539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8c16acd-ad82-4e4d-97aa-74039ff5c79e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:56.960430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8c16acd-ad82-4e4d-97aa-74039ff5c79e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:56.961494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8c16acd-ad82-4e4d-97aa-74039ff5c79e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:56.962780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8c16acd-ad82-4e4d-97aa-74039ff5c79e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:57.121345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-86884a3c-d8e4-42f0-9c90-46e654ac34ff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:57.144956 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-86884a3c-d8e4-42f0-9c90-46e654ac34ff tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1564 microversion: 2.1 time: 0.506503 Aug 03 02:21:57.169986 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2867/5613] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:56 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1564 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:57.173696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-434b18bc-7a9c-450a-9133-6672442be8de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:57.174507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-434b18bc-7a9c-450a-9133-6672442be8de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:57.185168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-434b18bc-7a9c-450a-9133-6672442be8de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:57.195658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-434b18bc-7a9c-450a-9133-6672442be8de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:57.196761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-434b18bc-7a9c-450a-9133-6672442be8de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:57.197353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-434b18bc-7a9c-450a-9133-6672442be8de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:57.437634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e8c16acd-ad82-4e4d-97aa-74039ff5c79e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:57.446884 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e8c16acd-ad82-4e4d-97aa-74039ff5c79e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1677 microversion: 2.1 time: 0.504234 Aug 03 02:21:57.447493 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2747/5614] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:56 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1677 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:57.602555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-434b18bc-7a9c-450a-9133-6672442be8de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:57.636080 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-434b18bc-7a9c-450a-9133-6672442be8de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.467247 Aug 03 02:21:57.640312 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2868/5615] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:57 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:57.672987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ac6bee7-40a5-4746-a652-952e3bac4fe8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:57.673645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2ac6bee7-40a5-4746-a652-952e3bac4fe8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:57.705486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ac6bee7-40a5-4746-a652-952e3bac4fe8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:57.706209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ac6bee7-40a5-4746-a652-952e3bac4fe8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:57.710998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ac6bee7-40a5-4746-a652-952e3bac4fe8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:57.711865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ac6bee7-40a5-4746-a652-952e3bac4fe8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:58.393210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2ac6bee7-40a5-4746-a652-952e3bac4fe8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:58.402891 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2ac6bee7-40a5-4746-a652-952e3bac4fe8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.740288 Aug 03 02:21:58.416889 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2748/5616] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:57 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:58.428266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-244a5d81-7299-4054-8281-6b0cc0ce93bd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:58.431134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-244a5d81-7299-4054-8281-6b0cc0ce93bd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:58.438698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-244a5d81-7299-4054-8281-6b0cc0ce93bd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:58.439405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-244a5d81-7299-4054-8281-6b0cc0ce93bd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:58.440806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-244a5d81-7299-4054-8281-6b0cc0ce93bd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:58.441393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-244a5d81-7299-4054-8281-6b0cc0ce93bd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:58.457944 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-244a5d81-7299-4054-8281-6b0cc0ce93bd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-244a5d81-7299-4054-8281-6b0cc0ce93bd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3/action HTTP/1.1 Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 65 Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: {"rebuild": {"imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3"}} Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '80ba4e52-bfcc-4b75-8d15-dec1bafa54f3', 'body': {'rebuild': {'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3'}}} Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 03 02:21:58.460798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:21:58.467176 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:58.470371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-244a5d81-7299-4054-8281-6b0cc0ce93bd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:58.471501 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-244a5d81-7299-4054-8281-6b0cc0ce93bd tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3/action" status: 404 len: 111 microversion: 2.1 time: 0.048346 Aug 03 02:21:58.480472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fb7b066f-2b92-47dc-8644-a8c6a3ff6fe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:58.481508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fb7b066f-2b92-47dc-8644-a8c6a3ff6fe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:58.493553 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2869/5617] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:21:58 2022] POST /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:21:58.509916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb7b066f-2b92-47dc-8644-a8c6a3ff6fe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:58.511966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d350ddd9-f758-4e79-88f6-eea695932604 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:58.512700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb7b066f-2b92-47dc-8644-a8c6a3ff6fe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:58.514384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb7b066f-2b92-47dc-8644-a8c6a3ff6fe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:58.516079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d350ddd9-f758-4e79-88f6-eea695932604 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:58.516652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb7b066f-2b92-47dc-8644-a8c6a3ff6fe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:58.534213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d350ddd9-f758-4e79-88f6-eea695932604 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:58.535028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d350ddd9-f758-4e79-88f6-eea695932604 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:58.536037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d350ddd9-f758-4e79-88f6-eea695932604 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:58.540926 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d350ddd9-f758-4e79-88f6-eea695932604 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:58.904075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fb7b066f-2b92-47dc-8644-a8c6a3ff6fe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:58.918771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d350ddd9-f758-4e79-88f6-eea695932604 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:58.931180 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d350ddd9-f758-4e79-88f6-eea695932604 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.427899 Aug 03 02:21:58.931957 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2870/5618] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:58 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:58.939761 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fb7b066f-2b92-47dc-8644-a8c6a3ff6fe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1677 microversion: 2.1 time: 0.458459 Aug 03 02:21:58.940805 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2749/5619] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:58 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1677 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:21:58.974714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fd55d072-6249-4f87-ab74-bb115e965182 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:58.975509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fd55d072-6249-4f87-ab74-bb115e965182 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:58.997286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd55d072-6249-4f87-ab74-bb115e965182 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:58.999873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd55d072-6249-4f87-ab74-bb115e965182 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:59.000871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd55d072-6249-4f87-ab74-bb115e965182 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:59.002094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd55d072-6249-4f87-ab74-bb115e965182 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:59.283497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fd55d072-6249-4f87-ab74-bb115e965182 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:59.287159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:21:59.295529 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fd55d072-6249-4f87-ab74-bb115e965182 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.324991 Aug 03 02:21:59.296118 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2871/5620] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:58 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:59.317014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c78170cd-8d0b-4521-8057-10a7df182638 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:59.320869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c78170cd-8d0b-4521-8057-10a7df182638 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 499c0510-f381-41d2-898f-c9c61d272b7e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:59.326829 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-c78170cd-8d0b-4521-8057-10a7df182638 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance 499c0510-f381-41d2-898f-c9c61d272b7e could not be found. Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c78170cd-8d0b-4521-8057-10a7df182638 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/499c0510-f381-41d2-898f-c9c61d272b7e/action HTTP/1.1 Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 65 Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: {"rebuild": {"imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3"}} Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 499c0510-f381-41d2-898f-c9c61d272b7e could not be found. Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '499c0510-f381-41d2-898f-c9c61d272b7e', 'body': {'rebuild': {'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3'}}} Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 499c0510-f381-41d2-898f-c9c61d272b7e could not be found. Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 02:21:59.329431 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 499c0510-f381-41d2-898f-c9c61d272b7e could not be found. Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 499c0510-f381-41d2-898f-c9c61d272b7e could not be found. Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c78170cd-8d0b-4521-8057-10a7df182638 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance 499c0510-f381-41d2-898f-c9c61d272b7e could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:59.334575 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c78170cd-8d0b-4521-8057-10a7df182638 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/499c0510-f381-41d2-898f-c9c61d272b7e/action" status: 404 len: 111 microversion: 2.1 time: 0.018018 Aug 03 02:21:59.340280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e213d427-ab6d-4417-ba9b-e2e58f5b8629 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:59.340908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e213d427-ab6d-4417-ba9b-e2e58f5b8629 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:59.346275 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2750/5621] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:21:59 2022] POST /compute/v2.1/servers/499c0510-f381-41d2-898f-c9c61d272b7e/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:21:59.348701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e213d427-ab6d-4417-ba9b-e2e58f5b8629 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:59.349761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e213d427-ab6d-4417-ba9b-e2e58f5b8629 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:59.350568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e213d427-ab6d-4417-ba9b-e2e58f5b8629 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:59.351044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e213d427-ab6d-4417-ba9b-e2e58f5b8629 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:59.572623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e213d427-ab6d-4417-ba9b-e2e58f5b8629 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:59.582283 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e213d427-ab6d-4417-ba9b-e2e58f5b8629 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.245339 Aug 03 02:21:59.583550 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2872/5622] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:59 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:59.616052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-37dcc9d1-cdae-416b-afc4-f93223af4be7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:59.616686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-37dcc9d1-cdae-416b-afc4-f93223af4be7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:59.624567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37dcc9d1-cdae-416b-afc4-f93223af4be7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:59.625038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37dcc9d1-cdae-416b-afc4-f93223af4be7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:59.625832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37dcc9d1-cdae-416b-afc4-f93223af4be7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:59.626485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37dcc9d1-cdae-416b-afc4-f93223af4be7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:59.793219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-37dcc9d1-cdae-416b-afc4-f93223af4be7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:21:59.801508 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-37dcc9d1-cdae-416b-afc4-f93223af4be7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.198770 Aug 03 02:21:59.804385 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2751/5623] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:59 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:21:59.824119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd594c2a-452a-4b88-844a-6dbd4194376e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:21:59.824941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cd594c2a-452a-4b88-844a-6dbd4194376e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: a8a66e3e-c046-4e2d-9ddd-faac3e35ca5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:59.830762 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-cd594c2a-452a-4b88-844a-6dbd4194376e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance a8a66e3e-c046-4e2d-9ddd-faac3e35ca5f could not be found. Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd594c2a-452a-4b88-844a-6dbd4194376e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/a8a66e3e-c046-4e2d-9ddd-faac3e35ca5f/action HTTP/1.1 Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 15 Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: {"restore": {}} Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance a8a66e3e-c046-4e2d-9ddd-faac3e35ca5f could not be found. Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'a8a66e3e-c046-4e2d-9ddd-faac3e35ca5f', 'body': {'restore': {}}} Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a66e3e-c046-4e2d-9ddd-faac3e35ca5f could not be found. Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a66e3e-c046-4e2d-9ddd-faac3e35ca5f could not be found. Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:21:59.832803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:21:59.838280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:21:59.838280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:21:59.838280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a66e3e-c046-4e2d-9ddd-faac3e35ca5f could not be found. Aug 03 02:21:59.838280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:21:59.839415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd594c2a-452a-4b88-844a-6dbd4194376e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance a8a66e3e-c046-4e2d-9ddd-faac3e35ca5f could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:21:59.840933 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cd594c2a-452a-4b88-844a-6dbd4194376e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/a8a66e3e-c046-4e2d-9ddd-faac3e35ca5f/action" status: 404 len: 111 microversion: 2.1 time: 0.020986 Aug 03 02:21:59.841548 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2873/5624] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:21:59 2022] POST /compute/v2.1/servers/a8a66e3e-c046-4e2d-9ddd-faac3e35ca5f/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:21:59.851793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5fa4a3c7-1919-45cd-91a2-fb4a0ae102c9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:59.852422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5fa4a3c7-1919-45cd-91a2-fb4a0ae102c9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:21:59.862616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fa4a3c7-1919-45cd-91a2-fb4a0ae102c9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:59.863304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fa4a3c7-1919-45cd-91a2-fb4a0ae102c9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:59.864909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fa4a3c7-1919-45cd-91a2-fb4a0ae102c9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:21:59.865645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fa4a3c7-1919-45cd-91a2-fb4a0ae102c9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:21:59.987880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-34c8414d-f4d4-4d40-97be-d5e0bd3c15ba tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:21:59.988587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-34c8414d-f4d4-4d40-97be-d5e0bd3c15ba tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:00.006189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34c8414d-f4d4-4d40-97be-d5e0bd3c15ba tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:00.007511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34c8414d-f4d4-4d40-97be-d5e0bd3c15ba tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:00.009975 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34c8414d-f4d4-4d40-97be-d5e0bd3c15ba tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:00.011340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-34c8414d-f4d4-4d40-97be-d5e0bd3c15ba tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:00.276347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5fa4a3c7-1919-45cd-91a2-fb4a0ae102c9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:00.284897 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5fa4a3c7-1919-45cd-91a2-fb4a0ae102c9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.438814 Aug 03 02:22:00.299606 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2752/5625] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:59 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:00.308384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3b230c38-b6a2-4f84-b2a6-ea8dd3a934ab tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:00.309616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3b230c38-b6a2-4f84-b2a6-ea8dd3a934ab tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:00.313902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-34c8414d-f4d4-4d40-97be-d5e0bd3c15ba tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:00.326388 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-34c8414d-f4d4-4d40-97be-d5e0bd3c15ba tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1677 microversion: 2.1 time: 0.359499 Aug 03 02:22:00.327664 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2874/5626] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:21:59 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1677 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:00.330404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b230c38-b6a2-4f84-b2a6-ea8dd3a934ab tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:00.331119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b230c38-b6a2-4f84-b2a6-ea8dd3a934ab tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:00.331994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b230c38-b6a2-4f84-b2a6-ea8dd3a934ab tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:00.332511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b230c38-b6a2-4f84-b2a6-ea8dd3a934ab tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:00.568804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3b230c38-b6a2-4f84-b2a6-ea8dd3a934ab tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:00.577196 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3b230c38-b6a2-4f84-b2a6-ea8dd3a934ab tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.273210 Aug 03 02:22:00.578404 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2753/5627] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:00 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:00.604340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-87339f8d-2a51-429a-ae13-ff627285b2e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:00.605185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-87339f8d-2a51-429a-ae13-ff627285b2e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:00.617840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87339f8d-2a51-429a-ae13-ff627285b2e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:00.618310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87339f8d-2a51-429a-ae13-ff627285b2e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:00.619165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87339f8d-2a51-429a-ae13-ff627285b2e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:00.619589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87339f8d-2a51-429a-ae13-ff627285b2e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:00.657574 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-87339f8d-2a51-429a-ae13-ff627285b2e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Cannot 'restore' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-87339f8d-2a51-429a-ae13-ff627285b2e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action HTTP/1.1 Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 15 Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: {"restore": {}} Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: exception: Cannot 'restore' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'cc4dcb4b-0945-49cb-b946-0fe75f053c37', 'body': {'restore': {}}} Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 in vm_state active. Cannot restore while the instance is in this state. Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:00.659719 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:22:00.664751 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:22:00.664751 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:22:00.664751 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:22:00.664751 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:22:00.664751 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:22:00.667686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-87339f8d-2a51-429a-ae13-ff627285b2e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 409 to user: Cannot 'restore' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:22:00.668727 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-87339f8d-2a51-429a-ae13-ff627285b2e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action" status: 409 len: 145 microversion: 2.1 time: 0.068568 Aug 03 02:22:00.669789 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2875/5628] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:22:00 2022] POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action => generated 145 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:22:00.678143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d8ecfa85-91db-447c-be97-468a8e34f831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:00.678761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d8ecfa85-91db-447c-be97-468a8e34f831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:00.686341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8ecfa85-91db-447c-be97-468a8e34f831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:00.687073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8ecfa85-91db-447c-be97-468a8e34f831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:00.688089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8ecfa85-91db-447c-be97-468a8e34f831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:00.688755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8ecfa85-91db-447c-be97-468a8e34f831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:00.963321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d8ecfa85-91db-447c-be97-468a8e34f831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:00.970997 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d8ecfa85-91db-447c-be97-468a8e34f831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.296773 Aug 03 02:22:00.972564 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2754/5629] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:00 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:00.995245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-53ffe937-d7cb-4a80-942a-4a39e717f64f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:00.995886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-53ffe937-d7cb-4a80-942a-4a39e717f64f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:01.004083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53ffe937-d7cb-4a80-942a-4a39e717f64f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:01.005997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53ffe937-d7cb-4a80-942a-4a39e717f64f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:01.007433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53ffe937-d7cb-4a80-942a-4a39e717f64f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:01.009198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53ffe937-d7cb-4a80-942a-4a39e717f64f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:01.277177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-53ffe937-d7cb-4a80-942a-4a39e717f64f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:01.295412 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-53ffe937-d7cb-4a80-942a-4a39e717f64f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.304865 Aug 03 02:22:01.296109 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2876/5630] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:00 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:01.325693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5ca426fd-5eb4-4704-a1d3-8e97ab394ac8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:01.326470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5ca426fd-5eb4-4704-a1d3-8e97ab394ac8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 1da1ba3a-ea9d-40f6-b0c4-80eb5f1985c6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:01.343678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:22:01.345144 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-5ca426fd-5eb4-4704-a1d3-8e97ab394ac8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance 1da1ba3a-ea9d-40f6-b0c4-80eb5f1985c6 could not be found. Aug 03 02:22:01.351608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-40baa918-712e-4c65-9313-71a70e1aaac7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:01.352500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-40baa918-712e-4c65-9313-71a70e1aaac7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:01.359505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40baa918-712e-4c65-9313-71a70e1aaac7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:01.360249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40baa918-712e-4c65-9313-71a70e1aaac7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:01.361228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40baa918-712e-4c65-9313-71a70e1aaac7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:01.361859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40baa918-712e-4c65-9313-71a70e1aaac7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5ca426fd-5eb4-4704-a1d3-8e97ab394ac8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/1da1ba3a-ea9d-40f6-b0c4-80eb5f1985c6/action HTTP/1.1 Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 14 Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: {"resume": {}} Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 1da1ba3a-ea9d-40f6-b0c4-80eb5f1985c6 could not be found. Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '1da1ba3a-ea9d-40f6-b0c4-80eb5f1985c6', 'body': {'resume': {}}} Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da1ba3a-ea9d-40f6-b0c4-80eb5f1985c6 could not be found. Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da1ba3a-ea9d-40f6-b0c4-80eb5f1985c6 could not be found. Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:22:01.362780 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:22:01.367452 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:22:01.367452 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:22:01.367452 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da1ba3a-ea9d-40f6-b0c4-80eb5f1985c6 could not be found. Aug 03 02:22:01.367452 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:01.369273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5ca426fd-5eb4-4704-a1d3-8e97ab394ac8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance 1da1ba3a-ea9d-40f6-b0c4-80eb5f1985c6 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:22:01.370362 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5ca426fd-5eb4-4704-a1d3-8e97ab394ac8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/1da1ba3a-ea9d-40f6-b0c4-80eb5f1985c6/action" status: 404 len: 111 microversion: 2.1 time: 0.049603 Aug 03 02:22:01.371172 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2755/5631] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:22:01 2022] POST /compute/v2.1/servers/1da1ba3a-ea9d-40f6-b0c4-80eb5f1985c6/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:22:01.380579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e484084c-ad94-4876-b5de-1ee320891dc3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:01.386465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e484084c-ad94-4876-b5de-1ee320891dc3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:01.416361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e484084c-ad94-4876-b5de-1ee320891dc3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:01.418100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e484084c-ad94-4876-b5de-1ee320891dc3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:01.419945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e484084c-ad94-4876-b5de-1ee320891dc3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:01.421267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e484084c-ad94-4876-b5de-1ee320891dc3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:01.740931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-40baa918-712e-4c65-9313-71a70e1aaac7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:01.751507 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-40baa918-712e-4c65-9313-71a70e1aaac7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1677 microversion: 2.1 time: 0.403591 Aug 03 02:22:01.755415 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2877/5632] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:01 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1677 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:01.790978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e484084c-ad94-4876-b5de-1ee320891dc3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:01.808373 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e484084c-ad94-4876-b5de-1ee320891dc3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.432534 Aug 03 02:22:01.810095 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2756/5633] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:01 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:01.832262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2aa3aee-bda0-444a-9b3e-129bbaf22fe3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:01.834077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c2aa3aee-bda0-444a-9b3e-129bbaf22fe3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:01.846061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2aa3aee-bda0-444a-9b3e-129bbaf22fe3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:01.846826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2aa3aee-bda0-444a-9b3e-129bbaf22fe3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:01.848896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2aa3aee-bda0-444a-9b3e-129bbaf22fe3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:01.851004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2aa3aee-bda0-444a-9b3e-129bbaf22fe3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:02.049667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c2aa3aee-bda0-444a-9b3e-129bbaf22fe3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:02.064331 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c2aa3aee-bda0-444a-9b3e-129bbaf22fe3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.235729 Aug 03 02:22:02.071035 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2878/5634] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:01 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:02.085483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1eae459b-ceb3-4251-9480-fdd460f9c9cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:02.086189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1eae459b-ceb3-4251-9480-fdd460f9c9cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:02.103468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1eae459b-ceb3-4251-9480-fdd460f9c9cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:02.103928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1eae459b-ceb3-4251-9480-fdd460f9c9cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:02.104730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1eae459b-ceb3-4251-9480-fdd460f9c9cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:02.105172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1eae459b-ceb3-4251-9480-fdd460f9c9cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:02.144077 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-1eae459b-ceb3-4251-9480-fdd460f9c9cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Cannot 'resume' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1eae459b-ceb3-4251-9480-fdd460f9c9cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action HTTP/1.1 Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 14 Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: {"resume": {}} Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: exception: Cannot 'resume' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'cc4dcb4b-0945-49cb-b946-0fe75f053c37', 'body': {'resume': {}}} Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 in vm_state active. Cannot resume while the instance is in this state. Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:02.154596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:22:02.163215 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:22:02.163215 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:22:02.163215 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:22:02.163215 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:22:02.163215 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:02.163215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1eae459b-ceb3-4251-9480-fdd460f9c9cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 409 to user: Cannot 'resume' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:22:02.163215 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1eae459b-ceb3-4251-9480-fdd460f9c9cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action" status: 409 len: 144 microversion: 2.1 time: 0.075503 Aug 03 02:22:02.163215 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2757/5635] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:22:02 2022] POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action => generated 144 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:22:02.165427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b3881570-ccfc-4f2c-8e37-6614a4632f3b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:02.166050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b3881570-ccfc-4f2c-8e37-6614a4632f3b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:02.182541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3881570-ccfc-4f2c-8e37-6614a4632f3b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:02.183838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3881570-ccfc-4f2c-8e37-6614a4632f3b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:02.184428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3881570-ccfc-4f2c-8e37-6614a4632f3b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:02.185148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3881570-ccfc-4f2c-8e37-6614a4632f3b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:02.431035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b3881570-ccfc-4f2c-8e37-6614a4632f3b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:02.442019 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b3881570-ccfc-4f2c-8e37-6614a4632f3b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.280890 Aug 03 02:22:02.444406 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2879/5636] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:02 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:02.465052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fefce1fb-166b-4a6c-b2d6-cf6b20448d24 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:02.465977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fefce1fb-166b-4a6c-b2d6-cf6b20448d24 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:02.473388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fefce1fb-166b-4a6c-b2d6-cf6b20448d24 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:02.474672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fefce1fb-166b-4a6c-b2d6-cf6b20448d24 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:02.475738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fefce1fb-166b-4a6c-b2d6-cf6b20448d24 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:02.476353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fefce1fb-166b-4a6c-b2d6-cf6b20448d24 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:02.776767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2ecdd22d-a1b5-4107-a001-c66ce82c360b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:02.777820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2ecdd22d-a1b5-4107-a001-c66ce82c360b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:02.795365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ecdd22d-a1b5-4107-a001-c66ce82c360b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:02.796229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ecdd22d-a1b5-4107-a001-c66ce82c360b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:02.797428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ecdd22d-a1b5-4107-a001-c66ce82c360b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:02.803258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ecdd22d-a1b5-4107-a001-c66ce82c360b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:02.835486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fefce1fb-166b-4a6c-b2d6-cf6b20448d24 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:02.853325 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fefce1fb-166b-4a6c-b2d6-cf6b20448d24 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.391932 Aug 03 02:22:02.867468 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2758/5637] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:02 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:02.998444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a57b3dc5-442d-46e4-b359-5d1e72229b2f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a57b3dc5-442d-46e4-b359-5d1e72229b2f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 160 Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "d5928fc2-6005-4eab-90c9-c57e9fce7e40"}]}} Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'server': {'name': '', 'imageRef': 'b851b45e-5c09-4153-a051-b8cb3fbe48b3', 'flavorRef': '452', 'networks': [{'uuid': 'd5928fc2-6005-4eab-90c9-c57e9fce7e40'}]}}} Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi '' Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:22:03.003281 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:22:03.007940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:22:03.007940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 03 02:22:03.007940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:03.007940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:22:03.007940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:03.007940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:03.007940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:22:03.007940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:22:03.007940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:22:03.007940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:22:03.007940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 03 02:22:03.007940 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:03.010440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a57b3dc5-442d-46e4-b359-5d1e72229b2f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:22:03.012197 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a57b3dc5-442d-46e4-b359-5d1e72229b2f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.017515 Aug 03 02:22:03.017676 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2759/5638] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:22:02 2022] POST /compute/v2.1/servers => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:22:03.026149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-679af9c4-004f-48c4-8ecc-380ceb1ba51f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:03.027336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-679af9c4-004f-48c4-8ecc-380ceb1ba51f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:03.045117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-679af9c4-004f-48c4-8ecc-380ceb1ba51f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:03.045882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-679af9c4-004f-48c4-8ecc-380ceb1ba51f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:03.047104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-679af9c4-004f-48c4-8ecc-380ceb1ba51f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:03.047783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-679af9c4-004f-48c4-8ecc-380ceb1ba51f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:03.213220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2ecdd22d-a1b5-4107-a001-c66ce82c360b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:03.223958 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2ecdd22d-a1b5-4107-a001-c66ce82c360b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1677 microversion: 2.1 time: 0.450896 Aug 03 02:22:03.225858 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2880/5639] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:02 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1677 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:03.292985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-679af9c4-004f-48c4-8ecc-380ceb1ba51f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:03.302647 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-679af9c4-004f-48c4-8ecc-380ceb1ba51f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.283438 Aug 03 02:22:03.303906 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2760/5640] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:03 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:03.326551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-17c33a53-8079-4ac0-9a61-ff33bad2e935 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:03.327338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-17c33a53-8079-4ac0-9a61-ff33bad2e935 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:03.337305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-17c33a53-8079-4ac0-9a61-ff33bad2e935 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:03.339257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-17c33a53-8079-4ac0-9a61-ff33bad2e935 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:03.340172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-17c33a53-8079-4ac0-9a61-ff33bad2e935 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:03.340631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-17c33a53-8079-4ac0-9a61-ff33bad2e935 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:03.531782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-17c33a53-8079-4ac0-9a61-ff33bad2e935 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:03.548014 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-17c33a53-8079-4ac0-9a61-ff33bad2e935 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.226026 Aug 03 02:22:03.558979 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2881/5641] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:03 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:03.570870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25061d40-01b6-4a77-911b-2126a3e42983 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:03.571466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-25061d40-01b6-4a77-911b-2126a3e42983 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: fffef195-e615-4b6e-b98c-8b30edbd2067] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:03.582168 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-25061d40-01b6-4a77-911b-2126a3e42983 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance fffef195-e615-4b6e-b98c-8b30edbd2067 could not be found. Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25061d40-01b6-4a77-911b-2126a3e42983 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/fffef195-e615-4b6e-b98c-8b30edbd2067/action HTTP/1.1 Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 14 Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: {"shelve": {}} Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance fffef195-e615-4b6e-b98c-8b30edbd2067 could not be found. Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'fffef195-e615-4b6e-b98c-8b30edbd2067', 'body': {'shelve': {}}} Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fffef195-e615-4b6e-b98c-8b30edbd2067 could not be found. Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fffef195-e615-4b6e-b98c-8b30edbd2067 could not be found. Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:22:03.590895 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:22:03.595681 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:22:03.595681 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:22:03.595681 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fffef195-e615-4b6e-b98c-8b30edbd2067 could not be found. Aug 03 02:22:03.595681 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:03.597453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25061d40-01b6-4a77-911b-2126a3e42983 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance fffef195-e615-4b6e-b98c-8b30edbd2067 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:22:03.600060 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-25061d40-01b6-4a77-911b-2126a3e42983 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/fffef195-e615-4b6e-b98c-8b30edbd2067/action" status: 404 len: 111 microversion: 2.1 time: 0.034456 Aug 03 02:22:03.608763 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2761/5642] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:22:03 2022] POST /compute/v2.1/servers/fffef195-e615-4b6e-b98c-8b30edbd2067/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:22:03.616112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b99b83d0-e391-4ec7-92f4-47be2621d159 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:03.616739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b99b83d0-e391-4ec7-92f4-47be2621d159 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:03.623352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b99b83d0-e391-4ec7-92f4-47be2621d159 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:03.624072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b99b83d0-e391-4ec7-92f4-47be2621d159 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:03.625046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b99b83d0-e391-4ec7-92f4-47be2621d159 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:03.625679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b99b83d0-e391-4ec7-92f4-47be2621d159 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:03.850807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b99b83d0-e391-4ec7-92f4-47be2621d159 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:03.865890 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b99b83d0-e391-4ec7-92f4-47be2621d159 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.252373 Aug 03 02:22:03.867026 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2882/5643] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:03 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:03.888118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f330115b-a8b0-4ec3-8f16-e63abfce6fa7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:03.889604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f330115b-a8b0-4ec3-8f16-e63abfce6fa7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:03.899129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f330115b-a8b0-4ec3-8f16-e63abfce6fa7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:03.900085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f330115b-a8b0-4ec3-8f16-e63abfce6fa7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:03.901139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f330115b-a8b0-4ec3-8f16-e63abfce6fa7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:03.901805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f330115b-a8b0-4ec3-8f16-e63abfce6fa7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:04.187522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f330115b-a8b0-4ec3-8f16-e63abfce6fa7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:04.199801 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f330115b-a8b0-4ec3-8f16-e63abfce6fa7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.315495 Aug 03 02:22:04.215472 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2762/5644] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:03 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:04.224286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6072198b-ec98-4adf-842d-208f37c3219a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:04.225601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6072198b-ec98-4adf-842d-208f37c3219a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:04.232588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6072198b-ec98-4adf-842d-208f37c3219a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:04.233354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6072198b-ec98-4adf-842d-208f37c3219a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:04.234364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6072198b-ec98-4adf-842d-208f37c3219a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:04.235307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6072198b-ec98-4adf-842d-208f37c3219a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:04.252021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-34526002-3fdc-4544-a836-b0765057c90e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:04.252656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-34526002-3fdc-4544-a836-b0765057c90e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:04.263876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-6072198b-ec98-4adf-842d-208f37c3219a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lazy-loading 'flavor' on Instance uuid cc4dcb4b-0945-49cb-b946-0fe75f053c37 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:22:04.266684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34526002-3fdc-4544-a836-b0765057c90e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:04.267203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34526002-3fdc-4544-a836-b0765057c90e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:04.268022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34526002-3fdc-4544-a836-b0765057c90e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:04.268477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-34526002-3fdc-4544-a836-b0765057c90e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:04.284174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:22:04.587567 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6072198b-ec98-4adf-842d-208f37c3219a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action" status: 202 len: 0 microversion: 2.1 time: 0.368000 Aug 03 02:22:04.588357 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2883/5645] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:22:04 2022] POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:22:04.597254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-01b822c6-246b-458b-b48c-e44659afef30 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:04.598384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-01b822c6-246b-458b-b48c-e44659afef30 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:04.614025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=98 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:22:04.616818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01b822c6-246b-458b-b48c-e44659afef30 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:04.617613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01b822c6-246b-458b-b48c-e44659afef30 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:04.618738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01b822c6-246b-458b-b48c-e44659afef30 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:04.619381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-01b822c6-246b-458b-b48c-e44659afef30 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:04.686039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-34526002-3fdc-4544-a836-b0765057c90e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:04.697440 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-34526002-3fdc-4544-a836-b0765057c90e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1677 microversion: 2.1 time: 0.449513 Aug 03 02:22:04.698044 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2763/5646] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:04 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1677 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:04.905361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-01b822c6-246b-458b-b48c-e44659afef30 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:04.917346 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-01b822c6-246b-458b-b48c-e44659afef30 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1510 microversion: 2.1 time: 0.324125 Aug 03 02:22:04.918647 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2884/5647] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:04 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1510 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:05.730646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0eafce46-9848-4891-8e12-0581d9449e9c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:05.731458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0eafce46-9848-4891-8e12-0581d9449e9c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:05.751923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0eafce46-9848-4891-8e12-0581d9449e9c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:05.752489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0eafce46-9848-4891-8e12-0581d9449e9c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:05.755883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0eafce46-9848-4891-8e12-0581d9449e9c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:05.756376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0eafce46-9848-4891-8e12-0581d9449e9c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:05.942424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-171a09d2-49f8-48f4-908c-8ff23fffab44 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:05.943315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-171a09d2-49f8-48f4-908c-8ff23fffab44 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:05.956239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-171a09d2-49f8-48f4-908c-8ff23fffab44 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:05.958759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-171a09d2-49f8-48f4-908c-8ff23fffab44 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:05.960384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-171a09d2-49f8-48f4-908c-8ff23fffab44 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:05.960964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-171a09d2-49f8-48f4-908c-8ff23fffab44 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:06.066842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0eafce46-9848-4891-8e12-0581d9449e9c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:06.074969 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0eafce46-9848-4891-8e12-0581d9449e9c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1677 microversion: 2.1 time: 0.353785 Aug 03 02:22:06.075574 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2764/5648] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:05 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1677 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:06.312303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-171a09d2-49f8-48f4-908c-8ff23fffab44 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:06.343132 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-171a09d2-49f8-48f4-908c-8ff23fffab44 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1510 microversion: 2.1 time: 0.396402 Aug 03 02:22:06.343822 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2885/5649] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:05 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1510 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:07.097444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-869b074e-b44f-45d2-8a2c-eb0df863e446 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:07.099348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-869b074e-b44f-45d2-8a2c-eb0df863e446 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:07.106818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-869b074e-b44f-45d2-8a2c-eb0df863e446 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:07.107325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-869b074e-b44f-45d2-8a2c-eb0df863e446 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:07.108322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-869b074e-b44f-45d2-8a2c-eb0df863e446 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:07.108941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-869b074e-b44f-45d2-8a2c-eb0df863e446 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:07.271767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-869b074e-b44f-45d2-8a2c-eb0df863e446 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:07.280402 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-869b074e-b44f-45d2-8a2c-eb0df863e446 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1677 microversion: 2.1 time: 0.186728 Aug 03 02:22:07.295957 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2765/5650] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:07 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:07.365465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-feca5aa7-6bea-4876-931f-59674eb1c57a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:07.366724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-feca5aa7-6bea-4876-931f-59674eb1c57a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:07.377351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-feca5aa7-6bea-4876-931f-59674eb1c57a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:07.378356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-feca5aa7-6bea-4876-931f-59674eb1c57a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:07.379413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-feca5aa7-6bea-4876-931f-59674eb1c57a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:07.380195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-feca5aa7-6bea-4876-931f-59674eb1c57a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:07.586275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-feca5aa7-6bea-4876-931f-59674eb1c57a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:07.597743 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-feca5aa7-6bea-4876-931f-59674eb1c57a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1510 microversion: 2.1 time: 0.235625 Aug 03 02:22:07.604663 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2886/5651] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:07 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:08.305961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bda4f362-8d57-4272-ae79-ad191420e512 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:08.308823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bda4f362-8d57-4272-ae79-ad191420e512 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:08.318824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bda4f362-8d57-4272-ae79-ad191420e512 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:08.320273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bda4f362-8d57-4272-ae79-ad191420e512 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:08.321352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bda4f362-8d57-4272-ae79-ad191420e512 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:08.322624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bda4f362-8d57-4272-ae79-ad191420e512 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:08.496749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bda4f362-8d57-4272-ae79-ad191420e512 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:08.508441 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bda4f362-8d57-4272-ae79-ad191420e512 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1677 microversion: 2.1 time: 0.207547 Aug 03 02:22:08.520927 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2766/5652] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:08 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:08.622996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bcbe4e66-f8d5-4f84-8e87-09d824a6e93d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:08.624247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bcbe4e66-f8d5-4f84-8e87-09d824a6e93d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:08.642673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcbe4e66-f8d5-4f84-8e87-09d824a6e93d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:08.643172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcbe4e66-f8d5-4f84-8e87-09d824a6e93d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:08.644407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcbe4e66-f8d5-4f84-8e87-09d824a6e93d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:08.645034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcbe4e66-f8d5-4f84-8e87-09d824a6e93d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:08.822010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bcbe4e66-f8d5-4f84-8e87-09d824a6e93d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:08.824888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:22:08.836983 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bcbe4e66-f8d5-4f84-8e87-09d824a6e93d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1510 microversion: 2.1 time: 0.219134 Aug 03 02:22:08.838259 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2887/5653] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:08 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1510 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:09.530529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4217e449-3d66-44b5-8b54-2c8c40777145 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:09.531172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4217e449-3d66-44b5-8b54-2c8c40777145 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:09.540148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4217e449-3d66-44b5-8b54-2c8c40777145 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:09.540821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4217e449-3d66-44b5-8b54-2c8c40777145 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:09.541609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4217e449-3d66-44b5-8b54-2c8c40777145 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:09.542055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4217e449-3d66-44b5-8b54-2c8c40777145 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:09.860868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-67b5856a-92f6-4f5c-9ca5-134f4dbcf2a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:09.862346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-67b5856a-92f6-4f5c-9ca5-134f4dbcf2a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:09.875780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67b5856a-92f6-4f5c-9ca5-134f4dbcf2a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:09.877150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67b5856a-92f6-4f5c-9ca5-134f4dbcf2a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:09.878428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67b5856a-92f6-4f5c-9ca5-134f4dbcf2a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:09.879381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-67b5856a-92f6-4f5c-9ca5-134f4dbcf2a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:10.128485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4217e449-3d66-44b5-8b54-2c8c40777145 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:10.138341 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4217e449-3d66-44b5-8b54-2c8c40777145 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1677 microversion: 2.1 time: 0.611815 Aug 03 02:22:10.139597 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2767/5654] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:09 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1677 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:10.196383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-67b5856a-92f6-4f5c-9ca5-134f4dbcf2a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:10.214504 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-67b5856a-92f6-4f5c-9ca5-134f4dbcf2a3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1510 microversion: 2.1 time: 0.358481 Aug 03 02:22:10.215632 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2888/5655] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:09 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1510 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:11.162863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c557a4f6-5bac-4f89-abdb-f0c2df4abc38 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:11.163613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c557a4f6-5bac-4f89-abdb-f0c2df4abc38 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:11.172659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c557a4f6-5bac-4f89-abdb-f0c2df4abc38 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:11.173823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c557a4f6-5bac-4f89-abdb-f0c2df4abc38 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:11.175680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c557a4f6-5bac-4f89-abdb-f0c2df4abc38 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:11.176872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c557a4f6-5bac-4f89-abdb-f0c2df4abc38 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:11.237857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-04990806-f17f-425c-ba9a-30ad13118b76 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:11.240463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-04990806-f17f-425c-ba9a-30ad13118b76 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:11.257775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04990806-f17f-425c-ba9a-30ad13118b76 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:11.258589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04990806-f17f-425c-ba9a-30ad13118b76 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:11.260857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04990806-f17f-425c-ba9a-30ad13118b76 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:11.262831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04990806-f17f-425c-ba9a-30ad13118b76 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:11.407939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c557a4f6-5bac-4f89-abdb-f0c2df4abc38 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:11.426222 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c557a4f6-5bac-4f89-abdb-f0c2df4abc38 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1654 microversion: 2.1 time: 0.269217 Aug 03 02:22:11.428482 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2768/5656] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:11 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1654 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:11.449628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-36700d86-7fff-4388-ba71-e615cd5e1dcf tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:11.461315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36700d86-7fff-4388-ba71-e615cd5e1dcf tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:11.461788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36700d86-7fff-4388-ba71-e615cd5e1dcf tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:11.530007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-36700d86-7fff-4388-ba71-e615cd5e1dcf tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Going to try to start instance {{(pid=125942) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 02:22:11.531647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-04990806-f17f-425c-ba9a-30ad13118b76 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:11.544537 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-04990806-f17f-425c-ba9a-30ad13118b76 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1510 microversion: 2.1 time: 0.312197 Aug 03 02:22:11.545620 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2889/5657] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:11 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1510 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:11.605904 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-36700d86-7fff-4388-ba71-e615cd5e1dcf tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "POST /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/action" status: 202 len: 0 microversion: 2.1 time: 0.160902 Aug 03 02:22:11.607518 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2769/5658] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:22:11 2022] POST /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 02:22:11.617211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e93d695-ed3f-4af1-bda5-4b6cdf3c1a54 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:11.618083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3e93d695-ed3f-4af1-bda5-4b6cdf3c1a54 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:11.625355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e93d695-ed3f-4af1-bda5-4b6cdf3c1a54 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:11.626047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e93d695-ed3f-4af1-bda5-4b6cdf3c1a54 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:11.627024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e93d695-ed3f-4af1-bda5-4b6cdf3c1a54 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:11.627619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e93d695-ed3f-4af1-bda5-4b6cdf3c1a54 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:11.925883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3e93d695-ed3f-4af1-bda5-4b6cdf3c1a54 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:11.945484 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e93d695-ed3f-4af1-bda5-4b6cdf3c1a54 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1663 microversion: 2.1 time: 0.332804 Aug 03 02:22:11.948293 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2890/5659] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:11 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1663 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:12.567758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1e687dba-d0f0-4389-a3cb-3b6f3665a85e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:12.568565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1e687dba-d0f0-4389-a3cb-3b6f3665a85e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:12.576392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e687dba-d0f0-4389-a3cb-3b6f3665a85e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:12.576924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e687dba-d0f0-4389-a3cb-3b6f3665a85e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:12.577942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e687dba-d0f0-4389-a3cb-3b6f3665a85e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:12.578555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e687dba-d0f0-4389-a3cb-3b6f3665a85e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:12.771439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1e687dba-d0f0-4389-a3cb-3b6f3665a85e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:12.797639 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1e687dba-d0f0-4389-a3cb-3b6f3665a85e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1510 microversion: 2.1 time: 0.226059 Aug 03 02:22:12.797639 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2770/5660] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:12 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:12.970136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e6cdbe03-797b-4ba5-9cc4-f0d88815ba0d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:12.971448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e6cdbe03-797b-4ba5-9cc4-f0d88815ba0d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:12.979818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6cdbe03-797b-4ba5-9cc4-f0d88815ba0d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:12.980277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6cdbe03-797b-4ba5-9cc4-f0d88815ba0d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:12.981232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6cdbe03-797b-4ba5-9cc4-f0d88815ba0d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:12.981830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e6cdbe03-797b-4ba5-9cc4-f0d88815ba0d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:13.237095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e6cdbe03-797b-4ba5-9cc4-f0d88815ba0d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:13.247649 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e6cdbe03-797b-4ba5-9cc4-f0d88815ba0d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1663 microversion: 2.1 time: 0.281229 Aug 03 02:22:13.248844 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2891/5661] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:12 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1663 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:13.816112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a056c93c-435f-4418-9770-c816b8df3f5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:13.819064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a056c93c-435f-4418-9770-c816b8df3f5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:13.828859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a056c93c-435f-4418-9770-c816b8df3f5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:13.829679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a056c93c-435f-4418-9770-c816b8df3f5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:13.830698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a056c93c-435f-4418-9770-c816b8df3f5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:13.831409 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a056c93c-435f-4418-9770-c816b8df3f5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:13.994452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a056c93c-435f-4418-9770-c816b8df3f5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:14.003555 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a056c93c-435f-4418-9770-c816b8df3f5a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1510 microversion: 2.1 time: 0.194031 Aug 03 02:22:14.015281 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2771/5662] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:13 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:14.269827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b4c5607-8084-4133-b83a-021108304ba2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:14.270739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8b4c5607-8084-4133-b83a-021108304ba2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:14.277775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b4c5607-8084-4133-b83a-021108304ba2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:14.278521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b4c5607-8084-4133-b83a-021108304ba2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:14.279749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b4c5607-8084-4133-b83a-021108304ba2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:14.280428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b4c5607-8084-4133-b83a-021108304ba2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:14.449833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8b4c5607-8084-4133-b83a-021108304ba2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:14.459209 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8b4c5607-8084-4133-b83a-021108304ba2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1667 microversion: 2.1 time: 0.193529 Aug 03 02:22:14.460045 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2892/5663] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:14 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1667 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:15.027487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4414472d-586f-4016-acff-9e41829f0744 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:15.028071 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4414472d-586f-4016-acff-9e41829f0744 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:15.035712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4414472d-586f-4016-acff-9e41829f0744 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:15.036614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4414472d-586f-4016-acff-9e41829f0744 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:15.037435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4414472d-586f-4016-acff-9e41829f0744 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:15.037881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4414472d-586f-4016-acff-9e41829f0744 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:15.292897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4414472d-586f-4016-acff-9e41829f0744 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:15.301195 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4414472d-586f-4016-acff-9e41829f0744 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1510 microversion: 2.1 time: 0.277650 Aug 03 02:22:15.317708 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2772/5664] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:15 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:16.334538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-44dd2e2b-8f18-4fe3-9981-acdd914ada29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:16.336524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-44dd2e2b-8f18-4fe3-9981-acdd914ada29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:16.360148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-44dd2e2b-8f18-4fe3-9981-acdd914ada29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:16.360620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-44dd2e2b-8f18-4fe3-9981-acdd914ada29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:16.361434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-44dd2e2b-8f18-4fe3-9981-acdd914ada29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:16.361883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-44dd2e2b-8f18-4fe3-9981-acdd914ada29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:16.601769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-44dd2e2b-8f18-4fe3-9981-acdd914ada29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:16.615620 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-44dd2e2b-8f18-4fe3-9981-acdd914ada29 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1510 microversion: 2.1 time: 0.292085 Aug 03 02:22:16.617226 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2893/5665] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:16 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:17.610737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fd2c0c13-da30-4330-ae13-2ca9c8638e36 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:17.614785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fd2c0c13-da30-4330-ae13-2ca9c8638e36 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:17.627428 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd2c0c13-da30-4330-ae13-2ca9c8638e36 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:17.628481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd2c0c13-da30-4330-ae13-2ca9c8638e36 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:17.632805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd2c0c13-da30-4330-ae13-2ca9c8638e36 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:17.633483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd2c0c13-da30-4330-ae13-2ca9c8638e36 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:17.638084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0c45e26b-f55e-4086-9f57-81490a40ecc6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:17.638807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0c45e26b-f55e-4086-9f57-81490a40ecc6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:17.648735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c45e26b-f55e-4086-9f57-81490a40ecc6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:17.650258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c45e26b-f55e-4086-9f57-81490a40ecc6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:17.652077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c45e26b-f55e-4086-9f57-81490a40ecc6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:17.653399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c45e26b-f55e-4086-9f57-81490a40ecc6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:17.702532 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fd2c0c13-da30-4330-ae13-2ca9c8638e36 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a/action" status: 200 len: 24562 microversion: 2.1 time: 0.096247 Aug 03 02:22:17.703232 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2773/5666] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:22:17 2022] POST /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a/action => generated 24562 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:22:17.937003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0c45e26b-f55e-4086-9f57-81490a40ecc6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:17.948250 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0c45e26b-f55e-4086-9f57-81490a40ecc6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1510 microversion: 2.1 time: 0.314303 Aug 03 02:22:17.965247 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2894/5667] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:17 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1510 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:18.978404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0af82a9c-0bcf-4db7-8256-d360d7422f14 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:18.980227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0af82a9c-0bcf-4db7-8256-d360d7422f14 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:18.990067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0af82a9c-0bcf-4db7-8256-d360d7422f14 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:18.990267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0af82a9c-0bcf-4db7-8256-d360d7422f14 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:18.992060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0af82a9c-0bcf-4db7-8256-d360d7422f14 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:18.992755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0af82a9c-0bcf-4db7-8256-d360d7422f14 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:19.247923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0af82a9c-0bcf-4db7-8256-d360d7422f14 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:19.259702 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0af82a9c-0bcf-4db7-8256-d360d7422f14 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1510 microversion: 2.1 time: 0.287406 Aug 03 02:22:19.260986 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2774/5668] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:18 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1510 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:20.283496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a644142e-3cba-475e-9998-26570c0e85b1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:20.284781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a644142e-3cba-475e-9998-26570c0e85b1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:20.293914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a644142e-3cba-475e-9998-26570c0e85b1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:20.294383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a644142e-3cba-475e-9998-26570c0e85b1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:20.295561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a644142e-3cba-475e-9998-26570c0e85b1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:20.296026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a644142e-3cba-475e-9998-26570c0e85b1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:20.552466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a644142e-3cba-475e-9998-26570c0e85b1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:20.565901 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a644142e-3cba-475e-9998-26570c0e85b1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1531 microversion: 2.1 time: 0.287311 Aug 03 02:22:20.581140 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2895/5669] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:20 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1531 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:21.590586 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-89944ce1-704d-4264-809b-4ebf2460fba4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:21.591857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-89944ce1-704d-4264-809b-4ebf2460fba4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:21.608772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89944ce1-704d-4264-809b-4ebf2460fba4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:21.609523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89944ce1-704d-4264-809b-4ebf2460fba4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:21.610347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89944ce1-704d-4264-809b-4ebf2460fba4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:21.610798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89944ce1-704d-4264-809b-4ebf2460fba4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:21.789180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-89944ce1-704d-4264-809b-4ebf2460fba4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:21.797838 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-89944ce1-704d-4264-809b-4ebf2460fba4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1531 microversion: 2.1 time: 0.211650 Aug 03 02:22:21.803190 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2775/5670] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:21 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1531 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:22.880734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-359d6e4b-e3cf-49a4-98bb-f1c8e9db2bdf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:22.880734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-359d6e4b-e3cf-49a4-98bb-f1c8e9db2bdf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:22.880734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-359d6e4b-e3cf-49a4-98bb-f1c8e9db2bdf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:22.880734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-359d6e4b-e3cf-49a4-98bb-f1c8e9db2bdf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:22.880734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-359d6e4b-e3cf-49a4-98bb-f1c8e9db2bdf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:22.880734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-359d6e4b-e3cf-49a4-98bb-f1c8e9db2bdf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:23.133727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-359d6e4b-e3cf-49a4-98bb-f1c8e9db2bdf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:23.161327 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-359d6e4b-e3cf-49a4-98bb-f1c8e9db2bdf tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1531 microversion: 2.1 time: 0.342067 Aug 03 02:22:23.165086 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2896/5671] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:22 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1531 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:23.518255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-48cdceee-163d-4770-9b51-07b11b90b608 req-28742423-2d69-4410-95ba-703a21477fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4dcb4b-0945-49cb-b946-0fe75f053c37", "name": "network-vif-plugged", "status": "completed", "tag": "3d7ec981-7632-4ce7-8a7a-4b8453f3e081"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:23.547879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-48cdceee-163d-4770-9b51-07b11b90b608 req-28742423-2d69-4410-95ba-703a21477fd8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:23.549212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-48cdceee-163d-4770-9b51-07b11b90b608 req-28742423-2d69-4410-95ba-703a21477fd8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:23.569227 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-48cdceee-163d-4770-9b51-07b11b90b608 req-28742423-2d69-4410-95ba-703a21477fd8 service nova] Creating event network-vif-plugged:3d7ec981-7632-4ce7-8a7a-4b8453f3e081 for instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 on n-h2-826529-8 Aug 03 02:22:23.575466 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-48cdceee-163d-4770-9b51-07b11b90b608 req-28742423-2d69-4410-95ba-703a21477fd8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077842 Aug 03 02:22:23.576443 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2776/5672] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:22:24.195996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ef7f9a40-e6c3-49b2-b726-3182be0a28c3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:24.196885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ef7f9a40-e6c3-49b2-b726-3182be0a28c3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:24.204937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef7f9a40-e6c3-49b2-b726-3182be0a28c3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:24.205403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef7f9a40-e6c3-49b2-b726-3182be0a28c3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:24.206214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef7f9a40-e6c3-49b2-b726-3182be0a28c3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:24.206662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef7f9a40-e6c3-49b2-b726-3182be0a28c3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:24.636295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ef7f9a40-e6c3-49b2-b726-3182be0a28c3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:24.653073 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ef7f9a40-e6c3-49b2-b726-3182be0a28c3 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1526 microversion: 2.1 time: 0.465276 Aug 03 02:22:24.655153 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2897/5673] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:24 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1526 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:25.693325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-08a93481-b15f-40a6-b1b7-9e59c14360de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:25.695421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-08a93481-b15f-40a6-b1b7-9e59c14360de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:25.708261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08a93481-b15f-40a6-b1b7-9e59c14360de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:25.708910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08a93481-b15f-40a6-b1b7-9e59c14360de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:25.709872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08a93481-b15f-40a6-b1b7-9e59c14360de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:25.710479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-08a93481-b15f-40a6-b1b7-9e59c14360de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:26.355928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-08a93481-b15f-40a6-b1b7-9e59c14360de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:26.381439 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-08a93481-b15f-40a6-b1b7-9e59c14360de tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1526 microversion: 2.1 time: 0.698689 Aug 03 02:22:26.382662 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2777/5674] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:25 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1526 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:27.404312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-846ef134-9e02-4743-9d50-305990cec8d8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:27.405429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-846ef134-9e02-4743-9d50-305990cec8d8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:27.454594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-846ef134-9e02-4743-9d50-305990cec8d8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:27.456818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-846ef134-9e02-4743-9d50-305990cec8d8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:27.460123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-846ef134-9e02-4743-9d50-305990cec8d8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:27.461287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-846ef134-9e02-4743-9d50-305990cec8d8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:27.685886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-846ef134-9e02-4743-9d50-305990cec8d8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:27.698442 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-846ef134-9e02-4743-9d50-305990cec8d8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1526 microversion: 2.1 time: 0.298858 Aug 03 02:22:27.699759 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2898/5675] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:27 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1526 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:28.737372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0cc36721-3214-4a1d-aaff-9e1f5916d1c4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:28.744596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-157faf0c-83be-4ccf-aa93-ed1f29e31027 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:28.745868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-157faf0c-83be-4ccf-aa93-ed1f29e31027 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:28.746217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0cc36721-3214-4a1d-aaff-9e1f5916d1c4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:28.778869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cc36721-3214-4a1d-aaff-9e1f5916d1c4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:28.783049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-157faf0c-83be-4ccf-aa93-ed1f29e31027 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:28.783799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cc36721-3214-4a1d-aaff-9e1f5916d1c4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:28.784369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-157faf0c-83be-4ccf-aa93-ed1f29e31027 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:28.788026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cc36721-3214-4a1d-aaff-9e1f5916d1c4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:28.788952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-157faf0c-83be-4ccf-aa93-ed1f29e31027 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:28.789623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cc36721-3214-4a1d-aaff-9e1f5916d1c4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:28.794355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-157faf0c-83be-4ccf-aa93-ed1f29e31027 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:29.491305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0cc36721-3214-4a1d-aaff-9e1f5916d1c4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:29.504993 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0cc36721-3214-4a1d-aaff-9e1f5916d1c4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1526 microversion: 2.1 time: 0.771823 Aug 03 02:22:29.515300 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2778/5676] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:28 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1526 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:29.633795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-157faf0c-83be-4ccf-aa93-ed1f29e31027 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:29.656799 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-157faf0c-83be-4ccf-aa93-ed1f29e31027 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1682 microversion: 2.1 time: 0.916767 Aug 03 02:22:29.658002 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2899/5677] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:28 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1682 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:29.782993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b293186c-5a2c-4f8b-8952-8cfed1d26adc tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:29.786223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b293186c-5a2c-4f8b-8952-8cfed1d26adc tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:29.799154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b293186c-5a2c-4f8b-8952-8cfed1d26adc tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:29.799935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b293186c-5a2c-4f8b-8952-8cfed1d26adc tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:29.801653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b293186c-5a2c-4f8b-8952-8cfed1d26adc tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:29.802351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b293186c-5a2c-4f8b-8952-8cfed1d26adc tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:29.880160 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b293186c-5a2c-4f8b-8952-8cfed1d26adc tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a/action" status: 200 len: 32637 microversion: 2.1 time: 0.101277 Aug 03 02:22:29.881364 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2779/5678] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:22:29 2022] POST /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a/action => generated 32637 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:22:30.079674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f811a398-508a-4161-bbe6-0567de25201c tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:30.080957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f811a398-508a-4161-bbe6-0567de25201c tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:30.095182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f811a398-508a-4161-bbe6-0567de25201c tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:30.098520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f811a398-508a-4161-bbe6-0567de25201c tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:30.101631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f811a398-508a-4161-bbe6-0567de25201c tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:30.103384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f811a398-508a-4161-bbe6-0567de25201c tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:30.388863 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f811a398-508a-4161-bbe6-0567de25201c tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1833 microversion: 2.1 time: 0.312553 Aug 03 02:22:30.390740 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2900/5679] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:30 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1833 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:30.423035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3e376123-f174-4d98-a964-b8031ee84ea4 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:30.427970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3e376123-f174-4d98-a964-b8031ee84ea4 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:30.435663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e376123-f174-4d98-a964-b8031ee84ea4 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:30.436601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e376123-f174-4d98-a964-b8031ee84ea4 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:30.437783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e376123-f174-4d98-a964-b8031ee84ea4 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:30.438514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3e376123-f174-4d98-a964-b8031ee84ea4 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:30.480497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:22:30.496816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-3e376123-f174-4d98-a964-b8031ee84ea4 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lazy-loading 'flavor' on Instance uuid 0e9f5029-1b4c-4764-87a8-e7df5950154a {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:22:30.526584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e949baf8-20df-4f9f-8cc7-de040a2e8f3a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:30.527343 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e949baf8-20df-4f9f-8cc7-de040a2e8f3a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:30.534783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3e376123-f174-4d98-a964-b8031ee84ea4 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Going to try to live migrate instance to another host {{(pid=125942) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 02:22:30.537553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e949baf8-20df-4f9f-8cc7-de040a2e8f3a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:30.539417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e949baf8-20df-4f9f-8cc7-de040a2e8f3a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:30.542269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e949baf8-20df-4f9f-8cc7-de040a2e8f3a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:30.543959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e949baf8-20df-4f9f-8cc7-de040a2e8f3a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:30.960326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e949baf8-20df-4f9f-8cc7-de040a2e8f3a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:30.973734 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e949baf8-20df-4f9f-8cc7-de040a2e8f3a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1526 microversion: 2.1 time: 0.450081 Aug 03 02:22:30.987186 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2901/5680] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:30 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1526 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:32.005642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e65c0fe4-ec90-4301-8f92-b47b99fa87f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:32.007662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e65c0fe4-ec90-4301-8f92-b47b99fa87f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:32.020295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e65c0fe4-ec90-4301-8f92-b47b99fa87f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:32.021037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e65c0fe4-ec90-4301-8f92-b47b99fa87f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:32.022611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e65c0fe4-ec90-4301-8f92-b47b99fa87f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:32.023588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e65c0fe4-ec90-4301-8f92-b47b99fa87f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:32.415929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e65c0fe4-ec90-4301-8f92-b47b99fa87f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:32.428855 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e65c0fe4-ec90-4301-8f92-b47b99fa87f6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1526 microversion: 2.1 time: 0.435582 Aug 03 02:22:32.430373 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2902/5681] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:31 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1526 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:33.478340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-97ea3d4e-a0ea-4730-b3ad-cfc655083965 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:33.482531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-97ea3d4e-a0ea-4730-b3ad-cfc655083965 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:33.497964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97ea3d4e-a0ea-4730-b3ad-cfc655083965 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:33.499266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97ea3d4e-a0ea-4730-b3ad-cfc655083965 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:33.501517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97ea3d4e-a0ea-4730-b3ad-cfc655083965 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:33.504368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97ea3d4e-a0ea-4730-b3ad-cfc655083965 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:33.993734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-97ea3d4e-a0ea-4730-b3ad-cfc655083965 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:34.009853 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-97ea3d4e-a0ea-4730-b3ad-cfc655083965 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1526 microversion: 2.1 time: 0.546814 Aug 03 02:22:34.011402 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2903/5682] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:33 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1526 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:34.099097 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3e376123-f174-4d98-a964-b8031ee84ea4 tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a/action" status: 202 len: 0 microversion: 2.1 time: 3.680741 Aug 03 02:22:34.101013 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2780/5683] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:22:30 2022] POST /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a/action => generated 0 bytes in 3684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:22:34.115706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2523e2f6-c98e-4b2d-822f-f608739acdec tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:34.116420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2523e2f6-c98e-4b2d-822f-f608739acdec tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:34.163611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2523e2f6-c98e-4b2d-822f-f608739acdec tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:34.164378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2523e2f6-c98e-4b2d-822f-f608739acdec tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:34.166619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2523e2f6-c98e-4b2d-822f-f608739acdec tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:34.175617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2523e2f6-c98e-4b2d-822f-f608739acdec tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:34.204188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:22:34.394767 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2523e2f6-c98e-4b2d-822f-f608739acdec tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:34.409386 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2523e2f6-c98e-4b2d-822f-f608739acdec tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1692 microversion: 2.1 time: 0.301080 Aug 03 02:22:34.410319 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2904/5684] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:34 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1692 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:35.034327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c4b8383a-a661-4bb4-9063-422b909b61d9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:35.036166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c4b8383a-a661-4bb4-9063-422b909b61d9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:35.065786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=52 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:22:35.068820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4b8383a-a661-4bb4-9063-422b909b61d9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:35.075112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4b8383a-a661-4bb4-9063-422b909b61d9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:35.076582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4b8383a-a661-4bb4-9063-422b909b61d9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:35.087621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4b8383a-a661-4bb4-9063-422b909b61d9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:35.452398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f99cb102-09ea-4026-b8e6-cf90f0185703 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:35.453153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f99cb102-09ea-4026-b8e6-cf90f0185703 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:35.469707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=42 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:22:35.471986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f99cb102-09ea-4026-b8e6-cf90f0185703 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:35.473519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f99cb102-09ea-4026-b8e6-cf90f0185703 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:35.476091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f99cb102-09ea-4026-b8e6-cf90f0185703 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:35.479555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f99cb102-09ea-4026-b8e6-cf90f0185703 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:35.520395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c4b8383a-a661-4bb4-9063-422b909b61d9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:35.536934 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c4b8383a-a661-4bb4-9063-422b909b61d9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1526 microversion: 2.1 time: 0.502781 Aug 03 02:22:35.539087 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2781/5685] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:35 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1526 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:35.952307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f99cb102-09ea-4026-b8e6-cf90f0185703 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:35.975819 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f99cb102-09ea-4026-b8e6-cf90f0185703 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1692 microversion: 2.1 time: 0.529330 Aug 03 02:22:35.979216 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2905/5686] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:35 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1692 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:36.537183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-9fb1edff-faba-491f-8da3-9d5022f00d96 req-608358f7-0b8e-46ef-a425-19b5f53ce7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e9f5029-1b4c-4764-87a8-e7df5950154a", "name": "network-vif-unplugged", "status": "completed", "tag": "2c175fa6-c779-4716-992f-2b2d4e374e11"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:36.564419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c58da442-953b-4f8e-8a7e-59f66921b6d4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:36.565231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c58da442-953b-4f8e-8a7e-59f66921b6d4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:36.588411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c58da442-953b-4f8e-8a7e-59f66921b6d4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:36.589022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9fb1edff-faba-491f-8da3-9d5022f00d96 req-608358f7-0b8e-46ef-a425-19b5f53ce7ae service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:36.589499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9fb1edff-faba-491f-8da3-9d5022f00d96 req-608358f7-0b8e-46ef-a425-19b5f53ce7ae service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:36.591150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c58da442-953b-4f8e-8a7e-59f66921b6d4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:36.592116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c58da442-953b-4f8e-8a7e-59f66921b6d4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:36.594359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c58da442-953b-4f8e-8a7e-59f66921b6d4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:36.612129 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-9fb1edff-faba-491f-8da3-9d5022f00d96 req-608358f7-0b8e-46ef-a425-19b5f53ce7ae service nova] Creating event network-vif-unplugged:2c175fa6-c779-4716-992f-2b2d4e374e11 for instance 0e9f5029-1b4c-4764-87a8-e7df5950154a on n-h1-826529-8 Aug 03 02:22:36.638873 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-9fb1edff-faba-491f-8da3-9d5022f00d96 req-608358f7-0b8e-46ef-a425-19b5f53ce7ae service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106566 Aug 03 02:22:36.639535 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2782/5687] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:22:37.000523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a6e218c9-c29d-4a0c-a618-3fa8820f1d52 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:37.001562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a6e218c9-c29d-4a0c-a618-3fa8820f1d52 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:37.025713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6e218c9-c29d-4a0c-a618-3fa8820f1d52 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:37.027459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6e218c9-c29d-4a0c-a618-3fa8820f1d52 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:37.028773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6e218c9-c29d-4a0c-a618-3fa8820f1d52 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:37.029397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6e218c9-c29d-4a0c-a618-3fa8820f1d52 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:37.074559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c58da442-953b-4f8e-8a7e-59f66921b6d4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:37.091091 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c58da442-953b-4f8e-8a7e-59f66921b6d4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1526 microversion: 2.1 time: 0.531398 Aug 03 02:22:37.109369 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2906/5688] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:36 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1526 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:37.600127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a6e218c9-c29d-4a0c-a618-3fa8820f1d52 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:37.615539 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a6e218c9-c29d-4a0c-a618-3fa8820f1d52 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1692 microversion: 2.1 time: 0.618534 Aug 03 02:22:37.616166 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2783/5689] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:36 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1692 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:38.124024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-261c6176-be0e-4da0-bd64-59de63755612 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:38.125549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-261c6176-be0e-4da0-bd64-59de63755612 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:38.141439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-261c6176-be0e-4da0-bd64-59de63755612 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:38.142345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-261c6176-be0e-4da0-bd64-59de63755612 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:38.146865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-261c6176-be0e-4da0-bd64-59de63755612 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:38.152107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-261c6176-be0e-4da0-bd64-59de63755612 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:38.639860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f028e519-4c4d-4075-abd7-c5f23ccae88a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:38.641524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f028e519-4c4d-4075-abd7-c5f23ccae88a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:38.669180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f028e519-4c4d-4075-abd7-c5f23ccae88a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:38.672589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f028e519-4c4d-4075-abd7-c5f23ccae88a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:38.673918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f028e519-4c4d-4075-abd7-c5f23ccae88a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:38.677521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f028e519-4c4d-4075-abd7-c5f23ccae88a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:38.795078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-261c6176-be0e-4da0-bd64-59de63755612 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:38.811900 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-261c6176-be0e-4da0-bd64-59de63755612 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1526 microversion: 2.1 time: 0.691753 Aug 03 02:22:38.815460 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2907/5690] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:38 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1526 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:38.832288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-613c0090-fe3d-411c-b5a5-e93203b828b8 req-5f846474-85c0-477f-ab4e-420efa884706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e9f5029-1b4c-4764-87a8-e7df5950154a", "tag": "2c175fa6-c779-4716-992f-2b2d4e374e11"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:38.868029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-613c0090-fe3d-411c-b5a5-e93203b828b8 req-5f846474-85c0-477f-ab4e-420efa884706 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:38.875238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-613c0090-fe3d-411c-b5a5-e93203b828b8 req-5f846474-85c0-477f-ab4e-420efa884706 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:38.917727 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-613c0090-fe3d-411c-b5a5-e93203b828b8 req-5f846474-85c0-477f-ab4e-420efa884706 service nova] Creating event network-changed:2c175fa6-c779-4716-992f-2b2d4e374e11 for instance 0e9f5029-1b4c-4764-87a8-e7df5950154a on n-h1-826529-8 Aug 03 02:22:38.928053 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-613c0090-fe3d-411c-b5a5-e93203b828b8 req-5f846474-85c0-477f-ab4e-420efa884706 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110307 Aug 03 02:22:38.929607 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2908/5691] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:22:39.104038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f028e519-4c4d-4075-abd7-c5f23ccae88a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:39.113625 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f028e519-4c4d-4075-abd7-c5f23ccae88a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1692 microversion: 2.1 time: 0.477872 Aug 03 02:22:39.121386 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2784/5692] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:38 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1692 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:39.843598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bed0644c-706a-4477-a6c4-76990e46ed1c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:39.845814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bed0644c-706a-4477-a6c4-76990e46ed1c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:39.857694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bed0644c-706a-4477-a6c4-76990e46ed1c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:39.858460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bed0644c-706a-4477-a6c4-76990e46ed1c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:39.859585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bed0644c-706a-4477-a6c4-76990e46ed1c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:39.860202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bed0644c-706a-4477-a6c4-76990e46ed1c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:40.150507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a494b8b4-1fec-4e56-bfe5-be59f8a34b59 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:40.151159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a494b8b4-1fec-4e56-bfe5-be59f8a34b59 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:40.181076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a494b8b4-1fec-4e56-bfe5-be59f8a34b59 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:40.181548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a494b8b4-1fec-4e56-bfe5-be59f8a34b59 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:40.183620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a494b8b4-1fec-4e56-bfe5-be59f8a34b59 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:40.184272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a494b8b4-1fec-4e56-bfe5-be59f8a34b59 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:40.194074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bed0644c-706a-4477-a6c4-76990e46ed1c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:40.248669 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bed0644c-706a-4477-a6c4-76990e46ed1c tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1526 microversion: 2.1 time: 0.411775 Aug 03 02:22:40.257751 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2909/5693] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:39 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1526 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:40.491020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a494b8b4-1fec-4e56-bfe5-be59f8a34b59 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:40.499411 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a494b8b4-1fec-4e56-bfe5-be59f8a34b59 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1692 microversion: 2.1 time: 0.353118 Aug 03 02:22:40.500069 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2785/5694] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:40 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1692 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:41.282270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20ffe7a3-e10a-4bd9-ba5c-189ceea25104 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:41.282917 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-20ffe7a3-e10a-4bd9-ba5c-189ceea25104 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:41.303515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20ffe7a3-e10a-4bd9-ba5c-189ceea25104 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:41.306738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20ffe7a3-e10a-4bd9-ba5c-189ceea25104 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:41.307619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20ffe7a3-e10a-4bd9-ba5c-189ceea25104 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:41.308073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20ffe7a3-e10a-4bd9-ba5c-189ceea25104 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:41.526408 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-af543ea8-a867-4e2e-a2cc-abddbde85343 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:41.527097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-af543ea8-a867-4e2e-a2cc-abddbde85343 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:41.547106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af543ea8-a867-4e2e-a2cc-abddbde85343 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:41.547912 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af543ea8-a867-4e2e-a2cc-abddbde85343 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:41.548920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af543ea8-a867-4e2e-a2cc-abddbde85343 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:41.549539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af543ea8-a867-4e2e-a2cc-abddbde85343 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:41.857765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-20ffe7a3-e10a-4bd9-ba5c-189ceea25104 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:41.871505 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-20ffe7a3-e10a-4bd9-ba5c-189ceea25104 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1526 microversion: 2.1 time: 0.593405 Aug 03 02:22:41.872296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-af543ea8-a867-4e2e-a2cc-abddbde85343 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:41.872716 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2910/5695] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:41 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1526 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:41.888335 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-af543ea8-a867-4e2e-a2cc-abddbde85343 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1692 microversion: 2.1 time: 0.363591 Aug 03 02:22:41.902133 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2786/5696] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:41 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1692 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:42.894506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-18405935-10a7-4f01-b60f-2961201d4ec0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:42.895855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-18405935-10a7-4f01-b60f-2961201d4ec0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:42.907416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18405935-10a7-4f01-b60f-2961201d4ec0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:42.907416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18405935-10a7-4f01-b60f-2961201d4ec0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:42.907416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18405935-10a7-4f01-b60f-2961201d4ec0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:42.908435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18405935-10a7-4f01-b60f-2961201d4ec0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:42.917458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f2b9a2da-f6d2-4bf0-a9d1-920fd7d2d9fa tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:42.918286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f2b9a2da-f6d2-4bf0-a9d1-920fd7d2d9fa tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:42.959824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2b9a2da-f6d2-4bf0-a9d1-920fd7d2d9fa tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:42.960285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2b9a2da-f6d2-4bf0-a9d1-920fd7d2d9fa tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:42.961291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2b9a2da-f6d2-4bf0-a9d1-920fd7d2d9fa tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:42.962191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2b9a2da-f6d2-4bf0-a9d1-920fd7d2d9fa tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:43.320272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-18405935-10a7-4f01-b60f-2961201d4ec0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:43.330543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f2b9a2da-f6d2-4bf0-a9d1-920fd7d2d9fa tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:43.335280 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-18405935-10a7-4f01-b60f-2961201d4ec0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1526 microversion: 2.1 time: 0.445551 Aug 03 02:22:43.336572 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2911/5697] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:42 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1526 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:43.356632 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f2b9a2da-f6d2-4bf0-a9d1-920fd7d2d9fa tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1692 microversion: 2.1 time: 0.447734 Aug 03 02:22:43.357542 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2787/5698] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:42 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1692 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:44.371337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aefda550-8339-4fb4-913e-c2f0d2d4134b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:44.374138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-aefda550-8339-4fb4-913e-c2f0d2d4134b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:44.381043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1808f3af-4e69-4644-9fb9-b213f501fe78 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:44.382058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1808f3af-4e69-4644-9fb9-b213f501fe78 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:44.382436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aefda550-8339-4fb4-913e-c2f0d2d4134b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:44.383189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aefda550-8339-4fb4-913e-c2f0d2d4134b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:44.385234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aefda550-8339-4fb4-913e-c2f0d2d4134b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:44.387379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aefda550-8339-4fb4-913e-c2f0d2d4134b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:44.399791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1808f3af-4e69-4644-9fb9-b213f501fe78 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:44.400423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1808f3af-4e69-4644-9fb9-b213f501fe78 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:44.401404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1808f3af-4e69-4644-9fb9-b213f501fe78 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:44.404301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1808f3af-4e69-4644-9fb9-b213f501fe78 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:44.770764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-aefda550-8339-4fb4-913e-c2f0d2d4134b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:44.784604 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-aefda550-8339-4fb4-913e-c2f0d2d4134b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1508 microversion: 2.1 time: 0.425012 Aug 03 02:22:44.786328 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2912/5699] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:44 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1508 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:45.080920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1808f3af-4e69-4644-9fb9-b213f501fe78 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:45.097143 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1808f3af-4e69-4644-9fb9-b213f501fe78 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1692 microversion: 2.1 time: 0.720878 Aug 03 02:22:45.101586 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2788/5700] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:44 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1692 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:45.809889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-894813f4-b299-42bf-9990-44a204a4d80e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:45.812049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-894813f4-b299-42bf-9990-44a204a4d80e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:45.822126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-894813f4-b299-42bf-9990-44a204a4d80e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:45.822843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-894813f4-b299-42bf-9990-44a204a4d80e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:45.823871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-894813f4-b299-42bf-9990-44a204a4d80e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:45.825407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-894813f4-b299-42bf-9990-44a204a4d80e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:46.071725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-894813f4-b299-42bf-9990-44a204a4d80e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:46.079951 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-894813f4-b299-42bf-9990-44a204a4d80e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1508 microversion: 2.1 time: 0.276786 Aug 03 02:22:46.080858 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2913/5701] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:45 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1508 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:46.123347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-59eb0c4d-5862-47a6-b1c4-8834c4520d9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:46.124674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-59eb0c4d-5862-47a6-b1c4-8834c4520d9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:46.136865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59eb0c4d-5862-47a6-b1c4-8834c4520d9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:46.138387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59eb0c4d-5862-47a6-b1c4-8834c4520d9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:46.140015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59eb0c4d-5862-47a6-b1c4-8834c4520d9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:46.140683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-59eb0c4d-5862-47a6-b1c4-8834c4520d9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:46.371658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-59eb0c4d-5862-47a6-b1c4-8834c4520d9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:46.388656 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-59eb0c4d-5862-47a6-b1c4-8834c4520d9e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1692 microversion: 2.1 time: 0.268780 Aug 03 02:22:46.391494 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2789/5702] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:46 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1692 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:47.103936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f0a4f9ef-c689-49e3-9aa2-e8e797c364d7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:47.105712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f0a4f9ef-c689-49e3-9aa2-e8e797c364d7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:47.114213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f0a4f9ef-c689-49e3-9aa2-e8e797c364d7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:47.114677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f0a4f9ef-c689-49e3-9aa2-e8e797c364d7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:47.115517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f0a4f9ef-c689-49e3-9aa2-e8e797c364d7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:47.115964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f0a4f9ef-c689-49e3-9aa2-e8e797c364d7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:47.407311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-edf4b981-ebd5-4567-8368-7482a45d203f req-7894277c-a042-4624-b431-519ce7c6c40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4dcb4b-0945-49cb-b946-0fe75f053c37", "name": "network-vif-unplugged", "status": "completed", "tag": "3d7ec981-7632-4ce7-8a7a-4b8453f3e081"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:47.431273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-edf4b981-ebd5-4567-8368-7482a45d203f req-7894277c-a042-4624-b431-519ce7c6c40a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:47.433009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-edf4b981-ebd5-4567-8368-7482a45d203f req-7894277c-a042-4624-b431-519ce7c6c40a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:47.471405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.compute.server_external_events [req-edf4b981-ebd5-4567-8368-7482a45d203f req-7894277c-a042-4624-b431-519ce7c6c40a service nova] Unable to find a host for instance cc4dcb4b-0945-49cb-b946-0fe75f053c37. Dropping event network-vif-unplugged {{(pid=125942) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 02:22:47.474173 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-edf4b981-ebd5-4567-8368-7482a45d203f req-7894277c-a042-4624-b431-519ce7c6c40a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.072519 Aug 03 02:22:47.475610 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2790/5703] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 75 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 03 02:22:47.486297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6aaf0f6c-007c-4c97-8896-f0dc859d5e68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:47.488993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6aaf0f6c-007c-4c97-8896-f0dc859d5e68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:47.504230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6aaf0f6c-007c-4c97-8896-f0dc859d5e68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:47.505425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6aaf0f6c-007c-4c97-8896-f0dc859d5e68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:47.507644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6aaf0f6c-007c-4c97-8896-f0dc859d5e68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:47.508614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6aaf0f6c-007c-4c97-8896-f0dc859d5e68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:47.510671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f0a4f9ef-c689-49e3-9aa2-e8e797c364d7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:47.525416 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f0a4f9ef-c689-49e3-9aa2-e8e797c364d7 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1511 microversion: 2.1 time: 0.424180 Aug 03 02:22:47.526737 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2914/5704] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:47 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1511 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:47.549851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a3d1a771-f981-4cc3-8e13-726cc4999302 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:47.553876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a3d1a771-f981-4cc3-8e13-726cc4999302 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:47.572857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3d1a771-f981-4cc3-8e13-726cc4999302 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:47.573596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3d1a771-f981-4cc3-8e13-726cc4999302 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:47.574853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3d1a771-f981-4cc3-8e13-726cc4999302 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:47.576418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3d1a771-f981-4cc3-8e13-726cc4999302 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:48.501481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6aaf0f6c-007c-4c97-8896-f0dc859d5e68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:48.515848 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6aaf0f6c-007c-4c97-8896-f0dc859d5e68 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1692 microversion: 2.1 time: 1.037430 Aug 03 02:22:48.516051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a3d1a771-f981-4cc3-8e13-726cc4999302 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:48.520206 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2791/5705] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:47 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1692 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:48.527026 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a3d1a771-f981-4cc3-8e13-726cc4999302 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1451 microversion: 2.1 time: 0.981716 Aug 03 02:22:48.528393 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2915/5706] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:47 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1451 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:48.589683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fc71980d-1765-4ebc-8035-505699c11e8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:48.590553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fc71980d-1765-4ebc-8035-505699c11e8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:48.606408 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fc71980d-1765-4ebc-8035-505699c11e8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:48.607748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fc71980d-1765-4ebc-8035-505699c11e8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:48.608943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fc71980d-1765-4ebc-8035-505699c11e8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:48.609552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fc71980d-1765-4ebc-8035-505699c11e8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:48.649217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-fc71980d-1765-4ebc-8035-505699c11e8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lazy-loading 'flavor' on Instance uuid cc4dcb4b-0945-49cb-b946-0fe75f053c37 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:22:48.664970 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-fc71980d-1765-4ebc-8035-505699c11e8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Cannot 'shelve' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state shelved_offloaded Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fc71980d-1765-4ebc-8035-505699c11e8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action HTTP/1.1 Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 14 Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: {"shelve": {}} Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: exception: Cannot 'shelve' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state shelved_offloaded Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'cc4dcb4b-0945-49cb-b946-0fe75f053c37', 'body': {'shelve': {}}} Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 03 02:22:48.666794 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state shelved_offloaded Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state shelved_offloaded Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fc71980d-1765-4ebc-8035-505699c11e8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 409 to user: Cannot 'shelve' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state shelved_offloaded {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fc71980d-1765-4ebc-8035-505699c11e8b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action" status: 409 len: 155 microversion: 2.1 time: 0.083396 Aug 03 02:22:48.672445 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2792/5707] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:22:48 2022] POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action => generated 155 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:22:48.679992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-40158a32-0ce7-4a91-8727-0862ea2ce87b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:48.680604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-40158a32-0ce7-4a91-8727-0862ea2ce87b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:48.688655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40158a32-0ce7-4a91-8727-0862ea2ce87b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:48.689400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40158a32-0ce7-4a91-8727-0862ea2ce87b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:48.692165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40158a32-0ce7-4a91-8727-0862ea2ce87b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:48.692828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40158a32-0ce7-4a91-8727-0862ea2ce87b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:48.939462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-40158a32-0ce7-4a91-8727-0862ea2ce87b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125941) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 02:22:49.058635 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-40158a32-0ce7-4a91-8727-0862ea2ce87b tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action" status: 202 len: 0 microversion: 2.1 time: 0.383064 Aug 03 02:22:49.060491 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2916/5708] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:22:48 2022] POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:22:49.073678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-38ef7477-f0b1-4c13-845d-d2c99d33a5e5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:49.074824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-38ef7477-f0b1-4c13-845d-d2c99d33a5e5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:49.087315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38ef7477-f0b1-4c13-845d-d2c99d33a5e5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:49.088038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38ef7477-f0b1-4c13-845d-d2c99d33a5e5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:49.089579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38ef7477-f0b1-4c13-845d-d2c99d33a5e5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:49.090597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38ef7477-f0b1-4c13-845d-d2c99d33a5e5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:49.526717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-38ef7477-f0b1-4c13-845d-d2c99d33a5e5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:49.540057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3ea57cb0-fdfc-441b-90e6-ed806e067c9f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:49.540745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3ea57cb0-fdfc-441b-90e6-ed806e067c9f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:49.553217 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-38ef7477-f0b1-4c13-845d-d2c99d33a5e5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1459 microversion: 2.1 time: 0.484466 Aug 03 02:22:49.553430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ea57cb0-fdfc-441b-90e6-ed806e067c9f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:49.556006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ea57cb0-fdfc-441b-90e6-ed806e067c9f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:49.557951 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2793/5709] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:49 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1459 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:49.575019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ea57cb0-fdfc-441b-90e6-ed806e067c9f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:49.575514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ea57cb0-fdfc-441b-90e6-ed806e067c9f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:49.827560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3ea57cb0-fdfc-441b-90e6-ed806e067c9f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:49.845543 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3ea57cb0-fdfc-441b-90e6-ed806e067c9f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1682 microversion: 2.1 time: 0.310128 Aug 03 02:22:49.846460 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2917/5710] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:49 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1682 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:49.867980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ceded1bb-0240-4168-9af4-824fc511a95a tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:49.868880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ceded1bb-0240-4168-9af4-824fc511a95a tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:49.875760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ceded1bb-0240-4168-9af4-824fc511a95a tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:49.876525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ceded1bb-0240-4168-9af4-824fc511a95a tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:49.877548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ceded1bb-0240-4168-9af4-824fc511a95a tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:49.878862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ceded1bb-0240-4168-9af4-824fc511a95a tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:50.162755 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ceded1bb-0240-4168-9af4-824fc511a95a tempest-TestNetworkAdvancedServerOps-350525915 tempest-TestNetworkAdvancedServerOps-350525915-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1833 microversion: 2.1 time: 0.298630 Aug 03 02:22:50.164488 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2794/5711] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:49 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1833 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:50.196872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c40a1fb4-927d-430c-8622-a5837e1e395d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:50.197930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c40a1fb4-927d-430c-8622-a5837e1e395d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:50.205536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c40a1fb4-927d-430c-8622-a5837e1e395d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:50.207903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c40a1fb4-927d-430c-8622-a5837e1e395d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:50.209642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c40a1fb4-927d-430c-8622-a5837e1e395d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:50.210616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c40a1fb4-927d-430c-8622-a5837e1e395d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:50.480018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c40a1fb4-927d-430c-8622-a5837e1e395d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:50.490311 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c40a1fb4-927d-430c-8622-a5837e1e395d tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1682 microversion: 2.1 time: 0.302492 Aug 03 02:22:50.491345 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2918/5712] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:50 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1682 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:50.585856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c4b8af76-09d2-4b08-b67c-2dc8d5a7f7dc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:50.586512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c4b8af76-09d2-4b08-b67c-2dc8d5a7f7dc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:50.605475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4b8af76-09d2-4b08-b67c-2dc8d5a7f7dc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:50.606691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4b8af76-09d2-4b08-b67c-2dc8d5a7f7dc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:50.606892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4b8af76-09d2-4b08-b67c-2dc8d5a7f7dc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:50.607320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c4b8af76-09d2-4b08-b67c-2dc8d5a7f7dc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:50.649329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1c7d017d-7572-47de-8205-976020caff32 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:50.652827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1c7d017d-7572-47de-8205-976020caff32 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:50.661294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c7d017d-7572-47de-8205-976020caff32 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:50.662094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c7d017d-7572-47de-8205-976020caff32 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:50.663184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c7d017d-7572-47de-8205-976020caff32 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:50.663826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1c7d017d-7572-47de-8205-976020caff32 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:50.736415 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1c7d017d-7572-47de-8205-976020caff32 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a/action" status: 200 len: 38621 microversion: 2.1 time: 0.091123 Aug 03 02:22:50.738530 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2919/5713] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:22:50 2022] POST /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a/action => generated 38621 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 02:22:51.012941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c4b8af76-09d2-4b08-b67c-2dc8d5a7f7dc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:51.026464 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c4b8af76-09d2-4b08-b67c-2dc8d5a7f7dc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1459 microversion: 2.1 time: 0.451464 Aug 03 02:22:51.029011 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2795/5714] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:50 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1459 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:52.051927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ee0b55bc-cac9-46f4-a520-e93f652c5a20 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:52.053344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ee0b55bc-cac9-46f4-a520-e93f652c5a20 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:52.072266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee0b55bc-cac9-46f4-a520-e93f652c5a20 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:52.073524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee0b55bc-cac9-46f4-a520-e93f652c5a20 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:52.076092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee0b55bc-cac9-46f4-a520-e93f652c5a20 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:52.078253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee0b55bc-cac9-46f4-a520-e93f652c5a20 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:52.620800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ee0b55bc-cac9-46f4-a520-e93f652c5a20 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:52.630693 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ee0b55bc-cac9-46f4-a520-e93f652c5a20 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 0.584576 Aug 03 02:22:52.646943 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2920/5715] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:52 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:53.427645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c18aba79-15af-4560-8f29-a56411dc595a req-0ea66587-aaf5-481c-a119-b76d880a3080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e9f5029-1b4c-4764-87a8-e7df5950154a", "tag": "2c175fa6-c779-4716-992f-2b2d4e374e11"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:53.439425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-92e0658b-e372-46d4-9516-26e21acbbb05 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:53.445943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-92e0658b-e372-46d4-9516-26e21acbbb05 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:53.476201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92e0658b-e372-46d4-9516-26e21acbbb05 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:53.480073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92e0658b-e372-46d4-9516-26e21acbbb05 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:53.481270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92e0658b-e372-46d4-9516-26e21acbbb05 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:53.485583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c18aba79-15af-4560-8f29-a56411dc595a req-0ea66587-aaf5-481c-a119-b76d880a3080 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:53.486091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92e0658b-e372-46d4-9516-26e21acbbb05 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:53.517527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c18aba79-15af-4560-8f29-a56411dc595a req-0ea66587-aaf5-481c-a119-b76d880a3080 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:53.532661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:22:53.537588 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c18aba79-15af-4560-8f29-a56411dc595a req-0ea66587-aaf5-481c-a119-b76d880a3080 service nova] Creating event network-changed:2c175fa6-c779-4716-992f-2b2d4e374e11 for instance 0e9f5029-1b4c-4764-87a8-e7df5950154a on n-h2-826529-8 Aug 03 02:22:53.547329 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c18aba79-15af-4560-8f29-a56411dc595a req-0ea66587-aaf5-481c-a119-b76d880a3080 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121892 Aug 03 02:22:53.568654 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2921/5716] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:22:53.574813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:22:53.614070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-92e0658b-e372-46d4-9516-26e21acbbb05 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:22:53.663359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d406ac27-b97a-4fdb-b23c-18cd3d99b3ca tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:53.664230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d406ac27-b97a-4fdb-b23c-18cd3d99b3ca tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:53.702478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d406ac27-b97a-4fdb-b23c-18cd3d99b3ca tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:53.703329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d406ac27-b97a-4fdb-b23c-18cd3d99b3ca tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:53.732074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d406ac27-b97a-4fdb-b23c-18cd3d99b3ca tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:53.735744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d406ac27-b97a-4fdb-b23c-18cd3d99b3ca tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:53.832735 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-92e0658b-e372-46d4-9516-26e21acbbb05 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 204 len: 0 microversion: 2.1 time: 0.417486 Aug 03 02:22:53.833925 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2796/5717] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:22:53 2022] DELETE /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:22:53.843256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-688ce68a-582e-4bba-9194-16fd669fc822 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:53.844711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-688ce68a-582e-4bba-9194-16fd669fc822 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:53.856512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-688ce68a-582e-4bba-9194-16fd669fc822 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:53.864957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-688ce68a-582e-4bba-9194-16fd669fc822 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:53.866144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-688ce68a-582e-4bba-9194-16fd669fc822 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:53.866774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-688ce68a-582e-4bba-9194-16fd669fc822 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:54.719967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d406ac27-b97a-4fdb-b23c-18cd3d99b3ca tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:54.734454 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d406ac27-b97a-4fdb-b23c-18cd3d99b3ca tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 1.073855 Aug 03 02:22:54.739898 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2922/5718] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:53 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:54.787396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-688ce68a-582e-4bba-9194-16fd669fc822 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:54.796730 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-688ce68a-582e-4bba-9194-16fd669fc822 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1688 microversion: 2.1 time: 0.958128 Aug 03 02:22:54.804502 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2797/5719] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:53 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1688 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:55.762773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a1f84a7e-65c8-409f-bbd0-fe5ff2173f15 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:55.766108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a1f84a7e-65c8-409f-bbd0-fe5ff2173f15 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:55.776120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a1f84a7e-65c8-409f-bbd0-fe5ff2173f15 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:55.777025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a1f84a7e-65c8-409f-bbd0-fe5ff2173f15 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:55.779140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a1f84a7e-65c8-409f-bbd0-fe5ff2173f15 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:55.779859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a1f84a7e-65c8-409f-bbd0-fe5ff2173f15 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:55.836246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a89daac5-af55-4829-9a2d-88424b4d67f8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:55.840171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a89daac5-af55-4829-9a2d-88424b4d67f8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:55.876251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a89daac5-af55-4829-9a2d-88424b4d67f8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:55.880229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a89daac5-af55-4829-9a2d-88424b4d67f8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:55.886015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a89daac5-af55-4829-9a2d-88424b4d67f8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:55.888566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a89daac5-af55-4829-9a2d-88424b4d67f8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:57.184035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a89daac5-af55-4829-9a2d-88424b4d67f8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:57.205952 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a89daac5-af55-4829-9a2d-88424b4d67f8 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1688 microversion: 2.1 time: 1.376365 Aug 03 02:22:57.207403 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2798/5720] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:55 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1688 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:57.212923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-708c9bbb-ce73-43f7-bad9-eb544c25c2ed tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:57.215202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-708c9bbb-ce73-43f7-bad9-eb544c25c2ed tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:57.229321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-708c9bbb-ce73-43f7-bad9-eb544c25c2ed tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:57.230615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-708c9bbb-ce73-43f7-bad9-eb544c25c2ed tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:57.232031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-708c9bbb-ce73-43f7-bad9-eb544c25c2ed tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:57.234598 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-708c9bbb-ce73-43f7-bad9-eb544c25c2ed tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:57.312575 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-708c9bbb-ce73-43f7-bad9-eb544c25c2ed tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103871 Aug 03 02:22:57.318762 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2799/5721] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:22:57 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:22:57.430743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a1f84a7e-65c8-409f-bbd0-fe5ff2173f15 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:57.458289 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a1f84a7e-65c8-409f-bbd0-fe5ff2173f15 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 1.698966 Aug 03 02:22:57.461210 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2923/5722] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:55 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:22:57.488935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-51cc6092-3839-44d1-9ffc-8f683395d85c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:57.489521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-51cc6092-3839-44d1-9ffc-8f683395d85c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:57.496634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51cc6092-3839-44d1-9ffc-8f683395d85c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:57.497325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51cc6092-3839-44d1-9ffc-8f683395d85c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:57.498299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51cc6092-3839-44d1-9ffc-8f683395d85c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:57.511114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51cc6092-3839-44d1-9ffc-8f683395d85c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:57.580537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-51cc6092-3839-44d1-9ffc-8f683395d85c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:22:57.790184 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-51cc6092-3839-44d1-9ffc-8f683395d85c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "DELETE /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 204 len: 0 microversion: 2.1 time: 0.305882 Aug 03 02:22:57.792235 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2800/5723] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:22:57 2022] DELETE /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:22:57.792392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-24275e47-25da-43ab-8b96-fdb713c39e1c req-2b7bd4a2-30e1-4c3f-a2ab-7506841c0cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e9f5029-1b4c-4764-87a8-e7df5950154a", "name": "network-vif-deleted", "tag": "2c175fa6-c779-4716-992f-2b2d4e374e11"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:22:57.806845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-24275e47-25da-43ab-8b96-fdb713c39e1c req-2b7bd4a2-30e1-4c3f-a2ab-7506841c0cb2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:57.807662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-24275e47-25da-43ab-8b96-fdb713c39e1c req-2b7bd4a2-30e1-4c3f-a2ab-7506841c0cb2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:57.824637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-377784d1-885e-4ce3-b23c-06014d93256b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:57.826134 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-24275e47-25da-43ab-8b96-fdb713c39e1c req-2b7bd4a2-30e1-4c3f-a2ab-7506841c0cb2 service nova] Creating event network-vif-deleted:2c175fa6-c779-4716-992f-2b2d4e374e11 for instance 0e9f5029-1b4c-4764-87a8-e7df5950154a on n-h2-826529-8 Aug 03 02:22:57.828331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-377784d1-885e-4ce3-b23c-06014d93256b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:57.833293 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-24275e47-25da-43ab-8b96-fdb713c39e1c req-2b7bd4a2-30e1-4c3f-a2ab-7506841c0cb2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044896 Aug 03 02:22:57.834384 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2924/5724] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:22:57.842034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-377784d1-885e-4ce3-b23c-06014d93256b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:57.844878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-377784d1-885e-4ce3-b23c-06014d93256b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:57.849983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-377784d1-885e-4ce3-b23c-06014d93256b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:57.852655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-377784d1-885e-4ce3-b23c-06014d93256b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:58.248017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7d123bff-df4b-4e71-a785-f465d5f1bcc9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:58.257654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7d123bff-df4b-4e71-a785-f465d5f1bcc9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:58.285935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d123bff-df4b-4e71-a785-f465d5f1bcc9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:58.287142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d123bff-df4b-4e71-a785-f465d5f1bcc9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:58.290762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d123bff-df4b-4e71-a785-f465d5f1bcc9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:58.293601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7d123bff-df4b-4e71-a785-f465d5f1bcc9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:58.307332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-377784d1-885e-4ce3-b23c-06014d93256b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:58.317388 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-377784d1-885e-4ce3-b23c-06014d93256b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1673 microversion: 2.1 time: 0.518733 Aug 03 02:22:58.318270 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2801/5725] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:57 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1673 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:58.474083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7d123bff-df4b-4e71-a785-f465d5f1bcc9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:58.490335 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7d123bff-df4b-4e71-a785-f465d5f1bcc9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1621 microversion: 2.1 time: 0.257495 Aug 03 02:22:58.491169 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2925/5726] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:58 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1621 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:58.511948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-71a4abe4-d8ae-4fb9-95cd-e3735f1c8b99 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:58.512682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-71a4abe4-d8ae-4fb9-95cd-e3735f1c8b99 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:58.525827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71a4abe4-d8ae-4fb9-95cd-e3735f1c8b99 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:58.526586 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71a4abe4-d8ae-4fb9-95cd-e3735f1c8b99 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:58.527998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71a4abe4-d8ae-4fb9-95cd-e3735f1c8b99 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:58.528629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71a4abe4-d8ae-4fb9-95cd-e3735f1c8b99 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:58.825127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-71a4abe4-d8ae-4fb9-95cd-e3735f1c8b99 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:58.841569 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-71a4abe4-d8ae-4fb9-95cd-e3735f1c8b99 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 0.334124 Aug 03 02:22:58.843583 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2802/5727] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:58 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:59.342859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-63bd689f-2bca-4c24-9419-3917b77e8526 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:59.343440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-63bd689f-2bca-4c24-9419-3917b77e8526 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:59.356974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63bd689f-2bca-4c24-9419-3917b77e8526 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:59.357441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63bd689f-2bca-4c24-9419-3917b77e8526 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:59.358292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63bd689f-2bca-4c24-9419-3917b77e8526 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:59.361865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63bd689f-2bca-4c24-9419-3917b77e8526 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:59.520317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d9dc4254-746e-44c7-aae7-bbf8fd044a3c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:59.521040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d9dc4254-746e-44c7-aae7-bbf8fd044a3c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:59.561703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9dc4254-746e-44c7-aae7-bbf8fd044a3c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:59.562171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9dc4254-746e-44c7-aae7-bbf8fd044a3c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:59.576723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9dc4254-746e-44c7-aae7-bbf8fd044a3c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:59.577202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d9dc4254-746e-44c7-aae7-bbf8fd044a3c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:59.660411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-63bd689f-2bca-4c24-9419-3917b77e8526 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:59.692236 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-63bd689f-2bca-4c24-9419-3917b77e8526 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1673 microversion: 2.1 time: 0.354118 Aug 03 02:22:59.697504 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2926/5728] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:59 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1673 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:59.807342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d9dc4254-746e-44c7-aae7-bbf8fd044a3c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:22:59.822412 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d9dc4254-746e-44c7-aae7-bbf8fd044a3c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1621 microversion: 2.1 time: 0.309859 Aug 03 02:22:59.823496 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2803/5729] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:59 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1621 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:22:59.871055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cfceacc7-01db-41cc-a70e-7108286ff5f5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:22:59.871841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cfceacc7-01db-41cc-a70e-7108286ff5f5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:22:59.889453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cfceacc7-01db-41cc-a70e-7108286ff5f5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:59.891575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cfceacc7-01db-41cc-a70e-7108286ff5f5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:22:59.892875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cfceacc7-01db-41cc-a70e-7108286ff5f5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:22:59.896551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cfceacc7-01db-41cc-a70e-7108286ff5f5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:00.336103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cfceacc7-01db-41cc-a70e-7108286ff5f5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:00.365960 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cfceacc7-01db-41cc-a70e-7108286ff5f5 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 0.504923 Aug 03 02:23:00.367528 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2927/5730] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:22:59 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:00.720856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-df8bdc13-e233-4c2e-a7d3-8c22fe05d522 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:00.723545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-df8bdc13-e233-4c2e-a7d3-8c22fe05d522 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:00.745152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df8bdc13-e233-4c2e-a7d3-8c22fe05d522 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:00.747283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df8bdc13-e233-4c2e-a7d3-8c22fe05d522 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:00.751594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df8bdc13-e233-4c2e-a7d3-8c22fe05d522 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:00.753986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df8bdc13-e233-4c2e-a7d3-8c22fe05d522 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:00.849667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-58090e12-f3a0-4783-bc16-ce0f7e1a3737 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:00.850468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-58090e12-f3a0-4783-bc16-ce0f7e1a3737 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:00.866003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58090e12-f3a0-4783-bc16-ce0f7e1a3737 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:00.871399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58090e12-f3a0-4783-bc16-ce0f7e1a3737 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:00.872750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58090e12-f3a0-4783-bc16-ce0f7e1a3737 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:00.876094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58090e12-f3a0-4783-bc16-ce0f7e1a3737 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:01.076847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-58090e12-f3a0-4783-bc16-ce0f7e1a3737 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:01.090667 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-58090e12-f3a0-4783-bc16-ce0f7e1a3737 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1503 microversion: 2.1 time: 0.246036 Aug 03 02:23:01.092579 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2928/5731] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:00 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1503 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:01.242357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-df8bdc13-e233-4c2e-a7d3-8c22fe05d522 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:01.255037 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-df8bdc13-e233-4c2e-a7d3-8c22fe05d522 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1673 microversion: 2.1 time: 0.540609 Aug 03 02:23:01.257317 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2804/5732] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:00 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1673 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:01.391550 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ab168294-7cc9-4420-a8fa-0dea48c3ee27 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:01.392396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ab168294-7cc9-4420-a8fa-0dea48c3ee27 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:01.418122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab168294-7cc9-4420-a8fa-0dea48c3ee27 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:01.422244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab168294-7cc9-4420-a8fa-0dea48c3ee27 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:01.423765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab168294-7cc9-4420-a8fa-0dea48c3ee27 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:01.424306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ab168294-7cc9-4420-a8fa-0dea48c3ee27 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:01.736946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ab168294-7cc9-4420-a8fa-0dea48c3ee27 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:01.754686 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ab168294-7cc9-4420-a8fa-0dea48c3ee27 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 0.368028 Aug 03 02:23:01.755402 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2929/5733] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:01 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:02.114559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c13c81a3-a374-4066-adbc-10b493fb9179 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:02.115307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c13c81a3-a374-4066-adbc-10b493fb9179 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:02.167369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c13c81a3-a374-4066-adbc-10b493fb9179 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:02.168388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c13c81a3-a374-4066-adbc-10b493fb9179 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:02.169462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c13c81a3-a374-4066-adbc-10b493fb9179 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:02.170110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c13c81a3-a374-4066-adbc-10b493fb9179 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:02.288982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-52eac72b-07b6-4933-83ea-e2f35f6bf21f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:02.300256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-52eac72b-07b6-4933-83ea-e2f35f6bf21f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:02.305705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c13c81a3-a374-4066-adbc-10b493fb9179 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:02.306690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c13c81a3-a374-4066-adbc-10b493fb9179 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:02.313312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-c13c81a3-a374-4066-adbc-10b493fb9179 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lazy-loading 'fault' on Instance uuid 0e9f5029-1b4c-4764-87a8-e7df5950154a {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:23:02.322628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52eac72b-07b6-4933-83ea-e2f35f6bf21f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:02.333370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52eac72b-07b6-4933-83ea-e2f35f6bf21f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:02.334613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52eac72b-07b6-4933-83ea-e2f35f6bf21f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:02.338922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52eac72b-07b6-4933-83ea-e2f35f6bf21f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:02.461398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c13c81a3-a374-4066-adbc-10b493fb9179 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:02.472290 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c13c81a3-a374-4066-adbc-10b493fb9179 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1357 microversion: 2.1 time: 0.361955 Aug 03 02:23:02.479902 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2805/5734] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:02 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1357 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:02.779012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-73fa07c0-495d-44a0-aefd-7e4437459026 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:02.779687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-73fa07c0-495d-44a0-aefd-7e4437459026 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:02.792878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73fa07c0-495d-44a0-aefd-7e4437459026 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:02.793342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73fa07c0-495d-44a0-aefd-7e4437459026 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:02.794150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73fa07c0-495d-44a0-aefd-7e4437459026 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:02.794601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73fa07c0-495d-44a0-aefd-7e4437459026 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:02.797660 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-52eac72b-07b6-4933-83ea-e2f35f6bf21f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:02.806966 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-52eac72b-07b6-4933-83ea-e2f35f6bf21f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1673 microversion: 2.1 time: 0.529624 Aug 03 02:23:02.807586 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2930/5735] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:02 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1673 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:03.215988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-73fa07c0-495d-44a0-aefd-7e4437459026 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:03.241068 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-73fa07c0-495d-44a0-aefd-7e4437459026 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 0.466730 Aug 03 02:23:03.246262 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2806/5736] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:02 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:03.506548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e27bda53-38a4-4c8d-94fd-a4816b0c2e7c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:03.512076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e27bda53-38a4-4c8d-94fd-a4816b0c2e7c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:03.542377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e27bda53-38a4-4c8d-94fd-a4816b0c2e7c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:03.543295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e27bda53-38a4-4c8d-94fd-a4816b0c2e7c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:03.544341 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e27bda53-38a4-4c8d-94fd-a4816b0c2e7c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:03.545009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e27bda53-38a4-4c8d-94fd-a4816b0c2e7c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:03.734357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e27bda53-38a4-4c8d-94fd-a4816b0c2e7c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:03.734731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e27bda53-38a4-4c8d-94fd-a4816b0c2e7c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:03.735238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-e27bda53-38a4-4c8d-94fd-a4816b0c2e7c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lazy-loading 'fault' on Instance uuid 0e9f5029-1b4c-4764-87a8-e7df5950154a {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:23:03.834565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4ca26e97-0140-4990-af85-b6d7a2d3eb13 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:03.844704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4ca26e97-0140-4990-af85-b6d7a2d3eb13 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:03.889199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ca26e97-0140-4990-af85-b6d7a2d3eb13 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:03.890358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ca26e97-0140-4990-af85-b6d7a2d3eb13 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:03.896901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ca26e97-0140-4990-af85-b6d7a2d3eb13 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:03.898016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ca26e97-0140-4990-af85-b6d7a2d3eb13 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:04.195134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e27bda53-38a4-4c8d-94fd-a4816b0c2e7c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:04.213677 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e27bda53-38a4-4c8d-94fd-a4816b0c2e7c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 200 len: 1357 microversion: 2.1 time: 0.712467 Aug 03 02:23:04.221916 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2931/5737] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:03 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 1357 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:04.268875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-991d40bf-dd47-4a58-90de-20b20f19e494 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:04.271387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-991d40bf-dd47-4a58-90de-20b20f19e494 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:04.283272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-991d40bf-dd47-4a58-90de-20b20f19e494 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:04.285844 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-991d40bf-dd47-4a58-90de-20b20f19e494 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:04.286944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-991d40bf-dd47-4a58-90de-20b20f19e494 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:04.287679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-991d40bf-dd47-4a58-90de-20b20f19e494 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:04.971661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4ca26e97-0140-4990-af85-b6d7a2d3eb13 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:04.981562 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4ca26e97-0140-4990-af85-b6d7a2d3eb13 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1673 microversion: 2.1 time: 1.155076 Aug 03 02:23:05.006345 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2807/5738] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:03 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1673 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:05.120084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-991d40bf-dd47-4a58-90de-20b20f19e494 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:05.129747 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-991d40bf-dd47-4a58-90de-20b20f19e494 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 0.865565 Aug 03 02:23:05.134026 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2932/5739] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:04 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:23:05.244470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3efa26e9-871d-4368-b864-8aa6124c7cf4 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:05.245785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3efa26e9-871d-4368-b864-8aa6124c7cf4 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 0e9f5029-1b4c-4764-87a8-e7df5950154a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:05.256802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:05.262461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3efa26e9-871d-4368-b864-8aa6124c7cf4 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:05.264865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3efa26e9-871d-4368-b864-8aa6124c7cf4 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:05.269902 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3efa26e9-871d-4368-b864-8aa6124c7cf4 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:05.270707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3efa26e9-871d-4368-b864-8aa6124c7cf4 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:05.328929 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-3efa26e9-871d-4368-b864-8aa6124c7cf4 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] HTTP exception thrown: Instance 0e9f5029-1b4c-4764-87a8-e7df5950154a could not be found. Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3efa26e9-871d-4368-b864-8aa6124c7cf4 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Request method failure captured: Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a HTTP/1.1 Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6doi9mhvS1ouiIhMAao9U5FMCKoCDK2Svh-rN38K6LLUL5Jz46cjohY4VinMjw8nEITcvufUHSTuoEsFDcuvi9KweDemmvXVR2Y50H-XN3XOCzqBlRtzMafBlbAgN_igQZKGETPhyc3zhVKXRP1svhEgFnKivuflt3X2jd-ilbL3xBI Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: f6179959e78b438cb68680f694190a8c Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-160243142 Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f6179959e78b438cb68680f694190a8c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6179959e78b438cb68680f694190a8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f6179959e78b438cb68680f694190a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6179959e78b438cb68680f694190a8c"}]}] Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestNetworkAdvancedServerOps-160243142 Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: f6179959e78b438cb68680f694190a8c Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-160243142 Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestNetworkAdvancedServerOps-160243142-project Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: adca21bc340d440e91e4d856a625cd3a Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestNetworkAdvancedServerOps-160243142-project Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 0e9f5029-1b4c-4764-87a8-e7df5950154a could not be found. Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '0e9f5029-1b4c-4764-87a8-e7df5950154a'} Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e9f5029-1b4c-4764-87a8-e7df5950154a could not be found. Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e9f5029-1b4c-4764-87a8-e7df5950154a could not be found. Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:05.369110 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:05.374678 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:05.374678 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:05.374678 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:05.374678 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:05.374678 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:23:05.374678 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:23:05.374678 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e9f5029-1b4c-4764-87a8-e7df5950154a could not be found. Aug 03 02:23:05.374678 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:05.381377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3efa26e9-871d-4368-b864-8aa6124c7cf4 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Returning 404 to user: Instance 0e9f5029-1b4c-4764-87a8-e7df5950154a could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:23:05.382739 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3efa26e9-871d-4368-b864-8aa6124c7cf4 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a" status: 404 len: 111 microversion: 2.1 time: 0.144120 Aug 03 02:23:05.383665 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2808/5740] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:05 2022] GET /compute/v2.1/servers/0e9f5029-1b4c-4764-87a8-e7df5950154a => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:23:06.020091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-919149ef-44a4-4dc7-b8fb-055926eefc97 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:06.021185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-919149ef-44a4-4dc7-b8fb-055926eefc97 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:06.027467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:06.055604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-919149ef-44a4-4dc7-b8fb-055926eefc97 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:06.061140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-919149ef-44a4-4dc7-b8fb-055926eefc97 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:06.062353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-919149ef-44a4-4dc7-b8fb-055926eefc97 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:06.064322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-919149ef-44a4-4dc7-b8fb-055926eefc97 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:06.154137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bf971643-f727-447d-b89c-8d25f49c135a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:06.154797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bf971643-f727-447d-b89c-8d25f49c135a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:06.192730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf971643-f727-447d-b89c-8d25f49c135a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:06.193310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf971643-f727-447d-b89c-8d25f49c135a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:06.194187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf971643-f727-447d-b89c-8d25f49c135a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:06.194693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf971643-f727-447d-b89c-8d25f49c135a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:06.317462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-919149ef-44a4-4dc7-b8fb-055926eefc97 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:06.332037 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-919149ef-44a4-4dc7-b8fb-055926eefc97 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1605 microversion: 2.1 time: 0.322002 Aug 03 02:23:06.348259 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2933/5741] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:06 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1605 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:07.038970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-65fb713b-0a4a-4181-889c-8d456cbcae75 req-a723da1d-fcf3-45cc-85ac-b9cde1f30dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583e3553-3343-4c37-b5f9-df334dd4f27e", "name": "network-vif-deleted", "tag": "bf635720-a428-419f-81ec-7da68ab65057"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:07.091334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-65fb713b-0a4a-4181-889c-8d456cbcae75 req-a723da1d-fcf3-45cc-85ac-b9cde1f30dad service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:07.091936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-65fb713b-0a4a-4181-889c-8d456cbcae75 req-a723da1d-fcf3-45cc-85ac-b9cde1f30dad service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:07.149965 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-65fb713b-0a4a-4181-889c-8d456cbcae75 req-a723da1d-fcf3-45cc-85ac-b9cde1f30dad service nova] Creating event network-vif-deleted:bf635720-a428-419f-81ec-7da68ab65057 for instance 583e3553-3343-4c37-b5f9-df334dd4f27e on n-h2-826529-8 Aug 03 02:23:07.155870 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-65fb713b-0a4a-4181-889c-8d456cbcae75 req-a723da1d-fcf3-45cc-85ac-b9cde1f30dad service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124754 Aug 03 02:23:07.156880 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2934/5742] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:23:07.221774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bf971643-f727-447d-b89c-8d25f49c135a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:07.231481 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bf971643-f727-447d-b89c-8d25f49c135a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 1.081662 Aug 03 02:23:07.238291 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2809/5743] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:06 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:23:07.363077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2bcc07bf-e9cb-40ad-8dae-ed4ac259e5c5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:07.364614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2bcc07bf-e9cb-40ad-8dae-ed4ac259e5c5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:07.376387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2bcc07bf-e9cb-40ad-8dae-ed4ac259e5c5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:07.380798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2bcc07bf-e9cb-40ad-8dae-ed4ac259e5c5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:07.383771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2bcc07bf-e9cb-40ad-8dae-ed4ac259e5c5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:07.384355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2bcc07bf-e9cb-40ad-8dae-ed4ac259e5c5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:07.592446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2bcc07bf-e9cb-40ad-8dae-ed4ac259e5c5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:07.601786 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2bcc07bf-e9cb-40ad-8dae-ed4ac259e5c5 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1605 microversion: 2.1 time: 0.244021 Aug 03 02:23:07.624611 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2935/5744] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:07 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1605 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:08.255527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1a6a52e1-e9b2-46b7-81ff-e649fafbe61a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:08.256280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1a6a52e1-e9b2-46b7-81ff-e649fafbe61a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:08.278124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a6a52e1-e9b2-46b7-81ff-e649fafbe61a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:08.281262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a6a52e1-e9b2-46b7-81ff-e649fafbe61a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:08.283363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a6a52e1-e9b2-46b7-81ff-e649fafbe61a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:08.287445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a6a52e1-e9b2-46b7-81ff-e649fafbe61a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:08.307736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:08.633461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-95e56a42-d6c6-4aa2-8a38-d0bb427e9b73 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:08.634095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-95e56a42-d6c6-4aa2-8a38-d0bb427e9b73 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:08.649949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95e56a42-d6c6-4aa2-8a38-d0bb427e9b73 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:08.659872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95e56a42-d6c6-4aa2-8a38-d0bb427e9b73 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:08.663469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95e56a42-d6c6-4aa2-8a38-d0bb427e9b73 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:08.664091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95e56a42-d6c6-4aa2-8a38-d0bb427e9b73 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:09.017693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-95e56a42-d6c6-4aa2-8a38-d0bb427e9b73 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:09.033043 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-95e56a42-d6c6-4aa2-8a38-d0bb427e9b73 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1605 microversion: 2.1 time: 0.403707 Aug 03 02:23:09.043280 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2936/5745] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:08 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1605 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:09.866875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1a6a52e1-e9b2-46b7-81ff-e649fafbe61a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:09.882282 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1a6a52e1-e9b2-46b7-81ff-e649fafbe61a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 1.628273 Aug 03 02:23:09.883575 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2810/5746] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:08 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:10.066124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-503bbfe8-f431-4c3e-9920-c054b03ae8b2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:10.067701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-503bbfe8-f431-4c3e-9920-c054b03ae8b2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:10.076161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-503bbfe8-f431-4c3e-9920-c054b03ae8b2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:10.077007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-503bbfe8-f431-4c3e-9920-c054b03ae8b2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:10.078142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-503bbfe8-f431-4c3e-9920-c054b03ae8b2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:10.078818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-503bbfe8-f431-4c3e-9920-c054b03ae8b2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:10.130230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-503bbfe8-f431-4c3e-9920-c054b03ae8b2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:10.131175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-503bbfe8-f431-4c3e-9920-c054b03ae8b2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:10.131877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-503bbfe8-f431-4c3e-9920-c054b03ae8b2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lazy-loading 'fault' on Instance uuid 583e3553-3343-4c37-b5f9-df334dd4f27e {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:23:10.234037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-503bbfe8-f431-4c3e-9920-c054b03ae8b2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:10.243801 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-503bbfe8-f431-4c3e-9920-c054b03ae8b2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 200 len: 1328 microversion: 2.1 time: 0.183207 Aug 03 02:23:10.246818 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2937/5747] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:10 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 1328 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:10.912378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-19540ecb-c1be-414a-bba6-c9944ef98522 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:10.914406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-19540ecb-c1be-414a-bba6-c9944ef98522 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:10.925543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19540ecb-c1be-414a-bba6-c9944ef98522 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:10.927008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19540ecb-c1be-414a-bba6-c9944ef98522 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:10.928763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19540ecb-c1be-414a-bba6-c9944ef98522 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:10.931257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19540ecb-c1be-414a-bba6-c9944ef98522 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:11.270773 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-709ecdc6-9bba-40fe-9325-6bf71fdeb651 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:11.271369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-709ecdc6-9bba-40fe-9325-6bf71fdeb651 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:11.286707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-709ecdc6-9bba-40fe-9325-6bf71fdeb651 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:11.287202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-709ecdc6-9bba-40fe-9325-6bf71fdeb651 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:11.292024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-709ecdc6-9bba-40fe-9325-6bf71fdeb651 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:11.294570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-709ecdc6-9bba-40fe-9325-6bf71fdeb651 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:11.332302 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-709ecdc6-9bba-40fe-9325-6bf71fdeb651 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] HTTP exception thrown: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-709ecdc6-9bba-40fe-9325-6bf71fdeb651 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Request method failure captured: Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e HTTP/1.1 Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dsOtt-P5o27JOO1HyMtn7d-xLgtlKyRYECf6VrMCjdxQXHEAccmuFXvFTHAnsSxH47VhD74QrzmlqU2DKX_-tlMOBLtd9IdH47lnAqLL_0CmrNrYpa9TEdfrxu6UGuk7EgfNF4O4HqwnJRdDpEfyQ9gnmCxxw4rQw35LSQcAjvoBeY Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 8c9cb361c2db46cd80e1d83c2706d91a Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c9cb361c2db46cd80e1d83c2706d91a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c9cb361c2db46cd80e1d83c2706d91a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c9cb361c2db46cd80e1d83c2706d91a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c9cb361c2db46cd80e1d83c2706d91a"}]}] Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 8c9cb361c2db46cd80e1d83c2706d91a Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeTestJSON-920965676-project Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4ab11af44ce14dbabafaf0136a3f2847 Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeTestJSON-920965676-project Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '583e3553-3343-4c37-b5f9-df334dd4f27e'} Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:11.337007 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:11.341972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:11.341972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:11.341972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:11.341972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:23:11.341972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:23:11.341972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. Aug 03 02:23:11.341972 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:11.341972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-709ecdc6-9bba-40fe-9325-6bf71fdeb651 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Returning 404 to user: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:23:11.341972 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-709ecdc6-9bba-40fe-9325-6bf71fdeb651 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 404 len: 111 microversion: 2.1 time: 0.074147 Aug 03 02:23:11.351302 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2938/5748] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:11 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:23:11.357838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c55bc732-3b9a-4a73-98da-f504a66f7c20 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '.version_select at 0x7f5b12480ee0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:11.405984 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c55bc732-3b9a-4a73-98da-f504a66f7c20 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557350195" status: 202 len: 0 microversion: 2.1 time: 0.053060 Aug 03 02:23:11.411509 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2939/5749] 10.222.0.67 () {58 vars in 1221 bytes} [Wed Aug 3 02:23:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557350195 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:23:11.684160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-19540ecb-c1be-414a-bba6-c9944ef98522 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:11.705061 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-19540ecb-c1be-414a-bba6-c9944ef98522 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 0.802237 Aug 03 02:23:11.707468 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2811/5750] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:10 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:12.728375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d1a0460d-8a48-4667-9c0f-2490591cf41d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:12.728993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d1a0460d-8a48-4667-9c0f-2490591cf41d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:12.741867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1a0460d-8a48-4667-9c0f-2490591cf41d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:12.742328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1a0460d-8a48-4667-9c0f-2490591cf41d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:12.743159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1a0460d-8a48-4667-9c0f-2490591cf41d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:12.743600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1a0460d-8a48-4667-9c0f-2490591cf41d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:12.938579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c980d687-56a9-480e-ab93-14dc51b7df5b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Action: 'create', calling method: .version_select at 0x7f5b135a4b80>, body: {"keypair": {"name": "tempest-keypair-202971633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJt3v5BMzh3TEPC8cVAVgwrd8qzz+B/W4cfdQok5EwkXnxWKrgXMSm+sHWBKUK5EDXbR2ohSyrerDtwDrJlx5/M33ts8StKLWiGxtaVXfU44bxsxID4ISxcFjyCR3YnfuA=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:12.972406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-c980d687-56a9-480e-ab93-14dc51b7df5b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Getting quotas for project 8c9cb361c2db46cd80e1d83c2706d91a. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:23:12.991781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-c980d687-56a9-480e-ab93-14dc51b7df5b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Getting quotas for user 4ab11af44ce14dbabafaf0136a3f2847 and project 8c9cb361c2db46cd80e1d83c2706d91a. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:23:13.022729 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c980d687-56a9-480e-ab93-14dc51b7df5b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.090673 Aug 03 02:23:13.023995 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2812/5751] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:23:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:23:13.089450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d1a0460d-8a48-4667-9c0f-2490591cf41d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:13.102383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:13.111510 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d1a0460d-8a48-4667-9c0f-2490591cf41d tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 0.386888 Aug 03 02:23:13.121558 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2940/5752] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:12 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:13.651690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7080a9a3-0164-4595-9411-894b6b7194c3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '.version_select at 0x7f5b1317e5e0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:13.691316 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7080a9a3-0164-4595-9411-894b6b7194c3 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1075978888" status: 202 len: 0 microversion: 2.1 time: 0.050328 Aug 03 02:23:13.693848 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2813/5753] 10.222.0.67 () {58 vars in 1284 bytes} [Wed Aug 3 02:23:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1075978888 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:23:13.737528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a45a6d62-6d37-405c-b6a6-55928c0151b5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'create', calling method: .version_select at 0x7f5b128ae430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-802031361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoJXiISW1YJ7BY3iexBw6BNn1QlvzFTpyUQS4lnnD5bpXfeBZAfRIDMIWtb2JhSlc/CGcALNDF8v3MJLs7fRfWyseBpALKDvWdEpFGGw9HvvaphNpAkGPzFJ1CDSjo+sg=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:13.776750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-a45a6d62-6d37-405c-b6a6-55928c0151b5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for project f6179959e78b438cb68680f694190a8c. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:23:13.789333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-a45a6d62-6d37-405c-b6a6-55928c0151b5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for user adca21bc340d440e91e4d856a625cd3a and project f6179959e78b438cb68680f694190a8c. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:23:13.828632 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a45a6d62-6d37-405c-b6a6-55928c0151b5 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.098591 Aug 03 02:23:13.829881 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2941/5754] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:23:13 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:23:14.142180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fcffa76e-722c-4b82-a4d2-9916f82d9083 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:14.143861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fcffa76e-722c-4b82-a4d2-9916f82d9083 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:14.164867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcffa76e-722c-4b82-a4d2-9916f82d9083 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:14.170655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcffa76e-722c-4b82-a4d2-9916f82d9083 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:14.173350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcffa76e-722c-4b82-a4d2-9916f82d9083 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:14.174167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fcffa76e-722c-4b82-a4d2-9916f82d9083 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:14.402296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fcffa76e-722c-4b82-a4d2-9916f82d9083 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:14.414806 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fcffa76e-722c-4b82-a4d2-9916f82d9083 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 0.276913 Aug 03 02:23:14.426936 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2814/5755] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:14 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:15.440627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-df4b6ef5-0b1a-4c42-a81a-19776602645e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:15.441725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-df4b6ef5-0b1a-4c42-a81a-19776602645e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:15.472539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df4b6ef5-0b1a-4c42-a81a-19776602645e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:15.473267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df4b6ef5-0b1a-4c42-a81a-19776602645e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:15.474382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df4b6ef5-0b1a-4c42-a81a-19776602645e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:15.475007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df4b6ef5-0b1a-4c42-a81a-19776602645e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:15.627955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ce213690-db82-4223-ad58-e758cec23f71 req-c0e68fd5-9c37-4c54-bfe7-bad61ed8278a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4dcb4b-0945-49cb-b946-0fe75f053c37", "name": "network-vif-plugged", "status": "completed", "tag": "3d7ec981-7632-4ce7-8a7a-4b8453f3e081"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:15.656645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ce213690-db82-4223-ad58-e758cec23f71 req-c0e68fd5-9c37-4c54-bfe7-bad61ed8278a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:15.657433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ce213690-db82-4223-ad58-e758cec23f71 req-c0e68fd5-9c37-4c54-bfe7-bad61ed8278a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:15.679711 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ce213690-db82-4223-ad58-e758cec23f71 req-c0e68fd5-9c37-4c54-bfe7-bad61ed8278a service nova] Creating event network-vif-plugged:3d7ec981-7632-4ce7-8a7a-4b8453f3e081 for instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 on n-h2-826529-8 Aug 03 02:23:15.685455 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ce213690-db82-4223-ad58-e758cec23f71 req-c0e68fd5-9c37-4c54-bfe7-bad61ed8278a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062619 Aug 03 02:23:15.686896 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2815/5756] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:23:16.007278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-df4b6ef5-0b1a-4c42-a81a-19776602645e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:16.016540 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-df4b6ef5-0b1a-4c42-a81a-19776602645e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 0.581517 Aug 03 02:23:16.031249 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2942/5757] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:15 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:16.668194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1554868285", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "227e6bed-9572-4faa-aec4-655325b93bdb"}], "security_groups": [{"name": "tempest-securitygroup--2121601857"}], "key_name": "tempest-keypair-202971633", "user_data": "}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:16.871354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] validate_networks() for [('227e6bed-9572-4faa-aec4-655325b93bdb', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:23:17.040600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2210565b-06fe-41f7-9911-68fccf62cd3e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:17.042187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2210565b-06fe-41f7-9911-68fccf62cd3e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:17.055445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2210565b-06fe-41f7-9911-68fccf62cd3e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:17.056722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2210565b-06fe-41f7-9911-68fccf62cd3e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:17.059474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2210565b-06fe-41f7-9911-68fccf62cd3e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:17.060863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2210565b-06fe-41f7-9911-68fccf62cd3e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:17.563937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2210565b-06fe-41f7-9911-68fccf62cd3e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:17.584196 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2210565b-06fe-41f7-9911-68fccf62cd3e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 0.541171 Aug 03 02:23:17.604916 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2943/5758] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:17 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:18.147980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:23:18.148532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:23:18.148953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:23:18.149374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:23:18.150020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:23:18.171731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:18.178667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:18.181597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:18.183955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:18.228825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Getting quotas for project 8c9cb361c2db46cd80e1d83c2706d91a. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:23:18.241278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Getting quotas for user 4ab11af44ce14dbabafaf0136a3f2847 and project 8c9cb361c2db46cd80e1d83c2706d91a. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:23:18.263022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:23:18.267198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:23:18.366981 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f2546730-71ec-4f7b-856c-42d47e652808 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.706019 Aug 03 02:23:18.368355 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2816/5759] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:23:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:23:18.381718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4053bad6-c0fc-4c3b-bc90-48ec63951531 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:18.383484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4053bad6-c0fc-4c3b-bc90-48ec63951531 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:18.607352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4053bad6-c0fc-4c3b-bc90-48ec63951531 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:18.609479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bd38120b-3dce-4586-9b2d-16bf57b75c41 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:18.611804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bd38120b-3dce-4586-9b2d-16bf57b75c41 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:18.618733 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4053bad6-c0fc-4c3b-bc90-48ec63951531 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1237 microversion: 2.1 time: 0.243599 Aug 03 02:23:18.620446 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2944/5760] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:18 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1237 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:18.634282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd38120b-3dce-4586-9b2d-16bf57b75c41 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:18.636992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd38120b-3dce-4586-9b2d-16bf57b75c41 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:18.638169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd38120b-3dce-4586-9b2d-16bf57b75c41 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:18.640115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bd38120b-3dce-4586-9b2d-16bf57b75c41 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:19.218740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bd38120b-3dce-4586-9b2d-16bf57b75c41 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:19.253922 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bd38120b-3dce-4586-9b2d-16bf57b75c41 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1517 microversion: 2.1 time: 0.647884 Aug 03 02:23:19.255641 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2817/5761] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:18 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1517 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:19.643007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8c440d30-c940-4294-90de-51f72a139143 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:19.644615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8c440d30-c940-4294-90de-51f72a139143 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:19.687036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c440d30-c940-4294-90de-51f72a139143 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:19.691159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c440d30-c940-4294-90de-51f72a139143 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:19.694469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c440d30-c940-4294-90de-51f72a139143 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:19.695101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c440d30-c940-4294-90de-51f72a139143 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:19.826948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8c440d30-c940-4294-90de-51f72a139143 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:19.840993 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8c440d30-c940-4294-90de-51f72a139143 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1233 microversion: 2.1 time: 0.202707 Aug 03 02:23:19.842415 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2945/5762] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:19 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1233 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:23:20.278875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9d508823-b0e0-4de6-923e-9a451e6c94c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:20.280166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9d508823-b0e0-4de6-923e-9a451e6c94c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:20.299264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d508823-b0e0-4de6-923e-9a451e6c94c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:20.300028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d508823-b0e0-4de6-923e-9a451e6c94c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:20.301837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d508823-b0e0-4de6-923e-9a451e6c94c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:20.302506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d508823-b0e0-4de6-923e-9a451e6c94c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:20.797479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9d508823-b0e0-4de6-923e-9a451e6c94c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:20.838895 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9d508823-b0e0-4de6-923e-9a451e6c94c0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.558064 Aug 03 02:23:20.855245 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2818/5763] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:20 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:20.884005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b129b83c-3ac0-4545-82c3-bd122854eb7f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:20.887299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-352744de-9e26-44a2-b897-b3fa9e6ca9b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:20.890495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-352744de-9e26-44a2-b897-b3fa9e6ca9b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:20.891632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b129b83c-3ac0-4545-82c3-bd122854eb7f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:20.932579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b129b83c-3ac0-4545-82c3-bd122854eb7f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:20.934033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b129b83c-3ac0-4545-82c3-bd122854eb7f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:20.937575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-352744de-9e26-44a2-b897-b3fa9e6ca9b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:20.939057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-352744de-9e26-44a2-b897-b3fa9e6ca9b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:20.943691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b129b83c-3ac0-4545-82c3-bd122854eb7f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:20.945763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-352744de-9e26-44a2-b897-b3fa9e6ca9b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:20.947047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b129b83c-3ac0-4545-82c3-bd122854eb7f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:20.951963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-352744de-9e26-44a2-b897-b3fa9e6ca9b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:21.276347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-352744de-9e26-44a2-b897-b3fa9e6ca9b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:21.298151 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-352744de-9e26-44a2-b897-b3fa9e6ca9b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1295 microversion: 2.1 time: 0.438261 Aug 03 02:23:21.299356 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2946/5764] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:20 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1295 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:21.505846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b129b83c-3ac0-4545-82c3-bd122854eb7f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:21.516156 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b129b83c-3ac0-4545-82c3-bd122854eb7f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.651510 Aug 03 02:23:21.519952 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2819/5765] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:20 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:21.548560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6487a343-fd11-4b75-b371-a50114a047a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:21.549443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6487a343-fd11-4b75-b371-a50114a047a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:21.566638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6487a343-fd11-4b75-b371-a50114a047a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:21.567680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6487a343-fd11-4b75-b371-a50114a047a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:21.568609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6487a343-fd11-4b75-b371-a50114a047a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:21.574590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6487a343-fd11-4b75-b371-a50114a047a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:21.933220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6487a343-fd11-4b75-b371-a50114a047a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:21.951017 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6487a343-fd11-4b75-b371-a50114a047a8 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.405687 Aug 03 02:23:21.952199 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2947/5766] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:21 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:21.979265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3d3580b3-2e6b-4555-b4d9-d9c7ab66a947 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:21.991190 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-3d3580b3-2e6b-4555-b4d9-d9c7ab66a947 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance 11b53a3f-9ae5-4783-b1d6-0870d435c8bc has no mapping to a cell. Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3d3580b3-2e6b-4555-b4d9-d9c7ab66a947 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/11b53a3f-9ae5-4783-b1d6-0870d435c8bc/action HTTP/1.1 Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 15 Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: {"os-stop": {}} Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 11b53a3f-9ae5-4783-b1d6-0870d435c8bc has no mapping to a cell. Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '11b53a3f-9ae5-4783-b1d6-0870d435c8bc', 'body': {'os-stop': {}}} Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 11b53a3f-9ae5-4783-b1d6-0870d435c8bc has no mapping to a cell. Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:23:22.004915 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b53a3f-9ae5-4783-b1d6-0870d435c8bc has no mapping to a cell. Aug 03 02:23:22.009734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:22.009734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:22.009734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:22.009734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:22.009734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:22.009734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:22.009734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:23:22.009734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:23:22.009734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b53a3f-9ae5-4783-b1d6-0870d435c8bc has no mapping to a cell. Aug 03 02:23:22.009734 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:22.009734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3d3580b3-2e6b-4555-b4d9-d9c7ab66a947 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance 11b53a3f-9ae5-4783-b1d6-0870d435c8bc has no mapping to a cell. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:23:22.009734 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3d3580b3-2e6b-4555-b4d9-d9c7ab66a947 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/11b53a3f-9ae5-4783-b1d6-0870d435c8bc/action" status: 404 len: 117 microversion: 2.1 time: 0.038323 Aug 03 02:23:22.014406 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2820/5767] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:23:21 2022] POST /compute/v2.1/servers/11b53a3f-9ae5-4783-b1d6-0870d435c8bc/action => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:23:22.026755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-442ea146-0a35-4f96-ad58-7290f567b0f0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:22.028067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-442ea146-0a35-4f96-ad58-7290f567b0f0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:22.060888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-442ea146-0a35-4f96-ad58-7290f567b0f0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:22.061336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-442ea146-0a35-4f96-ad58-7290f567b0f0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:22.063567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-442ea146-0a35-4f96-ad58-7290f567b0f0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:22.066321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-442ea146-0a35-4f96-ad58-7290f567b0f0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:22.339421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b3c184d3-adf0-486d-af19-f365a4b17da8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:22.340121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b3c184d3-adf0-486d-af19-f365a4b17da8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:22.366223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3c184d3-adf0-486d-af19-f365a4b17da8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:22.366700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3c184d3-adf0-486d-af19-f365a4b17da8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:22.372735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3c184d3-adf0-486d-af19-f365a4b17da8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:22.374698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3c184d3-adf0-486d-af19-f365a4b17da8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:22.687477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-442ea146-0a35-4f96-ad58-7290f567b0f0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:22.702576 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-442ea146-0a35-4f96-ad58-7290f567b0f0 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.685944 Aug 03 02:23:22.703888 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2948/5768] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:22 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:22.744115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1dea4bd0-2c0b-48da-b5f7-802399baf72e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:22.744739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1dea4bd0-2c0b-48da-b5f7-802399baf72e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:22.764709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1dea4bd0-2c0b-48da-b5f7-802399baf72e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:22.765475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1dea4bd0-2c0b-48da-b5f7-802399baf72e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:22.766641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1dea4bd0-2c0b-48da-b5f7-802399baf72e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:22.767447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1dea4bd0-2c0b-48da-b5f7-802399baf72e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:23.966383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b3c184d3-adf0-486d-af19-f365a4b17da8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:23.976083 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b3c184d3-adf0-486d-af19-f365a4b17da8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1363 microversion: 2.1 time: 1.642398 Aug 03 02:23:24.009545 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2821/5769] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:22 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1363 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:24.108100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1dea4bd0-2c0b-48da-b5f7-802399baf72e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:24.146246 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1dea4bd0-2c0b-48da-b5f7-802399baf72e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 1.406366 Aug 03 02:23:24.147037 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2949/5770] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:22 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:23:24.176383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-31970b50-f337-45ed-8bfb-56b7d8cce155 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:24.177070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-31970b50-f337-45ed-8bfb-56b7d8cce155 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 731745f2-7d86-4f75-a8e4-0b5c76500ef5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:24.203230 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-31970b50-f337-45ed-8bfb-56b7d8cce155 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance 731745f2-7d86-4f75-a8e4-0b5c76500ef5 could not be found. Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-31970b50-f337-45ed-8bfb-56b7d8cce155 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/731745f2-7d86-4f75-a8e4-0b5c76500ef5/action HTTP/1.1 Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 15 Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: {"suspend": {}} Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 731745f2-7d86-4f75-a8e4-0b5c76500ef5 could not be found. Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '731745f2-7d86-4f75-a8e4-0b5c76500ef5', 'body': {'suspend': {}}} Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 731745f2-7d86-4f75-a8e4-0b5c76500ef5 could not be found. Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 731745f2-7d86-4f75-a8e4-0b5c76500ef5 could not be found. Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:24.206663 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:24.211427 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:23:24.211427 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:23:24.211427 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 731745f2-7d86-4f75-a8e4-0b5c76500ef5 could not be found. Aug 03 02:23:24.211427 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:24.212087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-31970b50-f337-45ed-8bfb-56b7d8cce155 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance 731745f2-7d86-4f75-a8e4-0b5c76500ef5 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:23:24.213158 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-31970b50-f337-45ed-8bfb-56b7d8cce155 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/731745f2-7d86-4f75-a8e4-0b5c76500ef5/action" status: 404 len: 111 microversion: 2.1 time: 0.042199 Aug 03 02:23:24.214205 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2822/5771] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:23:24 2022] POST /compute/v2.1/servers/731745f2-7d86-4f75-a8e4-0b5c76500ef5/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:23:24.223087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d5d68411-6a6f-413d-b055-dfc278a58b77 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:24.224690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d5d68411-6a6f-413d-b055-dfc278a58b77 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:24.250522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5d68411-6a6f-413d-b055-dfc278a58b77 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:24.251508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5d68411-6a6f-413d-b055-dfc278a58b77 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:24.256363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5d68411-6a6f-413d-b055-dfc278a58b77 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:24.257181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d5d68411-6a6f-413d-b055-dfc278a58b77 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:25.036972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-56c1f940-00ec-4ab7-b141-d932532c79b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:25.037767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-56c1f940-00ec-4ab7-b141-d932532c79b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:25.067165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56c1f940-00ec-4ab7-b141-d932532c79b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:25.072984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56c1f940-00ec-4ab7-b141-d932532c79b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:25.079023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56c1f940-00ec-4ab7-b141-d932532c79b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:25.083826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56c1f940-00ec-4ab7-b141-d932532c79b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:25.508945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d5d68411-6a6f-413d-b055-dfc278a58b77 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:25.523787 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d5d68411-6a6f-413d-b055-dfc278a58b77 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 1.305182 Aug 03 02:23:25.525948 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2950/5772] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:24 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:25.556942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c928f0b1-cf2a-421e-9bff-9987416fb5e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:25.558051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c928f0b1-cf2a-421e-9bff-9987416fb5e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:25.579156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c928f0b1-cf2a-421e-9bff-9987416fb5e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:25.580192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c928f0b1-cf2a-421e-9bff-9987416fb5e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:25.581491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c928f0b1-cf2a-421e-9bff-9987416fb5e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:25.582191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c928f0b1-cf2a-421e-9bff-9987416fb5e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:25.868226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-56c1f940-00ec-4ab7-b141-d932532c79b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:25.924374 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-56c1f940-00ec-4ab7-b141-d932532c79b7 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1363 microversion: 2.1 time: 0.895568 Aug 03 02:23:25.927764 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2823/5773] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:25 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1363 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:26.068053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c928f0b1-cf2a-421e-9bff-9987416fb5e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:26.090047 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c928f0b1-cf2a-421e-9bff-9987416fb5e9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.540349 Aug 03 02:23:26.096414 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2951/5774] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:25 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:26.122617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c28918b4-3bef-4dd3-ace2-58f45ac4c996 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:26.123340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c28918b4-3bef-4dd3-ace2-58f45ac4c996 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:26.134060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c28918b4-3bef-4dd3-ace2-58f45ac4c996 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:26.134686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c28918b4-3bef-4dd3-ace2-58f45ac4c996 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:26.135623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c28918b4-3bef-4dd3-ace2-58f45ac4c996 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:26.136171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c28918b4-3bef-4dd3-ace2-58f45ac4c996 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:26.170597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-c28918b4-3bef-4dd3-ace2-58f45ac4c996 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lazy-loading 'flavor' on Instance uuid cc4dcb4b-0945-49cb-b946-0fe75f053c37 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:23:26.379772 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c28918b4-3bef-4dd3-ace2-58f45ac4c996 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action" status: 202 len: 0 microversion: 2.1 time: 0.261796 Aug 03 02:23:26.387442 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2824/5775] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:23:26 2022] POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:23:26.400496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-295f0dac-6985-4e1d-9242-319f0d3b914e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:26.401272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-295f0dac-6985-4e1d-9242-319f0d3b914e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:26.428386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-dfa3bb9f-8291-49e0-8c94-d61be700bab4 req-6c8ea9df-07c9-414d-b003-c7679579e016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1d1216-dd0a-4189-894a-71d2a856af52", "tag": "986de4d8-7448-47a2-beec-f2f60c60bb2f"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:26.430802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-295f0dac-6985-4e1d-9242-319f0d3b914e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:26.431531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-295f0dac-6985-4e1d-9242-319f0d3b914e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:26.432535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-295f0dac-6985-4e1d-9242-319f0d3b914e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:26.438497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-295f0dac-6985-4e1d-9242-319f0d3b914e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:26.472766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-dfa3bb9f-8291-49e0-8c94-d61be700bab4 req-6c8ea9df-07c9-414d-b003-c7679579e016 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:26.473811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-dfa3bb9f-8291-49e0-8c94-d61be700bab4 req-6c8ea9df-07c9-414d-b003-c7679579e016 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:26.519479 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-dfa3bb9f-8291-49e0-8c94-d61be700bab4 req-6c8ea9df-07c9-414d-b003-c7679579e016 service nova] Creating event network-changed:986de4d8-7448-47a2-beec-f2f60c60bb2f for instance 1a1d1216-dd0a-4189-894a-71d2a856af52 on n-h2-826529-8 Aug 03 02:23:26.531808 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-dfa3bb9f-8291-49e0-8c94-d61be700bab4 req-6c8ea9df-07c9-414d-b003-c7679579e016 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117064 Aug 03 02:23:26.534920 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2825/5776] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:23:26.956743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8dd2be98-6d64-4887-8409-ba35b730923b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:26.957549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8dd2be98-6d64-4887-8409-ba35b730923b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:26.968192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8dd2be98-6d64-4887-8409-ba35b730923b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:26.973898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8dd2be98-6d64-4887-8409-ba35b730923b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:26.980192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8dd2be98-6d64-4887-8409-ba35b730923b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:26.981079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8dd2be98-6d64-4887-8409-ba35b730923b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:27.134120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-295f0dac-6985-4e1d-9242-319f0d3b914e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:27.145271 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-295f0dac-6985-4e1d-9242-319f0d3b914e tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1512 microversion: 2.1 time: 0.751713 Aug 03 02:23:27.145902 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2952/5777] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:26 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1512 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:23:27.473857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8dd2be98-6d64-4887-8409-ba35b730923b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:27.494167 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8dd2be98-6d64-4887-8409-ba35b730923b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1363 microversion: 2.1 time: 0.543115 Aug 03 02:23:27.507625 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2826/5778] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:26 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1363 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:27.728556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-531531337", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "82cb17eb-1a33-4f2f-b044-65c44c09d3de"}], "key_name": "tempest-TestNetworkAdvancedServerOps-802031361", "security_groups": [{"name": "tempest-secgroup-smoke-837619194"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:27.925783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] validate_networks() for [('82cb17eb-1a33-4f2f-b044-65c44c09d3de', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:23:28.172196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6439d5a4-0272-4f00-9ccf-711ce022e0ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:28.172904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6439d5a4-0272-4f00-9ccf-711ce022e0ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:28.194401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6439d5a4-0272-4f00-9ccf-711ce022e0ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:28.194401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6439d5a4-0272-4f00-9ccf-711ce022e0ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:28.195519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6439d5a4-0272-4f00-9ccf-711ce022e0ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:28.196913 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6439d5a4-0272-4f00-9ccf-711ce022e0ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:28.231956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:28.256663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=10 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:28.504265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6439d5a4-0272-4f00-9ccf-711ce022e0ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:28.518549 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6439d5a4-0272-4f00-9ccf-711ce022e0ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1495 microversion: 2.1 time: 0.349039 Aug 03 02:23:28.528559 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2827/5779] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:28 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1495 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:23:28.534414 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ea6122a0-4023-4a98-ad18-8adc7c2741b8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:28.543806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ea6122a0-4023-4a98-ad18-8adc7c2741b8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:28.557427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ea6122a0-4023-4a98-ad18-8adc7c2741b8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:28.558135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ea6122a0-4023-4a98-ad18-8adc7c2741b8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:28.568340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ea6122a0-4023-4a98-ad18-8adc7c2741b8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:28.569788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ea6122a0-4023-4a98-ad18-8adc7c2741b8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:28.612098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:28.657071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:23:28.658541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:23:28.663353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:23:28.664014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:23:28.664644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:23:28.709459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:28.717111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:28.718402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:28.719132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:28.765715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for project f6179959e78b438cb68680f694190a8c. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:23:28.782842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Getting quotas for user adca21bc340d440e91e4d856a625cd3a and project f6179959e78b438cb68680f694190a8c. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:23:28.811795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:23:28.817493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:23:28.927831 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bd3df68d-0720-4a17-b0a6-26b434bd6627 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.203044 Aug 03 02:23:28.928785 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2953/5780] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:23:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:23:28.934434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2c5930b2-868d-445d-9e0f-5cf3bf0246cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:28.935433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2c5930b2-868d-445d-9e0f-5cf3bf0246cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:28.943163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c5930b2-868d-445d-9e0f-5cf3bf0246cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:28.944022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c5930b2-868d-445d-9e0f-5cf3bf0246cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:28.945124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c5930b2-868d-445d-9e0f-5cf3bf0246cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:28.946935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c5930b2-868d-445d-9e0f-5cf3bf0246cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:29.059156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-2c5930b2-868d-445d-9e0f-5cf3bf0246cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lazy-loading 'flavor' on Instance uuid cc4dcb4b-0945-49cb-b946-0fe75f053c37 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:23:29.062993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ea6122a0-4023-4a98-ad18-8adc7c2741b8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:29.075920 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ea6122a0-4023-4a98-ad18-8adc7c2741b8 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1363 microversion: 2.1 time: 0.545947 Aug 03 02:23:29.076252 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-2c5930b2-868d-445d-9e0f-5cf3bf0246cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Cannot 'suspend' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state suspended Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2c5930b2-868d-445d-9e0f-5cf3bf0246cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action HTTP/1.1 Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 15 Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: {"suspend": {}} Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: exception: Cannot 'suspend' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state suspended Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'cc4dcb4b-0945-49cb-b946-0fe75f053c37', 'body': {'suspend': {}}} Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 03 02:23:29.079209 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 02:23:29.085117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 02:23:29.085117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 02:23:29.085117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state suspended Aug 03 02:23:29.085117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:29.085117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:29.085117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:29.085117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:29.085117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:29.085117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:29.085117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:23:29.085117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:23:29.085117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state suspended Aug 03 02:23:29.085117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:29.086081 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2828/5781] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:28 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1363 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:29.088571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2c5930b2-868d-445d-9e0f-5cf3bf0246cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 409 to user: Cannot 'suspend' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state suspended {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:23:29.089926 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2c5930b2-868d-445d-9e0f-5cf3bf0246cc tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action" status: 409 len: 148 microversion: 2.1 time: 0.159961 Aug 03 02:23:29.090707 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2954/5782] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:23:28 2022] POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action => generated 148 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:23:29.107560 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aa3f79d9-430f-4c6e-a243-084d3ab05ff0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:29.108107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-aa3f79d9-430f-4c6e-a243-084d3ab05ff0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:29.111990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6bbc7404-c46d-4617-8d06-a46a7e7f2956 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:29.116730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6bbc7404-c46d-4617-8d06-a46a7e7f2956 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:29.133461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bbc7404-c46d-4617-8d06-a46a7e7f2956 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:29.143776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bbc7404-c46d-4617-8d06-a46a7e7f2956 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:29.147753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bbc7404-c46d-4617-8d06-a46a7e7f2956 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:29.148210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bbc7404-c46d-4617-8d06-a46a7e7f2956 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:29.333921 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6bbc7404-c46d-4617-8d06-a46a7e7f2956 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action" status: 202 len: 0 microversion: 2.1 time: 0.228287 Aug 03 02:23:29.338547 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2955/5783] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:23:29 2022] POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 02:23:29.351959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-50a4de9c-2253-463c-9389-e75b67b29be6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:29.353864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-50a4de9c-2253-463c-9389-e75b67b29be6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:29.371955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50a4de9c-2253-463c-9389-e75b67b29be6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:29.376012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50a4de9c-2253-463c-9389-e75b67b29be6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:29.379065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50a4de9c-2253-463c-9389-e75b67b29be6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:29.380353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50a4de9c-2253-463c-9389-e75b67b29be6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:29.427473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-aa3f79d9-430f-4c6e-a243-084d3ab05ff0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:29.436631 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aa3f79d9-430f-4c6e-a243-084d3ab05ff0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1265 microversion: 2.1 time: 0.338795 Aug 03 02:23:29.437758 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2829/5784] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:29 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1265 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:29.874879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-50a4de9c-2253-463c-9389-e75b67b29be6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:29.898510 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-50a4de9c-2253-463c-9389-e75b67b29be6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1501 microversion: 2.1 time: 0.550731 Aug 03 02:23:29.901172 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2956/5785] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:29 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1501 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:30.112245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-90def568-f866-4b49-8226-e0775ad71004 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:30.113925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-90def568-f866-4b49-8226-e0775ad71004 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:30.126966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90def568-f866-4b49-8226-e0775ad71004 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:30.130604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90def568-f866-4b49-8226-e0775ad71004 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:30.132871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90def568-f866-4b49-8226-e0775ad71004 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:30.134500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90def568-f866-4b49-8226-e0775ad71004 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:30.462422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-11028373-4dee-48c1-811c-44eb5499efd0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:30.463226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-11028373-4dee-48c1-811c-44eb5499efd0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:30.480165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11028373-4dee-48c1-811c-44eb5499efd0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:30.481034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11028373-4dee-48c1-811c-44eb5499efd0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:30.482051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11028373-4dee-48c1-811c-44eb5499efd0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:30.482714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11028373-4dee-48c1-811c-44eb5499efd0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:30.814686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-11028373-4dee-48c1-811c-44eb5499efd0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:30.830033 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-11028373-4dee-48c1-811c-44eb5499efd0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1317 microversion: 2.1 time: 0.371307 Aug 03 02:23:30.861607 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2957/5786] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:30 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:23:30.933557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7c1a8f5d-df26-4a18-9796-c44d6fe301f1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:30.934361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7c1a8f5d-df26-4a18-9796-c44d6fe301f1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:30.945619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c1a8f5d-df26-4a18-9796-c44d6fe301f1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:30.946418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c1a8f5d-df26-4a18-9796-c44d6fe301f1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:30.948086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c1a8f5d-df26-4a18-9796-c44d6fe301f1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:30.964365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c1a8f5d-df26-4a18-9796-c44d6fe301f1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:31.109695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-90def568-f866-4b49-8226-e0775ad71004 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:31.123887 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-90def568-f866-4b49-8226-e0775ad71004 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1363 microversion: 2.1 time: 1.015912 Aug 03 02:23:31.140478 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2830/5787] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:30 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1363 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:31.356904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7c1a8f5d-df26-4a18-9796-c44d6fe301f1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:31.369701 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7c1a8f5d-df26-4a18-9796-c44d6fe301f1 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1501 microversion: 2.1 time: 0.448424 Aug 03 02:23:31.372164 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2958/5788] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:30 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1501 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:31.819457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-acd1adad-cfba-4e91-af7f-b5f726a07fa0 req-d38d43cf-3322-4615-a126-5c5b0ef28fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1d1216-dd0a-4189-894a-71d2a856af52", "name": "network-vif-plugged", "status": "completed", "tag": "986de4d8-7448-47a2-beec-f2f60c60bb2f"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:31.853032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-50eb9460-9aa8-41cd-9ba4-0213ccb304e2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:31.854092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-50eb9460-9aa8-41cd-9ba4-0213ccb304e2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:31.862949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-acd1adad-cfba-4e91-af7f-b5f726a07fa0 req-d38d43cf-3322-4615-a126-5c5b0ef28fb4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:31.866014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-acd1adad-cfba-4e91-af7f-b5f726a07fa0 req-d38d43cf-3322-4615-a126-5c5b0ef28fb4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:31.873826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50eb9460-9aa8-41cd-9ba4-0213ccb304e2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:31.874734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50eb9460-9aa8-41cd-9ba4-0213ccb304e2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:31.875858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50eb9460-9aa8-41cd-9ba4-0213ccb304e2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:31.878716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50eb9460-9aa8-41cd-9ba4-0213ccb304e2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:31.890005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:31.905933 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-acd1adad-cfba-4e91-af7f-b5f726a07fa0 req-d38d43cf-3322-4615-a126-5c5b0ef28fb4 service nova] Creating event network-vif-plugged:986de4d8-7448-47a2-beec-f2f60c60bb2f for instance 1a1d1216-dd0a-4189-894a-71d2a856af52 on n-h2-826529-8 Aug 03 02:23:31.911617 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-acd1adad-cfba-4e91-af7f-b5f726a07fa0 req-d38d43cf-3322-4615-a126-5c5b0ef28fb4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097497 Aug 03 02:23:31.912753 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2831/5789] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:23:32.000413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-50eb9460-9aa8-41cd-9ba4-0213ccb304e2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:32.009161 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-50eb9460-9aa8-41cd-9ba4-0213ccb304e2 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1323 microversion: 2.1 time: 0.160772 Aug 03 02:23:32.010086 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2959/5790] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:31 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1323 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:32.152049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-29a182a5-0560-41c0-9e63-632c07ab0df3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:32.152883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-29a182a5-0560-41c0-9e63-632c07ab0df3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:32.170546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29a182a5-0560-41c0-9e63-632c07ab0df3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:32.171226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29a182a5-0560-41c0-9e63-632c07ab0df3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:32.183213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29a182a5-0560-41c0-9e63-632c07ab0df3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:32.183711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29a182a5-0560-41c0-9e63-632c07ab0df3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:32.395192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c4c30f48-e3a4-4bdf-998f-00731e6f7517 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:32.395828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c4c30f48-e3a4-4bdf-998f-00731e6f7517 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:32.409367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4c30f48-e3a4-4bdf-998f-00731e6f7517 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:32.410611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4c30f48-e3a4-4bdf-998f-00731e6f7517 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:32.414423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4c30f48-e3a4-4bdf-998f-00731e6f7517 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:32.414976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4c30f48-e3a4-4bdf-998f-00731e6f7517 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:32.459296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-29a182a5-0560-41c0-9e63-632c07ab0df3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:32.464104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:32.469041 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-29a182a5-0560-41c0-9e63-632c07ab0df3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1363 microversion: 2.1 time: 0.321491 Aug 03 02:23:32.472559 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2832/5791] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:32 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:32.711733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c4c30f48-e3a4-4bdf-998f-00731e6f7517 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:32.751582 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c4c30f48-e3a4-4bdf-998f-00731e6f7517 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1501 microversion: 2.1 time: 0.360395 Aug 03 02:23:32.761435 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2960/5792] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:32 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1501 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:33.037175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e6be981c-e2b0-4200-ba42-804952fe397b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:33.038090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e6be981c-e2b0-4200-ba42-804952fe397b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:33.064710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6be981c-e2b0-4200-ba42-804952fe397b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:33.065267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6be981c-e2b0-4200-ba42-804952fe397b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:33.066385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6be981c-e2b0-4200-ba42-804952fe397b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:33.066828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6be981c-e2b0-4200-ba42-804952fe397b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:33.207693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e6be981c-e2b0-4200-ba42-804952fe397b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:33.224844 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e6be981c-e2b0-4200-ba42-804952fe397b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1323 microversion: 2.1 time: 0.194700 Aug 03 02:23:33.229625 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2833/5793] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:33 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1323 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:33.492908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bab308a0-e128-44e6-9c7e-07a13a22ae15 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:33.493525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bab308a0-e128-44e6-9c7e-07a13a22ae15 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:33.511156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bab308a0-e128-44e6-9c7e-07a13a22ae15 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:33.511624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bab308a0-e128-44e6-9c7e-07a13a22ae15 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:33.512430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bab308a0-e128-44e6-9c7e-07a13a22ae15 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:33.512871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bab308a0-e128-44e6-9c7e-07a13a22ae15 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:33.799139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a8e0af19-c95a-4dde-8ba3-9cd097bcd370 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:33.803657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a8e0af19-c95a-4dde-8ba3-9cd097bcd370 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:33.821357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8e0af19-c95a-4dde-8ba3-9cd097bcd370 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:33.822391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8e0af19-c95a-4dde-8ba3-9cd097bcd370 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:33.824711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8e0af19-c95a-4dde-8ba3-9cd097bcd370 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:33.825369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8e0af19-c95a-4dde-8ba3-9cd097bcd370 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:34.553535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bab308a0-e128-44e6-9c7e-07a13a22ae15 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:34.564169 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bab308a0-e128-44e6-9c7e-07a13a22ae15 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1363 microversion: 2.1 time: 1.074998 Aug 03 02:23:34.564789 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2961/5794] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:33 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1363 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:34.575291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-22d67ba4-0911-47d7-b09d-344fb83409de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:34.575930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-22d67ba4-0911-47d7-b09d-344fb83409de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:34.585880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a8e0af19-c95a-4dde-8ba3-9cd097bcd370 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:34.597627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22d67ba4-0911-47d7-b09d-344fb83409de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:34.598239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22d67ba4-0911-47d7-b09d-344fb83409de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:34.599096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22d67ba4-0911-47d7-b09d-344fb83409de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:34.602090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22d67ba4-0911-47d7-b09d-344fb83409de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:34.602244 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a8e0af19-c95a-4dde-8ba3-9cd097bcd370 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.822750 Aug 03 02:23:34.603156 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2834/5795] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:33 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:34.610859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-add21664-030f-4468-8e6d-277f952dfd03 req-38443bb3-db3b-43af-bd47-5a48453b1ccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "276f94ef-5142-4fd1-9844-cda0691ebd21", "tag": "265479f7-db45-494e-8d58-0d2282676ca6"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:34.631911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-add21664-030f-4468-8e6d-277f952dfd03 req-38443bb3-db3b-43af-bd47-5a48453b1ccf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:34.640981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-add21664-030f-4468-8e6d-277f952dfd03 req-38443bb3-db3b-43af-bd47-5a48453b1ccf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:34.667679 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-add21664-030f-4468-8e6d-277f952dfd03 req-38443bb3-db3b-43af-bd47-5a48453b1ccf service nova] Creating event network-changed:265479f7-db45-494e-8d58-0d2282676ca6 for instance 276f94ef-5142-4fd1-9844-cda0691ebd21 on n-h1-826529-8 Aug 03 02:23:34.688644 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-add21664-030f-4468-8e6d-277f952dfd03 req-38443bb3-db3b-43af-bd47-5a48453b1ccf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083148 Aug 03 02:23:34.691036 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2835/5796] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:23:34.714368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cada6af1-a5cd-49e8-897f-17eb6c989117 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:34.715582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cada6af1-a5cd-49e8-897f-17eb6c989117 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:34.724274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cada6af1-a5cd-49e8-897f-17eb6c989117 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:34.725710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cada6af1-a5cd-49e8-897f-17eb6c989117 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:34.737943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cada6af1-a5cd-49e8-897f-17eb6c989117 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:34.737943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cada6af1-a5cd-49e8-897f-17eb6c989117 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:35.021675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-22d67ba4-0911-47d7-b09d-344fb83409de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:35.043089 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-22d67ba4-0911-47d7-b09d-344fb83409de tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1390 microversion: 2.1 time: 0.471113 Aug 03 02:23:35.044344 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2962/5797] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:34 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1390 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:35.166679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cada6af1-a5cd-49e8-897f-17eb6c989117 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:35.182513 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cada6af1-a5cd-49e8-897f-17eb6c989117 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.489843 Aug 03 02:23:35.199266 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2836/5798] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:34 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:35.207084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-13e03476-637e-405c-96c1-f00b7e8ef860 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:35.207664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-13e03476-637e-405c-96c1-f00b7e8ef860 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: e0115232-1335-41d6-beba-0922f51654ca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:35.216411 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-13e03476-637e-405c-96c1-f00b7e8ef860 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance e0115232-1335-41d6-beba-0922f51654ca could not be found. Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-13e03476-637e-405c-96c1-f00b7e8ef860 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/e0115232-1335-41d6-beba-0922f51654ca/action HTTP/1.1 Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 15 Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: {"unpause": {}} Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance e0115232-1335-41d6-beba-0922f51654ca could not be found. Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'e0115232-1335-41d6-beba-0922f51654ca', 'body': {'unpause': {}}} Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0115232-1335-41d6-beba-0922f51654ca could not be found. Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0115232-1335-41d6-beba-0922f51654ca could not be found. Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:35.218096 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:35.224331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:23:35.224331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:23:35.224331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0115232-1335-41d6-beba-0922f51654ca could not be found. Aug 03 02:23:35.224331 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:35.224331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-13e03476-637e-405c-96c1-f00b7e8ef860 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance e0115232-1335-41d6-beba-0922f51654ca could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:23:35.224331 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-13e03476-637e-405c-96c1-f00b7e8ef860 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/e0115232-1335-41d6-beba-0922f51654ca/action" status: 404 len: 111 microversion: 2.1 time: 0.018600 Aug 03 02:23:35.228983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7a54bca3-62a3-4f9b-badc-fe0e93ebc270 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:35.229878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7a54bca3-62a3-4f9b-badc-fe0e93ebc270 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:35.231351 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2963/5799] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:23:35 2022] POST /compute/v2.1/servers/e0115232-1335-41d6-beba-0922f51654ca/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:23:35.237735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a54bca3-62a3-4f9b-badc-fe0e93ebc270 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:35.238663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a54bca3-62a3-4f9b-badc-fe0e93ebc270 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:35.239634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a54bca3-62a3-4f9b-badc-fe0e93ebc270 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:35.240313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a54bca3-62a3-4f9b-badc-fe0e93ebc270 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:35.483433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7a54bca3-62a3-4f9b-badc-fe0e93ebc270 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:35.503491 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7a54bca3-62a3-4f9b-badc-fe0e93ebc270 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.278046 Aug 03 02:23:35.504108 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2837/5800] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:35 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:35.527103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5ae66bf2-5a47-40a9-b15c-17c22fc31d89 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:35.530938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5ae66bf2-5a47-40a9-b15c-17c22fc31d89 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:35.542749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ae66bf2-5a47-40a9-b15c-17c22fc31d89 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:35.543761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ae66bf2-5a47-40a9-b15c-17c22fc31d89 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:35.544976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ae66bf2-5a47-40a9-b15c-17c22fc31d89 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:35.545599 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ae66bf2-5a47-40a9-b15c-17c22fc31d89 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:35.597350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-63cbc0d9-23df-47ae-82f5-81e542786223 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:35.598205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-63cbc0d9-23df-47ae-82f5-81e542786223 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:35.600601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:35.618858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63cbc0d9-23df-47ae-82f5-81e542786223 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:35.619748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63cbc0d9-23df-47ae-82f5-81e542786223 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:35.621799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63cbc0d9-23df-47ae-82f5-81e542786223 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:35.622571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63cbc0d9-23df-47ae-82f5-81e542786223 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:35.761808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ae66bf2-5a47-40a9-b15c-17c22fc31d89 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:35.781385 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5ae66bf2-5a47-40a9-b15c-17c22fc31d89 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.258221 Aug 03 02:23:35.796385 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2964/5801] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:35 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:35.812414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-780a899b-268a-4ac1-917a-80175698d287 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:35.813266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-780a899b-268a-4ac1-917a-80175698d287 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:35.821722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-780a899b-268a-4ac1-917a-80175698d287 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:35.822472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-780a899b-268a-4ac1-917a-80175698d287 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:35.823549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-780a899b-268a-4ac1-917a-80175698d287 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:35.824596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-780a899b-268a-4ac1-917a-80175698d287 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:35.856873 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-780a899b-268a-4ac1-917a-80175698d287 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Cannot 'unpause' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-780a899b-268a-4ac1-917a-80175698d287 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action HTTP/1.1 Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 15 Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: {"unpause": {}} Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: exception: Cannot 'unpause' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'cc4dcb4b-0945-49cb-b946-0fe75f053c37', 'body': {'unpause': {}}} Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 in vm_state active. Cannot unpause while the instance is in this state. Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:35.858560 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:35.865404 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:35.865404 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:23:35.865404 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:23:35.865404 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:23:35.865404 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:35.865404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-780a899b-268a-4ac1-917a-80175698d287 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 409 to user: Cannot 'unpause' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:23:35.865404 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-780a899b-268a-4ac1-917a-80175698d287 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action" status: 409 len: 145 microversion: 2.1 time: 0.056159 Aug 03 02:23:35.866687 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2965/5802] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:23:35 2022] POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action => generated 145 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:23:35.872188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-63cbc0d9-23df-47ae-82f5-81e542786223 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:35.874951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-587286a6-42f1-442d-9e7b-b28b8cd7e7e6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:35.875677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-587286a6-42f1-442d-9e7b-b28b8cd7e7e6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:35.888733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-587286a6-42f1-442d-9e7b-b28b8cd7e7e6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:35.889533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-587286a6-42f1-442d-9e7b-b28b8cd7e7e6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:35.890776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-587286a6-42f1-442d-9e7b-b28b8cd7e7e6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:35.893804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-587286a6-42f1-442d-9e7b-b28b8cd7e7e6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:35.895764 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-63cbc0d9-23df-47ae-82f5-81e542786223 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1548 microversion: 2.1 time: 0.307806 Aug 03 02:23:35.901073 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2838/5803] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:35 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1548 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:23:35.928370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c1a57ec0-10dc-4e88-8f11-668b4edf8340 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:35.929000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c1a57ec0-10dc-4e88-8f11-668b4edf8340 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:35.941098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1a57ec0-10dc-4e88-8f11-668b4edf8340 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:35.941804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1a57ec0-10dc-4e88-8f11-668b4edf8340 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:35.942705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1a57ec0-10dc-4e88-8f11-668b4edf8340 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:35.943464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1a57ec0-10dc-4e88-8f11-668b4edf8340 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:36.100006 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c1a57ec0-10dc-4e88-8f11-668b4edf8340 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181290 Aug 03 02:23:36.114716 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2839/5804] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:23:35 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:23:36.120759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-29c8710d-e5a8-46fb-9ae3-b0fcffad6e44 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:36.122995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-29c8710d-e5a8-46fb-9ae3-b0fcffad6e44 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:36.133778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29c8710d-e5a8-46fb-9ae3-b0fcffad6e44 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:36.134453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29c8710d-e5a8-46fb-9ae3-b0fcffad6e44 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:36.135475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29c8710d-e5a8-46fb-9ae3-b0fcffad6e44 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:36.136089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29c8710d-e5a8-46fb-9ae3-b0fcffad6e44 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:36.346983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-587286a6-42f1-442d-9e7b-b28b8cd7e7e6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:36.362550 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-587286a6-42f1-442d-9e7b-b28b8cd7e7e6 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.490618 Aug 03 02:23:36.395704 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2966/5805] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:35 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:23:36.408217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e683c754-ef4a-47fb-9f5b-22b20ddab1df tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:36.409607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e683c754-ef4a-47fb-9f5b-22b20ddab1df tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:36.417994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:36.430239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e683c754-ef4a-47fb-9f5b-22b20ddab1df tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:36.431651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e683c754-ef4a-47fb-9f5b-22b20ddab1df tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:36.435479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e683c754-ef4a-47fb-9f5b-22b20ddab1df tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:36.436122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e683c754-ef4a-47fb-9f5b-22b20ddab1df tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:36.481224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-29c8710d-e5a8-46fb-9ae3-b0fcffad6e44 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:36.490291 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-29c8710d-e5a8-46fb-9ae3-b0fcffad6e44 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1390 microversion: 2.1 time: 0.373860 Aug 03 02:23:36.495683 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2840/5806] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:36 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1390 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:36.730530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e683c754-ef4a-47fb-9f5b-22b20ddab1df tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:36.757050 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e683c754-ef4a-47fb-9f5b-22b20ddab1df tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.359969 Aug 03 02:23:36.758049 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2967/5807] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:36 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:36.783861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-73ff84e5-36dd-4321-9c86-10e1dfb5b582 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:36.785614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-73ff84e5-36dd-4321-9c86-10e1dfb5b582 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 61cdd7c0-8101-4ff4-b404-ff3e43d3f848] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:36.803967 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-73ff84e5-36dd-4321-9c86-10e1dfb5b582 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance 61cdd7c0-8101-4ff4-b404-ff3e43d3f848 could not be found. Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-73ff84e5-36dd-4321-9c86-10e1dfb5b582 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/61cdd7c0-8101-4ff4-b404-ff3e43d3f848/action HTTP/1.1 Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 18 Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: {"unshelve": null} Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 61cdd7c0-8101-4ff4-b404-ff3e43d3f848 could not be found. Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '61cdd7c0-8101-4ff4-b404-ff3e43d3f848', 'body': {'unshelve': None}} Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61cdd7c0-8101-4ff4-b404-ff3e43d3f848 could not be found. Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61cdd7c0-8101-4ff4-b404-ff3e43d3f848 could not be found. Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:36.806183 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:36.812028 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:36.812028 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:36.812028 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:36.812028 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:36.812028 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:23:36.812028 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:23:36.812028 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61cdd7c0-8101-4ff4-b404-ff3e43d3f848 could not be found. Aug 03 02:23:36.812028 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:36.815292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-73ff84e5-36dd-4321-9c86-10e1dfb5b582 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance 61cdd7c0-8101-4ff4-b404-ff3e43d3f848 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:23:36.816643 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-73ff84e5-36dd-4321-9c86-10e1dfb5b582 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/61cdd7c0-8101-4ff4-b404-ff3e43d3f848/action" status: 404 len: 111 microversion: 2.1 time: 0.039328 Aug 03 02:23:36.817538 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2841/5808] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:23:36 2022] POST /compute/v2.1/servers/61cdd7c0-8101-4ff4-b404-ff3e43d3f848/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:23:36.826105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7e20af92-596b-4fc9-8147-0310bfdaeff9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:36.826755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7e20af92-596b-4fc9-8147-0310bfdaeff9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:36.833831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e20af92-596b-4fc9-8147-0310bfdaeff9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:36.834519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e20af92-596b-4fc9-8147-0310bfdaeff9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:36.835490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e20af92-596b-4fc9-8147-0310bfdaeff9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:36.836079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e20af92-596b-4fc9-8147-0310bfdaeff9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:37.038264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7e20af92-596b-4fc9-8147-0310bfdaeff9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:37.047871 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7e20af92-596b-4fc9-8147-0310bfdaeff9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.225669 Aug 03 02:23:37.064816 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2968/5809] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:36 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:37.072311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-311b5ad8-00cb-4835-8c43-c03c83265535 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:37.073150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-311b5ad8-00cb-4835-8c43-c03c83265535 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:37.089443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-311b5ad8-00cb-4835-8c43-c03c83265535 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:37.090256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-311b5ad8-00cb-4835-8c43-c03c83265535 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:37.092386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-311b5ad8-00cb-4835-8c43-c03c83265535 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:37.093043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-311b5ad8-00cb-4835-8c43-c03c83265535 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:37.424834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-311b5ad8-00cb-4835-8c43-c03c83265535 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:37.433190 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-311b5ad8-00cb-4835-8c43-c03c83265535 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.365128 Aug 03 02:23:37.445092 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2842/5810] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:37 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:23:37.468354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6627cd98-6856-4eb7-b953-34ff099ce541 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:37.475906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6627cd98-6856-4eb7-b953-34ff099ce541 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:37.485026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6627cd98-6856-4eb7-b953-34ff099ce541 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:37.485758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6627cd98-6856-4eb7-b953-34ff099ce541 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:37.486703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6627cd98-6856-4eb7-b953-34ff099ce541 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:37.488177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6627cd98-6856-4eb7-b953-34ff099ce541 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:37.517797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f2c8f360-4f09-4110-8a0c-062e3bc455d9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:37.519480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f2c8f360-4f09-4110-8a0c-062e3bc455d9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:37.529627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2c8f360-4f09-4110-8a0c-062e3bc455d9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:37.530339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2c8f360-4f09-4110-8a0c-062e3bc455d9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:37.530667 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-6627cd98-6856-4eb7-b953-34ff099ce541 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Cannot 'unshelve' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6627cd98-6856-4eb7-b953-34ff099ce541 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action HTTP/1.1 Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 18 Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: {"unshelve": null} Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: exception: Cannot 'unshelve' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'cc4dcb4b-0945-49cb-b946-0fe75f053c37', 'body': {'unshelve': None}} Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 in vm_state active. Cannot unshelve while the instance is in this state. Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 02:23:37.533476 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 02:23:37.537518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:23:37.537518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:37.537518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:37.537518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:37.537518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:37.537518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:37.537518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:37.537518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:23:37.537518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:23:37.537518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active Aug 03 02:23:37.537518 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:37.540224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2c8f360-4f09-4110-8a0c-062e3bc455d9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:37.541304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2c8f360-4f09-4110-8a0c-062e3bc455d9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:37.558946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6627cd98-6856-4eb7-b953-34ff099ce541 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 409 to user: Cannot 'unshelve' instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 while it is in vm_state active {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:23:37.564976 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6627cd98-6856-4eb7-b953-34ff099ce541 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action" status: 409 len: 146 microversion: 2.1 time: 0.100405 Aug 03 02:23:37.568204 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2969/5811] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:23:37 2022] POST /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37/action => generated 146 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:23:37.581350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4a9611d4-8be0-4234-8f67-facc45d0be32 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:37.581937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4a9611d4-8be0-4234-8f67-facc45d0be32 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:37.590374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a9611d4-8be0-4234-8f67-facc45d0be32 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:37.590885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a9611d4-8be0-4234-8f67-facc45d0be32 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:37.592039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a9611d4-8be0-4234-8f67-facc45d0be32 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:37.592660 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4a9611d4-8be0-4234-8f67-facc45d0be32 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:38.004849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4a9611d4-8be0-4234-8f67-facc45d0be32 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:38.036431 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4a9611d4-8be0-4234-8f67-facc45d0be32 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.459728 Aug 03 02:23:38.049799 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2970/5812] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:37 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:38.068074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6bc67ff4-00e8-4b52-a4c4-5e997827be16 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:38.068769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6bc67ff4-00e8-4b52-a4c4-5e997827be16 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:38.087422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bc67ff4-00e8-4b52-a4c4-5e997827be16 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:38.088080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bc67ff4-00e8-4b52-a4c4-5e997827be16 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:38.090491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bc67ff4-00e8-4b52-a4c4-5e997827be16 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:38.092506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6bc67ff4-00e8-4b52-a4c4-5e997827be16 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:38.145235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f2c8f360-4f09-4110-8a0c-062e3bc455d9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:38.160035 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f2c8f360-4f09-4110-8a0c-062e3bc455d9 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1390 microversion: 2.1 time: 0.644292 Aug 03 02:23:38.161118 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2843/5813] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:37 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1390 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:38.399716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-3b27a662-03d7-4ac1-8d13-2c77aec1a8e2 req-46d6a794-a583-4225-9724-3861d66a3745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1d1216-dd0a-4189-894a-71d2a856af52", "tag": "986de4d8-7448-47a2-beec-f2f60c60bb2f"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:38.414992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3b27a662-03d7-4ac1-8d13-2c77aec1a8e2 req-46d6a794-a583-4225-9724-3861d66a3745 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:38.415762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3b27a662-03d7-4ac1-8d13-2c77aec1a8e2 req-46d6a794-a583-4225-9724-3861d66a3745 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:38.432365 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-3b27a662-03d7-4ac1-8d13-2c77aec1a8e2 req-46d6a794-a583-4225-9724-3861d66a3745 service nova] Creating event network-changed:986de4d8-7448-47a2-beec-f2f60c60bb2f for instance 1a1d1216-dd0a-4189-894a-71d2a856af52 on n-h2-826529-8 Aug 03 02:23:38.438221 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-3b27a662-03d7-4ac1-8d13-2c77aec1a8e2 req-46d6a794-a583-4225-9724-3861d66a3745 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042366 Aug 03 02:23:38.445366 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2844/5814] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:23:38.504064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6bc67ff4-00e8-4b52-a4c4-5e997827be16 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:38.517147 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6bc67ff4-00e8-4b52-a4c4-5e997827be16 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.457132 Aug 03 02:23:38.518392 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2971/5815] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:38 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:38.551040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cea1cb3a-280e-4228-b863-ab9c9e18c81a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-664922229_updated"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:38.558137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cea1cb3a-280e-4228-b863-ab9c9e18c81a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 138fffba-f5e9-4aa2-a050-2fa4c2380f33] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:38.574566 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-cea1cb3a-280e-4228-b863-ab9c9e18c81a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance 138fffba-f5e9-4aa2-a050-2fa4c2380f33 could not be found. Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cea1cb3a-280e-4228-b863-ab9c9e18c81a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: request: PUT /compute/v2.1/servers/138fffba-f5e9-4aa2-a050-2fa4c2380f33 HTTP/1.1 Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 80 Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-664922229_updated"}} Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 138fffba-f5e9-4aa2-a050-2fa4c2380f33 could not be found. Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '138fffba-f5e9-4aa2-a050-2fa4c2380f33', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-664922229_updated'}}} Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 138fffba-f5e9-4aa2-a050-2fa4c2380f33 could not be found. Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 03 02:23:38.576581 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 138fffba-f5e9-4aa2-a050-2fa4c2380f33 could not be found. Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 138fffba-f5e9-4aa2-a050-2fa4c2380f33 could not be found. Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cea1cb3a-280e-4228-b863-ab9c9e18c81a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance 138fffba-f5e9-4aa2-a050-2fa4c2380f33 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cea1cb3a-280e-4228-b863-ab9c9e18c81a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "PUT /compute/v2.1/servers/138fffba-f5e9-4aa2-a050-2fa4c2380f33" status: 404 len: 111 microversion: 2.1 time: 0.039385 Aug 03 02:23:38.581521 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2845/5816] 10.222.0.67 () {60 vars in 1256 bytes} [Wed Aug 3 02:23:38 2022] PUT /compute/v2.1/servers/138fffba-f5e9-4aa2-a050-2fa4c2380f33 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:23:38.587625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2454952b-4dd3-48f6-89ff-163879479831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:38.588251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2454952b-4dd3-48f6-89ff-163879479831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:38.600975 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2454952b-4dd3-48f6-89ff-163879479831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:38.601446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2454952b-4dd3-48f6-89ff-163879479831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:38.612068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2454952b-4dd3-48f6-89ff-163879479831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:38.612937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2454952b-4dd3-48f6-89ff-163879479831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:38.734658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:38.800319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:38.886716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2454952b-4dd3-48f6-89ff-163879479831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:38.895037 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2454952b-4dd3-48f6-89ff-163879479831 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.311228 Aug 03 02:23:38.898849 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2972/5817] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:38 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:38.921741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6106ddc4-3628-4742-9f5e-2d5caa6e021a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:38.923736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6106ddc4-3628-4742-9f5e-2d5caa6e021a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:38.944229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6106ddc4-3628-4742-9f5e-2d5caa6e021a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:38.944791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6106ddc4-3628-4742-9f5e-2d5caa6e021a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:38.946614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6106ddc4-3628-4742-9f5e-2d5caa6e021a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:38.948872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6106ddc4-3628-4742-9f5e-2d5caa6e021a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:39.187828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5fad32f5-5d69-4bba-8085-ef47d3e6d6fd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:39.190238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5fad32f5-5d69-4bba-8085-ef47d3e6d6fd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:39.209306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fad32f5-5d69-4bba-8085-ef47d3e6d6fd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:39.212382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fad32f5-5d69-4bba-8085-ef47d3e6d6fd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:39.217269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fad32f5-5d69-4bba-8085-ef47d3e6d6fd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:39.218528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fad32f5-5d69-4bba-8085-ef47d3e6d6fd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:39.358110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6106ddc4-3628-4742-9f5e-2d5caa6e021a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:39.378389 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6106ddc4-3628-4742-9f5e-2d5caa6e021a tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.460573 Aug 03 02:23:39.379328 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2846/5818] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:38 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:39.401704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b5a767ea-eede-4df3-baff-7d3db53ea2c9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b5a767ea-eede-4df3-baff-7d3db53ea2c9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: request: PUT /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 HTTP/1.1 Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 280 Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'cc4dcb4b-0945-49cb-b946-0fe75f053c37', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:39.405699 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 02:23:39.410136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:39.414743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b5a767ea-eede-4df3-baff-7d3db53ea2c9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:23:39.416205 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b5a767ea-eede-4df3-baff-7d3db53ea2c9 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "PUT /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 400 len: 619 microversion: 2.1 time: 0.018151 Aug 03 02:23:39.419378 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2847/5819] 10.222.0.67 () {60 vars in 1257 bytes} [Wed Aug 3 02:23:39 2022] PUT /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 02:23:39.430401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8b06b787-016b-455b-8c5f-cb40ee40a646 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:39.434932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8b06b787-016b-455b-8c5f-cb40ee40a646 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:39.452921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:39.457140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8b06b787-016b-455b-8c5f-cb40ee40a646 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:39.460451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8b06b787-016b-455b-8c5f-cb40ee40a646 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:39.461370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8b06b787-016b-455b-8c5f-cb40ee40a646 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:39.462868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8b06b787-016b-455b-8c5f-cb40ee40a646 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:39.463275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5fad32f5-5d69-4bba-8085-ef47d3e6d6fd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:39.475058 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5fad32f5-5d69-4bba-8085-ef47d3e6d6fd tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1390 microversion: 2.1 time: 0.296680 Aug 03 02:23:39.476128 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2973/5820] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:39 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1390 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:23:39.974376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8b06b787-016b-455b-8c5f-cb40ee40a646 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:39.987320 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8b06b787-016b-455b-8c5f-cb40ee40a646 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.563353 Aug 03 02:23:39.988543 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2848/5821] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:39 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:40.011759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-338c7743-e94a-43bc-aa54-d680570887f2 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:40.013567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-80e6c975-9447-45ad-8c47-181deae6dac2 req-3cfef3b5-ad33-48b2-ad0a-1c7d75627baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276f94ef-5142-4fd1-9844-cda0691ebd21", "name": "network-vif-plugged", "status": "completed", "tag": "265479f7-db45-494e-8d58-0d2282676ca6"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:40.019331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-338c7743-e94a-43bc-aa54-d680570887f2 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:40.032083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-338c7743-e94a-43bc-aa54-d680570887f2 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:40.033161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-338c7743-e94a-43bc-aa54-d680570887f2 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:40.033969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-338c7743-e94a-43bc-aa54-d680570887f2 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:40.034417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-338c7743-e94a-43bc-aa54-d680570887f2 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:40.036190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-80e6c975-9447-45ad-8c47-181deae6dac2 req-3cfef3b5-ad33-48b2-ad0a-1c7d75627baa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:40.037642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-80e6c975-9447-45ad-8c47-181deae6dac2 req-3cfef3b5-ad33-48b2-ad0a-1c7d75627baa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:40.075114 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-80e6c975-9447-45ad-8c47-181deae6dac2 req-3cfef3b5-ad33-48b2-ad0a-1c7d75627baa service nova] Creating event network-vif-plugged:265479f7-db45-494e-8d58-0d2282676ca6 for instance 276f94ef-5142-4fd1-9844-cda0691ebd21 on n-h1-826529-8 Aug 03 02:23:40.082988 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-80e6c975-9447-45ad-8c47-181deae6dac2 req-3cfef3b5-ad33-48b2-ad0a-1c7d75627baa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073202 Aug 03 02:23:40.084659 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2849/5822] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:23:40.357720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-338c7743-e94a-43bc-aa54-d680570887f2 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:40.372065 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-338c7743-e94a-43bc-aa54-d680570887f2 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.364185 Aug 03 02:23:40.391542 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2974/5823] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:40 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:40.398093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3ed9e8eb-1f38-4d75-95ea-42766781a1da tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3ed9e8eb-1f38-4d75-95ea-42766781a1da tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: request: PUT /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 HTTP/1.1 Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 24 Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: {"server": {"name": ""}} Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'cc4dcb4b-0945-49cb-b946-0fe75f053c37', 'body': {'server': {'name': ''}}} Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi '' Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:23:40.402051 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:23:40.408590 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 03 02:23:40.408590 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:40.408590 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:40.408590 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:40.408590 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:40.408590 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:40.408590 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:40.408590 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:23:40.408590 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:23:40.408590 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 03 02:23:40.408590 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:40.408590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3ed9e8eb-1f38-4d75-95ea-42766781a1da tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:23:40.411153 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3ed9e8eb-1f38-4d75-95ea-42766781a1da tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "PUT /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 400 len: 108 microversion: 2.1 time: 0.017432 Aug 03 02:23:40.412428 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2850/5824] 10.222.0.67 () {60 vars in 1256 bytes} [Wed Aug 3 02:23:40 2022] PUT /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 02:23:40.441922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2646acc-e2e3-4449-99b4-33ba963f2bfa tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:40.459808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c2646acc-e2e3-4449-99b4-33ba963f2bfa tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:40.482004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2646acc-e2e3-4449-99b4-33ba963f2bfa tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:40.482471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2646acc-e2e3-4449-99b4-33ba963f2bfa tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:40.483314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2646acc-e2e3-4449-99b4-33ba963f2bfa tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:40.483762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2646acc-e2e3-4449-99b4-33ba963f2bfa tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:40.514391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3c4d856b-1b4f-4de5-a57e-7eb6f5cae395 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:40.515369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3c4d856b-1b4f-4de5-a57e-7eb6f5cae395 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:40.539711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c4d856b-1b4f-4de5-a57e-7eb6f5cae395 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:40.540440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c4d856b-1b4f-4de5-a57e-7eb6f5cae395 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:40.541617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c4d856b-1b4f-4de5-a57e-7eb6f5cae395 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:40.542257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c4d856b-1b4f-4de5-a57e-7eb6f5cae395 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:40.840893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3c4d856b-1b4f-4de5-a57e-7eb6f5cae395 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:40.856443 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3c4d856b-1b4f-4de5-a57e-7eb6f5cae395 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1390 microversion: 2.1 time: 0.345866 Aug 03 02:23:40.857911 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2851/5825] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:40 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1390 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:23:40.859322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c2646acc-e2e3-4449-99b4-33ba963f2bfa tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:40.873447 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c2646acc-e2e3-4449-99b4-33ba963f2bfa tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1504 microversion: 2.1 time: 0.442405 Aug 03 02:23:40.874170 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2975/5826] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:40 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:41.884685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-81bd720f-4445-425e-81c5-53706a2b2e0e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:41.885918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-81bd720f-4445-425e-81c5-53706a2b2e0e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:41.896692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81bd720f-4445-425e-81c5-53706a2b2e0e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:41.897460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81bd720f-4445-425e-81c5-53706a2b2e0e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:41.898492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81bd720f-4445-425e-81c5-53706a2b2e0e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:41.899409 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81bd720f-4445-425e-81c5-53706a2b2e0e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:42.209682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-81bd720f-4445-425e-81c5-53706a2b2e0e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:42.221237 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-81bd720f-4445-425e-81c5-53706a2b2e0e tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1390 microversion: 2.1 time: 0.342497 Aug 03 02:23:42.224598 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2852/5827] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:41 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1390 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:43.246309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8517ec0-60b1-42fb-beb0-d34e47b092bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:43.246960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8517ec0-60b1-42fb-beb0-d34e47b092bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:43.260371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8517ec0-60b1-42fb-beb0-d34e47b092bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:43.263514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8517ec0-60b1-42fb-beb0-d34e47b092bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:43.264357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8517ec0-60b1-42fb-beb0-d34e47b092bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:43.264907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8517ec0-60b1-42fb-beb0-d34e47b092bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:43.795907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8517ec0-60b1-42fb-beb0-d34e47b092bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:43.809169 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8517ec0-60b1-42fb-beb0-d34e47b092bb tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1560 microversion: 2.1 time: 0.567115 Aug 03 02:23:43.809953 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2976/5828] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:43 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1560 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:43.832249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-14c8aa94-7aa1-4cdc-8e43-18eed5580704 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:43.833563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-14c8aa94-7aa1-4cdc-8e43-18eed5580704 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:43.845525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-14c8aa94-7aa1-4cdc-8e43-18eed5580704 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:43.852540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-14c8aa94-7aa1-4cdc-8e43-18eed5580704 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:43.853193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-14c8aa94-7aa1-4cdc-8e43-18eed5580704 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:43.853827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-14c8aa94-7aa1-4cdc-8e43-18eed5580704 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:45.077127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-14c8aa94-7aa1-4cdc-8e43-18eed5580704 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:45.087884 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-14c8aa94-7aa1-4cdc-8e43-18eed5580704 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1560 microversion: 2.1 time: 1.261154 Aug 03 02:23:45.089672 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2853/5829] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:43 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1560 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:49.497237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-223f31d8-c764-4c2c-9353-1ca56211bf03 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:49.498423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-223f31d8-c764-4c2c-9353-1ca56211bf03 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:49.512041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-e89baa4b-e225-466d-9cdc-ffe306e2ac7c req-11715d6e-1fe6-4224-babb-fc8a50be7b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "276f94ef-5142-4fd1-9844-cda0691ebd21", "tag": "265479f7-db45-494e-8d58-0d2282676ca6"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:49.517287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-223f31d8-c764-4c2c-9353-1ca56211bf03 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:49.517745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-223f31d8-c764-4c2c-9353-1ca56211bf03 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:49.518538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-223f31d8-c764-4c2c-9353-1ca56211bf03 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:49.527093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-223f31d8-c764-4c2c-9353-1ca56211bf03 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:49.549098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e89baa4b-e225-466d-9cdc-ffe306e2ac7c req-11715d6e-1fe6-4224-babb-fc8a50be7b81 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:49.557548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e89baa4b-e225-466d-9cdc-ffe306e2ac7c req-11715d6e-1fe6-4224-babb-fc8a50be7b81 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:49.578043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:49.588552 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e89baa4b-e225-466d-9cdc-ffe306e2ac7c req-11715d6e-1fe6-4224-babb-fc8a50be7b81 service nova] Creating event network-changed:265479f7-db45-494e-8d58-0d2282676ca6 for instance 276f94ef-5142-4fd1-9844-cda0691ebd21 on n-h1-826529-8 Aug 03 02:23:49.608492 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-e89baa4b-e225-466d-9cdc-ffe306e2ac7c req-11715d6e-1fe6-4224-babb-fc8a50be7b81 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100137 Aug 03 02:23:49.609124 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2854/5830] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:23:50.218799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-223f31d8-c764-4c2c-9353-1ca56211bf03 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:50.227810 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-223f31d8-c764-4c2c-9353-1ca56211bf03 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1560 microversion: 2.1 time: 0.734367 Aug 03 02:23:50.233108 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2977/5831] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:49 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1560 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:51.486614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6fe2c0db-f04e-4488-ad00-a892467130ec tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:51.487803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6fe2c0db-f04e-4488-ad00-a892467130ec tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:51.501961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fe2c0db-f04e-4488-ad00-a892467130ec tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:51.502926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fe2c0db-f04e-4488-ad00-a892467130ec tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:51.503920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fe2c0db-f04e-4488-ad00-a892467130ec tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:51.504537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6fe2c0db-f04e-4488-ad00-a892467130ec tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:51.540368 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-6fe2c0db-f04e-4488-ad00-a892467130ec tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6fe2c0db-f04e-4488-ad00-a892467130ec tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 HTTP/1.1 Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '80ba4e52-bfcc-4b75-8d15-dec1bafa54f3'} Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:23:51.542733 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:23:51.547139 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:23:51.547139 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:51.547139 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:51.547139 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:51.547139 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:51.547139 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:51.547139 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:51.547139 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:23:51.547139 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:23:51.547139 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:23:51.547139 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:23:51.549464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6fe2c0db-f04e-4488-ad00-a892467130ec tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:23:51.552456 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6fe2c0db-f04e-4488-ad00-a892467130ec tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "DELETE /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 404 len: 111 microversion: 2.1 time: 0.072387 Aug 03 02:23:51.554233 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2855/5832] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:23:51 2022] DELETE /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:23:51.563933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20412d80-a6c3-4326-bfa6-ac2853cf5f8f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:51.565213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-20412d80-a6c3-4326-bfa6-ac2853cf5f8f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:51.614964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20412d80-a6c3-4326-bfa6-ac2853cf5f8f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:51.614964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20412d80-a6c3-4326-bfa6-ac2853cf5f8f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:51.614964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20412d80-a6c3-4326-bfa6-ac2853cf5f8f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:51.614964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20412d80-a6c3-4326-bfa6-ac2853cf5f8f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:51.706085 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-20412d80-a6c3-4326-bfa6-ac2853cf5f8f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20412d80-a6c3-4326-bfa6-ac2853cf5f8f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 HTTP/1.1 Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '80ba4e52-bfcc-4b75-8d15-dec1bafa54f3'} Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:51.708915 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:51.712815 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:51.712815 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:51.712815 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:51.712815 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:23:51.712815 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:23:51.712815 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. Aug 03 02:23:51.712815 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:51.712815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20412d80-a6c3-4326-bfa6-ac2853cf5f8f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance 80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:23:51.712815 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-20412d80-a6c3-4326-bfa6-ac2853cf5f8f tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3" status: 404 len: 111 microversion: 2.1 time: 0.151402 Aug 03 02:23:51.723231 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2978/5833] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:51 2022] GET /compute/v2.1/servers/80ba4e52-bfcc-4b75-8d15-dec1bafa54f3 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:23:51.731570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4374cc46-a360-4f0e-9836-eebb3b98adf4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:51.733120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4374cc46-a360-4f0e-9836-eebb3b98adf4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:51.745084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4374cc46-a360-4f0e-9836-eebb3b98adf4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:51.755573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4374cc46-a360-4f0e-9836-eebb3b98adf4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:51.756660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4374cc46-a360-4f0e-9836-eebb3b98adf4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:51.766606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4374cc46-a360-4f0e-9836-eebb3b98adf4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:51.815277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4374cc46-a360-4f0e-9836-eebb3b98adf4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:23:51.896205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=100 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:23:52.014284 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4374cc46-a360-4f0e-9836-eebb3b98adf4 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 204 len: 0 microversion: 2.1 time: 0.278209 Aug 03 02:23:52.015731 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2856/5834] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:23:51 2022] DELETE /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:23:52.023806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fe272001-4d4b-4e52-bce4-8abeba1065bb tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:52.024436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fe272001-4d4b-4e52-bce4-8abeba1065bb tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:52.032803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe272001-4d4b-4e52-bce4-8abeba1065bb tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:52.033502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe272001-4d4b-4e52-bce4-8abeba1065bb tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:52.034419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe272001-4d4b-4e52-bce4-8abeba1065bb tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:52.034876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe272001-4d4b-4e52-bce4-8abeba1065bb tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:52.462350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fe272001-4d4b-4e52-bce4-8abeba1065bb tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:52.475178 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fe272001-4d4b-4e52-bce4-8abeba1065bb tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1510 microversion: 2.1 time: 0.455155 Aug 03 02:23:52.475783 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2979/5835] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:52 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1510 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:53.503028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-40b189fd-5e26-4762-8b2c-501de060d598 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:53.504724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-40b189fd-5e26-4762-8b2c-501de060d598 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:53.525702 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40b189fd-5e26-4762-8b2c-501de060d598 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:53.526300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40b189fd-5e26-4762-8b2c-501de060d598 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:53.527261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40b189fd-5e26-4762-8b2c-501de060d598 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:53.528148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40b189fd-5e26-4762-8b2c-501de060d598 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:53.822115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-40b189fd-5e26-4762-8b2c-501de060d598 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:53.834866 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-40b189fd-5e26-4762-8b2c-501de060d598 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1510 microversion: 2.1 time: 0.337186 Aug 03 02:23:53.835587 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2857/5836] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:53 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1510 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:23:54.858485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a5984da5-28b1-4924-b15b-9d035df8b4ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:54.859748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a5984da5-28b1-4924-b15b-9d035df8b4ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:54.873297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5984da5-28b1-4924-b15b-9d035df8b4ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:54.873752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5984da5-28b1-4924-b15b-9d035df8b4ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:54.891980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5984da5-28b1-4924-b15b-9d035df8b4ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:54.894238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a5984da5-28b1-4924-b15b-9d035df8b4ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:55.140886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a5984da5-28b1-4924-b15b-9d035df8b4ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7273f3ccd4d9469aa16eba259eae7eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f2f72e230c40a98899206f4a0b2d29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:23:55.151806 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a5984da5-28b1-4924-b15b-9d035df8b4ea tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 200 len: 1510 microversion: 2.1 time: 0.297573 Aug 03 02:23:55.153013 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2980/5837] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:54 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:23:55.520081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-c00ac995-08e6-45b4-bf8b-bc74e7cca843 req-2ea5e225-61e0-4045-8623-49423b15a542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4dcb4b-0945-49cb-b946-0fe75f053c37", "name": "network-vif-deleted", "tag": "3d7ec981-7632-4ce7-8a7a-4b8453f3e081"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:23:55.533340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c00ac995-08e6-45b4-bf8b-bc74e7cca843 req-2ea5e225-61e0-4045-8623-49423b15a542 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:55.534105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c00ac995-08e6-45b4-bf8b-bc74e7cca843 req-2ea5e225-61e0-4045-8623-49423b15a542 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:55.557140 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c00ac995-08e6-45b4-bf8b-bc74e7cca843 req-2ea5e225-61e0-4045-8623-49423b15a542 service nova] Creating event network-vif-deleted:3d7ec981-7632-4ce7-8a7a-4b8453f3e081 for instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 on n-h2-826529-8 Aug 03 02:23:55.569326 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-c00ac995-08e6-45b4-bf8b-bc74e7cca843 req-2ea5e225-61e0-4045-8623-49423b15a542 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056774 Aug 03 02:23:55.571166 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2858/5838] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:23:56.179890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6a67bd95-3ffc-4c61-8607-8732cbb4fe03 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:23:56.180515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6a67bd95-3ffc-4c61-8607-8732cbb4fe03 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] [instance: cc4dcb4b-0945-49cb-b946-0fe75f053c37] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:23:56.187850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a67bd95-3ffc-4c61-8607-8732cbb4fe03 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:56.188812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a67bd95-3ffc-4c61-8607-8732cbb4fe03 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:56.189758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a67bd95-3ffc-4c61-8607-8732cbb4fe03 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:23:56.190356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a67bd95-3ffc-4c61-8607-8732cbb4fe03 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:23:56.206328 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-6a67bd95-3ffc-4c61-8607-8732cbb4fe03 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] HTTP exception thrown: Instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 could not be found. Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6a67bd95-3ffc-4c61-8607-8732cbb4fe03 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Request method failure captured: Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 HTTP/1.1 Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dt6safTd3UP5ot4erC6nyNHzkO_P821zUn-Jhgx9pHfBQdNnOl7y_eS5vxyHrGtqDI4HZdtNTZMx0fezTIUfbUYmQK9YaH6svghBgakuyu92cejTa_eRhBRTavwRhDnykHWTkRI8nbD-7ZjUVN9t5Z38nNF_7pelvW1GQSiQ7NPfyo Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_33f2f72e230c40a98899206f4a0b2d29", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/33f2f72e230c40a98899206f4a0b2d29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/33f2f72e230c40a98899206f4a0b2d29"}]}] Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 33f2f72e230c40a98899206f4a0b2d29 Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1308327457 Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7273f3ccd4d9469aa16eba259eae7eda Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1308327457-project Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 could not be found. Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'cc4dcb4b-0945-49cb-b946-0fe75f053c37'} Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 could not be found. Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 could not be found. Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:23:56.208382 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:56.213196 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:23:56.213196 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:23:56.213196 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:23:56.213196 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:23:56.213196 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:23:56.213196 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 could not be found. Aug 03 02:23:56.213196 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:23:56.215673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6a67bd95-3ffc-4c61-8607-8732cbb4fe03 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] Returning 404 to user: Instance cc4dcb4b-0945-49cb-b946-0fe75f053c37 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:23:56.216721 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6a67bd95-3ffc-4c61-8607-8732cbb4fe03 tempest-ServersNegativeTestJSON-1308327457 tempest-ServersNegativeTestJSON-1308327457-project] 10.222.0.67 "GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37" status: 404 len: 111 microversion: 2.1 time: 0.041557 Aug 03 02:23:56.217783 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2981/5839] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:23:56 2022] GET /compute/v2.1/servers/cc4dcb4b-0945-49cb-b946-0fe75f053c37 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:24:05.532650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:24:05.540771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:24:05.748297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-06baaadd-f228-42aa-883f-e821acff7e34 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Action: 'create', calling method: .version_select at 0x7f5b13129280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1098852662"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:24:06.545118 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-06baaadd-f228-42aa-883f-e821acff7e34 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.038159 Aug 03 02:24:06.547573 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2859/5840] 10.222.0.67 () {60 vars in 1155 bytes} [Wed Aug 3 02:24:05 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1042 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 03 02:24:06.567855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-32198c73-8686-4316-9a23-1deb343dfb81 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b1289f310>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:06.631240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=29 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:24:06.635157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=19 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:24:06.796961 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-32198c73-8686-4316-9a23-1deb343dfb81 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4" status: 200 len: 345 microversion: 2.1 time: 0.234818 Aug 03 02:24:06.817186 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2982/5841] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:24:06 2022] GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4 => generated 345 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:07.823121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6219b525-c636-4f03-9e73-3f14c7217a77 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b13520dc0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:08.042729 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6219b525-c636-4f03-9e73-3f14c7217a77 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4" status: 200 len: 345 microversion: 2.1 time: 0.228479 Aug 03 02:24:08.043822 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2860/5842] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:24:07 2022] GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4 => generated 345 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:09.068012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-90e2f67a-8342-4952-a806-a175ca810a88 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b12363d30>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:09.154648 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-90e2f67a-8342-4952-a806-a175ca810a88 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4" status: 200 len: 346 microversion: 2.1 time: 0.099372 Aug 03 02:24:09.155266 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2983/5843] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:24:09 2022] GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4 => generated 346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:09.167936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fc9be145-ebb5-4507-bf1e-66de64057e9c tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Action: 'create', calling method: .version_select at 0x7f5b131299d0>, body: {"snapshot": {"volume_id": "4dd4f761-933e-4a49-bce5-fd4fb96d78c4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1182976952"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:24:09.644867 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fc9be145-ebb5-4507-bf1e-66de64057e9c tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.480391 Aug 03 02:24:09.645373 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2861/5844] 10.222.0.67 () {60 vars in 1162 bytes} [Wed Aug 3 02:24:09 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:09.664327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2ce25e6-26e6-4a42-8166-4c72867fc4e0 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b123c9160>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:09.791022 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c2ce25e6-26e6-4a42-8166-4c72867fc4e0 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759" status: 200 len: 287 microversion: 2.1 time: 0.138002 Aug 03 02:24:09.792189 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2984/5845] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 3 02:24:09 2022] GET /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759 => generated 287 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:09.803596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7390834e-60d1-4b24-bfaa-10aaa61ca0ee tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b244cd550>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:09.858959 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7390834e-60d1-4b24-bfaa-10aaa61ca0ee tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.059114 Aug 03 02:24:09.860017 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2862/5846] 10.222.0.67 () {58 vars in 1140 bytes} [Wed Aug 3 02:24:09 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:09.870757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-27000faf-1b40-4711-9823-58d96b44d5cb tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b1220b4c0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:09.916894 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-27000faf-1b40-4711-9823-58d96b44d5cb tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759" status: 200 len: 287 microversion: 2.1 time: 0.049823 Aug 03 02:24:09.917780 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2985/5847] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 3 02:24:09 2022] GET /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:24:10.934944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-19ac48f3-a397-46cc-b149-16b9d5515652 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b245c4790>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:10.993002 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-19ac48f3-a397-46cc-b149-16b9d5515652 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759" status: 200 len: 287 microversion: 2.1 time: 0.065336 Aug 03 02:24:10.993799 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2863/5848] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 3 02:24:10 2022] GET /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:12.010486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ffaaebc4-7879-4ec9-991c-ecc3d1cf4837 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b12220940>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:12.059197 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ffaaebc4-7879-4ec9-991c-ecc3d1cf4837 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759" status: 200 len: 288 microversion: 2.1 time: 0.056093 Aug 03 02:24:12.060184 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2986/5849] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 3 02:24:12 2022] GET /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759 => generated 288 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:12.075840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-86058be5-b22b-4521-9f60-81b32ffbc09d tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b13129280>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:12.233816 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-86058be5-b22b-4521-9f60-81b32ffbc09d tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "DELETE /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759" status: 202 len: 0 microversion: 2.1 time: 0.163651 Aug 03 02:24:12.243478 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2864/5850] 10.222.0.67 () {58 vars in 1254 bytes} [Wed Aug 3 02:24:12 2022] DELETE /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:24:12.248140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7e5bfc89-3157-4135-8504-4c0ce0401fcf tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b1220b310>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:12.304190 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7e5bfc89-3157-4135-8504-4c0ce0401fcf tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759" status: 200 len: 287 microversion: 2.1 time: 0.060431 Aug 03 02:24:12.305247 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2987/5851] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 3 02:24:12 2022] GET /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:13.045666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2802b6de-612c-41be-88f3-8a6dc7f3304a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:24:13.050425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2802b6de-612c-41be-88f3-8a6dc7f3304a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:13.063704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2802b6de-612c-41be-88f3-8a6dc7f3304a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:13.064585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2802b6de-612c-41be-88f3-8a6dc7f3304a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:13.065618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2802b6de-612c-41be-88f3-8a6dc7f3304a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:13.066310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2802b6de-612c-41be-88f3-8a6dc7f3304a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:13.174027 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2802b6de-612c-41be-88f3-8a6dc7f3304a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21/action" status: 200 len: 24570 microversion: 2.1 time: 0.133576 Aug 03 02:24:13.175199 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2865/5852] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:24:13 2022] POST /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21/action => generated 24570 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:24:13.320532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5ed5aab2-f111-4040-855d-870e7f50af89 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b12363ee0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:13.387249 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5ed5aab2-f111-4040-855d-870e7f50af89 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759" status: 200 len: 287 microversion: 2.1 time: 0.073526 Aug 03 02:24:13.388805 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2988/5853] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 3 02:24:13 2022] GET /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:14.401561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7df05483-94eb-499e-8e9d-96a92eae14f8 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b128a8ee0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:14.441476 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-7df05483-94eb-499e-8e9d-96a92eae14f8 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] HTTP exception thrown: Snapshot cf272a05-db93-4294-84ee-cd66b4d40759 could not be found. Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7df05483-94eb-499e-8e9d-96a92eae14f8 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Request method failure captured: Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759 HTTP/1.1 Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dxFLl0b0p2C-2dsYIN20Y-TV63qpI8tfV73fkmLLBI7fvdCCwKvDJ-bULVuM6vUUkg9VAQiTwZuRjqxWhJZ65Ha8cIZZiLCMao82Tfcxn7gQm1TVdbkcIG6cIJfH-LDuMpXE5WPd9tFJ1ArfkduORwbcwFp-m6C3gx2cv2N57Sh6lw Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: a74b5fb7b34f4c4dba4fb9b84ecd3f3a Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1256475085 Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a74b5fb7b34f4c4dba4fb9b84ecd3f3a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a74b5fb7b34f4c4dba4fb9b84ecd3f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a74b5fb7b34f4c4dba4fb9b84ecd3f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a74b5fb7b34f4c4dba4fb9b84ecd3f3a"}]}] Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1256475085 Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: a74b5fb7b34f4c4dba4fb9b84ecd3f3a Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1256475085 Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-VolumesSnapshotsTestJSON-1256475085-project Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 6bc5ebe34464494c96f1a099a76daa45 Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1256475085-project Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: exception: Snapshot cf272a05-db93-4294-84ee-cd66b4d40759 could not be found. Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'cf272a05-db93-4294-84ee-cd66b4d40759'} Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cf272a05-db93-4294-84ee-cd66b4d40759 could not be found. (HTTP 404) (Request-ID: req-75e4bc54-25f5-40a1-b472-2a150e44ddef) Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 02:24:14.460921 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cf272a05-db93-4294-84ee-cd66b4d40759 could not be found. Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cf272a05-db93-4294-84ee-cd66b4d40759 could not be found. Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cf272a05-db93-4294-84ee-cd66b4d40759 could not be found. Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7df05483-94eb-499e-8e9d-96a92eae14f8 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Returning 404 to user: Snapshot cf272a05-db93-4294-84ee-cd66b4d40759 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7df05483-94eb-499e-8e9d-96a92eae14f8 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759" status: 404 len: 111 microversion: 2.1 time: 0.069587 Aug 03 02:24:14.475252 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2866/5854] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 3 02:24:14 2022] GET /compute/v2.1/os-snapshots/cf272a05-db93-4294-84ee-cd66b4d40759 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:24:14.481028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4a548495-dcac-471c-8cd3-3b5982242507 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b12363790>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:14.586316 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4a548495-dcac-471c-8cd3-3b5982242507 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4" status: 202 len: 0 microversion: 2.1 time: 0.110675 Aug 03 02:24:14.587700 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2989/5855] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 02:24:14 2022] DELETE /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:24:14.600082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-142759c9-d453-4590-8325-4de51fe46576 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b244cd670>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:14.732839 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-142759c9-d453-4590-8325-4de51fe46576 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4" status: 200 len: 345 microversion: 2.1 time: 0.138973 Aug 03 02:24:14.736489 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2867/5856] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:24:14 2022] GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4 => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:15.762391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a0fcee4f-ed61-4f55-9897-a92753b49054 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b122208b0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:15.860149 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a0fcee4f-ed61-4f55-9897-a92753b49054 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4" status: 200 len: 345 microversion: 2.1 time: 0.111438 Aug 03 02:24:15.861764 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2990/5857] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:24:15 2022] GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4 => generated 345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:16.880256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-35822fed-a2fc-448a-b49e-ee0320ec83c6 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b1322ddc0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:17.004065 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-35822fed-a2fc-448a-b49e-ee0320ec83c6 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4" status: 200 len: 345 microversion: 2.1 time: 0.128095 Aug 03 02:24:17.004652 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2868/5858] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:24:16 2022] GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4 => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:18.021810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-523e8b2b-33c3-4a30-a9ce-12d74dc10fee tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b12383160>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:18.073212 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-523e8b2b-33c3-4a30-a9ce-12d74dc10fee tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] HTTP exception thrown: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-523e8b2b-33c3-4a30-a9ce-12d74dc10fee tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Request method failure captured: Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4 HTTP/1.1 Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dxFLl0b0p2C-2dsYIN20Y-TV63qpI8tfV73fkmLLBI7fvdCCwKvDJ-bULVuM6vUUkg9VAQiTwZuRjqxWhJZ65Ha8cIZZiLCMao82Tfcxn7gQm1TVdbkcIG6cIJfH-LDuMpXE5WPd9tFJ1ArfkduORwbcwFp-m6C3gx2cv2N57Sh6lw Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a74b5fb7b34f4c4dba4fb9b84ecd3f3a Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1256475085 Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a74b5fb7b34f4c4dba4fb9b84ecd3f3a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a74b5fb7b34f4c4dba4fb9b84ecd3f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a74b5fb7b34f4c4dba4fb9b84ecd3f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a74b5fb7b34f4c4dba4fb9b84ecd3f3a"}]}] Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1256475085 Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a74b5fb7b34f4c4dba4fb9b84ecd3f3a Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1256475085 Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-VolumesSnapshotsTestJSON-1256475085-project Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 6bc5ebe34464494c96f1a099a76daa45 Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1256475085-project Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: exception: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '4dd4f761-933e-4a49-bce5-fd4fb96d78c4'} Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. (HTTP 404) (Request-ID: req-248cb453-fee1-4bf5-a927-e19423a254ca) Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 02:24:18.076366 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. Aug 03 02:24:18.083557 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.090999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-523e8b2b-33c3-4a30-a9ce-12d74dc10fee tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Returning 404 to user: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:24:18.090999 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-523e8b2b-33c3-4a30-a9ce-12d74dc10fee tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4" status: 404 len: 109 microversion: 2.1 time: 0.067853 Aug 03 02:24:18.090999 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2991/5859] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:24:18 2022] GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:24:18.100023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0d963845-4c26-49e8-bfb3-5a91a59c588f tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b13b45a60>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:18.140329 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-0d963845-4c26-49e8-bfb3-5a91a59c588f tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] HTTP exception thrown: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0d963845-4c26-49e8-bfb3-5a91a59c588f tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Request method failure captured: Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4 HTTP/1.1 Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dxFLl0b0p2C-2dsYIN20Y-TV63qpI8tfV73fkmLLBI7fvdCCwKvDJ-bULVuM6vUUkg9VAQiTwZuRjqxWhJZ65Ha8cIZZiLCMao82Tfcxn7gQm1TVdbkcIG6cIJfH-LDuMpXE5WPd9tFJ1ArfkduORwbcwFp-m6C3gx2cv2N57Sh6lw Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: a74b5fb7b34f4c4dba4fb9b84ecd3f3a Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1256475085 Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a74b5fb7b34f4c4dba4fb9b84ecd3f3a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a74b5fb7b34f4c4dba4fb9b84ecd3f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a74b5fb7b34f4c4dba4fb9b84ecd3f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a74b5fb7b34f4c4dba4fb9b84ecd3f3a"}]}] Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1256475085 Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: a74b5fb7b34f4c4dba4fb9b84ecd3f3a Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1256475085 Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-VolumesSnapshotsTestJSON-1256475085-project Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 6bc5ebe34464494c96f1a099a76daa45 Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1256475085-project Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: exception: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '4dd4f761-933e-4a49-bce5-fd4fb96d78c4'} Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. (HTTP 404) (Request-ID: req-da65dff4-6aa7-4817-9aef-b0eba49f954b) Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 02:24:18.143473 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. Aug 03 02:24:18.148709 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.154935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0d963845-4c26-49e8-bfb3-5a91a59c588f tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Returning 404 to user: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:24:18.158931 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0d963845-4c26-49e8-bfb3-5a91a59c588f tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4" status: 404 len: 109 microversion: 2.1 time: 0.059065 Aug 03 02:24:18.166298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-059e3758-b540-4d71-9a69-3205c56abf60 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Calling method '.version_select at 0x7f5b1220b820>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:18.168772 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2869/5860] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 02:24:18 2022] DELETE /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:24:18.209687 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-059e3758-b540-4d71-9a69-3205c56abf60 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] HTTP exception thrown: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-059e3758-b540-4d71-9a69-3205c56abf60 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Request method failure captured: Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4 HTTP/1.1 Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dxFLl0b0p2C-2dsYIN20Y-TV63qpI8tfV73fkmLLBI7fvdCCwKvDJ-bULVuM6vUUkg9VAQiTwZuRjqxWhJZ65Ha8cIZZiLCMao82Tfcxn7gQm1TVdbkcIG6cIJfH-LDuMpXE5WPd9tFJ1ArfkduORwbcwFp-m6C3gx2cv2N57Sh6lw Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a74b5fb7b34f4c4dba4fb9b84ecd3f3a Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1256475085 Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a74b5fb7b34f4c4dba4fb9b84ecd3f3a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a74b5fb7b34f4c4dba4fb9b84ecd3f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a74b5fb7b34f4c4dba4fb9b84ecd3f3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a74b5fb7b34f4c4dba4fb9b84ecd3f3a"}]}] Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1256475085 Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a74b5fb7b34f4c4dba4fb9b84ecd3f3a Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1256475085 Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-VolumesSnapshotsTestJSON-1256475085-project Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 6bc5ebe34464494c96f1a099a76daa45 Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1256475085-project Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: exception: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '4dd4f761-933e-4a49-bce5-fd4fb96d78c4'} Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. (HTTP 404) (Request-ID: req-a57440ae-fb86-4d30-adf3-ccacc381cf37) Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 02:24:18.212237 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-059e3758-b540-4d71-9a69-3205c56abf60 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] Returning 404 to user: Volume 4dd4f761-933e-4a49-bce5-fd4fb96d78c4 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:24:18.217086 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-059e3758-b540-4d71-9a69-3205c56abf60 tempest-VolumesSnapshotsTestJSON-1256475085 tempest-VolumesSnapshotsTestJSON-1256475085-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4" status: 404 len: 109 microversion: 2.1 time: 0.052764 Aug 03 02:24:18.228275 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2992/5861] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:24:18 2022] GET /compute/v2.1/os-volumes/4dd4f761-933e-4a49-bce5-fd4fb96d78c4 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:24:22.051277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d6bcbdd4-336f-4908-a8e1-e9f31ceda3f0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:22.051811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d6bcbdd4-336f-4908-a8e1-e9f31ceda3f0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:22.064418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6bcbdd4-336f-4908-a8e1-e9f31ceda3f0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:22.064885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6bcbdd4-336f-4908-a8e1-e9f31ceda3f0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:22.065696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6bcbdd4-336f-4908-a8e1-e9f31ceda3f0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:22.066142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6bcbdd4-336f-4908-a8e1-e9f31ceda3f0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:22.154579 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d6bcbdd4-336f-4908-a8e1-e9f31ceda3f0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/ips" status: 200 len: 145 microversion: 2.1 time: 0.465827 Aug 03 02:24:22.155397 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2870/5862] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 02:24:21 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/ips => generated 145 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:24.130622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:24:24.141546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:24.170936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:24.172381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:24.175252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:24.175836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:24.377329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:24:24.378485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:24:24.380138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:24:24.380738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:24:24.387595 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:24:24.506589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:24.525292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:24.527393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:24.530449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:24.532769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:24.584163 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9673b02d-f5f7-4979-aed3-f047e4db1a9b tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21/action" status: 202 len: 1135 microversion: 2.1 time: 0.479555 Aug 03 02:24:24.598689 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2993/5863] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:24:24 2022] POST /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21/action => generated 1135 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 03 02:24:24.606571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a2dd3ed8-6f7e-403a-8e9c-8c91350c7b50 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:24.607880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a2dd3ed8-6f7e-403a-8e9c-8c91350c7b50 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:24.631785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2dd3ed8-6f7e-403a-8e9c-8c91350c7b50 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:24.632272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2dd3ed8-6f7e-403a-8e9c-8c91350c7b50 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:24.641785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2dd3ed8-6f7e-403a-8e9c-8c91350c7b50 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:24.643313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2dd3ed8-6f7e-403a-8e9c-8c91350c7b50 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:24.994288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d16638d7-2a06-4937-be47-70dcbb7bd2aa tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "298665c3-735c-419c-93b1-147a32eed0f4"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:24:24.998639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d16638d7-2a06-4937-be47-70dcbb7bd2aa tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:25.018665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d16638d7-2a06-4937-be47-70dcbb7bd2aa tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:25.021026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d16638d7-2a06-4937-be47-70dcbb7bd2aa tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:25.021832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d16638d7-2a06-4937-be47-70dcbb7bd2aa tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:25.022280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d16638d7-2a06-4937-be47-70dcbb7bd2aa tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:25.128401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a2dd3ed8-6f7e-403a-8e9c-8c91350c7b50 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:24:25.164321 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a2dd3ed8-6f7e-403a-8e9c-8c91350c7b50 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1688 microversion: 2.1 time: 0.561400 Aug 03 02:24:25.168374 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2871/5864] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:24:24 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1688 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:24:25.478364 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d16638d7-2a06-4937-be47-70dcbb7bd2aa tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "POST /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.499139 Aug 03 02:24:25.479165 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2994/5865] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:24:24 2022] POST /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments => generated 194 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:24:26.195102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ba3a695f-60fb-488a-a159-3146d182a8e6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:26.196112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ba3a695f-60fb-488a-a159-3146d182a8e6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:26.215251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba3a695f-60fb-488a-a159-3146d182a8e6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:26.215793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba3a695f-60fb-488a-a159-3146d182a8e6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:26.216772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba3a695f-60fb-488a-a159-3146d182a8e6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:26.217231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba3a695f-60fb-488a-a159-3146d182a8e6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:26.689326 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ba3a695f-60fb-488a-a159-3146d182a8e6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:24:26.708789 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ba3a695f-60fb-488a-a159-3146d182a8e6 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1688 microversion: 2.1 time: 0.518137 Aug 03 02:24:26.709959 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2872/5866] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:24:26 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1688 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:24:27.737602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4b4aa49f-406d-40a3-a88c-00fd13b0f27a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:27.738739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4b4aa49f-406d-40a3-a88c-00fd13b0f27a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:27.777952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b4aa49f-406d-40a3-a88c-00fd13b0f27a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:27.778661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b4aa49f-406d-40a3-a88c-00fd13b0f27a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:27.780082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b4aa49f-406d-40a3-a88c-00fd13b0f27a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:27.786075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4b4aa49f-406d-40a3-a88c-00fd13b0f27a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:28.180553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4b4aa49f-406d-40a3-a88c-00fd13b0f27a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:24:28.207101 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4b4aa49f-406d-40a3-a88c-00fd13b0f27a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1688 microversion: 2.1 time: 0.477928 Aug 03 02:24:28.219764 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2995/5867] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:24:27 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1688 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:24:29.236779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9f26e7f6-c68c-46f4-819f-6b8197990b28 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:29.237357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9f26e7f6-c68c-46f4-819f-6b8197990b28 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:29.256807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f26e7f6-c68c-46f4-819f-6b8197990b28 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:29.257343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f26e7f6-c68c-46f4-819f-6b8197990b28 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:29.258216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f26e7f6-c68c-46f4-819f-6b8197990b28 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:29.258667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9f26e7f6-c68c-46f4-819f-6b8197990b28 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:30.473365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9f26e7f6-c68c-46f4-819f-6b8197990b28 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:24:30.496009 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9f26e7f6-c68c-46f4-819f-6b8197990b28 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1688 microversion: 2.1 time: 1.263976 Aug 03 02:24:30.512347 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2873/5868] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:24:29 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1688 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:24:31.535344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f619d034-3c8f-4b95-849f-359c93bfbf31 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:31.537266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f619d034-3c8f-4b95-849f-359c93bfbf31 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:31.582173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f619d034-3c8f-4b95-849f-359c93bfbf31 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:31.583517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f619d034-3c8f-4b95-849f-359c93bfbf31 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:31.584992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f619d034-3c8f-4b95-849f-359c93bfbf31 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:31.585842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f619d034-3c8f-4b95-849f-359c93bfbf31 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:31.942950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f619d034-3c8f-4b95-849f-359c93bfbf31 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:24:31.955036 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f619d034-3c8f-4b95-849f-359c93bfbf31 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1688 microversion: 2.1 time: 0.432168 Aug 03 02:24:31.960577 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2996/5869] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:24:31 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1688 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:24:32.997359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e198356f-433e-47fe-9b50-00b239451419 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:32.998069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e198356f-433e-47fe-9b50-00b239451419 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:33.022928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e198356f-433e-47fe-9b50-00b239451419 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:33.022928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e198356f-433e-47fe-9b50-00b239451419 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:33.022928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e198356f-433e-47fe-9b50-00b239451419 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:33.022928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e198356f-433e-47fe-9b50-00b239451419 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:33.586839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e198356f-433e-47fe-9b50-00b239451419 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:24:33.605484 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e198356f-433e-47fe-9b50-00b239451419 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1688 microversion: 2.1 time: 0.613032 Aug 03 02:24:33.606282 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2874/5870] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:24:32 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1688 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:24:34.629178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ef17bb1b-b4cd-45a6-965b-fc4c753bb49a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:34.629810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ef17bb1b-b4cd-45a6-965b-fc4c753bb49a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:34.641585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef17bb1b-b4cd-45a6-965b-fc4c753bb49a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:34.651869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef17bb1b-b4cd-45a6-965b-fc4c753bb49a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:34.653119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef17bb1b-b4cd-45a6-965b-fc4c753bb49a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:34.657621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef17bb1b-b4cd-45a6-965b-fc4c753bb49a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:34.989098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ef17bb1b-b4cd-45a6-965b-fc4c753bb49a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:24:34.998688 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ef17bb1b-b4cd-45a6-965b-fc4c753bb49a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1688 microversion: 2.1 time: 0.374952 Aug 03 02:24:35.000095 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2997/5871] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:24:34 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1688 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:24:36.021792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-963d1324-05d2-45c5-8f5a-e62a73488151 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:36.022426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-963d1324-05d2-45c5-8f5a-e62a73488151 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:36.025620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=13 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:24:36.042574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-963d1324-05d2-45c5-8f5a-e62a73488151 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:36.043051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-963d1324-05d2-45c5-8f5a-e62a73488151 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:36.047793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-963d1324-05d2-45c5-8f5a-e62a73488151 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:36.048590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-963d1324-05d2-45c5-8f5a-e62a73488151 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:36.061457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=33 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:24:36.443157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-963d1324-05d2-45c5-8f5a-e62a73488151 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:24:36.455991 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-963d1324-05d2-45c5-8f5a-e62a73488151 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1688 microversion: 2.1 time: 0.438228 Aug 03 02:24:36.471800 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2875/5872] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:24:36 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1688 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:24:37.480932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d4070d99-a0e6-4fb2-b0d8-8f260f364112 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:37.481575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d4070d99-a0e6-4fb2-b0d8-8f260f364112 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:37.493761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4070d99-a0e6-4fb2-b0d8-8f260f364112 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:37.494227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4070d99-a0e6-4fb2-b0d8-8f260f364112 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:37.495067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4070d99-a0e6-4fb2-b0d8-8f260f364112 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:37.495519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d4070d99-a0e6-4fb2-b0d8-8f260f364112 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:37.945822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d4070d99-a0e6-4fb2-b0d8-8f260f364112 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:24:37.957731 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d4070d99-a0e6-4fb2-b0d8-8f260f364112 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1694 microversion: 2.1 time: 0.481347 Aug 03 02:24:37.960871 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2998/5873] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:24:37 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1694 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:24:38.987718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-676f852b-7f1a-4e9e-a58f-73137ed8f887 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:38.989129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-676f852b-7f1a-4e9e-a58f-73137ed8f887 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:39.005639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-676f852b-7f1a-4e9e-a58f-73137ed8f887 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:39.006437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-676f852b-7f1a-4e9e-a58f-73137ed8f887 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:39.008056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-676f852b-7f1a-4e9e-a58f-73137ed8f887 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:39.008744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-676f852b-7f1a-4e9e-a58f-73137ed8f887 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:39.401410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-676f852b-7f1a-4e9e-a58f-73137ed8f887 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:24:39.415543 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-676f852b-7f1a-4e9e-a58f-73137ed8f887 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1694 microversion: 2.1 time: 0.432480 Aug 03 02:24:39.417421 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2876/5874] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:24:38 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1694 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:24:40.445270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1fc30d2a-959b-42dc-af50-b45abfb81c35 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:40.446544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1fc30d2a-959b-42dc-af50-b45abfb81c35 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:40.471840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fc30d2a-959b-42dc-af50-b45abfb81c35 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:40.473130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fc30d2a-959b-42dc-af50-b45abfb81c35 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:40.474517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fc30d2a-959b-42dc-af50-b45abfb81c35 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:40.475197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fc30d2a-959b-42dc-af50-b45abfb81c35 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:40.800262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1fc30d2a-959b-42dc-af50-b45abfb81c35 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:24:40.815869 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1fc30d2a-959b-42dc-af50-b45abfb81c35 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1679 microversion: 2.1 time: 0.371465 Aug 03 02:24:40.816965 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 2999/5875] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:24:40 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1679 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:24:41.661494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e542bf14-108e-49cc-aef6-387f7b6124ac tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:41.664502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e542bf14-108e-49cc-aef6-387f7b6124ac tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:41.697363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e542bf14-108e-49cc-aef6-387f7b6124ac tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:41.705410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e542bf14-108e-49cc-aef6-387f7b6124ac tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:41.705410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e542bf14-108e-49cc-aef6-387f7b6124ac tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:41.705809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e542bf14-108e-49cc-aef6-387f7b6124ac tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:41.804740 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e542bf14-108e-49cc-aef6-387f7b6124ac tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147847 Aug 03 02:24:41.806508 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2877/5876] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:24:41 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:41.819058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6a545bd4-8ccd-4522-b5de-58cfe7cb4ec3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:41.819646 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6a545bd4-8ccd-4522-b5de-58cfe7cb4ec3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:41.843566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a545bd4-8ccd-4522-b5de-58cfe7cb4ec3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:41.844203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a545bd4-8ccd-4522-b5de-58cfe7cb4ec3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:41.845127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a545bd4-8ccd-4522-b5de-58cfe7cb4ec3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:41.845672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6a545bd4-8ccd-4522-b5de-58cfe7cb4ec3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:41.928128 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6a545bd4-8ccd-4522-b5de-58cfe7cb4ec3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments/298665c3-735c-419c-93b1-147a32eed0f4" status: 200 len: 194 microversion: 2.1 time: 0.108485 Aug 03 02:24:41.929412 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3000/5877] 10.222.0.67 () {58 vars in 1413 bytes} [Wed Aug 3 02:24:41 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments/298665c3-735c-419c-93b1-147a32eed0f4 => generated 194 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:42.356447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-f971dee8-ac18-48fe-958a-37544b24bb7d req-23f6f5be-96c3-48fa-8991-ebe6f12c6429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276f94ef-5142-4fd1-9844-cda0691ebd21", "name": "network-vif-plugged", "status": "completed", "tag": "265479f7-db45-494e-8d58-0d2282676ca6"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:24:42.383119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f971dee8-ac18-48fe-958a-37544b24bb7d req-23f6f5be-96c3-48fa-8991-ebe6f12c6429 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:42.393078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f971dee8-ac18-48fe-958a-37544b24bb7d req-23f6f5be-96c3-48fa-8991-ebe6f12c6429 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:42.440075 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-f971dee8-ac18-48fe-958a-37544b24bb7d req-23f6f5be-96c3-48fa-8991-ebe6f12c6429 service nova] Creating event network-vif-plugged:265479f7-db45-494e-8d58-0d2282676ca6 for instance 276f94ef-5142-4fd1-9844-cda0691ebd21 on n-h1-826529-8 Aug 03 02:24:42.456492 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-f971dee8-ac18-48fe-958a-37544b24bb7d req-23f6f5be-96c3-48fa-8991-ebe6f12c6429 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.504522 Aug 03 02:24:42.457924 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2878/5878] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:24:44.949553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b036f0a-b261-4b4c-a262-e16b97801f9e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b35c3ea1-71c0-4c86-8cba-c958027c54c5"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:24:44.952381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8b036f0a-b261-4b4c-a262-e16b97801f9e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:44.961260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b036f0a-b261-4b4c-a262-e16b97801f9e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:44.961920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b036f0a-b261-4b4c-a262-e16b97801f9e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:44.962933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b036f0a-b261-4b4c-a262-e16b97801f9e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:44.963536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b036f0a-b261-4b4c-a262-e16b97801f9e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:45.438277 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8b036f0a-b261-4b4c-a262-e16b97801f9e tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "POST /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492622 Aug 03 02:24:45.440012 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3001/5879] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:24:44 2022] POST /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments => generated 194 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:24:53.182279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=7 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:24:53.183003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=19 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:24:53.736974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6717bf85-aabb-4c27-8313-340787fa71ca tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:53.751935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6717bf85-aabb-4c27-8313-340787fa71ca tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:53.768766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6717bf85-aabb-4c27-8313-340787fa71ca tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:53.769320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6717bf85-aabb-4c27-8313-340787fa71ca tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:53.770230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6717bf85-aabb-4c27-8313-340787fa71ca tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:53.770688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6717bf85-aabb-4c27-8313-340787fa71ca tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:53.819588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6717bf85-aabb-4c27-8313-340787fa71ca tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:24:54.008924 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6717bf85-aabb-4c27-8313-340787fa71ca tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 204 len: 0 microversion: 2.1 time: 0.832530 Aug 03 02:24:54.010683 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2879/5880] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:24:53 2022] DELETE /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 0 bytes in 836 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:24:54.021158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2a5571f2-b356-4925-8405-a298a739f9c7 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:54.021885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2a5571f2-b356-4925-8405-a298a739f9c7 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:54.031839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=23 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:24:54.036043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2a5571f2-b356-4925-8405-a298a739f9c7 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:54.038000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2a5571f2-b356-4925-8405-a298a739f9c7 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:54.040224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2a5571f2-b356-4925-8405-a298a739f9c7 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:54.045002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2a5571f2-b356-4925-8405-a298a739f9c7 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:54.066711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:24:54.975089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2a5571f2-b356-4925-8405-a298a739f9c7 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:24:54.993404 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2a5571f2-b356-4925-8405-a298a739f9c7 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1731 microversion: 2.1 time: 0.977784 Aug 03 02:24:55.009435 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3002/5881] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:24:54 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1731 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:24:56.031493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-07f55859-6155-442f-9b71-8dd4cb6739d6 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:56.033167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-07f55859-6155-442f-9b71-8dd4cb6739d6 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:56.056128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07f55859-6155-442f-9b71-8dd4cb6739d6 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:56.057959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07f55859-6155-442f-9b71-8dd4cb6739d6 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:56.060404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07f55859-6155-442f-9b71-8dd4cb6739d6 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:56.062216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07f55859-6155-442f-9b71-8dd4cb6739d6 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:56.714395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-07f55859-6155-442f-9b71-8dd4cb6739d6 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:24:56.736714 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-07f55859-6155-442f-9b71-8dd4cb6739d6 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1731 microversion: 2.1 time: 0.715704 Aug 03 02:24:56.768552 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2880/5882] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:24:56 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1731 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:24:57.763284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b0b0b6d7-74dc-475c-83e2-ef65344e8bb0 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:57.765409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b0b0b6d7-74dc-475c-83e2-ef65344e8bb0 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:57.776586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0b0b6d7-74dc-475c-83e2-ef65344e8bb0 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:57.777935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0b0b6d7-74dc-475c-83e2-ef65344e8bb0 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:57.779114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0b0b6d7-74dc-475c-83e2-ef65344e8bb0 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:57.780475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0b0b6d7-74dc-475c-83e2-ef65344e8bb0 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:57.953805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b0b0b6d7-74dc-475c-83e2-ef65344e8bb0 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:24:57.974210 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b0b0b6d7-74dc-475c-83e2-ef65344e8bb0 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1663 microversion: 2.1 time: 0.217328 Aug 03 02:24:57.988113 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3003/5883] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:24:57 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1663 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:24:59.001317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-277d8c13-2f75-4a84-b614-4d1597f0595a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:24:59.002486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-277d8c13-2f75-4a84-b614-4d1597f0595a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:24:59.018528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-277d8c13-2f75-4a84-b614-4d1597f0595a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:59.019521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-277d8c13-2f75-4a84-b614-4d1597f0595a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:59.022805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-277d8c13-2f75-4a84-b614-4d1597f0595a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:59.023531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-277d8c13-2f75-4a84-b614-4d1597f0595a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:59.341427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-b7a2daa0-55c9-427d-8a92-2c0fb3aba64f req-79712ddd-3a21-40b3-90b6-0d1b400fb47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a", "name": "network-vif-deleted", "tag": "569a4598-8a31-4c72-bdf1-8a8ce109284c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:24:59.367822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b7a2daa0-55c9-427d-8a92-2c0fb3aba64f req-79712ddd-3a21-40b3-90b6-0d1b400fb47e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:24:59.368574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b7a2daa0-55c9-427d-8a92-2c0fb3aba64f req-79712ddd-3a21-40b3-90b6-0d1b400fb47e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:24:59.397273 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-b7a2daa0-55c9-427d-8a92-2c0fb3aba64f req-79712ddd-3a21-40b3-90b6-0d1b400fb47e service nova] Creating event network-vif-deleted:569a4598-8a31-4c72-bdf1-8a8ce109284c for instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a on n-h1-826529-8 Aug 03 02:24:59.407361 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-b7a2daa0-55c9-427d-8a92-2c0fb3aba64f req-79712ddd-3a21-40b3-90b6-0d1b400fb47e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.363036 Aug 03 02:24:59.413234 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3004/5884] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:24:59.454534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-277d8c13-2f75-4a84-b614-4d1597f0595a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d46abfe97b454e88b51d6cb9255b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7548c1d33d8843adb6ee18ab605dce49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:24:59.469225 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-277d8c13-2f75-4a84-b614-4d1597f0595a tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 200 len: 1663 microversion: 2.1 time: 0.473121 Aug 03 02:24:59.470441 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2881/5885] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:24:58 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 1663 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:24:59.946947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1368883043", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:25:00.126848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] validate_networks() for None {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:25:00.492642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3ee541ce-5721-4856-9dc3-e95c2e6ea701 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:00.494845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3ee541ce-5721-4856-9dc3-e95c2e6ea701 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:00.510784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ee541ce-5721-4856-9dc3-e95c2e6ea701 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:00.512765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ee541ce-5721-4856-9dc3-e95c2e6ea701 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:00.516980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ee541ce-5721-4856-9dc3-e95c2e6ea701 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:00.516980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ee541ce-5721-4856-9dc3-e95c2e6ea701 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:00.550181 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-3ee541ce-5721-4856-9dc3-e95c2e6ea701 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] HTTP exception thrown: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3ee541ce-5721-4856-9dc3-e95c2e6ea701 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Request method failure captured: Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a HTTP/1.1 Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dsrsX5LjEbYOQXjwlbfqfqtVJvaLNpkvd3OHAHtuTrti1hWZsTDCL2xrvYT5_3wDw5mY04jNTDrsiM0EO3wVoSdLjKsUQPLXZX8Ct8QUNx7bW7IT63UAqOMlBeRb9Ht5KtW3ViA0nPGgbtzbWIaRNd95bFvpenSGGKuT78tcxgyvA8 Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 7548c1d33d8843adb6ee18ab605dce49 Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestServerBasicOps-527074844 Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7548c1d33d8843adb6ee18ab605dce49", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7548c1d33d8843adb6ee18ab605dce49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7548c1d33d8843adb6ee18ab605dce49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7548c1d33d8843adb6ee18ab605dce49"}]}] Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestServerBasicOps-527074844 Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 7548c1d33d8843adb6ee18ab605dce49 Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestServerBasicOps-527074844 Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestServerBasicOps-527074844-project Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 54d46abfe97b454e88b51d6cb9255b50 Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestServerBasicOps-527074844-project Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a'} Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:00.553073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:00.559109 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:00.559109 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:00.559109 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:00.559109 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:25:00.559109 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:25:00.559109 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. Aug 03 02:25:00.559109 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:00.561467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3ee541ce-5721-4856-9dc3-e95c2e6ea701 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Returning 404 to user: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:25:00.563184 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3ee541ce-5721-4856-9dc3-e95c2e6ea701 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 404 len: 111 microversion: 2.1 time: 0.075605 Aug 03 02:25:00.564532 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2882/5886] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:00 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:25:00.943799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:25:00.944275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:25:00.944703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:25:00.945120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:25:00.945543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:25:00.966655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:00.968144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:00.969087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:00.970364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:01.007547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Getting quotas for project d6ea705606444b7e906afe4e148b2659. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:25:01.014993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Getting quotas for user 175889c171da4844aad6576129d12084 and project d6ea705606444b7e906afe4e148b2659. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:25:01.031560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:25:01.036941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:25:01.116686 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-50f290b7-f0e7-4830-a728-f641b92611af tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.182248 Aug 03 02:25:01.118515 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3005/5887] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:24:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:25:01.135294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-48b2fd45-e364-4f50-a09a-9079629ab765 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:01.135939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-48b2fd45-e364-4f50-a09a-9079629ab765 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:01.268411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-48b2fd45-e364-4f50-a09a-9079629ab765 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175889c171da4844aad6576129d12084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ea705606444b7e906afe4e148b2659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:01.278883 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-48b2fd45-e364-4f50-a09a-9079629ab765 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256" status: 200 len: 1214 microversion: 2.1 time: 0.151740 Aug 03 02:25:01.280232 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2883/5888] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:01 2022] GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:01.744525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6ce7e63a-a2c3-4a21-abce-3659dbd63add tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:01.745197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6ce7e63a-a2c3-4a21-abce-3659dbd63add tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:01.764245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ce7e63a-a2c3-4a21-abce-3659dbd63add tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:01.766340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ce7e63a-a2c3-4a21-abce-3659dbd63add tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:01.770260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ce7e63a-a2c3-4a21-abce-3659dbd63add tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:01.770831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ce7e63a-a2c3-4a21-abce-3659dbd63add tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:01.821070 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-6ce7e63a-a2c3-4a21-abce-3659dbd63add tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] HTTP exception thrown: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6ce7e63a-a2c3-4a21-abce-3659dbd63add tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Request method failure captured: Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a HTTP/1.1 Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dsrsX5LjEbYOQXjwlbfqfqtVJvaLNpkvd3OHAHtuTrti1hWZsTDCL2xrvYT5_3wDw5mY04jNTDrsiM0EO3wVoSdLjKsUQPLXZX8Ct8QUNx7bW7IT63UAqOMlBeRb9Ht5KtW3ViA0nPGgbtzbWIaRNd95bFvpenSGGKuT78tcxgyvA8 Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 7548c1d33d8843adb6ee18ab605dce49 Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestServerBasicOps-527074844 Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7548c1d33d8843adb6ee18ab605dce49", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7548c1d33d8843adb6ee18ab605dce49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7548c1d33d8843adb6ee18ab605dce49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7548c1d33d8843adb6ee18ab605dce49"}]}] Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestServerBasicOps-527074844 Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 7548c1d33d8843adb6ee18ab605dce49 Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestServerBasicOps-527074844 Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestServerBasicOps-527074844-project Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 54d46abfe97b454e88b51d6cb9255b50 Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestServerBasicOps-527074844-project Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a'} Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:25:01.833322 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:25:01.837523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. Aug 03 02:25:01.837523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:25:01.837523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:01.837523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:25:01.837523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:01.837523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:01.837523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:01.837523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:25:01.837523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:25:01.837523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. Aug 03 02:25:01.837523 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:25:01.837523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6ce7e63a-a2c3-4a21-abce-3659dbd63add tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Returning 404 to user: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:25:01.837523 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6ce7e63a-a2c3-4a21-abce-3659dbd63add tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 404 len: 111 microversion: 2.1 time: 0.096369 Aug 03 02:25:01.838605 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3006/5889] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:25:01 2022] DELETE /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:25:01.844514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a615b4d8-2019-4529-aec5-99affae8bb26 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:01.845029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a615b4d8-2019-4529-aec5-99affae8bb26 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] [instance: ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:01.853436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a615b4d8-2019-4529-aec5-99affae8bb26 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:01.854379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a615b4d8-2019-4529-aec5-99affae8bb26 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:01.855769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a615b4d8-2019-4529-aec5-99affae8bb26 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:01.856817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a615b4d8-2019-4529-aec5-99affae8bb26 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:01.878939 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-a615b4d8-2019-4529-aec5-99affae8bb26 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] HTTP exception thrown: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a615b4d8-2019-4529-aec5-99affae8bb26 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Request method failure captured: Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a HTTP/1.1 Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dsrsX5LjEbYOQXjwlbfqfqtVJvaLNpkvd3OHAHtuTrti1hWZsTDCL2xrvYT5_3wDw5mY04jNTDrsiM0EO3wVoSdLjKsUQPLXZX8Ct8QUNx7bW7IT63UAqOMlBeRb9Ht5KtW3ViA0nPGgbtzbWIaRNd95bFvpenSGGKuT78tcxgyvA8 Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 7548c1d33d8843adb6ee18ab605dce49 Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestServerBasicOps-527074844 Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7548c1d33d8843adb6ee18ab605dce49", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7548c1d33d8843adb6ee18ab605dce49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7548c1d33d8843adb6ee18ab605dce49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7548c1d33d8843adb6ee18ab605dce49"}]}] Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestServerBasicOps-527074844 Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 7548c1d33d8843adb6ee18ab605dce49 Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestServerBasicOps-527074844 Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestServerBasicOps-527074844-project Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 54d46abfe97b454e88b51d6cb9255b50 Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestServerBasicOps-527074844-project Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a'} Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:01.880799 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:01.885579 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:01.885579 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:01.885579 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:01.885579 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:25:01.885579 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:25:01.885579 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. Aug 03 02:25:01.885579 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:01.889711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a615b4d8-2019-4529-aec5-99affae8bb26 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Returning 404 to user: Instance ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:25:01.889711 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a615b4d8-2019-4529-aec5-99affae8bb26 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a" status: 404 len: 111 microversion: 2.1 time: 0.048509 Aug 03 02:25:01.893826 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2884/5890] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:01 2022] GET /compute/v2.1/servers/ec5b89ff-9a13-4aa1-8748-5d3e8bf8574a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:25:02.305519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-84afde16-2df0-4cfe-8ce4-65562a8a3a67 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:02.306169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-84afde16-2df0-4cfe-8ce4-65562a8a3a67 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:02.406231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-84afde16-2df0-4cfe-8ce4-65562a8a3a67 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175889c171da4844aad6576129d12084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ea705606444b7e906afe4e148b2659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:02.420672 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-84afde16-2df0-4cfe-8ce4-65562a8a3a67 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256" status: 200 len: 1214 microversion: 2.1 time: 0.118312 Aug 03 02:25:02.421768 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3007/5891] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:02 2022] GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:02.466449 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d117a444-18cf-4dcb-8a9a-d833bce45715 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] Calling method '.version_select at 0x7f5b132a38b0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:02.526226 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d117a444-18cf-4dcb-8a9a-d833bce45715 tempest-TestServerBasicOps-527074844 tempest-TestServerBasicOps-527074844-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1904189166" status: 202 len: 0 microversion: 2.1 time: 0.064091 Aug 03 02:25:02.526833 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2885/5892] 10.222.0.67 () {58 vars in 1254 bytes} [Wed Aug 3 02:25:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1904189166 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:25:03.441978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-68050f92-f312-4811-9739-f240f1f69f09 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:03.444040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-68050f92-f312-4811-9739-f240f1f69f09 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:03.453422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68050f92-f312-4811-9739-f240f1f69f09 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:03.453864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68050f92-f312-4811-9739-f240f1f69f09 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:03.454780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68050f92-f312-4811-9739-f240f1f69f09 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:03.465931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68050f92-f312-4811-9739-f240f1f69f09 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:03.706407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-68050f92-f312-4811-9739-f240f1f69f09 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175889c171da4844aad6576129d12084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ea705606444b7e906afe4e148b2659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:03.720641 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-68050f92-f312-4811-9739-f240f1f69f09 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256" status: 200 len: 1274 microversion: 2.1 time: 0.282523 Aug 03 02:25:03.721631 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3008/5893] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:03 2022] GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 => generated 1274 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:04.292944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0c2d1f3-56b9-45fa-b3f7-1218197dc855 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:04.296164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0c2d1f3-56b9-45fa-b3f7-1218197dc855 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:04.310086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0c2d1f3-56b9-45fa-b3f7-1218197dc855 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:04.311152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0c2d1f3-56b9-45fa-b3f7-1218197dc855 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:04.312981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0c2d1f3-56b9-45fa-b3f7-1218197dc855 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:04.313655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0c2d1f3-56b9-45fa-b3f7-1218197dc855 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:04.353358 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0c2d1f3-56b9-45fa-b3f7-1218197dc855 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.064455 Aug 03 02:25:04.361863 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2886/5894] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:25:04 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:25:04.536427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b82e607f-8cbb-447b-85d1-ab23f17c95a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:04.541467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b82e607f-8cbb-447b-85d1-ab23f17c95a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:04.580882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b82e607f-8cbb-447b-85d1-ab23f17c95a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:04.584795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b82e607f-8cbb-447b-85d1-ab23f17c95a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:04.587458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b82e607f-8cbb-447b-85d1-ab23f17c95a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:04.589910 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b82e607f-8cbb-447b-85d1-ab23f17c95a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:04.734602 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b82e607f-8cbb-447b-85d1-ab23f17c95a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments/298665c3-735c-419c-93b1-147a32eed0f4" status: 200 len: 194 microversion: 2.1 time: 0.227917 Aug 03 02:25:04.742749 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3009/5895] 10.222.0.67 () {58 vars in 1413 bytes} [Wed Aug 3 02:25:04 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments/298665c3-735c-419c-93b1-147a32eed0f4 => generated 194 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:25:04.747006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e64bf5d8-933b-4552-96b7-a4031b19f0cd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:04.747756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e64bf5d8-933b-4552-96b7-a4031b19f0cd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:04.757104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5cb1aecd-14e7-4ed2-996d-af80edb1960c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:04.765099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5cb1aecd-14e7-4ed2-996d-af80edb1960c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:04.791734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e64bf5d8-933b-4552-96b7-a4031b19f0cd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:04.794461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e64bf5d8-933b-4552-96b7-a4031b19f0cd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:04.799159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e64bf5d8-933b-4552-96b7-a4031b19f0cd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:04.800277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5cb1aecd-14e7-4ed2-996d-af80edb1960c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:04.800865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5cb1aecd-14e7-4ed2-996d-af80edb1960c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:04.801368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e64bf5d8-933b-4552-96b7-a4031b19f0cd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:04.801744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5cb1aecd-14e7-4ed2-996d-af80edb1960c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:04.802283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5cb1aecd-14e7-4ed2-996d-af80edb1960c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:04.990351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-5cb1aecd-14e7-4ed2-996d-af80edb1960c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lazy-loading 'services' on Instance uuid 1a1d1216-dd0a-4189-894a-71d2a856af52 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:25:05.002506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e64bf5d8-933b-4552-96b7-a4031b19f0cd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175889c171da4844aad6576129d12084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ea705606444b7e906afe4e148b2659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:05.013209 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e64bf5d8-933b-4552-96b7-a4031b19f0cd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256" status: 200 len: 1272 microversion: 2.1 time: 0.271560 Aug 03 02:25:05.014385 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2887/5896] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:04 2022] GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:05.166141 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5cb1aecd-14e7-4ed2-996d-af80edb1960c tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments/298665c3-735c-419c-93b1-147a32eed0f4" status: 202 len: 0 microversion: 2.1 time: 0.421477 Aug 03 02:25:05.167148 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3010/5897] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:25:04 2022] DELETE /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments/298665c3-735c-419c-93b1-147a32eed0f4 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:25:06.041680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d4389bca-6a94-4198-abd4-e49674031c24 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:06.043747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d4389bca-6a94-4198-abd4-e49674031c24 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:06.069801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4389bca-6a94-4198-abd4-e49674031c24 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:06.071435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4389bca-6a94-4198-abd4-e49674031c24 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:06.073451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4389bca-6a94-4198-abd4-e49674031c24 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:06.073918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4389bca-6a94-4198-abd4-e49674031c24 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:06.479984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d4389bca-6a94-4198-abd4-e49674031c24 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175889c171da4844aad6576129d12084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ea705606444b7e906afe4e148b2659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:06.492207 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d4389bca-6a94-4198-abd4-e49674031c24 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256" status: 200 len: 1314 microversion: 2.1 time: 0.457927 Aug 03 02:25:06.510682 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2888/5898] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:06 2022] GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:07.517955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f79df17e-540a-433e-b199-0fd869e99138 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:07.521028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f79df17e-540a-433e-b199-0fd869e99138 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:07.570251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f79df17e-540a-433e-b199-0fd869e99138 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:07.573711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f79df17e-540a-433e-b199-0fd869e99138 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:07.574558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f79df17e-540a-433e-b199-0fd869e99138 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:07.575031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f79df17e-540a-433e-b199-0fd869e99138 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:08.527750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f79df17e-540a-433e-b199-0fd869e99138 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175889c171da4844aad6576129d12084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ea705606444b7e906afe4e148b2659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:08.550386 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f79df17e-540a-433e-b199-0fd869e99138 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256" status: 200 len: 1314 microversion: 2.1 time: 1.037414 Aug 03 02:25:08.551049 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3011/5899] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:07 2022] GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 => generated 1314 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:08.858630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ba6c9d3f-f1e5-41bd-a916-e580084a7bd8 req-fbb5c957-16f4-4c92-aba2-43757cd24fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23a0131f-6428-4e35-8bde-d82625b92256", "tag": "461ac1b0-75db-4cc5-b35b-bdd7f9e8657b"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:25:08.886392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ba6c9d3f-f1e5-41bd-a916-e580084a7bd8 req-fbb5c957-16f4-4c92-aba2-43757cd24fb5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:08.886856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ba6c9d3f-f1e5-41bd-a916-e580084a7bd8 req-fbb5c957-16f4-4c92-aba2-43757cd24fb5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:08.922795 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ba6c9d3f-f1e5-41bd-a916-e580084a7bd8 req-fbb5c957-16f4-4c92-aba2-43757cd24fb5 service nova] Creating event network-changed:461ac1b0-75db-4cc5-b35b-bdd7f9e8657b for instance 23a0131f-6428-4e35-8bde-d82625b92256 on n-h1-826529-8 Aug 03 02:25:08.933906 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ba6c9d3f-f1e5-41bd-a916-e580084a7bd8 req-fbb5c957-16f4-4c92-aba2-43757cd24fb5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081505 Aug 03 02:25:08.941909 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2889/5900] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 03 02:25:09.575221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3eb506e5-a51f-4cda-9db5-e5c8bfa900a1 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:09.576483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3eb506e5-a51f-4cda-9db5-e5c8bfa900a1 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:09.595194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3eb506e5-a51f-4cda-9db5-e5c8bfa900a1 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:09.595836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3eb506e5-a51f-4cda-9db5-e5c8bfa900a1 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:09.596841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3eb506e5-a51f-4cda-9db5-e5c8bfa900a1 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:09.597376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3eb506e5-a51f-4cda-9db5-e5c8bfa900a1 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:10.365933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3eb506e5-a51f-4cda-9db5-e5c8bfa900a1 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175889c171da4844aad6576129d12084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ea705606444b7e906afe4e148b2659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:10.390536 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3eb506e5-a51f-4cda-9db5-e5c8bfa900a1 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256" status: 200 len: 1314 microversion: 2.1 time: 0.814141 Aug 03 02:25:10.392465 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3012/5901] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:09 2022] GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 => generated 1314 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:11.274147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:25:11.413619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9d958698-f8cc-429e-9151-af654842e14d tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:11.414931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9d958698-f8cc-429e-9151-af654842e14d tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:11.418558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:25:11.432194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d958698-f8cc-429e-9151-af654842e14d tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:11.445840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d958698-f8cc-429e-9151-af654842e14d tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:11.447997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d958698-f8cc-429e-9151-af654842e14d tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:11.454370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9d958698-f8cc-429e-9151-af654842e14d tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:11.673025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a4d13fbd-a71d-44dc-9f2f-9e1e6a5db17c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:25:11.675836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a4d13fbd-a71d-44dc-9f2f-9e1e6a5db17c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:11.683087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4d13fbd-a71d-44dc-9f2f-9e1e6a5db17c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:11.684400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4d13fbd-a71d-44dc-9f2f-9e1e6a5db17c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:11.686381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4d13fbd-a71d-44dc-9f2f-9e1e6a5db17c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:11.687043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4d13fbd-a71d-44dc-9f2f-9e1e6a5db17c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:11.757778 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a4d13fbd-a71d-44dc-9f2f-9e1e6a5db17c tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "POST /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21/action" status: 200 len: 24564 microversion: 2.1 time: 0.574589 Aug 03 02:25:11.759219 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2890/5902] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:25:11 2022] POST /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21/action => generated 24564 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 02:25:12.186922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9d958698-f8cc-429e-9151-af654842e14d tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175889c171da4844aad6576129d12084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ea705606444b7e906afe4e148b2659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:12.214107 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9d958698-f8cc-429e-9151-af654842e14d tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256" status: 200 len: 1314 microversion: 2.1 time: 0.804374 Aug 03 02:25:12.218475 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3013/5903] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:11 2022] GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:13.245337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4eb75156-dc82-40f0-8133-df362982e315 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:13.246076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4eb75156-dc82-40f0-8133-df362982e315 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:13.264166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eb75156-dc82-40f0-8133-df362982e315 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:13.264615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eb75156-dc82-40f0-8133-df362982e315 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:13.265435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eb75156-dc82-40f0-8133-df362982e315 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:13.266366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4eb75156-dc82-40f0-8133-df362982e315 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:13.300548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-85247bf2-1cd5-4ff6-be0c-f1d52fc29cc1 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:13.301697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-85247bf2-1cd5-4ff6-be0c-f1d52fc29cc1 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:13.312966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:25:13.316150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85247bf2-1cd5-4ff6-be0c-f1d52fc29cc1 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:13.317434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85247bf2-1cd5-4ff6-be0c-f1d52fc29cc1 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:13.318431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85247bf2-1cd5-4ff6-be0c-f1d52fc29cc1 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:13.319125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85247bf2-1cd5-4ff6-be0c-f1d52fc29cc1 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:13.355105 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-85247bf2-1cd5-4ff6-be0c-f1d52fc29cc1 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments/b35c3ea1-71c0-4c86-8cba-c958027c54c5" status: 200 len: 194 microversion: 2.1 time: 0.058684 Aug 03 02:25:13.356023 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3014/5904] 10.222.0.67 () {58 vars in 1413 bytes} [Wed Aug 3 02:25:13 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments/b35c3ea1-71c0-4c86-8cba-c958027c54c5 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:25:13.367857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-55a45c5c-699b-4398-a187-049f6ada6701 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:13.368750 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-55a45c5c-699b-4398-a187-049f6ada6701 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:13.378191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55a45c5c-699b-4398-a187-049f6ada6701 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:13.378877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55a45c5c-699b-4398-a187-049f6ada6701 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:13.379878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55a45c5c-699b-4398-a187-049f6ada6701 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:13.380495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55a45c5c-699b-4398-a187-049f6ada6701 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:13.511217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-55a45c5c-699b-4398-a187-049f6ada6701 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lazy-loading 'services' on Instance uuid 1a1d1216-dd0a-4189-894a-71d2a856af52 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:25:13.569361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4eb75156-dc82-40f0-8133-df362982e315 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175889c171da4844aad6576129d12084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ea705606444b7e906afe4e148b2659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:13.597794 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4eb75156-dc82-40f0-8133-df362982e315 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256" status: 200 len: 1314 microversion: 2.1 time: 0.358991 Aug 03 02:25:13.598867 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2891/5905] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:13 2022] GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:13.665037 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-55a45c5c-699b-4398-a187-049f6ada6701 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments/b35c3ea1-71c0-4c86-8cba-c958027c54c5" status: 202 len: 0 microversion: 2.1 time: 0.301382 Aug 03 02:25:13.665713 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3015/5906] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:25:13 2022] DELETE /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments/b35c3ea1-71c0-4c86-8cba-c958027c54c5 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 02:25:13.948362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-90d4f4fb-a866-4af2-99e9-7e415125ac33 req-dbf0b2fb-0ce0-4348-a835-de02b85d9846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a0131f-6428-4e35-8bde-d82625b92256", "name": "network-vif-plugged", "status": "completed", "tag": "461ac1b0-75db-4cc5-b35b-bdd7f9e8657b"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:25:13.968153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-90d4f4fb-a866-4af2-99e9-7e415125ac33 req-dbf0b2fb-0ce0-4348-a835-de02b85d9846 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:13.968883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-90d4f4fb-a866-4af2-99e9-7e415125ac33 req-dbf0b2fb-0ce0-4348-a835-de02b85d9846 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:13.986179 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-90d4f4fb-a866-4af2-99e9-7e415125ac33 req-dbf0b2fb-0ce0-4348-a835-de02b85d9846 service nova] Creating event network-vif-plugged:461ac1b0-75db-4cc5-b35b-bdd7f9e8657b for instance 23a0131f-6428-4e35-8bde-d82625b92256 on n-h1-826529-8 Aug 03 02:25:13.992079 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-90d4f4fb-a866-4af2-99e9-7e415125ac33 req-dbf0b2fb-0ce0-4348-a835-de02b85d9846 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059532 Aug 03 02:25:13.994810 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2892/5907] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:25:14.629354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bcb7ba55-ef16-4515-867a-55639fac2ccd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:14.630497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bcb7ba55-ef16-4515-867a-55639fac2ccd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:14.642635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcb7ba55-ef16-4515-867a-55639fac2ccd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:14.647057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcb7ba55-ef16-4515-867a-55639fac2ccd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:14.647967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcb7ba55-ef16-4515-867a-55639fac2ccd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:14.652732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcb7ba55-ef16-4515-867a-55639fac2ccd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:15.458299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bcb7ba55-ef16-4515-867a-55639fac2ccd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175889c171da4844aad6576129d12084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ea705606444b7e906afe4e148b2659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:15.472512 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bcb7ba55-ef16-4515-867a-55639fac2ccd tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256" status: 200 len: 1314 microversion: 2.1 time: 0.852821 Aug 03 02:25:15.475522 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3016/5908] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:14 2022] GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 => generated 1314 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:16.501692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25848283-efb4-4a60-9c98-03f843600b41 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:16.502422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-25848283-efb4-4a60-9c98-03f843600b41 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:16.520754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25848283-efb4-4a60-9c98-03f843600b41 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:16.521209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25848283-efb4-4a60-9c98-03f843600b41 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:16.522227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25848283-efb4-4a60-9c98-03f843600b41 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:16.522876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25848283-efb4-4a60-9c98-03f843600b41 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:16.878165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-25848283-efb4-4a60-9c98-03f843600b41 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175889c171da4844aad6576129d12084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ea705606444b7e906afe4e148b2659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:16.899767 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-25848283-efb4-4a60-9c98-03f843600b41 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256" status: 200 len: 1463 microversion: 2.1 time: 0.403714 Aug 03 02:25:16.900416 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2893/5909] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:16 2022] GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 => generated 1463 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:16.925707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc6b5cf2-c474-42b0-9e3e-4bc74624b2f8 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db9a8680-ebba-4b47-a937-000f628267e0", "device": "/dev/sdb"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:25:16.928238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fc6b5cf2-c474-42b0-9e3e-4bc74624b2f8 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:16.951421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc6b5cf2-c474-42b0-9e3e-4bc74624b2f8 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:16.952025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc6b5cf2-c474-42b0-9e3e-4bc74624b2f8 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:16.952997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc6b5cf2-c474-42b0-9e3e-4bc74624b2f8 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:16.953484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc6b5cf2-c474-42b0-9e3e-4bc74624b2f8 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:17.458474 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fc6b5cf2-c474-42b0-9e3e-4bc74624b2f8 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "POST /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538878 Aug 03 02:25:17.459164 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3017/5910] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:25:16 2022] POST /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256/os-volume_attachments => generated 194 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:25:19.867012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-09899a46-5633-4642-bbba-f91cb840c2dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:19.869915 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-09899a46-5633-4642-bbba-f91cb840c2dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:19.878133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09899a46-5633-4642-bbba-f91cb840c2dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:19.883483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09899a46-5633-4642-bbba-f91cb840c2dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:19.884759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09899a46-5633-4642-bbba-f91cb840c2dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:19.885413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-09899a46-5633-4642-bbba-f91cb840c2dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:19.986441 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-09899a46-5633-4642-bbba-f91cb840c2dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123570 Aug 03 02:25:19.987387 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2894/5911] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:25:19 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:25:20.226107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5748c40e-0ebd-4248-935a-bdcf867b030d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:20.229211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5748c40e-0ebd-4248-935a-bdcf867b030d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:20.242220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5748c40e-0ebd-4248-935a-bdcf867b030d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:20.247057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5748c40e-0ebd-4248-935a-bdcf867b030d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:20.250108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5748c40e-0ebd-4248-935a-bdcf867b030d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:20.252890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5748c40e-0ebd-4248-935a-bdcf867b030d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:20.323319 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5748c40e-0ebd-4248-935a-bdcf867b030d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102468 Aug 03 02:25:20.333973 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3018/5912] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:25:20 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:25:20.443695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-280479e8-a899-4093-aef3-12c91d84b1dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:20.444252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-280479e8-a899-4093-aef3-12c91d84b1dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:20.453006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-280479e8-a899-4093-aef3-12c91d84b1dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:20.454171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-280479e8-a899-4093-aef3-12c91d84b1dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:20.455244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-280479e8-a899-4093-aef3-12c91d84b1dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:20.455883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-280479e8-a899-4093-aef3-12c91d84b1dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:20.537290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-280479e8-a899-4093-aef3-12c91d84b1dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:25:20.725032 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-280479e8-a899-4093-aef3-12c91d84b1dd tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 204 len: 0 microversion: 2.1 time: 0.284299 Aug 03 02:25:20.730994 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2895/5913] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:25:20 2022] DELETE /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:25:20.738868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7135e57f-d33b-48e3-9938-eaabf2a5c818 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:20.739983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7135e57f-d33b-48e3-9938-eaabf2a5c818 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:20.767543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7135e57f-d33b-48e3-9938-eaabf2a5c818 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:20.768030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7135e57f-d33b-48e3-9938-eaabf2a5c818 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:20.771904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7135e57f-d33b-48e3-9938-eaabf2a5c818 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:20.774981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7135e57f-d33b-48e3-9938-eaabf2a5c818 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:20.784224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:25:21.173545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7135e57f-d33b-48e3-9938-eaabf2a5c818 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:21.188394 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7135e57f-d33b-48e3-9938-eaabf2a5c818 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1673 microversion: 2.1 time: 0.455018 Aug 03 02:25:21.189243 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3019/5914] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:20 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1673 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:22.215832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0282dec9-d32f-42f6-9c5c-1e47be876fe0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:22.217575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0282dec9-d32f-42f6-9c5c-1e47be876fe0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:22.235568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0282dec9-d32f-42f6-9c5c-1e47be876fe0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:22.236115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0282dec9-d32f-42f6-9c5c-1e47be876fe0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:22.236999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0282dec9-d32f-42f6-9c5c-1e47be876fe0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:22.237521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0282dec9-d32f-42f6-9c5c-1e47be876fe0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:22.633034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0282dec9-d32f-42f6-9c5c-1e47be876fe0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:22.644282 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0282dec9-d32f-42f6-9c5c-1e47be876fe0 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1673 microversion: 2.1 time: 0.432755 Aug 03 02:25:22.648115 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2896/5915] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:22 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1673 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:23.673182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-06405732-4893-43e0-a57b-5267b112c1a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:23.674124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-06405732-4893-43e0-a57b-5267b112c1a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:23.700147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06405732-4893-43e0-a57b-5267b112c1a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:23.704477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06405732-4893-43e0-a57b-5267b112c1a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:23.705481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06405732-4893-43e0-a57b-5267b112c1a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:23.706034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06405732-4893-43e0-a57b-5267b112c1a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:24.742057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-06405732-4893-43e0-a57b-5267b112c1a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:24.754809 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-06405732-4893-43e0-a57b-5267b112c1a2 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1673 microversion: 2.1 time: 1.086915 Aug 03 02:25:24.761019 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3020/5916] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:23 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1673 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:25.157531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-98267e6a-fdc9-4a98-97fe-d9b7561246b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:25.158691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-98267e6a-fdc9-4a98-97fe-d9b7561246b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:25.162637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:25:25.194271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-36a644e1-3918-40dd-a710-4f7b199cb0ed req-7cddc2e1-6148-4b0c-a19b-1d1be4e39a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "276f94ef-5142-4fd1-9844-cda0691ebd21", "tag": "265479f7-db45-494e-8d58-0d2282676ca6"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:25:25.202281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:25:25.210602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-36a644e1-3918-40dd-a710-4f7b199cb0ed req-7cddc2e1-6148-4b0c-a19b-1d1be4e39a05 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:25.218284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-36a644e1-3918-40dd-a710-4f7b199cb0ed req-7cddc2e1-6148-4b0c-a19b-1d1be4e39a05 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:25.219347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98267e6a-fdc9-4a98-97fe-d9b7561246b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:25.223109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98267e6a-fdc9-4a98-97fe-d9b7561246b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:25.224057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98267e6a-fdc9-4a98-97fe-d9b7561246b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:25.224508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98267e6a-fdc9-4a98-97fe-d9b7561246b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:25.251695 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-36a644e1-3918-40dd-a710-4f7b199cb0ed req-7cddc2e1-6148-4b0c-a19b-1d1be4e39a05 service nova] Creating event network-changed:265479f7-db45-494e-8d58-0d2282676ca6 for instance 276f94ef-5142-4fd1-9844-cda0691ebd21 on n-h1-826529-8 Aug 03 02:25:25.272583 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-36a644e1-3918-40dd-a710-4f7b199cb0ed req-7cddc2e1-6148-4b0c-a19b-1d1be4e39a05 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083061 Aug 03 02:25:25.290033 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3021/5917] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:25:25.293284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:25:25.340090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-98267e6a-fdc9-4a98-97fe-d9b7561246b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:25:25.589927 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-98267e6a-fdc9-4a98-97fe-d9b7561246b0 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "DELETE /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 204 len: 0 microversion: 2.1 time: 0.437647 Aug 03 02:25:25.592906 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2897/5918] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:25:25 2022] DELETE /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:25:25.603633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b8b00978-2f30-44d8-bfff-88114a3fa269 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:25.604730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b8b00978-2f30-44d8-bfff-88114a3fa269 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:25.630358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8b00978-2f30-44d8-bfff-88114a3fa269 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:25.634232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8b00978-2f30-44d8-bfff-88114a3fa269 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:25.635318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8b00978-2f30-44d8-bfff-88114a3fa269 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:25.640411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8b00978-2f30-44d8-bfff-88114a3fa269 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:25.792374 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-95bb86ed-1f43-4d11-b064-b5d572a11438 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:25.793743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-95bb86ed-1f43-4d11-b064-b5d572a11438 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:25.821238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95bb86ed-1f43-4d11-b064-b5d572a11438 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:25.822083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95bb86ed-1f43-4d11-b064-b5d572a11438 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:25.823077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95bb86ed-1f43-4d11-b064-b5d572a11438 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:25.828577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-95bb86ed-1f43-4d11-b064-b5d572a11438 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:26.100456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-95bb86ed-1f43-4d11-b064-b5d572a11438 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:26.112258 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-95bb86ed-1f43-4d11-b064-b5d572a11438 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1605 microversion: 2.1 time: 0.333369 Aug 03 02:25:26.120539 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2898/5919] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:25 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1605 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:26.411554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b8b00978-2f30-44d8-bfff-88114a3fa269 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:26.421581 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b8b00978-2f30-44d8-bfff-88114a3fa269 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1685 microversion: 2.1 time: 0.822377 Aug 03 02:25:26.431276 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3022/5920] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:25 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1685 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:25:27.161107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cc2cd57e-e868-4c16-b731-7c76e2afbbe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:27.161656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cc2cd57e-e868-4c16-b731-7c76e2afbbe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:27.177498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc2cd57e-e868-4c16-b731-7c76e2afbbe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:27.178031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc2cd57e-e868-4c16-b731-7c76e2afbbe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:27.178829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc2cd57e-e868-4c16-b731-7c76e2afbbe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:27.189440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc2cd57e-e868-4c16-b731-7c76e2afbbe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:27.288648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc2cd57e-e868-4c16-b731-7c76e2afbbe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:27.289221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc2cd57e-e868-4c16-b731-7c76e2afbbe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:27.290133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-cc2cd57e-e868-4c16-b731-7c76e2afbbe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lazy-loading 'fault' on Instance uuid 1a1d1216-dd0a-4189-894a-71d2a856af52 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:25:27.369366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cc2cd57e-e868-4c16-b731-7c76e2afbbe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab11af44ce14dbabafaf0136a3f2847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9cb361c2db46cd80e1d83c2706d91a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:27.381807 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cc2cd57e-e868-4c16-b731-7c76e2afbbe3 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 200 len: 1327 microversion: 2.1 time: 0.225660 Aug 03 02:25:27.382413 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3023/5921] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:27 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 1327 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:25:27.418069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-a3ecbe77-3c48-4fb2-af5e-0f5767249c23 req-7d9aedef-bc56-4caf-bac7-4471eecefd67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1d1216-dd0a-4189-894a-71d2a856af52", "name": "network-vif-deleted", "tag": "986de4d8-7448-47a2-beec-f2f60c60bb2f"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:25:27.448400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a3ecbe77-3c48-4fb2-af5e-0f5767249c23 req-7d9aedef-bc56-4caf-bac7-4471eecefd67 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:27.449328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a3ecbe77-3c48-4fb2-af5e-0f5767249c23 req-7d9aedef-bc56-4caf-bac7-4471eecefd67 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:27.460979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ef78d406-a23e-413a-bc6d-ac3f6b863101 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:27.462297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ef78d406-a23e-413a-bc6d-ac3f6b863101 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:27.474376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef78d406-a23e-413a-bc6d-ac3f6b863101 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:27.474839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef78d406-a23e-413a-bc6d-ac3f6b863101 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:27.475811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef78d406-a23e-413a-bc6d-ac3f6b863101 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:27.476256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef78d406-a23e-413a-bc6d-ac3f6b863101 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:27.500698 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-a3ecbe77-3c48-4fb2-af5e-0f5767249c23 req-7d9aedef-bc56-4caf-bac7-4471eecefd67 service nova] Creating event network-vif-deleted:986de4d8-7448-47a2-beec-f2f60c60bb2f for instance 1a1d1216-dd0a-4189-894a-71d2a856af52 on n-h2-826529-8 Aug 03 02:25:27.514078 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-a3ecbe77-3c48-4fb2-af5e-0f5767249c23 req-7d9aedef-bc56-4caf-bac7-4471eecefd67 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.681571 Aug 03 02:25:27.518426 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2899/5922] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:25:27.824232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ef78d406-a23e-413a-bc6d-ac3f6b863101 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:27.845757 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ef78d406-a23e-413a-bc6d-ac3f6b863101 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1685 microversion: 2.1 time: 0.389070 Aug 03 02:25:27.860572 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3024/5923] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:27 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1685 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:28.408615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bc3f8c6e-d07a-490a-b2ac-e01a07b5141f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:28.410306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bc3f8c6e-d07a-490a-b2ac-e01a07b5141f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:28.418213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc3f8c6e-d07a-490a-b2ac-e01a07b5141f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:28.420538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc3f8c6e-d07a-490a-b2ac-e01a07b5141f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:28.421610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc3f8c6e-d07a-490a-b2ac-e01a07b5141f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:28.422297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc3f8c6e-d07a-490a-b2ac-e01a07b5141f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:28.448152 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-bc3f8c6e-d07a-490a-b2ac-e01a07b5141f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] HTTP exception thrown: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bc3f8c6e-d07a-490a-b2ac-e01a07b5141f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Request method failure captured: Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 HTTP/1.1 Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dsOtt-P5o27JOO1HyMtn7d-xLgtlKyRYECf6VrMCjdxQXHEAccmuFXvFTHAnsSxH47VhD74QrzmlqU2DKX_-tlMOBLtd9IdH47lnAqLL_0CmrNrYpa9TEdfrxu6UGuk7EgfNF4O4HqwnJRdDpEfyQ9gnmCxxw4rQw35LSQcAjvoBeY Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 8c9cb361c2db46cd80e1d83c2706d91a Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "tempest-type-1713205854", "name": "tempest-service-696794725", "endpoints": [{"region": "tempest-region-1028777055", "internalURL": "https://url-338480768.com"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c9cb361c2db46cd80e1d83c2706d91a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "tempest-type-99381424", "name": "tempest-service-1361497826", "endpoints": [{"region": "tempest-region-1304310723", "publicURL": "https://url-1648113633.com"}, {"region": "tempest-region-1773037312", "publicURL": "https://url-1623104555.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c9cb361c2db46cd80e1d83c2706d91a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c9cb361c2db46cd80e1d83c2706d91a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c9cb361c2db46cd80e1d83c2706d91a"}]}] Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 8c9cb361c2db46cd80e1d83c2706d91a Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AttachVolumeTestJSON-920965676-project Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4ab11af44ce14dbabafaf0136a3f2847 Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AttachVolumeTestJSON-920965676-project Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '1a1d1216-dd0a-4189-894a-71d2a856af52'} Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:25:28.457852 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:25:28.462880 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:25:28.462880 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. Aug 03 02:25:28.462880 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:28.462880 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:28.462880 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:28.462880 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:28.462880 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:28.462880 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:28.462880 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:25:28.462880 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:25:28.462880 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. Aug 03 02:25:28.462880 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:28.462880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bc3f8c6e-d07a-490a-b2ac-e01a07b5141f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Returning 404 to user: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:25:28.462880 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bc3f8c6e-d07a-490a-b2ac-e01a07b5141f tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 404 len: 111 microversion: 2.1 time: 0.056563 Aug 03 02:25:28.462880 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2900/5924] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:28 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:25:28.471858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7e4fa65b-4ebb-41ac-8dbc-19ac9d0bb57d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '.version_select at 0x7f5b122203a0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:28.506454 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7e4fa65b-4ebb-41ac-8dbc-19ac9d0bb57d tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202971633" status: 202 len: 0 microversion: 2.1 time: 0.038365 Aug 03 02:25:28.508256 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3025/5925] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 3 02:25:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202971633 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:25:28.876373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-23b6a476-9cfe-4fd0-b64b-84cd623f6e0f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:28.877002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-23b6a476-9cfe-4fd0-b64b-84cd623f6e0f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:28.888313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23b6a476-9cfe-4fd0-b64b-84cd623f6e0f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:28.889566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23b6a476-9cfe-4fd0-b64b-84cd623f6e0f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:28.890885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23b6a476-9cfe-4fd0-b64b-84cd623f6e0f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:28.891766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23b6a476-9cfe-4fd0-b64b-84cd623f6e0f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:29.037327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-23b6a476-9cfe-4fd0-b64b-84cd623f6e0f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adca21bc340d440e91e4d856a625cd3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6179959e78b438cb68680f694190a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:25:29.046300 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-23b6a476-9cfe-4fd0-b64b-84cd623f6e0f tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 200 len: 1499 microversion: 2.1 time: 0.173910 Aug 03 02:25:29.047236 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2901/5926] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:28 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 1499 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:25:29.148994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-7f140320-1e3c-4297-9379-8a4568786f57 req-88ce36b8-6c30-4d3f-a3bc-b8526db00d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276f94ef-5142-4fd1-9844-cda0691ebd21", "name": "network-vif-deleted", "tag": "265479f7-db45-494e-8d58-0d2282676ca6"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:25:29.176860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7f140320-1e3c-4297-9379-8a4568786f57 req-88ce36b8-6c30-4d3f-a3bc-b8526db00d0e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:29.177759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-7f140320-1e3c-4297-9379-8a4568786f57 req-88ce36b8-6c30-4d3f-a3bc-b8526db00d0e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:29.196590 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-7f140320-1e3c-4297-9379-8a4568786f57 req-88ce36b8-6c30-4d3f-a3bc-b8526db00d0e service nova] Creating event network-vif-deleted:265479f7-db45-494e-8d58-0d2282676ca6 for instance 276f94ef-5142-4fd1-9844-cda0691ebd21 on n-h1-826529-8 Aug 03 02:25:29.204233 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-7f140320-1e3c-4297-9379-8a4568786f57 req-88ce36b8-6c30-4d3f-a3bc-b8526db00d0e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062559 Aug 03 02:25:29.205866 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3026/5927] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:25:30.069191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ede06409-5395-4751-bb01-2767eef02985 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:30.069819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ede06409-5395-4751-bb01-2767eef02985 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] [instance: 276f94ef-5142-4fd1-9844-cda0691ebd21] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:30.079030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ede06409-5395-4751-bb01-2767eef02985 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:30.082256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ede06409-5395-4751-bb01-2767eef02985 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:30.088296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ede06409-5395-4751-bb01-2767eef02985 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:30.088979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ede06409-5395-4751-bb01-2767eef02985 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:30.118140 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-ede06409-5395-4751-bb01-2767eef02985 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] HTTP exception thrown: Instance 276f94ef-5142-4fd1-9844-cda0691ebd21 could not be found. Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ede06409-5395-4751-bb01-2767eef02985 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Request method failure captured: Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 HTTP/1.1 Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6doi9mhvS1ouiIhMAao9U5FMCKoCDK2Svh-rN38K6LLUL5Jz46cjohY4VinMjw8nEITcvufUHSTuoEsFDcuvi9KweDemmvXVR2Y50H-XN3XOCzqBlRtzMafBlbAgN_igQZKGETPhyc3zhVKXRP1svhEgFnKivuflt3X2jd-ilbL3xBI Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: f6179959e78b438cb68680f694190a8c Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-160243142 Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f6179959e78b438cb68680f694190a8c", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6179959e78b438cb68680f694190a8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f6179959e78b438cb68680f694190a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f6179959e78b438cb68680f694190a8c"}]}] Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestNetworkAdvancedServerOps-160243142 Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: f6179959e78b438cb68680f694190a8c Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-160243142 Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestNetworkAdvancedServerOps-160243142-project Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: adca21bc340d440e91e4d856a625cd3a Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestNetworkAdvancedServerOps-160243142-project Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 276f94ef-5142-4fd1-9844-cda0691ebd21 could not be found. Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '276f94ef-5142-4fd1-9844-cda0691ebd21'} Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 276f94ef-5142-4fd1-9844-cda0691ebd21 could not be found. Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 276f94ef-5142-4fd1-9844-cda0691ebd21 could not be found. Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:30.121596 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:30.126702 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:30.126702 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:30.126702 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:30.126702 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:30.126702 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:25:30.126702 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:25:30.126702 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 276f94ef-5142-4fd1-9844-cda0691ebd21 could not be found. Aug 03 02:25:30.126702 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:30.132676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ede06409-5395-4751-bb01-2767eef02985 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Returning 404 to user: Instance 276f94ef-5142-4fd1-9844-cda0691ebd21 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:25:30.135143 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ede06409-5395-4751-bb01-2767eef02985 tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21" status: 404 len: 111 microversion: 2.1 time: 0.070243 Aug 03 02:25:30.139296 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2902/5928] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:30 2022] GET /compute/v2.1/servers/276f94ef-5142-4fd1-9844-cda0691ebd21 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:25:37.755441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-feda48d6-f4f3-4544-a086-be18c802dc6a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] Calling method '.version_select at 0x7f5b1226c700>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:37.801972 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-feda48d6-f4f3-4544-a086-be18c802dc6a tempest-TestNetworkAdvancedServerOps-160243142 tempest-TestNetworkAdvancedServerOps-160243142-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-802031361" status: 202 len: 0 microversion: 2.1 time: 0.052239 Aug 03 02:25:37.807686 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3027/5929] 10.222.0.67 () {58 vars in 1281 bytes} [Wed Aug 3 02:25:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-802031361 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:25:40.838826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-daef765d-7a46-4154-85c8-8be77554d0ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:40.840552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-daef765d-7a46-4154-85c8-8be77554d0ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:40.867047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:25:40.870177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:25:40.879140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-daef765d-7a46-4154-85c8-8be77554d0ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:40.881249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-daef765d-7a46-4154-85c8-8be77554d0ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:40.882345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-daef765d-7a46-4154-85c8-8be77554d0ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:40.883530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-daef765d-7a46-4154-85c8-8be77554d0ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:40.920631 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-daef765d-7a46-4154-85c8-8be77554d0ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] HTTP exception thrown: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-daef765d-7a46-4154-85c8-8be77554d0ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Request method failure captured: Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 HTTP/1.1 Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dsOtt-P5o27JOO1HyMtn7d-xLgtlKyRYECf6VrMCjdxQXHEAccmuFXvFTHAnsSxH47VhD74QrzmlqU2DKX_-tlMOBLtd9IdH47lnAqLL_0CmrNrYpa9TEdfrxu6UGuk7EgfNF4O4HqwnJRdDpEfyQ9gnmCxxw4rQw35LSQcAjvoBeY Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 8c9cb361c2db46cd80e1d83c2706d91a Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "tempest-type-1713205854", "name": "tempest-service-696794725", "endpoints": [{"region": "tempest-region-1028777055", "internalURL": "https://url-338480768.com"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c9cb361c2db46cd80e1d83c2706d91a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "tempest-type-99381424", "name": "tempest-service-1361497826", "endpoints": [{"region": "tempest-region-1304310723", "publicURL": "https://url-1648113633.com"}, {"region": "tempest-region-1773037312", "publicURL": "https://url-1623104555.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c9cb361c2db46cd80e1d83c2706d91a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c9cb361c2db46cd80e1d83c2706d91a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c9cb361c2db46cd80e1d83c2706d91a"}]}] Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 8c9cb361c2db46cd80e1d83c2706d91a Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AttachVolumeTestJSON-920965676-project Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4ab11af44ce14dbabafaf0136a3f2847 Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AttachVolumeTestJSON-920965676-project Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '1a1d1216-dd0a-4189-894a-71d2a856af52'} Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:25:40.922443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:25:40.928124 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:25:40.928124 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:25:40.928124 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:25:40.928124 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. Aug 03 02:25:40.928124 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:40.928124 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:40.928124 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:40.928124 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:40.928124 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:40.928124 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:40.928124 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:25:40.928124 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:25:40.928124 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. Aug 03 02:25:40.928124 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:40.932914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-daef765d-7a46-4154-85c8-8be77554d0ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Returning 404 to user: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:25:40.943482 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-daef765d-7a46-4154-85c8-8be77554d0ee tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 404 len: 111 microversion: 2.1 time: 0.106058 Aug 03 02:25:40.945360 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2903/5930] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:25:40 2022] DELETE /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:25:40.954404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc99acd8-cedb-4d78-88b3-ea20b1dbb41b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:40.955451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fc99acd8-cedb-4d78-88b3-ea20b1dbb41b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 1a1d1216-dd0a-4189-894a-71d2a856af52] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:40.959603 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=35 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:25:40.974309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc99acd8-cedb-4d78-88b3-ea20b1dbb41b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:40.979377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc99acd8-cedb-4d78-88b3-ea20b1dbb41b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:40.980658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc99acd8-cedb-4d78-88b3-ea20b1dbb41b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:40.982500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc99acd8-cedb-4d78-88b3-ea20b1dbb41b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:41.005397 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-fc99acd8-cedb-4d78-88b3-ea20b1dbb41b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] HTTP exception thrown: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc99acd8-cedb-4d78-88b3-ea20b1dbb41b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Request method failure captured: Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 HTTP/1.1 Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dsOtt-P5o27JOO1HyMtn7d-xLgtlKyRYECf6VrMCjdxQXHEAccmuFXvFTHAnsSxH47VhD74QrzmlqU2DKX_-tlMOBLtd9IdH47lnAqLL_0CmrNrYpa9TEdfrxu6UGuk7EgfNF4O4HqwnJRdDpEfyQ9gnmCxxw4rQw35LSQcAjvoBeY Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 8c9cb361c2db46cd80e1d83c2706d91a Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "tempest-type-1713205854", "name": "tempest-service-696794725", "endpoints": [{"region": "tempest-region-1028777055", "internalURL": "https://url-338480768.com"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c9cb361c2db46cd80e1d83c2706d91a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "tempest-type-99381424", "name": "tempest-service-1361497826", "endpoints": [{"region": "tempest-region-1304310723", "publicURL": "https://url-1648113633.com"}, {"region": "tempest-region-1773037312", "publicURL": "https://url-1623104555.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c9cb361c2db46cd80e1d83c2706d91a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c9cb361c2db46cd80e1d83c2706d91a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c9cb361c2db46cd80e1d83c2706d91a"}]}] Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 8c9cb361c2db46cd80e1d83c2706d91a Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeTestJSON-920965676-project Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4ab11af44ce14dbabafaf0136a3f2847 Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeTestJSON-920965676-project Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '1a1d1216-dd0a-4189-894a-71d2a856af52'} Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:25:41.009663 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:25:41.015489 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:25:41.015489 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. Aug 03 02:25:41.015489 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:25:41.015489 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:41.015489 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:25:41.015489 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:41.015489 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:41.015489 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:41.015489 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:25:41.015489 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:25:41.015489 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. Aug 03 02:25:41.015489 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:25:41.020653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc99acd8-cedb-4d78-88b3-ea20b1dbb41b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Returning 404 to user: Instance 1a1d1216-dd0a-4189-894a-71d2a856af52 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:25:41.021770 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fc99acd8-cedb-4d78-88b3-ea20b1dbb41b tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52" status: 404 len: 111 microversion: 2.1 time: 0.073046 Aug 03 02:25:41.023939 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3028/5931] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:40 2022] GET /compute/v2.1/servers/1a1d1216-dd0a-4189-894a-71d2a856af52 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:25:46.734656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bdc9a3f1-7396-444e-80f6-31da7a674d28 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:46.735465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bdc9a3f1-7396-444e-80f6-31da7a674d28 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:46.757965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bdc9a3f1-7396-444e-80f6-31da7a674d28 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:46.758605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bdc9a3f1-7396-444e-80f6-31da7a674d28 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:46.759570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bdc9a3f1-7396-444e-80f6-31da7a674d28 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:46.760090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bdc9a3f1-7396-444e-80f6-31da7a674d28 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:46.792495 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-bdc9a3f1-7396-444e-80f6-31da7a674d28 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] HTTP exception thrown: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bdc9a3f1-7396-444e-80f6-31da7a674d28 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Request method failure captured: Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e HTTP/1.1 Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dsOtt-P5o27JOO1HyMtn7d-xLgtlKyRYECf6VrMCjdxQXHEAccmuFXvFTHAnsSxH47VhD74QrzmlqU2DKX_-tlMOBLtd9IdH47lnAqLL_0CmrNrYpa9TEdfrxu6UGuk7EgfNF4O4HqwnJRdDpEfyQ9gnmCxxw4rQw35LSQcAjvoBeY Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 8c9cb361c2db46cd80e1d83c2706d91a Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "tempest-type-1713205854", "name": "tempest-service-696794725", "endpoints": [{"region": "tempest-region-1028777055", "internalURL": "https://url-338480768.com"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c9cb361c2db46cd80e1d83c2706d91a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "tempest-type-99381424", "name": "tempest-service-1361497826", "endpoints": [{"region": "tempest-region-1304310723", "publicURL": "https://url-1648113633.com"}, {"region": "tempest-region-1773037312", "publicURL": "https://url-1623104555.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c9cb361c2db46cd80e1d83c2706d91a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c9cb361c2db46cd80e1d83c2706d91a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c9cb361c2db46cd80e1d83c2706d91a"}]}] Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 8c9cb361c2db46cd80e1d83c2706d91a Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-AttachVolumeTestJSON-920965676-project Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4ab11af44ce14dbabafaf0136a3f2847 Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-AttachVolumeTestJSON-920965676-project Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '583e3553-3343-4c37-b5f9-df334dd4f27e'} Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:25:46.794939 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:25:46.799803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:25:46.799803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:25:46.799803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:25:46.799803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. Aug 03 02:25:46.799803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:46.799803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:46.799803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:46.799803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:46.799803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:46.799803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:46.799803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:25:46.799803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:25:46.799803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. Aug 03 02:25:46.799803 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:25:46.801504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bdc9a3f1-7396-444e-80f6-31da7a674d28 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Returning 404 to user: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:25:46.803913 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bdc9a3f1-7396-444e-80f6-31da7a674d28 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "DELETE /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 404 len: 111 microversion: 2.1 time: 0.074694 Aug 03 02:25:46.812018 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2904/5932] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:25:46 2022] DELETE /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:25:46.816842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8a95eb06-56f9-4f59-9ad5-3ef594678394 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:25:46.817639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8a95eb06-56f9-4f59-9ad5-3ef594678394 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] [instance: 583e3553-3343-4c37-b5f9-df334dd4f27e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:25:46.833485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a95eb06-56f9-4f59-9ad5-3ef594678394 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:46.842321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a95eb06-56f9-4f59-9ad5-3ef594678394 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:46.843221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a95eb06-56f9-4f59-9ad5-3ef594678394 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:25:46.843668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a95eb06-56f9-4f59-9ad5-3ef594678394 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:25:46.908035 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-8a95eb06-56f9-4f59-9ad5-3ef594678394 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] HTTP exception thrown: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8a95eb06-56f9-4f59-9ad5-3ef594678394 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Request method failure captured: Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e HTTP/1.1 Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dsOtt-P5o27JOO1HyMtn7d-xLgtlKyRYECf6VrMCjdxQXHEAccmuFXvFTHAnsSxH47VhD74QrzmlqU2DKX_-tlMOBLtd9IdH47lnAqLL_0CmrNrYpa9TEdfrxu6UGuk7EgfNF4O4HqwnJRdDpEfyQ9gnmCxxw4rQw35LSQcAjvoBeY Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 8c9cb361c2db46cd80e1d83c2706d91a Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "tempest-type-1713205854", "name": "tempest-service-696794725", "endpoints": [{"region": "tempest-region-1028777055", "internalURL": "https://url-338480768.com"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c9cb361c2db46cd80e1d83c2706d91a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "tempest-type-99381424", "name": "tempest-service-1361497826", "endpoints": [{"region": "tempest-region-1304310723", "publicURL": "https://url-1648113633.com"}, {"region": "tempest-region-1773037312", "publicURL": "https://url-1623104555.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c9cb361c2db46cd80e1d83c2706d91a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c9cb361c2db46cd80e1d83c2706d91a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c9cb361c2db46cd80e1d83c2706d91a"}]}] Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 8c9cb361c2db46cd80e1d83c2706d91a Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-AttachVolumeTestJSON-920965676 Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-AttachVolumeTestJSON-920965676-project Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4ab11af44ce14dbabafaf0136a3f2847 Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-AttachVolumeTestJSON-920965676-project Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '583e3553-3343-4c37-b5f9-df334dd4f27e'} Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:25:46.909814 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:25:46.922619 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:25:46.922619 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. Aug 03 02:25:46.922619 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:25:46.922619 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:25:46.922619 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:25:46.922619 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:25:46.922619 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:25:46.922619 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:25:46.922619 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:25:46.922619 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:25:46.922619 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. Aug 03 02:25:46.922619 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:25:46.922619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8a95eb06-56f9-4f59-9ad5-3ef594678394 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] Returning 404 to user: Instance 583e3553-3343-4c37-b5f9-df334dd4f27e could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:25:46.922619 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8a95eb06-56f9-4f59-9ad5-3ef594678394 tempest-AttachVolumeTestJSON-920965676 tempest-AttachVolumeTestJSON-920965676-project] 10.222.0.67 "GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e" status: 404 len: 111 microversion: 2.1 time: 0.104307 Aug 03 02:25:46.925033 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3029/5933] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:25:46 2022] GET /compute/v2.1/servers/583e3553-3343-4c37-b5f9-df334dd4f27e => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:25:52.028389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1c9b40ca-72db-46f5-b4d9-b83ba64da08f tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Action: 'create', calling method: .version_select at 0x7f5b12888dc0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2132688460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEIC50Inddzf1JjouEuJkSE06hWNMDG/obsVbT+CJGZkT/kSbDmDQq1DDHtIcOuIzwQvEDcomeQ1MA8XB6yp1F6ALBYIKxFgOzNqd76xdPCoYsZKQvUU/dp6gP2gZQLrw=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:25:52.069140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-1c9b40ca-72db-46f5-b4d9-b83ba64da08f tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Getting quotas for project 70f3b59cbd864042ad3a5e19802e7e27. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:25:52.084099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-1c9b40ca-72db-46f5-b4d9-b83ba64da08f tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Getting quotas for user c38ef02678ad4099af395de16f78c6b3 and project 70f3b59cbd864042ad3a5e19802e7e27. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:25:52.156625 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1c9b40ca-72db-46f5-b4d9-b83ba64da08f tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.544626 Aug 03 02:25:52.157758 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2905/5934] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:25:51 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:25:59.557733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:25:59.560510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:25:59.690686 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:25:59.691242 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 02:25:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:26:00.233350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a2d6916a-f892-440a-a9b8-0470e41a8df7 tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Action: 'create', calling method: .version_select at 0x7f5b1226c700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-158937397", "metadata": {"Type": "work"}}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a2d6916a-f892-440a-a9b8-0470e41a8df7 tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Request method failure captured: Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 121 Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dy3ZhGXgacAGPJT2B9dJBd1lracJO0HDdgncdohmJ-AOlNDosUYID4I-wz32r4JyROkvhUzCfCifjJBXeabmpbsZuGRwfr3sh7LGITn_hFPjmw2dEPx3YhV2qduV7pPRRZHKJ40hyfybBbIhspHMbmDKp15tRyiNHPL1Ujjq9YzvaA Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 3fe3889a624c421c84a5323a01990411 Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3fe3889a624c421c84a5323a01990411", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fe3889a624c421c84a5323a01990411"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3fe3889a624c421c84a5323a01990411"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fe3889a624c421c84a5323a01990411"}]}] Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 3fe3889a624c421c84a5323a01990411 Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-VolumesNegativeTest-1250779770-project Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1b64d16698ee4e9ba37eaf696314bfb8 Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-VolumesNegativeTest-1250779770-project Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-158937397", "metadata": {"Type": "work"}}} Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-158937397', 'metadata': {'Type': 'work'}}}} Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi '#$%' Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:26:00.238181 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:26:00.243813 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 02:26:00.243813 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.243813 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:26:00.243813 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.243813 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.243813 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:26:00.243813 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:26:00.243813 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:26:00.243813 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:26:00.243813 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 02:26:00.243813 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.243813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a2d6916a-f892-440a-a9b8-0470e41a8df7 tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:26:00.243813 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a2d6916a-f892-440a-a9b8-0470e41a8df7 tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.707716 Aug 03 02:26:00.254650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f4a5fbf6-5797-4c71-a84b-77b24e1bfb33 tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Action: 'create', calling method: .version_select at 0x7f5b244cd5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-269572392", "metadata": {"Type": "work"}}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f4a5fbf6-5797-4c71-a84b-77b24e1bfb33 tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Request method failure captured: Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 119 Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dy3ZhGXgacAGPJT2B9dJBd1lracJO0HDdgncdohmJ-AOlNDosUYID4I-wz32r4JyROkvhUzCfCifjJBXeabmpbsZuGRwfr3sh7LGITn_hFPjmw2dEPx3YhV2qduV7pPRRZHKJ40hyfybBbIhspHMbmDKp15tRyiNHPL1Ujjq9YzvaA Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 3fe3889a624c421c84a5323a01990411 Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3fe3889a624c421c84a5323a01990411", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fe3889a624c421c84a5323a01990411"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3fe3889a624c421c84a5323a01990411"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fe3889a624c421c84a5323a01990411"}]}] Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 3fe3889a624c421c84a5323a01990411 Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-VolumesNegativeTest-1250779770-project Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1b64d16698ee4e9ba37eaf696314bfb8 Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-VolumesNegativeTest-1250779770-project Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-269572392", "metadata": {"Type": "work"}}} Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-269572392', 'metadata': {'Type': 'work'}}}} Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi '0' Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:26:00.259239 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:26:00.265451 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 02:26:00.265451 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.265451 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:26:00.265451 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.265451 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.265451 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:26:00.265451 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:26:00.265451 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:26:00.265451 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:26:00.265451 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 02:26:00.265451 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.265451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f4a5fbf6-5797-4c71-a84b-77b24e1bfb33 tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:26:00.265451 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f4a5fbf6-5797-4c71-a84b-77b24e1bfb33 tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011861 Aug 03 02:26:00.266516 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3030/5935] 10.222.0.67 () {60 vars in 1156 bytes} [Wed Aug 3 02:25:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 732 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:26:00.266608 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2906/5936] 10.222.0.67 () {60 vars in 1156 bytes} [Wed Aug 3 02:26:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:26:00.277513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2b6eac9b-d952-45b3-9dfb-1d535a82247e tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Action: 'create', calling method: .version_select at 0x7f5b128a8790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1958237982", "metadata": {"Type": "work"}}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2b6eac9b-d952-45b3-9dfb-1d535a82247e tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Request method failure captured: Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 119 Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dy3ZhGXgacAGPJT2B9dJBd1lracJO0HDdgncdohmJ-AOlNDosUYID4I-wz32r4JyROkvhUzCfCifjJBXeabmpbsZuGRwfr3sh7LGITn_hFPjmw2dEPx3YhV2qduV7pPRRZHKJ40hyfybBbIhspHMbmDKp15tRyiNHPL1Ujjq9YzvaA Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 3fe3889a624c421c84a5323a01990411 Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3fe3889a624c421c84a5323a01990411", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fe3889a624c421c84a5323a01990411"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3fe3889a624c421c84a5323a01990411"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fe3889a624c421c84a5323a01990411"}]}] Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 3fe3889a624c421c84a5323a01990411 Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-VolumesNegativeTest-1250779770-project Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1b64d16698ee4e9ba37eaf696314bfb8 Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-VolumesNegativeTest-1250779770-project Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1958237982", "metadata": {"Type": "work"}}} Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1958237982', 'metadata': {'Type': 'work'}}}} Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi '' Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:26:00.285533 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:26:00.291920 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 02:26:00.291920 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.291920 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:26:00.291920 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.291920 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.291920 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:26:00.291920 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:26:00.291920 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:26:00.291920 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:26:00.291920 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 02:26:00.291920 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.293066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2b6eac9b-d952-45b3-9dfb-1d535a82247e tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:26:00.293844 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2b6eac9b-d952-45b3-9dfb-1d535a82247e tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022108 Aug 03 02:26:00.295585 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3031/5937] 10.222.0.67 () {60 vars in 1156 bytes} [Wed Aug 3 02:26:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 02:26:00.304846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e48f7b47-6f66-40ac-a686-fba408c7d71d tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Calling method '.version_select at 0x7f5b24427b80>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:00.316731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:26:00.352165 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-e48f7b47-6f66-40ac-a686-fba408c7d71d tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] HTTP exception thrown: Volume tempest-invalid-1742675449 could not be found. Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e48f7b47-6f66-40ac-a686-fba408c7d71d tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Request method failure captured: Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1742675449 HTTP/1.1 Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dy3ZhGXgacAGPJT2B9dJBd1lracJO0HDdgncdohmJ-AOlNDosUYID4I-wz32r4JyROkvhUzCfCifjJBXeabmpbsZuGRwfr3sh7LGITn_hFPjmw2dEPx3YhV2qduV7pPRRZHKJ40hyfybBbIhspHMbmDKp15tRyiNHPL1Ujjq9YzvaA Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 3fe3889a624c421c84a5323a01990411 Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3fe3889a624c421c84a5323a01990411", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fe3889a624c421c84a5323a01990411"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3fe3889a624c421c84a5323a01990411"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fe3889a624c421c84a5323a01990411"}]}] Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 3fe3889a624c421c84a5323a01990411 Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-VolumesNegativeTest-1250779770-project Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1b64d16698ee4e9ba37eaf696314bfb8 Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-VolumesNegativeTest-1250779770-project Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: exception: Volume tempest-invalid-1742675449 could not be found. Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'tempest-invalid-1742675449'} Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1742675449 could not be found. (HTTP 404) (Request-ID: req-8e719f68-98e3-44e8-a217-b823612f5451) Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 02:26:00.354442 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1742675449 could not be found. Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1742675449 could not be found. Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1742675449 could not be found. Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e48f7b47-6f66-40ac-a686-fba408c7d71d tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Returning 404 to user: Volume tempest-invalid-1742675449 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e48f7b47-6f66-40ac-a686-fba408c7d71d tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1742675449" status: 404 len: 99 microversion: 2.1 time: 0.056530 Aug 03 02:26:00.361556 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2907/5938] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 3 02:26:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1742675449 => generated 99 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 02:26:00.373860 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a6e0b039-78f2-482a-8cc6-d6672d17eb00 tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005577 Aug 03 02:26:00.379473 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3032/5939] 10.222.0.67 () {58 vars in 1140 bytes} [Wed Aug 3 02:26:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 02:26:00.389225 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2ff74eaa-525b-43a5-be9e-1c3910fa2101 tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004430 Aug 03 02:26:00.389821 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2908/5940] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 3 02:26:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 02:26:00.403664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a0700ba4-873d-464f-ba96-3c95fa07f60c tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Calling method '.version_select at 0x7f5b12363790>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:00.460600 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-a0700ba4-873d-464f-ba96-3c95fa07f60c tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] HTTP exception thrown: Volume b57dfb00-456b-40c1-b397-688b2104acca could not be found. Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a0700ba4-873d-464f-ba96-3c95fa07f60c tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Request method failure captured: Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/os-volumes/b57dfb00-456b-40c1-b397-688b2104acca HTTP/1.1 Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dy3ZhGXgacAGPJT2B9dJBd1lracJO0HDdgncdohmJ-AOlNDosUYID4I-wz32r4JyROkvhUzCfCifjJBXeabmpbsZuGRwfr3sh7LGITn_hFPjmw2dEPx3YhV2qduV7pPRRZHKJ40hyfybBbIhspHMbmDKp15tRyiNHPL1Ujjq9YzvaA Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 3fe3889a624c421c84a5323a01990411 Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3fe3889a624c421c84a5323a01990411", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fe3889a624c421c84a5323a01990411"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3fe3889a624c421c84a5323a01990411"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fe3889a624c421c84a5323a01990411"}]}] Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 3fe3889a624c421c84a5323a01990411 Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-VolumesNegativeTest-1250779770-project Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1b64d16698ee4e9ba37eaf696314bfb8 Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-VolumesNegativeTest-1250779770-project Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: method: Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: exception: Volume b57dfb00-456b-40c1-b397-688b2104acca could not be found. Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'b57dfb00-456b-40c1-b397-688b2104acca'} Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b57dfb00-456b-40c1-b397-688b2104acca could not be found. (HTTP 404) (Request-ID: req-6ebcbad3-e110-4db2-9501-e70fad33a6c2) Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 02:26:00.462571 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b57dfb00-456b-40c1-b397-688b2104acca could not be found. Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b57dfb00-456b-40c1-b397-688b2104acca could not be found. Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b57dfb00-456b-40c1-b397-688b2104acca could not be found. Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a0700ba4-873d-464f-ba96-3c95fa07f60c tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Returning 404 to user: Volume b57dfb00-456b-40c1-b397-688b2104acca could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:26:00.468107 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a0700ba4-873d-464f-ba96-3c95fa07f60c tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/b57dfb00-456b-40c1-b397-688b2104acca" status: 404 len: 109 microversion: 2.1 time: 0.069605 Aug 03 02:26:00.474996 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3033/5941] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 3 02:26:00 2022] DELETE /compute/v2.1/os-volumes/b57dfb00-456b-40c1-b397-688b2104acca => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:26:00.477078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-23c849ef-b6ba-45ad-ab54-7431105d268d tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Calling method '.version_select at 0x7f5b13029310>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:00.513875 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-23c849ef-b6ba-45ad-ab54-7431105d268d tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] HTTP exception thrown: Volume 1760f592-669a-4863-9256-0566a3404215 could not be found. Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-23c849ef-b6ba-45ad-ab54-7431105d268d tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Request method failure captured: Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/os-volumes/1760f592-669a-4863-9256-0566a3404215 HTTP/1.1 Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dy3ZhGXgacAGPJT2B9dJBd1lracJO0HDdgncdohmJ-AOlNDosUYID4I-wz32r4JyROkvhUzCfCifjJBXeabmpbsZuGRwfr3sh7LGITn_hFPjmw2dEPx3YhV2qduV7pPRRZHKJ40hyfybBbIhspHMbmDKp15tRyiNHPL1Ujjq9YzvaA Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 3fe3889a624c421c84a5323a01990411 Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3fe3889a624c421c84a5323a01990411", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fe3889a624c421c84a5323a01990411"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3fe3889a624c421c84a5323a01990411"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3fe3889a624c421c84a5323a01990411"}]}] Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 3fe3889a624c421c84a5323a01990411 Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-VolumesNegativeTest-1250779770 Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-VolumesNegativeTest-1250779770-project Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1b64d16698ee4e9ba37eaf696314bfb8 Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-VolumesNegativeTest-1250779770-project Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: method: Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: exception: Volume 1760f592-669a-4863-9256-0566a3404215 could not be found. Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '1760f592-669a-4863-9256-0566a3404215'} Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1760f592-669a-4863-9256-0566a3404215 could not be found. (HTTP 404) (Request-ID: req-b89a72fd-c5e4-4115-9b0b-46e7032d16c8) Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 02:26:00.515969 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1760f592-669a-4863-9256-0566a3404215 could not be found. Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1760f592-669a-4863-9256-0566a3404215 could not be found. Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1760f592-669a-4863-9256-0566a3404215 could not be found. Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-23c849ef-b6ba-45ad-ab54-7431105d268d tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] Returning 404 to user: Volume 1760f592-669a-4863-9256-0566a3404215 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:26:00.521212 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-23c849ef-b6ba-45ad-ab54-7431105d268d tempest-VolumesNegativeTest-1250779770 tempest-VolumesNegativeTest-1250779770-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1760f592-669a-4863-9256-0566a3404215" status: 404 len: 109 microversion: 2.1 time: 0.044383 Aug 03 02:26:00.524986 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2909/5942] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 3 02:26:00 2022] GET /compute/v2.1/os-volumes/1760f592-669a-4863-9256-0566a3404215 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:26:03.624778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1591668434-access_point-2097434466", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "206adf52-5c50-4f39-acf9-2a88c4c9ec76"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2132688460", "security_groups": [{"name": "tempest-secgroup_access--333804859"}, {"name": "tempest-secgroup_general--1400802461"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:26:03.956764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] validate_networks() for [('206adf52-5c50-4f39-acf9-2a88c4c9ec76', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:26:05.306210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:26:05.308786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:26:05.309640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:26:05.310246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:26:05.310835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:26:05.328790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:05.329691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:05.332105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:05.333869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:05.384439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Getting quotas for project 70f3b59cbd864042ad3a5e19802e7e27. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:26:05.405323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Getting quotas for user c38ef02678ad4099af395de16f78c6b3 and project 70f3b59cbd864042ad3a5e19802e7e27. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:26:05.465231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:26:05.470184 n-d-826529-8 devstack@n-api.service[125941]: WARNING nova.utils [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1591668434-access_point-2097434466 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1591668434-ac Aug 03 02:26:05.477500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:26:05.627833 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-94956c37-5e76-49f4-a645-cb0308171cb5 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.008681 Aug 03 02:26:05.629784 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3034/5943] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:26:03 2022] POST /compute/v2.1/servers => generated 457 bytes in 2012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 02:26:05.639966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:26:05.640732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:26:05.645286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2930791b-ab47-4dd8-ac92-f51b479bd6f8 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:05.648127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2930791b-ab47-4dd8-ac92-f51b479bd6f8 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:26:05.773544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2930791b-ab47-4dd8-ac92-f51b479bd6f8 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:26:05.781654 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2930791b-ab47-4dd8-ac92-f51b479bd6f8 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1295 microversion: 2.1 time: 0.144225 Aug 03 02:26:05.783583 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2910/5944] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:26:05 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1295 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:26:06.812261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3b44de8f-58af-42d2-9588-1fa9ea629b89 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:06.817329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3b44de8f-58af-42d2-9588-1fa9ea629b89 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:26:06.832422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b44de8f-58af-42d2-9588-1fa9ea629b89 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:06.834742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b44de8f-58af-42d2-9588-1fa9ea629b89 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:06.835805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b44de8f-58af-42d2-9588-1fa9ea629b89 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:06.836326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3b44de8f-58af-42d2-9588-1fa9ea629b89 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:06.977739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3b44de8f-58af-42d2-9588-1fa9ea629b89 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:26:06.997296 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3b44de8f-58af-42d2-9588-1fa9ea629b89 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1299 microversion: 2.1 time: 0.190682 Aug 03 02:26:06.998576 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3035/5945] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:26:06 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1299 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:26:08.027104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5995f42a-3e74-4c11-adbc-b335a927f08d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:08.027722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5995f42a-3e74-4c11-adbc-b335a927f08d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:26:08.057716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5995f42a-3e74-4c11-adbc-b335a927f08d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:08.058771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5995f42a-3e74-4c11-adbc-b335a927f08d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:08.060814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5995f42a-3e74-4c11-adbc-b335a927f08d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:08.061505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5995f42a-3e74-4c11-adbc-b335a927f08d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:08.209817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5995f42a-3e74-4c11-adbc-b335a927f08d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:26:08.219116 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5995f42a-3e74-4c11-adbc-b335a927f08d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1353 microversion: 2.1 time: 0.197908 Aug 03 02:26:08.241389 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2911/5946] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:26:08 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1353 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:26:09.249554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b557b4d-3fdb-404c-94dd-784ba386f007 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:09.250537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8b557b4d-3fdb-404c-94dd-784ba386f007 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:26:09.268952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b557b4d-3fdb-404c-94dd-784ba386f007 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:09.270121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b557b4d-3fdb-404c-94dd-784ba386f007 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:09.294026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b557b4d-3fdb-404c-94dd-784ba386f007 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:09.296423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8b557b4d-3fdb-404c-94dd-784ba386f007 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:09.901303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8b557b4d-3fdb-404c-94dd-784ba386f007 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:26:09.917752 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8b557b4d-3fdb-404c-94dd-784ba386f007 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1472 microversion: 2.1 time: 0.672412 Aug 03 02:26:09.918955 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3036/5947] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:26:09 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1472 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:26:10.807397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-1af246a0-bca9-4dab-a486-e917e468835b req-a959850c-8ba8-4873-b321-7da137023286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1856543a-2d5e-4bd1-a4e5-74f56a372048", "tag": "5686f5e2-3434-44c5-80f3-d34110133dfd"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:26:10.834706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1af246a0-bca9-4dab-a486-e917e468835b req-a959850c-8ba8-4873-b321-7da137023286 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:10.837382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1af246a0-bca9-4dab-a486-e917e468835b req-a959850c-8ba8-4873-b321-7da137023286 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:10.868042 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-1af246a0-bca9-4dab-a486-e917e468835b req-a959850c-8ba8-4873-b321-7da137023286 service nova] Creating event network-changed:5686f5e2-3434-44c5-80f3-d34110133dfd for instance 1856543a-2d5e-4bd1-a4e5-74f56a372048 on n-h2-826529-8 Aug 03 02:26:10.874666 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-1af246a0-bca9-4dab-a486-e917e468835b req-a959850c-8ba8-4873-b321-7da137023286 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070823 Aug 03 02:26:10.875876 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2912/5948] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:26:10.941109 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ae223385-3c99-4c4e-9b62-19e151e0bb76 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:10.941589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ae223385-3c99-4c4e-9b62-19e151e0bb76 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:26:10.958760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae223385-3c99-4c4e-9b62-19e151e0bb76 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:10.959261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae223385-3c99-4c4e-9b62-19e151e0bb76 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:10.960054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae223385-3c99-4c4e-9b62-19e151e0bb76 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:10.960502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae223385-3c99-4c4e-9b62-19e151e0bb76 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:11.318243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ae223385-3c99-4c4e-9b62-19e151e0bb76 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:26:11.333792 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ae223385-3c99-4c4e-9b62-19e151e0bb76 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1472 microversion: 2.1 time: 0.396215 Aug 03 02:26:11.334919 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3037/5949] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:26:10 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1472 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:26:12.370887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-303f4a9b-a4c6-4299-8f6c-79c679ea0d71 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:12.371856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-303f4a9b-a4c6-4299-8f6c-79c679ea0d71 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:26:12.388732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-303f4a9b-a4c6-4299-8f6c-79c679ea0d71 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:12.389194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-303f4a9b-a4c6-4299-8f6c-79c679ea0d71 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:12.390043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-303f4a9b-a4c6-4299-8f6c-79c679ea0d71 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:12.391286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-303f4a9b-a4c6-4299-8f6c-79c679ea0d71 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:12.569391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-303f4a9b-a4c6-4299-8f6c-79c679ea0d71 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:26:12.581075 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-303f4a9b-a4c6-4299-8f6c-79c679ea0d71 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1472 microversion: 2.1 time: 0.228426 Aug 03 02:26:12.596550 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2913/5950] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:26:12 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:26:13.603394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5fb1e4f-e59e-4d6a-9fc1-b92e37f4babb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:13.604030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5fb1e4f-e59e-4d6a-9fc1-b92e37f4babb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:26:13.611486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5fb1e4f-e59e-4d6a-9fc1-b92e37f4babb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:13.611951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5fb1e4f-e59e-4d6a-9fc1-b92e37f4babb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:13.612757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5fb1e4f-e59e-4d6a-9fc1-b92e37f4babb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:13.613294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5fb1e4f-e59e-4d6a-9fc1-b92e37f4babb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:13.850806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c5fb1e4f-e59e-4d6a-9fc1-b92e37f4babb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:26:13.861650 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5fb1e4f-e59e-4d6a-9fc1-b92e37f4babb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1472 microversion: 2.1 time: 0.262042 Aug 03 02:26:13.862734 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3038/5951] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:26:13 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1472 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:26:14.884155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-440c1f4b-000d-4b13-8438-a965e5d56927 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:14.884851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-440c1f4b-000d-4b13-8438-a965e5d56927 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:26:14.927386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-440c1f4b-000d-4b13-8438-a965e5d56927 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:14.936959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-440c1f4b-000d-4b13-8438-a965e5d56927 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:14.938192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-440c1f4b-000d-4b13-8438-a965e5d56927 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:14.940590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-440c1f4b-000d-4b13-8438-a965e5d56927 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:15.285367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-440c1f4b-000d-4b13-8438-a965e5d56927 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:26:15.293418 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-440c1f4b-000d-4b13-8438-a965e5d56927 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1472 microversion: 2.1 time: 0.413123 Aug 03 02:26:15.294328 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2914/5952] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:26:14 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1472 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:26:16.315318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-000fb723-d848-4da1-9263-391e9db050d0 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:16.316083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-000fb723-d848-4da1-9263-391e9db050d0 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:26:16.319206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:26:16.324119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:26:16.337813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-000fb723-d848-4da1-9263-391e9db050d0 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:16.338278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-000fb723-d848-4da1-9263-391e9db050d0 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:16.340114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-000fb723-d848-4da1-9263-391e9db050d0 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:16.342942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-000fb723-d848-4da1-9263-391e9db050d0 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:16.607695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-000fb723-d848-4da1-9263-391e9db050d0 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:26:16.623049 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-000fb723-d848-4da1-9263-391e9db050d0 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1472 microversion: 2.1 time: 0.311749 Aug 03 02:26:16.623853 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3039/5953] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:26:16 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1472 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:26:16.663094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-3f6f5677-1cd7-43ef-9075-6d4dfc9ce929 req-6935d30d-8751-4e55-9d05-4dabf087cfa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1856543a-2d5e-4bd1-a4e5-74f56a372048", "name": "network-vif-plugged", "status": "completed", "tag": "5686f5e2-3434-44c5-80f3-d34110133dfd"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:26:16.710073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:26:16.717091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3f6f5677-1cd7-43ef-9075-6d4dfc9ce929 req-6935d30d-8751-4e55-9d05-4dabf087cfa5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:16.717545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3f6f5677-1cd7-43ef-9075-6d4dfc9ce929 req-6935d30d-8751-4e55-9d05-4dabf087cfa5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:16.732250 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-3f6f5677-1cd7-43ef-9075-6d4dfc9ce929 req-6935d30d-8751-4e55-9d05-4dabf087cfa5 service nova] Creating event network-vif-plugged:5686f5e2-3434-44c5-80f3-d34110133dfd for instance 1856543a-2d5e-4bd1-a4e5-74f56a372048 on n-h2-826529-8 Aug 03 02:26:16.742753 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-3f6f5677-1cd7-43ef-9075-6d4dfc9ce929 req-6935d30d-8751-4e55-9d05-4dabf087cfa5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083897 Aug 03 02:26:16.744593 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2915/5954] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:26:17.655214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-85d0262b-de3f-4e91-ad5b-8f0770ad8743 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:17.655839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-85d0262b-de3f-4e91-ad5b-8f0770ad8743 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:26:17.663911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85d0262b-de3f-4e91-ad5b-8f0770ad8743 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:17.664656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85d0262b-de3f-4e91-ad5b-8f0770ad8743 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:17.665693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85d0262b-de3f-4e91-ad5b-8f0770ad8743 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:17.666345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85d0262b-de3f-4e91-ad5b-8f0770ad8743 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:17.927743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-85d0262b-de3f-4e91-ad5b-8f0770ad8743 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:26:17.948020 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-85d0262b-de3f-4e91-ad5b-8f0770ad8743 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1472 microversion: 2.1 time: 0.296495 Aug 03 02:26:17.949485 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3040/5955] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:26:17 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1472 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:26:18.976247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b3872668-d186-426d-b513-9cd1e603f933 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:18.977519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b3872668-d186-426d-b513-9cd1e603f933 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:26:18.996254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3872668-d186-426d-b513-9cd1e603f933 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:18.998283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3872668-d186-426d-b513-9cd1e603f933 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:19.000074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3872668-d186-426d-b513-9cd1e603f933 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:19.003375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3872668-d186-426d-b513-9cd1e603f933 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:19.273694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b3872668-d186-426d-b513-9cd1e603f933 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:26:19.284747 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b3872668-d186-426d-b513-9cd1e603f933 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1643 microversion: 2.1 time: 0.315479 Aug 03 02:26:19.286227 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2916/5956] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:26:18 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1643 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:26:19.312678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2b1f4bf9-d55e-430f-98c5-65a0eaeeba2c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:19.313322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2b1f4bf9-d55e-430f-98c5-65a0eaeeba2c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:26:19.322461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b1f4bf9-d55e-430f-98c5-65a0eaeeba2c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:19.322971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b1f4bf9-d55e-430f-98c5-65a0eaeeba2c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:19.324528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b1f4bf9-d55e-430f-98c5-65a0eaeeba2c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:19.325237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b1f4bf9-d55e-430f-98c5-65a0eaeeba2c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:19.578936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2b1f4bf9-d55e-430f-98c5-65a0eaeeba2c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:26:19.602388 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2b1f4bf9-d55e-430f-98c5-65a0eaeeba2c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1643 microversion: 2.1 time: 0.295241 Aug 03 02:26:19.602927 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3041/5957] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:26:19 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1643 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:26:19.627885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d1c18c23-a618-4ca2-a944-d6442408dc08 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:19.628632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d1c18c23-a618-4ca2-a944-d6442408dc08 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:26:19.637101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1c18c23-a618-4ca2-a944-d6442408dc08 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:19.637672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1c18c23-a618-4ca2-a944-d6442408dc08 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:19.638488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1c18c23-a618-4ca2-a944-d6442408dc08 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:19.639107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1c18c23-a618-4ca2-a944-d6442408dc08 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:20.075112 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d1c18c23-a618-4ca2-a944-d6442408dc08 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1794 microversion: 2.1 time: 0.454365 Aug 03 02:26:20.077983 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2917/5958] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:26:19 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1794 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:26:23.524436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-42cebaea-90da-466e-8d65-df155dbdd375 req-10bde18d-4fcf-4851-b2a3-035d7346d888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1856543a-2d5e-4bd1-a4e5-74f56a372048", "tag": "5686f5e2-3434-44c5-80f3-d34110133dfd"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:26:23.570606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-42cebaea-90da-466e-8d65-df155dbdd375 req-10bde18d-4fcf-4851-b2a3-035d7346d888 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:23.577683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-42cebaea-90da-466e-8d65-df155dbdd375 req-10bde18d-4fcf-4851-b2a3-035d7346d888 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:23.643080 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-42cebaea-90da-466e-8d65-df155dbdd375 req-10bde18d-4fcf-4851-b2a3-035d7346d888 service nova] Creating event network-changed:5686f5e2-3434-44c5-80f3-d34110133dfd for instance 1856543a-2d5e-4bd1-a4e5-74f56a372048 on n-h2-826529-8 Aug 03 02:26:23.669195 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-42cebaea-90da-466e-8d65-df155dbdd375 req-10bde18d-4fcf-4851-b2a3-035d7346d888 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153338 Aug 03 02:26:23.677254 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3042/5959] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:26:54.975714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5f917156-fd6c-4ae3-9040-1d4dfb524831 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:26:54.976332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5f917156-fd6c-4ae3-9040-1d4dfb524831 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:26:54.979392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=18 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:26:54.980028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=34 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:26:54.990940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f917156-fd6c-4ae3-9040-1d4dfb524831 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:54.997915 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f917156-fd6c-4ae3-9040-1d4dfb524831 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:54.999102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f917156-fd6c-4ae3-9040-1d4dfb524831 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:26:54.999771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f917156-fd6c-4ae3-9040-1d4dfb524831 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:26:55.196076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-5f917156-fd6c-4ae3-9040-1d4dfb524831 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lazy-loading 'services' on Instance uuid 23a0131f-6428-4e35-8bde-d82625b92256 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:26:55.346633 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5f917156-fd6c-4ae3-9040-1d4dfb524831 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "DELETE /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256/os-volume_attachments/db9a8680-ebba-4b47-a937-000f628267e0" status: 202 len: 0 microversion: 2.1 time: 0.375074 Aug 03 02:26:55.347750 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2918/5960] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:26:54 2022] DELETE /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256/os-volume_attachments/db9a8680-ebba-4b47-a937-000f628267e0 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:27:03.314065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-be55a54c-e81c-4404-b0f2-ee62d97b4765 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:03.318557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-be55a54c-e81c-4404-b0f2-ee62d97b4765 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:03.326117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:27:03.334857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=46 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:27:03.357923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-be55a54c-e81c-4404-b0f2-ee62d97b4765 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:03.359727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-be55a54c-e81c-4404-b0f2-ee62d97b4765 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:03.360632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-be55a54c-e81c-4404-b0f2-ee62d97b4765 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:03.362148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-be55a54c-e81c-4404-b0f2-ee62d97b4765 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:03.426132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-be55a54c-e81c-4404-b0f2-ee62d97b4765 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:27:03.609717 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-be55a54c-e81c-4404-b0f2-ee62d97b4765 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "DELETE /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256" status: 204 len: 0 microversion: 2.1 time: 0.300146 Aug 03 02:27:03.611432 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3043/5961] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:27:03 2022] DELETE /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:27:03.624618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c5fa559c-4f1d-4614-9ab6-425a41ad4e58 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:03.626036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c5fa559c-4f1d-4614-9ab6-425a41ad4e58 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:03.641596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5fa559c-4f1d-4614-9ab6-425a41ad4e58 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:03.642070 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5fa559c-4f1d-4614-9ab6-425a41ad4e58 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:03.642889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5fa559c-4f1d-4614-9ab6-425a41ad4e58 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:03.643377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5fa559c-4f1d-4614-9ab6-425a41ad4e58 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:04.035384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c5fa559c-4f1d-4614-9ab6-425a41ad4e58 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175889c171da4844aad6576129d12084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ea705606444b7e906afe4e148b2659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:04.044097 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c5fa559c-4f1d-4614-9ab6-425a41ad4e58 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256" status: 200 len: 1469 microversion: 2.1 time: 0.427204 Aug 03 02:27:04.044097 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2919/5962] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:03 2022] GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 => generated 1469 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:05.069492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5f4d5330-0f32-43ec-9d70-5cafc289ab04 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:05.070388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5f4d5330-0f32-43ec-9d70-5cafc289ab04 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:05.078823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f4d5330-0f32-43ec-9d70-5cafc289ab04 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:05.079983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f4d5330-0f32-43ec-9d70-5cafc289ab04 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:05.081017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f4d5330-0f32-43ec-9d70-5cafc289ab04 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:05.081698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f4d5330-0f32-43ec-9d70-5cafc289ab04 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:05.828654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5f4d5330-0f32-43ec-9d70-5cafc289ab04 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175889c171da4844aad6576129d12084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6ea705606444b7e906afe4e148b2659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:05.850020 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5f4d5330-0f32-43ec-9d70-5cafc289ab04 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256" status: 200 len: 1469 microversion: 2.1 time: 0.776423 Aug 03 02:27:05.855519 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3044/5963] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:05 2022] GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 => generated 1469 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:06.288266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-c2492fbb-619d-48f7-8706-d85d4fc11175 req-568725a4-152b-4448-aca1-3a65fae2760b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a0131f-6428-4e35-8bde-d82625b92256", "name": "network-vif-deleted", "tag": "461ac1b0-75db-4cc5-b35b-bdd7f9e8657b"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:27:06.311004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c2492fbb-619d-48f7-8706-d85d4fc11175 req-568725a4-152b-4448-aca1-3a65fae2760b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:06.311509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c2492fbb-619d-48f7-8706-d85d4fc11175 req-568725a4-152b-4448-aca1-3a65fae2760b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:06.342547 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c2492fbb-619d-48f7-8706-d85d4fc11175 req-568725a4-152b-4448-aca1-3a65fae2760b service nova] Creating event network-vif-deleted:461ac1b0-75db-4cc5-b35b-bdd7f9e8657b for instance 23a0131f-6428-4e35-8bde-d82625b92256 on n-h1-826529-8 Aug 03 02:27:06.352376 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-c2492fbb-619d-48f7-8706-d85d4fc11175 req-568725a4-152b-4448-aca1-3a65fae2760b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066601 Aug 03 02:27:06.356832 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2920/5964] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:27:06.884158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37095858-3521-4903-98a2-73bfff52fc10 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:06.885883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-37095858-3521-4903-98a2-73bfff52fc10 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] [instance: 23a0131f-6428-4e35-8bde-d82625b92256] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:06.904423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37095858-3521-4903-98a2-73bfff52fc10 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:06.905256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37095858-3521-4903-98a2-73bfff52fc10 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:06.906330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37095858-3521-4903-98a2-73bfff52fc10 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:06.907037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37095858-3521-4903-98a2-73bfff52fc10 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:06.942376 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-37095858-3521-4903-98a2-73bfff52fc10 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] HTTP exception thrown: Instance 23a0131f-6428-4e35-8bde-d82625b92256 could not be found. Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37095858-3521-4903-98a2-73bfff52fc10 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Request method failure captured: Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 HTTP/1.1 Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6dx3earEIx3nf1T7HYMPuigcKGsXZhcc1gYcrDPta6lmk08aEmqHmM0YB1Dgyse2XuJoT5Gmmkr1bLSw7mfUMQ1sMZCFnQ6IGR7wPmQgmtm6g4gx4xPXEUVrN-zI25x5DdY5J88HPfvsy3UxAT_lnrfpWslZz3OVO-kw8DuStX9LDvU Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: d6ea705606444b7e906afe4e148b2659 Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-VolumesBackupsTest-2059117503 Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6ea705606444b7e906afe4e148b2659", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6ea705606444b7e906afe4e148b2659"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6ea705606444b7e906afe4e148b2659"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6ea705606444b7e906afe4e148b2659"}]}] Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-VolumesBackupsTest-2059117503 Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: d6ea705606444b7e906afe4e148b2659 Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-VolumesBackupsTest-2059117503 Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-VolumesBackupsTest-2059117503-project Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 175889c171da4844aad6576129d12084 Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-VolumesBackupsTest-2059117503-project Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 23a0131f-6428-4e35-8bde-d82625b92256 could not be found. Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '23a0131f-6428-4e35-8bde-d82625b92256'} Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23a0131f-6428-4e35-8bde-d82625b92256 could not be found. Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23a0131f-6428-4e35-8bde-d82625b92256 could not be found. Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:27:06.945130 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:27:06.951460 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:27:06.951460 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:27:06.951460 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:27:06.951460 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:27:06.951460 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:27:06.951460 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23a0131f-6428-4e35-8bde-d82625b92256 could not be found. Aug 03 02:27:06.951460 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:27:06.953262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37095858-3521-4903-98a2-73bfff52fc10 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] Returning 404 to user: Instance 23a0131f-6428-4e35-8bde-d82625b92256 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:27:06.955109 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-37095858-3521-4903-98a2-73bfff52fc10 tempest-VolumesBackupsTest-2059117503 tempest-VolumesBackupsTest-2059117503-project] 10.222.0.67 "GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256" status: 404 len: 111 microversion: 2.1 time: 0.075833 Aug 03 02:27:06.955968 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3045/5965] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:06 2022] GET /compute/v2.1/servers/23a0131f-6428-4e35-8bde-d82625b92256 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:27:16.157417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1985877470", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "764b0f59-c350-4623-8203-2af3fa055615"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2132688460", "security_groups": []}, "os:scheduler_hints": {"different_host": ["1856543a-2d5e-4bd1-a4e5-74f56a372048"]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:27:16.319715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:27:17.120573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] validate_networks() for [('764b0f59-c350-4623-8203-2af3fa055615', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:27:19.221343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:27:19.223246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:27:19.224192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:27:19.224944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:27:19.225648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:27:19.247556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:19.248541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:19.259399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:19.260079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:19.307398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Getting quotas for project 70f3b59cbd864042ad3a5e19802e7e27. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:27:19.332636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Getting quotas for user c38ef02678ad4099af395de16f78c6b3 and project 70f3b59cbd864042ad3a5e19802e7e27. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:27:19.368693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:27:19.374382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:27:19.493976 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c7395a64-0487-4d9c-83b8-f7a357e1a481 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 3.338020 Aug 03 02:27:19.497325 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2921/5966] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:27:16 2022] POST /compute/v2.1/servers => generated 361 bytes in 3346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:27:19.509095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2f0b42a5-6acb-4572-b3db-5a71b59cec5b tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:19.511142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2f0b42a5-6acb-4572-b3db-5a71b59cec5b tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:19.546869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:27:19.559012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:27:19.687663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2f0b42a5-6acb-4572-b3db-5a71b59cec5b tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:19.697330 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2f0b42a5-6acb-4572-b3db-5a71b59cec5b tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1242 microversion: 2.1 time: 0.191355 Aug 03 02:27:19.715224 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3046/5967] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:19 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1242 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:20.722351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6f60f732-d5e9-4d17-a5e8-b465ed6978fa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:20.723193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6f60f732-d5e9-4d17-a5e8-b465ed6978fa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:20.743418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f60f732-d5e9-4d17-a5e8-b465ed6978fa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:20.751112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f60f732-d5e9-4d17-a5e8-b465ed6978fa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:20.752991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f60f732-d5e9-4d17-a5e8-b465ed6978fa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:20.754618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f60f732-d5e9-4d17-a5e8-b465ed6978fa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:21.008465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6f60f732-d5e9-4d17-a5e8-b465ed6978fa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:21.026709 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6f60f732-d5e9-4d17-a5e8-b465ed6978fa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1246 microversion: 2.1 time: 0.308580 Aug 03 02:27:21.045357 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2922/5968] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:20 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1246 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:22.054194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dbbb7603-7abf-482b-ab78-00685cdfff8b tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:22.056517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dbbb7603-7abf-482b-ab78-00685cdfff8b tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:22.068448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbbb7603-7abf-482b-ab78-00685cdfff8b tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:22.069354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbbb7603-7abf-482b-ab78-00685cdfff8b tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:22.070471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbbb7603-7abf-482b-ab78-00685cdfff8b tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:22.072218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbbb7603-7abf-482b-ab78-00685cdfff8b tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:22.217330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dbbb7603-7abf-482b-ab78-00685cdfff8b tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:22.226431 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dbbb7603-7abf-482b-ab78-00685cdfff8b tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1300 microversion: 2.1 time: 0.179413 Aug 03 02:27:22.232311 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3047/5969] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:22 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1300 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:23.249053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-28eaa41b-02b0-4142-aa5f-f99f1097f355 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:23.250301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-28eaa41b-02b0-4142-aa5f-f99f1097f355 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:23.265463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28eaa41b-02b0-4142-aa5f-f99f1097f355 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:23.266177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28eaa41b-02b0-4142-aa5f-f99f1097f355 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:23.268638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28eaa41b-02b0-4142-aa5f-f99f1097f355 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:23.269466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28eaa41b-02b0-4142-aa5f-f99f1097f355 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:23.792074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-28eaa41b-02b0-4142-aa5f-f99f1097f355 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:23.800351 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-28eaa41b-02b0-4142-aa5f-f99f1097f355 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1300 microversion: 2.1 time: 0.555337 Aug 03 02:27:23.806252 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2923/5970] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:23 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1300 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:27:24.689066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-403736b5-2eb0-4024-9ff5-1357edd20702 req-d4fa75e5-c537-4da5-9f10-cbe8ad0e6edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ce13a8f-a4e9-4f28-b099-99547bbe6501", "tag": "01fa720e-f101-4d48-abf2-577777237a47"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:27:24.714312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-403736b5-2eb0-4024-9ff5-1357edd20702 req-d4fa75e5-c537-4da5-9f10-cbe8ad0e6edc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:24.714778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-403736b5-2eb0-4024-9ff5-1357edd20702 req-d4fa75e5-c537-4da5-9f10-cbe8ad0e6edc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:24.739017 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-403736b5-2eb0-4024-9ff5-1357edd20702 req-d4fa75e5-c537-4da5-9f10-cbe8ad0e6edc service nova] Creating event network-changed:01fa720e-f101-4d48-abf2-577777237a47 for instance 4ce13a8f-a4e9-4f28-b099-99547bbe6501 on n-h1-826529-8 Aug 03 02:27:24.747746 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-403736b5-2eb0-4024-9ff5-1357edd20702 req-d4fa75e5-c537-4da5-9f10-cbe8ad0e6edc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063781 Aug 03 02:27:24.749350 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3048/5971] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:27:24.834770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7cc5708e-38d4-4c23-bfb0-094bc908c55c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:24.835436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7cc5708e-38d4-4c23-bfb0-094bc908c55c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:24.856613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7cc5708e-38d4-4c23-bfb0-094bc908c55c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:24.857082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7cc5708e-38d4-4c23-bfb0-094bc908c55c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:24.857898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7cc5708e-38d4-4c23-bfb0-094bc908c55c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:24.858355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7cc5708e-38d4-4c23-bfb0-094bc908c55c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:24.974072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7cc5708e-38d4-4c23-bfb0-094bc908c55c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:24.985383 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7cc5708e-38d4-4c23-bfb0-094bc908c55c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1300 microversion: 2.1 time: 0.157307 Aug 03 02:27:24.986612 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2924/5972] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:24 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1300 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:26.019492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9da2c6b9-efe9-49ad-bf43-150842e3d7d7 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:26.020322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9da2c6b9-efe9-49ad-bf43-150842e3d7d7 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:26.067575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9da2c6b9-efe9-49ad-bf43-150842e3d7d7 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:26.074400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9da2c6b9-efe9-49ad-bf43-150842e3d7d7 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:26.076422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9da2c6b9-efe9-49ad-bf43-150842e3d7d7 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:26.077791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9da2c6b9-efe9-49ad-bf43-150842e3d7d7 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:26.357755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9da2c6b9-efe9-49ad-bf43-150842e3d7d7 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:26.366566 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9da2c6b9-efe9-49ad-bf43-150842e3d7d7 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1300 microversion: 2.1 time: 0.361776 Aug 03 02:27:26.386102 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3049/5973] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:26 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1300 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:27.391030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7805b19d-8cfc-44b5-888d-6aca15c804f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:27.391721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7805b19d-8cfc-44b5-888d-6aca15c804f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:27.405927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:27:27.408377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7805b19d-8cfc-44b5-888d-6aca15c804f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:27.408913 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7805b19d-8cfc-44b5-888d-6aca15c804f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:27.412207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7805b19d-8cfc-44b5-888d-6aca15c804f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:27.412670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7805b19d-8cfc-44b5-888d-6aca15c804f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:27.633411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7805b19d-8cfc-44b5-888d-6aca15c804f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:27.647607 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7805b19d-8cfc-44b5-888d-6aca15c804f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1300 microversion: 2.1 time: 0.260790 Aug 03 02:27:27.651097 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2925/5974] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:27 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1300 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:28.673490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8df18edf-75da-4e3d-8712-f9c863e2da40 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:28.675091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8df18edf-75da-4e3d-8712-f9c863e2da40 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:28.688435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8df18edf-75da-4e3d-8712-f9c863e2da40 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:28.689257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8df18edf-75da-4e3d-8712-f9c863e2da40 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:28.691812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8df18edf-75da-4e3d-8712-f9c863e2da40 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:28.692803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8df18edf-75da-4e3d-8712-f9c863e2da40 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:29.071430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8df18edf-75da-4e3d-8712-f9c863e2da40 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:29.093068 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8df18edf-75da-4e3d-8712-f9c863e2da40 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1300 microversion: 2.1 time: 0.423624 Aug 03 02:27:29.094591 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3050/5975] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:28 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1300 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:30.116620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cd6d1a14-b404-4779-8b52-046534e8e2c4 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:30.120547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cd6d1a14-b404-4779-8b52-046534e8e2c4 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:30.137655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:27:30.142249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:27:30.145602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd6d1a14-b404-4779-8b52-046534e8e2c4 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:30.150446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd6d1a14-b404-4779-8b52-046534e8e2c4 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:30.152676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd6d1a14-b404-4779-8b52-046534e8e2c4 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:30.155365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd6d1a14-b404-4779-8b52-046534e8e2c4 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:30.355003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cd6d1a14-b404-4779-8b52-046534e8e2c4 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:30.375220 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cd6d1a14-b404-4779-8b52-046534e8e2c4 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1300 microversion: 2.1 time: 0.262442 Aug 03 02:27:30.377996 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2926/5976] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:30 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1300 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:30.944982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a6de56d4-153b-4744-9645-29b973de7b24 req-666ef920-2ddc-4b01-9b04-01335cc07ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce13a8f-a4e9-4f28-b099-99547bbe6501", "name": "network-vif-plugged", "status": "completed", "tag": "01fa720e-f101-4d48-abf2-577777237a47"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:27:30.969920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:27:30.978639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a6de56d4-153b-4744-9645-29b973de7b24 req-666ef920-2ddc-4b01-9b04-01335cc07ea9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:30.979907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a6de56d4-153b-4744-9645-29b973de7b24 req-666ef920-2ddc-4b01-9b04-01335cc07ea9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:31.023935 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a6de56d4-153b-4744-9645-29b973de7b24 req-666ef920-2ddc-4b01-9b04-01335cc07ea9 service nova] Creating event network-vif-plugged:01fa720e-f101-4d48-abf2-577777237a47 for instance 4ce13a8f-a4e9-4f28-b099-99547bbe6501 on n-h1-826529-8 Aug 03 02:27:31.047664 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a6de56d4-153b-4744-9645-29b973de7b24 req-666ef920-2ddc-4b01-9b04-01335cc07ea9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105177 Aug 03 02:27:31.048662 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3051/5977] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:27:31.399317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2afb21fd-dc34-453f-a7c0-23c229b359df tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:31.401099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2afb21fd-dc34-453f-a7c0-23c229b359df tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:31.410609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2afb21fd-dc34-453f-a7c0-23c229b359df tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:31.411576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2afb21fd-dc34-453f-a7c0-23c229b359df tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:31.412749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2afb21fd-dc34-453f-a7c0-23c229b359df tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:31.413361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2afb21fd-dc34-453f-a7c0-23c229b359df tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:31.618753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2afb21fd-dc34-453f-a7c0-23c229b359df tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:31.644263 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2afb21fd-dc34-453f-a7c0-23c229b359df tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1300 microversion: 2.1 time: 0.248787 Aug 03 02:27:31.649446 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2927/5978] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:31 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1300 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:32.672861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-278d909b-aff2-46a9-b5c7-771fec1e2b35 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:32.674247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-278d909b-aff2-46a9-b5c7-771fec1e2b35 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:32.689284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-278d909b-aff2-46a9-b5c7-771fec1e2b35 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:32.690058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-278d909b-aff2-46a9-b5c7-771fec1e2b35 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:32.693471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-278d909b-aff2-46a9-b5c7-771fec1e2b35 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:32.694365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-278d909b-aff2-46a9-b5c7-771fec1e2b35 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:32.838749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-278d909b-aff2-46a9-b5c7-771fec1e2b35 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:32.851932 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-278d909b-aff2-46a9-b5c7-771fec1e2b35 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1472 microversion: 2.1 time: 0.187358 Aug 03 02:27:32.859839 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3052/5979] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:32 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1472 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:32.877930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9e9f628e-2b65-4812-ba4f-1ca421894159 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:32.878558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9e9f628e-2b65-4812-ba4f-1ca421894159 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:32.898261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e9f628e-2b65-4812-ba4f-1ca421894159 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:32.900631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e9f628e-2b65-4812-ba4f-1ca421894159 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:32.904143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e9f628e-2b65-4812-ba4f-1ca421894159 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:32.904736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e9f628e-2b65-4812-ba4f-1ca421894159 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:33.031274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9e9f628e-2b65-4812-ba4f-1ca421894159 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:33.052723 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9e9f628e-2b65-4812-ba4f-1ca421894159 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1472 microversion: 2.1 time: 0.180096 Aug 03 02:27:33.075973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5736fd69-77d6-43b0-a52e-78634808a2a3 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:33.076595 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5736fd69-77d6-43b0-a52e-78634808a2a3 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:33.077700 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2928/5980] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:32 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1472 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:33.086452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5736fd69-77d6-43b0-a52e-78634808a2a3 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:33.089630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5736fd69-77d6-43b0-a52e-78634808a2a3 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:33.097965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5736fd69-77d6-43b0-a52e-78634808a2a3 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:33.098433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5736fd69-77d6-43b0-a52e-78634808a2a3 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:33.545481 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5736fd69-77d6-43b0-a52e-78634808a2a3 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1623 microversion: 2.1 time: 0.472966 Aug 03 02:27:33.559710 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3053/5981] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:33 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1623 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:33.569000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b3b1c0c8-ea42-414d-8969-e5bc848b17e5 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:33.570050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b3b1c0c8-ea42-414d-8969-e5bc848b17e5 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:33.579525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3b1c0c8-ea42-414d-8969-e5bc848b17e5 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:33.580291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3b1c0c8-ea42-414d-8969-e5bc848b17e5 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:33.582131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3b1c0c8-ea42-414d-8969-e5bc848b17e5 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:33.582884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3b1c0c8-ea42-414d-8969-e5bc848b17e5 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:34.318822 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b3b1c0c8-ea42-414d-8969-e5bc848b17e5 tempest-TestSecurityGroupsBasicOps-1643890604 tempest-TestSecurityGroupsBasicOps-1643890604-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1913 microversion: 2.1 time: 0.754852 Aug 03 02:27:34.324021 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2929/5982] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:33 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1913 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:34.423418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a4e71e9f-233d-4807-8f53-c8406bfdd837 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:34.424009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a4e71e9f-233d-4807-8f53-c8406bfdd837 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:34.434410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4e71e9f-233d-4807-8f53-c8406bfdd837 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:34.441912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4e71e9f-233d-4807-8f53-c8406bfdd837 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:34.443083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4e71e9f-233d-4807-8f53-c8406bfdd837 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:34.445073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4e71e9f-233d-4807-8f53-c8406bfdd837 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:34.515922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a4e71e9f-233d-4807-8f53-c8406bfdd837 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:27:34.683571 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a4e71e9f-233d-4807-8f53-c8406bfdd837 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 204 len: 0 microversion: 2.1 time: 0.268403 Aug 03 02:27:34.688179 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3054/5983] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:27:34 2022] DELETE /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:27:34.693325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e1274b44-9507-4874-bb28-c019feab0ecb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:34.694215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e1274b44-9507-4874-bb28-c019feab0ecb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:34.704143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1274b44-9507-4874-bb28-c019feab0ecb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:34.704597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1274b44-9507-4874-bb28-c019feab0ecb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:34.705542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1274b44-9507-4874-bb28-c019feab0ecb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:34.705981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1274b44-9507-4874-bb28-c019feab0ecb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:34.912058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e1274b44-9507-4874-bb28-c019feab0ecb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:34.931282 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e1274b44-9507-4874-bb28-c019feab0ecb tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1478 microversion: 2.1 time: 0.239823 Aug 03 02:27:34.932146 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2930/5984] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:34 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1478 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:35.953447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-389b8c20-a4ed-4b22-a792-6d5ed447ccaa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:35.954175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-389b8c20-a4ed-4b22-a792-6d5ed447ccaa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:35.970057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-389b8c20-a4ed-4b22-a792-6d5ed447ccaa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:35.970514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-389b8c20-a4ed-4b22-a792-6d5ed447ccaa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:35.971391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-389b8c20-a4ed-4b22-a792-6d5ed447ccaa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:35.971819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-389b8c20-a4ed-4b22-a792-6d5ed447ccaa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:36.214416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-389b8c20-a4ed-4b22-a792-6d5ed447ccaa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:36.231073 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-389b8c20-a4ed-4b22-a792-6d5ed447ccaa tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1478 microversion: 2.1 time: 0.280702 Aug 03 02:27:36.231707 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3055/5985] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:35 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1478 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:37.263847 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a1867186-cdfc-461a-a42b-13e44b2aa2b6 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:37.264619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a1867186-cdfc-461a-a42b-13e44b2aa2b6 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:37.272001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1867186-cdfc-461a-a42b-13e44b2aa2b6 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:37.272808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1867186-cdfc-461a-a42b-13e44b2aa2b6 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:37.275153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1867186-cdfc-461a-a42b-13e44b2aa2b6 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:37.275887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a1867186-cdfc-461a-a42b-13e44b2aa2b6 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:37.494203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a1867186-cdfc-461a-a42b-13e44b2aa2b6 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:37.521925 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a1867186-cdfc-461a-a42b-13e44b2aa2b6 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 200 len: 1478 microversion: 2.1 time: 0.262740 Aug 03 02:27:37.535283 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2931/5986] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:37 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 1478 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:37.589448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f4f67322-f211-4480-bfc3-36a5b9f3a5a0 req-31ca8b01-69bd-4358-9bf3-389cb9d5493d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce13a8f-a4e9-4f28-b099-99547bbe6501", "name": "network-vif-deleted", "tag": "01fa720e-f101-4d48-abf2-577777237a47"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:27:37.634950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f4f67322-f211-4480-bfc3-36a5b9f3a5a0 req-31ca8b01-69bd-4358-9bf3-389cb9d5493d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:37.636115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f4f67322-f211-4480-bfc3-36a5b9f3a5a0 req-31ca8b01-69bd-4358-9bf3-389cb9d5493d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:37.652181 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f4f67322-f211-4480-bfc3-36a5b9f3a5a0 req-31ca8b01-69bd-4358-9bf3-389cb9d5493d service nova] Creating event network-vif-deleted:01fa720e-f101-4d48-abf2-577777237a47 for instance 4ce13a8f-a4e9-4f28-b099-99547bbe6501 on n-h1-826529-8 Aug 03 02:27:37.663060 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f4f67322-f211-4480-bfc3-36a5b9f3a5a0 req-31ca8b01-69bd-4358-9bf3-389cb9d5493d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077903 Aug 03 02:27:37.665280 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3056/5987] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:27:38.548664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ee388a9-8360-4e52-af64-632e6ca169f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:38.549813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2ee388a9-8360-4e52-af64-632e6ca169f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 4ce13a8f-a4e9-4f28-b099-99547bbe6501] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:38.563227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ee388a9-8360-4e52-af64-632e6ca169f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:38.563853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ee388a9-8360-4e52-af64-632e6ca169f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:38.566356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ee388a9-8360-4e52-af64-632e6ca169f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:38.571632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ee388a9-8360-4e52-af64-632e6ca169f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:38.596541 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-2ee388a9-8360-4e52-af64-632e6ca169f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] HTTP exception thrown: Instance 4ce13a8f-a4e9-4f28-b099-99547bbe6501 could not be found. Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ee388a9-8360-4e52-af64-632e6ca169f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Request method failure captured: Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 HTTP/1.1 Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dytyqxnNF-ewYeIhFZ-9ThKz0ETkN09u11_lAknuS3qdf59bmG-Ty1CHGfA_3wUQ2vk3vMqsMUoTpKDByBZZxuvNxIl2CKoPvgKhc8P84ez8yL9YKYYjBaNcYBk0_Baztb6kNwIkZJGvceBHp7sJqX26iF8rlgrosWSH3VVBpfkSGc Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 70f3b59cbd864042ad3a5e19802e7e27 Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1591668434 Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_70f3b59cbd864042ad3a5e19802e7e27", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70f3b59cbd864042ad3a5e19802e7e27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/70f3b59cbd864042ad3a5e19802e7e27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70f3b59cbd864042ad3a5e19802e7e27"}]}] Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1591668434 Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 70f3b59cbd864042ad3a5e19802e7e27 Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1591668434 Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestSecurityGroupsBasicOps-1591668434-project Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: c38ef02678ad4099af395de16f78c6b3 Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1591668434-project Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 4ce13a8f-a4e9-4f28-b099-99547bbe6501 could not be found. Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '4ce13a8f-a4e9-4f28-b099-99547bbe6501'} Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ce13a8f-a4e9-4f28-b099-99547bbe6501 could not be found. Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ce13a8f-a4e9-4f28-b099-99547bbe6501 could not be found. Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:27:38.599002 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:27:38.603044 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:27:38.603044 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:27:38.603044 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:27:38.603044 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:27:38.603044 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:27:38.603044 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:27:38.603044 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ce13a8f-a4e9-4f28-b099-99547bbe6501 could not be found. Aug 03 02:27:38.603044 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:27:38.604910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ee388a9-8360-4e52-af64-632e6ca169f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Returning 404 to user: Instance 4ce13a8f-a4e9-4f28-b099-99547bbe6501 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:27:38.605974 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2ee388a9-8360-4e52-af64-632e6ca169f9 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501" status: 404 len: 111 microversion: 2.1 time: 0.061513 Aug 03 02:27:38.616934 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2932/5988] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:38 2022] GET /compute/v2.1/servers/4ce13a8f-a4e9-4f28-b099-99547bbe6501 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:27:39.557543 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:27:39.558061 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 02:27:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:27:47.646191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-b44476e4-3b30-454b-bd50-5162408e95be req-825c7027-bd4a-4a38-aff6-0aae405083de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1856543a-2d5e-4bd1-a4e5-74f56a372048", "tag": "5686f5e2-3434-44c5-80f3-d34110133dfd"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:27:47.650282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d134faf7-2d8a-4ba1-a5fc-28c2d8401c6c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:47.655013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d134faf7-2d8a-4ba1-a5fc-28c2d8401c6c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:47.664740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:27:47.666864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:27:47.681636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d134faf7-2d8a-4ba1-a5fc-28c2d8401c6c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:47.683099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b44476e4-3b30-454b-bd50-5162408e95be req-825c7027-bd4a-4a38-aff6-0aae405083de service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:47.683613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d134faf7-2d8a-4ba1-a5fc-28c2d8401c6c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:47.684533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d134faf7-2d8a-4ba1-a5fc-28c2d8401c6c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:47.685148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b44476e4-3b30-454b-bd50-5162408e95be req-825c7027-bd4a-4a38-aff6-0aae405083de service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:47.685810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d134faf7-2d8a-4ba1-a5fc-28c2d8401c6c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:47.698115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=65 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:27:47.724963 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-b44476e4-3b30-454b-bd50-5162408e95be req-825c7027-bd4a-4a38-aff6-0aae405083de service nova] Creating event network-changed:5686f5e2-3434-44c5-80f3-d34110133dfd for instance 1856543a-2d5e-4bd1-a4e5-74f56a372048 on n-h2-826529-8 Aug 03 02:27:47.759724 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-b44476e4-3b30-454b-bd50-5162408e95be req-825c7027-bd4a-4a38-aff6-0aae405083de service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105056 Aug 03 02:27:47.759724 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2933/5989] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:27:47.785824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d134faf7-2d8a-4ba1-a5fc-28c2d8401c6c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:27:47.963545 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d134faf7-2d8a-4ba1-a5fc-28c2d8401c6c tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 204 len: 0 microversion: 2.1 time: 0.326501 Aug 03 02:27:47.965145 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3057/5990] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:27:47 2022] DELETE /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:27:47.983022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b1ae54d1-3366-48e0-a927-361c1e1d1446 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:47.984817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b1ae54d1-3366-48e0-a927-361c1e1d1446 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:48.016016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1ae54d1-3366-48e0-a927-361c1e1d1446 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:48.017596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1ae54d1-3366-48e0-a927-361c1e1d1446 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:48.024011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1ae54d1-3366-48e0-a927-361c1e1d1446 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:48.026026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1ae54d1-3366-48e0-a927-361c1e1d1446 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:48.652282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b1ae54d1-3366-48e0-a927-361c1e1d1446 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:48.664650 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b1ae54d1-3366-48e0-a927-361c1e1d1446 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1768 microversion: 2.1 time: 0.693375 Aug 03 02:27:48.665867 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2934/5991] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:47 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1768 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:49.688695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7240fea1-58f6-4468-ad8a-458a4d0e2595 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:49.689411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7240fea1-58f6-4468-ad8a-458a4d0e2595 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:49.704856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7240fea1-58f6-4468-ad8a-458a4d0e2595 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:49.705494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7240fea1-58f6-4468-ad8a-458a4d0e2595 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:49.706443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7240fea1-58f6-4468-ad8a-458a4d0e2595 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:49.706931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7240fea1-58f6-4468-ad8a-458a4d0e2595 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:50.441019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7240fea1-58f6-4468-ad8a-458a4d0e2595 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:50.458446 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7240fea1-58f6-4468-ad8a-458a4d0e2595 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1768 microversion: 2.1 time: 0.773655 Aug 03 02:27:50.459968 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3058/5992] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:49 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1768 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:51.495303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ff43a17b-07ec-4c85-948b-32c350d82059 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:51.496566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ff43a17b-07ec-4c85-948b-32c350d82059 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:51.505286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff43a17b-07ec-4c85-948b-32c350d82059 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:51.506826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff43a17b-07ec-4c85-948b-32c350d82059 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:51.508862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff43a17b-07ec-4c85-948b-32c350d82059 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:51.509477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff43a17b-07ec-4c85-948b-32c350d82059 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:51.752174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-828c034d-ee12-4959-8d4c-f072ebfd9ba4 req-1edf7b1d-a88d-434f-b3d5-b9c5bd17bb30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1856543a-2d5e-4bd1-a4e5-74f56a372048", "name": "network-vif-deleted", "tag": "5686f5e2-3434-44c5-80f3-d34110133dfd"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:27:51.760822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ff43a17b-07ec-4c85-948b-32c350d82059 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef02678ad4099af395de16f78c6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3b59cbd864042ad3a5e19802e7e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:27:51.789442 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ff43a17b-07ec-4c85-948b-32c350d82059 tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 200 len: 1530 microversion: 2.1 time: 0.301751 Aug 03 02:27:51.798339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-828c034d-ee12-4959-8d4c-f072ebfd9ba4 req-1edf7b1d-a88d-434f-b3d5-b9c5bd17bb30 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:51.799330 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2935/5993] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:51 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 1530 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:27:51.799954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-828c034d-ee12-4959-8d4c-f072ebfd9ba4 req-1edf7b1d-a88d-434f-b3d5-b9c5bd17bb30 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:51.836607 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-828c034d-ee12-4959-8d4c-f072ebfd9ba4 req-1edf7b1d-a88d-434f-b3d5-b9c5bd17bb30 service nova] Creating event network-vif-deleted:5686f5e2-3434-44c5-80f3-d34110133dfd for instance 1856543a-2d5e-4bd1-a4e5-74f56a372048 on n-h2-826529-8 Aug 03 02:27:51.870372 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-828c034d-ee12-4959-8d4c-f072ebfd9ba4 req-1edf7b1d-a88d-434f-b3d5-b9c5bd17bb30 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124792 Aug 03 02:27:51.876004 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3059/5994] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:27:52.823470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-45c1495d-c96c-487c-9101-18f8d161e50d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:27:52.824277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-45c1495d-c96c-487c-9101-18f8d161e50d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] [instance: 1856543a-2d5e-4bd1-a4e5-74f56a372048] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:27:52.842531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45c1495d-c96c-487c-9101-18f8d161e50d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:52.843383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45c1495d-c96c-487c-9101-18f8d161e50d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:52.844457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45c1495d-c96c-487c-9101-18f8d161e50d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:27:52.845116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45c1495d-c96c-487c-9101-18f8d161e50d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:27:52.882604 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-45c1495d-c96c-487c-9101-18f8d161e50d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] HTTP exception thrown: Instance 1856543a-2d5e-4bd1-a4e5-74f56a372048 could not be found. Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-45c1495d-c96c-487c-9101-18f8d161e50d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Request method failure captured: Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 HTTP/1.1 Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6dytyqxnNF-ewYeIhFZ-9ThKz0ETkN09u11_lAknuS3qdf59bmG-Ty1CHGfA_3wUQ2vk3vMqsMUoTpKDByBZZxuvNxIl2CKoPvgKhc8P84ez8yL9YKYYjBaNcYBk0_Baztb6kNwIkZJGvceBHp7sJqX26iF8rlgrosWSH3VVBpfkSGc Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 70f3b59cbd864042ad3a5e19802e7e27 Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1591668434 Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_70f3b59cbd864042ad3a5e19802e7e27", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70f3b59cbd864042ad3a5e19802e7e27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/70f3b59cbd864042ad3a5e19802e7e27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70f3b59cbd864042ad3a5e19802e7e27"}]}] Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1591668434 Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 70f3b59cbd864042ad3a5e19802e7e27 Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1591668434 Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestSecurityGroupsBasicOps-1591668434-project Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: c38ef02678ad4099af395de16f78c6b3 Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1591668434-project Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 1856543a-2d5e-4bd1-a4e5-74f56a372048 could not be found. Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '1856543a-2d5e-4bd1-a4e5-74f56a372048'} Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1856543a-2d5e-4bd1-a4e5-74f56a372048 could not be found. Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1856543a-2d5e-4bd1-a4e5-74f56a372048 could not be found. Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:27:52.892582 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:27:52.895632 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:27:52.895632 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:27:52.895632 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:27:52.895632 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:27:52.895632 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:27:52.895632 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:27:52.895632 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1856543a-2d5e-4bd1-a4e5-74f56a372048 could not be found. Aug 03 02:27:52.895632 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:27:52.897549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-45c1495d-c96c-487c-9101-18f8d161e50d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Returning 404 to user: Instance 1856543a-2d5e-4bd1-a4e5-74f56a372048 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:27:52.899113 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-45c1495d-c96c-487c-9101-18f8d161e50d tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048" status: 404 len: 111 microversion: 2.1 time: 0.081254 Aug 03 02:27:52.903703 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2936/5995] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:27:52 2022] GET /compute/v2.1/servers/1856543a-2d5e-4bd1-a4e5-74f56a372048 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:28:03.713520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4f9e25ac-6e9e-48b9-a64e-2c62e8999d9b tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] Calling method '.version_select at 0x7f5b12363310>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:03.736704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:28:03.738134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:28:03.804797 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4f9e25ac-6e9e-48b9-a64e-2c62e8999d9b tempest-TestSecurityGroupsBasicOps-1591668434 tempest-TestSecurityGroupsBasicOps-1591668434-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2132688460" status: 202 len: 0 microversion: 2.1 time: 0.091900 Aug 03 02:28:03.805550 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3060/5996] 10.222.0.67 () {58 vars in 1278 bytes} [Wed Aug 3 02:28:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2132688460 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:28:14.013580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=23 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:28:14.016315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=15 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:28:14.317091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1899434183", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "171c32c6-3b0e-40bd-a055-5b6858d69e6e"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:28:14.458734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] validate_networks() for [('171c32c6-3b0e-40bd-a055-5b6858d69e6e', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:28:15.795509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:28:15.796831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:28:15.797479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:28:15.797957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:28:15.798544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:28:15.824972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:15.825705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:15.832109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:15.833943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:15.937260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Getting quotas for project 79310a0f25854860963ccf416cd4b6f8. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:28:15.949417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Getting quotas for user 0baefb0afab34de09d8bfcc04c4018a2 and project 79310a0f25854860963ccf416cd4b6f8. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:28:16.060198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:28:16.068285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:28:16.269102 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2cc06055-590e-4d02-899f-8e40ebdeda7b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.263493 Aug 03 02:28:16.281434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-961f5631-85d6-4441-b1a5-aa873b6e53b6 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:16.284722 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2937/5997] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:28:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:28:16.286318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-961f5631-85d6-4441-b1a5-aa873b6e53b6 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:16.323847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:28:16.863100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-961f5631-85d6-4441-b1a5-aa873b6e53b6 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:16.876986 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-961f5631-85d6-4441-b1a5-aa873b6e53b6 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1215 microversion: 2.1 time: 0.597980 Aug 03 02:28:16.881645 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3061/5998] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:16 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1215 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:17.904224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-47ca7687-d8cf-44e6-87f6-3e375656f190 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:17.905059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-47ca7687-d8cf-44e6-87f6-3e375656f190 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:17.925285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47ca7687-d8cf-44e6-87f6-3e375656f190 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:17.929764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47ca7687-d8cf-44e6-87f6-3e375656f190 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:17.931468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47ca7687-d8cf-44e6-87f6-3e375656f190 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:17.933117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47ca7687-d8cf-44e6-87f6-3e375656f190 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:18.048695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-47ca7687-d8cf-44e6-87f6-3e375656f190 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:18.064739 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-47ca7687-d8cf-44e6-87f6-3e375656f190 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1267 microversion: 2.1 time: 0.165673 Aug 03 02:28:18.067719 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2938/5999] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:17 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:19.092047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-583f0dc8-37b6-4566-bb77-e1af2637c446 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:19.093510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-583f0dc8-37b6-4566-bb77-e1af2637c446 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:19.119130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-583f0dc8-37b6-4566-bb77-e1af2637c446 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:19.120998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-583f0dc8-37b6-4566-bb77-e1af2637c446 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:19.123613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-583f0dc8-37b6-4566-bb77-e1af2637c446 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:19.126172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-583f0dc8-37b6-4566-bb77-e1af2637c446 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:19.281364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-583f0dc8-37b6-4566-bb77-e1af2637c446 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:19.293534 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-583f0dc8-37b6-4566-bb77-e1af2637c446 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1273 microversion: 2.1 time: 0.209603 Aug 03 02:28:19.296495 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3062/6000] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:19 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:20.323566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1ce99413-23ad-4393-93bf-2ac598c682a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:20.324566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1ce99413-23ad-4393-93bf-2ac598c682a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:20.353461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ce99413-23ad-4393-93bf-2ac598c682a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:20.354352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ce99413-23ad-4393-93bf-2ac598c682a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:20.356400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ce99413-23ad-4393-93bf-2ac598c682a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:20.359563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1ce99413-23ad-4393-93bf-2ac598c682a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:20.905615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1ce99413-23ad-4393-93bf-2ac598c682a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:20.914820 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1ce99413-23ad-4393-93bf-2ac598c682a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1315 microversion: 2.1 time: 0.600091 Aug 03 02:28:20.925317 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2939/6001] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:20 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:21.875327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a4c6f89d-5994-4168-8bbd-cc2adcb6b503 req-057e2d39-2f9f-4b9f-b146-bfc453f09fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ee50ee-d5f9-44b6-a428-c661f353c103", "tag": "e9cc9b25-fe23-4d82-956e-56ed146bdc95"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:28:21.905964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a4c6f89d-5994-4168-8bbd-cc2adcb6b503 req-057e2d39-2f9f-4b9f-b146-bfc453f09fc7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:21.906549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a4c6f89d-5994-4168-8bbd-cc2adcb6b503 req-057e2d39-2f9f-4b9f-b146-bfc453f09fc7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:21.948063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e4e8fc7c-e936-40eb-9e61-75fba10ebb50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:21.948978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e4e8fc7c-e936-40eb-9e61-75fba10ebb50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:21.957693 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a4c6f89d-5994-4168-8bbd-cc2adcb6b503 req-057e2d39-2f9f-4b9f-b146-bfc453f09fc7 service nova] Creating event network-changed:e9cc9b25-fe23-4d82-956e-56ed146bdc95 for instance 18ee50ee-d5f9-44b6-a428-c661f353c103 on n-h1-826529-8 Aug 03 02:28:21.960776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4e8fc7c-e936-40eb-9e61-75fba10ebb50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:21.966602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4e8fc7c-e936-40eb-9e61-75fba10ebb50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:21.967709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4e8fc7c-e936-40eb-9e61-75fba10ebb50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:21.971611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4e8fc7c-e936-40eb-9e61-75fba10ebb50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:21.985006 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a4c6f89d-5994-4168-8bbd-cc2adcb6b503 req-057e2d39-2f9f-4b9f-b146-bfc453f09fc7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113226 Aug 03 02:28:21.985948 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3063/6002] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:28:22.347497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e4e8fc7c-e936-40eb-9e61-75fba10ebb50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:22.372033 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e4e8fc7c-e936-40eb-9e61-75fba10ebb50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1315 microversion: 2.1 time: 0.425215 Aug 03 02:28:22.373619 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2940/6003] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:21 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:28:23.396174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a349b2b3-8dae-48da-89b2-406c2cdeb4d2 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:23.397703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a349b2b3-8dae-48da-89b2-406c2cdeb4d2 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:23.404560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a349b2b3-8dae-48da-89b2-406c2cdeb4d2 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:23.405247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a349b2b3-8dae-48da-89b2-406c2cdeb4d2 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:23.406193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a349b2b3-8dae-48da-89b2-406c2cdeb4d2 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:23.406790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a349b2b3-8dae-48da-89b2-406c2cdeb4d2 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:23.757268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a349b2b3-8dae-48da-89b2-406c2cdeb4d2 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:23.773049 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a349b2b3-8dae-48da-89b2-406c2cdeb4d2 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1315 microversion: 2.1 time: 0.381842 Aug 03 02:28:23.773645 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3064/6004] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:23 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:24.795399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d377fe1c-5908-4d5a-a707-8db9ac131b2f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:24.796702 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d377fe1c-5908-4d5a-a707-8db9ac131b2f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:24.809230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d377fe1c-5908-4d5a-a707-8db9ac131b2f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:24.810044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d377fe1c-5908-4d5a-a707-8db9ac131b2f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:24.811101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d377fe1c-5908-4d5a-a707-8db9ac131b2f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:24.811745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d377fe1c-5908-4d5a-a707-8db9ac131b2f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:25.129762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d377fe1c-5908-4d5a-a707-8db9ac131b2f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:25.141372 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d377fe1c-5908-4d5a-a707-8db9ac131b2f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1315 microversion: 2.1 time: 0.350286 Aug 03 02:28:25.155820 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2941/6005] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:24 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:26.166037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5ad0e43d-e72c-4735-b0cf-c75aae7c8eb8 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:26.166702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5ad0e43d-e72c-4735-b0cf-c75aae7c8eb8 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:26.188096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ad0e43d-e72c-4735-b0cf-c75aae7c8eb8 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:26.188563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ad0e43d-e72c-4735-b0cf-c75aae7c8eb8 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:26.189362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ad0e43d-e72c-4735-b0cf-c75aae7c8eb8 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:26.189803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5ad0e43d-e72c-4735-b0cf-c75aae7c8eb8 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:26.407809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5ad0e43d-e72c-4735-b0cf-c75aae7c8eb8 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:26.417197 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5ad0e43d-e72c-4735-b0cf-c75aae7c8eb8 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1315 microversion: 2.1 time: 0.256667 Aug 03 02:28:26.418023 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3065/6006] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:26 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:27.440601 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6299fa8d-07a1-4599-bbec-32455b90ea1e tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:27.441438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6299fa8d-07a1-4599-bbec-32455b90ea1e tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:27.457739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:28:27.458547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:28:27.462789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6299fa8d-07a1-4599-bbec-32455b90ea1e tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:27.467467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6299fa8d-07a1-4599-bbec-32455b90ea1e tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:27.468951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6299fa8d-07a1-4599-bbec-32455b90ea1e tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:27.469423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6299fa8d-07a1-4599-bbec-32455b90ea1e tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:27.879169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6299fa8d-07a1-4599-bbec-32455b90ea1e tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:27.887560 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6299fa8d-07a1-4599-bbec-32455b90ea1e tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1315 microversion: 2.1 time: 0.451825 Aug 03 02:28:27.903084 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2942/6007] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:27 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:28.914311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-feedfd1d-4782-4d0e-a77e-c7c84dcc9a83 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:28.915475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-feedfd1d-4782-4d0e-a77e-c7c84dcc9a83 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:28.918827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:28:28.930308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-feedfd1d-4782-4d0e-a77e-c7c84dcc9a83 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:28.931259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-feedfd1d-4782-4d0e-a77e-c7c84dcc9a83 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:28.932406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-feedfd1d-4782-4d0e-a77e-c7c84dcc9a83 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:28.933042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-feedfd1d-4782-4d0e-a77e-c7c84dcc9a83 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:29.259755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-52c9cd1f-7e21-48f1-8ee7-9c92b341161b req-37b51a71-354e-47fa-8f4d-c26e3b5e876b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ee50ee-d5f9-44b6-a428-c661f353c103", "name": "network-vif-plugged", "status": "completed", "tag": "e9cc9b25-fe23-4d82-956e-56ed146bdc95"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:28:29.286376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-52c9cd1f-7e21-48f1-8ee7-9c92b341161b req-37b51a71-354e-47fa-8f4d-c26e3b5e876b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:29.288252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-52c9cd1f-7e21-48f1-8ee7-9c92b341161b req-37b51a71-354e-47fa-8f4d-c26e3b5e876b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:29.313827 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-52c9cd1f-7e21-48f1-8ee7-9c92b341161b req-37b51a71-354e-47fa-8f4d-c26e3b5e876b service nova] Creating event network-vif-plugged:e9cc9b25-fe23-4d82-956e-56ed146bdc95 for instance 18ee50ee-d5f9-44b6-a428-c661f353c103 on n-h1-826529-8 Aug 03 02:28:29.322588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-feedfd1d-4782-4d0e-a77e-c7c84dcc9a83 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:29.328084 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-52c9cd1f-7e21-48f1-8ee7-9c92b341161b req-37b51a71-354e-47fa-8f4d-c26e3b5e876b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072465 Aug 03 02:28:29.329974 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2943/6008] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:28:29.337098 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-feedfd1d-4782-4d0e-a77e-c7c84dcc9a83 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1315 microversion: 2.1 time: 0.430803 Aug 03 02:28:29.337897 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3066/6009] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:28 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:30.378535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8661728d-ec84-4a74-bc6e-29a041bc84d1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:30.380340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8661728d-ec84-4a74-bc6e-29a041bc84d1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:30.393165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8661728d-ec84-4a74-bc6e-29a041bc84d1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:30.393907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8661728d-ec84-4a74-bc6e-29a041bc84d1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:30.398494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8661728d-ec84-4a74-bc6e-29a041bc84d1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:30.399290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8661728d-ec84-4a74-bc6e-29a041bc84d1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:30.874198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8661728d-ec84-4a74-bc6e-29a041bc84d1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:30.883708 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8661728d-ec84-4a74-bc6e-29a041bc84d1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1315 microversion: 2.1 time: 0.512325 Aug 03 02:28:30.895868 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2944/6010] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:30 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:31.915067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ebc56fed-9b5b-4769-9fc6-028f815db4c9 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:31.916407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ebc56fed-9b5b-4769-9fc6-028f815db4c9 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:31.925759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebc56fed-9b5b-4769-9fc6-028f815db4c9 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:31.929887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebc56fed-9b5b-4769-9fc6-028f815db4c9 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:31.931211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebc56fed-9b5b-4769-9fc6-028f815db4c9 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:31.931888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebc56fed-9b5b-4769-9fc6-028f815db4c9 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:32.219250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ebc56fed-9b5b-4769-9fc6-028f815db4c9 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:32.227775 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ebc56fed-9b5b-4769-9fc6-028f815db4c9 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1503 microversion: 2.1 time: 0.318396 Aug 03 02:28:32.243381 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3067/6011] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:31 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1503 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:32.253104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-627ce186-af9b-478e-9be1-54b985995cf1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:32.254286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-627ce186-af9b-478e-9be1-54b985995cf1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:32.269307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-627ce186-af9b-478e-9be1-54b985995cf1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:32.269940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-627ce186-af9b-478e-9be1-54b985995cf1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:32.275170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-627ce186-af9b-478e-9be1-54b985995cf1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:32.275897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-627ce186-af9b-478e-9be1-54b985995cf1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:32.572671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-627ce186-af9b-478e-9be1-54b985995cf1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:32.588464 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-627ce186-af9b-478e-9be1-54b985995cf1 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1503 microversion: 2.1 time: 0.339500 Aug 03 02:28:32.589577 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2945/6012] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:32 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1503 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:32.611694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-69f5823c-d591-4582-aeda-902ac86ce818 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:28:32.612448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-69f5823c-d591-4582-aeda-902ac86ce818 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:32.621375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69f5823c-d591-4582-aeda-902ac86ce818 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:32.622220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69f5823c-d591-4582-aeda-902ac86ce818 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:32.623519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69f5823c-d591-4582-aeda-902ac86ce818 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:32.624179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69f5823c-d591-4582-aeda-902ac86ce818 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:32.672611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-69f5823c-d591-4582-aeda-902ac86ce818 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lazy-loading 'flavor' on Instance uuid 18ee50ee-d5f9-44b6-a428-c661f353c103 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:28:32.830417 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-69f5823c-d591-4582-aeda-902ac86ce818 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "POST /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103/action" status: 202 len: 0 microversion: 2.1 time: 0.221996 Aug 03 02:28:32.835537 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3068/6013] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:28:32 2022] POST /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:28:32.845736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7fdc9c10-2dae-46cd-a85e-7e4a528322e3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:32.847226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7fdc9c10-2dae-46cd-a85e-7e4a528322e3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:32.860334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fdc9c10-2dae-46cd-a85e-7e4a528322e3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:32.863173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fdc9c10-2dae-46cd-a85e-7e4a528322e3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:32.863173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fdc9c10-2dae-46cd-a85e-7e4a528322e3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:32.863173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fdc9c10-2dae-46cd-a85e-7e4a528322e3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:33.038543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7fdc9c10-2dae-46cd-a85e-7e4a528322e3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:33.050151 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7fdc9c10-2dae-46cd-a85e-7e4a528322e3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1511 microversion: 2.1 time: 0.208174 Aug 03 02:28:33.051227 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2946/6014] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:32 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:34.075352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ebf80c05-74ad-45e8-803b-ec1d5dce83db tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:34.077137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ebf80c05-74ad-45e8-803b-ec1d5dce83db tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:34.109168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebf80c05-74ad-45e8-803b-ec1d5dce83db tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:34.109825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebf80c05-74ad-45e8-803b-ec1d5dce83db tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:34.110626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebf80c05-74ad-45e8-803b-ec1d5dce83db tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:34.111100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebf80c05-74ad-45e8-803b-ec1d5dce83db tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:34.417455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ebf80c05-74ad-45e8-803b-ec1d5dce83db tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:34.441343 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ebf80c05-74ad-45e8-803b-ec1d5dce83db tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1494 microversion: 2.1 time: 0.370984 Aug 03 02:28:34.444498 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3069/6015] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:34 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1494 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:34.466384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f0b992ca-b07a-4349-9807-d314abf0b0a6 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:28:34.469038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f0b992ca-b07a-4349-9807-d314abf0b0a6 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:34.494234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f0b992ca-b07a-4349-9807-d314abf0b0a6 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:34.495030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f0b992ca-b07a-4349-9807-d314abf0b0a6 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:34.496034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f0b992ca-b07a-4349-9807-d314abf0b0a6 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:34.503750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f0b992ca-b07a-4349-9807-d314abf0b0a6 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:34.668328 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f0b992ca-b07a-4349-9807-d314abf0b0a6 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "POST /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103/action" status: 202 len: 0 microversion: 2.1 time: 0.205690 Aug 03 02:28:34.669307 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2947/6016] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:28:34 2022] POST /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:28:34.684307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-62337449-4934-42c6-9bff-43fdb18c9e2c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:34.686827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-62337449-4934-42c6-9bff-43fdb18c9e2c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:34.702505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62337449-4934-42c6-9bff-43fdb18c9e2c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:34.703200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62337449-4934-42c6-9bff-43fdb18c9e2c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:34.704285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62337449-4934-42c6-9bff-43fdb18c9e2c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:34.707027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62337449-4934-42c6-9bff-43fdb18c9e2c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:34.928851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-62337449-4934-42c6-9bff-43fdb18c9e2c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:34.937913 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-62337449-4934-42c6-9bff-43fdb18c9e2c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1500 microversion: 2.1 time: 0.264706 Aug 03 02:28:34.939177 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3070/6017] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:34 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1500 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:35.966855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c2812ba5-cd06-4c04-9241-3a0a4c61a6e5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:35.967802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c2812ba5-cd06-4c04-9241-3a0a4c61a6e5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:35.982998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2812ba5-cd06-4c04-9241-3a0a4c61a6e5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:35.985788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2812ba5-cd06-4c04-9241-3a0a4c61a6e5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:35.986766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2812ba5-cd06-4c04-9241-3a0a4c61a6e5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:35.987398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2812ba5-cd06-4c04-9241-3a0a4c61a6e5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:36.309729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c2812ba5-cd06-4c04-9241-3a0a4c61a6e5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:36.324049 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c2812ba5-cd06-4c04-9241-3a0a4c61a6e5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1500 microversion: 2.1 time: 0.363023 Aug 03 02:28:36.325264 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2948/6018] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:35 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1500 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:37.345633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-542269ce-84f9-4d0a-a0f6-044ec889aa02 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:37.346239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-542269ce-84f9-4d0a-a0f6-044ec889aa02 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:37.356225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-542269ce-84f9-4d0a-a0f6-044ec889aa02 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:37.356687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-542269ce-84f9-4d0a-a0f6-044ec889aa02 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:37.357570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-542269ce-84f9-4d0a-a0f6-044ec889aa02 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:37.358605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-542269ce-84f9-4d0a-a0f6-044ec889aa02 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:37.703670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-542269ce-84f9-4d0a-a0f6-044ec889aa02 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:37.722297 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-542269ce-84f9-4d0a-a0f6-044ec889aa02 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1503 microversion: 2.1 time: 0.380345 Aug 03 02:28:37.745276 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-97332204-1c2a-4b2b-b58a-2b2d9a868e2b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:28:37.745821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-97332204-1c2a-4b2b-b58a-2b2d9a868e2b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:37.750472 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3071/6019] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:37 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1503 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:37.754270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97332204-1c2a-4b2b-b58a-2b2d9a868e2b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:37.754946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97332204-1c2a-4b2b-b58a-2b2d9a868e2b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:37.756814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97332204-1c2a-4b2b-b58a-2b2d9a868e2b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:37.757426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-97332204-1c2a-4b2b-b58a-2b2d9a868e2b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:37.785911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-97332204-1c2a-4b2b-b58a-2b2d9a868e2b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lazy-loading 'flavor' on Instance uuid 18ee50ee-d5f9-44b6-a428-c661f353c103 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:28:37.874099 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-97332204-1c2a-4b2b-b58a-2b2d9a868e2b tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "POST /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103/action" status: 202 len: 0 microversion: 2.1 time: 0.132573 Aug 03 02:28:37.875514 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2949/6020] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:28:37 2022] POST /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 02:28:37.884606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-38e80863-113d-41f0-8c81-127bfae5af0f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:37.885327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-38e80863-113d-41f0-8c81-127bfae5af0f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:37.893156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38e80863-113d-41f0-8c81-127bfae5af0f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:37.905322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38e80863-113d-41f0-8c81-127bfae5af0f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:37.906835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38e80863-113d-41f0-8c81-127bfae5af0f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:37.908052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38e80863-113d-41f0-8c81-127bfae5af0f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:38.120102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-38e80863-113d-41f0-8c81-127bfae5af0f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:38.135360 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-38e80863-113d-41f0-8c81-127bfae5af0f tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1511 microversion: 2.1 time: 0.255530 Aug 03 02:28:38.136385 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3072/6021] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:37 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1511 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:39.160956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-64db1cc2-93b2-4457-8d5b-b594835d4e50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:39.162811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-64db1cc2-93b2-4457-8d5b-b594835d4e50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:39.169353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64db1cc2-93b2-4457-8d5b-b594835d4e50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:39.169810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64db1cc2-93b2-4457-8d5b-b594835d4e50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:39.170594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64db1cc2-93b2-4457-8d5b-b594835d4e50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:39.171074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-64db1cc2-93b2-4457-8d5b-b594835d4e50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:39.384382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-64db1cc2-93b2-4457-8d5b-b594835d4e50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:39.400299 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-64db1cc2-93b2-4457-8d5b-b594835d4e50 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1494 microversion: 2.1 time: 0.244361 Aug 03 02:28:39.404048 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2950/6022] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:39 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1494 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:39.428442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dc10bc89-b620-46b3-845f-a8218b236c24 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:28:39.428999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dc10bc89-b620-46b3-845f-a8218b236c24 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:39.448679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc10bc89-b620-46b3-845f-a8218b236c24 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:39.449353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc10bc89-b620-46b3-845f-a8218b236c24 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:39.450307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc10bc89-b620-46b3-845f-a8218b236c24 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:39.450923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dc10bc89-b620-46b3-845f-a8218b236c24 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:39.540284 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dc10bc89-b620-46b3-845f-a8218b236c24 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "POST /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103/action" status: 202 len: 0 microversion: 2.1 time: 0.115874 Aug 03 02:28:39.544148 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3073/6023] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:28:39 2022] POST /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:28:39.549521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c5eed2fe-751d-49db-b3ab-6b6d170b77ae tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:39.549933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c5eed2fe-751d-49db-b3ab-6b6d170b77ae tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:39.562649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5eed2fe-751d-49db-b3ab-6b6d170b77ae tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:39.563146 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5eed2fe-751d-49db-b3ab-6b6d170b77ae tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:39.563979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5eed2fe-751d-49db-b3ab-6b6d170b77ae tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:39.564435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5eed2fe-751d-49db-b3ab-6b6d170b77ae tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:40.340386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c5eed2fe-751d-49db-b3ab-6b6d170b77ae tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:40.355317 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c5eed2fe-751d-49db-b3ab-6b6d170b77ae tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1500 microversion: 2.1 time: 0.809708 Aug 03 02:28:40.356452 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2951/6024] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:39 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1500 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:41.379991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-088e9b4c-f77d-4938-8623-740a1b6f8f0d tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:41.382994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-088e9b4c-f77d-4938-8623-740a1b6f8f0d tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:41.403288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-088e9b4c-f77d-4938-8623-740a1b6f8f0d tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:41.403999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-088e9b4c-f77d-4938-8623-740a1b6f8f0d tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:41.404957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-088e9b4c-f77d-4938-8623-740a1b6f8f0d tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:41.405560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-088e9b4c-f77d-4938-8623-740a1b6f8f0d tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:41.730620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-088e9b4c-f77d-4938-8623-740a1b6f8f0d tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:41.742109 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-088e9b4c-f77d-4938-8623-740a1b6f8f0d tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1500 microversion: 2.1 time: 0.365972 Aug 03 02:28:41.746635 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3074/6025] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:41 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1500 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:42.773330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e6afbe8f-2e06-48d7-97d0-7946ccb6b51c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:42.774548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e6afbe8f-2e06-48d7-97d0-7946ccb6b51c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:42.783559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6afbe8f-2e06-48d7-97d0-7946ccb6b51c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:42.784378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6afbe8f-2e06-48d7-97d0-7946ccb6b51c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:42.785341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6afbe8f-2e06-48d7-97d0-7946ccb6b51c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:42.786099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e6afbe8f-2e06-48d7-97d0-7946ccb6b51c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:42.816876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:28:43.024346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e6afbe8f-2e06-48d7-97d0-7946ccb6b51c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:43.037957 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e6afbe8f-2e06-48d7-97d0-7946ccb6b51c tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1503 microversion: 2.1 time: 0.267852 Aug 03 02:28:43.044037 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2952/6026] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:42 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1503 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:43.065909 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2653fab0-f65b-4499-b4ac-1fc6efdc45b5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:43.066423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2653fab0-f65b-4499-b4ac-1fc6efdc45b5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:43.087160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2653fab0-f65b-4499-b4ac-1fc6efdc45b5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:43.087631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2653fab0-f65b-4499-b4ac-1fc6efdc45b5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:43.088448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2653fab0-f65b-4499-b4ac-1fc6efdc45b5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:43.088908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2653fab0-f65b-4499-b4ac-1fc6efdc45b5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:43.121819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2653fab0-f65b-4499-b4ac-1fc6efdc45b5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:28:43.172418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:28:43.305206 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2653fab0-f65b-4499-b4ac-1fc6efdc45b5 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "DELETE /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 204 len: 0 microversion: 2.1 time: 0.242718 Aug 03 02:28:43.309476 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3075/6027] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:28:43 2022] DELETE /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:28:43.315935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-481a337e-0353-4cc6-a7a5-50663369660a tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:43.317057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-481a337e-0353-4cc6-a7a5-50663369660a tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:43.325627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-481a337e-0353-4cc6-a7a5-50663369660a tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:43.326090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-481a337e-0353-4cc6-a7a5-50663369660a tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:43.332792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-481a337e-0353-4cc6-a7a5-50663369660a tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:43.333546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-481a337e-0353-4cc6-a7a5-50663369660a tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:43.699813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-481a337e-0353-4cc6-a7a5-50663369660a tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:43.712460 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-481a337e-0353-4cc6-a7a5-50663369660a tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1509 microversion: 2.1 time: 0.399967 Aug 03 02:28:43.713450 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2953/6028] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:43 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1509 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:44.737967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-beea3509-ecd6-48ce-8388-416e6d4a0062 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:44.738682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-beea3509-ecd6-48ce-8388-416e6d4a0062 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:44.754153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-beea3509-ecd6-48ce-8388-416e6d4a0062 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:44.759937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-beea3509-ecd6-48ce-8388-416e6d4a0062 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:44.762227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-beea3509-ecd6-48ce-8388-416e6d4a0062 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:44.762928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-beea3509-ecd6-48ce-8388-416e6d4a0062 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:45.133972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-beea3509-ecd6-48ce-8388-416e6d4a0062 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:45.146830 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-beea3509-ecd6-48ce-8388-416e6d4a0062 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1509 microversion: 2.1 time: 0.412616 Aug 03 02:28:45.148064 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3076/6029] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:44 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1509 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:46.173337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8740fda4-c3fc-4cd3-92b6-cf4c917334a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:46.174570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8740fda4-c3fc-4cd3-92b6-cf4c917334a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:46.188109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:28:46.206942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8740fda4-c3fc-4cd3-92b6-cf4c917334a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:46.207683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8740fda4-c3fc-4cd3-92b6-cf4c917334a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:46.208954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8740fda4-c3fc-4cd3-92b6-cf4c917334a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:46.209544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8740fda4-c3fc-4cd3-92b6-cf4c917334a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:46.604519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8740fda4-c3fc-4cd3-92b6-cf4c917334a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:46.623838 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8740fda4-c3fc-4cd3-92b6-cf4c917334a3 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1509 microversion: 2.1 time: 0.453691 Aug 03 02:28:46.632263 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2954/6030] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:46 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1509 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:47.103808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f3787c0c-5097-4778-905b-32d9f26bf6cf req-c33cb04e-2f2d-4bdf-b3a0-12c38029d89b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ee50ee-d5f9-44b6-a428-c661f353c103", "name": "network-vif-deleted", "tag": "e9cc9b25-fe23-4d82-956e-56ed146bdc95"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:28:47.125893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:28:47.150519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f3787c0c-5097-4778-905b-32d9f26bf6cf req-c33cb04e-2f2d-4bdf-b3a0-12c38029d89b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:47.152653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f3787c0c-5097-4778-905b-32d9f26bf6cf req-c33cb04e-2f2d-4bdf-b3a0-12c38029d89b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:47.195398 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f3787c0c-5097-4778-905b-32d9f26bf6cf req-c33cb04e-2f2d-4bdf-b3a0-12c38029d89b service nova] Creating event network-vif-deleted:e9cc9b25-fe23-4d82-956e-56ed146bdc95 for instance 18ee50ee-d5f9-44b6-a428-c661f353c103 on n-h1-826529-8 Aug 03 02:28:47.204410 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f3787c0c-5097-4778-905b-32d9f26bf6cf req-c33cb04e-2f2d-4bdf-b3a0-12c38029d89b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109745 Aug 03 02:28:47.207437 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3077/6031] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:28:47.657427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2a81a699-370e-487c-9659-1fefa7d77d93 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:47.657427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2a81a699-370e-487c-9659-1fefa7d77d93 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:47.678183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a81a699-370e-487c-9659-1fefa7d77d93 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:47.680364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a81a699-370e-487c-9659-1fefa7d77d93 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:47.682122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a81a699-370e-487c-9659-1fefa7d77d93 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:47.682804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a81a699-370e-487c-9659-1fefa7d77d93 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:47.818535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a81a699-370e-487c-9659-1fefa7d77d93 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:47.819044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a81a699-370e-487c-9659-1fefa7d77d93 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:47.819615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-2a81a699-370e-487c-9659-1fefa7d77d93 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lazy-loading 'fault' on Instance uuid 18ee50ee-d5f9-44b6-a428-c661f353c103 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:28:47.913183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2a81a699-370e-487c-9659-1fefa7d77d93 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0baefb0afab34de09d8bfcc04c4018a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79310a0f25854860963ccf416cd4b6f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:28:47.931676 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2a81a699-370e-487c-9659-1fefa7d77d93 tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 200 len: 1305 microversion: 2.1 time: 0.280916 Aug 03 02:28:47.938627 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2955/6032] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:47 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 1305 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:28:48.976377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0c36578d-4330-4526-8fbc-003203bb69ec tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:28:48.982597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0c36578d-4330-4526-8fbc-003203bb69ec tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] [instance: 18ee50ee-d5f9-44b6-a428-c661f353c103] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:28:49.000351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c36578d-4330-4526-8fbc-003203bb69ec tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:49.001272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c36578d-4330-4526-8fbc-003203bb69ec tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:49.002223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c36578d-4330-4526-8fbc-003203bb69ec tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:28:49.003167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c36578d-4330-4526-8fbc-003203bb69ec tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:28:49.038440 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-0c36578d-4330-4526-8fbc-003203bb69ec tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] HTTP exception thrown: Instance 18ee50ee-d5f9-44b6-a428-c661f353c103 could not be found. Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0c36578d-4330-4526-8fbc-003203bb69ec tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Request method failure captured: Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 HTTP/1.1 Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6d06sx7nIaqIbNTL4vDgeTaCoHMBDDk9wcC8NHBOgizK2mvDWIgE8JlgqK_vmV4IqinhHX7KPN-coXD96DW7YRuQJLGfL-ta6IsLkktNLoerO9kFpTfkoGoDOb1O3652hn63eRMWFTt0AdtwJO22yenKc5w5O30lZmRXbBw8o7LG9lI Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 79310a0f25854860963ccf416cd4b6f8 Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestServerAdvancedOps-705359472 Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_79310a0f25854860963ccf416cd4b6f8", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/79310a0f25854860963ccf416cd4b6f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/79310a0f25854860963ccf416cd4b6f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/79310a0f25854860963ccf416cd4b6f8"}]}] Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestServerAdvancedOps-705359472 Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 79310a0f25854860963ccf416cd4b6f8 Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestServerAdvancedOps-705359472 Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestServerAdvancedOps-705359472-project Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 0baefb0afab34de09d8bfcc04c4018a2 Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestServerAdvancedOps-705359472-project Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 18ee50ee-d5f9-44b6-a428-c661f353c103 could not be found. Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '18ee50ee-d5f9-44b6-a428-c661f353c103'} Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ee50ee-d5f9-44b6-a428-c661f353c103 could not be found. Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ee50ee-d5f9-44b6-a428-c661f353c103 could not be found. Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:28:49.044798 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:28:49.049112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:28:49.049112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:28:49.049112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:28:49.049112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:28:49.049112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:28:49.049112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ee50ee-d5f9-44b6-a428-c661f353c103 could not be found. Aug 03 02:28:49.049112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:28:49.050282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0c36578d-4330-4526-8fbc-003203bb69ec tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] Returning 404 to user: Instance 18ee50ee-d5f9-44b6-a428-c661f353c103 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:28:49.055342 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0c36578d-4330-4526-8fbc-003203bb69ec tempest-TestServerAdvancedOps-705359472 tempest-TestServerAdvancedOps-705359472-project] 10.222.0.67 "GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103" status: 404 len: 111 microversion: 2.1 time: 0.092837 Aug 03 02:28:49.055965 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3078/6033] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:28:48 2022] GET /compute/v2.1/servers/18ee50ee-d5f9-44b6-a428-c661f353c103 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:29:19.631630 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:29:19.633918 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 02:29:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:30:59.569497 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:30:59.570397 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 02:30:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:30:59.665569 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:30:59.666197 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 02:30:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:30:59.703838 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:30:59.704222 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 02:30:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:31:13.853488 n-d-826529-8 devstack@n-api.service[125942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6768ec80-552a-4875-95fb-ee55c75da43d] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 02:31:13.855076 n-d-826529-8 devstack@n-api.service[125942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95a5e56a-7955-4bb2-902f-a217315250e4] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 02:31:13.855796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=5 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:31:13.856700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=24 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:31:13.989718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-998719235", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "d6cd4de9-7274-44a9-9c8a-f937d1a59ebf"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:31:14.056391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] validate_networks() for [('d6cd4de9-7274-44a9-9c8a-f937d1a59ebf', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:31:14.773617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:31:14.774737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:31:14.775892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:31:14.776884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:31:14.777648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:31:14.792688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:14.793386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:14.794482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:14.795251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:14.817100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Getting quotas for project 2250ad7065fb4ac7a202ea19526a6ab0. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:31:14.823254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Getting quotas for user 62bd31e6be0a47989231e8b0d119e063 and project 2250ad7065fb4ac7a202ea19526a6ab0. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:31:14.839030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:31:14.841641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:31:14.880512 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] [6768ec80-552a-4875-95fb-ee55c75da43d] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 56646. Aug 03 02:31:14.882017 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] [95a5e56a-7955-4bb2-902f-a217315250e4] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 56648. Aug 03 02:31:14.900505 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7a1d0b89-541c-414e-a1ca-459f6150d5b3 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.054816 Aug 03 02:31:14.901156 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2956/6034] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:31:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:31:14.911316 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b324c37-7dbb-4b30-9a93-80ead1f0c21e] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 02:31:14.912793 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c87329c-10f0-40cc-99d5-2fdb48e49def] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 02:31:14.913532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:31:14.914426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:31:14.919027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-690f596c-27b0-4d5a-a9e3-55d22afddc64 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:31:14.919819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-690f596c-27b0-4d5a-a9e3-55d22afddc64 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:31:14.998753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-690f596c-27b0-4d5a-a9e3-55d22afddc64 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bd31e6be0a47989231e8b0d119e063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2250ad7065fb4ac7a202ea19526a6ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:31:15.007448 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-690f596c-27b0-4d5a-a9e3-55d22afddc64 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6" status: 200 len: 1213 microversion: 2.1 time: 0.098968 Aug 03 02:31:15.008981 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3079/6035] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:31:14 2022] GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:31:15.418028 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:31:15.418392 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 02:31:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:31:16.030630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bc8a59c0-c954-451a-a275-8a7a1ac0f0b8 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:31:16.031609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bc8a59c0-c954-451a-a275-8a7a1ac0f0b8 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:31:16.051156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc8a59c0-c954-451a-a275-8a7a1ac0f0b8 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:16.053465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc8a59c0-c954-451a-a275-8a7a1ac0f0b8 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:16.056022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc8a59c0-c954-451a-a275-8a7a1ac0f0b8 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:16.056796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc8a59c0-c954-451a-a275-8a7a1ac0f0b8 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:16.159071 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bc8a59c0-c954-451a-a275-8a7a1ac0f0b8 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bd31e6be0a47989231e8b0d119e063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2250ad7065fb4ac7a202ea19526a6ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:31:16.185111 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bc8a59c0-c954-451a-a275-8a7a1ac0f0b8 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6" status: 200 len: 1265 microversion: 2.1 time: 0.159306 Aug 03 02:31:16.186065 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2957/6036] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:31:16 2022] GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:31:16.822239 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:31:16.822690 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 02:31:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:31:17.207903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-52733463-2176-4dcb-82b3-29c18844ae4c tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:31:17.208455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-52733463-2176-4dcb-82b3-29c18844ae4c tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:31:17.219256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52733463-2176-4dcb-82b3-29c18844ae4c tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:17.219714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52733463-2176-4dcb-82b3-29c18844ae4c tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:17.220525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52733463-2176-4dcb-82b3-29c18844ae4c tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:17.221107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52733463-2176-4dcb-82b3-29c18844ae4c tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:17.229843 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b324c37-7dbb-4b30-9a93-80ead1f0c21e] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 56694. Aug 03 02:31:17.244679 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c87329c-10f0-40cc-99d5-2fdb48e49def] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 56696. Aug 03 02:31:17.383206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-52733463-2176-4dcb-82b3-29c18844ae4c tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bd31e6be0a47989231e8b0d119e063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2250ad7065fb4ac7a202ea19526a6ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:31:17.391415 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-52733463-2176-4dcb-82b3-29c18844ae4c tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6" status: 200 len: 1313 microversion: 2.1 time: 0.189544 Aug 03 02:31:17.392640 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3080/6037] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:31:17 2022] GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:31:17.912820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-0433e5f7-3401-4a7b-bd6c-f98ce979fda9 req-970cc1d2-6188-46f9-8453-f4e5a94ca055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e96c8d7f-9572-4bf7-baec-4709be4c07b6", "tag": "02827e77-aeeb-4109-9705-4b5ffa32636c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:31:17.931004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0433e5f7-3401-4a7b-bd6c-f98ce979fda9 req-970cc1d2-6188-46f9-8453-f4e5a94ca055 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:17.931450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0433e5f7-3401-4a7b-bd6c-f98ce979fda9 req-970cc1d2-6188-46f9-8453-f4e5a94ca055 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:17.947609 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-0433e5f7-3401-4a7b-bd6c-f98ce979fda9 req-970cc1d2-6188-46f9-8453-f4e5a94ca055 service nova] Creating event network-changed:02827e77-aeeb-4109-9705-4b5ffa32636c for instance e96c8d7f-9572-4bf7-baec-4709be4c07b6 on n-h1-826529-8 Aug 03 02:31:17.959258 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-0433e5f7-3401-4a7b-bd6c-f98ce979fda9 req-970cc1d2-6188-46f9-8453-f4e5a94ca055 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159527 Aug 03 02:31:17.960175 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2958/6038] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:31:18.414379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-493c6c1e-fcaa-450c-8018-ada84140f562 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:31:18.414931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-493c6c1e-fcaa-450c-8018-ada84140f562 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:31:18.422331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-493c6c1e-fcaa-450c-8018-ada84140f562 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:18.422986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-493c6c1e-fcaa-450c-8018-ada84140f562 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:18.423784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-493c6c1e-fcaa-450c-8018-ada84140f562 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:18.425502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-493c6c1e-fcaa-450c-8018-ada84140f562 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:18.566517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-493c6c1e-fcaa-450c-8018-ada84140f562 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bd31e6be0a47989231e8b0d119e063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2250ad7065fb4ac7a202ea19526a6ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:31:18.575042 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-493c6c1e-fcaa-450c-8018-ada84140f562 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6" status: 200 len: 1313 microversion: 2.1 time: 0.164916 Aug 03 02:31:18.575616 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3081/6039] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:31:18 2022] GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:31:19.603134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-913bd867-1594-48b4-81fa-4b415d57d927 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:31:19.603869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-913bd867-1594-48b4-81fa-4b415d57d927 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:31:19.610615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-913bd867-1594-48b4-81fa-4b415d57d927 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:19.611114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-913bd867-1594-48b4-81fa-4b415d57d927 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:19.612564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-913bd867-1594-48b4-81fa-4b415d57d927 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:19.613008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-913bd867-1594-48b4-81fa-4b415d57d927 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:19.783591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-913bd867-1594-48b4-81fa-4b415d57d927 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bd31e6be0a47989231e8b0d119e063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2250ad7065fb4ac7a202ea19526a6ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:31:19.791440 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-913bd867-1594-48b4-81fa-4b415d57d927 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6" status: 200 len: 1313 microversion: 2.1 time: 0.197693 Aug 03 02:31:19.794938 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2959/6040] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:31:19 2022] GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:31:20.813223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-89462f32-f885-4706-b819-37f5cc28e220 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:31:20.814255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-89462f32-f885-4706-b819-37f5cc28e220 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:31:20.822993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89462f32-f885-4706-b819-37f5cc28e220 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:20.823459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89462f32-f885-4706-b819-37f5cc28e220 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:20.824260 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89462f32-f885-4706-b819-37f5cc28e220 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:20.824742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-89462f32-f885-4706-b819-37f5cc28e220 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:20.965617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-89462f32-f885-4706-b819-37f5cc28e220 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bd31e6be0a47989231e8b0d119e063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2250ad7065fb4ac7a202ea19526a6ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:31:20.974539 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-89462f32-f885-4706-b819-37f5cc28e220 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6" status: 200 len: 1313 microversion: 2.1 time: 0.165599 Aug 03 02:31:20.975151 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3082/6041] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:31:20 2022] GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:31:21.995942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-acb53129-b46f-4c51-bcc6-ba42fb3d2423 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:31:21.996845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-acb53129-b46f-4c51-bcc6-ba42fb3d2423 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:31:22.005315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acb53129-b46f-4c51-bcc6-ba42fb3d2423 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:22.005892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acb53129-b46f-4c51-bcc6-ba42fb3d2423 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:22.006858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acb53129-b46f-4c51-bcc6-ba42fb3d2423 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:22.007400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-acb53129-b46f-4c51-bcc6-ba42fb3d2423 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:22.170096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-acb53129-b46f-4c51-bcc6-ba42fb3d2423 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bd31e6be0a47989231e8b0d119e063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2250ad7065fb4ac7a202ea19526a6ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:31:22.179410 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-acb53129-b46f-4c51-bcc6-ba42fb3d2423 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6" status: 200 len: 1313 microversion: 2.1 time: 0.187654 Aug 03 02:31:22.180268 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2960/6042] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:31:21 2022] GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:31:23.201596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3f595b9b-1812-46fd-bec9-a384794bab15 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:31:23.202334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3f595b9b-1812-46fd-bec9-a384794bab15 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:31:23.210817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f595b9b-1812-46fd-bec9-a384794bab15 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:23.211310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f595b9b-1812-46fd-bec9-a384794bab15 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:23.212155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f595b9b-1812-46fd-bec9-a384794bab15 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:23.212667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f595b9b-1812-46fd-bec9-a384794bab15 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:23.364653 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3f595b9b-1812-46fd-bec9-a384794bab15 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bd31e6be0a47989231e8b0d119e063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2250ad7065fb4ac7a202ea19526a6ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:31:23.374359 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3f595b9b-1812-46fd-bec9-a384794bab15 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6" status: 200 len: 1313 microversion: 2.1 time: 0.176429 Aug 03 02:31:23.375329 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3083/6043] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:31:23 2022] GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:31:23.536819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-2e7d0372-514e-4e1b-8672-7981f12d5801 req-c478e75e-58ce-4608-9af9-5757d580bd44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96c8d7f-9572-4bf7-baec-4709be4c07b6", "name": "network-vif-plugged", "status": "completed", "tag": "02827e77-aeeb-4109-9705-4b5ffa32636c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:31:23.548574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2e7d0372-514e-4e1b-8672-7981f12d5801 req-c478e75e-58ce-4608-9af9-5757d580bd44 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:23.549403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2e7d0372-514e-4e1b-8672-7981f12d5801 req-c478e75e-58ce-4608-9af9-5757d580bd44 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:23.561471 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-2e7d0372-514e-4e1b-8672-7981f12d5801 req-c478e75e-58ce-4608-9af9-5757d580bd44 service nova] Creating event network-vif-plugged:02827e77-aeeb-4109-9705-4b5ffa32636c for instance e96c8d7f-9572-4bf7-baec-4709be4c07b6 on n-h1-826529-8 Aug 03 02:31:23.568313 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-2e7d0372-514e-4e1b-8672-7981f12d5801 req-c478e75e-58ce-4608-9af9-5757d580bd44 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130580 Aug 03 02:31:23.569087 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2961/6044] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:31:24.396296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a4294a45-c6a3-45b9-90f7-c029babf7707 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:31:24.396909 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a4294a45-c6a3-45b9-90f7-c029babf7707 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:31:24.404318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4294a45-c6a3-45b9-90f7-c029babf7707 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:24.404766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4294a45-c6a3-45b9-90f7-c029babf7707 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:24.405544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4294a45-c6a3-45b9-90f7-c029babf7707 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:24.405979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a4294a45-c6a3-45b9-90f7-c029babf7707 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:24.544957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a4294a45-c6a3-45b9-90f7-c029babf7707 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bd31e6be0a47989231e8b0d119e063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2250ad7065fb4ac7a202ea19526a6ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:31:24.553778 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a4294a45-c6a3-45b9-90f7-c029babf7707 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6" status: 200 len: 1313 microversion: 2.1 time: 0.161330 Aug 03 02:31:24.554367 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3084/6045] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:31:24 2022] GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:31:25.574834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:31:25.574834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:31:25.581980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d2bb1dcc-df61-431d-87bd-d2c0c7d1b2a4 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:31:25.582737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d2bb1dcc-df61-431d-87bd-d2c0c7d1b2a4 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:31:25.590993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2bb1dcc-df61-431d-87bd-d2c0c7d1b2a4 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:25.591461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2bb1dcc-df61-431d-87bd-d2c0c7d1b2a4 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:25.592276 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2bb1dcc-df61-431d-87bd-d2c0c7d1b2a4 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:25.592728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2bb1dcc-df61-431d-87bd-d2c0c7d1b2a4 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:25.826410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d2bb1dcc-df61-431d-87bd-d2c0c7d1b2a4 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bd31e6be0a47989231e8b0d119e063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2250ad7065fb4ac7a202ea19526a6ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:31:25.835314 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d2bb1dcc-df61-431d-87bd-d2c0c7d1b2a4 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6" status: 200 len: 1497 microversion: 2.1 time: 0.263929 Aug 03 02:31:25.838996 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2962/6046] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:31:25 2022] GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 => generated 1497 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:31:28.364997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed13b0fd-7d7f-4e57-b18b-07e33fde9a3d tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:31:28.365661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ed13b0fd-7d7f-4e57-b18b-07e33fde9a3d tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:31:28.367950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:31:28.385078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed13b0fd-7d7f-4e57-b18b-07e33fde9a3d tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:28.385638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed13b0fd-7d7f-4e57-b18b-07e33fde9a3d tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:28.386932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed13b0fd-7d7f-4e57-b18b-07e33fde9a3d tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:28.387464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed13b0fd-7d7f-4e57-b18b-07e33fde9a3d tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:28.425941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ed13b0fd-7d7f-4e57-b18b-07e33fde9a3d tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:31:28.522741 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed13b0fd-7d7f-4e57-b18b-07e33fde9a3d tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6" status: 204 len: 0 microversion: 2.1 time: 0.162067 Aug 03 02:31:28.525991 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3085/6047] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:31:28 2022] DELETE /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:31:28.534182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-05b0b9ef-0116-4809-9115-77c5a75728fb tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:31:28.534823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-05b0b9ef-0116-4809-9115-77c5a75728fb tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:31:28.542669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05b0b9ef-0116-4809-9115-77c5a75728fb tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:28.543112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05b0b9ef-0116-4809-9115-77c5a75728fb tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:28.544110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05b0b9ef-0116-4809-9115-77c5a75728fb tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:28.544558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-05b0b9ef-0116-4809-9115-77c5a75728fb tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:28.692008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-05b0b9ef-0116-4809-9115-77c5a75728fb tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bd31e6be0a47989231e8b0d119e063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2250ad7065fb4ac7a202ea19526a6ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:31:28.706224 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-05b0b9ef-0116-4809-9115-77c5a75728fb tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6" status: 200 len: 1503 microversion: 2.1 time: 0.175625 Aug 03 02:31:28.707425 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2963/6048] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:31:28 2022] GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:31:29.728262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-68fddd23-3650-493b-8415-60b46090a786 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:31:29.728968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-68fddd23-3650-493b-8415-60b46090a786 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:31:29.737389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68fddd23-3650-493b-8415-60b46090a786 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:29.738072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68fddd23-3650-493b-8415-60b46090a786 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:29.739065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68fddd23-3650-493b-8415-60b46090a786 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:29.739793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68fddd23-3650-493b-8415-60b46090a786 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:29.911407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-68fddd23-3650-493b-8415-60b46090a786 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bd31e6be0a47989231e8b0d119e063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2250ad7065fb4ac7a202ea19526a6ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:31:29.921517 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-68fddd23-3650-493b-8415-60b46090a786 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6" status: 200 len: 1503 microversion: 2.1 time: 0.197206 Aug 03 02:31:29.922107 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3086/6049] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:31:29 2022] GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:31:30.945584 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fb889d5d-71f2-4257-8c3c-15206a82b349 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:31:30.946529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fb889d5d-71f2-4257-8c3c-15206a82b349 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:31:30.954286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb889d5d-71f2-4257-8c3c-15206a82b349 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:30.956530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb889d5d-71f2-4257-8c3c-15206a82b349 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:30.957477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb889d5d-71f2-4257-8c3c-15206a82b349 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:30.957897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb889d5d-71f2-4257-8c3c-15206a82b349 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:31.053997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fb889d5d-71f2-4257-8c3c-15206a82b349 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62bd31e6be0a47989231e8b0d119e063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2250ad7065fb4ac7a202ea19526a6ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:31:31.074184 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fb889d5d-71f2-4257-8c3c-15206a82b349 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6" status: 200 len: 1461 microversion: 2.1 time: 0.131287 Aug 03 02:31:31.074818 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2964/6050] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:31:30 2022] GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 => generated 1461 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:31:31.168881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-eebad2a4-ba78-4f73-b24e-cb7d5c654daf req-9d5d4136-c541-4ae9-a583-10a107dcfa04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96c8d7f-9572-4bf7-baec-4709be4c07b6", "name": "network-vif-deleted", "tag": "02827e77-aeeb-4109-9705-4b5ffa32636c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:31:31.193834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-eebad2a4-ba78-4f73-b24e-cb7d5c654daf req-9d5d4136-c541-4ae9-a583-10a107dcfa04 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:31.196933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-eebad2a4-ba78-4f73-b24e-cb7d5c654daf req-9d5d4136-c541-4ae9-a583-10a107dcfa04 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:31.213983 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-eebad2a4-ba78-4f73-b24e-cb7d5c654daf req-9d5d4136-c541-4ae9-a583-10a107dcfa04 service nova] Creating event network-vif-deleted:02827e77-aeeb-4109-9705-4b5ffa32636c for instance e96c8d7f-9572-4bf7-baec-4709be4c07b6 on n-h1-826529-8 Aug 03 02:31:31.224546 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-eebad2a4-ba78-4f73-b24e-cb7d5c654daf req-9d5d4136-c541-4ae9-a583-10a107dcfa04 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058808 Aug 03 02:31:31.225911 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3087/6051] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:31:32.096749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-52255096-8287-4f32-b811-e2747bbf5091 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:31:32.098094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-52255096-8287-4f32-b811-e2747bbf5091 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] [instance: e96c8d7f-9572-4bf7-baec-4709be4c07b6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:31:32.105739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52255096-8287-4f32-b811-e2747bbf5091 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:32.106262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52255096-8287-4f32-b811-e2747bbf5091 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:32.107163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52255096-8287-4f32-b811-e2747bbf5091 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:31:32.107679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-52255096-8287-4f32-b811-e2747bbf5091 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:31:32.122831 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-52255096-8287-4f32-b811-e2747bbf5091 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] HTTP exception thrown: Instance e96c8d7f-9572-4bf7-baec-4709be4c07b6 could not be found. Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-52255096-8287-4f32-b811-e2747bbf5091 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Request method failure captured: Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 HTTP/1.1 Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6d3wwp6sJ5uWaGYh3Wrc3jMRdm3HwRrD8d98_xJx5c48_bT_KYeSIYgzcVasFuQx5TBihhhOKBY5oS-XQYrO9zf-KQZTusBdfYWake6bLZkLTasa3ZnhV8TE9dyAXNAiv8_w67P0Hztq09P5661ufMzNx4Ma2eEre6OZ8IG3ok6OofA Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 2250ad7065fb4ac7a202ea19526a6ab0 Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-VolumesActionsTest-1867698447 Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2250ad7065fb4ac7a202ea19526a6ab0", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2250ad7065fb4ac7a202ea19526a6ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2250ad7065fb4ac7a202ea19526a6ab0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2250ad7065fb4ac7a202ea19526a6ab0"}]}] Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-VolumesActionsTest-1867698447 Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 2250ad7065fb4ac7a202ea19526a6ab0 Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-VolumesActionsTest-1867698447 Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-VolumesActionsTest-1867698447-project Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 62bd31e6be0a47989231e8b0d119e063 Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-VolumesActionsTest-1867698447-project Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance e96c8d7f-9572-4bf7-baec-4709be4c07b6 could not be found. Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'e96c8d7f-9572-4bf7-baec-4709be4c07b6'} Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e96c8d7f-9572-4bf7-baec-4709be4c07b6 could not be found. Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e96c8d7f-9572-4bf7-baec-4709be4c07b6 could not be found. Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:31:32.124968 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:31:32.134532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:31:32.134532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:31:32.134532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:31:32.134532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:31:32.134532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:31:32.134532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e96c8d7f-9572-4bf7-baec-4709be4c07b6 could not be found. Aug 03 02:31:32.134532 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:31:32.134532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-52255096-8287-4f32-b811-e2747bbf5091 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] Returning 404 to user: Instance e96c8d7f-9572-4bf7-baec-4709be4c07b6 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:31:32.134532 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-52255096-8287-4f32-b811-e2747bbf5091 tempest-VolumesActionsTest-1867698447 tempest-VolumesActionsTest-1867698447-project] 10.222.0.67 "GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6" status: 404 len: 111 microversion: 2.1 time: 0.036020 Aug 03 02:31:32.134532 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2965/6052] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:31:32 2022] GET /compute/v2.1/servers/e96c8d7f-9572-4bf7-baec-4709be4c07b6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:32:27.348661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bb98beee-c3bf-4eb4-ab17-63c14d0a414a tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Action: 'create', calling method: .version_select at 0x7f5b122ffd30>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-573380780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5P3kRruXns0yGBSQsZmCFthBae3SejqXmkZb3WsTPhBz+9j9AUWvCkeAa+6+2PlNAuhcGrx3/Czy9IP2uiFU+YuhEuqSVLxb2u6Y8ZcKXqNX2Sn8Hdjqy70JW3+3/BBQ=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:32:27.367645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:32:27.369439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:32:27.386304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-bb98beee-c3bf-4eb4-ab17-63c14d0a414a tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Getting quotas for project 8c035964586b4e73a6394246ef08c8e1. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:32:27.396426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-bb98beee-c3bf-4eb4-ab17-63c14d0a414a tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Getting quotas for user 2b6af47da52741b985a7dad4a19023b8 and project 8c035964586b4e73a6394246ef08c8e1. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:32:27.442480 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bb98beee-c3bf-4eb4-ab17-63c14d0a414a tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.105352 Aug 03 02:32:27.443713 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3088/6053] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:32:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:32:28.816664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1263956173", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cd93911a-fe0d-4b49-a35b-023ea406e4cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-573380780", "security_groups": [{"name": "tempest-secgroup-smoke-679864904"}], "networks": [{"uuid": "6785d329-5b84-490a-b713-a99971de5110"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:32:28.837195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:32:28.838303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=44 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:32:29.011965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] validate_networks() for [('6785d329-5b84-490a-b713-a99971de5110', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:32:29.669756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:32:29.670187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:32:29.670701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:32:29.671265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:32:29.671850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:32:29.683887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:29.684616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:29.685471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:29.686067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:29.708681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Getting quotas for project 8c035964586b4e73a6394246ef08c8e1. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:32:29.714916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Getting quotas for user 2b6af47da52741b985a7dad4a19023b8 and project 8c035964586b4e73a6394246ef08c8e1. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:32:29.812163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:32:29.815334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd93911a-fe0d-4b49-a35b-023ea406e4cd',volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:32:30.024237 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ffdb614f-8bf0-4e9e-be13-5552c5407fca tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.214823 Aug 03 02:32:30.025593 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2966/6054] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:32:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:32:30.039312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6c75fb59-cb47-4cb8-9cc0-c3072a2663c2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:30.040624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6c75fb59-cb47-4cb8-9cc0-c3072a2663c2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:30.119588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6c75fb59-cb47-4cb8-9cc0-c3072a2663c2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:30.128219 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6c75fb59-cb47-4cb8-9cc0-c3072a2663c2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1098 microversion: 2.1 time: 0.095451 Aug 03 02:32:30.130389 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3089/6055] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:30 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1098 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:31.165427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-07a7d612-028f-4f11-94b8-dae94c310c42 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:31.166150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-07a7d612-028f-4f11-94b8-dae94c310c42 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:31.174940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07a7d612-028f-4f11-94b8-dae94c310c42 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:31.175387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07a7d612-028f-4f11-94b8-dae94c310c42 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:31.176184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07a7d612-028f-4f11-94b8-dae94c310c42 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:31.176628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07a7d612-028f-4f11-94b8-dae94c310c42 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:31.281023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-07a7d612-028f-4f11-94b8-dae94c310c42 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:31.291251 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-07a7d612-028f-4f11-94b8-dae94c310c42 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1196 microversion: 2.1 time: 0.141182 Aug 03 02:32:31.292244 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2967/6056] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:31 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1196 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:32.313426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1a633448-e29c-4f85-8b29-d6af4418fcb9 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:32.316375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1a633448-e29c-4f85-8b29-d6af4418fcb9 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:32.331050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a633448-e29c-4f85-8b29-d6af4418fcb9 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:32.332116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a633448-e29c-4f85-8b29-d6af4418fcb9 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:32.333144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a633448-e29c-4f85-8b29-d6af4418fcb9 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:32.333857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a633448-e29c-4f85-8b29-d6af4418fcb9 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:32.481925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1a633448-e29c-4f85-8b29-d6af4418fcb9 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:32.497551 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1a633448-e29c-4f85-8b29-d6af4418fcb9 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1214 microversion: 2.1 time: 0.188458 Aug 03 02:32:32.514791 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3090/6057] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:32 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:33.525204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bf9de969-7b38-4de5-b0f4-bc419bc3a9e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:33.526426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bf9de969-7b38-4de5-b0f4-bc419bc3a9e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:33.535247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf9de969-7b38-4de5-b0f4-bc419bc3a9e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:33.535710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf9de969-7b38-4de5-b0f4-bc419bc3a9e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:33.536529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf9de969-7b38-4de5-b0f4-bc419bc3a9e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:33.537279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf9de969-7b38-4de5-b0f4-bc419bc3a9e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:33.895381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bf9de969-7b38-4de5-b0f4-bc419bc3a9e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:33.914701 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bf9de969-7b38-4de5-b0f4-bc419bc3a9e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1281 microversion: 2.1 time: 0.387099 Aug 03 02:32:33.915696 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2968/6058] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:33 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1281 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:34.083876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-56946ac9-83e8-4b55-bc71-5837530d4fae req-93d9dd83-822f-4b58-9c85-e327fa77a3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6140c0a0-2123-4239-8003-f8677742e477", "tag": "f44fa36a-cab7-4f52-9ecf-4c32e33d976e"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:32:34.107328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-56946ac9-83e8-4b55-bc71-5837530d4fae req-93d9dd83-822f-4b58-9c85-e327fa77a3a0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:34.107808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-56946ac9-83e8-4b55-bc71-5837530d4fae req-93d9dd83-822f-4b58-9c85-e327fa77a3a0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:34.145299 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-56946ac9-83e8-4b55-bc71-5837530d4fae req-93d9dd83-822f-4b58-9c85-e327fa77a3a0 service nova] Creating event network-changed:f44fa36a-cab7-4f52-9ecf-4c32e33d976e for instance 6140c0a0-2123-4239-8003-f8677742e477 on n-h1-826529-8 Aug 03 02:32:34.150672 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-56946ac9-83e8-4b55-bc71-5837530d4fae req-93d9dd83-822f-4b58-9c85-e327fa77a3a0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070510 Aug 03 02:32:34.151326 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3091/6059] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:32:34.962103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6c66151b-df15-40fc-916a-689d50e42897 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:34.963488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6c66151b-df15-40fc-916a-689d50e42897 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:34.977134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c66151b-df15-40fc-916a-689d50e42897 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:34.977791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c66151b-df15-40fc-916a-689d50e42897 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:34.978754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c66151b-df15-40fc-916a-689d50e42897 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:34.979457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c66151b-df15-40fc-916a-689d50e42897 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:35.146050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6c66151b-df15-40fc-916a-689d50e42897 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:35.160087 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6c66151b-df15-40fc-916a-689d50e42897 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1281 microversion: 2.1 time: 0.204014 Aug 03 02:32:35.160689 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2969/6060] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:34 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1281 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:36.183235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6909cc3d-a47a-438b-bb02-fb376bd98894 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:36.184054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6909cc3d-a47a-438b-bb02-fb376bd98894 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:36.190932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6909cc3d-a47a-438b-bb02-fb376bd98894 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:36.191424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6909cc3d-a47a-438b-bb02-fb376bd98894 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:36.192217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6909cc3d-a47a-438b-bb02-fb376bd98894 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:36.192657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6909cc3d-a47a-438b-bb02-fb376bd98894 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:36.345655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6909cc3d-a47a-438b-bb02-fb376bd98894 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:36.354038 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6909cc3d-a47a-438b-bb02-fb376bd98894 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1281 microversion: 2.1 time: 0.176014 Aug 03 02:32:36.354625 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3092/6061] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:36 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:37.374471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a7521000-fce9-4b0d-a056-8f7ab49b8c3e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:37.375436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a7521000-fce9-4b0d-a056-8f7ab49b8c3e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:37.383168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a7521000-fce9-4b0d-a056-8f7ab49b8c3e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:37.383757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a7521000-fce9-4b0d-a056-8f7ab49b8c3e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:37.384655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a7521000-fce9-4b0d-a056-8f7ab49b8c3e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:37.385267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a7521000-fce9-4b0d-a056-8f7ab49b8c3e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:37.530991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a7521000-fce9-4b0d-a056-8f7ab49b8c3e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:37.540618 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a7521000-fce9-4b0d-a056-8f7ab49b8c3e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1281 microversion: 2.1 time: 0.169978 Aug 03 02:32:37.541634 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2970/6062] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:37 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1281 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:38.563814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f549eec7-391b-4fd5-b999-1cb2b9f0ae09 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:38.564622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f549eec7-391b-4fd5-b999-1cb2b9f0ae09 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:38.572159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f549eec7-391b-4fd5-b999-1cb2b9f0ae09 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:38.572622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f549eec7-391b-4fd5-b999-1cb2b9f0ae09 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:38.573423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f549eec7-391b-4fd5-b999-1cb2b9f0ae09 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:38.573872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f549eec7-391b-4fd5-b999-1cb2b9f0ae09 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:38.739264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f549eec7-391b-4fd5-b999-1cb2b9f0ae09 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:38.762813 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f549eec7-391b-4fd5-b999-1cb2b9f0ae09 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1281 microversion: 2.1 time: 0.203174 Aug 03 02:32:38.763453 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3093/6063] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:38 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1281 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:39.647548 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:32:39.648492 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 02:32:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:32:39.782257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:32:39.784406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:32:39.788911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4ff14df2-a03f-426c-ae9d-c8673f4921fb tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:39.790147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4ff14df2-a03f-426c-ae9d-c8673f4921fb tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:39.799185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ff14df2-a03f-426c-ae9d-c8673f4921fb tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:39.799898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ff14df2-a03f-426c-ae9d-c8673f4921fb tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:39.800906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ff14df2-a03f-426c-ae9d-c8673f4921fb tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:39.801499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ff14df2-a03f-426c-ae9d-c8673f4921fb tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:39.978459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4ff14df2-a03f-426c-ae9d-c8673f4921fb tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:39.988044 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4ff14df2-a03f-426c-ae9d-c8673f4921fb tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1281 microversion: 2.1 time: 0.207539 Aug 03 02:32:40.000536 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2971/6064] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:39 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1281 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:41.008972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e1fddf9a-3f31-4d33-90ff-07cb925ae5f2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:41.010239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e1fddf9a-3f31-4d33-90ff-07cb925ae5f2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:41.014335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:32:41.019214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e1fddf9a-3f31-4d33-90ff-07cb925ae5f2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:41.019677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e1fddf9a-3f31-4d33-90ff-07cb925ae5f2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:41.020467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e1fddf9a-3f31-4d33-90ff-07cb925ae5f2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:41.020907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e1fddf9a-3f31-4d33-90ff-07cb925ae5f2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:41.238680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e1fddf9a-3f31-4d33-90ff-07cb925ae5f2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:41.247250 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e1fddf9a-3f31-4d33-90ff-07cb925ae5f2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1269 microversion: 2.1 time: 0.242735 Aug 03 02:32:41.248150 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3094/6065] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:41 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1269 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:42.268507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-49faca66-530e-4771-ab00-2e3487bc483e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:42.269203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-49faca66-530e-4771-ab00-2e3487bc483e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:42.276886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49faca66-530e-4771-ab00-2e3487bc483e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:42.277366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49faca66-530e-4771-ab00-2e3487bc483e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:42.278210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49faca66-530e-4771-ab00-2e3487bc483e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:42.278756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-49faca66-530e-4771-ab00-2e3487bc483e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:42.428406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-49faca66-530e-4771-ab00-2e3487bc483e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:42.451944 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-49faca66-530e-4771-ab00-2e3487bc483e tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1269 microversion: 2.1 time: 0.187210 Aug 03 02:32:42.466185 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2972/6066] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:42 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1269 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:43.474007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-563e7749-bc1f-478a-923a-9036ddf23756 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:43.474873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-563e7749-bc1f-478a-923a-9036ddf23756 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:43.482621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-563e7749-bc1f-478a-923a-9036ddf23756 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:43.483252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-563e7749-bc1f-478a-923a-9036ddf23756 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:43.484210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-563e7749-bc1f-478a-923a-9036ddf23756 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:43.484823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-563e7749-bc1f-478a-923a-9036ddf23756 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:43.632185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-563e7749-bc1f-478a-923a-9036ddf23756 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:43.641328 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-563e7749-bc1f-478a-923a-9036ddf23756 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1269 microversion: 2.1 time: 0.170146 Aug 03 02:32:43.641833 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3095/6067] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:43 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1269 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:44.662132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f48c610c-81a3-4e3e-b118-f621bb75f3f7 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:44.662825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f48c610c-81a3-4e3e-b118-f621bb75f3f7 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:44.670135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f48c610c-81a3-4e3e-b118-f621bb75f3f7 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:44.670592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f48c610c-81a3-4e3e-b118-f621bb75f3f7 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:44.671397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f48c610c-81a3-4e3e-b118-f621bb75f3f7 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:44.674235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f48c610c-81a3-4e3e-b118-f621bb75f3f7 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:44.829485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f48c610c-81a3-4e3e-b118-f621bb75f3f7 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:44.837520 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f48c610c-81a3-4e3e-b118-f621bb75f3f7 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1269 microversion: 2.1 time: 0.179420 Aug 03 02:32:44.838312 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2973/6068] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:44 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1269 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:45.858954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-80499531-512e-44c8-81bc-e7760c1dcf46 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:45.860117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-80499531-512e-44c8-81bc-e7760c1dcf46 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:45.867410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80499531-512e-44c8-81bc-e7760c1dcf46 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:45.867881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80499531-512e-44c8-81bc-e7760c1dcf46 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:45.868654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80499531-512e-44c8-81bc-e7760c1dcf46 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:45.869089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80499531-512e-44c8-81bc-e7760c1dcf46 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:46.017485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-80499531-512e-44c8-81bc-e7760c1dcf46 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:46.025191 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-80499531-512e-44c8-81bc-e7760c1dcf46 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1269 microversion: 2.1 time: 0.170197 Aug 03 02:32:46.026229 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3096/6069] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:45 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:47.048534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1bcabd3e-b799-4fc6-9c0a-be3abbfae0d4 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:47.049279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1bcabd3e-b799-4fc6-9c0a-be3abbfae0d4 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:47.056081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1bcabd3e-b799-4fc6-9c0a-be3abbfae0d4 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:47.056620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1bcabd3e-b799-4fc6-9c0a-be3abbfae0d4 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:47.057484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1bcabd3e-b799-4fc6-9c0a-be3abbfae0d4 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:47.058002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1bcabd3e-b799-4fc6-9c0a-be3abbfae0d4 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:47.207579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1bcabd3e-b799-4fc6-9c0a-be3abbfae0d4 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:47.215749 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1bcabd3e-b799-4fc6-9c0a-be3abbfae0d4 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1269 microversion: 2.1 time: 0.172072 Aug 03 02:32:47.216639 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2974/6070] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:47 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:48.238218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1a5bf207-4b33-4514-b9e1-faa9031c2792 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:48.238792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1a5bf207-4b33-4514-b9e1-faa9031c2792 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:48.245482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a5bf207-4b33-4514-b9e1-faa9031c2792 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:48.245949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a5bf207-4b33-4514-b9e1-faa9031c2792 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:48.246735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a5bf207-4b33-4514-b9e1-faa9031c2792 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:48.247226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1a5bf207-4b33-4514-b9e1-faa9031c2792 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:48.387303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1a5bf207-4b33-4514-b9e1-faa9031c2792 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:48.395573 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1a5bf207-4b33-4514-b9e1-faa9031c2792 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1269 microversion: 2.1 time: 0.161887 Aug 03 02:32:48.396145 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3097/6071] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:48 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:49.416514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7fa46749-57bf-4175-95a0-33545f310145 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:49.417267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7fa46749-57bf-4175-95a0-33545f310145 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:49.425539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fa46749-57bf-4175-95a0-33545f310145 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:49.426004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fa46749-57bf-4175-95a0-33545f310145 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:49.426985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fa46749-57bf-4175-95a0-33545f310145 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:49.427440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fa46749-57bf-4175-95a0-33545f310145 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:49.807174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7fa46749-57bf-4175-95a0-33545f310145 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:49.816808 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7fa46749-57bf-4175-95a0-33545f310145 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1269 microversion: 2.1 time: 0.404433 Aug 03 02:32:49.817503 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2975/6072] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:49 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1269 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:50.837590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-056dc2fc-edc6-45f4-baae-a2bde7326dab tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:50.838741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-056dc2fc-edc6-45f4-baae-a2bde7326dab tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:50.857138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-056dc2fc-edc6-45f4-baae-a2bde7326dab tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:50.857608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-056dc2fc-edc6-45f4-baae-a2bde7326dab tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:50.858401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-056dc2fc-edc6-45f4-baae-a2bde7326dab tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:50.858843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-056dc2fc-edc6-45f4-baae-a2bde7326dab tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:51.048436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-056dc2fc-edc6-45f4-baae-a2bde7326dab tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:51.058407 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-056dc2fc-edc6-45f4-baae-a2bde7326dab tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1269 microversion: 2.1 time: 0.224358 Aug 03 02:32:51.072761 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3098/6073] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:50 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1269 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:51.930148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-10479f3c-eb3f-460f-82e1-5a75ebe2d2e2 req-48759a83-42da-4c93-b797-656d77d7d8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6140c0a0-2123-4239-8003-f8677742e477", "name": "network-vif-plugged", "status": "completed", "tag": "f44fa36a-cab7-4f52-9ecf-4c32e33d976e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:32:51.964566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-10479f3c-eb3f-460f-82e1-5a75ebe2d2e2 req-48759a83-42da-4c93-b797-656d77d7d8b5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:51.965677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-10479f3c-eb3f-460f-82e1-5a75ebe2d2e2 req-48759a83-42da-4c93-b797-656d77d7d8b5 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:51.995405 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-10479f3c-eb3f-460f-82e1-5a75ebe2d2e2 req-48759a83-42da-4c93-b797-656d77d7d8b5 service nova] Creating event network-vif-plugged:f44fa36a-cab7-4f52-9ecf-4c32e33d976e for instance 6140c0a0-2123-4239-8003-f8677742e477 on n-h1-826529-8 Aug 03 02:32:52.002921 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-10479f3c-eb3f-460f-82e1-5a75ebe2d2e2 req-48759a83-42da-4c93-b797-656d77d7d8b5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077522 Aug 03 02:32:52.007441 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2976/6074] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:32:52.083584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-08509e76-199f-420e-b358-1fdc1da90803 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:52.084412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-08509e76-199f-420e-b358-1fdc1da90803 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:52.097894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08509e76-199f-420e-b358-1fdc1da90803 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:52.098460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08509e76-199f-420e-b358-1fdc1da90803 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:52.102299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08509e76-199f-420e-b358-1fdc1da90803 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:52.119275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-08509e76-199f-420e-b358-1fdc1da90803 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:52.451935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-08509e76-199f-420e-b358-1fdc1da90803 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:52.477953 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-08509e76-199f-420e-b358-1fdc1da90803 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1269 microversion: 2.1 time: 0.389494 Aug 03 02:32:52.478920 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3099/6075] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:52 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1269 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:53.506975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-497745b5-0de6-4c29-8061-30d5a8bf6c81 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:53.507703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-497745b5-0de6-4c29-8061-30d5a8bf6c81 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:53.514531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-497745b5-0de6-4c29-8061-30d5a8bf6c81 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:53.515036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-497745b5-0de6-4c29-8061-30d5a8bf6c81 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:53.516186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-497745b5-0de6-4c29-8061-30d5a8bf6c81 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:53.516486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-497745b5-0de6-4c29-8061-30d5a8bf6c81 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:53.662197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-497745b5-0de6-4c29-8061-30d5a8bf6c81 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:53.670122 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-497745b5-0de6-4c29-8061-30d5a8bf6c81 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1458 microversion: 2.1 time: 0.168984 Aug 03 02:32:53.670701 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2977/6076] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:53 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1458 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:53.692450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-16d08ebb-1f63-4e65-8e19-9a71d2edf099 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:32:53.693080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-16d08ebb-1f63-4e65-8e19-9a71d2edf099 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:32:53.701226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16d08ebb-1f63-4e65-8e19-9a71d2edf099 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:53.701688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16d08ebb-1f63-4e65-8e19-9a71d2edf099 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:53.703383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16d08ebb-1f63-4e65-8e19-9a71d2edf099 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:53.704310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16d08ebb-1f63-4e65-8e19-9a71d2edf099 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:53.847596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-16d08ebb-1f63-4e65-8e19-9a71d2edf099 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:32:53.855537 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-16d08ebb-1f63-4e65-8e19-9a71d2edf099 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1458 microversion: 2.1 time: 0.167289 Aug 03 02:32:53.856128 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3100/6077] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:32:53 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1458 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:32:56.333620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-14cef961-12e2-459b-a063-7b58f431b111 req-8c061821-9078-4918-bbab-268b0e291f61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6140c0a0-2123-4239-8003-f8677742e477", "tag": "f44fa36a-cab7-4f52-9ecf-4c32e33d976e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:32:56.347281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-14cef961-12e2-459b-a063-7b58f431b111 req-8c061821-9078-4918-bbab-268b0e291f61 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:56.347989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-14cef961-12e2-459b-a063-7b58f431b111 req-8c061821-9078-4918-bbab-268b0e291f61 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:56.364073 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-14cef961-12e2-459b-a063-7b58f431b111 req-8c061821-9078-4918-bbab-268b0e291f61 service nova] Creating event network-changed:f44fa36a-cab7-4f52-9ecf-4c32e33d976e for instance 6140c0a0-2123-4239-8003-f8677742e477 on n-h1-826529-8 Aug 03 02:32:56.370360 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-14cef961-12e2-459b-a063-7b58f431b111 req-8c061821-9078-4918-bbab-268b0e291f61 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224819 Aug 03 02:32:56.371591 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2978/6078] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:32:58.394074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-02797cfc-7eae-4024-ac9b-95d8903a2deb req-819fd2f2-4913-4208-aece-7bc2855416fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6140c0a0-2123-4239-8003-f8677742e477", "tag": "f44fa36a-cab7-4f52-9ecf-4c32e33d976e"}, {"name": "network-changed", "server_uuid": "6140c0a0-2123-4239-8003-f8677742e477", "tag": "f44fa36a-cab7-4f52-9ecf-4c32e33d976e"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:32:58.404603 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:32:58.412040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-02797cfc-7eae-4024-ac9b-95d8903a2deb req-819fd2f2-4913-4208-aece-7bc2855416fe service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:32:58.412486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-02797cfc-7eae-4024-ac9b-95d8903a2deb req-819fd2f2-4913-4208-aece-7bc2855416fe service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:32:58.418020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=63 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:32:58.430679 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-02797cfc-7eae-4024-ac9b-95d8903a2deb req-819fd2f2-4913-4208-aece-7bc2855416fe service nova] Creating event network-changed:f44fa36a-cab7-4f52-9ecf-4c32e33d976e for instance 6140c0a0-2123-4239-8003-f8677742e477 on n-h1-826529-8 Aug 03 02:32:58.431231 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-02797cfc-7eae-4024-ac9b-95d8903a2deb req-819fd2f2-4913-4208-aece-7bc2855416fe service nova] Creating event network-changed:f44fa36a-cab7-4f52-9ecf-4c32e33d976e for instance 6140c0a0-2123-4239-8003-f8677742e477 on n-h1-826529-8 Aug 03 02:32:58.437089 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-02797cfc-7eae-4024-ac9b-95d8903a2deb req-819fd2f2-4913-4208-aece-7bc2855416fe service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047497 Aug 03 02:32:58.437893 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3101/6079] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:33:21.101711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:33:21.102462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=66 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:33:21.106848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-418482244", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "7aa5e1ea-d7bf-44d0-bc5b-2c0f35e27ae8"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:33:21.165284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] validate_networks() for [('7aa5e1ea-d7bf-44d0-bc5b-2c0f35e27ae8', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:33:21.526546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:33:21.527029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:33:21.527512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:33:21.527977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:33:21.528344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:33:21.538098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:21.538549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:21.539494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:21.539932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:21.559310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Getting quotas for project 7be279a1c5fa48a187c1678e81858861. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:33:21.564861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Getting quotas for user e15634a3fab242ad8a0fc8c512976126 and project 7be279a1c5fa48a187c1678e81858861. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:33:21.577302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:33:21.579976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:33:21.624331 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f4b76e0d-bf7d-4660-abbd-190bb75c9fb9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524483 Aug 03 02:33:21.625025 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2979/6080] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:33:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:33:21.640063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-283b5e6d-41db-4647-b807-53bd1b5f4265 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:21.640783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-283b5e6d-41db-4647-b807-53bd1b5f4265 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:21.780215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-283b5e6d-41db-4647-b807-53bd1b5f4265 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:21.788868 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-283b5e6d-41db-4647-b807-53bd1b5f4265 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c" status: 200 len: 1218 microversion: 2.1 time: 0.154400 Aug 03 02:33:21.789930 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3102/6081] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:21 2022] GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:33:22.811850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6f4caac3-1b36-471f-8104-38f462f159cf tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:22.813345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6f4caac3-1b36-471f-8104-38f462f159cf tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:22.821108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f4caac3-1b36-471f-8104-38f462f159cf tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:22.821617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f4caac3-1b36-471f-8104-38f462f159cf tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:22.822455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f4caac3-1b36-471f-8104-38f462f159cf tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:22.823149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f4caac3-1b36-471f-8104-38f462f159cf tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:22.937081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6f4caac3-1b36-471f-8104-38f462f159cf tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:22.945555 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6f4caac3-1b36-471f-8104-38f462f159cf tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c" status: 200 len: 1288 microversion: 2.1 time: 0.139361 Aug 03 02:33:22.946339 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2980/6082] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:22 2022] GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c => generated 1288 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:33:23.971573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6df1ee7e-a48b-4818-b9f3-771419b11f4d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:23.972325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6df1ee7e-a48b-4818-b9f3-771419b11f4d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:23.981847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6df1ee7e-a48b-4818-b9f3-771419b11f4d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:23.982300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6df1ee7e-a48b-4818-b9f3-771419b11f4d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:23.983112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6df1ee7e-a48b-4818-b9f3-771419b11f4d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:23.983721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6df1ee7e-a48b-4818-b9f3-771419b11f4d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:24.198310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6df1ee7e-a48b-4818-b9f3-771419b11f4d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:24.207664 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6df1ee7e-a48b-4818-b9f3-771419b11f4d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c" status: 200 len: 1318 microversion: 2.1 time: 0.242405 Aug 03 02:33:24.208260 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3103/6083] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:23 2022] GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:33:24.269939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-fcacde41-a403-4dc3-9f15-2fc98603c085 req-800be7bd-f753-4c04-83a8-0984708dd1bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c", "tag": "62ae30de-b149-4c2a-b4d5-c2ce68ef7385"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:33:24.283681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-fcacde41-a403-4dc3-9f15-2fc98603c085 req-800be7bd-f753-4c04-83a8-0984708dd1bb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:24.284138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-fcacde41-a403-4dc3-9f15-2fc98603c085 req-800be7bd-f753-4c04-83a8-0984708dd1bb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:24.296623 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-fcacde41-a403-4dc3-9f15-2fc98603c085 req-800be7bd-f753-4c04-83a8-0984708dd1bb service nova] Creating event network-changed:62ae30de-b149-4c2a-b4d5-c2ce68ef7385 for instance 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c on n-h2-826529-8 Aug 03 02:33:24.301848 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-fcacde41-a403-4dc3-9f15-2fc98603c085 req-800be7bd-f753-4c04-83a8-0984708dd1bb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036423 Aug 03 02:33:24.302708 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2981/6084] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:33:25.230171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-613c685d-9de3-40ba-9c39-65d4dd31affd tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:25.230816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-613c685d-9de3-40ba-9c39-65d4dd31affd tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:25.238173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-613c685d-9de3-40ba-9c39-65d4dd31affd tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:25.238621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-613c685d-9de3-40ba-9c39-65d4dd31affd tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:25.239430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-613c685d-9de3-40ba-9c39-65d4dd31affd tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:25.239870 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-613c685d-9de3-40ba-9c39-65d4dd31affd tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:25.373205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-613c685d-9de3-40ba-9c39-65d4dd31affd tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:25.380741 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-613c685d-9de3-40ba-9c39-65d4dd31affd tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c" status: 200 len: 1318 microversion: 2.1 time: 0.154495 Aug 03 02:33:25.381578 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3104/6085] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:25 2022] GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:33:26.401370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7de7ca50-0272-4c2f-97db-cf9e7f22a862 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:26.402078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7de7ca50-0272-4c2f-97db-cf9e7f22a862 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:26.410621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7de7ca50-0272-4c2f-97db-cf9e7f22a862 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:26.411119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7de7ca50-0272-4c2f-97db-cf9e7f22a862 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:26.411920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7de7ca50-0272-4c2f-97db-cf9e7f22a862 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:26.412362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7de7ca50-0272-4c2f-97db-cf9e7f22a862 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:26.628359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7de7ca50-0272-4c2f-97db-cf9e7f22a862 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:26.636180 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7de7ca50-0272-4c2f-97db-cf9e7f22a862 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c" status: 200 len: 1318 microversion: 2.1 time: 0.239098 Aug 03 02:33:26.636777 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2982/6086] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:26 2022] GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:33:27.657772 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0a39192b-5650-4284-9bce-d388f340a879 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:27.658380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0a39192b-5650-4284-9bce-d388f340a879 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:27.665469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a39192b-5650-4284-9bce-d388f340a879 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:27.665923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a39192b-5650-4284-9bce-d388f340a879 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:27.666699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a39192b-5650-4284-9bce-d388f340a879 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:27.667237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a39192b-5650-4284-9bce-d388f340a879 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:27.805562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a39192b-5650-4284-9bce-d388f340a879 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:27.813132 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0a39192b-5650-4284-9bce-d388f340a879 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c" status: 200 len: 1318 microversion: 2.1 time: 0.159951 Aug 03 02:33:27.813784 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3105/6087] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:27 2022] GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:33:28.835749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3137346a-3f65-4e78-9656-184e0854d1a9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:28.836360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3137346a-3f65-4e78-9656-184e0854d1a9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:28.843474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3137346a-3f65-4e78-9656-184e0854d1a9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:28.843929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3137346a-3f65-4e78-9656-184e0854d1a9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:28.845319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3137346a-3f65-4e78-9656-184e0854d1a9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:28.845775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3137346a-3f65-4e78-9656-184e0854d1a9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:28.980419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3137346a-3f65-4e78-9656-184e0854d1a9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:28.989023 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3137346a-3f65-4e78-9656-184e0854d1a9 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c" status: 200 len: 1318 microversion: 2.1 time: 0.157188 Aug 03 02:33:28.989619 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2983/6088] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:28 2022] GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:33:30.010302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ee69f785-3ddb-48cc-996d-d846117e4ce1 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:30.010851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ee69f785-3ddb-48cc-996d-d846117e4ce1 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:30.018532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee69f785-3ddb-48cc-996d-d846117e4ce1 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:30.019016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee69f785-3ddb-48cc-996d-d846117e4ce1 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:30.019803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee69f785-3ddb-48cc-996d-d846117e4ce1 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:30.020245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ee69f785-3ddb-48cc-996d-d846117e4ce1 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:30.155517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ee69f785-3ddb-48cc-996d-d846117e4ce1 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:30.163371 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ee69f785-3ddb-48cc-996d-d846117e4ce1 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c" status: 200 len: 1318 microversion: 2.1 time: 0.157267 Aug 03 02:33:30.163951 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3106/6089] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:30 2022] GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:33:30.392582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-5becf18c-aeb0-4331-bb93-b24241afe911 req-b09b65e1-3004-44e9-bfac-6a27a4a33217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c", "name": "network-vif-plugged", "status": "completed", "tag": "62ae30de-b149-4c2a-b4d5-c2ce68ef7385"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:33:30.406867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5becf18c-aeb0-4331-bb93-b24241afe911 req-b09b65e1-3004-44e9-bfac-6a27a4a33217 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:30.407378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5becf18c-aeb0-4331-bb93-b24241afe911 req-b09b65e1-3004-44e9-bfac-6a27a4a33217 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:30.419366 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-5becf18c-aeb0-4331-bb93-b24241afe911 req-b09b65e1-3004-44e9-bfac-6a27a4a33217 service nova] Creating event network-vif-plugged:62ae30de-b149-4c2a-b4d5-c2ce68ef7385 for instance 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c on n-h2-826529-8 Aug 03 02:33:30.425954 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-5becf18c-aeb0-4331-bb93-b24241afe911 req-b09b65e1-3004-44e9-bfac-6a27a4a33217 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037327 Aug 03 02:33:30.427301 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2984/6090] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:33:31.183775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-402c1cf8-c267-4cb0-9a8f-3f2e5cdee590 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:31.184422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-402c1cf8-c267-4cb0-9a8f-3f2e5cdee590 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:31.191784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-402c1cf8-c267-4cb0-9a8f-3f2e5cdee590 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:31.192238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-402c1cf8-c267-4cb0-9a8f-3f2e5cdee590 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:31.193013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-402c1cf8-c267-4cb0-9a8f-3f2e5cdee590 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:31.193457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-402c1cf8-c267-4cb0-9a8f-3f2e5cdee590 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:31.331301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-402c1cf8-c267-4cb0-9a8f-3f2e5cdee590 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:31.339591 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-402c1cf8-c267-4cb0-9a8f-3f2e5cdee590 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c" status: 200 len: 1318 microversion: 2.1 time: 0.159743 Aug 03 02:33:31.340341 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3107/6091] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:31 2022] GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:33:32.362465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-af20f2e7-2bd6-4359-82b8-4a656ec518f4 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:32.363204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-af20f2e7-2bd6-4359-82b8-4a656ec518f4 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:32.366514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:33:32.367218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:33:32.374974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af20f2e7-2bd6-4359-82b8-4a656ec518f4 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:32.375440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af20f2e7-2bd6-4359-82b8-4a656ec518f4 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:32.376337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af20f2e7-2bd6-4359-82b8-4a656ec518f4 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:32.376794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af20f2e7-2bd6-4359-82b8-4a656ec518f4 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:32.523854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-af20f2e7-2bd6-4359-82b8-4a656ec518f4 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:32.531463 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-af20f2e7-2bd6-4359-82b8-4a656ec518f4 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c" status: 200 len: 1507 microversion: 2.1 time: 0.174427 Aug 03 02:33:32.532738 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2985/6092] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:32 2022] GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:33:33.714512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b04e2a83-f9b9-4993-a8ed-f48550d5dac0 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:33.715151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b04e2a83-f9b9-4993-a8ed-f48550d5dac0 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:33.717373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:33:33.734940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-b2a17a16-c109-4289-859c-1f3b6f5153c9 req-3c06e612-368b-4980-ab2f-c081b8a38530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6140c0a0-2123-4239-8003-f8677742e477", "tag": "f44fa36a-cab7-4f52-9ecf-4c32e33d976e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:33:33.745026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b04e2a83-f9b9-4993-a8ed-f48550d5dac0 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:33.745496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b04e2a83-f9b9-4993-a8ed-f48550d5dac0 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:33.746592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b04e2a83-f9b9-4993-a8ed-f48550d5dac0 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:33.747198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b04e2a83-f9b9-4993-a8ed-f48550d5dac0 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:33.760987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b2a17a16-c109-4289-859c-1f3b6f5153c9 req-3c06e612-368b-4980-ab2f-c081b8a38530 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:33.761447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b2a17a16-c109-4289-859c-1f3b6f5153c9 req-3c06e612-368b-4980-ab2f-c081b8a38530 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:33.794247 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-b2a17a16-c109-4289-859c-1f3b6f5153c9 req-3c06e612-368b-4980-ab2f-c081b8a38530 service nova] Creating event network-changed:f44fa36a-cab7-4f52-9ecf-4c32e33d976e for instance 6140c0a0-2123-4239-8003-f8677742e477 on n-h1-826529-8 Aug 03 02:33:33.803797 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-b2a17a16-c109-4289-859c-1f3b6f5153c9 req-3c06e612-368b-4980-ab2f-c081b8a38530 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074068 Aug 03 02:33:33.808627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b04e2a83-f9b9-4993-a8ed-f48550d5dac0 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:33:33.809009 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2986/6093] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:33:33.914317 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b04e2a83-f9b9-4993-a8ed-f48550d5dac0 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 204 len: 0 microversion: 2.1 time: 0.203444 Aug 03 02:33:33.917463 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3108/6094] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:33:33 2022] DELETE /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:33:33.927866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eea5ae65-d4a3-4e46-aab0-2e47ac21f4b5 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:33.928789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eea5ae65-d4a3-4e46-aab0-2e47ac21f4b5 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:33.941096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eea5ae65-d4a3-4e46-aab0-2e47ac21f4b5 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:33.942251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eea5ae65-d4a3-4e46-aab0-2e47ac21f4b5 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:33.943662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eea5ae65-d4a3-4e46-aab0-2e47ac21f4b5 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:33.944709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eea5ae65-d4a3-4e46-aab0-2e47ac21f4b5 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:34.121102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eea5ae65-d4a3-4e46-aab0-2e47ac21f4b5 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:34.130438 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eea5ae65-d4a3-4e46-aab0-2e47ac21f4b5 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1583 microversion: 2.1 time: 0.207717 Aug 03 02:33:34.135550 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2987/6095] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:33 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1583 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:33:35.160694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-903680f8-4b6b-4da0-b768-222abc570b7f tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:35.161422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-903680f8-4b6b-4da0-b768-222abc570b7f tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:35.172456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-903680f8-4b6b-4da0-b768-222abc570b7f tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:35.173372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-903680f8-4b6b-4da0-b768-222abc570b7f tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:35.175164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-903680f8-4b6b-4da0-b768-222abc570b7f tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:35.175846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-903680f8-4b6b-4da0-b768-222abc570b7f tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:35.330159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-903680f8-4b6b-4da0-b768-222abc570b7f tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:35.338354 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-903680f8-4b6b-4da0-b768-222abc570b7f tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1583 microversion: 2.1 time: 0.187279 Aug 03 02:33:35.338962 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3109/6096] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:35 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1583 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:33:36.288681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-2036a6d1-3474-4f9d-84c4-845274a21317 req-d9ff0441-cd7d-4aa1-acba-e3d6a8ee8319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6140c0a0-2123-4239-8003-f8677742e477", "name": "network-vif-deleted", "tag": "f44fa36a-cab7-4f52-9ecf-4c32e33d976e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:33:36.304688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2036a6d1-3474-4f9d-84c4-845274a21317 req-d9ff0441-cd7d-4aa1-acba-e3d6a8ee8319 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:36.305158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2036a6d1-3474-4f9d-84c4-845274a21317 req-d9ff0441-cd7d-4aa1-acba-e3d6a8ee8319 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:36.322111 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-2036a6d1-3474-4f9d-84c4-845274a21317 req-d9ff0441-cd7d-4aa1-acba-e3d6a8ee8319 service nova] Creating event network-vif-deleted:f44fa36a-cab7-4f52-9ecf-4c32e33d976e for instance 6140c0a0-2123-4239-8003-f8677742e477 on n-h1-826529-8 Aug 03 02:33:36.327795 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-2036a6d1-3474-4f9d-84c4-845274a21317 req-d9ff0441-cd7d-4aa1-acba-e3d6a8ee8319 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043168 Aug 03 02:33:36.330367 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2988/6097] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:33:36.363014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed9b9c9c-994f-4f87-a967-d9bed30e0866 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:36.364806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ed9b9c9c-994f-4f87-a967-d9bed30e0866 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:36.373836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed9b9c9c-994f-4f87-a967-d9bed30e0866 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:36.374594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed9b9c9c-994f-4f87-a967-d9bed30e0866 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:36.375488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed9b9c9c-994f-4f87-a967-d9bed30e0866 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:36.376119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed9b9c9c-994f-4f87-a967-d9bed30e0866 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:36.442956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ed9b9c9c-994f-4f87-a967-d9bed30e0866 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:36.452501 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed9b9c9c-994f-4f87-a967-d9bed30e0866 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1229 microversion: 2.1 time: 0.095479 Aug 03 02:33:36.454226 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3110/6098] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:36 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:33:37.476764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4c5600f5-a6f0-4fec-ae6c-d5dec6c845e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:37.477711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4c5600f5-a6f0-4fec-ae6c-d5dec6c845e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:37.491492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c5600f5-a6f0-4fec-ae6c-d5dec6c845e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:37.492335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c5600f5-a6f0-4fec-ae6c-d5dec6c845e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:37.493793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c5600f5-a6f0-4fec-ae6c-d5dec6c845e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:37.494372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4c5600f5-a6f0-4fec-ae6c-d5dec6c845e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:37.567500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4c5600f5-a6f0-4fec-ae6c-d5dec6c845e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:37.575647 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4c5600f5-a6f0-4fec-ae6c-d5dec6c845e8 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1229 microversion: 2.1 time: 0.104931 Aug 03 02:33:37.576254 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2989/6099] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:37 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:33:38.597789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1d3faede-0beb-421e-bfb2-535aebe76603 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:38.598330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1d3faede-0beb-421e-bfb2-535aebe76603 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:38.605730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d3faede-0beb-421e-bfb2-535aebe76603 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:38.606195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d3faede-0beb-421e-bfb2-535aebe76603 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:38.607013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d3faede-0beb-421e-bfb2-535aebe76603 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:38.607464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d3faede-0beb-421e-bfb2-535aebe76603 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:38.682860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1d3faede-0beb-421e-bfb2-535aebe76603 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:38.691981 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1d3faede-0beb-421e-bfb2-535aebe76603 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1229 microversion: 2.1 time: 0.098741 Aug 03 02:33:38.692578 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3111/6100] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:38 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:33:39.714200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a3bc6508-adc2-43e4-95d5-e5c07b06d546 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:39.714789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a3bc6508-adc2-43e4-95d5-e5c07b06d546 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:39.723293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3bc6508-adc2-43e4-95d5-e5c07b06d546 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:39.724122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3bc6508-adc2-43e4-95d5-e5c07b06d546 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:39.725138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3bc6508-adc2-43e4-95d5-e5c07b06d546 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:39.725799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3bc6508-adc2-43e4-95d5-e5c07b06d546 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:39.800861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a3bc6508-adc2-43e4-95d5-e5c07b06d546 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:39.810393 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a3bc6508-adc2-43e4-95d5-e5c07b06d546 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1229 microversion: 2.1 time: 0.100407 Aug 03 02:33:39.811020 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2990/6101] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:39 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:33:40.835199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-09341102-154b-49c0-8a67-dea061c45c01 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:40.836115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-09341102-154b-49c0-8a67-dea061c45c01 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:40.846420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-09341102-154b-49c0-8a67-dea061c45c01 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:40.846877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-09341102-154b-49c0-8a67-dea061c45c01 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:40.847702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-09341102-154b-49c0-8a67-dea061c45c01 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:40.848147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-09341102-154b-49c0-8a67-dea061c45c01 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:40.884682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-09341102-154b-49c0-8a67-dea061c45c01 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:40.885134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-09341102-154b-49c0-8a67-dea061c45c01 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:40.885606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-09341102-154b-49c0-8a67-dea061c45c01 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lazy-loading 'fault' on Instance uuid 6140c0a0-2123-4239-8003-f8677742e477 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:33:40.932605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-09341102-154b-49c0-8a67-dea061c45c01 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b6af47da52741b985a7dad4a19023b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c035964586b4e73a6394246ef08c8e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:33:40.943241 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-09341102-154b-49c0-8a67-dea061c45c01 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 200 len: 1234 microversion: 2.1 time: 0.114674 Aug 03 02:33:40.943902 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3112/6102] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:40 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 1234 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:33:41.967012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dca06ff1-b512-45bd-8df5-414e5590e3a2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:41.967849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dca06ff1-b512-45bd-8df5-414e5590e3a2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] [instance: 6140c0a0-2123-4239-8003-f8677742e477] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:41.975661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dca06ff1-b512-45bd-8df5-414e5590e3a2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:41.976124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dca06ff1-b512-45bd-8df5-414e5590e3a2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:41.976915 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dca06ff1-b512-45bd-8df5-414e5590e3a2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:41.977364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dca06ff1-b512-45bd-8df5-414e5590e3a2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:41.992128 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-dca06ff1-b512-45bd-8df5-414e5590e3a2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] HTTP exception thrown: Instance 6140c0a0-2123-4239-8003-f8677742e477 could not be found. Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dca06ff1-b512-45bd-8df5-414e5590e3a2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Request method failure captured: Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 HTTP/1.1 Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6d2rkLAEGa0D75trNC-upvGpt2_6ieU0OlVxj_Ec85LGVZI8TlP3Sz_PSTLZbPbXexPXwqJDBt_Zm1UireKXyJiofAWJQkphzBt-U9BDW6iZkusqmQ2pJOaY6Z6Mh_qb4ANmMnXLwZTUUYeGKLXO8cTqd9fosbyG3ZOdb7BFtQJ5Qj0 Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 8c035964586b4e73a6394246ef08c8e1 Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestVolumeBackupRestore-2144641034 Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8c035964586b4e73a6394246ef08c8e1", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c035964586b4e73a6394246ef08c8e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8c035964586b4e73a6394246ef08c8e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8c035964586b4e73a6394246ef08c8e1"}]}] Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestVolumeBackupRestore-2144641034 Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 8c035964586b4e73a6394246ef08c8e1 Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestVolumeBackupRestore-2144641034 Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestVolumeBackupRestore-2144641034-project Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 2b6af47da52741b985a7dad4a19023b8 Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestVolumeBackupRestore-2144641034-project Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 6140c0a0-2123-4239-8003-f8677742e477 could not be found. Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '6140c0a0-2123-4239-8003-f8677742e477'} Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6140c0a0-2123-4239-8003-f8677742e477 could not be found. Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6140c0a0-2123-4239-8003-f8677742e477 could not be found. Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:33:41.993827 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:33:42.011443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:33:42.011443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:33:42.011443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:33:42.011443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:33:42.011443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:33:42.011443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6140c0a0-2123-4239-8003-f8677742e477 could not be found. Aug 03 02:33:42.011443 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:33:42.011443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dca06ff1-b512-45bd-8df5-414e5590e3a2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Returning 404 to user: Instance 6140c0a0-2123-4239-8003-f8677742e477 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:33:42.011443 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dca06ff1-b512-45bd-8df5-414e5590e3a2 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477" status: 404 len: 111 microversion: 2.1 time: 0.032211 Aug 03 02:33:42.011443 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2991/6103] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:33:41 2022] GET /compute/v2.1/servers/6140c0a0-2123-4239-8003-f8677742e477 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:33:42.173148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-234cb4a4-8f30-4aad-b21c-d03d0a0f1a66 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] Calling method '.version_select at 0x7f5b122443a0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:33:42.196377 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-234cb4a4-8f30-4aad-b21c-d03d0a0f1a66 tempest-TestVolumeBackupRestore-2144641034 tempest-TestVolumeBackupRestore-2144641034-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-573380780" status: 202 len: 0 microversion: 2.1 time: 0.027731 Aug 03 02:33:42.197071 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3113/6104] 10.222.0.67 () {58 vars in 1266 bytes} [Wed Aug 3 02:33:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-573380780 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:33:51.287885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-db26e88e-aecf-463f-be0e-631168895e1f tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ce49486-c4f9-40f7-9d0f-58f7a8cbce66", "device": "/dev/sdb"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:33:51.290580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-db26e88e-aecf-463f-be0e-631168895e1f tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:33:51.292828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:33:51.299555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db26e88e-aecf-463f-be0e-631168895e1f tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:51.300017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db26e88e-aecf-463f-be0e-631168895e1f tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:51.300811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db26e88e-aecf-463f-be0e-631168895e1f tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:33:51.301253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db26e88e-aecf-463f-be0e-631168895e1f tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:33:51.305338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=55 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:33:51.666024 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-db26e88e-aecf-463f-be0e-631168895e1f tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "POST /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.382279 Aug 03 02:33:51.671884 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2992/6105] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:33:51 2022] POST /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:34:16.656925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:34:16.657826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:34:16.663010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-13b8dc26-8849-42e0-b12b-3b326f7edd81 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:16.663577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-13b8dc26-8849-42e0-b12b-3b326f7edd81 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:16.675071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13b8dc26-8849-42e0-b12b-3b326f7edd81 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:16.675619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13b8dc26-8849-42e0-b12b-3b326f7edd81 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:16.676416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13b8dc26-8849-42e0-b12b-3b326f7edd81 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:16.676865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-13b8dc26-8849-42e0-b12b-3b326f7edd81 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:16.763760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-13b8dc26-8849-42e0-b12b-3b326f7edd81 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lazy-loading 'services' on Instance uuid 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:34:16.837827 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-13b8dc26-8849-42e0-b12b-3b326f7edd81 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c/os-volume_attachments/9ce49486-c4f9-40f7-9d0f-58f7a8cbce66" status: 202 len: 0 microversion: 2.1 time: 0.182909 Aug 03 02:34:16.838481 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3114/6106] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:34:16 2022] DELETE /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c/os-volume_attachments/9ce49486-c4f9-40f7-9d0f-58f7a8cbce66 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:34:19.675705 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:34:19.676499 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 02:34:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:34:22.210096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:34:22.210874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:34:22.215554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ac9646f4-8be7-4491-b039-61802c0b94a6 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:22.216150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ac9646f4-8be7-4491-b039-61802c0b94a6 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:22.223924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac9646f4-8be7-4491-b039-61802c0b94a6 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:22.224395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac9646f4-8be7-4491-b039-61802c0b94a6 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:22.225183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac9646f4-8be7-4491-b039-61802c0b94a6 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:22.225631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac9646f4-8be7-4491-b039-61802c0b94a6 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:22.253321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ac9646f4-8be7-4491-b039-61802c0b94a6 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:34:22.331209 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ac9646f4-8be7-4491-b039-61802c0b94a6 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c" status: 204 len: 0 microversion: 2.1 time: 0.122648 Aug 03 02:34:22.332085 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2993/6107] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:34:22 2022] DELETE /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:34:22.342355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6f6eee61-42cd-4cf3-b59a-993ad8231fcb tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:22.343252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6f6eee61-42cd-4cf3-b59a-993ad8231fcb tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:22.349924 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f6eee61-42cd-4cf3-b59a-993ad8231fcb tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:22.350380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f6eee61-42cd-4cf3-b59a-993ad8231fcb tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:22.351191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f6eee61-42cd-4cf3-b59a-993ad8231fcb tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:22.351631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f6eee61-42cd-4cf3-b59a-993ad8231fcb tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:22.499336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6f6eee61-42cd-4cf3-b59a-993ad8231fcb tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:34:22.507931 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6f6eee61-42cd-4cf3-b59a-993ad8231fcb tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c" status: 200 len: 1513 microversion: 2.1 time: 0.171252 Aug 03 02:34:22.508518 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3115/6108] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:34:22 2022] GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:34:23.530888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eded4d39-9ba3-4527-9ed8-3cdba4a52a60 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:23.531549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eded4d39-9ba3-4527-9ed8-3cdba4a52a60 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:23.538634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eded4d39-9ba3-4527-9ed8-3cdba4a52a60 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:23.539128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eded4d39-9ba3-4527-9ed8-3cdba4a52a60 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:23.539907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eded4d39-9ba3-4527-9ed8-3cdba4a52a60 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:23.540353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eded4d39-9ba3-4527-9ed8-3cdba4a52a60 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:23.677255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eded4d39-9ba3-4527-9ed8-3cdba4a52a60 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:34:23.685566 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eded4d39-9ba3-4527-9ed8-3cdba4a52a60 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c" status: 200 len: 1513 microversion: 2.1 time: 0.159904 Aug 03 02:34:23.686141 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2994/6109] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:34:23 2022] GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:34:24.705618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c6d5215f-b5fd-4368-ae03-444cad8fec6e tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:24.706246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c6d5215f-b5fd-4368-ae03-444cad8fec6e tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:24.713171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6d5215f-b5fd-4368-ae03-444cad8fec6e tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:24.713658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6d5215f-b5fd-4368-ae03-444cad8fec6e tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:24.714441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6d5215f-b5fd-4368-ae03-444cad8fec6e tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:24.714890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6d5215f-b5fd-4368-ae03-444cad8fec6e tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:24.936088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c6d5215f-b5fd-4368-ae03-444cad8fec6e tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:34:24.944013 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c6d5215f-b5fd-4368-ae03-444cad8fec6e tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c" status: 200 len: 1513 microversion: 2.1 time: 0.242259 Aug 03 02:34:24.944928 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3116/6110] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:34:24 2022] GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:34:25.195848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-65ffb1ee-0687-40d1-b172-74243272bae1 req-c3a5d4d1-45fe-4d84-bf25-7eb146a48da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c", "name": "network-vif-deleted", "tag": "62ae30de-b149-4c2a-b4d5-c2ce68ef7385"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:34:25.209805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-65ffb1ee-0687-40d1-b172-74243272bae1 req-c3a5d4d1-45fe-4d84-bf25-7eb146a48da6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:25.210256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-65ffb1ee-0687-40d1-b172-74243272bae1 req-c3a5d4d1-45fe-4d84-bf25-7eb146a48da6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:25.223904 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-65ffb1ee-0687-40d1-b172-74243272bae1 req-c3a5d4d1-45fe-4d84-bf25-7eb146a48da6 service nova] Creating event network-vif-deleted:62ae30de-b149-4c2a-b4d5-c2ce68ef7385 for instance 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c on n-h2-826529-8 Aug 03 02:34:25.230394 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-65ffb1ee-0687-40d1-b172-74243272bae1 req-c3a5d4d1-45fe-4d84-bf25-7eb146a48da6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038103 Aug 03 02:34:25.231061 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2995/6111] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:34:25.966083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-15ff0dee-b2ab-43a8-9797-8362e98e1810 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:25.966634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-15ff0dee-b2ab-43a8-9797-8362e98e1810 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:25.973625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-15ff0dee-b2ab-43a8-9797-8362e98e1810 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:25.974129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-15ff0dee-b2ab-43a8-9797-8362e98e1810 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:25.974951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-15ff0dee-b2ab-43a8-9797-8362e98e1810 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:25.975388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-15ff0dee-b2ab-43a8-9797-8362e98e1810 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:25.989570 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-15ff0dee-b2ab-43a8-9797-8362e98e1810 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] HTTP exception thrown: Instance 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c could not be found. Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-15ff0dee-b2ab-43a8-9797-8362e98e1810 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Request method failure captured: Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c HTTP/1.1 Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6d4zc_WCAj4YSU-ZwY9ly3A4qQ4xP4XrtwFnD-fcx2K8OciZS0KkD4JBOSG4gn7P1EkKLwfhhxVOX5fk4Wulo7MvdR1BNn-az4KTnjn2w3mLAdFbzoNdQo4sbKDdLS_YiLBW-2W3rHtNx0RBvg9bkY_MyVwDwa6yjF3oK5YSjmZ1ARo Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 7be279a1c5fa48a187c1678e81858861 Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-VolumesSnapshotTestJSON-946158596 Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7be279a1c5fa48a187c1678e81858861", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7be279a1c5fa48a187c1678e81858861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7be279a1c5fa48a187c1678e81858861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7be279a1c5fa48a187c1678e81858861"}]}] Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-VolumesSnapshotTestJSON-946158596 Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 7be279a1c5fa48a187c1678e81858861 Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-946158596 Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-VolumesSnapshotTestJSON-946158596-project Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e15634a3fab242ad8a0fc8c512976126 Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-VolumesSnapshotTestJSON-946158596-project Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c could not be found. Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c'} Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c could not be found. Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c could not be found. Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:34:25.991294 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:34:25.996708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:34:25.996708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:34:25.996708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:34:25.996708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:34:25.996708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:34:25.996708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c could not be found. Aug 03 02:34:25.996708 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:34:25.996708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-15ff0dee-b2ab-43a8-9797-8362e98e1810 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Returning 404 to user: Instance 1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:34:25.996708 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-15ff0dee-b2ab-43a8-9797-8362e98e1810 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c" status: 404 len: 111 microversion: 2.1 time: 0.030878 Aug 03 02:34:25.996708 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3117/6112] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:34:25 2022] GET /compute/v2.1/servers/1086b59a-60b1-4cb8-a8ba-4e4e9bf12a0c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:34:32.843295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-697799249", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "7aa5e1ea-d7bf-44d0-bc5b-2c0f35e27ae8"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:34:32.907983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] validate_networks() for [('7aa5e1ea-d7bf-44d0-bc5b-2c0f35e27ae8', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:34:33.315271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:34:33.315702 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:34:33.316208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:34:33.316620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:34:33.317063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:34:33.328861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:33.329335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:33.330164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:33.330607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:33.350360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Getting quotas for project 7be279a1c5fa48a187c1678e81858861. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:34:33.356494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Getting quotas for user e15634a3fab242ad8a0fc8c512976126 and project 7be279a1c5fa48a187c1678e81858861. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:34:33.370335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:34:33.375620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:34:33.431326 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f5ee631e-2d55-4bae-86a8-075613d9572d tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592602 Aug 03 02:34:33.431992 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2996/6113] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:34:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:34:33.450518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8775e449-80a7-44ed-8897-61ed3860e243 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:33.451172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8775e449-80a7-44ed-8897-61ed3860e243 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:33.515247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8775e449-80a7-44ed-8897-61ed3860e243 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:34:33.523577 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8775e449-80a7-44ed-8897-61ed3860e243 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096" status: 200 len: 1218 microversion: 2.1 time: 0.078110 Aug 03 02:34:33.524222 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3118/6114] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:34:33 2022] GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:34:34.554480 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d05cf1ed-ab89-4b44-9af9-c36389f9db39 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:34.556097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d05cf1ed-ab89-4b44-9af9-c36389f9db39 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:34.564875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d05cf1ed-ab89-4b44-9af9-c36389f9db39 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:34.565469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d05cf1ed-ab89-4b44-9af9-c36389f9db39 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:34.566384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d05cf1ed-ab89-4b44-9af9-c36389f9db39 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:34.567133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d05cf1ed-ab89-4b44-9af9-c36389f9db39 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:34.642683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d05cf1ed-ab89-4b44-9af9-c36389f9db39 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:34:34.651569 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d05cf1ed-ab89-4b44-9af9-c36389f9db39 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096" status: 200 len: 1276 microversion: 2.1 time: 0.103494 Aug 03 02:34:34.652883 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2997/6115] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:34:34 2022] GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 => generated 1276 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:34:35.674357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e143523e-6544-431a-a53b-ef2d9b687700 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:35.675009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e143523e-6544-431a-a53b-ef2d9b687700 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:35.682425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e143523e-6544-431a-a53b-ef2d9b687700 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:35.683566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e143523e-6544-431a-a53b-ef2d9b687700 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:35.684491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e143523e-6544-431a-a53b-ef2d9b687700 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:35.684995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e143523e-6544-431a-a53b-ef2d9b687700 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:35.704755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-3b70db55-a1f7-413a-b53f-9374f55cdea0 req-e9fa6748-6379-4572-9044-8fd73a3e4e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f218a88f-1394-40e2-b1c0-0051b5b9c096", "tag": "ba921940-c5d4-4e81-8987-c25c43e56c23"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:34:35.720979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3b70db55-a1f7-413a-b53f-9374f55cdea0 req-e9fa6748-6379-4572-9044-8fd73a3e4e70 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:35.722379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3b70db55-a1f7-413a-b53f-9374f55cdea0 req-e9fa6748-6379-4572-9044-8fd73a3e4e70 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:35.739861 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-3b70db55-a1f7-413a-b53f-9374f55cdea0 req-e9fa6748-6379-4572-9044-8fd73a3e4e70 service nova] Creating event network-changed:ba921940-c5d4-4e81-8987-c25c43e56c23 for instance f218a88f-1394-40e2-b1c0-0051b5b9c096 on n-h1-826529-8 Aug 03 02:34:35.755720 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-3b70db55-a1f7-413a-b53f-9374f55cdea0 req-e9fa6748-6379-4572-9044-8fd73a3e4e70 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055426 Aug 03 02:34:35.756419 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2998/6116] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:34:35.837962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e143523e-6544-431a-a53b-ef2d9b687700 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:34:35.846528 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e143523e-6544-431a-a53b-ef2d9b687700 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096" status: 200 len: 1318 microversion: 2.1 time: 0.176108 Aug 03 02:34:35.847253 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3119/6117] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:34:35 2022] GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:34:36.868747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bf0c27aa-3a03-4217-b883-888c3a1d1c73 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:36.869456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bf0c27aa-3a03-4217-b883-888c3a1d1c73 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:36.877314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf0c27aa-3a03-4217-b883-888c3a1d1c73 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:36.877777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf0c27aa-3a03-4217-b883-888c3a1d1c73 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:36.878563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf0c27aa-3a03-4217-b883-888c3a1d1c73 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:36.879044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bf0c27aa-3a03-4217-b883-888c3a1d1c73 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:37.014274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bf0c27aa-3a03-4217-b883-888c3a1d1c73 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:34:37.021886 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bf0c27aa-3a03-4217-b883-888c3a1d1c73 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096" status: 200 len: 1318 microversion: 2.1 time: 0.157465 Aug 03 02:34:37.022462 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 2999/6118] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:34:36 2022] GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:34:38.045878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7f09e917-66f1-4f35-8332-a24df8a38b84 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:38.046501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7f09e917-66f1-4f35-8332-a24df8a38b84 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:38.053745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f09e917-66f1-4f35-8332-a24df8a38b84 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:38.054206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f09e917-66f1-4f35-8332-a24df8a38b84 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:38.055030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f09e917-66f1-4f35-8332-a24df8a38b84 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:38.055509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f09e917-66f1-4f35-8332-a24df8a38b84 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:38.190395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7f09e917-66f1-4f35-8332-a24df8a38b84 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:34:38.198189 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7f09e917-66f1-4f35-8332-a24df8a38b84 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096" status: 200 len: 1318 microversion: 2.1 time: 0.156847 Aug 03 02:34:38.198779 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3120/6119] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:34:38 2022] GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:34:39.219577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0e951df-2ec1-47f7-bed9-ab8ef4661ca7 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:39.220246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0e951df-2ec1-47f7-bed9-ab8ef4661ca7 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:39.227197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0e951df-2ec1-47f7-bed9-ab8ef4661ca7 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:39.227651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0e951df-2ec1-47f7-bed9-ab8ef4661ca7 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:39.228422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0e951df-2ec1-47f7-bed9-ab8ef4661ca7 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:39.228857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0e951df-2ec1-47f7-bed9-ab8ef4661ca7 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:39.366848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a0e951df-2ec1-47f7-bed9-ab8ef4661ca7 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:34:39.374883 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0e951df-2ec1-47f7-bed9-ab8ef4661ca7 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096" status: 200 len: 1318 microversion: 2.1 time: 0.159563 Aug 03 02:34:39.375477 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3000/6120] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:34:39 2022] GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:34:40.395539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ccd63413-9ef7-4fb1-96e4-b28cbed7e598 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:40.396070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ccd63413-9ef7-4fb1-96e4-b28cbed7e598 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:40.403689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccd63413-9ef7-4fb1-96e4-b28cbed7e598 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:40.404142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccd63413-9ef7-4fb1-96e4-b28cbed7e598 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:40.404913 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccd63413-9ef7-4fb1-96e4-b28cbed7e598 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:40.405351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccd63413-9ef7-4fb1-96e4-b28cbed7e598 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:40.545117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ccd63413-9ef7-4fb1-96e4-b28cbed7e598 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:34:40.552747 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ccd63413-9ef7-4fb1-96e4-b28cbed7e598 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096" status: 200 len: 1318 microversion: 2.1 time: 0.161123 Aug 03 02:34:40.553321 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3121/6121] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:34:40 2022] GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:34:41.575129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9c93bc87-6463-4ea1-ab50-50414f830074 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:41.575734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9c93bc87-6463-4ea1-ab50-50414f830074 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:41.583185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c93bc87-6463-4ea1-ab50-50414f830074 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:41.583649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c93bc87-6463-4ea1-ab50-50414f830074 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:41.584439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c93bc87-6463-4ea1-ab50-50414f830074 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:41.584881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9c93bc87-6463-4ea1-ab50-50414f830074 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:41.717606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9c93bc87-6463-4ea1-ab50-50414f830074 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:34:41.725218 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9c93bc87-6463-4ea1-ab50-50414f830074 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096" status: 200 len: 1318 microversion: 2.1 time: 0.154726 Aug 03 02:34:41.725799 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3001/6122] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:34:41 2022] GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:34:42.279435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-3e93be0c-c40d-4dc3-8260-ea0148d1b820 req-0915a566-7554-43b3-84e4-4daa3f37d7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f218a88f-1394-40e2-b1c0-0051b5b9c096", "name": "network-vif-plugged", "status": "completed", "tag": "ba921940-c5d4-4e81-8987-c25c43e56c23"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:34:42.291556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3e93be0c-c40d-4dc3-8260-ea0148d1b820 req-0915a566-7554-43b3-84e4-4daa3f37d7e4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:42.292519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3e93be0c-c40d-4dc3-8260-ea0148d1b820 req-0915a566-7554-43b3-84e4-4daa3f37d7e4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:42.304575 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-3e93be0c-c40d-4dc3-8260-ea0148d1b820 req-0915a566-7554-43b3-84e4-4daa3f37d7e4 service nova] Creating event network-vif-plugged:ba921940-c5d4-4e81-8987-c25c43e56c23 for instance f218a88f-1394-40e2-b1c0-0051b5b9c096 on n-h1-826529-8 Aug 03 02:34:42.310584 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-3e93be0c-c40d-4dc3-8260-ea0148d1b820 req-0915a566-7554-43b3-84e4-4daa3f37d7e4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035198 Aug 03 02:34:42.311391 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3122/6123] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:34:42.746382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3b6d97c3-7751-4a02-92eb-a86820b9b735 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:42.747041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3b6d97c3-7751-4a02-92eb-a86820b9b735 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:42.754197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b6d97c3-7751-4a02-92eb-a86820b9b735 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:42.754651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b6d97c3-7751-4a02-92eb-a86820b9b735 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:42.755457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b6d97c3-7751-4a02-92eb-a86820b9b735 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:42.755901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b6d97c3-7751-4a02-92eb-a86820b9b735 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:42.890391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3b6d97c3-7751-4a02-92eb-a86820b9b735 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:34:42.897955 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3b6d97c3-7751-4a02-92eb-a86820b9b735 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096" status: 200 len: 1318 microversion: 2.1 time: 0.156525 Aug 03 02:34:42.898527 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3002/6124] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:34:42 2022] GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:34:43.916428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:34:43.920865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5743992f-1326-4a01-abe6-ae843a1f434f tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:34:43.921577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5743992f-1326-4a01-abe6-ae843a1f434f tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:43.928292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5743992f-1326-4a01-abe6-ae843a1f434f tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:43.928753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5743992f-1326-4a01-abe6-ae843a1f434f tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:43.929535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5743992f-1326-4a01-abe6-ae843a1f434f tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:43.929987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5743992f-1326-4a01-abe6-ae843a1f434f tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:44.068965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5743992f-1326-4a01-abe6-ae843a1f434f tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:34:44.077984 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5743992f-1326-4a01-abe6-ae843a1f434f tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096" status: 200 len: 1508 microversion: 2.1 time: 0.163373 Aug 03 02:34:44.078658 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3123/6125] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:34:43 2022] GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:34:44.115636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6ea2a4db-789f-4295-853f-b739ed055f19 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1c85cc0-cac8-4943-8bf2-17141c560767", "device": "/dev/sdb"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:34:44.119676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6ea2a4db-789f-4295-853f-b739ed055f19 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:34:44.123364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:34:44.124479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:34:44.142023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ea2a4db-789f-4295-853f-b739ed055f19 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:44.142823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ea2a4db-789f-4295-853f-b739ed055f19 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:44.144219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ea2a4db-789f-4295-853f-b739ed055f19 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:34:44.145003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6ea2a4db-789f-4295-853f-b739ed055f19 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:34:44.396679 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6ea2a4db-789f-4295-853f-b739ed055f19 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "POST /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288126 Aug 03 02:34:44.397337 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3003/6126] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:34:44 2022] POST /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:35:06.034037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-213b39ec-1c4a-4ab7-b397-0ee1c4baaf85 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:35:06.034625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-213b39ec-1c4a-4ab7-b397-0ee1c4baaf85 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:35:06.036881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=22 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:35:06.037678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:35:06.044831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-213b39ec-1c4a-4ab7-b397-0ee1c4baaf85 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:35:06.045292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-213b39ec-1c4a-4ab7-b397-0ee1c4baaf85 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:35:06.046115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-213b39ec-1c4a-4ab7-b397-0ee1c4baaf85 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:35:06.046557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-213b39ec-1c4a-4ab7-b397-0ee1c4baaf85 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:35:06.140483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-213b39ec-1c4a-4ab7-b397-0ee1c4baaf85 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lazy-loading 'services' on Instance uuid f218a88f-1394-40e2-b1c0-0051b5b9c096 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:35:06.215484 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-213b39ec-1c4a-4ab7-b397-0ee1c4baaf85 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096/os-volume_attachments/b1c85cc0-cac8-4943-8bf2-17141c560767" status: 202 len: 0 microversion: 2.1 time: 0.185200 Aug 03 02:35:06.216131 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3124/6127] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:35:06 2022] DELETE /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096/os-volume_attachments/b1c85cc0-cac8-4943-8bf2-17141c560767 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:35:11.595873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5051081a-ed4f-45ca-a555-663d904b2f01 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:35:11.596457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5051081a-ed4f-45ca-a555-663d904b2f01 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:35:11.599011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:35:11.599801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:35:11.606832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5051081a-ed4f-45ca-a555-663d904b2f01 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:35:11.607328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5051081a-ed4f-45ca-a555-663d904b2f01 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:35:11.608139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5051081a-ed4f-45ca-a555-663d904b2f01 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:35:11.608592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5051081a-ed4f-45ca-a555-663d904b2f01 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:35:11.637885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5051081a-ed4f-45ca-a555-663d904b2f01 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:35:11.721816 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5051081a-ed4f-45ca-a555-663d904b2f01 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096" status: 204 len: 0 microversion: 2.1 time: 0.130802 Aug 03 02:35:11.722663 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3004/6128] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:35:11 2022] DELETE /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:35:11.731667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c8312c2d-f914-43f4-979a-170c24c8d993 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:35:11.733129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c8312c2d-f914-43f4-979a-170c24c8d993 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:35:11.740979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c8312c2d-f914-43f4-979a-170c24c8d993 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:35:11.741445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c8312c2d-f914-43f4-979a-170c24c8d993 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:35:11.742248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c8312c2d-f914-43f4-979a-170c24c8d993 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:35:11.742690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c8312c2d-f914-43f4-979a-170c24c8d993 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:35:11.884034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c8312c2d-f914-43f4-979a-170c24c8d993 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:35:11.891902 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c8312c2d-f914-43f4-979a-170c24c8d993 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096" status: 200 len: 1514 microversion: 2.1 time: 0.164777 Aug 03 02:35:11.892491 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3125/6129] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:35:11 2022] GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:35:12.913416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d179c1bf-caab-4ed9-8539-099704951231 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:35:12.914130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d179c1bf-caab-4ed9-8539-099704951231 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:35:12.921911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d179c1bf-caab-4ed9-8539-099704951231 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:35:12.922369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d179c1bf-caab-4ed9-8539-099704951231 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:35:12.923188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d179c1bf-caab-4ed9-8539-099704951231 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:35:12.923640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d179c1bf-caab-4ed9-8539-099704951231 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:35:13.056358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d179c1bf-caab-4ed9-8539-099704951231 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:35:13.064081 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d179c1bf-caab-4ed9-8539-099704951231 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096" status: 200 len: 1514 microversion: 2.1 time: 0.154958 Aug 03 02:35:13.064654 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3005/6130] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:35:12 2022] GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:35:13.919372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2ffde609-df57-4b47-982b-fc39e4b51bd0 req-26fe5fb9-1085-412a-af84-41612ecf0ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f218a88f-1394-40e2-b1c0-0051b5b9c096", "name": "network-vif-deleted", "tag": "ba921940-c5d4-4e81-8987-c25c43e56c23"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:35:13.930678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2ffde609-df57-4b47-982b-fc39e4b51bd0 req-26fe5fb9-1085-412a-af84-41612ecf0ea7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:35:13.931166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2ffde609-df57-4b47-982b-fc39e4b51bd0 req-26fe5fb9-1085-412a-af84-41612ecf0ea7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:35:13.943259 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2ffde609-df57-4b47-982b-fc39e4b51bd0 req-26fe5fb9-1085-412a-af84-41612ecf0ea7 service nova] Creating event network-vif-deleted:ba921940-c5d4-4e81-8987-c25c43e56c23 for instance f218a88f-1394-40e2-b1c0-0051b5b9c096 on n-h1-826529-8 Aug 03 02:35:13.948299 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2ffde609-df57-4b47-982b-fc39e4b51bd0 req-26fe5fb9-1085-412a-af84-41612ecf0ea7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033188 Aug 03 02:35:13.949011 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3126/6131] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:35:14.086947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2a0475cf-36cc-4dd3-89f6-c269fe66d387 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:35:14.087577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2a0475cf-36cc-4dd3-89f6-c269fe66d387 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:35:14.095916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a0475cf-36cc-4dd3-89f6-c269fe66d387 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:35:14.096385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a0475cf-36cc-4dd3-89f6-c269fe66d387 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:35:14.097171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a0475cf-36cc-4dd3-89f6-c269fe66d387 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:35:14.097613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a0475cf-36cc-4dd3-89f6-c269fe66d387 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:35:14.130102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a0475cf-36cc-4dd3-89f6-c269fe66d387 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:35:14.130559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a0475cf-36cc-4dd3-89f6-c269fe66d387 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:35:14.131123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-2a0475cf-36cc-4dd3-89f6-c269fe66d387 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lazy-loading 'fault' on Instance uuid f218a88f-1394-40e2-b1c0-0051b5b9c096 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:35:14.173499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2a0475cf-36cc-4dd3-89f6-c269fe66d387 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15634a3fab242ad8a0fc8c512976126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be279a1c5fa48a187c1678e81858861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:35:14.181072 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2a0475cf-36cc-4dd3-89f6-c269fe66d387 tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096" status: 200 len: 1308 microversion: 2.1 time: 0.099057 Aug 03 02:35:14.181638 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3006/6132] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:35:14 2022] GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:35:15.203243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e7908a23-b248-45bd-958d-f2f1eb8a538b tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:35:15.203989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e7908a23-b248-45bd-958d-f2f1eb8a538b tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] [instance: f218a88f-1394-40e2-b1c0-0051b5b9c096] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:35:15.210233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7908a23-b248-45bd-958d-f2f1eb8a538b tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:35:15.210678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7908a23-b248-45bd-958d-f2f1eb8a538b tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:35:15.211470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7908a23-b248-45bd-958d-f2f1eb8a538b tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:35:15.211905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7908a23-b248-45bd-958d-f2f1eb8a538b tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:35:15.225746 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-e7908a23-b248-45bd-958d-f2f1eb8a538b tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] HTTP exception thrown: Instance f218a88f-1394-40e2-b1c0-0051b5b9c096 could not be found. Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e7908a23-b248-45bd-958d-f2f1eb8a538b tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Request method failure captured: Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 HTTP/1.1 Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6d4zc_WCAj4YSU-ZwY9ly3A4qQ4xP4XrtwFnD-fcx2K8OciZS0KkD4JBOSG4gn7P1EkKLwfhhxVOX5fk4Wulo7MvdR1BNn-az4KTnjn2w3mLAdFbzoNdQo4sbKDdLS_YiLBW-2W3rHtNx0RBvg9bkY_MyVwDwa6yjF3oK5YSjmZ1ARo Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 7be279a1c5fa48a187c1678e81858861 Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-VolumesSnapshotTestJSON-946158596 Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7be279a1c5fa48a187c1678e81858861", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7be279a1c5fa48a187c1678e81858861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7be279a1c5fa48a187c1678e81858861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7be279a1c5fa48a187c1678e81858861"}]}] Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-VolumesSnapshotTestJSON-946158596 Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 7be279a1c5fa48a187c1678e81858861 Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-946158596 Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-VolumesSnapshotTestJSON-946158596-project Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: e15634a3fab242ad8a0fc8c512976126 Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-VolumesSnapshotTestJSON-946158596-project Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance f218a88f-1394-40e2-b1c0-0051b5b9c096 could not be found. Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'f218a88f-1394-40e2-b1c0-0051b5b9c096'} Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f218a88f-1394-40e2-b1c0-0051b5b9c096 could not be found. Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f218a88f-1394-40e2-b1c0-0051b5b9c096 could not be found. Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:35:15.227440 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:35:15.232703 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:35:15.232703 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:35:15.232703 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:35:15.232703 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:35:15.232703 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:35:15.232703 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f218a88f-1394-40e2-b1c0-0051b5b9c096 could not be found. Aug 03 02:35:15.232703 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:35:15.232703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e7908a23-b248-45bd-958d-f2f1eb8a538b tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] Returning 404 to user: Instance f218a88f-1394-40e2-b1c0-0051b5b9c096 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:35:15.232703 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e7908a23-b248-45bd-958d-f2f1eb8a538b tempest-VolumesSnapshotTestJSON-946158596 tempest-VolumesSnapshotTestJSON-946158596-project] 10.222.0.67 "GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096" status: 404 len: 111 microversion: 2.1 time: 0.030903 Aug 03 02:35:15.232703 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3127/6133] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:35:15 2022] GET /compute/v2.1/servers/f218a88f-1394-40e2-b1c0-0051b5b9c096 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:35:59.586723 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:35:59.587457 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 02:35:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:35:59.660925 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:35:59.661122 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 02:35:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:36:11.752166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:36:11.752914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:36:11.884392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-83c6ed4b-1571-48be-9a69-dc12492c1ce5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:11.885278 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:36:11.885278 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 02:36:11.886640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83c6ed4b-1571-48be-9a69-dc12492c1ce5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:11.887117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83c6ed4b-1571-48be-9a69-dc12492c1ce5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:11.888546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83c6ed4b-1571-48be-9a69-dc12492c1ce5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:11.889093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-83c6ed4b-1571-48be-9a69-dc12492c1ce5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:11.912933 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-83c6ed4b-1571-48be-9a69-dc12492c1ce5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.167330 Aug 03 02:36:11.913502 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3007/6134] 10.222.0.67 () {58 vars in 1185 bytes} [Wed Aug 3 02:36:11 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:36:12.020415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-944647035", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "availability_zone": "nova:n-h1-826529-8", "networks": [{"uuid": "2ec94cf4-8d26-4133-8f58-857b2fd60f48"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:36:12.031766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:36:12.032434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:36:12.096247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] validate_networks() for [('2ec94cf4-8d26-4133-8f58-857b2fd60f48', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:36:12.601563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:36:12.602025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:36:12.602530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:36:12.603249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:36:12.603390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:36:12.613473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:12.613929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:12.614739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:12.615218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:12.634486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Getting quotas for project 3aacda7c63cd45d6a1de295cab0c5d72. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:36:12.641223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Getting quotas for user a0490e7e79964b5eba3e5adc4ed4802c and project 3aacda7c63cd45d6a1de295cab0c5d72. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:36:12.655097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:36:12.657441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:36:12.707068 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-400e8106-ef4d-4990-b885-e6d569fe2eaf tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690226 Aug 03 02:36:12.707640 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3128/6135] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:36:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:36:12.718617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7864f1c2-81dc-4ff3-bd03-94911af30fd5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:12.719394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7864f1c2-81dc-4ff3-bd03-94911af30fd5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:12.793027 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7864f1c2-81dc-4ff3-bd03-94911af30fd5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 200 len: 1328 microversion: 2.1 time: 0.078620 Aug 03 02:36:12.793605 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3008/6136] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:12 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 1328 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:13.816899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8ce5935d-f17a-4d3b-94b1-535e94ba48e1 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:13.818222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8ce5935d-f17a-4d3b-94b1-535e94ba48e1 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:13.841866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ce5935d-f17a-4d3b-94b1-535e94ba48e1 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:13.843783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ce5935d-f17a-4d3b-94b1-535e94ba48e1 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:13.846695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ce5935d-f17a-4d3b-94b1-535e94ba48e1 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:13.848240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ce5935d-f17a-4d3b-94b1-535e94ba48e1 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:13.936836 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8ce5935d-f17a-4d3b-94b1-535e94ba48e1 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 200 len: 1423 microversion: 2.1 time: 0.124718 Aug 03 02:36:13.937738 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3129/6137] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:13 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 1423 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:14.960866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fa4d5d61-c1f2-4a82-9b89-97bac7c05e2c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:14.961499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fa4d5d61-c1f2-4a82-9b89-97bac7c05e2c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:14.970884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fa4d5d61-c1f2-4a82-9b89-97bac7c05e2c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:14.971367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fa4d5d61-c1f2-4a82-9b89-97bac7c05e2c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:14.972253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fa4d5d61-c1f2-4a82-9b89-97bac7c05e2c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:14.972696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fa4d5d61-c1f2-4a82-9b89-97bac7c05e2c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:15.156470 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fa4d5d61-c1f2-4a82-9b89-97bac7c05e2c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 200 len: 1463 microversion: 2.1 time: 0.200263 Aug 03 02:36:15.157613 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3009/6138] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:14 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 1463 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:15.490321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-22b6e650-77bb-421c-92cb-ed74a1a6c3e4 req-a9f6f922-de1c-473d-ae66-21c93ab98be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d51f86b-e173-439c-9b94-84d1054ac42e", "tag": "fc6b6dbc-0017-4bfb-889b-611fec6c5fb2"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:36:15.514564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-22b6e650-77bb-421c-92cb-ed74a1a6c3e4 req-a9f6f922-de1c-473d-ae66-21c93ab98be7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:15.515523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-22b6e650-77bb-421c-92cb-ed74a1a6c3e4 req-a9f6f922-de1c-473d-ae66-21c93ab98be7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:15.527086 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-22b6e650-77bb-421c-92cb-ed74a1a6c3e4 req-a9f6f922-de1c-473d-ae66-21c93ab98be7 service nova] Creating event network-changed:fc6b6dbc-0017-4bfb-889b-611fec6c5fb2 for instance 4d51f86b-e173-439c-9b94-84d1054ac42e on n-h1-826529-8 Aug 03 02:36:15.533104 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-22b6e650-77bb-421c-92cb-ed74a1a6c3e4 req-a9f6f922-de1c-473d-ae66-21c93ab98be7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046611 Aug 03 02:36:15.534014 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3130/6139] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:36:16.179108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-820644e0-135f-4143-a548-e19544e2fcb5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:16.179637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-820644e0-135f-4143-a548-e19544e2fcb5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:16.187673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-820644e0-135f-4143-a548-e19544e2fcb5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:16.188231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-820644e0-135f-4143-a548-e19544e2fcb5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:16.189051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-820644e0-135f-4143-a548-e19544e2fcb5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:16.189497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-820644e0-135f-4143-a548-e19544e2fcb5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:16.329319 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-820644e0-135f-4143-a548-e19544e2fcb5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 200 len: 1463 microversion: 2.1 time: 0.154286 Aug 03 02:36:16.329906 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3010/6140] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:16 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 1463 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:17.350996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e7eb9850-71e5-4fc2-b1f8-b1fecfc297a9 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:17.351705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e7eb9850-71e5-4fc2-b1f8-b1fecfc297a9 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:17.359538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7eb9850-71e5-4fc2-b1f8-b1fecfc297a9 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:17.360155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7eb9850-71e5-4fc2-b1f8-b1fecfc297a9 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:17.360778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7eb9850-71e5-4fc2-b1f8-b1fecfc297a9 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:17.361221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e7eb9850-71e5-4fc2-b1f8-b1fecfc297a9 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:17.499045 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e7eb9850-71e5-4fc2-b1f8-b1fecfc297a9 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 200 len: 1463 microversion: 2.1 time: 0.152391 Aug 03 02:36:17.499631 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3131/6141] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:17 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:18.520146 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-325bb06a-276a-4528-ba1e-0b585b13ba13 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:18.520714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-325bb06a-276a-4528-ba1e-0b585b13ba13 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:18.527785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-325bb06a-276a-4528-ba1e-0b585b13ba13 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:18.528240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-325bb06a-276a-4528-ba1e-0b585b13ba13 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:18.529691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-325bb06a-276a-4528-ba1e-0b585b13ba13 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:18.530130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-325bb06a-276a-4528-ba1e-0b585b13ba13 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:18.660040 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-325bb06a-276a-4528-ba1e-0b585b13ba13 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 200 len: 1463 microversion: 2.1 time: 0.143622 Aug 03 02:36:18.660641 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3011/6142] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:18 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 1463 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:19.681128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-daf1f32d-55e0-4a33-b5eb-e6885a5dfa6a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:19.681735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-daf1f32d-55e0-4a33-b5eb-e6885a5dfa6a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:19.689456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-daf1f32d-55e0-4a33-b5eb-e6885a5dfa6a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:19.689909 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-daf1f32d-55e0-4a33-b5eb-e6885a5dfa6a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:19.690678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-daf1f32d-55e0-4a33-b5eb-e6885a5dfa6a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:19.691146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-daf1f32d-55e0-4a33-b5eb-e6885a5dfa6a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:19.821776 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-daf1f32d-55e0-4a33-b5eb-e6885a5dfa6a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 200 len: 1463 microversion: 2.1 time: 0.144394 Aug 03 02:36:19.822345 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3132/6143] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:19 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 1463 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:20.839475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-f2d7a60c-0ce9-4048-a8a1-89ec96b099d0 req-a550fd45-9f74-446c-a032-598336d92226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d51f86b-e173-439c-9b94-84d1054ac42e", "name": "network-vif-plugged", "status": "completed", "tag": "fc6b6dbc-0017-4bfb-889b-611fec6c5fb2"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:36:20.844207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-afb0fde0-ed23-4e7b-a257-128f11d08b51 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:20.844838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-afb0fde0-ed23-4e7b-a257-128f11d08b51 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:20.851402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f2d7a60c-0ce9-4048-a8a1-89ec96b099d0 req-a550fd45-9f74-446c-a032-598336d92226 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:20.851873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-f2d7a60c-0ce9-4048-a8a1-89ec96b099d0 req-a550fd45-9f74-446c-a032-598336d92226 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:20.852192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-afb0fde0-ed23-4e7b-a257-128f11d08b51 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:20.852649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-afb0fde0-ed23-4e7b-a257-128f11d08b51 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:20.853429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-afb0fde0-ed23-4e7b-a257-128f11d08b51 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:20.854036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-afb0fde0-ed23-4e7b-a257-128f11d08b51 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:20.864012 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-f2d7a60c-0ce9-4048-a8a1-89ec96b099d0 req-a550fd45-9f74-446c-a032-598336d92226 service nova] Creating event network-vif-plugged:fc6b6dbc-0017-4bfb-889b-611fec6c5fb2 for instance 4d51f86b-e173-439c-9b94-84d1054ac42e on n-h1-826529-8 Aug 03 02:36:20.870200 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-f2d7a60c-0ce9-4048-a8a1-89ec96b099d0 req-a550fd45-9f74-446c-a032-598336d92226 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034713 Aug 03 02:36:20.871517 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3012/6144] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:36:21.000754 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-afb0fde0-ed23-4e7b-a257-128f11d08b51 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 200 len: 1463 microversion: 2.1 time: 0.161451 Aug 03 02:36:21.001424 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3133/6145] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:20 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 1463 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:36:22.021703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:36:22.027882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ee62ac3e-52bd-41c5-94b3-4a2ae54f5332 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:22.029018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ee62ac3e-52bd-41c5-94b3-4a2ae54f5332 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:22.037591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee62ac3e-52bd-41c5-94b3-4a2ae54f5332 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:22.038300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee62ac3e-52bd-41c5-94b3-4a2ae54f5332 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:22.039276 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee62ac3e-52bd-41c5-94b3-4a2ae54f5332 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:22.039730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee62ac3e-52bd-41c5-94b3-4a2ae54f5332 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:22.189427 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ee62ac3e-52bd-41c5-94b3-4a2ae54f5332 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 200 len: 1463 microversion: 2.1 time: 0.170308 Aug 03 02:36:22.190090 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3013/6146] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:22 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 1463 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:23.209461 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fa1674ed-5a49-427c-9c5a-d26a2c6a9950 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:23.210606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fa1674ed-5a49-427c-9c5a-d26a2c6a9950 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:23.213782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:36:23.214456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:36:23.221021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa1674ed-5a49-427c-9c5a-d26a2c6a9950 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:23.221464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa1674ed-5a49-427c-9c5a-d26a2c6a9950 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:23.222255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa1674ed-5a49-427c-9c5a-d26a2c6a9950 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:23.222704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa1674ed-5a49-427c-9c5a-d26a2c6a9950 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:23.362377 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fa1674ed-5a49-427c-9c5a-d26a2c6a9950 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 200 len: 1648 microversion: 2.1 time: 0.156597 Aug 03 02:36:23.362980 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3134/6147] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:23 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 1648 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:23.383229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ee31c342-bba7-4206-b0c1-01208f022d7d tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:23.384122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ee31c342-bba7-4206-b0c1-01208f022d7d tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:23.386027 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:36:23.392638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee31c342-bba7-4206-b0c1-01208f022d7d tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:23.393096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee31c342-bba7-4206-b0c1-01208f022d7d tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:23.393876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee31c342-bba7-4206-b0c1-01208f022d7d tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:23.394320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee31c342-bba7-4206-b0c1-01208f022d7d tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:23.522481 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ee31c342-bba7-4206-b0c1-01208f022d7d tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 200 len: 1648 microversion: 2.1 time: 0.143233 Aug 03 02:36:23.523094 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3014/6148] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:23 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 1648 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:23.542980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-75d4e3ef-752d-410f-86ff-70a4224ce137 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:23.543589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-75d4e3ef-752d-410f-86ff-70a4224ce137 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:23.550367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75d4e3ef-752d-410f-86ff-70a4224ce137 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:23.550817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75d4e3ef-752d-410f-86ff-70a4224ce137 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:23.551611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75d4e3ef-752d-410f-86ff-70a4224ce137 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:23.552047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75d4e3ef-752d-410f-86ff-70a4224ce137 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:23.677514 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-75d4e3ef-752d-410f-86ff-70a4224ce137 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 200 len: 1648 microversion: 2.1 time: 0.138162 Aug 03 02:36:23.678087 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3135/6149] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:23 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 1648 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:23.738687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-538179279", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "availability_zone": "nova:n-h2-826529-8", "networks": [{"uuid": "2ec94cf4-8d26-4133-8f58-857b2fd60f48"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:36:23.801943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] validate_networks() for [('2ec94cf4-8d26-4133-8f58-857b2fd60f48', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:36:24.165829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:36:24.166146 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:36:24.166633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:36:24.167096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:36:24.167522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:36:24.177402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:24.177856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:24.178677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:24.179158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:24.196718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Getting quotas for project 3aacda7c63cd45d6a1de295cab0c5d72. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:36:24.202093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Getting quotas for user a0490e7e79964b5eba3e5adc4ed4802c and project 3aacda7c63cd45d6a1de295cab0c5d72. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:36:24.214470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:36:24.217394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:36:24.263347 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5404726f-9390-444f-a747-21f8d940050a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528966 Aug 03 02:36:24.264006 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3015/6150] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:36:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:36:24.274891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cde03bdb-9467-4ed1-b7c9-ab51d1281e09 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:24.276096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cde03bdb-9467-4ed1-b7c9-ab51d1281e09 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:24.343953 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cde03bdb-9467-4ed1-b7c9-ab51d1281e09 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 200 len: 1328 microversion: 2.1 time: 0.072786 Aug 03 02:36:24.344535 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3136/6151] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:24 2022] GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 1328 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:25.376531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-469ae4ad-5ce4-42a4-aeea-a9b967205da5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:25.377170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-469ae4ad-5ce4-42a4-aeea-a9b967205da5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:25.387256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-469ae4ad-5ce4-42a4-aeea-a9b967205da5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:25.388545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-469ae4ad-5ce4-42a4-aeea-a9b967205da5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:25.389652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-469ae4ad-5ce4-42a4-aeea-a9b967205da5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:25.390106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-469ae4ad-5ce4-42a4-aeea-a9b967205da5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:25.464769 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-469ae4ad-5ce4-42a4-aeea-a9b967205da5 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 200 len: 1415 microversion: 2.1 time: 0.092909 Aug 03 02:36:25.479868 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3016/6152] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:25 2022] GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 1415 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:26.494162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c09a0054-9227-4b67-a91a-aa4bbda90982 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:26.494782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c09a0054-9227-4b67-a91a-aa4bbda90982 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:26.502915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c09a0054-9227-4b67-a91a-aa4bbda90982 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:26.503381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c09a0054-9227-4b67-a91a-aa4bbda90982 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:26.504172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c09a0054-9227-4b67-a91a-aa4bbda90982 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:26.504611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c09a0054-9227-4b67-a91a-aa4bbda90982 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:26.697130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-844ddf05-7142-485f-8801-6cd77622a195 req-e853d38d-8762-40b4-aa9e-71e7a80b4c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dac1ee35-d63c-43d5-aa63-84d0527be359", "tag": "6e6394a5-92a3-4e2d-a0e1-69144f72e8b6"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:36:26.706948 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c09a0054-9227-4b67-a91a-aa4bbda90982 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 200 len: 1463 microversion: 2.1 time: 0.221008 Aug 03 02:36:26.708004 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3137/6153] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:26 2022] GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 1463 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:26.709749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-844ddf05-7142-485f-8801-6cd77622a195 req-e853d38d-8762-40b4-aa9e-71e7a80b4c80 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:26.710381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-844ddf05-7142-485f-8801-6cd77622a195 req-e853d38d-8762-40b4-aa9e-71e7a80b4c80 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:26.723255 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-844ddf05-7142-485f-8801-6cd77622a195 req-e853d38d-8762-40b4-aa9e-71e7a80b4c80 service nova] Creating event network-changed:6e6394a5-92a3-4e2d-a0e1-69144f72e8b6 for instance dac1ee35-d63c-43d5-aa63-84d0527be359 on n-h2-826529-8 Aug 03 02:36:26.730302 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-844ddf05-7142-485f-8801-6cd77622a195 req-e853d38d-8762-40b4-aa9e-71e7a80b4c80 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038713 Aug 03 02:36:26.730835 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3017/6154] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:36:27.729202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ac4a5731-c7c3-477a-906f-b8253c76031d tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:27.729821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ac4a5731-c7c3-477a-906f-b8253c76031d tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:27.737415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ac4a5731-c7c3-477a-906f-b8253c76031d tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:27.737879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ac4a5731-c7c3-477a-906f-b8253c76031d tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:27.738670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ac4a5731-c7c3-477a-906f-b8253c76031d tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:27.739145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ac4a5731-c7c3-477a-906f-b8253c76031d tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:27.871321 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ac4a5731-c7c3-477a-906f-b8253c76031d tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 200 len: 1463 microversion: 2.1 time: 0.145833 Aug 03 02:36:27.872734 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3138/6155] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:27 2022] GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 1463 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:28.893650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3ce1e509-d76e-4c8f-ae3f-4856e1383846 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:28.894359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3ce1e509-d76e-4c8f-ae3f-4856e1383846 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:28.901477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ce1e509-d76e-4c8f-ae3f-4856e1383846 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:28.901934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ce1e509-d76e-4c8f-ae3f-4856e1383846 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:28.902737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ce1e509-d76e-4c8f-ae3f-4856e1383846 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:28.903281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ce1e509-d76e-4c8f-ae3f-4856e1383846 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:29.031317 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3ce1e509-d76e-4c8f-ae3f-4856e1383846 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 200 len: 1463 microversion: 2.1 time: 0.142524 Aug 03 02:36:29.031896 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3018/6156] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:28 2022] GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 1463 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:30.052265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8feccd16-61bd-472d-84d3-15967eb12e16 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:30.053819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8feccd16-61bd-472d-84d3-15967eb12e16 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:30.061324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8feccd16-61bd-472d-84d3-15967eb12e16 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:30.061771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8feccd16-61bd-472d-84d3-15967eb12e16 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:30.062568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8feccd16-61bd-472d-84d3-15967eb12e16 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:30.063034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8feccd16-61bd-472d-84d3-15967eb12e16 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:30.193468 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8feccd16-61bd-472d-84d3-15967eb12e16 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 200 len: 1463 microversion: 2.1 time: 0.144856 Aug 03 02:36:30.194036 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3139/6157] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:30 2022] GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 1463 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:31.213343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0018dfbd-2bf3-40e4-ac18-297691132720 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:31.213973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0018dfbd-2bf3-40e4-ac18-297691132720 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:31.221907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0018dfbd-2bf3-40e4-ac18-297691132720 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:31.222358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0018dfbd-2bf3-40e4-ac18-297691132720 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:31.223169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0018dfbd-2bf3-40e4-ac18-297691132720 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:31.223606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0018dfbd-2bf3-40e4-ac18-297691132720 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:31.362703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-b9229b89-1ff6-4c99-8b24-7487cfccad54 req-cb8bdbde-8968-4729-85c8-384a6dfd5ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac1ee35-d63c-43d5-aa63-84d0527be359", "name": "network-vif-plugged", "status": "completed", "tag": "6e6394a5-92a3-4e2d-a0e1-69144f72e8b6"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:36:31.365620 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0018dfbd-2bf3-40e4-ac18-297691132720 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 200 len: 1463 microversion: 2.1 time: 0.156153 Aug 03 02:36:31.366204 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3019/6158] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:31 2022] GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 1463 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:31.372800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b9229b89-1ff6-4c99-8b24-7487cfccad54 req-cb8bdbde-8968-4729-85c8-384a6dfd5ae3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:31.373257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b9229b89-1ff6-4c99-8b24-7487cfccad54 req-cb8bdbde-8968-4729-85c8-384a6dfd5ae3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:31.384954 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-b9229b89-1ff6-4c99-8b24-7487cfccad54 req-cb8bdbde-8968-4729-85c8-384a6dfd5ae3 service nova] Creating event network-vif-plugged:6e6394a5-92a3-4e2d-a0e1-69144f72e8b6 for instance dac1ee35-d63c-43d5-aa63-84d0527be359 on n-h2-826529-8 Aug 03 02:36:31.390936 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-b9229b89-1ff6-4c99-8b24-7487cfccad54 req-cb8bdbde-8968-4729-85c8-384a6dfd5ae3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117269 Aug 03 02:36:31.391543 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3140/6159] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:36:32.386682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-784f610c-41a7-46a3-a468-27c33796209c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:32.387870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-784f610c-41a7-46a3-a468-27c33796209c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:32.395386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-784f610c-41a7-46a3-a468-27c33796209c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:32.395851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-784f610c-41a7-46a3-a468-27c33796209c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:32.396681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-784f610c-41a7-46a3-a468-27c33796209c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:32.397131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-784f610c-41a7-46a3-a468-27c33796209c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:32.535559 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-784f610c-41a7-46a3-a468-27c33796209c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 200 len: 1463 microversion: 2.1 time: 0.152626 Aug 03 02:36:32.536389 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3020/6160] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:32 2022] GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:33.558122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-00d9c288-5361-4a4e-8126-558217b2d16e tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:33.558834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-00d9c288-5361-4a4e-8126-558217b2d16e tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:33.565997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00d9c288-5361-4a4e-8126-558217b2d16e tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:33.566476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00d9c288-5361-4a4e-8126-558217b2d16e tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:33.567296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00d9c288-5361-4a4e-8126-558217b2d16e tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:33.567740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00d9c288-5361-4a4e-8126-558217b2d16e tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:33.694720 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-00d9c288-5361-4a4e-8126-558217b2d16e tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 200 len: 1648 microversion: 2.1 time: 0.142017 Aug 03 02:36:33.695330 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3141/6161] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:33 2022] GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 1648 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:33.714875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e2c3d8b2-5736-4bdd-a86e-998e7799c089 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:33.715512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e2c3d8b2-5736-4bdd-a86e-998e7799c089 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:33.722745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2c3d8b2-5736-4bdd-a86e-998e7799c089 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:33.723240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2c3d8b2-5736-4bdd-a86e-998e7799c089 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:33.724062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2c3d8b2-5736-4bdd-a86e-998e7799c089 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:33.724623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e2c3d8b2-5736-4bdd-a86e-998e7799c089 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:33.861801 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e2c3d8b2-5736-4bdd-a86e-998e7799c089 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 200 len: 1648 microversion: 2.1 time: 0.150717 Aug 03 02:36:33.862370 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3021/6162] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:33 2022] GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 1648 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:33.881959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-391a1ce6-770e-4d43-8666-7ab1593aed2a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:33.882856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-391a1ce6-770e-4d43-8666-7ab1593aed2a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:33.889744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-391a1ce6-770e-4d43-8666-7ab1593aed2a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:33.890200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-391a1ce6-770e-4d43-8666-7ab1593aed2a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:33.891014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-391a1ce6-770e-4d43-8666-7ab1593aed2a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:33.891459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-391a1ce6-770e-4d43-8666-7ab1593aed2a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:34.030809 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-391a1ce6-770e-4d43-8666-7ab1593aed2a tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 200 len: 1648 microversion: 2.1 time: 0.152522 Aug 03 02:36:34.031413 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3142/6163] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:33 2022] GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 1648 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:34.058940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-205f9cfa-9ea6-4b83-85ea-d04547f37eef tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:34.059831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-205f9cfa-9ea6-4b83-85ea-d04547f37eef tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:34.065603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-205f9cfa-9ea6-4b83-85ea-d04547f37eef tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:34.066055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-205f9cfa-9ea6-4b83-85ea-d04547f37eef tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:34.066826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-205f9cfa-9ea6-4b83-85ea-d04547f37eef tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:34.067313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-205f9cfa-9ea6-4b83-85ea-d04547f37eef tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:34.096604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-205f9cfa-9ea6-4b83-85ea-d04547f37eef tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:36:34.188189 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-205f9cfa-9ea6-4b83-85ea-d04547f37eef tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "DELETE /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 204 len: 0 microversion: 2.1 time: 0.136368 Aug 03 02:36:34.193611 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3022/6164] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:36:34 2022] DELETE /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:36:34.198325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9dc1dd33-c78c-489f-92ba-97e268bf8dc2 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:34.198971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9dc1dd33-c78c-489f-92ba-97e268bf8dc2 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:34.205836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dc1dd33-c78c-489f-92ba-97e268bf8dc2 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:34.206283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dc1dd33-c78c-489f-92ba-97e268bf8dc2 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:34.207082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dc1dd33-c78c-489f-92ba-97e268bf8dc2 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:34.207520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dc1dd33-c78c-489f-92ba-97e268bf8dc2 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:34.339998 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9dc1dd33-c78c-489f-92ba-97e268bf8dc2 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 200 len: 1654 microversion: 2.1 time: 0.145452 Aug 03 02:36:34.341207 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3143/6165] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:34 2022] GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 1654 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:35.363149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ecc04eeb-0fbc-4185-8934-68e9189fcd23 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:35.363875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ecc04eeb-0fbc-4185-8934-68e9189fcd23 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:35.365902 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:36:35.366580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:36:35.374875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecc04eeb-0fbc-4185-8934-68e9189fcd23 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:35.375358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecc04eeb-0fbc-4185-8934-68e9189fcd23 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:35.376154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecc04eeb-0fbc-4185-8934-68e9189fcd23 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:35.376598 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecc04eeb-0fbc-4185-8934-68e9189fcd23 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:35.509503 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ecc04eeb-0fbc-4185-8934-68e9189fcd23 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 200 len: 1654 microversion: 2.1 time: 0.150586 Aug 03 02:36:35.510076 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3023/6166] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:35 2022] GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:36.385553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c1a12e24-fa2f-429e-a056-aa47086cff85 req-fbf9b29b-a8eb-41a4-b338-447dbffc645d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac1ee35-d63c-43d5-aa63-84d0527be359", "name": "network-vif-deleted", "tag": "6e6394a5-92a3-4e2d-a0e1-69144f72e8b6"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:36:36.394104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:36:36.409677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c1a12e24-fa2f-429e-a056-aa47086cff85 req-fbf9b29b-a8eb-41a4-b338-447dbffc645d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:36.410377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c1a12e24-fa2f-429e-a056-aa47086cff85 req-fbf9b29b-a8eb-41a4-b338-447dbffc645d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:36.431154 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c1a12e24-fa2f-429e-a056-aa47086cff85 req-fbf9b29b-a8eb-41a4-b338-447dbffc645d service nova] Creating event network-vif-deleted:6e6394a5-92a3-4e2d-a0e1-69144f72e8b6 for instance dac1ee35-d63c-43d5-aa63-84d0527be359 on n-h2-826529-8 Aug 03 02:36:36.440717 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c1a12e24-fa2f-429e-a056-aa47086cff85 req-fbf9b29b-a8eb-41a4-b338-447dbffc645d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060756 Aug 03 02:36:36.442290 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3144/6167] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:36:36.530274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3fec64f4-5adc-44da-8bc1-6e6453af4835 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:36.531097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3fec64f4-5adc-44da-8bc1-6e6453af4835 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:36.538362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3fec64f4-5adc-44da-8bc1-6e6453af4835 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:36.538845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3fec64f4-5adc-44da-8bc1-6e6453af4835 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:36.539855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3fec64f4-5adc-44da-8bc1-6e6453af4835 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:36.540296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3fec64f4-5adc-44da-8bc1-6e6453af4835 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:36.572921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3fec64f4-5adc-44da-8bc1-6e6453af4835 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:36.573375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3fec64f4-5adc-44da-8bc1-6e6453af4835 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:36.573831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-3fec64f4-5adc-44da-8bc1-6e6453af4835 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lazy-loading 'fault' on Instance uuid dac1ee35-d63c-43d5-aa63-84d0527be359 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:36:36.623549 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3fec64f4-5adc-44da-8bc1-6e6453af4835 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 200 len: 1453 microversion: 2.1 time: 0.097671 Aug 03 02:36:36.624126 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3024/6168] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:36 2022] GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:37.645326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6f28ef08-cb8e-4f13-989b-e31f7bdfa9ab tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:37.646039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6f28ef08-cb8e-4f13-989b-e31f7bdfa9ab tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: dac1ee35-d63c-43d5-aa63-84d0527be359] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:37.653412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f28ef08-cb8e-4f13-989b-e31f7bdfa9ab tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:37.653879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f28ef08-cb8e-4f13-989b-e31f7bdfa9ab tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:37.659475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f28ef08-cb8e-4f13-989b-e31f7bdfa9ab tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:37.659928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f28ef08-cb8e-4f13-989b-e31f7bdfa9ab tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:37.674610 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-6f28ef08-cb8e-4f13-989b-e31f7bdfa9ab tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] HTTP exception thrown: Instance dac1ee35-d63c-43d5-aa63-84d0527be359 could not be found. Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6f28ef08-cb8e-4f13-989b-e31f7bdfa9ab tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Request method failure captured: Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 HTTP/1.1 Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6d8bdDa3cxJaso94tNNKvK_V3I7ZL83wB3HCbu-ZMh2jNdib-mZbtZ_BmnDRulbQ0_jPXPviMCbXb2IscAWzhgOkm0bMWwsxyqHvlaZHNLDZ7Gng9DWDj5p3e2OyukrMPMykYT41AvrqZqYOrvjKuzQ2MYWikYD9wsHjYrQxV5nyMcQ Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 3aacda7c63cd45d6a1de295cab0c5d72 Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestServerMultinode-1681722804 Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3aacda7c63cd45d6a1de295cab0c5d72", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3aacda7c63cd45d6a1de295cab0c5d72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3aacda7c63cd45d6a1de295cab0c5d72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3aacda7c63cd45d6a1de295cab0c5d72"}]}] Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestServerMultinode-1681722804 Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 3aacda7c63cd45d6a1de295cab0c5d72 Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestServerMultinode-1681722804 Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestServerMultinode-1681722804-project-admin Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: a0490e7e79964b5eba3e5adc4ed4802c Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestServerMultinode-1681722804-project-admin Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance dac1ee35-d63c-43d5-aa63-84d0527be359 could not be found. Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'dac1ee35-d63c-43d5-aa63-84d0527be359'} Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dac1ee35-d63c-43d5-aa63-84d0527be359 could not be found. Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dac1ee35-d63c-43d5-aa63-84d0527be359 could not be found. Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:36:37.676311 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:36:37.681036 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:36:37.681036 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:36:37.681036 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:36:37.681036 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:36:37.681036 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:36:37.681036 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dac1ee35-d63c-43d5-aa63-84d0527be359 could not be found. Aug 03 02:36:37.681036 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:36:37.681036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6f28ef08-cb8e-4f13-989b-e31f7bdfa9ab tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Returning 404 to user: Instance dac1ee35-d63c-43d5-aa63-84d0527be359 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:36:37.681036 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6f28ef08-cb8e-4f13-989b-e31f7bdfa9ab tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359" status: 404 len: 111 microversion: 2.1 time: 0.036715 Aug 03 02:36:37.681036 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3145/6169] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:37 2022] GET /compute/v2.1/servers/dac1ee35-d63c-43d5-aa63-84d0527be359 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:36:37.686527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-927e5d7f-1119-4ebb-a810-e9fbd38b73f7 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:37.687071 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-927e5d7f-1119-4ebb-a810-e9fbd38b73f7 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:37.694502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-927e5d7f-1119-4ebb-a810-e9fbd38b73f7 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:37.694993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-927e5d7f-1119-4ebb-a810-e9fbd38b73f7 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:37.695784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-927e5d7f-1119-4ebb-a810-e9fbd38b73f7 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:37.696232 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-927e5d7f-1119-4ebb-a810-e9fbd38b73f7 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:37.700266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:36:37.730869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-927e5d7f-1119-4ebb-a810-e9fbd38b73f7 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:36:37.814278 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-927e5d7f-1119-4ebb-a810-e9fbd38b73f7 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "DELETE /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 204 len: 0 microversion: 2.1 time: 0.131032 Aug 03 02:36:37.814868 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3025/6170] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:36:37 2022] DELETE /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:36:37.823188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c90a64a6-1875-4727-91a3-7e84792766ae tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:37.823807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c90a64a6-1875-4727-91a3-7e84792766ae tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:37.832288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c90a64a6-1875-4727-91a3-7e84792766ae tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:37.832755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c90a64a6-1875-4727-91a3-7e84792766ae tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:37.833543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c90a64a6-1875-4727-91a3-7e84792766ae tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:37.833986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c90a64a6-1875-4727-91a3-7e84792766ae tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:37.969192 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c90a64a6-1875-4727-91a3-7e84792766ae tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 200 len: 1654 microversion: 2.1 time: 0.149649 Aug 03 02:36:37.969765 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3146/6171] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:37 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 1654 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:38.995010 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-893b6936-2c36-4d38-9313-152af03e1f69 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:38.995396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-893b6936-2c36-4d38-9313-152af03e1f69 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:39.002880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-893b6936-2c36-4d38-9313-152af03e1f69 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:39.003293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-893b6936-2c36-4d38-9313-152af03e1f69 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:39.004100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-893b6936-2c36-4d38-9313-152af03e1f69 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:39.004539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-893b6936-2c36-4d38-9313-152af03e1f69 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:39.145161 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-893b6936-2c36-4d38-9313-152af03e1f69 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 200 len: 1654 microversion: 2.1 time: 0.155160 Aug 03 02:36:39.145740 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3026/6172] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:38 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:39.992394 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-ecacdb12-43ce-4178-9f43-7136dd4b24fd req-e39d8061-ddb5-4a4a-894b-77dae577b7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d51f86b-e173-439c-9b94-84d1054ac42e", "name": "network-vif-deleted", "tag": "fc6b6dbc-0017-4bfb-889b-611fec6c5fb2"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:36:40.007969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ecacdb12-43ce-4178-9f43-7136dd4b24fd req-e39d8061-ddb5-4a4a-894b-77dae577b7c1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:40.008673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ecacdb12-43ce-4178-9f43-7136dd4b24fd req-e39d8061-ddb5-4a4a-894b-77dae577b7c1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:40.023258 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-ecacdb12-43ce-4178-9f43-7136dd4b24fd req-e39d8061-ddb5-4a4a-894b-77dae577b7c1 service nova] Creating event network-vif-deleted:fc6b6dbc-0017-4bfb-889b-611fec6c5fb2 for instance 4d51f86b-e173-439c-9b94-84d1054ac42e on n-h1-826529-8 Aug 03 02:36:40.028809 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-ecacdb12-43ce-4178-9f43-7136dd4b24fd req-e39d8061-ddb5-4a4a-894b-77dae577b7c1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126465 Aug 03 02:36:40.030145 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3147/6173] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:36:40.165790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6f7e7d6e-152b-4d28-a107-9931eeafbb57 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:40.166308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6f7e7d6e-152b-4d28-a107-9931eeafbb57 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:40.173943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f7e7d6e-152b-4d28-a107-9931eeafbb57 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:40.174396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f7e7d6e-152b-4d28-a107-9931eeafbb57 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:40.175201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f7e7d6e-152b-4d28-a107-9931eeafbb57 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:40.175646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f7e7d6e-152b-4d28-a107-9931eeafbb57 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:40.213083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f7e7d6e-152b-4d28-a107-9931eeafbb57 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:40.213538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6f7e7d6e-152b-4d28-a107-9931eeafbb57 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:40.213997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-6f7e7d6e-152b-4d28-a107-9931eeafbb57 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lazy-loading 'fault' on Instance uuid 4d51f86b-e173-439c-9b94-84d1054ac42e {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:36:40.263768 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6f7e7d6e-152b-4d28-a107-9931eeafbb57 tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 200 len: 1453 microversion: 2.1 time: 0.101266 Aug 03 02:36:40.264355 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3027/6174] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:40 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:36:41.286627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c545f329-c4aa-476f-b0cd-fa754a7b0f8c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:36:41.287345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c545f329-c4aa-476f-b0cd-fa754a7b0f8c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] [instance: 4d51f86b-e173-439c-9b94-84d1054ac42e] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:36:41.296414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c545f329-c4aa-476f-b0cd-fa754a7b0f8c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:41.296857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c545f329-c4aa-476f-b0cd-fa754a7b0f8c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:41.297636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c545f329-c4aa-476f-b0cd-fa754a7b0f8c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:36:41.298072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c545f329-c4aa-476f-b0cd-fa754a7b0f8c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:36:41.313341 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-c545f329-c4aa-476f-b0cd-fa754a7b0f8c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] HTTP exception thrown: Instance 4d51f86b-e173-439c-9b94-84d1054ac42e could not be found. Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c545f329-c4aa-476f-b0cd-fa754a7b0f8c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Request method failure captured: Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e HTTP/1.1 Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6d8bdDa3cxJaso94tNNKvK_V3I7ZL83wB3HCbu-ZMh2jNdib-mZbtZ_BmnDRulbQ0_jPXPviMCbXb2IscAWzhgOkm0bMWwsxyqHvlaZHNLDZ7Gng9DWDj5p3e2OyukrMPMykYT41AvrqZqYOrvjKuzQ2MYWikYD9wsHjYrQxV5nyMcQ Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 3aacda7c63cd45d6a1de295cab0c5d72 Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestServerMultinode-1681722804 Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3aacda7c63cd45d6a1de295cab0c5d72", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3aacda7c63cd45d6a1de295cab0c5d72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3aacda7c63cd45d6a1de295cab0c5d72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3aacda7c63cd45d6a1de295cab0c5d72"}]}] Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestServerMultinode-1681722804 Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 3aacda7c63cd45d6a1de295cab0c5d72 Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestServerMultinode-1681722804 Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestServerMultinode-1681722804-project-admin Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: a0490e7e79964b5eba3e5adc4ed4802c Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestServerMultinode-1681722804-project-admin Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 4d51f86b-e173-439c-9b94-84d1054ac42e could not be found. Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '4d51f86b-e173-439c-9b94-84d1054ac42e'} Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d51f86b-e173-439c-9b94-84d1054ac42e could not be found. Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d51f86b-e173-439c-9b94-84d1054ac42e could not be found. Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:36:41.315071 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:36:41.319764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:36:41.319764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:36:41.319764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:36:41.319764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:36:41.319764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:36:41.319764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d51f86b-e173-439c-9b94-84d1054ac42e could not be found. Aug 03 02:36:41.319764 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:36:41.319764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c545f329-c4aa-476f-b0cd-fa754a7b0f8c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] Returning 404 to user: Instance 4d51f86b-e173-439c-9b94-84d1054ac42e could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:36:41.319764 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c545f329-c4aa-476f-b0cd-fa754a7b0f8c tempest-TestServerMultinode-1681722804 tempest-TestServerMultinode-1681722804-project-admin] 10.222.0.67 "GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e" status: 404 len: 111 microversion: 2.1 time: 0.034917 Aug 03 02:36:41.319764 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3148/6175] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:36:41 2022] GET /compute/v2.1/servers/4d51f86b-e173-439c-9b94-84d1054ac42e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:37:01.949572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-549080488", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "429f3364-5d38-4bce-a186-6e46e5298326", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5eae0150-a7f5-4e00-b929-5ba4bf7b1156"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:37:01.960019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:37:01.960907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:37:02.017072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] validate_networks() for [('5eae0150-a7f5-4e00-b929-5ba4bf7b1156', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:37:02.411144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:37:02.411571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:37:02.412047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:37:02.412460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:37:02.412878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:37:02.423603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:02.424089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:02.424941 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:02.425384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:02.445808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:37:02.452198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for user 1114641f11954d74885d0e4b082d7704 and project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:37:02.518573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:37:02.521100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='429f3364-5d38-4bce-a186-6e46e5298326',volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:37:02.677891 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b5ee3969-16a4-4dc1-a916-7bbd60cdbbce tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732825 Aug 03 02:37:02.679173 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3028/6176] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:37:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:37:02.690052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bdea1464-cf4f-4d7c-b02f-d0f4d41c922d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:02.691405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bdea1464-cf4f-4d7c-b02f-d0f4d41c922d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:02.694443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:37:02.705305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=92 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:37:02.780081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bdea1464-cf4f-4d7c-b02f-d0f4d41c922d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:02.787908 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bdea1464-cf4f-4d7c-b02f-d0f4d41c922d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1056 microversion: 2.1 time: 0.101851 Aug 03 02:37:02.788859 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3149/6177] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:02 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1056 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:37:03.813836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-81060040-d5d3-481a-bf2a-490e4ac61eed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:03.814452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-81060040-d5d3-481a-bf2a-490e4ac61eed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:03.821861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81060040-d5d3-481a-bf2a-490e4ac61eed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:03.822319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81060040-d5d3-481a-bf2a-490e4ac61eed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:03.823126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81060040-d5d3-481a-bf2a-490e4ac61eed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:03.823566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-81060040-d5d3-481a-bf2a-490e4ac61eed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:03.894394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-81060040-d5d3-481a-bf2a-490e4ac61eed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:03.902555 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-81060040-d5d3-481a-bf2a-490e4ac61eed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1154 microversion: 2.1 time: 0.094753 Aug 03 02:37:03.903263 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3029/6178] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:03 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1154 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:04.924594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b3af65de-bc34-4894-ab3f-ac525b2b4a97 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:04.926079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b3af65de-bc34-4894-ab3f-ac525b2b4a97 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:04.934024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3af65de-bc34-4894-ab3f-ac525b2b4a97 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:04.935060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3af65de-bc34-4894-ab3f-ac525b2b4a97 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:04.936742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3af65de-bc34-4894-ab3f-ac525b2b4a97 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:04.937381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b3af65de-bc34-4894-ab3f-ac525b2b4a97 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:05.129187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b3af65de-bc34-4894-ab3f-ac525b2b4a97 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:05.144741 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b3af65de-bc34-4894-ab3f-ac525b2b4a97 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1214 microversion: 2.1 time: 0.222911 Aug 03 02:37:05.146109 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3150/6179] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:04 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1214 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:05.281062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-0acf6e0f-f89b-4075-93a2-ce33032e3e40 req-0296d2aa-04cd-4a33-a449-0e6bf8ea4965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c26376a9-d987-4056-847f-8a90b798edf3", "tag": "8f77ed59-5384-422e-bb19-587497d7c9ea"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:37:05.316807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0acf6e0f-f89b-4075-93a2-ce33032e3e40 req-0296d2aa-04cd-4a33-a449-0e6bf8ea4965 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:05.319197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0acf6e0f-f89b-4075-93a2-ce33032e3e40 req-0296d2aa-04cd-4a33-a449-0e6bf8ea4965 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:05.334310 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-0acf6e0f-f89b-4075-93a2-ce33032e3e40 req-0296d2aa-04cd-4a33-a449-0e6bf8ea4965 service nova] Creating event network-changed:8f77ed59-5384-422e-bb19-587497d7c9ea for instance c26376a9-d987-4056-847f-8a90b798edf3 on n-h1-826529-8 Aug 03 02:37:05.344005 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-0acf6e0f-f89b-4075-93a2-ce33032e3e40 req-0296d2aa-04cd-4a33-a449-0e6bf8ea4965 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070562 Aug 03 02:37:05.348530 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3030/6180] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:37:06.165852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2743890f-d029-4b8a-9b4c-8d7eab7c33ab tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:06.166464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2743890f-d029-4b8a-9b4c-8d7eab7c33ab tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:06.174742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2743890f-d029-4b8a-9b4c-8d7eab7c33ab tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:06.175463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2743890f-d029-4b8a-9b4c-8d7eab7c33ab tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:06.176427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2743890f-d029-4b8a-9b4c-8d7eab7c33ab tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:06.176866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2743890f-d029-4b8a-9b4c-8d7eab7c33ab tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:06.335615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2743890f-d029-4b8a-9b4c-8d7eab7c33ab tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:06.344935 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2743890f-d029-4b8a-9b4c-8d7eab7c33ab tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1214 microversion: 2.1 time: 0.182949 Aug 03 02:37:06.345798 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3151/6181] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:06 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:07.367515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a8cb99a7-edea-4e47-8a1e-a5eb6d7cded4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:07.368218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a8cb99a7-edea-4e47-8a1e-a5eb6d7cded4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:07.376777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8cb99a7-edea-4e47-8a1e-a5eb6d7cded4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:07.377249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8cb99a7-edea-4e47-8a1e-a5eb6d7cded4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:07.378056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8cb99a7-edea-4e47-8a1e-a5eb6d7cded4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:07.378506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8cb99a7-edea-4e47-8a1e-a5eb6d7cded4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:07.515752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a8cb99a7-edea-4e47-8a1e-a5eb6d7cded4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:07.523526 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a8cb99a7-edea-4e47-8a1e-a5eb6d7cded4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1214 microversion: 2.1 time: 0.160468 Aug 03 02:37:07.524110 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3031/6182] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:07 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:08.545409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-472b06be-9e91-4555-a181-b24bdc00acb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:08.546022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-472b06be-9e91-4555-a181-b24bdc00acb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:08.553126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-472b06be-9e91-4555-a181-b24bdc00acb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:08.553558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-472b06be-9e91-4555-a181-b24bdc00acb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:08.554344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-472b06be-9e91-4555-a181-b24bdc00acb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:08.555047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-472b06be-9e91-4555-a181-b24bdc00acb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:08.698998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-472b06be-9e91-4555-a181-b24bdc00acb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:08.707043 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-472b06be-9e91-4555-a181-b24bdc00acb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1214 microversion: 2.1 time: 0.165359 Aug 03 02:37:08.707875 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3152/6183] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:08 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:09.730056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ba572593-972d-475c-94c8-b82a22b181dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:09.730670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ba572593-972d-475c-94c8-b82a22b181dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:09.738254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba572593-972d-475c-94c8-b82a22b181dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:09.738705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba572593-972d-475c-94c8-b82a22b181dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:09.739760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba572593-972d-475c-94c8-b82a22b181dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:09.740204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba572593-972d-475c-94c8-b82a22b181dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:09.889016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ba572593-972d-475c-94c8-b82a22b181dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:09.897760 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ba572593-972d-475c-94c8-b82a22b181dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1202 microversion: 2.1 time: 0.171804 Aug 03 02:37:09.898345 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3032/6184] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:09 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1202 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:10.920003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-14aa7c0e-4533-42fd-856d-43454dc23eeb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:10.920647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-14aa7c0e-4533-42fd-856d-43454dc23eeb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:10.927978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-14aa7c0e-4533-42fd-856d-43454dc23eeb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:10.928460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-14aa7c0e-4533-42fd-856d-43454dc23eeb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:10.929238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-14aa7c0e-4533-42fd-856d-43454dc23eeb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:10.929678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-14aa7c0e-4533-42fd-856d-43454dc23eeb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:11.062191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-14aa7c0e-4533-42fd-856d-43454dc23eeb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:11.070096 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-14aa7c0e-4533-42fd-856d-43454dc23eeb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1202 microversion: 2.1 time: 0.154657 Aug 03 02:37:11.070667 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3153/6185] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:10 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:12.091875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2e6a2298-8fb9-46d9-883a-a59c25e8afd8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:12.092594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2e6a2298-8fb9-46d9-883a-a59c25e8afd8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:12.100187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e6a2298-8fb9-46d9-883a-a59c25e8afd8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:12.100642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e6a2298-8fb9-46d9-883a-a59c25e8afd8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:12.101429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e6a2298-8fb9-46d9-883a-a59c25e8afd8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:12.101869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e6a2298-8fb9-46d9-883a-a59c25e8afd8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:12.236624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2e6a2298-8fb9-46d9-883a-a59c25e8afd8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:12.244520 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2e6a2298-8fb9-46d9-883a-a59c25e8afd8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1202 microversion: 2.1 time: 0.157299 Aug 03 02:37:12.245092 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3033/6186] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:12 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:13.265857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1fdce7a-3067-405a-b4ee-a0c65ee3150f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:13.266498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b1fdce7a-3067-405a-b4ee-a0c65ee3150f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:13.269296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:37:13.275136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1fdce7a-3067-405a-b4ee-a0c65ee3150f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:13.275589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1fdce7a-3067-405a-b4ee-a0c65ee3150f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:13.276353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1fdce7a-3067-405a-b4ee-a0c65ee3150f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:13.276786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1fdce7a-3067-405a-b4ee-a0c65ee3150f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:13.410587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b1fdce7a-3067-405a-b4ee-a0c65ee3150f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:13.418217 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b1fdce7a-3067-405a-b4ee-a0c65ee3150f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1202 microversion: 2.1 time: 0.156413 Aug 03 02:37:13.419453 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3154/6187] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:13 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:14.440759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eb3ae819-49f9-49df-a52d-4d661c6949e8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:14.441347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eb3ae819-49f9-49df-a52d-4d661c6949e8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:14.443355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:37:14.444035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:37:14.452327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb3ae819-49f9-49df-a52d-4d661c6949e8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:14.452714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb3ae819-49f9-49df-a52d-4d661c6949e8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:14.453501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb3ae819-49f9-49df-a52d-4d661c6949e8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:14.453955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eb3ae819-49f9-49df-a52d-4d661c6949e8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:14.594569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eb3ae819-49f9-49df-a52d-4d661c6949e8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:14.602166 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eb3ae819-49f9-49df-a52d-4d661c6949e8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1202 microversion: 2.1 time: 0.165334 Aug 03 02:37:14.602755 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3034/6188] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:14 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:15.625035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e65948c0-68a1-42fa-9b18-da7b088affbe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:15.625668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e65948c0-68a1-42fa-9b18-da7b088affbe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:15.635302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e65948c0-68a1-42fa-9b18-da7b088affbe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:15.636087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e65948c0-68a1-42fa-9b18-da7b088affbe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:15.636907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e65948c0-68a1-42fa-9b18-da7b088affbe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:15.637357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e65948c0-68a1-42fa-9b18-da7b088affbe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:15.776309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e65948c0-68a1-42fa-9b18-da7b088affbe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:15.784204 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e65948c0-68a1-42fa-9b18-da7b088affbe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1202 microversion: 2.1 time: 0.165131 Aug 03 02:37:15.784789 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3155/6189] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:15 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:16.806105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9a1c7431-3047-4b0c-bab2-0b771160771a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:16.806721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9a1c7431-3047-4b0c-bab2-0b771160771a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:16.813123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a1c7431-3047-4b0c-bab2-0b771160771a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:16.813579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a1c7431-3047-4b0c-bab2-0b771160771a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:16.814705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a1c7431-3047-4b0c-bab2-0b771160771a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:16.815217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a1c7431-3047-4b0c-bab2-0b771160771a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:16.950962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9a1c7431-3047-4b0c-bab2-0b771160771a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:16.959128 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9a1c7431-3047-4b0c-bab2-0b771160771a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1202 microversion: 2.1 time: 0.157104 Aug 03 02:37:16.959721 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3035/6190] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:16 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:17.980239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-daa46fb3-5593-4801-9b6c-12f542a51c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:17.980853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-daa46fb3-5593-4801-9b6c-12f542a51c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:17.987709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-daa46fb3-5593-4801-9b6c-12f542a51c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:17.988162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-daa46fb3-5593-4801-9b6c-12f542a51c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:17.988931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-daa46fb3-5593-4801-9b6c-12f542a51c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:17.989369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-daa46fb3-5593-4801-9b6c-12f542a51c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:18.128409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-daa46fb3-5593-4801-9b6c-12f542a51c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:18.136468 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-daa46fb3-5593-4801-9b6c-12f542a51c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1202 microversion: 2.1 time: 0.160324 Aug 03 02:37:18.137047 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3156/6191] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:17 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:19.010544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-4c8d8896-8c29-4bba-9cae-f35cc5ede5ec req-d39bffae-fa49-4eee-a6ec-d99b948e73ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c26376a9-d987-4056-847f-8a90b798edf3", "name": "network-vif-plugged", "status": "completed", "tag": "8f77ed59-5384-422e-bb19-587497d7c9ea"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:37:19.022812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4c8d8896-8c29-4bba-9cae-f35cc5ede5ec req-d39bffae-fa49-4eee-a6ec-d99b948e73ac service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:19.023411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4c8d8896-8c29-4bba-9cae-f35cc5ede5ec req-d39bffae-fa49-4eee-a6ec-d99b948e73ac service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:19.035743 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-4c8d8896-8c29-4bba-9cae-f35cc5ede5ec req-d39bffae-fa49-4eee-a6ec-d99b948e73ac service nova] Creating event network-vif-plugged:8f77ed59-5384-422e-bb19-587497d7c9ea for instance c26376a9-d987-4056-847f-8a90b798edf3 on n-h1-826529-8 Aug 03 02:37:19.040864 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-4c8d8896-8c29-4bba-9cae-f35cc5ede5ec req-d39bffae-fa49-4eee-a6ec-d99b948e73ac service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034770 Aug 03 02:37:19.041476 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3036/6192] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:37:19.157676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6dd09306-4a2f-40b5-bf8c-4ab52269e55b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:19.158292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6dd09306-4a2f-40b5-bf8c-4ab52269e55b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:19.165390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dd09306-4a2f-40b5-bf8c-4ab52269e55b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:19.165848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dd09306-4a2f-40b5-bf8c-4ab52269e55b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:19.166638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dd09306-4a2f-40b5-bf8c-4ab52269e55b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:19.167119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dd09306-4a2f-40b5-bf8c-4ab52269e55b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:19.299122 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6dd09306-4a2f-40b5-bf8c-4ab52269e55b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:19.306709 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6dd09306-4a2f-40b5-bf8c-4ab52269e55b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1202 microversion: 2.1 time: 0.152921 Aug 03 02:37:19.307320 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3157/6193] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:19 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:20.330159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a7e3443c-33ff-4f4f-a69f-5cdcdf28b7b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:20.331679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a7e3443c-33ff-4f4f-a69f-5cdcdf28b7b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:20.338331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a7e3443c-33ff-4f4f-a69f-5cdcdf28b7b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:20.338782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a7e3443c-33ff-4f4f-a69f-5cdcdf28b7b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:20.339671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a7e3443c-33ff-4f4f-a69f-5cdcdf28b7b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:20.340109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a7e3443c-33ff-4f4f-a69f-5cdcdf28b7b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:20.493433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a7e3443c-33ff-4f4f-a69f-5cdcdf28b7b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:20.502402 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a7e3443c-33ff-4f4f-a69f-5cdcdf28b7b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1388 microversion: 2.1 time: 0.177934 Aug 03 02:37:20.503196 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3037/6194] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:20 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1388 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:20.522989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c069e3b7-9fc5-453b-974f-011da069dec0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:20.523677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c069e3b7-9fc5-453b-974f-011da069dec0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:20.530717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c069e3b7-9fc5-453b-974f-011da069dec0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:20.531297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c069e3b7-9fc5-453b-974f-011da069dec0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:20.532064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c069e3b7-9fc5-453b-974f-011da069dec0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:20.532504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c069e3b7-9fc5-453b-974f-011da069dec0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:20.665731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c069e3b7-9fc5-453b-974f-011da069dec0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:20.673648 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c069e3b7-9fc5-453b-974f-011da069dec0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1388 microversion: 2.1 time: 0.154459 Aug 03 02:37:20.674232 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3158/6195] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:20 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1388 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:20.694216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-506d6769-3857-460e-b827-9b5e969fe4f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:20.694860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-506d6769-3857-460e-b827-9b5e969fe4f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:20.701740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-506d6769-3857-460e-b827-9b5e969fe4f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:20.702195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-506d6769-3857-460e-b827-9b5e969fe4f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:20.703277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-506d6769-3857-460e-b827-9b5e969fe4f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:20.703725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-506d6769-3857-460e-b827-9b5e969fe4f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:20.836284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-506d6769-3857-460e-b827-9b5e969fe4f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:20.844230 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-506d6769-3857-460e-b827-9b5e969fe4f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1388 microversion: 2.1 time: 0.154526 Aug 03 02:37:20.844799 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3038/6196] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:20 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1388 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:20.864718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e3188fa2-9787-48cb-9ac6-35d5d0b3d900 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:20.865156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e3188fa2-9787-48cb-9ac6-35d5d0b3d900 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:20.871143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3188fa2-9787-48cb-9ac6-35d5d0b3d900 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:20.871590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3188fa2-9787-48cb-9ac6-35d5d0b3d900 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:20.872983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3188fa2-9787-48cb-9ac6-35d5d0b3d900 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:20.873528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3188fa2-9787-48cb-9ac6-35d5d0b3d900 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:20.897932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e3188fa2-9787-48cb-9ac6-35d5d0b3d900 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:37:20.973427 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e3188fa2-9787-48cb-9ac6-35d5d0b3d900 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 204 len: 0 microversion: 2.1 time: 0.112182 Aug 03 02:37:20.974013 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3159/6197] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:37:20 2022] DELETE /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:37:20.983248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-18cdeda2-0ac4-462b-bfe7-b88db5354bac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:20.983859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-18cdeda2-0ac4-462b-bfe7-b88db5354bac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:20.991626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18cdeda2-0ac4-462b-bfe7-b88db5354bac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:20.992095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18cdeda2-0ac4-462b-bfe7-b88db5354bac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:20.992891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18cdeda2-0ac4-462b-bfe7-b88db5354bac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:20.993345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18cdeda2-0ac4-462b-bfe7-b88db5354bac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:21.133389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-18cdeda2-0ac4-462b-bfe7-b88db5354bac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:21.141823 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-18cdeda2-0ac4-462b-bfe7-b88db5354bac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1394 microversion: 2.1 time: 0.163594 Aug 03 02:37:21.142400 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3039/6198] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:20 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1394 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:37:22.162623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-22c81ff2-bca4-478f-bff6-5f474393f497 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:22.163350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-22c81ff2-bca4-478f-bff6-5f474393f497 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:22.171037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22c81ff2-bca4-478f-bff6-5f474393f497 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:22.171499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22c81ff2-bca4-478f-bff6-5f474393f497 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:22.172267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22c81ff2-bca4-478f-bff6-5f474393f497 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:22.172704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-22c81ff2-bca4-478f-bff6-5f474393f497 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:22.304333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-22c81ff2-bca4-478f-bff6-5f474393f497 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:22.312113 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-22c81ff2-bca4-478f-bff6-5f474393f497 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1394 microversion: 2.1 time: 0.153747 Aug 03 02:37:22.312679 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3160/6199] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:22 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1394 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:23.212332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-bedf16d4-8e47-4334-b220-b9caaf1ea8f4 req-624f8d15-fe21-436b-89cf-6d89c15fb7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c26376a9-d987-4056-847f-8a90b798edf3", "name": "network-vif-deleted", "tag": "8f77ed59-5384-422e-bb19-587497d7c9ea"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:37:23.225347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bedf16d4-8e47-4334-b220-b9caaf1ea8f4 req-624f8d15-fe21-436b-89cf-6d89c15fb7de service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:23.225808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bedf16d4-8e47-4334-b220-b9caaf1ea8f4 req-624f8d15-fe21-436b-89cf-6d89c15fb7de service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:23.239866 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-bedf16d4-8e47-4334-b220-b9caaf1ea8f4 req-624f8d15-fe21-436b-89cf-6d89c15fb7de service nova] Creating event network-vif-deleted:8f77ed59-5384-422e-bb19-587497d7c9ea for instance c26376a9-d987-4056-847f-8a90b798edf3 on n-h1-826529-8 Aug 03 02:37:23.246847 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-bedf16d4-8e47-4334-b220-b9caaf1ea8f4 req-624f8d15-fe21-436b-89cf-6d89c15fb7de service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038257 Aug 03 02:37:23.247549 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3040/6200] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:37:23.333733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c664ff5d-d909-4c26-873e-1ead857c6491 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:23.335220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c664ff5d-d909-4c26-873e-1ead857c6491 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:23.344182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c664ff5d-d909-4c26-873e-1ead857c6491 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:23.344635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c664ff5d-d909-4c26-873e-1ead857c6491 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:23.345420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c664ff5d-d909-4c26-873e-1ead857c6491 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:23.345857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c664ff5d-d909-4c26-873e-1ead857c6491 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:23.410619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c664ff5d-d909-4c26-873e-1ead857c6491 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:23.418654 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c664ff5d-d909-4c26-873e-1ead857c6491 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1187 microversion: 2.1 time: 0.089319 Aug 03 02:37:23.419266 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3161/6201] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:23 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:24.440893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b5cdd597-1919-4809-bda4-fc6cf2c73c68 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:24.441504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b5cdd597-1919-4809-bda4-fc6cf2c73c68 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:24.449088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5cdd597-1919-4809-bda4-fc6cf2c73c68 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:24.449550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5cdd597-1919-4809-bda4-fc6cf2c73c68 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:24.450344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5cdd597-1919-4809-bda4-fc6cf2c73c68 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:24.451431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5cdd597-1919-4809-bda4-fc6cf2c73c68 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:24.519356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b5cdd597-1919-4809-bda4-fc6cf2c73c68 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:24.527694 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b5cdd597-1919-4809-bda4-fc6cf2c73c68 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1187 microversion: 2.1 time: 0.091138 Aug 03 02:37:24.528264 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3041/6202] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:24 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:37:25.548645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-40cb5733-2d98-455f-a2cd-6aed01a72daa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:25.549297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-40cb5733-2d98-455f-a2cd-6aed01a72daa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:25.556522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40cb5733-2d98-455f-a2cd-6aed01a72daa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:25.557287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40cb5733-2d98-455f-a2cd-6aed01a72daa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:25.558081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40cb5733-2d98-455f-a2cd-6aed01a72daa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:25.558532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-40cb5733-2d98-455f-a2cd-6aed01a72daa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:25.624575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-40cb5733-2d98-455f-a2cd-6aed01a72daa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:25.632532 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-40cb5733-2d98-455f-a2cd-6aed01a72daa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1187 microversion: 2.1 time: 0.088269 Aug 03 02:37:25.633394 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3162/6203] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:25 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:26.654367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-807dc302-3621-4324-96bf-b2d0b20a863f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:26.655088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-807dc302-3621-4324-96bf-b2d0b20a863f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:26.662040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-807dc302-3621-4324-96bf-b2d0b20a863f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:26.662501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-807dc302-3621-4324-96bf-b2d0b20a863f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:26.663514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-807dc302-3621-4324-96bf-b2d0b20a863f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:26.663961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-807dc302-3621-4324-96bf-b2d0b20a863f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:26.730044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-807dc302-3621-4324-96bf-b2d0b20a863f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:26.738131 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-807dc302-3621-4324-96bf-b2d0b20a863f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1187 microversion: 2.1 time: 0.088203 Aug 03 02:37:26.738621 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3042/6204] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:26 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:27.758799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5d1df093-0692-4458-9738-1648815156f1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:27.759586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5d1df093-0692-4458-9738-1648815156f1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:27.767733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d1df093-0692-4458-9738-1648815156f1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:27.768189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d1df093-0692-4458-9738-1648815156f1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:27.768961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d1df093-0692-4458-9738-1648815156f1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:27.769520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d1df093-0692-4458-9738-1648815156f1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:27.803600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d1df093-0692-4458-9738-1648815156f1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:27.804906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d1df093-0692-4458-9738-1648815156f1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:27.804906 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-5d1df093-0692-4458-9738-1648815156f1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lazy-loading 'fault' on Instance uuid c26376a9-d987-4056-847f-8a90b798edf3 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:37:27.848196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5d1df093-0692-4458-9738-1648815156f1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:27.855190 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5d1df093-0692-4458-9738-1648815156f1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 200 len: 1146 microversion: 2.1 time: 0.100815 Aug 03 02:37:27.855764 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3163/6205] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:27 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 1146 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:28.876975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8c5ea1ac-96dd-4094-b902-5cd0209b92af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:28.877604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8c5ea1ac-96dd-4094-b902-5cd0209b92af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: c26376a9-d987-4056-847f-8a90b798edf3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:28.885210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c5ea1ac-96dd-4094-b902-5cd0209b92af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:28.885672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c5ea1ac-96dd-4094-b902-5cd0209b92af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:28.886459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c5ea1ac-96dd-4094-b902-5cd0209b92af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:28.886927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c5ea1ac-96dd-4094-b902-5cd0209b92af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:28.903184 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-8c5ea1ac-96dd-4094-b902-5cd0209b92af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance c26376a9-d987-4056-847f-8a90b798edf3 could not be found. Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8c5ea1ac-96dd-4094-b902-5cd0209b92af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 HTTP/1.1 Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance c26376a9-d987-4056-847f-8a90b798edf3 could not be found. Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'c26376a9-d987-4056-847f-8a90b798edf3'} Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c26376a9-d987-4056-847f-8a90b798edf3 could not be found. Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c26376a9-d987-4056-847f-8a90b798edf3 could not be found. Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:37:28.905033 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:37:28.909989 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:37:28.909989 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:37:28.909989 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:37:28.909989 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:37:28.909989 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:37:28.909989 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c26376a9-d987-4056-847f-8a90b798edf3 could not be found. Aug 03 02:37:28.909989 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:37:28.909989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8c5ea1ac-96dd-4094-b902-5cd0209b92af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance c26376a9-d987-4056-847f-8a90b798edf3 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:37:28.909989 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8c5ea1ac-96dd-4094-b902-5cd0209b92af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3" status: 404 len: 111 microversion: 2.1 time: 0.033963 Aug 03 02:37:28.909989 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3043/6206] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:28 2022] GET /compute/v2.1/servers/c26376a9-d987-4056-847f-8a90b798edf3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:37:33.839256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1164446550", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b37e6bbb-396b-41aa-8682-43332846c06e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5eae0150-a7f5-4e00-b929-5ba4bf7b1156"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:37:33.849634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:37:33.903043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] validate_networks() for [('5eae0150-a7f5-4e00-b929-5ba4bf7b1156', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:37:34.274851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:37:34.275300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:37:34.275783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:37:34.276221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:37:34.276649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:37:34.286701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:34.287185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:34.288088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:34.288530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:34.297070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:37:34.312531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:37:34.317976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for user 1114641f11954d74885d0e4b082d7704 and project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:37:34.375817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:37:34.377841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b37e6bbb-396b-41aa-8682-43332846c06e',volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:37:34.505956 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d1c75ec7-3b80-425f-b51c-80e21e876667 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670634 Aug 03 02:37:34.506631 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3164/6207] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:37:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:37:34.517737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fe99a4a9-4494-46da-9868-e7e1bc750a41 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:34.518360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fe99a4a9-4494-46da-9868-e7e1bc750a41 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:34.521362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:37:34.583085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fe99a4a9-4494-46da-9868-e7e1bc750a41 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:34.590100 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fe99a4a9-4494-46da-9868-e7e1bc750a41 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1057 microversion: 2.1 time: 0.076065 Aug 03 02:37:34.590868 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3044/6208] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:34 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1057 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:35.613026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-91e2b656-1e17-43d1-83bc-a77a8e3adf03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:35.613781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-91e2b656-1e17-43d1-83bc-a77a8e3adf03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:35.620528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91e2b656-1e17-43d1-83bc-a77a8e3adf03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:35.621071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91e2b656-1e17-43d1-83bc-a77a8e3adf03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:35.621927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91e2b656-1e17-43d1-83bc-a77a8e3adf03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:35.622379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91e2b656-1e17-43d1-83bc-a77a8e3adf03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:35.696790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-91e2b656-1e17-43d1-83bc-a77a8e3adf03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:35.705846 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-91e2b656-1e17-43d1-83bc-a77a8e3adf03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1173 microversion: 2.1 time: 0.098432 Aug 03 02:37:35.706485 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3165/6209] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:35 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1173 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:36.728401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a4189862-d91c-49a8-9c8d-5292a83b64b3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:36.729166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a4189862-d91c-49a8-9c8d-5292a83b64b3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:36.738534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4189862-d91c-49a8-9c8d-5292a83b64b3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:36.739190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4189862-d91c-49a8-9c8d-5292a83b64b3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:36.740227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4189862-d91c-49a8-9c8d-5292a83b64b3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:36.740767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a4189862-d91c-49a8-9c8d-5292a83b64b3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:36.744235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=77 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:37:36.770283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-6926e7dd-82b2-4f12-8b72-b30a08437dfb req-5294ba7c-6f82-4878-9162-956bd1c59892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e1f195c-50f4-46ba-8398-605a4eefe746", "tag": "272c7b3a-97f6-470e-9c9c-e3ffb2e87c45"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:37:36.801784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6926e7dd-82b2-4f12-8b72-b30a08437dfb req-5294ba7c-6f82-4878-9162-956bd1c59892 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:36.802731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6926e7dd-82b2-4f12-8b72-b30a08437dfb req-5294ba7c-6f82-4878-9162-956bd1c59892 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:36.818735 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-6926e7dd-82b2-4f12-8b72-b30a08437dfb req-5294ba7c-6f82-4878-9162-956bd1c59892 service nova] Creating event network-changed:272c7b3a-97f6-470e-9c9c-e3ffb2e87c45 for instance 9e1f195c-50f4-46ba-8398-605a4eefe746 on n-h1-826529-8 Aug 03 02:37:36.825068 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-6926e7dd-82b2-4f12-8b72-b30a08437dfb req-5294ba7c-6f82-4878-9162-956bd1c59892 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059769 Aug 03 02:37:36.826385 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3166/6210] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:37:36.899599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a4189862-d91c-49a8-9c8d-5292a83b64b3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:36.909453 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a4189862-d91c-49a8-9c8d-5292a83b64b3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1215 microversion: 2.1 time: 0.185385 Aug 03 02:37:36.910764 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3045/6211] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:36 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:37.931060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e11c6fe4-8559-498a-af7e-c751e4d01040 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:37.931730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e11c6fe4-8559-498a-af7e-c751e4d01040 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:37.939585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e11c6fe4-8559-498a-af7e-c751e4d01040 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:37.940044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e11c6fe4-8559-498a-af7e-c751e4d01040 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:37.940840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e11c6fe4-8559-498a-af7e-c751e4d01040 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:37.941311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e11c6fe4-8559-498a-af7e-c751e4d01040 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:38.080419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e11c6fe4-8559-498a-af7e-c751e4d01040 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:38.088347 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e11c6fe4-8559-498a-af7e-c751e4d01040 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1215 microversion: 2.1 time: 0.161664 Aug 03 02:37:38.088969 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3167/6212] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:37 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:39.109782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9014ee2e-36bd-4d19-b5ae-89ad6c700956 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:39.110456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9014ee2e-36bd-4d19-b5ae-89ad6c700956 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:39.117544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9014ee2e-36bd-4d19-b5ae-89ad6c700956 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:39.118003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9014ee2e-36bd-4d19-b5ae-89ad6c700956 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:39.118799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9014ee2e-36bd-4d19-b5ae-89ad6c700956 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:39.119269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9014ee2e-36bd-4d19-b5ae-89ad6c700956 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:39.253633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9014ee2e-36bd-4d19-b5ae-89ad6c700956 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:39.261702 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9014ee2e-36bd-4d19-b5ae-89ad6c700956 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1215 microversion: 2.1 time: 0.156129 Aug 03 02:37:39.262290 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3046/6213] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:39 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:39.687093 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:37:39.687341 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 02:37:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:37:40.282693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8e6415cd-3210-435c-9af8-ebe0d86ffd5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:40.283328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8e6415cd-3210-435c-9af8-ebe0d86ffd5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:40.291057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e6415cd-3210-435c-9af8-ebe0d86ffd5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:40.291519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e6415cd-3210-435c-9af8-ebe0d86ffd5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:40.292302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e6415cd-3210-435c-9af8-ebe0d86ffd5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:40.292789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e6415cd-3210-435c-9af8-ebe0d86ffd5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:40.440415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8e6415cd-3210-435c-9af8-ebe0d86ffd5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:40.448571 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8e6415cd-3210-435c-9af8-ebe0d86ffd5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1215 microversion: 2.1 time: 0.170556 Aug 03 02:37:40.449193 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3168/6214] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:40 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:41.472174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8f5b5b3b-9682-4d02-95c1-602a3555c177 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:41.472797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8f5b5b3b-9682-4d02-95c1-602a3555c177 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:41.479774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f5b5b3b-9682-4d02-95c1-602a3555c177 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:41.480225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f5b5b3b-9682-4d02-95c1-602a3555c177 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:41.480995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f5b5b3b-9682-4d02-95c1-602a3555c177 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:41.481432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f5b5b3b-9682-4d02-95c1-602a3555c177 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:41.613897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8f5b5b3b-9682-4d02-95c1-602a3555c177 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:41.621567 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8f5b5b3b-9682-4d02-95c1-602a3555c177 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1203 microversion: 2.1 time: 0.153388 Aug 03 02:37:41.622145 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3047/6215] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:41 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:42.643760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2cf07031-33fd-416a-9da1-ab4ae8a3e26e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:42.644374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2cf07031-33fd-416a-9da1-ab4ae8a3e26e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:42.651368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2cf07031-33fd-416a-9da1-ab4ae8a3e26e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:42.651826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2cf07031-33fd-416a-9da1-ab4ae8a3e26e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:42.652621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2cf07031-33fd-416a-9da1-ab4ae8a3e26e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:42.653128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2cf07031-33fd-416a-9da1-ab4ae8a3e26e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:42.789629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2cf07031-33fd-416a-9da1-ab4ae8a3e26e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:42.797471 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2cf07031-33fd-416a-9da1-ab4ae8a3e26e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1203 microversion: 2.1 time: 0.157685 Aug 03 02:37:42.798043 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3169/6216] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:42 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:43.819267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b05db432-9780-4f02-ba37-88735937a2cc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:43.819892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b05db432-9780-4f02-ba37-88735937a2cc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:43.828091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b05db432-9780-4f02-ba37-88735937a2cc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:43.828553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b05db432-9780-4f02-ba37-88735937a2cc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:43.829487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b05db432-9780-4f02-ba37-88735937a2cc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:43.829955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b05db432-9780-4f02-ba37-88735937a2cc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:43.958231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b05db432-9780-4f02-ba37-88735937a2cc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:43.965744 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b05db432-9780-4f02-ba37-88735937a2cc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1203 microversion: 2.1 time: 0.150861 Aug 03 02:37:43.966320 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3048/6217] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:43 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:44.986558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b8fa0d95-4754-408b-b4f6-9e0d47255b1e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:44.987203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b8fa0d95-4754-408b-b4f6-9e0d47255b1e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:44.990069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:37:44.990751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:37:44.996565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8fa0d95-4754-408b-b4f6-9e0d47255b1e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:44.997020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8fa0d95-4754-408b-b4f6-9e0d47255b1e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:44.998023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8fa0d95-4754-408b-b4f6-9e0d47255b1e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:44.998464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8fa0d95-4754-408b-b4f6-9e0d47255b1e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:45.130061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b8fa0d95-4754-408b-b4f6-9e0d47255b1e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:45.138572 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b8fa0d95-4754-408b-b4f6-9e0d47255b1e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1203 microversion: 2.1 time: 0.155756 Aug 03 02:37:45.139453 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3170/6218] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:44 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:46.159947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-975e7856-1859-4a15-b858-7d107a3aed2a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:46.160555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-975e7856-1859-4a15-b858-7d107a3aed2a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:46.162627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:37:46.168288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-975e7856-1859-4a15-b858-7d107a3aed2a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:46.168740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-975e7856-1859-4a15-b858-7d107a3aed2a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:46.169523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-975e7856-1859-4a15-b858-7d107a3aed2a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:46.169947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-975e7856-1859-4a15-b858-7d107a3aed2a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:46.302981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-975e7856-1859-4a15-b858-7d107a3aed2a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:46.310589 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-975e7856-1859-4a15-b858-7d107a3aed2a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1203 microversion: 2.1 time: 0.155200 Aug 03 02:37:46.311193 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3049/6219] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:46 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:47.331948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-872e41f2-4a80-4e72-8222-2b96b6269280 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:47.332613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-872e41f2-4a80-4e72-8222-2b96b6269280 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:47.338888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-872e41f2-4a80-4e72-8222-2b96b6269280 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:47.339374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-872e41f2-4a80-4e72-8222-2b96b6269280 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:47.340150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-872e41f2-4a80-4e72-8222-2b96b6269280 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:47.340597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-872e41f2-4a80-4e72-8222-2b96b6269280 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:47.474131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-872e41f2-4a80-4e72-8222-2b96b6269280 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:47.482566 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-872e41f2-4a80-4e72-8222-2b96b6269280 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1203 microversion: 2.1 time: 0.155337 Aug 03 02:37:47.483183 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3171/6220] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:47 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:48.504153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f0b93c8c-405f-4eba-b90a-3543427d8634 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:48.504704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f0b93c8c-405f-4eba-b90a-3543427d8634 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:48.512002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f0b93c8c-405f-4eba-b90a-3543427d8634 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:48.512482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f0b93c8c-405f-4eba-b90a-3543427d8634 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:48.513248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f0b93c8c-405f-4eba-b90a-3543427d8634 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:48.513696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f0b93c8c-405f-4eba-b90a-3543427d8634 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:48.648785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f0b93c8c-405f-4eba-b90a-3543427d8634 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:48.657059 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f0b93c8c-405f-4eba-b90a-3543427d8634 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1203 microversion: 2.1 time: 0.156951 Aug 03 02:37:48.657628 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3050/6221] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:48 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:49.677452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d9a90364-f2c5-4732-9ab4-f9b2c745c41e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:49.678079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d9a90364-f2c5-4732-9ab4-f9b2c745c41e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:49.685121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9a90364-f2c5-4732-9ab4-f9b2c745c41e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:49.685605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9a90364-f2c5-4732-9ab4-f9b2c745c41e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:49.686887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9a90364-f2c5-4732-9ab4-f9b2c745c41e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:49.687387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d9a90364-f2c5-4732-9ab4-f9b2c745c41e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:49.832068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d9a90364-f2c5-4732-9ab4-f9b2c745c41e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:49.839733 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d9a90364-f2c5-4732-9ab4-f9b2c745c41e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1203 microversion: 2.1 time: 0.166129 Aug 03 02:37:49.840340 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3172/6222] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:49 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:50.861112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7d25cedd-7dae-4140-bc4f-818fe76742ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:50.862142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7d25cedd-7dae-4140-bc4f-818fe76742ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:50.869815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d25cedd-7dae-4140-bc4f-818fe76742ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:50.870311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d25cedd-7dae-4140-bc4f-818fe76742ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:50.871311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d25cedd-7dae-4140-bc4f-818fe76742ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:50.871756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7d25cedd-7dae-4140-bc4f-818fe76742ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:51.212597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7d25cedd-7dae-4140-bc4f-818fe76742ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:51.220971 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7d25cedd-7dae-4140-bc4f-818fe76742ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1203 microversion: 2.1 time: 0.364371 Aug 03 02:37:51.230979 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3051/6223] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:50 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1203 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:51.250082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-9f2d8479-8806-4966-a92e-478bb5064e7f req-93e93bb1-6b1e-4c73-b3f4-6e3487cd1a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1f195c-50f4-46ba-8398-605a4eefe746", "name": "network-vif-plugged", "status": "completed", "tag": "272c7b3a-97f6-470e-9c9c-e3ffb2e87c45"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:37:51.261571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9f2d8479-8806-4966-a92e-478bb5064e7f req-93e93bb1-6b1e-4c73-b3f4-6e3487cd1a5d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:51.262355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9f2d8479-8806-4966-a92e-478bb5064e7f req-93e93bb1-6b1e-4c73-b3f4-6e3487cd1a5d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:51.274805 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-9f2d8479-8806-4966-a92e-478bb5064e7f req-93e93bb1-6b1e-4c73-b3f4-6e3487cd1a5d service nova] Creating event network-vif-plugged:272c7b3a-97f6-470e-9c9c-e3ffb2e87c45 for instance 9e1f195c-50f4-46ba-8398-605a4eefe746 on n-h1-826529-8 Aug 03 02:37:51.279818 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-9f2d8479-8806-4966-a92e-478bb5064e7f req-93e93bb1-6b1e-4c73-b3f4-6e3487cd1a5d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034445 Aug 03 02:37:51.281061 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3173/6224] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:37:52.242491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e1581724-c295-4e11-9e02-b7c273dd1785 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:52.243157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e1581724-c295-4e11-9e02-b7c273dd1785 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:52.250913 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1581724-c295-4e11-9e02-b7c273dd1785 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:52.251379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1581724-c295-4e11-9e02-b7c273dd1785 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:52.252210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1581724-c295-4e11-9e02-b7c273dd1785 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:52.252619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1581724-c295-4e11-9e02-b7c273dd1785 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:52.385471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e1581724-c295-4e11-9e02-b7c273dd1785 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:52.393578 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e1581724-c295-4e11-9e02-b7c273dd1785 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1203 microversion: 2.1 time: 0.154947 Aug 03 02:37:52.394159 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3052/6225] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:52 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:53.416655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fd332192-5b55-48d9-9852-8f0c34144835 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:53.417268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fd332192-5b55-48d9-9852-8f0c34144835 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:53.423809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd332192-5b55-48d9-9852-8f0c34144835 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:53.424259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd332192-5b55-48d9-9852-8f0c34144835 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:53.425030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd332192-5b55-48d9-9852-8f0c34144835 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:53.425471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd332192-5b55-48d9-9852-8f0c34144835 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:53.554332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fd332192-5b55-48d9-9852-8f0c34144835 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:53.562636 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fd332192-5b55-48d9-9852-8f0c34144835 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1390 microversion: 2.1 time: 0.151146 Aug 03 02:37:53.563243 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3174/6226] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:53 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:53.583114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-12ffdd13-dfb5-486d-92aa-2d8c01fd263f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:53.583753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-12ffdd13-dfb5-486d-92aa-2d8c01fd263f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:53.591251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12ffdd13-dfb5-486d-92aa-2d8c01fd263f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:53.591703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12ffdd13-dfb5-486d-92aa-2d8c01fd263f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:53.592494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12ffdd13-dfb5-486d-92aa-2d8c01fd263f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:53.593256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12ffdd13-dfb5-486d-92aa-2d8c01fd263f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:53.727593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-12ffdd13-dfb5-486d-92aa-2d8c01fd263f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:53.737062 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-12ffdd13-dfb5-486d-92aa-2d8c01fd263f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1390 microversion: 2.1 time: 0.157483 Aug 03 02:37:53.737670 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3053/6227] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:53 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:53.759089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2be0558c-12cb-4674-8a78-f5dcebf39898 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:53.759718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2be0558c-12cb-4674-8a78-f5dcebf39898 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:53.765993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2be0558c-12cb-4674-8a78-f5dcebf39898 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:53.766453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2be0558c-12cb-4674-8a78-f5dcebf39898 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:53.767266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2be0558c-12cb-4674-8a78-f5dcebf39898 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:53.767715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2be0558c-12cb-4674-8a78-f5dcebf39898 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:53.896567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2be0558c-12cb-4674-8a78-f5dcebf39898 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:53.904181 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2be0558c-12cb-4674-8a78-f5dcebf39898 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1390 microversion: 2.1 time: 0.149287 Aug 03 02:37:53.904762 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3175/6228] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:53 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1390 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:53.925165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69b92379-818d-48c2-ac64-027ab039f074 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:53.925631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-69b92379-818d-48c2-ac64-027ab039f074 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:53.931853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69b92379-818d-48c2-ac64-027ab039f074 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:53.932316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69b92379-818d-48c2-ac64-027ab039f074 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:53.933094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69b92379-818d-48c2-ac64-027ab039f074 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:53.933541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69b92379-818d-48c2-ac64-027ab039f074 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:53.958367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-69b92379-818d-48c2-ac64-027ab039f074 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:37:54.035348 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-69b92379-818d-48c2-ac64-027ab039f074 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 204 len: 0 microversion: 2.1 time: 0.114400 Aug 03 02:37:54.036046 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3054/6229] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:37:53 2022] DELETE /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:37:54.044547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b2e547e0-592c-4be8-8abb-c3ed18957ac4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:54.045157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b2e547e0-592c-4be8-8abb-c3ed18957ac4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:54.051384 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2e547e0-592c-4be8-8abb-c3ed18957ac4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:54.051836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2e547e0-592c-4be8-8abb-c3ed18957ac4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:54.052604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2e547e0-592c-4be8-8abb-c3ed18957ac4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:54.053040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b2e547e0-592c-4be8-8abb-c3ed18957ac4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:54.189786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b2e547e0-592c-4be8-8abb-c3ed18957ac4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:54.199854 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b2e547e0-592c-4be8-8abb-c3ed18957ac4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1396 microversion: 2.1 time: 0.159174 Aug 03 02:37:54.200487 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3176/6230] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:54 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1396 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:55.222513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69904d77-2573-47ac-9cc9-06972d56e230 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:55.223247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-69904d77-2573-47ac-9cc9-06972d56e230 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:55.230816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69904d77-2573-47ac-9cc9-06972d56e230 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:55.231292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69904d77-2573-47ac-9cc9-06972d56e230 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:55.232066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69904d77-2573-47ac-9cc9-06972d56e230 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:55.232501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69904d77-2573-47ac-9cc9-06972d56e230 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:55.364396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-69904d77-2573-47ac-9cc9-06972d56e230 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:55.372133 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-69904d77-2573-47ac-9cc9-06972d56e230 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1396 microversion: 2.1 time: 0.154095 Aug 03 02:37:55.372721 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3055/6231] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:55 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1396 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:56.052996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-e36f4c03-4431-4f7c-9f38-dae4d80afc2d req-cbd92531-0c21-4ca2-a829-7261b2e0f671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1f195c-50f4-46ba-8398-605a4eefe746", "name": "network-vif-deleted", "tag": "272c7b3a-97f6-470e-9c9c-e3ffb2e87c45"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:37:56.073137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e36f4c03-4431-4f7c-9f38-dae4d80afc2d req-cbd92531-0c21-4ca2-a829-7261b2e0f671 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:56.073575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e36f4c03-4431-4f7c-9f38-dae4d80afc2d req-cbd92531-0c21-4ca2-a829-7261b2e0f671 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:56.087782 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-e36f4c03-4431-4f7c-9f38-dae4d80afc2d req-cbd92531-0c21-4ca2-a829-7261b2e0f671 service nova] Creating event network-vif-deleted:272c7b3a-97f6-470e-9c9c-e3ffb2e87c45 for instance 9e1f195c-50f4-46ba-8398-605a4eefe746 on n-h1-826529-8 Aug 03 02:37:56.093850 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-e36f4c03-4431-4f7c-9f38-dae4d80afc2d req-cbd92531-0c21-4ca2-a829-7261b2e0f671 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043875 Aug 03 02:37:56.094712 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3177/6232] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:37:56.394693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5d0d5fa3-edda-4219-97ad-24b9a5ec25ca tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:56.395354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5d0d5fa3-edda-4219-97ad-24b9a5ec25ca tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:56.402564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d0d5fa3-edda-4219-97ad-24b9a5ec25ca tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:56.403083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d0d5fa3-edda-4219-97ad-24b9a5ec25ca tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:56.403866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d0d5fa3-edda-4219-97ad-24b9a5ec25ca tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:56.404314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5d0d5fa3-edda-4219-97ad-24b9a5ec25ca tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:56.466796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5d0d5fa3-edda-4219-97ad-24b9a5ec25ca tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:56.474522 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5d0d5fa3-edda-4219-97ad-24b9a5ec25ca tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1188 microversion: 2.1 time: 0.084651 Aug 03 02:37:56.475127 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3056/6233] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:56 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:57.495665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8e5165eb-32c5-4e84-94d5-f5cddf2c1db0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:57.496468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8e5165eb-32c5-4e84-94d5-f5cddf2c1db0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:57.509070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e5165eb-32c5-4e84-94d5-f5cddf2c1db0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:57.509526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e5165eb-32c5-4e84-94d5-f5cddf2c1db0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:57.510326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e5165eb-32c5-4e84-94d5-f5cddf2c1db0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:57.510753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e5165eb-32c5-4e84-94d5-f5cddf2c1db0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:57.574476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8e5165eb-32c5-4e84-94d5-f5cddf2c1db0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:57.583110 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8e5165eb-32c5-4e84-94d5-f5cddf2c1db0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1188 microversion: 2.1 time: 0.091602 Aug 03 02:37:57.583690 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3178/6234] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:57 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:58.604641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f867d3b3-0443-4f10-a48c-a90fe8b4cabd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:58.605266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f867d3b3-0443-4f10-a48c-a90fe8b4cabd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:58.612694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f867d3b3-0443-4f10-a48c-a90fe8b4cabd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:58.613145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f867d3b3-0443-4f10-a48c-a90fe8b4cabd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:58.613934 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f867d3b3-0443-4f10-a48c-a90fe8b4cabd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:58.614384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f867d3b3-0443-4f10-a48c-a90fe8b4cabd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:58.686600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f867d3b3-0443-4f10-a48c-a90fe8b4cabd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:58.694640 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f867d3b3-0443-4f10-a48c-a90fe8b4cabd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1188 microversion: 2.1 time: 0.093926 Aug 03 02:37:58.695278 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3057/6235] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:58 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:37:59.715812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-644a6329-3b5c-41ae-97d0-3c831d29cc53 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:37:59.716405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-644a6329-3b5c-41ae-97d0-3c831d29cc53 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:37:59.724336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-644a6329-3b5c-41ae-97d0-3c831d29cc53 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:59.725173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-644a6329-3b5c-41ae-97d0-3c831d29cc53 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:59.725966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-644a6329-3b5c-41ae-97d0-3c831d29cc53 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:37:59.726398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-644a6329-3b5c-41ae-97d0-3c831d29cc53 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:37:59.793963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-644a6329-3b5c-41ae-97d0-3c831d29cc53 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:37:59.803866 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-644a6329-3b5c-41ae-97d0-3c831d29cc53 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 200 len: 1188 microversion: 2.1 time: 0.091880 Aug 03 02:37:59.804321 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3179/6236] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:37:59 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:00.824660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-51b402ba-00db-4f9b-be59-471afee73114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:00.825505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-51b402ba-00db-4f9b-be59-471afee73114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 9e1f195c-50f4-46ba-8398-605a4eefe746] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:00.833273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51b402ba-00db-4f9b-be59-471afee73114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:00.833724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51b402ba-00db-4f9b-be59-471afee73114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:00.834502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51b402ba-00db-4f9b-be59-471afee73114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:00.835071 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-51b402ba-00db-4f9b-be59-471afee73114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:00.848864 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-51b402ba-00db-4f9b-be59-471afee73114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance 9e1f195c-50f4-46ba-8398-605a4eefe746 could not be found. Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-51b402ba-00db-4f9b-be59-471afee73114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 HTTP/1.1 Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 9e1f195c-50f4-46ba-8398-605a4eefe746 could not be found. Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '9e1f195c-50f4-46ba-8398-605a4eefe746'} Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e1f195c-50f4-46ba-8398-605a4eefe746 could not be found. Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e1f195c-50f4-46ba-8398-605a4eefe746 could not be found. Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:38:00.850526 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:38:00.855174 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:38:00.855174 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:38:00.855174 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:38:00.855174 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:38:00.855174 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:38:00.855174 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e1f195c-50f4-46ba-8398-605a4eefe746 could not be found. Aug 03 02:38:00.855174 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:38:00.855174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-51b402ba-00db-4f9b-be59-471afee73114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance 9e1f195c-50f4-46ba-8398-605a4eefe746 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:38:00.855174 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-51b402ba-00db-4f9b-be59-471afee73114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746" status: 404 len: 111 microversion: 2.1 time: 0.031520 Aug 03 02:38:00.855174 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3058/6237] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:00 2022] GET /compute/v2.1/servers/9e1f195c-50f4-46ba-8398-605a4eefe746 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:38:21.874182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1032329897", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "97b491e6-d423-4075-929e-bc19aa6acee0", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "5eae0150-a7f5-4e00-b929-5ba4bf7b1156"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:38:21.884106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:38:21.884765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=79 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:38:22.026968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] validate_networks() for [('5eae0150-a7f5-4e00-b929-5ba4bf7b1156', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:38:22.416322 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:38:22.416754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:38:22.417235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:38:22.417658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:38:22.418071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:38:22.427688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:22.428143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:22.428979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:22.429420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:22.447959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:38:22.453806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for user 1114641f11954d74885d0e4b082d7704 and project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:38:22.466787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:38:22.468845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='97b491e6-d423-4075-929e-bc19aa6acee0',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:38:22.553585 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8f2818a4-1e32-4e87-8d59-c1ffe74e3ef3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683460 Aug 03 02:38:22.554260 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3180/6238] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:38:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:38:22.569103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-07bd18a5-3652-48af-9d48-8ddb7aadeb6f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:22.570643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-07bd18a5-3652-48af-9d48-8ddb7aadeb6f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:22.573142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:38:22.573794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:38:22.631538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-07bd18a5-3652-48af-9d48-8ddb7aadeb6f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:22.638557 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-07bd18a5-3652-48af-9d48-8ddb7aadeb6f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1057 microversion: 2.1 time: 0.075879 Aug 03 02:38:22.639157 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3059/6239] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:22 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1057 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:23.661167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2236f574-6360-427c-85b0-79b8b7f58cb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:23.661805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2236f574-6360-427c-85b0-79b8b7f58cb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:23.668427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2236f574-6360-427c-85b0-79b8b7f58cb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:23.669136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2236f574-6360-427c-85b0-79b8b7f58cb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:23.670100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2236f574-6360-427c-85b0-79b8b7f58cb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:23.670559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2236f574-6360-427c-85b0-79b8b7f58cb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:23.750345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2236f574-6360-427c-85b0-79b8b7f58cb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:23.758964 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2236f574-6360-427c-85b0-79b8b7f58cb5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1127 microversion: 2.1 time: 0.103278 Aug 03 02:38:23.759700 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3181/6240] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:23 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1127 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:24.781571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f50115ff-c1c0-400c-90fb-aba29c9fb642 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:24.783261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f50115ff-c1c0-400c-90fb-aba29c9fb642 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:24.790808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f50115ff-c1c0-400c-90fb-aba29c9fb642 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:24.791198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f50115ff-c1c0-400c-90fb-aba29c9fb642 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:24.791839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f50115ff-c1c0-400c-90fb-aba29c9fb642 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:24.792507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f50115ff-c1c0-400c-90fb-aba29c9fb642 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:24.969268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-5b191d7e-3f46-43b9-b5fd-8e0819240566 req-50ec15b3-6907-4f6b-a63a-c0a57dc569d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5869fd04-8539-4b80-9c87-9587046df554", "tag": "c43621ad-dcee-427c-a2a5-c1833ea581a4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:38:24.976180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f50115ff-c1c0-400c-90fb-aba29c9fb642 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:24.985406 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f50115ff-c1c0-400c-90fb-aba29c9fb642 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1169 microversion: 2.1 time: 0.207528 Aug 03 02:38:24.986315 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3060/6241] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:24 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1169 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:24.991172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5b191d7e-3f46-43b9-b5fd-8e0819240566 req-50ec15b3-6907-4f6b-a63a-c0a57dc569d6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:24.992382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5b191d7e-3f46-43b9-b5fd-8e0819240566 req-50ec15b3-6907-4f6b-a63a-c0a57dc569d6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:25.019686 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-5b191d7e-3f46-43b9-b5fd-8e0819240566 req-50ec15b3-6907-4f6b-a63a-c0a57dc569d6 service nova] Creating event network-changed:c43621ad-dcee-427c-a2a5-c1833ea581a4 for instance 5869fd04-8539-4b80-9c87-9587046df554 on n-h1-826529-8 Aug 03 02:38:25.026576 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-5b191d7e-3f46-43b9-b5fd-8e0819240566 req-50ec15b3-6907-4f6b-a63a-c0a57dc569d6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061171 Aug 03 02:38:25.027552 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3182/6242] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:38:26.019293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-333c574c-1632-4915-a2cd-6c2b703e18bb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:26.020022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-333c574c-1632-4915-a2cd-6c2b703e18bb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:26.027621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-333c574c-1632-4915-a2cd-6c2b703e18bb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:26.028367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-333c574c-1632-4915-a2cd-6c2b703e18bb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:26.029210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-333c574c-1632-4915-a2cd-6c2b703e18bb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:26.029665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-333c574c-1632-4915-a2cd-6c2b703e18bb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:26.173244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-333c574c-1632-4915-a2cd-6c2b703e18bb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:26.185618 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-333c574c-1632-4915-a2cd-6c2b703e18bb tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1169 microversion: 2.1 time: 0.170302 Aug 03 02:38:26.186228 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3061/6243] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:26 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:27.208606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bdfc5ffe-9681-49cc-9bbf-9488823a17f5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:27.209649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bdfc5ffe-9681-49cc-9bbf-9488823a17f5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:27.216096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdfc5ffe-9681-49cc-9bbf-9488823a17f5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:27.216548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdfc5ffe-9681-49cc-9bbf-9488823a17f5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:27.217315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdfc5ffe-9681-49cc-9bbf-9488823a17f5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:27.217753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdfc5ffe-9681-49cc-9bbf-9488823a17f5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:27.392602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bdfc5ffe-9681-49cc-9bbf-9488823a17f5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:27.405343 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bdfc5ffe-9681-49cc-9bbf-9488823a17f5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1169 microversion: 2.1 time: 0.202549 Aug 03 02:38:27.407441 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3183/6244] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:27 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1169 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:28.430085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bfdbd492-9f08-493d-a418-a6a197c4f267 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:28.430717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bfdbd492-9f08-493d-a418-a6a197c4f267 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:28.440357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfdbd492-9f08-493d-a418-a6a197c4f267 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:28.441152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfdbd492-9f08-493d-a418-a6a197c4f267 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:28.442169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfdbd492-9f08-493d-a418-a6a197c4f267 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:28.442936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfdbd492-9f08-493d-a418-a6a197c4f267 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:28.634039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bfdbd492-9f08-493d-a418-a6a197c4f267 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:28.651640 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bfdbd492-9f08-493d-a418-a6a197c4f267 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1169 microversion: 2.1 time: 0.225693 Aug 03 02:38:28.652564 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3062/6245] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:28 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1169 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:29.674817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eeb60583-5a02-4b0e-ae90-0c5fadc34b19 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:29.676710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eeb60583-5a02-4b0e-ae90-0c5fadc34b19 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:29.685367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeb60583-5a02-4b0e-ae90-0c5fadc34b19 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:29.685856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeb60583-5a02-4b0e-ae90-0c5fadc34b19 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:29.686633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeb60583-5a02-4b0e-ae90-0c5fadc34b19 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:29.687098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eeb60583-5a02-4b0e-ae90-0c5fadc34b19 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:29.845859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-eeb60583-5a02-4b0e-ae90-0c5fadc34b19 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:29.854031 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eeb60583-5a02-4b0e-ae90-0c5fadc34b19 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1169 microversion: 2.1 time: 0.183725 Aug 03 02:38:29.855304 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3184/6246] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:29 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1169 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:30.877340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d871b2bc-f330-499e-8ad7-910fe0b3aa67 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:30.878343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d871b2bc-f330-499e-8ad7-910fe0b3aa67 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:30.885281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d871b2bc-f330-499e-8ad7-910fe0b3aa67 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:30.885969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d871b2bc-f330-499e-8ad7-910fe0b3aa67 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:30.887015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d871b2bc-f330-499e-8ad7-910fe0b3aa67 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:30.887527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d871b2bc-f330-499e-8ad7-910fe0b3aa67 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:31.029182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d871b2bc-f330-499e-8ad7-910fe0b3aa67 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:31.037908 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d871b2bc-f330-499e-8ad7-910fe0b3aa67 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1169 microversion: 2.1 time: 0.166098 Aug 03 02:38:31.043370 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3063/6247] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:30 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:32.059309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5751017a-e075-4bf2-9554-80c0140008f9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:32.059932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5751017a-e075-4bf2-9554-80c0140008f9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:32.069097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5751017a-e075-4bf2-9554-80c0140008f9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:32.069564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5751017a-e075-4bf2-9554-80c0140008f9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:32.070366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5751017a-e075-4bf2-9554-80c0140008f9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:32.071088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5751017a-e075-4bf2-9554-80c0140008f9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:32.203548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5751017a-e075-4bf2-9554-80c0140008f9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:32.211317 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5751017a-e075-4bf2-9554-80c0140008f9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1169 microversion: 2.1 time: 0.156646 Aug 03 02:38:32.211835 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3185/6248] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:32 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1169 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:33.235668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a118b4ce-c830-40f7-955b-6fa79500d72b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:33.236275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a118b4ce-c830-40f7-955b-6fa79500d72b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:33.239098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:38:33.245559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a118b4ce-c830-40f7-955b-6fa79500d72b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:33.246009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a118b4ce-c830-40f7-955b-6fa79500d72b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:33.246794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a118b4ce-c830-40f7-955b-6fa79500d72b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:33.247262 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a118b4ce-c830-40f7-955b-6fa79500d72b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:33.423330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a118b4ce-c830-40f7-955b-6fa79500d72b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:33.437596 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a118b4ce-c830-40f7-955b-6fa79500d72b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1169 microversion: 2.1 time: 0.207732 Aug 03 02:38:33.446425 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3064/6249] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:33 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1169 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:38:34.461541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7b1f59bc-82d8-4385-90b8-4fef3a0ce2f4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:34.462090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7b1f59bc-82d8-4385-90b8-4fef3a0ce2f4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:34.463942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:38:34.464601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:38:34.472479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b1f59bc-82d8-4385-90b8-4fef3a0ce2f4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:34.472933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b1f59bc-82d8-4385-90b8-4fef3a0ce2f4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:34.473704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b1f59bc-82d8-4385-90b8-4fef3a0ce2f4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:34.474143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b1f59bc-82d8-4385-90b8-4fef3a0ce2f4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:34.613912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7b1f59bc-82d8-4385-90b8-4fef3a0ce2f4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:34.622132 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7b1f59bc-82d8-4385-90b8-4fef3a0ce2f4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1169 microversion: 2.1 time: 0.164946 Aug 03 02:38:34.622725 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3186/6250] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:34 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:35.643600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a5784ff1-c129-42f0-9ac1-4ef7bf33f108 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:35.644385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a5784ff1-c129-42f0-9ac1-4ef7bf33f108 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:35.651659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5784ff1-c129-42f0-9ac1-4ef7bf33f108 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:35.652141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5784ff1-c129-42f0-9ac1-4ef7bf33f108 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:35.652929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5784ff1-c129-42f0-9ac1-4ef7bf33f108 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:35.653382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5784ff1-c129-42f0-9ac1-4ef7bf33f108 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:35.817660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a5784ff1-c129-42f0-9ac1-4ef7bf33f108 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:35.825817 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a5784ff1-c129-42f0-9ac1-4ef7bf33f108 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1169 microversion: 2.1 time: 0.186686 Aug 03 02:38:35.826429 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3065/6251] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:35 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1169 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:36.848582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-189cb6c3-db61-4f7f-9dba-782dccf2a619 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:36.849195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-189cb6c3-db61-4f7f-9dba-782dccf2a619 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:36.856398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-189cb6c3-db61-4f7f-9dba-782dccf2a619 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:36.856899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-189cb6c3-db61-4f7f-9dba-782dccf2a619 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:36.857628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-189cb6c3-db61-4f7f-9dba-782dccf2a619 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:36.858067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-189cb6c3-db61-4f7f-9dba-782dccf2a619 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:36.997165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-189cb6c3-db61-4f7f-9dba-782dccf2a619 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:37.005199 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-189cb6c3-db61-4f7f-9dba-782dccf2a619 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1169 microversion: 2.1 time: 0.160995 Aug 03 02:38:37.005813 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3187/6252] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:36 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:38.025794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5520daef-4fea-40b7-a7f0-898179b4f971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:38.026396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5520daef-4fea-40b7-a7f0-898179b4f971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:38.034757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5520daef-4fea-40b7-a7f0-898179b4f971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:38.035423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5520daef-4fea-40b7-a7f0-898179b4f971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:38.036396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5520daef-4fea-40b7-a7f0-898179b4f971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:38.036843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5520daef-4fea-40b7-a7f0-898179b4f971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:38.188909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5520daef-4fea-40b7-a7f0-898179b4f971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:38.203649 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5520daef-4fea-40b7-a7f0-898179b4f971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1169 microversion: 2.1 time: 0.180821 Aug 03 02:38:38.204864 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3066/6253] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:38 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1169 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:39.224528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ead55883-d4ac-451e-81b9-7afcb2f260a6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:39.225263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ead55883-d4ac-451e-81b9-7afcb2f260a6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:39.232847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ead55883-d4ac-451e-81b9-7afcb2f260a6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:39.233295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ead55883-d4ac-451e-81b9-7afcb2f260a6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:39.234081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ead55883-d4ac-451e-81b9-7afcb2f260a6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:39.234827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ead55883-d4ac-451e-81b9-7afcb2f260a6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:39.374446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ead55883-d4ac-451e-81b9-7afcb2f260a6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:39.382623 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ead55883-d4ac-451e-81b9-7afcb2f260a6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1203 microversion: 2.1 time: 0.162081 Aug 03 02:38:39.383273 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3188/6254] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:39 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:40.403695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2a2ee006-2c39-43a3-bf7c-553111633f30 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:40.404314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2a2ee006-2c39-43a3-bf7c-553111633f30 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:40.411770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a2ee006-2c39-43a3-bf7c-553111633f30 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:40.412486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a2ee006-2c39-43a3-bf7c-553111633f30 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:40.412995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a2ee006-2c39-43a3-bf7c-553111633f30 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:40.413490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a2ee006-2c39-43a3-bf7c-553111633f30 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:40.545519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2a2ee006-2c39-43a3-bf7c-553111633f30 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:40.553329 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2a2ee006-2c39-43a3-bf7c-553111633f30 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1203 microversion: 2.1 time: 0.153515 Aug 03 02:38:40.554228 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3067/6255] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:40 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:41.574925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7c04c0b3-2fdc-4e8c-9196-af14f511f811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:41.575624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7c04c0b3-2fdc-4e8c-9196-af14f511f811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:41.584101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c04c0b3-2fdc-4e8c-9196-af14f511f811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:41.584570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c04c0b3-2fdc-4e8c-9196-af14f511f811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:41.585344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c04c0b3-2fdc-4e8c-9196-af14f511f811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:41.585862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c04c0b3-2fdc-4e8c-9196-af14f511f811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:41.730494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7c04c0b3-2fdc-4e8c-9196-af14f511f811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:41.739167 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7c04c0b3-2fdc-4e8c-9196-af14f511f811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1203 microversion: 2.1 time: 0.169057 Aug 03 02:38:41.739758 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3189/6256] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:41 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:42.761407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7fb97b55-e9c8-4ef4-8b1c-3412788fbc55 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:42.762030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7fb97b55-e9c8-4ef4-8b1c-3412788fbc55 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:42.770258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fb97b55-e9c8-4ef4-8b1c-3412788fbc55 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:42.770747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fb97b55-e9c8-4ef4-8b1c-3412788fbc55 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:42.771669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fb97b55-e9c8-4ef4-8b1c-3412788fbc55 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:42.772116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fb97b55-e9c8-4ef4-8b1c-3412788fbc55 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:42.904335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7fb97b55-e9c8-4ef4-8b1c-3412788fbc55 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:42.914007 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7fb97b55-e9c8-4ef4-8b1c-3412788fbc55 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1203 microversion: 2.1 time: 0.156770 Aug 03 02:38:42.914590 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3068/6257] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:42 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:43.935404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-35635af4-f687-4dd8-a4b6-869b3b0b9c65 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:43.936036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-35635af4-f687-4dd8-a4b6-869b3b0b9c65 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:43.943793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35635af4-f687-4dd8-a4b6-869b3b0b9c65 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:43.944248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35635af4-f687-4dd8-a4b6-869b3b0b9c65 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:43.945020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35635af4-f687-4dd8-a4b6-869b3b0b9c65 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:43.945454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35635af4-f687-4dd8-a4b6-869b3b0b9c65 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:44.101700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-35635af4-f687-4dd8-a4b6-869b3b0b9c65 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:44.110417 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-35635af4-f687-4dd8-a4b6-869b3b0b9c65 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1203 microversion: 2.1 time: 0.178904 Aug 03 02:38:44.111074 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3190/6258] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:43 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1203 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:45.134084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f52f0ea0-3005-4c4e-b03e-3ca470e52f02 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:45.134738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f52f0ea0-3005-4c4e-b03e-3ca470e52f02 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:45.141885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f52f0ea0-3005-4c4e-b03e-3ca470e52f02 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:45.142332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f52f0ea0-3005-4c4e-b03e-3ca470e52f02 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:45.143140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f52f0ea0-3005-4c4e-b03e-3ca470e52f02 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:45.143583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f52f0ea0-3005-4c4e-b03e-3ca470e52f02 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:45.278330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f52f0ea0-3005-4c4e-b03e-3ca470e52f02 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:45.286811 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f52f0ea0-3005-4c4e-b03e-3ca470e52f02 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1203 microversion: 2.1 time: 0.157107 Aug 03 02:38:45.287511 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3069/6259] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:45 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:46.313182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f11e64d5-46f8-44ba-9651-91a21081118d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:46.314484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f11e64d5-46f8-44ba-9651-91a21081118d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:46.322594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f11e64d5-46f8-44ba-9651-91a21081118d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:46.323156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f11e64d5-46f8-44ba-9651-91a21081118d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:46.323954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f11e64d5-46f8-44ba-9651-91a21081118d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:46.324402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f11e64d5-46f8-44ba-9651-91a21081118d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:46.486442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f11e64d5-46f8-44ba-9651-91a21081118d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:46.494294 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f11e64d5-46f8-44ba-9651-91a21081118d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1203 microversion: 2.1 time: 0.189445 Aug 03 02:38:46.494851 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3191/6260] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:46 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1203 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:47.453600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-781ad882-b86b-4fca-be02-7b6596c7e923 req-e20aaa3c-9643-44ff-8f47-31a4dbf9e1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5869fd04-8539-4b80-9c87-9587046df554", "name": "network-vif-plugged", "status": "completed", "tag": "c43621ad-dcee-427c-a2a5-c1833ea581a4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:38:47.465619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-781ad882-b86b-4fca-be02-7b6596c7e923 req-e20aaa3c-9643-44ff-8f47-31a4dbf9e1b9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:47.466078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-781ad882-b86b-4fca-be02-7b6596c7e923 req-e20aaa3c-9643-44ff-8f47-31a4dbf9e1b9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:47.478448 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-781ad882-b86b-4fca-be02-7b6596c7e923 req-e20aaa3c-9643-44ff-8f47-31a4dbf9e1b9 service nova] Creating event network-vif-plugged:c43621ad-dcee-427c-a2a5-c1833ea581a4 for instance 5869fd04-8539-4b80-9c87-9587046df554 on n-h1-826529-8 Aug 03 02:38:47.483581 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-781ad882-b86b-4fca-be02-7b6596c7e923 req-e20aaa3c-9643-44ff-8f47-31a4dbf9e1b9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034674 Aug 03 02:38:47.484484 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3070/6261] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:38:47.517670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-46f9667f-c094-4de3-9d89-9d3759803662 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:47.518301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-46f9667f-c094-4de3-9d89-9d3759803662 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:47.527135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46f9667f-c094-4de3-9d89-9d3759803662 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:47.527746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46f9667f-c094-4de3-9d89-9d3759803662 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:47.528555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46f9667f-c094-4de3-9d89-9d3759803662 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:47.529000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46f9667f-c094-4de3-9d89-9d3759803662 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:47.675667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-46f9667f-c094-4de3-9d89-9d3759803662 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:47.683448 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-46f9667f-c094-4de3-9d89-9d3759803662 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1203 microversion: 2.1 time: 0.171836 Aug 03 02:38:47.684031 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3192/6262] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:47 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1203 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:48.710456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ee90355-c868-47e1-b39c-910536d5c1b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:48.713749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2ee90355-c868-47e1-b39c-910536d5c1b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:48.721781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ee90355-c868-47e1-b39c-910536d5c1b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:48.722256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ee90355-c868-47e1-b39c-910536d5c1b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:48.723179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ee90355-c868-47e1-b39c-910536d5c1b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:48.723639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ee90355-c868-47e1-b39c-910536d5c1b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:48.971694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2ee90355-c868-47e1-b39c-910536d5c1b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:48.981177 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2ee90355-c868-47e1-b39c-910536d5c1b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1389 microversion: 2.1 time: 0.278773 Aug 03 02:38:48.982368 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3071/6263] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:48 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1389 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:49.003234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-10485e3a-266c-446b-8479-8609fb794d3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:49.003954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-10485e3a-266c-446b-8479-8609fb794d3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:49.013978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10485e3a-266c-446b-8479-8609fb794d3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:49.014657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10485e3a-266c-446b-8479-8609fb794d3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:49.015784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10485e3a-266c-446b-8479-8609fb794d3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:49.016320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10485e3a-266c-446b-8479-8609fb794d3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:49.167127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-10485e3a-266c-446b-8479-8609fb794d3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:49.175497 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-10485e3a-266c-446b-8479-8609fb794d3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1389 microversion: 2.1 time: 0.177406 Aug 03 02:38:49.176090 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3193/6264] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:48 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1389 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:49.197144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d14348a4-3477-40a7-b404-b394d232bfa2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:49.197758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d14348a4-3477-40a7-b404-b394d232bfa2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:49.206525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d14348a4-3477-40a7-b404-b394d232bfa2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:49.207278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d14348a4-3477-40a7-b404-b394d232bfa2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:49.208292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d14348a4-3477-40a7-b404-b394d232bfa2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:49.208748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d14348a4-3477-40a7-b404-b394d232bfa2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:49.355244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d14348a4-3477-40a7-b404-b394d232bfa2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:49.364109 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d14348a4-3477-40a7-b404-b394d232bfa2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1389 microversion: 2.1 time: 0.170878 Aug 03 02:38:49.365031 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3072/6265] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:49 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1389 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:49.443225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5e5758b1-b24d-421f-89ca-5764f807e7dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:49.443690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5e5758b1-b24d-421f-89ca-5764f807e7dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:49.450668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e5758b1-b24d-421f-89ca-5764f807e7dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:49.451160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e5758b1-b24d-421f-89ca-5764f807e7dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:49.451948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e5758b1-b24d-421f-89ca-5764f807e7dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:49.452393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e5758b1-b24d-421f-89ca-5764f807e7dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:49.479206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5e5758b1-b24d-421f-89ca-5764f807e7dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:38:49.563571 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5e5758b1-b24d-421f-89ca-5764f807e7dc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 204 len: 0 microversion: 2.1 time: 0.122602 Aug 03 02:38:49.564538 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3194/6266] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:38:49 2022] DELETE /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:38:49.574563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e427e0dc-3adb-4011-ae11-90271c323bba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:49.575226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e427e0dc-3adb-4011-ae11-90271c323bba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:49.582310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e427e0dc-3adb-4011-ae11-90271c323bba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:49.582756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e427e0dc-3adb-4011-ae11-90271c323bba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:49.583595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e427e0dc-3adb-4011-ae11-90271c323bba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:49.584034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e427e0dc-3adb-4011-ae11-90271c323bba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:49.736167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e427e0dc-3adb-4011-ae11-90271c323bba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:49.744621 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e427e0dc-3adb-4011-ae11-90271c323bba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1395 microversion: 2.1 time: 0.173831 Aug 03 02:38:49.745446 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3073/6267] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:49 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1395 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:50.766697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-52493a63-b0a0-4f24-8861-885597372d06 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:50.767442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-52493a63-b0a0-4f24-8861-885597372d06 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:50.774406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52493a63-b0a0-4f24-8861-885597372d06 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:50.774865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52493a63-b0a0-4f24-8861-885597372d06 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:50.775675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52493a63-b0a0-4f24-8861-885597372d06 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:50.776121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52493a63-b0a0-4f24-8861-885597372d06 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:50.914009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-52493a63-b0a0-4f24-8861-885597372d06 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:50.921783 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-52493a63-b0a0-4f24-8861-885597372d06 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1395 microversion: 2.1 time: 0.159531 Aug 03 02:38:50.935098 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3195/6268] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:50 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1395 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:51.572856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-098cff62-ee64-4562-ab2f-1a7f85e9249a req-e37934c5-0831-4b64-881b-b4f3f8f2f624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5869fd04-8539-4b80-9c87-9587046df554", "name": "network-vif-deleted", "tag": "c43621ad-dcee-427c-a2a5-c1833ea581a4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:38:51.585739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-098cff62-ee64-4562-ab2f-1a7f85e9249a req-e37934c5-0831-4b64-881b-b4f3f8f2f624 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:51.586591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-098cff62-ee64-4562-ab2f-1a7f85e9249a req-e37934c5-0831-4b64-881b-b4f3f8f2f624 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:51.599426 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-098cff62-ee64-4562-ab2f-1a7f85e9249a req-e37934c5-0831-4b64-881b-b4f3f8f2f624 service nova] Creating event network-vif-deleted:c43621ad-dcee-427c-a2a5-c1833ea581a4 for instance 5869fd04-8539-4b80-9c87-9587046df554 on n-h1-826529-8 Aug 03 02:38:51.604954 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-098cff62-ee64-4562-ab2f-1a7f85e9249a req-e37934c5-0831-4b64-881b-b4f3f8f2f624 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036610 Aug 03 02:38:51.605878 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3074/6269] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:38:51.943558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2556df67-79df-470a-8c56-98dbd7f686d7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:51.944116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2556df67-79df-470a-8c56-98dbd7f686d7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:51.947097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:38:51.953600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2556df67-79df-470a-8c56-98dbd7f686d7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:51.954132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2556df67-79df-470a-8c56-98dbd7f686d7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:51.955018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2556df67-79df-470a-8c56-98dbd7f686d7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:51.955528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2556df67-79df-470a-8c56-98dbd7f686d7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:51.959316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:38:52.036154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2556df67-79df-470a-8c56-98dbd7f686d7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:52.043205 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2556df67-79df-470a-8c56-98dbd7f686d7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1188 microversion: 2.1 time: 0.103873 Aug 03 02:38:52.044019 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3196/6270] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:51 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:53.067156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-90c64299-64cc-42cb-88a8-5d5a2b66d1c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:53.067864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-90c64299-64cc-42cb-88a8-5d5a2b66d1c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:53.069948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=35 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:38:53.075838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90c64299-64cc-42cb-88a8-5d5a2b66d1c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:53.076299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90c64299-64cc-42cb-88a8-5d5a2b66d1c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:53.077083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90c64299-64cc-42cb-88a8-5d5a2b66d1c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:53.078252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90c64299-64cc-42cb-88a8-5d5a2b66d1c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:53.081426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=83 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:38:53.147554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-90c64299-64cc-42cb-88a8-5d5a2b66d1c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:53.156198 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-90c64299-64cc-42cb-88a8-5d5a2b66d1c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1188 microversion: 2.1 time: 0.094173 Aug 03 02:38:53.157480 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3075/6271] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:53 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1188 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:54.177764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-11555df4-5f8f-4c8a-95cc-555b1082f456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:54.178367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-11555df4-5f8f-4c8a-95cc-555b1082f456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:54.186010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11555df4-5f8f-4c8a-95cc-555b1082f456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:54.186460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11555df4-5f8f-4c8a-95cc-555b1082f456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:54.188018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11555df4-5f8f-4c8a-95cc-555b1082f456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:54.188243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11555df4-5f8f-4c8a-95cc-555b1082f456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:54.255602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-11555df4-5f8f-4c8a-95cc-555b1082f456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:54.263624 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-11555df4-5f8f-4c8a-95cc-555b1082f456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1188 microversion: 2.1 time: 0.089966 Aug 03 02:38:54.264207 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3197/6272] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:54 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:55.286779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-38ca5d4b-42d2-4917-8f61-1d40cbcf09a9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:55.288238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-38ca5d4b-42d2-4917-8f61-1d40cbcf09a9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:55.295429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38ca5d4b-42d2-4917-8f61-1d40cbcf09a9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:55.296019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38ca5d4b-42d2-4917-8f61-1d40cbcf09a9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:55.297566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38ca5d4b-42d2-4917-8f61-1d40cbcf09a9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:55.298018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-38ca5d4b-42d2-4917-8f61-1d40cbcf09a9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:55.363201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-38ca5d4b-42d2-4917-8f61-1d40cbcf09a9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:38:55.371696 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-38ca5d4b-42d2-4917-8f61-1d40cbcf09a9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 200 len: 1188 microversion: 2.1 time: 0.089157 Aug 03 02:38:55.372304 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3076/6273] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:55 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:38:56.393344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-64a38832-7cba-414a-a33b-2ffb9351d75c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:56.393954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-64a38832-7cba-414a-a33b-2ffb9351d75c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:56.401539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-64a38832-7cba-414a-a33b-2ffb9351d75c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:56.401994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-64a38832-7cba-414a-a33b-2ffb9351d75c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:56.402759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-64a38832-7cba-414a-a33b-2ffb9351d75c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:56.403293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-64a38832-7cba-414a-a33b-2ffb9351d75c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:56.416968 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-64a38832-7cba-414a-a33b-2ffb9351d75c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-64a38832-7cba-414a-a33b-2ffb9351d75c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 HTTP/1.1 Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '5869fd04-8539-4b80-9c87-9587046df554'} Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:38:56.418803 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:38:56.426777 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:38:56.426777 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:38:56.426777 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:38:56.426777 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:38:56.426777 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:38:56.426777 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. Aug 03 02:38:56.426777 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:38:56.426777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-64a38832-7cba-414a-a33b-2ffb9351d75c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:38:56.426777 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-64a38832-7cba-414a-a33b-2ffb9351d75c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 404 len: 111 microversion: 2.1 time: 0.031710 Aug 03 02:38:56.426777 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3198/6274] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:56 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:38:59.626432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1caf982b-3cfe-4ea7-ac5e-edb04853971d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:59.627316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1caf982b-3cfe-4ea7-ac5e-edb04853971d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:59.633974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1caf982b-3cfe-4ea7-ac5e-edb04853971d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:59.634427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1caf982b-3cfe-4ea7-ac5e-edb04853971d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:59.635256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1caf982b-3cfe-4ea7-ac5e-edb04853971d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:59.635697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1caf982b-3cfe-4ea7-ac5e-edb04853971d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:59.650895 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-1caf982b-3cfe-4ea7-ac5e-edb04853971d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1caf982b-3cfe-4ea7-ac5e-edb04853971d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 HTTP/1.1 Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '5869fd04-8539-4b80-9c87-9587046df554'} Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:38:59.652640 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:38:59.657662 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. Aug 03 02:38:59.657662 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:38:59.657662 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:38:59.657662 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:38:59.657662 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:38:59.657662 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:38:59.657662 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:38:59.657662 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:38:59.657662 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:38:59.657662 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. Aug 03 02:38:59.657662 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:38:59.657662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1caf982b-3cfe-4ea7-ac5e-edb04853971d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:38:59.657662 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1caf982b-3cfe-4ea7-ac5e-edb04853971d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 404 len: 111 microversion: 2.1 time: 0.034289 Aug 03 02:38:59.657662 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3077/6275] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:38:59 2022] DELETE /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:38:59.664058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-05efa810-769b-4f2e-b406-1180b1b04610 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:38:59.664687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-05efa810-769b-4f2e-b406-1180b1b04610 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 5869fd04-8539-4b80-9c87-9587046df554] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:38:59.672392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05efa810-769b-4f2e-b406-1180b1b04610 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:59.672861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05efa810-769b-4f2e-b406-1180b1b04610 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:59.673656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05efa810-769b-4f2e-b406-1180b1b04610 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:38:59.674104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-05efa810-769b-4f2e-b406-1180b1b04610 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:38:59.692108 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-05efa810-769b-4f2e-b406-1180b1b04610 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-05efa810-769b-4f2e-b406-1180b1b04610 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 HTTP/1.1 Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '5869fd04-8539-4b80-9c87-9587046df554'} Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:38:59.693677 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:38:59.700507 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:38:59.700507 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:38:59.700507 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:38:59.700507 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:38:59.700507 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:38:59.700507 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. Aug 03 02:38:59.700507 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:38:59.700507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-05efa810-769b-4f2e-b406-1180b1b04610 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance 5869fd04-8539-4b80-9c87-9587046df554 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:38:59.700507 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-05efa810-769b-4f2e-b406-1180b1b04610 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554" status: 404 len: 111 microversion: 2.1 time: 0.035173 Aug 03 02:38:59.700507 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3199/6276] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:38:59 2022] GET /compute/v2.1/servers/5869fd04-8539-4b80-9c87-9587046df554 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:39:19.373756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-997642392", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ac3f6d4d-0433-4aa9-9c1c-116dbfd56685", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "5eae0150-a7f5-4e00-b929-5ba4bf7b1156"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:39:19.383919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=5 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:39:19.384561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=13 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:39:19.440295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] validate_networks() for [('5eae0150-a7f5-4e00-b929-5ba4bf7b1156', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:39:19.596942 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:39:19.597589 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 02:39:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:39:20.209154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:39:20.209624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:39:20.210114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:39:20.210570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:39:20.211023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:39:20.222062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:20.222522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:20.223378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:20.223823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:20.241294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:39:20.246710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for user 1114641f11954d74885d0e4b082d7704 and project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:39:20.308223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:39:20.310337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac3f6d4d-0433-4aa9-9c1c-116dbfd56685',volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:39:20.439225 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-abc0b0c9-ef91-4b26-9dfe-d20c19b9e648 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069220 Aug 03 02:39:20.439934 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3078/6277] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:39:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 02:39:20.450553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-001c2b62-0afa-49f4-9e9f-acf0eb230090 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:20.451194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-001c2b62-0afa-49f4-9e9f-acf0eb230090 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:20.454195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=7 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:39:20.454852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=15 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:39:20.508271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-001c2b62-0afa-49f4-9e9f-acf0eb230090 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:20.516067 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-001c2b62-0afa-49f4-9e9f-acf0eb230090 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1070 microversion: 2.1 time: 0.069370 Aug 03 02:39:20.516634 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3200/6278] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:20 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1070 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:21.538181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c7869bb8-be99-4b84-969b-ae11de1d5c2b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:21.539876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c7869bb8-be99-4b84-969b-ae11de1d5c2b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:21.547186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7869bb8-be99-4b84-969b-ae11de1d5c2b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:21.547696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7869bb8-be99-4b84-969b-ae11de1d5c2b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:21.548557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7869bb8-be99-4b84-969b-ae11de1d5c2b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:21.549067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7869bb8-be99-4b84-969b-ae11de1d5c2b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:21.621138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c7869bb8-be99-4b84-969b-ae11de1d5c2b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:21.630621 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c7869bb8-be99-4b84-969b-ae11de1d5c2b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1186 microversion: 2.1 time: 0.097679 Aug 03 02:39:21.631577 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3079/6279] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:21 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1186 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:22.654293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bc2ca88c-06ab-4cdd-9679-114027e4e971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:22.654844 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bc2ca88c-06ab-4cdd-9679-114027e4e971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:22.663859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc2ca88c-06ab-4cdd-9679-114027e4e971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:22.664320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc2ca88c-06ab-4cdd-9679-114027e4e971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:22.665118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc2ca88c-06ab-4cdd-9679-114027e4e971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:22.665568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc2ca88c-06ab-4cdd-9679-114027e4e971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:22.833316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bc2ca88c-06ab-4cdd-9679-114027e4e971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:22.842317 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bc2ca88c-06ab-4cdd-9679-114027e4e971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1228 microversion: 2.1 time: 0.192072 Aug 03 02:39:22.844053 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3201/6280] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:22 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1228 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:23.175820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-3586deaa-ed90-4349-9deb-1815f2fbb861 req-32c2481c-09cb-44cd-a7b2-194485c2ed97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed3ffd1-b289-4409-aefc-2457775b0a25", "tag": "47665d7e-177a-4cfc-ba5c-f629cd4ace7d"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:39:23.199638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3586deaa-ed90-4349-9deb-1815f2fbb861 req-32c2481c-09cb-44cd-a7b2-194485c2ed97 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:23.206762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3586deaa-ed90-4349-9deb-1815f2fbb861 req-32c2481c-09cb-44cd-a7b2-194485c2ed97 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:23.223533 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-3586deaa-ed90-4349-9deb-1815f2fbb861 req-32c2481c-09cb-44cd-a7b2-194485c2ed97 service nova] Creating event network-changed:47665d7e-177a-4cfc-ba5c-f629cd4ace7d for instance bed3ffd1-b289-4409-aefc-2457775b0a25 on n-h1-826529-8 Aug 03 02:39:23.230779 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-3586deaa-ed90-4349-9deb-1815f2fbb861 req-32c2481c-09cb-44cd-a7b2-194485c2ed97 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059241 Aug 03 02:39:23.231846 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3080/6281] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:39:23.864654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ba58f2c2-561f-4468-b8a2-7f08fb5bbb4b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:23.865256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ba58f2c2-561f-4468-b8a2-7f08fb5bbb4b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:23.872377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba58f2c2-561f-4468-b8a2-7f08fb5bbb4b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:23.872830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba58f2c2-561f-4468-b8a2-7f08fb5bbb4b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:23.873612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba58f2c2-561f-4468-b8a2-7f08fb5bbb4b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:23.874089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba58f2c2-561f-4468-b8a2-7f08fb5bbb4b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:24.020243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ba58f2c2-561f-4468-b8a2-7f08fb5bbb4b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:24.028234 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ba58f2c2-561f-4468-b8a2-7f08fb5bbb4b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1228 microversion: 2.1 time: 0.168244 Aug 03 02:39:24.028879 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3202/6282] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:23 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1228 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:25.050153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8ba2d121-59e8-46c9-bbbf-14cb9e817f57 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:25.050852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8ba2d121-59e8-46c9-bbbf-14cb9e817f57 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:25.057525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8ba2d121-59e8-46c9-bbbf-14cb9e817f57 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:25.057981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8ba2d121-59e8-46c9-bbbf-14cb9e817f57 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:25.058820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8ba2d121-59e8-46c9-bbbf-14cb9e817f57 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:25.059224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8ba2d121-59e8-46c9-bbbf-14cb9e817f57 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:25.197166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8ba2d121-59e8-46c9-bbbf-14cb9e817f57 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:25.204896 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8ba2d121-59e8-46c9-bbbf-14cb9e817f57 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1228 microversion: 2.1 time: 0.159971 Aug 03 02:39:25.205476 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3081/6283] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:25 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1228 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:26.226300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-223df592-9dd8-4900-b835-ab3fdfc188e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:26.227157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-223df592-9dd8-4900-b835-ab3fdfc188e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:26.236036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-223df592-9dd8-4900-b835-ab3fdfc188e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:26.236491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-223df592-9dd8-4900-b835-ab3fdfc188e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:26.237267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-223df592-9dd8-4900-b835-ab3fdfc188e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:26.237707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-223df592-9dd8-4900-b835-ab3fdfc188e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:26.374501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-223df592-9dd8-4900-b835-ab3fdfc188e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:26.382705 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-223df592-9dd8-4900-b835-ab3fdfc188e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1228 microversion: 2.1 time: 0.160995 Aug 03 02:39:26.383319 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3203/6284] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:26 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1228 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:27.404685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9e541c4f-78b3-4a02-b6c1-c9219b27e2b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:27.405870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9e541c4f-78b3-4a02-b6c1-c9219b27e2b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:27.413610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e541c4f-78b3-4a02-b6c1-c9219b27e2b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:27.414063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e541c4f-78b3-4a02-b6c1-c9219b27e2b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:27.414846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e541c4f-78b3-4a02-b6c1-c9219b27e2b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:27.415323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e541c4f-78b3-4a02-b6c1-c9219b27e2b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:27.553048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9e541c4f-78b3-4a02-b6c1-c9219b27e2b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:27.560725 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9e541c4f-78b3-4a02-b6c1-c9219b27e2b5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1216 microversion: 2.1 time: 0.159952 Aug 03 02:39:27.561397 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3082/6285] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:27 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1216 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:28.581678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-76b579db-bfc7-4fc7-a72d-1f19f0dd29d5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:28.582295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-76b579db-bfc7-4fc7-a72d-1f19f0dd29d5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:28.589272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76b579db-bfc7-4fc7-a72d-1f19f0dd29d5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:28.589727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76b579db-bfc7-4fc7-a72d-1f19f0dd29d5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:28.590494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76b579db-bfc7-4fc7-a72d-1f19f0dd29d5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:28.590956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76b579db-bfc7-4fc7-a72d-1f19f0dd29d5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:28.731446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-76b579db-bfc7-4fc7-a72d-1f19f0dd29d5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:28.739030 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-76b579db-bfc7-4fc7-a72d-1f19f0dd29d5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1216 microversion: 2.1 time: 0.161268 Aug 03 02:39:28.739709 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3204/6286] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:28 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:29.761093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ded0b1bb-af74-475f-9fce-7c654c213107 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:29.761707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ded0b1bb-af74-475f-9fce-7c654c213107 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:29.769416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ded0b1bb-af74-475f-9fce-7c654c213107 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:29.769868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ded0b1bb-af74-475f-9fce-7c654c213107 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:29.770641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ded0b1bb-af74-475f-9fce-7c654c213107 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:29.771123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ded0b1bb-af74-475f-9fce-7c654c213107 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:29.907911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ded0b1bb-af74-475f-9fce-7c654c213107 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:29.915729 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ded0b1bb-af74-475f-9fce-7c654c213107 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1216 microversion: 2.1 time: 0.158752 Aug 03 02:39:29.916319 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3083/6287] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:29 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:30.938015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0db42ff4-a53b-4b4c-a2c2-8f0f8104d9ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:30.938631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0db42ff4-a53b-4b4c-a2c2-8f0f8104d9ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:30.941459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:39:30.947212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0db42ff4-a53b-4b4c-a2c2-8f0f8104d9ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:30.947670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0db42ff4-a53b-4b4c-a2c2-8f0f8104d9ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:30.948444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0db42ff4-a53b-4b4c-a2c2-8f0f8104d9ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:30.948883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0db42ff4-a53b-4b4c-a2c2-8f0f8104d9ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:31.081117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0db42ff4-a53b-4b4c-a2c2-8f0f8104d9ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:31.088859 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0db42ff4-a53b-4b4c-a2c2-8f0f8104d9ad tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1216 microversion: 2.1 time: 0.154808 Aug 03 02:39:31.089369 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3205/6288] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:30 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:32.110783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1f510918-d130-4532-87f6-c04ea889a3e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:32.111430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1f510918-d130-4532-87f6-c04ea889a3e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:32.113461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:39:32.114152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:39:32.121553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f510918-d130-4532-87f6-c04ea889a3e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:32.122011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f510918-d130-4532-87f6-c04ea889a3e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:32.122791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f510918-d130-4532-87f6-c04ea889a3e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:32.123258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f510918-d130-4532-87f6-c04ea889a3e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:32.255668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1f510918-d130-4532-87f6-c04ea889a3e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:32.263825 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1f510918-d130-4532-87f6-c04ea889a3e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1216 microversion: 2.1 time: 0.157509 Aug 03 02:39:32.264447 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3084/6289] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:32 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:33.285254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-de93f228-1c72-487f-9fb5-d1acf84fee6d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:33.285872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-de93f228-1c72-487f-9fb5-d1acf84fee6d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:33.292875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de93f228-1c72-487f-9fb5-d1acf84fee6d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:33.293334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de93f228-1c72-487f-9fb5-d1acf84fee6d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:33.294105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de93f228-1c72-487f-9fb5-d1acf84fee6d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:33.294549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de93f228-1c72-487f-9fb5-d1acf84fee6d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:33.433387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-de93f228-1c72-487f-9fb5-d1acf84fee6d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:33.441587 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-de93f228-1c72-487f-9fb5-d1acf84fee6d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1216 microversion: 2.1 time: 0.160349 Aug 03 02:39:33.442178 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3206/6290] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:33 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1216 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:34.462424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1f13b420-f18e-4751-9aa4-02514ab3c422 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:34.463234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1f13b420-f18e-4751-9aa4-02514ab3c422 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:34.471686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f13b420-f18e-4751-9aa4-02514ab3c422 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:34.472136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f13b420-f18e-4751-9aa4-02514ab3c422 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:34.472915 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f13b420-f18e-4751-9aa4-02514ab3c422 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:34.473648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f13b420-f18e-4751-9aa4-02514ab3c422 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:34.612762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1f13b420-f18e-4751-9aa4-02514ab3c422 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:34.625032 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1f13b420-f18e-4751-9aa4-02514ab3c422 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1216 microversion: 2.1 time: 0.165616 Aug 03 02:39:34.625948 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3085/6291] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:34 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1216 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:39:35.657210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8c7f44cf-4bbf-4707-9336-9957d45cad83 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:35.657854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8c7f44cf-4bbf-4707-9336-9957d45cad83 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:35.665926 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c7f44cf-4bbf-4707-9336-9957d45cad83 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:35.666377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c7f44cf-4bbf-4707-9336-9957d45cad83 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:35.667184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c7f44cf-4bbf-4707-9336-9957d45cad83 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:35.667620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c7f44cf-4bbf-4707-9336-9957d45cad83 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:35.732452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-2445fad2-1bac-414e-a7d1-06358744126f req-ff408ce4-3e76-4fdc-a831-c218a3e71f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed3ffd1-b289-4409-aefc-2457775b0a25", "name": "network-vif-plugged", "status": "completed", "tag": "47665d7e-177a-4cfc-ba5c-f629cd4ace7d"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:39:35.744679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2445fad2-1bac-414e-a7d1-06358744126f req-ff408ce4-3e76-4fdc-a831-c218a3e71f42 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:35.745447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2445fad2-1bac-414e-a7d1-06358744126f req-ff408ce4-3e76-4fdc-a831-c218a3e71f42 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:35.760686 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-2445fad2-1bac-414e-a7d1-06358744126f req-ff408ce4-3e76-4fdc-a831-c218a3e71f42 service nova] Creating event network-vif-plugged:47665d7e-177a-4cfc-ba5c-f629cd4ace7d for instance bed3ffd1-b289-4409-aefc-2457775b0a25 on n-h1-826529-8 Aug 03 02:39:35.766702 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-2445fad2-1bac-414e-a7d1-06358744126f req-ff408ce4-3e76-4fdc-a831-c218a3e71f42 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037902 Aug 03 02:39:35.767659 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3086/6292] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:39:35.845854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8c7f44cf-4bbf-4707-9336-9957d45cad83 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:35.853529 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8c7f44cf-4bbf-4707-9336-9957d45cad83 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1216 microversion: 2.1 time: 0.203008 Aug 03 02:39:35.854527 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3207/6293] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:35 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1216 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:36.882619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bee0181c-fdda-4fa7-9fa0-74f9cf83b4b6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:36.883360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bee0181c-fdda-4fa7-9fa0-74f9cf83b4b6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:36.890959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bee0181c-fdda-4fa7-9fa0-74f9cf83b4b6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:36.891422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bee0181c-fdda-4fa7-9fa0-74f9cf83b4b6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:36.892224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bee0181c-fdda-4fa7-9fa0-74f9cf83b4b6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:36.892671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bee0181c-fdda-4fa7-9fa0-74f9cf83b4b6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:37.046313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bee0181c-fdda-4fa7-9fa0-74f9cf83b4b6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:37.054316 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bee0181c-fdda-4fa7-9fa0-74f9cf83b4b6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1216 microversion: 2.1 time: 0.176858 Aug 03 02:39:37.054931 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3087/6294] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:36 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1216 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:38.074720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c4a08b09-6b70-425b-ba99-ad49174a0caa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:38.075368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c4a08b09-6b70-425b-ba99-ad49174a0caa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:38.083139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a08b09-6b70-425b-ba99-ad49174a0caa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:38.083607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a08b09-6b70-425b-ba99-ad49174a0caa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:38.084386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a08b09-6b70-425b-ba99-ad49174a0caa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:38.084832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4a08b09-6b70-425b-ba99-ad49174a0caa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:38.227492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c4a08b09-6b70-425b-ba99-ad49174a0caa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:38.235480 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c4a08b09-6b70-425b-ba99-ad49174a0caa tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1402 microversion: 2.1 time: 0.164722 Aug 03 02:39:38.236059 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3208/6295] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:38 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1402 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:38.256076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dc743fff-18ad-4cb5-a03f-4f59d67a5035 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:38.256721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dc743fff-18ad-4cb5-a03f-4f59d67a5035 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:38.264016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc743fff-18ad-4cb5-a03f-4f59d67a5035 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:38.265294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc743fff-18ad-4cb5-a03f-4f59d67a5035 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:38.265816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc743fff-18ad-4cb5-a03f-4f59d67a5035 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:38.266267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dc743fff-18ad-4cb5-a03f-4f59d67a5035 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:38.400973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dc743fff-18ad-4cb5-a03f-4f59d67a5035 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:38.408646 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dc743fff-18ad-4cb5-a03f-4f59d67a5035 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1402 microversion: 2.1 time: 0.156503 Aug 03 02:39:38.409223 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3088/6296] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:38 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1402 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:38.428526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d02d600f-1dca-4bcc-b53a-3286fed8d48b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-560521718"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:39:38.430895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d02d600f-1dca-4bcc-b53a-3286fed8d48b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:38.438093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d02d600f-1dca-4bcc-b53a-3286fed8d48b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:38.438547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d02d600f-1dca-4bcc-b53a-3286fed8d48b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:38.439369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d02d600f-1dca-4bcc-b53a-3286fed8d48b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:38.439813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d02d600f-1dca-4bcc-b53a-3286fed8d48b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:38.535184 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.compute.api [None req-d02d600f-1dca-4bcc-b53a-3286fed8d48b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Attempting to quiesce instance before volume snapshot. Aug 03 02:39:38.593958 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.compute.api [None req-d02d600f-1dca-4bcc-b53a-3286fed8d48b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 03 02:39:38.675227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d02d600f-1dca-4bcc-b53a-3286fed8d48b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Creating snapshot from volume ac3f6d4d-0433-4aa9-9c1c-116dbfd56685. {{(pid=125941) snapshot_instance /opt/stack/nova/nova/compute/api.py:3456}} Aug 03 02:39:39.601606 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d02d600f-1dca-4bcc-b53a-3286fed8d48b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "POST /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25/action" status: 202 len: 0 microversion: 2.1 time: 1.177011 Aug 03 02:39:39.602938 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3209/6297] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:39:38 2022] POST /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25/action => generated 0 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 02:39:40.765694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1706347727", "imageRef": "dc909b48-6339-4f21-8982-6a10eac48cc5", "flavorRef": "452", "networks": [{"uuid": "5eae0150-a7f5-4e00-b929-5ba4bf7b1156"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:39:40.823537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] validate_networks() for [('5eae0150-a7f5-4e00-b929-5ba4bf7b1156', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:39:41.208901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:39:41.209757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:39:41.210953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:39:41.211713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:39:41.212309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:39:41.223140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:41.223623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:41.224571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:41.225012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:41.244869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:39:41.250805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for user 1114641f11954d74885d0e4b082d7704 and project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:39:41.263815 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:39:41.266641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c0ba7df1-3ac6-4442-8cfa-8da9f5f992fa',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:39:41.344986 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2afca8d6-e935-4d9f-ae36-e70747171ab3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584022 Aug 03 02:39:41.345656 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3089/6298] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:39:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:39:41.358447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8dde5820-1a58-44c6-96ef-dccb8b444f58 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:41.359857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8dde5820-1a58-44c6-96ef-dccb8b444f58 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:41.418190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8dde5820-1a58-44c6-96ef-dccb8b444f58 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:41.425939 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8dde5820-1a58-44c6-96ef-dccb8b444f58 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1230 microversion: 2.1 time: 0.073141 Aug 03 02:39:41.426521 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3210/6299] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:41 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1230 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:42.448786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3f6ca9cc-8180-46f0-9b81-5cd9d3f44e6b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:42.449508 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3f6ca9cc-8180-46f0-9b81-5cd9d3f44e6b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:42.458087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f6ca9cc-8180-46f0-9b81-5cd9d3f44e6b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:42.458678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f6ca9cc-8180-46f0-9b81-5cd9d3f44e6b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:42.459606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f6ca9cc-8180-46f0-9b81-5cd9d3f44e6b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:42.460127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3f6ca9cc-8180-46f0-9b81-5cd9d3f44e6b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:42.554077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3f6ca9cc-8180-46f0-9b81-5cd9d3f44e6b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:42.562953 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3f6ca9cc-8180-46f0-9b81-5cd9d3f44e6b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1300 microversion: 2.1 time: 0.118991 Aug 03 02:39:42.563548 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3090/6300] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:42 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1300 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:43.584635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-43f4b25c-89a4-4c15-b597-d5db636dfdbf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:43.586268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-43f4b25c-89a4-4c15-b597-d5db636dfdbf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:43.595206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43f4b25c-89a4-4c15-b597-d5db636dfdbf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:43.595763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43f4b25c-89a4-4c15-b597-d5db636dfdbf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:43.596617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43f4b25c-89a4-4c15-b597-d5db636dfdbf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:43.597033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43f4b25c-89a4-4c15-b597-d5db636dfdbf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:43.874670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-43f4b25c-89a4-4c15-b597-d5db636dfdbf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:43.883323 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-43f4b25c-89a4-4c15-b597-d5db636dfdbf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1342 microversion: 2.1 time: 0.302432 Aug 03 02:39:43.888843 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3211/6301] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:43 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1342 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:44.099626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-1a2fe2a8-03bb-47dd-ac6a-b758209b79e4 req-ba1567d5-4ad2-403a-8a5b-267736ba51c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00465333-61a9-49ca-9284-b663bce26dab", "tag": "bd5293fb-b2ad-4dac-8df6-e78a3e3129b0"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:39:44.113340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1a2fe2a8-03bb-47dd-ac6a-b758209b79e4 req-ba1567d5-4ad2-403a-8a5b-267736ba51c1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:44.113794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1a2fe2a8-03bb-47dd-ac6a-b758209b79e4 req-ba1567d5-4ad2-403a-8a5b-267736ba51c1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:44.127341 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-1a2fe2a8-03bb-47dd-ac6a-b758209b79e4 req-ba1567d5-4ad2-403a-8a5b-267736ba51c1 service nova] Creating event network-changed:bd5293fb-b2ad-4dac-8df6-e78a3e3129b0 for instance 00465333-61a9-49ca-9284-b663bce26dab on n-h2-826529-8 Aug 03 02:39:44.132528 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-1a2fe2a8-03bb-47dd-ac6a-b758209b79e4 req-ba1567d5-4ad2-403a-8a5b-267736ba51c1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130666 Aug 03 02:39:44.133172 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3091/6302] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:39:44.905458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9ecddd77-3318-41b0-ac2a-45780fc518a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:44.907024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9ecddd77-3318-41b0-ac2a-45780fc518a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:44.914337 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ecddd77-3318-41b0-ac2a-45780fc518a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:44.915112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ecddd77-3318-41b0-ac2a-45780fc518a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:44.916116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ecddd77-3318-41b0-ac2a-45780fc518a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:44.917040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ecddd77-3318-41b0-ac2a-45780fc518a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:45.144167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9ecddd77-3318-41b0-ac2a-45780fc518a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:45.151977 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9ecddd77-3318-41b0-ac2a-45780fc518a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1342 microversion: 2.1 time: 0.250725 Aug 03 02:39:45.152640 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3212/6303] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:44 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1342 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:46.174793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9b10092b-7012-419c-bfc8-8194e63f531c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:46.176339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9b10092b-7012-419c-bfc8-8194e63f531c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:46.186207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b10092b-7012-419c-bfc8-8194e63f531c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:46.186823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b10092b-7012-419c-bfc8-8194e63f531c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:46.187928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b10092b-7012-419c-bfc8-8194e63f531c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:46.189180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b10092b-7012-419c-bfc8-8194e63f531c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:46.350839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9b10092b-7012-419c-bfc8-8194e63f531c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:46.360925 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9b10092b-7012-419c-bfc8-8194e63f531c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1342 microversion: 2.1 time: 0.190894 Aug 03 02:39:46.375726 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3092/6304] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:46 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:47.390415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-60eeb022-9554-4c74-8411-64ee87a7922f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:47.391323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-60eeb022-9554-4c74-8411-64ee87a7922f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:47.399957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60eeb022-9554-4c74-8411-64ee87a7922f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:47.400535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60eeb022-9554-4c74-8411-64ee87a7922f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:47.401368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60eeb022-9554-4c74-8411-64ee87a7922f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:47.401954 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60eeb022-9554-4c74-8411-64ee87a7922f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:47.599956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-60eeb022-9554-4c74-8411-64ee87a7922f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:47.609261 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-60eeb022-9554-4c74-8411-64ee87a7922f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1342 microversion: 2.1 time: 0.225775 Aug 03 02:39:47.610733 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3213/6305] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:47 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1342 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:48.643540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3b6e1dbb-6c7c-4bb7-a271-715707983693 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:48.644289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3b6e1dbb-6c7c-4bb7-a271-715707983693 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:48.661393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b6e1dbb-6c7c-4bb7-a271-715707983693 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:48.662400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b6e1dbb-6c7c-4bb7-a271-715707983693 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:48.663353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b6e1dbb-6c7c-4bb7-a271-715707983693 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:48.663838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3b6e1dbb-6c7c-4bb7-a271-715707983693 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:48.867388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3b6e1dbb-6c7c-4bb7-a271-715707983693 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:48.876981 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3b6e1dbb-6c7c-4bb7-a271-715707983693 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1342 microversion: 2.1 time: 0.245656 Aug 03 02:39:48.877775 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3093/6306] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:48 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1342 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:49.908050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-06ff6ec3-c451-411b-9b58-bfa433eaed8c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:49.909539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-06ff6ec3-c451-411b-9b58-bfa433eaed8c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:49.917586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06ff6ec3-c451-411b-9b58-bfa433eaed8c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:49.918411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06ff6ec3-c451-411b-9b58-bfa433eaed8c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:49.919398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06ff6ec3-c451-411b-9b58-bfa433eaed8c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:49.919968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06ff6ec3-c451-411b-9b58-bfa433eaed8c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:50.080743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-06ff6ec3-c451-411b-9b58-bfa433eaed8c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:50.089097 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-06ff6ec3-c451-411b-9b58-bfa433eaed8c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1342 microversion: 2.1 time: 0.186151 Aug 03 02:39:50.089842 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3214/6307] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:49 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1342 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:51.110526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b4732068-4472-4d5a-8d48-f41e7bd0045e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:51.111106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b4732068-4472-4d5a-8d48-f41e7bd0045e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:51.113971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:39:51.120493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4732068-4472-4d5a-8d48-f41e7bd0045e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:51.120955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4732068-4472-4d5a-8d48-f41e7bd0045e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:51.121781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4732068-4472-4d5a-8d48-f41e7bd0045e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:51.122287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4732068-4472-4d5a-8d48-f41e7bd0045e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:51.127019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=77 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:39:51.232207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:39:51.258078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:39:51.291005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b4732068-4472-4d5a-8d48-f41e7bd0045e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:51.302705 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b4732068-4472-4d5a-8d48-f41e7bd0045e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1342 microversion: 2.1 time: 0.196148 Aug 03 02:39:51.303365 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3094/6308] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:51 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1342 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:39:52.324690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-23858343-8c2f-4af1-b60d-13167431b458 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:52.325355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-23858343-8c2f-4af1-b60d-13167431b458 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:52.329666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:39:52.330416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=35 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:39:52.334876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23858343-8c2f-4af1-b60d-13167431b458 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:52.335371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23858343-8c2f-4af1-b60d-13167431b458 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:52.336160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23858343-8c2f-4af1-b60d-13167431b458 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:52.336609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23858343-8c2f-4af1-b60d-13167431b458 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:52.340092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:39:52.485779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-23858343-8c2f-4af1-b60d-13167431b458 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:52.493837 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-23858343-8c2f-4af1-b60d-13167431b458 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1342 microversion: 2.1 time: 0.173078 Aug 03 02:39:52.500746 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3215/6309] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:52 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1342 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:39:53.516336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b9ab1067-25d4-4868-83a8-d2b87045e102 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:53.516860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b9ab1067-25d4-4868-83a8-d2b87045e102 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:53.524008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b9ab1067-25d4-4868-83a8-d2b87045e102 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:53.524474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b9ab1067-25d4-4868-83a8-d2b87045e102 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:53.525263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b9ab1067-25d4-4868-83a8-d2b87045e102 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:53.525710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b9ab1067-25d4-4868-83a8-d2b87045e102 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:53.661003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b9ab1067-25d4-4868-83a8-d2b87045e102 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:53.668605 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b9ab1067-25d4-4868-83a8-d2b87045e102 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1342 microversion: 2.1 time: 0.156883 Aug 03 02:39:53.669382 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3095/6310] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:53 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1342 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:54.690886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d99f167b-0606-4542-9ae6-195d60c2745f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:54.691759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d99f167b-0606-4542-9ae6-195d60c2745f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:54.700705 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d99f167b-0606-4542-9ae6-195d60c2745f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:54.702061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d99f167b-0606-4542-9ae6-195d60c2745f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:54.702843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d99f167b-0606-4542-9ae6-195d60c2745f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:54.703496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d99f167b-0606-4542-9ae6-195d60c2745f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:54.864487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d99f167b-0606-4542-9ae6-195d60c2745f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:54.876003 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d99f167b-0606-4542-9ae6-195d60c2745f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1342 microversion: 2.1 time: 0.190119 Aug 03 02:39:54.877313 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3216/6311] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:54 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1342 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:55.898405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b4fbdce4-6a91-4d39-b875-748564cf65b8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:55.899181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b4fbdce4-6a91-4d39-b875-748564cf65b8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:55.907922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4fbdce4-6a91-4d39-b875-748564cf65b8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:55.908387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4fbdce4-6a91-4d39-b875-748564cf65b8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:55.909190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4fbdce4-6a91-4d39-b875-748564cf65b8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:55.909648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4fbdce4-6a91-4d39-b875-748564cf65b8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:56.063899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b4fbdce4-6a91-4d39-b875-748564cf65b8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:56.071978 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b4fbdce4-6a91-4d39-b875-748564cf65b8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1342 microversion: 2.1 time: 0.178028 Aug 03 02:39:56.072647 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3096/6312] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:55 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1342 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:39:57.095481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-272f3c19-bbf8-41d3-bda7-676cf6877584 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:57.096475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-272f3c19-bbf8-41d3-bda7-676cf6877584 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:57.105065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-272f3c19-bbf8-41d3-bda7-676cf6877584 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:57.105550 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-272f3c19-bbf8-41d3-bda7-676cf6877584 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:57.106501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-272f3c19-bbf8-41d3-bda7-676cf6877584 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:57.107101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-272f3c19-bbf8-41d3-bda7-676cf6877584 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:57.253725 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-272f3c19-bbf8-41d3-bda7-676cf6877584 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:57.264108 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-272f3c19-bbf8-41d3-bda7-676cf6877584 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1388 microversion: 2.1 time: 0.173098 Aug 03 02:39:57.265059 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3217/6313] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:57 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1388 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:39:58.286431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5eda6473-30c0-415d-b5b2-75756b106c91 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:58.287098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5eda6473-30c0-415d-b5b2-75756b106c91 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:58.294095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5eda6473-30c0-415d-b5b2-75756b106c91 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:58.294559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5eda6473-30c0-415d-b5b2-75756b106c91 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:58.295395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5eda6473-30c0-415d-b5b2-75756b106c91 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:58.295844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5eda6473-30c0-415d-b5b2-75756b106c91 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:58.431393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5eda6473-30c0-415d-b5b2-75756b106c91 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:58.439686 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5eda6473-30c0-415d-b5b2-75756b106c91 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1376 microversion: 2.1 time: 0.157293 Aug 03 02:39:58.440269 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3097/6314] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:58 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:39:59.461989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a681dd96-8b0c-412a-b7b3-daa8913195f7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:39:59.462726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a681dd96-8b0c-412a-b7b3-daa8913195f7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:39:59.471355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a681dd96-8b0c-412a-b7b3-daa8913195f7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:59.471832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a681dd96-8b0c-412a-b7b3-daa8913195f7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:59.472639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a681dd96-8b0c-412a-b7b3-daa8913195f7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:39:59.473090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a681dd96-8b0c-412a-b7b3-daa8913195f7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:39:59.616345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a681dd96-8b0c-412a-b7b3-daa8913195f7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:39:59.624107 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a681dd96-8b0c-412a-b7b3-daa8913195f7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1376 microversion: 2.1 time: 0.166122 Aug 03 02:39:59.624695 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3218/6315] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:39:59 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1376 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:00.647127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0b906f47-52b7-4858-9711-1ba7d2430eba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:00.647737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0b906f47-52b7-4858-9711-1ba7d2430eba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:00.654737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b906f47-52b7-4858-9711-1ba7d2430eba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:00.655229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b906f47-52b7-4858-9711-1ba7d2430eba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:00.656646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b906f47-52b7-4858-9711-1ba7d2430eba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:00.657088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b906f47-52b7-4858-9711-1ba7d2430eba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:00.804094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0b906f47-52b7-4858-9711-1ba7d2430eba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:00.812542 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0b906f47-52b7-4858-9711-1ba7d2430eba tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1376 microversion: 2.1 time: 0.168850 Aug 03 02:40:00.813366 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3098/6316] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:00 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1376 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:01.833891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fe59e686-5d5e-48bc-9718-d4f5206e6d1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:01.834639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fe59e686-5d5e-48bc-9718-d4f5206e6d1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:01.842719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe59e686-5d5e-48bc-9718-d4f5206e6d1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:01.843304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe59e686-5d5e-48bc-9718-d4f5206e6d1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:01.844321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe59e686-5d5e-48bc-9718-d4f5206e6d1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:01.844777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fe59e686-5d5e-48bc-9718-d4f5206e6d1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:01.989025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fe59e686-5d5e-48bc-9718-d4f5206e6d1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:01.997345 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fe59e686-5d5e-48bc-9718-d4f5206e6d1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1376 microversion: 2.1 time: 0.167147 Aug 03 02:40:01.998175 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3219/6317] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:01 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:03.022016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-628c54f8-690f-4a2b-9f10-62c6d3106cb3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:03.022747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-628c54f8-690f-4a2b-9f10-62c6d3106cb3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:03.030510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-628c54f8-690f-4a2b-9f10-62c6d3106cb3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:03.030933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-628c54f8-690f-4a2b-9f10-62c6d3106cb3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:03.031878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-628c54f8-690f-4a2b-9f10-62c6d3106cb3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:03.032877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-628c54f8-690f-4a2b-9f10-62c6d3106cb3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:03.177613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-628c54f8-690f-4a2b-9f10-62c6d3106cb3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:03.185768 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-628c54f8-690f-4a2b-9f10-62c6d3106cb3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1376 microversion: 2.1 time: 0.167870 Aug 03 02:40:03.186360 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3099/6318] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:03 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:40:04.208608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-18d71974-9117-459d-bb12-f5a834fa13a4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:04.209234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-18d71974-9117-459d-bb12-f5a834fa13a4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:04.217045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18d71974-9117-459d-bb12-f5a834fa13a4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:04.217561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18d71974-9117-459d-bb12-f5a834fa13a4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:04.219093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18d71974-9117-459d-bb12-f5a834fa13a4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:04.219555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-18d71974-9117-459d-bb12-f5a834fa13a4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:04.367927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-18d71974-9117-459d-bb12-f5a834fa13a4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:04.376846 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-18d71974-9117-459d-bb12-f5a834fa13a4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1376 microversion: 2.1 time: 0.172370 Aug 03 02:40:04.377521 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3220/6319] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:04 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1376 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:05.398771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aba8f739-775b-4a2a-a6c1-f7d101d3dfc4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:05.399416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-aba8f739-775b-4a2a-a6c1-f7d101d3dfc4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:05.406644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aba8f739-775b-4a2a-a6c1-f7d101d3dfc4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:05.407097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aba8f739-775b-4a2a-a6c1-f7d101d3dfc4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:05.407883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aba8f739-775b-4a2a-a6c1-f7d101d3dfc4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:05.408332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aba8f739-775b-4a2a-a6c1-f7d101d3dfc4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:05.545332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-aba8f739-775b-4a2a-a6c1-f7d101d3dfc4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:05.553732 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aba8f739-775b-4a2a-a6c1-f7d101d3dfc4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1376 microversion: 2.1 time: 0.158868 Aug 03 02:40:05.554302 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3100/6320] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:05 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:06.165285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-3e6c4454-d288-44fe-837c-7582ac509d08 req-1cd88a87-4fda-4d05-921f-694a6ce29570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00465333-61a9-49ca-9284-b663bce26dab", "name": "network-vif-plugged", "status": "completed", "tag": "bd5293fb-b2ad-4dac-8df6-e78a3e3129b0"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:40:06.176691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3e6c4454-d288-44fe-837c-7582ac509d08 req-1cd88a87-4fda-4d05-921f-694a6ce29570 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:06.177162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3e6c4454-d288-44fe-837c-7582ac509d08 req-1cd88a87-4fda-4d05-921f-694a6ce29570 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:06.190352 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-3e6c4454-d288-44fe-837c-7582ac509d08 req-1cd88a87-4fda-4d05-921f-694a6ce29570 service nova] Creating event network-vif-plugged:bd5293fb-b2ad-4dac-8df6-e78a3e3129b0 for instance 00465333-61a9-49ca-9284-b663bce26dab on n-h2-826529-8 Aug 03 02:40:06.196656 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-3e6c4454-d288-44fe-837c-7582ac509d08 req-1cd88a87-4fda-4d05-921f-694a6ce29570 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034530 Aug 03 02:40:06.197218 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3221/6321] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:40:06.575417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0196ad4d-16e0-4490-8095-3df6989d1547 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:06.575970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0196ad4d-16e0-4490-8095-3df6989d1547 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:06.584290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0196ad4d-16e0-4490-8095-3df6989d1547 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:06.584757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0196ad4d-16e0-4490-8095-3df6989d1547 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:06.585585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0196ad4d-16e0-4490-8095-3df6989d1547 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:06.586038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0196ad4d-16e0-4490-8095-3df6989d1547 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:06.728693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0196ad4d-16e0-4490-8095-3df6989d1547 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:06.738475 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0196ad4d-16e0-4490-8095-3df6989d1547 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1376 microversion: 2.1 time: 0.167073 Aug 03 02:40:06.739107 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3101/6322] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:06 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:07.761567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e0b8e81-a091-4a83-adb9-860b1b51c432 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:07.762392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3e0b8e81-a091-4a83-adb9-860b1b51c432 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:07.770296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e0b8e81-a091-4a83-adb9-860b1b51c432 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:07.770762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e0b8e81-a091-4a83-adb9-860b1b51c432 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:07.771573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e0b8e81-a091-4a83-adb9-860b1b51c432 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:07.772025 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e0b8e81-a091-4a83-adb9-860b1b51c432 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:07.928304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3e0b8e81-a091-4a83-adb9-860b1b51c432 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:07.937778 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e0b8e81-a091-4a83-adb9-860b1b51c432 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1563 microversion: 2.1 time: 0.181486 Aug 03 02:40:07.938622 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3222/6323] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:07 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:07.966331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5e7d614f-e206-45bc-bc1d-95d0dad9ec0f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:07.967420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5e7d614f-e206-45bc-bc1d-95d0dad9ec0f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:07.975495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e7d614f-e206-45bc-bc1d-95d0dad9ec0f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:07.975950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e7d614f-e206-45bc-bc1d-95d0dad9ec0f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:07.977183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e7d614f-e206-45bc-bc1d-95d0dad9ec0f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:07.977183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e7d614f-e206-45bc-bc1d-95d0dad9ec0f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:08.139341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5e7d614f-e206-45bc-bc1d-95d0dad9ec0f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:08.148726 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5e7d614f-e206-45bc-bc1d-95d0dad9ec0f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1563 microversion: 2.1 time: 0.191141 Aug 03 02:40:08.149575 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3102/6324] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:07 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1563 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:08.242379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3429d564-3c25-44bc-a33c-0b6160891f1b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:08.242927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3429d564-3c25-44bc-a33c-0b6160891f1b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:08.250408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3429d564-3c25-44bc-a33c-0b6160891f1b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:08.250876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3429d564-3c25-44bc-a33c-0b6160891f1b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:08.251690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3429d564-3c25-44bc-a33c-0b6160891f1b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:08.252136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3429d564-3c25-44bc-a33c-0b6160891f1b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:08.285755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3429d564-3c25-44bc-a33c-0b6160891f1b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:40:08.384150 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3429d564-3c25-44bc-a33c-0b6160891f1b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "DELETE /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 204 len: 0 microversion: 2.1 time: 0.144499 Aug 03 02:40:08.384855 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3223/6325] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:40:08 2022] DELETE /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:40:08.394467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-06bfa47a-2b90-4613-98ea-40392d2675c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:08.395103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-06bfa47a-2b90-4613-98ea-40392d2675c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:08.401712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06bfa47a-2b90-4613-98ea-40392d2675c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:08.402170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06bfa47a-2b90-4613-98ea-40392d2675c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:08.403055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06bfa47a-2b90-4613-98ea-40392d2675c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:08.403510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06bfa47a-2b90-4613-98ea-40392d2675c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:08.551033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-06bfa47a-2b90-4613-98ea-40392d2675c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:08.559128 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-06bfa47a-2b90-4613-98ea-40392d2675c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1569 microversion: 2.1 time: 0.169041 Aug 03 02:40:08.559712 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3103/6326] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:08 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:40:09.584936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37303fba-4093-453f-84d3-6e81388405cd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:09.586197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-37303fba-4093-453f-84d3-6e81388405cd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:09.595739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37303fba-4093-453f-84d3-6e81388405cd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:09.596708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37303fba-4093-453f-84d3-6e81388405cd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:09.597698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37303fba-4093-453f-84d3-6e81388405cd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:09.598311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37303fba-4093-453f-84d3-6e81388405cd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:09.753087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-37303fba-4093-453f-84d3-6e81388405cd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:09.761300 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-37303fba-4093-453f-84d3-6e81388405cd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1569 microversion: 2.1 time: 0.181631 Aug 03 02:40:09.761866 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3224/6327] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:09 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:10.783362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9fcbcf0e-1d63-4239-a75a-cb09d34b20bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:10.784964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9fcbcf0e-1d63-4239-a75a-cb09d34b20bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:10.794163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fcbcf0e-1d63-4239-a75a-cb09d34b20bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:10.795130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fcbcf0e-1d63-4239-a75a-cb09d34b20bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:10.796119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fcbcf0e-1d63-4239-a75a-cb09d34b20bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:10.796806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9fcbcf0e-1d63-4239-a75a-cb09d34b20bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:10.852959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-805ca969-caf6-49fc-8187-b2ba47038f50 req-b38c6f10-7100-404e-a9a5-92a1a8151511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00465333-61a9-49ca-9284-b663bce26dab", "name": "network-vif-deleted", "tag": "bd5293fb-b2ad-4dac-8df6-e78a3e3129b0"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:40:10.876429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-805ca969-caf6-49fc-8187-b2ba47038f50 req-b38c6f10-7100-404e-a9a5-92a1a8151511 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:10.877072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-805ca969-caf6-49fc-8187-b2ba47038f50 req-b38c6f10-7100-404e-a9a5-92a1a8151511 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:10.924571 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-805ca969-caf6-49fc-8187-b2ba47038f50 req-b38c6f10-7100-404e-a9a5-92a1a8151511 service nova] Creating event network-vif-deleted:bd5293fb-b2ad-4dac-8df6-e78a3e3129b0 for instance 00465333-61a9-49ca-9284-b663bce26dab on n-h2-826529-8 Aug 03 02:40:10.939657 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-805ca969-caf6-49fc-8187-b2ba47038f50 req-b38c6f10-7100-404e-a9a5-92a1a8151511 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090167 Aug 03 02:40:10.941093 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3225/6328] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:40:10.946706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9fcbcf0e-1d63-4239-a75a-cb09d34b20bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:10.966760 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9fcbcf0e-1d63-4239-a75a-cb09d34b20bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1527 microversion: 2.1 time: 0.188885 Aug 03 02:40:10.967392 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3104/6329] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:10 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1527 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:11.991459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f27c80ee-4565-4660-b3e0-4e913cf96e45 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:11.992172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f27c80ee-4565-4660-b3e0-4e913cf96e45 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:11.998630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f27c80ee-4565-4660-b3e0-4e913cf96e45 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:11.999068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f27c80ee-4565-4660-b3e0-4e913cf96e45 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:11.999855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f27c80ee-4565-4660-b3e0-4e913cf96e45 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:12.000966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f27c80ee-4565-4660-b3e0-4e913cf96e45 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:12.073428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f27c80ee-4565-4660-b3e0-4e913cf96e45 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:12.083606 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f27c80ee-4565-4660-b3e0-4e913cf96e45 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1361 microversion: 2.1 time: 0.096694 Aug 03 02:40:12.084023 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3226/6330] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:11 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1361 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:13.106836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-21c8a5b5-f6b0-4237-8232-66faccc5d8ea tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:13.108518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-21c8a5b5-f6b0-4237-8232-66faccc5d8ea tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:13.115106 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21c8a5b5-f6b0-4237-8232-66faccc5d8ea tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:13.115573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21c8a5b5-f6b0-4237-8232-66faccc5d8ea tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:13.116367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21c8a5b5-f6b0-4237-8232-66faccc5d8ea tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:13.116822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21c8a5b5-f6b0-4237-8232-66faccc5d8ea tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:13.182722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-21c8a5b5-f6b0-4237-8232-66faccc5d8ea tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:13.191149 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-21c8a5b5-f6b0-4237-8232-66faccc5d8ea tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1361 microversion: 2.1 time: 0.088176 Aug 03 02:40:13.191737 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3105/6331] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:13 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1361 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:14.212022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ef68f94b-3e2f-41fe-8d0d-1748c2815b51 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:14.212644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ef68f94b-3e2f-41fe-8d0d-1748c2815b51 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:14.220093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef68f94b-3e2f-41fe-8d0d-1748c2815b51 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:14.220558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef68f94b-3e2f-41fe-8d0d-1748c2815b51 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:14.221674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef68f94b-3e2f-41fe-8d0d-1748c2815b51 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:14.221815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef68f94b-3e2f-41fe-8d0d-1748c2815b51 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:14.292470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ef68f94b-3e2f-41fe-8d0d-1748c2815b51 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:14.301692 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ef68f94b-3e2f-41fe-8d0d-1748c2815b51 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1361 microversion: 2.1 time: 0.093322 Aug 03 02:40:14.302192 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3227/6332] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:14 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1361 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:15.325003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eaf87970-665f-4ea1-9dd2-105863748bb9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:15.325671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eaf87970-665f-4ea1-9dd2-105863748bb9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:15.340989 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eaf87970-665f-4ea1-9dd2-105863748bb9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:15.341464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eaf87970-665f-4ea1-9dd2-105863748bb9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:15.342274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eaf87970-665f-4ea1-9dd2-105863748bb9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:15.342729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eaf87970-665f-4ea1-9dd2-105863748bb9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:15.384468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eaf87970-665f-4ea1-9dd2-105863748bb9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:15.384853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eaf87970-665f-4ea1-9dd2-105863748bb9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:15.385310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-eaf87970-665f-4ea1-9dd2-105863748bb9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lazy-loading 'fault' on Instance uuid 00465333-61a9-49ca-9284-b663bce26dab {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:40:15.428251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eaf87970-665f-4ea1-9dd2-105863748bb9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:15.437088 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eaf87970-665f-4ea1-9dd2-105863748bb9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 200 len: 1366 microversion: 2.1 time: 0.117219 Aug 03 02:40:15.438618 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3106/6333] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:15 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:16.460286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0f7c2ba9-d436-407c-828b-7d9adefe54a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:16.460843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0f7c2ba9-d436-407c-828b-7d9adefe54a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:16.468306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0f7c2ba9-d436-407c-828b-7d9adefe54a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:16.469372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0f7c2ba9-d436-407c-828b-7d9adefe54a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:16.470192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0f7c2ba9-d436-407c-828b-7d9adefe54a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:16.470648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0f7c2ba9-d436-407c-828b-7d9adefe54a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:16.485200 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-0f7c2ba9-d436-407c-828b-7d9adefe54a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0f7c2ba9-d436-407c-828b-7d9adefe54a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab HTTP/1.1 Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '00465333-61a9-49ca-9284-b663bce26dab'} Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:40:16.487031 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:16.493712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:16.493712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:40:16.493712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:40:16.493712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:40:16.493712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:40:16.493712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. Aug 03 02:40:16.493712 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:16.493712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0f7c2ba9-d436-407c-828b-7d9adefe54a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:40:16.493712 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0f7c2ba9-d436-407c-828b-7d9adefe54a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 404 len: 111 microversion: 2.1 time: 0.032534 Aug 03 02:40:16.493712 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3228/6334] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:16 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:40:20.789544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-82d97343-c7b3-4879-96d0-cded5ce44fb7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:20.790179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-82d97343-c7b3-4879-96d0-cded5ce44fb7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:20.796422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-82d97343-c7b3-4879-96d0-cded5ce44fb7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:20.797473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-82d97343-c7b3-4879-96d0-cded5ce44fb7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:20.798297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-82d97343-c7b3-4879-96d0-cded5ce44fb7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:20.798748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-82d97343-c7b3-4879-96d0-cded5ce44fb7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:20.827102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-82d97343-c7b3-4879-96d0-cded5ce44fb7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:40:20.916255 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-82d97343-c7b3-4879-96d0-cded5ce44fb7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 204 len: 0 microversion: 2.1 time: 0.131501 Aug 03 02:40:20.917150 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3107/6335] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:40:20 2022] DELETE /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:40:20.927457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1184a572-b674-421f-b512-9dfdb2609c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:20.928092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1184a572-b674-421f-b512-9dfdb2609c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:20.935027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1184a572-b674-421f-b512-9dfdb2609c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:20.935529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1184a572-b674-421f-b512-9dfdb2609c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:20.936345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1184a572-b674-421f-b512-9dfdb2609c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:20.936870 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1184a572-b674-421f-b512-9dfdb2609c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:21.094183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1184a572-b674-421f-b512-9dfdb2609c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:21.105801 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1184a572-b674-421f-b512-9dfdb2609c3e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1408 microversion: 2.1 time: 0.183960 Aug 03 02:40:21.106749 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3229/6336] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:20 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:22.136379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-62efd1a0-37cd-41aa-8623-d270b6dd297e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:22.137085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-62efd1a0-37cd-41aa-8623-d270b6dd297e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:22.139854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:40:22.147521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62efd1a0-37cd-41aa-8623-d270b6dd297e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:22.148028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62efd1a0-37cd-41aa-8623-d270b6dd297e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:22.148841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62efd1a0-37cd-41aa-8623-d270b6dd297e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:22.149275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-62efd1a0-37cd-41aa-8623-d270b6dd297e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:22.152662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:40:22.291145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-62efd1a0-37cd-41aa-8623-d270b6dd297e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:22.299041 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-62efd1a0-37cd-41aa-8623-d270b6dd297e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1408 microversion: 2.1 time: 0.167130 Aug 03 02:40:22.300169 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3108/6337] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:22 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:23.163625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-8a321889-eb71-4ca9-a36a-9527fceef8e5 req-a4933147-84c6-4394-94bd-41df9f25fee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed3ffd1-b289-4409-aefc-2457775b0a25", "name": "network-vif-deleted", "tag": "47665d7e-177a-4cfc-ba5c-f629cd4ace7d"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:40:23.170863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:40:23.177628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8a321889-eb71-4ca9-a36a-9527fceef8e5 req-a4933147-84c6-4394-94bd-41df9f25fee9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:23.178148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8a321889-eb71-4ca9-a36a-9527fceef8e5 req-a4933147-84c6-4394-94bd-41df9f25fee9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:23.182658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:40:23.192735 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-8a321889-eb71-4ca9-a36a-9527fceef8e5 req-a4933147-84c6-4394-94bd-41df9f25fee9 service nova] Creating event network-vif-deleted:47665d7e-177a-4cfc-ba5c-f629cd4ace7d for instance bed3ffd1-b289-4409-aefc-2457775b0a25 on n-h1-826529-8 Aug 03 02:40:23.198181 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-8a321889-eb71-4ca9-a36a-9527fceef8e5 req-a4933147-84c6-4394-94bd-41df9f25fee9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038935 Aug 03 02:40:23.198782 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3230/6338] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:40:23.321736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6c03cbe5-8993-436c-8b6d-660074980114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:23.322285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6c03cbe5-8993-436c-8b6d-660074980114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:23.329507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c03cbe5-8993-436c-8b6d-660074980114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:23.329970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c03cbe5-8993-436c-8b6d-660074980114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:23.331545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c03cbe5-8993-436c-8b6d-660074980114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:23.331998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c03cbe5-8993-436c-8b6d-660074980114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:23.398997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6c03cbe5-8993-436c-8b6d-660074980114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:23.406746 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6c03cbe5-8993-436c-8b6d-660074980114 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1201 microversion: 2.1 time: 0.089020 Aug 03 02:40:23.407359 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3109/6339] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:23 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:24.430143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0cd61286-b155-4ed6-9526-e14e4c9f8156 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:24.430749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0cd61286-b155-4ed6-9526-e14e4c9f8156 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:24.437637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cd61286-b155-4ed6-9526-e14e4c9f8156 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:24.438108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cd61286-b155-4ed6-9526-e14e4c9f8156 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:24.438996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cd61286-b155-4ed6-9526-e14e4c9f8156 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:24.439395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0cd61286-b155-4ed6-9526-e14e4c9f8156 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:24.506494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0cd61286-b155-4ed6-9526-e14e4c9f8156 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:24.514554 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0cd61286-b155-4ed6-9526-e14e4c9f8156 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1201 microversion: 2.1 time: 0.090679 Aug 03 02:40:24.515178 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3231/6340] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:24 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:25.537067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a8e14017-5808-4c77-a327-886bab5b8e3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:25.537722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a8e14017-5808-4c77-a327-886bab5b8e3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:25.545046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8e14017-5808-4c77-a327-886bab5b8e3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:25.545502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8e14017-5808-4c77-a327-886bab5b8e3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:25.546289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8e14017-5808-4c77-a327-886bab5b8e3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:25.546736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8e14017-5808-4c77-a327-886bab5b8e3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:25.614793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a8e14017-5808-4c77-a327-886bab5b8e3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:25.622861 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a8e14017-5808-4c77-a327-886bab5b8e3d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1201 microversion: 2.1 time: 0.089775 Aug 03 02:40:25.623483 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3110/6341] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:25 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:26.644726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fd3a58f8-5541-43c0-a6c9-48d7323be0fe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:26.645392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fd3a58f8-5541-43c0-a6c9-48d7323be0fe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:26.652563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd3a58f8-5541-43c0-a6c9-48d7323be0fe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:26.653021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd3a58f8-5541-43c0-a6c9-48d7323be0fe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:26.653818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd3a58f8-5541-43c0-a6c9-48d7323be0fe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:26.654282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd3a58f8-5541-43c0-a6c9-48d7323be0fe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:26.722229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fd3a58f8-5541-43c0-a6c9-48d7323be0fe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:26.731744 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fd3a58f8-5541-43c0-a6c9-48d7323be0fe tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1201 microversion: 2.1 time: 0.091004 Aug 03 02:40:26.732324 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3232/6342] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:26 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:27.753269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d02e3675-41c2-4843-8b57-8d776d02cff1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:27.753892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d02e3675-41c2-4843-8b57-8d776d02cff1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:27.761395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d02e3675-41c2-4843-8b57-8d776d02cff1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:27.762075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d02e3675-41c2-4843-8b57-8d776d02cff1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:27.762860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d02e3675-41c2-4843-8b57-8d776d02cff1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:27.763341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d02e3675-41c2-4843-8b57-8d776d02cff1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:27.799712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d02e3675-41c2-4843-8b57-8d776d02cff1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:27.800364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d02e3675-41c2-4843-8b57-8d776d02cff1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:27.801020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-d02e3675-41c2-4843-8b57-8d776d02cff1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lazy-loading 'fault' on Instance uuid bed3ffd1-b289-4409-aefc-2457775b0a25 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:40:27.849372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d02e3675-41c2-4843-8b57-8d776d02cff1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:27.856237 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d02e3675-41c2-4843-8b57-8d776d02cff1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 200 len: 1160 microversion: 2.1 time: 0.107737 Aug 03 02:40:27.856812 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3111/6343] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:27 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 1160 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:28.878017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c6e01886-16f0-48e2-adda-a65065ceeda2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:28.878715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c6e01886-16f0-48e2-adda-a65065ceeda2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:28.886263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6e01886-16f0-48e2-adda-a65065ceeda2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:28.886721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6e01886-16f0-48e2-adda-a65065ceeda2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:28.887616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6e01886-16f0-48e2-adda-a65065ceeda2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:28.888064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c6e01886-16f0-48e2-adda-a65065ceeda2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:28.904255 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-c6e01886-16f0-48e2-adda-a65065ceeda2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c6e01886-16f0-48e2-adda-a65065ceeda2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 HTTP/1.1 Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'bed3ffd1-b289-4409-aefc-2457775b0a25'} Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:40:28.905928 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:28.910947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:28.910947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:40:28.910947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:40:28.910947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:40:28.910947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:40:28.910947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. Aug 03 02:40:28.910947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:28.910947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c6e01886-16f0-48e2-adda-a65065ceeda2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:40:28.910947 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c6e01886-16f0-48e2-adda-a65065ceeda2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 404 len: 111 microversion: 2.1 time: 0.034093 Aug 03 02:40:28.910947 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3233/6344] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:28 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:40:31.056149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-427f81d1-7019-4a74-abf6-3f325382415e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:31.056679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-427f81d1-7019-4a74-abf6-3f325382415e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:31.064227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-427f81d1-7019-4a74-abf6-3f325382415e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:31.065136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-427f81d1-7019-4a74-abf6-3f325382415e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:31.065946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-427f81d1-7019-4a74-abf6-3f325382415e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:31.066382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-427f81d1-7019-4a74-abf6-3f325382415e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:31.084009 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-427f81d1-7019-4a74-abf6-3f325382415e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-427f81d1-7019-4a74-abf6-3f325382415e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab HTTP/1.1 Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '00465333-61a9-49ca-9284-b663bce26dab'} Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:40:31.085692 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:40:31.089918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. Aug 03 02:40:31.089918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.089918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:40:31.089918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.089918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:31.089918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:40:31.089918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:40:31.089918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:40:31.089918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:40:31.089918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. Aug 03 02:40:31.089918 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.089918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-427f81d1-7019-4a74-abf6-3f325382415e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:40:31.089918 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-427f81d1-7019-4a74-abf6-3f325382415e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "DELETE /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 404 len: 111 microversion: 2.1 time: 0.035686 Aug 03 02:40:31.089918 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3112/6345] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:40:31 2022] DELETE /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:40:31.096902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1e0b0cde-8563-4d99-8107-4b72861257c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:31.097421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1e0b0cde-8563-4d99-8107-4b72861257c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: 00465333-61a9-49ca-9284-b663bce26dab] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:31.104390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e0b0cde-8563-4d99-8107-4b72861257c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:31.104852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e0b0cde-8563-4d99-8107-4b72861257c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:31.105631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e0b0cde-8563-4d99-8107-4b72861257c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:31.106077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1e0b0cde-8563-4d99-8107-4b72861257c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:31.119995 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-1e0b0cde-8563-4d99-8107-4b72861257c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1e0b0cde-8563-4d99-8107-4b72861257c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab HTTP/1.1 Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '00465333-61a9-49ca-9284-b663bce26dab'} Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:40:31.121548 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.126454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:31.126454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:40:31.126454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:40:31.126454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:40:31.126454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:40:31.126454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. Aug 03 02:40:31.126454 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.126454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1e0b0cde-8563-4d99-8107-4b72861257c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance 00465333-61a9-49ca-9284-b663bce26dab could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:40:31.126454 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1e0b0cde-8563-4d99-8107-4b72861257c2 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab" status: 404 len: 111 microversion: 2.1 time: 0.030953 Aug 03 02:40:31.126454 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3234/6346] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:31 2022] GET /compute/v2.1/servers/00465333-61a9-49ca-9284-b663bce26dab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:40:31.512234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e9980aa1-e019-4949-b81d-29777353a12e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:31.512737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e9980aa1-e019-4949-b81d-29777353a12e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:31.520218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9980aa1-e019-4949-b81d-29777353a12e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:31.520672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9980aa1-e019-4949-b81d-29777353a12e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:31.521438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9980aa1-e019-4949-b81d-29777353a12e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:31.521873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9980aa1-e019-4949-b81d-29777353a12e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:31.536595 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-e9980aa1-e019-4949-b81d-29777353a12e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e9980aa1-e019-4949-b81d-29777353a12e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 HTTP/1.1 Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'bed3ffd1-b289-4409-aefc-2457775b0a25'} Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:40:31.538061 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:40:31.542994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. Aug 03 02:40:31.542994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.542994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:40:31.542994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.542994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:31.542994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:40:31.542994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:40:31.542994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:40:31.542994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:40:31.542994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. Aug 03 02:40:31.542994 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.542994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e9980aa1-e019-4949-b81d-29777353a12e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:40:31.542994 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e9980aa1-e019-4949-b81d-29777353a12e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 404 len: 111 microversion: 2.1 time: 0.031395 Aug 03 02:40:31.542994 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3113/6347] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:40:31 2022] DELETE /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:40:31.548167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-69ab5ee9-6850-496e-b7a6-03e4864ab951 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:31.549520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-69ab5ee9-6850-496e-b7a6-03e4864ab951 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: bed3ffd1-b289-4409-aefc-2457775b0a25] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:31.555673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69ab5ee9-6850-496e-b7a6-03e4864ab951 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:31.556140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69ab5ee9-6850-496e-b7a6-03e4864ab951 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:31.556927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69ab5ee9-6850-496e-b7a6-03e4864ab951 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:31.557382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-69ab5ee9-6850-496e-b7a6-03e4864ab951 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:31.570938 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-69ab5ee9-6850-496e-b7a6-03e4864ab951 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-69ab5ee9-6850-496e-b7a6-03e4864ab951 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 HTTP/1.1 Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'bed3ffd1-b289-4409-aefc-2457775b0a25'} Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:40:31.572478 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.577863 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:40:31.577863 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:40:31.577863 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:40:31.577863 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:40:31.577863 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:40:31.577863 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. Aug 03 02:40:31.577863 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:40:31.577863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-69ab5ee9-6850-496e-b7a6-03e4864ab951 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance bed3ffd1-b289-4409-aefc-2457775b0a25 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:40:31.577863 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-69ab5ee9-6850-496e-b7a6-03e4864ab951 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25" status: 404 len: 111 microversion: 2.1 time: 0.029579 Aug 03 02:40:31.578575 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3235/6348] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:31 2022] GET /compute/v2.1/servers/bed3ffd1-b289-4409-aefc-2457775b0a25 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:40:31.650375 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e5d2d7df-d24a-45a4-aa83-531226b778f0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Action: 'create', calling method: .version_select at 0x7f5b243fde50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2109864592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbDs2kUN9OgrzNbH/ZzvL2FP5oGhvOif6t97uo7wsHO1KF7osaexj6+6wA4tn/0oWedQqIbGgkWIWr7HXBnQ2sgS+/dbmGY+ZCB+oBBwmlnqnd69H/8NpDoFUW5BvzgBw=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:40:31.666068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-e5d2d7df-d24a-45a4-aa83-531226b778f0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:40:31.671358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-e5d2d7df-d24a-45a4-aa83-531226b778f0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for user 1114641f11954d74885d0e4b082d7704 and project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:40:31.698028 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e5d2d7df-d24a-45a4-aa83-531226b778f0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.051587 Aug 03 02:40:31.698627 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3114/6349] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:40:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:40:47.972438 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1257695282", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2109864592", "security_groups": [{"name": "tempest-secgroup-smoke-426748971"}], "block_device_mapping_v2": [{"uuid": "789f700b-753c-4da6-9e79-3ca5805dff26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5eae0150-a7f5-4e00-b929-5ba4bf7b1156"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:40:47.982417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=11 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:40:47.983112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=19 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:40:48.093137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] validate_networks() for [('5eae0150-a7f5-4e00-b929-5ba4bf7b1156', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:40:48.789957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:40:48.790405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:40:48.790919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:40:48.791360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:40:48.791792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:40:48.801149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:48.801618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:48.802447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:48.802925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:48.820713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:40:48.825982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for user 1114641f11954d74885d0e4b082d7704 and project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:40:48.884633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:40:48.886777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='789f700b-753c-4da6-9e79-3ca5805dff26',volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:40:49.018251 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1db8976e-54a7-48ea-996d-0182bb53fc71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.049894 Aug 03 02:40:49.019247 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3236/6350] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:40:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 02:40:49.027629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=29 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:40:49.028423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:40:49.029261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:40:49.034022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7085f678-93cc-4d7c-a395-fd41caf87169 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:49.034665 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7085f678-93cc-4d7c-a395-fd41caf87169 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:49.094113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7085f678-93cc-4d7c-a395-fd41caf87169 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:49.101999 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7085f678-93cc-4d7c-a395-fd41caf87169 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1095 microversion: 2.1 time: 0.076139 Aug 03 02:40:49.102530 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3115/6351] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:49 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:50.124456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8808fb18-4cec-4c87-9408-85d4d13b1843 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:50.125362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8808fb18-4cec-4c87-9408-85d4d13b1843 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:50.133816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8808fb18-4cec-4c87-9408-85d4d13b1843 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:50.134543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8808fb18-4cec-4c87-9408-85d4d13b1843 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:50.135575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8808fb18-4cec-4c87-9408-85d4d13b1843 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:50.136029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8808fb18-4cec-4c87-9408-85d4d13b1843 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:50.218693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8808fb18-4cec-4c87-9408-85d4d13b1843 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:50.228893 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8808fb18-4cec-4c87-9408-85d4d13b1843 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1211 microversion: 2.1 time: 0.108424 Aug 03 02:40:50.229688 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3237/6352] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:50 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:51.251060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-06ec3980-7b52-466f-90ce-30dabcf4c355 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:51.252882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-06ec3980-7b52-466f-90ce-30dabcf4c355 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:51.261676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06ec3980-7b52-466f-90ce-30dabcf4c355 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:51.262725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06ec3980-7b52-466f-90ce-30dabcf4c355 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:51.264023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06ec3980-7b52-466f-90ce-30dabcf4c355 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:51.264945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-06ec3980-7b52-466f-90ce-30dabcf4c355 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:51.584404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-06ec3980-7b52-466f-90ce-30dabcf4c355 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:51.598576 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-06ec3980-7b52-466f-90ce-30dabcf4c355 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1278 microversion: 2.1 time: 0.351823 Aug 03 02:40:51.616677 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3116/6353] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:51 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1278 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:51.732658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-28fa1f38-a2be-4388-ae88-55c99d1a28af req-2e768d6b-461e-4142-a64e-5dd579adde53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f176db0d-6e6c-440d-bb11-45c90194f8f1", "tag": "840f28a4-bb5e-4a40-bbf6-ee10b2d4d7ce"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:40:51.763629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-28fa1f38-a2be-4388-ae88-55c99d1a28af req-2e768d6b-461e-4142-a64e-5dd579adde53 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:51.764469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-28fa1f38-a2be-4388-ae88-55c99d1a28af req-2e768d6b-461e-4142-a64e-5dd579adde53 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:51.778862 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-28fa1f38-a2be-4388-ae88-55c99d1a28af req-2e768d6b-461e-4142-a64e-5dd579adde53 service nova] Creating event network-changed:840f28a4-bb5e-4a40-bbf6-ee10b2d4d7ce for instance f176db0d-6e6c-440d-bb11-45c90194f8f1 on n-h2-826529-8 Aug 03 02:40:51.785713 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-28fa1f38-a2be-4388-ae88-55c99d1a28af req-2e768d6b-461e-4142-a64e-5dd579adde53 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069760 Aug 03 02:40:51.787160 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3238/6354] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:40:52.621657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e1b938f2-5d47-40d8-ad2b-efc1c18a1c04 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:52.622292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e1b938f2-5d47-40d8-ad2b-efc1c18a1c04 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:52.629772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1b938f2-5d47-40d8-ad2b-efc1c18a1c04 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:52.630227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1b938f2-5d47-40d8-ad2b-efc1c18a1c04 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:52.631056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1b938f2-5d47-40d8-ad2b-efc1c18a1c04 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:52.631499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1b938f2-5d47-40d8-ad2b-efc1c18a1c04 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:52.825879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e1b938f2-5d47-40d8-ad2b-efc1c18a1c04 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:52.834788 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e1b938f2-5d47-40d8-ad2b-efc1c18a1c04 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1278 microversion: 2.1 time: 0.217073 Aug 03 02:40:52.835657 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3117/6355] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:52 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1278 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:53.858072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0735bfe4-120d-4e20-a5a1-1920ac192727 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:53.858792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0735bfe4-120d-4e20-a5a1-1920ac192727 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:53.865700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0735bfe4-120d-4e20-a5a1-1920ac192727 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:53.866168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0735bfe4-120d-4e20-a5a1-1920ac192727 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:53.867019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0735bfe4-120d-4e20-a5a1-1920ac192727 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:53.867478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0735bfe4-120d-4e20-a5a1-1920ac192727 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:54.018555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0735bfe4-120d-4e20-a5a1-1920ac192727 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:54.026846 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0735bfe4-120d-4e20-a5a1-1920ac192727 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1278 microversion: 2.1 time: 0.173854 Aug 03 02:40:54.027568 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3239/6356] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:53 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:55.048013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-88d4565e-1b45-4e68-a561-97a0850f2f14 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:55.049861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-88d4565e-1b45-4e68-a561-97a0850f2f14 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:55.057859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88d4565e-1b45-4e68-a561-97a0850f2f14 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:55.058632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88d4565e-1b45-4e68-a561-97a0850f2f14 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:55.059561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88d4565e-1b45-4e68-a561-97a0850f2f14 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:55.060082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88d4565e-1b45-4e68-a561-97a0850f2f14 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:55.225376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-88d4565e-1b45-4e68-a561-97a0850f2f14 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:55.237393 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-88d4565e-1b45-4e68-a561-97a0850f2f14 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1278 microversion: 2.1 time: 0.193253 Aug 03 02:40:55.247703 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3118/6357] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:55 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:56.259228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ad0b2ac9-bf2b-488c-8282-3bfa50daf990 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:56.259842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ad0b2ac9-bf2b-488c-8282-3bfa50daf990 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:56.267111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad0b2ac9-bf2b-488c-8282-3bfa50daf990 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:56.268738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad0b2ac9-bf2b-488c-8282-3bfa50daf990 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:56.269542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad0b2ac9-bf2b-488c-8282-3bfa50daf990 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:56.269996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ad0b2ac9-bf2b-488c-8282-3bfa50daf990 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:56.413558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ad0b2ac9-bf2b-488c-8282-3bfa50daf990 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:56.421304 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ad0b2ac9-bf2b-488c-8282-3bfa50daf990 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1266 microversion: 2.1 time: 0.166198 Aug 03 02:40:56.421883 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3240/6358] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:56 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:57.443020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8c5c416e-b1cf-41b5-91bd-3be65db35f73 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:57.443605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8c5c416e-b1cf-41b5-91bd-3be65db35f73 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:57.450808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c5c416e-b1cf-41b5-91bd-3be65db35f73 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:57.451293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c5c416e-b1cf-41b5-91bd-3be65db35f73 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:57.452082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c5c416e-b1cf-41b5-91bd-3be65db35f73 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:57.452519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8c5c416e-b1cf-41b5-91bd-3be65db35f73 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:57.606137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8c5c416e-b1cf-41b5-91bd-3be65db35f73 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:57.614473 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8c5c416e-b1cf-41b5-91bd-3be65db35f73 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1266 microversion: 2.1 time: 0.176154 Aug 03 02:40:57.615093 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3119/6359] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:57 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:40:58.636658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0a1bcce6-daf1-4dc6-b9f2-7474d751c12f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:58.637336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0a1bcce6-daf1-4dc6-b9f2-7474d751c12f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:58.645291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a1bcce6-daf1-4dc6-b9f2-7474d751c12f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:58.645756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a1bcce6-daf1-4dc6-b9f2-7474d751c12f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:58.646553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a1bcce6-daf1-4dc6-b9f2-7474d751c12f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:58.647039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a1bcce6-daf1-4dc6-b9f2-7474d751c12f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:58.786482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a1bcce6-daf1-4dc6-b9f2-7474d751c12f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:58.794233 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0a1bcce6-daf1-4dc6-b9f2-7474d751c12f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1266 microversion: 2.1 time: 0.161781 Aug 03 02:40:58.794918 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3241/6360] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:58 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:40:59.816971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e566672d-970e-4917-8308-b9905827abed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:40:59.817594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e566672d-970e-4917-8308-b9905827abed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:40:59.820477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:40:59.834196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e566672d-970e-4917-8308-b9905827abed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:59.834666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e566672d-970e-4917-8308-b9905827abed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:59.835509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e566672d-970e-4917-8308-b9905827abed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:40:59.835966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e566672d-970e-4917-8308-b9905827abed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:40:59.979786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e566672d-970e-4917-8308-b9905827abed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:40:59.987533 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e566672d-970e-4917-8308-b9905827abed tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1266 microversion: 2.1 time: 0.175159 Aug 03 02:40:59.988131 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3120/6361] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:40:59 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:41:01.008289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0449aa9f-0e83-4f60-abf2-55460f2e0a37 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:41:01.008883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0449aa9f-0e83-4f60-abf2-55460f2e0a37 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:41:01.011108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:41:01.011866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:41:01.019941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0449aa9f-0e83-4f60-abf2-55460f2e0a37 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:01.020411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0449aa9f-0e83-4f60-abf2-55460f2e0a37 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:01.021219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0449aa9f-0e83-4f60-abf2-55460f2e0a37 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:01.021676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0449aa9f-0e83-4f60-abf2-55460f2e0a37 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:01.162523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0449aa9f-0e83-4f60-abf2-55460f2e0a37 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:41:01.170156 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0449aa9f-0e83-4f60-abf2-55460f2e0a37 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1266 microversion: 2.1 time: 0.165855 Aug 03 02:41:01.170722 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3242/6362] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:41:01 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:41:02.191811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0b191af5-f1bc-4a88-9801-2429ed2a0759 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:41:02.192565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0b191af5-f1bc-4a88-9801-2429ed2a0759 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:41:02.199866 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b191af5-f1bc-4a88-9801-2429ed2a0759 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:02.200331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b191af5-f1bc-4a88-9801-2429ed2a0759 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:02.201121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b191af5-f1bc-4a88-9801-2429ed2a0759 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:02.201565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b191af5-f1bc-4a88-9801-2429ed2a0759 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:02.352656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0b191af5-f1bc-4a88-9801-2429ed2a0759 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:41:02.361178 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0b191af5-f1bc-4a88-9801-2429ed2a0759 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1266 microversion: 2.1 time: 0.173643 Aug 03 02:41:02.361786 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3121/6363] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:41:02 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:41:03.383050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-645d4385-022a-4469-aced-a447730e9c08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:41:03.383683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-645d4385-022a-4469-aced-a447730e9c08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:41:03.390984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-645d4385-022a-4469-aced-a447730e9c08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:03.391458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-645d4385-022a-4469-aced-a447730e9c08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:03.392254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-645d4385-022a-4469-aced-a447730e9c08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:03.392714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-645d4385-022a-4469-aced-a447730e9c08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:03.532595 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-645d4385-022a-4469-aced-a447730e9c08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:41:03.540361 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-645d4385-022a-4469-aced-a447730e9c08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1266 microversion: 2.1 time: 0.161365 Aug 03 02:41:03.540928 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3243/6364] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:41:03 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:41:04.319381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-3e7b92da-8e4b-4f7b-b332-604b2d2d268b req-ddee9203-eca7-4cf7-a87f-94e44e1f45f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f176db0d-6e6c-440d-bb11-45c90194f8f1", "name": "network-vif-plugged", "status": "completed", "tag": "840f28a4-bb5e-4a40-bbf6-ee10b2d4d7ce"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:41:04.332382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3e7b92da-8e4b-4f7b-b332-604b2d2d268b req-ddee9203-eca7-4cf7-a87f-94e44e1f45f3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:04.333025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3e7b92da-8e4b-4f7b-b332-604b2d2d268b req-ddee9203-eca7-4cf7-a87f-94e44e1f45f3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:04.344409 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-3e7b92da-8e4b-4f7b-b332-604b2d2d268b req-ddee9203-eca7-4cf7-a87f-94e44e1f45f3 service nova] Creating event network-vif-plugged:840f28a4-bb5e-4a40-bbf6-ee10b2d4d7ce for instance f176db0d-6e6c-440d-bb11-45c90194f8f1 on n-h2-826529-8 Aug 03 02:41:04.349577 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-3e7b92da-8e4b-4f7b-b332-604b2d2d268b req-ddee9203-eca7-4cf7-a87f-94e44e1f45f3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034708 Aug 03 02:41:04.350444 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3122/6365] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:41:04.561566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e3eaca50-41dd-44a3-b337-bc083c6859d1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:41:04.562193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e3eaca50-41dd-44a3-b337-bc083c6859d1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:41:04.570275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3eaca50-41dd-44a3-b337-bc083c6859d1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:04.570742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3eaca50-41dd-44a3-b337-bc083c6859d1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:04.571566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3eaca50-41dd-44a3-b337-bc083c6859d1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:04.572018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3eaca50-41dd-44a3-b337-bc083c6859d1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:04.708594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3eaca50-41dd-44a3-b337-bc083c6859d1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:41:04.716541 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e3eaca50-41dd-44a3-b337-bc083c6859d1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1266 microversion: 2.1 time: 0.158830 Aug 03 02:41:04.717016 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3244/6366] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:41:04 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:41:05.738841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cf02edc4-4ca3-4db3-9980-0cea4ed94bc7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:41:05.739570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cf02edc4-4ca3-4db3-9980-0cea4ed94bc7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:41:05.746503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf02edc4-4ca3-4db3-9980-0cea4ed94bc7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:05.747043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf02edc4-4ca3-4db3-9980-0cea4ed94bc7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:05.747762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf02edc4-4ca3-4db3-9980-0cea4ed94bc7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:05.748206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf02edc4-4ca3-4db3-9980-0cea4ed94bc7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:05.892503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cf02edc4-4ca3-4db3-9980-0cea4ed94bc7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:41:05.902113 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cf02edc4-4ca3-4db3-9980-0cea4ed94bc7 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1266 microversion: 2.1 time: 0.168868 Aug 03 02:41:05.902939 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3123/6367] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:41:05 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:41:06.922991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bb2b3450-a758-4713-bf2a-77bb15b97ca3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:41:06.923651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bb2b3450-a758-4713-bf2a-77bb15b97ca3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:41:06.931723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb2b3450-a758-4713-bf2a-77bb15b97ca3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:06.932189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb2b3450-a758-4713-bf2a-77bb15b97ca3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:06.932981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb2b3450-a758-4713-bf2a-77bb15b97ca3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:06.933433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb2b3450-a758-4713-bf2a-77bb15b97ca3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:07.076198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bb2b3450-a758-4713-bf2a-77bb15b97ca3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:41:07.085638 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bb2b3450-a758-4713-bf2a-77bb15b97ca3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1452 microversion: 2.1 time: 0.166524 Aug 03 02:41:07.086227 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3245/6368] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:41:06 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:41:07.107238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-883ce026-94da-4f47-a61c-6dd83bea51a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:41:07.107968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-883ce026-94da-4f47-a61c-6dd83bea51a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:41:07.115921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-883ce026-94da-4f47-a61c-6dd83bea51a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:07.116381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-883ce026-94da-4f47-a61c-6dd83bea51a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:07.117211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-883ce026-94da-4f47-a61c-6dd83bea51a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:07.117673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-883ce026-94da-4f47-a61c-6dd83bea51a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:07.254381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-883ce026-94da-4f47-a61c-6dd83bea51a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:41:07.262836 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-883ce026-94da-4f47-a61c-6dd83bea51a5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1452 microversion: 2.1 time: 0.159577 Aug 03 02:41:07.263517 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3124/6369] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:41:07 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:41:09.240450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-12463249-245a-4e8f-8bab-9d62b0f47a1b req-6694281e-2b77-47d9-8768-953d162c88c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f176db0d-6e6c-440d-bb11-45c90194f8f1", "tag": "840f28a4-bb5e-4a40-bbf6-ee10b2d4d7ce"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:41:09.251028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-12463249-245a-4e8f-8bab-9d62b0f47a1b req-6694281e-2b77-47d9-8768-953d162c88c0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:41:09.251488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-12463249-245a-4e8f-8bab-9d62b0f47a1b req-6694281e-2b77-47d9-8768-953d162c88c0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:41:09.263964 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-12463249-245a-4e8f-8bab-9d62b0f47a1b req-6694281e-2b77-47d9-8768-953d162c88c0 service nova] Creating event network-changed:840f28a4-bb5e-4a40-bbf6-ee10b2d4d7ce for instance f176db0d-6e6c-440d-bb11-45c90194f8f1 on n-h2-826529-8 Aug 03 02:41:09.270259 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-12463249-245a-4e8f-8bab-9d62b0f47a1b req-6694281e-2b77-47d9-8768-953d162c88c0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033887 Aug 03 02:41:09.270856 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3246/6370] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:42:39.606858 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:42:39.607615 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 02:42:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:42:39.698573 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:42:39.699351 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 02:42:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:42:39.723465 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:42:39.723656 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 02:42:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:43:08.967165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=22 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:43:08.967998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=50 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:43:09.022717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1a6bc7ac-310a-4a5e-9018-92980a176f88 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:09.023304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1a6bc7ac-310a-4a5e-9018-92980a176f88 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:09.029822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a6bc7ac-310a-4a5e-9018-92980a176f88 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:09.030282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a6bc7ac-310a-4a5e-9018-92980a176f88 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:09.031099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a6bc7ac-310a-4a5e-9018-92980a176f88 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:09.031544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a6bc7ac-310a-4a5e-9018-92980a176f88 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:09.058026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1a6bc7ac-310a-4a5e-9018-92980a176f88 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:43:09.138010 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1a6bc7ac-310a-4a5e-9018-92980a176f88 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 204 len: 0 microversion: 2.1 time: 0.172533 Aug 03 02:43:09.138637 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3125/6371] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:43:08 2022] DELETE /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:43:09.151506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:43:09.152262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=54 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:43:09.156295 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1b9cf53f-7f42-49d3-ac75-102ffaec6456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:09.156995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1b9cf53f-7f42-49d3-ac75-102ffaec6456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:09.164254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b9cf53f-7f42-49d3-ac75-102ffaec6456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:09.164715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b9cf53f-7f42-49d3-ac75-102ffaec6456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:09.165490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b9cf53f-7f42-49d3-ac75-102ffaec6456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:09.165940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b9cf53f-7f42-49d3-ac75-102ffaec6456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:09.305808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1b9cf53f-7f42-49d3-ac75-102ffaec6456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:09.313373 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1b9cf53f-7f42-49d3-ac75-102ffaec6456 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1577 microversion: 2.1 time: 0.164162 Aug 03 02:43:09.313928 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3247/6372] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:09 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:10.336096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1825a930-84a9-426d-b8f2-d6fe2a87c1bf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:10.336800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1825a930-84a9-426d-b8f2-d6fe2a87c1bf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:10.344095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1825a930-84a9-426d-b8f2-d6fe2a87c1bf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:10.344552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1825a930-84a9-426d-b8f2-d6fe2a87c1bf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:10.345338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1825a930-84a9-426d-b8f2-d6fe2a87c1bf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:10.345783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1825a930-84a9-426d-b8f2-d6fe2a87c1bf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:10.539423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1825a930-84a9-426d-b8f2-d6fe2a87c1bf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:10.547700 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1825a930-84a9-426d-b8f2-d6fe2a87c1bf tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1577 microversion: 2.1 time: 0.216552 Aug 03 02:43:10.548285 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3126/6373] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:10 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:11.570371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-16f3a9a5-60d2-4b5b-90af-8f58f50ad1c6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:11.571761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-16f3a9a5-60d2-4b5b-90af-8f58f50ad1c6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:11.579312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16f3a9a5-60d2-4b5b-90af-8f58f50ad1c6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:11.579791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16f3a9a5-60d2-4b5b-90af-8f58f50ad1c6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:11.580596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16f3a9a5-60d2-4b5b-90af-8f58f50ad1c6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:11.581029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16f3a9a5-60d2-4b5b-90af-8f58f50ad1c6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:11.678388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-16f3a9a5-60d2-4b5b-90af-8f58f50ad1c6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:11.686386 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-16f3a9a5-60d2-4b5b-90af-8f58f50ad1c6 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1510 microversion: 2.1 time: 0.120556 Aug 03 02:43:11.686989 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3248/6374] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:11 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1510 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:11.924542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-30639160-8b01-4b76-a3f9-fcd6484d20f4 req-f79d2611-1afa-48a1-9abb-7c1108a7014a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f176db0d-6e6c-440d-bb11-45c90194f8f1", "name": "network-vif-deleted", "tag": "840f28a4-bb5e-4a40-bbf6-ee10b2d4d7ce"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:43:11.938991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-30639160-8b01-4b76-a3f9-fcd6484d20f4 req-f79d2611-1afa-48a1-9abb-7c1108a7014a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:11.939517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-30639160-8b01-4b76-a3f9-fcd6484d20f4 req-f79d2611-1afa-48a1-9abb-7c1108a7014a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:11.955833 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-30639160-8b01-4b76-a3f9-fcd6484d20f4 req-f79d2611-1afa-48a1-9abb-7c1108a7014a service nova] Creating event network-vif-deleted:840f28a4-bb5e-4a40-bbf6-ee10b2d4d7ce for instance f176db0d-6e6c-440d-bb11-45c90194f8f1 on n-h2-826529-8 Aug 03 02:43:11.961758 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-30639160-8b01-4b76-a3f9-fcd6484d20f4 req-f79d2611-1afa-48a1-9abb-7c1108a7014a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040866 Aug 03 02:43:11.962414 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3127/6375] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:43:12.707370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8f056868-366b-49a3-a420-550272fd0f84 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:12.708631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8f056868-366b-49a3-a420-550272fd0f84 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:12.716339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f056868-366b-49a3-a420-550272fd0f84 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:12.716809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f056868-366b-49a3-a420-550272fd0f84 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:12.717607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f056868-366b-49a3-a420-550272fd0f84 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:12.718067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f056868-366b-49a3-a420-550272fd0f84 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:12.797639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8f056868-366b-49a3-a420-550272fd0f84 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:12.807475 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8f056868-366b-49a3-a420-550272fd0f84 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1226 microversion: 2.1 time: 0.103836 Aug 03 02:43:12.808824 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3249/6376] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:12 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:13.830746 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-be3d43cc-46ca-4706-af46-50adfcce79c3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:13.831481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-be3d43cc-46ca-4706-af46-50adfcce79c3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:13.838557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be3d43cc-46ca-4706-af46-50adfcce79c3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:13.839104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be3d43cc-46ca-4706-af46-50adfcce79c3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:13.840509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be3d43cc-46ca-4706-af46-50adfcce79c3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:13.841208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be3d43cc-46ca-4706-af46-50adfcce79c3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:13.907289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-be3d43cc-46ca-4706-af46-50adfcce79c3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:13.915716 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-be3d43cc-46ca-4706-af46-50adfcce79c3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1226 microversion: 2.1 time: 0.090086 Aug 03 02:43:13.916280 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3128/6377] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:13 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:14.937713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5d5f2ba5-3923-47e4-93c5-572695a89963 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:14.938340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5d5f2ba5-3923-47e4-93c5-572695a89963 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:14.945932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d5f2ba5-3923-47e4-93c5-572695a89963 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:14.946398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d5f2ba5-3923-47e4-93c5-572695a89963 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:14.947226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d5f2ba5-3923-47e4-93c5-572695a89963 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:14.947755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d5f2ba5-3923-47e4-93c5-572695a89963 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:15.017968 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5d5f2ba5-3923-47e4-93c5-572695a89963 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:15.029037 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5d5f2ba5-3923-47e4-93c5-572695a89963 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1226 microversion: 2.1 time: 0.095951 Aug 03 02:43:15.029902 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3250/6378] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:14 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:16.052422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e16c4721-f320-4871-a3b1-5fe772973c43 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:16.053290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e16c4721-f320-4871-a3b1-5fe772973c43 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:16.059901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e16c4721-f320-4871-a3b1-5fe772973c43 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:16.060356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e16c4721-f320-4871-a3b1-5fe772973c43 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:16.061158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e16c4721-f320-4871-a3b1-5fe772973c43 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:16.061605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e16c4721-f320-4871-a3b1-5fe772973c43 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:16.143914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e16c4721-f320-4871-a3b1-5fe772973c43 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:16.153376 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e16c4721-f320-4871-a3b1-5fe772973c43 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 200 len: 1226 microversion: 2.1 time: 0.105335 Aug 03 02:43:16.153948 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3129/6379] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:16 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:17.174861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f1939537-e647-4643-8b5c-455ba7270397 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:17.175586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f1939537-e647-4643-8b5c-455ba7270397 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:17.184050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1939537-e647-4643-8b5c-455ba7270397 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:17.184512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1939537-e647-4643-8b5c-455ba7270397 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:17.185307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1939537-e647-4643-8b5c-455ba7270397 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:17.185761 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f1939537-e647-4643-8b5c-455ba7270397 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:17.199845 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-f1939537-e647-4643-8b5c-455ba7270397 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f1939537-e647-4643-8b5c-455ba7270397 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 HTTP/1.1 Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'f176db0d-6e6c-440d-bb11-45c90194f8f1'} Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:43:17.201520 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:43:17.207107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:43:17.207107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:43:17.207107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:43:17.207107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:43:17.207107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:43:17.207107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. Aug 03 02:43:17.207107 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:43:17.207107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f1939537-e647-4643-8b5c-455ba7270397 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:43:17.207107 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f1939537-e647-4643-8b5c-455ba7270397 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 404 len: 111 microversion: 2.1 time: 0.032094 Aug 03 02:43:17.207107 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3251/6380] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:17 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:43:17.253028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2118850988", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2109864592", "security_groups": [{"name": "tempest-secgroup-smoke-426748971"}], "block_device_mapping_v2": [{"uuid": "789f700b-753c-4da6-9e79-3ca5805dff26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5eae0150-a7f5-4e00-b929-5ba4bf7b1156"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:43:17.370723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] validate_networks() for [('5eae0150-a7f5-4e00-b929-5ba4bf7b1156', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:43:17.764290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:43:17.764715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:43:17.765223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:43:17.765680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:43:17.766097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:43:17.775694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:17.776144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:17.777053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:17.777489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:17.796436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:43:17.802478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for user 1114641f11954d74885d0e4b082d7704 and project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:43:17.863434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:43:17.866459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='789f700b-753c-4da6-9e79-3ca5805dff26',volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:43:18.005281 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dbca4c4c-6601-41db-bf39-1cffa02c8bcc tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.756152 Aug 03 02:43:18.005860 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3130/6381] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:43:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:43:18.018476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-75538f20-ffe9-495f-a75e-a2035f7f611c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:18.019300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-75538f20-ffe9-495f-a75e-a2035f7f611c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:18.079602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-75538f20-ffe9-495f-a75e-a2035f7f611c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:18.087169 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-75538f20-ffe9-495f-a75e-a2035f7f611c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1095 microversion: 2.1 time: 0.073763 Aug 03 02:43:18.087791 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3252/6382] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:18 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:19.110272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-420c3a27-6948-4399-938f-85eb92e33971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:19.110930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-420c3a27-6948-4399-938f-85eb92e33971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:19.118263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-420c3a27-6948-4399-938f-85eb92e33971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:19.118723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-420c3a27-6948-4399-938f-85eb92e33971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:19.119553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-420c3a27-6948-4399-938f-85eb92e33971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:19.120278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-420c3a27-6948-4399-938f-85eb92e33971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:19.194936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-420c3a27-6948-4399-938f-85eb92e33971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:19.203784 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-420c3a27-6948-4399-938f-85eb92e33971 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1211 microversion: 2.1 time: 0.098653 Aug 03 02:43:19.204591 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3131/6383] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:19 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:20.226537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d6222c6a-0b78-48e1-ab2f-c923713b637c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:20.228035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d6222c6a-0b78-48e1-ab2f-c923713b637c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:20.237493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6222c6a-0b78-48e1-ab2f-c923713b637c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:20.238373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6222c6a-0b78-48e1-ab2f-c923713b637c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:20.240894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6222c6a-0b78-48e1-ab2f-c923713b637c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:20.241422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6222c6a-0b78-48e1-ab2f-c923713b637c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:20.402310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d6222c6a-0b78-48e1-ab2f-c923713b637c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:20.420307 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d6222c6a-0b78-48e1-ab2f-c923713b637c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1278 microversion: 2.1 time: 0.198278 Aug 03 02:43:20.424530 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3253/6384] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:20 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:20.695203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-5452f1e9-251a-4d3f-aaea-9e64eed19754 req-07df42eb-e4c0-4887-8962-ca8e30e1c6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b009eef8-50b5-4a13-9017-cb60cf07e9fd", "tag": "d67a7637-27e0-4f9a-91ad-8f85b02639cf"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:43:20.712321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5452f1e9-251a-4d3f-aaea-9e64eed19754 req-07df42eb-e4c0-4887-8962-ca8e30e1c6a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:20.712819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5452f1e9-251a-4d3f-aaea-9e64eed19754 req-07df42eb-e4c0-4887-8962-ca8e30e1c6a7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:20.732488 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-5452f1e9-251a-4d3f-aaea-9e64eed19754 req-07df42eb-e4c0-4887-8962-ca8e30e1c6a7 service nova] Creating event network-changed:d67a7637-27e0-4f9a-91ad-8f85b02639cf for instance b009eef8-50b5-4a13-9017-cb60cf07e9fd on n-h1-826529-8 Aug 03 02:43:20.738652 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-5452f1e9-251a-4d3f-aaea-9e64eed19754 req-07df42eb-e4c0-4887-8962-ca8e30e1c6a7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161715 Aug 03 02:43:20.740420 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3132/6385] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:43:21.451704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c3716236-aff0-49ad-8eed-8e08298e9fa9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:21.452459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c3716236-aff0-49ad-8eed-8e08298e9fa9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:21.461026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3716236-aff0-49ad-8eed-8e08298e9fa9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:21.461659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3716236-aff0-49ad-8eed-8e08298e9fa9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:21.462602 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3716236-aff0-49ad-8eed-8e08298e9fa9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:21.463339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3716236-aff0-49ad-8eed-8e08298e9fa9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:21.629669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c3716236-aff0-49ad-8eed-8e08298e9fa9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:21.640044 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c3716236-aff0-49ad-8eed-8e08298e9fa9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1278 microversion: 2.1 time: 0.192770 Aug 03 02:43:21.641017 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3254/6386] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:21 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1278 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:22.663417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2e8d5533-a490-4c69-b9bc-704c153d472f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:22.664140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2e8d5533-a490-4c69-b9bc-704c153d472f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:22.670684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e8d5533-a490-4c69-b9bc-704c153d472f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:22.671217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e8d5533-a490-4c69-b9bc-704c153d472f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:22.671993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e8d5533-a490-4c69-b9bc-704c153d472f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:22.672446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e8d5533-a490-4c69-b9bc-704c153d472f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:22.837416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2e8d5533-a490-4c69-b9bc-704c153d472f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:22.845791 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2e8d5533-a490-4c69-b9bc-704c153d472f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1278 microversion: 2.1 time: 0.188343 Aug 03 02:43:22.846476 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3133/6387] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:22 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:23.868261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31a197c1-cc05-4ff1-909e-4aea260e880e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:23.868853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-31a197c1-cc05-4ff1-909e-4aea260e880e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:23.876619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31a197c1-cc05-4ff1-909e-4aea260e880e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:23.877101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31a197c1-cc05-4ff1-909e-4aea260e880e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:23.877895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31a197c1-cc05-4ff1-909e-4aea260e880e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:23.878348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31a197c1-cc05-4ff1-909e-4aea260e880e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:24.086162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-31a197c1-cc05-4ff1-909e-4aea260e880e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:24.094378 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-31a197c1-cc05-4ff1-909e-4aea260e880e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1278 microversion: 2.1 time: 0.230783 Aug 03 02:43:24.095014 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3255/6388] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:23 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:25.117108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ac9b7a3b-a6c0-4831-8bb7-52be0b7579af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:25.118103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ac9b7a3b-a6c0-4831-8bb7-52be0b7579af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:25.126252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac9b7a3b-a6c0-4831-8bb7-52be0b7579af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:25.126712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac9b7a3b-a6c0-4831-8bb7-52be0b7579af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:25.127656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac9b7a3b-a6c0-4831-8bb7-52be0b7579af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:25.128096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ac9b7a3b-a6c0-4831-8bb7-52be0b7579af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:25.284300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ac9b7a3b-a6c0-4831-8bb7-52be0b7579af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:25.292733 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ac9b7a3b-a6c0-4831-8bb7-52be0b7579af tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1266 microversion: 2.1 time: 0.179935 Aug 03 02:43:25.293307 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3134/6389] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:25 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:26.314522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5d8f80eb-dcc6-4bc9-9fad-9e5077c7e00f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:26.315184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5d8f80eb-dcc6-4bc9-9fad-9e5077c7e00f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:26.323182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d8f80eb-dcc6-4bc9-9fad-9e5077c7e00f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:26.323655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d8f80eb-dcc6-4bc9-9fad-9e5077c7e00f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:26.324506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d8f80eb-dcc6-4bc9-9fad-9e5077c7e00f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:26.324964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d8f80eb-dcc6-4bc9-9fad-9e5077c7e00f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:26.459477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5d8f80eb-dcc6-4bc9-9fad-9e5077c7e00f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:26.467617 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5d8f80eb-dcc6-4bc9-9fad-9e5077c7e00f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1266 microversion: 2.1 time: 0.156984 Aug 03 02:43:26.468198 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3256/6390] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:26 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:27.488820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ee670728-2ceb-4fe7-b484-4eea2a13dd9b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:27.489438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ee670728-2ceb-4fe7-b484-4eea2a13dd9b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:27.497622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee670728-2ceb-4fe7-b484-4eea2a13dd9b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:27.498078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee670728-2ceb-4fe7-b484-4eea2a13dd9b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:27.498930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee670728-2ceb-4fe7-b484-4eea2a13dd9b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:27.499337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ee670728-2ceb-4fe7-b484-4eea2a13dd9b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:27.644635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ee670728-2ceb-4fe7-b484-4eea2a13dd9b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:27.652364 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ee670728-2ceb-4fe7-b484-4eea2a13dd9b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1266 microversion: 2.1 time: 0.167781 Aug 03 02:43:27.653054 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3135/6391] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:27 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:28.675554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-597abb13-4e0e-47fb-b2db-578bb439330b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:28.676206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-597abb13-4e0e-47fb-b2db-578bb439330b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:28.678931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:43:28.684714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-597abb13-4e0e-47fb-b2db-578bb439330b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:28.685188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-597abb13-4e0e-47fb-b2db-578bb439330b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:28.685995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-597abb13-4e0e-47fb-b2db-578bb439330b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:28.686444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-597abb13-4e0e-47fb-b2db-578bb439330b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:28.822284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-597abb13-4e0e-47fb-b2db-578bb439330b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:28.829964 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-597abb13-4e0e-47fb-b2db-578bb439330b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1266 microversion: 2.1 time: 0.158641 Aug 03 02:43:28.830538 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3257/6392] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:28 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:29.851417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d6bdd731-234a-43be-a289-78c3814ce0f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:29.852223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d6bdd731-234a-43be-a289-78c3814ce0f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:29.854060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:43:29.854839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:43:29.861910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6bdd731-234a-43be-a289-78c3814ce0f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:29.862373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6bdd731-234a-43be-a289-78c3814ce0f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:29.863195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6bdd731-234a-43be-a289-78c3814ce0f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:29.863647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6bdd731-234a-43be-a289-78c3814ce0f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:29.997216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d6bdd731-234a-43be-a289-78c3814ce0f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:30.004886 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d6bdd731-234a-43be-a289-78c3814ce0f8 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1266 microversion: 2.1 time: 0.157395 Aug 03 02:43:30.005387 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3136/6393] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:29 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:31.025833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a27fe7c1-ea8f-4b09-b1df-5b30f22aba0c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:31.026661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a27fe7c1-ea8f-4b09-b1df-5b30f22aba0c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:31.034109 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a27fe7c1-ea8f-4b09-b1df-5b30f22aba0c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:31.034581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a27fe7c1-ea8f-4b09-b1df-5b30f22aba0c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:31.035419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a27fe7c1-ea8f-4b09-b1df-5b30f22aba0c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:31.035886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a27fe7c1-ea8f-4b09-b1df-5b30f22aba0c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:31.189155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a27fe7c1-ea8f-4b09-b1df-5b30f22aba0c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:31.198090 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a27fe7c1-ea8f-4b09-b1df-5b30f22aba0c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1266 microversion: 2.1 time: 0.176146 Aug 03 02:43:31.198836 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3258/6394] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:31 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:32.219766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3bcabcf3-34c1-4893-8f95-2ab5a91edecd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:32.220371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3bcabcf3-34c1-4893-8f95-2ab5a91edecd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:32.228188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3bcabcf3-34c1-4893-8f95-2ab5a91edecd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:32.228638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3bcabcf3-34c1-4893-8f95-2ab5a91edecd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:32.229412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3bcabcf3-34c1-4893-8f95-2ab5a91edecd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:32.229849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3bcabcf3-34c1-4893-8f95-2ab5a91edecd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:32.364767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3bcabcf3-34c1-4893-8f95-2ab5a91edecd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:32.373415 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3bcabcf3-34c1-4893-8f95-2ab5a91edecd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1266 microversion: 2.1 time: 0.157598 Aug 03 02:43:32.374062 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3137/6395] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:32 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:32.924635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2045f87d-85e3-42ab-ad5e-5632095f3b1c req-88c9ff02-7060-431b-94d3-e40b72dc16c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b009eef8-50b5-4a13-9017-cb60cf07e9fd", "name": "network-vif-plugged", "status": "completed", "tag": "d67a7637-27e0-4f9a-91ad-8f85b02639cf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:43:32.934772 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2045f87d-85e3-42ab-ad5e-5632095f3b1c req-88c9ff02-7060-431b-94d3-e40b72dc16c6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:32.935265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2045f87d-85e3-42ab-ad5e-5632095f3b1c req-88c9ff02-7060-431b-94d3-e40b72dc16c6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:32.947655 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2045f87d-85e3-42ab-ad5e-5632095f3b1c req-88c9ff02-7060-431b-94d3-e40b72dc16c6 service nova] Creating event network-vif-plugged:d67a7637-27e0-4f9a-91ad-8f85b02639cf for instance b009eef8-50b5-4a13-9017-cb60cf07e9fd on n-h1-826529-8 Aug 03 02:43:32.953076 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2045f87d-85e3-42ab-ad5e-5632095f3b1c req-88c9ff02-7060-431b-94d3-e40b72dc16c6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108568 Aug 03 02:43:32.954109 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3259/6396] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:43:33.394635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0841834a-d72d-42d1-9688-41deb2288847 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:33.395223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0841834a-d72d-42d1-9688-41deb2288847 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:33.402280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0841834a-d72d-42d1-9688-41deb2288847 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:33.402749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0841834a-d72d-42d1-9688-41deb2288847 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:33.403631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0841834a-d72d-42d1-9688-41deb2288847 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:33.404080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0841834a-d72d-42d1-9688-41deb2288847 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:33.543622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0841834a-d72d-42d1-9688-41deb2288847 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:33.551255 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0841834a-d72d-42d1-9688-41deb2288847 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1266 microversion: 2.1 time: 0.160584 Aug 03 02:43:33.551838 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3138/6397] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:33 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:34.574220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2f04de89-f262-435e-bb17-de766e1592d4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:34.575214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2f04de89-f262-435e-bb17-de766e1592d4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:34.584717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f04de89-f262-435e-bb17-de766e1592d4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:34.586137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f04de89-f262-435e-bb17-de766e1592d4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:34.586939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f04de89-f262-435e-bb17-de766e1592d4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:34.587401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f04de89-f262-435e-bb17-de766e1592d4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:34.731930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2f04de89-f262-435e-bb17-de766e1592d4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:34.739762 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2f04de89-f262-435e-bb17-de766e1592d4 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1452 microversion: 2.1 time: 0.170889 Aug 03 02:43:34.740374 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3260/6398] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:34 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:34.760983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9e24699a-3d4c-4452-a355-30425eca2185 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:43:34.761695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9e24699a-3d4c-4452-a355-30425eca2185 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:43:34.768819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e24699a-3d4c-4452-a355-30425eca2185 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:34.769288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e24699a-3d4c-4452-a355-30425eca2185 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:34.770109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e24699a-3d4c-4452-a355-30425eca2185 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:34.770560 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e24699a-3d4c-4452-a355-30425eca2185 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:34.909828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9e24699a-3d4c-4452-a355-30425eca2185 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:43:34.918232 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9e24699a-3d4c-4452-a355-30425eca2185 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1452 microversion: 2.1 time: 0.161546 Aug 03 02:43:34.918818 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3139/6399] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:43:34 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:43:36.950401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-3928dc41-6502-4c61-bb68-c748aa85cad2 req-7ae3aad2-5938-4c2b-b6ff-eede0800bc68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b009eef8-50b5-4a13-9017-cb60cf07e9fd", "tag": "d67a7637-27e0-4f9a-91ad-8f85b02639cf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:43:36.961546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3928dc41-6502-4c61-bb68-c748aa85cad2 req-7ae3aad2-5938-4c2b-b6ff-eede0800bc68 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:43:36.962007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3928dc41-6502-4c61-bb68-c748aa85cad2 req-7ae3aad2-5938-4c2b-b6ff-eede0800bc68 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:43:36.973527 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-3928dc41-6502-4c61-bb68-c748aa85cad2 req-7ae3aad2-5938-4c2b-b6ff-eede0800bc68 service nova] Creating event network-changed:d67a7637-27e0-4f9a-91ad-8f85b02639cf for instance b009eef8-50b5-4a13-9017-cb60cf07e9fd on n-h1-826529-8 Aug 03 02:43:36.979208 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-3928dc41-6502-4c61-bb68-c748aa85cad2 req-7ae3aad2-5938-4c2b-b6ff-eede0800bc68 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032339 Aug 03 02:43:36.980464 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3261/6400] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:45:16.858192 n-d-826529-8 devstack@n-api.service[125942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95a5e56a-7955-4bb2-902f-a217315250e4] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 02:45:16.859170 n-d-826529-8 devstack@n-api.service[125942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6768ec80-552a-4875-95fb-ee55c75da43d] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 02:45:16.859748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:45:16.860495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:45:16.864991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-87478910", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2109864592", "security_groups": [{"name": "tempest-secgroup-smoke-426748971"}], "block_device_mapping_v2": [{"uuid": "185d4728-dde3-4fb2-bd1e-6573fce4694e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5eae0150-a7f5-4e00-b929-5ba4bf7b1156"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:45:16.989845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] validate_networks() for [('5eae0150-a7f5-4e00-b929-5ba4bf7b1156', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:45:17.437691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:45:17.438121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:45:17.438757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:45:17.439222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:45:17.439676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:45:17.448995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:17.449451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:17.450270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:17.451333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:17.468748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:45:17.474123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Getting quotas for user 1114641f11954d74885d0e4b082d7704 and project 5f334fb7e1f5472b9f65edc059914b78. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:45:17.535502 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:45:17.537691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='185d4728-dde3-4fb2-bd1e-6573fce4694e',volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:45:17.674589 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d0b793e3-6227-42f7-92f3-384a67784b08 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.818875 Aug 03 02:45:17.675324 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3140/6401] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:45:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:45:17.684978 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b324c37-7dbb-4b30-9a93-80ead1f0c21e] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 02:45:17.685915 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c87329c-10f0-40cc-99d5-2fdb48e49def] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 02:45:17.686565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=32 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:45:17.687935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=72 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:45:17.692729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7f9aa2e4-c60a-4f6f-9c7f-a28a020e8173 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:17.693446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7f9aa2e4-c60a-4f6f-9c7f-a28a020e8173 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:17.749721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7f9aa2e4-c60a-4f6f-9c7f-a28a020e8173 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:17.756352 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7f9aa2e4-c60a-4f6f-9c7f-a28a020e8173 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1093 microversion: 2.1 time: 0.073352 Aug 03 02:45:17.756913 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3262/6402] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:17 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:18.777473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c0c88958-c75c-4633-8a0e-524041fd2e63 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:18.778274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c0c88958-c75c-4633-8a0e-524041fd2e63 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:18.795286 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] [95a5e56a-7955-4bb2-902f-a217315250e4] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 34648. Aug 03 02:45:18.796055 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] [6768ec80-552a-4875-95fb-ee55c75da43d] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 34650. Aug 03 02:45:18.843090 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c0c88958-c75c-4633-8a0e-524041fd2e63 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:18.850034 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c0c88958-c75c-4633-8a0e-524041fd2e63 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1093 microversion: 2.1 time: 0.076571 Aug 03 02:45:18.850612 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3141/6403] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:18 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:19.871077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9bd9c256-a0b0-4d84-9f59-82e15cc8dce9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:19.871862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9bd9c256-a0b0-4d84-9f59-82e15cc8dce9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:19.886602 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b324c37-7dbb-4b30-9a93-80ead1f0c21e] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 34654. Aug 03 02:45:19.891114 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c87329c-10f0-40cc-99d5-2fdb48e49def] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 34656. Aug 03 02:45:19.944467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9bd9c256-a0b0-4d84-9f59-82e15cc8dce9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:19.956066 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9bd9c256-a0b0-4d84-9f59-82e15cc8dce9 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1093 microversion: 2.1 time: 0.085132 Aug 03 02:45:19.956066 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3263/6404] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:19 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1093 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:20.975736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-00cbb090-f0dc-40de-a1d3-2a2b711a9645 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:20.976343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-00cbb090-f0dc-40de-a1d3-2a2b711a9645 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:21.031775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-00cbb090-f0dc-40de-a1d3-2a2b711a9645 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:21.039128 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-00cbb090-f0dc-40de-a1d3-2a2b711a9645 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1093 microversion: 2.1 time: 0.066981 Aug 03 02:45:21.039703 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3142/6405] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:20 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:22.061288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-24786436-55a4-4d11-af05-f69b9eb4f4bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:22.061969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-24786436-55a4-4d11-af05-f69b9eb4f4bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:22.070558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24786436-55a4-4d11-af05-f69b9eb4f4bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:22.071129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24786436-55a4-4d11-af05-f69b9eb4f4bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:22.071957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24786436-55a4-4d11-af05-f69b9eb4f4bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:22.072428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24786436-55a4-4d11-af05-f69b9eb4f4bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:22.143088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-24786436-55a4-4d11-af05-f69b9eb4f4bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:22.150778 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-24786436-55a4-4d11-af05-f69b9eb4f4bd tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1143 microversion: 2.1 time: 0.094083 Aug 03 02:45:22.151381 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3264/6406] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:22 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1143 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:23.172619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-35b4c1ca-55a1-48eb-830a-64f2af8eb50d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:23.173281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-35b4c1ca-55a1-48eb-830a-64f2af8eb50d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:23.182157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35b4c1ca-55a1-48eb-830a-64f2af8eb50d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:23.182638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35b4c1ca-55a1-48eb-830a-64f2af8eb50d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:23.183620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35b4c1ca-55a1-48eb-830a-64f2af8eb50d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:23.184094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35b4c1ca-55a1-48eb-830a-64f2af8eb50d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:23.249101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-35b4c1ca-55a1-48eb-830a-64f2af8eb50d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:23.257173 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-35b4c1ca-55a1-48eb-830a-64f2af8eb50d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1191 microversion: 2.1 time: 0.089630 Aug 03 02:45:23.257755 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3143/6407] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:23 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:24.281409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ccefa2d9-9d92-40b5-a161-a4ce39bf5436 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:24.283841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ccefa2d9-9d92-40b5-a161-a4ce39bf5436 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:24.291886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccefa2d9-9d92-40b5-a161-a4ce39bf5436 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:24.292338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccefa2d9-9d92-40b5-a161-a4ce39bf5436 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:24.293126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccefa2d9-9d92-40b5-a161-a4ce39bf5436 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:24.293783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccefa2d9-9d92-40b5-a161-a4ce39bf5436 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:24.384243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ccefa2d9-9d92-40b5-a161-a4ce39bf5436 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:24.394013 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ccefa2d9-9d92-40b5-a161-a4ce39bf5436 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1209 microversion: 2.1 time: 0.118013 Aug 03 02:45:24.395290 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3265/6408] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:24 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1209 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:25.399023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-a3bed274-0186-4be1-aadd-1178952bc43d req-9f517f0a-f3bd-480b-85b2-bdd9beff19ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b53f9e13-2692-42b2-97c7-3250698662ac", "tag": "0c90608c-df4a-4803-be0d-59fb3168a5a9"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:45:25.415839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-81a848ff-fd44-47cd-a32d-1704c9fc2fe1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:25.416464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-81a848ff-fd44-47cd-a32d-1704c9fc2fe1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:25.423564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81a848ff-fd44-47cd-a32d-1704c9fc2fe1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:25.424032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81a848ff-fd44-47cd-a32d-1704c9fc2fe1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:25.424826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81a848ff-fd44-47cd-a32d-1704c9fc2fe1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:25.425281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81a848ff-fd44-47cd-a32d-1704c9fc2fe1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:25.428098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a3bed274-0186-4be1-aadd-1178952bc43d req-9f517f0a-f3bd-480b-85b2-bdd9beff19ba service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:25.428098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a3bed274-0186-4be1-aadd-1178952bc43d req-9f517f0a-f3bd-480b-85b2-bdd9beff19ba service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:25.441234 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-a3bed274-0186-4be1-aadd-1178952bc43d req-9f517f0a-f3bd-480b-85b2-bdd9beff19ba service nova] Creating event network-changed:0c90608c-df4a-4803-be0d-59fb3168a5a9 for instance b53f9e13-2692-42b2-97c7-3250698662ac on n-h2-826529-8 Aug 03 02:45:25.446393 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-a3bed274-0186-4be1-aadd-1178952bc43d req-9f517f0a-f3bd-480b-85b2-bdd9beff19ba service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134767 Aug 03 02:45:25.447512 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3144/6409] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:45:25.643682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-81a848ff-fd44-47cd-a32d-1704c9fc2fe1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:25.651603 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-81a848ff-fd44-47cd-a32d-1704c9fc2fe1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1276 microversion: 2.1 time: 0.239885 Aug 03 02:45:25.652542 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3266/6410] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:25 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1276 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:45:26.674340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-55220393-5828-4e54-b679-d6f278f8866c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:26.675166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-55220393-5828-4e54-b679-d6f278f8866c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:26.681621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55220393-5828-4e54-b679-d6f278f8866c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:26.682078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55220393-5828-4e54-b679-d6f278f8866c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:26.682862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55220393-5828-4e54-b679-d6f278f8866c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:26.683376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55220393-5828-4e54-b679-d6f278f8866c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:26.836578 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-55220393-5828-4e54-b679-d6f278f8866c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:26.845169 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-55220393-5828-4e54-b679-d6f278f8866c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1276 microversion: 2.1 time: 0.176424 Aug 03 02:45:26.845931 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3145/6411] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:26 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:27.865740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-975b0ec4-d385-42dc-b6d4-ae915c6e225a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:27.866370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-975b0ec4-d385-42dc-b6d4-ae915c6e225a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:27.873794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-975b0ec4-d385-42dc-b6d4-ae915c6e225a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:27.874258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-975b0ec4-d385-42dc-b6d4-ae915c6e225a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:27.875079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-975b0ec4-d385-42dc-b6d4-ae915c6e225a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:27.875535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-975b0ec4-d385-42dc-b6d4-ae915c6e225a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:28.024495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-975b0ec4-d385-42dc-b6d4-ae915c6e225a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:28.033512 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-975b0ec4-d385-42dc-b6d4-ae915c6e225a tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1276 microversion: 2.1 time: 0.171654 Aug 03 02:45:28.034099 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3267/6412] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:27 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:45:29.056084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-19ab3c57-c06c-4f24-ae8f-bf3cc14d4b71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:29.057091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-19ab3c57-c06c-4f24-ae8f-bf3cc14d4b71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:29.059746 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:45:29.068616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19ab3c57-c06c-4f24-ae8f-bf3cc14d4b71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:29.069278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19ab3c57-c06c-4f24-ae8f-bf3cc14d4b71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:29.070466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19ab3c57-c06c-4f24-ae8f-bf3cc14d4b71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:29.070938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19ab3c57-c06c-4f24-ae8f-bf3cc14d4b71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:29.229041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-19ab3c57-c06c-4f24-ae8f-bf3cc14d4b71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:29.239114 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-19ab3c57-c06c-4f24-ae8f-bf3cc14d4b71 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1264 microversion: 2.1 time: 0.188818 Aug 03 02:45:29.239684 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3146/6413] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:29 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:30.261016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e2e6bb45-7087-417e-ba97-487d9bc0e708 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:30.261652 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e2e6bb45-7087-417e-ba97-487d9bc0e708 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:30.265196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:45:30.270916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e2e6bb45-7087-417e-ba97-487d9bc0e708 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:30.271399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e2e6bb45-7087-417e-ba97-487d9bc0e708 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:30.272231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e2e6bb45-7087-417e-ba97-487d9bc0e708 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:30.272742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e2e6bb45-7087-417e-ba97-487d9bc0e708 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:30.439584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e2e6bb45-7087-417e-ba97-487d9bc0e708 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:30.447638 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e2e6bb45-7087-417e-ba97-487d9bc0e708 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1264 microversion: 2.1 time: 0.191281 Aug 03 02:45:30.448156 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3268/6414] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:30 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:31.470577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-db46e9bd-6081-44a9-96ee-bc1b00c6ec29 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:31.471174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-db46e9bd-6081-44a9-96ee-bc1b00c6ec29 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:31.473853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=10 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:45:31.479710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db46e9bd-6081-44a9-96ee-bc1b00c6ec29 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:31.480162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db46e9bd-6081-44a9-96ee-bc1b00c6ec29 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:31.480943 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db46e9bd-6081-44a9-96ee-bc1b00c6ec29 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:31.482735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-db46e9bd-6081-44a9-96ee-bc1b00c6ec29 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:31.624278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-db46e9bd-6081-44a9-96ee-bc1b00c6ec29 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:31.632080 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-db46e9bd-6081-44a9-96ee-bc1b00c6ec29 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1264 microversion: 2.1 time: 0.166481 Aug 03 02:45:31.632431 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3147/6415] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:31 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:32.653298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-85106670-69b7-4203-b152-d28918a6de03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:32.653937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-85106670-69b7-4203-b152-d28918a6de03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:32.660996 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85106670-69b7-4203-b152-d28918a6de03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:32.661468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85106670-69b7-4203-b152-d28918a6de03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:32.662266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85106670-69b7-4203-b152-d28918a6de03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:32.662780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-85106670-69b7-4203-b152-d28918a6de03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:32.805406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-85106670-69b7-4203-b152-d28918a6de03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:32.813498 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-85106670-69b7-4203-b152-d28918a6de03 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1264 microversion: 2.1 time: 0.164129 Aug 03 02:45:32.814246 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3269/6416] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:32 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:33.834929 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f58bc475-28c1-42c3-9b1f-b3666016d8e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:33.835597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f58bc475-28c1-42c3-9b1f-b3666016d8e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:33.843586 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f58bc475-28c1-42c3-9b1f-b3666016d8e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:33.844057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f58bc475-28c1-42c3-9b1f-b3666016d8e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:33.844843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f58bc475-28c1-42c3-9b1f-b3666016d8e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:33.845288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f58bc475-28c1-42c3-9b1f-b3666016d8e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:33.989074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f58bc475-28c1-42c3-9b1f-b3666016d8e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:33.997167 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f58bc475-28c1-42c3-9b1f-b3666016d8e3 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1264 microversion: 2.1 time: 0.166171 Aug 03 02:45:33.997877 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3148/6417] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:33 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:35.018063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-501d0700-a488-470a-8059-298721947c9f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:35.018622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-501d0700-a488-470a-8059-298721947c9f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:35.025712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-501d0700-a488-470a-8059-298721947c9f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:35.026183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-501d0700-a488-470a-8059-298721947c9f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:35.027007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-501d0700-a488-470a-8059-298721947c9f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:35.027471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-501d0700-a488-470a-8059-298721947c9f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:35.166778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-501d0700-a488-470a-8059-298721947c9f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:35.175872 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-501d0700-a488-470a-8059-298721947c9f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1264 microversion: 2.1 time: 0.161605 Aug 03 02:45:35.176581 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3270/6418] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:35 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:36.199600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-712af37a-5131-40f6-a4ba-a9e524884159 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:36.200807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-712af37a-5131-40f6-a4ba-a9e524884159 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:36.207980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-712af37a-5131-40f6-a4ba-a9e524884159 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:36.208465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-712af37a-5131-40f6-a4ba-a9e524884159 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:36.209255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-712af37a-5131-40f6-a4ba-a9e524884159 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:36.209699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-712af37a-5131-40f6-a4ba-a9e524884159 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:36.350330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-712af37a-5131-40f6-a4ba-a9e524884159 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:36.359080 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-712af37a-5131-40f6-a4ba-a9e524884159 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1264 microversion: 2.1 time: 0.163298 Aug 03 02:45:36.359676 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3149/6419] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:36 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:37.380540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-36afb17e-8462-4424-826d-e532ed0eff1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:37.381289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-36afb17e-8462-4424-826d-e532ed0eff1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:37.389540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-36afb17e-8462-4424-826d-e532ed0eff1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:37.390150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-36afb17e-8462-4424-826d-e532ed0eff1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:37.391006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-36afb17e-8462-4424-826d-e532ed0eff1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:37.391469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-36afb17e-8462-4424-826d-e532ed0eff1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:37.536227 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-36afb17e-8462-4424-826d-e532ed0eff1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:37.544150 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-36afb17e-8462-4424-826d-e532ed0eff1c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1264 microversion: 2.1 time: 0.167306 Aug 03 02:45:37.545091 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3271/6420] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:37 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:38.565395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b1967a3c-35e7-40c9-8afe-d66b180e0b64 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:38.566023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b1967a3c-35e7-40c9-8afe-d66b180e0b64 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:38.573193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1967a3c-35e7-40c9-8afe-d66b180e0b64 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:38.573657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1967a3c-35e7-40c9-8afe-d66b180e0b64 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:38.574443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1967a3c-35e7-40c9-8afe-d66b180e0b64 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:38.575052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1967a3c-35e7-40c9-8afe-d66b180e0b64 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:38.773132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b1967a3c-35e7-40c9-8afe-d66b180e0b64 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:38.781404 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b1967a3c-35e7-40c9-8afe-d66b180e0b64 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1264 microversion: 2.1 time: 0.219955 Aug 03 02:45:38.781980 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3150/6421] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:38 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1264 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:39.457265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-50d870ab-129f-4446-9fdd-cc32edad891a req-d00eec03-64d0-4760-994e-5c1e41b59841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53f9e13-2692-42b2-97c7-3250698662ac", "name": "network-vif-plugged", "status": "completed", "tag": "0c90608c-df4a-4803-be0d-59fb3168a5a9"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:45:39.468102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-50d870ab-129f-4446-9fdd-cc32edad891a req-d00eec03-64d0-4760-994e-5c1e41b59841 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:39.468565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-50d870ab-129f-4446-9fdd-cc32edad891a req-d00eec03-64d0-4760-994e-5c1e41b59841 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:39.480359 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-50d870ab-129f-4446-9fdd-cc32edad891a req-d00eec03-64d0-4760-994e-5c1e41b59841 service nova] Creating event network-vif-plugged:0c90608c-df4a-4803-be0d-59fb3168a5a9 for instance b53f9e13-2692-42b2-97c7-3250698662ac on n-h2-826529-8 Aug 03 02:45:39.485583 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-50d870ab-129f-4446-9fdd-cc32edad891a req-d00eec03-64d0-4760-994e-5c1e41b59841 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032076 Aug 03 02:45:39.486180 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3272/6422] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:45:39.803136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4b0e2177-a2e4-497d-bd97-2dd5d52a42e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:39.803829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4b0e2177-a2e4-497d-bd97-2dd5d52a42e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:39.810938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b0e2177-a2e4-497d-bd97-2dd5d52a42e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:39.811404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b0e2177-a2e4-497d-bd97-2dd5d52a42e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:39.812220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b0e2177-a2e4-497d-bd97-2dd5d52a42e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:39.812670 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b0e2177-a2e4-497d-bd97-2dd5d52a42e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:39.945876 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4b0e2177-a2e4-497d-bd97-2dd5d52a42e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:39.954044 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4b0e2177-a2e4-497d-bd97-2dd5d52a42e5 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1264 microversion: 2.1 time: 0.154919 Aug 03 02:45:39.954616 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3151/6423] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:39 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:40.976562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-16df90d0-adcb-4554-9459-55433964296b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:40.977264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-16df90d0-adcb-4554-9459-55433964296b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:40.983593 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16df90d0-adcb-4554-9459-55433964296b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:40.984031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16df90d0-adcb-4554-9459-55433964296b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:40.984808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16df90d0-adcb-4554-9459-55433964296b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:40.985256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16df90d0-adcb-4554-9459-55433964296b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:41.164632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-16df90d0-adcb-4554-9459-55433964296b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:41.172300 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-16df90d0-adcb-4554-9459-55433964296b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1450 microversion: 2.1 time: 0.200846 Aug 03 02:45:41.172863 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3273/6424] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:40 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1450 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:41.192333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-359d1519-16a2-4562-9c1d-06fa8a24097f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:45:41.192955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-359d1519-16a2-4562-9c1d-06fa8a24097f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:45:41.200064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-359d1519-16a2-4562-9c1d-06fa8a24097f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:41.200521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-359d1519-16a2-4562-9c1d-06fa8a24097f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:41.201299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-359d1519-16a2-4562-9c1d-06fa8a24097f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:41.201742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-359d1519-16a2-4562-9c1d-06fa8a24097f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:41.338227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-359d1519-16a2-4562-9c1d-06fa8a24097f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:45:41.346106 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-359d1519-16a2-4562-9c1d-06fa8a24097f tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1450 microversion: 2.1 time: 0.157688 Aug 03 02:45:41.346669 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3152/6425] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:45:41 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:45:43.089724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-046e71ca-3b50-4aad-a8dc-79af1bd27d3d req-5769c1d2-747c-4c06-a650-0886dc54c65b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b53f9e13-2692-42b2-97c7-3250698662ac", "tag": "0c90608c-df4a-4803-be0d-59fb3168a5a9"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:45:43.101688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-046e71ca-3b50-4aad-a8dc-79af1bd27d3d req-5769c1d2-747c-4c06-a650-0886dc54c65b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:45:43.102079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-046e71ca-3b50-4aad-a8dc-79af1bd27d3d req-5769c1d2-747c-4c06-a650-0886dc54c65b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:45:43.114157 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-046e71ca-3b50-4aad-a8dc-79af1bd27d3d req-5769c1d2-747c-4c06-a650-0886dc54c65b service nova] Creating event network-changed:0c90608c-df4a-4803-be0d-59fb3168a5a9 for instance b53f9e13-2692-42b2-97c7-3250698662ac on n-h2-826529-8 Aug 03 02:45:43.119456 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-046e71ca-3b50-4aad-a8dc-79af1bd27d3d req-5769c1d2-747c-4c06-a650-0886dc54c65b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033406 Aug 03 02:45:43.120437 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3274/6426] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:45:59.615367 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:45:59.616574 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 02:45:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:45:59.678035 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:45:59.678272 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 02:45:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:45:59.707919 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:45:59.708506 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 02:45:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:47:20.418822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:47:20.420315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=58 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:47:20.425796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2b9ac409-40d3-46ae-8aab-6eb992f698a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:20.426669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2b9ac409-40d3-46ae-8aab-6eb992f698a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:20.438842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b9ac409-40d3-46ae-8aab-6eb992f698a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:20.439641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b9ac409-40d3-46ae-8aab-6eb992f698a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:20.440978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b9ac409-40d3-46ae-8aab-6eb992f698a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:20.441689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b9ac409-40d3-46ae-8aab-6eb992f698a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:20.482605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2b9ac409-40d3-46ae-8aab-6eb992f698a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:47:20.531566 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b324c37-7dbb-4b30-9a93-80ead1f0c21e] AMQP server on 10.222.0.67:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 03 02:47:20.532826 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c87329c-10f0-40cc-99d5-2fdb48e49def] AMQP server on 10.222.0.67:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 03 02:47:20.534204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=30 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:47:20.534866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=58 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:47:20.618428 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2b9ac409-40d3-46ae-8aab-6eb992f698a1 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 204 len: 0 microversion: 2.1 time: 0.201507 Aug 03 02:47:20.625855 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3153/6427] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:47:20 2022] DELETE /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:47:20.636781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-98dc9f35-dde4-43ef-8d5a-a84ed27fff5b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:20.636781 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-98dc9f35-dde4-43ef-8d5a-a84ed27fff5b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:20.642926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98dc9f35-dde4-43ef-8d5a-a84ed27fff5b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:20.643406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98dc9f35-dde4-43ef-8d5a-a84ed27fff5b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:20.643674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-5c1287fd-4e49-44c9-ad3a-29bde3ead1de req-551b9558-29dc-4203-b431-655a0f356e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b53f9e13-2692-42b2-97c7-3250698662ac", "tag": "0c90608c-df4a-4803-be0d-59fb3168a5a9"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:47:20.644200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98dc9f35-dde4-43ef-8d5a-a84ed27fff5b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:20.644645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98dc9f35-dde4-43ef-8d5a-a84ed27fff5b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:20.659447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5c1287fd-4e49-44c9-ad3a-29bde3ead1de req-551b9558-29dc-4203-b431-655a0f356e06 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:20.660153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5c1287fd-4e49-44c9-ad3a-29bde3ead1de req-551b9558-29dc-4203-b431-655a0f356e06 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:20.677690 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-5c1287fd-4e49-44c9-ad3a-29bde3ead1de req-551b9558-29dc-4203-b431-655a0f356e06 service nova] Creating event network-changed:0c90608c-df4a-4803-be0d-59fb3168a5a9 for instance b53f9e13-2692-42b2-97c7-3250698662ac on n-h2-826529-8 Aug 03 02:47:20.684217 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-5c1287fd-4e49-44c9-ad3a-29bde3ead1de req-551b9558-29dc-4203-b431-655a0f356e06 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155703 Aug 03 02:47:20.687074 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3275/6428] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:47:20.920440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-98dc9f35-dde4-43ef-8d5a-a84ed27fff5b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:47:20.931104 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-98dc9f35-dde4-43ef-8d5a-a84ed27fff5b tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1575 microversion: 2.1 time: 0.302993 Aug 03 02:47:20.934260 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3154/6429] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:47:20 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1575 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:47:21.957478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2e12b33c-23db-4dfe-8624-807244972e48 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:21.958169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2e12b33c-23db-4dfe-8624-807244972e48 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:21.967803 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c87329c-10f0-40cc-99d5-2fdb48e49def] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 34802. Aug 03 02:47:21.971462 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b324c37-7dbb-4b30-9a93-80ead1f0c21e] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 34800. Aug 03 02:47:21.973094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e12b33c-23db-4dfe-8624-807244972e48 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:21.973567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e12b33c-23db-4dfe-8624-807244972e48 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:21.974366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e12b33c-23db-4dfe-8624-807244972e48 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:21.974822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e12b33c-23db-4dfe-8624-807244972e48 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:22.200238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2e12b33c-23db-4dfe-8624-807244972e48 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:47:22.208110 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2e12b33c-23db-4dfe-8624-807244972e48 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1575 microversion: 2.1 time: 0.257077 Aug 03 02:47:22.208665 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3276/6430] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:47:21 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1575 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:47:22.890766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-93443aa0-fbf4-48ed-bcb5-f236aac3a13a req-f9f71e3f-a3a3-4c90-8bac-5dc8ccefb8ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53f9e13-2692-42b2-97c7-3250698662ac", "name": "network-vif-deleted", "tag": "0c90608c-df4a-4803-be0d-59fb3168a5a9"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:47:22.900707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-93443aa0-fbf4-48ed-bcb5-f236aac3a13a req-f9f71e3f-a3a3-4c90-8bac-5dc8ccefb8ef service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:22.901686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-93443aa0-fbf4-48ed-bcb5-f236aac3a13a req-f9f71e3f-a3a3-4c90-8bac-5dc8ccefb8ef service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:22.913682 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-93443aa0-fbf4-48ed-bcb5-f236aac3a13a req-f9f71e3f-a3a3-4c90-8bac-5dc8ccefb8ef service nova] Creating event network-vif-deleted:0c90608c-df4a-4803-be0d-59fb3168a5a9 for instance b53f9e13-2692-42b2-97c7-3250698662ac on n-h2-826529-8 Aug 03 02:47:22.919624 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-93443aa0-fbf4-48ed-bcb5-f236aac3a13a req-f9f71e3f-a3a3-4c90-8bac-5dc8ccefb8ef service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087390 Aug 03 02:47:22.920240 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3155/6431] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:47:23.230364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-98cff1d7-64cf-4e69-9a81-d9fbec05c646 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:23.231062 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-98cff1d7-64cf-4e69-9a81-d9fbec05c646 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:23.239408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98cff1d7-64cf-4e69-9a81-d9fbec05c646 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:23.240242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98cff1d7-64cf-4e69-9a81-d9fbec05c646 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:23.241112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98cff1d7-64cf-4e69-9a81-d9fbec05c646 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:23.241641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98cff1d7-64cf-4e69-9a81-d9fbec05c646 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:23.309075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-98cff1d7-64cf-4e69-9a81-d9fbec05c646 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:47:23.316827 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-98cff1d7-64cf-4e69-9a81-d9fbec05c646 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1224 microversion: 2.1 time: 0.091069 Aug 03 02:47:23.317403 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3277/6432] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:47:23 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:47:24.338241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4ebde69a-62a4-410f-99e8-42335f89e93d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:24.339959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4ebde69a-62a4-410f-99e8-42335f89e93d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:24.347257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ebde69a-62a4-410f-99e8-42335f89e93d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:24.347713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ebde69a-62a4-410f-99e8-42335f89e93d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:24.348518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ebde69a-62a4-410f-99e8-42335f89e93d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:24.348957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4ebde69a-62a4-410f-99e8-42335f89e93d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:24.414938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4ebde69a-62a4-410f-99e8-42335f89e93d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:47:24.422691 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4ebde69a-62a4-410f-99e8-42335f89e93d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1224 microversion: 2.1 time: 0.088686 Aug 03 02:47:24.423305 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3156/6433] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:47:24 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:47:25.444458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6e396d2a-9102-4040-9e87-b3955cd1c0ac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:25.445080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6e396d2a-9102-4040-9e87-b3955cd1c0ac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:25.452732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e396d2a-9102-4040-9e87-b3955cd1c0ac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:25.453197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e396d2a-9102-4040-9e87-b3955cd1c0ac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:25.453976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e396d2a-9102-4040-9e87-b3955cd1c0ac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:25.454424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e396d2a-9102-4040-9e87-b3955cd1c0ac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:25.522440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6e396d2a-9102-4040-9e87-b3955cd1c0ac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:47:25.531575 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6e396d2a-9102-4040-9e87-b3955cd1c0ac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1224 microversion: 2.1 time: 0.091249 Aug 03 02:47:25.532161 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3278/6434] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:47:25 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:47:26.553176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8b15fbaa-172f-4cca-84e1-454cfa7f6c62 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:26.553806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8b15fbaa-172f-4cca-84e1-454cfa7f6c62 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:26.561673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8b15fbaa-172f-4cca-84e1-454cfa7f6c62 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:26.562140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8b15fbaa-172f-4cca-84e1-454cfa7f6c62 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:26.562957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8b15fbaa-172f-4cca-84e1-454cfa7f6c62 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:26.563410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8b15fbaa-172f-4cca-84e1-454cfa7f6c62 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:26.629836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8b15fbaa-172f-4cca-84e1-454cfa7f6c62 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:47:26.638579 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8b15fbaa-172f-4cca-84e1-454cfa7f6c62 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 200 len: 1224 microversion: 2.1 time: 0.089469 Aug 03 02:47:26.639190 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3157/6435] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:47:26 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:47:27.660534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6ac9845a-1df1-4579-82f2-c3e467d67c8d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:27.661090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6ac9845a-1df1-4579-82f2-c3e467d67c8d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b53f9e13-2692-42b2-97c7-3250698662ac] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:27.668821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ac9845a-1df1-4579-82f2-c3e467d67c8d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:27.669280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ac9845a-1df1-4579-82f2-c3e467d67c8d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:27.670066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ac9845a-1df1-4579-82f2-c3e467d67c8d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:27.670511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ac9845a-1df1-4579-82f2-c3e467d67c8d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:27.683887 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-6ac9845a-1df1-4579-82f2-c3e467d67c8d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance b53f9e13-2692-42b2-97c7-3250698662ac could not be found. Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6ac9845a-1df1-4579-82f2-c3e467d67c8d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac HTTP/1.1 Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance b53f9e13-2692-42b2-97c7-3250698662ac could not be found. Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'b53f9e13-2692-42b2-97c7-3250698662ac'} Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53f9e13-2692-42b2-97c7-3250698662ac could not be found. Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53f9e13-2692-42b2-97c7-3250698662ac could not be found. Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:47:27.685524 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:47:27.690782 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:47:27.690782 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:47:27.690782 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:47:27.690782 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:47:27.690782 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:47:27.690782 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53f9e13-2692-42b2-97c7-3250698662ac could not be found. Aug 03 02:47:27.690782 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:47:27.690782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6ac9845a-1df1-4579-82f2-c3e467d67c8d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance b53f9e13-2692-42b2-97c7-3250698662ac could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:47:27.690782 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6ac9845a-1df1-4579-82f2-c3e467d67c8d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac" status: 404 len: 111 microversion: 2.1 time: 0.030383 Aug 03 02:47:27.690782 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3279/6436] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:47:27 2022] GET /compute/v2.1/servers/b53f9e13-2692-42b2-97c7-3250698662ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:47:33.915826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25e531bf-dd4e-4def-bd87-5e6f02ad289c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:33.917141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-25e531bf-dd4e-4def-bd87-5e6f02ad289c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:33.918804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-6a4af50c-6508-4e6e-8e98-92b43d353f8f req-480b9be1-ca1e-4a92-ad26-698821f87d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b009eef8-50b5-4a13-9017-cb60cf07e9fd", "tag": "d67a7637-27e0-4f9a-91ad-8f85b02639cf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:47:33.924842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25e531bf-dd4e-4def-bd87-5e6f02ad289c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:33.925301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25e531bf-dd4e-4def-bd87-5e6f02ad289c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:33.926088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25e531bf-dd4e-4def-bd87-5e6f02ad289c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:33.926702 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25e531bf-dd4e-4def-bd87-5e6f02ad289c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:33.930510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6a4af50c-6508-4e6e-8e98-92b43d353f8f req-480b9be1-ca1e-4a92-ad26-698821f87d86 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:33.931010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6a4af50c-6508-4e6e-8e98-92b43d353f8f req-480b9be1-ca1e-4a92-ad26-698821f87d86 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:33.944948 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-6a4af50c-6508-4e6e-8e98-92b43d353f8f req-480b9be1-ca1e-4a92-ad26-698821f87d86 service nova] Creating event network-changed:d67a7637-27e0-4f9a-91ad-8f85b02639cf for instance b009eef8-50b5-4a13-9017-cb60cf07e9fd on n-h1-826529-8 Aug 03 02:47:33.951195 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-6a4af50c-6508-4e6e-8e98-92b43d353f8f req-480b9be1-ca1e-4a92-ad26-698821f87d86 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037064 Aug 03 02:47:33.951810 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3280/6437] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:47:33.955022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-25e531bf-dd4e-4def-bd87-5e6f02ad289c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:47:34.044285 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-25e531bf-dd4e-4def-bd87-5e6f02ad289c tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 204 len: 0 microversion: 2.1 time: 0.132512 Aug 03 02:47:34.045295 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3158/6438] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:47:33 2022] DELETE /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:47:34.055610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7c9ee677-53f9-4ed0-9f42-784f083f4520 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:34.056650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7c9ee677-53f9-4ed0-9f42-784f083f4520 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:34.066397 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c9ee677-53f9-4ed0-9f42-784f083f4520 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:34.066877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c9ee677-53f9-4ed0-9f42-784f083f4520 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:34.067742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c9ee677-53f9-4ed0-9f42-784f083f4520 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:34.068387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7c9ee677-53f9-4ed0-9f42-784f083f4520 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:34.211409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7c9ee677-53f9-4ed0-9f42-784f083f4520 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:47:34.219914 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7c9ee677-53f9-4ed0-9f42-784f083f4520 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1577 microversion: 2.1 time: 0.169281 Aug 03 02:47:34.220504 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3281/6439] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:47:34 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:47:35.243737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2b6aaf35-de78-48a1-88f0-69e290964ae0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:35.245071 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2b6aaf35-de78-48a1-88f0-69e290964ae0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:35.252780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b6aaf35-de78-48a1-88f0-69e290964ae0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:35.253251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b6aaf35-de78-48a1-88f0-69e290964ae0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:35.254082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b6aaf35-de78-48a1-88f0-69e290964ae0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:35.255111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b6aaf35-de78-48a1-88f0-69e290964ae0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:35.405140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2b6aaf35-de78-48a1-88f0-69e290964ae0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:47:35.413310 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2b6aaf35-de78-48a1-88f0-69e290964ae0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1577 microversion: 2.1 time: 0.173885 Aug 03 02:47:35.414007 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3159/6440] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:47:35 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:47:36.193253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-aedeef07-5a28-49ef-a95a-4f784c054344 req-c375b735-cdfa-498e-b372-77d7aeb15e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b009eef8-50b5-4a13-9017-cb60cf07e9fd", "name": "network-vif-deleted", "tag": "d67a7637-27e0-4f9a-91ad-8f85b02639cf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:47:36.204804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-aedeef07-5a28-49ef-a95a-4f784c054344 req-c375b735-cdfa-498e-b372-77d7aeb15e07 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:36.205271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-aedeef07-5a28-49ef-a95a-4f784c054344 req-c375b735-cdfa-498e-b372-77d7aeb15e07 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:36.217793 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-aedeef07-5a28-49ef-a95a-4f784c054344 req-c375b735-cdfa-498e-b372-77d7aeb15e07 service nova] Creating event network-vif-deleted:d67a7637-27e0-4f9a-91ad-8f85b02639cf for instance b009eef8-50b5-4a13-9017-cb60cf07e9fd on n-h1-826529-8 Aug 03 02:47:36.223140 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-aedeef07-5a28-49ef-a95a-4f784c054344 req-c375b735-cdfa-498e-b372-77d7aeb15e07 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033561 Aug 03 02:47:36.223778 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3282/6441] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:47:36.435104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9d742135-8f75-486d-9cd3-bd607c988164 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:36.435648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9d742135-8f75-486d-9cd3-bd607c988164 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:36.442439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d742135-8f75-486d-9cd3-bd607c988164 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:36.442891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d742135-8f75-486d-9cd3-bd607c988164 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:36.443706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d742135-8f75-486d-9cd3-bd607c988164 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:36.444139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d742135-8f75-486d-9cd3-bd607c988164 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:36.514961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9d742135-8f75-486d-9cd3-bd607c988164 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:47:36.524554 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9d742135-8f75-486d-9cd3-bd607c988164 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1226 microversion: 2.1 time: 0.093785 Aug 03 02:47:36.525225 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3160/6442] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:47:36 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:47:37.547148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd85b230-86a0-46b9-95f6-8d8a40f9321d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:37.547886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cd85b230-86a0-46b9-95f6-8d8a40f9321d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:37.554290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd85b230-86a0-46b9-95f6-8d8a40f9321d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:37.554751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd85b230-86a0-46b9-95f6-8d8a40f9321d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:37.555622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd85b230-86a0-46b9-95f6-8d8a40f9321d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:37.556071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd85b230-86a0-46b9-95f6-8d8a40f9321d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:37.622477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cd85b230-86a0-46b9-95f6-8d8a40f9321d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:47:37.630434 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cd85b230-86a0-46b9-95f6-8d8a40f9321d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1226 microversion: 2.1 time: 0.088243 Aug 03 02:47:37.630997 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3283/6443] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:47:37 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:47:38.652757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-861ebf3c-4044-4ada-8c82-743a08976e5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:38.653389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-861ebf3c-4044-4ada-8c82-743a08976e5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:38.660514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-861ebf3c-4044-4ada-8c82-743a08976e5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:38.660975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-861ebf3c-4044-4ada-8c82-743a08976e5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:38.661981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-861ebf3c-4044-4ada-8c82-743a08976e5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:38.662207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-861ebf3c-4044-4ada-8c82-743a08976e5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:38.729512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-861ebf3c-4044-4ada-8c82-743a08976e5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:47:38.737699 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-861ebf3c-4044-4ada-8c82-743a08976e5d tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1226 microversion: 2.1 time: 0.089497 Aug 03 02:47:38.738467 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3161/6444] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:47:38 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:47:39.736740 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:47:39.736740 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 02:47:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:47:39.758895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-781b8598-3670-4a4c-b49f-2c0e549ff811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:39.759557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-781b8598-3670-4a4c-b49f-2c0e549ff811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:39.767600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-781b8598-3670-4a4c-b49f-2c0e549ff811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:39.768070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-781b8598-3670-4a4c-b49f-2c0e549ff811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:39.768861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-781b8598-3670-4a4c-b49f-2c0e549ff811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:39.769314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-781b8598-3670-4a4c-b49f-2c0e549ff811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:39.837340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-781b8598-3670-4a4c-b49f-2c0e549ff811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1114641f11954d74885d0e4b082d7704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f334fb7e1f5472b9f65edc059914b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:47:39.846714 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-781b8598-3670-4a4c-b49f-2c0e549ff811 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 200 len: 1226 microversion: 2.1 time: 0.091538 Aug 03 02:47:39.847476 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3284/6445] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:47:39 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:47:40.867695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-027bb5f0-ecb1-4186-8147-ba9030e293be tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:40.868248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-027bb5f0-ecb1-4186-8147-ba9030e293be tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: b009eef8-50b5-4a13-9017-cb60cf07e9fd] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:40.875932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-027bb5f0-ecb1-4186-8147-ba9030e293be tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:40.876383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-027bb5f0-ecb1-4186-8147-ba9030e293be tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:40.877347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-027bb5f0-ecb1-4186-8147-ba9030e293be tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:40.877785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-027bb5f0-ecb1-4186-8147-ba9030e293be tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:40.892080 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-027bb5f0-ecb1-4186-8147-ba9030e293be tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance b009eef8-50b5-4a13-9017-cb60cf07e9fd could not be found. Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-027bb5f0-ecb1-4186-8147-ba9030e293be tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd HTTP/1.1 Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance b009eef8-50b5-4a13-9017-cb60cf07e9fd could not be found. Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'b009eef8-50b5-4a13-9017-cb60cf07e9fd'} Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b009eef8-50b5-4a13-9017-cb60cf07e9fd could not be found. Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b009eef8-50b5-4a13-9017-cb60cf07e9fd could not be found. Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:47:40.893716 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:47:40.898988 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:47:40.898988 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:47:40.898988 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:47:40.898988 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:47:40.898988 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:47:40.898988 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b009eef8-50b5-4a13-9017-cb60cf07e9fd could not be found. Aug 03 02:47:40.898988 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:47:40.898988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-027bb5f0-ecb1-4186-8147-ba9030e293be tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance b009eef8-50b5-4a13-9017-cb60cf07e9fd could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:47:40.898988 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-027bb5f0-ecb1-4186-8147-ba9030e293be tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd" status: 404 len: 111 microversion: 2.1 time: 0.031407 Aug 03 02:47:40.898988 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3162/6446] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:47:40 2022] GET /compute/v2.1/servers/b009eef8-50b5-4a13-9017-cb60cf07e9fd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:47:41.348729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f6984dfd-ee35-4283-b401-e6851d7b7aac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:41.349248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f6984dfd-ee35-4283-b401-e6851d7b7aac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:41.356405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f6984dfd-ee35-4283-b401-e6851d7b7aac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:41.356876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f6984dfd-ee35-4283-b401-e6851d7b7aac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:41.357657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f6984dfd-ee35-4283-b401-e6851d7b7aac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:41.358109 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f6984dfd-ee35-4283-b401-e6851d7b7aac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:41.371663 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-f6984dfd-ee35-4283-b401-e6851d7b7aac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f6984dfd-ee35-4283-b401-e6851d7b7aac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 HTTP/1.1 Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'f176db0d-6e6c-440d-bb11-45c90194f8f1'} Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:47:41.373335 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:47:41.379416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. Aug 03 02:47:41.379416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:47:41.379416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:47:41.379416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:47:41.379416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:47:41.379416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:47:41.379416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:47:41.379416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:47:41.379416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:47:41.379416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. Aug 03 02:47:41.379416 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:47:41.379416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f6984dfd-ee35-4283-b401-e6851d7b7aac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:47:41.379416 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f6984dfd-ee35-4283-b401-e6851d7b7aac tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 404 len: 111 microversion: 2.1 time: 0.029927 Aug 03 02:47:41.379416 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3285/6447] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:47:41 2022] DELETE /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:47:41.383588 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-644343bf-786f-418c-9637-9b0538d23c0e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:41.384207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-644343bf-786f-418c-9637-9b0538d23c0e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] [instance: f176db0d-6e6c-440d-bb11-45c90194f8f1] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:47:41.394512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-644343bf-786f-418c-9637-9b0538d23c0e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:41.395009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-644343bf-786f-418c-9637-9b0538d23c0e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:41.395794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-644343bf-786f-418c-9637-9b0538d23c0e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:47:41.396236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-644343bf-786f-418c-9637-9b0538d23c0e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:47:41.410568 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-644343bf-786f-418c-9637-9b0538d23c0e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] HTTP exception thrown: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-644343bf-786f-418c-9637-9b0538d23c0e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Request method failure captured: Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 HTTP/1.1 Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6d9GrHDMUWfm71yAREDb2uLLTg54vynfOBPttDM8chzca4VAbTaFVvLgg05hMk7Ybq2RfVi8AHB9DMkp8-PHKVfhLd37NKzxOSQaEEjURW7EKxW2T4SblmyVN2z7eE1v4SeRYC3iwkvwN0lxh1eG3aojyUz5xMS9BwKk6JBniMwxq68 Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5f334fb7e1f5472b9f65edc059914b78", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5f334fb7e1f5472b9f65edc059914b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5f334fb7e1f5472b9f65edc059914b78"}]}] Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestVolumeBootPattern-34258614 Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 5f334fb7e1f5472b9f65edc059914b78 Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestVolumeBootPattern-34258614 Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1114641f11954d74885d0e4b082d7704 Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestVolumeBootPattern-34258614-project Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'f176db0d-6e6c-440d-bb11-45c90194f8f1'} Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:47:41.412165 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:47:41.416756 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:47:41.416756 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:47:41.416756 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:47:41.416756 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:47:41.416756 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:47:41.416756 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. Aug 03 02:47:41.416756 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:47:41.416756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-644343bf-786f-418c-9637-9b0538d23c0e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Returning 404 to user: Instance f176db0d-6e6c-440d-bb11-45c90194f8f1 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:47:41.416756 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-644343bf-786f-418c-9637-9b0538d23c0e tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1" status: 404 len: 111 microversion: 2.1 time: 0.033817 Aug 03 02:47:41.416756 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3163/6448] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:47:41 2022] GET /compute/v2.1/servers/f176db0d-6e6c-440d-bb11-45c90194f8f1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:47:44.842432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7f613673-9a50-48db-afe4-069ed66bf7a0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] Calling method '.version_select at 0x7f5b1030b0d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:47:44.880516 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7f613673-9a50-48db-afe4-069ed66bf7a0 tempest-TestVolumeBootPattern-34258614 tempest-TestVolumeBootPattern-34258614-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2109864592" status: 202 len: 0 microversion: 2.1 time: 0.040017 Aug 03 02:47:44.880516 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3286/6449] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 3 02:47:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2109864592 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:48:03.886240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:03.887017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:04.017539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-184400918", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:48:04.074126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] validate_networks() for None {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:48:04.362379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:48:04.362802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:48:04.363315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:48:04.363728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:48:04.364185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:48:04.376709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:04.377158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:04.377961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:04.378401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:04.399138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Getting quotas for project 11b5ba0fb45c46d3a45955c41b9aa4e9. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:48:04.405416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Getting quotas for user 7ed13395bcfb4478b013e0aadb08a390 and project 11b5ba0fb45c46d3a45955c41b9aa4e9. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:48:04.418206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:48:04.420504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:48:04.466469 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5e35e9b6-7e77-4cb9-9d7e-e18ffbdcaa8c tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585992 Aug 03 02:48:04.467480 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3164/6450] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:48:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:48:04.481908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-49a2e13e-f92e-4988-81cb-a030f134c662 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:04.482563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-49a2e13e-f92e-4988-81cb-a030f134c662 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:04.485554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=46 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:04.486625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:04.547634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-49a2e13e-f92e-4988-81cb-a030f134c662 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed13395bcfb4478b013e0aadb08a390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5ba0fb45c46d3a45955c41b9aa4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:04.557974 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-49a2e13e-f92e-4988-81cb-a030f134c662 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] 10.222.0.67 "GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b" status: 200 len: 1221 microversion: 2.1 time: 0.081250 Aug 03 02:48:04.558539 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3287/6451] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:04 2022] GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:05.582684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-207cb5bf-5630-4951-a56c-a6f9788a8295 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:05.583329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-207cb5bf-5630-4951-a56c-a6f9788a8295 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:05.591117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-207cb5bf-5630-4951-a56c-a6f9788a8295 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:05.591879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-207cb5bf-5630-4951-a56c-a6f9788a8295 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:05.592863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-207cb5bf-5630-4951-a56c-a6f9788a8295 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:05.593487 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-207cb5bf-5630-4951-a56c-a6f9788a8295 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:05.668072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-207cb5bf-5630-4951-a56c-a6f9788a8295 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed13395bcfb4478b013e0aadb08a390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5ba0fb45c46d3a45955c41b9aa4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:05.675744 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-207cb5bf-5630-4951-a56c-a6f9788a8295 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] 10.222.0.67 "GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b" status: 200 len: 1291 microversion: 2.1 time: 0.097859 Aug 03 02:48:05.676306 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3165/6452] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:05 2022] GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b => generated 1291 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:06.697759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-43ddca06-3c67-4728-aba9-a44ae3c594a6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:06.698493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-43ddca06-3c67-4728-aba9-a44ae3c594a6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:06.706428 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43ddca06-3c67-4728-aba9-a44ae3c594a6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:06.707054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43ddca06-3c67-4728-aba9-a44ae3c594a6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:06.707923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43ddca06-3c67-4728-aba9-a44ae3c594a6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:06.708449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43ddca06-3c67-4728-aba9-a44ae3c594a6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:06.860034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-43ddca06-3c67-4728-aba9-a44ae3c594a6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed13395bcfb4478b013e0aadb08a390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5ba0fb45c46d3a45955c41b9aa4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:06.868892 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-43ddca06-3c67-4728-aba9-a44ae3c594a6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] 10.222.0.67 "GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b" status: 200 len: 1321 microversion: 2.1 time: 0.174413 Aug 03 02:48:06.869943 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3288/6453] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:06 2022] GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:07.000045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-b4c37a46-b5aa-472c-b982-398ece849be9 req-27c72ca2-997d-41df-9618-e4f9c4759015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "219065c2-9bfe-4334-b1f6-563617556d0b", "tag": "b4dabee2-98f0-4211-9b5b-c9bca355eeb7"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:48:07.017962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b4c37a46-b5aa-472c-b982-398ece849be9 req-27c72ca2-997d-41df-9618-e4f9c4759015 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:07.018424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b4c37a46-b5aa-472c-b982-398ece849be9 req-27c72ca2-997d-41df-9618-e4f9c4759015 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:07.030747 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-b4c37a46-b5aa-472c-b982-398ece849be9 req-27c72ca2-997d-41df-9618-e4f9c4759015 service nova] Creating event network-changed:b4dabee2-98f0-4211-9b5b-c9bca355eeb7 for instance 219065c2-9bfe-4334-b1f6-563617556d0b on n-h2-826529-8 Aug 03 02:48:07.036139 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-b4c37a46-b5aa-472c-b982-398ece849be9 req-27c72ca2-997d-41df-9618-e4f9c4759015 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039896 Aug 03 02:48:07.036771 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3166/6454] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:48:07.890521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-832729b3-22e4-49f2-acb6-0f5e0d20a37a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:07.891192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-832729b3-22e4-49f2-acb6-0f5e0d20a37a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:07.898418 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-832729b3-22e4-49f2-acb6-0f5e0d20a37a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:07.898876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-832729b3-22e4-49f2-acb6-0f5e0d20a37a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:07.900283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-832729b3-22e4-49f2-acb6-0f5e0d20a37a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:07.900754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-832729b3-22e4-49f2-acb6-0f5e0d20a37a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:08.034988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-832729b3-22e4-49f2-acb6-0f5e0d20a37a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed13395bcfb4478b013e0aadb08a390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5ba0fb45c46d3a45955c41b9aa4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:08.043595 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-832729b3-22e4-49f2-acb6-0f5e0d20a37a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] 10.222.0.67 "GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b" status: 200 len: 1321 microversion: 2.1 time: 0.157305 Aug 03 02:48:08.044169 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3289/6455] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:07 2022] GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:09.065331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-989d5de8-9a23-4412-b406-55ed25c3f49a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:09.066039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-989d5de8-9a23-4412-b406-55ed25c3f49a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:09.072692 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-989d5de8-9a23-4412-b406-55ed25c3f49a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:09.073150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-989d5de8-9a23-4412-b406-55ed25c3f49a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:09.073944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-989d5de8-9a23-4412-b406-55ed25c3f49a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:09.074390 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-989d5de8-9a23-4412-b406-55ed25c3f49a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:09.205904 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-989d5de8-9a23-4412-b406-55ed25c3f49a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed13395bcfb4478b013e0aadb08a390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5ba0fb45c46d3a45955c41b9aa4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:09.213503 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-989d5de8-9a23-4412-b406-55ed25c3f49a tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] 10.222.0.67 "GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b" status: 200 len: 1321 microversion: 2.1 time: 0.153245 Aug 03 02:48:09.214073 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3167/6456] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:09 2022] GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:10.234487 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8c1616d7-2ac9-4df6-832c-4f37ef46a50e tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:10.235181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8c1616d7-2ac9-4df6-832c-4f37ef46a50e tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:10.242406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c1616d7-2ac9-4df6-832c-4f37ef46a50e tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:10.243949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c1616d7-2ac9-4df6-832c-4f37ef46a50e tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:10.246240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c1616d7-2ac9-4df6-832c-4f37ef46a50e tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:10.246240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c1616d7-2ac9-4df6-832c-4f37ef46a50e tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:10.380997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8c1616d7-2ac9-4df6-832c-4f37ef46a50e tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed13395bcfb4478b013e0aadb08a390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5ba0fb45c46d3a45955c41b9aa4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:10.389845 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8c1616d7-2ac9-4df6-832c-4f37ef46a50e tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] 10.222.0.67 "GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b" status: 200 len: 1321 microversion: 2.1 time: 0.159492 Aug 03 02:48:10.390411 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3290/6457] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:10 2022] GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:11.411154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d1410747-d9bc-4a0b-bd42-773181d1799b tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:11.411789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d1410747-d9bc-4a0b-bd42-773181d1799b tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:11.420040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1410747-d9bc-4a0b-bd42-773181d1799b tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:11.420516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1410747-d9bc-4a0b-bd42-773181d1799b tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:11.421302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1410747-d9bc-4a0b-bd42-773181d1799b tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:11.421743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1410747-d9bc-4a0b-bd42-773181d1799b tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:11.563507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d1410747-d9bc-4a0b-bd42-773181d1799b tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed13395bcfb4478b013e0aadb08a390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5ba0fb45c46d3a45955c41b9aa4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:11.572312 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d1410747-d9bc-4a0b-bd42-773181d1799b tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] 10.222.0.67 "GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b" status: 200 len: 1321 microversion: 2.1 time: 0.165188 Aug 03 02:48:11.572905 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3168/6458] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:11 2022] GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:12.329045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c66e828f-9da3-4c92-a5aa-fe62de8b2101 req-cdc3bcae-46b5-45a9-a44f-bd54faa703b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "219065c2-9bfe-4334-b1f6-563617556d0b", "name": "network-vif-plugged", "status": "completed", "tag": "b4dabee2-98f0-4211-9b5b-c9bca355eeb7"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:48:12.338792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c66e828f-9da3-4c92-a5aa-fe62de8b2101 req-cdc3bcae-46b5-45a9-a44f-bd54faa703b6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:12.339278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c66e828f-9da3-4c92-a5aa-fe62de8b2101 req-cdc3bcae-46b5-45a9-a44f-bd54faa703b6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:12.352864 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c66e828f-9da3-4c92-a5aa-fe62de8b2101 req-cdc3bcae-46b5-45a9-a44f-bd54faa703b6 service nova] Creating event network-vif-plugged:b4dabee2-98f0-4211-9b5b-c9bca355eeb7 for instance 219065c2-9bfe-4334-b1f6-563617556d0b on n-h2-826529-8 Aug 03 02:48:12.358262 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c66e828f-9da3-4c92-a5aa-fe62de8b2101 req-cdc3bcae-46b5-45a9-a44f-bd54faa703b6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091884 Aug 03 02:48:12.358996 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3291/6459] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:48:12.593633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-715df0c4-57d3-42a0-a5f5-b9b52faa1cdd tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:12.594288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-715df0c4-57d3-42a0-a5f5-b9b52faa1cdd tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:12.601198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-715df0c4-57d3-42a0-a5f5-b9b52faa1cdd tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:12.601655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-715df0c4-57d3-42a0-a5f5-b9b52faa1cdd tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:12.603204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-715df0c4-57d3-42a0-a5f5-b9b52faa1cdd tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:12.603204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-715df0c4-57d3-42a0-a5f5-b9b52faa1cdd tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:12.741699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-715df0c4-57d3-42a0-a5f5-b9b52faa1cdd tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed13395bcfb4478b013e0aadb08a390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5ba0fb45c46d3a45955c41b9aa4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:12.750256 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-715df0c4-57d3-42a0-a5f5-b9b52faa1cdd tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] 10.222.0.67 "GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b" status: 200 len: 1321 microversion: 2.1 time: 0.160628 Aug 03 02:48:12.750837 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3169/6460] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:12 2022] GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:13.771989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc8e66de-5001-4ada-9599-b052a2d86b9f tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:13.772921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fc8e66de-5001-4ada-9599-b052a2d86b9f tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:13.780686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc8e66de-5001-4ada-9599-b052a2d86b9f tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:13.781165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc8e66de-5001-4ada-9599-b052a2d86b9f tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:13.782017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc8e66de-5001-4ada-9599-b052a2d86b9f tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:13.782468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc8e66de-5001-4ada-9599-b052a2d86b9f tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:13.928359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fc8e66de-5001-4ada-9599-b052a2d86b9f tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed13395bcfb4478b013e0aadb08a390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5ba0fb45c46d3a45955c41b9aa4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:13.936794 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fc8e66de-5001-4ada-9599-b052a2d86b9f tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] 10.222.0.67 "GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b" status: 200 len: 1471 microversion: 2.1 time: 0.169112 Aug 03 02:48:13.937408 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3292/6461] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:13 2022] GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:14.009750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d5504fd4-8ab5-40f7-aa4f-c239e5170c3d tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Calling method '.version_select at 0x7f5b12183040>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:14.080254 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d5504fd4-8ab5-40f7-aa4f-c239e5170c3d tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/641b39316cca42f6949f4cdf30810503" status: 200 len: 371 microversion: 2.1 time: 0.124389 Aug 03 02:48:14.080836 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3170/6462] 10.222.0.67 () {58 vars in 1242 bytes} [Wed Aug 3 02:48:13 2022] GET /compute/v2.1/os-quota-sets/641b39316cca42f6949f4cdf30810503 => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:48:14.093600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-74a2435f-c6f9-4cf9-b2f3-aec5ba6d1cfc tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1339566234", "id": 113005364, "os-flavor-access:is_public": "True"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:48:14.096673 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:48:14.096673 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 02:48:14.114816 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-74a2435f-c6f9-4cf9-b2f3-aec5ba6d1cfc tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.024737 Aug 03 02:48:14.115850 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3293/6463] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:48:14 2022] POST /compute/v2.1/flavors => generated 435 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:48:14.128254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "113005364"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:48:14.130643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:14.137889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:14.138340 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:14.139147 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:14.139587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:14.371450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b0cbfc97cd75467fbdb5cc81c23728c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b39316cca42f6949f4cdf30810503', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:14.378540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1339566234 {{(pid=125942) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 02:48:14.386148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:14.386680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:14.387535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:14.387986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:14.395125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:14.411311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Getting quotas for project 11b5ba0fb45c46d3a45955c41b9aa4e9. Resources: {'cores', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:48:14.417599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Getting quotas for user 7ed13395bcfb4478b013e0aadb08a390 and project 11b5ba0fb45c46d3a45955c41b9aa4e9. Resources: {'cores', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:48:14.431779 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.compute.api [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] ram quota exceeded for 641b39316cca42f6949f4cdf30810503, tried to resize instance. Aug 03 02:48:14.432307 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Request method failure captured: Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b/action HTTP/1.1 Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 38 Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eHjgPpbOxzEgvYAhLa4GDnppQWhDtq27PmLklJWVCwiInNrKQol6fec2uEUWnNUdoQYwh2mc4ujjnGrjA1ROdzq0SpTARy-qATjr4Jq_aqacmD16hUNOxVOTTfTJKypY0nItTKUwvxHou-yoggYCTZ91g_VANGc39gBIZ6ni5ON9vo Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 641b39316cca42f6949f4cdf30810503 Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1172544475 Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-Role: admin,member,reader Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: admin,member,reader Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_641b39316cca42f6949f4cdf30810503", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/641b39316cca42f6949f4cdf30810503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/641b39316cca42f6949f4cdf30810503"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/641b39316cca42f6949f4cdf30810503"}]}] Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1172544475 Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 641b39316cca42f6949f4cdf30810503 Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1172544475 Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersAdminNegativeTestJSON-1172544475-project-admin Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: b0cbfc97cd75467fbdb5cc81c23728c0 Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1172544475-project-admin Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: {"resize": {"flavorRef": "113005364"}} Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '219065c2-9bfe-4334-b1f6-563617556d0b', 'body': {'resize': {'flavorRef': '113005364'}}} Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:48:14.434525 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f643ac6a-5956-49cd-a084-1a1eda64434b tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b/action" status: 403 len: 118 microversion: 2.1 time: 0.311653 Aug 03 02:48:14.441404 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3171/6464] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:48:14 2022] POST /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b/action => generated 118 bytes in 313 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:48:14.446831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6770bd36-4fb5-4ae5-a8a3-f801a7b7d746 tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:14.447625 n-d-826529-8 devstack@n-api.service[125941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:48:14.447625 n-d-826529-8 devstack@n-api.service[125941]: warnings.warn(msg) Aug 03 02:48:14.470819 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6770bd36-4fb5-4ae5-a8a3-f801a7b7d746 tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/113005364" status: 202 len: 0 microversion: 2.1 time: 0.028634 Aug 03 02:48:14.471462 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3294/6465] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 02:48:14 2022] DELETE /compute/v2.1/flavors/113005364 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:48:14.480725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3333129a-6119-4e96-9ec6-ec0bc2d47615 tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:14.502563 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3333129a-6119-4e96-9ec6-ec0bc2d47615 tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026546 Aug 03 02:48:14.503171 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3172/6466] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 02:48:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:14.523712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc3959ed-2586-4a88-ad10-8d232d143673 tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Calling method '.version_select at 0x7f5b102d69d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:14.556742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:14.600984 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fc3959ed-2586-4a88-ad10-8d232d143673 tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] 10.222.0.67 "GET /compute/v2.1/os-quota-sets/641b39316cca42f6949f4cdf30810503" status: 200 len: 371 microversion: 2.1 time: 0.081409 Aug 03 02:48:14.601558 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3295/6467] 10.222.0.67 () {58 vars in 1242 bytes} [Wed Aug 3 02:48:14 2022] GET /compute/v2.1/os-quota-sets/641b39316cca42f6949f4cdf30810503 => generated 371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:48:14.614156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eb226c11-99ea-4f6c-b8fd-82cdf7a69f8e tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1903900098", "id": 248271333, "os-flavor-access:is_public": "True"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:48:14.617109 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:48:14.617109 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 02:48:14.631913 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eb226c11-99ea-4f6c-b8fd-82cdf7a69f8e tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021711 Aug 03 02:48:14.632604 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3173/6468] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:48:14 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:48:14.646116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "248271333"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:48:14.648370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:14.657458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:14.658109 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:14.659442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:14.660193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:14.828177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b0cbfc97cd75467fbdb5cc81c23728c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b39316cca42f6949f4cdf30810503', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:14.835211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1903900098 {{(pid=125941) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 02:48:14.842707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:14.843206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:14.844037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:14.844491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:14.870026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Getting quotas for project 11b5ba0fb45c46d3a45955c41b9aa4e9. Resources: {'cores', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:48:14.875408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Getting quotas for user 7ed13395bcfb4478b013e0aadb08a390 and project 11b5ba0fb45c46d3a45955c41b9aa4e9. Resources: {'cores', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:48:14.888434 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.compute.api [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] cores quota exceeded for 641b39316cca42f6949f4cdf30810503, tried to resize instance. Aug 03 02:48:14.888977 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Request method failure captured: Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b/action HTTP/1.1 Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 38 Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eHjgPpbOxzEgvYAhLa4GDnppQWhDtq27PmLklJWVCwiInNrKQol6fec2uEUWnNUdoQYwh2mc4ujjnGrjA1ROdzq0SpTARy-qATjr4Jq_aqacmD16hUNOxVOTTfTJKypY0nItTKUwvxHou-yoggYCTZ91g_VANGc39gBIZ6ni5ON9vo Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 641b39316cca42f6949f4cdf30810503 Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1172544475 Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-Role: admin,member,reader Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: admin,member,reader Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_641b39316cca42f6949f4cdf30810503", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/641b39316cca42f6949f4cdf30810503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/641b39316cca42f6949f4cdf30810503"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/641b39316cca42f6949f4cdf30810503"}]}] Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1172544475 Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 641b39316cca42f6949f4cdf30810503 Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1172544475 Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersAdminNegativeTestJSON-1172544475-project-admin Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: b0cbfc97cd75467fbdb5cc81c23728c0 Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1172544475-project-admin Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: {"resize": {"flavorRef": "248271333"}} Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '219065c2-9bfe-4334-b1f6-563617556d0b', 'body': {'resize': {'flavorRef': '248271333'}}} Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:48:14.891117 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e348922d-067e-40a1-b927-e56305720ebe tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] 10.222.0.67 "POST /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b/action" status: 403 len: 113 microversion: 2.1 time: 0.250908 Aug 03 02:48:14.897947 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3296/6469] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:48:14 2022] POST /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b/action => generated 113 bytes in 252 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:48:14.905657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-465b9685-af03-4927-b45b-756732d2dfb9 tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:14.905657 n-d-826529-8 devstack@n-api.service[125942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 02:48:14.905657 n-d-826529-8 devstack@n-api.service[125942]: warnings.warn(msg) Aug 03 02:48:14.921798 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-465b9685-af03-4927-b45b-756732d2dfb9 tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] 10.222.0.67 "DELETE /compute/v2.1/flavors/248271333" status: 202 len: 0 microversion: 2.1 time: 0.024169 Aug 03 02:48:14.922367 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3174/6470] 10.222.0.67 () {58 vars in 1158 bytes} [Wed Aug 3 02:48:14 2022] DELETE /compute/v2.1/flavors/248271333 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:48:14.930497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b710e639-8f5c-4fee-992e-dd8b508ea532 tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:14.951810 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b710e639-8f5c-4fee-992e-dd8b508ea532 tempest-ServersAdminNegativeTestJSON-1172544475 tempest-ServersAdminNegativeTestJSON-1172544475-project-admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024968 Aug 03 02:48:14.952584 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3297/6471] 10.222.0.67 () {58 vars in 1146 bytes} [Wed Aug 3 02:48:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:14.973260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d6edbc3e-2cc7-401a-91a9-6dc7d4ce1cca tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:14.973759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d6edbc3e-2cc7-401a-91a9-6dc7d4ce1cca tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:14.981593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6edbc3e-2cc7-401a-91a9-6dc7d4ce1cca tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:14.982047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6edbc3e-2cc7-401a-91a9-6dc7d4ce1cca tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:14.982824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6edbc3e-2cc7-401a-91a9-6dc7d4ce1cca tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:14.983298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6edbc3e-2cc7-401a-91a9-6dc7d4ce1cca tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:15.009954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d6edbc3e-2cc7-401a-91a9-6dc7d4ce1cca tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:48:15.095342 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d6edbc3e-2cc7-401a-91a9-6dc7d4ce1cca tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] 10.222.0.67 "DELETE /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b" status: 204 len: 0 microversion: 2.1 time: 0.125798 Aug 03 02:48:15.095944 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3175/6472] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:48:14 2022] DELETE /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:48:15.107744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-91bd63b1-1203-46a5-92d4-49f331821852 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:15.108851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-91bd63b1-1203-46a5-92d4-49f331821852 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:15.119253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91bd63b1-1203-46a5-92d4-49f331821852 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:15.120023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91bd63b1-1203-46a5-92d4-49f331821852 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:15.121309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91bd63b1-1203-46a5-92d4-49f331821852 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:15.122066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91bd63b1-1203-46a5-92d4-49f331821852 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:15.259139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-91bd63b1-1203-46a5-92d4-49f331821852 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed13395bcfb4478b013e0aadb08a390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5ba0fb45c46d3a45955c41b9aa4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:15.267145 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-91bd63b1-1203-46a5-92d4-49f331821852 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] 10.222.0.67 "GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b" status: 200 len: 1477 microversion: 2.1 time: 0.166703 Aug 03 02:48:15.267836 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3298/6473] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:15 2022] GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b => generated 1477 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:16.294312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e504f235-f26e-423b-8d71-aa3ceb6062bf tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:16.295045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e504f235-f26e-423b-8d71-aa3ceb6062bf tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:16.302018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e504f235-f26e-423b-8d71-aa3ceb6062bf tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:16.302479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e504f235-f26e-423b-8d71-aa3ceb6062bf tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:16.303296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e504f235-f26e-423b-8d71-aa3ceb6062bf tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:16.303744 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e504f235-f26e-423b-8d71-aa3ceb6062bf tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:16.458669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e504f235-f26e-423b-8d71-aa3ceb6062bf tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed13395bcfb4478b013e0aadb08a390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5ba0fb45c46d3a45955c41b9aa4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:16.466865 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e504f235-f26e-423b-8d71-aa3ceb6062bf tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] 10.222.0.67 "GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b" status: 200 len: 1477 microversion: 2.1 time: 0.177431 Aug 03 02:48:16.467467 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3176/6474] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:16 2022] GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b => generated 1477 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:17.205541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-bc5f5beb-0cbb-4158-ab97-be675e310605 req-60afc9c6-f21b-4ebb-90a6-4be8ccd29a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "219065c2-9bfe-4334-b1f6-563617556d0b", "name": "network-vif-deleted", "tag": "b4dabee2-98f0-4211-9b5b-c9bca355eeb7"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:48:17.221706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bc5f5beb-0cbb-4158-ab97-be675e310605 req-60afc9c6-f21b-4ebb-90a6-4be8ccd29a00 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:17.222045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bc5f5beb-0cbb-4158-ab97-be675e310605 req-60afc9c6-f21b-4ebb-90a6-4be8ccd29a00 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:17.236897 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-bc5f5beb-0cbb-4158-ab97-be675e310605 req-60afc9c6-f21b-4ebb-90a6-4be8ccd29a00 service nova] Creating event network-vif-deleted:b4dabee2-98f0-4211-9b5b-c9bca355eeb7 for instance 219065c2-9bfe-4334-b1f6-563617556d0b on n-h2-826529-8 Aug 03 02:48:17.242469 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-bc5f5beb-0cbb-4158-ab97-be675e310605 req-60afc9c6-f21b-4ebb-90a6-4be8ccd29a00 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042597 Aug 03 02:48:17.243207 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3299/6475] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:48:17.488328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e4795083-4765-47d3-9190-0ee0f3f424b6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:17.488999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e4795083-4765-47d3-9190-0ee0f3f424b6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:17.496965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4795083-4765-47d3-9190-0ee0f3f424b6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:17.497429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4795083-4765-47d3-9190-0ee0f3f424b6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:17.498222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4795083-4765-47d3-9190-0ee0f3f424b6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:17.498672 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4795083-4765-47d3-9190-0ee0f3f424b6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:17.530857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4795083-4765-47d3-9190-0ee0f3f424b6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:17.531346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4795083-4765-47d3-9190-0ee0f3f424b6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:17.531807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-e4795083-4765-47d3-9190-0ee0f3f424b6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lazy-loading 'fault' on Instance uuid 219065c2-9bfe-4334-b1f6-563617556d0b {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:48:17.573525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e4795083-4765-47d3-9190-0ee0f3f424b6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed13395bcfb4478b013e0aadb08a390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b5ba0fb45c46d3a45955c41b9aa4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:17.581547 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e4795083-4765-47d3-9190-0ee0f3f424b6 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] 10.222.0.67 "GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b" status: 200 len: 1311 microversion: 2.1 time: 0.097106 Aug 03 02:48:17.582280 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3177/6476] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:17 2022] GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:18.604318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d759e0d3-5e02-4138-a891-f3a78534b185 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:18.605628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d759e0d3-5e02-4138-a891-f3a78534b185 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] [instance: 219065c2-9bfe-4334-b1f6-563617556d0b] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:18.612344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d759e0d3-5e02-4138-a891-f3a78534b185 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:18.612813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d759e0d3-5e02-4138-a891-f3a78534b185 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:18.613606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d759e0d3-5e02-4138-a891-f3a78534b185 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:18.614061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d759e0d3-5e02-4138-a891-f3a78534b185 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:18.631803 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-d759e0d3-5e02-4138-a891-f3a78534b185 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] HTTP exception thrown: Instance 219065c2-9bfe-4334-b1f6-563617556d0b could not be found. Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d759e0d3-5e02-4138-a891-f3a78534b185 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Request method failure captured: Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b HTTP/1.1 Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eHjceZ0X8mcMnAchG0lj5QDUJTag6Y4qiT7UyHVXlx_9Ic0c02wa8fs-4fbp6oDJD7BlomZgwS8C98wv8NXyHnYa7fd6c7eKHGq8mVmcj_RtELpM3OKhr5Ip4KJKrT5cWt9nsCX1OfdP-vYUYBvJrIFwnBz2R6KPcfiXBzTd15wRqc Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 11b5ba0fb45c46d3a45955c41b9aa4e9 Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1815005083 Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_11b5ba0fb45c46d3a45955c41b9aa4e9", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/11b5ba0fb45c46d3a45955c41b9aa4e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/11b5ba0fb45c46d3a45955c41b9aa4e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/11b5ba0fb45c46d3a45955c41b9aa4e9"}]}] Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1815005083 Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 11b5ba0fb45c46d3a45955c41b9aa4e9 Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1815005083 Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersAdminNegativeTestJSON-1815005083-project Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 7ed13395bcfb4478b013e0aadb08a390 Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1815005083-project Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 219065c2-9bfe-4334-b1f6-563617556d0b could not be found. Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '219065c2-9bfe-4334-b1f6-563617556d0b'} Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 219065c2-9bfe-4334-b1f6-563617556d0b could not be found. Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 219065c2-9bfe-4334-b1f6-563617556d0b could not be found. Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:48:18.634147 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:48:18.642192 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:48:18.642192 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:48:18.642192 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:48:18.642192 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:48:18.642192 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:48:18.642192 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:48:18.642192 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 219065c2-9bfe-4334-b1f6-563617556d0b could not be found. Aug 03 02:48:18.642192 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:48:18.642192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d759e0d3-5e02-4138-a891-f3a78534b185 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] Returning 404 to user: Instance 219065c2-9bfe-4334-b1f6-563617556d0b could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:48:18.642192 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d759e0d3-5e02-4138-a891-f3a78534b185 tempest-ServersAdminNegativeTestJSON-1815005083 tempest-ServersAdminNegativeTestJSON-1815005083-project] 10.222.0.67 "GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b" status: 404 len: 111 microversion: 2.1 time: 0.037104 Aug 03 02:48:18.642192 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3300/6477] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:18 2022] GET /compute/v2.1/servers/219065c2-9bfe-4334-b1f6-563617556d0b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:48:25.171971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:25.172770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:25.310827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-803916500", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "b2e0bd76-72b5-421b-adc9-1fc44c41a2c2"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:48:25.374539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] validate_networks() for [('b2e0bd76-72b5-421b-adc9-1fc44c41a2c2', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:48:25.834778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:48:25.835238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:48:25.835733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:48:25.836148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:48:25.836823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:48:25.846556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:25.847046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:25.847868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:25.848317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:25.866416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Getting quotas for project a806f9b3e5154aa385f6a9ff01452acd. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:48:25.872536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Getting quotas for user 5b5057876b05445b884dd98b9fd96883 and project a806f9b3e5154aa385f6a9ff01452acd. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:48:25.886153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:48:25.888504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:48:25.940284 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e282a8d6-fe0a-4a35-b428-ed2f89d1399b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769507 Aug 03 02:48:25.941011 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3178/6478] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:48:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:48:25.954564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7b37688f-56d7-4e52-85e5-df737e06f5c9 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:25.955957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7b37688f-56d7-4e52-85e5-df737e06f5c9 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:25.960006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:25.961603 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:26.024374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7b37688f-56d7-4e52-85e5-df737e06f5c9 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:26.033237 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7b37688f-56d7-4e52-85e5-df737e06f5c9 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1214 microversion: 2.1 time: 0.083747 Aug 03 02:48:26.034395 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3301/6479] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:25 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:48:27.062328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-45142327-e534-4502-bce9-ff356ae0c150 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:27.064540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-45142327-e534-4502-bce9-ff356ae0c150 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:27.075173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45142327-e534-4502-bce9-ff356ae0c150 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:27.076141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45142327-e534-4502-bce9-ff356ae0c150 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:27.077216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45142327-e534-4502-bce9-ff356ae0c150 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:27.077906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45142327-e534-4502-bce9-ff356ae0c150 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:27.177261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-45142327-e534-4502-bce9-ff356ae0c150 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:27.187334 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-45142327-e534-4502-bce9-ff356ae0c150 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1284 microversion: 2.1 time: 0.132306 Aug 03 02:48:27.188497 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3179/6480] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:27 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:28.211426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-10d5a68f-2008-423e-a5ec-88e4fe8c08ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:28.213330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-10d5a68f-2008-423e-a5ec-88e4fe8c08ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:28.220440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10d5a68f-2008-423e-a5ec-88e4fe8c08ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:28.221194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10d5a68f-2008-423e-a5ec-88e4fe8c08ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:28.222019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10d5a68f-2008-423e-a5ec-88e4fe8c08ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:28.222472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-10d5a68f-2008-423e-a5ec-88e4fe8c08ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:28.514653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-0daff139-35e9-450a-8db5-1ceb61750633 req-9637ae75-035c-4623-bb32-0f36771782ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc26510-5bd6-43d4-a0b5-7ee5648f33f5", "tag": "24064254-42de-4757-9f26-c1be1c4cb066"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:48:28.529050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0daff139-35e9-450a-8db5-1ceb61750633 req-9637ae75-035c-4623-bb32-0f36771782ed service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:28.529836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0daff139-35e9-450a-8db5-1ceb61750633 req-9637ae75-035c-4623-bb32-0f36771782ed service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:28.548644 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-0daff139-35e9-450a-8db5-1ceb61750633 req-9637ae75-035c-4623-bb32-0f36771782ed service nova] Creating event network-changed:24064254-42de-4757-9f26-c1be1c4cb066 for instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 on n-h1-826529-8 Aug 03 02:48:28.554706 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-0daff139-35e9-450a-8db5-1ceb61750633 req-9637ae75-035c-4623-bb32-0f36771782ed service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044820 Aug 03 02:48:28.556174 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3180/6481] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:48:28.682846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-10d5a68f-2008-423e-a5ec-88e4fe8c08ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:28.692014 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-10d5a68f-2008-423e-a5ec-88e4fe8c08ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1314 microversion: 2.1 time: 0.485686 Aug 03 02:48:28.692704 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3302/6482] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:28 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:29.716947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6c44a491-f75a-4cf4-8d4f-fc126a3ec5f0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:29.717634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6c44a491-f75a-4cf4-8d4f-fc126a3ec5f0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:29.724440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c44a491-f75a-4cf4-8d4f-fc126a3ec5f0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:29.724897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c44a491-f75a-4cf4-8d4f-fc126a3ec5f0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:29.725693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c44a491-f75a-4cf4-8d4f-fc126a3ec5f0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:29.726137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c44a491-f75a-4cf4-8d4f-fc126a3ec5f0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:29.867141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6c44a491-f75a-4cf4-8d4f-fc126a3ec5f0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:29.875253 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6c44a491-f75a-4cf4-8d4f-fc126a3ec5f0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1314 microversion: 2.1 time: 0.164182 Aug 03 02:48:29.875864 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3181/6483] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:29 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:30.896689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6dcada8c-73f8-4aa8-a9e1-5bafd31f9f48 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:30.897282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6dcada8c-73f8-4aa8-a9e1-5bafd31f9f48 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:30.904989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dcada8c-73f8-4aa8-a9e1-5bafd31f9f48 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:30.905456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dcada8c-73f8-4aa8-a9e1-5bafd31f9f48 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:30.906257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dcada8c-73f8-4aa8-a9e1-5bafd31f9f48 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:30.906714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dcada8c-73f8-4aa8-a9e1-5bafd31f9f48 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:31.048751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6dcada8c-73f8-4aa8-a9e1-5bafd31f9f48 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:31.057810 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6dcada8c-73f8-4aa8-a9e1-5bafd31f9f48 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1314 microversion: 2.1 time: 0.165098 Aug 03 02:48:31.058409 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3303/6484] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:30 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:32.079497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-89e8f88e-b9e0-4820-bd3e-305580b187df tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:32.080125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-89e8f88e-b9e0-4820-bd3e-305580b187df tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:32.087966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89e8f88e-b9e0-4820-bd3e-305580b187df tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:32.088423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89e8f88e-b9e0-4820-bd3e-305580b187df tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:32.089197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89e8f88e-b9e0-4820-bd3e-305580b187df tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:32.089666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89e8f88e-b9e0-4820-bd3e-305580b187df tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:32.232447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-89e8f88e-b9e0-4820-bd3e-305580b187df tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:32.240334 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-89e8f88e-b9e0-4820-bd3e-305580b187df tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1314 microversion: 2.1 time: 0.164700 Aug 03 02:48:32.240940 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3182/6485] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:32 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:33.262372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31dd8b7a-4346-46b9-819f-a21d8bc13a90 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:33.263032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-31dd8b7a-4346-46b9-819f-a21d8bc13a90 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:33.270050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31dd8b7a-4346-46b9-819f-a21d8bc13a90 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:33.270520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31dd8b7a-4346-46b9-819f-a21d8bc13a90 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:33.271333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31dd8b7a-4346-46b9-819f-a21d8bc13a90 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:33.271791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31dd8b7a-4346-46b9-819f-a21d8bc13a90 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:33.404946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-31dd8b7a-4346-46b9-819f-a21d8bc13a90 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:33.412564 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-31dd8b7a-4346-46b9-819f-a21d8bc13a90 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1314 microversion: 2.1 time: 0.154686 Aug 03 02:48:33.413140 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3304/6486] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:33 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:34.319856 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-9d8a6950-3ba4-409e-9da1-be2bffd08a3f req-92a9c7c8-5b51-49fa-bf48-d8330e2ec410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc26510-5bd6-43d4-a0b5-7ee5648f33f5", "name": "network-vif-plugged", "status": "completed", "tag": "24064254-42de-4757-9f26-c1be1c4cb066"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:48:34.326272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:34.332044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9d8a6950-3ba4-409e-9da1-be2bffd08a3f req-92a9c7c8-5b51-49fa-bf48-d8330e2ec410 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:34.332491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-9d8a6950-3ba4-409e-9da1-be2bffd08a3f req-92a9c7c8-5b51-49fa-bf48-d8330e2ec410 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:34.338979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:34.348000 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-9d8a6950-3ba4-409e-9da1-be2bffd08a3f req-92a9c7c8-5b51-49fa-bf48-d8330e2ec410 service nova] Creating event network-vif-plugged:24064254-42de-4757-9f26-c1be1c4cb066 for instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 on n-h1-826529-8 Aug 03 02:48:34.353071 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-9d8a6950-3ba4-409e-9da1-be2bffd08a3f req-92a9c7c8-5b51-49fa-bf48-d8330e2ec410 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036965 Aug 03 02:48:34.353917 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3183/6487] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:48:34.434278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b34986cf-b602-47b0-ae71-c1e83fe206ec tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:34.434977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b34986cf-b602-47b0-ae71-c1e83fe206ec tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:34.442080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b34986cf-b602-47b0-ae71-c1e83fe206ec tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:34.442544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b34986cf-b602-47b0-ae71-c1e83fe206ec tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:34.443413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b34986cf-b602-47b0-ae71-c1e83fe206ec tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:34.443862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b34986cf-b602-47b0-ae71-c1e83fe206ec tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:34.577130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b34986cf-b602-47b0-ae71-c1e83fe206ec tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:34.579334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=72 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:34.585659 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b34986cf-b602-47b0-ae71-c1e83fe206ec tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1314 microversion: 2.1 time: 0.155843 Aug 03 02:48:34.586438 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3305/6488] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:34 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:35.608407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7fb78480-d950-470a-b8b2-a82bba75fdcd tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:35.609224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7fb78480-d950-470a-b8b2-a82bba75fdcd tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:35.618503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fb78480-d950-470a-b8b2-a82bba75fdcd tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:35.618974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fb78480-d950-470a-b8b2-a82bba75fdcd tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:35.619761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fb78480-d950-470a-b8b2-a82bba75fdcd tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:35.620197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7fb78480-d950-470a-b8b2-a82bba75fdcd tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:35.755637 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7fb78480-d950-470a-b8b2-a82bba75fdcd tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:35.764525 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7fb78480-d950-470a-b8b2-a82bba75fdcd tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1314 microversion: 2.1 time: 0.161216 Aug 03 02:48:35.765103 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3184/6489] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:35 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:36.786070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ff6684a0-2d95-41ea-8369-c2f820792f40 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:36.786726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ff6684a0-2d95-41ea-8369-c2f820792f40 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:36.789444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:36.790124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:36.796075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff6684a0-2d95-41ea-8369-c2f820792f40 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:36.796552 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff6684a0-2d95-41ea-8369-c2f820792f40 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:36.797364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff6684a0-2d95-41ea-8369-c2f820792f40 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:36.797819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ff6684a0-2d95-41ea-8369-c2f820792f40 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:36.937982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ff6684a0-2d95-41ea-8369-c2f820792f40 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:36.946345 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ff6684a0-2d95-41ea-8369-c2f820792f40 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1501 microversion: 2.1 time: 0.164524 Aug 03 02:48:36.946923 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3306/6490] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:36 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:36.968716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-17e7bf83-041b-4254-8de3-9edbec357fae tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:48:36.970991 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-17e7bf83-041b-4254-8de3-9edbec357fae tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:36.972983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:36.973660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:48:36.980766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17e7bf83-041b-4254-8de3-9edbec357fae tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:36.981225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17e7bf83-041b-4254-8de3-9edbec357fae tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:36.982007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17e7bf83-041b-4254-8de3-9edbec357fae tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:36.982453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17e7bf83-041b-4254-8de3-9edbec357fae tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:37.011420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-17e7bf83-041b-4254-8de3-9edbec357fae tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:37.017134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-17e7bf83-041b-4254-8de3-9edbec357fae tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Old instance type m1.heat2, new instance type m1.heat {{(pid=125942) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 02:48:37.024121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-17e7bf83-041b-4254-8de3-9edbec357fae tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:48:37.024795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-17e7bf83-041b-4254-8de3-9edbec357fae tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:48:37.025289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-17e7bf83-041b-4254-8de3-9edbec357fae tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:48:37.025717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-17e7bf83-041b-4254-8de3-9edbec357fae tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:48:37.026141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-17e7bf83-041b-4254-8de3-9edbec357fae tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:48:37.092209 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-17e7bf83-041b-4254-8de3-9edbec357fae tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "POST /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5/action" status: 202 len: 0 microversion: 2.1 time: 0.127485 Aug 03 02:48:37.092825 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3185/6491] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:48:36 2022] POST /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:48:37.100887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5bde0a11-e9c2-4a31-b879-adc266827d75 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:37.102323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5bde0a11-e9c2-4a31-b879-adc266827d75 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:37.108543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bde0a11-e9c2-4a31-b879-adc266827d75 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:37.109023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bde0a11-e9c2-4a31-b879-adc266827d75 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:37.109829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bde0a11-e9c2-4a31-b879-adc266827d75 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:37.110288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bde0a11-e9c2-4a31-b879-adc266827d75 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:37.250420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5bde0a11-e9c2-4a31-b879-adc266827d75 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:37.258954 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5bde0a11-e9c2-4a31-b879-adc266827d75 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1510 microversion: 2.1 time: 0.161742 Aug 03 02:48:37.259548 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3307/6492] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:37 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:38.282409 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-710d3fee-73dc-4c15-93b0-2aab41911b8e tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:38.283085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-710d3fee-73dc-4c15-93b0-2aab41911b8e tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:38.289874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-710d3fee-73dc-4c15-93b0-2aab41911b8e tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:38.290339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-710d3fee-73dc-4c15-93b0-2aab41911b8e tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:38.291244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-710d3fee-73dc-4c15-93b0-2aab41911b8e tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:38.291701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-710d3fee-73dc-4c15-93b0-2aab41911b8e tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:38.429314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-710d3fee-73dc-4c15-93b0-2aab41911b8e tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:38.437780 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-710d3fee-73dc-4c15-93b0-2aab41911b8e tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1510 microversion: 2.1 time: 0.160125 Aug 03 02:48:38.438593 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3186/6493] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:38 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:39.459048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4dc6b5e1-7b2e-4ef5-9c8c-31e31bc0e2e4 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:39.459681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4dc6b5e1-7b2e-4ef5-9c8c-31e31bc0e2e4 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:39.466740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4dc6b5e1-7b2e-4ef5-9c8c-31e31bc0e2e4 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:39.467247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4dc6b5e1-7b2e-4ef5-9c8c-31e31bc0e2e4 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:39.468042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4dc6b5e1-7b2e-4ef5-9c8c-31e31bc0e2e4 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:39.468538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4dc6b5e1-7b2e-4ef5-9c8c-31e31bc0e2e4 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:39.599731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4dc6b5e1-7b2e-4ef5-9c8c-31e31bc0e2e4 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:39.607445 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4dc6b5e1-7b2e-4ef5-9c8c-31e31bc0e2e4 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.152369 Aug 03 02:48:39.608025 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3308/6494] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:39 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:40.630640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a3c33fa7-3747-4f71-a0d8-d92cb1dcec77 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:40.631216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a3c33fa7-3747-4f71-a0d8-d92cb1dcec77 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:40.638668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3c33fa7-3747-4f71-a0d8-d92cb1dcec77 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:40.639154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3c33fa7-3747-4f71-a0d8-d92cb1dcec77 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:40.639933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3c33fa7-3747-4f71-a0d8-d92cb1dcec77 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:40.640376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3c33fa7-3747-4f71-a0d8-d92cb1dcec77 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:40.777259 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a3c33fa7-3747-4f71-a0d8-d92cb1dcec77 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:40.784826 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a3c33fa7-3747-4f71-a0d8-d92cb1dcec77 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.159314 Aug 03 02:48:40.785398 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3187/6495] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:40 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:41.805747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-056c4b43-e36e-44fd-8bb6-5d6ad8a11a29 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:41.806429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-056c4b43-e36e-44fd-8bb6-5d6ad8a11a29 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:41.813455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-056c4b43-e36e-44fd-8bb6-5d6ad8a11a29 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:41.813922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-056c4b43-e36e-44fd-8bb6-5d6ad8a11a29 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:41.814706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-056c4b43-e36e-44fd-8bb6-5d6ad8a11a29 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:41.815190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-056c4b43-e36e-44fd-8bb6-5d6ad8a11a29 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:41.946789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-056c4b43-e36e-44fd-8bb6-5d6ad8a11a29 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:41.954400 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-056c4b43-e36e-44fd-8bb6-5d6ad8a11a29 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.152668 Aug 03 02:48:41.954999 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3309/6496] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:41 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:42.976045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-000c7d7f-6824-4c49-8722-51901c1d9898 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:42.976704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-000c7d7f-6824-4c49-8722-51901c1d9898 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:42.983728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-000c7d7f-6824-4c49-8722-51901c1d9898 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:42.984185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-000c7d7f-6824-4c49-8722-51901c1d9898 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:42.984962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-000c7d7f-6824-4c49-8722-51901c1d9898 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:42.985415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-000c7d7f-6824-4c49-8722-51901c1d9898 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:43.120527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-000c7d7f-6824-4c49-8722-51901c1d9898 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:43.128094 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-000c7d7f-6824-4c49-8722-51901c1d9898 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.156001 Aug 03 02:48:43.128682 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3188/6497] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:42 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:44.150511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7a1c2385-5466-4f5a-a921-15e59380b429 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:44.151848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7a1c2385-5466-4f5a-a921-15e59380b429 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:44.158777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a1c2385-5466-4f5a-a921-15e59380b429 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:44.159297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a1c2385-5466-4f5a-a921-15e59380b429 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:44.160107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a1c2385-5466-4f5a-a921-15e59380b429 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:44.160570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7a1c2385-5466-4f5a-a921-15e59380b429 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:44.296151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7a1c2385-5466-4f5a-a921-15e59380b429 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:44.303695 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7a1c2385-5466-4f5a-a921-15e59380b429 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.157916 Aug 03 02:48:44.304329 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3310/6498] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:44 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:45.325107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-89a73dc0-d528-412f-8c1d-322bf0a6063b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:45.325718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-89a73dc0-d528-412f-8c1d-322bf0a6063b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:45.332766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89a73dc0-d528-412f-8c1d-322bf0a6063b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:45.333213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89a73dc0-d528-412f-8c1d-322bf0a6063b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:45.333977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89a73dc0-d528-412f-8c1d-322bf0a6063b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:45.334413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89a73dc0-d528-412f-8c1d-322bf0a6063b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:45.475162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-89a73dc0-d528-412f-8c1d-322bf0a6063b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:45.483543 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-89a73dc0-d528-412f-8c1d-322bf0a6063b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.162278 Aug 03 02:48:45.484129 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3189/6499] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:45 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:46.505829 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fdf4aead-91d8-479e-8994-03ef70b6ac58 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:46.506455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fdf4aead-91d8-479e-8994-03ef70b6ac58 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:46.513878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fdf4aead-91d8-479e-8994-03ef70b6ac58 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:46.514347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fdf4aead-91d8-479e-8994-03ef70b6ac58 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:46.515161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fdf4aead-91d8-479e-8994-03ef70b6ac58 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:46.515618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fdf4aead-91d8-479e-8994-03ef70b6ac58 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:46.651493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fdf4aead-91d8-479e-8994-03ef70b6ac58 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:46.659275 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fdf4aead-91d8-479e-8994-03ef70b6ac58 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.157636 Aug 03 02:48:46.659863 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3311/6500] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:46 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:47.681495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a9de1538-a867-4ceb-a7df-0101dcc2bd32 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:47.682201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a9de1538-a867-4ceb-a7df-0101dcc2bd32 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:47.689638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9de1538-a867-4ceb-a7df-0101dcc2bd32 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:47.690100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9de1538-a867-4ceb-a7df-0101dcc2bd32 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:47.690945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9de1538-a867-4ceb-a7df-0101dcc2bd32 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:47.691400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9de1538-a867-4ceb-a7df-0101dcc2bd32 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:47.826680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a9de1538-a867-4ceb-a7df-0101dcc2bd32 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:47.834422 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a9de1538-a867-4ceb-a7df-0101dcc2bd32 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.157376 Aug 03 02:48:47.835020 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3190/6501] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:47 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:48.855233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-20e0ec1b-b635-4685-8a41-d4d58feec89d tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:48.855864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-20e0ec1b-b635-4685-8a41-d4d58feec89d tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:48.862877 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20e0ec1b-b635-4685-8a41-d4d58feec89d tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:48.863376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20e0ec1b-b635-4685-8a41-d4d58feec89d tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:48.864161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20e0ec1b-b635-4685-8a41-d4d58feec89d tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:48.864617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-20e0ec1b-b635-4685-8a41-d4d58feec89d tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:48.996834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-20e0ec1b-b635-4685-8a41-d4d58feec89d tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:49.004493 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-20e0ec1b-b635-4685-8a41-d4d58feec89d tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.153542 Aug 03 02:48:49.005578 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3312/6502] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:48 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:50.028015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a43b38f7-14e1-4ecb-bafa-f95443eec1b2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:50.028585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a43b38f7-14e1-4ecb-bafa-f95443eec1b2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:50.034618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a43b38f7-14e1-4ecb-bafa-f95443eec1b2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:50.035132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a43b38f7-14e1-4ecb-bafa-f95443eec1b2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:50.035907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a43b38f7-14e1-4ecb-bafa-f95443eec1b2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:50.036350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a43b38f7-14e1-4ecb-bafa-f95443eec1b2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:50.175210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a43b38f7-14e1-4ecb-bafa-f95443eec1b2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:50.182803 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a43b38f7-14e1-4ecb-bafa-f95443eec1b2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.159942 Aug 03 02:48:50.183407 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3191/6503] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:50 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:51.204690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-123923d3-9248-4c1f-bbc6-120a2b402497 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:51.205223 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-123923d3-9248-4c1f-bbc6-120a2b402497 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:51.212489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-123923d3-9248-4c1f-bbc6-120a2b402497 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:51.212957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-123923d3-9248-4c1f-bbc6-120a2b402497 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:51.213749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-123923d3-9248-4c1f-bbc6-120a2b402497 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:51.214206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-123923d3-9248-4c1f-bbc6-120a2b402497 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:51.355261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-123923d3-9248-4c1f-bbc6-120a2b402497 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:51.362978 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-123923d3-9248-4c1f-bbc6-120a2b402497 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.162326 Aug 03 02:48:51.363573 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3313/6504] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:51 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:52.384819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2591d201-e648-4819-aee6-e2d80341c35a tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:52.385644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2591d201-e648-4819-aee6-e2d80341c35a tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:52.392621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2591d201-e648-4819-aee6-e2d80341c35a tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:52.393071 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2591d201-e648-4819-aee6-e2d80341c35a tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:52.393848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2591d201-e648-4819-aee6-e2d80341c35a tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:52.394290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2591d201-e648-4819-aee6-e2d80341c35a tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:52.527456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2591d201-e648-4819-aee6-e2d80341c35a tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:52.534923 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2591d201-e648-4819-aee6-e2d80341c35a tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.154603 Aug 03 02:48:52.535504 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3192/6505] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:52 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:53.557515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d0cd2ff6-2c1a-48eb-be07-ef35708989a0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:53.558165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d0cd2ff6-2c1a-48eb-be07-ef35708989a0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:53.564528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0cd2ff6-2c1a-48eb-be07-ef35708989a0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:53.564997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0cd2ff6-2c1a-48eb-be07-ef35708989a0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:53.565781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0cd2ff6-2c1a-48eb-be07-ef35708989a0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:53.566236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d0cd2ff6-2c1a-48eb-be07-ef35708989a0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:53.695951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d0cd2ff6-2c1a-48eb-be07-ef35708989a0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:53.703784 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d0cd2ff6-2c1a-48eb-be07-ef35708989a0 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.151199 Aug 03 02:48:53.704374 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3314/6506] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:53 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:54.725071 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c393cabf-6794-49a8-8d5c-523e05a17c22 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:54.725957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c393cabf-6794-49a8-8d5c-523e05a17c22 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:54.733300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c393cabf-6794-49a8-8d5c-523e05a17c22 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:54.734178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c393cabf-6794-49a8-8d5c-523e05a17c22 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:54.734613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c393cabf-6794-49a8-8d5c-523e05a17c22 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:54.735034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c393cabf-6794-49a8-8d5c-523e05a17c22 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:54.868401 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c393cabf-6794-49a8-8d5c-523e05a17c22 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:54.875998 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c393cabf-6794-49a8-8d5c-523e05a17c22 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.154933 Aug 03 02:48:54.876583 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3193/6507] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:54 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:55.898574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9ad5dcdb-bddf-4c21-bc1f-9a0dc7d13179 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:55.899261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9ad5dcdb-bddf-4c21-bc1f-9a0dc7d13179 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:55.906235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ad5dcdb-bddf-4c21-bc1f-9a0dc7d13179 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:55.906706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ad5dcdb-bddf-4c21-bc1f-9a0dc7d13179 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:55.907533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ad5dcdb-bddf-4c21-bc1f-9a0dc7d13179 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:55.907992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ad5dcdb-bddf-4c21-bc1f-9a0dc7d13179 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:56.038792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9ad5dcdb-bddf-4c21-bc1f-9a0dc7d13179 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:56.046421 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9ad5dcdb-bddf-4c21-bc1f-9a0dc7d13179 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.152290 Aug 03 02:48:56.047027 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3315/6508] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:55 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:57.067683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-645bf260-b761-4c15-89cd-a725ff0be76b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:57.068303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-645bf260-b761-4c15-89cd-a725ff0be76b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:57.076247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-645bf260-b761-4c15-89cd-a725ff0be76b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:57.076706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-645bf260-b761-4c15-89cd-a725ff0be76b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:57.078289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-645bf260-b761-4c15-89cd-a725ff0be76b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:57.078606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-645bf260-b761-4c15-89cd-a725ff0be76b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:57.215229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-645bf260-b761-4c15-89cd-a725ff0be76b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:57.222811 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-645bf260-b761-4c15-89cd-a725ff0be76b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.159036 Aug 03 02:48:57.223421 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3194/6509] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:57 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:58.246225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0eef62fa-f688-450f-b33c-8937f7a099e7 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:58.247179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0eef62fa-f688-450f-b33c-8937f7a099e7 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:58.254272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0eef62fa-f688-450f-b33c-8937f7a099e7 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:58.254742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0eef62fa-f688-450f-b33c-8937f7a099e7 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:58.255560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0eef62fa-f688-450f-b33c-8937f7a099e7 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:58.256014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0eef62fa-f688-450f-b33c-8937f7a099e7 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:58.389820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0eef62fa-f688-450f-b33c-8937f7a099e7 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:58.397372 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0eef62fa-f688-450f-b33c-8937f7a099e7 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.155790 Aug 03 02:48:58.398527 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3316/6510] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:58 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:48:59.419047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1783c59d-92ce-44bb-8325-ee9ed30b6850 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:48:59.419698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1783c59d-92ce-44bb-8325-ee9ed30b6850 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:48:59.426737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1783c59d-92ce-44bb-8325-ee9ed30b6850 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:59.427222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1783c59d-92ce-44bb-8325-ee9ed30b6850 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:59.427999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1783c59d-92ce-44bb-8325-ee9ed30b6850 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:48:59.428444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1783c59d-92ce-44bb-8325-ee9ed30b6850 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:48:59.561392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1783c59d-92ce-44bb-8325-ee9ed30b6850 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:48:59.569113 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1783c59d-92ce-44bb-8325-ee9ed30b6850 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.153958 Aug 03 02:48:59.570349 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3195/6511] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:48:59 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:00.590464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-07ada677-31ee-42a0-a031-0e1e4e7b2088 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:00.591129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-07ada677-31ee-42a0-a031-0e1e4e7b2088 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:00.598168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-07ada677-31ee-42a0-a031-0e1e4e7b2088 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:00.598629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-07ada677-31ee-42a0-a031-0e1e4e7b2088 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:00.599443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-07ada677-31ee-42a0-a031-0e1e4e7b2088 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:00.599891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-07ada677-31ee-42a0-a031-0e1e4e7b2088 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:00.738328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-07ada677-31ee-42a0-a031-0e1e4e7b2088 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:00.746788 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-07ada677-31ee-42a0-a031-0e1e4e7b2088 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.160229 Aug 03 02:49:00.747416 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3317/6512] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:00 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:01.769422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5258cdbd-3728-4672-b895-cfba86a5aefc tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:01.770054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5258cdbd-3728-4672-b895-cfba86a5aefc tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:01.777854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5258cdbd-3728-4672-b895-cfba86a5aefc tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:01.778313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5258cdbd-3728-4672-b895-cfba86a5aefc tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:01.779139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5258cdbd-3728-4672-b895-cfba86a5aefc tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:01.779587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5258cdbd-3728-4672-b895-cfba86a5aefc tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:01.909994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5258cdbd-3728-4672-b895-cfba86a5aefc tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:01.917982 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5258cdbd-3728-4672-b895-cfba86a5aefc tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.152785 Aug 03 02:49:01.918555 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3196/6513] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:01 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:02.939867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-24747323-2f43-4643-8d5e-499743f3e2f6 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:02.940423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-24747323-2f43-4643-8d5e-499743f3e2f6 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:02.948218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24747323-2f43-4643-8d5e-499743f3e2f6 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:02.948693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24747323-2f43-4643-8d5e-499743f3e2f6 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:02.949480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24747323-2f43-4643-8d5e-499743f3e2f6 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:02.949937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24747323-2f43-4643-8d5e-499743f3e2f6 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:03.082956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-24747323-2f43-4643-8d5e-499743f3e2f6 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:03.091202 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-24747323-2f43-4643-8d5e-499743f3e2f6 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.155310 Aug 03 02:49:03.091784 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3318/6514] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:02 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:04.112092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5db9d28c-a07e-454d-8762-78b60f8bbfac tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:04.112696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5db9d28c-a07e-454d-8762-78b60f8bbfac tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:04.120537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5db9d28c-a07e-454d-8762-78b60f8bbfac tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:04.120993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5db9d28c-a07e-454d-8762-78b60f8bbfac tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:04.121765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5db9d28c-a07e-454d-8762-78b60f8bbfac tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:04.122203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5db9d28c-a07e-454d-8762-78b60f8bbfac tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:04.259530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5db9d28c-a07e-454d-8762-78b60f8bbfac tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:04.267930 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5db9d28c-a07e-454d-8762-78b60f8bbfac tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.159665 Aug 03 02:49:04.268504 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3197/6515] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:04 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:05.289963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f15fd3c5-0752-45d6-a82c-1af49edc9b93 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:05.290587 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f15fd3c5-0752-45d6-a82c-1af49edc9b93 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:05.297589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f15fd3c5-0752-45d6-a82c-1af49edc9b93 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:05.298046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f15fd3c5-0752-45d6-a82c-1af49edc9b93 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:05.298826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f15fd3c5-0752-45d6-a82c-1af49edc9b93 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:05.299308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f15fd3c5-0752-45d6-a82c-1af49edc9b93 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:05.428393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f15fd3c5-0752-45d6-a82c-1af49edc9b93 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:05.436123 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f15fd3c5-0752-45d6-a82c-1af49edc9b93 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1515 microversion: 2.1 time: 0.150228 Aug 03 02:49:05.436705 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3319/6516] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:05 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:06.458091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fbd462c4-0761-4ef5-bf10-67c7e5905169 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:06.458701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fbd462c4-0761-4ef5-bf10-67c7e5905169 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:06.462023 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=34 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:49:06.467804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbd462c4-0761-4ef5-bf10-67c7e5905169 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:06.468264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbd462c4-0761-4ef5-bf10-67c7e5905169 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:06.469060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbd462c4-0761-4ef5-bf10-67c7e5905169 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:06.469511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbd462c4-0761-4ef5-bf10-67c7e5905169 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:06.473745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:49:06.956091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fbd462c4-0761-4ef5-bf10-67c7e5905169 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:06.964265 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fbd462c4-0761-4ef5-bf10-67c7e5905169 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1514 microversion: 2.1 time: 0.510270 Aug 03 02:49:06.964993 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3198/6517] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:06 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1514 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:06.969060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-bfa0cfea-3b1c-48a6-bf69-6e4ce73ea388 req-e7eade35-f8db-43d1-87cb-e65cd01e13ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc26510-5bd6-43d4-a0b5-7ee5648f33f5", "name": "network-vif-unplugged", "status": "completed", "tag": "24064254-42de-4757-9f26-c1be1c4cb066"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:49:06.975937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=28 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:49:06.980707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bfa0cfea-3b1c-48a6-bf69-6e4ce73ea388 req-e7eade35-f8db-43d1-87cb-e65cd01e13ab service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:06.981302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-bfa0cfea-3b1c-48a6-bf69-6e4ce73ea388 req-e7eade35-f8db-43d1-87cb-e65cd01e13ab service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:06.988984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=86 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:49:06.998569 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-bfa0cfea-3b1c-48a6-bf69-6e4ce73ea388 req-e7eade35-f8db-43d1-87cb-e65cd01e13ab service nova] Creating event network-vif-unplugged:24064254-42de-4757-9f26-c1be1c4cb066 for instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 on n-h2-826529-8 Aug 03 02:49:07.004360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-bfa0cfea-3b1c-48a6-bf69-6e4ce73ea388 req-e7eade35-f8db-43d1-87cb-e65cd01e13ab service nova] Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:49:07.017003 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-bfa0cfea-3b1c-48a6-bf69-6e4ce73ea388 req-e7eade35-f8db-43d1-87cb-e65cd01e13ab service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052519 Aug 03 02:49:07.017798 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3320/6518] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:49:07.987722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-23228832-cbaa-4136-bf58-85903a39c452 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:07.988287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-23228832-cbaa-4136-bf58-85903a39c452 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:07.995828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23228832-cbaa-4136-bf58-85903a39c452 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:07.996292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23228832-cbaa-4136-bf58-85903a39c452 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:07.997066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23228832-cbaa-4136-bf58-85903a39c452 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:07.997512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23228832-cbaa-4136-bf58-85903a39c452 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:08.128254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-23228832-cbaa-4136-bf58-85903a39c452 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:08.137063 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-23228832-cbaa-4136-bf58-85903a39c452 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1512 microversion: 2.1 time: 0.153310 Aug 03 02:49:08.137646 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3199/6519] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:07 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:09.044828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-8c4efafa-901e-435c-a833-ac6396b73637 req-95d39a6c-6e92-4e88-80eb-01be9ee6120d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc26510-5bd6-43d4-a0b5-7ee5648f33f5", "tag": "24064254-42de-4757-9f26-c1be1c4cb066"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:49:09.054553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8c4efafa-901e-435c-a833-ac6396b73637 req-95d39a6c-6e92-4e88-80eb-01be9ee6120d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:09.055043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8c4efafa-901e-435c-a833-ac6396b73637 req-95d39a6c-6e92-4e88-80eb-01be9ee6120d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:09.066381 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-8c4efafa-901e-435c-a833-ac6396b73637 req-95d39a6c-6e92-4e88-80eb-01be9ee6120d service nova] Creating event network-changed:24064254-42de-4757-9f26-c1be1c4cb066 for instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 on n-h2-826529-8 Aug 03 02:49:09.072417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-8c4efafa-901e-435c-a833-ac6396b73637 req-95d39a6c-6e92-4e88-80eb-01be9ee6120d service nova] Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:49:09.082847 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-8c4efafa-901e-435c-a833-ac6396b73637 req-95d39a6c-6e92-4e88-80eb-01be9ee6120d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042985 Aug 03 02:49:09.083470 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3321/6520] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:49:09.158195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3185285a-d662-40dc-b8d1-ff02bd1014fa tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:09.158807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3185285a-d662-40dc-b8d1-ff02bd1014fa tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:09.166998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3185285a-d662-40dc-b8d1-ff02bd1014fa tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:09.167460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3185285a-d662-40dc-b8d1-ff02bd1014fa tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:09.168289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3185285a-d662-40dc-b8d1-ff02bd1014fa tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:09.168732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3185285a-d662-40dc-b8d1-ff02bd1014fa tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:09.320210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3185285a-d662-40dc-b8d1-ff02bd1014fa tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:09.328725 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3185285a-d662-40dc-b8d1-ff02bd1014fa tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1512 microversion: 2.1 time: 0.174570 Aug 03 02:49:09.329501 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3200/6521] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:09 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:49:10.351256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-caca5b6e-065c-46c1-a2e5-680b0fc9e1e3 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:10.351979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-caca5b6e-065c-46c1-a2e5-680b0fc9e1e3 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:10.358245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-caca5b6e-065c-46c1-a2e5-680b0fc9e1e3 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:10.358712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-caca5b6e-065c-46c1-a2e5-680b0fc9e1e3 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:10.359630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-caca5b6e-065c-46c1-a2e5-680b0fc9e1e3 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:10.360085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-caca5b6e-065c-46c1-a2e5-680b0fc9e1e3 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:10.494125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-caca5b6e-065c-46c1-a2e5-680b0fc9e1e3 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:10.501946 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-caca5b6e-065c-46c1-a2e5-680b0fc9e1e3 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1509 microversion: 2.1 time: 0.156001 Aug 03 02:49:10.502540 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3322/6522] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:10 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:10.522517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ca8f3068-3223-476e-9acb-468aff70c754 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:10.523110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ca8f3068-3223-476e-9acb-468aff70c754 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:10.530078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca8f3068-3223-476e-9acb-468aff70c754 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:10.530547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca8f3068-3223-476e-9acb-468aff70c754 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:10.531395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca8f3068-3223-476e-9acb-468aff70c754 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:10.531839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca8f3068-3223-476e-9acb-468aff70c754 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:10.821575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ca8f3068-3223-476e-9acb-468aff70c754 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:49:10.872909 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.compute.api [None req-ca8f3068-3223-476e-9acb-468aff70c754 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Found an unconfirmed migration during delete, id: 16, status: finished Aug 03 02:49:12.257788 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ca8f3068-3223-476e-9acb-468aff70c754 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 204 len: 0 microversion: 2.1 time: 1.738806 Aug 03 02:49:12.258972 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3201/6523] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:49:10 2022] DELETE /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 0 bytes in 1740 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:49:12.267855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5441a912-365a-47ae-8ccd-cf86c7c7f4ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:12.268516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5441a912-365a-47ae-8ccd-cf86c7c7f4ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:12.275685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5441a912-365a-47ae-8ccd-cf86c7c7f4ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:12.276155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5441a912-365a-47ae-8ccd-cf86c7c7f4ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:12.277056 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5441a912-365a-47ae-8ccd-cf86c7c7f4ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:12.277517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5441a912-365a-47ae-8ccd-cf86c7c7f4ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:12.408379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5441a912-365a-47ae-8ccd-cf86c7c7f4ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:12.416929 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5441a912-365a-47ae-8ccd-cf86c7c7f4ff tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1501 microversion: 2.1 time: 0.153860 Aug 03 02:49:12.417515 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3323/6524] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:12 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:12.567474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-5fc98480-dbfa-40d3-b25a-5acb3176fa5f req-fc01f01a-fda5-491f-8f05-cbe1def1552f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc26510-5bd6-43d4-a0b5-7ee5648f33f5", "name": "network-vif-plugged", "status": "completed", "tag": "24064254-42de-4757-9f26-c1be1c4cb066"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:49:12.579619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5fc98480-dbfa-40d3-b25a-5acb3176fa5f req-fc01f01a-fda5-491f-8f05-cbe1def1552f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:12.580151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5fc98480-dbfa-40d3-b25a-5acb3176fa5f req-fc01f01a-fda5-491f-8f05-cbe1def1552f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:12.591752 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-5fc98480-dbfa-40d3-b25a-5acb3176fa5f req-fc01f01a-fda5-491f-8f05-cbe1def1552f service nova] Creating event network-vif-plugged:24064254-42de-4757-9f26-c1be1c4cb066 for instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 on n-h2-826529-8 Aug 03 02:49:12.597090 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-5fc98480-dbfa-40d3-b25a-5acb3176fa5f req-fc01f01a-fda5-491f-8f05-cbe1def1552f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033806 Aug 03 02:49:12.597703 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3202/6525] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:49:13.437730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ea344189-95e7-4ea4-bae3-58798b565f8b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:13.438358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ea344189-95e7-4ea4-bae3-58798b565f8b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:13.445731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea344189-95e7-4ea4-bae3-58798b565f8b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:13.446202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea344189-95e7-4ea4-bae3-58798b565f8b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:13.447012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea344189-95e7-4ea4-bae3-58798b565f8b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:13.447460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ea344189-95e7-4ea4-bae3-58798b565f8b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:13.579839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ea344189-95e7-4ea4-bae3-58798b565f8b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5057876b05445b884dd98b9fd96883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a806f9b3e5154aa385f6a9ff01452acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:13.588032 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ea344189-95e7-4ea4-bae3-58798b565f8b tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 200 len: 1501 microversion: 2.1 time: 0.154217 Aug 03 02:49:13.588620 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3324/6526] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:13 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:14.314833 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-476350e0-1493-4692-82bb-ab03eaa74de8 req-95416e21-2f2e-488b-8867-ba14105380d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc26510-5bd6-43d4-a0b5-7ee5648f33f5", "name": "network-vif-deleted", "tag": "24064254-42de-4757-9f26-c1be1c4cb066"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:49:14.329425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-476350e0-1493-4692-82bb-ab03eaa74de8 req-95416e21-2f2e-488b-8867-ba14105380d2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:14.330142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-476350e0-1493-4692-82bb-ab03eaa74de8 req-95416e21-2f2e-488b-8867-ba14105380d2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:14.343609 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-476350e0-1493-4692-82bb-ab03eaa74de8 req-95416e21-2f2e-488b-8867-ba14105380d2 service nova] Creating event network-vif-deleted:24064254-42de-4757-9f26-c1be1c4cb066 for instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 on n-h2-826529-8 Aug 03 02:49:14.349184 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-476350e0-1493-4692-82bb-ab03eaa74de8 req-95416e21-2f2e-488b-8867-ba14105380d2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039325 Aug 03 02:49:14.349795 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3203/6527] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:49:14.609245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7b72bf91-945a-4ab0-8fb9-89bccd0ac5d2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:14.609810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7b72bf91-945a-4ab0-8fb9-89bccd0ac5d2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:14.617306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b72bf91-945a-4ab0-8fb9-89bccd0ac5d2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:14.617774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b72bf91-945a-4ab0-8fb9-89bccd0ac5d2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:14.618565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b72bf91-945a-4ab0-8fb9-89bccd0ac5d2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:14.619049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b72bf91-945a-4ab0-8fb9-89bccd0ac5d2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:14.632687 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-7b72bf91-945a-4ab0-8fb9-89bccd0ac5d2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] HTTP exception thrown: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7b72bf91-945a-4ab0-8fb9-89bccd0ac5d2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Request method failure captured: Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 HTTP/1.1 Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eH5JLoYgsKqzDivalqg3RkweaqvEdlKjUEwS1CBQhlJGIYWY5bd6qn4Mvo_0PK2gve1ndj06wHJ1NIrNzpiSeMEaXzldGKb_7WLhEHO7wkRiRpLIyPNQe-FEqqoAn1uTHylqeI2dEN8lEf6ZPJiUFVHrUFe0JSe8utku8FknjaQOeQ Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a806f9b3e5154aa385f6a9ff01452acd Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersTestJSON-1521164755 Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a806f9b3e5154aa385f6a9ff01452acd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a806f9b3e5154aa385f6a9ff01452acd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a806f9b3e5154aa385f6a9ff01452acd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a806f9b3e5154aa385f6a9ff01452acd"}]}] Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersTestJSON-1521164755 Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a806f9b3e5154aa385f6a9ff01452acd Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersTestJSON-1521164755 Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersTestJSON-1521164755-project Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5b5057876b05445b884dd98b9fd96883 Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersTestJSON-1521164755-project Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'bdc26510-5bd6-43d4-a0b5-7ee5648f33f5'} Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:49:14.634377 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:49:14.640269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:49:14.640269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:49:14.640269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:49:14.640269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:49:14.640269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:49:14.640269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. Aug 03 02:49:14.640269 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:49:14.640269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7b72bf91-945a-4ab0-8fb9-89bccd0ac5d2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Returning 404 to user: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:49:14.640269 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7b72bf91-945a-4ab0-8fb9-89bccd0ac5d2 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 404 len: 111 microversion: 2.1 time: 0.031006 Aug 03 02:49:14.640269 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3325/6528] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:14 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:49:14.653103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-57b81cdf-3164-47f3-8313-999c73c8d7ea tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:14.653731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-57b81cdf-3164-47f3-8313-999c73c8d7ea tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:14.660471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57b81cdf-3164-47f3-8313-999c73c8d7ea tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:14.660915 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57b81cdf-3164-47f3-8313-999c73c8d7ea tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:14.661695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57b81cdf-3164-47f3-8313-999c73c8d7ea tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:14.662117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-57b81cdf-3164-47f3-8313-999c73c8d7ea tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:14.676020 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-57b81cdf-3164-47f3-8313-999c73c8d7ea tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] HTTP exception thrown: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-57b81cdf-3164-47f3-8313-999c73c8d7ea tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Request method failure captured: Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 HTTP/1.1 Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eH5JLoYgsKqzDivalqg3RkweaqvEdlKjUEwS1CBQhlJGIYWY5bd6qn4Mvo_0PK2gve1ndj06wHJ1NIrNzpiSeMEaXzldGKb_7WLhEHO7wkRiRpLIyPNQe-FEqqoAn1uTHylqeI2dEN8lEf6ZPJiUFVHrUFe0JSe8utku8FknjaQOeQ Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: a806f9b3e5154aa385f6a9ff01452acd Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-DeleteServersTestJSON-1521164755 Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a806f9b3e5154aa385f6a9ff01452acd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a806f9b3e5154aa385f6a9ff01452acd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a806f9b3e5154aa385f6a9ff01452acd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a806f9b3e5154aa385f6a9ff01452acd"}]}] Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-DeleteServersTestJSON-1521164755 Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: a806f9b3e5154aa385f6a9ff01452acd Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-DeleteServersTestJSON-1521164755 Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-DeleteServersTestJSON-1521164755-project Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 5b5057876b05445b884dd98b9fd96883 Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-DeleteServersTestJSON-1521164755-project Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'bdc26510-5bd6-43d4-a0b5-7ee5648f33f5'} Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:49:14.677651 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:49:14.682821 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. Aug 03 02:49:14.682821 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:49:14.682821 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:49:14.682821 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:49:14.682821 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:49:14.682821 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:49:14.682821 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:49:14.682821 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:49:14.682821 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:49:14.682821 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. Aug 03 02:49:14.682821 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:49:14.682821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-57b81cdf-3164-47f3-8313-999c73c8d7ea tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Returning 404 to user: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:49:14.682821 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-57b81cdf-3164-47f3-8313-999c73c8d7ea tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 404 len: 111 microversion: 2.1 time: 0.030505 Aug 03 02:49:14.682821 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3204/6529] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:49:14 2022] DELETE /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:49:14.687848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4cdbffad-3da1-4b37-8d9c-e57c80256d97 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:14.688486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4cdbffad-3da1-4b37-8d9c-e57c80256d97 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] [instance: bdc26510-5bd6-43d4-a0b5-7ee5648f33f5] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:14.694999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4cdbffad-3da1-4b37-8d9c-e57c80256d97 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:14.695470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4cdbffad-3da1-4b37-8d9c-e57c80256d97 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:14.696257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4cdbffad-3da1-4b37-8d9c-e57c80256d97 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:14.696712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4cdbffad-3da1-4b37-8d9c-e57c80256d97 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:14.710539 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-4cdbffad-3da1-4b37-8d9c-e57c80256d97 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] HTTP exception thrown: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4cdbffad-3da1-4b37-8d9c-e57c80256d97 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Request method failure captured: Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 HTTP/1.1 Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eH5JLoYgsKqzDivalqg3RkweaqvEdlKjUEwS1CBQhlJGIYWY5bd6qn4Mvo_0PK2gve1ndj06wHJ1NIrNzpiSeMEaXzldGKb_7WLhEHO7wkRiRpLIyPNQe-FEqqoAn1uTHylqeI2dEN8lEf6ZPJiUFVHrUFe0JSe8utku8FknjaQOeQ Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: a806f9b3e5154aa385f6a9ff01452acd Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-DeleteServersTestJSON-1521164755 Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a806f9b3e5154aa385f6a9ff01452acd", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a806f9b3e5154aa385f6a9ff01452acd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a806f9b3e5154aa385f6a9ff01452acd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a806f9b3e5154aa385f6a9ff01452acd"}]}] Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-DeleteServersTestJSON-1521164755 Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: a806f9b3e5154aa385f6a9ff01452acd Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-DeleteServersTestJSON-1521164755 Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-DeleteServersTestJSON-1521164755-project Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 5b5057876b05445b884dd98b9fd96883 Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-DeleteServersTestJSON-1521164755-project Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'bdc26510-5bd6-43d4-a0b5-7ee5648f33f5'} Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:49:14.712069 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:49:14.716783 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:49:14.716783 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:49:14.716783 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:49:14.716783 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:49:14.716783 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:49:14.716783 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. Aug 03 02:49:14.716783 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:49:14.716783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4cdbffad-3da1-4b37-8d9c-e57c80256d97 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] Returning 404 to user: Instance bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:49:14.716783 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4cdbffad-3da1-4b37-8d9c-e57c80256d97 tempest-DeleteServersTestJSON-1521164755 tempest-DeleteServersTestJSON-1521164755-project] 10.222.0.67 "GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5" status: 404 len: 111 microversion: 2.1 time: 0.029526 Aug 03 02:49:14.716783 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3326/6530] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:14 2022] GET /compute/v2.1/servers/bdc26510-5bd6-43d4-a0b5-7ee5648f33f5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:49:19.687621 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:49:19.688218 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 02:49:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:49:19.716639 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:49:19.717306 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 02:49:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:49:23.656853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-826907315", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "f5b3a314-fb33-4f5d-8781-2d75e0c8a82b"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:49:23.718018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] validate_networks() for [('f5b3a314-fb33-4f5d-8781-2d75e0c8a82b', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:49:24.183591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:49:24.184022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:49:24.184503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:49:24.184921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:49:24.185346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:49:24.195021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:24.195479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:24.196328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:24.196766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:24.215124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Getting quotas for project f689938f413f471b8b8de94c32e40854. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:49:24.220437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Getting quotas for user fc327dafaf8e419b8d150fa7cbf1acea and project f689938f413f471b8b8de94c32e40854. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:49:24.232846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:49:24.235184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:49:24.281729 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-92301aa7-5484-4ce3-8cf2-6dacd900e5b9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771097 Aug 03 02:49:24.282722 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3205/6531] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:49:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:49:24.293593 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8460e94-a267-4105-a127-913503c0d93d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:24.294233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8460e94-a267-4105-a127-913503c0d93d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:24.355677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8460e94-a267-4105-a127-913503c0d93d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:24.363473 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8460e94-a267-4105-a127-913503c0d93d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1217 microversion: 2.1 time: 0.073798 Aug 03 02:49:24.363915 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3327/6532] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:24 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:25.387359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7a663d06-cc45-4a30-a4cb-9d6ff1eab0f4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:25.388869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7a663d06-cc45-4a30-a4cb-9d6ff1eab0f4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:25.397010 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a663d06-cc45-4a30-a4cb-9d6ff1eab0f4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:25.397470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a663d06-cc45-4a30-a4cb-9d6ff1eab0f4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:25.398287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a663d06-cc45-4a30-a4cb-9d6ff1eab0f4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:25.399298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7a663d06-cc45-4a30-a4cb-9d6ff1eab0f4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:25.465653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7a663d06-cc45-4a30-a4cb-9d6ff1eab0f4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:25.474052 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7a663d06-cc45-4a30-a4cb-9d6ff1eab0f4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1275 microversion: 2.1 time: 0.091923 Aug 03 02:49:25.476248 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3206/6533] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:25 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:26.498590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-015c6af3-529a-43f0-be7e-fe56d79d6989 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:26.499854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-015c6af3-529a-43f0-be7e-fe56d79d6989 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:26.509359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=29 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:49:26.513685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-015c6af3-529a-43f0-be7e-fe56d79d6989 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:26.514216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-015c6af3-529a-43f0-be7e-fe56d79d6989 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:26.514986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-015c6af3-529a-43f0-be7e-fe56d79d6989 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:26.515630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-015c6af3-529a-43f0-be7e-fe56d79d6989 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:26.664739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d327697f-63b0-4d84-ac3a-c57bba37c0cb req-dab36a5e-35fd-46c2-b8c8-c73029c577d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1345a19-e30a-4900-8b18-b603df397f5f", "tag": "24f2b39b-dbde-413b-b980-fcb19cd3db80"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:49:26.684492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-015c6af3-529a-43f0-be7e-fe56d79d6989 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:26.688109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d327697f-63b0-4d84-ac3a-c57bba37c0cb req-dab36a5e-35fd-46c2-b8c8-c73029c577d6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:26.688898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d327697f-63b0-4d84-ac3a-c57bba37c0cb req-dab36a5e-35fd-46c2-b8c8-c73029c577d6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:26.693550 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-015c6af3-529a-43f0-be7e-fe56d79d6989 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1317 microversion: 2.1 time: 0.199425 Aug 03 02:49:26.694829 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3328/6534] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:26 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:26.710232 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d327697f-63b0-4d84-ac3a-c57bba37c0cb req-dab36a5e-35fd-46c2-b8c8-c73029c577d6 service nova] Creating event network-changed:24f2b39b-dbde-413b-b980-fcb19cd3db80 for instance a1345a19-e30a-4900-8b18-b603df397f5f on n-h1-826529-8 Aug 03 02:49:26.716319 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d327697f-63b0-4d84-ac3a-c57bba37c0cb req-dab36a5e-35fd-46c2-b8c8-c73029c577d6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056431 Aug 03 02:49:26.717691 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3207/6535] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:49:27.716063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-997e3df4-23da-44cf-9283-56f0cb3da25f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:27.716597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-997e3df4-23da-44cf-9283-56f0cb3da25f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:27.723803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-997e3df4-23da-44cf-9283-56f0cb3da25f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:27.724268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-997e3df4-23da-44cf-9283-56f0cb3da25f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:27.725114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-997e3df4-23da-44cf-9283-56f0cb3da25f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:27.725639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-997e3df4-23da-44cf-9283-56f0cb3da25f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:27.862160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-997e3df4-23da-44cf-9283-56f0cb3da25f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:27.869882 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-997e3df4-23da-44cf-9283-56f0cb3da25f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1317 microversion: 2.1 time: 0.157810 Aug 03 02:49:27.870465 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3329/6536] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:27 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:28.893518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-55cb8c4e-bb20-4e7a-9d51-ee61ab3e37f2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:28.894252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-55cb8c4e-bb20-4e7a-9d51-ee61ab3e37f2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:28.901305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55cb8c4e-bb20-4e7a-9d51-ee61ab3e37f2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:28.901770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55cb8c4e-bb20-4e7a-9d51-ee61ab3e37f2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:28.902549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55cb8c4e-bb20-4e7a-9d51-ee61ab3e37f2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:28.903021 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55cb8c4e-bb20-4e7a-9d51-ee61ab3e37f2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:29.038840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-55cb8c4e-bb20-4e7a-9d51-ee61ab3e37f2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:29.049099 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-55cb8c4e-bb20-4e7a-9d51-ee61ab3e37f2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1317 microversion: 2.1 time: 0.160703 Aug 03 02:49:29.049687 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3208/6537] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:28 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:30.070291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bbc283be-8c3e-4391-a9b8-9dfae9ff898e tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:30.070964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bbc283be-8c3e-4391-a9b8-9dfae9ff898e tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:30.077952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbc283be-8c3e-4391-a9b8-9dfae9ff898e tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:30.078423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbc283be-8c3e-4391-a9b8-9dfae9ff898e tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:30.079236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbc283be-8c3e-4391-a9b8-9dfae9ff898e tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:30.079694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bbc283be-8c3e-4391-a9b8-9dfae9ff898e tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:30.220393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bbc283be-8c3e-4391-a9b8-9dfae9ff898e tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:30.229045 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bbc283be-8c3e-4391-a9b8-9dfae9ff898e tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1317 microversion: 2.1 time: 0.163191 Aug 03 02:49:30.229622 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3330/6538] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:30 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:31.249747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4e58ef8c-ebcb-405b-9fca-e2e2aa509146 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:31.250349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4e58ef8c-ebcb-405b-9fca-e2e2aa509146 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:31.257843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e58ef8c-ebcb-405b-9fca-e2e2aa509146 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:31.258306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e58ef8c-ebcb-405b-9fca-e2e2aa509146 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:31.259165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e58ef8c-ebcb-405b-9fca-e2e2aa509146 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:31.259613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4e58ef8c-ebcb-405b-9fca-e2e2aa509146 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:31.398061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4e58ef8c-ebcb-405b-9fca-e2e2aa509146 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:31.405797 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4e58ef8c-ebcb-405b-9fca-e2e2aa509146 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1317 microversion: 2.1 time: 0.160031 Aug 03 02:49:31.406365 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3209/6539] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:31 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:32.427225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1fee4b50-ebd7-45dd-b3d6-a3e65ee08be4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:32.428840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1fee4b50-ebd7-45dd-b3d6-a3e65ee08be4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:32.436486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fee4b50-ebd7-45dd-b3d6-a3e65ee08be4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:32.436957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fee4b50-ebd7-45dd-b3d6-a3e65ee08be4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:32.437853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fee4b50-ebd7-45dd-b3d6-a3e65ee08be4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:32.438214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fee4b50-ebd7-45dd-b3d6-a3e65ee08be4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:32.531740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-e971f808-c502-4385-8036-b26d3f0a7413 req-37d9a0d0-fa09-4c94-beb9-a1ccf4bc8170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1345a19-e30a-4900-8b18-b603df397f5f", "name": "network-vif-plugged", "status": "completed", "tag": "24f2b39b-dbde-413b-b980-fcb19cd3db80"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:49:32.543202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e971f808-c502-4385-8036-b26d3f0a7413 req-37d9a0d0-fa09-4c94-beb9-a1ccf4bc8170 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:32.544190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-e971f808-c502-4385-8036-b26d3f0a7413 req-37d9a0d0-fa09-4c94-beb9-a1ccf4bc8170 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:32.558004 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-e971f808-c502-4385-8036-b26d3f0a7413 req-37d9a0d0-fa09-4c94-beb9-a1ccf4bc8170 service nova] Creating event network-vif-plugged:24f2b39b-dbde-413b-b980-fcb19cd3db80 for instance a1345a19-e30a-4900-8b18-b603df397f5f on n-h1-826529-8 Aug 03 02:49:32.563448 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-e971f808-c502-4385-8036-b26d3f0a7413 req-37d9a0d0-fa09-4c94-beb9-a1ccf4bc8170 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035474 Aug 03 02:49:32.564048 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3210/6540] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:49:32.583131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1fee4b50-ebd7-45dd-b3d6-a3e65ee08be4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:32.592422 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1fee4b50-ebd7-45dd-b3d6-a3e65ee08be4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1317 microversion: 2.1 time: 0.169281 Aug 03 02:49:32.593282 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3331/6541] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:32 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:33.617537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2f6410f4-1502-4296-b463-c8d36c7ec5f7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:33.618249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2f6410f4-1502-4296-b463-c8d36c7ec5f7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:33.624693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f6410f4-1502-4296-b463-c8d36c7ec5f7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:33.625152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f6410f4-1502-4296-b463-c8d36c7ec5f7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:33.625945 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f6410f4-1502-4296-b463-c8d36c7ec5f7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:33.626391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2f6410f4-1502-4296-b463-c8d36c7ec5f7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:33.762119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2f6410f4-1502-4296-b463-c8d36c7ec5f7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:33.769756 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2f6410f4-1502-4296-b463-c8d36c7ec5f7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1317 microversion: 2.1 time: 0.157982 Aug 03 02:49:33.770328 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3211/6542] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:33 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:34.791007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-63df03f6-65f2-4a96-a83f-172cf0169136 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:34.791636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-63df03f6-65f2-4a96-a83f-172cf0169136 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:34.794380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:49:34.800058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63df03f6-65f2-4a96-a83f-172cf0169136 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:34.800524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63df03f6-65f2-4a96-a83f-172cf0169136 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:34.801305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63df03f6-65f2-4a96-a83f-172cf0169136 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:34.801757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63df03f6-65f2-4a96-a83f-172cf0169136 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:34.937601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-63df03f6-65f2-4a96-a83f-172cf0169136 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:34.945257 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-63df03f6-65f2-4a96-a83f-172cf0169136 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1507 microversion: 2.1 time: 0.158174 Aug 03 02:49:34.945825 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3332/6543] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:34 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:34.965836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4512fee2-c0bf-4863-9654-90e82f4e06ca tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:34.966471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4512fee2-c0bf-4863-9654-90e82f4e06ca tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:34.968484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:49:34.969174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:49:34.976658 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4512fee2-c0bf-4863-9654-90e82f4e06ca tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:34.977126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4512fee2-c0bf-4863-9654-90e82f4e06ca tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:34.977914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4512fee2-c0bf-4863-9654-90e82f4e06ca tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:34.978362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4512fee2-c0bf-4863-9654-90e82f4e06ca tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:35.110038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4512fee2-c0bf-4863-9654-90e82f4e06ca tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:35.118357 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4512fee2-c0bf-4863-9654-90e82f4e06ca tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1507 microversion: 2.1 time: 0.156418 Aug 03 02:49:35.118945 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3212/6544] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:34 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:35.138465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-235a57d0-725b-4e0f-8db5-f52a30fbf51b tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:49:35.140939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-235a57d0-725b-4e0f-8db5-f52a30fbf51b tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:35.147960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-235a57d0-725b-4e0f-8db5-f52a30fbf51b tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:35.148435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-235a57d0-725b-4e0f-8db5-f52a30fbf51b tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:35.149222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-235a57d0-725b-4e0f-8db5-f52a30fbf51b tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:35.149677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-235a57d0-725b-4e0f-8db5-f52a30fbf51b tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:35.220155 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-235a57d0-725b-4e0f-8db5-f52a30fbf51b tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "PUT /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1079 microversion: 2.1 time: 0.085857 Aug 03 02:49:35.220791 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3333/6545] 10.222.0.67 () {60 vars in 1256 bytes} [Wed Aug 3 02:49:35 2022] PUT /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1079 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:35.238498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f386d93f-7a39-4a2e-a9a3-d4d31c803d1c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:35.239162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f386d93f-7a39-4a2e-a9a3-d4d31c803d1c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:35.245732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f386d93f-7a39-4a2e-a9a3-d4d31c803d1c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:35.246196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f386d93f-7a39-4a2e-a9a3-d4d31c803d1c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:35.247020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f386d93f-7a39-4a2e-a9a3-d4d31c803d1c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:35.247476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f386d93f-7a39-4a2e-a9a3-d4d31c803d1c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:35.380605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f386d93f-7a39-4a2e-a9a3-d4d31c803d1c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:35.388724 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f386d93f-7a39-4a2e-a9a3-d4d31c803d1c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1505 microversion: 2.1 time: 0.154151 Aug 03 02:49:35.389307 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3213/6546] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:35 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:49:35.409112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dff887c1-2fe7-4999-b789-67426b66636c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:35.409739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dff887c1-2fe7-4999-b789-67426b66636c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:35.416751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dff887c1-2fe7-4999-b789-67426b66636c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:35.417254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dff887c1-2fe7-4999-b789-67426b66636c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:35.418031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dff887c1-2fe7-4999-b789-67426b66636c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:35.418477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dff887c1-2fe7-4999-b789-67426b66636c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:35.554734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dff887c1-2fe7-4999-b789-67426b66636c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:35.562815 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dff887c1-2fe7-4999-b789-67426b66636c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1505 microversion: 2.1 time: 0.157608 Aug 03 02:49:35.563407 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3334/6547] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:35 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:35.583648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-407b66ac-a4c3-44ff-a638-d2342287c1d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:49:35.586507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-407b66ac-a4c3-44ff-a638-d2342287c1d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:35.592718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-407b66ac-a4c3-44ff-a638-d2342287c1d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:35.593184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-407b66ac-a4c3-44ff-a638-d2342287c1d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:35.593975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-407b66ac-a4c3-44ff-a638-d2342287c1d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:35.594422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-407b66ac-a4c3-44ff-a638-d2342287c1d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:35.622771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-407b66ac-a4c3-44ff-a638-d2342287c1d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:35.628983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-407b66ac-a4c3-44ff-a638-d2342287c1d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Old instance type m1.heat2, new instance type m1.heat {{(pid=125942) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 02:49:35.636382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-407b66ac-a4c3-44ff-a638-d2342287c1d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:49:35.636806 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-407b66ac-a4c3-44ff-a638-d2342287c1d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:49:35.637284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-407b66ac-a4c3-44ff-a638-d2342287c1d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:49:35.637697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-407b66ac-a4c3-44ff-a638-d2342287c1d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:49:35.638116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-407b66ac-a4c3-44ff-a638-d2342287c1d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:49:35.703883 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-407b66ac-a4c3-44ff-a638-d2342287c1d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "POST /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f/action" status: 202 len: 0 microversion: 2.1 time: 0.124247 Aug 03 02:49:35.704682 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3214/6548] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:49:35 2022] POST /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:49:35.713303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c3df2dc7-f8d7-4637-bd06-58ee0d289a6d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:35.713851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c3df2dc7-f8d7-4637-bd06-58ee0d289a6d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:35.719935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3df2dc7-f8d7-4637-bd06-58ee0d289a6d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:35.720395 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3df2dc7-f8d7-4637-bd06-58ee0d289a6d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:35.721177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3df2dc7-f8d7-4637-bd06-58ee0d289a6d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:35.721628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3df2dc7-f8d7-4637-bd06-58ee0d289a6d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:35.861360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c3df2dc7-f8d7-4637-bd06-58ee0d289a6d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:35.869119 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c3df2dc7-f8d7-4637-bd06-58ee0d289a6d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1516 microversion: 2.1 time: 0.160286 Aug 03 02:49:35.869721 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3335/6549] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:35 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:36.891632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9a9924dd-f666-40a2-963f-42874d2a6737 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:36.892351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9a9924dd-f666-40a2-963f-42874d2a6737 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:36.894445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:49:36.901053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a9924dd-f666-40a2-963f-42874d2a6737 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:36.901518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a9924dd-f666-40a2-963f-42874d2a6737 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:36.902312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a9924dd-f666-40a2-963f-42874d2a6737 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:36.902800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a9924dd-f666-40a2-963f-42874d2a6737 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:36.907839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:49:37.054415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9a9924dd-f666-40a2-963f-42874d2a6737 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:37.062270 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9a9924dd-f666-40a2-963f-42874d2a6737 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1516 microversion: 2.1 time: 0.175500 Aug 03 02:49:37.063080 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3215/6550] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:36 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:38.083612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-82c92e60-4845-4ec0-9aca-7be68cd4c98d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:38.084852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-82c92e60-4845-4ec0-9aca-7be68cd4c98d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:38.087539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=34 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:49:38.093021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82c92e60-4845-4ec0-9aca-7be68cd4c98d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:38.093526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82c92e60-4845-4ec0-9aca-7be68cd4c98d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:38.094309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82c92e60-4845-4ec0-9aca-7be68cd4c98d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:38.094766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-82c92e60-4845-4ec0-9aca-7be68cd4c98d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:38.233929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-82c92e60-4845-4ec0-9aca-7be68cd4c98d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:38.242314 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-82c92e60-4845-4ec0-9aca-7be68cd4c98d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.162790 Aug 03 02:49:38.242890 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3336/6551] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:38 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:39.264572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-157f9625-12dd-4463-8f9c-6d658adb7e4b tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:39.265173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-157f9625-12dd-4463-8f9c-6d658adb7e4b tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:39.273226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-157f9625-12dd-4463-8f9c-6d658adb7e4b tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:39.273680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-157f9625-12dd-4463-8f9c-6d658adb7e4b tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:39.274476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-157f9625-12dd-4463-8f9c-6d658adb7e4b tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:39.274946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-157f9625-12dd-4463-8f9c-6d658adb7e4b tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:39.405178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-157f9625-12dd-4463-8f9c-6d658adb7e4b tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:39.413477 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-157f9625-12dd-4463-8f9c-6d658adb7e4b tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.153103 Aug 03 02:49:39.414049 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3216/6552] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:39 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:49:40.433846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8c7193ea-8cbf-44cf-8c42-c214b9c59bbc tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:40.434465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8c7193ea-8cbf-44cf-8c42-c214b9c59bbc tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:40.441486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c7193ea-8cbf-44cf-8c42-c214b9c59bbc tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:40.441960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c7193ea-8cbf-44cf-8c42-c214b9c59bbc tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:40.442752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c7193ea-8cbf-44cf-8c42-c214b9c59bbc tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:40.443752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c7193ea-8cbf-44cf-8c42-c214b9c59bbc tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:40.578795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8c7193ea-8cbf-44cf-8c42-c214b9c59bbc tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:40.586656 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8c7193ea-8cbf-44cf-8c42-c214b9c59bbc tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.156779 Aug 03 02:49:40.587263 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3337/6553] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:40 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:41.607437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-89353b08-f587-4310-b8ea-873e4911f927 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:41.608055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-89353b08-f587-4310-b8ea-873e4911f927 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:41.615809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89353b08-f587-4310-b8ea-873e4911f927 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:41.616267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89353b08-f587-4310-b8ea-873e4911f927 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:41.617041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89353b08-f587-4310-b8ea-873e4911f927 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:41.617512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-89353b08-f587-4310-b8ea-873e4911f927 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:41.752211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-89353b08-f587-4310-b8ea-873e4911f927 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:41.757938 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-89353b08-f587-4310-b8ea-873e4911f927 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.154441 Aug 03 02:49:41.758506 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3217/6554] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:41 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:42.779420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dced7131-0b81-4561-91a5-0282573b9c1f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:42.780052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dced7131-0b81-4561-91a5-0282573b9c1f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:42.787177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dced7131-0b81-4561-91a5-0282573b9c1f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:42.787645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dced7131-0b81-4561-91a5-0282573b9c1f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:42.788439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dced7131-0b81-4561-91a5-0282573b9c1f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:42.788897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dced7131-0b81-4561-91a5-0282573b9c1f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:42.923406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dced7131-0b81-4561-91a5-0282573b9c1f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:42.931540 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dced7131-0b81-4561-91a5-0282573b9c1f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.156078 Aug 03 02:49:42.932113 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3338/6555] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:42 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:43.953293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e832b2fb-2060-494f-8200-1267627258f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:43.953940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e832b2fb-2060-494f-8200-1267627258f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:43.961655 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e832b2fb-2060-494f-8200-1267627258f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:43.962111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e832b2fb-2060-494f-8200-1267627258f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:43.962914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e832b2fb-2060-494f-8200-1267627258f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:43.963368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e832b2fb-2060-494f-8200-1267627258f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:44.094224 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e832b2fb-2060-494f-8200-1267627258f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:44.101925 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e832b2fb-2060-494f-8200-1267627258f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.152619 Aug 03 02:49:44.102494 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3218/6556] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:43 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:45.123348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d8f1f368-bb2d-4497-8f8a-a8abe70b87de tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:45.123974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d8f1f368-bb2d-4497-8f8a-a8abe70b87de tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:45.131066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8f1f368-bb2d-4497-8f8a-a8abe70b87de tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:45.131526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8f1f368-bb2d-4497-8f8a-a8abe70b87de tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:45.132304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8f1f368-bb2d-4497-8f8a-a8abe70b87de tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:45.132752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d8f1f368-bb2d-4497-8f8a-a8abe70b87de tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:45.266672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d8f1f368-bb2d-4497-8f8a-a8abe70b87de tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:45.275110 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d8f1f368-bb2d-4497-8f8a-a8abe70b87de tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.155605 Aug 03 02:49:45.275696 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3339/6557] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:45 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:46.297718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d28c1343-fe0f-49a9-87c9-660a5e546c30 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:46.298349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d28c1343-fe0f-49a9-87c9-660a5e546c30 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:46.306367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d28c1343-fe0f-49a9-87c9-660a5e546c30 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:46.306827 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d28c1343-fe0f-49a9-87c9-660a5e546c30 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:46.307639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d28c1343-fe0f-49a9-87c9-660a5e546c30 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:46.308085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d28c1343-fe0f-49a9-87c9-660a5e546c30 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:46.442258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d28c1343-fe0f-49a9-87c9-660a5e546c30 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:46.449977 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d28c1343-fe0f-49a9-87c9-660a5e546c30 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.156163 Aug 03 02:49:46.450560 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3219/6558] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:46 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:47.471407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9272f260-9048-499f-9ca6-15709cea8ab3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:47.471930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9272f260-9048-499f-9ca6-15709cea8ab3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:47.479211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9272f260-9048-499f-9ca6-15709cea8ab3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:47.479635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9272f260-9048-499f-9ca6-15709cea8ab3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:47.480470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9272f260-9048-499f-9ca6-15709cea8ab3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:47.480900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9272f260-9048-499f-9ca6-15709cea8ab3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:47.612290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9272f260-9048-499f-9ca6-15709cea8ab3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:47.620605 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9272f260-9048-499f-9ca6-15709cea8ab3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.153273 Aug 03 02:49:47.621174 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3340/6559] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:47 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:48.642034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bfb057df-45dd-464a-81af-1675bb139017 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:48.642669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bfb057df-45dd-464a-81af-1675bb139017 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:48.650434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfb057df-45dd-464a-81af-1675bb139017 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:48.650894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfb057df-45dd-464a-81af-1675bb139017 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:48.651704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfb057df-45dd-464a-81af-1675bb139017 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:48.652153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bfb057df-45dd-464a-81af-1675bb139017 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:48.788366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bfb057df-45dd-464a-81af-1675bb139017 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:48.795983 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bfb057df-45dd-464a-81af-1675bb139017 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.157976 Aug 03 02:49:48.796571 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3220/6560] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:48 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:49.818972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0a318f19-aa04-4ebc-8961-f6efe73b06d3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:49.819638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0a318f19-aa04-4ebc-8961-f6efe73b06d3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:49.826640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a318f19-aa04-4ebc-8961-f6efe73b06d3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:49.827149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a318f19-aa04-4ebc-8961-f6efe73b06d3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:49.827945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a318f19-aa04-4ebc-8961-f6efe73b06d3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:49.828403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a318f19-aa04-4ebc-8961-f6efe73b06d3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:49.962473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a318f19-aa04-4ebc-8961-f6efe73b06d3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:49.970049 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0a318f19-aa04-4ebc-8961-f6efe73b06d3 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.156128 Aug 03 02:49:49.970622 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3341/6561] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:49 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:50.992776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-be7f7d55-3164-4d18-8179-6010b4f2ae08 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:50.993406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-be7f7d55-3164-4d18-8179-6010b4f2ae08 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:51.000247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be7f7d55-3164-4d18-8179-6010b4f2ae08 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:51.000673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be7f7d55-3164-4d18-8179-6010b4f2ae08 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:51.001447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be7f7d55-3164-4d18-8179-6010b4f2ae08 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:51.001889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be7f7d55-3164-4d18-8179-6010b4f2ae08 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:51.139433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-be7f7d55-3164-4d18-8179-6010b4f2ae08 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:51.148003 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-be7f7d55-3164-4d18-8179-6010b4f2ae08 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.160357 Aug 03 02:49:51.148696 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3221/6562] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:50 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:52.172170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2f2325c2-3913-43d6-8b32-83d9fd180086 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:52.172824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2f2325c2-3913-43d6-8b32-83d9fd180086 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:52.179935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f2325c2-3913-43d6-8b32-83d9fd180086 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:52.180397 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f2325c2-3913-43d6-8b32-83d9fd180086 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:52.181180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f2325c2-3913-43d6-8b32-83d9fd180086 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:52.181625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f2325c2-3913-43d6-8b32-83d9fd180086 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:52.312641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2f2325c2-3913-43d6-8b32-83d9fd180086 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:52.320499 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2f2325c2-3913-43d6-8b32-83d9fd180086 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.152363 Aug 03 02:49:52.321079 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3342/6563] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:52 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:53.353181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2b256faa-a0cd-4a45-a5b5-b37c8d469db7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:53.353826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2b256faa-a0cd-4a45-a5b5-b37c8d469db7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:53.361307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b256faa-a0cd-4a45-a5b5-b37c8d469db7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:53.361795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b256faa-a0cd-4a45-a5b5-b37c8d469db7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:53.362579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b256faa-a0cd-4a45-a5b5-b37c8d469db7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:53.363056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b256faa-a0cd-4a45-a5b5-b37c8d469db7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:53.494069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2b256faa-a0cd-4a45-a5b5-b37c8d469db7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:53.501677 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2b256faa-a0cd-4a45-a5b5-b37c8d469db7 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.152565 Aug 03 02:49:53.502259 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3222/6564] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:53 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:54.524194 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-937c8253-7e9e-4a7c-91d3-1cb7a90d013d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:54.524838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-937c8253-7e9e-4a7c-91d3-1cb7a90d013d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:54.531796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-937c8253-7e9e-4a7c-91d3-1cb7a90d013d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:54.532271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-937c8253-7e9e-4a7c-91d3-1cb7a90d013d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:54.533063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-937c8253-7e9e-4a7c-91d3-1cb7a90d013d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:54.533523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-937c8253-7e9e-4a7c-91d3-1cb7a90d013d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:54.668657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-937c8253-7e9e-4a7c-91d3-1cb7a90d013d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:54.672101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:49:54.677237 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-937c8253-7e9e-4a7c-91d3-1cb7a90d013d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.157492 Aug 03 02:49:54.677728 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3343/6565] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:54 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:55.698029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e81d9a3c-2712-4e93-8fef-b0dc12edae23 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:55.698657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e81d9a3c-2712-4e93-8fef-b0dc12edae23 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:55.705809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e81d9a3c-2712-4e93-8fef-b0dc12edae23 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:55.706267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e81d9a3c-2712-4e93-8fef-b0dc12edae23 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:55.707081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e81d9a3c-2712-4e93-8fef-b0dc12edae23 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:55.707528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e81d9a3c-2712-4e93-8fef-b0dc12edae23 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:55.841891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e81d9a3c-2712-4e93-8fef-b0dc12edae23 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:55.849631 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e81d9a3c-2712-4e93-8fef-b0dc12edae23 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.155515 Aug 03 02:49:55.850217 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3223/6566] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:55 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:56.872251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03618962-7ee5-44fd-af6c-3d2ee02c6964 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:56.872994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-03618962-7ee5-44fd-af6c-3d2ee02c6964 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:56.880245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03618962-7ee5-44fd-af6c-3d2ee02c6964 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:56.880730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03618962-7ee5-44fd-af6c-3d2ee02c6964 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:56.881518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03618962-7ee5-44fd-af6c-3d2ee02c6964 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:56.881970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03618962-7ee5-44fd-af6c-3d2ee02c6964 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:57.015496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03618962-7ee5-44fd-af6c-3d2ee02c6964 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:57.023778 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03618962-7ee5-44fd-af6c-3d2ee02c6964 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.156311 Aug 03 02:49:57.024356 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3344/6567] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:56 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:58.045747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4258d34b-1000-4d3c-b60d-f6fb3e58d579 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:58.046376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4258d34b-1000-4d3c-b60d-f6fb3e58d579 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:58.054306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4258d34b-1000-4d3c-b60d-f6fb3e58d579 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:58.054774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4258d34b-1000-4d3c-b60d-f6fb3e58d579 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:58.055595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4258d34b-1000-4d3c-b60d-f6fb3e58d579 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:58.056053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4258d34b-1000-4d3c-b60d-f6fb3e58d579 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:58.188373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4258d34b-1000-4d3c-b60d-f6fb3e58d579 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:58.196181 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4258d34b-1000-4d3c-b60d-f6fb3e58d579 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.154398 Aug 03 02:49:58.196752 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3224/6568] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:58 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:49:59.217412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ffdeb377-d33f-432b-b6ac-622ccf870fe0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:49:59.218050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ffdeb377-d33f-432b-b6ac-622ccf870fe0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:49:59.225841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ffdeb377-d33f-432b-b6ac-622ccf870fe0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:59.226310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ffdeb377-d33f-432b-b6ac-622ccf870fe0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:59.227149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ffdeb377-d33f-432b-b6ac-622ccf870fe0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:49:59.227611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ffdeb377-d33f-432b-b6ac-622ccf870fe0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:49:59.363443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ffdeb377-d33f-432b-b6ac-622ccf870fe0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:49:59.371560 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ffdeb377-d33f-432b-b6ac-622ccf870fe0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.158064 Aug 03 02:49:59.372139 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3345/6569] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:49:59 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:00.392958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0b0fc70c-da6e-45ed-9a2c-c674dcba98c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:00.393587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0b0fc70c-da6e-45ed-9a2c-c674dcba98c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:00.400720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b0fc70c-da6e-45ed-9a2c-c674dcba98c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:00.401187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b0fc70c-da6e-45ed-9a2c-c674dcba98c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:00.401975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b0fc70c-da6e-45ed-9a2c-c674dcba98c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:00.402426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b0fc70c-da6e-45ed-9a2c-c674dcba98c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:00.542013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0b0fc70c-da6e-45ed-9a2c-c674dcba98c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:00.549652 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0b0fc70c-da6e-45ed-9a2c-c674dcba98c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.160677 Aug 03 02:50:00.550326 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3225/6570] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:00 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:01.573063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a53dadeb-6ace-41a4-b00a-27d53e45be0f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:01.573698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a53dadeb-6ace-41a4-b00a-27d53e45be0f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:01.580387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a53dadeb-6ace-41a4-b00a-27d53e45be0f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:01.580860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a53dadeb-6ace-41a4-b00a-27d53e45be0f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:01.581654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a53dadeb-6ace-41a4-b00a-27d53e45be0f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:01.582111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a53dadeb-6ace-41a4-b00a-27d53e45be0f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:01.712623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a53dadeb-6ace-41a4-b00a-27d53e45be0f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:01.720153 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a53dadeb-6ace-41a4-b00a-27d53e45be0f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.152643 Aug 03 02:50:01.720737 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3346/6571] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:01 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:02.741562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a2dc1307-cce9-4fd9-b7eb-0a3c6cc6635c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:02.742269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a2dc1307-cce9-4fd9-b7eb-0a3c6cc6635c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:02.749416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2dc1307-cce9-4fd9-b7eb-0a3c6cc6635c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:02.749892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2dc1307-cce9-4fd9-b7eb-0a3c6cc6635c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:02.750732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2dc1307-cce9-4fd9-b7eb-0a3c6cc6635c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:02.751223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a2dc1307-cce9-4fd9-b7eb-0a3c6cc6635c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:02.888331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a2dc1307-cce9-4fd9-b7eb-0a3c6cc6635c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:02.896660 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a2dc1307-cce9-4fd9-b7eb-0a3c6cc6635c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.159132 Aug 03 02:50:02.897243 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3226/6572] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:02 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:03.918402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6ef0fd2d-5968-4ac7-bed9-430a6507c29d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:03.919087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6ef0fd2d-5968-4ac7-bed9-430a6507c29d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:03.926082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ef0fd2d-5968-4ac7-bed9-430a6507c29d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:03.926574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ef0fd2d-5968-4ac7-bed9-430a6507c29d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:03.927490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ef0fd2d-5968-4ac7-bed9-430a6507c29d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:03.927948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6ef0fd2d-5968-4ac7-bed9-430a6507c29d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:04.061758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6ef0fd2d-5968-4ac7-bed9-430a6507c29d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:04.070239 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6ef0fd2d-5968-4ac7-bed9-430a6507c29d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1521 microversion: 2.1 time: 0.155788 Aug 03 02:50:04.070839 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3347/6573] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:03 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:04.784008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d8b0d061-a4c8-41ff-81c4-50fab32bac7b req-53016c9a-372a-4469-8447-f63215c63f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1345a19-e30a-4900-8b18-b603df397f5f", "name": "network-vif-unplugged", "status": "completed", "tag": "24f2b39b-dbde-413b-b980-fcb19cd3db80"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:50:04.795982 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d8b0d061-a4c8-41ff-81c4-50fab32bac7b req-53016c9a-372a-4469-8447-f63215c63f5c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:04.796435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d8b0d061-a4c8-41ff-81c4-50fab32bac7b req-53016c9a-372a-4469-8447-f63215c63f5c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:04.812560 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d8b0d061-a4c8-41ff-81c4-50fab32bac7b req-53016c9a-372a-4469-8447-f63215c63f5c service nova] Creating event network-vif-unplugged:24f2b39b-dbde-413b-b980-fcb19cd3db80 for instance a1345a19-e30a-4900-8b18-b603df397f5f on n-h2-826529-8 Aug 03 02:50:04.819579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-d8b0d061-a4c8-41ff-81c4-50fab32bac7b req-53016c9a-372a-4469-8447-f63215c63f5c service nova] Instance a1345a19-e30a-4900-8b18-b603df397f5f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:50:04.830842 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d8b0d061-a4c8-41ff-81c4-50fab32bac7b req-53016c9a-372a-4469-8447-f63215c63f5c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050701 Aug 03 02:50:04.831621 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3227/6574] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:50:05.092334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a8fcecb6-01f6-43b9-bbb3-525f2b951462 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:05.093129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a8fcecb6-01f6-43b9-bbb3-525f2b951462 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:05.101069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8fcecb6-01f6-43b9-bbb3-525f2b951462 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:05.101621 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8fcecb6-01f6-43b9-bbb3-525f2b951462 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:05.102431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8fcecb6-01f6-43b9-bbb3-525f2b951462 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:05.102890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8fcecb6-01f6-43b9-bbb3-525f2b951462 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:05.248041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a8fcecb6-01f6-43b9-bbb3-525f2b951462 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:05.256590 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a8fcecb6-01f6-43b9-bbb3-525f2b951462 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1520 microversion: 2.1 time: 0.168164 Aug 03 02:50:05.261945 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3348/6575] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:05 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:06.280871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9b53eb5d-d7a0-45b7-b113-c45f55250cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:06.281575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9b53eb5d-d7a0-45b7-b113-c45f55250cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:06.288689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b53eb5d-d7a0-45b7-b113-c45f55250cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:06.289151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b53eb5d-d7a0-45b7-b113-c45f55250cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:06.289937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b53eb5d-d7a0-45b7-b113-c45f55250cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:06.290385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b53eb5d-d7a0-45b7-b113-c45f55250cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:06.427394 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9b53eb5d-d7a0-45b7-b113-c45f55250cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:06.435108 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9b53eb5d-d7a0-45b7-b113-c45f55250cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1518 microversion: 2.1 time: 0.159335 Aug 03 02:50:06.435701 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3228/6576] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:06 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:07.087015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-5c232840-fc7d-4f34-8e13-71a9623c781a req-058fbf01-f7cb-44fe-9451-aec7109713e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1345a19-e30a-4900-8b18-b603df397f5f", "tag": "24f2b39b-dbde-413b-b980-fcb19cd3db80"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:50:07.097488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5c232840-fc7d-4f34-8e13-71a9623c781a req-058fbf01-f7cb-44fe-9451-aec7109713e8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:07.097952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5c232840-fc7d-4f34-8e13-71a9623c781a req-058fbf01-f7cb-44fe-9451-aec7109713e8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:07.110038 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-5c232840-fc7d-4f34-8e13-71a9623c781a req-058fbf01-f7cb-44fe-9451-aec7109713e8 service nova] Creating event network-changed:24f2b39b-dbde-413b-b980-fcb19cd3db80 for instance a1345a19-e30a-4900-8b18-b603df397f5f on n-h2-826529-8 Aug 03 02:50:07.116149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-5c232840-fc7d-4f34-8e13-71a9623c781a req-058fbf01-f7cb-44fe-9451-aec7109713e8 service nova] Instance a1345a19-e30a-4900-8b18-b603df397f5f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:50:07.126785 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-5c232840-fc7d-4f34-8e13-71a9623c781a req-058fbf01-f7cb-44fe-9451-aec7109713e8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043662 Aug 03 02:50:07.127443 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3349/6577] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:50:07.458061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-61efbeef-167d-4856-87ff-3bb41f6d2290 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:07.459079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-61efbeef-167d-4856-87ff-3bb41f6d2290 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:07.461776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=28 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:50:07.468043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61efbeef-167d-4856-87ff-3bb41f6d2290 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:07.468544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61efbeef-167d-4856-87ff-3bb41f6d2290 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:07.469354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61efbeef-167d-4856-87ff-3bb41f6d2290 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:07.469882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-61efbeef-167d-4856-87ff-3bb41f6d2290 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:07.474940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=82 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:50:07.607641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-61efbeef-167d-4856-87ff-3bb41f6d2290 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:07.615761 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-61efbeef-167d-4856-87ff-3bb41f6d2290 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1515 microversion: 2.1 time: 0.162086 Aug 03 02:50:07.616257 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3229/6578] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:07 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:07.638805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-56140035-10ee-4c27-a97a-a9b40b90d0d0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:50:07.639475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-56140035-10ee-4c27-a97a-a9b40b90d0d0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:07.646352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56140035-10ee-4c27-a97a-a9b40b90d0d0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:07.647271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56140035-10ee-4c27-a97a-a9b40b90d0d0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:07.647639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56140035-10ee-4c27-a97a-a9b40b90d0d0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:07.648096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56140035-10ee-4c27-a97a-a9b40b90d0d0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:07.708197 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-56140035-10ee-4c27-a97a-a9b40b90d0d0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "POST /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f/action" status: 204 len: 0 microversion: 2.1 time: 0.073896 Aug 03 02:50:07.709681 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3350/6579] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:50:07 2022] POST /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 02:50:07.719013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c1d0b816-bd1d-41df-92c2-17ac5104cc64 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:07.719726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c1d0b816-bd1d-41df-92c2-17ac5104cc64 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:07.727068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1d0b816-bd1d-41df-92c2-17ac5104cc64 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:07.727998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1d0b816-bd1d-41df-92c2-17ac5104cc64 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:07.729055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1d0b816-bd1d-41df-92c2-17ac5104cc64 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:07.729718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1d0b816-bd1d-41df-92c2-17ac5104cc64 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:07.877388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c1d0b816-bd1d-41df-92c2-17ac5104cc64 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:07.891489 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c1d0b816-bd1d-41df-92c2-17ac5104cc64 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1515 microversion: 2.1 time: 0.176982 Aug 03 02:50:07.892098 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3230/6580] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:07 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:08.915809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1444bfda-e488-43da-9bed-8ffdefcab0b8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:08.917253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1444bfda-e488-43da-9bed-8ffdefcab0b8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:08.920529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=30 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:50:08.924887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1444bfda-e488-43da-9bed-8ffdefcab0b8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:08.925375 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1444bfda-e488-43da-9bed-8ffdefcab0b8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:08.926166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1444bfda-e488-43da-9bed-8ffdefcab0b8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:08.927455 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1444bfda-e488-43da-9bed-8ffdefcab0b8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:09.070985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1444bfda-e488-43da-9bed-8ffdefcab0b8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:09.079177 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1444bfda-e488-43da-9bed-8ffdefcab0b8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1507 microversion: 2.1 time: 0.169178 Aug 03 02:50:09.079789 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3351/6581] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:08 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:09.101824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-88b2bff9-4938-4bbc-8032-942f47beb843 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:09.102541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-88b2bff9-4938-4bbc-8032-942f47beb843 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:09.110463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88b2bff9-4938-4bbc-8032-942f47beb843 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:09.111048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88b2bff9-4938-4bbc-8032-942f47beb843 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:09.111916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88b2bff9-4938-4bbc-8032-942f47beb843 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:09.112593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88b2bff9-4938-4bbc-8032-942f47beb843 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:09.251709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-88b2bff9-4938-4bbc-8032-942f47beb843 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:09.260498 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-88b2bff9-4938-4bbc-8032-942f47beb843 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1507 microversion: 2.1 time: 0.163087 Aug 03 02:50:09.261084 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3231/6582] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:09 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:09.284426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ae0a3fdc-9232-443d-a65a-b542b193d7d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Action: 'create', calling method: .version_select at 0x7f5b11b7e160>, body: {"keypair": {"name": "tempest-keypair-1641057473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlMQCNvU3tUw6oBGBvUI5jdgo/oqUFrGO6YgMFB2evuHKuXzMkgLIMnTAPiEjL8DOOv6tCjfF0IpZWTBaxgXCGtbu/Ko6CvtmuyF2rZKYQc1SIFceIAJCESoDli+MMJzw=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:50:09.300336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-ae0a3fdc-9232-443d-a65a-b542b193d7d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Getting quotas for project f689938f413f471b8b8de94c32e40854. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:50:09.306245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-ae0a3fdc-9232-443d-a65a-b542b193d7d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Getting quotas for user fc327dafaf8e419b8d150fa7cbf1acea and project f689938f413f471b8b8de94c32e40854. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:50:09.320729 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ae0a3fdc-9232-443d-a65a-b542b193d7d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [43351c15-b3cd-4655-9748-f2eea73caa46] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 02:50:10.328580 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [None req-ae0a3fdc-9232-443d-a65a-b542b193d7d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [43351c15-b3cd-4655-9748-f2eea73caa46] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 35560. Aug 03 02:50:10.345463 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ae0a3fdc-9232-443d-a65a-b542b193d7d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.064978 Aug 03 02:50:10.346080 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3352/6583] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:50:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:50:10.869743 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d8db52f6-b2be-4540-8f91-0737136011ad req-b5c987e0-f1c7-4820-98c0-2804f6ad0d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1345a19-e30a-4900-8b18-b603df397f5f", "name": "network-vif-plugged", "status": "completed", "tag": "24f2b39b-dbde-413b-b980-fcb19cd3db80"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:50:10.881712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d8db52f6-b2be-4540-8f91-0737136011ad req-b5c987e0-f1c7-4820-98c0-2804f6ad0d86 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:10.882251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d8db52f6-b2be-4540-8f91-0737136011ad req-b5c987e0-f1c7-4820-98c0-2804f6ad0d86 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:10.905189 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d8db52f6-b2be-4540-8f91-0737136011ad req-b5c987e0-f1c7-4820-98c0-2804f6ad0d86 service nova] Creating event network-vif-plugged:24f2b39b-dbde-413b-b980-fcb19cd3db80 for instance a1345a19-e30a-4900-8b18-b603df397f5f on n-h2-826529-8 Aug 03 02:50:10.910970 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d8db52f6-b2be-4540-8f91-0737136011ad req-b5c987e0-f1c7-4820-98c0-2804f6ad0d86 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045582 Aug 03 02:50:10.912120 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3232/6584] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:50:11.576105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fa04845b-f454-4bdb-b263-1f8e8ade5e9f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:11.576740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fa04845b-f454-4bdb-b263-1f8e8ade5e9f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:11.582836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa04845b-f454-4bdb-b263-1f8e8ade5e9f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:11.583335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa04845b-f454-4bdb-b263-1f8e8ade5e9f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:11.584187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa04845b-f454-4bdb-b263-1f8e8ade5e9f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:11.584644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa04845b-f454-4bdb-b263-1f8e8ade5e9f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:11.714166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fa04845b-f454-4bdb-b263-1f8e8ade5e9f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:11.721922 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fa04845b-f454-4bdb-b263-1f8e8ade5e9f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 200 len: 1507 microversion: 2.1 time: 0.151384 Aug 03 02:50:11.722432 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3353/6585] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:11 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:11.743454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7277e99f-85a4-4d3c-ad4d-d80fb89e0413 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:11.744039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7277e99f-85a4-4d3c-ad4d-d80fb89e0413 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:11.750525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7277e99f-85a4-4d3c-ad4d-d80fb89e0413 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:11.751002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7277e99f-85a4-4d3c-ad4d-d80fb89e0413 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:11.751782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7277e99f-85a4-4d3c-ad4d-d80fb89e0413 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:11.752223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7277e99f-85a4-4d3c-ad4d-d80fb89e0413 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:11.777673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7277e99f-85a4-4d3c-ad4d-d80fb89e0413 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:50:11.853880 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7277e99f-85a4-4d3c-ad4d-d80fb89e0413 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 204 len: 0 microversion: 2.1 time: 0.115021 Aug 03 02:50:11.854894 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3233/6586] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:50:11 2022] DELETE /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:50:11.912841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-351075588", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "f5b3a314-fb33-4f5d-8781-2d75e0c8a82b"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:50:11.969739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] validate_networks() for [('f5b3a314-fb33-4f5d-8781-2d75e0c8a82b', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:50:12.344422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:50:12.344897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:50:12.345389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:50:12.345814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:50:12.346241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:50:12.355299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:12.355765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:12.356584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:12.357036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:12.374266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Getting quotas for project f689938f413f471b8b8de94c32e40854. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:50:12.380056 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Getting quotas for user fc327dafaf8e419b8d150fa7cbf1acea and project f689938f413f471b8b8de94c32e40854. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:50:12.392715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:50:12.395790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:50:12.442563 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-38cbc689-d143-422a-8af2-880c61a40686 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533664 Aug 03 02:50:12.443311 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3354/6587] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:50:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:50:12.455260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6314886b-ccbf-49f3-8302-46021cce983f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:12.455983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6314886b-ccbf-49f3-8302-46021cce983f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:12.519196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6314886b-ccbf-49f3-8302-46021cce983f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:12.531572 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6314886b-ccbf-49f3-8302-46021cce983f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1217 microversion: 2.1 time: 0.080431 Aug 03 02:50:12.532155 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3234/6588] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:12 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:13.553232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0a2f5078-438c-4dde-890c-e64d878a13f9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:13.553879 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0a2f5078-438c-4dde-890c-e64d878a13f9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:13.561026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a2f5078-438c-4dde-890c-e64d878a13f9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:13.561504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a2f5078-438c-4dde-890c-e64d878a13f9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:13.562303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a2f5078-438c-4dde-890c-e64d878a13f9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:13.562765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0a2f5078-438c-4dde-890c-e64d878a13f9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:13.628271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0a2f5078-438c-4dde-890c-e64d878a13f9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:13.636236 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0a2f5078-438c-4dde-890c-e64d878a13f9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1269 microversion: 2.1 time: 0.087911 Aug 03 02:50:13.636817 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3355/6589] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:13 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1269 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:14.170675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-154e6ab1-b0d5-4c30-b83d-4327e98eecf9 req-7da8f664-38dd-47d2-ba74-f889cd557450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1345a19-e30a-4900-8b18-b603df397f5f", "name": "network-vif-deleted", "tag": "24f2b39b-dbde-413b-b980-fcb19cd3db80"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:50:14.184276 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-154e6ab1-b0d5-4c30-b83d-4327e98eecf9 req-7da8f664-38dd-47d2-ba74-f889cd557450 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:14.184726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-154e6ab1-b0d5-4c30-b83d-4327e98eecf9 req-7da8f664-38dd-47d2-ba74-f889cd557450 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:14.198873 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-154e6ab1-b0d5-4c30-b83d-4327e98eecf9 req-7da8f664-38dd-47d2-ba74-f889cd557450 service nova] Creating event network-vif-deleted:24f2b39b-dbde-413b-b980-fcb19cd3db80 for instance a1345a19-e30a-4900-8b18-b603df397f5f on n-h2-826529-8 Aug 03 02:50:14.204224 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-154e6ab1-b0d5-4c30-b83d-4327e98eecf9 req-7da8f664-38dd-47d2-ba74-f889cd557450 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037989 Aug 03 02:50:14.205206 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3235/6590] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:50:14.657864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-63730b7c-0d20-40bb-b68a-304169d081f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:14.658498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-63730b7c-0d20-40bb-b68a-304169d081f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:14.666100 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63730b7c-0d20-40bb-b68a-304169d081f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:14.666572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63730b7c-0d20-40bb-b68a-304169d081f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:14.672864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63730b7c-0d20-40bb-b68a-304169d081f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:14.673348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63730b7c-0d20-40bb-b68a-304169d081f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:14.897518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-63730b7c-0d20-40bb-b68a-304169d081f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:14.905274 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-63730b7c-0d20-40bb-b68a-304169d081f5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1317 microversion: 2.1 time: 0.251405 Aug 03 02:50:14.905865 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3356/6591] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:14 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:15.140000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-a509e95d-3ed6-43bc-ae45-423df73d0f18 req-585c09d6-3fdc-4cb1-a706-710d76be25b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "007e19f7-fe68-46c4-a2eb-9f9bd698dafb", "tag": "d8d55dfe-c8cb-4b3c-87ae-95094cdc15d8"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:50:15.152292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a509e95d-3ed6-43bc-ae45-423df73d0f18 req-585c09d6-3fdc-4cb1-a706-710d76be25b1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:15.152652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a509e95d-3ed6-43bc-ae45-423df73d0f18 req-585c09d6-3fdc-4cb1-a706-710d76be25b1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:15.166096 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-a509e95d-3ed6-43bc-ae45-423df73d0f18 req-585c09d6-3fdc-4cb1-a706-710d76be25b1 service nova] Creating event network-changed:d8d55dfe-c8cb-4b3c-87ae-95094cdc15d8 for instance 007e19f7-fe68-46c4-a2eb-9f9bd698dafb on n-h2-826529-8 Aug 03 02:50:15.171519 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-a509e95d-3ed6-43bc-ae45-423df73d0f18 req-585c09d6-3fdc-4cb1-a706-710d76be25b1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035965 Aug 03 02:50:15.172174 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3236/6592] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:50:15.925719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5f8dc1ba-9622-4eb0-a4a4-1f893ad5b50f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:15.926345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5f8dc1ba-9622-4eb0-a4a4-1f893ad5b50f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:15.933563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f8dc1ba-9622-4eb0-a4a4-1f893ad5b50f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:15.934031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f8dc1ba-9622-4eb0-a4a4-1f893ad5b50f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:15.934822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f8dc1ba-9622-4eb0-a4a4-1f893ad5b50f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:15.935299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5f8dc1ba-9622-4eb0-a4a4-1f893ad5b50f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:16.067164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5f8dc1ba-9622-4eb0-a4a4-1f893ad5b50f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:16.075868 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5f8dc1ba-9622-4eb0-a4a4-1f893ad5b50f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1317 microversion: 2.1 time: 0.154095 Aug 03 02:50:16.076447 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3357/6593] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:15 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:17.098272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6c3486a8-9f53-484e-a208-3543dc4e05a9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:17.099629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6c3486a8-9f53-484e-a208-3543dc4e05a9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:17.106824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c3486a8-9f53-484e-a208-3543dc4e05a9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:17.107318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c3486a8-9f53-484e-a208-3543dc4e05a9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:17.108113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c3486a8-9f53-484e-a208-3543dc4e05a9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:17.108566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c3486a8-9f53-484e-a208-3543dc4e05a9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:17.244910 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6c3486a8-9f53-484e-a208-3543dc4e05a9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:17.252527 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6c3486a8-9f53-484e-a208-3543dc4e05a9 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1317 microversion: 2.1 time: 0.158509 Aug 03 02:50:17.253501 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3237/6594] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:17 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:18.274171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f221b8ed-b313-4f80-8b20-6c8f4177fc25 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:18.274803 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f221b8ed-b313-4f80-8b20-6c8f4177fc25 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:18.282245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f221b8ed-b313-4f80-8b20-6c8f4177fc25 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:18.282716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f221b8ed-b313-4f80-8b20-6c8f4177fc25 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:18.283542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f221b8ed-b313-4f80-8b20-6c8f4177fc25 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:18.284008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f221b8ed-b313-4f80-8b20-6c8f4177fc25 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:18.416857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f221b8ed-b313-4f80-8b20-6c8f4177fc25 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:18.424334 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f221b8ed-b313-4f80-8b20-6c8f4177fc25 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1317 microversion: 2.1 time: 0.154543 Aug 03 02:50:18.424940 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3358/6595] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:18 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:19.446997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7460fa11-2c85-414c-915f-1a17e69e3193 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:19.447582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7460fa11-2c85-414c-915f-1a17e69e3193 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:19.453913 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7460fa11-2c85-414c-915f-1a17e69e3193 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:19.454370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7460fa11-2c85-414c-915f-1a17e69e3193 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:19.455181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7460fa11-2c85-414c-915f-1a17e69e3193 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:19.455629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7460fa11-2c85-414c-915f-1a17e69e3193 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:19.588423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7460fa11-2c85-414c-915f-1a17e69e3193 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:19.596030 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7460fa11-2c85-414c-915f-1a17e69e3193 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1317 microversion: 2.1 time: 0.154187 Aug 03 02:50:19.596607 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3238/6596] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:19 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:20.616848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3f8fd680-b746-47c4-b100-0021365274df tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:20.617474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3f8fd680-b746-47c4-b100-0021365274df tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:20.624764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f8fd680-b746-47c4-b100-0021365274df tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:20.625258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f8fd680-b746-47c4-b100-0021365274df tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:20.626038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f8fd680-b746-47c4-b100-0021365274df tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:20.626500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f8fd680-b746-47c4-b100-0021365274df tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:20.910728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-2055e708-e81f-45a7-ba2c-4e00cf624230 req-1d90afe5-dc5c-4304-832c-23d112ae8a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "007e19f7-fe68-46c4-a2eb-9f9bd698dafb", "name": "network-vif-plugged", "status": "completed", "tag": "d8d55dfe-c8cb-4b3c-87ae-95094cdc15d8"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:50:20.923313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2055e708-e81f-45a7-ba2c-4e00cf624230 req-1d90afe5-dc5c-4304-832c-23d112ae8a18 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:20.923849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-2055e708-e81f-45a7-ba2c-4e00cf624230 req-1d90afe5-dc5c-4304-832c-23d112ae8a18 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:20.937019 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-2055e708-e81f-45a7-ba2c-4e00cf624230 req-1d90afe5-dc5c-4304-832c-23d112ae8a18 service nova] Creating event network-vif-plugged:d8d55dfe-c8cb-4b3c-87ae-95094cdc15d8 for instance 007e19f7-fe68-46c4-a2eb-9f9bd698dafb on n-h2-826529-8 Aug 03 02:50:20.942446 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-2055e708-e81f-45a7-ba2c-4e00cf624230 req-1d90afe5-dc5c-4304-832c-23d112ae8a18 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035313 Aug 03 02:50:20.943185 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3239/6597] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:50:21.192847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3f8fd680-b746-47c4-b100-0021365274df tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:21.200721 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3f8fd680-b746-47c4-b100-0021365274df tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1317 microversion: 2.1 time: 0.587899 Aug 03 02:50:21.201296 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3359/6598] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:20 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1317 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:22.223203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b30a520d-98ec-4a33-a70d-b88de58f90f0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:22.223912 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b30a520d-98ec-4a33-a70d-b88de58f90f0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:22.230520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b30a520d-98ec-4a33-a70d-b88de58f90f0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:22.231006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b30a520d-98ec-4a33-a70d-b88de58f90f0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:22.231800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b30a520d-98ec-4a33-a70d-b88de58f90f0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:22.232250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b30a520d-98ec-4a33-a70d-b88de58f90f0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:22.364353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b30a520d-98ec-4a33-a70d-b88de58f90f0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:22.372325 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b30a520d-98ec-4a33-a70d-b88de58f90f0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1317 microversion: 2.1 time: 0.154282 Aug 03 02:50:22.372904 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3240/6599] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:22 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:23.393997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0df0866d-cc58-4b0f-a5af-ad5ece338564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:23.394627 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0df0866d-cc58-4b0f-a5af-ad5ece338564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:23.397119 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:50:23.397801 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=10 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:50:23.404483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0df0866d-cc58-4b0f-a5af-ad5ece338564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:23.404953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0df0866d-cc58-4b0f-a5af-ad5ece338564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:23.405742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0df0866d-cc58-4b0f-a5af-ad5ece338564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:23.406195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0df0866d-cc58-4b0f-a5af-ad5ece338564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:23.538314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0df0866d-cc58-4b0f-a5af-ad5ece338564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:23.546227 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0df0866d-cc58-4b0f-a5af-ad5ece338564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1507 microversion: 2.1 time: 0.156441 Aug 03 02:50:23.546821 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3360/6600] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:23 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:23.567091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7dd6a6ce-666b-43e9-bfc5-16db4ff8c796 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:23.567645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7dd6a6ce-666b-43e9-bfc5-16db4ff8c796 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:23.570398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:50:23.576836 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7dd6a6ce-666b-43e9-bfc5-16db4ff8c796 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:23.577295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7dd6a6ce-666b-43e9-bfc5-16db4ff8c796 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:23.578083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7dd6a6ce-666b-43e9-bfc5-16db4ff8c796 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:23.578533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7dd6a6ce-666b-43e9-bfc5-16db4ff8c796 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:23.714372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7dd6a6ce-666b-43e9-bfc5-16db4ff8c796 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:23.722071 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7dd6a6ce-666b-43e9-bfc5-16db4ff8c796 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1507 microversion: 2.1 time: 0.159043 Aug 03 02:50:23.722663 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3241/6601] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:23 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:23.742184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-353fd9a8-99ad-433f-a227-472f4d42569d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:50:23.744688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-353fd9a8-99ad-433f-a227-472f4d42569d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:23.751398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-353fd9a8-99ad-433f-a227-472f4d42569d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:23.751876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-353fd9a8-99ad-433f-a227-472f4d42569d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:23.752673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-353fd9a8-99ad-433f-a227-472f4d42569d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:23.753132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-353fd9a8-99ad-433f-a227-472f4d42569d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:23.770116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:50:23.786727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-353fd9a8-99ad-433f-a227-472f4d42569d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:23.793173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-353fd9a8-99ad-433f-a227-472f4d42569d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Old instance type m1.heat2, new instance type m1.heat {{(pid=125941) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 02:50:23.799711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-353fd9a8-99ad-433f-a227-472f4d42569d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:50:23.800155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-353fd9a8-99ad-433f-a227-472f4d42569d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:50:23.800649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-353fd9a8-99ad-433f-a227-472f4d42569d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:50:23.801080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-353fd9a8-99ad-433f-a227-472f4d42569d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:50:23.801510 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-353fd9a8-99ad-433f-a227-472f4d42569d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:50:23.865960 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-353fd9a8-99ad-433f-a227-472f4d42569d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "POST /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb/action" status: 202 len: 0 microversion: 2.1 time: 0.127301 Aug 03 02:50:23.866672 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3361/6602] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:50:23 2022] POST /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:50:23.874650 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b6d1e954-8359-4cc6-a836-7f8c413f53c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:23.875307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b6d1e954-8359-4cc6-a836-7f8c413f53c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:23.881460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6d1e954-8359-4cc6-a836-7f8c413f53c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:23.881931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6d1e954-8359-4cc6-a836-7f8c413f53c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:23.882726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6d1e954-8359-4cc6-a836-7f8c413f53c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:23.883221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6d1e954-8359-4cc6-a836-7f8c413f53c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:24.019403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b6d1e954-8359-4cc6-a836-7f8c413f53c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:24.028152 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b6d1e954-8359-4cc6-a836-7f8c413f53c6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1514 microversion: 2.1 time: 0.157349 Aug 03 02:50:24.028760 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3242/6603] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:23 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:25.050995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cf08bdd2-0bdc-4847-955d-5706cb28b5b5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:25.051851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cf08bdd2-0bdc-4847-955d-5706cb28b5b5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:25.060901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf08bdd2-0bdc-4847-955d-5706cb28b5b5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:25.061373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf08bdd2-0bdc-4847-955d-5706cb28b5b5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:25.062171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf08bdd2-0bdc-4847-955d-5706cb28b5b5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:25.062629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf08bdd2-0bdc-4847-955d-5706cb28b5b5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:25.208037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cf08bdd2-0bdc-4847-955d-5706cb28b5b5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:25.215932 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cf08bdd2-0bdc-4847-955d-5706cb28b5b5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1514 microversion: 2.1 time: 0.170034 Aug 03 02:50:25.216507 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3362/6604] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:25 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:26.237579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-24f8a46b-c876-4fe4-8140-d05853d3f3c2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:26.238230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-24f8a46b-c876-4fe4-8140-d05853d3f3c2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:26.245858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-24f8a46b-c876-4fe4-8140-d05853d3f3c2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:26.246323 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-24f8a46b-c876-4fe4-8140-d05853d3f3c2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:26.247145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-24f8a46b-c876-4fe4-8140-d05853d3f3c2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:26.247609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-24f8a46b-c876-4fe4-8140-d05853d3f3c2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:26.386427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-24f8a46b-c876-4fe4-8140-d05853d3f3c2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:26.394187 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-24f8a46b-c876-4fe4-8140-d05853d3f3c2 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.160576 Aug 03 02:50:26.394766 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3243/6605] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:26 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:27.415871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-476d3f2d-8027-4aa3-a057-e41649a3c315 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:27.416509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-476d3f2d-8027-4aa3-a057-e41649a3c315 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:27.423506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-476d3f2d-8027-4aa3-a057-e41649a3c315 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:27.423977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-476d3f2d-8027-4aa3-a057-e41649a3c315 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:27.424765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-476d3f2d-8027-4aa3-a057-e41649a3c315 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:27.425222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-476d3f2d-8027-4aa3-a057-e41649a3c315 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:27.557175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-476d3f2d-8027-4aa3-a057-e41649a3c315 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:27.564785 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-476d3f2d-8027-4aa3-a057-e41649a3c315 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.153592 Aug 03 02:50:27.565356 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3363/6606] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:27 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:28.586623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-743ede23-6a7c-4d10-925f-52fa3c7a0da1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:28.587274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-743ede23-6a7c-4d10-925f-52fa3c7a0da1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:28.594605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-743ede23-6a7c-4d10-925f-52fa3c7a0da1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:28.595137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-743ede23-6a7c-4d10-925f-52fa3c7a0da1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:28.595926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-743ede23-6a7c-4d10-925f-52fa3c7a0da1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:28.596377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-743ede23-6a7c-4d10-925f-52fa3c7a0da1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:28.732184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-743ede23-6a7c-4d10-925f-52fa3c7a0da1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:28.739906 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-743ede23-6a7c-4d10-925f-52fa3c7a0da1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.157778 Aug 03 02:50:28.740715 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3244/6607] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:28 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:29.761912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c0375958-7a56-4a9b-86d7-259913c8aea4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:29.762465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c0375958-7a56-4a9b-86d7-259913c8aea4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:29.769478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0375958-7a56-4a9b-86d7-259913c8aea4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:29.769943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0375958-7a56-4a9b-86d7-259913c8aea4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:29.770724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0375958-7a56-4a9b-86d7-259913c8aea4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:29.771204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0375958-7a56-4a9b-86d7-259913c8aea4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:29.902212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c0375958-7a56-4a9b-86d7-259913c8aea4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:29.909857 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c0375958-7a56-4a9b-86d7-259913c8aea4 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.152438 Aug 03 02:50:29.910428 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3364/6608] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:29 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:30.931955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0ef9edd8-497a-4537-ad79-f99bd0d75564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:30.932587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0ef9edd8-497a-4537-ad79-f99bd0d75564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:30.939853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ef9edd8-497a-4537-ad79-f99bd0d75564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:30.940321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ef9edd8-497a-4537-ad79-f99bd0d75564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:30.941115 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ef9edd8-497a-4537-ad79-f99bd0d75564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:30.941567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ef9edd8-497a-4537-ad79-f99bd0d75564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:31.076551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0ef9edd8-497a-4537-ad79-f99bd0d75564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:31.084248 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0ef9edd8-497a-4537-ad79-f99bd0d75564 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.156800 Aug 03 02:50:31.084830 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3245/6609] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:30 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:32.105330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7acc0743-accb-48ee-831a-41b03d72a025 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:32.105946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7acc0743-accb-48ee-831a-41b03d72a025 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:32.112913 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7acc0743-accb-48ee-831a-41b03d72a025 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:32.113379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7acc0743-accb-48ee-831a-41b03d72a025 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:32.114166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7acc0743-accb-48ee-831a-41b03d72a025 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:32.114648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7acc0743-accb-48ee-831a-41b03d72a025 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:32.248704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7acc0743-accb-48ee-831a-41b03d72a025 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:32.257141 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7acc0743-accb-48ee-831a-41b03d72a025 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.155578 Aug 03 02:50:32.257722 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3365/6610] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:32 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:33.279518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b43d5709-5889-47e3-ace7-6433c74d2491 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:33.280143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b43d5709-5889-47e3-ace7-6433c74d2491 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:33.288419 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b43d5709-5889-47e3-ace7-6433c74d2491 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:33.288879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b43d5709-5889-47e3-ace7-6433c74d2491 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:33.289675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b43d5709-5889-47e3-ace7-6433c74d2491 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:33.290239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b43d5709-5889-47e3-ace7-6433c74d2491 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:33.423376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b43d5709-5889-47e3-ace7-6433c74d2491 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:33.432242 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b43d5709-5889-47e3-ace7-6433c74d2491 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.157127 Aug 03 02:50:33.432825 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3246/6611] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:33 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:34.454101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ef972eac-387d-4d3f-bc77-071c334496db tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:34.454721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ef972eac-387d-4d3f-bc77-071c334496db tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:34.461849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef972eac-387d-4d3f-bc77-071c334496db tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:34.462314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef972eac-387d-4d3f-bc77-071c334496db tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:34.463129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef972eac-387d-4d3f-bc77-071c334496db tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:34.463581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ef972eac-387d-4d3f-bc77-071c334496db tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:34.682740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ef972eac-387d-4d3f-bc77-071c334496db tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:34.690370 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ef972eac-387d-4d3f-bc77-071c334496db tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.240460 Aug 03 02:50:34.690967 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3366/6612] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:34 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:35.713170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-26599104-8e81-441d-9546-4081ce682edf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:35.713798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-26599104-8e81-441d-9546-4081ce682edf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:35.721005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26599104-8e81-441d-9546-4081ce682edf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:35.721495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26599104-8e81-441d-9546-4081ce682edf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:35.722288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26599104-8e81-441d-9546-4081ce682edf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:35.722736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26599104-8e81-441d-9546-4081ce682edf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:35.855574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-26599104-8e81-441d-9546-4081ce682edf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:35.857420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:50:35.864168 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-26599104-8e81-441d-9546-4081ce682edf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.155688 Aug 03 02:50:35.864774 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3247/6613] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:35 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:50:36.885900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dece26cb-6926-47c3-aa5d-1ddea2428f61 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:36.886532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dece26cb-6926-47c3-aa5d-1ddea2428f61 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:36.893802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dece26cb-6926-47c3-aa5d-1ddea2428f61 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:36.894271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dece26cb-6926-47c3-aa5d-1ddea2428f61 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:36.895094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dece26cb-6926-47c3-aa5d-1ddea2428f61 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:36.895545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dece26cb-6926-47c3-aa5d-1ddea2428f61 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:37.048054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dece26cb-6926-47c3-aa5d-1ddea2428f61 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:37.055784 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dece26cb-6926-47c3-aa5d-1ddea2428f61 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.174204 Aug 03 02:50:37.056365 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3367/6614] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:36 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:50:38.078032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-77a81b00-87d7-4041-b63c-40bc10af5830 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:38.078698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-77a81b00-87d7-4041-b63c-40bc10af5830 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:38.082307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:50:38.090609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77a81b00-87d7-4041-b63c-40bc10af5830 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:38.091110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77a81b00-87d7-4041-b63c-40bc10af5830 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:38.091906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77a81b00-87d7-4041-b63c-40bc10af5830 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:38.092356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77a81b00-87d7-4041-b63c-40bc10af5830 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:38.228512 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-77a81b00-87d7-4041-b63c-40bc10af5830 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:38.236322 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-77a81b00-87d7-4041-b63c-40bc10af5830 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.162228 Aug 03 02:50:38.236906 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3248/6615] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:38 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:39.258671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-80fa1710-2a03-4a56-9d4b-d3cdeececd7d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:39.259326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-80fa1710-2a03-4a56-9d4b-d3cdeececd7d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:39.262266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:50:39.268090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80fa1710-2a03-4a56-9d4b-d3cdeececd7d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:39.268571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80fa1710-2a03-4a56-9d4b-d3cdeececd7d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:39.269368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80fa1710-2a03-4a56-9d4b-d3cdeececd7d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:39.269826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-80fa1710-2a03-4a56-9d4b-d3cdeececd7d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:39.403328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-80fa1710-2a03-4a56-9d4b-d3cdeececd7d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:39.410943 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-80fa1710-2a03-4a56-9d4b-d3cdeececd7d tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.157177 Aug 03 02:50:39.411526 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3368/6616] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:39 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:40.432418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-79d84fcc-1b33-479d-86e5-d2ead67c20c8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:40.433046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-79d84fcc-1b33-479d-86e5-d2ead67c20c8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:40.440156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79d84fcc-1b33-479d-86e5-d2ead67c20c8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:40.440615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79d84fcc-1b33-479d-86e5-d2ead67c20c8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:40.441402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79d84fcc-1b33-479d-86e5-d2ead67c20c8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:40.441845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79d84fcc-1b33-479d-86e5-d2ead67c20c8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:40.580859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-79d84fcc-1b33-479d-86e5-d2ead67c20c8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:40.589152 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-79d84fcc-1b33-479d-86e5-d2ead67c20c8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.160706 Aug 03 02:50:40.589733 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3249/6617] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:40 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:50:41.610666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4dec67d6-08c2-41e5-a03f-a522dc7e9f04 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:41.611324 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4dec67d6-08c2-41e5-a03f-a522dc7e9f04 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:41.619094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4dec67d6-08c2-41e5-a03f-a522dc7e9f04 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:41.619567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4dec67d6-08c2-41e5-a03f-a522dc7e9f04 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:41.621081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4dec67d6-08c2-41e5-a03f-a522dc7e9f04 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:41.621081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4dec67d6-08c2-41e5-a03f-a522dc7e9f04 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:41.752372 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4dec67d6-08c2-41e5-a03f-a522dc7e9f04 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:41.760966 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4dec67d6-08c2-41e5-a03f-a522dc7e9f04 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.153966 Aug 03 02:50:41.761541 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3369/6618] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:41 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:42.782299 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-29ee38c7-2815-4aad-8b3b-ca80dc6c6f0a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:42.782936 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-29ee38c7-2815-4aad-8b3b-ca80dc6c6f0a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:42.790732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29ee38c7-2815-4aad-8b3b-ca80dc6c6f0a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:42.791216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29ee38c7-2815-4aad-8b3b-ca80dc6c6f0a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:42.792001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29ee38c7-2815-4aad-8b3b-ca80dc6c6f0a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:42.792440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-29ee38c7-2815-4aad-8b3b-ca80dc6c6f0a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:42.926965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-29ee38c7-2815-4aad-8b3b-ca80dc6c6f0a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:42.934719 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-29ee38c7-2815-4aad-8b3b-ca80dc6c6f0a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.156418 Aug 03 02:50:42.935270 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3250/6619] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:42 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:43.956537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-065f2701-7209-4f1f-a30c-591e8035fbf6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:43.957177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-065f2701-7209-4f1f-a30c-591e8035fbf6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:43.964409 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-065f2701-7209-4f1f-a30c-591e8035fbf6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:43.964881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-065f2701-7209-4f1f-a30c-591e8035fbf6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:43.965672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-065f2701-7209-4f1f-a30c-591e8035fbf6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:43.966131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-065f2701-7209-4f1f-a30c-591e8035fbf6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:44.100180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-065f2701-7209-4f1f-a30c-591e8035fbf6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:44.108069 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-065f2701-7209-4f1f-a30c-591e8035fbf6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.155524 Aug 03 02:50:44.108655 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3370/6620] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:43 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:45.130171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1e990318-e361-4234-a06b-ce223fa5f50a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:45.130894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1e990318-e361-4234-a06b-ce223fa5f50a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:45.138035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e990318-e361-4234-a06b-ce223fa5f50a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:45.138494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e990318-e361-4234-a06b-ce223fa5f50a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:45.139379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e990318-e361-4234-a06b-ce223fa5f50a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:45.139828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e990318-e361-4234-a06b-ce223fa5f50a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:45.272169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1e990318-e361-4234-a06b-ce223fa5f50a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:45.280374 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1e990318-e361-4234-a06b-ce223fa5f50a tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.154318 Aug 03 02:50:45.280950 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3251/6621] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:45 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:46.302525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c9c0e8db-db3f-4573-9713-3aba453406d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:46.303285 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c9c0e8db-db3f-4573-9713-3aba453406d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:46.311129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9c0e8db-db3f-4573-9713-3aba453406d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:46.312263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9c0e8db-db3f-4573-9713-3aba453406d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:46.313067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9c0e8db-db3f-4573-9713-3aba453406d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:46.313523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9c0e8db-db3f-4573-9713-3aba453406d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:46.449753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c9c0e8db-db3f-4573-9713-3aba453406d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:46.457397 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c9c0e8db-db3f-4573-9713-3aba453406d6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.159331 Aug 03 02:50:46.458594 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3371/6622] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:46 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:47.479532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c15cf22c-04b6-4e57-b1ae-9649f62157e0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:47.480245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c15cf22c-04b6-4e57-b1ae-9649f62157e0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:47.487577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c15cf22c-04b6-4e57-b1ae-9649f62157e0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:47.488049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c15cf22c-04b6-4e57-b1ae-9649f62157e0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:47.488848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c15cf22c-04b6-4e57-b1ae-9649f62157e0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:47.489402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c15cf22c-04b6-4e57-b1ae-9649f62157e0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:47.622015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c15cf22c-04b6-4e57-b1ae-9649f62157e0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:47.630435 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c15cf22c-04b6-4e57-b1ae-9649f62157e0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.154276 Aug 03 02:50:47.631125 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3252/6623] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:47 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:48.652013 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-99627b88-3c94-4558-bd32-a1d620adbef8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:48.652645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-99627b88-3c94-4558-bd32-a1d620adbef8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:48.659661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99627b88-3c94-4558-bd32-a1d620adbef8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:48.660132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99627b88-3c94-4558-bd32-a1d620adbef8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:48.660922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99627b88-3c94-4558-bd32-a1d620adbef8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:48.661504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-99627b88-3c94-4558-bd32-a1d620adbef8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:48.799396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-99627b88-3c94-4558-bd32-a1d620adbef8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:48.807829 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-99627b88-3c94-4558-bd32-a1d620adbef8 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.159732 Aug 03 02:50:48.808415 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3372/6624] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:48 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:49.829279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6178ae11-c187-4dda-aa6e-04537c9c2cbf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:49.829909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6178ae11-c187-4dda-aa6e-04537c9c2cbf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:49.836769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6178ae11-c187-4dda-aa6e-04537c9c2cbf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:49.837218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6178ae11-c187-4dda-aa6e-04537c9c2cbf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:49.837998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6178ae11-c187-4dda-aa6e-04537c9c2cbf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:49.838437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6178ae11-c187-4dda-aa6e-04537c9c2cbf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:49.990444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6178ae11-c187-4dda-aa6e-04537c9c2cbf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:50.000095 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6178ae11-c187-4dda-aa6e-04537c9c2cbf tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.174548 Aug 03 02:50:50.001023 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3253/6625] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:49 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:51.022586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9bb4c83e-0ce5-4ace-a0bf-bddfea903fb5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:51.023164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9bb4c83e-0ce5-4ace-a0bf-bddfea903fb5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:51.030336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bb4c83e-0ce5-4ace-a0bf-bddfea903fb5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:51.030805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bb4c83e-0ce5-4ace-a0bf-bddfea903fb5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:51.031643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bb4c83e-0ce5-4ace-a0bf-bddfea903fb5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:51.032102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9bb4c83e-0ce5-4ace-a0bf-bddfea903fb5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:51.179253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9bb4c83e-0ce5-4ace-a0bf-bddfea903fb5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:51.187308 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9bb4c83e-0ce5-4ace-a0bf-bddfea903fb5 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.169428 Aug 03 02:50:51.187894 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3373/6626] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:51 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:52.210173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5a9a3fbd-fe31-4381-8df7-ef82c35df7aa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:52.210809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5a9a3fbd-fe31-4381-8df7-ef82c35df7aa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:52.217823 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a9a3fbd-fe31-4381-8df7-ef82c35df7aa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:52.218288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a9a3fbd-fe31-4381-8df7-ef82c35df7aa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:52.219113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a9a3fbd-fe31-4381-8df7-ef82c35df7aa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:52.219567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a9a3fbd-fe31-4381-8df7-ef82c35df7aa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:52.359159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5a9a3fbd-fe31-4381-8df7-ef82c35df7aa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:52.367129 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5a9a3fbd-fe31-4381-8df7-ef82c35df7aa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1519 microversion: 2.1 time: 0.161555 Aug 03 02:50:52.367710 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3254/6627] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:52 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:53.390484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c3e0984b-9048-4bd3-8417-c569056415ef tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:53.391116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c3e0984b-9048-4bd3-8417-c569056415ef tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:53.397413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3e0984b-9048-4bd3-8417-c569056415ef tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:53.397885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3e0984b-9048-4bd3-8417-c569056415ef tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:53.398695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3e0984b-9048-4bd3-8417-c569056415ef tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:53.399190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3e0984b-9048-4bd3-8417-c569056415ef tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:53.503496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d944bead-36e1-4a88-98bb-8ab51c4c3596 req-f85ac02a-8396-4290-bb29-acaf363b9181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "007e19f7-fe68-46c4-a2eb-9f9bd698dafb", "name": "network-vif-unplugged", "status": "completed", "tag": "d8d55dfe-c8cb-4b3c-87ae-95094cdc15d8"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:50:53.517582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d944bead-36e1-4a88-98bb-8ab51c4c3596 req-f85ac02a-8396-4290-bb29-acaf363b9181 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:53.518263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d944bead-36e1-4a88-98bb-8ab51c4c3596 req-f85ac02a-8396-4290-bb29-acaf363b9181 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:53.531001 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d944bead-36e1-4a88-98bb-8ab51c4c3596 req-f85ac02a-8396-4290-bb29-acaf363b9181 service nova] Creating event network-vif-unplugged:d8d55dfe-c8cb-4b3c-87ae-95094cdc15d8 for instance 007e19f7-fe68-46c4-a2eb-9f9bd698dafb on n-h1-826529-8 Aug 03 02:50:53.540886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c3e0984b-9048-4bd3-8417-c569056415ef tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:53.545030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-d944bead-36e1-4a88-98bb-8ab51c4c3596 req-f85ac02a-8396-4290-bb29-acaf363b9181 service nova] Instance 007e19f7-fe68-46c4-a2eb-9f9bd698dafb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:50:53.550690 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c3e0984b-9048-4bd3-8417-c569056415ef tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1518 microversion: 2.1 time: 0.163546 Aug 03 02:50:53.552833 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3374/6628] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:53 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:53.572667 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d944bead-36e1-4a88-98bb-8ab51c4c3596 req-f85ac02a-8396-4290-bb29-acaf363b9181 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073067 Aug 03 02:50:53.573298 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3255/6629] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:50:54.574443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cc098615-357b-4f24-8cb4-6ee775c47ddb tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:54.575069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cc098615-357b-4f24-8cb4-6ee775c47ddb tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:54.582107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc098615-357b-4f24-8cb4-6ee775c47ddb tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:54.582608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc098615-357b-4f24-8cb4-6ee775c47ddb tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:54.583414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc098615-357b-4f24-8cb4-6ee775c47ddb tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:54.583874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cc098615-357b-4f24-8cb4-6ee775c47ddb tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:54.586458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:50:54.718406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cc098615-357b-4f24-8cb4-6ee775c47ddb tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:54.726670 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cc098615-357b-4f24-8cb4-6ee775c47ddb tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1516 microversion: 2.1 time: 0.156188 Aug 03 02:50:54.727568 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3375/6630] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:54 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:55.600395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-da37d021-0249-4736-925e-0b033531eba8 req-96c7a29c-92ef-42e6-890a-dd36251db2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "007e19f7-fe68-46c4-a2eb-9f9bd698dafb", "tag": "d8d55dfe-c8cb-4b3c-87ae-95094cdc15d8"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:50:55.610127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-da37d021-0249-4736-925e-0b033531eba8 req-96c7a29c-92ef-42e6-890a-dd36251db2b7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:55.610587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-da37d021-0249-4736-925e-0b033531eba8 req-96c7a29c-92ef-42e6-890a-dd36251db2b7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:55.625461 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-da37d021-0249-4736-925e-0b033531eba8 req-96c7a29c-92ef-42e6-890a-dd36251db2b7 service nova] Creating event network-changed:d8d55dfe-c8cb-4b3c-87ae-95094cdc15d8 for instance 007e19f7-fe68-46c4-a2eb-9f9bd698dafb on n-h1-826529-8 Aug 03 02:50:55.631461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-da37d021-0249-4736-925e-0b033531eba8 req-96c7a29c-92ef-42e6-890a-dd36251db2b7 service nova] Instance 007e19f7-fe68-46c4-a2eb-9f9bd698dafb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:50:55.642594 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-da37d021-0249-4736-925e-0b033531eba8 req-96c7a29c-92ef-42e6-890a-dd36251db2b7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047222 Aug 03 02:50:55.643319 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3256/6631] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:50:55.749639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c09229f1-7260-4fdc-a286-0d605acbe46f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:55.750292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c09229f1-7260-4fdc-a286-0d605acbe46f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:55.758117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c09229f1-7260-4fdc-a286-0d605acbe46f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:55.758811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c09229f1-7260-4fdc-a286-0d605acbe46f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:55.759642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c09229f1-7260-4fdc-a286-0d605acbe46f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:55.760094 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c09229f1-7260-4fdc-a286-0d605acbe46f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:55.990289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c09229f1-7260-4fdc-a286-0d605acbe46f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:56.001425 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c09229f1-7260-4fdc-a286-0d605acbe46f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1516 microversion: 2.1 time: 0.255079 Aug 03 02:50:56.002412 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3376/6632] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:55 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1516 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:57.025873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b23bb85f-9985-45a3-ba6f-86d1a2e281fa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:57.027206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b23bb85f-9985-45a3-ba6f-86d1a2e281fa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:57.033062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b23bb85f-9985-45a3-ba6f-86d1a2e281fa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:57.033543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b23bb85f-9985-45a3-ba6f-86d1a2e281fa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:57.034320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b23bb85f-9985-45a3-ba6f-86d1a2e281fa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:57.034762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b23bb85f-9985-45a3-ba6f-86d1a2e281fa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:57.171969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b23bb85f-9985-45a3-ba6f-86d1a2e281fa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:57.179710 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b23bb85f-9985-45a3-ba6f-86d1a2e281fa tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1513 microversion: 2.1 time: 0.160031 Aug 03 02:50:57.180300 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3257/6633] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:57 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:57.213466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e57197b9-48bd-431b-898f-eeac3b95adc0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:50:57.214076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e57197b9-48bd-431b-898f-eeac3b95adc0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:57.221032 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e57197b9-48bd-431b-898f-eeac3b95adc0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:57.221503 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e57197b9-48bd-431b-898f-eeac3b95adc0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:57.222303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e57197b9-48bd-431b-898f-eeac3b95adc0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:57.222768 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e57197b9-48bd-431b-898f-eeac3b95adc0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:57.284845 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e57197b9-48bd-431b-898f-eeac3b95adc0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "POST /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb/action" status: 204 len: 0 microversion: 2.1 time: 0.075536 Aug 03 02:50:57.286543 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3377/6634] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:50:57 2022] POST /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:50:57.296075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-40126e08-fa23-4729-928d-06f83ee0633c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:57.296730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-40126e08-fa23-4729-928d-06f83ee0633c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:57.304126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40126e08-fa23-4729-928d-06f83ee0633c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:57.304590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40126e08-fa23-4729-928d-06f83ee0633c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:57.305496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40126e08-fa23-4729-928d-06f83ee0633c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:57.306316 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40126e08-fa23-4729-928d-06f83ee0633c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:57.550931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-40126e08-fa23-4729-928d-06f83ee0633c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:57.563898 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-40126e08-fa23-4729-928d-06f83ee0633c tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1513 microversion: 2.1 time: 0.272186 Aug 03 02:50:57.564997 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3258/6635] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:57 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:58.586976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d2d3a97d-1873-4310-b771-593da4e2ab2f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:58.587710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d2d3a97d-1873-4310-b771-593da4e2ab2f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:58.594833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2d3a97d-1873-4310-b771-593da4e2ab2f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:58.595347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2d3a97d-1873-4310-b771-593da4e2ab2f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:58.596152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2d3a97d-1873-4310-b771-593da4e2ab2f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:58.596609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d2d3a97d-1873-4310-b771-593da4e2ab2f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:58.736995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d2d3a97d-1873-4310-b771-593da4e2ab2f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:58.744919 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d2d3a97d-1873-4310-b771-593da4e2ab2f tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1505 microversion: 2.1 time: 0.163050 Aug 03 02:50:58.749694 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3378/6636] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:58 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:58.765940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-15b35e22-c8ae-4417-8dab-d8bdb65aa2b1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:58.766554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-15b35e22-c8ae-4417-8dab-d8bdb65aa2b1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:58.774284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-15b35e22-c8ae-4417-8dab-d8bdb65aa2b1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:58.774750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-15b35e22-c8ae-4417-8dab-d8bdb65aa2b1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:58.775614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-15b35e22-c8ae-4417-8dab-d8bdb65aa2b1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:58.776069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-15b35e22-c8ae-4417-8dab-d8bdb65aa2b1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:58.912731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-15b35e22-c8ae-4417-8dab-d8bdb65aa2b1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:58.920660 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-15b35e22-c8ae-4417-8dab-d8bdb65aa2b1 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1505 microversion: 2.1 time: 0.158600 Aug 03 02:50:58.921231 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3259/6637] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:58 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:58.925043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-0f6f17b4-8a56-4c6b-8b24-36ca747d7927 req-e6453e11-bd8b-4648-b8e3-8f61f68c2867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "007e19f7-fe68-46c4-a2eb-9f9bd698dafb", "name": "network-vif-plugged", "status": "completed", "tag": "d8d55dfe-c8cb-4b3c-87ae-95094cdc15d8"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:50:58.936270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-0f6f17b4-8a56-4c6b-8b24-36ca747d7927 req-e6453e11-bd8b-4648-b8e3-8f61f68c2867 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:58.936921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-0f6f17b4-8a56-4c6b-8b24-36ca747d7927 req-e6453e11-bd8b-4648-b8e3-8f61f68c2867 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:58.943748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ff5c95d5-d8e1-4433-a10a-9214f8ff16cd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:58.944385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ff5c95d5-d8e1-4433-a10a-9214f8ff16cd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:58.950441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff5c95d5-d8e1-4433-a10a-9214f8ff16cd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:58.950922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff5c95d5-d8e1-4433-a10a-9214f8ff16cd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:58.951200 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-0f6f17b4-8a56-4c6b-8b24-36ca747d7927 req-e6453e11-bd8b-4648-b8e3-8f61f68c2867 service nova] Creating event network-vif-plugged:d8d55dfe-c8cb-4b3c-87ae-95094cdc15d8 for instance 007e19f7-fe68-46c4-a2eb-9f9bd698dafb on n-h1-826529-8 Aug 03 02:50:58.951750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff5c95d5-d8e1-4433-a10a-9214f8ff16cd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:58.952202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff5c95d5-d8e1-4433-a10a-9214f8ff16cd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:58.956774 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-0f6f17b4-8a56-4c6b-8b24-36ca747d7927 req-e6453e11-bd8b-4648-b8e3-8f61f68c2867 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035784 Aug 03 02:50:58.957449 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3379/6638] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:50:59.088552 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ff5c95d5-d8e1-4433-a10a-9214f8ff16cd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:59.096101 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ff5c95d5-d8e1-4433-a10a-9214f8ff16cd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1505 microversion: 2.1 time: 0.157425 Aug 03 02:50:59.096667 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3260/6639] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:58 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:50:59.117276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-68153283-c469-4a9c-bb75-c9577b8ebd69 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:59.117866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-68153283-c469-4a9c-bb75-c9577b8ebd69 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:59.124099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68153283-c469-4a9c-bb75-c9577b8ebd69 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:59.124563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68153283-c469-4a9c-bb75-c9577b8ebd69 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:59.125336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68153283-c469-4a9c-bb75-c9577b8ebd69 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:59.125789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68153283-c469-4a9c-bb75-c9577b8ebd69 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:59.153151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-68153283-c469-4a9c-bb75-c9577b8ebd69 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:50:59.234343 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-68153283-c469-4a9c-bb75-c9577b8ebd69 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "DELETE /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 204 len: 0 microversion: 2.1 time: 0.120950 Aug 03 02:50:59.234984 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3380/6640] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:50:59 2022] DELETE /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:50:59.251334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a0457179-6c5a-4ee2-ba2b-7de6b527a223 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:59.251842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0457179-6c5a-4ee2-ba2b-7de6b527a223 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:59.258972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0457179-6c5a-4ee2-ba2b-7de6b527a223 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:59.259432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0457179-6c5a-4ee2-ba2b-7de6b527a223 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:59.260205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0457179-6c5a-4ee2-ba2b-7de6b527a223 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:59.260911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a0457179-6c5a-4ee2-ba2b-7de6b527a223 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:59.287174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a0457179-6c5a-4ee2-ba2b-7de6b527a223 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:50:59.331562 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.compute.api [None req-a0457179-6c5a-4ee2-ba2b-7de6b527a223 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Instance is already in deleting state, ignoring this request Aug 03 02:50:59.332383 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a0457179-6c5a-4ee2-ba2b-7de6b527a223 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "DELETE /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 204 len: 0 microversion: 2.1 time: 0.085080 Aug 03 02:50:59.333633 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3261/6641] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:50:59 2022] DELETE /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:50:59.342502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d6ec639d-1ab0-486c-bc74-14f132740377 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:50:59.343185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d6ec639d-1ab0-486c-bc74-14f132740377 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:50:59.349435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6ec639d-1ab0-486c-bc74-14f132740377 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:59.349905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6ec639d-1ab0-486c-bc74-14f132740377 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:59.350701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6ec639d-1ab0-486c-bc74-14f132740377 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:50:59.351185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d6ec639d-1ab0-486c-bc74-14f132740377 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:50:59.486577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d6ec639d-1ab0-486c-bc74-14f132740377 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:50:59.494552 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d6ec639d-1ab0-486c-bc74-14f132740377 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1511 microversion: 2.1 time: 0.156409 Aug 03 02:50:59.495500 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3381/6642] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:50:59 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:51:00.516795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-887a3793-e229-4ad8-8456-2640d35a33fd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:00.517415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-887a3793-e229-4ad8-8456-2640d35a33fd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:00.525162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-887a3793-e229-4ad8-8456-2640d35a33fd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:00.525609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-887a3793-e229-4ad8-8456-2640d35a33fd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:00.526400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-887a3793-e229-4ad8-8456-2640d35a33fd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:00.526854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-887a3793-e229-4ad8-8456-2640d35a33fd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:00.656951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-887a3793-e229-4ad8-8456-2640d35a33fd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc327dafaf8e419b8d150fa7cbf1acea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f689938f413f471b8b8de94c32e40854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:51:00.665858 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-887a3793-e229-4ad8-8456-2640d35a33fd tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 200 len: 1511 microversion: 2.1 time: 0.153045 Aug 03 02:51:00.673550 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3262/6643] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:51:00 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:51:01.102592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a3b041cc-c859-4286-9112-16354e82d9b7 req-7fa0bb60-03b2-4c06-857d-87d27123e3db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "007e19f7-fe68-46c4-a2eb-9f9bd698dafb", "name": "network-vif-deleted", "tag": "d8d55dfe-c8cb-4b3c-87ae-95094cdc15d8"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:51:01.113554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a3b041cc-c859-4286-9112-16354e82d9b7 req-7fa0bb60-03b2-4c06-857d-87d27123e3db service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:01.114741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a3b041cc-c859-4286-9112-16354e82d9b7 req-7fa0bb60-03b2-4c06-857d-87d27123e3db service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:01.128539 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a3b041cc-c859-4286-9112-16354e82d9b7 req-7fa0bb60-03b2-4c06-857d-87d27123e3db service nova] Creating event network-vif-deleted:d8d55dfe-c8cb-4b3c-87ae-95094cdc15d8 for instance 007e19f7-fe68-46c4-a2eb-9f9bd698dafb on n-h1-826529-8 Aug 03 02:51:01.133911 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a3b041cc-c859-4286-9112-16354e82d9b7 req-7fa0bb60-03b2-4c06-857d-87d27123e3db service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035678 Aug 03 02:51:01.134524 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3382/6644] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:51:01.686451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b66c0029-e5d1-4094-90b3-577a37295902 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:01.687108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b66c0029-e5d1-4094-90b3-577a37295902 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: 007e19f7-fe68-46c4-a2eb-9f9bd698dafb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:01.694301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b66c0029-e5d1-4094-90b3-577a37295902 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:01.694758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b66c0029-e5d1-4094-90b3-577a37295902 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:01.695574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b66c0029-e5d1-4094-90b3-577a37295902 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:01.696019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b66c0029-e5d1-4094-90b3-577a37295902 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:01.709481 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-b66c0029-e5d1-4094-90b3-577a37295902 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] HTTP exception thrown: Instance 007e19f7-fe68-46c4-a2eb-9f9bd698dafb could not be found. Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b66c0029-e5d1-4094-90b3-577a37295902 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Request method failure captured: Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb HTTP/1.1 Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eIzH6FDyc3NJsL1KxjUG6BrXUfdV3dgJIuFSGr3DMj5xKIgytKLwqYZ3yMmY_JLQ5FApBaScjkhh2QrDkdox5oTy5sVQkI7RvAR5sh5RrNrGKEDwnFUR3OaSBCF8OZ8YG8RONaNexo6eE9srvfGmENsjQ4O5jlO8uYvZid9YUrFhHQ Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: f689938f413f471b8b8de94c32e40854 Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerDiskConfigTestJSON-934482424 Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f689938f413f471b8b8de94c32e40854", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f689938f413f471b8b8de94c32e40854"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f689938f413f471b8b8de94c32e40854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f689938f413f471b8b8de94c32e40854"}]}] Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerDiskConfigTestJSON-934482424 Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: f689938f413f471b8b8de94c32e40854 Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-934482424 Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerDiskConfigTestJSON-934482424-project Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: fc327dafaf8e419b8d150fa7cbf1acea Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerDiskConfigTestJSON-934482424-project Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 007e19f7-fe68-46c4-a2eb-9f9bd698dafb could not be found. Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '007e19f7-fe68-46c4-a2eb-9f9bd698dafb'} Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 007e19f7-fe68-46c4-a2eb-9f9bd698dafb could not be found. Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 007e19f7-fe68-46c4-a2eb-9f9bd698dafb could not be found. Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:51:01.711208 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:51:01.716857 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:51:01.716857 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:51:01.716857 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:51:01.716857 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:51:01.716857 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:51:01.716857 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 007e19f7-fe68-46c4-a2eb-9f9bd698dafb could not be found. Aug 03 02:51:01.716857 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:51:01.716857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b66c0029-e5d1-4094-90b3-577a37295902 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Returning 404 to user: Instance 007e19f7-fe68-46c4-a2eb-9f9bd698dafb could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:51:01.716857 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b66c0029-e5d1-4094-90b3-577a37295902 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb" status: 404 len: 111 microversion: 2.1 time: 0.030188 Aug 03 02:51:01.716857 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3263/6645] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:51:01 2022] GET /compute/v2.1/servers/007e19f7-fe68-46c4-a2eb-9f9bd698dafb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:51:01.722060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b212385f-b21b-4669-adb2-afcb86f2b6a6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '.version_select at 0x7f5b12525af0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:01.743267 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b212385f-b21b-4669-adb2-afcb86f2b6a6 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641057473" status: 202 len: 0 microversion: 2.1 time: 0.025503 Aug 03 02:51:01.743875 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3383/6646] 10.222.0.67 () {58 vars in 1221 bytes} [Wed Aug 3 02:51:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641057473 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:51:02.351124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9b23aac6-9b5e-4403-85af-3fbc45f2e3ce tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:02.351642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9b23aac6-9b5e-4403-85af-3fbc45f2e3ce tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:02.358028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b23aac6-9b5e-4403-85af-3fbc45f2e3ce tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:02.358432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b23aac6-9b5e-4403-85af-3fbc45f2e3ce tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:02.359280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b23aac6-9b5e-4403-85af-3fbc45f2e3ce tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:02.359727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b23aac6-9b5e-4403-85af-3fbc45f2e3ce tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:02.376979 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-9b23aac6-9b5e-4403-85af-3fbc45f2e3ce tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] HTTP exception thrown: Instance a1345a19-e30a-4900-8b18-b603df397f5f could not be found. Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9b23aac6-9b5e-4403-85af-3fbc45f2e3ce tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Request method failure captured: Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f HTTP/1.1 Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eIzH6FDyc3NJsL1KxjUG6BrXUfdV3dgJIuFSGr3DMj5xKIgytKLwqYZ3yMmY_JLQ5FApBaScjkhh2QrDkdox5oTy5sVQkI7RvAR5sh5RrNrGKEDwnFUR3OaSBCF8OZ8YG8RONaNexo6eE9srvfGmENsjQ4O5jlO8uYvZid9YUrFhHQ Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: f689938f413f471b8b8de94c32e40854 Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerDiskConfigTestJSON-934482424 Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f689938f413f471b8b8de94c32e40854", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f689938f413f471b8b8de94c32e40854"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f689938f413f471b8b8de94c32e40854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f689938f413f471b8b8de94c32e40854"}]}] Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerDiskConfigTestJSON-934482424 Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: f689938f413f471b8b8de94c32e40854 Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-934482424 Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerDiskConfigTestJSON-934482424-project Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: fc327dafaf8e419b8d150fa7cbf1acea Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerDiskConfigTestJSON-934482424-project Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance a1345a19-e30a-4900-8b18-b603df397f5f could not be found. Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'a1345a19-e30a-4900-8b18-b603df397f5f'} Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1345a19-e30a-4900-8b18-b603df397f5f could not be found. Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:51:02.378547 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:51:02.383739 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1345a19-e30a-4900-8b18-b603df397f5f could not be found. Aug 03 02:51:02.383739 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:51:02.383739 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:51:02.383739 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:51:02.383739 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:51:02.383739 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:51:02.383739 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:51:02.383739 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:51:02.383739 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:51:02.383739 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1345a19-e30a-4900-8b18-b603df397f5f could not be found. Aug 03 02:51:02.383739 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:51:02.383739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9b23aac6-9b5e-4403-85af-3fbc45f2e3ce tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Returning 404 to user: Instance a1345a19-e30a-4900-8b18-b603df397f5f could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:51:02.383739 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9b23aac6-9b5e-4403-85af-3fbc45f2e3ce tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 404 len: 111 microversion: 2.1 time: 0.033609 Aug 03 02:51:02.383739 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3264/6647] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:51:02 2022] DELETE /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:51:02.390353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6dc2d0cd-25c7-41da-9e46-0482294a8cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:02.391151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6dc2d0cd-25c7-41da-9e46-0482294a8cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] [instance: a1345a19-e30a-4900-8b18-b603df397f5f] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:02.398288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dc2d0cd-25c7-41da-9e46-0482294a8cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:02.398774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dc2d0cd-25c7-41da-9e46-0482294a8cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:02.399581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dc2d0cd-25c7-41da-9e46-0482294a8cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:02.400041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dc2d0cd-25c7-41da-9e46-0482294a8cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:02.413936 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-6dc2d0cd-25c7-41da-9e46-0482294a8cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] HTTP exception thrown: Instance a1345a19-e30a-4900-8b18-b603df397f5f could not be found. Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6dc2d0cd-25c7-41da-9e46-0482294a8cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Request method failure captured: Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f HTTP/1.1 Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eIzH6FDyc3NJsL1KxjUG6BrXUfdV3dgJIuFSGr3DMj5xKIgytKLwqYZ3yMmY_JLQ5FApBaScjkhh2QrDkdox5oTy5sVQkI7RvAR5sh5RrNrGKEDwnFUR3OaSBCF8OZ8YG8RONaNexo6eE9srvfGmENsjQ4O5jlO8uYvZid9YUrFhHQ Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: f689938f413f471b8b8de94c32e40854 Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerDiskConfigTestJSON-934482424 Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f689938f413f471b8b8de94c32e40854", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f689938f413f471b8b8de94c32e40854"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f689938f413f471b8b8de94c32e40854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f689938f413f471b8b8de94c32e40854"}]}] Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerDiskConfigTestJSON-934482424 Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: f689938f413f471b8b8de94c32e40854 Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-934482424 Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerDiskConfigTestJSON-934482424-project Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: fc327dafaf8e419b8d150fa7cbf1acea Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerDiskConfigTestJSON-934482424-project Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance a1345a19-e30a-4900-8b18-b603df397f5f could not be found. Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'a1345a19-e30a-4900-8b18-b603df397f5f'} Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1345a19-e30a-4900-8b18-b603df397f5f could not be found. Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1345a19-e30a-4900-8b18-b603df397f5f could not be found. Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:51:02.415628 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:51:02.420561 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:51:02.420561 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:51:02.420561 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:51:02.420561 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:51:02.420561 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:51:02.420561 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1345a19-e30a-4900-8b18-b603df397f5f could not be found. Aug 03 02:51:02.420561 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:51:02.420561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6dc2d0cd-25c7-41da-9e46-0482294a8cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] Returning 404 to user: Instance a1345a19-e30a-4900-8b18-b603df397f5f could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:51:02.420561 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6dc2d0cd-25c7-41da-9e46-0482294a8cb0 tempest-ServerDiskConfigTestJSON-934482424 tempest-ServerDiskConfigTestJSON-934482424-project] 10.222.0.67 "GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f" status: 404 len: 111 microversion: 2.1 time: 0.032254 Aug 03 02:51:02.420561 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3384/6648] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:51:02 2022] GET /compute/v2.1/servers/a1345a19-e30a-4900-8b18-b603df397f5f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:51:11.100638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8602933d-170d-4d4d-ad48-b556f9a8ec74 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Action: 'create', calling method: .version_select at 0x7f5b121e2b80>, body: {"keypair": {"name": "tempest-keypair-768996741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQOKTUh9BAEgoZM8sZSzFhEkeQRBgOaJjfL73ARmpNkZsC3Fm0z7zE0bmc62AIZhZW431XTfTxZ274Sk+cpmAhjY514b6+yM88Ed9wk65UaosO3pzmpBPlEU7wqsUzzfg=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:51:11.106493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=34 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:51:11.119460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-8602933d-170d-4d4d-ad48-b556f9a8ec74 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Getting quotas for project eec1de914edd4c8794c90561940c3402. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:51:11.125077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-8602933d-170d-4d4d-ad48-b556f9a8ec74 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Getting quotas for user 4a6c42ecf1044bf79778ec5b4da0c270 and project eec1de914edd4c8794c90561940c3402. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:51:11.158689 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8602933d-170d-4d4d-ad48-b556f9a8ec74 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.182980 Aug 03 02:51:11.159686 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3265/6649] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:51:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:51:12.451315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-497874858", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1026769a-4617-4108-a578-a580ac382a8b"}], "security_groups": [{"name": "tempest-securitygroup--1881219998"}], "key_name": "tempest-keypair-768996741", "user_data": "}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:51:12.461366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:51:12.462043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:51:12.572749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] validate_networks() for [('1026769a-4617-4108-a578-a580ac382a8b', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:51:12.978042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:51:12.978734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:51:12.979448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:51:12.979904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:51:12.980346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:51:12.990551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:12.991088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:12.991933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:12.992393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:13.011069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Getting quotas for project eec1de914edd4c8794c90561940c3402. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:51:13.016641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Getting quotas for user 4a6c42ecf1044bf79778ec5b4da0c270 and project eec1de914edd4c8794c90561940c3402. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:51:13.030570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:51:13.033212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:51:13.081195 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5d597da9-67eb-4b7a-8363-aad97dc49425 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.634214 Aug 03 02:51:13.081764 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3385/6650] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:51:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:51:13.091364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:51:13.095978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8d56069-1d05-4650-93c2-bb7554023e45 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:13.096599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b8d56069-1d05-4650-93c2-bb7554023e45 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:13.164589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b8d56069-1d05-4650-93c2-bb7554023e45 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:51:13.173022 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b8d56069-1d05-4650-93c2-bb7554023e45 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1237 microversion: 2.1 time: 0.083141 Aug 03 02:51:13.173958 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3266/6651] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:51:13 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:51:14.196966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd6402e5-2c29-405b-92a6-e6c4825caee6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:14.197697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cd6402e5-2c29-405b-92a6-e6c4825caee6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:14.205145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd6402e5-2c29-405b-92a6-e6c4825caee6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:14.205698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd6402e5-2c29-405b-92a6-e6c4825caee6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:14.206571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd6402e5-2c29-405b-92a6-e6c4825caee6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:14.208018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd6402e5-2c29-405b-92a6-e6c4825caee6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:14.282744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-cd6402e5-2c29-405b-92a6-e6c4825caee6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:51:14.294404 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cd6402e5-2c29-405b-92a6-e6c4825caee6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1289 microversion: 2.1 time: 0.103636 Aug 03 02:51:14.295531 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3386/6652] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:51:14 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1289 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:51:15.316357 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2843ed17-e158-481b-b165-9b8e0405867d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:15.317536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2843ed17-e158-481b-b165-9b8e0405867d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:15.324260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2843ed17-e158-481b-b165-9b8e0405867d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:15.324728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2843ed17-e158-481b-b165-9b8e0405867d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:15.325527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2843ed17-e158-481b-b165-9b8e0405867d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:15.325974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2843ed17-e158-481b-b165-9b8e0405867d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:15.467242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2843ed17-e158-481b-b165-9b8e0405867d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:51:15.475905 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2843ed17-e158-481b-b165-9b8e0405867d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1363 microversion: 2.1 time: 0.163658 Aug 03 02:51:15.476570 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3267/6653] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:51:15 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:51:15.653469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-b5f9af25-a6cd-4cae-b7ca-5186471507bb req-ee802f19-9014-4589-8432-fd1b35d13f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c8b4eec-9bad-42fb-a1a8-0102fc56657d", "tag": "10043143-a59a-49e4-88b8-cc4c22d1bfaf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:51:15.666057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b5f9af25-a6cd-4cae-b7ca-5186471507bb req-ee802f19-9014-4589-8432-fd1b35d13f46 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:15.667018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b5f9af25-a6cd-4cae-b7ca-5186471507bb req-ee802f19-9014-4589-8432-fd1b35d13f46 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:15.679749 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-b5f9af25-a6cd-4cae-b7ca-5186471507bb req-ee802f19-9014-4589-8432-fd1b35d13f46 service nova] Creating event network-changed:10043143-a59a-49e4-88b8-cc4c22d1bfaf for instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d on n-h1-826529-8 Aug 03 02:51:15.685908 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-b5f9af25-a6cd-4cae-b7ca-5186471507bb req-ee802f19-9014-4589-8432-fd1b35d13f46 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037866 Aug 03 02:51:15.686831 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3387/6654] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:51:16.497138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c260d7fb-b258-496d-a38a-497211aa7ed4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:16.497766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c260d7fb-b258-496d-a38a-497211aa7ed4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:16.505548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c260d7fb-b258-496d-a38a-497211aa7ed4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:16.506014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c260d7fb-b258-496d-a38a-497211aa7ed4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:16.506811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c260d7fb-b258-496d-a38a-497211aa7ed4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:16.507293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c260d7fb-b258-496d-a38a-497211aa7ed4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:16.642506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c260d7fb-b258-496d-a38a-497211aa7ed4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:51:16.650238 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c260d7fb-b258-496d-a38a-497211aa7ed4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1363 microversion: 2.1 time: 0.157244 Aug 03 02:51:16.650816 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3268/6655] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:51:16 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:51:17.673646 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-98f54d6a-a016-423b-8f02-41e6c4579bf9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:17.674354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-98f54d6a-a016-423b-8f02-41e6c4579bf9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:17.681347 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98f54d6a-a016-423b-8f02-41e6c4579bf9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:17.682110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98f54d6a-a016-423b-8f02-41e6c4579bf9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:17.682594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98f54d6a-a016-423b-8f02-41e6c4579bf9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:17.683078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-98f54d6a-a016-423b-8f02-41e6c4579bf9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:17.818933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-98f54d6a-a016-423b-8f02-41e6c4579bf9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:51:17.826780 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-98f54d6a-a016-423b-8f02-41e6c4579bf9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1363 microversion: 2.1 time: 0.158964 Aug 03 02:51:17.827391 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3388/6656] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:51:17 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:51:18.849079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-22e29da7-f2ba-4830-b605-8d2aa5af26e4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:18.849488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-22e29da7-f2ba-4830-b605-8d2aa5af26e4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:18.856006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22e29da7-f2ba-4830-b605-8d2aa5af26e4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:18.856468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22e29da7-f2ba-4830-b605-8d2aa5af26e4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:18.857288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22e29da7-f2ba-4830-b605-8d2aa5af26e4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:18.857738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-22e29da7-f2ba-4830-b605-8d2aa5af26e4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:18.990211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-22e29da7-f2ba-4830-b605-8d2aa5af26e4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:51:18.998077 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-22e29da7-f2ba-4830-b605-8d2aa5af26e4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1363 microversion: 2.1 time: 0.154194 Aug 03 02:51:18.998673 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3269/6657] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:51:18 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:51:20.020164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0777afcd-3703-463e-bfbd-223bd2a97547 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:20.020950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0777afcd-3703-463e-bfbd-223bd2a97547 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:20.028035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0777afcd-3703-463e-bfbd-223bd2a97547 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:20.028499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0777afcd-3703-463e-bfbd-223bd2a97547 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:20.029289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0777afcd-3703-463e-bfbd-223bd2a97547 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:20.029747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0777afcd-3703-463e-bfbd-223bd2a97547 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:20.167585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0777afcd-3703-463e-bfbd-223bd2a97547 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:51:20.175178 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0777afcd-3703-463e-bfbd-223bd2a97547 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1363 microversion: 2.1 time: 0.159647 Aug 03 02:51:20.176081 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3389/6658] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:51:20 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:51:21.047253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-7599e606-6dc1-4307-9123-3a5b6c51a3d5 req-f78afcb5-f733-4eee-a41d-d14525cb1121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8b4eec-9bad-42fb-a1a8-0102fc56657d", "name": "network-vif-plugged", "status": "completed", "tag": "10043143-a59a-49e4-88b8-cc4c22d1bfaf"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:51:21.058971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7599e606-6dc1-4307-9123-3a5b6c51a3d5 req-f78afcb5-f733-4eee-a41d-d14525cb1121 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:21.059439 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7599e606-6dc1-4307-9123-3a5b6c51a3d5 req-f78afcb5-f733-4eee-a41d-d14525cb1121 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:21.071812 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-7599e606-6dc1-4307-9123-3a5b6c51a3d5 req-f78afcb5-f733-4eee-a41d-d14525cb1121 service nova] Creating event network-vif-plugged:10043143-a59a-49e4-88b8-cc4c22d1bfaf for instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d on n-h1-826529-8 Aug 03 02:51:21.076903 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-7599e606-6dc1-4307-9123-3a5b6c51a3d5 req-f78afcb5-f733-4eee-a41d-d14525cb1121 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033526 Aug 03 02:51:21.077575 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3270/6659] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:51:21.196387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4bfcda1-6a2b-422a-81d5-0647ce2a0221 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:21.197021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f4bfcda1-6a2b-422a-81d5-0647ce2a0221 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:21.204234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4bfcda1-6a2b-422a-81d5-0647ce2a0221 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:21.204708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4bfcda1-6a2b-422a-81d5-0647ce2a0221 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:21.205504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4bfcda1-6a2b-422a-81d5-0647ce2a0221 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:21.205964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4bfcda1-6a2b-422a-81d5-0647ce2a0221 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:21.337945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f4bfcda1-6a2b-422a-81d5-0647ce2a0221 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:51:21.345628 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f4bfcda1-6a2b-422a-81d5-0647ce2a0221 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1363 microversion: 2.1 time: 0.153207 Aug 03 02:51:21.346203 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3390/6660] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:51:21 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:51:22.370002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9d24904f-8259-46ce-9fe5-63bcb26ea7e8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:22.370918 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9d24904f-8259-46ce-9fe5-63bcb26ea7e8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:22.377579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d24904f-8259-46ce-9fe5-63bcb26ea7e8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:22.378044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d24904f-8259-46ce-9fe5-63bcb26ea7e8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:22.379472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d24904f-8259-46ce-9fe5-63bcb26ea7e8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:22.380033 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9d24904f-8259-46ce-9fe5-63bcb26ea7e8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:22.518107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9d24904f-8259-46ce-9fe5-63bcb26ea7e8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:51:22.525881 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9d24904f-8259-46ce-9fe5-63bcb26ea7e8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1549 microversion: 2.1 time: 0.162956 Aug 03 02:51:22.526453 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3271/6661] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:51:22 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:51:22.548262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1b3718aa-7183-4e11-8951-4a2b8298b430 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:22.548816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1b3718aa-7183-4e11-8951-4a2b8298b430 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:22.555894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b3718aa-7183-4e11-8951-4a2b8298b430 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:22.556369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b3718aa-7183-4e11-8951-4a2b8298b430 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:22.557162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b3718aa-7183-4e11-8951-4a2b8298b430 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:22.557616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b3718aa-7183-4e11-8951-4a2b8298b430 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:22.637000 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1b3718aa-7183-4e11-8951-4a2b8298b430 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092811 Aug 03 02:51:22.637634 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3391/6662] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:51:22 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:51:23.588646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-8200356f-5230-47fa-92f9-89dc7e86e7bf req-39b2ae6e-418f-40f3-bbb3-c522fbaec935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c8b4eec-9bad-42fb-a1a8-0102fc56657d", "tag": "10043143-a59a-49e4-88b8-cc4c22d1bfaf"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:51:23.593594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:51:23.601452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8200356f-5230-47fa-92f9-89dc7e86e7bf req-39b2ae6e-418f-40f3-bbb3-c522fbaec935 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:23.601986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8200356f-5230-47fa-92f9-89dc7e86e7bf req-39b2ae6e-418f-40f3-bbb3-c522fbaec935 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:23.615012 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-8200356f-5230-47fa-92f9-89dc7e86e7bf req-39b2ae6e-418f-40f3-bbb3-c522fbaec935 service nova] Creating event network-changed:10043143-a59a-49e4-88b8-cc4c22d1bfaf for instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d on n-h1-826529-8 Aug 03 02:51:23.619973 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-8200356f-5230-47fa-92f9-89dc7e86e7bf req-39b2ae6e-418f-40f3-bbb3-c522fbaec935 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035083 Aug 03 02:51:23.620587 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3272/6663] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:51:59.416380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:51:59.417359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:51:59.419231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:51:59.419863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=32 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:51:59.424371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eed2b1c7-d1ff-4df9-a7f9-8edca0fb29eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:59.425166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eed2b1c7-d1ff-4df9-a7f9-8edca0fb29eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:59.433002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed2b1c7-d1ff-4df9-a7f9-8edca0fb29eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:59.433472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed2b1c7-d1ff-4df9-a7f9-8edca0fb29eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:59.434266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed2b1c7-d1ff-4df9-a7f9-8edca0fb29eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:59.434719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eed2b1c7-d1ff-4df9-a7f9-8edca0fb29eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:59.564261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-eed2b1c7-d1ff-4df9-a7f9-8edca0fb29eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:51:59.572298 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eed2b1c7-d1ff-4df9-a7f9-8edca0fb29eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1668 microversion: 2.1 time: 0.156853 Aug 03 02:51:59.572871 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3392/6664] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:51:59 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:51:59.592248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:51:59.593063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=28 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:51:59.597227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1590bca4-d07c-41cc-92e2-b18f0da5913a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:59.597939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1590bca4-d07c-41cc-92e2-b18f0da5913a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:59.605699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1590bca4-d07c-41cc-92e2-b18f0da5913a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:59.606206 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1590bca4-d07c-41cc-92e2-b18f0da5913a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:59.607050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1590bca4-d07c-41cc-92e2-b18f0da5913a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:59.607505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1590bca4-d07c-41cc-92e2-b18f0da5913a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:59.744310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1590bca4-d07c-41cc-92e2-b18f0da5913a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:51:59.752118 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1590bca4-d07c-41cc-92e2-b18f0da5913a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1668 microversion: 2.1 time: 0.162036 Aug 03 02:51:59.753637 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3273/6665] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:51:59 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:51:59.773677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c7d6cf40-770d-4682-836e-f35047c145b5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:51:59.774489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c7d6cf40-770d-4682-836e-f35047c145b5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:59.780423 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7d6cf40-770d-4682-836e-f35047c145b5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:59.780892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7d6cf40-770d-4682-836e-f35047c145b5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:59.781674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7d6cf40-770d-4682-836e-f35047c145b5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:59.782127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c7d6cf40-770d-4682-836e-f35047c145b5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:59.910325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c7d6cf40-770d-4682-836e-f35047c145b5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:51:59.918264 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c7d6cf40-770d-4682-836e-f35047c145b5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1668 microversion: 2.1 time: 0.148472 Aug 03 02:51:59.918871 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3393/6666] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:51:59 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1668 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:51:59.939437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:51:59.942315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:51:59.948521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:59.948909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:59.949686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:51:59.950125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:51:59.978393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:51:59.984447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Old instance type m1.heat2, new instance type m1.heat {{(pid=125942) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 02:51:59.991325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:51:59.991747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:51:59.992223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:51:59.992635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:51:59.993142 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:52:00.056234 n-d-826529-8 devstack@n-api.service[125942]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [c23105b3-df8a-4f92-a544-507dd6798a61] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 02:52:01.063565 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [c23105b3-df8a-4f92-a544-507dd6798a61] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 35900. Aug 03 02:52:01.067450 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6015618e-f193-4846-b32b-e6a26ff3ddec tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "POST /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d/action" status: 202 len: 0 microversion: 2.1 time: 1.132205 Aug 03 02:52:01.068217 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3274/6667] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:51:59 2022] POST /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:52:01.076145 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f4a2da8a-46f3-48b2-8112-f48abe1688c4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:01.076809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f4a2da8a-46f3-48b2-8112-f48abe1688c4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:01.083944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4a2da8a-46f3-48b2-8112-f48abe1688c4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:01.084497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4a2da8a-46f3-48b2-8112-f48abe1688c4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:01.085376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4a2da8a-46f3-48b2-8112-f48abe1688c4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:01.086018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f4a2da8a-46f3-48b2-8112-f48abe1688c4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:01.225798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f4a2da8a-46f3-48b2-8112-f48abe1688c4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:01.234058 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f4a2da8a-46f3-48b2-8112-f48abe1688c4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1677 microversion: 2.1 time: 0.161752 Aug 03 02:52:01.234645 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3394/6668] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:01 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:02.258654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cf582cff-55e7-4714-a551-c3f863ed7d4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:02.261615 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cf582cff-55e7-4714-a551-c3f863ed7d4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:02.268997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf582cff-55e7-4714-a551-c3f863ed7d4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:02.269462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf582cff-55e7-4714-a551-c3f863ed7d4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:02.270294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf582cff-55e7-4714-a551-c3f863ed7d4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:02.270824 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf582cff-55e7-4714-a551-c3f863ed7d4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:02.404822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cf582cff-55e7-4714-a551-c3f863ed7d4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:02.412638 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cf582cff-55e7-4714-a551-c3f863ed7d4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1677 microversion: 2.1 time: 0.161588 Aug 03 02:52:02.413217 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3275/6669] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:02 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:03.434284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2ad748da-cde3-4d55-9fef-d92ca462baae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:03.434944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2ad748da-cde3-4d55-9fef-d92ca462baae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:03.442110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ad748da-cde3-4d55-9fef-d92ca462baae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:03.442586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ad748da-cde3-4d55-9fef-d92ca462baae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:03.443476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ad748da-cde3-4d55-9fef-d92ca462baae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:03.443937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ad748da-cde3-4d55-9fef-d92ca462baae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:03.576943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2ad748da-cde3-4d55-9fef-d92ca462baae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:03.584610 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2ad748da-cde3-4d55-9fef-d92ca462baae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1682 microversion: 2.1 time: 0.154318 Aug 03 02:52:03.585181 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3395/6670] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:03 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:04.606162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7c3db8f7-e07c-49b9-bfa1-8400795d2bf2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:04.606790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7c3db8f7-e07c-49b9-bfa1-8400795d2bf2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:04.613921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c3db8f7-e07c-49b9-bfa1-8400795d2bf2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:04.614414 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c3db8f7-e07c-49b9-bfa1-8400795d2bf2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:04.615246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c3db8f7-e07c-49b9-bfa1-8400795d2bf2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:04.615703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c3db8f7-e07c-49b9-bfa1-8400795d2bf2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:04.749813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7c3db8f7-e07c-49b9-bfa1-8400795d2bf2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:04.758297 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7c3db8f7-e07c-49b9-bfa1-8400795d2bf2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1682 microversion: 2.1 time: 0.156121 Aug 03 02:52:04.758879 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3276/6671] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:04 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:05.780899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-518f5c25-d2bf-42bf-a44d-0aef4cb41418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:05.781564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-518f5c25-d2bf-42bf-a44d-0aef4cb41418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:05.788748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-518f5c25-d2bf-42bf-a44d-0aef4cb41418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:05.789247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-518f5c25-d2bf-42bf-a44d-0aef4cb41418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:05.790033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-518f5c25-d2bf-42bf-a44d-0aef4cb41418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:05.790490 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-518f5c25-d2bf-42bf-a44d-0aef4cb41418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:05.922220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-518f5c25-d2bf-42bf-a44d-0aef4cb41418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:05.930459 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-518f5c25-d2bf-42bf-a44d-0aef4cb41418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1682 microversion: 2.1 time: 0.153499 Aug 03 02:52:05.931064 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3396/6672] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:05 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:06.952301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-82f15a84-8373-401c-901d-0617ba16a09f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:06.952928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-82f15a84-8373-401c-901d-0617ba16a09f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:06.960570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-82f15a84-8373-401c-901d-0617ba16a09f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:06.961034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-82f15a84-8373-401c-901d-0617ba16a09f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:06.961924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-82f15a84-8373-401c-901d-0617ba16a09f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:06.962372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-82f15a84-8373-401c-901d-0617ba16a09f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:07.099464 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-82f15a84-8373-401c-901d-0617ba16a09f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:07.107011 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-82f15a84-8373-401c-901d-0617ba16a09f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1682 microversion: 2.1 time: 0.158652 Aug 03 02:52:07.107599 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3277/6673] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:06 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:08.129213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bca979b2-6db2-42be-8901-c8a8b5ea1406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:08.130171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bca979b2-6db2-42be-8901-c8a8b5ea1406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:08.137516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bca979b2-6db2-42be-8901-c8a8b5ea1406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:08.137985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bca979b2-6db2-42be-8901-c8a8b5ea1406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:08.138792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bca979b2-6db2-42be-8901-c8a8b5ea1406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:08.139262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bca979b2-6db2-42be-8901-c8a8b5ea1406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:08.280590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bca979b2-6db2-42be-8901-c8a8b5ea1406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:08.288379 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bca979b2-6db2-42be-8901-c8a8b5ea1406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1682 microversion: 2.1 time: 0.163523 Aug 03 02:52:08.288976 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3397/6674] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:08 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:09.309280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c31b10dc-e3fc-414d-8168-dfece57667c9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:09.309897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c31b10dc-e3fc-414d-8168-dfece57667c9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:09.317036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c31b10dc-e3fc-414d-8168-dfece57667c9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:09.317491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c31b10dc-e3fc-414d-8168-dfece57667c9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:09.318266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c31b10dc-e3fc-414d-8168-dfece57667c9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:09.318711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c31b10dc-e3fc-414d-8168-dfece57667c9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:09.452752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c31b10dc-e3fc-414d-8168-dfece57667c9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:09.460967 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c31b10dc-e3fc-414d-8168-dfece57667c9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1682 microversion: 2.1 time: 0.155644 Aug 03 02:52:09.461543 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3278/6675] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:09 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:10.482661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-931ecb06-6603-4da5-8da3-ef3e10076aa5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:10.483323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-931ecb06-6603-4da5-8da3-ef3e10076aa5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:10.491044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-931ecb06-6603-4da5-8da3-ef3e10076aa5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:10.491522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-931ecb06-6603-4da5-8da3-ef3e10076aa5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:10.492312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-931ecb06-6603-4da5-8da3-ef3e10076aa5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:10.492787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-931ecb06-6603-4da5-8da3-ef3e10076aa5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:10.625710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-931ecb06-6603-4da5-8da3-ef3e10076aa5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:10.633893 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-931ecb06-6603-4da5-8da3-ef3e10076aa5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1682 microversion: 2.1 time: 0.155226 Aug 03 02:52:10.634476 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3398/6676] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:10 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:11.655979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3afa0a69-547d-473c-8d2e-2b3c8aac15fb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:11.656600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3afa0a69-547d-473c-8d2e-2b3c8aac15fb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:11.664291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3afa0a69-547d-473c-8d2e-2b3c8aac15fb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:11.664773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3afa0a69-547d-473c-8d2e-2b3c8aac15fb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:11.665567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3afa0a69-547d-473c-8d2e-2b3c8aac15fb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:11.666076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3afa0a69-547d-473c-8d2e-2b3c8aac15fb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:11.802473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3afa0a69-547d-473c-8d2e-2b3c8aac15fb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:11.810749 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3afa0a69-547d-473c-8d2e-2b3c8aac15fb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1682 microversion: 2.1 time: 0.158839 Aug 03 02:52:11.811363 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3279/6677] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:11 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:12.832344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b0a65ef0-6be3-4bce-8f73-8920250cabf8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:12.832983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b0a65ef0-6be3-4bce-8f73-8920250cabf8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:12.840002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0a65ef0-6be3-4bce-8f73-8920250cabf8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:12.840473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0a65ef0-6be3-4bce-8f73-8920250cabf8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:12.841265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0a65ef0-6be3-4bce-8f73-8920250cabf8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:12.841727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0a65ef0-6be3-4bce-8f73-8920250cabf8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:12.977152 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b0a65ef0-6be3-4bce-8f73-8920250cabf8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:12.985048 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b0a65ef0-6be3-4bce-8f73-8920250cabf8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1682 microversion: 2.1 time: 0.156624 Aug 03 02:52:12.985632 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3399/6678] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:12 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:14.006663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-53a19564-d74f-4d65-8375-f96704192ff4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:14.007249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-53a19564-d74f-4d65-8375-f96704192ff4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:14.014486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53a19564-d74f-4d65-8375-f96704192ff4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:14.014979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53a19564-d74f-4d65-8375-f96704192ff4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:14.015778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53a19564-d74f-4d65-8375-f96704192ff4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:14.016222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-53a19564-d74f-4d65-8375-f96704192ff4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:14.149177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-53a19564-d74f-4d65-8375-f96704192ff4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:14.157095 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-53a19564-d74f-4d65-8375-f96704192ff4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1682 microversion: 2.1 time: 0.154503 Aug 03 02:52:14.157687 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3280/6679] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:14 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:15.180262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9a896dad-255a-41d5-8b68-d4626f2011d9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:15.180898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9a896dad-255a-41d5-8b68-d4626f2011d9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:15.188213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9a896dad-255a-41d5-8b68-d4626f2011d9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:15.188691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9a896dad-255a-41d5-8b68-d4626f2011d9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:15.190030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9a896dad-255a-41d5-8b68-d4626f2011d9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:15.190492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9a896dad-255a-41d5-8b68-d4626f2011d9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:15.322471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9a896dad-255a-41d5-8b68-d4626f2011d9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:15.330816 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9a896dad-255a-41d5-8b68-d4626f2011d9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1682 microversion: 2.1 time: 0.153742 Aug 03 02:52:15.331592 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3400/6680] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:15 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:16.353445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-68a0d02f-86f2-401a-b4a9-b2a629dabc73 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:16.354073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-68a0d02f-86f2-401a-b4a9-b2a629dabc73 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:16.361430 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68a0d02f-86f2-401a-b4a9-b2a629dabc73 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:16.361896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68a0d02f-86f2-401a-b4a9-b2a629dabc73 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:16.362687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68a0d02f-86f2-401a-b4a9-b2a629dabc73 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:16.363161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68a0d02f-86f2-401a-b4a9-b2a629dabc73 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:16.494107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-68a0d02f-86f2-401a-b4a9-b2a629dabc73 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:16.502789 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-68a0d02f-86f2-401a-b4a9-b2a629dabc73 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1682 microversion: 2.1 time: 0.153374 Aug 03 02:52:16.503389 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3281/6681] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:16 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:17.524586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-df8ceec6-4b30-404d-ac31-aebd80b6869b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:17.525167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-df8ceec6-4b30-404d-ac31-aebd80b6869b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:17.532173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df8ceec6-4b30-404d-ac31-aebd80b6869b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:17.532642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df8ceec6-4b30-404d-ac31-aebd80b6869b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:17.534429 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df8ceec6-4b30-404d-ac31-aebd80b6869b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:17.535198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-df8ceec6-4b30-404d-ac31-aebd80b6869b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:17.665916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-df8ceec6-4b30-404d-ac31-aebd80b6869b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:17.673754 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-df8ceec6-4b30-404d-ac31-aebd80b6869b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1682 microversion: 2.1 time: 0.153042 Aug 03 02:52:17.674345 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3401/6682] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:17 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:18.695473 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3bafa845-e269-418f-97cd-386527c5c661 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:18.696112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3bafa845-e269-418f-97cd-386527c5c661 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:18.703438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3bafa845-e269-418f-97cd-386527c5c661 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:18.703892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3bafa845-e269-418f-97cd-386527c5c661 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:18.704713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3bafa845-e269-418f-97cd-386527c5c661 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:18.705251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3bafa845-e269-418f-97cd-386527c5c661 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:18.840204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3bafa845-e269-418f-97cd-386527c5c661 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:18.849069 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3bafa845-e269-418f-97cd-386527c5c661 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1682 microversion: 2.1 time: 0.157557 Aug 03 02:52:18.849644 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3282/6683] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:18 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:52:19.871606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c220ebb1-6221-48f8-8f62-94adbcc545ae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:19.872177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c220ebb1-6221-48f8-8f62-94adbcc545ae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:19.880009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c220ebb1-6221-48f8-8f62-94adbcc545ae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:19.880479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c220ebb1-6221-48f8-8f62-94adbcc545ae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:19.881279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c220ebb1-6221-48f8-8f62-94adbcc545ae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:19.881742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c220ebb1-6221-48f8-8f62-94adbcc545ae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:20.021274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c220ebb1-6221-48f8-8f62-94adbcc545ae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:20.029842 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c220ebb1-6221-48f8-8f62-94adbcc545ae tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1682 microversion: 2.1 time: 0.162506 Aug 03 02:52:20.030444 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3402/6684] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:19 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:20.632192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-7b3abe16-2cc6-4df1-a3ea-041d50160d65 req-ce06ff98-c889-47b6-bc49-2fc80d2b1bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8b4eec-9bad-42fb-a1a8-0102fc56657d", "name": "network-vif-unplugged", "status": "completed", "tag": "10043143-a59a-49e4-88b8-cc4c22d1bfaf"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:52:20.642690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7b3abe16-2cc6-4df1-a3ea-041d50160d65 req-ce06ff98-c889-47b6-bc49-2fc80d2b1bf1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:20.643383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7b3abe16-2cc6-4df1-a3ea-041d50160d65 req-ce06ff98-c889-47b6-bc49-2fc80d2b1bf1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:20.655867 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-7b3abe16-2cc6-4df1-a3ea-041d50160d65 req-ce06ff98-c889-47b6-bc49-2fc80d2b1bf1 service nova] Creating event network-vif-unplugged:10043143-a59a-49e4-88b8-cc4c22d1bfaf for instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d on n-h2-826529-8 Aug 03 02:52:20.661999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-7b3abe16-2cc6-4df1-a3ea-041d50160d65 req-ce06ff98-c889-47b6-bc49-2fc80d2b1bf1 service nova] Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:52:20.673713 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-7b3abe16-2cc6-4df1-a3ea-041d50160d65 req-ce06ff98-c889-47b6-bc49-2fc80d2b1bf1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103946 Aug 03 02:52:20.674691 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3283/6685] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:52:21.052216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-83ff664c-c801-4013-a55d-9a96e22cac90 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:21.052886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-83ff664c-c801-4013-a55d-9a96e22cac90 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:21.060478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83ff664c-c801-4013-a55d-9a96e22cac90 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:21.060952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83ff664c-c801-4013-a55d-9a96e22cac90 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:21.061758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83ff664c-c801-4013-a55d-9a96e22cac90 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:21.062218 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83ff664c-c801-4013-a55d-9a96e22cac90 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:21.336614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-83ff664c-c801-4013-a55d-9a96e22cac90 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:21.344505 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-83ff664c-c801-4013-a55d-9a96e22cac90 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1681 microversion: 2.1 time: 0.296530 Aug 03 02:52:21.345151 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3403/6686] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:21 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1681 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:22.371600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-73401135-80a5-4b6e-bca8-17a063666bb9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:22.372238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-73401135-80a5-4b6e-bca8-17a063666bb9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:22.385708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73401135-80a5-4b6e-bca8-17a063666bb9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:22.386182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73401135-80a5-4b6e-bca8-17a063666bb9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:22.387017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73401135-80a5-4b6e-bca8-17a063666bb9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:22.387471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73401135-80a5-4b6e-bca8-17a063666bb9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:22.591630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-73401135-80a5-4b6e-bca8-17a063666bb9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:22.599746 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-73401135-80a5-4b6e-bca8-17a063666bb9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1679 microversion: 2.1 time: 0.237644 Aug 03 02:52:22.600330 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3284/6687] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:22 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1679 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:22.699556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-f6664686-5e6b-4e8b-96f7-1f31bd056682 req-41d50504-23d3-4556-a7fe-8d4a0279e109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c8b4eec-9bad-42fb-a1a8-0102fc56657d", "tag": "10043143-a59a-49e4-88b8-cc4c22d1bfaf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:52:22.712440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f6664686-5e6b-4e8b-96f7-1f31bd056682 req-41d50504-23d3-4556-a7fe-8d4a0279e109 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:22.713002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-f6664686-5e6b-4e8b-96f7-1f31bd056682 req-41d50504-23d3-4556-a7fe-8d4a0279e109 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:22.726319 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-f6664686-5e6b-4e8b-96f7-1f31bd056682 req-41d50504-23d3-4556-a7fe-8d4a0279e109 service nova] Creating event network-changed:10043143-a59a-49e4-88b8-cc4c22d1bfaf for instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d on n-h2-826529-8 Aug 03 02:52:22.732197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-f6664686-5e6b-4e8b-96f7-1f31bd056682 req-41d50504-23d3-4556-a7fe-8d4a0279e109 service nova] Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:52:22.746590 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-f6664686-5e6b-4e8b-96f7-1f31bd056682 req-41d50504-23d3-4556-a7fe-8d4a0279e109 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050801 Aug 03 02:52:22.747870 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3404/6688] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:52:23.621704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0c1d46b9-ff96-43b7-abbe-a331844afe8f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:23.622364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0c1d46b9-ff96-43b7-abbe-a331844afe8f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:23.629978 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c1d46b9-ff96-43b7-abbe-a331844afe8f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:23.630441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c1d46b9-ff96-43b7-abbe-a331844afe8f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:23.631272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c1d46b9-ff96-43b7-abbe-a331844afe8f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:23.631725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c1d46b9-ff96-43b7-abbe-a331844afe8f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:23.847660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0c1d46b9-ff96-43b7-abbe-a331844afe8f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:23.855962 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0c1d46b9-ff96-43b7-abbe-a331844afe8f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1676 microversion: 2.1 time: 0.238181 Aug 03 02:52:23.856555 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3285/6689] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:23 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1676 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:23.878531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ccffd15c-9f4d-481d-bf66-474e310395ab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:52:23.879229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ccffd15c-9f4d-481d-bf66-474e310395ab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:23.886744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccffd15c-9f4d-481d-bf66-474e310395ab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:23.887420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccffd15c-9f4d-481d-bf66-474e310395ab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:23.888047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccffd15c-9f4d-481d-bf66-474e310395ab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:23.888541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccffd15c-9f4d-481d-bf66-474e310395ab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:23.948315 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ccffd15c-9f4d-481d-bf66-474e310395ab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "POST /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d/action" status: 204 len: 0 microversion: 2.1 time: 0.074626 Aug 03 02:52:23.949427 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3405/6690] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:52:23 2022] POST /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:52:23.957881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-23d8cb7f-dbde-4606-9561-44119f800ee8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:23.958497 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-23d8cb7f-dbde-4606-9561-44119f800ee8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:23.964704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23d8cb7f-dbde-4606-9561-44119f800ee8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:23.965155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23d8cb7f-dbde-4606-9561-44119f800ee8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:23.965987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23d8cb7f-dbde-4606-9561-44119f800ee8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:23.966509 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-23d8cb7f-dbde-4606-9561-44119f800ee8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:24.104324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-23d8cb7f-dbde-4606-9561-44119f800ee8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:24.112934 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-23d8cb7f-dbde-4606-9561-44119f800ee8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1676 microversion: 2.1 time: 0.159164 Aug 03 02:52:24.113521 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3286/6691] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:23 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:25.134255 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-76dc0472-2339-41ef-89a4-d6d02e92cbb6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:25.135008 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-76dc0472-2339-41ef-89a4-d6d02e92cbb6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:25.142690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76dc0472-2339-41ef-89a4-d6d02e92cbb6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:25.143189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76dc0472-2339-41ef-89a4-d6d02e92cbb6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:25.143979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76dc0472-2339-41ef-89a4-d6d02e92cbb6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:25.144435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-76dc0472-2339-41ef-89a4-d6d02e92cbb6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:25.341189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-76dc0472-2339-41ef-89a4-d6d02e92cbb6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:25.350070 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-76dc0472-2339-41ef-89a4-d6d02e92cbb6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1676 microversion: 2.1 time: 0.219970 Aug 03 02:52:25.350752 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3406/6692] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:25 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:26.372664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fb4b0e60-49d6-4b6c-9f2d-a21fbeca9ff2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:26.373267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fb4b0e60-49d6-4b6c-9f2d-a21fbeca9ff2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:26.381850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb4b0e60-49d6-4b6c-9f2d-a21fbeca9ff2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:26.382396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb4b0e60-49d6-4b6c-9f2d-a21fbeca9ff2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:26.383207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb4b0e60-49d6-4b6c-9f2d-a21fbeca9ff2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:26.383645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fb4b0e60-49d6-4b6c-9f2d-a21fbeca9ff2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:26.516370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fb4b0e60-49d6-4b6c-9f2d-a21fbeca9ff2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:26.524984 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fb4b0e60-49d6-4b6c-9f2d-a21fbeca9ff2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1668 microversion: 2.1 time: 0.156389 Aug 03 02:52:26.525562 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3287/6693] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:26 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:26.546151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0949e97d-9892-44f7-8561-7d2eab94ca55 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:26.546791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0949e97d-9892-44f7-8561-7d2eab94ca55 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:26.553980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0949e97d-9892-44f7-8561-7d2eab94ca55 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:26.554442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0949e97d-9892-44f7-8561-7d2eab94ca55 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:26.555261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0949e97d-9892-44f7-8561-7d2eab94ca55 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:26.555719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0949e97d-9892-44f7-8561-7d2eab94ca55 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:26.692321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0949e97d-9892-44f7-8561-7d2eab94ca55 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:26.694679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:52:26.701591 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0949e97d-9892-44f7-8561-7d2eab94ca55 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1668 microversion: 2.1 time: 0.159454 Aug 03 02:52:26.702166 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3407/6694] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:26 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:26.721558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6833b7d5-d263-41f3-b8cf-3f89faf55544 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:26.722169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6833b7d5-d263-41f3-b8cf-3f89faf55544 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:26.728526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6833b7d5-d263-41f3-b8cf-3f89faf55544 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:26.728993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6833b7d5-d263-41f3-b8cf-3f89faf55544 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:26.729793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6833b7d5-d263-41f3-b8cf-3f89faf55544 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:26.730245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6833b7d5-d263-41f3-b8cf-3f89faf55544 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:26.749644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:52:26.867477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6833b7d5-d263-41f3-b8cf-3f89faf55544 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:26.875091 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6833b7d5-d263-41f3-b8cf-3f89faf55544 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1668 microversion: 2.1 time: 0.157597 Aug 03 02:52:26.875673 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3288/6695] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:26 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:26.896095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0c0d9c87-8b45-43ce-9ed0-82a367dffd63 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:26.896541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0c0d9c87-8b45-43ce-9ed0-82a367dffd63 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:26.903993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c0d9c87-8b45-43ce-9ed0-82a367dffd63 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:26.904454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c0d9c87-8b45-43ce-9ed0-82a367dffd63 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:26.905234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c0d9c87-8b45-43ce-9ed0-82a367dffd63 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:26.905686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c0d9c87-8b45-43ce-9ed0-82a367dffd63 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:26.931024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0c0d9c87-8b45-43ce-9ed0-82a367dffd63 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:52:27.010859 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0c0d9c87-8b45-43ce-9ed0-82a367dffd63 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 204 len: 0 microversion: 2.1 time: 0.118109 Aug 03 02:52:27.011493 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3408/6696] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:52:26 2022] DELETE /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:52:27.020776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5a81bebc-029e-44fa-8ad1-30956a8ac606 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:27.021412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5a81bebc-029e-44fa-8ad1-30956a8ac606 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:27.027608 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a81bebc-029e-44fa-8ad1-30956a8ac606 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:27.028074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a81bebc-029e-44fa-8ad1-30956a8ac606 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:27.028869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a81bebc-029e-44fa-8ad1-30956a8ac606 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:27.029319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5a81bebc-029e-44fa-8ad1-30956a8ac606 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:27.164062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5a81bebc-029e-44fa-8ad1-30956a8ac606 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:27.171951 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5a81bebc-029e-44fa-8ad1-30956a8ac606 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1674 microversion: 2.1 time: 0.155334 Aug 03 02:52:27.172537 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3289/6697] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:27 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:27.500131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-757abbf3-5146-4522-be02-4667b2d9f2bd req-89af00e5-762a-46d5-b831-7478c2fa1df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8b4eec-9bad-42fb-a1a8-0102fc56657d", "name": "network-vif-plugged", "status": "completed", "tag": "10043143-a59a-49e4-88b8-cc4c22d1bfaf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:52:27.510760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-757abbf3-5146-4522-be02-4667b2d9f2bd req-89af00e5-762a-46d5-b831-7478c2fa1df2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:27.511251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-757abbf3-5146-4522-be02-4667b2d9f2bd req-89af00e5-762a-46d5-b831-7478c2fa1df2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:27.523271 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-757abbf3-5146-4522-be02-4667b2d9f2bd req-89af00e5-762a-46d5-b831-7478c2fa1df2 service nova] Creating event network-vif-plugged:10043143-a59a-49e4-88b8-cc4c22d1bfaf for instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d on n-h2-826529-8 Aug 03 02:52:27.528130 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-757abbf3-5146-4522-be02-4667b2d9f2bd req-89af00e5-762a-46d5-b831-7478c2fa1df2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032768 Aug 03 02:52:27.528729 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3409/6698] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:52:28.193965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-475d90e9-2c7c-4366-a3c5-c9bd5087bc60 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:28.194572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-475d90e9-2c7c-4366-a3c5-c9bd5087bc60 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:28.202376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-475d90e9-2c7c-4366-a3c5-c9bd5087bc60 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:28.202838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-475d90e9-2c7c-4366-a3c5-c9bd5087bc60 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:28.203654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-475d90e9-2c7c-4366-a3c5-c9bd5087bc60 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:28.204100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-475d90e9-2c7c-4366-a3c5-c9bd5087bc60 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:28.343410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-475d90e9-2c7c-4366-a3c5-c9bd5087bc60 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:28.354351 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-475d90e9-2c7c-4366-a3c5-c9bd5087bc60 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1674 microversion: 2.1 time: 0.164301 Aug 03 02:52:28.354968 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3290/6699] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:28 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:52:29.326193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-9ca075fe-c3f9-4c76-a26e-331ac3d5c2d3 req-d8ef5e6f-b290-43ec-89fa-6ef1a090cda2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8b4eec-9bad-42fb-a1a8-0102fc56657d", "name": "network-vif-deleted", "tag": "10043143-a59a-49e4-88b8-cc4c22d1bfaf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:52:29.339341 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9ca075fe-c3f9-4c76-a26e-331ac3d5c2d3 req-d8ef5e6f-b290-43ec-89fa-6ef1a090cda2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:29.339886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-9ca075fe-c3f9-4c76-a26e-331ac3d5c2d3 req-d8ef5e6f-b290-43ec-89fa-6ef1a090cda2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:29.355582 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-9ca075fe-c3f9-4c76-a26e-331ac3d5c2d3 req-d8ef5e6f-b290-43ec-89fa-6ef1a090cda2 service nova] Creating event network-vif-deleted:10043143-a59a-49e4-88b8-cc4c22d1bfaf for instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d on n-h2-826529-8 Aug 03 02:52:29.362918 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-9ca075fe-c3f9-4c76-a26e-331ac3d5c2d3 req-d8ef5e6f-b290-43ec-89fa-6ef1a090cda2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041720 Aug 03 02:52:29.363771 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3410/6700] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:52:29.376948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e9ddadad-e137-4e14-b898-e7924f735554 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:29.377591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e9ddadad-e137-4e14-b898-e7924f735554 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:29.387146 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9ddadad-e137-4e14-b898-e7924f735554 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:29.387527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9ddadad-e137-4e14-b898-e7924f735554 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:29.388322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9ddadad-e137-4e14-b898-e7924f735554 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:29.388765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9ddadad-e137-4e14-b898-e7924f735554 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:29.459490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e9ddadad-e137-4e14-b898-e7924f735554 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:29.468074 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e9ddadad-e137-4e14-b898-e7924f735554 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 200 len: 1322 microversion: 2.1 time: 0.096293 Aug 03 02:52:29.468678 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3291/6701] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:29 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 1322 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:30.493436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-26d466bd-8c63-48c5-9364-20e51682ead4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:30.494492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-26d466bd-8c63-48c5-9364-20e51682ead4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:30.497237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:52:30.503262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26d466bd-8c63-48c5-9364-20e51682ead4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:30.503748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26d466bd-8c63-48c5-9364-20e51682ead4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:30.504520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26d466bd-8c63-48c5-9364-20e51682ead4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:30.504977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26d466bd-8c63-48c5-9364-20e51682ead4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:30.520860 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-26d466bd-8c63-48c5-9364-20e51682ead4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] HTTP exception thrown: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-26d466bd-8c63-48c5-9364-20e51682ead4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Request method failure captured: Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d HTTP/1.1 Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eKeTO9grXOxkCa6FoTdy4xisGe48wpNftmUsWS79LxdRUK_LQ-i9rR-LRmf_RsR0d0R2L33Na6U4SrN4RRH8mJYKXfLmcOPQ0_b7WgBoWh3OY0ufX1kuw7Kd1Co7FKtp3mmKHpa3Wv4IryoEDTAH4ADzqtGvfuXOg24sT2zGLa2XZ4 Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eec1de914edd4c8794c90561940c3402", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eec1de914edd4c8794c90561940c3402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}] Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4a6c42ecf1044bf79778ec5b4da0c270 Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '7c8b4eec-9bad-42fb-a1a8-0102fc56657d'} Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:52:30.522567 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:52:30.527943 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:52:30.527943 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:52:30.527943 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:52:30.527943 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:52:30.527943 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:52:30.527943 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:52:30.527943 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:52:30.527943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-26d466bd-8c63-48c5-9364-20e51682ead4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Returning 404 to user: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:52:30.527943 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-26d466bd-8c63-48c5-9364-20e51682ead4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 404 len: 111 microversion: 2.1 time: 0.036282 Aug 03 02:52:30.527943 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3411/6702] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:30 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:52:30.537127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5fe6ac4b-e0fb-415b-922d-1447025440fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:30.537760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5fe6ac4b-e0fb-415b-922d-1447025440fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:30.540533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=43 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:52:30.546125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fe6ac4b-e0fb-415b-922d-1447025440fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:30.546592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fe6ac4b-e0fb-415b-922d-1447025440fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:30.547566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fe6ac4b-e0fb-415b-922d-1447025440fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:30.548525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5fe6ac4b-e0fb-415b-922d-1447025440fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:30.562821 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-5fe6ac4b-e0fb-415b-922d-1447025440fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] HTTP exception thrown: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5fe6ac4b-e0fb-415b-922d-1447025440fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Request method failure captured: Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d HTTP/1.1 Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eKeTO9grXOxkCa6FoTdy4xisGe48wpNftmUsWS79LxdRUK_LQ-i9rR-LRmf_RsR0d0R2L33Na6U4SrN4RRH8mJYKXfLmcOPQ0_b7WgBoWh3OY0ufX1kuw7Kd1Co7FKtp3mmKHpa3Wv4IryoEDTAH4ADzqtGvfuXOg24sT2zGLa2XZ4 Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eec1de914edd4c8794c90561940c3402", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eec1de914edd4c8794c90561940c3402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}] Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4a6c42ecf1044bf79778ec5b4da0c270 Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '7c8b4eec-9bad-42fb-a1a8-0102fc56657d'} Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:52:30.565339 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:52:30.570854 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:52:30.570854 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:52:30.570854 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:52:30.570854 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:52:30.570854 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:52:30.570854 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:52:30.570854 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:52:30.570854 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5fe6ac4b-e0fb-415b-922d-1447025440fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Returning 404 to user: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:52:30.570854 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5fe6ac4b-e0fb-415b-922d-1447025440fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 404 len: 111 microversion: 2.1 time: 0.033842 Aug 03 02:52:30.570854 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3292/6703] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:30 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:52:30.615601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1121314", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "1026769a-4617-4108-a578-a580ac382a8b"}], "security_groups": [{"name": "tempest-securitygroup--1881219998"}], "key_name": "tempest-keypair-768996741", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:52:30.727633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] validate_networks() for [('1026769a-4617-4108-a578-a580ac382a8b', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:52:31.331713 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:52:31.332159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:52:31.332676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:52:31.333102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:52:31.333560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:52:31.342842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:31.343402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:31.344228 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:31.344740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:31.363293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Getting quotas for project eec1de914edd4c8794c90561940c3402. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:52:31.368722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Getting quotas for user 4a6c42ecf1044bf79778ec5b4da0c270 and project eec1de914edd4c8794c90561940c3402. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:52:31.382138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:52:31.384459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:52:31.432587 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1d822009-216b-4fbe-a1f0-4799117b3945 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.820920 Aug 03 02:52:31.433242 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3412/6704] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:52:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:52:31.445221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b168f2ae-b385-47bf-bb6c-fbd7ac453b6f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:31.445850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b168f2ae-b385-47bf-bb6c-fbd7ac453b6f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:31.499859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b168f2ae-b385-47bf-bb6c-fbd7ac453b6f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:31.507316 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b168f2ae-b385-47bf-bb6c-fbd7ac453b6f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1235 microversion: 2.1 time: 0.066043 Aug 03 02:52:31.507898 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3293/6705] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:31 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1235 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:32.529189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bcbdc691-521a-42fb-9a80-22f1d16a16d1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:32.529828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bcbdc691-521a-42fb-9a80-22f1d16a16d1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:32.539451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcbdc691-521a-42fb-9a80-22f1d16a16d1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:32.539921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcbdc691-521a-42fb-9a80-22f1d16a16d1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:32.540930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcbdc691-521a-42fb-9a80-22f1d16a16d1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:32.541391 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bcbdc691-521a-42fb-9a80-22f1d16a16d1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:32.608178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bcbdc691-521a-42fb-9a80-22f1d16a16d1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:32.616552 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bcbdc691-521a-42fb-9a80-22f1d16a16d1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1293 microversion: 2.1 time: 0.091346 Aug 03 02:52:32.617144 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3413/6706] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:32 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:33.638094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2dce7428-6245-4511-bb3b-fc3f10634acc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:33.639277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2dce7428-6245-4511-bb3b-fc3f10634acc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:33.650494 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2dce7428-6245-4511-bb3b-fc3f10634acc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:33.650993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2dce7428-6245-4511-bb3b-fc3f10634acc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:33.651805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2dce7428-6245-4511-bb3b-fc3f10634acc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:33.652267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2dce7428-6245-4511-bb3b-fc3f10634acc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:33.813407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2dce7428-6245-4511-bb3b-fc3f10634acc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:33.822445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-87d05a68-fd21-4cee-9e4e-7e99b4a7e3a8 req-df2c2d85-cc55-4f2e-b852-cf4287e6729a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7cf821d-dae8-43a9-bef5-247c320f6efb", "tag": "5f637ccd-a69b-4365-9b5a-418540b407a4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:52:33.824205 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2dce7428-6245-4511-bb3b-fc3f10634acc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1361 microversion: 2.1 time: 0.190267 Aug 03 02:52:33.824953 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3294/6707] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:33 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:33.833072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-87d05a68-fd21-4cee-9e4e-7e99b4a7e3a8 req-df2c2d85-cc55-4f2e-b852-cf4287e6729a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:33.833867 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-87d05a68-fd21-4cee-9e4e-7e99b4a7e3a8 req-df2c2d85-cc55-4f2e-b852-cf4287e6729a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:33.848672 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-87d05a68-fd21-4cee-9e4e-7e99b4a7e3a8 req-df2c2d85-cc55-4f2e-b852-cf4287e6729a service nova] Creating event network-changed:5f637ccd-a69b-4365-9b5a-418540b407a4 for instance c7cf821d-dae8-43a9-bef5-247c320f6efb on n-h1-826529-8 Aug 03 02:52:33.855198 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-87d05a68-fd21-4cee-9e4e-7e99b4a7e3a8 req-df2c2d85-cc55-4f2e-b852-cf4287e6729a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119357 Aug 03 02:52:33.855948 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3414/6708] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:52:34.846412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-188a3c82-a080-4bbd-b6dd-93a199a6ac1e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:34.847076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-188a3c82-a080-4bbd-b6dd-93a199a6ac1e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:34.854129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-188a3c82-a080-4bbd-b6dd-93a199a6ac1e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:34.854594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-188a3c82-a080-4bbd-b6dd-93a199a6ac1e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:34.855423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-188a3c82-a080-4bbd-b6dd-93a199a6ac1e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:34.855877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-188a3c82-a080-4bbd-b6dd-93a199a6ac1e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:34.991551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-188a3c82-a080-4bbd-b6dd-93a199a6ac1e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:35.000449 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-188a3c82-a080-4bbd-b6dd-93a199a6ac1e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1361 microversion: 2.1 time: 0.158525 Aug 03 02:52:35.001738 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3295/6709] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:34 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:36.023711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0904f021-3042-4800-a2f8-66351cb68cbb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:36.024351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0904f021-3042-4800-a2f8-66351cb68cbb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:36.031953 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0904f021-3042-4800-a2f8-66351cb68cbb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:36.033399 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0904f021-3042-4800-a2f8-66351cb68cbb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:36.034219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0904f021-3042-4800-a2f8-66351cb68cbb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:36.034701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0904f021-3042-4800-a2f8-66351cb68cbb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:36.172147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0904f021-3042-4800-a2f8-66351cb68cbb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:36.180769 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0904f021-3042-4800-a2f8-66351cb68cbb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1361 microversion: 2.1 time: 0.161426 Aug 03 02:52:36.181361 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3415/6710] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:36 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:37.202644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6bb736a4-66a8-4b67-a955-fa497f173570 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:37.203280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6bb736a4-66a8-4b67-a955-fa497f173570 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:37.210921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6bb736a4-66a8-4b67-a955-fa497f173570 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:37.211402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6bb736a4-66a8-4b67-a955-fa497f173570 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:37.212203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6bb736a4-66a8-4b67-a955-fa497f173570 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:37.212654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6bb736a4-66a8-4b67-a955-fa497f173570 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:37.354304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6bb736a4-66a8-4b67-a955-fa497f173570 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:37.362768 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6bb736a4-66a8-4b67-a955-fa497f173570 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1361 microversion: 2.1 time: 0.164041 Aug 03 02:52:37.363388 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3296/6711] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:37 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:52:38.385225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7ef77d04-fe16-47ab-9470-9a800b6469ab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:38.386173 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7ef77d04-fe16-47ab-9470-9a800b6469ab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:38.393271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ef77d04-fe16-47ab-9470-9a800b6469ab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:38.393731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ef77d04-fe16-47ab-9470-9a800b6469ab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:38.394519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ef77d04-fe16-47ab-9470-9a800b6469ab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:38.394994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ef77d04-fe16-47ab-9470-9a800b6469ab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:38.524577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7ef77d04-fe16-47ab-9470-9a800b6469ab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:38.532323 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7ef77d04-fe16-47ab-9470-9a800b6469ab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1361 microversion: 2.1 time: 0.151150 Aug 03 02:52:38.532897 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3416/6712] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:38 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:39.284200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-5fd003a3-f8ba-4c86-848c-831fefd50192 req-2c8e9598-e483-4ef7-a8e3-dd83a8c989f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7cf821d-dae8-43a9-bef5-247c320f6efb", "name": "network-vif-plugged", "status": "completed", "tag": "5f637ccd-a69b-4365-9b5a-418540b407a4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:52:39.295757 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5fd003a3-f8ba-4c86-848c-831fefd50192 req-2c8e9598-e483-4ef7-a8e3-dd83a8c989f3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:39.296257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5fd003a3-f8ba-4c86-848c-831fefd50192 req-2c8e9598-e483-4ef7-a8e3-dd83a8c989f3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:39.307923 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-5fd003a3-f8ba-4c86-848c-831fefd50192 req-2c8e9598-e483-4ef7-a8e3-dd83a8c989f3 service nova] Creating event network-vif-plugged:5f637ccd-a69b-4365-9b5a-418540b407a4 for instance c7cf821d-dae8-43a9-bef5-247c320f6efb on n-h1-826529-8 Aug 03 02:52:39.312941 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-5fd003a3-f8ba-4c86-848c-831fefd50192 req-2c8e9598-e483-4ef7-a8e3-dd83a8c989f3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033487 Aug 03 02:52:39.313891 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3297/6713] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:52:39.553174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b9fc710d-6f4b-4df8-9c9d-1537e95eb97c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:39.553813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b9fc710d-6f4b-4df8-9c9d-1537e95eb97c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:39.560900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9fc710d-6f4b-4df8-9c9d-1537e95eb97c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:39.561379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9fc710d-6f4b-4df8-9c9d-1537e95eb97c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:39.562183 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9fc710d-6f4b-4df8-9c9d-1537e95eb97c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:39.562676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b9fc710d-6f4b-4df8-9c9d-1537e95eb97c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:39.702683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b9fc710d-6f4b-4df8-9c9d-1537e95eb97c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:39.711095 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b9fc710d-6f4b-4df8-9c9d-1537e95eb97c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1361 microversion: 2.1 time: 0.161712 Aug 03 02:52:39.711677 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3417/6714] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:39 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:40.733821 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a01bc87f-5d6d-46bf-9a95-bcb63f5df5e5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:40.734443 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a01bc87f-5d6d-46bf-9a95-bcb63f5df5e5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:40.740831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a01bc87f-5d6d-46bf-9a95-bcb63f5df5e5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:40.741292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a01bc87f-5d6d-46bf-9a95-bcb63f5df5e5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:40.742418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a01bc87f-5d6d-46bf-9a95-bcb63f5df5e5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:40.742862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a01bc87f-5d6d-46bf-9a95-bcb63f5df5e5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:40.873953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a01bc87f-5d6d-46bf-9a95-bcb63f5df5e5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:52:40.882431 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a01bc87f-5d6d-46bf-9a95-bcb63f5df5e5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1548 microversion: 2.1 time: 0.153825 Aug 03 02:52:40.883036 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3298/6715] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:52:40 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:52:40.904446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c57d126c-5341-455a-9e25-e58f90d63eab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:52:40.905074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c57d126c-5341-455a-9e25-e58f90d63eab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:52:40.912185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c57d126c-5341-455a-9e25-e58f90d63eab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:40.912654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c57d126c-5341-455a-9e25-e58f90d63eab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:40.913444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c57d126c-5341-455a-9e25-e58f90d63eab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:40.913893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c57d126c-5341-455a-9e25-e58f90d63eab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:40.991726 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c57d126c-5341-455a-9e25-e58f90d63eab tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091190 Aug 03 02:52:40.992326 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3418/6716] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:52:40 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:52:41.933043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-6630fa31-6045-4401-9486-9a569cbd5b4d req-04a2163d-4392-4f58-85c3-d3ebe2264bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7cf821d-dae8-43a9-bef5-247c320f6efb", "tag": "5f637ccd-a69b-4365-9b5a-418540b407a4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:52:41.938072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:52:41.945676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6630fa31-6045-4401-9486-9a569cbd5b4d req-04a2163d-4392-4f58-85c3-d3ebe2264bab service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:52:41.946137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6630fa31-6045-4401-9486-9a569cbd5b4d req-04a2163d-4392-4f58-85c3-d3ebe2264bab service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:52:41.959347 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-6630fa31-6045-4401-9486-9a569cbd5b4d req-04a2163d-4392-4f58-85c3-d3ebe2264bab service nova] Creating event network-changed:5f637ccd-a69b-4365-9b5a-418540b407a4 for instance c7cf821d-dae8-43a9-bef5-247c320f6efb on n-h1-826529-8 Aug 03 02:52:41.964709 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-6630fa31-6045-4401-9486-9a569cbd5b4d req-04a2163d-4392-4f58-85c3-d3ebe2264bab service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035496 Aug 03 02:52:41.965737 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3299/6717] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:53:15.115700 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:53:15.116505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:53:15.118422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:53:15.119120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:53:15.125887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c9d8982e-ab5c-4a7e-8225-7dc4bd40da10 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:53:15.135380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9d8982e-ab5c-4a7e-8225-7dc4bd40da10 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:15.136124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9d8982e-ab5c-4a7e-8225-7dc4bd40da10 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:15.162273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c9d8982e-ab5c-4a7e-8225-7dc4bd40da10 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Going to try to stop instance {{(pid=125941) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 02:53:15.207098 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c9d8982e-ab5c-4a7e-8225-7dc4bd40da10 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "POST /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb/action" status: 202 len: 0 microversion: 2.1 time: 0.091920 Aug 03 02:53:15.207729 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3419/6718] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:53:15 2022] POST /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:53:15.214623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=17 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:53:15.215467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=50 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:53:15.219723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e491a3cd-a7b6-493c-b03b-7326e6e1b65b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:15.220448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e491a3cd-a7b6-493c-b03b-7326e6e1b65b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:15.228363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e491a3cd-a7b6-493c-b03b-7326e6e1b65b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:15.228926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e491a3cd-a7b6-493c-b03b-7326e6e1b65b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:15.229632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e491a3cd-a7b6-493c-b03b-7326e6e1b65b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:15.230083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e491a3cd-a7b6-493c-b03b-7326e6e1b65b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:15.375377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e491a3cd-a7b6-493c-b03b-7326e6e1b65b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:15.383749 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e491a3cd-a7b6-493c-b03b-7326e6e1b65b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1677 microversion: 2.1 time: 0.171239 Aug 03 02:53:15.384327 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3300/6719] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:15 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:53:16.407151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-506bbf62-6643-4112-a64d-34902add902d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:16.407873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-506bbf62-6643-4112-a64d-34902add902d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:16.415654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-506bbf62-6643-4112-a64d-34902add902d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:16.416129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-506bbf62-6643-4112-a64d-34902add902d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:16.416926 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-506bbf62-6643-4112-a64d-34902add902d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:16.417383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-506bbf62-6643-4112-a64d-34902add902d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:16.548894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-506bbf62-6643-4112-a64d-34902add902d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:16.557072 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-506bbf62-6643-4112-a64d-34902add902d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1677 microversion: 2.1 time: 0.155155 Aug 03 02:53:16.557659 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3420/6720] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:16 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:17.577780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-032a05a1-61b8-40f6-bed3-371d289e1d8a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:17.578381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-032a05a1-61b8-40f6-bed3-371d289e1d8a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:17.586392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-032a05a1-61b8-40f6-bed3-371d289e1d8a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:17.586850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-032a05a1-61b8-40f6-bed3-371d289e1d8a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:17.587740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-032a05a1-61b8-40f6-bed3-371d289e1d8a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:17.588181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-032a05a1-61b8-40f6-bed3-371d289e1d8a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:17.731855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-032a05a1-61b8-40f6-bed3-371d289e1d8a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:17.740648 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-032a05a1-61b8-40f6-bed3-371d289e1d8a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1677 microversion: 2.1 time: 0.166694 Aug 03 02:53:17.741261 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3301/6721] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:17 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:18.763821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-93231931-136e-4b40-90ff-45da98783889 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:18.764499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-93231931-136e-4b40-90ff-45da98783889 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:18.772373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93231931-136e-4b40-90ff-45da98783889 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:18.772831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93231931-136e-4b40-90ff-45da98783889 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:18.773694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93231931-136e-4b40-90ff-45da98783889 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:18.774146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93231931-136e-4b40-90ff-45da98783889 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:18.910757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-93231931-136e-4b40-90ff-45da98783889 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:18.918593 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-93231931-136e-4b40-90ff-45da98783889 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1677 microversion: 2.1 time: 0.158970 Aug 03 02:53:18.919203 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3421/6722] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:18 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:19.942019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-af7704d0-e0e3-49ff-8f2d-6a80d6102dd1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:19.942621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-af7704d0-e0e3-49ff-8f2d-6a80d6102dd1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:19.949052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af7704d0-e0e3-49ff-8f2d-6a80d6102dd1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:19.949514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af7704d0-e0e3-49ff-8f2d-6a80d6102dd1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:19.950302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af7704d0-e0e3-49ff-8f2d-6a80d6102dd1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:19.950747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af7704d0-e0e3-49ff-8f2d-6a80d6102dd1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:20.087429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-af7704d0-e0e3-49ff-8f2d-6a80d6102dd1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:20.095104 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-af7704d0-e0e3-49ff-8f2d-6a80d6102dd1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1677 microversion: 2.1 time: 0.157835 Aug 03 02:53:20.095679 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3302/6723] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:19 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:21.116779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-93da2269-fc6b-46d9-b0b6-e7a9b0c8c926 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:21.117445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-93da2269-fc6b-46d9-b0b6-e7a9b0c8c926 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:21.124516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93da2269-fc6b-46d9-b0b6-e7a9b0c8c926 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:21.124990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93da2269-fc6b-46d9-b0b6-e7a9b0c8c926 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:21.125784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93da2269-fc6b-46d9-b0b6-e7a9b0c8c926 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:21.126244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93da2269-fc6b-46d9-b0b6-e7a9b0c8c926 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:21.262562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-93da2269-fc6b-46d9-b0b6-e7a9b0c8c926 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:21.270860 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-93da2269-fc6b-46d9-b0b6-e7a9b0c8c926 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1677 microversion: 2.1 time: 0.158117 Aug 03 02:53:21.271499 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3422/6724] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:21 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:22.292979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3ed29085-b57b-4930-a1b9-ca93abd42ce5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:22.293595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3ed29085-b57b-4930-a1b9-ca93abd42ce5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:22.301956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ed29085-b57b-4930-a1b9-ca93abd42ce5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:22.302413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ed29085-b57b-4930-a1b9-ca93abd42ce5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:22.303235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ed29085-b57b-4930-a1b9-ca93abd42ce5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:22.303682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ed29085-b57b-4930-a1b9-ca93abd42ce5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:22.442698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3ed29085-b57b-4930-a1b9-ca93abd42ce5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:22.450690 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3ed29085-b57b-4930-a1b9-ca93abd42ce5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1677 microversion: 2.1 time: 0.161787 Aug 03 02:53:22.451374 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3303/6725] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:22 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:23.473333 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-37267137-674e-4a18-a3ae-539a4b1e565e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:23.473975 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-37267137-674e-4a18-a3ae-539a4b1e565e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:23.480362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37267137-674e-4a18-a3ae-539a4b1e565e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:23.480839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37267137-674e-4a18-a3ae-539a4b1e565e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:23.483457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37267137-674e-4a18-a3ae-539a4b1e565e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:23.483457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-37267137-674e-4a18-a3ae-539a4b1e565e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:23.624804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-37267137-674e-4a18-a3ae-539a4b1e565e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:23.636172 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-37267137-674e-4a18-a3ae-539a4b1e565e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1677 microversion: 2.1 time: 0.166479 Aug 03 02:53:23.636783 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3423/6726] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:23 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:24.661642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-58704c5e-150d-44b5-a086-0dfc75aeb82f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:24.662257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-58704c5e-150d-44b5-a086-0dfc75aeb82f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:24.669898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58704c5e-150d-44b5-a086-0dfc75aeb82f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:24.670358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58704c5e-150d-44b5-a086-0dfc75aeb82f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:24.671203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58704c5e-150d-44b5-a086-0dfc75aeb82f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:24.671652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-58704c5e-150d-44b5-a086-0dfc75aeb82f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:24.821837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-58704c5e-150d-44b5-a086-0dfc75aeb82f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:24.831873 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-58704c5e-150d-44b5-a086-0dfc75aeb82f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1677 microversion: 2.1 time: 0.175440 Aug 03 02:53:24.832116 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3304/6727] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:24 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:25.853036 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b09b3187-d633-4b39-b73f-7214fce9a132 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:25.853606 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b09b3187-d633-4b39-b73f-7214fce9a132 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:25.860651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b09b3187-d633-4b39-b73f-7214fce9a132 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:25.861129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b09b3187-d633-4b39-b73f-7214fce9a132 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:25.861922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b09b3187-d633-4b39-b73f-7214fce9a132 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:25.862392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b09b3187-d633-4b39-b73f-7214fce9a132 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:25.997684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b09b3187-d633-4b39-b73f-7214fce9a132 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:26.006378 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b09b3187-d633-4b39-b73f-7214fce9a132 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1654 microversion: 2.1 time: 0.157328 Aug 03 02:53:26.006993 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3424/6728] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:25 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:53:26.028059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2710b489-1494-4fbd-aaa0-f9d7574b68dd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:53:26.030384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2710b489-1494-4fbd-aaa0-f9d7574b68dd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:26.038072 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2710b489-1494-4fbd-aaa0-f9d7574b68dd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:26.038530 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2710b489-1494-4fbd-aaa0-f9d7574b68dd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:26.039499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2710b489-1494-4fbd-aaa0-f9d7574b68dd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:26.039948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2710b489-1494-4fbd-aaa0-f9d7574b68dd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:26.070066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2710b489-1494-4fbd-aaa0-f9d7574b68dd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:26.076629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2710b489-1494-4fbd-aaa0-f9d7574b68dd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Old instance type m1.heat2, new instance type m1.heat {{(pid=125942) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 02:53:26.084041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2710b489-1494-4fbd-aaa0-f9d7574b68dd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:53:26.084474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2710b489-1494-4fbd-aaa0-f9d7574b68dd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:53:26.084977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2710b489-1494-4fbd-aaa0-f9d7574b68dd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:53:26.085413 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2710b489-1494-4fbd-aaa0-f9d7574b68dd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:53:26.085798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-2710b489-1494-4fbd-aaa0-f9d7574b68dd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:53:26.154438 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2710b489-1494-4fbd-aaa0-f9d7574b68dd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "POST /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb/action" status: 202 len: 0 microversion: 2.1 time: 0.130233 Aug 03 02:53:26.155237 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3305/6729] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:53:26 2022] POST /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:53:26.163500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1205fa59-2d7e-4739-bcb9-37090bf40723 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:26.164154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1205fa59-2d7e-4739-bcb9-37090bf40723 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:26.170272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1205fa59-2d7e-4739-bcb9-37090bf40723 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:26.170741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1205fa59-2d7e-4739-bcb9-37090bf40723 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:26.171667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1205fa59-2d7e-4739-bcb9-37090bf40723 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:26.172121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1205fa59-2d7e-4739-bcb9-37090bf40723 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:26.317527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1205fa59-2d7e-4739-bcb9-37090bf40723 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:26.325809 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1205fa59-2d7e-4739-bcb9-37090bf40723 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1677 microversion: 2.1 time: 0.166247 Aug 03 02:53:26.326382 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3425/6730] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:26 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:27.350565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1cbd395d-3be6-4cd1-815c-501a0958627d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:27.351308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1cbd395d-3be6-4cd1-815c-501a0958627d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:27.357484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1cbd395d-3be6-4cd1-815c-501a0958627d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:27.357938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1cbd395d-3be6-4cd1-815c-501a0958627d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:27.358712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1cbd395d-3be6-4cd1-815c-501a0958627d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:27.359182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1cbd395d-3be6-4cd1-815c-501a0958627d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:27.501591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1cbd395d-3be6-4cd1-815c-501a0958627d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:27.509591 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1cbd395d-3be6-4cd1-815c-501a0958627d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1677 microversion: 2.1 time: 0.164495 Aug 03 02:53:27.510185 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3306/6731] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:27 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:28.532618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-62876145-eb76-44f5-8d2a-6fb70defc9cc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:28.533264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-62876145-eb76-44f5-8d2a-6fb70defc9cc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:28.541443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62876145-eb76-44f5-8d2a-6fb70defc9cc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:28.541920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62876145-eb76-44f5-8d2a-6fb70defc9cc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:28.542760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62876145-eb76-44f5-8d2a-6fb70defc9cc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:28.543246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62876145-eb76-44f5-8d2a-6fb70defc9cc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:28.679274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-62876145-eb76-44f5-8d2a-6fb70defc9cc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:28.687541 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-62876145-eb76-44f5-8d2a-6fb70defc9cc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1682 microversion: 2.1 time: 0.158942 Aug 03 02:53:28.688125 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3426/6732] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:28 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:29.710516 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9ad26bff-5d5a-43be-b4b6-1ddfe00dcd9d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:29.711161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9ad26bff-5d5a-43be-b4b6-1ddfe00dcd9d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:29.718175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9ad26bff-5d5a-43be-b4b6-1ddfe00dcd9d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:29.718627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9ad26bff-5d5a-43be-b4b6-1ddfe00dcd9d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:29.719437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9ad26bff-5d5a-43be-b4b6-1ddfe00dcd9d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:29.719881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9ad26bff-5d5a-43be-b4b6-1ddfe00dcd9d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:29.863345 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9ad26bff-5d5a-43be-b4b6-1ddfe00dcd9d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:29.871972 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9ad26bff-5d5a-43be-b4b6-1ddfe00dcd9d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1682 microversion: 2.1 time: 0.165600 Aug 03 02:53:29.872572 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3307/6733] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:29 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:30.398875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-30962077-2e18-4b15-b58f-e64e2ae7dcff req-117f3ccf-0f9a-40a4-96ad-326a33b7385c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7cf821d-dae8-43a9-bef5-247c320f6efb", "name": "network-vif-unplugged", "status": "completed", "tag": "5f637ccd-a69b-4365-9b5a-418540b407a4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:53:30.410526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-30962077-2e18-4b15-b58f-e64e2ae7dcff req-117f3ccf-0f9a-40a4-96ad-326a33b7385c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:30.411097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-30962077-2e18-4b15-b58f-e64e2ae7dcff req-117f3ccf-0f9a-40a4-96ad-326a33b7385c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:30.425218 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-30962077-2e18-4b15-b58f-e64e2ae7dcff req-117f3ccf-0f9a-40a4-96ad-326a33b7385c service nova] Creating event network-vif-unplugged:5f637ccd-a69b-4365-9b5a-418540b407a4 for instance c7cf821d-dae8-43a9-bef5-247c320f6efb on n-h2-826529-8 Aug 03 02:53:30.430871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-30962077-2e18-4b15-b58f-e64e2ae7dcff req-117f3ccf-0f9a-40a4-96ad-326a33b7385c service nova] Instance c7cf821d-dae8-43a9-bef5-247c320f6efb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:53:30.442980 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-30962077-2e18-4b15-b58f-e64e2ae7dcff req-117f3ccf-0f9a-40a4-96ad-326a33b7385c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048011 Aug 03 02:53:30.443976 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3427/6734] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:53:30.893926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-af6ca1d5-7235-45f3-9e61-697af5e80c68 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:30.894522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-af6ca1d5-7235-45f3-9e61-697af5e80c68 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:30.901774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af6ca1d5-7235-45f3-9e61-697af5e80c68 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:30.902226 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af6ca1d5-7235-45f3-9e61-697af5e80c68 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:30.903022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af6ca1d5-7235-45f3-9e61-697af5e80c68 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:30.903461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-af6ca1d5-7235-45f3-9e61-697af5e80c68 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:31.286127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-af6ca1d5-7235-45f3-9e61-697af5e80c68 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:31.294193 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-af6ca1d5-7235-45f3-9e61-697af5e80c68 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1681 microversion: 2.1 time: 0.404620 Aug 03 02:53:31.294917 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3308/6735] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:30 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1681 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:32.318421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f11210b9-e5f5-47ac-ac42-c1acd66198ca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:32.319060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f11210b9-e5f5-47ac-ac42-c1acd66198ca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:32.325283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f11210b9-e5f5-47ac-ac42-c1acd66198ca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:32.325747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f11210b9-e5f5-47ac-ac42-c1acd66198ca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:32.326522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f11210b9-e5f5-47ac-ac42-c1acd66198ca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:32.326998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f11210b9-e5f5-47ac-ac42-c1acd66198ca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:32.462399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-c8da29bf-e5ea-4977-b0ca-d42091b2f969 req-6e3c067e-891b-4bc1-bd4f-525aeba39429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7cf821d-dae8-43a9-bef5-247c320f6efb", "tag": "5f637ccd-a69b-4365-9b5a-418540b407a4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:53:32.470515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f11210b9-e5f5-47ac-ac42-c1acd66198ca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:32.472620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c8da29bf-e5ea-4977-b0ca-d42091b2f969 req-6e3c067e-891b-4bc1-bd4f-525aeba39429 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:32.473068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c8da29bf-e5ea-4977-b0ca-d42091b2f969 req-6e3c067e-891b-4bc1-bd4f-525aeba39429 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:32.479338 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f11210b9-e5f5-47ac-ac42-c1acd66198ca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1679 microversion: 2.1 time: 0.166586 Aug 03 02:53:32.479936 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3428/6736] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:32 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:32.485053 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c8da29bf-e5ea-4977-b0ca-d42091b2f969 req-6e3c067e-891b-4bc1-bd4f-525aeba39429 service nova] Creating event network-changed:5f637ccd-a69b-4365-9b5a-418540b407a4 for instance c7cf821d-dae8-43a9-bef5-247c320f6efb on n-h2-826529-8 Aug 03 02:53:32.491456 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-c8da29bf-e5ea-4977-b0ca-d42091b2f969 req-6e3c067e-891b-4bc1-bd4f-525aeba39429 service nova] Instance c7cf821d-dae8-43a9-bef5-247c320f6efb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:53:32.502415 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-c8da29bf-e5ea-4977-b0ca-d42091b2f969 req-6e3c067e-891b-4bc1-bd4f-525aeba39429 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044645 Aug 03 02:53:32.503334 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3309/6737] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:53:33.501771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03c70490-04f0-4702-aaba-d6dd2a11d53b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:33.502398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-03c70490-04f0-4702-aaba-d6dd2a11d53b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:33.509553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03c70490-04f0-4702-aaba-d6dd2a11d53b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:33.510023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03c70490-04f0-4702-aaba-d6dd2a11d53b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:33.511208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03c70490-04f0-4702-aaba-d6dd2a11d53b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:33.511617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03c70490-04f0-4702-aaba-d6dd2a11d53b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:33.728393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-03c70490-04f0-4702-aaba-d6dd2a11d53b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:33.738276 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03c70490-04f0-4702-aaba-d6dd2a11d53b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1675 microversion: 2.1 time: 0.240340 Aug 03 02:53:33.739498 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3429/6738] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:33 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1675 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:33.762750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c89383f7-1a4e-4124-9604-252d6068810f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:53:33.763418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c89383f7-1a4e-4124-9604-252d6068810f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:33.771581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c89383f7-1a4e-4124-9604-252d6068810f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:33.772041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c89383f7-1a4e-4124-9604-252d6068810f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:33.772850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c89383f7-1a4e-4124-9604-252d6068810f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:33.773296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c89383f7-1a4e-4124-9604-252d6068810f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:33.836846 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c89383f7-1a4e-4124-9604-252d6068810f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "POST /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb/action" status: 204 len: 0 microversion: 2.1 time: 0.079432 Aug 03 02:53:33.837833 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3310/6739] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:53:33 2022] POST /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:53:33.847232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2d7baa18-abad-47ae-aa6e-446885e36fcc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:33.847940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2d7baa18-abad-47ae-aa6e-446885e36fcc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:33.854257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d7baa18-abad-47ae-aa6e-446885e36fcc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:33.854735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d7baa18-abad-47ae-aa6e-446885e36fcc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:33.855569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d7baa18-abad-47ae-aa6e-446885e36fcc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:33.856080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d7baa18-abad-47ae-aa6e-446885e36fcc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:34.016199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2d7baa18-abad-47ae-aa6e-446885e36fcc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:34.025010 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2d7baa18-abad-47ae-aa6e-446885e36fcc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1675 microversion: 2.1 time: 0.183016 Aug 03 02:53:34.036396 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3430/6740] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:33 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:35.051230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e8e0e74f-e3d6-4fbf-8b12-f8fa86346193 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:35.051992 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e8e0e74f-e3d6-4fbf-8b12-f8fa86346193 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:35.059493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8e0e74f-e3d6-4fbf-8b12-f8fa86346193 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:35.059946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8e0e74f-e3d6-4fbf-8b12-f8fa86346193 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:35.060739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8e0e74f-e3d6-4fbf-8b12-f8fa86346193 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:35.061203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8e0e74f-e3d6-4fbf-8b12-f8fa86346193 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:35.214730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e8e0e74f-e3d6-4fbf-8b12-f8fa86346193 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:35.222828 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e8e0e74f-e3d6-4fbf-8b12-f8fa86346193 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1654 microversion: 2.1 time: 0.177063 Aug 03 02:53:35.223451 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3311/6741] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:35 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1654 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:35.243342 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e9f19f97-c0b2-403d-908d-ba7c8b0f0f7c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:35.243986 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e9f19f97-c0b2-403d-908d-ba7c8b0f0f7c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:35.250998 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9f19f97-c0b2-403d-908d-ba7c8b0f0f7c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:35.251465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9f19f97-c0b2-403d-908d-ba7c8b0f0f7c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:35.252307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9f19f97-c0b2-403d-908d-ba7c8b0f0f7c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:35.253486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9f19f97-c0b2-403d-908d-ba7c8b0f0f7c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:35.388355 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e9f19f97-c0b2-403d-908d-ba7c8b0f0f7c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:35.397113 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e9f19f97-c0b2-403d-908d-ba7c8b0f0f7c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1654 microversion: 2.1 time: 0.157703 Aug 03 02:53:35.397723 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3431/6742] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:35 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:35.418024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d1a64129-7f12-4d00-b605-af330842867d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:53:35.424325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1a64129-7f12-4d00-b605-af330842867d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:35.424994 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d1a64129-7f12-4d00-b605-af330842867d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:35.447995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d1a64129-7f12-4d00-b605-af330842867d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Going to try to start instance {{(pid=125942) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 02:53:35.492129 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d1a64129-7f12-4d00-b605-af330842867d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "POST /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb/action" status: 202 len: 0 microversion: 2.1 time: 0.077900 Aug 03 02:53:35.492779 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3312/6743] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:53:35 2022] POST /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:53:35.503963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aac9973b-52d8-4f12-b103-4066ddd87338 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:35.504863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-aac9973b-52d8-4f12-b103-4066ddd87338 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:35.515636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aac9973b-52d8-4f12-b103-4066ddd87338 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:35.516104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aac9973b-52d8-4f12-b103-4066ddd87338 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:35.516912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aac9973b-52d8-4f12-b103-4066ddd87338 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:35.517410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aac9973b-52d8-4f12-b103-4066ddd87338 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:35.751582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-aac9973b-52d8-4f12-b103-4066ddd87338 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:35.761354 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-aac9973b-52d8-4f12-b103-4066ddd87338 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1663 microversion: 2.1 time: 0.262980 Aug 03 02:53:35.762142 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3432/6744] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:35 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1663 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:36.111559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-a72053e0-1e2d-4630-8a64-ceadc80d1e1d req-e5a77ccc-5560-4d33-9b1d-6cdf82f6a220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7cf821d-dae8-43a9-bef5-247c320f6efb", "name": "network-vif-plugged", "status": "completed", "tag": "5f637ccd-a69b-4365-9b5a-418540b407a4"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:53:36.123103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a72053e0-1e2d-4630-8a64-ceadc80d1e1d req-e5a77ccc-5560-4d33-9b1d-6cdf82f6a220 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:36.123983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-a72053e0-1e2d-4630-8a64-ceadc80d1e1d req-e5a77ccc-5560-4d33-9b1d-6cdf82f6a220 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:36.138013 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-a72053e0-1e2d-4630-8a64-ceadc80d1e1d req-e5a77ccc-5560-4d33-9b1d-6cdf82f6a220 service nova] Creating event network-vif-plugged:5f637ccd-a69b-4365-9b5a-418540b407a4 for instance c7cf821d-dae8-43a9-bef5-247c320f6efb on n-h2-826529-8 Aug 03 02:53:36.143013 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-a72053e0-1e2d-4630-8a64-ceadc80d1e1d req-e5a77ccc-5560-4d33-9b1d-6cdf82f6a220 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103914 Aug 03 02:53:36.145042 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3313/6745] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:53:36.783202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-16316a1d-17f7-45fc-ad95-b139157d9c10 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:36.783838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-16316a1d-17f7-45fc-ad95-b139157d9c10 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:36.791634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16316a1d-17f7-45fc-ad95-b139157d9c10 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:36.792112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16316a1d-17f7-45fc-ad95-b139157d9c10 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:36.792899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16316a1d-17f7-45fc-ad95-b139157d9c10 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:36.793353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16316a1d-17f7-45fc-ad95-b139157d9c10 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:36.929654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-16316a1d-17f7-45fc-ad95-b139157d9c10 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:36.937317 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-16316a1d-17f7-45fc-ad95-b139157d9c10 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1667 microversion: 2.1 time: 0.158086 Aug 03 02:53:36.938022 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3433/6746] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:36 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:36.960660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-203cf220-62b8-448b-8b12-4fbcac2174a5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:36.961186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-203cf220-62b8-448b-8b12-4fbcac2174a5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:36.967539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-203cf220-62b8-448b-8b12-4fbcac2174a5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:36.968218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-203cf220-62b8-448b-8b12-4fbcac2174a5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:36.969010 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-203cf220-62b8-448b-8b12-4fbcac2174a5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:36.969461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-203cf220-62b8-448b-8b12-4fbcac2174a5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:36.973565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:53:37.000387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-203cf220-62b8-448b-8b12-4fbcac2174a5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:53:37.083019 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-203cf220-62b8-448b-8b12-4fbcac2174a5 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 204 len: 0 microversion: 2.1 time: 0.126835 Aug 03 02:53:37.083951 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3314/6747] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:53:36 2022] DELETE /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:53:37.098235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ba58e487-d330-4ede-905e-38b8b51a6828 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:37.098872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ba58e487-d330-4ede-905e-38b8b51a6828 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:37.105126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba58e487-d330-4ede-905e-38b8b51a6828 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:37.105591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba58e487-d330-4ede-905e-38b8b51a6828 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:37.106388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba58e487-d330-4ede-905e-38b8b51a6828 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:37.106841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba58e487-d330-4ede-905e-38b8b51a6828 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:37.244149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ba58e487-d330-4ede-905e-38b8b51a6828 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:37.247763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:53:37.253401 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ba58e487-d330-4ede-905e-38b8b51a6828 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1673 microversion: 2.1 time: 0.164349 Aug 03 02:53:37.253985 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3434/6748] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:37 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:53:38.276311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-405aeb54-de76-4064-b78a-02c01b0ff596 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:38.277266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-405aeb54-de76-4064-b78a-02c01b0ff596 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:38.285899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-405aeb54-de76-4064-b78a-02c01b0ff596 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:38.286363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-405aeb54-de76-4064-b78a-02c01b0ff596 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:38.287201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-405aeb54-de76-4064-b78a-02c01b0ff596 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:38.287652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-405aeb54-de76-4064-b78a-02c01b0ff596 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:38.423191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-405aeb54-de76-4064-b78a-02c01b0ff596 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:38.431342 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-405aeb54-de76-4064-b78a-02c01b0ff596 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1673 microversion: 2.1 time: 0.159439 Aug 03 02:53:38.431924 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3315/6749] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:38 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:39.379166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2cd88f3a-2af9-4cb3-86fa-6dbfd1407d3e req-156d5c5f-93e3-4ee0-a95a-549ee6e7588e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7cf821d-dae8-43a9-bef5-247c320f6efb", "name": "network-vif-deleted", "tag": "5f637ccd-a69b-4365-9b5a-418540b407a4"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:53:39.398834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2cd88f3a-2af9-4cb3-86fa-6dbfd1407d3e req-156d5c5f-93e3-4ee0-a95a-549ee6e7588e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:39.399495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2cd88f3a-2af9-4cb3-86fa-6dbfd1407d3e req-156d5c5f-93e3-4ee0-a95a-549ee6e7588e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:39.413331 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2cd88f3a-2af9-4cb3-86fa-6dbfd1407d3e req-156d5c5f-93e3-4ee0-a95a-549ee6e7588e service nova] Creating event network-vif-deleted:5f637ccd-a69b-4365-9b5a-418540b407a4 for instance c7cf821d-dae8-43a9-bef5-247c320f6efb on n-h2-826529-8 Aug 03 02:53:39.420671 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2cd88f3a-2af9-4cb3-86fa-6dbfd1407d3e req-156d5c5f-93e3-4ee0-a95a-549ee6e7588e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045405 Aug 03 02:53:39.421481 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3435/6750] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:53:39.454837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-30697e05-59f7-456c-9ff8-23aac5124418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:39.456247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-30697e05-59f7-456c-9ff8-23aac5124418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:39.463402 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30697e05-59f7-456c-9ff8-23aac5124418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:39.463869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30697e05-59f7-456c-9ff8-23aac5124418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:39.464661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30697e05-59f7-456c-9ff8-23aac5124418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:39.465123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30697e05-59f7-456c-9ff8-23aac5124418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:39.500120 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30697e05-59f7-456c-9ff8-23aac5124418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:39.500578 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30697e05-59f7-456c-9ff8-23aac5124418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:39.501183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-30697e05-59f7-456c-9ff8-23aac5124418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lazy-loading 'fault' on Instance uuid c7cf821d-dae8-43a9-bef5-247c320f6efb {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:53:39.544951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-30697e05-59f7-456c-9ff8-23aac5124418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:39.553234 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-30697e05-59f7-456c-9ff8-23aac5124418 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 200 len: 1325 microversion: 2.1 time: 0.102502 Aug 03 02:53:39.554128 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3316/6751] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:39 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 1325 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:40.577747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1bc6d8a-7faf-44f4-95e3-0280b4038bc7 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:40.578607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b1bc6d8a-7faf-44f4-95e3-0280b4038bc7 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:40.586581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1bc6d8a-7faf-44f4-95e3-0280b4038bc7 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:40.587112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1bc6d8a-7faf-44f4-95e3-0280b4038bc7 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:40.587918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1bc6d8a-7faf-44f4-95e3-0280b4038bc7 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:40.588379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1bc6d8a-7faf-44f4-95e3-0280b4038bc7 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:40.603342 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-b1bc6d8a-7faf-44f4-95e3-0280b4038bc7 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] HTTP exception thrown: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1bc6d8a-7faf-44f4-95e3-0280b4038bc7 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Request method failure captured: Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb HTTP/1.1 Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eKeTO9grXOxkCa6FoTdy4xisGe48wpNftmUsWS79LxdRUK_LQ-i9rR-LRmf_RsR0d0R2L33Na6U4SrN4RRH8mJYKXfLmcOPQ0_b7WgBoWh3OY0ufX1kuw7Kd1Co7FKtp3mmKHpa3Wv4IryoEDTAH4ADzqtGvfuXOg24sT2zGLa2XZ4 Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eec1de914edd4c8794c90561940c3402", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eec1de914edd4c8794c90561940c3402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}] Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4a6c42ecf1044bf79778ec5b4da0c270 Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'c7cf821d-dae8-43a9-bef5-247c320f6efb'} Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:53:40.605004 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:53:40.610639 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:53:40.610639 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:53:40.610639 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:53:40.610639 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:53:40.610639 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:53:40.610639 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:53:40.610639 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:53:40.610639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1bc6d8a-7faf-44f4-95e3-0280b4038bc7 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Returning 404 to user: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:53:40.610639 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b1bc6d8a-7faf-44f4-95e3-0280b4038bc7 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 404 len: 111 microversion: 2.1 time: 0.034788 Aug 03 02:53:40.610639 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3436/6752] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:40 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:53:40.621175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c5ee577d-1949-4abf-87cd-48a63f6a9b4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:40.621798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c5ee577d-1949-4abf-87cd-48a63f6a9b4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:40.630018 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5ee577d-1949-4abf-87cd-48a63f6a9b4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:40.630477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5ee577d-1949-4abf-87cd-48a63f6a9b4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:40.631289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5ee577d-1949-4abf-87cd-48a63f6a9b4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:40.631739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c5ee577d-1949-4abf-87cd-48a63f6a9b4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:40.646502 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-c5ee577d-1949-4abf-87cd-48a63f6a9b4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] HTTP exception thrown: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c5ee577d-1949-4abf-87cd-48a63f6a9b4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Request method failure captured: Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb HTTP/1.1 Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eKeTO9grXOxkCa6FoTdy4xisGe48wpNftmUsWS79LxdRUK_LQ-i9rR-LRmf_RsR0d0R2L33Na6U4SrN4RRH8mJYKXfLmcOPQ0_b7WgBoWh3OY0ufX1kuw7Kd1Co7FKtp3mmKHpa3Wv4IryoEDTAH4ADzqtGvfuXOg24sT2zGLa2XZ4 Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eec1de914edd4c8794c90561940c3402", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eec1de914edd4c8794c90561940c3402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}] Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4a6c42ecf1044bf79778ec5b4da0c270 Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'c7cf821d-dae8-43a9-bef5-247c320f6efb'} Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:53:40.648184 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:53:40.653591 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:53:40.653591 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:53:40.653591 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:53:40.653591 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:53:40.653591 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:53:40.653591 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:53:40.653591 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:53:40.653591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c5ee577d-1949-4abf-87cd-48a63f6a9b4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Returning 404 to user: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:53:40.653591 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c5ee577d-1949-4abf-87cd-48a63f6a9b4f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 404 len: 111 microversion: 2.1 time: 0.032366 Aug 03 02:53:40.653591 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3317/6753] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:40 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:53:40.699777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-388950031", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "1026769a-4617-4108-a578-a580ac382a8b"}], "security_groups": [{"name": "tempest-securitygroup--1881219998"}], "key_name": "tempest-keypair-768996741", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:53:40.808279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] validate_networks() for [('1026769a-4617-4108-a578-a580ac382a8b', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:53:41.228985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:53:41.229425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:53:41.229926 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:53:41.230353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:53:41.230780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:53:41.240618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:41.241085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:41.241908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:41.242357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:41.258961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Getting quotas for project eec1de914edd4c8794c90561940c3402. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:53:41.264488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Getting quotas for user 4a6c42ecf1044bf79778ec5b4da0c270 and project eec1de914edd4c8794c90561940c3402. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:53:41.276878 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:53:41.279220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:53:41.326749 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c80b3560-81e3-43f4-97ee-422ec6f3388e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.632048 Aug 03 02:53:41.327435 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3437/6754] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:53:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:53:41.338434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ae1dfe44-4758-43c0-bedc-a8df5a76cc57 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:41.339123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ae1dfe44-4758-43c0-bedc-a8df5a76cc57 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:41.396759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ae1dfe44-4758-43c0-bedc-a8df5a76cc57 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:41.404104 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ae1dfe44-4758-43c0-bedc-a8df5a76cc57 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1237 microversion: 2.1 time: 0.069525 Aug 03 02:53:41.404866 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3318/6755] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:41 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:42.428520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b196c331-227c-4216-b11a-3441434d5543 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:42.429874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b196c331-227c-4216-b11a-3441434d5543 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:42.438479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b196c331-227c-4216-b11a-3441434d5543 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:42.438985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b196c331-227c-4216-b11a-3441434d5543 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:42.439795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b196c331-227c-4216-b11a-3441434d5543 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:42.440937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b196c331-227c-4216-b11a-3441434d5543 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:42.507984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b196c331-227c-4216-b11a-3441434d5543 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:42.515868 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b196c331-227c-4216-b11a-3441434d5543 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1295 microversion: 2.1 time: 0.093272 Aug 03 02:53:42.516375 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3438/6756] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:42 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1295 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:43.538076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d58ed2aa-f7f3-4721-81e9-7577876e536e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:43.538711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d58ed2aa-f7f3-4721-81e9-7577876e536e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:43.546877 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d58ed2aa-f7f3-4721-81e9-7577876e536e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:43.547355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d58ed2aa-f7f3-4721-81e9-7577876e536e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:43.548155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d58ed2aa-f7f3-4721-81e9-7577876e536e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:43.548610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d58ed2aa-f7f3-4721-81e9-7577876e536e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:43.623501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-1ba2e81a-a959-473c-a890-6f66e44c0ea9 req-7d26905d-44b9-4814-9876-9f9534c4ce6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00391e73-c15c-46d9-8548-3eb81b5a0f3c", "tag": "5354c0ef-4c0a-4ec3-bf63-d66be49b41fc"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:53:43.640989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1ba2e81a-a959-473c-a890-6f66e44c0ea9 req-7d26905d-44b9-4814-9876-9f9534c4ce6c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:43.641789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-1ba2e81a-a959-473c-a890-6f66e44c0ea9 req-7d26905d-44b9-4814-9876-9f9534c4ce6c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:43.658644 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-1ba2e81a-a959-473c-a890-6f66e44c0ea9 req-7d26905d-44b9-4814-9876-9f9534c4ce6c service nova] Creating event network-changed:5354c0ef-4c0a-4ec3-bf63-d66be49b41fc for instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c on n-h1-826529-8 Aug 03 02:53:43.665229 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-1ba2e81a-a959-473c-a890-6f66e44c0ea9 req-7d26905d-44b9-4814-9876-9f9534c4ce6c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045243 Aug 03 02:53:43.665867 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3439/6757] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:53:43.711389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d58ed2aa-f7f3-4721-81e9-7577876e536e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:43.719095 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d58ed2aa-f7f3-4721-81e9-7577876e536e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1363 microversion: 2.1 time: 0.185287 Aug 03 02:53:43.719675 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3319/6758] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:43 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:44.741826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2ec66033-4068-44a1-a00f-06f3cd680f84 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:44.742548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2ec66033-4068-44a1-a00f-06f3cd680f84 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:44.749848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ec66033-4068-44a1-a00f-06f3cd680f84 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:44.750329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ec66033-4068-44a1-a00f-06f3cd680f84 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:44.751165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ec66033-4068-44a1-a00f-06f3cd680f84 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:44.751628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2ec66033-4068-44a1-a00f-06f3cd680f84 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:44.883802 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2ec66033-4068-44a1-a00f-06f3cd680f84 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:44.891602 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2ec66033-4068-44a1-a00f-06f3cd680f84 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1363 microversion: 2.1 time: 0.154122 Aug 03 02:53:44.892173 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3440/6759] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:44 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:45.913813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e767d72f-74be-4204-87dc-5606dff3d7fd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:45.914436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e767d72f-74be-4204-87dc-5606dff3d7fd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:45.917446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:53:45.923104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e767d72f-74be-4204-87dc-5606dff3d7fd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:45.923569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e767d72f-74be-4204-87dc-5606dff3d7fd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:45.925055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e767d72f-74be-4204-87dc-5606dff3d7fd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:45.925514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e767d72f-74be-4204-87dc-5606dff3d7fd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:46.062946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e767d72f-74be-4204-87dc-5606dff3d7fd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:46.070681 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e767d72f-74be-4204-87dc-5606dff3d7fd tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1363 microversion: 2.1 time: 0.160939 Aug 03 02:53:46.071291 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3320/6760] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:45 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:47.093071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4787115a-41d7-4400-86c6-648d134f7575 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:47.093699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4787115a-41d7-4400-86c6-648d134f7575 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:47.097901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:53:47.103521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4787115a-41d7-4400-86c6-648d134f7575 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:47.103984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4787115a-41d7-4400-86c6-648d134f7575 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:47.104766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4787115a-41d7-4400-86c6-648d134f7575 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:47.105214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4787115a-41d7-4400-86c6-648d134f7575 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:47.239730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4787115a-41d7-4400-86c6-648d134f7575 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:47.247254 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4787115a-41d7-4400-86c6-648d134f7575 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1363 microversion: 2.1 time: 0.158074 Aug 03 02:53:47.247835 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3441/6761] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:47 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:47.552666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-1c871f56-1d3f-44d9-96ac-ef0aa9307399 req-c397b2e7-adb2-4519-af40-ae2e6f963035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00391e73-c15c-46d9-8548-3eb81b5a0f3c", "name": "network-vif-plugged", "status": "completed", "tag": "5354c0ef-4c0a-4ec3-bf63-d66be49b41fc"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:53:47.563818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1c871f56-1d3f-44d9-96ac-ef0aa9307399 req-c397b2e7-adb2-4519-af40-ae2e6f963035 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:47.564295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1c871f56-1d3f-44d9-96ac-ef0aa9307399 req-c397b2e7-adb2-4519-af40-ae2e6f963035 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:47.575842 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-1c871f56-1d3f-44d9-96ac-ef0aa9307399 req-c397b2e7-adb2-4519-af40-ae2e6f963035 service nova] Creating event network-vif-plugged:5354c0ef-4c0a-4ec3-bf63-d66be49b41fc for instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c on n-h1-826529-8 Aug 03 02:53:47.581672 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-1c871f56-1d3f-44d9-96ac-ef0aa9307399 req-c397b2e7-adb2-4519-af40-ae2e6f963035 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032670 Aug 03 02:53:47.582723 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3321/6762] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:53:48.270868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-21230114-c093-41a1-b74d-20d6cc3c8d3a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:48.271513 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-21230114-c093-41a1-b74d-20d6cc3c8d3a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:48.277807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21230114-c093-41a1-b74d-20d6cc3c8d3a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:48.278271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21230114-c093-41a1-b74d-20d6cc3c8d3a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:48.279086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21230114-c093-41a1-b74d-20d6cc3c8d3a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:48.279535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-21230114-c093-41a1-b74d-20d6cc3c8d3a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:48.414801 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-21230114-c093-41a1-b74d-20d6cc3c8d3a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:48.422299 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-21230114-c093-41a1-b74d-20d6cc3c8d3a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1363 microversion: 2.1 time: 0.157121 Aug 03 02:53:48.422870 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3442/6763] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:48 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:49.446768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8a372f8a-d2d3-4f63-a35f-08d53d924406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:49.447518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8a372f8a-d2d3-4f63-a35f-08d53d924406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:49.454069 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8a372f8a-d2d3-4f63-a35f-08d53d924406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:49.454537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8a372f8a-d2d3-4f63-a35f-08d53d924406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:49.456052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8a372f8a-d2d3-4f63-a35f-08d53d924406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:49.456618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8a372f8a-d2d3-4f63-a35f-08d53d924406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:49.590521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8a372f8a-d2d3-4f63-a35f-08d53d924406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:53:49.598821 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8a372f8a-d2d3-4f63-a35f-08d53d924406 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1549 microversion: 2.1 time: 0.157384 Aug 03 02:53:49.599438 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3322/6764] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:53:49 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:53:49.620614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-04fb8f82-fadb-443d-9ec5-198f9621578e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:53:49.621142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-04fb8f82-fadb-443d-9ec5-198f9621578e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:53:49.628930 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04fb8f82-fadb-443d-9ec5-198f9621578e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:49.629402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04fb8f82-fadb-443d-9ec5-198f9621578e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:49.630196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04fb8f82-fadb-443d-9ec5-198f9621578e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:49.630657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04fb8f82-fadb-443d-9ec5-198f9621578e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:49.709226 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-04fb8f82-fadb-443d-9ec5-198f9621578e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092572 Aug 03 02:53:49.709826 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3443/6765] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:53:49 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:53:50.911897 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-8e97f0ce-1136-4d42-ba34-8b4cfed46fd7 req-043ddc32-c7f4-4d4e-b1b2-95475fd1d3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00391e73-c15c-46d9-8548-3eb81b5a0f3c", "tag": "5354c0ef-4c0a-4ec3-bf63-d66be49b41fc"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:53:50.923169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8e97f0ce-1136-4d42-ba34-8b4cfed46fd7 req-043ddc32-c7f4-4d4e-b1b2-95475fd1d3e0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:53:50.923741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8e97f0ce-1136-4d42-ba34-8b4cfed46fd7 req-043ddc32-c7f4-4d4e-b1b2-95475fd1d3e0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:53:50.936299 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-8e97f0ce-1136-4d42-ba34-8b4cfed46fd7 req-043ddc32-c7f4-4d4e-b1b2-95475fd1d3e0 service nova] Creating event network-changed:5354c0ef-4c0a-4ec3-bf63-d66be49b41fc for instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c on n-h1-826529-8 Aug 03 02:53:50.943433 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-8e97f0ce-1136-4d42-ba34-8b4cfed46fd7 req-043ddc32-c7f4-4d4e-b1b2-95475fd1d3e0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035575 Aug 03 02:53:50.944196 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3323/6766] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:54:19.629668 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:54:19.630323 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 02:54:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:54:19.738061 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:54:19.739216 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 02:54:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:54:26.081789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:54:26.082585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:54:26.083345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=5 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:54:26.083994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=36 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:54:26.088054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9197c192-d218-45e5-8659-420605b97baf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:54:26.090416 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9197c192-d218-45e5-8659-420605b97baf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:26.099576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9197c192-d218-45e5-8659-420605b97baf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:26.100047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9197c192-d218-45e5-8659-420605b97baf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:26.100848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9197c192-d218-45e5-8659-420605b97baf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:26.101309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9197c192-d218-45e5-8659-420605b97baf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:26.129960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9197c192-d218-45e5-8659-420605b97baf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:26.136281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9197c192-d218-45e5-8659-420605b97baf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Old instance type m1.heat2, new instance type m1.heat {{(pid=125941) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 02:54:26.142501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-9197c192-d218-45e5-8659-420605b97baf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:54:26.142965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-9197c192-d218-45e5-8659-420605b97baf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:54:26.143466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-9197c192-d218-45e5-8659-420605b97baf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:54:26.143898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-9197c192-d218-45e5-8659-420605b97baf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:54:26.144383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-9197c192-d218-45e5-8659-420605b97baf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:54:26.212187 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9197c192-d218-45e5-8659-420605b97baf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "POST /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c/action" status: 202 len: 0 microversion: 2.1 time: 0.131654 Aug 03 02:54:26.213002 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3444/6767] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:54:26 2022] POST /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:54:26.218322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:54:26.220977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=7 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:54:26.221086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:54:26.225817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d4f112cd-301c-45c5-861f-aef0d80c5ed9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:26.226536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d4f112cd-301c-45c5-861f-aef0d80c5ed9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:26.236216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4f112cd-301c-45c5-861f-aef0d80c5ed9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:26.236682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4f112cd-301c-45c5-861f-aef0d80c5ed9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:26.237486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4f112cd-301c-45c5-861f-aef0d80c5ed9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:26.238000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4f112cd-301c-45c5-861f-aef0d80c5ed9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:26.380610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d4f112cd-301c-45c5-861f-aef0d80c5ed9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:26.391152 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d4f112cd-301c-45c5-861f-aef0d80c5ed9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1677 microversion: 2.1 time: 0.173582 Aug 03 02:54:26.392409 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3324/6768] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:26 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:27.416363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b421c707-6b72-4526-ab06-023ca2e7e048 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:27.416363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b421c707-6b72-4526-ab06-023ca2e7e048 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:27.423854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b421c707-6b72-4526-ab06-023ca2e7e048 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:27.424317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b421c707-6b72-4526-ab06-023ca2e7e048 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:27.425288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b421c707-6b72-4526-ab06-023ca2e7e048 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:27.426098 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b421c707-6b72-4526-ab06-023ca2e7e048 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:27.570080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b421c707-6b72-4526-ab06-023ca2e7e048 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:27.578849 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b421c707-6b72-4526-ab06-023ca2e7e048 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1677 microversion: 2.1 time: 0.168436 Aug 03 02:54:27.579567 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3445/6769] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:27 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:28.604459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3a320bfd-ad74-479f-a79e-181e4db66854 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:28.605133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3a320bfd-ad74-479f-a79e-181e4db66854 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:28.613709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a320bfd-ad74-479f-a79e-181e4db66854 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:28.614186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a320bfd-ad74-479f-a79e-181e4db66854 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:28.615026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a320bfd-ad74-479f-a79e-181e4db66854 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:28.615481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3a320bfd-ad74-479f-a79e-181e4db66854 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:28.751194 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3a320bfd-ad74-479f-a79e-181e4db66854 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:28.759557 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3a320bfd-ad74-479f-a79e-181e4db66854 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1682 microversion: 2.1 time: 0.159020 Aug 03 02:54:28.760133 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3325/6770] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:28 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:29.781926 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-96cc4889-2d0d-4c8e-81e6-6efb79246358 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:29.782566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-96cc4889-2d0d-4c8e-81e6-6efb79246358 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:29.789693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96cc4889-2d0d-4c8e-81e6-6efb79246358 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:29.790165 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96cc4889-2d0d-4c8e-81e6-6efb79246358 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:29.790984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96cc4889-2d0d-4c8e-81e6-6efb79246358 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:29.791445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96cc4889-2d0d-4c8e-81e6-6efb79246358 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:29.933876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-96cc4889-2d0d-4c8e-81e6-6efb79246358 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:29.941679 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-96cc4889-2d0d-4c8e-81e6-6efb79246358 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1682 microversion: 2.1 time: 0.163760 Aug 03 02:54:29.942257 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3446/6771] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:29 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:30.963666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3c8c116c-b5d9-4518-b273-d500648fb909 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:30.964278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3c8c116c-b5d9-4518-b273-d500648fb909 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:30.971297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c8c116c-b5d9-4518-b273-d500648fb909 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:30.971753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c8c116c-b5d9-4518-b273-d500648fb909 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:30.972886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c8c116c-b5d9-4518-b273-d500648fb909 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:30.973328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c8c116c-b5d9-4518-b273-d500648fb909 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:31.105694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3c8c116c-b5d9-4518-b273-d500648fb909 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:31.115028 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3c8c116c-b5d9-4518-b273-d500648fb909 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1682 microversion: 2.1 time: 0.154804 Aug 03 02:54:31.115286 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3326/6772] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:30 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:32.140486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-87f37799-9f64-470a-90fd-703397d93a47 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:32.141422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-87f37799-9f64-470a-90fd-703397d93a47 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:32.148291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87f37799-9f64-470a-90fd-703397d93a47 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:32.148760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87f37799-9f64-470a-90fd-703397d93a47 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:32.149551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87f37799-9f64-470a-90fd-703397d93a47 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:32.150003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-87f37799-9f64-470a-90fd-703397d93a47 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:32.283657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-87f37799-9f64-470a-90fd-703397d93a47 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:32.292036 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-87f37799-9f64-470a-90fd-703397d93a47 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1682 microversion: 2.1 time: 0.155472 Aug 03 02:54:32.292624 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3447/6773] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:32 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:54:33.314006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a9042416-c32d-43e0-805f-1c37e3aa263b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:33.314643 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a9042416-c32d-43e0-805f-1c37e3aa263b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:33.321857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9042416-c32d-43e0-805f-1c37e3aa263b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:33.322313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9042416-c32d-43e0-805f-1c37e3aa263b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:33.323138 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9042416-c32d-43e0-805f-1c37e3aa263b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:33.323594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9042416-c32d-43e0-805f-1c37e3aa263b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:33.463292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a9042416-c32d-43e0-805f-1c37e3aa263b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:33.470888 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a9042416-c32d-43e0-805f-1c37e3aa263b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1682 microversion: 2.1 time: 0.160888 Aug 03 02:54:33.471500 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3327/6774] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:33 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:34.494426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-66395aa5-c2f8-42d1-9121-186f56757b98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:34.495114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-66395aa5-c2f8-42d1-9121-186f56757b98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:34.502110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66395aa5-c2f8-42d1-9121-186f56757b98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:34.502585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66395aa5-c2f8-42d1-9121-186f56757b98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:34.503740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66395aa5-c2f8-42d1-9121-186f56757b98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:34.504336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66395aa5-c2f8-42d1-9121-186f56757b98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:34.635704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-66395aa5-c2f8-42d1-9121-186f56757b98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:34.643302 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-66395aa5-c2f8-42d1-9121-186f56757b98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1682 microversion: 2.1 time: 0.152961 Aug 03 02:54:34.643914 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3448/6775] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:34 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:35.666176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-91ea60dc-47bf-4c74-b9a3-b66ebc2dadb4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:35.666803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-91ea60dc-47bf-4c74-b9a3-b66ebc2dadb4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:35.673869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91ea60dc-47bf-4c74-b9a3-b66ebc2dadb4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:35.674329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91ea60dc-47bf-4c74-b9a3-b66ebc2dadb4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:35.675220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91ea60dc-47bf-4c74-b9a3-b66ebc2dadb4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:35.675673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-91ea60dc-47bf-4c74-b9a3-b66ebc2dadb4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:35.824625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-91ea60dc-47bf-4c74-b9a3-b66ebc2dadb4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:35.832693 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-91ea60dc-47bf-4c74-b9a3-b66ebc2dadb4 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1682 microversion: 2.1 time: 0.170634 Aug 03 02:54:35.833286 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3328/6776] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:35 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:36.854550 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8e8705a2-188b-4708-8dcd-3e976d240763 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:36.855369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8e8705a2-188b-4708-8dcd-3e976d240763 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:36.863424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e8705a2-188b-4708-8dcd-3e976d240763 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:36.863895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e8705a2-188b-4708-8dcd-3e976d240763 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:36.864723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e8705a2-188b-4708-8dcd-3e976d240763 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:36.865215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8e8705a2-188b-4708-8dcd-3e976d240763 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:37.016551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8e8705a2-188b-4708-8dcd-3e976d240763 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:37.024625 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8e8705a2-188b-4708-8dcd-3e976d240763 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1682 microversion: 2.1 time: 0.174399 Aug 03 02:54:37.025198 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3449/6777] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:36 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:38.053326 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-418b4000-c6ca-4cea-a920-849e3988f7c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:38.053952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-418b4000-c6ca-4cea-a920-849e3988f7c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:38.061209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-418b4000-c6ca-4cea-a920-849e3988f7c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:38.061667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-418b4000-c6ca-4cea-a920-849e3988f7c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:38.062481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-418b4000-c6ca-4cea-a920-849e3988f7c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:38.062948 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-418b4000-c6ca-4cea-a920-849e3988f7c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:38.203188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-418b4000-c6ca-4cea-a920-849e3988f7c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:38.211280 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-418b4000-c6ca-4cea-a920-849e3988f7c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1682 microversion: 2.1 time: 0.163326 Aug 03 02:54:38.212375 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3329/6778] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:38 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:39.233345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f15d6315-cb72-4cbc-a84c-fcb8b79106bf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:39.234328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f15d6315-cb72-4cbc-a84c-fcb8b79106bf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:39.242214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f15d6315-cb72-4cbc-a84c-fcb8b79106bf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:39.242692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f15d6315-cb72-4cbc-a84c-fcb8b79106bf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:39.243535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f15d6315-cb72-4cbc-a84c-fcb8b79106bf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:39.243999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f15d6315-cb72-4cbc-a84c-fcb8b79106bf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:39.387132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f15d6315-cb72-4cbc-a84c-fcb8b79106bf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:39.395108 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f15d6315-cb72-4cbc-a84c-fcb8b79106bf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1682 microversion: 2.1 time: 0.165869 Aug 03 02:54:39.395695 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3450/6779] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:39 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:40.416574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-43e4265a-ef69-479e-a041-582618c84e06 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:40.417320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-43e4265a-ef69-479e-a041-582618c84e06 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:40.426551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43e4265a-ef69-479e-a041-582618c84e06 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:40.427053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43e4265a-ef69-479e-a041-582618c84e06 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:40.427862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43e4265a-ef69-479e-a041-582618c84e06 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:40.428307 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43e4265a-ef69-479e-a041-582618c84e06 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:40.571139 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-43e4265a-ef69-479e-a041-582618c84e06 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:40.579257 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-43e4265a-ef69-479e-a041-582618c84e06 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1682 microversion: 2.1 time: 0.166586 Aug 03 02:54:40.579940 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3330/6780] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:40 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:40.999439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c5864d95-c8e9-4723-9e56-e9ea94dfa856 req-2d16415d-d327-4895-ada6-037c158a5845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00391e73-c15c-46d9-8548-3eb81b5a0f3c", "name": "network-vif-unplugged", "status": "completed", "tag": "5354c0ef-4c0a-4ec3-bf63-d66be49b41fc"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:54:41.011106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c5864d95-c8e9-4723-9e56-e9ea94dfa856 req-2d16415d-d327-4895-ada6-037c158a5845 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:41.011724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c5864d95-c8e9-4723-9e56-e9ea94dfa856 req-2d16415d-d327-4895-ada6-037c158a5845 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:41.026120 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c5864d95-c8e9-4723-9e56-e9ea94dfa856 req-2d16415d-d327-4895-ada6-037c158a5845 service nova] Creating event network-vif-unplugged:5354c0ef-4c0a-4ec3-bf63-d66be49b41fc for instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c on n-h2-826529-8 Aug 03 02:54:41.032350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-c5864d95-c8e9-4723-9e56-e9ea94dfa856 req-2d16415d-d327-4895-ada6-037c158a5845 service nova] Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:54:41.045897 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c5864d95-c8e9-4723-9e56-e9ea94dfa856 req-2d16415d-d327-4895-ada6-037c158a5845 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050040 Aug 03 02:54:41.046520 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3451/6781] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:54:41.604628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f2a6e7ae-3a05-4ce9-a474-61eda4eac060 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:41.605271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f2a6e7ae-3a05-4ce9-a474-61eda4eac060 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:41.612881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2a6e7ae-3a05-4ce9-a474-61eda4eac060 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:41.613596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2a6e7ae-3a05-4ce9-a474-61eda4eac060 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:41.614414 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2a6e7ae-3a05-4ce9-a474-61eda4eac060 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:41.614864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2a6e7ae-3a05-4ce9-a474-61eda4eac060 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:41.849422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f2a6e7ae-3a05-4ce9-a474-61eda4eac060 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:41.860682 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f2a6e7ae-3a05-4ce9-a474-61eda4eac060 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1681 microversion: 2.1 time: 0.260349 Aug 03 02:54:41.874927 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3331/6782] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:41 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1681 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:42.884142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-035d9856-7372-40f9-a89e-44f4d32db44e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:42.884863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-035d9856-7372-40f9-a89e-44f4d32db44e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:42.892365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-035d9856-7372-40f9-a89e-44f4d32db44e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:42.892812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-035d9856-7372-40f9-a89e-44f4d32db44e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:42.893711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-035d9856-7372-40f9-a89e-44f4d32db44e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:42.894059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-035d9856-7372-40f9-a89e-44f4d32db44e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:43.028934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-035d9856-7372-40f9-a89e-44f4d32db44e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:43.037494 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-035d9856-7372-40f9-a89e-44f4d32db44e tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1679 microversion: 2.1 time: 0.157668 Aug 03 02:54:43.038087 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3452/6783] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:42 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:43.068029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-29819ba3-a7b2-48b6-b9c6-cd01f0e1f1be req-36320a48-0378-4f3f-aaf4-1a0e09d2fd9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00391e73-c15c-46d9-8548-3eb81b5a0f3c", "tag": "5354c0ef-4c0a-4ec3-bf63-d66be49b41fc"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:54:43.078348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-29819ba3-a7b2-48b6-b9c6-cd01f0e1f1be req-36320a48-0378-4f3f-aaf4-1a0e09d2fd9c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:43.078802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-29819ba3-a7b2-48b6-b9c6-cd01f0e1f1be req-36320a48-0378-4f3f-aaf4-1a0e09d2fd9c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:43.091410 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-29819ba3-a7b2-48b6-b9c6-cd01f0e1f1be req-36320a48-0378-4f3f-aaf4-1a0e09d2fd9c service nova] Creating event network-changed:5354c0ef-4c0a-4ec3-bf63-d66be49b41fc for instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c on n-h2-826529-8 Aug 03 02:54:43.097488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-29819ba3-a7b2-48b6-b9c6-cd01f0e1f1be req-36320a48-0378-4f3f-aaf4-1a0e09d2fd9c service nova] Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:54:43.109546 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-29819ba3-a7b2-48b6-b9c6-cd01f0e1f1be req-36320a48-0378-4f3f-aaf4-1a0e09d2fd9c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045384 Aug 03 02:54:43.110171 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3332/6784] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:54:44.059371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d94890f1-602e-4d6c-9628-3c209c98660a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:44.060163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d94890f1-602e-4d6c-9628-3c209c98660a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:44.067764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d94890f1-602e-4d6c-9628-3c209c98660a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:44.068294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d94890f1-602e-4d6c-9628-3c209c98660a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:44.069089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d94890f1-602e-4d6c-9628-3c209c98660a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:44.069547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d94890f1-602e-4d6c-9628-3c209c98660a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:44.205890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d94890f1-602e-4d6c-9628-3c209c98660a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:44.214682 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d94890f1-602e-4d6c-9628-3c209c98660a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1676 microversion: 2.1 time: 0.159176 Aug 03 02:54:44.215403 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3453/6785] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:44 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:44.237185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-085d0c7c-c667-47a0-abe9-6c7dab65ddce tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:54:44.238722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-085d0c7c-c667-47a0-abe9-6c7dab65ddce tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:44.246101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-085d0c7c-c667-47a0-abe9-6c7dab65ddce tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:44.246931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-085d0c7c-c667-47a0-abe9-6c7dab65ddce tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:44.247761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-085d0c7c-c667-47a0-abe9-6c7dab65ddce tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:44.248209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-085d0c7c-c667-47a0-abe9-6c7dab65ddce tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:44.288952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-085d0c7c-c667-47a0-abe9-6c7dab65ddce tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:44.289416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-085d0c7c-c667-47a0-abe9-6c7dab65ddce tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:44.290227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-085d0c7c-c667-47a0-abe9-6c7dab65ddce tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:44.290671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-085d0c7c-c667-47a0-abe9-6c7dab65ddce tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:44.314190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-085d0c7c-c667-47a0-abe9-6c7dab65ddce tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Getting quotas for project eec1de914edd4c8794c90561940c3402. Resources: {'cores', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:54:44.320077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-085d0c7c-c667-47a0-abe9-6c7dab65ddce tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Getting quotas for user 4a6c42ecf1044bf79778ec5b4da0c270 and project eec1de914edd4c8794c90561940c3402. Resources: {'cores', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:54:44.427070 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-085d0c7c-c667-47a0-abe9-6c7dab65ddce tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "POST /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c/action" status: 202 len: 0 microversion: 2.1 time: 0.194029 Aug 03 02:54:44.427661 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3333/6786] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:54:44 2022] POST /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:54:44.435831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-43a0784d-c89b-493d-8afd-5987b5968069 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:44.436550 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-43a0784d-c89b-493d-8afd-5987b5968069 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:44.442854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43a0784d-c89b-493d-8afd-5987b5968069 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:44.443371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43a0784d-c89b-493d-8afd-5987b5968069 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:44.444161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43a0784d-c89b-493d-8afd-5987b5968069 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:44.444609 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43a0784d-c89b-493d-8afd-5987b5968069 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:44.657271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-43a0784d-c89b-493d-8afd-5987b5968069 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:44.667607 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-43a0784d-c89b-493d-8afd-5987b5968069 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1675 microversion: 2.1 time: 0.234758 Aug 03 02:54:44.669264 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3454/6787] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:44 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1675 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:45.692493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5797369a-5cf3-4398-b4aa-ed277c7f5ce6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:45.693243 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5797369a-5cf3-4398-b4aa-ed277c7f5ce6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:45.701308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5797369a-5cf3-4398-b4aa-ed277c7f5ce6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:45.701764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5797369a-5cf3-4398-b4aa-ed277c7f5ce6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:45.702535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5797369a-5cf3-4398-b4aa-ed277c7f5ce6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:45.702996 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5797369a-5cf3-4398-b4aa-ed277c7f5ce6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:45.854244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5797369a-5cf3-4398-b4aa-ed277c7f5ce6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:45.861984 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5797369a-5cf3-4398-b4aa-ed277c7f5ce6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1675 microversion: 2.1 time: 0.173908 Aug 03 02:54:45.863462 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3334/6788] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:45 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:46.274889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c94b3984-0e50-444d-afd0-13322cd18058 req-0861c52e-9033-47ea-8e64-a9f3670e8970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00391e73-c15c-46d9-8548-3eb81b5a0f3c", "name": "network-vif-plugged", "status": "completed", "tag": "5354c0ef-4c0a-4ec3-bf63-d66be49b41fc"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:54:46.285543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c94b3984-0e50-444d-afd0-13322cd18058 req-0861c52e-9033-47ea-8e64-a9f3670e8970 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:46.286396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c94b3984-0e50-444d-afd0-13322cd18058 req-0861c52e-9033-47ea-8e64-a9f3670e8970 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:46.298576 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c94b3984-0e50-444d-afd0-13322cd18058 req-0861c52e-9033-47ea-8e64-a9f3670e8970 service nova] Creating event network-vif-plugged:5354c0ef-4c0a-4ec3-bf63-d66be49b41fc for instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c on n-h2-826529-8 Aug 03 02:54:46.304669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-c94b3984-0e50-444d-afd0-13322cd18058 req-0861c52e-9033-47ea-8e64-a9f3670e8970 service nova] Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:54:46.316099 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c94b3984-0e50-444d-afd0-13322cd18058 req-0861c52e-9033-47ea-8e64-a9f3670e8970 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046263 Aug 03 02:54:46.316950 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3455/6789] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:54:46.885085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-66b3486d-dd59-41ab-9e3d-b5e461265970 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:46.885970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-66b3486d-dd59-41ab-9e3d-b5e461265970 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:46.893042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66b3486d-dd59-41ab-9e3d-b5e461265970 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:46.893600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66b3486d-dd59-41ab-9e3d-b5e461265970 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:46.894661 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66b3486d-dd59-41ab-9e3d-b5e461265970 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:46.895656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66b3486d-dd59-41ab-9e3d-b5e461265970 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:47.035632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-66b3486d-dd59-41ab-9e3d-b5e461265970 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:47.043179 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-66b3486d-dd59-41ab-9e3d-b5e461265970 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1675 microversion: 2.1 time: 0.162000 Aug 03 02:54:47.043771 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3335/6790] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:46 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:47.682721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-710908ff-e0d9-4676-aaab-ebd1e5b11e2c req-b93f6b97-91e9-4566-b394-60672e0fe166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00391e73-c15c-46d9-8548-3eb81b5a0f3c", "name": "network-vif-unplugged", "status": "completed", "tag": "5354c0ef-4c0a-4ec3-bf63-d66be49b41fc"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:54:47.695495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-710908ff-e0d9-4676-aaab-ebd1e5b11e2c req-b93f6b97-91e9-4566-b394-60672e0fe166 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:47.695784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-710908ff-e0d9-4676-aaab-ebd1e5b11e2c req-b93f6b97-91e9-4566-b394-60672e0fe166 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:47.712506 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-710908ff-e0d9-4676-aaab-ebd1e5b11e2c req-b93f6b97-91e9-4566-b394-60672e0fe166 service nova] Creating event network-vif-unplugged:5354c0ef-4c0a-4ec3-bf63-d66be49b41fc for instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c on n-h1-826529-8 Aug 03 02:54:47.718413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-710908ff-e0d9-4676-aaab-ebd1e5b11e2c req-b93f6b97-91e9-4566-b394-60672e0fe166 service nova] Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:54:47.734654 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-710908ff-e0d9-4676-aaab-ebd1e5b11e2c req-b93f6b97-91e9-4566-b394-60672e0fe166 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056207 Aug 03 02:54:47.735461 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3456/6791] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:54:48.065901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-36773b8f-114e-40da-86a1-0ec6558a76fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:48.066721 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-36773b8f-114e-40da-86a1-0ec6558a76fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:48.074125 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36773b8f-114e-40da-86a1-0ec6558a76fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:48.074590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36773b8f-114e-40da-86a1-0ec6558a76fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:48.075423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36773b8f-114e-40da-86a1-0ec6558a76fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:48.075874 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36773b8f-114e-40da-86a1-0ec6558a76fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:48.238604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-36773b8f-114e-40da-86a1-0ec6558a76fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:48.247573 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-36773b8f-114e-40da-86a1-0ec6558a76fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1675 microversion: 2.1 time: 0.186159 Aug 03 02:54:48.248169 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3336/6792] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:48 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1675 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:49.272087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e8ff13f8-8737-4b9c-abcf-6c36f5f3c50c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:49.272805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e8ff13f8-8737-4b9c-abcf-6c36f5f3c50c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:49.279162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8ff13f8-8737-4b9c-abcf-6c36f5f3c50c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:49.279634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8ff13f8-8737-4b9c-abcf-6c36f5f3c50c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:49.280415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8ff13f8-8737-4b9c-abcf-6c36f5f3c50c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:49.280866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e8ff13f8-8737-4b9c-abcf-6c36f5f3c50c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:49.412438 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e8ff13f8-8737-4b9c-abcf-6c36f5f3c50c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:49.420084 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e8ff13f8-8737-4b9c-abcf-6c36f5f3c50c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1675 microversion: 2.1 time: 0.153847 Aug 03 02:54:49.420663 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3457/6793] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:49 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:49.760174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-af6aeacc-ddbc-431b-9fed-8d3becabc365 req-76f736f2-5ecd-48a8-af54-e7eb81a508dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00391e73-c15c-46d9-8548-3eb81b5a0f3c", "tag": "5354c0ef-4c0a-4ec3-bf63-d66be49b41fc"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:54:49.770103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-af6aeacc-ddbc-431b-9fed-8d3becabc365 req-76f736f2-5ecd-48a8-af54-e7eb81a508dd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:49.770537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-af6aeacc-ddbc-431b-9fed-8d3becabc365 req-76f736f2-5ecd-48a8-af54-e7eb81a508dd service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:49.782031 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-af6aeacc-ddbc-431b-9fed-8d3becabc365 req-76f736f2-5ecd-48a8-af54-e7eb81a508dd service nova] Creating event network-changed:5354c0ef-4c0a-4ec3-bf63-d66be49b41fc for instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c on n-h1-826529-8 Aug 03 02:54:49.787786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-af6aeacc-ddbc-431b-9fed-8d3becabc365 req-76f736f2-5ecd-48a8-af54-e7eb81a508dd service nova] Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:54:49.803725 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-af6aeacc-ddbc-431b-9fed-8d3becabc365 req-76f736f2-5ecd-48a8-af54-e7eb81a508dd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047306 Aug 03 02:54:49.804354 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3337/6794] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:54:50.444824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0eef5f3d-d5ac-4091-b95c-ce52cb4259eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:50.445566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0eef5f3d-d5ac-4091-b95c-ce52cb4259eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:50.452693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0eef5f3d-d5ac-4091-b95c-ce52cb4259eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:50.453167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0eef5f3d-d5ac-4091-b95c-ce52cb4259eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:50.453970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0eef5f3d-d5ac-4091-b95c-ce52cb4259eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:50.454426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0eef5f3d-d5ac-4091-b95c-ce52cb4259eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:50.665496 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0eef5f3d-d5ac-4091-b95c-ce52cb4259eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:50.673144 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0eef5f3d-d5ac-4091-b95c-ce52cb4259eb tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1668 microversion: 2.1 time: 0.234078 Aug 03 02:54:50.673732 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3458/6795] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:50 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1668 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:50.699451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-360c9db0-a363-4c3a-a8dd-b5df8f600bca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:50.700165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-360c9db0-a363-4c3a-a8dd-b5df8f600bca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:50.707211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-360c9db0-a363-4c3a-a8dd-b5df8f600bca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:50.707685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-360c9db0-a363-4c3a-a8dd-b5df8f600bca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:50.708476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-360c9db0-a363-4c3a-a8dd-b5df8f600bca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:50.708923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-360c9db0-a363-4c3a-a8dd-b5df8f600bca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:50.713181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:54:50.846367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-360c9db0-a363-4c3a-a8dd-b5df8f600bca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:50.854339 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-360c9db0-a363-4c3a-a8dd-b5df8f600bca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1668 microversion: 2.1 time: 0.159168 Aug 03 02:54:50.854972 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3338/6796] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:50 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:50.875140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e0954d5e-1b2b-49e4-a1c8-9e5e730d1274 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:50.875896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e0954d5e-1b2b-49e4-a1c8-9e5e730d1274 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:50.883219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0954d5e-1b2b-49e4-a1c8-9e5e730d1274 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:50.883769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0954d5e-1b2b-49e4-a1c8-9e5e730d1274 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:50.884639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0954d5e-1b2b-49e4-a1c8-9e5e730d1274 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:50.885163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0954d5e-1b2b-49e4-a1c8-9e5e730d1274 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:51.031707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e0954d5e-1b2b-49e4-a1c8-9e5e730d1274 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:51.041309 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e0954d5e-1b2b-49e4-a1c8-9e5e730d1274 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1668 microversion: 2.1 time: 0.169975 Aug 03 02:54:51.042059 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3459/6797] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:50 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1668 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:51.061685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5ef302db-cc41-48d6-91c1-892b524275c6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:51.062200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5ef302db-cc41-48d6-91c1-892b524275c6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:51.069219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ef302db-cc41-48d6-91c1-892b524275c6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:51.069686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ef302db-cc41-48d6-91c1-892b524275c6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:51.070478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ef302db-cc41-48d6-91c1-892b524275c6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:51.070956 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5ef302db-cc41-48d6-91c1-892b524275c6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:51.098780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5ef302db-cc41-48d6-91c1-892b524275c6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:54:51.178545 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5ef302db-cc41-48d6-91c1-892b524275c6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "DELETE /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 204 len: 0 microversion: 2.1 time: 0.120215 Aug 03 02:54:51.179567 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3339/6798] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:54:51 2022] DELETE /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:54:51.188907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-688f0ada-623a-4ecb-9929-daf4cf1685fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:51.189554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-688f0ada-623a-4ecb-9929-daf4cf1685fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:51.196464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-688f0ada-623a-4ecb-9929-daf4cf1685fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:51.196944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-688f0ada-623a-4ecb-9929-daf4cf1685fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:51.197740 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-688f0ada-623a-4ecb-9929-daf4cf1685fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:51.198201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-688f0ada-623a-4ecb-9929-daf4cf1685fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:51.202414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:54:51.336655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-688f0ada-623a-4ecb-9929-daf4cf1685fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:51.344631 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-688f0ada-623a-4ecb-9929-daf4cf1685fa tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1674 microversion: 2.1 time: 0.160748 Aug 03 02:54:51.345201 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3460/6799] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:51 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:54:52.366651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a194eee5-0ea3-4bb9-8dc7-96701973c390 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:52.367319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a194eee5-0ea3-4bb9-8dc7-96701973c390 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:52.374626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a194eee5-0ea3-4bb9-8dc7-96701973c390 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:52.375123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a194eee5-0ea3-4bb9-8dc7-96701973c390 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:52.375922 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a194eee5-0ea3-4bb9-8dc7-96701973c390 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:52.376567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a194eee5-0ea3-4bb9-8dc7-96701973c390 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:52.515759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a194eee5-0ea3-4bb9-8dc7-96701973c390 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:52.524243 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a194eee5-0ea3-4bb9-8dc7-96701973c390 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1674 microversion: 2.1 time: 0.162238 Aug 03 02:54:52.524832 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3340/6800] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:52 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:53.477085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-79ab96ad-f7c0-43a4-82f3-82e47ec90c3d req-c2489fb2-26f1-4f5d-80fa-ef498f892105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00391e73-c15c-46d9-8548-3eb81b5a0f3c", "name": "network-vif-deleted", "tag": "5354c0ef-4c0a-4ec3-bf63-d66be49b41fc"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:54:53.491575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-79ab96ad-f7c0-43a4-82f3-82e47ec90c3d req-c2489fb2-26f1-4f5d-80fa-ef498f892105 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:53.492046 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-79ab96ad-f7c0-43a4-82f3-82e47ec90c3d req-c2489fb2-26f1-4f5d-80fa-ef498f892105 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:53.504772 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-79ab96ad-f7c0-43a4-82f3-82e47ec90c3d req-c2489fb2-26f1-4f5d-80fa-ef498f892105 service nova] Creating event network-vif-deleted:5354c0ef-4c0a-4ec3-bf63-d66be49b41fc for instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c on n-h1-826529-8 Aug 03 02:54:53.511233 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-79ab96ad-f7c0-43a4-82f3-82e47ec90c3d req-c2489fb2-26f1-4f5d-80fa-ef498f892105 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037922 Aug 03 02:54:53.511860 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3461/6801] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:54:53.546236 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-955e6e8c-cce9-456c-8776-0a9b2d8dff6a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:53.546869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-955e6e8c-cce9-456c-8776-0a9b2d8dff6a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:53.555745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-955e6e8c-cce9-456c-8776-0a9b2d8dff6a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:53.556134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-955e6e8c-cce9-456c-8776-0a9b2d8dff6a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:53.557127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-955e6e8c-cce9-456c-8776-0a9b2d8dff6a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:53.557592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-955e6e8c-cce9-456c-8776-0a9b2d8dff6a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:53.594522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-955e6e8c-cce9-456c-8776-0a9b2d8dff6a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:53.595107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-955e6e8c-cce9-456c-8776-0a9b2d8dff6a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:53.595814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-955e6e8c-cce9-456c-8776-0a9b2d8dff6a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lazy-loading 'fault' on Instance uuid 00391e73-c15c-46d9-8548-3eb81b5a0f3c {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:54:53.651218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-955e6e8c-cce9-456c-8776-0a9b2d8dff6a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:53.661653 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-955e6e8c-cce9-456c-8776-0a9b2d8dff6a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 200 len: 1327 microversion: 2.1 time: 0.119639 Aug 03 02:54:53.671633 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3341/6802] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:53 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:54.684720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-27b0c324-952c-408a-8674-d8f577c874c2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:54.685439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-27b0c324-952c-408a-8674-d8f577c874c2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:54.694168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27b0c324-952c-408a-8674-d8f577c874c2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:54.694636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27b0c324-952c-408a-8674-d8f577c874c2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:54.695486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27b0c324-952c-408a-8674-d8f577c874c2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:54.695937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27b0c324-952c-408a-8674-d8f577c874c2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:54.710682 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-27b0c324-952c-408a-8674-d8f577c874c2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] HTTP exception thrown: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-27b0c324-952c-408a-8674-d8f577c874c2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Request method failure captured: Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c HTTP/1.1 Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eKeTO9grXOxkCa6FoTdy4xisGe48wpNftmUsWS79LxdRUK_LQ-i9rR-LRmf_RsR0d0R2L33Na6U4SrN4RRH8mJYKXfLmcOPQ0_b7WgBoWh3OY0ufX1kuw7Kd1Co7FKtp3mmKHpa3Wv4IryoEDTAH4ADzqtGvfuXOg24sT2zGLa2XZ4 Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eec1de914edd4c8794c90561940c3402", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eec1de914edd4c8794c90561940c3402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}] Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4a6c42ecf1044bf79778ec5b4da0c270 Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '00391e73-c15c-46d9-8548-3eb81b5a0f3c'} Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:54:54.712386 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:54:54.717408 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:54:54.717408 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:54:54.717408 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:54:54.717408 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:54:54.717408 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:54:54.717408 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:54:54.717408 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:54:54.717408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-27b0c324-952c-408a-8674-d8f577c874c2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Returning 404 to user: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:54:54.717408 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-27b0c324-952c-408a-8674-d8f577c874c2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 404 len: 111 microversion: 2.1 time: 0.033434 Aug 03 02:54:54.717408 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3462/6803] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:54 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:54:54.731790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d5523ffa-c08f-4875-b24d-4df7361a12c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:54.732415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d5523ffa-c08f-4875-b24d-4df7361a12c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:54.734529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:54:54.741600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5523ffa-c08f-4875-b24d-4df7361a12c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:54.742055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5523ffa-c08f-4875-b24d-4df7361a12c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:54.742872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5523ffa-c08f-4875-b24d-4df7361a12c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:54.743336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5523ffa-c08f-4875-b24d-4df7361a12c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:54.759306 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-d5523ffa-c08f-4875-b24d-4df7361a12c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] HTTP exception thrown: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d5523ffa-c08f-4875-b24d-4df7361a12c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Request method failure captured: Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c HTTP/1.1 Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eKeTO9grXOxkCa6FoTdy4xisGe48wpNftmUsWS79LxdRUK_LQ-i9rR-LRmf_RsR0d0R2L33Na6U4SrN4RRH8mJYKXfLmcOPQ0_b7WgBoWh3OY0ufX1kuw7Kd1Co7FKtp3mmKHpa3Wv4IryoEDTAH4ADzqtGvfuXOg24sT2zGLa2XZ4 Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eec1de914edd4c8794c90561940c3402", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eec1de914edd4c8794c90561940c3402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}] Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4a6c42ecf1044bf79778ec5b4da0c270 Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '00391e73-c15c-46d9-8548-3eb81b5a0f3c'} Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:54:54.761269 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:54:54.767233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:54:54.767233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:54:54.767233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:54:54.767233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:54:54.767233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:54:54.767233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:54:54.767233 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:54:54.767233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d5523ffa-c08f-4875-b24d-4df7361a12c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Returning 404 to user: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:54:54.767233 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d5523ffa-c08f-4875-b24d-4df7361a12c8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 404 len: 111 microversion: 2.1 time: 0.034869 Aug 03 02:54:54.767233 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3342/6804] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:54 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:54:54.875019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-723788157", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "1026769a-4617-4108-a578-a580ac382a8b"}], "security_groups": [{"name": "tempest-securitygroup--1881219998"}], "key_name": "tempest-keypair-768996741", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:54:54.985205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] validate_networks() for [('1026769a-4617-4108-a578-a580ac382a8b', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:54:55.366065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:54:55.366515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:54:55.367060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:54:55.367498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:54:55.368275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:54:55.377225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:55.377690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:55.378560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:55.379102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:55.396790 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Getting quotas for project eec1de914edd4c8794c90561940c3402. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:54:55.402018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Getting quotas for user 4a6c42ecf1044bf79778ec5b4da0c270 and project eec1de914edd4c8794c90561940c3402. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:54:55.416092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:54:55.418402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:54:55.465074 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cf801d51-3a03-49bd-bf45-952f4765fc77 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.594133 Aug 03 02:54:55.465729 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3463/6805] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:54:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:54:55.478017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-63754d30-9f8e-426b-930b-d87c919bedc9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:55.478639 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-63754d30-9f8e-426b-930b-d87c919bedc9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:55.532461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-63754d30-9f8e-426b-930b-d87c919bedc9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:55.540658 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-63754d30-9f8e-426b-930b-d87c919bedc9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1237 microversion: 2.1 time: 0.066613 Aug 03 02:54:55.541249 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3343/6806] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:55 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:54:56.563453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-45101630-df27-477a-9530-d2293ef275b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:56.564097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-45101630-df27-477a-9530-d2293ef275b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:56.567862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:54:56.574296 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45101630-df27-477a-9530-d2293ef275b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:56.574779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45101630-df27-477a-9530-d2293ef275b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:56.575625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45101630-df27-477a-9530-d2293ef275b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:56.576085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-45101630-df27-477a-9530-d2293ef275b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:56.650987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-45101630-df27-477a-9530-d2293ef275b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:56.658600 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-45101630-df27-477a-9530-d2293ef275b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1295 microversion: 2.1 time: 0.099103 Aug 03 02:54:56.660714 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3464/6807] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:56 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1295 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:57.680905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a65c3ccb-b38f-44ee-8b86-f612b2b5c155 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:57.681521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a65c3ccb-b38f-44ee-8b86-f612b2b5c155 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:57.686432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:54:57.690099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a65c3ccb-b38f-44ee-8b86-f612b2b5c155 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:57.690549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a65c3ccb-b38f-44ee-8b86-f612b2b5c155 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:57.691379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a65c3ccb-b38f-44ee-8b86-f612b2b5c155 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:57.691826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a65c3ccb-b38f-44ee-8b86-f612b2b5c155 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:57.835504 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a7dd8653-26e1-49e3-8b31-e2d146846974 req-40dc1e87-417f-44b8-bb3d-a82a7eff4659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b41f341-555f-493f-bed1-ab015faf5388", "tag": "74f21df4-2491-4ac1-9aee-ada55c74c12c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:54:57.851439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a7dd8653-26e1-49e3-8b31-e2d146846974 req-40dc1e87-417f-44b8-bb3d-a82a7eff4659 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:57.852468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a7dd8653-26e1-49e3-8b31-e2d146846974 req-40dc1e87-417f-44b8-bb3d-a82a7eff4659 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:57.868611 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a7dd8653-26e1-49e3-8b31-e2d146846974 req-40dc1e87-417f-44b8-bb3d-a82a7eff4659 service nova] Creating event network-changed:74f21df4-2491-4ac1-9aee-ada55c74c12c for instance 7b41f341-555f-493f-bed1-ab015faf5388 on n-h2-826529-8 Aug 03 02:54:57.874224 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a7dd8653-26e1-49e3-8b31-e2d146846974 req-40dc1e87-417f-44b8-bb3d-a82a7eff4659 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042606 Aug 03 02:54:57.875389 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3465/6808] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:54:57.929817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a65c3ccb-b38f-44ee-8b86-f612b2b5c155 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:57.937633 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a65c3ccb-b38f-44ee-8b86-f612b2b5c155 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1363 microversion: 2.1 time: 0.260609 Aug 03 02:54:57.938327 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3344/6809] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:57 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:54:58.960478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-960243d9-d6c1-43b2-8993-d5ee65570e81 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:54:58.961200 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-960243d9-d6c1-43b2-8993-d5ee65570e81 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:54:58.968527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-960243d9-d6c1-43b2-8993-d5ee65570e81 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:58.969004 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-960243d9-d6c1-43b2-8993-d5ee65570e81 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:58.969806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-960243d9-d6c1-43b2-8993-d5ee65570e81 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:54:58.970272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-960243d9-d6c1-43b2-8993-d5ee65570e81 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:54:59.105099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-960243d9-d6c1-43b2-8993-d5ee65570e81 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:54:59.113669 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-960243d9-d6c1-43b2-8993-d5ee65570e81 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1363 microversion: 2.1 time: 0.157682 Aug 03 02:54:59.114261 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3466/6810] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:54:58 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:55:00.135188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b11ca0a6-55e3-46f3-803c-c53880756a98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:55:00.136091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b11ca0a6-55e3-46f3-803c-c53880756a98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:55:00.143253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b11ca0a6-55e3-46f3-803c-c53880756a98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:00.143711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b11ca0a6-55e3-46f3-803c-c53880756a98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:00.144486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b11ca0a6-55e3-46f3-803c-c53880756a98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:00.144925 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b11ca0a6-55e3-46f3-803c-c53880756a98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:00.278518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b11ca0a6-55e3-46f3-803c-c53880756a98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:55:00.287002 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b11ca0a6-55e3-46f3-803c-c53880756a98 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1363 microversion: 2.1 time: 0.155736 Aug 03 02:55:00.287716 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3345/6811] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:55:00 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:55:01.308896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-753bb116-7ec7-4e9b-9067-f395345a60f8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:55:01.309542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-753bb116-7ec7-4e9b-9067-f395345a60f8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:55:01.318366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-753bb116-7ec7-4e9b-9067-f395345a60f8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:01.318839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-753bb116-7ec7-4e9b-9067-f395345a60f8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:01.319675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-753bb116-7ec7-4e9b-9067-f395345a60f8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:01.320132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-753bb116-7ec7-4e9b-9067-f395345a60f8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:01.457444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-753bb116-7ec7-4e9b-9067-f395345a60f8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:55:01.465067 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-753bb116-7ec7-4e9b-9067-f395345a60f8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1363 microversion: 2.1 time: 0.160147 Aug 03 02:55:01.465659 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3467/6812] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:55:01 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:55:02.323097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-774eb734-d400-4170-9535-52560331ebe0 req-1e85adf7-134e-435b-9a31-10c1805d8724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b41f341-555f-493f-bed1-ab015faf5388", "name": "network-vif-plugged", "status": "completed", "tag": "74f21df4-2491-4ac1-9aee-ada55c74c12c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:55:02.334974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-774eb734-d400-4170-9535-52560331ebe0 req-1e85adf7-134e-435b-9a31-10c1805d8724 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:02.335469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-774eb734-d400-4170-9535-52560331ebe0 req-1e85adf7-134e-435b-9a31-10c1805d8724 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:02.347748 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-774eb734-d400-4170-9535-52560331ebe0 req-1e85adf7-134e-435b-9a31-10c1805d8724 service nova] Creating event network-vif-plugged:74f21df4-2491-4ac1-9aee-ada55c74c12c for instance 7b41f341-555f-493f-bed1-ab015faf5388 on n-h2-826529-8 Aug 03 02:55:02.353566 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-774eb734-d400-4170-9535-52560331ebe0 req-1e85adf7-134e-435b-9a31-10c1805d8724 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034147 Aug 03 02:55:02.354217 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3346/6813] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:55:02.486047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dfec36d2-7cf4-46a3-b22b-b41d994e1d53 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:55:02.486854 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dfec36d2-7cf4-46a3-b22b-b41d994e1d53 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:55:02.493982 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfec36d2-7cf4-46a3-b22b-b41d994e1d53 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:02.494528 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfec36d2-7cf4-46a3-b22b-b41d994e1d53 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:02.495448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfec36d2-7cf4-46a3-b22b-b41d994e1d53 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:02.495940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dfec36d2-7cf4-46a3-b22b-b41d994e1d53 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:02.629207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dfec36d2-7cf4-46a3-b22b-b41d994e1d53 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:55:02.637065 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dfec36d2-7cf4-46a3-b22b-b41d994e1d53 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1363 microversion: 2.1 time: 0.155255 Aug 03 02:55:02.637643 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3468/6814] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:55:02 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:55:03.661493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f6bab704-676e-43ca-bb3a-a8a29cec6520 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:55:03.662333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f6bab704-676e-43ca-bb3a-a8a29cec6520 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:55:03.668920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6bab704-676e-43ca-bb3a-a8a29cec6520 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:03.669755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6bab704-676e-43ca-bb3a-a8a29cec6520 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:03.670325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6bab704-676e-43ca-bb3a-a8a29cec6520 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:03.670679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f6bab704-676e-43ca-bb3a-a8a29cec6520 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:03.805920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f6bab704-676e-43ca-bb3a-a8a29cec6520 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:55:03.813626 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f6bab704-676e-43ca-bb3a-a8a29cec6520 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1550 microversion: 2.1 time: 0.158339 Aug 03 02:55:03.814268 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3347/6815] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:55:03 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:55:03.835234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fb835d8d-3b6d-4232-9966-cb40e4790ff3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:55:03.835801 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fb835d8d-3b6d-4232-9966-cb40e4790ff3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:55:03.842722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb835d8d-3b6d-4232-9966-cb40e4790ff3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:03.843253 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb835d8d-3b6d-4232-9966-cb40e4790ff3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:03.844045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb835d8d-3b6d-4232-9966-cb40e4790ff3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:03.844501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb835d8d-3b6d-4232-9966-cb40e4790ff3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:03.921660 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fb835d8d-3b6d-4232-9966-cb40e4790ff3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090277 Aug 03 02:55:03.922227 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3469/6816] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:55:03 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:55:05.103648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-6f4074a4-5334-49f6-bcc9-33b65bd99a76 req-d3ad4b22-f36c-4f00-802a-74e72f1153a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b41f341-555f-493f-bed1-ab015faf5388", "tag": "74f21df4-2491-4ac1-9aee-ada55c74c12c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:55:05.114714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6f4074a4-5334-49f6-bcc9-33b65bd99a76 req-d3ad4b22-f36c-4f00-802a-74e72f1153a1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:05.115199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6f4074a4-5334-49f6-bcc9-33b65bd99a76 req-d3ad4b22-f36c-4f00-802a-74e72f1153a1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:05.126888 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-6f4074a4-5334-49f6-bcc9-33b65bd99a76 req-d3ad4b22-f36c-4f00-802a-74e72f1153a1 service nova] Creating event network-changed:74f21df4-2491-4ac1-9aee-ada55c74c12c for instance 7b41f341-555f-493f-bed1-ab015faf5388 on n-h2-826529-8 Aug 03 02:55:05.133054 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-6f4074a4-5334-49f6-bcc9-33b65bd99a76 req-d3ad4b22-f36c-4f00-802a-74e72f1153a1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033114 Aug 03 02:55:05.133747 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3348/6817] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:55:42.169207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:55:42.169981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:55:42.170779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=11 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:55:42.171572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=40 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:55:42.176138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0713f9e7-2d08-4d85-879e-d977d68b1c0a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:55:42.176851 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0713f9e7-2d08-4d85-879e-d977d68b1c0a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:55:42.185497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0713f9e7-2d08-4d85-879e-d977d68b1c0a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:42.185880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0713f9e7-2d08-4d85-879e-d977d68b1c0a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:42.186658 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0713f9e7-2d08-4d85-879e-d977d68b1c0a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:42.187139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0713f9e7-2d08-4d85-879e-d977d68b1c0a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:42.323841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0713f9e7-2d08-4d85-879e-d977d68b1c0a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:55:42.331540 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0713f9e7-2d08-4d85-879e-d977d68b1c0a tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1669 microversion: 2.1 time: 0.164531 Aug 03 02:55:42.332111 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3470/6818] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:55:42 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:55:42.349132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:55:42.351274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=9 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:55:42.352058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:55:42.357293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-938c6b1b-c9bc-407a-ab67-4220f7a3dd4b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a7090d5-1037-4078-a7d2-e6fcd01a763e"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:55:42.359758 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-938c6b1b-c9bc-407a-ab67-4220f7a3dd4b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:55:42.372332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-938c6b1b-c9bc-407a-ab67-4220f7a3dd4b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:42.372812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-938c6b1b-c9bc-407a-ab67-4220f7a3dd4b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:42.373582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-938c6b1b-c9bc-407a-ab67-4220f7a3dd4b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:42.374028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-938c6b1b-c9bc-407a-ab67-4220f7a3dd4b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:42.616068 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-938c6b1b-c9bc-407a-ab67-4220f7a3dd4b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "POST /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267643 Aug 03 02:55:42.616725 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3349/6819] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:55:42 2022] POST /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:55:53.337471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ed975046-8b9b-448f-9e79-ca30649f435c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:55:53.339860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ed975046-8b9b-448f-9e79-ca30649f435c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:55:53.341947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:55:53.342795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:55:53.349124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed975046-8b9b-448f-9e79-ca30649f435c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:53.349594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed975046-8b9b-448f-9e79-ca30649f435c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:53.350376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed975046-8b9b-448f-9e79-ca30649f435c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:53.350828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ed975046-8b9b-448f-9e79-ca30649f435c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:53.379819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ed975046-8b9b-448f-9e79-ca30649f435c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:55:53.386234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ed975046-8b9b-448f-9e79-ca30649f435c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Old instance type m1.heat2, new instance type m1.heat {{(pid=125941) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 02:55:53.393153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ed975046-8b9b-448f-9e79-ca30649f435c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:55:53.393589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ed975046-8b9b-448f-9e79-ca30649f435c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:55:53.394075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ed975046-8b9b-448f-9e79-ca30649f435c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:55:53.395329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ed975046-8b9b-448f-9e79-ca30649f435c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:55:53.395949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-ed975046-8b9b-448f-9e79-ca30649f435c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:55:53.462067 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ed975046-8b9b-448f-9e79-ca30649f435c tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "POST /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388/action" status: 202 len: 0 microversion: 2.1 time: 0.128619 Aug 03 02:55:53.462685 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3471/6820] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:55:53 2022] POST /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:55:53.469281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:55:53.470053 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:55:53.475384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a574ce2d-6218-457f-ae03-f722495e1108 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:55:53.476047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a574ce2d-6218-457f-ae03-f722495e1108 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:55:53.483612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a574ce2d-6218-457f-ae03-f722495e1108 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:53.484075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a574ce2d-6218-457f-ae03-f722495e1108 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:53.484868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a574ce2d-6218-457f-ae03-f722495e1108 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:53.485343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a574ce2d-6218-457f-ae03-f722495e1108 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:53.636363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a574ce2d-6218-457f-ae03-f722495e1108 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:55:53.645875 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a574ce2d-6218-457f-ae03-f722495e1108 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1724 microversion: 2.1 time: 0.178148 Aug 03 02:55:53.646010 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3350/6821] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:55:53 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:55:54.668221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f0cc9019-a833-4677-a961-21c711647d86 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:55:54.668955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f0cc9019-a833-4677-a961-21c711647d86 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:55:54.676131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f0cc9019-a833-4677-a961-21c711647d86 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:54.676604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f0cc9019-a833-4677-a961-21c711647d86 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:54.677412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f0cc9019-a833-4677-a961-21c711647d86 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:54.677868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f0cc9019-a833-4677-a961-21c711647d86 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:54.917112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f0cc9019-a833-4677-a961-21c711647d86 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:55:54.924913 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f0cc9019-a833-4677-a961-21c711647d86 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1724 microversion: 2.1 time: 0.261900 Aug 03 02:55:54.926623 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3472/6822] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:55:54 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:55:55.949587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-508fcac7-6374-408c-bfa5-18b1a1d53cca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:55:55.950189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-508fcac7-6374-408c-bfa5-18b1a1d53cca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:55:55.961434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-508fcac7-6374-408c-bfa5-18b1a1d53cca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:55.961902 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-508fcac7-6374-408c-bfa5-18b1a1d53cca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:55.962712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-508fcac7-6374-408c-bfa5-18b1a1d53cca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:55.963264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-508fcac7-6374-408c-bfa5-18b1a1d53cca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:56.119993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-508fcac7-6374-408c-bfa5-18b1a1d53cca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:55:56.132611 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-508fcac7-6374-408c-bfa5-18b1a1d53cca tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.187062 Aug 03 02:55:56.134101 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3351/6823] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:55:55 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:55:57.157061 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-54487b84-f488-4290-9278-26e971a860b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:55:57.157687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-54487b84-f488-4290-9278-26e971a860b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:55:57.164921 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54487b84-f488-4290-9278-26e971a860b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:57.165387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54487b84-f488-4290-9278-26e971a860b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:57.166163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54487b84-f488-4290-9278-26e971a860b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:57.166615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54487b84-f488-4290-9278-26e971a860b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:57.298736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-54487b84-f488-4290-9278-26e971a860b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:55:57.307601 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-54487b84-f488-4290-9278-26e971a860b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.154485 Aug 03 02:55:57.308184 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3473/6824] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:55:57 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:55:58.329522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b6cc326b-6c5e-48b9-86ec-a30418982b40 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:55:58.330134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b6cc326b-6c5e-48b9-86ec-a30418982b40 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:55:58.339272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6cc326b-6c5e-48b9-86ec-a30418982b40 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:58.339735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6cc326b-6c5e-48b9-86ec-a30418982b40 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:58.340528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6cc326b-6c5e-48b9-86ec-a30418982b40 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:58.340974 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b6cc326b-6c5e-48b9-86ec-a30418982b40 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:58.487129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b6cc326b-6c5e-48b9-86ec-a30418982b40 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:55:58.495580 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b6cc326b-6c5e-48b9-86ec-a30418982b40 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.170007 Aug 03 02:55:58.496145 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3352/6825] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:55:58 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:55:59.518417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d75f2cb8-01bd-4c6c-b9a5-a0c76c95e07b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:55:59.519130 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d75f2cb8-01bd-4c6c-b9a5-a0c76c95e07b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:55:59.526205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d75f2cb8-01bd-4c6c-b9a5-a0c76c95e07b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:59.526675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d75f2cb8-01bd-4c6c-b9a5-a0c76c95e07b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:59.527509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d75f2cb8-01bd-4c6c-b9a5-a0c76c95e07b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:55:59.527971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d75f2cb8-01bd-4c6c-b9a5-a0c76c95e07b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:55:59.673823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d75f2cb8-01bd-4c6c-b9a5-a0c76c95e07b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:55:59.682812 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d75f2cb8-01bd-4c6c-b9a5-a0c76c95e07b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.168351 Aug 03 02:55:59.683442 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3474/6826] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:55:59 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:00.705441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-769b1b0f-742e-412c-993d-387ccd772e02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:00.708747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-769b1b0f-742e-412c-993d-387ccd772e02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:00.715471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-769b1b0f-742e-412c-993d-387ccd772e02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:00.715947 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-769b1b0f-742e-412c-993d-387ccd772e02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:00.716753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-769b1b0f-742e-412c-993d-387ccd772e02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:00.717205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-769b1b0f-742e-412c-993d-387ccd772e02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:00.870263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-769b1b0f-742e-412c-993d-387ccd772e02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:00.879397 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-769b1b0f-742e-412c-993d-387ccd772e02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.178065 Aug 03 02:56:00.879972 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3353/6827] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:00 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:01.901992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d774214d-bb7f-474a-8279-e4c131e92279 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:01.902638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d774214d-bb7f-474a-8279-e4c131e92279 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:01.909856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d774214d-bb7f-474a-8279-e4c131e92279 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:01.910326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d774214d-bb7f-474a-8279-e4c131e92279 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:01.911149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d774214d-bb7f-474a-8279-e4c131e92279 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:01.911613 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d774214d-bb7f-474a-8279-e4c131e92279 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:02.047611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d774214d-bb7f-474a-8279-e4c131e92279 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:02.056017 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d774214d-bb7f-474a-8279-e4c131e92279 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.157962 Aug 03 02:56:02.056607 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3475/6828] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:01 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:03.077751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a5a13173-bad2-4e59-a581-11b09f986e1d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:03.078397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a5a13173-bad2-4e59-a581-11b09f986e1d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:03.085722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5a13173-bad2-4e59-a581-11b09f986e1d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:03.086179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5a13173-bad2-4e59-a581-11b09f986e1d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:03.086986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5a13173-bad2-4e59-a581-11b09f986e1d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:03.087426 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a5a13173-bad2-4e59-a581-11b09f986e1d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:03.224619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a5a13173-bad2-4e59-a581-11b09f986e1d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:03.233502 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a5a13173-bad2-4e59-a581-11b09f986e1d tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.159689 Aug 03 02:56:03.234084 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3354/6829] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:03 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:04.255665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-529c21b8-d039-46fe-93a9-a8abd6a89c35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:04.256279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-529c21b8-d039-46fe-93a9-a8abd6a89c35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:04.264573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-529c21b8-d039-46fe-93a9-a8abd6a89c35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:04.265039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-529c21b8-d039-46fe-93a9-a8abd6a89c35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:04.265832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-529c21b8-d039-46fe-93a9-a8abd6a89c35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:04.266291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-529c21b8-d039-46fe-93a9-a8abd6a89c35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:04.408669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-529c21b8-d039-46fe-93a9-a8abd6a89c35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:04.417528 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-529c21b8-d039-46fe-93a9-a8abd6a89c35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.166106 Aug 03 02:56:04.418109 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3476/6830] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:04 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:05.439562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dd424681-9dc1-4da7-b88b-6335a3a916f3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:05.440176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dd424681-9dc1-4da7-b88b-6335a3a916f3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:05.448011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd424681-9dc1-4da7-b88b-6335a3a916f3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:05.448481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd424681-9dc1-4da7-b88b-6335a3a916f3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:05.449269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd424681-9dc1-4da7-b88b-6335a3a916f3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:05.449720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dd424681-9dc1-4da7-b88b-6335a3a916f3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:05.580967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dd424681-9dc1-4da7-b88b-6335a3a916f3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:05.589199 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dd424681-9dc1-4da7-b88b-6335a3a916f3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.153659 Aug 03 02:56:05.589777 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3355/6831] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:05 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:06.610664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8d36b27f-2e67-4234-ab98-54710a7af9ac tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:06.611329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8d36b27f-2e67-4234-ab98-54710a7af9ac tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:06.618478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d36b27f-2e67-4234-ab98-54710a7af9ac tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:06.618979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d36b27f-2e67-4234-ab98-54710a7af9ac tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:06.619783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d36b27f-2e67-4234-ab98-54710a7af9ac tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:06.620240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d36b27f-2e67-4234-ab98-54710a7af9ac tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:06.759087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8d36b27f-2e67-4234-ab98-54710a7af9ac tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:06.767422 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8d36b27f-2e67-4234-ab98-54710a7af9ac tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.160748 Aug 03 02:56:06.768005 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3477/6832] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:06 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:07.790843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-76a06773-24c6-43f7-998c-ec7c1ff5a580 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:07.791591 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-76a06773-24c6-43f7-998c-ec7c1ff5a580 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:07.798804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76a06773-24c6-43f7-998c-ec7c1ff5a580 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:07.799296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76a06773-24c6-43f7-998c-ec7c1ff5a580 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:07.800087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76a06773-24c6-43f7-998c-ec7c1ff5a580 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:07.800540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-76a06773-24c6-43f7-998c-ec7c1ff5a580 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:07.932944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-76a06773-24c6-43f7-998c-ec7c1ff5a580 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:07.941110 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-76a06773-24c6-43f7-998c-ec7c1ff5a580 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.155623 Aug 03 02:56:07.941687 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3356/6833] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:07 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:08.962325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fd913e01-fcd3-4cf9-b113-81ab38fdcdbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:08.962972 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fd913e01-fcd3-4cf9-b113-81ab38fdcdbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:08.970187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd913e01-fcd3-4cf9-b113-81ab38fdcdbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:08.970656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd913e01-fcd3-4cf9-b113-81ab38fdcdbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:08.971498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd913e01-fcd3-4cf9-b113-81ab38fdcdbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:08.971952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fd913e01-fcd3-4cf9-b113-81ab38fdcdbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:09.107691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fd913e01-fcd3-4cf9-b113-81ab38fdcdbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:09.115811 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fd913e01-fcd3-4cf9-b113-81ab38fdcdbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.157423 Aug 03 02:56:09.116925 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3478/6834] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:08 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:10.138602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-28313322-3c7e-4ca2-9782-370513b2afbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:10.139383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-28313322-3c7e-4ca2-9782-370513b2afbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:10.146292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28313322-3c7e-4ca2-9782-370513b2afbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:10.146752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28313322-3c7e-4ca2-9782-370513b2afbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:10.148076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28313322-3c7e-4ca2-9782-370513b2afbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:10.148524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-28313322-3c7e-4ca2-9782-370513b2afbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:10.280554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-28313322-3c7e-4ca2-9782-370513b2afbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:10.288931 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-28313322-3c7e-4ca2-9782-370513b2afbf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.154422 Aug 03 02:56:10.289410 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3357/6835] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:10 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:11.363931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fb94d6fb-537d-41a7-9ee6-43a03ffa0251 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:11.364607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fb94d6fb-537d-41a7-9ee6-43a03ffa0251 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:11.371856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb94d6fb-537d-41a7-9ee6-43a03ffa0251 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:11.372331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb94d6fb-537d-41a7-9ee6-43a03ffa0251 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:11.373136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb94d6fb-537d-41a7-9ee6-43a03ffa0251 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:11.373594 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb94d6fb-537d-41a7-9ee6-43a03ffa0251 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:11.509559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fb94d6fb-537d-41a7-9ee6-43a03ffa0251 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:11.518163 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fb94d6fb-537d-41a7-9ee6-43a03ffa0251 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.210658 Aug 03 02:56:11.518753 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3479/6836] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:11 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:12.540383 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-19a0805b-b5ad-4af3-bc2f-79a36ffbb767 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:12.541014 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-19a0805b-b5ad-4af3-bc2f-79a36ffbb767 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:12.548453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19a0805b-b5ad-4af3-bc2f-79a36ffbb767 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:12.548921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19a0805b-b5ad-4af3-bc2f-79a36ffbb767 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:12.549712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19a0805b-b5ad-4af3-bc2f-79a36ffbb767 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:12.550160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19a0805b-b5ad-4af3-bc2f-79a36ffbb767 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:12.696619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-19a0805b-b5ad-4af3-bc2f-79a36ffbb767 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:12.704921 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-19a0805b-b5ad-4af3-bc2f-79a36ffbb767 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.168705 Aug 03 02:56:12.705589 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3358/6837] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:12 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:13.725729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-57e02136-9939-440d-8a16-87c0a98ffb02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:13.726597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-57e02136-9939-440d-8a16-87c0a98ffb02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:13.733944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57e02136-9939-440d-8a16-87c0a98ffb02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:13.734414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57e02136-9939-440d-8a16-87c0a98ffb02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:13.735252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57e02136-9939-440d-8a16-87c0a98ffb02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:13.735704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-57e02136-9939-440d-8a16-87c0a98ffb02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:13.878281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-57e02136-9939-440d-8a16-87c0a98ffb02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:13.887538 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-57e02136-9939-440d-8a16-87c0a98ffb02 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1729 microversion: 2.1 time: 0.165780 Aug 03 02:56:13.888126 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3480/6838] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:13 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:14.909442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-813f0354-3174-489f-8e11-ee88eb5bdd0f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:14.910044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-813f0354-3174-489f-8e11-ee88eb5bdd0f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:14.918126 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-813f0354-3174-489f-8e11-ee88eb5bdd0f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:14.918582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-813f0354-3174-489f-8e11-ee88eb5bdd0f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:14.919416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-813f0354-3174-489f-8e11-ee88eb5bdd0f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:14.919861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-813f0354-3174-489f-8e11-ee88eb5bdd0f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:15.056392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-813f0354-3174-489f-8e11-ee88eb5bdd0f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:15.064794 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-813f0354-3174-489f-8e11-ee88eb5bdd0f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1728 microversion: 2.1 time: 0.159341 Aug 03 02:56:15.065390 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3359/6839] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:14 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:15.226167 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-d93ba1d8-e025-4bd4-82de-b377dee84aa0 req-25e68898-7d3c-47b8-a635-291643939b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b41f341-555f-493f-bed1-ab015faf5388", "name": "network-vif-unplugged", "status": "completed", "tag": "74f21df4-2491-4ac1-9aee-ada55c74c12c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:56:15.237720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d93ba1d8-e025-4bd4-82de-b377dee84aa0 req-25e68898-7d3c-47b8-a635-291643939b71 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:15.238191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d93ba1d8-e025-4bd4-82de-b377dee84aa0 req-25e68898-7d3c-47b8-a635-291643939b71 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:15.252055 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-d93ba1d8-e025-4bd4-82de-b377dee84aa0 req-25e68898-7d3c-47b8-a635-291643939b71 service nova] Creating event network-vif-unplugged:74f21df4-2491-4ac1-9aee-ada55c74c12c for instance 7b41f341-555f-493f-bed1-ab015faf5388 on n-h1-826529-8 Aug 03 02:56:15.258555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-d93ba1d8-e025-4bd4-82de-b377dee84aa0 req-25e68898-7d3c-47b8-a635-291643939b71 service nova] Instance 7b41f341-555f-493f-bed1-ab015faf5388 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:56:15.269837 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-d93ba1d8-e025-4bd4-82de-b377dee84aa0 req-25e68898-7d3c-47b8-a635-291643939b71 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047534 Aug 03 02:56:15.270451 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3481/6840] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:56:16.089335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-517d8464-be05-4a56-a594-80b700f0f0b8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:16.089949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-517d8464-be05-4a56-a594-80b700f0f0b8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:16.097211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-517d8464-be05-4a56-a594-80b700f0f0b8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:16.097679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-517d8464-be05-4a56-a594-80b700f0f0b8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:16.098484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-517d8464-be05-4a56-a594-80b700f0f0b8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:16.098958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-517d8464-be05-4a56-a594-80b700f0f0b8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:16.240603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-517d8464-be05-4a56-a594-80b700f0f0b8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:16.249172 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-517d8464-be05-4a56-a594-80b700f0f0b8 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1728 microversion: 2.1 time: 0.165829 Aug 03 02:56:16.250051 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3360/6841] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:16 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:17.273568 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a1f8784d-1d47-4c2f-b703-3442bf15877f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:17.274292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a1f8784d-1d47-4c2f-b703-3442bf15877f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:17.281258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a1f8784d-1d47-4c2f-b703-3442bf15877f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:17.281951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a1f8784d-1d47-4c2f-b703-3442bf15877f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:17.282745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a1f8784d-1d47-4c2f-b703-3442bf15877f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:17.283369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a1f8784d-1d47-4c2f-b703-3442bf15877f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:17.289302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-0f7340c8-060a-48b4-aae7-d1be918154b0 req-3b13279c-2135-4b0c-b82c-e30ad970927f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b41f341-555f-493f-bed1-ab015faf5388", "tag": "74f21df4-2491-4ac1-9aee-ada55c74c12c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:56:17.300623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0f7340c8-060a-48b4-aae7-d1be918154b0 req-3b13279c-2135-4b0c-b82c-e30ad970927f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:17.301162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0f7340c8-060a-48b4-aae7-d1be918154b0 req-3b13279c-2135-4b0c-b82c-e30ad970927f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:17.314657 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-0f7340c8-060a-48b4-aae7-d1be918154b0 req-3b13279c-2135-4b0c-b82c-e30ad970927f service nova] Creating event network-changed:74f21df4-2491-4ac1-9aee-ada55c74c12c for instance 7b41f341-555f-493f-bed1-ab015faf5388 on n-h1-826529-8 Aug 03 02:56:17.329751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-0f7340c8-060a-48b4-aae7-d1be918154b0 req-3b13279c-2135-4b0c-b82c-e30ad970927f service nova] Instance 7b41f341-555f-493f-bed1-ab015faf5388 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:56:17.344605 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-0f7340c8-060a-48b4-aae7-d1be918154b0 req-3b13279c-2135-4b0c-b82c-e30ad970927f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059383 Aug 03 02:56:17.345566 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3361/6842] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:56:17.492302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a1f8784d-1d47-4c2f-b703-3442bf15877f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:17.514298 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a1f8784d-1d47-4c2f-b703-3442bf15877f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1726 microversion: 2.1 time: 0.244525 Aug 03 02:56:17.515600 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3482/6843] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:17 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1726 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:18.540839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-beb2bf20-a09a-4aac-bc5b-241b3964bfc6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:18.541492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-beb2bf20-a09a-4aac-bc5b-241b3964bfc6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:18.548086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-beb2bf20-a09a-4aac-bc5b-241b3964bfc6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:18.548545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-beb2bf20-a09a-4aac-bc5b-241b3964bfc6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:18.549334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-beb2bf20-a09a-4aac-bc5b-241b3964bfc6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:18.549780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-beb2bf20-a09a-4aac-bc5b-241b3964bfc6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:18.692474 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-beb2bf20-a09a-4aac-bc5b-241b3964bfc6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:18.701692 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-beb2bf20-a09a-4aac-bc5b-241b3964bfc6 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1726 microversion: 2.1 time: 0.166612 Aug 03 02:56:18.702472 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3362/6844] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:18 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:19.729306 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c11499c6-7069-4ed7-984d-34d896127cea tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:19.729856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c11499c6-7069-4ed7-984d-34d896127cea tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:19.736941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c11499c6-7069-4ed7-984d-34d896127cea tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:19.737407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c11499c6-7069-4ed7-984d-34d896127cea tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:19.738192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c11499c6-7069-4ed7-984d-34d896127cea tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:19.738637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c11499c6-7069-4ed7-984d-34d896127cea tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:20.136186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c11499c6-7069-4ed7-984d-34d896127cea tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:20.144539 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c11499c6-7069-4ed7-984d-34d896127cea tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1726 microversion: 2.1 time: 0.424599 Aug 03 02:56:20.145116 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3483/6845] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:19 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1726 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:56:21.167313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-92f2ae47-e0a1-4f5e-87cd-48488274b5e2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:21.168332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-92f2ae47-e0a1-4f5e-87cd-48488274b5e2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:21.175335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92f2ae47-e0a1-4f5e-87cd-48488274b5e2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:21.175801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92f2ae47-e0a1-4f5e-87cd-48488274b5e2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:21.176607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92f2ae47-e0a1-4f5e-87cd-48488274b5e2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:21.177234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92f2ae47-e0a1-4f5e-87cd-48488274b5e2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:21.316197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-92f2ae47-e0a1-4f5e-87cd-48488274b5e2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:21.324426 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-92f2ae47-e0a1-4f5e-87cd-48488274b5e2 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1726 microversion: 2.1 time: 0.162252 Aug 03 02:56:21.325006 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3363/6846] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:21 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:22.346448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ccf4badc-1d82-4975-b20c-07b69e6aa89b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:22.347101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ccf4badc-1d82-4975-b20c-07b69e6aa89b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:22.354225 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccf4badc-1d82-4975-b20c-07b69e6aa89b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:22.354702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccf4badc-1d82-4975-b20c-07b69e6aa89b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:22.355519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccf4badc-1d82-4975-b20c-07b69e6aa89b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:22.355974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccf4badc-1d82-4975-b20c-07b69e6aa89b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:22.389633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccf4badc-1d82-4975-b20c-07b69e6aa89b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:22.390104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccf4badc-1d82-4975-b20c-07b69e6aa89b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:22.390612 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-ccf4badc-1d82-4975-b20c-07b69e6aa89b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lazy-loading 'fault' on Instance uuid 7b41f341-555f-493f-bed1-ab015faf5388 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:56:22.506245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ccf4badc-1d82-4975-b20c-07b69e6aa89b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:22.514804 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ccf4badc-1d82-4975-b20c-07b69e6aa89b tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1777 microversion: 2.1 time: 0.172977 Aug 03 02:56:22.515421 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3484/6847] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:22 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1777 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:22.549048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-856e8518-0dc8-4092-b763-b94f88e52b89 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:22.549669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-856e8518-0dc8-4092-b763-b94f88e52b89 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:22.558240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-856e8518-0dc8-4092-b763-b94f88e52b89 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:22.558706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-856e8518-0dc8-4092-b763-b94f88e52b89 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:22.559537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-856e8518-0dc8-4092-b763-b94f88e52b89 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:22.559988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-856e8518-0dc8-4092-b763-b94f88e52b89 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:22.594046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-856e8518-0dc8-4092-b763-b94f88e52b89 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:22.594504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-856e8518-0dc8-4092-b763-b94f88e52b89 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:22.594997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-856e8518-0dc8-4092-b763-b94f88e52b89 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lazy-loading 'fault' on Instance uuid 7b41f341-555f-493f-bed1-ab015faf5388 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:56:22.707343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-856e8518-0dc8-4092-b763-b94f88e52b89 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:22.716387 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-856e8518-0dc8-4092-b763-b94f88e52b89 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1777 microversion: 2.1 time: 0.171238 Aug 03 02:56:22.716980 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3364/6848] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:22 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1777 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:23.738204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c4e0cd4a-20e7-4052-afb0-475a3ff655b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:23.738822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c4e0cd4a-20e7-4052-afb0-475a3ff655b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:23.742309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=35 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:56:23.750123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4e0cd4a-20e7-4052-afb0-475a3ff655b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:23.751006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4e0cd4a-20e7-4052-afb0-475a3ff655b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:23.752162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4e0cd4a-20e7-4052-afb0-475a3ff655b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:23.752821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4e0cd4a-20e7-4052-afb0-475a3ff655b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:23.755914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:56:23.790475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4e0cd4a-20e7-4052-afb0-475a3ff655b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:23.790971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c4e0cd4a-20e7-4052-afb0-475a3ff655b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:23.791445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-c4e0cd4a-20e7-4052-afb0-475a3ff655b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lazy-loading 'fault' on Instance uuid 7b41f341-555f-493f-bed1-ab015faf5388 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:56:23.905501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c4e0cd4a-20e7-4052-afb0-475a3ff655b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:23.914476 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c4e0cd4a-20e7-4052-afb0-475a3ff655b3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1777 microversion: 2.1 time: 0.180721 Aug 03 02:56:23.915393 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3485/6849] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:23 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1777 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:23.940625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-de345d2c-7f66-48ac-82e2-b478681e6e80 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:23.941290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-de345d2c-7f66-48ac-82e2-b478681e6e80 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:23.943905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=33 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:56:23.949724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de345d2c-7f66-48ac-82e2-b478681e6e80 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:23.950191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de345d2c-7f66-48ac-82e2-b478681e6e80 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:23.951020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de345d2c-7f66-48ac-82e2-b478681e6e80 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:23.951472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-de345d2c-7f66-48ac-82e2-b478681e6e80 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:23.954123 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=91 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:56:23.979528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-de345d2c-7f66-48ac-82e2-b478681e6e80 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:56:24.063823 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-de345d2c-7f66-48ac-82e2-b478681e6e80 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 204 len: 0 microversion: 2.1 time: 0.126947 Aug 03 02:56:24.064436 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3365/6850] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:56:23 2022] DELETE /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:56:24.074018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aa269e14-065c-49a5-9472-4e0c9942c8a3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:24.074655 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-aa269e14-065c-49a5-9472-4e0c9942c8a3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:24.080897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa269e14-065c-49a5-9472-4e0c9942c8a3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:24.081374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa269e14-065c-49a5-9472-4e0c9942c8a3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:24.082174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa269e14-065c-49a5-9472-4e0c9942c8a3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:24.082634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa269e14-065c-49a5-9472-4e0c9942c8a3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:24.117215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa269e14-065c-49a5-9472-4e0c9942c8a3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:24.117726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa269e14-065c-49a5-9472-4e0c9942c8a3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:24.118202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-aa269e14-065c-49a5-9472-4e0c9942c8a3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lazy-loading 'fault' on Instance uuid 7b41f341-555f-493f-bed1-ab015faf5388 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:56:24.234012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-aa269e14-065c-49a5-9472-4e0c9942c8a3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:24.242233 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-aa269e14-065c-49a5-9472-4e0c9942c8a3 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1783 microversion: 2.1 time: 0.173312 Aug 03 02:56:24.242806 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3486/6851] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:24 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1783 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:25.158755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-5a9ccce1-ba99-4ba7-95a6-c4020eec2c16 req-71c01145-4ac2-4824-aeb8-3be28673fb2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b41f341-555f-493f-bed1-ab015faf5388", "name": "network-vif-deleted", "tag": "74f21df4-2491-4ac1-9aee-ada55c74c12c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:56:25.174890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5a9ccce1-ba99-4ba7-95a6-c4020eec2c16 req-71c01145-4ac2-4824-aeb8-3be28673fb2b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:25.176082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-5a9ccce1-ba99-4ba7-95a6-c4020eec2c16 req-71c01145-4ac2-4824-aeb8-3be28673fb2b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:25.194020 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-5a9ccce1-ba99-4ba7-95a6-c4020eec2c16 req-71c01145-4ac2-4824-aeb8-3be28673fb2b service nova] Creating event network-vif-deleted:74f21df4-2491-4ac1-9aee-ada55c74c12c for instance 7b41f341-555f-493f-bed1-ab015faf5388 on n-h1-826529-8 Aug 03 02:56:25.199968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-5a9ccce1-ba99-4ba7-95a6-c4020eec2c16 req-71c01145-4ac2-4824-aeb8-3be28673fb2b service nova] Instance 7b41f341-555f-493f-bed1-ab015faf5388 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 02:56:25.217592 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-5a9ccce1-ba99-4ba7-95a6-c4020eec2c16 req-71c01145-4ac2-4824-aeb8-3be28673fb2b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062600 Aug 03 02:56:25.218633 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3366/6852] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:56:25.264126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f8a34e01-446a-4dbc-b155-1cdd731af431 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:25.265091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f8a34e01-446a-4dbc-b155-1cdd731af431 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:25.274847 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8a34e01-446a-4dbc-b155-1cdd731af431 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:25.275969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8a34e01-446a-4dbc-b155-1cdd731af431 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:25.276990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8a34e01-446a-4dbc-b155-1cdd731af431 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:25.277449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8a34e01-446a-4dbc-b155-1cdd731af431 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:25.316383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8a34e01-446a-4dbc-b155-1cdd731af431 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:25.316840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8a34e01-446a-4dbc-b155-1cdd731af431 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:25.317516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-f8a34e01-446a-4dbc-b155-1cdd731af431 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lazy-loading 'fault' on Instance uuid 7b41f341-555f-493f-bed1-ab015faf5388 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:56:25.361617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f8a34e01-446a-4dbc-b155-1cdd731af431 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:25.370728 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f8a34e01-446a-4dbc-b155-1cdd731af431 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1430 microversion: 2.1 time: 0.110383 Aug 03 02:56:25.371516 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3487/6853] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:25 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1430 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:56:25.393405 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-12d08637-9439-4c50-8a9f-dd66ac64fb04 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:25.394073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-12d08637-9439-4c50-8a9f-dd66ac64fb04 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:25.401424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12d08637-9439-4c50-8a9f-dd66ac64fb04 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:25.401893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12d08637-9439-4c50-8a9f-dd66ac64fb04 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:25.402695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12d08637-9439-4c50-8a9f-dd66ac64fb04 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:25.403245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12d08637-9439-4c50-8a9f-dd66ac64fb04 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:25.433822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-12d08637-9439-4c50-8a9f-dd66ac64fb04 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:56:25.490411 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.compute.api [None req-12d08637-9439-4c50-8a9f-dd66ac64fb04 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Instance is already in deleting state, ignoring this request Aug 03 02:56:25.491904 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-12d08637-9439-4c50-8a9f-dd66ac64fb04 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 204 len: 0 microversion: 2.1 time: 0.102787 Aug 03 02:56:25.494984 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3367/6854] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:56:25 2022] DELETE /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:56:25.502482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2e86ef5d-70f9-469f-826a-f91a0903fcbc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:25.503442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2e86ef5d-70f9-469f-826a-f91a0903fcbc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:25.510893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e86ef5d-70f9-469f-826a-f91a0903fcbc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:25.511405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e86ef5d-70f9-469f-826a-f91a0903fcbc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:25.512214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e86ef5d-70f9-469f-826a-f91a0903fcbc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:25.512674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e86ef5d-70f9-469f-826a-f91a0903fcbc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:25.546626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e86ef5d-70f9-469f-826a-f91a0903fcbc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:25.547453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2e86ef5d-70f9-469f-826a-f91a0903fcbc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:25.548138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-2e86ef5d-70f9-469f-826a-f91a0903fcbc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lazy-loading 'fault' on Instance uuid 7b41f341-555f-493f-bed1-ab015faf5388 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:56:25.595238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2e86ef5d-70f9-469f-826a-f91a0903fcbc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:25.611539 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2e86ef5d-70f9-469f-826a-f91a0903fcbc tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1430 microversion: 2.1 time: 0.112967 Aug 03 02:56:25.612457 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3488/6855] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:25 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1430 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:56:26.635213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7dd5df3d-3cc6-463d-9e5e-34201b9e3964 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:26.636338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7dd5df3d-3cc6-463d-9e5e-34201b9e3964 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:26.645216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7dd5df3d-3cc6-463d-9e5e-34201b9e3964 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:26.645681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7dd5df3d-3cc6-463d-9e5e-34201b9e3964 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:26.646477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7dd5df3d-3cc6-463d-9e5e-34201b9e3964 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:26.647134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7dd5df3d-3cc6-463d-9e5e-34201b9e3964 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:26.687708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7dd5df3d-3cc6-463d-9e5e-34201b9e3964 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:26.688239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7dd5df3d-3cc6-463d-9e5e-34201b9e3964 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:26.688712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-7dd5df3d-3cc6-463d-9e5e-34201b9e3964 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lazy-loading 'fault' on Instance uuid 7b41f341-555f-493f-bed1-ab015faf5388 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:56:26.736920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7dd5df3d-3cc6-463d-9e5e-34201b9e3964 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6c42ecf1044bf79778ec5b4da0c270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1de914edd4c8794c90561940c3402', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:26.749290 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7dd5df3d-3cc6-463d-9e5e-34201b9e3964 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 200 len: 1430 microversion: 2.1 time: 0.119050 Aug 03 02:56:26.749892 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3368/6856] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:26 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 1430 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:26.831863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc244e81-6e48-49ec-b037-edd05e475199 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:26.834413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fc244e81-6e48-49ec-b037-edd05e475199 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:26.841927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc244e81-6e48-49ec-b037-edd05e475199 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:26.842405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc244e81-6e48-49ec-b037-edd05e475199 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:26.843334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc244e81-6e48-49ec-b037-edd05e475199 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:26.843800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc244e81-6e48-49ec-b037-edd05e475199 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:26.883227 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fc244e81-6e48-49ec-b037-edd05e475199 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055489 Aug 03 02:56:26.884113 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3489/6857] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:56:26 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:56:27.896550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d719fbd-a877-4a27-97cb-2db2f8eb53bf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:27.899855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8d719fbd-a877-4a27-97cb-2db2f8eb53bf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:27.907302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d719fbd-a877-4a27-97cb-2db2f8eb53bf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:27.907773 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d719fbd-a877-4a27-97cb-2db2f8eb53bf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:27.908573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d719fbd-a877-4a27-97cb-2db2f8eb53bf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:27.909020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d719fbd-a877-4a27-97cb-2db2f8eb53bf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:27.943902 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8d719fbd-a877-4a27-97cb-2db2f8eb53bf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051316 Aug 03 02:56:27.944735 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3369/6858] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:56:27 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:56:28.956794 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6e6475ab-5a1c-44db-968b-16579c068569 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:28.959054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6e6475ab-5a1c-44db-968b-16579c068569 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:28.966852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e6475ab-5a1c-44db-968b-16579c068569 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:28.967364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e6475ab-5a1c-44db-968b-16579c068569 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:28.968187 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e6475ab-5a1c-44db-968b-16579c068569 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:28.968643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6e6475ab-5a1c-44db-968b-16579c068569 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:29.000127 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6e6475ab-5a1c-44db-968b-16579c068569 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047492 Aug 03 02:56:29.000700 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3490/6859] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:56:28 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:56:30.013306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cb74bd05-f13b-4c41-b4be-9d8bb5db7eaf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:30.015468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cb74bd05-f13b-4c41-b4be-9d8bb5db7eaf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:30.022590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cb74bd05-f13b-4c41-b4be-9d8bb5db7eaf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:30.023091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cb74bd05-f13b-4c41-b4be-9d8bb5db7eaf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:30.023889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cb74bd05-f13b-4c41-b4be-9d8bb5db7eaf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:30.024338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cb74bd05-f13b-4c41-b4be-9d8bb5db7eaf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:30.037899 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-cb74bd05-f13b-4c41-b4be-9d8bb5db7eaf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] HTTP exception thrown: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cb74bd05-f13b-4c41-b4be-9d8bb5db7eaf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Request method failure captured: Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388/os-volume_attachments HTTP/1.1 Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eKeTO9grXOxkCa6FoTdy4xisGe48wpNftmUsWS79LxdRUK_LQ-i9rR-LRmf_RsR0d0R2L33Na6U4SrN4RRH8mJYKXfLmcOPQ0_b7WgBoWh3OY0ufX1kuw7Kd1Co7FKtp3mmKHpa3Wv4IryoEDTAH4ADzqtGvfuXOg24sT2zGLa2XZ4 Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eec1de914edd4c8794c90561940c3402", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eec1de914edd4c8794c90561940c3402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}] Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4a6c42ecf1044bf79778ec5b4da0c270 Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'server_id': '7b41f341-555f-493f-bed1-ab015faf5388'} Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:56:30.039761 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:56:30.045284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. Aug 03 02:56:30.045284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:30.045284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:30.045284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:30.045284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:30.045284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:30.045284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:30.045284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:56:30.045284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:56:30.045284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. Aug 03 02:56:30.045284 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:30.045284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cb74bd05-f13b-4c41-b4be-9d8bb5db7eaf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Returning 404 to user: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:56:30.045284 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cb74bd05-f13b-4c41-b4be-9d8bb5db7eaf tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032371 Aug 03 02:56:30.045284 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3370/6860] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:56:30 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:56:33.375251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-04fe550e-8a3f-4b72-b10b-027d0520ca49 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:33.376396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-04fe550e-8a3f-4b72-b10b-027d0520ca49 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:33.384329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04fe550e-8a3f-4b72-b10b-027d0520ca49 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.384793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04fe550e-8a3f-4b72-b10b-027d0520ca49 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.385864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04fe550e-8a3f-4b72-b10b-027d0520ca49 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.386317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04fe550e-8a3f-4b72-b10b-027d0520ca49 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.400551 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-04fe550e-8a3f-4b72-b10b-027d0520ca49 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] HTTP exception thrown: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-04fe550e-8a3f-4b72-b10b-027d0520ca49 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Request method failure captured: Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 HTTP/1.1 Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eKeTO9grXOxkCa6FoTdy4xisGe48wpNftmUsWS79LxdRUK_LQ-i9rR-LRmf_RsR0d0R2L33Na6U4SrN4RRH8mJYKXfLmcOPQ0_b7WgBoWh3OY0ufX1kuw7Kd1Co7FKtp3mmKHpa3Wv4IryoEDTAH4ADzqtGvfuXOg24sT2zGLa2XZ4 Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eec1de914edd4c8794c90561940c3402", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eec1de914edd4c8794c90561940c3402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}] Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4a6c42ecf1044bf79778ec5b4da0c270 Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '7b41f341-555f-493f-bed1-ab015faf5388'} Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:56:33.402369 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:56:33.407397 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. Aug 03 02:56:33.407397 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.407397 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.407397 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.407397 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.407397 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.407397 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.407397 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:56:33.407397 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:56:33.407397 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. Aug 03 02:56:33.407397 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.407397 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-04fe550e-8a3f-4b72-b10b-027d0520ca49 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Returning 404 to user: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:56:33.407397 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-04fe550e-8a3f-4b72-b10b-027d0520ca49 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 404 len: 111 microversion: 2.1 time: 0.032815 Aug 03 02:56:33.407397 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3491/6861] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:56:33 2022] DELETE /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:56:33.412861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e8fcfb2d-0c46-40a6-86b3-4e895b22724f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:33.413424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e8fcfb2d-0c46-40a6-86b3-4e895b22724f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7b41f341-555f-493f-bed1-ab015faf5388] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:33.420862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8fcfb2d-0c46-40a6-86b3-4e895b22724f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.421336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8fcfb2d-0c46-40a6-86b3-4e895b22724f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.422193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8fcfb2d-0c46-40a6-86b3-4e895b22724f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.422634 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8fcfb2d-0c46-40a6-86b3-4e895b22724f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.439597 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-e8fcfb2d-0c46-40a6-86b3-4e895b22724f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] HTTP exception thrown: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e8fcfb2d-0c46-40a6-86b3-4e895b22724f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Request method failure captured: Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 HTTP/1.1 Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eKeTO9grXOxkCa6FoTdy4xisGe48wpNftmUsWS79LxdRUK_LQ-i9rR-LRmf_RsR0d0R2L33Na6U4SrN4RRH8mJYKXfLmcOPQ0_b7WgBoWh3OY0ufX1kuw7Kd1Co7FKtp3mmKHpa3Wv4IryoEDTAH4ADzqtGvfuXOg24sT2zGLa2XZ4 Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eec1de914edd4c8794c90561940c3402", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eec1de914edd4c8794c90561940c3402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}] Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4a6c42ecf1044bf79778ec5b4da0c270 Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '7b41f341-555f-493f-bed1-ab015faf5388'} Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.441172 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.448136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.448136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.448136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.448136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:56:33.448136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:56:33.448136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. Aug 03 02:56:33.448136 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.448136 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e8fcfb2d-0c46-40a6-86b3-4e895b22724f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Returning 404 to user: Instance 7b41f341-555f-493f-bed1-ab015faf5388 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:56:33.448136 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e8fcfb2d-0c46-40a6-86b3-4e895b22724f tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388" status: 404 len: 111 microversion: 2.1 time: 0.033801 Aug 03 02:56:33.448136 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3371/6862] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:33 2022] GET /compute/v2.1/servers/7b41f341-555f-493f-bed1-ab015faf5388 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:56:33.453472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7f579ab5-9b76-4fe3-9de1-f09a3fdd1b54 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:33.454104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7f579ab5-9b76-4fe3-9de1-f09a3fdd1b54 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:33.460820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f579ab5-9b76-4fe3-9de1-f09a3fdd1b54 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.461293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f579ab5-9b76-4fe3-9de1-f09a3fdd1b54 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.462111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f579ab5-9b76-4fe3-9de1-f09a3fdd1b54 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.462571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7f579ab5-9b76-4fe3-9de1-f09a3fdd1b54 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.477400 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-7f579ab5-9b76-4fe3-9de1-f09a3fdd1b54 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] HTTP exception thrown: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7f579ab5-9b76-4fe3-9de1-f09a3fdd1b54 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Request method failure captured: Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c HTTP/1.1 Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eKeTO9grXOxkCa6FoTdy4xisGe48wpNftmUsWS79LxdRUK_LQ-i9rR-LRmf_RsR0d0R2L33Na6U4SrN4RRH8mJYKXfLmcOPQ0_b7WgBoWh3OY0ufX1kuw7Kd1Co7FKtp3mmKHpa3Wv4IryoEDTAH4ADzqtGvfuXOg24sT2zGLa2XZ4 Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eec1de914edd4c8794c90561940c3402", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eec1de914edd4c8794c90561940c3402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}] Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4a6c42ecf1044bf79778ec5b4da0c270 Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '00391e73-c15c-46d9-8548-3eb81b5a0f3c'} Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:56:33.479248 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:56:33.484666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:56:33.484666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.484666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.484666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.484666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.484666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.484666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.484666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:56:33.484666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:56:33.484666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:56:33.484666 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.484666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7f579ab5-9b76-4fe3-9de1-f09a3fdd1b54 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Returning 404 to user: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:56:33.484666 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7f579ab5-9b76-4fe3-9de1-f09a3fdd1b54 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "DELETE /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 404 len: 111 microversion: 2.1 time: 0.034768 Aug 03 02:56:33.484666 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3492/6863] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:56:33 2022] DELETE /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:56:33.492489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-31b0136a-fb6e-4fee-b318-92135a9cd4a1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:33.493204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-31b0136a-fb6e-4fee-b318-92135a9cd4a1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 00391e73-c15c-46d9-8548-3eb81b5a0f3c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:33.499656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31b0136a-fb6e-4fee-b318-92135a9cd4a1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.500112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31b0136a-fb6e-4fee-b318-92135a9cd4a1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.500898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31b0136a-fb6e-4fee-b318-92135a9cd4a1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.501556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-31b0136a-fb6e-4fee-b318-92135a9cd4a1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.517614 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-31b0136a-fb6e-4fee-b318-92135a9cd4a1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] HTTP exception thrown: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-31b0136a-fb6e-4fee-b318-92135a9cd4a1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Request method failure captured: Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c HTTP/1.1 Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eKeTO9grXOxkCa6FoTdy4xisGe48wpNftmUsWS79LxdRUK_LQ-i9rR-LRmf_RsR0d0R2L33Na6U4SrN4RRH8mJYKXfLmcOPQ0_b7WgBoWh3OY0ufX1kuw7Kd1Co7FKtp3mmKHpa3Wv4IryoEDTAH4ADzqtGvfuXOg24sT2zGLa2XZ4 Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eec1de914edd4c8794c90561940c3402", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eec1de914edd4c8794c90561940c3402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}] Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4a6c42ecf1044bf79778ec5b4da0c270 Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '00391e73-c15c-46d9-8548-3eb81b5a0f3c'} Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.519240 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.525617 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.525617 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.525617 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.525617 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:56:33.525617 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:56:33.525617 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. Aug 03 02:56:33.525617 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.525617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-31b0136a-fb6e-4fee-b318-92135a9cd4a1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Returning 404 to user: Instance 00391e73-c15c-46d9-8548-3eb81b5a0f3c could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:56:33.525617 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-31b0136a-fb6e-4fee-b318-92135a9cd4a1 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c" status: 404 len: 111 microversion: 2.1 time: 0.033031 Aug 03 02:56:33.525617 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3372/6864] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:33 2022] GET /compute/v2.1/servers/00391e73-c15c-46d9-8548-3eb81b5a0f3c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:56:33.531431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-26be0de6-4447-4d74-804c-9c5ee04e0e35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:33.531431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-26be0de6-4447-4d74-804c-9c5ee04e0e35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:33.537065 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26be0de6-4447-4d74-804c-9c5ee04e0e35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.538082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26be0de6-4447-4d74-804c-9c5ee04e0e35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.538885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26be0de6-4447-4d74-804c-9c5ee04e0e35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.539366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-26be0de6-4447-4d74-804c-9c5ee04e0e35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.554268 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-26be0de6-4447-4d74-804c-9c5ee04e0e35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] HTTP exception thrown: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-26be0de6-4447-4d74-804c-9c5ee04e0e35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Request method failure captured: Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb HTTP/1.1 Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eKeTO9grXOxkCa6FoTdy4xisGe48wpNftmUsWS79LxdRUK_LQ-i9rR-LRmf_RsR0d0R2L33Na6U4SrN4RRH8mJYKXfLmcOPQ0_b7WgBoWh3OY0ufX1kuw7Kd1Co7FKtp3mmKHpa3Wv4IryoEDTAH4ADzqtGvfuXOg24sT2zGLa2XZ4 Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eec1de914edd4c8794c90561940c3402", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eec1de914edd4c8794c90561940c3402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}] Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4a6c42ecf1044bf79778ec5b4da0c270 Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'c7cf821d-dae8-43a9-bef5-247c320f6efb'} Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:56:33.555963 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:56:33.562164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:56:33.562164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.562164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.562164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.562164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.562164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.562164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.562164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:56:33.562164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:56:33.562164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:56:33.562164 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.562164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-26be0de6-4447-4d74-804c-9c5ee04e0e35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Returning 404 to user: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:56:33.562164 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-26be0de6-4447-4d74-804c-9c5ee04e0e35 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 404 len: 111 microversion: 2.1 time: 0.031716 Aug 03 02:56:33.562164 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3493/6865] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:56:33 2022] DELETE /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:56:33.566568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5818e2ea-fb72-4db3-8b00-dda1ae31b1b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:33.567231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5818e2ea-fb72-4db3-8b00-dda1ae31b1b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: c7cf821d-dae8-43a9-bef5-247c320f6efb] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:33.573676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5818e2ea-fb72-4db3-8b00-dda1ae31b1b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.574137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5818e2ea-fb72-4db3-8b00-dda1ae31b1b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.574957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5818e2ea-fb72-4db3-8b00-dda1ae31b1b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.575396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5818e2ea-fb72-4db3-8b00-dda1ae31b1b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.591621 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-5818e2ea-fb72-4db3-8b00-dda1ae31b1b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] HTTP exception thrown: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5818e2ea-fb72-4db3-8b00-dda1ae31b1b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Request method failure captured: Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb HTTP/1.1 Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eKeTO9grXOxkCa6FoTdy4xisGe48wpNftmUsWS79LxdRUK_LQ-i9rR-LRmf_RsR0d0R2L33Na6U4SrN4RRH8mJYKXfLmcOPQ0_b7WgBoWh3OY0ufX1kuw7Kd1Co7FKtp3mmKHpa3Wv4IryoEDTAH4ADzqtGvfuXOg24sT2zGLa2XZ4 Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eec1de914edd4c8794c90561940c3402", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eec1de914edd4c8794c90561940c3402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}] Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4a6c42ecf1044bf79778ec5b4da0c270 Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'c7cf821d-dae8-43a9-bef5-247c320f6efb'} Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.593218 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.601073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.601073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.601073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.601073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:56:33.601073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:56:33.601073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. Aug 03 02:56:33.601073 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.601073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5818e2ea-fb72-4db3-8b00-dda1ae31b1b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Returning 404 to user: Instance c7cf821d-dae8-43a9-bef5-247c320f6efb could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:56:33.601073 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5818e2ea-fb72-4db3-8b00-dda1ae31b1b9 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb" status: 404 len: 111 microversion: 2.1 time: 0.032648 Aug 03 02:56:33.601073 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3373/6866] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:33 2022] GET /compute/v2.1/servers/c7cf821d-dae8-43a9-bef5-247c320f6efb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:56:33.606566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-86f07242-bef4-4fdc-bbfd-7493e15e2292 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:33.607129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-86f07242-bef4-4fdc-bbfd-7493e15e2292 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:33.619614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-86f07242-bef4-4fdc-bbfd-7493e15e2292 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.620981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-86f07242-bef4-4fdc-bbfd-7493e15e2292 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.622007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-86f07242-bef4-4fdc-bbfd-7493e15e2292 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.622486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-86f07242-bef4-4fdc-bbfd-7493e15e2292 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.641130 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-86f07242-bef4-4fdc-bbfd-7493e15e2292 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] HTTP exception thrown: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-86f07242-bef4-4fdc-bbfd-7493e15e2292 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Request method failure captured: Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d HTTP/1.1 Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eKeTO9grXOxkCa6FoTdy4xisGe48wpNftmUsWS79LxdRUK_LQ-i9rR-LRmf_RsR0d0R2L33Na6U4SrN4RRH8mJYKXfLmcOPQ0_b7WgBoWh3OY0ufX1kuw7Kd1Co7FKtp3mmKHpa3Wv4IryoEDTAH4ADzqtGvfuXOg24sT2zGLa2XZ4 Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eec1de914edd4c8794c90561940c3402", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eec1de914edd4c8794c90561940c3402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}] Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 4a6c42ecf1044bf79778ec5b4da0c270 Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '7c8b4eec-9bad-42fb-a1a8-0102fc56657d'} Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:56:33.642737 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:56:33.690373 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:56:33.690373 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.690373 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.690373 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.690373 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.690373 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.690373 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.690373 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:56:33.690373 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:56:33.690373 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:56:33.690373 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.690373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-86f07242-bef4-4fdc-bbfd-7493e15e2292 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Returning 404 to user: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:56:33.690373 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-86f07242-bef4-4fdc-bbfd-7493e15e2292 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 404 len: 111 microversion: 2.1 time: 0.042200 Aug 03 02:56:33.690373 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3494/6867] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:56:33 2022] DELETE /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b13c978f-5bee-481b-bf7b-c55d88874d30 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b13c978f-5bee-481b-bf7b-c55d88874d30 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] [instance: 7c8b4eec-9bad-42fb-a1a8-0102fc56657d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b13c978f-5bee-481b-bf7b-c55d88874d30 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b13c978f-5bee-481b-bf7b-c55d88874d30 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b13c978f-5bee-481b-bf7b-c55d88874d30 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b13c978f-5bee-481b-bf7b-c55d88874d30 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-b13c978f-5bee-481b-bf7b-c55d88874d30 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] HTTP exception thrown: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b13c978f-5bee-481b-bf7b-c55d88874d30 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Request method failure captured: Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d HTTP/1.1 Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eKeTO9grXOxkCa6FoTdy4xisGe48wpNftmUsWS79LxdRUK_LQ-i9rR-LRmf_RsR0d0R2L33Na6U4SrN4RRH8mJYKXfLmcOPQ0_b7WgBoWh3OY0ufX1kuw7Kd1Co7FKtp3mmKHpa3Wv4IryoEDTAH4ADzqtGvfuXOg24sT2zGLa2XZ4 Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_eec1de914edd4c8794c90561940c3402", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/eec1de914edd4c8794c90561940c3402"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/eec1de914edd4c8794c90561940c3402"}]}] Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: eec1de914edd4c8794c90561940c3402 Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServerActionsTestJSON-1501348332 Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 4a6c42ecf1044bf79778ec5b4da0c270 Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServerActionsTestJSON-1501348332-project Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:56:33.692534 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '7c8b4eec-9bad-42fb-a1a8-0102fc56657d'} Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b13c978f-5bee-481b-bf7b-c55d88874d30 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Returning 404 to user: Instance 7c8b4eec-9bad-42fb-a1a8-0102fc56657d could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b13c978f-5bee-481b-bf7b-c55d88874d30 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d" status: 404 len: 111 microversion: 2.1 time: 0.040158 Aug 03 02:56:33.695195 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3374/6868] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:33 2022] GET /compute/v2.1/servers/7c8b4eec-9bad-42fb-a1a8-0102fc56657d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:56:33.702727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7de2e41b-9e06-4b59-bbff-ff0f34a31e80 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] Calling method '.version_select at 0x7f5b1220c9d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:33.728646 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7de2e41b-9e06-4b59-bbff-ff0f34a31e80 tempest-ServerActionsTestJSON-1501348332 tempest-ServerActionsTestJSON-1501348332-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-768996741" status: 202 len: 0 microversion: 2.1 time: 0.029764 Aug 03 02:56:33.729464 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3495/6869] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 3 02:56:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-768996741 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:56:43.417425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1454097531", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "f6221bb9-f291-49d3-9a80-f409e318bea1"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:56:43.475269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] validate_networks() for [('f6221bb9-f291-49d3-9a80-f409e318bea1', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:56:43.689361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:56:43.951485 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:56:43.951937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:56:43.952766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:56:43.953573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:56:43.954239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:56:43.965118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:43.965580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:43.966461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:43.966857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:43.985988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Getting quotas for project c06d2c97464c45229f24e5f45fdc2b9a. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:56:43.991684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Getting quotas for user 1b1edf48477d4340bf5453f6bd197d08 and project c06d2c97464c45229f24e5f45fdc2b9a. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:56:44.006271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:56:44.009498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:56:44.057639 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-11deb74c-be2d-4431-aeab-d4772d180903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766652 Aug 03 02:56:44.058568 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3375/6870] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:56:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:56:44.067286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=51 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:56:44.069578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:56:44.074002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f57d2c15-9158-4547-bbee-79cbde163bd6 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:44.075110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f57d2c15-9158-4547-bbee-79cbde163bd6 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:44.143259 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f57d2c15-9158-4547-bbee-79cbde163bd6 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:44.152727 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f57d2c15-9158-4547-bbee-79cbde163bd6 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1217 microversion: 2.1 time: 0.087209 Aug 03 02:56:44.167612 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3496/6871] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:44 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:45.174660 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-36072c59-4d00-4249-a3f2-02d403bee607 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:45.175319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-36072c59-4d00-4249-a3f2-02d403bee607 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:45.185489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36072c59-4d00-4249-a3f2-02d403bee607 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:45.186111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36072c59-4d00-4249-a3f2-02d403bee607 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:45.187075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36072c59-4d00-4249-a3f2-02d403bee607 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:45.187645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-36072c59-4d00-4249-a3f2-02d403bee607 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:45.256873 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-36072c59-4d00-4249-a3f2-02d403bee607 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:45.266085 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-36072c59-4d00-4249-a3f2-02d403bee607 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1275 microversion: 2.1 time: 0.096292 Aug 03 02:56:45.266844 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3376/6872] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:45 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:46.288642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ba3a146f-5703-48b1-8e3e-bcf11cb1a999 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:46.289275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ba3a146f-5703-48b1-8e3e-bcf11cb1a999 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:46.296486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba3a146f-5703-48b1-8e3e-bcf11cb1a999 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:46.296950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba3a146f-5703-48b1-8e3e-bcf11cb1a999 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:46.297956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba3a146f-5703-48b1-8e3e-bcf11cb1a999 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:46.298615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba3a146f-5703-48b1-8e3e-bcf11cb1a999 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:46.455269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ba3a146f-5703-48b1-8e3e-bcf11cb1a999 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:46.464613 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ba3a146f-5703-48b1-8e3e-bcf11cb1a999 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1317 microversion: 2.1 time: 0.180278 Aug 03 02:56:46.466201 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3497/6873] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:46 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:46.470677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-733fdebb-3072-46a9-9c8c-f477a3057607 req-35946a63-6aa1-4cb3-9f13-d9b38802c865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d63a1e-2b60-41e6-a49a-7eb472178610", "tag": "4cfd022c-ef74-430d-8f2c-54286444c94c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:56:46.487434 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-733fdebb-3072-46a9-9c8c-f477a3057607 req-35946a63-6aa1-4cb3-9f13-d9b38802c865 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:46.487995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-733fdebb-3072-46a9-9c8c-f477a3057607 req-35946a63-6aa1-4cb3-9f13-d9b38802c865 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:46.501852 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-733fdebb-3072-46a9-9c8c-f477a3057607 req-35946a63-6aa1-4cb3-9f13-d9b38802c865 service nova] Creating event network-changed:4cfd022c-ef74-430d-8f2c-54286444c94c for instance 10d63a1e-2b60-41e6-a49a-7eb472178610 on n-h1-826529-8 Aug 03 02:56:46.507282 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-733fdebb-3072-46a9-9c8c-f477a3057607 req-35946a63-6aa1-4cb3-9f13-d9b38802c865 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041977 Aug 03 02:56:46.508610 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3377/6874] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:56:47.486760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7ed7ef74-5007-4290-a73f-3c4f9dc4aaff tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:47.487485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7ed7ef74-5007-4290-a73f-3c4f9dc4aaff tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:47.495196 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ed7ef74-5007-4290-a73f-3c4f9dc4aaff tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:47.495664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ed7ef74-5007-4290-a73f-3c4f9dc4aaff tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:47.496603 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ed7ef74-5007-4290-a73f-3c4f9dc4aaff tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:47.497064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7ed7ef74-5007-4290-a73f-3c4f9dc4aaff tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:47.629586 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7ed7ef74-5007-4290-a73f-3c4f9dc4aaff tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:47.638269 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7ed7ef74-5007-4290-a73f-3c4f9dc4aaff tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1261 microversion: 2.1 time: 0.155820 Aug 03 02:56:47.638851 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3498/6875] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:47 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:48.528358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-000313d4-6696-4f6a-9273-aa62565795d7 req-cf2cd58a-1de5-4a96-a541-979a67064374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d63a1e-2b60-41e6-a49a-7eb472178610", "name": "network-vif-deleted", "tag": "4cfd022c-ef74-430d-8f2c-54286444c94c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:56:48.539444 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-000313d4-6696-4f6a-9273-aa62565795d7 req-cf2cd58a-1de5-4a96-a541-979a67064374 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:48.539830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-000313d4-6696-4f6a-9273-aa62565795d7 req-cf2cd58a-1de5-4a96-a541-979a67064374 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:48.553274 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-000313d4-6696-4f6a-9273-aa62565795d7 req-cf2cd58a-1de5-4a96-a541-979a67064374 service nova] Creating event network-vif-deleted:4cfd022c-ef74-430d-8f2c-54286444c94c for instance 10d63a1e-2b60-41e6-a49a-7eb472178610 on n-h2-826529-8 Aug 03 02:56:48.561079 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-000313d4-6696-4f6a-9273-aa62565795d7 req-cf2cd58a-1de5-4a96-a541-979a67064374 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037694 Aug 03 02:56:48.561713 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3378/6876] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:56:48.659041 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-eba87076-a193-4420-abea-32376fcde044 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:48.659669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-eba87076-a193-4420-abea-32376fcde044 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:48.667231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eba87076-a193-4420-abea-32376fcde044 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:48.667691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eba87076-a193-4420-abea-32376fcde044 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:48.668468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eba87076-a193-4420-abea-32376fcde044 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:48.668920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-eba87076-a193-4420-abea-32376fcde044 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:48.735774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-eba87076-a193-4420-abea-32376fcde044 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:48.744251 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-eba87076-a193-4420-abea-32376fcde044 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1269 microversion: 2.1 time: 0.089100 Aug 03 02:56:48.744827 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3499/6877] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:48 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:49.767141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2dc51277-2335-4773-81d2-ffdc418e05d1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:49.767767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2dc51277-2335-4773-81d2-ffdc418e05d1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:49.778807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2dc51277-2335-4773-81d2-ffdc418e05d1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:49.779415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2dc51277-2335-4773-81d2-ffdc418e05d1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:49.780289 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2dc51277-2335-4773-81d2-ffdc418e05d1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:49.780938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2dc51277-2335-4773-81d2-ffdc418e05d1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:49.999481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2dc51277-2335-4773-81d2-ffdc418e05d1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:50.008304 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2dc51277-2335-4773-81d2-ffdc418e05d1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1317 microversion: 2.1 time: 0.246496 Aug 03 02:56:50.009097 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3379/6878] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:49 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:50.249939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a74671f3-5895-4ec8-b2b2-af05b2448bbb req-7470bef5-4760-4faf-a8dc-931455e5119e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d63a1e-2b60-41e6-a49a-7eb472178610", "tag": "c43e0eff-034a-405d-be73-15666f65119b"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:56:50.260952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a74671f3-5895-4ec8-b2b2-af05b2448bbb req-7470bef5-4760-4faf-a8dc-931455e5119e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:50.261417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a74671f3-5895-4ec8-b2b2-af05b2448bbb req-7470bef5-4760-4faf-a8dc-931455e5119e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:50.273829 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a74671f3-5895-4ec8-b2b2-af05b2448bbb req-7470bef5-4760-4faf-a8dc-931455e5119e service nova] Creating event network-changed:c43e0eff-034a-405d-be73-15666f65119b for instance 10d63a1e-2b60-41e6-a49a-7eb472178610 on n-h2-826529-8 Aug 03 02:56:50.279565 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a74671f3-5895-4ec8-b2b2-af05b2448bbb req-7470bef5-4760-4faf-a8dc-931455e5119e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033253 Aug 03 02:56:50.280086 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3500/6879] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:56:51.031239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-98e4d1f3-c97a-46aa-874f-a509b7b1bd47 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:51.032077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-98e4d1f3-c97a-46aa-874f-a509b7b1bd47 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:51.039284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98e4d1f3-c97a-46aa-874f-a509b7b1bd47 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:51.039739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98e4d1f3-c97a-46aa-874f-a509b7b1bd47 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:51.040523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98e4d1f3-c97a-46aa-874f-a509b7b1bd47 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:51.040965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98e4d1f3-c97a-46aa-874f-a509b7b1bd47 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:51.176663 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-98e4d1f3-c97a-46aa-874f-a509b7b1bd47 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:51.185676 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-98e4d1f3-c97a-46aa-874f-a509b7b1bd47 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1317 microversion: 2.1 time: 0.158525 Aug 03 02:56:51.186342 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3380/6880] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:51 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:52.209687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b92313af-3889-446b-ac7c-70eba1829b77 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:52.210441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b92313af-3889-446b-ac7c-70eba1829b77 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:52.216965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b92313af-3889-446b-ac7c-70eba1829b77 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:52.217440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b92313af-3889-446b-ac7c-70eba1829b77 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:52.218245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b92313af-3889-446b-ac7c-70eba1829b77 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:52.218739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b92313af-3889-446b-ac7c-70eba1829b77 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:52.356095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b92313af-3889-446b-ac7c-70eba1829b77 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:52.363612 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b92313af-3889-446b-ac7c-70eba1829b77 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1317 microversion: 2.1 time: 0.159448 Aug 03 02:56:52.364182 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3501/6881] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:52 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:53.385225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-17c1969f-f89b-437c-b91b-6f60d33458e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:53.386187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-17c1969f-f89b-437c-b91b-6f60d33458e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:53.393264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17c1969f-f89b-437c-b91b-6f60d33458e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:53.393722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17c1969f-f89b-437c-b91b-6f60d33458e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:53.394503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17c1969f-f89b-437c-b91b-6f60d33458e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:53.394972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17c1969f-f89b-437c-b91b-6f60d33458e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:53.524785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-17c1969f-f89b-437c-b91b-6f60d33458e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:53.532454 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-17c1969f-f89b-437c-b91b-6f60d33458e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1317 microversion: 2.1 time: 0.151291 Aug 03 02:56:53.533295 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3381/6882] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:53 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:54.553759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-97128b83-b8b3-463a-8f7b-5c5fda95a7eb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:54.554403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-97128b83-b8b3-463a-8f7b-5c5fda95a7eb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:54.557338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:56:54.563386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97128b83-b8b3-463a-8f7b-5c5fda95a7eb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:54.563563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97128b83-b8b3-463a-8f7b-5c5fda95a7eb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:54.564373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97128b83-b8b3-463a-8f7b-5c5fda95a7eb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:54.564832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97128b83-b8b3-463a-8f7b-5c5fda95a7eb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:54.702549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-97128b83-b8b3-463a-8f7b-5c5fda95a7eb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:54.711027 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-97128b83-b8b3-463a-8f7b-5c5fda95a7eb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1317 microversion: 2.1 time: 0.161181 Aug 03 02:56:54.711616 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3502/6883] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:54 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:54.846421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-c6c53247-1d24-4276-a3cd-e2798831119a req-2334c82e-fc9b-4966-8302-6653bc38c738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d63a1e-2b60-41e6-a49a-7eb472178610", "name": "network-vif-plugged", "status": "completed", "tag": "c43e0eff-034a-405d-be73-15666f65119b"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:56:54.851527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:56:54.852511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:56:54.856008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:56:54.867841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c6c53247-1d24-4276-a3cd-e2798831119a req-2334c82e-fc9b-4966-8302-6653bc38c738 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:54.868297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-c6c53247-1d24-4276-a3cd-e2798831119a req-2334c82e-fc9b-4966-8302-6653bc38c738 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:54.880776 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-c6c53247-1d24-4276-a3cd-e2798831119a req-2334c82e-fc9b-4966-8302-6653bc38c738 service nova] Creating event network-vif-plugged:c43e0eff-034a-405d-be73-15666f65119b for instance 10d63a1e-2b60-41e6-a49a-7eb472178610 on n-h2-826529-8 Aug 03 02:56:54.887221 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-c6c53247-1d24-4276-a3cd-e2798831119a req-2334c82e-fc9b-4966-8302-6653bc38c738 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045042 Aug 03 02:56:54.888189 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3382/6884] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:56:55.732112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4457a0f6-ea2e-4a88-925b-afd490628096 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:55.732758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4457a0f6-ea2e-4a88-925b-afd490628096 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:55.741274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4457a0f6-ea2e-4a88-925b-afd490628096 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:55.741824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4457a0f6-ea2e-4a88-925b-afd490628096 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:55.742634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4457a0f6-ea2e-4a88-925b-afd490628096 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:55.743105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4457a0f6-ea2e-4a88-925b-afd490628096 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:55.894074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4457a0f6-ea2e-4a88-925b-afd490628096 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:55.902759 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4457a0f6-ea2e-4a88-925b-afd490628096 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1317 microversion: 2.1 time: 0.174657 Aug 03 02:56:55.903399 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3503/6885] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:55 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:56.926020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3d6afa07-d757-48cf-bb21-0b7552fd8c06 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:56.926727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3d6afa07-d757-48cf-bb21-0b7552fd8c06 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:56.934888 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d6afa07-d757-48cf-bb21-0b7552fd8c06 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:56.936016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d6afa07-d757-48cf-bb21-0b7552fd8c06 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:56.937365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d6afa07-d757-48cf-bb21-0b7552fd8c06 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:56.937886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3d6afa07-d757-48cf-bb21-0b7552fd8c06 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:57.075816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3d6afa07-d757-48cf-bb21-0b7552fd8c06 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:57.083743 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3d6afa07-d757-48cf-bb21-0b7552fd8c06 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1506 microversion: 2.1 time: 0.163259 Aug 03 02:56:57.084427 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3383/6886] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:56 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:57.145350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-268759670", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "f6221bb9-f291-49d3-9a80-f409e318bea1"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:56:57.202492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] validate_networks() for [('f6221bb9-f291-49d3-9a80-f409e318bea1', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:56:57.576269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:56:57.576736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:56:57.577222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:56:57.577667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:56:57.578095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:56:57.587778 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:57.588244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:57.589053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:57.589505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:57.606195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Getting quotas for project c06d2c97464c45229f24e5f45fdc2b9a. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:56:57.611463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Getting quotas for user 1b1edf48477d4340bf5453f6bd197d08 and project c06d2c97464c45229f24e5f45fdc2b9a. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:56:57.623734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:56:57.625999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:56:57.670349 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b94cf103-5b10-4b3d-a0bc-443b8fa02eaa tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528863 Aug 03 02:56:57.671044 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3504/6887] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:56:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:56:57.681946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-86879d9c-2b77-42b8-ab04-9495ee136841 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:57.682597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-86879d9c-2b77-42b8-ab04-9495ee136841 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:57.739333 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-86879d9c-2b77-42b8-ab04-9495ee136841 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:57.746554 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-86879d9c-2b77-42b8-ab04-9495ee136841 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 200 len: 1216 microversion: 2.1 time: 0.068711 Aug 03 02:56:57.747324 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3384/6888] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:57 2022] GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:58.768674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2e90d43-34a8-4c0c-9bc4-020ab58752d7 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:58.769309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c2e90d43-34a8-4c0c-9bc4-020ab58752d7 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:58.776066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2e90d43-34a8-4c0c-9bc4-020ab58752d7 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:58.776529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2e90d43-34a8-4c0c-9bc4-020ab58752d7 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:58.777309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2e90d43-34a8-4c0c-9bc4-020ab58752d7 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:58.777763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2e90d43-34a8-4c0c-9bc4-020ab58752d7 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:58.840625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c2e90d43-34a8-4c0c-9bc4-020ab58752d7 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:58.848156 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c2e90d43-34a8-4c0c-9bc4-020ab58752d7 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 200 len: 1268 microversion: 2.1 time: 0.084314 Aug 03 02:56:58.848731 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3505/6889] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:58 2022] GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 1268 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:56:59.869233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7c07c92b-f2ca-4c94-8e80-916c5f021173 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:56:59.869952 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7c07c92b-f2ca-4c94-8e80-916c5f021173 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:56:59.877535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c07c92b-f2ca-4c94-8e80-916c5f021173 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:59.878027 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c07c92b-f2ca-4c94-8e80-916c5f021173 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:59.878822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c07c92b-f2ca-4c94-8e80-916c5f021173 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:56:59.879298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7c07c92b-f2ca-4c94-8e80-916c5f021173 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:56:59.949859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7c07c92b-f2ca-4c94-8e80-916c5f021173 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:56:59.957765 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7c07c92b-f2ca-4c94-8e80-916c5f021173 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 200 len: 1274 microversion: 2.1 time: 0.092696 Aug 03 02:56:59.958354 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3385/6890] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:56:59 2022] GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:00.980701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d000dace-c295-43b6-af56-cc8f650ea429 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:00.981472 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d000dace-c295-43b6-af56-cc8f650ea429 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:00.988678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d000dace-c295-43b6-af56-cc8f650ea429 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:00.989179 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d000dace-c295-43b6-af56-cc8f650ea429 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:00.989989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d000dace-c295-43b6-af56-cc8f650ea429 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:00.990659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d000dace-c295-43b6-af56-cc8f650ea429 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:01.125989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d000dace-c295-43b6-af56-cc8f650ea429 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:01.133723 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d000dace-c295-43b6-af56-cc8f650ea429 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 200 len: 1316 microversion: 2.1 time: 0.157167 Aug 03 02:57:01.134409 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3506/6891] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:00 2022] GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:01.238605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ad01517e-81bf-4c1f-9441-e14dd3c1db6c req-e3d65705-7e4d-45ea-a558-d85a331546f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cea3173-7a66-4089-8ba5-9d80458053ce", "tag": "9b792ca7-5841-4eec-89a8-d2ba67e3c99f"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:57:01.250863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ad01517e-81bf-4c1f-9441-e14dd3c1db6c req-e3d65705-7e4d-45ea-a558-d85a331546f4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:01.251441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ad01517e-81bf-4c1f-9441-e14dd3c1db6c req-e3d65705-7e4d-45ea-a558-d85a331546f4 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:01.265151 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ad01517e-81bf-4c1f-9441-e14dd3c1db6c req-e3d65705-7e4d-45ea-a558-d85a331546f4 service nova] Creating event network-changed:9b792ca7-5841-4eec-89a8-d2ba67e3c99f for instance 2cea3173-7a66-4089-8ba5-9d80458053ce on n-h1-826529-8 Aug 03 02:57:01.270083 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ad01517e-81bf-4c1f-9441-e14dd3c1db6c req-e3d65705-7e4d-45ea-a558-d85a331546f4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035531 Aug 03 02:57:01.270937 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3386/6892] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:57:02.154693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e440116-791a-4077-ab1b-043c537ee92c tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:02.155413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3e440116-791a-4077-ab1b-043c537ee92c tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:02.163139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e440116-791a-4077-ab1b-043c537ee92c tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:02.163637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e440116-791a-4077-ab1b-043c537ee92c tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:02.164426 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e440116-791a-4077-ab1b-043c537ee92c tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:02.164881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e440116-791a-4077-ab1b-043c537ee92c tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:02.295628 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3e440116-791a-4077-ab1b-043c537ee92c tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:02.303738 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e440116-791a-4077-ab1b-043c537ee92c tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 200 len: 1316 microversion: 2.1 time: 0.152372 Aug 03 02:57:02.304318 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3507/6893] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:02 2022] GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:03.326416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d7663e4b-aea3-4165-9b56-26a3ca220512 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:03.327158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d7663e4b-aea3-4165-9b56-26a3ca220512 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:03.333558 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d7663e4b-aea3-4165-9b56-26a3ca220512 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:03.334143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d7663e4b-aea3-4165-9b56-26a3ca220512 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:03.334959 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d7663e4b-aea3-4165-9b56-26a3ca220512 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:03.335420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d7663e4b-aea3-4165-9b56-26a3ca220512 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:03.471498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d7663e4b-aea3-4165-9b56-26a3ca220512 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:03.479986 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d7663e4b-aea3-4165-9b56-26a3ca220512 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 200 len: 1316 microversion: 2.1 time: 0.158849 Aug 03 02:57:03.480572 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3387/6894] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:03 2022] GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:04.501616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-376c4d3f-bc20-4ea7-87fc-0c8f28f35ac1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:04.502245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-376c4d3f-bc20-4ea7-87fc-0c8f28f35ac1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:04.509798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-376c4d3f-bc20-4ea7-87fc-0c8f28f35ac1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:04.510263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-376c4d3f-bc20-4ea7-87fc-0c8f28f35ac1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:04.511330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-376c4d3f-bc20-4ea7-87fc-0c8f28f35ac1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:04.511782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-376c4d3f-bc20-4ea7-87fc-0c8f28f35ac1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:04.647855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-376c4d3f-bc20-4ea7-87fc-0c8f28f35ac1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:04.655698 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-376c4d3f-bc20-4ea7-87fc-0c8f28f35ac1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 200 len: 1316 microversion: 2.1 time: 0.158192 Aug 03 02:57:04.656282 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3508/6895] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:04 2022] GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:05.676182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b5f2f658-21cc-44f5-b081-97aeb20be2e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:05.676844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b5f2f658-21cc-44f5-b081-97aeb20be2e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:05.684510 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5f2f658-21cc-44f5-b081-97aeb20be2e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:05.684973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5f2f658-21cc-44f5-b081-97aeb20be2e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:05.685762 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5f2f658-21cc-44f5-b081-97aeb20be2e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:05.686215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b5f2f658-21cc-44f5-b081-97aeb20be2e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:05.821038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b5f2f658-21cc-44f5-b081-97aeb20be2e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:05.828797 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b5f2f658-21cc-44f5-b081-97aeb20be2e1 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 200 len: 1316 microversion: 2.1 time: 0.156653 Aug 03 02:57:05.829375 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3388/6896] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:05 2022] GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:57:06.556219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-cb1cc75c-4343-437e-bc65-c4386ef8d206 req-ec7a72e4-b780-4cf9-aa52-e1b838d12ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cea3173-7a66-4089-8ba5-9d80458053ce", "name": "network-vif-plugged", "status": "completed", "tag": "9b792ca7-5841-4eec-89a8-d2ba67e3c99f"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:57:06.567441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-cb1cc75c-4343-437e-bc65-c4386ef8d206 req-ec7a72e4-b780-4cf9-aa52-e1b838d12ac8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:06.567910 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-cb1cc75c-4343-437e-bc65-c4386ef8d206 req-ec7a72e4-b780-4cf9-aa52-e1b838d12ac8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:06.579779 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-cb1cc75c-4343-437e-bc65-c4386ef8d206 req-ec7a72e4-b780-4cf9-aa52-e1b838d12ac8 service nova] Creating event network-vif-plugged:9b792ca7-5841-4eec-89a8-d2ba67e3c99f for instance 2cea3173-7a66-4089-8ba5-9d80458053ce on n-h1-826529-8 Aug 03 02:57:06.585758 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-cb1cc75c-4343-437e-bc65-c4386ef8d206 req-ec7a72e4-b780-4cf9-aa52-e1b838d12ac8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033159 Aug 03 02:57:06.586945 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3509/6897] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:57:06.850388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-310f877e-0d74-4b40-9c8b-c7188b8f6196 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:06.851055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-310f877e-0d74-4b40-9c8b-c7188b8f6196 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:06.858192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-310f877e-0d74-4b40-9c8b-c7188b8f6196 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:06.858646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-310f877e-0d74-4b40-9c8b-c7188b8f6196 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:06.859455 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-310f877e-0d74-4b40-9c8b-c7188b8f6196 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:06.859902 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-310f877e-0d74-4b40-9c8b-c7188b8f6196 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:06.993462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-310f877e-0d74-4b40-9c8b-c7188b8f6196 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:07.001137 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-310f877e-0d74-4b40-9c8b-c7188b8f6196 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 200 len: 1316 microversion: 2.1 time: 0.155352 Aug 03 02:57:07.001715 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3389/6898] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:06 2022] GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:08.021280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:57:08.021859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:57:08.026294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-75167f8e-e27e-4ef5-80fa-bbc15e1a65da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:08.027073 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-75167f8e-e27e-4ef5-80fa-bbc15e1a65da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:08.034249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75167f8e-e27e-4ef5-80fa-bbc15e1a65da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:08.034714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75167f8e-e27e-4ef5-80fa-bbc15e1a65da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:08.035515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75167f8e-e27e-4ef5-80fa-bbc15e1a65da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:08.035967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75167f8e-e27e-4ef5-80fa-bbc15e1a65da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:08.172823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-75167f8e-e27e-4ef5-80fa-bbc15e1a65da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:08.181406 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-75167f8e-e27e-4ef5-80fa-bbc15e1a65da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 200 len: 1505 microversion: 2.1 time: 0.162356 Aug 03 02:57:08.181990 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3510/6899] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:08 2022] GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:08.201579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c05fc4ab-7955-44b1-87b4-5e75395d0ca5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:08.202230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c05fc4ab-7955-44b1-87b4-5e75395d0ca5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:08.204649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:57:08.211819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c05fc4ab-7955-44b1-87b4-5e75395d0ca5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:08.212355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c05fc4ab-7955-44b1-87b4-5e75395d0ca5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:08.213386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c05fc4ab-7955-44b1-87b4-5e75395d0ca5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:08.213838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c05fc4ab-7955-44b1-87b4-5e75395d0ca5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:08.241926 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c05fc4ab-7955-44b1-87b4-5e75395d0ca5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:57:08.321711 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c05fc4ab-7955-44b1-87b4-5e75395d0ca5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 204 len: 0 microversion: 2.1 time: 0.123744 Aug 03 02:57:08.322346 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3390/6900] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:57:08 2022] DELETE /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:57:08.330857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-35cf0885-120e-4162-b70d-3c94d1fd4494 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:08.331523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-35cf0885-120e-4162-b70d-3c94d1fd4494 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:08.337981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35cf0885-120e-4162-b70d-3c94d1fd4494 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:08.338458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35cf0885-120e-4162-b70d-3c94d1fd4494 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:08.339288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35cf0885-120e-4162-b70d-3c94d1fd4494 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:08.339754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35cf0885-120e-4162-b70d-3c94d1fd4494 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:08.477840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-35cf0885-120e-4162-b70d-3c94d1fd4494 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:08.485581 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-35cf0885-120e-4162-b70d-3c94d1fd4494 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 200 len: 1511 microversion: 2.1 time: 0.158755 Aug 03 02:57:08.486177 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3511/6901] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:08 2022] GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:09.507095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-897b6aff-f5e4-4df5-9471-bd24ce160909 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:09.507797 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-897b6aff-f5e4-4df5-9471-bd24ce160909 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:09.514979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-897b6aff-f5e4-4df5-9471-bd24ce160909 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:09.515527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-897b6aff-f5e4-4df5-9471-bd24ce160909 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:09.516309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-897b6aff-f5e4-4df5-9471-bd24ce160909 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:09.516785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-897b6aff-f5e4-4df5-9471-bd24ce160909 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:09.652235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-897b6aff-f5e4-4df5-9471-bd24ce160909 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:09.660214 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-897b6aff-f5e4-4df5-9471-bd24ce160909 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 200 len: 1511 microversion: 2.1 time: 0.157449 Aug 03 02:57:09.660809 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3391/6902] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:09 2022] GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:10.060682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a60cdf5c-8b3a-462c-b11c-9476a88e534f req-afb721eb-9f1a-4323-9c1d-167131667e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cea3173-7a66-4089-8ba5-9d80458053ce", "name": "network-vif-deleted", "tag": "9b792ca7-5841-4eec-89a8-d2ba67e3c99f"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:57:10.074525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a60cdf5c-8b3a-462c-b11c-9476a88e534f req-afb721eb-9f1a-4323-9c1d-167131667e42 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:10.075058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a60cdf5c-8b3a-462c-b11c-9476a88e534f req-afb721eb-9f1a-4323-9c1d-167131667e42 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:10.088346 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a60cdf5c-8b3a-462c-b11c-9476a88e534f req-afb721eb-9f1a-4323-9c1d-167131667e42 service nova] Creating event network-vif-deleted:9b792ca7-5841-4eec-89a8-d2ba67e3c99f for instance 2cea3173-7a66-4089-8ba5-9d80458053ce on n-h1-826529-8 Aug 03 02:57:10.101520 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a60cdf5c-8b3a-462c-b11c-9476a88e534f req-afb721eb-9f1a-4323-9c1d-167131667e42 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044555 Aug 03 02:57:10.102144 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3512/6903] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:57:10.682924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-75bc5284-aae8-4b95-939d-a53e36d35cbb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:10.683472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-75bc5284-aae8-4b95-939d-a53e36d35cbb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:10.690604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-75bc5284-aae8-4b95-939d-a53e36d35cbb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:10.691105 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-75bc5284-aae8-4b95-939d-a53e36d35cbb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:10.691889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-75bc5284-aae8-4b95-939d-a53e36d35cbb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:10.692338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-75bc5284-aae8-4b95-939d-a53e36d35cbb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:10.705898 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-75bc5284-aae8-4b95-939d-a53e36d35cbb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] HTTP exception thrown: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-75bc5284-aae8-4b95-939d-a53e36d35cbb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Request method failure captured: Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce HTTP/1.1 Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6ePrLMSbCkqnbzjOKvFOzaCcCbTa1A0glr4AIfUghPy-_sde2AD7wEhr7AaixtdLe4vKChenOmd1y1Vqf5NVaYFS_ImVXVl6ei6NAqbDtu0QnjM7tu7Y5CGFUUBzVgHv0B79jpCI5UBhhkX6Qvdx8McLdoIb4D3MVHt3REYz1kDuKFQ Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c06d2c97464c45229f24e5f45fdc2b9a Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c06d2c97464c45229f24e5f45fdc2b9a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c06d2c97464c45229f24e5f45fdc2b9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c06d2c97464c45229f24e5f45fdc2b9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c06d2c97464c45229f24e5f45fdc2b9a"}]}] Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c06d2c97464c45229f24e5f45fdc2b9a Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1588316191-project Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1b1edf48477d4340bf5453f6bd197d08 Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1588316191-project Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '2cea3173-7a66-4089-8ba5-9d80458053ce'} Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:57:10.707816 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:10.713542 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:10.713542 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:57:10.713542 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:57:10.713542 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:57:10.713542 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:57:10.713542 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. Aug 03 02:57:10.713542 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:10.713542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-75bc5284-aae8-4b95-939d-a53e36d35cbb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Returning 404 to user: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:57:10.713542 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-75bc5284-aae8-4b95-939d-a53e36d35cbb tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 404 len: 111 microversion: 2.1 time: 0.031172 Aug 03 02:57:10.713542 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3392/6904] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:10 2022] GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:57:10.719915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-59b2fd1a-7bb7-44a1-81a9-784c37198b94 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:10.720631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-59b2fd1a-7bb7-44a1-81a9-784c37198b94 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:10.727809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59b2fd1a-7bb7-44a1-81a9-784c37198b94 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:10.728281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59b2fd1a-7bb7-44a1-81a9-784c37198b94 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:10.729078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59b2fd1a-7bb7-44a1-81a9-784c37198b94 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:10.729529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-59b2fd1a-7bb7-44a1-81a9-784c37198b94 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:11.101178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-59b2fd1a-7bb7-44a1-81a9-784c37198b94 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:11.109198 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-59b2fd1a-7bb7-44a1-81a9-784c37198b94 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1506 microversion: 2.1 time: 0.393567 Aug 03 02:57:11.109769 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3513/6905] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:10 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:11.129767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-12827813-31e5-48e6-920f-a3fd9fcde903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:57:11.132687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-12827813-31e5-48e6-920f-a3fd9fcde903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 4c892cd7-3159-437a-9b7e-f39b4fc2aa6c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:11.138579 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-12827813-31e5-48e6-920f-a3fd9fcde903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] HTTP exception thrown: Instance 4c892cd7-3159-437a-9b7e-f39b4fc2aa6c could not be found. Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-12827813-31e5-48e6-920f-a3fd9fcde903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Request method failure captured: Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/4c892cd7-3159-437a-9b7e-f39b4fc2aa6c/action HTTP/1.1 Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 32 Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6ePrLMSbCkqnbzjOKvFOzaCcCbTa1A0glr4AIfUghPy-_sde2AD7wEhr7AaixtdLe4vKChenOmd1y1Vqf5NVaYFS_ImVXVl6ei6NAqbDtu0QnjM7tu7Y5CGFUUBzVgHv0B79jpCI5UBhhkX6Qvdx8McLdoIb4D3MVHt3REYz1kDuKFQ Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c06d2c97464c45229f24e5f45fdc2b9a Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c06d2c97464c45229f24e5f45fdc2b9a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c06d2c97464c45229f24e5f45fdc2b9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c06d2c97464c45229f24e5f45fdc2b9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c06d2c97464c45229f24e5f45fdc2b9a"}]}] Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c06d2c97464c45229f24e5f45fdc2b9a Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1588316191-project Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1b1edf48477d4340bf5453f6bd197d08 Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1588316191-project Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: {"resize": {"flavorRef": "452"}} Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 4c892cd7-3159-437a-9b7e-f39b4fc2aa6c could not be found. Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '4c892cd7-3159-437a-9b7e-f39b4fc2aa6c', 'body': {'resize': {'flavorRef': '452'}}} Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c892cd7-3159-437a-9b7e-f39b4fc2aa6c could not be found. Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:57:11.140202 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:57:11.143818 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c892cd7-3159-437a-9b7e-f39b4fc2aa6c could not be found. Aug 03 02:57:11.143818 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.143818 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:57:11.143818 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.143818 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:11.143818 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:57:11.143818 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:57:11.143818 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:57:11.143818 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:57:11.143818 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c892cd7-3159-437a-9b7e-f39b4fc2aa6c could not be found. Aug 03 02:57:11.143818 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.143818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-12827813-31e5-48e6-920f-a3fd9fcde903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Returning 404 to user: Instance 4c892cd7-3159-437a-9b7e-f39b4fc2aa6c could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:57:11.143818 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-12827813-31e5-48e6-920f-a3fd9fcde903 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "POST /compute/v2.1/servers/4c892cd7-3159-437a-9b7e-f39b4fc2aa6c/action" status: 404 len: 111 microversion: 2.1 time: 0.015975 Aug 03 02:57:11.143818 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3393/6906] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:57:11 2022] POST /compute/v2.1/servers/4c892cd7-3159-437a-9b7e-f39b4fc2aa6c/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:57:11.151787 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f8060c17-9cdf-4c14-ab9d-fa16d41999d5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:11.152511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f8060c17-9cdf-4c14-ab9d-fa16d41999d5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:11.158593 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8060c17-9cdf-4c14-ab9d-fa16d41999d5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:11.159101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8060c17-9cdf-4c14-ab9d-fa16d41999d5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:11.159885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8060c17-9cdf-4c14-ab9d-fa16d41999d5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:11.160336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f8060c17-9cdf-4c14-ab9d-fa16d41999d5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:11.291768 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f8060c17-9cdf-4c14-ab9d-fa16d41999d5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:11.299491 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f8060c17-9cdf-4c14-ab9d-fa16d41999d5 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1506 microversion: 2.1 time: 0.151835 Aug 03 02:57:11.300096 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3514/6907] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:11 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:11.321523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c2780ff5-3892-443d-a46e-dd21e07f12da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:11.322150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c2780ff5-3892-443d-a46e-dd21e07f12da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:11.329425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2780ff5-3892-443d-a46e-dd21e07f12da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:11.329890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2780ff5-3892-443d-a46e-dd21e07f12da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:11.330682 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2780ff5-3892-443d-a46e-dd21e07f12da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:11.331190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c2780ff5-3892-443d-a46e-dd21e07f12da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:11.469258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c2780ff5-3892-443d-a46e-dd21e07f12da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:11.477509 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c2780ff5-3892-443d-a46e-dd21e07f12da tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1506 microversion: 2.1 time: 0.160048 Aug 03 02:57:11.478084 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3394/6908] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:11 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:11.497664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-04cba8f2-021b-46b9-b9b6-6eb816e46d2b tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "de5c3899-7eec-42bd-abe0-e6a7eca55935"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:57:11.500087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-04cba8f2-021b-46b9-b9b6-6eb816e46d2b tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:11.506398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04cba8f2-021b-46b9-b9b6-6eb816e46d2b tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:11.506875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04cba8f2-021b-46b9-b9b6-6eb816e46d2b tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:11.507710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04cba8f2-021b-46b9-b9b6-6eb816e46d2b tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:11.508171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-04cba8f2-021b-46b9-b9b6-6eb816e46d2b tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:11.538826 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-04cba8f2-021b-46b9-b9b6-6eb816e46d2b tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:11.544171 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-04cba8f2-021b-46b9-b9b6-6eb816e46d2b tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] HTTP exception thrown: Flavor de5c3899-7eec-42bd-abe0-e6a7eca55935 could not be found. Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-04cba8f2-021b-46b9-b9b6-6eb816e46d2b tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Request method failure captured: Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: request: POST /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610/action HTTP/1.1 Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 65 Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6ePrLMSbCkqnbzjOKvFOzaCcCbTa1A0glr4AIfUghPy-_sde2AD7wEhr7AaixtdLe4vKChenOmd1y1Vqf5NVaYFS_ImVXVl6ei6NAqbDtu0QnjM7tu7Y5CGFUUBzVgHv0B79jpCI5UBhhkX6Qvdx8McLdoIb4D3MVHt3REYz1kDuKFQ Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: c06d2c97464c45229f24e5f45fdc2b9a Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c06d2c97464c45229f24e5f45fdc2b9a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c06d2c97464c45229f24e5f45fdc2b9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c06d2c97464c45229f24e5f45fdc2b9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c06d2c97464c45229f24e5f45fdc2b9a"}]}] Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: c06d2c97464c45229f24e5f45fdc2b9a Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1588316191-project Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1b1edf48477d4340bf5453f6bd197d08 Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1588316191-project Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: {"resize": {"flavorRef": "de5c3899-7eec-42bd-abe0-e6a7eca55935"}} Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: exception: Flavor de5c3899-7eec-42bd-abe0-e6a7eca55935 could not be found. Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '10d63a1e-2b60-41e6-a49a-7eb472178610', 'body': {'resize': {'flavorRef': 'de5c3899-7eec-42bd-abe0-e6a7eca55935'}}} Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4148, in resize Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 02:57:11.546114 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor de5c3899-7eec-42bd-abe0-e6a7eca55935 could not be found. Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor de5c3899-7eec-42bd-abe0-e6a7eca55935 could not be found. Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor de5c3899-7eec-42bd-abe0-e6a7eca55935 could not be found. Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-04cba8f2-021b-46b9-b9b6-6eb816e46d2b tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Returning 400 to user: Flavor de5c3899-7eec-42bd-abe0-e6a7eca55935 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-04cba8f2-021b-46b9-b9b6-6eb816e46d2b tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "POST /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610/action" status: 400 len: 107 microversion: 2.1 time: 0.054266 Aug 03 02:57:11.553103 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3515/6909] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:57:11 2022] POST /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610/action => generated 107 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:57:11.558113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4b262008-3c66-42bc-879d-24bb257f44bf tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:11.558737 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4b262008-3c66-42bc-879d-24bb257f44bf tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:11.565051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b262008-3c66-42bc-879d-24bb257f44bf tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:11.565517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b262008-3c66-42bc-879d-24bb257f44bf tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:11.566303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b262008-3c66-42bc-879d-24bb257f44bf tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:11.566751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4b262008-3c66-42bc-879d-24bb257f44bf tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:11.698841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4b262008-3c66-42bc-879d-24bb257f44bf tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:11.702501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:57:11.707647 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4b262008-3c66-42bc-879d-24bb257f44bf tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1506 microversion: 2.1 time: 0.154757 Aug 03 02:57:11.708219 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3395/6910] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:11 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:11.730561 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6819f43e-2a6d-4a33-822f-0cc7404370ca tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:11.731256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6819f43e-2a6d-4a33-822f-0cc7404370ca tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:11.737274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6819f43e-2a6d-4a33-822f-0cc7404370ca tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:11.737743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6819f43e-2a6d-4a33-822f-0cc7404370ca tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:11.738532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6819f43e-2a6d-4a33-822f-0cc7404370ca tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:11.739038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6819f43e-2a6d-4a33-822f-0cc7404370ca tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:11.759326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=100 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:57:11.873312 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6819f43e-2a6d-4a33-822f-0cc7404370ca tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:11.881029 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6819f43e-2a6d-4a33-822f-0cc7404370ca tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1506 microversion: 2.1 time: 0.154347 Aug 03 02:57:11.881668 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3516/6911] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:11 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:57:11.902337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-16cb50f0-446f-4d13-a3ac-36a7550ced1d tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-16cb50f0-446f-4d13-a3ac-36a7550ced1d tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Request method failure captured: Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: request: POST /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610/action HTTP/1.1 Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 29 Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6ePrLMSbCkqnbzjOKvFOzaCcCbTa1A0glr4AIfUghPy-_sde2AD7wEhr7AaixtdLe4vKChenOmd1y1Vqf5NVaYFS_ImVXVl6ei6NAqbDtu0QnjM7tu7Y5CGFUUBzVgHv0B79jpCI5UBhhkX6Qvdx8McLdoIb4D3MVHt3REYz1kDuKFQ Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c06d2c97464c45229f24e5f45fdc2b9a Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c06d2c97464c45229f24e5f45fdc2b9a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c06d2c97464c45229f24e5f45fdc2b9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c06d2c97464c45229f24e5f45fdc2b9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c06d2c97464c45229f24e5f45fdc2b9a"}]}] Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c06d2c97464c45229f24e5f45fdc2b9a Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1588316191-project Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1b1edf48477d4340bf5453f6bd197d08 Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1588316191-project Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: {"resize": {"flavorRef": ""}} Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '10d63a1e-2b60-41e6-a49a-7eb472178610', 'body': {'resize': {'flavorRef': ''}}} Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise error Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi '' Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.905949 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:57:11.910293 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.910293 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:11.910293 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:57:11.910293 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:57:11.910293 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 02:57:11.910293 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 02:57:11.910293 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 03 02:57:11.910293 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:11.910293 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-16cb50f0-446f-4d13-a3ac-36a7550ced1d tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:57:11.910293 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-16cb50f0-446f-4d13-a3ac-36a7550ced1d tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "POST /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610/action" status: 400 len: 113 microversion: 2.1 time: 0.009787 Aug 03 02:57:11.910293 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3396/6912] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 02:57:11 2022] POST /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 02:57:11.916553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fb0ccd1d-562a-4c47-9061-aea6efeda95d tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:11.917182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fb0ccd1d-562a-4c47-9061-aea6efeda95d tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:11.923274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb0ccd1d-562a-4c47-9061-aea6efeda95d tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:11.923743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb0ccd1d-562a-4c47-9061-aea6efeda95d tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:11.924527 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb0ccd1d-562a-4c47-9061-aea6efeda95d tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:11.924979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb0ccd1d-562a-4c47-9061-aea6efeda95d tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:12.058344 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fb0ccd1d-562a-4c47-9061-aea6efeda95d tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:12.066178 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fb0ccd1d-562a-4c47-9061-aea6efeda95d tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1506 microversion: 2.1 time: 0.154298 Aug 03 02:57:12.066752 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3517/6913] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:11 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:57:12.090732 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-24795133-0c77-4843-8ebd-1ff1087fd0fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:12.091275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-24795133-0c77-4843-8ebd-1ff1087fd0fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:12.100429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-24795133-0c77-4843-8ebd-1ff1087fd0fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:12.101068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-24795133-0c77-4843-8ebd-1ff1087fd0fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:12.101861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-24795133-0c77-4843-8ebd-1ff1087fd0fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:12.102312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-24795133-0c77-4843-8ebd-1ff1087fd0fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:12.117060 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-24795133-0c77-4843-8ebd-1ff1087fd0fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] HTTP exception thrown: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-24795133-0c77-4843-8ebd-1ff1087fd0fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Request method failure captured: Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce HTTP/1.1 Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6ePrLMSbCkqnbzjOKvFOzaCcCbTa1A0glr4AIfUghPy-_sde2AD7wEhr7AaixtdLe4vKChenOmd1y1Vqf5NVaYFS_ImVXVl6ei6NAqbDtu0QnjM7tu7Y5CGFUUBzVgHv0B79jpCI5UBhhkX6Qvdx8McLdoIb4D3MVHt3REYz1kDuKFQ Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c06d2c97464c45229f24e5f45fdc2b9a Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c06d2c97464c45229f24e5f45fdc2b9a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c06d2c97464c45229f24e5f45fdc2b9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c06d2c97464c45229f24e5f45fdc2b9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c06d2c97464c45229f24e5f45fdc2b9a"}]}] Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c06d2c97464c45229f24e5f45fdc2b9a Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-ServersNegativeTestJSON-1588316191-project Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 1b1edf48477d4340bf5453f6bd197d08 Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-ServersNegativeTestJSON-1588316191-project Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '2cea3173-7a66-4089-8ba5-9d80458053ce'} Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:57:12.118653 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:57:12.122185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. Aug 03 02:57:12.122185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:12.122185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:57:12.122185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:12.122185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:12.122185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:57:12.122185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:57:12.122185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:57:12.122185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:57:12.122185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. Aug 03 02:57:12.122185 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:57:12.122185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-24795133-0c77-4843-8ebd-1ff1087fd0fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Returning 404 to user: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:57:12.122185 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-24795133-0c77-4843-8ebd-1ff1087fd0fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 404 len: 111 microversion: 2.1 time: 0.033296 Aug 03 02:57:12.122185 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3397/6914] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:57:12 2022] DELETE /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 02:57:12.128902 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fa630d31-1213-4faf-8105-9b876d1f25c8 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:12.129539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fa630d31-1213-4faf-8105-9b876d1f25c8 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 2cea3173-7a66-4089-8ba5-9d80458053ce] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:12.136784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa630d31-1213-4faf-8105-9b876d1f25c8 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:12.137258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa630d31-1213-4faf-8105-9b876d1f25c8 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:12.138047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa630d31-1213-4faf-8105-9b876d1f25c8 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:12.138506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fa630d31-1213-4faf-8105-9b876d1f25c8 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:12.157288 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-fa630d31-1213-4faf-8105-9b876d1f25c8 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] HTTP exception thrown: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fa630d31-1213-4faf-8105-9b876d1f25c8 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Request method failure captured: Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce HTTP/1.1 Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6ePrLMSbCkqnbzjOKvFOzaCcCbTa1A0glr4AIfUghPy-_sde2AD7wEhr7AaixtdLe4vKChenOmd1y1Vqf5NVaYFS_ImVXVl6ei6NAqbDtu0QnjM7tu7Y5CGFUUBzVgHv0B79jpCI5UBhhkX6Qvdx8McLdoIb4D3MVHt3REYz1kDuKFQ Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: c06d2c97464c45229f24e5f45fdc2b9a Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c06d2c97464c45229f24e5f45fdc2b9a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c06d2c97464c45229f24e5f45fdc2b9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c06d2c97464c45229f24e5f45fdc2b9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c06d2c97464c45229f24e5f45fdc2b9a"}]}] Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: c06d2c97464c45229f24e5f45fdc2b9a Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1588316191-project Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1b1edf48477d4340bf5453f6bd197d08 Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1588316191-project Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '2cea3173-7a66-4089-8ba5-9d80458053ce'} Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:57:12.158892 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:57:12.164573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:12.164573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:57:12.164573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:57:12.164573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:57:12.164573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:57:12.164573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. Aug 03 02:57:12.164573 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:57:12.164573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fa630d31-1213-4faf-8105-9b876d1f25c8 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Returning 404 to user: Instance 2cea3173-7a66-4089-8ba5-9d80458053ce could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:57:12.164573 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fa630d31-1213-4faf-8105-9b876d1f25c8 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce" status: 404 len: 111 microversion: 2.1 time: 0.035398 Aug 03 02:57:12.164573 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3518/6915] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:12 2022] GET /compute/v2.1/servers/2cea3173-7a66-4089-8ba5-9d80458053ce => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:57:12.169820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-640cf247-06fb-4986-b90b-8c94f39c43f0 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:12.170324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-640cf247-06fb-4986-b90b-8c94f39c43f0 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:12.176600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-640cf247-06fb-4986-b90b-8c94f39c43f0 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:12.177081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-640cf247-06fb-4986-b90b-8c94f39c43f0 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:12.177879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-640cf247-06fb-4986-b90b-8c94f39c43f0 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:12.178406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-640cf247-06fb-4986-b90b-8c94f39c43f0 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:12.210714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-640cf247-06fb-4986-b90b-8c94f39c43f0 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:57:12.288624 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-640cf247-06fb-4986-b90b-8c94f39c43f0 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "DELETE /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 204 len: 0 microversion: 2.1 time: 0.122336 Aug 03 02:57:12.289219 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3398/6916] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:57:12 2022] DELETE /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:57:12.297735 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b04ac132-54d6-4c13-8e8f-b2ca0f24befe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:12.298370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b04ac132-54d6-4c13-8e8f-b2ca0f24befe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:12.307146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b04ac132-54d6-4c13-8e8f-b2ca0f24befe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:12.307616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b04ac132-54d6-4c13-8e8f-b2ca0f24befe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:12.308420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b04ac132-54d6-4c13-8e8f-b2ca0f24befe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:12.308880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b04ac132-54d6-4c13-8e8f-b2ca0f24befe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:12.442816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b04ac132-54d6-4c13-8e8f-b2ca0f24befe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:12.451181 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b04ac132-54d6-4c13-8e8f-b2ca0f24befe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1512 microversion: 2.1 time: 0.157429 Aug 03 02:57:12.451750 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3519/6917] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:12 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:57:13.472949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-13e600b3-d34e-439b-9e12-8811d36118fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:13.473678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-13e600b3-d34e-439b-9e12-8811d36118fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:13.480845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13e600b3-d34e-439b-9e12-8811d36118fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:13.481295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13e600b3-d34e-439b-9e12-8811d36118fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:13.482064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13e600b3-d34e-439b-9e12-8811d36118fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:13.482503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13e600b3-d34e-439b-9e12-8811d36118fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:13.619301 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-13e600b3-d34e-439b-9e12-8811d36118fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:13.627002 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-13e600b3-d34e-439b-9e12-8811d36118fe tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1512 microversion: 2.1 time: 0.158350 Aug 03 02:57:13.627573 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3399/6918] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:13 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:57:14.382286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-817352f3-6a48-4a25-b513-465c7a0200e0 req-0e9ed26a-9000-4fcf-b83c-471d933065b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d63a1e-2b60-41e6-a49a-7eb472178610", "name": "network-vif-deleted", "tag": "c43e0eff-034a-405d-be73-15666f65119b"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:57:14.389078 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:57:14.402508 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-817352f3-6a48-4a25-b513-465c7a0200e0 req-0e9ed26a-9000-4fcf-b83c-471d933065b1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:14.403178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-817352f3-6a48-4a25-b513-465c7a0200e0 req-0e9ed26a-9000-4fcf-b83c-471d933065b1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:14.417813 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-817352f3-6a48-4a25-b513-465c7a0200e0 req-0e9ed26a-9000-4fcf-b83c-471d933065b1 service nova] Creating event network-vif-deleted:c43e0eff-034a-405d-be73-15666f65119b for instance 10d63a1e-2b60-41e6-a49a-7eb472178610 on n-h2-826529-8 Aug 03 02:57:14.422865 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-817352f3-6a48-4a25-b513-465c7a0200e0 req-0e9ed26a-9000-4fcf-b83c-471d933065b1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044617 Aug 03 02:57:14.423510 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3520/6919] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:57:14.649103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c8883eb6-55d5-404a-b843-d88272730418 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:14.649603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c8883eb6-55d5-404a-b843-d88272730418 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:14.656685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8883eb6-55d5-404a-b843-d88272730418 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:14.657133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8883eb6-55d5-404a-b843-d88272730418 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:14.657905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8883eb6-55d5-404a-b843-d88272730418 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:14.658343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8883eb6-55d5-404a-b843-d88272730418 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:14.689381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8883eb6-55d5-404a-b843-d88272730418 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:14.689831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c8883eb6-55d5-404a-b843-d88272730418 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:14.690280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-c8883eb6-55d5-404a-b843-d88272730418 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lazy-loading 'fault' on Instance uuid 10d63a1e-2b60-41e6-a49a-7eb472178610 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:57:14.735738 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c8883eb6-55d5-404a-b843-d88272730418 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b1edf48477d4340bf5453f6bd197d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06d2c97464c45229f24e5f45fdc2b9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:14.745238 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c8883eb6-55d5-404a-b843-d88272730418 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 200 len: 1307 microversion: 2.1 time: 0.100611 Aug 03 02:57:14.746022 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3400/6920] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:14 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:15.767305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cba9c5f8-718e-496b-871f-ddc16c657d07 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:15.768020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cba9c5f8-718e-496b-871f-ddc16c657d07 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] [instance: 10d63a1e-2b60-41e6-a49a-7eb472178610] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:15.775386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cba9c5f8-718e-496b-871f-ddc16c657d07 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:15.775864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cba9c5f8-718e-496b-871f-ddc16c657d07 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:15.776665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cba9c5f8-718e-496b-871f-ddc16c657d07 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:15.777128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cba9c5f8-718e-496b-871f-ddc16c657d07 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:15.790792 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-cba9c5f8-718e-496b-871f-ddc16c657d07 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] HTTP exception thrown: Instance 10d63a1e-2b60-41e6-a49a-7eb472178610 could not be found. Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cba9c5f8-718e-496b-871f-ddc16c657d07 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Request method failure captured: Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 HTTP/1.1 Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6ePrLMSbCkqnbzjOKvFOzaCcCbTa1A0glr4AIfUghPy-_sde2AD7wEhr7AaixtdLe4vKChenOmd1y1Vqf5NVaYFS_ImVXVl6ei6NAqbDtu0QnjM7tu7Y5CGFUUBzVgHv0B79jpCI5UBhhkX6Qvdx8McLdoIb4D3MVHt3REYz1kDuKFQ Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: c06d2c97464c45229f24e5f45fdc2b9a Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c06d2c97464c45229f24e5f45fdc2b9a", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c06d2c97464c45229f24e5f45fdc2b9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c06d2c97464c45229f24e5f45fdc2b9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c06d2c97464c45229f24e5f45fdc2b9a"}]}] Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: c06d2c97464c45229f24e5f45fdc2b9a Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1588316191 Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-ServersNegativeTestJSON-1588316191-project Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 1b1edf48477d4340bf5453f6bd197d08 Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-ServersNegativeTestJSON-1588316191-project Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 10d63a1e-2b60-41e6-a49a-7eb472178610 could not be found. Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '10d63a1e-2b60-41e6-a49a-7eb472178610'} Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10d63a1e-2b60-41e6-a49a-7eb472178610 could not be found. Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d63a1e-2b60-41e6-a49a-7eb472178610 could not be found. Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:57:15.792465 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:57:15.796247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:57:15.796247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:57:15.796247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:57:15.796247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:57:15.796247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:57:15.796247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d63a1e-2b60-41e6-a49a-7eb472178610 could not be found. Aug 03 02:57:15.796247 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:57:15.796247 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cba9c5f8-718e-496b-871f-ddc16c657d07 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] Returning 404 to user: Instance 10d63a1e-2b60-41e6-a49a-7eb472178610 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:57:15.796247 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cba9c5f8-718e-496b-871f-ddc16c657d07 tempest-ServersNegativeTestJSON-1588316191 tempest-ServersNegativeTestJSON-1588316191-project] 10.222.0.67 "GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610" status: 404 len: 111 microversion: 2.1 time: 0.031783 Aug 03 02:57:15.796247 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3521/6921] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:15 2022] GET /compute/v2.1/servers/10d63a1e-2b60-41e6-a49a-7eb472178610 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:57:39.748361 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 02:57:39.748763 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 02:57:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 02:57:47.112905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:57:47.113654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:57:47.303616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93724228-7f34-41f6-bfe9-a326a41f46bb tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Action: 'create', calling method: .version_select at 0x7f5b128234c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1291018440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHe/rtfxe3Z5K66Mb9Tgadwif8eCCQtmyG/njTzyXNJHq8f7jnEoLT5xp/vgbDWQCsnzlWBBv7cMqjzlygPW02d7ukw2Yh+6wROjewqblj1Z9567xwZ99cIkgsmm9sAdJw=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:57:47.320923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-93724228-7f34-41f6-bfe9-a326a41f46bb tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Getting quotas for project 8f1fb62430d043099d168aacb9ebc74d. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:57:47.326528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-93724228-7f34-41f6-bfe9-a326a41f46bb tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Getting quotas for user c50294748a984535ba92bc66b6b7b4d6 and project 8f1fb62430d043099d168aacb9ebc74d. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:57:47.357139 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93724228-7f34-41f6-bfe9-a326a41f46bb tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.249380 Aug 03 02:57:47.357769 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3401/6922] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:57:47 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:57:47.412810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1184066407", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1291018440", "networks": [{"uuid": "d6e98ba7-4cf1-4356-a183-8c7599d8c56c"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:57:47.421753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:57:47.422431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=20 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:57:47.673175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] validate_networks() for [('d6e98ba7-4cf1-4356-a183-8c7599d8c56c', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:57:48.065517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:57:48.065962 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:57:48.066450 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:57:48.066875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:57:48.067326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:57:48.076937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:48.077542 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:48.078434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:48.079005 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:48.097216 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Getting quotas for project 8f1fb62430d043099d168aacb9ebc74d. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:57:48.103644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Getting quotas for user c50294748a984535ba92bc66b6b7b4d6 and project 8f1fb62430d043099d168aacb9ebc74d. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:57:48.117466 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:57:48.119957 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:57:48.169214 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a295b58e-ffb0-4c4f-a025-869af0f0e25e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760989 Aug 03 02:57:48.170046 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3522/6923] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:57:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:57:48.182150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-15641350-185f-426a-80a5-e383a172d81e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:48.182986 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-15641350-185f-426a-80a5-e383a172d81e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:48.399112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-15641350-185f-426a-80a5-e383a172d81e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:48.407984 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-15641350-185f-426a-80a5-e383a172d81e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55" status: 200 len: 1263 microversion: 2.1 time: 0.231038 Aug 03 02:57:48.408885 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3402/6924] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:48 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55 => generated 1263 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:49.431430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-93d6367c-7282-4c01-b960-633350e834ea tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:49.432164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-93d6367c-7282-4c01-b960-633350e834ea tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:49.439783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93d6367c-7282-4c01-b960-633350e834ea tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:49.440349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93d6367c-7282-4c01-b960-633350e834ea tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:49.441214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93d6367c-7282-4c01-b960-633350e834ea tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:49.441748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-93d6367c-7282-4c01-b960-633350e834ea tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:49.518959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-93d6367c-7282-4c01-b960-633350e834ea tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:49.529640 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-93d6367c-7282-4c01-b960-633350e834ea tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55" status: 200 len: 1321 microversion: 2.1 time: 0.102268 Aug 03 02:57:49.530381 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3523/6925] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:49 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55 => generated 1321 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:50.554083 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c7386db0-f4d3-4bfd-838e-9e21836880ee tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:50.555085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c7386db0-f4d3-4bfd-838e-9e21836880ee tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:50.563020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7386db0-f4d3-4bfd-838e-9e21836880ee tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:50.563624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7386db0-f4d3-4bfd-838e-9e21836880ee tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:50.564739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7386db0-f4d3-4bfd-838e-9e21836880ee tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:50.566427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c7386db0-f4d3-4bfd-838e-9e21836880ee tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:50.679807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-0abfdb4e-a844-4d0e-8ee5-adb26b34ee99 req-44c8d917-53b6-455f-8780-5a1779fb47f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c62a891-99b9-4067-9de5-55917eb58f55", "tag": "3b664997-433f-4f90-84e2-ee1e2804d440"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:57:50.690358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-0abfdb4e-a844-4d0e-8ee5-adb26b34ee99 req-44c8d917-53b6-455f-8780-5a1779fb47f9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:50.690820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-0abfdb4e-a844-4d0e-8ee5-adb26b34ee99 req-44c8d917-53b6-455f-8780-5a1779fb47f9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:50.710963 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-0abfdb4e-a844-4d0e-8ee5-adb26b34ee99 req-44c8d917-53b6-455f-8780-5a1779fb47f9 service nova] Creating event network-changed:3b664997-433f-4f90-84e2-ee1e2804d440 for instance 0c62a891-99b9-4067-9de5-55917eb58f55 on n-h1-826529-8 Aug 03 02:57:50.717768 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-0abfdb4e-a844-4d0e-8ee5-adb26b34ee99 req-44c8d917-53b6-455f-8780-5a1779fb47f9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132935 Aug 03 02:57:50.718724 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3524/6926] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:57:50.749159 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c7386db0-f4d3-4bfd-838e-9e21836880ee tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:50.757374 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c7386db0-f4d3-4bfd-838e-9e21836880ee tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55" status: 200 len: 1363 microversion: 2.1 time: 0.209579 Aug 03 02:57:50.758049 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3403/6927] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:50 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:51.779185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f97a729c-1498-4678-86d0-0bcb1f9c8dd3 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:51.780453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f97a729c-1498-4678-86d0-0bcb1f9c8dd3 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:51.788143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f97a729c-1498-4678-86d0-0bcb1f9c8dd3 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:51.788610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f97a729c-1498-4678-86d0-0bcb1f9c8dd3 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:51.789407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f97a729c-1498-4678-86d0-0bcb1f9c8dd3 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:51.789863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f97a729c-1498-4678-86d0-0bcb1f9c8dd3 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:51.934064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f97a729c-1498-4678-86d0-0bcb1f9c8dd3 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:51.942093 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f97a729c-1498-4678-86d0-0bcb1f9c8dd3 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55" status: 200 len: 1363 microversion: 2.1 time: 0.167110 Aug 03 02:57:51.943677 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3525/6928] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:51 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:52.964153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d94f394b-57ff-4304-b085-eb80e47d2b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:52.964814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d94f394b-57ff-4304-b085-eb80e47d2b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:52.972196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d94f394b-57ff-4304-b085-eb80e47d2b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:52.972681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d94f394b-57ff-4304-b085-eb80e47d2b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:52.974141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d94f394b-57ff-4304-b085-eb80e47d2b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:52.974800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d94f394b-57ff-4304-b085-eb80e47d2b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:53.115718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d94f394b-57ff-4304-b085-eb80e47d2b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:53.123344 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d94f394b-57ff-4304-b085-eb80e47d2b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55" status: 200 len: 1363 microversion: 2.1 time: 0.163142 Aug 03 02:57:53.123926 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3404/6929] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:52 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:57:54.145160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-56baccb6-ecf3-46c6-b212-024d45ab6ade tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:54.145831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-56baccb6-ecf3-46c6-b212-024d45ab6ade tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:54.152219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56baccb6-ecf3-46c6-b212-024d45ab6ade tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:54.152676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56baccb6-ecf3-46c6-b212-024d45ab6ade tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:54.153476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56baccb6-ecf3-46c6-b212-024d45ab6ade tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:54.153945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56baccb6-ecf3-46c6-b212-024d45ab6ade tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:54.283793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-56baccb6-ecf3-46c6-b212-024d45ab6ade tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:54.292088 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-56baccb6-ecf3-46c6-b212-024d45ab6ade tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55" status: 200 len: 1363 microversion: 2.1 time: 0.151121 Aug 03 02:57:54.292661 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3526/6930] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:54 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:54.695820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-96613867-dd48-48a9-86cd-65946d992937 req-df3bc3c2-ffba-4c53-ac52-52e5ac195175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c62a891-99b9-4067-9de5-55917eb58f55", "name": "network-vif-plugged", "status": "completed", "tag": "3b664997-433f-4f90-84e2-ee1e2804d440"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:57:54.707095 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-96613867-dd48-48a9-86cd-65946d992937 req-df3bc3c2-ffba-4c53-ac52-52e5ac195175 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:54.707688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-96613867-dd48-48a9-86cd-65946d992937 req-df3bc3c2-ffba-4c53-ac52-52e5ac195175 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:54.720175 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-96613867-dd48-48a9-86cd-65946d992937 req-df3bc3c2-ffba-4c53-ac52-52e5ac195175 service nova] Creating event network-vif-plugged:3b664997-433f-4f90-84e2-ee1e2804d440 for instance 0c62a891-99b9-4067-9de5-55917eb58f55 on n-h1-826529-8 Aug 03 02:57:54.726292 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-96613867-dd48-48a9-86cd-65946d992937 req-df3bc3c2-ffba-4c53-ac52-52e5ac195175 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034163 Aug 03 02:57:54.727224 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3405/6931] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:57:55.313727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-49bce42a-c3ac-49b3-9fa2-c3b0f87a6cfe tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:55.314362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-49bce42a-c3ac-49b3-9fa2-c3b0f87a6cfe tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:55.322858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49bce42a-c3ac-49b3-9fa2-c3b0f87a6cfe tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:55.323356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49bce42a-c3ac-49b3-9fa2-c3b0f87a6cfe tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:55.324150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49bce42a-c3ac-49b3-9fa2-c3b0f87a6cfe tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:55.324610 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-49bce42a-c3ac-49b3-9fa2-c3b0f87a6cfe tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:55.459560 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-49bce42a-c3ac-49b3-9fa2-c3b0f87a6cfe tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:55.467178 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-49bce42a-c3ac-49b3-9fa2-c3b0f87a6cfe tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55" status: 200 len: 1363 microversion: 2.1 time: 0.157361 Aug 03 02:57:55.467755 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3527/6932] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:55 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:56.490614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-79afc2bc-c1f6-41de-87a3-5bac7b5b0423 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:56.491295 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-79afc2bc-c1f6-41de-87a3-5bac7b5b0423 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:56.497803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79afc2bc-c1f6-41de-87a3-5bac7b5b0423 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:56.498261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79afc2bc-c1f6-41de-87a3-5bac7b5b0423 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:56.499153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79afc2bc-c1f6-41de-87a3-5bac7b5b0423 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:56.499606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79afc2bc-c1f6-41de-87a3-5bac7b5b0423 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:56.638242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-79afc2bc-c1f6-41de-87a3-5bac7b5b0423 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:56.646517 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-79afc2bc-c1f6-41de-87a3-5bac7b5b0423 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55" status: 200 len: 1555 microversion: 2.1 time: 0.161938 Aug 03 02:57:56.647120 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3406/6933] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:56 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:56.667131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8c1f6d60-989f-443a-93eb-c4853fff5d30 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:57:56.667762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8c1f6d60-989f-443a-93eb-c4853fff5d30 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:56.674696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c1f6d60-989f-443a-93eb-c4853fff5d30 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:56.675199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c1f6d60-989f-443a-93eb-c4853fff5d30 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:56.675988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c1f6d60-989f-443a-93eb-c4853fff5d30 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:56.676544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8c1f6d60-989f-443a-93eb-c4853fff5d30 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:56.838798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8c1f6d60-989f-443a-93eb-c4853fff5d30 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:57:56.847354 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8c1f6d60-989f-443a-93eb-c4853fff5d30 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55" status: 200 len: 1555 microversion: 2.1 time: 0.184214 Aug 03 02:57:56.847943 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3528/6934] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:57:56 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55 => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:57:58.786191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a69f6b36-3316-44d1-9864-8c91afb4289f tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bd08618-0b1b-4e6a-ab91-82032f8959b0"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:57:58.788698 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a69f6b36-3316-44d1-9864-8c91afb4289f tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:57:58.791968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:57:58.797720 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a69f6b36-3316-44d1-9864-8c91afb4289f tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:58.798180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a69f6b36-3316-44d1-9864-8c91afb4289f tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:58.798998 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a69f6b36-3316-44d1-9864-8c91afb4289f tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:57:58.799463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a69f6b36-3316-44d1-9864-8c91afb4289f tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:57:59.049233 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a69f6b36-3316-44d1-9864-8c91afb4289f tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "POST /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267009 Aug 03 02:57:59.049918 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3407/6935] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:57:58 2022] POST /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:58:09.764582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a446bbb1-aafb-46b2-a290-b5d7a689dacc tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:09.765101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a446bbb1-aafb-46b2-a290-b5d7a689dacc tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:09.768469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:58:09.769334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:58:09.770791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:58:09.771578 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=34 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:58:09.779283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a446bbb1-aafb-46b2-a290-b5d7a689dacc tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:09.779754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a446bbb1-aafb-46b2-a290-b5d7a689dacc tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:09.780551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a446bbb1-aafb-46b2-a290-b5d7a689dacc tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:09.781003 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a446bbb1-aafb-46b2-a290-b5d7a689dacc tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:09.864442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-a446bbb1-aafb-46b2-a290-b5d7a689dacc tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lazy-loading 'services' on Instance uuid 0c62a891-99b9-4067-9de5-55917eb58f55 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:58:09.947461 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a446bbb1-aafb-46b2-a290-b5d7a689dacc tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments/2bd08618-0b1b-4e6a-ab91-82032f8959b0" status: 202 len: 0 microversion: 2.1 time: 0.186924 Aug 03 02:58:09.948085 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3529/6936] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:58:09 2022] DELETE /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments/2bd08618-0b1b-4e6a-ab91-82032f8959b0 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 02:58:09.954713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:58:09.955592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:58:09.960939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-99ad8a73-2324-4f02-8d2c-449804cbfd2b tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:09.963429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-99ad8a73-2324-4f02-8d2c-449804cbfd2b tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:09.972109 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-99ad8a73-2324-4f02-8d2c-449804cbfd2b tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:09.972577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-99ad8a73-2324-4f02-8d2c-449804cbfd2b tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:09.973482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-99ad8a73-2324-4f02-8d2c-449804cbfd2b tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:09.974133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-99ad8a73-2324-4f02-8d2c-449804cbfd2b tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:10.007803 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-99ad8a73-2324-4f02-8d2c-449804cbfd2b tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054914 Aug 03 02:58:10.008386 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3408/6937] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:58:09 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:58:11.023037 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c3fe5ff1-58b8-4e24-94c4-bf629ff2ac33 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:11.025469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c3fe5ff1-58b8-4e24-94c4-bf629ff2ac33 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:11.032277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3fe5ff1-58b8-4e24-94c4-bf629ff2ac33 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:11.032744 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3fe5ff1-58b8-4e24-94c4-bf629ff2ac33 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:11.033573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3fe5ff1-58b8-4e24-94c4-bf629ff2ac33 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:11.034026 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3fe5ff1-58b8-4e24-94c4-bf629ff2ac33 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:11.068153 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c3fe5ff1-58b8-4e24-94c4-bf629ff2ac33 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050169 Aug 03 02:58:11.068974 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3530/6938] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:58:11 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:58:12.080750 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-47d113a1-446f-4b2a-bfb7-0d5787f815a1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:12.083542 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-47d113a1-446f-4b2a-bfb7-0d5787f815a1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:12.091062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47d113a1-446f-4b2a-bfb7-0d5787f815a1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:12.091522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47d113a1-446f-4b2a-bfb7-0d5787f815a1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:12.092319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47d113a1-446f-4b2a-bfb7-0d5787f815a1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:12.092766 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-47d113a1-446f-4b2a-bfb7-0d5787f815a1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:12.124087 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-47d113a1-446f-4b2a-bfb7-0d5787f815a1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047330 Aug 03 02:58:12.124670 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3409/6939] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:58:12 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:58:13.136389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aa4a5da5-2617-43f9-90b7-a98c756e8d04 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:13.138530 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-aa4a5da5-2617-43f9-90b7-a98c756e8d04 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:13.146158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa4a5da5-2617-43f9-90b7-a98c756e8d04 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:13.146622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa4a5da5-2617-43f9-90b7-a98c756e8d04 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:13.147432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa4a5da5-2617-43f9-90b7-a98c756e8d04 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:13.147918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa4a5da5-2617-43f9-90b7-a98c756e8d04 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:13.179376 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-aa4a5da5-2617-43f9-90b7-a98c756e8d04 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047241 Aug 03 02:58:13.179959 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3531/6940] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:58:13 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:58:14.192429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e8c3a62b-45d9-410a-a858-836dff32482a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:14.194723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e8c3a62b-45d9-410a-a858-836dff32482a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:14.202089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8c3a62b-45d9-410a-a858-836dff32482a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:14.202549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8c3a62b-45d9-410a-a858-836dff32482a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:14.203370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8c3a62b-45d9-410a-a858-836dff32482a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:14.203819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e8c3a62b-45d9-410a-a858-836dff32482a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:14.234346 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e8c3a62b-45d9-410a-a858-836dff32482a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046560 Aug 03 02:58:14.234942 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3410/6941] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:58:14 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:58:15.247547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b6a2caae-6c09-4c3f-adab-5f540350d4f4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:15.249783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b6a2caae-6c09-4c3f-adab-5f540350d4f4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:15.257023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6a2caae-6c09-4c3f-adab-5f540350d4f4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:15.257493 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6a2caae-6c09-4c3f-adab-5f540350d4f4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:15.258293 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6a2caae-6c09-4c3f-adab-5f540350d4f4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:15.258747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b6a2caae-6c09-4c3f-adab-5f540350d4f4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:15.290866 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b6a2caae-6c09-4c3f-adab-5f540350d4f4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047391 Aug 03 02:58:15.291475 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3532/6942] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:58:15 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:58:15.302691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-03920821-98d3-4f16-8721-0dad119e37de tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:15.303280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-03920821-98d3-4f16-8721-0dad119e37de tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:15.310662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03920821-98d3-4f16-8721-0dad119e37de tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:15.311163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03920821-98d3-4f16-8721-0dad119e37de tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:15.311963 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03920821-98d3-4f16-8721-0dad119e37de tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:15.312453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-03920821-98d3-4f16-8721-0dad119e37de tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:15.392537 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-03920821-98d3-4f16-8721-0dad119e37de tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] HTTP exception thrown: Instance 0c62a891-99b9-4067-9de5-55917eb58f55 is not attached to volume 2bd08618-0b1b-4e6a-ab91-82032f8959b0 Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-03920821-98d3-4f16-8721-0dad119e37de tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Request method failure captured: Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments/2bd08618-0b1b-4e6a-ab91-82032f8959b0 HTTP/1.1 Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eQlSx5D6krwwWIeDaNyf1mWhdxp7PCg2lTlA2GwKjWs0riM-mAiEUgLTuuF-Fh1bh0_TThSrl4cZS1vfETSxgvkdVaYxcCYtzDE0CS-zE5X0g2WvMeg68wMGaSmT6ovRrTVpvvAho9YE4Nt6bTCpb99ShHCZuj6TPZ_KiS6_pQSb1E Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 8f1fb62430d043099d168aacb9ebc74d Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8f1fb62430d043099d168aacb9ebc74d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f1fb62430d043099d168aacb9ebc74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8f1fb62430d043099d168aacb9ebc74d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f1fb62430d043099d168aacb9ebc74d"}]}] Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 8f1fb62430d043099d168aacb9ebc74d Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestEncryptedCinderVolumes-687753862-project Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: c50294748a984535ba92bc66b6b7b4d6 Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestEncryptedCinderVolumes-687753862-project Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 0c62a891-99b9-4067-9de5-55917eb58f55 is not attached to volume 2bd08618-0b1b-4e6a-ab91-82032f8959b0 Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'server_id': '0c62a891-99b9-4067-9de5-55917eb58f55', 'id': '2bd08618-0b1b-4e6a-ab91-82032f8959b0'} Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2bd08618-0b1b-4e6a-ab91-82032f8959b0. Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c62a891-99b9-4067-9de5-55917eb58f55 is not attached to volume 2bd08618-0b1b-4e6a-ab91-82032f8959b0 Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:58:15.398594 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:58:15.403058 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:58:15.403058 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:58:15.403058 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c62a891-99b9-4067-9de5-55917eb58f55 is not attached to volume 2bd08618-0b1b-4e6a-ab91-82032f8959b0 Aug 03 02:58:15.403058 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:58:15.403058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-03920821-98d3-4f16-8721-0dad119e37de tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Returning 404 to user: Instance 0c62a891-99b9-4067-9de5-55917eb58f55 is not attached to volume 2bd08618-0b1b-4e6a-ab91-82032f8959b0 {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:58:15.403058 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-03920821-98d3-4f16-8721-0dad119e37de tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments/2bd08618-0b1b-4e6a-ab91-82032f8959b0" status: 404 len: 154 microversion: 2.1 time: 0.102230 Aug 03 02:58:15.403058 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3411/6943] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:58:15 2022] DELETE /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55/os-volume_attachments/2bd08618-0b1b-4e6a-ab91-82032f8959b0 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:58:18.749786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3ee0169c-efd4-4413-8ffa-f417e981f3ab tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:18.750309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3ee0169c-efd4-4413-8ffa-f417e981f3ab tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:18.757880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ee0169c-efd4-4413-8ffa-f417e981f3ab tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:18.758351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ee0169c-efd4-4413-8ffa-f417e981f3ab tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:18.759174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ee0169c-efd4-4413-8ffa-f417e981f3ab tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:18.759636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3ee0169c-efd4-4413-8ffa-f417e981f3ab tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:18.789715 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3ee0169c-efd4-4413-8ffa-f417e981f3ab tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:58:18.875430 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3ee0169c-efd4-4413-8ffa-f417e981f3ab tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55" status: 204 len: 0 microversion: 2.1 time: 0.129263 Aug 03 02:58:18.876574 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3533/6944] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:58:18 2022] DELETE /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:58:18.884880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f152d52c-db15-4453-89f8-3f7a936a670f tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:18.885526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f152d52c-db15-4453-89f8-3f7a936a670f tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:18.892822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f152d52c-db15-4453-89f8-3f7a936a670f tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:18.893283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f152d52c-db15-4453-89f8-3f7a936a670f tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:18.894078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f152d52c-db15-4453-89f8-3f7a936a670f tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:18.894577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f152d52c-db15-4453-89f8-3f7a936a670f tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:19.034092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f152d52c-db15-4453-89f8-3f7a936a670f tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:19.043303 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f152d52c-db15-4453-89f8-3f7a936a670f tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55" status: 200 len: 1561 microversion: 2.1 time: 0.162560 Aug 03 02:58:19.043966 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3412/6945] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:18 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:58:20.065846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7b7a742a-aa76-481f-9f1a-83da6c88f116 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:20.067709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7b7a742a-aa76-481f-9f1a-83da6c88f116 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:20.074444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b7a742a-aa76-481f-9f1a-83da6c88f116 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:20.074947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b7a742a-aa76-481f-9f1a-83da6c88f116 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:20.075726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b7a742a-aa76-481f-9f1a-83da6c88f116 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:20.076176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b7a742a-aa76-481f-9f1a-83da6c88f116 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:20.216396 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7b7a742a-aa76-481f-9f1a-83da6c88f116 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:20.224090 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7b7a742a-aa76-481f-9f1a-83da6c88f116 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55" status: 200 len: 1561 microversion: 2.1 time: 0.162517 Aug 03 02:58:20.224677 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3534/6946] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:20 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:58:20.932157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-18649e96-1a51-4236-810a-3be3dbceea2a req-4670cb78-a299-4da6-bb51-fb0b321338e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c62a891-99b9-4067-9de5-55917eb58f55", "name": "network-vif-deleted", "tag": "3b664997-433f-4f90-84e2-ee1e2804d440"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:58:20.946007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-18649e96-1a51-4236-810a-3be3dbceea2a req-4670cb78-a299-4da6-bb51-fb0b321338e7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:20.946610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-18649e96-1a51-4236-810a-3be3dbceea2a req-4670cb78-a299-4da6-bb51-fb0b321338e7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:20.963721 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-18649e96-1a51-4236-810a-3be3dbceea2a req-4670cb78-a299-4da6-bb51-fb0b321338e7 service nova] Creating event network-vif-deleted:3b664997-433f-4f90-84e2-ee1e2804d440 for instance 0c62a891-99b9-4067-9de5-55917eb58f55 on n-h1-826529-8 Aug 03 02:58:20.969507 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-18649e96-1a51-4236-810a-3be3dbceea2a req-4670cb78-a299-4da6-bb51-fb0b321338e7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044106 Aug 03 02:58:20.970655 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3413/6947] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:58:21.245022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-06d98b5c-e63f-4135-a592-b45e75bcb6f8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:21.245541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-06d98b5c-e63f-4135-a592-b45e75bcb6f8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:21.252582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06d98b5c-e63f-4135-a592-b45e75bcb6f8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:21.253051 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06d98b5c-e63f-4135-a592-b45e75bcb6f8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:21.254353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06d98b5c-e63f-4135-a592-b45e75bcb6f8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:21.254814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06d98b5c-e63f-4135-a592-b45e75bcb6f8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:21.289056 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06d98b5c-e63f-4135-a592-b45e75bcb6f8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:21.289524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-06d98b5c-e63f-4135-a592-b45e75bcb6f8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:21.289994 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-06d98b5c-e63f-4135-a592-b45e75bcb6f8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lazy-loading 'fault' on Instance uuid 0c62a891-99b9-4067-9de5-55917eb58f55 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:58:21.340142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-06d98b5c-e63f-4135-a592-b45e75bcb6f8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:21.348158 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-06d98b5c-e63f-4135-a592-b45e75bcb6f8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55" status: 200 len: 1353 microversion: 2.1 time: 0.107116 Aug 03 02:58:21.348767 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3535/6948] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:21 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55 => generated 1353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:58:22.371086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d4fec02d-b0b9-4880-a0fe-be8113000887 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:22.371785 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d4fec02d-b0b9-4880-a0fe-be8113000887 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 0c62a891-99b9-4067-9de5-55917eb58f55] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:22.378078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4fec02d-b0b9-4880-a0fe-be8113000887 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:22.378523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4fec02d-b0b9-4880-a0fe-be8113000887 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:22.379570 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4fec02d-b0b9-4880-a0fe-be8113000887 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:22.380008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d4fec02d-b0b9-4880-a0fe-be8113000887 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:22.393500 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-d4fec02d-b0b9-4880-a0fe-be8113000887 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] HTTP exception thrown: Instance 0c62a891-99b9-4067-9de5-55917eb58f55 could not be found. Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d4fec02d-b0b9-4880-a0fe-be8113000887 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Request method failure captured: Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55 HTTP/1.1 Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eQlSx5D6krwwWIeDaNyf1mWhdxp7PCg2lTlA2GwKjWs0riM-mAiEUgLTuuF-Fh1bh0_TThSrl4cZS1vfETSxgvkdVaYxcCYtzDE0CS-zE5X0g2WvMeg68wMGaSmT6ovRrTVpvvAho9YE4Nt6bTCpb99ShHCZuj6TPZ_KiS6_pQSb1E Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 8f1fb62430d043099d168aacb9ebc74d Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8f1fb62430d043099d168aacb9ebc74d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f1fb62430d043099d168aacb9ebc74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8f1fb62430d043099d168aacb9ebc74d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f1fb62430d043099d168aacb9ebc74d"}]}] Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 8f1fb62430d043099d168aacb9ebc74d Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestEncryptedCinderVolumes-687753862-project Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: c50294748a984535ba92bc66b6b7b4d6 Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestEncryptedCinderVolumes-687753862-project Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 0c62a891-99b9-4067-9de5-55917eb58f55 could not be found. Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '0c62a891-99b9-4067-9de5-55917eb58f55'} Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c62a891-99b9-4067-9de5-55917eb58f55 could not be found. Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c62a891-99b9-4067-9de5-55917eb58f55 could not be found. Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:58:22.395724 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:58:22.399778 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:58:22.399778 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:58:22.399778 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:58:22.399778 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:58:22.399778 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:58:22.399778 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c62a891-99b9-4067-9de5-55917eb58f55 could not be found. Aug 03 02:58:22.399778 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:58:22.399778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d4fec02d-b0b9-4880-a0fe-be8113000887 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Returning 404 to user: Instance 0c62a891-99b9-4067-9de5-55917eb58f55 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:58:22.399778 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d4fec02d-b0b9-4880-a0fe-be8113000887 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55" status: 404 len: 111 microversion: 2.1 time: 0.031339 Aug 03 02:58:22.399778 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3414/6949] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:22 2022] GET /compute/v2.1/servers/0c62a891-99b9-4067-9de5-55917eb58f55 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:58:22.405903 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-307f2856-f7ba-48d8-adc2-8e2b036de842 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '.version_select at 0x7f5b24423040>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:22.427846 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-307f2856-f7ba-48d8-adc2-8e2b036de842 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1291018440" status: 202 len: 0 microversion: 2.1 time: 0.025732 Aug 03 02:58:22.428469 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3536/6950] 10.222.0.67 () {58 vars in 1278 bytes} [Wed Aug 3 02:58:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1291018440 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:58:22.446044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-719f5034-d1a8-49f7-97f8-ecd619977291 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Action: 'create', calling method: .version_select at 0x7f5b13a23c10>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-310891611", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQSpn3fRWH7l6+iqYxYAHESHl36RvfAbKEulL9J1GVlkzID2oBH+y4dxfBazV0CUAQvfDSKyN3h+jz2l8VYl7gi7b1CjqCJwznESM8QPkEHI9A7U8Upj1fw7y1gJNpIlw=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:58:22.462077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-719f5034-d1a8-49f7-97f8-ecd619977291 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Getting quotas for project 8f1fb62430d043099d168aacb9ebc74d. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:58:22.467431 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-719f5034-d1a8-49f7-97f8-ecd619977291 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Getting quotas for user c50294748a984535ba92bc66b6b7b4d6 and project 8f1fb62430d043099d168aacb9ebc74d. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:58:22.491334 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-719f5034-d1a8-49f7-97f8-ecd619977291 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049643 Aug 03 02:58:22.491933 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3415/6951] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:58:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:58:22.545380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-835745529", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-310891611", "networks": [{"uuid": "d6e98ba7-4cf1-4356-a183-8c7599d8c56c"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:58:22.599261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] validate_networks() for [('d6e98ba7-4cf1-4356-a183-8c7599d8c56c', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:58:23.242219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:58:23.242661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:58:23.243176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:58:23.243599 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:58:23.244024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:58:23.252890 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:23.253379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:23.254465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:23.254934 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:23.272868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Getting quotas for project 8f1fb62430d043099d168aacb9ebc74d. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:58:23.278406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Getting quotas for user c50294748a984535ba92bc66b6b7b4d6 and project 8f1fb62430d043099d168aacb9ebc74d. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:58:23.293872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:58:23.296235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:58:23.345463 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f5ee08d8-7bfe-4872-802a-ba9759664376 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804035 Aug 03 02:58:23.346136 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3537/6952] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:58:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:58:23.357980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-236c78c7-2fee-40c7-a078-1791f1fcc6f1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:23.358735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-236c78c7-2fee-40c7-a078-1791f1fcc6f1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:23.419520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-236c78c7-2fee-40c7-a078-1791f1fcc6f1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:23.427699 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-236c78c7-2fee-40c7-a078-1791f1fcc6f1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d" status: 200 len: 1261 microversion: 2.1 time: 0.073723 Aug 03 02:58:23.428293 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3416/6953] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:23 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d => generated 1261 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:58:24.449327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-de387c67-3380-4ebe-aa07-ffe50328368d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:24.450103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-de387c67-3380-4ebe-aa07-ffe50328368d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:24.457780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de387c67-3380-4ebe-aa07-ffe50328368d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:24.458649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de387c67-3380-4ebe-aa07-ffe50328368d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:24.459063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de387c67-3380-4ebe-aa07-ffe50328368d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:24.459535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de387c67-3380-4ebe-aa07-ffe50328368d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:24.523726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-de387c67-3380-4ebe-aa07-ffe50328368d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:24.531684 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-de387c67-3380-4ebe-aa07-ffe50328368d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d" status: 200 len: 1319 microversion: 2.1 time: 0.087060 Aug 03 02:58:24.532275 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3538/6954] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:24 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d => generated 1319 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:58:25.559044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f9b3d736-11d5-434a-851b-9a50de47d40b tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:25.559674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f9b3d736-11d5-434a-851b-9a50de47d40b tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:25.567192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9b3d736-11d5-434a-851b-9a50de47d40b tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:25.567646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9b3d736-11d5-434a-851b-9a50de47d40b tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:25.568435 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9b3d736-11d5-434a-851b-9a50de47d40b tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:25.568875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9b3d736-11d5-434a-851b-9a50de47d40b tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:25.624532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a9b82cd9-8f7a-4c59-8bf8-823bab64b6ab req-63e2b1b3-7e71-46c0-b2c0-05f7e243044a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d", "tag": "34605239-0ea5-475e-ab13-8de03dc67563"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:58:25.639261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a9b82cd9-8f7a-4c59-8bf8-823bab64b6ab req-63e2b1b3-7e71-46c0-b2c0-05f7e243044a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:25.640086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a9b82cd9-8f7a-4c59-8bf8-823bab64b6ab req-63e2b1b3-7e71-46c0-b2c0-05f7e243044a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:25.653695 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a9b82cd9-8f7a-4c59-8bf8-823bab64b6ab req-63e2b1b3-7e71-46c0-b2c0-05f7e243044a service nova] Creating event network-changed:34605239-0ea5-475e-ab13-8de03dc67563 for instance a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d on n-h1-826529-8 Aug 03 02:58:25.659655 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a9b82cd9-8f7a-4c59-8bf8-823bab64b6ab req-63e2b1b3-7e71-46c0-b2c0-05f7e243044a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039204 Aug 03 02:58:25.661144 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3539/6955] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:58:25.718955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f9b3d736-11d5-434a-851b-9a50de47d40b tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:25.727677 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f9b3d736-11d5-434a-851b-9a50de47d40b tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d" status: 200 len: 1361 microversion: 2.1 time: 0.173112 Aug 03 02:58:25.728290 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3417/6956] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:25 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:58:26.750437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0916d72d-86b4-4a23-b13f-503c962e4aa7 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:26.751214 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0916d72d-86b4-4a23-b13f-503c962e4aa7 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:26.758364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0916d72d-86b4-4a23-b13f-503c962e4aa7 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:26.758830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0916d72d-86b4-4a23-b13f-503c962e4aa7 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:26.759639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0916d72d-86b4-4a23-b13f-503c962e4aa7 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:26.760096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0916d72d-86b4-4a23-b13f-503c962e4aa7 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:26.909731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0916d72d-86b4-4a23-b13f-503c962e4aa7 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:26.921106 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0916d72d-86b4-4a23-b13f-503c962e4aa7 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d" status: 200 len: 1361 microversion: 2.1 time: 0.175780 Aug 03 02:58:26.921711 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3540/6957] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:26 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:58:27.944924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-32ad2304-5761-4648-a68a-0df0b94cc953 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:27.945550 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-32ad2304-5761-4648-a68a-0df0b94cc953 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:27.952635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-32ad2304-5761-4648-a68a-0df0b94cc953 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:27.953097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-32ad2304-5761-4648-a68a-0df0b94cc953 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:27.953887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-32ad2304-5761-4648-a68a-0df0b94cc953 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:27.954334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-32ad2304-5761-4648-a68a-0df0b94cc953 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:28.085235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-32ad2304-5761-4648-a68a-0df0b94cc953 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:28.092834 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-32ad2304-5761-4648-a68a-0df0b94cc953 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d" status: 200 len: 1361 microversion: 2.1 time: 0.151843 Aug 03 02:58:28.093411 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3418/6958] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:27 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:58:29.114723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5af684f6-2881-4f43-9b19-ffa7466e7d74 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:29.115388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5af684f6-2881-4f43-9b19-ffa7466e7d74 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:29.122714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5af684f6-2881-4f43-9b19-ffa7466e7d74 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:29.123215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5af684f6-2881-4f43-9b19-ffa7466e7d74 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:29.124034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5af684f6-2881-4f43-9b19-ffa7466e7d74 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:29.124485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5af684f6-2881-4f43-9b19-ffa7466e7d74 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:29.268309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5af684f6-2881-4f43-9b19-ffa7466e7d74 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:29.276358 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5af684f6-2881-4f43-9b19-ffa7466e7d74 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d" status: 200 len: 1361 microversion: 2.1 time: 0.166443 Aug 03 02:58:29.276957 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3541/6959] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:29 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:58:30.297145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e42912e1-3c95-4565-b8cb-ba5b59bea941 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:30.297788 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e42912e1-3c95-4565-b8cb-ba5b59bea941 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:30.305170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e42912e1-3c95-4565-b8cb-ba5b59bea941 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:30.305623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e42912e1-3c95-4565-b8cb-ba5b59bea941 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:30.306410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e42912e1-3c95-4565-b8cb-ba5b59bea941 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:30.306843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e42912e1-3c95-4565-b8cb-ba5b59bea941 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:30.439915 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e42912e1-3c95-4565-b8cb-ba5b59bea941 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:30.447926 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e42912e1-3c95-4565-b8cb-ba5b59bea941 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d" status: 200 len: 1361 microversion: 2.1 time: 0.154737 Aug 03 02:58:30.448496 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3419/6960] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:30 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:58:30.873467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-8e661bd1-af8a-4121-8dc4-bfc217983a7e req-89ff17c9-9418-44ef-965f-99352094210f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d", "name": "network-vif-plugged", "status": "completed", "tag": "34605239-0ea5-475e-ab13-8de03dc67563"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:58:30.884639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8e661bd1-af8a-4121-8dc4-bfc217983a7e req-89ff17c9-9418-44ef-965f-99352094210f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:30.885174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-8e661bd1-af8a-4121-8dc4-bfc217983a7e req-89ff17c9-9418-44ef-965f-99352094210f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:30.902346 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-8e661bd1-af8a-4121-8dc4-bfc217983a7e req-89ff17c9-9418-44ef-965f-99352094210f service nova] Creating event network-vif-plugged:34605239-0ea5-475e-ab13-8de03dc67563 for instance a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d on n-h1-826529-8 Aug 03 02:58:30.907412 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-8e661bd1-af8a-4121-8dc4-bfc217983a7e req-89ff17c9-9418-44ef-965f-99352094210f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037727 Aug 03 02:58:30.908032 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3542/6961] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:58:31.473329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8f8f9609-a3e9-482f-a487-7930490a1c4a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:31.474013 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8f8f9609-a3e9-482f-a487-7930490a1c4a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:31.481407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f8f9609-a3e9-482f-a487-7930490a1c4a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:31.481855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f8f9609-a3e9-482f-a487-7930490a1c4a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:31.482638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f8f9609-a3e9-482f-a487-7930490a1c4a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:31.483200 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8f8f9609-a3e9-482f-a487-7930490a1c4a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:31.642826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8f8f9609-a3e9-482f-a487-7930490a1c4a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:31.652274 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8f8f9609-a3e9-482f-a487-7930490a1c4a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d" status: 200 len: 1361 microversion: 2.1 time: 0.183462 Aug 03 02:58:31.652870 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3420/6962] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:31 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:58:32.674841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-14e9f910-4ac0-407f-8d81-c793a155de8c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:32.675614 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-14e9f910-4ac0-407f-8d81-c793a155de8c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:32.683144 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-14e9f910-4ac0-407f-8d81-c793a155de8c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:32.683619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-14e9f910-4ac0-407f-8d81-c793a155de8c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:32.684421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-14e9f910-4ac0-407f-8d81-c793a155de8c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:32.684881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-14e9f910-4ac0-407f-8d81-c793a155de8c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:32.822591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-14e9f910-4ac0-407f-8d81-c793a155de8c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:32.830573 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-14e9f910-4ac0-407f-8d81-c793a155de8c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d" status: 200 len: 1554 microversion: 2.1 time: 0.160047 Aug 03 02:58:32.831188 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3543/6963] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:32 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:58:32.851461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cf83bbe2-81cc-432e-94bd-afdac91a0408 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:32.852088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cf83bbe2-81cc-432e-94bd-afdac91a0408 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:32.859271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf83bbe2-81cc-432e-94bd-afdac91a0408 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:32.859729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf83bbe2-81cc-432e-94bd-afdac91a0408 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:32.860526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf83bbe2-81cc-432e-94bd-afdac91a0408 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:32.860976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cf83bbe2-81cc-432e-94bd-afdac91a0408 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:33.001275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cf83bbe2-81cc-432e-94bd-afdac91a0408 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:33.009661 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cf83bbe2-81cc-432e-94bd-afdac91a0408 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d" status: 200 len: 1554 microversion: 2.1 time: 0.162223 Aug 03 02:58:33.010262 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3421/6964] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:32 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:58:34.525299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8ee5ee80-d621-481c-9828-6dd23ed017c4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91a392c1-fd1d-42aa-842f-e5ae76c914e3"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:58:34.527925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8ee5ee80-d621-481c-9828-6dd23ed017c4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:34.529988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:58:34.530699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:58:34.546392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ee5ee80-d621-481c-9828-6dd23ed017c4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:34.546853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ee5ee80-d621-481c-9828-6dd23ed017c4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:34.547677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ee5ee80-d621-481c-9828-6dd23ed017c4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:34.548127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ee5ee80-d621-481c-9828-6dd23ed017c4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:34.983077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:58:35.004699 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8ee5ee80-d621-481c-9828-6dd23ed017c4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "POST /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483156 Aug 03 02:58:35.005490 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3544/6965] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:58:34 2022] POST /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:58:45.765889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-26235ac8-bc87-4f36-b698-5b774922b21a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:45.766463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-26235ac8-bc87-4f36-b698-5b774922b21a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:45.769017 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:58:45.770820 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:58:45.771484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=64 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:58:45.779093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26235ac8-bc87-4f36-b698-5b774922b21a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:45.779709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26235ac8-bc87-4f36-b698-5b774922b21a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:45.780635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26235ac8-bc87-4f36-b698-5b774922b21a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:45.781079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-26235ac8-bc87-4f36-b698-5b774922b21a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:45.868397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-26235ac8-bc87-4f36-b698-5b774922b21a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lazy-loading 'services' on Instance uuid a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:58:45.952084 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-26235ac8-bc87-4f36-b698-5b774922b21a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments/91a392c1-fd1d-42aa-842f-e5ae76c914e3" status: 202 len: 0 microversion: 2.1 time: 0.189930 Aug 03 02:58:45.952723 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3422/6966] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:58:45 2022] DELETE /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments/91a392c1-fd1d-42aa-842f-e5ae76c914e3 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:58:45.961664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:58:45.962698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:58:45.967494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aa02ed79-0ab1-45ae-bb07-e031921b09dc tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:45.970091 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-aa02ed79-0ab1-45ae-bb07-e031921b09dc tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:45.979792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa02ed79-0ab1-45ae-bb07-e031921b09dc tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:45.980340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa02ed79-0ab1-45ae-bb07-e031921b09dc tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:45.980976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa02ed79-0ab1-45ae-bb07-e031921b09dc tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:45.981433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa02ed79-0ab1-45ae-bb07-e031921b09dc tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:46.016544 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-aa02ed79-0ab1-45ae-bb07-e031921b09dc tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056661 Aug 03 02:58:46.017589 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3545/6967] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:58:45 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:58:47.031783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-df86cf1e-16dc-4f03-a39e-6c6bef7a9b62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:47.034179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-df86cf1e-16dc-4f03-a39e-6c6bef7a9b62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:47.042832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df86cf1e-16dc-4f03-a39e-6c6bef7a9b62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:47.043353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df86cf1e-16dc-4f03-a39e-6c6bef7a9b62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:47.044180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df86cf1e-16dc-4f03-a39e-6c6bef7a9b62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:47.044673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-df86cf1e-16dc-4f03-a39e-6c6bef7a9b62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:47.086010 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-df86cf1e-16dc-4f03-a39e-6c6bef7a9b62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059743 Aug 03 02:58:47.086640 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3423/6968] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:58:47 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:58:48.100617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-53faf05b-360d-4df9-8018-8181e95d00e1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:48.103786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-53faf05b-360d-4df9-8018-8181e95d00e1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:48.111316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53faf05b-360d-4df9-8018-8181e95d00e1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:48.111936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53faf05b-360d-4df9-8018-8181e95d00e1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:48.113442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53faf05b-360d-4df9-8018-8181e95d00e1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:48.113835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-53faf05b-360d-4df9-8018-8181e95d00e1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:48.150168 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-53faf05b-360d-4df9-8018-8181e95d00e1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054424 Aug 03 02:58:48.150553 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3546/6969] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:58:48 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:58:49.164398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-564aca82-8729-46ec-a7d7-02e5c078b16e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:49.166610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-564aca82-8729-46ec-a7d7-02e5c078b16e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:49.173614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-564aca82-8729-46ec-a7d7-02e5c078b16e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:49.174059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-564aca82-8729-46ec-a7d7-02e5c078b16e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:49.175556 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-564aca82-8729-46ec-a7d7-02e5c078b16e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:49.175997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-564aca82-8729-46ec-a7d7-02e5c078b16e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:49.209731 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-564aca82-8729-46ec-a7d7-02e5c078b16e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049415 Aug 03 02:58:49.210314 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3424/6970] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:58:49 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:58:50.231118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-16762fcd-caff-4e23-aafd-d896240602e1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:50.233414 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-16762fcd-caff-4e23-aafd-d896240602e1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:50.241149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16762fcd-caff-4e23-aafd-d896240602e1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:50.241618 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16762fcd-caff-4e23-aafd-d896240602e1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:50.242413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16762fcd-caff-4e23-aafd-d896240602e1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:50.242866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-16762fcd-caff-4e23-aafd-d896240602e1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:50.278088 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-16762fcd-caff-4e23-aafd-d896240602e1 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051206 Aug 03 02:58:50.278707 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3547/6971] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:58:50 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:58:51.290606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-be5cb0c7-d303-4d2f-82d1-4be9cedfd9f6 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:51.293002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-be5cb0c7-d303-4d2f-82d1-4be9cedfd9f6 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:51.301074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be5cb0c7-d303-4d2f-82d1-4be9cedfd9f6 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:51.301568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be5cb0c7-d303-4d2f-82d1-4be9cedfd9f6 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:51.302362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be5cb0c7-d303-4d2f-82d1-4be9cedfd9f6 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:51.302812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be5cb0c7-d303-4d2f-82d1-4be9cedfd9f6 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:51.334714 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-be5cb0c7-d303-4d2f-82d1-4be9cedfd9f6 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048089 Aug 03 02:58:51.335334 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3425/6972] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:58:51 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:58:51.345848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-511c9b7e-15e2-4d43-b5a4-44caf19ebb07 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:51.347087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-511c9b7e-15e2-4d43-b5a4-44caf19ebb07 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:51.354376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-511c9b7e-15e2-4d43-b5a4-44caf19ebb07 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:51.354759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-511c9b7e-15e2-4d43-b5a4-44caf19ebb07 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:51.355607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-511c9b7e-15e2-4d43-b5a4-44caf19ebb07 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:51.356072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-511c9b7e-15e2-4d43-b5a4-44caf19ebb07 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:51.436066 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-511c9b7e-15e2-4d43-b5a4-44caf19ebb07 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] HTTP exception thrown: Instance a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d is not attached to volume 91a392c1-fd1d-42aa-842f-e5ae76c914e3 Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-511c9b7e-15e2-4d43-b5a4-44caf19ebb07 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Request method failure captured: Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: request: DELETE /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments/91a392c1-fd1d-42aa-842f-e5ae76c914e3 HTTP/1.1 Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eQlSx5D6krwwWIeDaNyf1mWhdxp7PCg2lTlA2GwKjWs0riM-mAiEUgLTuuF-Fh1bh0_TThSrl4cZS1vfETSxgvkdVaYxcCYtzDE0CS-zE5X0g2WvMeg68wMGaSmT6ovRrTVpvvAho9YE4Nt6bTCpb99ShHCZuj6TPZ_KiS6_pQSb1E Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 8f1fb62430d043099d168aacb9ebc74d Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8f1fb62430d043099d168aacb9ebc74d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f1fb62430d043099d168aacb9ebc74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8f1fb62430d043099d168aacb9ebc74d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f1fb62430d043099d168aacb9ebc74d"}]}] Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 8f1fb62430d043099d168aacb9ebc74d Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestEncryptedCinderVolumes-687753862-project Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: c50294748a984535ba92bc66b6b7b4d6 Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestEncryptedCinderVolumes-687753862-project Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d is not attached to volume 91a392c1-fd1d-42aa-842f-e5ae76c914e3 Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'server_id': 'a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d', 'id': '91a392c1-fd1d-42aa-842f-e5ae76c914e3'} Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 91a392c1-fd1d-42aa-842f-e5ae76c914e3. Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d is not attached to volume 91a392c1-fd1d-42aa-842f-e5ae76c914e3 Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:58:51.438045 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:58:51.442958 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:58:51.442958 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:58:51.442958 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d is not attached to volume 91a392c1-fd1d-42aa-842f-e5ae76c914e3 Aug 03 02:58:51.442958 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:58:51.442958 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-511c9b7e-15e2-4d43-b5a4-44caf19ebb07 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Returning 404 to user: Instance a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d is not attached to volume 91a392c1-fd1d-42aa-842f-e5ae76c914e3 {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:58:51.442958 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-511c9b7e-15e2-4d43-b5a4-44caf19ebb07 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments/91a392c1-fd1d-42aa-842f-e5ae76c914e3" status: 404 len: 154 microversion: 2.1 time: 0.097802 Aug 03 02:58:51.442958 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3548/6973] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:58:51 2022] DELETE /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d/os-volume_attachments/91a392c1-fd1d-42aa-842f-e5ae76c914e3 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:58:54.810082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c1b5597e-afb2-43b7-9618-5c56771dba4d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:54.810651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c1b5597e-afb2-43b7-9618-5c56771dba4d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:54.819213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1b5597e-afb2-43b7-9618-5c56771dba4d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:54.819671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1b5597e-afb2-43b7-9618-5c56771dba4d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:54.820453 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1b5597e-afb2-43b7-9618-5c56771dba4d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:54.820927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1b5597e-afb2-43b7-9618-5c56771dba4d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:54.849057 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c1b5597e-afb2-43b7-9618-5c56771dba4d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:58:54.932151 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c1b5597e-afb2-43b7-9618-5c56771dba4d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d" status: 204 len: 0 microversion: 2.1 time: 0.125399 Aug 03 02:58:54.933323 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3426/6974] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:58:54 2022] DELETE /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:58:54.943017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b8fbe21d-e296-4c4e-8d3b-8b0fb9a3288c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:54.943579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b8fbe21d-e296-4c4e-8d3b-8b0fb9a3288c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:54.950990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8fbe21d-e296-4c4e-8d3b-8b0fb9a3288c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:54.951494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8fbe21d-e296-4c4e-8d3b-8b0fb9a3288c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:54.952289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8fbe21d-e296-4c4e-8d3b-8b0fb9a3288c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:54.953752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8fbe21d-e296-4c4e-8d3b-8b0fb9a3288c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:55.103651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b8fbe21d-e296-4c4e-8d3b-8b0fb9a3288c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:55.115410 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b8fbe21d-e296-4c4e-8d3b-8b0fb9a3288c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d" status: 200 len: 1560 microversion: 2.1 time: 0.177184 Aug 03 02:58:55.115986 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3549/6975] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:54 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:58:56.138855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-80a1a973-6dce-4bcf-8831-4f3a36e91184 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:56.139630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-80a1a973-6dce-4bcf-8831-4f3a36e91184 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:56.146979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80a1a973-6dce-4bcf-8831-4f3a36e91184 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:56.147442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80a1a973-6dce-4bcf-8831-4f3a36e91184 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:56.148231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80a1a973-6dce-4bcf-8831-4f3a36e91184 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:56.148680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80a1a973-6dce-4bcf-8831-4f3a36e91184 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:56.287995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-80a1a973-6dce-4bcf-8831-4f3a36e91184 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:56.296073 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-80a1a973-6dce-4bcf-8831-4f3a36e91184 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d" status: 200 len: 1560 microversion: 2.1 time: 0.161825 Aug 03 02:58:56.296660 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3427/6976] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:56 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:58:57.100149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c1e38837-2931-45b1-aa34-bdbf523d8a9d req-45cc51dd-8fdf-4d37-9426-a2d37c9961ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d", "name": "network-vif-deleted", "tag": "34605239-0ea5-475e-ab13-8de03dc67563"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:58:57.115463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c1e38837-2931-45b1-aa34-bdbf523d8a9d req-45cc51dd-8fdf-4d37-9426-a2d37c9961ef service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:57.116127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c1e38837-2931-45b1-aa34-bdbf523d8a9d req-45cc51dd-8fdf-4d37-9426-a2d37c9961ef service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:57.131726 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c1e38837-2931-45b1-aa34-bdbf523d8a9d req-45cc51dd-8fdf-4d37-9426-a2d37c9961ef service nova] Creating event network-vif-deleted:34605239-0ea5-475e-ab13-8de03dc67563 for instance a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d on n-h1-826529-8 Aug 03 02:58:57.138928 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c1e38837-2931-45b1-aa34-bdbf523d8a9d req-45cc51dd-8fdf-4d37-9426-a2d37c9961ef service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044059 Aug 03 02:58:57.139969 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3550/6977] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:58:57.319097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f116d541-7cc3-4e84-8486-c8d30ba16858 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:57.319801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f116d541-7cc3-4e84-8486-c8d30ba16858 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:57.335421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f116d541-7cc3-4e84-8486-c8d30ba16858 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:57.335901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f116d541-7cc3-4e84-8486-c8d30ba16858 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:57.336727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f116d541-7cc3-4e84-8486-c8d30ba16858 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:57.337174 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f116d541-7cc3-4e84-8486-c8d30ba16858 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:57.373006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f116d541-7cc3-4e84-8486-c8d30ba16858 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:57.373467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f116d541-7cc3-4e84-8486-c8d30ba16858 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:57.373931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-f116d541-7cc3-4e84-8486-c8d30ba16858 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lazy-loading 'fault' on Instance uuid a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:58:57.418259 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f116d541-7cc3-4e84-8486-c8d30ba16858 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:57.427154 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f116d541-7cc3-4e84-8486-c8d30ba16858 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d" status: 200 len: 1351 microversion: 2.1 time: 0.112510 Aug 03 02:58:57.427741 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3428/6978] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:57 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:58:58.451960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03f96aef-7c6e-4f1e-86c6-68cdeacf1e56 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:58.452689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-03f96aef-7c6e-4f1e-86c6-68cdeacf1e56 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:58.460859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03f96aef-7c6e-4f1e-86c6-68cdeacf1e56 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:58.461331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03f96aef-7c6e-4f1e-86c6-68cdeacf1e56 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:58.462163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03f96aef-7c6e-4f1e-86c6-68cdeacf1e56 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:58.462617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03f96aef-7c6e-4f1e-86c6-68cdeacf1e56 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:58.476973 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-03f96aef-7c6e-4f1e-86c6-68cdeacf1e56 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] HTTP exception thrown: Instance a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d could not be found. Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03f96aef-7c6e-4f1e-86c6-68cdeacf1e56 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Request method failure captured: Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d HTTP/1.1 Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eQlSx5D6krwwWIeDaNyf1mWhdxp7PCg2lTlA2GwKjWs0riM-mAiEUgLTuuF-Fh1bh0_TThSrl4cZS1vfETSxgvkdVaYxcCYtzDE0CS-zE5X0g2WvMeg68wMGaSmT6ovRrTVpvvAho9YE4Nt6bTCpb99ShHCZuj6TPZ_KiS6_pQSb1E Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 8f1fb62430d043099d168aacb9ebc74d Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8f1fb62430d043099d168aacb9ebc74d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f1fb62430d043099d168aacb9ebc74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8f1fb62430d043099d168aacb9ebc74d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f1fb62430d043099d168aacb9ebc74d"}]}] Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 8f1fb62430d043099d168aacb9ebc74d Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestEncryptedCinderVolumes-687753862-project Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: c50294748a984535ba92bc66b6b7b4d6 Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestEncryptedCinderVolumes-687753862-project Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d could not be found. Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d'} Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d could not be found. Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d could not be found. Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:58:58.478795 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:58:58.482729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:58:58.482729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:58:58.482729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:58:58.482729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:58:58.482729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:58:58.482729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d could not be found. Aug 03 02:58:58.482729 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 02:58:58.482729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03f96aef-7c6e-4f1e-86c6-68cdeacf1e56 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Returning 404 to user: Instance a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:58:58.482729 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03f96aef-7c6e-4f1e-86c6-68cdeacf1e56 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d" status: 404 len: 111 microversion: 2.1 time: 0.032621 Aug 03 02:58:58.482729 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3551/6979] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:58 2022] GET /compute/v2.1/servers/a25b2ac3-cc46-4045-bfcb-b2c6e11f3f3d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:58:58.489636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e553aa2f-a173-40da-952d-220cb52fcf12 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '.version_select at 0x7f5b127c6ca0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:58.511939 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e553aa2f-a173-40da-952d-220cb52fcf12 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-310891611" status: 202 len: 0 microversion: 2.1 time: 0.025700 Aug 03 02:58:58.513388 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3429/6980] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 3 02:58:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-310891611 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:58:58.531385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1c2a21b6-79f2-4f7b-8833-76224aee51c4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Action: 'create', calling method: .version_select at 0x7f5b12363820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2118667416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOrBQQPbTrzYJtPU0E0VE7l6Y9ihVGzZ1MqASIBKWyuZnHDofX35RPNNWpkrAftmF2P36jGn/ME3TynUy143fk12quExfPwoRc7JYZpT48hHA7LzWTeh+Q+UD217UJtPw=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:58:58.547532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1c2a21b6-79f2-4f7b-8833-76224aee51c4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Getting quotas for project 8f1fb62430d043099d168aacb9ebc74d. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:58:58.553403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1c2a21b6-79f2-4f7b-8833-76224aee51c4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Getting quotas for user c50294748a984535ba92bc66b6b7b4d6 and project 8f1fb62430d043099d168aacb9ebc74d. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:58:58.578092 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1c2a21b6-79f2-4f7b-8833-76224aee51c4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050556 Aug 03 02:58:58.578697 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3552/6981] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:58:58 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:58:58.630377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1041128382", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2118667416", "networks": [{"uuid": "d6e98ba7-4cf1-4356-a183-8c7599d8c56c"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:58:58.685980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] validate_networks() for [('d6e98ba7-4cf1-4356-a183-8c7599d8c56c', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 02:58:59.070864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 02:58:59.071325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 02:58:59.071839 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 02:58:59.072227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 02:58:59.072640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 02:58:59.083092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:59.083546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:59.084355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:58:59.084814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:58:59.103368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Getting quotas for project 8f1fb62430d043099d168aacb9ebc74d. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:58:59.108679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Getting quotas for user c50294748a984535ba92bc66b6b7b4d6 and project 8f1fb62430d043099d168aacb9ebc74d. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:58:59.122112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 02:58:59.124555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 02:58:59.175423 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-43e6e9d8-3a1f-46f8-aabd-15a91da6dc16 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549445 Aug 03 02:58:59.176163 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3430/6982] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:58:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 02:58:59.191252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-98652a8f-24c9-4e3f-9027-f44b32c040de tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:58:59.192537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-98652a8f-24c9-4e3f-9027-f44b32c040de tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:58:59.270859 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-98652a8f-24c9-4e3f-9027-f44b32c040de tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:58:59.278041 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-98652a8f-24c9-4e3f-9027-f44b32c040de tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c" status: 200 len: 1263 microversion: 2.1 time: 0.094394 Aug 03 02:58:59.278626 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3553/6983] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:58:59 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c => generated 1263 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:59:00.300889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0775df0e-838b-4299-a673-15f7636d83c9 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:00.301997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0775df0e-838b-4299-a673-15f7636d83c9 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:00.309321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0775df0e-838b-4299-a673-15f7636d83c9 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:00.309771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0775df0e-838b-4299-a673-15f7636d83c9 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:00.311235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0775df0e-838b-4299-a673-15f7636d83c9 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:00.311677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0775df0e-838b-4299-a673-15f7636d83c9 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:00.383984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0775df0e-838b-4299-a673-15f7636d83c9 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:59:00.394777 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0775df0e-838b-4299-a673-15f7636d83c9 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c" status: 200 len: 1321 microversion: 2.1 time: 0.099093 Aug 03 02:59:00.395436 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3431/6984] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:59:00 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c => generated 1321 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:59:01.415925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3892be9a-b2e6-43fc-a357-0ba36d3bb247 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:01.416676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3892be9a-b2e6-43fc-a357-0ba36d3bb247 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:01.423764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3892be9a-b2e6-43fc-a357-0ba36d3bb247 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:01.424846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3892be9a-b2e6-43fc-a357-0ba36d3bb247 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:01.426398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3892be9a-b2e6-43fc-a357-0ba36d3bb247 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:01.427236 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3892be9a-b2e6-43fc-a357-0ba36d3bb247 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:01.459116 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d45fd54f-434f-4f44-a364-f20f8e3b587f req-fa2b93fc-a134-4091-b92e-71316415a6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "333678f4-5ef0-4020-b84c-d694bff4978c", "tag": "3367aaaa-a325-49df-94f9-09837ab6b981"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:59:01.477440 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d45fd54f-434f-4f44-a364-f20f8e3b587f req-fa2b93fc-a134-4091-b92e-71316415a6b0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:01.478073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d45fd54f-434f-4f44-a364-f20f8e3b587f req-fa2b93fc-a134-4091-b92e-71316415a6b0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:01.493454 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d45fd54f-434f-4f44-a364-f20f8e3b587f req-fa2b93fc-a134-4091-b92e-71316415a6b0 service nova] Creating event network-changed:3367aaaa-a325-49df-94f9-09837ab6b981 for instance 333678f4-5ef0-4020-b84c-d694bff4978c on n-h1-826529-8 Aug 03 02:59:01.498813 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d45fd54f-434f-4f44-a364-f20f8e3b587f req-fa2b93fc-a134-4091-b92e-71316415a6b0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043645 Aug 03 02:59:01.499548 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3432/6985] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:59:01.590234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3892be9a-b2e6-43fc-a357-0ba36d3bb247 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:59:01.598440 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3892be9a-b2e6-43fc-a357-0ba36d3bb247 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c" status: 200 len: 1363 microversion: 2.1 time: 0.186506 Aug 03 02:59:01.599379 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3554/6986] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:59:01 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:59:02.626452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c9b94bf3-6049-43b6-848a-a29254f0c6f4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:02.627809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c9b94bf3-6049-43b6-848a-a29254f0c6f4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:02.640335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9b94bf3-6049-43b6-848a-a29254f0c6f4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:02.641220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9b94bf3-6049-43b6-848a-a29254f0c6f4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:02.642718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9b94bf3-6049-43b6-848a-a29254f0c6f4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:02.643511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c9b94bf3-6049-43b6-848a-a29254f0c6f4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:02.834050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c9b94bf3-6049-43b6-848a-a29254f0c6f4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:59:02.843306 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c9b94bf3-6049-43b6-848a-a29254f0c6f4 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c" status: 200 len: 1363 microversion: 2.1 time: 0.226654 Aug 03 02:59:02.852019 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3433/6987] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:59:02 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:59:03.866335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5fd3b041-3129-443d-809a-a6c1be24c153 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:03.867000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5fd3b041-3129-443d-809a-a6c1be24c153 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:03.874138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fd3b041-3129-443d-809a-a6c1be24c153 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:03.874617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fd3b041-3129-443d-809a-a6c1be24c153 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:03.875452 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fd3b041-3129-443d-809a-a6c1be24c153 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:03.875916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5fd3b041-3129-443d-809a-a6c1be24c153 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:04.011866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5fd3b041-3129-443d-809a-a6c1be24c153 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:59:04.019589 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5fd3b041-3129-443d-809a-a6c1be24c153 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c" status: 200 len: 1363 microversion: 2.1 time: 0.157923 Aug 03 02:59:04.020181 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3555/6988] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:59:03 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:59:05.040667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3fe0eee1-91b2-4054-b43d-a96f5e507459 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:05.042317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3fe0eee1-91b2-4054-b43d-a96f5e507459 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:05.050002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3fe0eee1-91b2-4054-b43d-a96f5e507459 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:05.050709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3fe0eee1-91b2-4054-b43d-a96f5e507459 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:05.051696 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3fe0eee1-91b2-4054-b43d-a96f5e507459 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:05.052427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3fe0eee1-91b2-4054-b43d-a96f5e507459 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:05.122822 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-859855e4-fb70-42d5-bf5b-3225b33089b4 req-45a4bdfa-6ad9-4dc9-8b93-cd8041099fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333678f4-5ef0-4020-b84c-d694bff4978c", "name": "network-vif-plugged", "status": "completed", "tag": "3367aaaa-a325-49df-94f9-09837ab6b981"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:59:05.133840 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-859855e4-fb70-42d5-bf5b-3225b33089b4 req-45a4bdfa-6ad9-4dc9-8b93-cd8041099fc2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:05.134292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-859855e4-fb70-42d5-bf5b-3225b33089b4 req-45a4bdfa-6ad9-4dc9-8b93-cd8041099fc2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:05.146683 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-859855e4-fb70-42d5-bf5b-3225b33089b4 req-45a4bdfa-6ad9-4dc9-8b93-cd8041099fc2 service nova] Creating event network-vif-plugged:3367aaaa-a325-49df-94f9-09837ab6b981 for instance 333678f4-5ef0-4020-b84c-d694bff4978c on n-h1-826529-8 Aug 03 02:59:05.152339 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-859855e4-fb70-42d5-bf5b-3225b33089b4 req-45a4bdfa-6ad9-4dc9-8b93-cd8041099fc2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121945 Aug 03 02:59:05.153132 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3434/6989] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:59:05.207127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3fe0eee1-91b2-4054-b43d-a96f5e507459 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:59:05.215921 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3fe0eee1-91b2-4054-b43d-a96f5e507459 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c" status: 200 len: 1363 microversion: 2.1 time: 0.180531 Aug 03 02:59:05.216921 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3556/6990] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:59:05 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:59:06.239908 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ecbd5338-afbd-4bb7-b98e-1398eabc0569 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:06.240626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ecbd5338-afbd-4bb7-b98e-1398eabc0569 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:06.248924 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecbd5338-afbd-4bb7-b98e-1398eabc0569 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:06.249380 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecbd5338-afbd-4bb7-b98e-1398eabc0569 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:06.250168 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecbd5338-afbd-4bb7-b98e-1398eabc0569 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:06.250611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ecbd5338-afbd-4bb7-b98e-1398eabc0569 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:06.387231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ecbd5338-afbd-4bb7-b98e-1398eabc0569 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:59:06.395723 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ecbd5338-afbd-4bb7-b98e-1398eabc0569 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c" status: 200 len: 1556 microversion: 2.1 time: 0.161443 Aug 03 02:59:06.396310 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3435/6991] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:59:06 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:59:06.417028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8f3b6aff-a6e1-4560-afa9-16bdb796cf2d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:06.417659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8f3b6aff-a6e1-4560-afa9-16bdb796cf2d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:06.425799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f3b6aff-a6e1-4560-afa9-16bdb796cf2d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:06.426350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f3b6aff-a6e1-4560-afa9-16bdb796cf2d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:06.427273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f3b6aff-a6e1-4560-afa9-16bdb796cf2d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:06.427833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8f3b6aff-a6e1-4560-afa9-16bdb796cf2d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:06.568611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8f3b6aff-a6e1-4560-afa9-16bdb796cf2d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:59:06.576335 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8f3b6aff-a6e1-4560-afa9-16bdb796cf2d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c" status: 200 len: 1556 microversion: 2.1 time: 0.163188 Aug 03 02:59:06.576916 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3557/6992] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:59:06 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:59:08.089990 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0cb0f2c5-a840-4b54-a279-ee958acbe11c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5dd772f-985c-4f49-a97f-7600d1bf213f"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:59:08.092460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0cb0f2c5-a840-4b54-a279-ee958acbe11c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:08.099764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cb0f2c5-a840-4b54-a279-ee958acbe11c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:08.100223 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cb0f2c5-a840-4b54-a279-ee958acbe11c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:08.101003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cb0f2c5-a840-4b54-a279-ee958acbe11c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:08.101447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0cb0f2c5-a840-4b54-a279-ee958acbe11c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:08.346384 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0cb0f2c5-a840-4b54-a279-ee958acbe11c tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "POST /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260354 Aug 03 02:59:08.347325 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3436/6993] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 02:59:08 2022] POST /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:59:19.236626 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-84287bbe-f770-4990-b299-1753ca6ba94a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:19.237291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-84287bbe-f770-4990-b299-1753ca6ba94a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:19.240835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:59:19.241651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:59:19.242467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=58 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:59:19.249283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84287bbe-f770-4990-b299-1753ca6ba94a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:19.249749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84287bbe-f770-4990-b299-1753ca6ba94a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:19.250537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84287bbe-f770-4990-b299-1753ca6ba94a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:19.251057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-84287bbe-f770-4990-b299-1753ca6ba94a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:19.335520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-84287bbe-f770-4990-b299-1753ca6ba94a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lazy-loading 'services' on Instance uuid 333678f4-5ef0-4020-b84c-d694bff4978c {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 02:59:19.408600 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-84287bbe-f770-4990-b299-1753ca6ba94a tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "DELETE /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments/a5dd772f-985c-4f49-a97f-7600d1bf213f" status: 202 len: 0 microversion: 2.1 time: 0.175741 Aug 03 02:59:19.409214 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3558/6994] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:59:19 2022] DELETE /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments/a5dd772f-985c-4f49-a97f-7600d1bf213f => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:59:19.415448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:59:19.417087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:59:19.418533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:59:19.418826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:59:19.424321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5c9180fe-1e83-4911-a562-14d8cf69ad0e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:19.426861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5c9180fe-1e83-4911-a562-14d8cf69ad0e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:19.437733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c9180fe-1e83-4911-a562-14d8cf69ad0e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:19.438367 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c9180fe-1e83-4911-a562-14d8cf69ad0e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:19.439417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c9180fe-1e83-4911-a562-14d8cf69ad0e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:19.439746 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c9180fe-1e83-4911-a562-14d8cf69ad0e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:19.476137 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5c9180fe-1e83-4911-a562-14d8cf69ad0e tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062136 Aug 03 02:59:19.476721 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3437/6995] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:59:19 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:59:20.490446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bc9c823c-98b6-4965-b693-92a700a70eaa tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:20.492891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bc9c823c-98b6-4965-b693-92a700a70eaa tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:20.499373 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc9c823c-98b6-4965-b693-92a700a70eaa tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:20.499848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc9c823c-98b6-4965-b693-92a700a70eaa tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:20.500645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc9c823c-98b6-4965-b693-92a700a70eaa tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:20.501106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bc9c823c-98b6-4965-b693-92a700a70eaa tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:20.534287 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bc9c823c-98b6-4965-b693-92a700a70eaa tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048840 Aug 03 02:59:20.538788 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3559/6996] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:59:20 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:59:21.547196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-19dcc276-f085-4a33-9702-7e0ad1ba6b0d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:21.549459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-19dcc276-f085-4a33-9702-7e0ad1ba6b0d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:21.556700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19dcc276-f085-4a33-9702-7e0ad1ba6b0d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:21.557330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19dcc276-f085-4a33-9702-7e0ad1ba6b0d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:21.558134 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19dcc276-f085-4a33-9702-7e0ad1ba6b0d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:21.558581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-19dcc276-f085-4a33-9702-7e0ad1ba6b0d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:21.591418 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-19dcc276-f085-4a33-9702-7e0ad1ba6b0d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048414 Aug 03 02:59:21.591995 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3438/6997] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:59:21 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:59:22.603835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6f708cc5-7369-4f9b-aeed-f1efcf19ceba tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:22.606052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6f708cc5-7369-4f9b-aeed-f1efcf19ceba tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:22.613516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f708cc5-7369-4f9b-aeed-f1efcf19ceba tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:22.613989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f708cc5-7369-4f9b-aeed-f1efcf19ceba tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:22.614807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f708cc5-7369-4f9b-aeed-f1efcf19ceba tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:22.615320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6f708cc5-7369-4f9b-aeed-f1efcf19ceba tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:22.646779 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6f708cc5-7369-4f9b-aeed-f1efcf19ceba tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046898 Aug 03 02:59:22.647416 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3560/6998] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:59:22 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:59:23.659879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1920f4cc-b981-4822-8a1b-b80b059032c0 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:23.662084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1920f4cc-b981-4822-8a1b-b80b059032c0 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:23.669624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1920f4cc-b981-4822-8a1b-b80b059032c0 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:23.670091 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1920f4cc-b981-4822-8a1b-b80b059032c0 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:23.670883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1920f4cc-b981-4822-8a1b-b80b059032c0 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:23.671354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1920f4cc-b981-4822-8a1b-b80b059032c0 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:23.704856 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1920f4cc-b981-4822-8a1b-b80b059032c0 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049564 Aug 03 02:59:23.705761 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3439/6999] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:59:23 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:59:24.717521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0f5a5e7c-ac87-4378-b882-61f9efcc37e8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:24.719741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0f5a5e7c-ac87-4378-b882-61f9efcc37e8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:24.727722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0f5a5e7c-ac87-4378-b882-61f9efcc37e8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:24.728186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0f5a5e7c-ac87-4378-b882-61f9efcc37e8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:24.728980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0f5a5e7c-ac87-4378-b882-61f9efcc37e8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:24.729434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0f5a5e7c-ac87-4378-b882-61f9efcc37e8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:24.759297 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0f5a5e7c-ac87-4378-b882-61f9efcc37e8 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045734 Aug 03 02:59:24.759869 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3561/7000] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 02:59:24 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 02:59:24.771266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6d3d9905-b094-455e-85b6-dd0472acb7cf tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:24.771774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6d3d9905-b094-455e-85b6-dd0472acb7cf tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:24.778716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d3d9905-b094-455e-85b6-dd0472acb7cf tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:24.779215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d3d9905-b094-455e-85b6-dd0472acb7cf tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:24.779993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d3d9905-b094-455e-85b6-dd0472acb7cf tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:24.780441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6d3d9905-b094-455e-85b6-dd0472acb7cf tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:24.858990 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-6d3d9905-b094-455e-85b6-dd0472acb7cf tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] HTTP exception thrown: Instance 333678f4-5ef0-4020-b84c-d694bff4978c is not attached to volume a5dd772f-985c-4f49-a97f-7600d1bf213f Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6d3d9905-b094-455e-85b6-dd0472acb7cf tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Request method failure captured: Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments/a5dd772f-985c-4f49-a97f-7600d1bf213f HTTP/1.1 Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eQlSx5D6krwwWIeDaNyf1mWhdxp7PCg2lTlA2GwKjWs0riM-mAiEUgLTuuF-Fh1bh0_TThSrl4cZS1vfETSxgvkdVaYxcCYtzDE0CS-zE5X0g2WvMeg68wMGaSmT6ovRrTVpvvAho9YE4Nt6bTCpb99ShHCZuj6TPZ_KiS6_pQSb1E Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 8f1fb62430d043099d168aacb9ebc74d Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8f1fb62430d043099d168aacb9ebc74d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f1fb62430d043099d168aacb9ebc74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8f1fb62430d043099d168aacb9ebc74d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f1fb62430d043099d168aacb9ebc74d"}]}] Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 8f1fb62430d043099d168aacb9ebc74d Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestEncryptedCinderVolumes-687753862-project Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: c50294748a984535ba92bc66b6b7b4d6 Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestEncryptedCinderVolumes-687753862-project Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 333678f4-5ef0-4020-b84c-d694bff4978c is not attached to volume a5dd772f-985c-4f49-a97f-7600d1bf213f Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'server_id': '333678f4-5ef0-4020-b84c-d694bff4978c', 'id': 'a5dd772f-985c-4f49-a97f-7600d1bf213f'} Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a5dd772f-985c-4f49-a97f-7600d1bf213f. Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 333678f4-5ef0-4020-b84c-d694bff4978c is not attached to volume a5dd772f-985c-4f49-a97f-7600d1bf213f Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:59:24.860609 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:59:24.864521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:59:24.864521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:59:24.864521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 333678f4-5ef0-4020-b84c-d694bff4978c is not attached to volume a5dd772f-985c-4f49-a97f-7600d1bf213f Aug 03 02:59:24.864521 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:59:24.864521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6d3d9905-b094-455e-85b6-dd0472acb7cf tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Returning 404 to user: Instance 333678f4-5ef0-4020-b84c-d694bff4978c is not attached to volume a5dd772f-985c-4f49-a97f-7600d1bf213f {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:59:24.864521 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6d3d9905-b094-455e-85b6-dd0472acb7cf tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "DELETE /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments/a5dd772f-985c-4f49-a97f-7600d1bf213f" status: 404 len: 154 microversion: 2.1 time: 0.095668 Aug 03 02:59:24.864521 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3440/7001] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 02:59:24 2022] DELETE /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c/os-volume_attachments/a5dd772f-985c-4f49-a97f-7600d1bf213f => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:59:28.215825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-233400ce-7a3a-490a-a8c1-7fc6d304ff61 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:28.216358 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-233400ce-7a3a-490a-a8c1-7fc6d304ff61 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:28.223711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-233400ce-7a3a-490a-a8c1-7fc6d304ff61 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:28.224177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-233400ce-7a3a-490a-a8c1-7fc6d304ff61 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:28.224980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-233400ce-7a3a-490a-a8c1-7fc6d304ff61 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:28.225435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-233400ce-7a3a-490a-a8c1-7fc6d304ff61 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:28.257120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-233400ce-7a3a-490a-a8c1-7fc6d304ff61 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 02:59:28.344117 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-233400ce-7a3a-490a-a8c1-7fc6d304ff61 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "DELETE /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c" status: 204 len: 0 microversion: 2.1 time: 0.131909 Aug 03 02:59:28.344797 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3562/7002] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 02:59:28 2022] DELETE /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 02:59:28.354152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-411a0791-f734-41c0-b891-c9c0b7048b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:28.354920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-411a0791-f734-41c0-b891-c9c0b7048b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:28.362652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-411a0791-f734-41c0-b891-c9c0b7048b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:28.363162 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-411a0791-f734-41c0-b891-c9c0b7048b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:28.363946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-411a0791-f734-41c0-b891-c9c0b7048b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:28.364387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-411a0791-f734-41c0-b891-c9c0b7048b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:28.499619 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-411a0791-f734-41c0-b891-c9c0b7048b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:59:28.508114 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-411a0791-f734-41c0-b891-c9c0b7048b49 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c" status: 200 len: 1562 microversion: 2.1 time: 0.157897 Aug 03 02:59:28.508709 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3441/7003] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:59:28 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 02:59:29.530224 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-430e4157-ec8d-4ba1-8e65-0fc2fca159c2 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:29.530961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-430e4157-ec8d-4ba1-8e65-0fc2fca159c2 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:29.537967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-430e4157-ec8d-4ba1-8e65-0fc2fca159c2 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:29.538430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-430e4157-ec8d-4ba1-8e65-0fc2fca159c2 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:29.539245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-430e4157-ec8d-4ba1-8e65-0fc2fca159c2 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:29.539689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-430e4157-ec8d-4ba1-8e65-0fc2fca159c2 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:29.673063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-430e4157-ec8d-4ba1-8e65-0fc2fca159c2 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:59:29.680875 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-430e4157-ec8d-4ba1-8e65-0fc2fca159c2 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c" status: 200 len: 1562 microversion: 2.1 time: 0.154931 Aug 03 02:59:29.681444 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3563/7004] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:59:29 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:59:30.703568 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1b0e1bc8-79db-4385-a0e6-ee84e7df8c6d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:30.704121 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1b0e1bc8-79db-4385-a0e6-ee84e7df8c6d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:30.713617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b0e1bc8-79db-4385-a0e6-ee84e7df8c6d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:30.713617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b0e1bc8-79db-4385-a0e6-ee84e7df8c6d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:30.714834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b0e1bc8-79db-4385-a0e6-ee84e7df8c6d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:30.715971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b0e1bc8-79db-4385-a0e6-ee84e7df8c6d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:30.864882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1b0e1bc8-79db-4385-a0e6-ee84e7df8c6d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c50294748a984535ba92bc66b6b7b4d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1fb62430d043099d168aacb9ebc74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 02:59:30.872953 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1b0e1bc8-79db-4385-a0e6-ee84e7df8c6d tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c" status: 200 len: 1562 microversion: 2.1 time: 0.173474 Aug 03 02:59:30.873553 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3442/7005] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:59:30 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 02:59:31.001590 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-4de93c85-6167-4b59-a73f-aa4d7f4b8fda req-5123ca7d-b1ac-44e7-af4d-519aaff7364c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333678f4-5ef0-4020-b84c-d694bff4978c", "name": "network-vif-deleted", "tag": "3367aaaa-a325-49df-94f9-09837ab6b981"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:59:31.014706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4de93c85-6167-4b59-a73f-aa4d7f4b8fda req-5123ca7d-b1ac-44e7-af4d-519aaff7364c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:31.015217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4de93c85-6167-4b59-a73f-aa4d7f4b8fda req-5123ca7d-b1ac-44e7-af4d-519aaff7364c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:31.028938 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-4de93c85-6167-4b59-a73f-aa4d7f4b8fda req-5123ca7d-b1ac-44e7-af4d-519aaff7364c service nova] Creating event network-vif-deleted:3367aaaa-a325-49df-94f9-09837ab6b981 for instance 333678f4-5ef0-4020-b84c-d694bff4978c on n-h1-826529-8 Aug 03 02:59:31.035501 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-4de93c85-6167-4b59-a73f-aa4d7f4b8fda req-5123ca7d-b1ac-44e7-af4d-519aaff7364c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036659 Aug 03 02:59:31.036619 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3564/7006] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 02:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 02:59:31.897946 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8cc83437-0869-484b-9716-01da992d8e62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:31.898566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8cc83437-0869-484b-9716-01da992d8e62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] [instance: 333678f4-5ef0-4020-b84c-d694bff4978c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 02:59:31.905740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8cc83437-0869-484b-9716-01da992d8e62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:31.906197 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8cc83437-0869-484b-9716-01da992d8e62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:31.907016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8cc83437-0869-484b-9716-01da992d8e62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 02:59:31.907468 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8cc83437-0869-484b-9716-01da992d8e62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 02:59:31.922652 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-8cc83437-0869-484b-9716-01da992d8e62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] HTTP exception thrown: Instance 333678f4-5ef0-4020-b84c-d694bff4978c could not be found. Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8cc83437-0869-484b-9716-01da992d8e62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Request method failure captured: Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c HTTP/1.1 Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eQlSx5D6krwwWIeDaNyf1mWhdxp7PCg2lTlA2GwKjWs0riM-mAiEUgLTuuF-Fh1bh0_TThSrl4cZS1vfETSxgvkdVaYxcCYtzDE0CS-zE5X0g2WvMeg68wMGaSmT6ovRrTVpvvAho9YE4Nt6bTCpb99ShHCZuj6TPZ_KiS6_pQSb1E Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: 8f1fb62430d043099d168aacb9ebc74d Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_8f1fb62430d043099d168aacb9ebc74d", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f1fb62430d043099d168aacb9ebc74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/8f1fb62430d043099d168aacb9ebc74d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/8f1fb62430d043099d168aacb9ebc74d"}]}] Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: 8f1fb62430d043099d168aacb9ebc74d Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-687753862 Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestEncryptedCinderVolumes-687753862-project Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: c50294748a984535ba92bc66b6b7b4d6 Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestEncryptedCinderVolumes-687753862-project Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 333678f4-5ef0-4020-b84c-d694bff4978c could not be found. Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '333678f4-5ef0-4020-b84c-d694bff4978c'} Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 333678f4-5ef0-4020-b84c-d694bff4978c could not be found. Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 333678f4-5ef0-4020-b84c-d694bff4978c could not be found. Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 02:59:31.924254 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:59:31.929056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 02:59:31.929056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 02:59:31.929056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 02:59:31.929056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 02:59:31.929056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 02:59:31.929056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 333678f4-5ef0-4020-b84c-d694bff4978c could not be found. Aug 03 02:59:31.929056 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 02:59:31.929056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8cc83437-0869-484b-9716-01da992d8e62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Returning 404 to user: Instance 333678f4-5ef0-4020-b84c-d694bff4978c could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 02:59:31.929056 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8cc83437-0869-484b-9716-01da992d8e62 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c" status: 404 len: 111 microversion: 2.1 time: 0.033189 Aug 03 02:59:31.929056 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3443/7007] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 02:59:31 2022] GET /compute/v2.1/servers/333678f4-5ef0-4020-b84c-d694bff4978c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 02:59:31.936376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-511180ff-f339-4fe7-9693-18ed09f1c578 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] Calling method '.version_select at 0x7f5b124809d0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 02:59:31.960146 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-511180ff-f339-4fe7-9693-18ed09f1c578 tempest-TestEncryptedCinderVolumes-687753862 tempest-TestEncryptedCinderVolumes-687753862-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2118667416" status: 202 len: 0 microversion: 2.1 time: 0.027941 Aug 03 02:59:31.960748 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3565/7008] 10.222.0.67 () {58 vars in 1278 bytes} [Wed Aug 3 02:59:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2118667416 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 02:59:59.348282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7aaef272-6325-4818-8db3-70229fbab573 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Action: 'create', calling method: .version_select at 0x7f5b133ad8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1905443520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMQQaiWD+BSEsbgkXKxK1FrRUG2AXXEYybjHvByvGEEj1ql3rDS6G2b8ei3ioPxoh2pop8upufgl6EHdT2QNsbZoG7pNqr1UD45CGCamwL7ngKeE0XQ37GZWhXcpp44EQ=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:59:59.354395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=14 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:59:59.355098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=38 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:59:59.368077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-7aaef272-6325-4818-8db3-70229fbab573 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Getting quotas for project c56b09fee41d40f085aed568f06d0ff7. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 02:59:59.373183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-7aaef272-6325-4818-8db3-70229fbab573 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Getting quotas for user 10f727693d764715ad413026021a1a8b and project c56b09fee41d40f085aed568f06d0ff7. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 02:59:59.399558 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7aaef272-6325-4818-8db3-70229fbab573 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056201 Aug 03 02:59:59.400171 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3444/7009] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 02:59:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 02:59:59.451035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:59:59.451805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 02:59:59.457178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1233070722", "imageRef": "cd21c1b0-0b84-4380-9078-9ee5ef65d033", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1905443520", "networks": [{"uuid": "4277f317-103b-44c3-be23-8b0456de237b"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 02:59:59.513649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] validate_networks() for [('4277f317-103b-44c3-be23-8b0456de237b', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 03:00:00.014764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 03:00:00.015239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 03:00:00.015768 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 03:00:00.016201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 03:00:00.016633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 03:00:00.026374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:00.026834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:00.027697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:00.028147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:00.045028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Getting quotas for project c56b09fee41d40f085aed568f06d0ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:00:00.050938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Getting quotas for user 10f727693d764715ad413026021a1a8b and project c56b09fee41d40f085aed568f06d0ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:00:00.065042 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 03:00:00.067427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd21c1b0-0b84-4380-9078-9ee5ef65d033',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 03:00:00.112614 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-cd160658-455f-4209-9778-d98bc77c1a44 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663588 Aug 03 03:00:00.113263 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3566/7010] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 02:59:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 03:00:00.124245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fbe798cd-b053-4ed0-bff9-00023d5b34cc tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:00.125303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fbe798cd-b053-4ed0-bff9-00023d5b34cc tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:00.182176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fbe798cd-b053-4ed0-bff9-00023d5b34cc tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:00.190717 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fbe798cd-b053-4ed0-bff9-00023d5b34cc tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1259 microversion: 2.1 time: 0.070620 Aug 03 03:00:00.191416 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3445/7011] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:00 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:01.214204 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a6c088a3-9b96-45fa-95f6-02b273e1c8d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:01.215276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a6c088a3-9b96-45fa-95f6-02b273e1c8d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:01.223997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6c088a3-9b96-45fa-95f6-02b273e1c8d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:01.224537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6c088a3-9b96-45fa-95f6-02b273e1c8d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:01.225439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6c088a3-9b96-45fa-95f6-02b273e1c8d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:01.225976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6c088a3-9b96-45fa-95f6-02b273e1c8d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:01.300852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a6c088a3-9b96-45fa-95f6-02b273e1c8d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:01.309793 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a6c088a3-9b96-45fa-95f6-02b273e1c8d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1319 microversion: 2.1 time: 0.101642 Aug 03 03:00:01.315265 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3567/7012] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:01 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1319 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:02.332898 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9954f095-8122-4a02-87c9-e092824fc5ba tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:02.334304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9954f095-8122-4a02-87c9-e092824fc5ba tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:02.348780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9954f095-8122-4a02-87c9-e092824fc5ba tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:02.352726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9954f095-8122-4a02-87c9-e092824fc5ba tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:02.353776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9954f095-8122-4a02-87c9-e092824fc5ba tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:02.356614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9954f095-8122-4a02-87c9-e092824fc5ba tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:02.536768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9954f095-8122-4a02-87c9-e092824fc5ba tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:02.550597 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9954f095-8122-4a02-87c9-e092824fc5ba tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1359 microversion: 2.1 time: 0.221884 Aug 03 03:00:02.552396 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3446/7013] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:02 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:03.586201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-91cc4c95-5b25-4a82-a8f8-52406da6633d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:03.587240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-91cc4c95-5b25-4a82-a8f8-52406da6633d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:03.594819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91cc4c95-5b25-4a82-a8f8-52406da6633d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:03.596040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91cc4c95-5b25-4a82-a8f8-52406da6633d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:03.596922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91cc4c95-5b25-4a82-a8f8-52406da6633d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:03.597371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-91cc4c95-5b25-4a82-a8f8-52406da6633d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:03.756072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-91cc4c95-5b25-4a82-a8f8-52406da6633d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:03.765466 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-91cc4c95-5b25-4a82-a8f8-52406da6633d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1359 microversion: 2.1 time: 0.183542 Aug 03 03:00:03.768754 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3568/7014] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:03 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:00:04.792029 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7ef41a09-4140-4d44-8ac7-5986093c07be tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:04.792930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7ef41a09-4140-4d44-8ac7-5986093c07be tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:04.800024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ef41a09-4140-4d44-8ac7-5986093c07be tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:04.800479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ef41a09-4140-4d44-8ac7-5986093c07be tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:04.801258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ef41a09-4140-4d44-8ac7-5986093c07be tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:04.801704 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ef41a09-4140-4d44-8ac7-5986093c07be tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:04.953935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7ef41a09-4140-4d44-8ac7-5986093c07be tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:04.961797 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7ef41a09-4140-4d44-8ac7-5986093c07be tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1359 microversion: 2.1 time: 0.178763 Aug 03 03:00:04.962356 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3447/7015] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:04 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:05.983550 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c1d3fdc3-a154-4dbd-b83d-d5a9546f3a84 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:05.984180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c1d3fdc3-a154-4dbd-b83d-d5a9546f3a84 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:05.991764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d3fdc3-a154-4dbd-b83d-d5a9546f3a84 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:05.992229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d3fdc3-a154-4dbd-b83d-d5a9546f3a84 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:05.993017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d3fdc3-a154-4dbd-b83d-d5a9546f3a84 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:05.993468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1d3fdc3-a154-4dbd-b83d-d5a9546f3a84 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:06.155031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c1d3fdc3-a154-4dbd-b83d-d5a9546f3a84 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:06.164856 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c1d3fdc3-a154-4dbd-b83d-d5a9546f3a84 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1359 microversion: 2.1 time: 0.185079 Aug 03 03:00:06.165465 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3569/7016] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:05 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:07.187729 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-275753f8-6c71-4c4d-afc0-2143c2aae74e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:07.188571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-275753f8-6c71-4c4d-afc0-2143c2aae74e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:07.196818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-275753f8-6c71-4c4d-afc0-2143c2aae74e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:07.197359 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-275753f8-6c71-4c4d-afc0-2143c2aae74e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:07.198229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-275753f8-6c71-4c4d-afc0-2143c2aae74e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:07.198749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-275753f8-6c71-4c4d-afc0-2143c2aae74e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:07.387100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-275753f8-6c71-4c4d-afc0-2143c2aae74e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:07.396306 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-275753f8-6c71-4c4d-afc0-2143c2aae74e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1359 microversion: 2.1 time: 0.212591 Aug 03 03:00:07.397085 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3448/7017] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:07 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:08.418232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ebace069-eab5-42fa-bd96-0b68c3560d9f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:08.420243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ebace069-eab5-42fa-bd96-0b68c3560d9f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:08.429124 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebace069-eab5-42fa-bd96-0b68c3560d9f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:08.430096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebace069-eab5-42fa-bd96-0b68c3560d9f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:08.431848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebace069-eab5-42fa-bd96-0b68c3560d9f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:08.432383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebace069-eab5-42fa-bd96-0b68c3560d9f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:08.598477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ebace069-eab5-42fa-bd96-0b68c3560d9f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:08.607670 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ebace069-eab5-42fa-bd96-0b68c3560d9f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1359 microversion: 2.1 time: 0.193335 Aug 03 03:00:08.615142 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3570/7018] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:08 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:00:09.630252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1f98ba0a-bfeb-4bc8-9b6c-107b4c065bbc tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:09.630802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1f98ba0a-bfeb-4bc8-9b6c-107b4c065bbc tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:09.639100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f98ba0a-bfeb-4bc8-9b6c-107b4c065bbc tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:09.639564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f98ba0a-bfeb-4bc8-9b6c-107b4c065bbc tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:09.640372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f98ba0a-bfeb-4bc8-9b6c-107b4c065bbc tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:09.640826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f98ba0a-bfeb-4bc8-9b6c-107b4c065bbc tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:09.788290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1f98ba0a-bfeb-4bc8-9b6c-107b4c065bbc tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:09.797862 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1f98ba0a-bfeb-4bc8-9b6c-107b4c065bbc tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1359 microversion: 2.1 time: 0.172584 Aug 03 03:00:09.810930 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3449/7019] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:09 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:09.927742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-66c9182b-6b61-4056-a723-98db02163481 req-b1e12b9e-854b-4193-a539-b7ba60ab56e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4cae21c-a710-4541-b934-7d6a824f11bc", "tag": "5da8ffb5-257f-4916-a77e-8d5857a88eb9"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:00:09.945838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-66c9182b-6b61-4056-a723-98db02163481 req-b1e12b9e-854b-4193-a539-b7ba60ab56e7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:09.946302 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-66c9182b-6b61-4056-a723-98db02163481 req-b1e12b9e-854b-4193-a539-b7ba60ab56e7 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:09.959588 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-66c9182b-6b61-4056-a723-98db02163481 req-b1e12b9e-854b-4193-a539-b7ba60ab56e7 service nova] Creating event network-changed:5da8ffb5-257f-4916-a77e-8d5857a88eb9 for instance d4cae21c-a710-4541-b934-7d6a824f11bc on n-h1-826529-8 Aug 03 03:00:09.964818 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-66c9182b-6b61-4056-a723-98db02163481 req-b1e12b9e-854b-4193-a539-b7ba60ab56e7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041610 Aug 03 03:00:09.965449 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3571/7020] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:00:10.820930 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0a496ba2-695d-4c9a-9a74-c5b7e2da4656 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:10.821675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0a496ba2-695d-4c9a-9a74-c5b7e2da4656 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:10.823476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:00:10.830313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a496ba2-695d-4c9a-9a74-c5b7e2da4656 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:10.830768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a496ba2-695d-4c9a-9a74-c5b7e2da4656 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:10.832088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a496ba2-695d-4c9a-9a74-c5b7e2da4656 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:10.832088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0a496ba2-695d-4c9a-9a74-c5b7e2da4656 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:10.973488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0a496ba2-695d-4c9a-9a74-c5b7e2da4656 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:10.981481 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0a496ba2-695d-4c9a-9a74-c5b7e2da4656 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1359 microversion: 2.1 time: 0.164426 Aug 03 03:00:10.982077 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3450/7021] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:10 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:12.000317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:00:12.001643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:00:12.006664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3fcb4dfd-2d98-4aa4-8a91-962c5985df34 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:12.007401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3fcb4dfd-2d98-4aa4-8a91-962c5985df34 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:12.015491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3fcb4dfd-2d98-4aa4-8a91-962c5985df34 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:12.015950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3fcb4dfd-2d98-4aa4-8a91-962c5985df34 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:12.016765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3fcb4dfd-2d98-4aa4-8a91-962c5985df34 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:12.017215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3fcb4dfd-2d98-4aa4-8a91-962c5985df34 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:12.151471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3fcb4dfd-2d98-4aa4-8a91-962c5985df34 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:12.159920 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3fcb4dfd-2d98-4aa4-8a91-962c5985df34 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1359 microversion: 2.1 time: 0.160693 Aug 03 03:00:12.160500 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3572/7022] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:11 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:13.181832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e750f8b5-1e0c-4687-b43f-056145013d99 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:13.182442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e750f8b5-1e0c-4687-b43f-056145013d99 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:13.189752 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e750f8b5-1e0c-4687-b43f-056145013d99 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:13.190492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e750f8b5-1e0c-4687-b43f-056145013d99 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:13.191336 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e750f8b5-1e0c-4687-b43f-056145013d99 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:13.191790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e750f8b5-1e0c-4687-b43f-056145013d99 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:13.341656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e750f8b5-1e0c-4687-b43f-056145013d99 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:13.350417 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e750f8b5-1e0c-4687-b43f-056145013d99 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1359 microversion: 2.1 time: 0.172423 Aug 03 03:00:13.363070 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3451/7023] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:13 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:13.379868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-aadc80fe-5f41-4f26-b95e-68c49cf30c6b req-fa7f0b6b-14f0-414d-85fb-40e27c301479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4cae21c-a710-4541-b934-7d6a824f11bc", "name": "network-vif-plugged", "status": "completed", "tag": "5da8ffb5-257f-4916-a77e-8d5857a88eb9"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:00:13.391724 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-aadc80fe-5f41-4f26-b95e-68c49cf30c6b req-fa7f0b6b-14f0-414d-85fb-40e27c301479 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:13.392198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-aadc80fe-5f41-4f26-b95e-68c49cf30c6b req-fa7f0b6b-14f0-414d-85fb-40e27c301479 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:13.404670 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-aadc80fe-5f41-4f26-b95e-68c49cf30c6b req-fa7f0b6b-14f0-414d-85fb-40e27c301479 service nova] Creating event network-vif-plugged:5da8ffb5-257f-4916-a77e-8d5857a88eb9 for instance d4cae21c-a710-4541-b934-7d6a824f11bc on n-h1-826529-8 Aug 03 03:00:13.410066 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-aadc80fe-5f41-4f26-b95e-68c49cf30c6b req-fa7f0b6b-14f0-414d-85fb-40e27c301479 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034122 Aug 03 03:00:13.410687 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3573/7024] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:00:14.372513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-66198318-6079-4323-b4b1-12f9c79747e0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:14.373233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-66198318-6079-4323-b4b1-12f9c79747e0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:14.381695 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66198318-6079-4323-b4b1-12f9c79747e0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:14.382145 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66198318-6079-4323-b4b1-12f9c79747e0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:14.382954 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66198318-6079-4323-b4b1-12f9c79747e0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:14.383450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-66198318-6079-4323-b4b1-12f9c79747e0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:14.526775 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-66198318-6079-4323-b4b1-12f9c79747e0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:14.534604 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-66198318-6079-4323-b4b1-12f9c79747e0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1359 microversion: 2.1 time: 0.166452 Aug 03 03:00:14.535221 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3452/7025] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:14 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:15.557574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0c022bc5-67ea-4bc5-a8b5-a7b127d2af35 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:15.558329 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0c022bc5-67ea-4bc5-a8b5-a7b127d2af35 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:15.565454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c022bc5-67ea-4bc5-a8b5-a7b127d2af35 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:15.565922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c022bc5-67ea-4bc5-a8b5-a7b127d2af35 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:15.566702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c022bc5-67ea-4bc5-a8b5-a7b127d2af35 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:15.567205 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0c022bc5-67ea-4bc5-a8b5-a7b127d2af35 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:15.700772 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0c022bc5-67ea-4bc5-a8b5-a7b127d2af35 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:15.709005 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0c022bc5-67ea-4bc5-a8b5-a7b127d2af35 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1549 microversion: 2.1 time: 0.156532 Aug 03 03:00:15.709694 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3574/7026] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:15 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:15.729191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fd80315d-9b6e-42da-837b-0a0d8ddb311d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:15.729814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fd80315d-9b6e-42da-837b-0a0d8ddb311d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:15.737511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd80315d-9b6e-42da-837b-0a0d8ddb311d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:15.737971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd80315d-9b6e-42da-837b-0a0d8ddb311d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:15.738763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd80315d-9b6e-42da-837b-0a0d8ddb311d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:15.739240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fd80315d-9b6e-42da-837b-0a0d8ddb311d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:15.883857 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fd80315d-9b6e-42da-837b-0a0d8ddb311d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:15.891738 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fd80315d-9b6e-42da-837b-0a0d8ddb311d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1549 microversion: 2.1 time: 0.166473 Aug 03 03:00:15.892313 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3453/7027] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:15 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:15.912016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e3fdcfff-7cd7-4b14-b1c0-c89d4ee26353 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:15.916643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e3fdcfff-7cd7-4b14-b1c0-c89d4ee26353 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:15.917415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e3fdcfff-7cd7-4b14-b1c0-c89d4ee26353 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Searching by: {'deleted': False, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 03:00:15.922857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3fdcfff-7cd7-4b14-b1c0-c89d4ee26353 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:15.923451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3fdcfff-7cd7-4b14-b1c0-c89d4ee26353 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:15.924949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3fdcfff-7cd7-4b14-b1c0-c89d4ee26353 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:15.925398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e3fdcfff-7cd7-4b14-b1c0-c89d4ee26353 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:15.951157 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-e3fdcfff-7cd7-4b14-b1c0-c89d4ee26353 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 03:00:15.979191 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e3fdcfff-7cd7-4b14-b1c0-c89d4ee26353 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.071541 Aug 03 03:00:15.979787 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3575/7028] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 3 03:00:15 2022] GET /compute/v2.1/servers => generated 343 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:00:15.992176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-88807f33-25aa-4357-a60f-5c86cbc31077 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:15.992795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-88807f33-25aa-4357-a60f-5c86cbc31077 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:15.999059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88807f33-25aa-4357-a60f-5c86cbc31077 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:15.999517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88807f33-25aa-4357-a60f-5c86cbc31077 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:16.000292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88807f33-25aa-4357-a60f-5c86cbc31077 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:16.000734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-88807f33-25aa-4357-a60f-5c86cbc31077 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:16.134590 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-88807f33-25aa-4357-a60f-5c86cbc31077 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:16.142566 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-88807f33-25aa-4357-a60f-5c86cbc31077 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1549 microversion: 2.1 time: 0.154336 Aug 03 03:00:16.143315 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3454/7029] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:15 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:17.742400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ebfb5f96-854b-4e0e-96e6-b1d14d4dac4b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31857574-7b5a-452d-a7f9-0cf62f7cb4c6"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:00:17.744898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ebfb5f96-854b-4e0e-96e6-b1d14d4dac4b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:17.752017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebfb5f96-854b-4e0e-96e6-b1d14d4dac4b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:17.752482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebfb5f96-854b-4e0e-96e6-b1d14d4dac4b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:17.753273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebfb5f96-854b-4e0e-96e6-b1d14d4dac4b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:17.753726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebfb5f96-854b-4e0e-96e6-b1d14d4dac4b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:18.014629 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ebfb5f96-854b-4e0e-96e6-b1d14d4dac4b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "POST /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276053 Aug 03 03:00:18.015764 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3576/7030] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 03:00:17 2022] POST /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:00:31.121635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2a1a435b-eee9-4eea-a531-88408cae9f1c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:31.122269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2a1a435b-eee9-4eea-a531-88408cae9f1c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:31.124589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:00:31.125263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=54 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:00:31.131727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a1a435b-eee9-4eea-a531-88408cae9f1c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:31.132285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a1a435b-eee9-4eea-a531-88408cae9f1c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:31.133088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a1a435b-eee9-4eea-a531-88408cae9f1c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:31.133541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2a1a435b-eee9-4eea-a531-88408cae9f1c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:31.271282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2a1a435b-eee9-4eea-a531-88408cae9f1c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:31.279436 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2a1a435b-eee9-4eea-a531-88408cae9f1c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1595 microversion: 2.1 time: 0.161837 Aug 03 03:00:31.280025 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3455/7031] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:31 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1595 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:33.309385 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:00:33.310250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:00:33.311055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:00:33.466849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-a9193fa8-5f51-4480-b00e-aaf5cc0fd0c7 req-439d75bf-e4f1-4a19-984d-64e4f962e97f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4cae21c-a710-4541-b934-7d6a824f11bc", "tag": "5da8ffb5-257f-4916-a77e-8d5857a88eb9"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:00:33.488973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a9193fa8-5f51-4480-b00e-aaf5cc0fd0c7 req-439d75bf-e4f1-4a19-984d-64e4f962e97f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:33.489370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-a9193fa8-5f51-4480-b00e-aaf5cc0fd0c7 req-439d75bf-e4f1-4a19-984d-64e4f962e97f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:33.503280 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-a9193fa8-5f51-4480-b00e-aaf5cc0fd0c7 req-439d75bf-e4f1-4a19-984d-64e4f962e97f service nova] Creating event network-changed:5da8ffb5-257f-4916-a77e-8d5857a88eb9 for instance d4cae21c-a710-4541-b934-7d6a824f11bc on n-h1-826529-8 Aug 03 03:00:33.509148 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-a9193fa8-5f51-4480-b00e-aaf5cc0fd0c7 req-439d75bf-e4f1-4a19-984d-64e4f962e97f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201882 Aug 03 03:00:33.509806 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3577/7032] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:00:34.428049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-69b89d27-adcb-41d9-8dae-506a35f2d4a7 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1438352309"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:00:34.429238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-69b89d27-adcb-41d9-8dae-506a35f2d4a7 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:34.436735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69b89d27-adcb-41d9-8dae-506a35f2d4a7 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:34.437204 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69b89d27-adcb-41d9-8dae-506a35f2d4a7 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:34.438165 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69b89d27-adcb-41d9-8dae-506a35f2d4a7 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:34.440170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-69b89d27-adcb-41d9-8dae-506a35f2d4a7 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:34.589692 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.network.security_group_api [None req-69b89d27-adcb-41d9-8dae-506a35f2d4a7 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Adding security group be7e3868-ab38-446f-8bf5-a2c3e6140acf to port 5da8ffb5-257f-4916-a77e-8d5857a88eb9 Aug 03 03:00:34.930784 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-69b89d27-adcb-41d9-8dae-506a35f2d4a7 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "POST /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/action" status: 202 len: 0 microversion: 2.1 time: 0.507939 Aug 03 03:00:34.931439 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3456/7033] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:00:34 2022] POST /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:00:34.941425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ec22e6a8-7ba0-46be-b2ae-10ceac444cb2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:00:34.942233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ec22e6a8-7ba0-46be-b2ae-10ceac444cb2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:00:34.948896 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec22e6a8-7ba0-46be-b2ae-10ceac444cb2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:34.949376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec22e6a8-7ba0-46be-b2ae-10ceac444cb2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:34.950161 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec22e6a8-7ba0-46be-b2ae-10ceac444cb2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:34.950783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec22e6a8-7ba0-46be-b2ae-10ceac444cb2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:35.137184 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ec22e6a8-7ba0-46be-b2ae-10ceac444cb2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:00:35.146350 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ec22e6a8-7ba0-46be-b2ae-10ceac444cb2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1761 microversion: 2.1 time: 0.210074 Aug 03 03:00:35.147190 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3578/7034] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:00:34 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1761 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:00:35.528080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-42ebb230-d410-4af2-af22-1be6cd605da0 req-d1f0e412-be58-4887-a19c-23888b196865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4cae21c-a710-4541-b934-7d6a824f11bc", "tag": "5da8ffb5-257f-4916-a77e-8d5857a88eb9"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:00:35.537932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-42ebb230-d410-4af2-af22-1be6cd605da0 req-d1f0e412-be58-4887-a19c-23888b196865 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:00:35.538391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-42ebb230-d410-4af2-af22-1be6cd605da0 req-d1f0e412-be58-4887-a19c-23888b196865 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:00:35.550327 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-42ebb230-d410-4af2-af22-1be6cd605da0 req-d1f0e412-be58-4887-a19c-23888b196865 service nova] Creating event network-changed:5da8ffb5-257f-4916-a77e-8d5857a88eb9 for instance d4cae21c-a710-4541-b934-7d6a824f11bc on n-h1-826529-8 Aug 03 03:00:35.555684 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-42ebb230-d410-4af2-af22-1be6cd605da0 req-d1f0e412-be58-4887-a19c-23888b196865 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032223 Aug 03 03:00:35.556548 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3457/7035] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:02:13.194176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:02:13.194966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:02:13.199943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-227a9c20-ddcc-44f1-ac61-5eb02b4abf89 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:02:13.202326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-227a9c20-ddcc-44f1-ac61-5eb02b4abf89 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:02:13.210592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-227a9c20-ddcc-44f1-ac61-5eb02b4abf89 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:02:13.211097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-227a9c20-ddcc-44f1-ac61-5eb02b4abf89 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:02:13.211887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-227a9c20-ddcc-44f1-ac61-5eb02b4abf89 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:02:13.212341 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-227a9c20-ddcc-44f1-ac61-5eb02b4abf89 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:02:13.290527 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-227a9c20-ddcc-44f1-ac61-5eb02b4abf89 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "POST /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/action" status: 202 len: 0 microversion: 2.1 time: 0.097994 Aug 03 03:02:13.291631 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3579/7036] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:02:13 2022] POST /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:02:13.301585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:02:13.302348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=12 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:02:13.308081 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-be164906-3669-4ced-9d07-d4ac879d64c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:02:13.308988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-be164906-3669-4ced-9d07-d4ac879d64c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:02:13.319789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be164906-3669-4ced-9d07-d4ac879d64c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:02:13.320253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be164906-3669-4ced-9d07-d4ac879d64c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:02:13.321065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be164906-3669-4ced-9d07-d4ac879d64c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:02:13.321517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be164906-3669-4ced-9d07-d4ac879d64c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:02:13.480019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-be164906-3669-4ced-9d07-d4ac879d64c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:02:13.488920 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-be164906-3669-4ced-9d07-d4ac879d64c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1763 microversion: 2.1 time: 0.191874 Aug 03 03:02:13.489560 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3458/7037] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:02:13 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1763 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:02:14.510318 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e99d1db8-eaa7-4dfd-8ab4-9450771df8d6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:02:14.511328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e99d1db8-eaa7-4dfd-8ab4-9450771df8d6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:02:14.519097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e99d1db8-eaa7-4dfd-8ab4-9450771df8d6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:02:14.519573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e99d1db8-eaa7-4dfd-8ab4-9450771df8d6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:02:14.520374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e99d1db8-eaa7-4dfd-8ab4-9450771df8d6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:02:14.520833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e99d1db8-eaa7-4dfd-8ab4-9450771df8d6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:02:14.668762 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e99d1db8-eaa7-4dfd-8ab4-9450771df8d6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:02:14.677689 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e99d1db8-eaa7-4dfd-8ab4-9450771df8d6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1761 microversion: 2.1 time: 0.171717 Aug 03 03:02:14.678260 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3580/7038] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:02:14 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1761 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:02:39.643696 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:02:39.644517 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 03:02:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:02:39.705791 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:02:39.705969 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 03:02:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:02:39.761599 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:02:39.762064 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 03:02:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:03:28.674097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:03:28.674865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:03:28.678879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2ab2c95a-e021-4855-ba46-49fd40ede4f3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1438352309"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:03:28.679450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2ab2c95a-e021-4855-ba46-49fd40ede4f3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:28.686662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ab2c95a-e021-4855-ba46-49fd40ede4f3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:28.687154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ab2c95a-e021-4855-ba46-49fd40ede4f3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:28.687953 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ab2c95a-e021-4855-ba46-49fd40ede4f3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:28.688400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2ab2c95a-e021-4855-ba46-49fd40ede4f3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:28.877467 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.network.security_group_api [None req-2ab2c95a-e021-4855-ba46-49fd40ede4f3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Removing security group be7e3868-ab38-446f-8bf5-a2c3e6140acf from port 5da8ffb5-257f-4916-a77e-8d5857a88eb9 Aug 03 03:03:29.193605 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2ab2c95a-e021-4855-ba46-49fd40ede4f3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "POST /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/action" status: 202 len: 0 microversion: 2.1 time: 0.520918 Aug 03 03:03:29.221405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-be33f453-8784-4d54-a9fb-cbb48776f183 req-2ece96ad-387d-4f72-9eee-3a022e4bfa15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4cae21c-a710-4541-b934-7d6a824f11bc", "tag": "5da8ffb5-257f-4916-a77e-8d5857a88eb9"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:03:29.222644 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3459/7039] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:03:28 2022] POST /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:03:29.246149 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:03:29.247499 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:03:29.271107 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-be33f453-8784-4d54-a9fb-cbb48776f183 req-2ece96ad-387d-4f72-9eee-3a022e4bfa15 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:29.272529 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-be33f453-8784-4d54-a9fb-cbb48776f183 req-2ece96ad-387d-4f72-9eee-3a022e4bfa15 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:29.291177 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-be33f453-8784-4d54-a9fb-cbb48776f183 req-2ece96ad-387d-4f72-9eee-3a022e4bfa15 service nova] Creating event network-changed:5da8ffb5-257f-4916-a77e-8d5857a88eb9 for instance d4cae21c-a710-4541-b934-7d6a824f11bc on n-h1-826529-8 Aug 03 03:03:29.299229 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-be33f453-8784-4d54-a9fb-cbb48776f183 req-2ece96ad-387d-4f72-9eee-3a022e4bfa15 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096603 Aug 03 03:03:29.299917 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3581/7040] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:03:30.542868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f00c10e6-d6f9-4000-8f48-60390eafb936 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:30.543709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f00c10e6-d6f9-4000-8f48-60390eafb936 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:30.549894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f00c10e6-d6f9-4000-8f48-60390eafb936 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:30.550362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f00c10e6-d6f9-4000-8f48-60390eafb936 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:30.551186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f00c10e6-d6f9-4000-8f48-60390eafb936 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:30.551638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f00c10e6-d6f9-4000-8f48-60390eafb936 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:30.644183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-f00c10e6-d6f9-4000-8f48-60390eafb936 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lazy-loading 'services' on Instance uuid d4cae21c-a710-4541-b934-7d6a824f11bc {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 03:03:30.723243 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f00c10e6-d6f9-4000-8f48-60390eafb936 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments/31857574-7b5a-452d-a7f9-0cf62f7cb4c6" status: 202 len: 0 microversion: 2.1 time: 0.185605 Aug 03 03:03:30.727917 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3460/7041] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 03:03:30 2022] DELETE /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments/31857574-7b5a-452d-a7f9-0cf62f7cb4c6 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:03:30.733748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-370138ae-7818-48ec-9cf6-a1025ce36626 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:30.736840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-370138ae-7818-48ec-9cf6-a1025ce36626 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:30.745460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-370138ae-7818-48ec-9cf6-a1025ce36626 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:30.745941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-370138ae-7818-48ec-9cf6-a1025ce36626 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:30.746793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-370138ae-7818-48ec-9cf6-a1025ce36626 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:30.747620 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-370138ae-7818-48ec-9cf6-a1025ce36626 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:30.788041 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-370138ae-7818-48ec-9cf6-a1025ce36626 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058598 Aug 03 03:03:30.788836 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3582/7042] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 03:03:30 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:03:31.324297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-fff9c7a9-c582-48bd-9acb-af156979ac64 req-649651e9-656a-4fdd-983a-23c065ad5546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4cae21c-a710-4541-b934-7d6a824f11bc", "tag": "5da8ffb5-257f-4916-a77e-8d5857a88eb9"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:03:31.335233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-fff9c7a9-c582-48bd-9acb-af156979ac64 req-649651e9-656a-4fdd-983a-23c065ad5546 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:31.335687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-fff9c7a9-c582-48bd-9acb-af156979ac64 req-649651e9-656a-4fdd-983a-23c065ad5546 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:31.357287 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-fff9c7a9-c582-48bd-9acb-af156979ac64 req-649651e9-656a-4fdd-983a-23c065ad5546 service nova] Creating event network-changed:5da8ffb5-257f-4916-a77e-8d5857a88eb9 for instance d4cae21c-a710-4541-b934-7d6a824f11bc on n-h1-826529-8 Aug 03 03:03:31.362506 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-fff9c7a9-c582-48bd-9acb-af156979ac64 req-649651e9-656a-4fdd-983a-23c065ad5546 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043676 Aug 03 03:03:31.363413 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3461/7043] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 03:03:31.802143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5d82f7d9-20ac-47ff-98e4-c94917803108 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:31.805681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5d82f7d9-20ac-47ff-98e4-c94917803108 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:31.813551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d82f7d9-20ac-47ff-98e4-c94917803108 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:31.814348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d82f7d9-20ac-47ff-98e4-c94917803108 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:31.815402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d82f7d9-20ac-47ff-98e4-c94917803108 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:31.815932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5d82f7d9-20ac-47ff-98e4-c94917803108 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:31.850651 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5d82f7d9-20ac-47ff-98e4-c94917803108 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053276 Aug 03 03:03:31.851252 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3583/7044] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 03:03:31 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:03:32.865042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d8519861-6e89-485e-af3b-12d197ec3e1d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:32.868864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d8519861-6e89-485e-af3b-12d197ec3e1d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:32.876714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8519861-6e89-485e-af3b-12d197ec3e1d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:32.877185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8519861-6e89-485e-af3b-12d197ec3e1d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:32.878065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8519861-6e89-485e-af3b-12d197ec3e1d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:32.878521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d8519861-6e89-485e-af3b-12d197ec3e1d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:32.917229 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d8519861-6e89-485e-af3b-12d197ec3e1d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058057 Aug 03 03:03:32.917837 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3462/7045] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 03:03:32 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:03:33.931521 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dad80ecb-70bf-424c-87be-4f56b9386a0a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:33.934123 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dad80ecb-70bf-424c-87be-4f56b9386a0a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:33.942531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dad80ecb-70bf-424c-87be-4f56b9386a0a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:33.943251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dad80ecb-70bf-424c-87be-4f56b9386a0a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:33.944095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dad80ecb-70bf-424c-87be-4f56b9386a0a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:33.944576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dad80ecb-70bf-424c-87be-4f56b9386a0a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:33.987090 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dad80ecb-70bf-424c-87be-4f56b9386a0a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060613 Aug 03 03:03:33.987565 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3584/7046] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 03:03:33 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:03:35.001813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-13943cee-f38e-46d4-bcac-667b3c75fa0d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:35.004036 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-13943cee-f38e-46d4-bcac-667b3c75fa0d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:35.012031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13943cee-f38e-46d4-bcac-667b3c75fa0d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:35.012755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13943cee-f38e-46d4-bcac-667b3c75fa0d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:35.013540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13943cee-f38e-46d4-bcac-667b3c75fa0d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:35.014111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-13943cee-f38e-46d4-bcac-667b3c75fa0d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:35.048277 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-13943cee-f38e-46d4-bcac-667b3c75fa0d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050815 Aug 03 03:03:35.048871 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3463/7047] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 03:03:34 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:03:36.060817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3f293fc5-b863-4715-940f-fbd69ac6aa37 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:36.063475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3f293fc5-b863-4715-940f-fbd69ac6aa37 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:36.070374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f293fc5-b863-4715-940f-fbd69ac6aa37 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:36.071044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f293fc5-b863-4715-940f-fbd69ac6aa37 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:36.071693 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f293fc5-b863-4715-940f-fbd69ac6aa37 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:36.072150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3f293fc5-b863-4715-940f-fbd69ac6aa37 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:36.101674 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3f293fc5-b863-4715-940f-fbd69ac6aa37 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044861 Aug 03 03:03:36.102923 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3585/7048] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 03:03:36 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 03:03:36.113267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6eb94d73-3b64-4d6d-8006-20f25145a6b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:36.113817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6eb94d73-3b64-4d6d-8006-20f25145a6b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:36.121082 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6eb94d73-3b64-4d6d-8006-20f25145a6b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:36.121546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6eb94d73-3b64-4d6d-8006-20f25145a6b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:36.122325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6eb94d73-3b64-4d6d-8006-20f25145a6b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:36.122771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6eb94d73-3b64-4d6d-8006-20f25145a6b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:36.198308 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-6eb94d73-3b64-4d6d-8006-20f25145a6b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] HTTP exception thrown: Instance d4cae21c-a710-4541-b934-7d6a824f11bc is not attached to volume 31857574-7b5a-452d-a7f9-0cf62f7cb4c6 Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6eb94d73-3b64-4d6d-8006-20f25145a6b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Request method failure captured: Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments/31857574-7b5a-452d-a7f9-0cf62f7cb4c6 HTTP/1.1 Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eSgIgM-Om_9yCABAhPylJCSN1OsUZ1V19pEPDyjvxqqo8MXwXBlz1VLD6WjoKTlfkoCkVOSrDiSyB19X0HVQbAkgu0fU_8hcLAVHcP7paNZexXAWCR3G-oE3FvuR3i8fuYCHl_hiYJ7ewDzbbYVlLvmgB2wT6PwPXd3U-YCHzIauaY Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c56b09fee41d40f085aed568f06d0ff7 Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestMinimumBasicScenario-1349369688 Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c56b09fee41d40f085aed568f06d0ff7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c56b09fee41d40f085aed568f06d0ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c56b09fee41d40f085aed568f06d0ff7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c56b09fee41d40f085aed568f06d0ff7"}]}] Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestMinimumBasicScenario-1349369688 Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c56b09fee41d40f085aed568f06d0ff7 Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1349369688 Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestMinimumBasicScenario-1349369688-project Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 10f727693d764715ad413026021a1a8b Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestMinimumBasicScenario-1349369688-project Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance d4cae21c-a710-4541-b934-7d6a824f11bc is not attached to volume 31857574-7b5a-452d-a7f9-0cf62f7cb4c6 Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'server_id': 'd4cae21c-a710-4541-b934-7d6a824f11bc', 'id': '31857574-7b5a-452d-a7f9-0cf62f7cb4c6'} Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 31857574-7b5a-452d-a7f9-0cf62f7cb4c6. Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4cae21c-a710-4541-b934-7d6a824f11bc is not attached to volume 31857574-7b5a-452d-a7f9-0cf62f7cb4c6 Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:03:36.199997 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:03:36.204409 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 03:03:36.204409 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 03:03:36.204409 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4cae21c-a710-4541-b934-7d6a824f11bc is not attached to volume 31857574-7b5a-452d-a7f9-0cf62f7cb4c6 Aug 03 03:03:36.204409 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:03:36.204409 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6eb94d73-3b64-4d6d-8006-20f25145a6b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Returning 404 to user: Instance d4cae21c-a710-4541-b934-7d6a824f11bc is not attached to volume 31857574-7b5a-452d-a7f9-0cf62f7cb4c6 {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 03:03:36.204409 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6eb94d73-3b64-4d6d-8006-20f25145a6b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments/31857574-7b5a-452d-a7f9-0cf62f7cb4c6" status: 404 len: 154 microversion: 2.1 time: 0.092204 Aug 03 03:03:36.204409 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3464/7049] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 03:03:36 2022] DELETE /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc/os-volume_attachments/31857574-7b5a-452d-a7f9-0cf62f7cb4c6 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 03:03:39.457015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4f2b0581-e171-48a6-a543-ffafb944563a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:39.458101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4f2b0581-e171-48a6-a543-ffafb944563a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:39.466292 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f2b0581-e171-48a6-a543-ffafb944563a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:39.466922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f2b0581-e171-48a6-a543-ffafb944563a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:39.467845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f2b0581-e171-48a6-a543-ffafb944563a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:39.468475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4f2b0581-e171-48a6-a543-ffafb944563a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:39.495940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4f2b0581-e171-48a6-a543-ffafb944563a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 03:03:39.585551 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4f2b0581-e171-48a6-a543-ffafb944563a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 204 len: 0 microversion: 2.1 time: 0.131117 Aug 03 03:03:39.586100 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3586/7050] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 03:03:39 2022] DELETE /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 03:03:39.595553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-18b4df13-9045-4c80-a149-32584aca87ae tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:39.596356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-18b4df13-9045-4c80-a149-32584aca87ae tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:39.605582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18b4df13-9045-4c80-a149-32584aca87ae tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:39.606050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18b4df13-9045-4c80-a149-32584aca87ae tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:39.607088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18b4df13-9045-4c80-a149-32584aca87ae tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:39.607541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18b4df13-9045-4c80-a149-32584aca87ae tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:39.753178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-18b4df13-9045-4c80-a149-32584aca87ae tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:03:39.761158 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-18b4df13-9045-4c80-a149-32584aca87ae tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1555 microversion: 2.1 time: 0.169876 Aug 03 03:03:39.761751 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3465/7051] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:03:39 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:03:40.783897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-767042f1-6fdf-4367-8ccf-e2245c15343f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:40.784617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-767042f1-6fdf-4367-8ccf-e2245c15343f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:40.792479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-767042f1-6fdf-4367-8ccf-e2245c15343f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:40.792952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-767042f1-6fdf-4367-8ccf-e2245c15343f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:40.793743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-767042f1-6fdf-4367-8ccf-e2245c15343f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:40.794199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-767042f1-6fdf-4367-8ccf-e2245c15343f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:40.973799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-767042f1-6fdf-4367-8ccf-e2245c15343f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:03:40.982039 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-767042f1-6fdf-4367-8ccf-e2245c15343f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1555 microversion: 2.1 time: 0.202455 Aug 03 03:03:40.982625 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3587/7052] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:03:40 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1555 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:03:42.003667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8a2ed50c-0965-4e53-a036-e7d44f9b2704 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:42.005419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8a2ed50c-0965-4e53-a036-e7d44f9b2704 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:42.014940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a2ed50c-0965-4e53-a036-e7d44f9b2704 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:42.015425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a2ed50c-0965-4e53-a036-e7d44f9b2704 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:42.016270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a2ed50c-0965-4e53-a036-e7d44f9b2704 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:42.016737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a2ed50c-0965-4e53-a036-e7d44f9b2704 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:42.051809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-8bc5b610-fe74-45d8-88f2-fa3253f8b93b req-ff952161-a275-4653-89ab-89cc728145e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4cae21c-a710-4541-b934-7d6a824f11bc", "name": "network-vif-deleted", "tag": "5da8ffb5-257f-4916-a77e-8d5857a88eb9"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:03:42.063675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8bc5b610-fe74-45d8-88f2-fa3253f8b93b req-ff952161-a275-4653-89ab-89cc728145e6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:42.064400 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8bc5b610-fe74-45d8-88f2-fa3253f8b93b req-ff952161-a275-4653-89ab-89cc728145e6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:42.077818 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-8bc5b610-fe74-45d8-88f2-fa3253f8b93b req-ff952161-a275-4653-89ab-89cc728145e6 service nova] Creating event network-vif-deleted:5da8ffb5-257f-4916-a77e-8d5857a88eb9 for instance d4cae21c-a710-4541-b934-7d6a824f11bc on n-h1-826529-8 Aug 03 03:03:42.083159 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-8bc5b610-fe74-45d8-88f2-fa3253f8b93b req-ff952161-a275-4653-89ab-89cc728145e6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103956 Aug 03 03:03:42.083979 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3466/7053] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:03:42.092047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8a2ed50c-0965-4e53-a036-e7d44f9b2704 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:03:42.100112 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8a2ed50c-0965-4e53-a036-e7d44f9b2704 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 200 len: 1344 microversion: 2.1 time: 0.100575 Aug 03 03:03:42.100695 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3588/7054] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:03:41 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 1344 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:03:43.122450 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-90fd62c9-557f-48a3-a936-d074535d4067 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:43.123221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-90fd62c9-557f-48a3-a936-d074535d4067 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: d4cae21c-a710-4541-b934-7d6a824f11bc] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:43.130052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90fd62c9-557f-48a3-a936-d074535d4067 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:43.130518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90fd62c9-557f-48a3-a936-d074535d4067 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:43.131342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90fd62c9-557f-48a3-a936-d074535d4067 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:43.131796 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90fd62c9-557f-48a3-a936-d074535d4067 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:43.146388 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-90fd62c9-557f-48a3-a936-d074535d4067 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] HTTP exception thrown: Instance d4cae21c-a710-4541-b934-7d6a824f11bc could not be found. Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-90fd62c9-557f-48a3-a936-d074535d4067 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Request method failure captured: Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc HTTP/1.1 Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eSgIgM-Om_9yCABAhPylJCSN1OsUZ1V19pEPDyjvxqqo8MXwXBlz1VLD6WjoKTlfkoCkVOSrDiSyB19X0HVQbAkgu0fU_8hcLAVHcP7paNZexXAWCR3G-oE3FvuR3i8fuYCHl_hiYJ7ewDzbbYVlLvmgB2wT6PwPXd3U-YCHzIauaY Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c56b09fee41d40f085aed568f06d0ff7 Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestMinimumBasicScenario-1349369688 Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c56b09fee41d40f085aed568f06d0ff7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c56b09fee41d40f085aed568f06d0ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c56b09fee41d40f085aed568f06d0ff7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c56b09fee41d40f085aed568f06d0ff7"}]}] Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestMinimumBasicScenario-1349369688 Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c56b09fee41d40f085aed568f06d0ff7 Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1349369688 Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestMinimumBasicScenario-1349369688-project Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 10f727693d764715ad413026021a1a8b Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestMinimumBasicScenario-1349369688-project Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance d4cae21c-a710-4541-b934-7d6a824f11bc could not be found. Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'd4cae21c-a710-4541-b934-7d6a824f11bc'} Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4cae21c-a710-4541-b934-7d6a824f11bc could not be found. Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4cae21c-a710-4541-b934-7d6a824f11bc could not be found. Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:03:43.148065 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:03:43.152511 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:03:43.152511 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:03:43.152511 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:03:43.152511 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 03:03:43.152511 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 03:03:43.152511 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4cae21c-a710-4541-b934-7d6a824f11bc could not be found. Aug 03 03:03:43.152511 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:03:43.152511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-90fd62c9-557f-48a3-a936-d074535d4067 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Returning 404 to user: Instance d4cae21c-a710-4541-b934-7d6a824f11bc could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 03:03:43.152511 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-90fd62c9-557f-48a3-a936-d074535d4067 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc" status: 404 len: 111 microversion: 2.1 time: 0.032721 Aug 03 03:03:43.152511 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3467/7055] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:03:43 2022] GET /compute/v2.1/servers/d4cae21c-a710-4541-b934-7d6a824f11bc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 03:03:43.158469 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7fd8aa62-ec65-48c6-8b14-da18110cc50a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '.version_select at 0x7f5b245e5550>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:43.182697 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7fd8aa62-ec65-48c6-8b14-da18110cc50a tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1905443520" status: 202 len: 0 microversion: 2.1 time: 0.028014 Aug 03 03:03:43.183318 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3589/7056] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 3 03:03:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1905443520 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:03:52.203919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b45bc06a-6564-455d-81dc-da600ba4e2c8 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Action: 'create', calling method: .version_select at 0x7f5b1306b040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-186706266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQXNkX/njlEO58h3z0v/ycX++RlTTAs4BD3BbWta6tr1h8W6i92ReeUvs2C4zSE/De2/o4VXKfBVLnYeJNJ1SdN/twfq9JJ4Yg/bhtsFecsI2OpRznOfFjc+F/Ii7JFAg=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:03:52.220389 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-b45bc06a-6564-455d-81dc-da600ba4e2c8 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Getting quotas for project c56b09fee41d40f085aed568f06d0ff7. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:03:52.225868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-b45bc06a-6564-455d-81dc-da600ba4e2c8 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Getting quotas for user 10f727693d764715ad413026021a1a8b and project c56b09fee41d40f085aed568f06d0ff7. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:03:52.252630 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b45bc06a-6564-455d-81dc-da600ba4e2c8 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052651 Aug 03 03:03:52.253247 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3468/7057] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 03:03:52 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:03:52.301929 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:03:52.306849 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-670135674", "imageRef": "5ed6cef9-c322-42e1-be5f-997a1173534a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-186706266", "networks": [{"uuid": "4277f317-103b-44c3-be23-8b0456de237b"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:03:52.374053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] validate_networks() for [('4277f317-103b-44c3-be23-8b0456de237b', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 03:03:52.766706 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 03:03:52.767549 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 03:03:52.768142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 03:03:52.768616 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 03:03:52.769176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 03:03:52.778895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:52.779369 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:52.780186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:52.780635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:52.797980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Getting quotas for project c56b09fee41d40f085aed568f06d0ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:03:52.803201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Getting quotas for user 10f727693d764715ad413026021a1a8b and project c56b09fee41d40f085aed568f06d0ff7. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:03:52.815597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 03:03:52.817789 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ed6cef9-c322-42e1-be5f-997a1173534a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 03:03:52.864235 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4954676f-bbfc-454b-be8f-7ce3ecabb647 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564227 Aug 03 03:03:52.864885 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3590/7058] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 03:03:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 03:03:52.876246 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a27a6271-149b-4465-b4a3-6ad9eb070326 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:52.876860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a27a6271-149b-4465-b4a3-6ad9eb070326 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:52.936647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a27a6271-149b-4465-b4a3-6ad9eb070326 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:03:52.944594 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a27a6271-149b-4465-b4a3-6ad9eb070326 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1257 microversion: 2.1 time: 0.072362 Aug 03 03:03:52.945155 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3469/7059] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:03:52 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:03:53.967641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ff5a2ccd-b250-40b7-8842-ceb557bb6fc5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:53.968287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ff5a2ccd-b250-40b7-8842-ceb557bb6fc5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:54.031788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ff5a2ccd-b250-40b7-8842-ceb557bb6fc5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:03:54.042700 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ff5a2ccd-b250-40b7-8842-ceb557bb6fc5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1257 microversion: 2.1 time: 0.081021 Aug 03 03:03:54.043330 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3591/7060] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:03:53 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1257 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:03:55.063555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-89ff776a-4895-4037-860d-4836e0c13ebe tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:55.064253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-89ff776a-4895-4037-860d-4836e0c13ebe tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:55.066213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:03:55.124407 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-89ff776a-4895-4037-860d-4836e0c13ebe tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:03:55.131311 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-89ff776a-4895-4037-860d-4836e0c13ebe tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1257 microversion: 2.1 time: 0.071627 Aug 03 03:03:55.131884 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3470/7061] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:03:55 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:03:56.153608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d49f57a2-2041-4fa5-aba7-fdf1b98f8815 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:56.154245 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d49f57a2-2041-4fa5-aba7-fdf1b98f8815 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:56.207697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d49f57a2-2041-4fa5-aba7-fdf1b98f8815 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:03:56.216013 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d49f57a2-2041-4fa5-aba7-fdf1b98f8815 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1257 microversion: 2.1 time: 0.067107 Aug 03 03:03:56.216603 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3592/7062] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:03:56 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:03:57.237759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1d1bda74-5165-4150-b015-904bc868489c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:57.238436 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1d1bda74-5165-4150-b015-904bc868489c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:57.246088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d1bda74-5165-4150-b015-904bc868489c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:57.246551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d1bda74-5165-4150-b015-904bc868489c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:57.247364 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d1bda74-5165-4150-b015-904bc868489c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:57.247814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1d1bda74-5165-4150-b015-904bc868489c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:57.312675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1d1bda74-5165-4150-b015-904bc868489c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:03:57.320416 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1d1bda74-5165-4150-b015-904bc868489c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1261 microversion: 2.1 time: 0.086711 Aug 03 03:03:57.320989 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3471/7063] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:03:57 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:03:58.341720 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1005e23a-75f5-4a3b-a9f1-8c17316c0a85 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:58.342467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1005e23a-75f5-4a3b-a9f1-8c17316c0a85 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:58.356286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1005e23a-75f5-4a3b-a9f1-8c17316c0a85 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:58.357102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1005e23a-75f5-4a3b-a9f1-8c17316c0a85 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:58.359811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1005e23a-75f5-4a3b-a9f1-8c17316c0a85 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:58.363636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1005e23a-75f5-4a3b-a9f1-8c17316c0a85 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:58.516964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1005e23a-75f5-4a3b-a9f1-8c17316c0a85 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:03:58.536900 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1005e23a-75f5-4a3b-a9f1-8c17316c0a85 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1315 microversion: 2.1 time: 0.198999 Aug 03 03:03:58.538262 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3593/7064] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:03:58 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:03:59.559011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9174b494-1d3f-4596-925b-4b4c1938a6d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:03:59.559633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9174b494-1d3f-4596-925b-4b4c1938a6d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:03:59.562300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:03:59.568711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9174b494-1d3f-4596-925b-4b4c1938a6d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:59.569173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9174b494-1d3f-4596-925b-4b4c1938a6d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:59.569967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9174b494-1d3f-4596-925b-4b4c1938a6d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:03:59.570417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9174b494-1d3f-4596-925b-4b4c1938a6d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:03:59.726742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9174b494-1d3f-4596-925b-4b4c1938a6d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:03:59.735169 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9174b494-1d3f-4596-925b-4b4c1938a6d0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1357 microversion: 2.1 time: 0.180630 Aug 03 03:03:59.735758 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3472/7065] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:03:59 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:00.756956 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-42b95bf0-4400-439e-a287-30c76ac6d3c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:00.757635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-42b95bf0-4400-439e-a287-30c76ac6d3c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:00.772039 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:04:00.781949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42b95bf0-4400-439e-a287-30c76ac6d3c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:00.782421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42b95bf0-4400-439e-a287-30c76ac6d3c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:00.783268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42b95bf0-4400-439e-a287-30c76ac6d3c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:00.783727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-42b95bf0-4400-439e-a287-30c76ac6d3c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:01.004050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-42b95bf0-4400-439e-a287-30c76ac6d3c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:01.014842 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-42b95bf0-4400-439e-a287-30c76ac6d3c0 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1357 microversion: 2.1 time: 0.261726 Aug 03 03:04:01.039667 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3594/7066] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:00 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1357 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:04:02.046360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-45a5d740-5d30-4baa-8d69-c8bdc8840ea1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:02.047140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-45a5d740-5d30-4baa-8d69-c8bdc8840ea1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:02.054291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45a5d740-5d30-4baa-8d69-c8bdc8840ea1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:02.054756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45a5d740-5d30-4baa-8d69-c8bdc8840ea1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:02.056229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45a5d740-5d30-4baa-8d69-c8bdc8840ea1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:02.056790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45a5d740-5d30-4baa-8d69-c8bdc8840ea1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:02.184882 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-45a5d740-5d30-4baa-8d69-c8bdc8840ea1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:02.192741 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-45a5d740-5d30-4baa-8d69-c8bdc8840ea1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1357 microversion: 2.1 time: 0.150326 Aug 03 03:04:02.193324 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3473/7067] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:02 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:03.217650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0410f8ce-cdbc-4d1f-8eb2-1231854cdb71 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:03.218287 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0410f8ce-cdbc-4d1f-8eb2-1231854cdb71 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:03.221090 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:04:03.228054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0410f8ce-cdbc-4d1f-8eb2-1231854cdb71 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:03.228714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0410f8ce-cdbc-4d1f-8eb2-1231854cdb71 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:03.229712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0410f8ce-cdbc-4d1f-8eb2-1231854cdb71 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:03.230170 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0410f8ce-cdbc-4d1f-8eb2-1231854cdb71 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:03.378274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0410f8ce-cdbc-4d1f-8eb2-1231854cdb71 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:03.386708 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0410f8ce-cdbc-4d1f-8eb2-1231854cdb71 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1357 microversion: 2.1 time: 0.172947 Aug 03 03:04:03.387532 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3595/7068] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:03 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:04.408712 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0aa7a79a-d81b-4371-a930-d00923050885 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:04.409353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0aa7a79a-d81b-4371-a930-d00923050885 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:04.416715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0aa7a79a-d81b-4371-a930-d00923050885 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:04.417176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0aa7a79a-d81b-4371-a930-d00923050885 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:04.417977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0aa7a79a-d81b-4371-a930-d00923050885 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:04.418421 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0aa7a79a-d81b-4371-a930-d00923050885 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:04.565528 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0aa7a79a-d81b-4371-a930-d00923050885 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:04.574395 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0aa7a79a-d81b-4371-a930-d00923050885 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1357 microversion: 2.1 time: 0.169463 Aug 03 03:04:04.575230 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3474/7069] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:04 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:05.595839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-07343032-2ee4-48ff-8fed-24b5ff967914 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:05.596476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-07343032-2ee4-48ff-8fed-24b5ff967914 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:05.603738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-07343032-2ee4-48ff-8fed-24b5ff967914 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:05.604443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-07343032-2ee4-48ff-8fed-24b5ff967914 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:05.605248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-07343032-2ee4-48ff-8fed-24b5ff967914 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:05.605711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-07343032-2ee4-48ff-8fed-24b5ff967914 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:05.778195 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-07343032-2ee4-48ff-8fed-24b5ff967914 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:05.786833 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-07343032-2ee4-48ff-8fed-24b5ff967914 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1357 microversion: 2.1 time: 0.194693 Aug 03 03:04:05.798319 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3596/7070] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:05 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:06.810395 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7797aa4e-6be5-4dbc-94ba-c6d88e29fe8d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:06.811107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7797aa4e-6be5-4dbc-94ba-c6d88e29fe8d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:06.812997 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:04:06.819384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7797aa4e-6be5-4dbc-94ba-c6d88e29fe8d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:06.819844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7797aa4e-6be5-4dbc-94ba-c6d88e29fe8d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:06.820644 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7797aa4e-6be5-4dbc-94ba-c6d88e29fe8d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:06.821099 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7797aa4e-6be5-4dbc-94ba-c6d88e29fe8d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:07.021635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7797aa4e-6be5-4dbc-94ba-c6d88e29fe8d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:07.029620 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7797aa4e-6be5-4dbc-94ba-c6d88e29fe8d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1357 microversion: 2.1 time: 0.223253 Aug 03 03:04:07.030215 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3475/7071] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:06 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:07.514833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-31a9502f-72b1-4252-89f7-cc505b756c56 req-c5a98503-a6c6-4706-8377-1554baafa7db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d70b5a-dfa5-4672-9b60-45694d605f32", "tag": "5841cec0-7bce-446e-86b4-d667a654aecc"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:04:07.520055 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=10 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:04:07.528512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-31a9502f-72b1-4252-89f7-cc505b756c56 req-c5a98503-a6c6-4706-8377-1554baafa7db service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:07.528915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-31a9502f-72b1-4252-89f7-cc505b756c56 req-c5a98503-a6c6-4706-8377-1554baafa7db service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:07.540406 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-31a9502f-72b1-4252-89f7-cc505b756c56 req-c5a98503-a6c6-4706-8377-1554baafa7db service nova] Creating event network-changed:5841cec0-7bce-446e-86b4-d667a654aecc for instance f0d70b5a-dfa5-4672-9b60-45694d605f32 on n-h2-826529-8 Aug 03 03:04:07.546256 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-31a9502f-72b1-4252-89f7-cc505b756c56 req-c5a98503-a6c6-4706-8377-1554baafa7db service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036756 Aug 03 03:04:07.547240 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3597/7072] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:04:08.051127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2e0c98fe-4f33-4417-a040-bfe11ad32651 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:08.051764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2e0c98fe-4f33-4417-a040-bfe11ad32651 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:08.059533 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e0c98fe-4f33-4417-a040-bfe11ad32651 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:08.060004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e0c98fe-4f33-4417-a040-bfe11ad32651 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:08.060787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e0c98fe-4f33-4417-a040-bfe11ad32651 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:08.061238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e0c98fe-4f33-4417-a040-bfe11ad32651 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:08.457908 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2e0c98fe-4f33-4417-a040-bfe11ad32651 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:08.466179 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2e0c98fe-4f33-4417-a040-bfe11ad32651 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1357 microversion: 2.1 time: 0.419036 Aug 03 03:04:08.466769 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3476/7073] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:08 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1357 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:09.488390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4fd723f7-c955-4471-a1f9-99297cd45ae6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:09.489138 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4fd723f7-c955-4471-a1f9-99297cd45ae6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:09.496811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4fd723f7-c955-4471-a1f9-99297cd45ae6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:09.497279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4fd723f7-c955-4471-a1f9-99297cd45ae6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:09.498068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4fd723f7-c955-4471-a1f9-99297cd45ae6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:09.498519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4fd723f7-c955-4471-a1f9-99297cd45ae6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:09.632040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4fd723f7-c955-4471-a1f9-99297cd45ae6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:09.641384 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4fd723f7-c955-4471-a1f9-99297cd45ae6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1357 microversion: 2.1 time: 0.158146 Aug 03 03:04:09.642022 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3598/7074] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:09 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:10.663551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-35955050-6fd7-41be-85ad-387234e90ff2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:10.664180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-35955050-6fd7-41be-85ad-387234e90ff2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:10.671745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35955050-6fd7-41be-85ad-387234e90ff2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:10.672203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35955050-6fd7-41be-85ad-387234e90ff2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:10.672988 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35955050-6fd7-41be-85ad-387234e90ff2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:10.673432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-35955050-6fd7-41be-85ad-387234e90ff2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:10.811799 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-35955050-6fd7-41be-85ad-387234e90ff2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:10.819339 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-35955050-6fd7-41be-85ad-387234e90ff2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1357 microversion: 2.1 time: 0.159723 Aug 03 03:04:10.819919 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3477/7075] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:10 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:11.284900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-ef2665d2-2d72-4d6b-8eff-c2003d222d58 req-57bb5dad-c168-40b4-a79a-af85248fdbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d70b5a-dfa5-4672-9b60-45694d605f32", "name": "network-vif-plugged", "status": "completed", "tag": "5841cec0-7bce-446e-86b4-d667a654aecc"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:04:11.295523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ef2665d2-2d72-4d6b-8eff-c2003d222d58 req-57bb5dad-c168-40b4-a79a-af85248fdbe2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:11.295804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ef2665d2-2d72-4d6b-8eff-c2003d222d58 req-57bb5dad-c168-40b4-a79a-af85248fdbe2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:11.310836 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-ef2665d2-2d72-4d6b-8eff-c2003d222d58 req-57bb5dad-c168-40b4-a79a-af85248fdbe2 service nova] Creating event network-vif-plugged:5841cec0-7bce-446e-86b4-d667a654aecc for instance f0d70b5a-dfa5-4672-9b60-45694d605f32 on n-h2-826529-8 Aug 03 03:04:11.316018 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-ef2665d2-2d72-4d6b-8eff-c2003d222d58 req-57bb5dad-c168-40b4-a79a-af85248fdbe2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094478 Aug 03 03:04:11.316645 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3599/7076] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:04:11.844786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2e7f99a2-e77f-4779-af34-ff3c6402a2d1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:11.845403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2e7f99a2-e77f-4779-af34-ff3c6402a2d1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:11.852782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e7f99a2-e77f-4779-af34-ff3c6402a2d1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:11.853235 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e7f99a2-e77f-4779-af34-ff3c6402a2d1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:11.854787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e7f99a2-e77f-4779-af34-ff3c6402a2d1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:11.855288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2e7f99a2-e77f-4779-af34-ff3c6402a2d1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:12.000133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2e7f99a2-e77f-4779-af34-ff3c6402a2d1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:12.007923 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2e7f99a2-e77f-4779-af34-ff3c6402a2d1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1357 microversion: 2.1 time: 0.167001 Aug 03 03:04:12.008510 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3478/7077] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:11 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:13.031112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e145251a-3e6b-4649-b1d4-6f098b152a3e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:13.031777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e145251a-3e6b-4649-b1d4-6f098b152a3e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:13.038126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e145251a-3e6b-4649-b1d4-6f098b152a3e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:13.038631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e145251a-3e6b-4649-b1d4-6f098b152a3e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:13.039451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e145251a-3e6b-4649-b1d4-6f098b152a3e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:13.040880 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e145251a-3e6b-4649-b1d4-6f098b152a3e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:13.173482 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e145251a-3e6b-4649-b1d4-6f098b152a3e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:13.181114 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e145251a-3e6b-4649-b1d4-6f098b152a3e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1548 microversion: 2.1 time: 0.155843 Aug 03 03:04:13.182210 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3600/7078] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:13 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:13.202373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-821ac9ec-f1f4-4ce2-8f96-9ba4c9ca35f5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:13.203051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-821ac9ec-f1f4-4ce2-8f96-9ba4c9ca35f5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:13.210703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-821ac9ec-f1f4-4ce2-8f96-9ba4c9ca35f5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:13.211196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-821ac9ec-f1f4-4ce2-8f96-9ba4c9ca35f5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:13.211979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-821ac9ec-f1f4-4ce2-8f96-9ba4c9ca35f5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:13.212415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-821ac9ec-f1f4-4ce2-8f96-9ba4c9ca35f5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:13.347371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-821ac9ec-f1f4-4ce2-8f96-9ba4c9ca35f5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:13.357009 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-821ac9ec-f1f4-4ce2-8f96-9ba4c9ca35f5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1548 microversion: 2.1 time: 0.158578 Aug 03 03:04:13.357586 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3479/7079] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:13 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:13.377497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-68e93677-5587-4104-a67e-a2939d7a902d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:13.382137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-68e93677-5587-4104-a67e-a2939d7a902d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:13.382944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-68e93677-5587-4104-a67e-a2939d7a902d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Searching by: {'deleted': False, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7'} {{(pid=125941) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 03:04:13.389198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68e93677-5587-4104-a67e-a2939d7a902d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:13.389678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68e93677-5587-4104-a67e-a2939d7a902d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:13.390507 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68e93677-5587-4104-a67e-a2939d7a902d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:13.391000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-68e93677-5587-4104-a67e-a2939d7a902d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:13.415417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.multi_cell_list [None req-68e93677-5587-4104-a67e-a2939d7a902d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 03:04:13.442799 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-68e93677-5587-4104-a67e-a2939d7a902d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069124 Aug 03 03:04:13.443419 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3601/7080] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 3 03:04:13 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:04:13.454871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2db7badc-2198-4f9b-8dec-46125112c83c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:13.455526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2db7badc-2198-4f9b-8dec-46125112c83c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:13.461689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2db7badc-2198-4f9b-8dec-46125112c83c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:13.462150 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2db7badc-2198-4f9b-8dec-46125112c83c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:13.463486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2db7badc-2198-4f9b-8dec-46125112c83c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:13.463942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2db7badc-2198-4f9b-8dec-46125112c83c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:13.600135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2db7badc-2198-4f9b-8dec-46125112c83c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:13.608047 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2db7badc-2198-4f9b-8dec-46125112c83c tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1548 microversion: 2.1 time: 0.157033 Aug 03 03:04:13.608650 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3480/7081] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:13 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:15.122685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-aa505008-247d-4f9d-8eaf-9107f32e497e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8bc279f-9b65-406d-93ce-0835755cda56"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:04:15.125077 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-aa505008-247d-4f9d-8eaf-9107f32e497e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:15.132018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa505008-247d-4f9d-8eaf-9107f32e497e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:15.132486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa505008-247d-4f9d-8eaf-9107f32e497e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:15.133266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa505008-247d-4f9d-8eaf-9107f32e497e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:15.133722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-aa505008-247d-4f9d-8eaf-9107f32e497e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:15.381221 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-aa505008-247d-4f9d-8eaf-9107f32e497e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "POST /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262044 Aug 03 03:04:15.381853 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3602/7082] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 3 03:04:15 2022] POST /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:04:19.764667 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:04:19.765213 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 03:04:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:04:26.163364 n-d-826529-8 devstack@n-api.service[125942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6768ec80-552a-4875-95fb-ee55c75da43d] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 03:04:26.164150 n-d-826529-8 devstack@n-api.service[125942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95a5e56a-7955-4bb2-902f-a217315250e4] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 03:04:26.169604 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-63a5a7f1-a081-4df9-8328-4eb4c429a69d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:26.170233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-63a5a7f1-a081-4df9-8328-4eb4c429a69d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:26.172563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=17 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:04:26.173272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=60 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:04:26.179460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63a5a7f1-a081-4df9-8328-4eb4c429a69d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:26.179967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63a5a7f1-a081-4df9-8328-4eb4c429a69d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:26.180767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63a5a7f1-a081-4df9-8328-4eb4c429a69d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:26.181217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63a5a7f1-a081-4df9-8328-4eb4c429a69d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:26.319201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-63a5a7f1-a081-4df9-8328-4eb4c429a69d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:26.328592 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-63a5a7f1-a081-4df9-8328-4eb4c429a69d tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1594 microversion: 2.1 time: 0.166578 Aug 03 03:04:26.329262 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3481/7083] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:26 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1594 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:27.953286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-40940388-5a51-4581-bb25-a152a89ed4fa req-219b9215-a248-4256-8d79-64dbb7024301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d70b5a-dfa5-4672-9b60-45694d605f32", "tag": "5841cec0-7bce-446e-86b4-d667a654aecc"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:04:27.963697 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b324c37-7dbb-4b30-9a93-80ead1f0c21e] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 03:04:27.964637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:04:27.965547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=17 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:04:27.966044 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:04:27.968403 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-40940388-5a51-4581-bb25-a152a89ed4fa req-219b9215-a248-4256-8d79-64dbb7024301 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:27.979458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-40940388-5a51-4581-bb25-a152a89ed4fa req-219b9215-a248-4256-8d79-64dbb7024301 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:27.995005 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-40940388-5a51-4581-bb25-a152a89ed4fa req-219b9215-a248-4256-8d79-64dbb7024301 service nova] Creating event network-changed:5841cec0-7bce-446e-86b4-d667a654aecc for instance f0d70b5a-dfa5-4672-9b60-45694d605f32 on n-h2-826529-8 Aug 03 03:04:28.000401 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-40940388-5a51-4581-bb25-a152a89ed4fa req-219b9215-a248-4256-8d79-64dbb7024301 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051408 Aug 03 03:04:28.000905 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3603/7084] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 03:04:29.069716 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-21d3322a-c27d-4910-855c-51f4601b752b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1570264296"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:04:29.070352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-21d3322a-c27d-4910-855c-51f4601b752b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:29.089292 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] [6768ec80-552a-4875-95fb-ee55c75da43d] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 38244. Aug 03 03:04:29.090257 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] [95a5e56a-7955-4bb2-902f-a217315250e4] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 38246. Aug 03 03:04:29.093673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21d3322a-c27d-4910-855c-51f4601b752b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:29.094130 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21d3322a-c27d-4910-855c-51f4601b752b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:29.095190 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21d3322a-c27d-4910-855c-51f4601b752b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:29.095646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-21d3322a-c27d-4910-855c-51f4601b752b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:29.236106 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.network.security_group_api [None req-21d3322a-c27d-4910-855c-51f4601b752b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Adding security group b130d691-9074-437d-b225-cd219983c6d0 to port 5841cec0-7bce-446e-86b4-d667a654aecc Aug 03 03:04:29.549538 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-21d3322a-c27d-4910-855c-51f4601b752b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "POST /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/action" status: 202 len: 0 microversion: 2.1 time: 0.483797 Aug 03 03:04:29.550153 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3482/7085] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:04:29 2022] POST /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 03:04:29.560202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b8d411c7-7196-4dbe-87c9-bff25420cfe3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:29.560202 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b8d411c7-7196-4dbe-87c9-bff25420cfe3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:29.569835 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8d411c7-7196-4dbe-87c9-bff25420cfe3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:29.570360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8d411c7-7196-4dbe-87c9-bff25420cfe3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:29.571346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8d411c7-7196-4dbe-87c9-bff25420cfe3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:29.572944 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b8d411c7-7196-4dbe-87c9-bff25420cfe3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:29.595400 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b324c37-7dbb-4b30-9a93-80ead1f0c21e] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 38250. Aug 03 03:04:29.749239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b8d411c7-7196-4dbe-87c9-bff25420cfe3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:29.757887 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b8d411c7-7196-4dbe-87c9-bff25420cfe3 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1760 microversion: 2.1 time: 0.203008 Aug 03 03:04:29.758847 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3604/7086] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:29 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1760 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:30.014973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-cc0ed0e9-33cb-4ea6-bdd3-e494bc55691b req-9605454d-3c1a-41f8-9b08-f65a5e3e214a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d70b5a-dfa5-4672-9b60-45694d605f32", "tag": "5841cec0-7bce-446e-86b4-d667a654aecc"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:04:30.024779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-cc0ed0e9-33cb-4ea6-bdd3-e494bc55691b req-9605454d-3c1a-41f8-9b08-f65a5e3e214a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:30.026707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-cc0ed0e9-33cb-4ea6-bdd3-e494bc55691b req-9605454d-3c1a-41f8-9b08-f65a5e3e214a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:30.038385 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-cc0ed0e9-33cb-4ea6-bdd3-e494bc55691b req-9605454d-3c1a-41f8-9b08-f65a5e3e214a service nova] Creating event network-changed:5841cec0-7bce-446e-86b4-d667a654aecc for instance f0d70b5a-dfa5-4672-9b60-45694d605f32 on n-h2-826529-8 Aug 03 03:04:30.044908 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-cc0ed0e9-33cb-4ea6-bdd3-e494bc55691b req-9605454d-3c1a-41f8-9b08-f65a5e3e214a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033976 Aug 03 03:04:30.045787 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3483/7087] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:04:45.769734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-62645d3e-69b0-4439-926c-3a3032f516d5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:04:45.772054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-62645d3e-69b0-4439-926c-3a3032f516d5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:45.774964 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:04:45.775636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=8 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:04:45.783256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62645d3e-69b0-4439-926c-3a3032f516d5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:45.783760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62645d3e-69b0-4439-926c-3a3032f516d5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:45.784604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62645d3e-69b0-4439-926c-3a3032f516d5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:45.785059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-62645d3e-69b0-4439-926c-3a3032f516d5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:45.860648 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-62645d3e-69b0-4439-926c-3a3032f516d5 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "POST /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/action" status: 202 len: 0 microversion: 2.1 time: 0.094984 Aug 03 03:04:45.861313 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3605/7088] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:04:45 2022] POST /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:04:45.867967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:04:45.868867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=12 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:04:45.873893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-46ffc356-b7eb-47c5-bb39-9cd5adc5bb0f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:45.874710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-46ffc356-b7eb-47c5-bb39-9cd5adc5bb0f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:45.882228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46ffc356-b7eb-47c5-bb39-9cd5adc5bb0f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:45.882690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46ffc356-b7eb-47c5-bb39-9cd5adc5bb0f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:45.883534 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46ffc356-b7eb-47c5-bb39-9cd5adc5bb0f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:45.883984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46ffc356-b7eb-47c5-bb39-9cd5adc5bb0f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:46.390559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-46ffc356-b7eb-47c5-bb39-9cd5adc5bb0f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:46.399923 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-46ffc356-b7eb-47c5-bb39-9cd5adc5bb0f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1752 microversion: 2.1 time: 0.533874 Aug 03 03:04:46.400518 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3484/7089] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:45 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1752 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:47.424166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f038cba5-a690-4aec-ba33-4012664c8abf tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:47.424887 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f038cba5-a690-4aec-ba33-4012664c8abf tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:47.431370 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f038cba5-a690-4aec-ba33-4012664c8abf tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:47.431842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f038cba5-a690-4aec-ba33-4012664c8abf tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:47.432661 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f038cba5-a690-4aec-ba33-4012664c8abf tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:47.433120 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f038cba5-a690-4aec-ba33-4012664c8abf tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:47.679748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f038cba5-a690-4aec-ba33-4012664c8abf tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:47.688313 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f038cba5-a690-4aec-ba33-4012664c8abf tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1757 microversion: 2.1 time: 0.270205 Aug 03 03:04:47.688925 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3606/7090] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:47 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1757 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:48.711657 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a3d9e6f7-3d6c-45a4-bd3f-a76a66cc2980 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:48.712285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a3d9e6f7-3d6c-45a4-bd3f-a76a66cc2980 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:48.719594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3d9e6f7-3d6c-45a4-bd3f-a76a66cc2980 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:48.720060 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3d9e6f7-3d6c-45a4-bd3f-a76a66cc2980 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:48.720848 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3d9e6f7-3d6c-45a4-bd3f-a76a66cc2980 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:48.721302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a3d9e6f7-3d6c-45a4-bd3f-a76a66cc2980 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:48.868319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a3d9e6f7-3d6c-45a4-bd3f-a76a66cc2980 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:48.877197 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a3d9e6f7-3d6c-45a4-bd3f-a76a66cc2980 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1757 microversion: 2.1 time: 0.169464 Aug 03 03:04:48.877782 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3485/7091] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:48 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:49.946632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d3b6d89d-e485-4250-b311-ddac2cea0b42 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:49.947297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d3b6d89d-e485-4250-b311-ddac2cea0b42 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:49.953819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3b6d89d-e485-4250-b311-ddac2cea0b42 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:49.954288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3b6d89d-e485-4250-b311-ddac2cea0b42 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:49.955105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3b6d89d-e485-4250-b311-ddac2cea0b42 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:49.955564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d3b6d89d-e485-4250-b311-ddac2cea0b42 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:50.108327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d3b6d89d-e485-4250-b311-ddac2cea0b42 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:50.116675 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d3b6d89d-e485-4250-b311-ddac2cea0b42 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1757 microversion: 2.1 time: 0.220853 Aug 03 03:04:50.117284 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3607/7092] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:49 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1757 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:51.138410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ddf475d1-c73f-47f0-98f4-61139b9422b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:51.139230 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ddf475d1-c73f-47f0-98f4-61139b9422b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:51.146964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ddf475d1-c73f-47f0-98f4-61139b9422b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:51.147503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ddf475d1-c73f-47f0-98f4-61139b9422b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:51.148385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ddf475d1-c73f-47f0-98f4-61139b9422b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:51.148896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ddf475d1-c73f-47f0-98f4-61139b9422b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:51.306976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ddf475d1-c73f-47f0-98f4-61139b9422b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:51.316001 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ddf475d1-c73f-47f0-98f4-61139b9422b9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1757 microversion: 2.1 time: 0.182172 Aug 03 03:04:51.316589 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3486/7093] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:51 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:52.339163 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2f5855af-82bf-46ae-baf5-19cb967f035b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:52.339730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2f5855af-82bf-46ae-baf5-19cb967f035b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:52.346814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f5855af-82bf-46ae-baf5-19cb967f035b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:52.347319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f5855af-82bf-46ae-baf5-19cb967f035b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:52.348102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f5855af-82bf-46ae-baf5-19cb967f035b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:52.348555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2f5855af-82bf-46ae-baf5-19cb967f035b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:52.495815 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2f5855af-82bf-46ae-baf5-19cb967f035b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:52.504157 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2f5855af-82bf-46ae-baf5-19cb967f035b tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1757 microversion: 2.1 time: 0.169192 Aug 03 03:04:52.504742 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3608/7094] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:52 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:53.526491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-075f1678-3e40-4798-a4d5-10aab8925fd4 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:53.527250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-075f1678-3e40-4798-a4d5-10aab8925fd4 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:53.535329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-075f1678-3e40-4798-a4d5-10aab8925fd4 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:53.535805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-075f1678-3e40-4798-a4d5-10aab8925fd4 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:53.536688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-075f1678-3e40-4798-a4d5-10aab8925fd4 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:53.537148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-075f1678-3e40-4798-a4d5-10aab8925fd4 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:53.683972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-075f1678-3e40-4798-a4d5-10aab8925fd4 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:53.692387 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-075f1678-3e40-4798-a4d5-10aab8925fd4 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1757 microversion: 2.1 time: 0.170101 Aug 03 03:04:53.692967 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3487/7095] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:53 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:54.713799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-363f4db1-5a77-4296-a039-4e8cefeaed2f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:54.714464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-363f4db1-5a77-4296-a039-4e8cefeaed2f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:54.722810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-363f4db1-5a77-4296-a039-4e8cefeaed2f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:54.723314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-363f4db1-5a77-4296-a039-4e8cefeaed2f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:54.724108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-363f4db1-5a77-4296-a039-4e8cefeaed2f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:54.724565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-363f4db1-5a77-4296-a039-4e8cefeaed2f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:54.869681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-363f4db1-5a77-4296-a039-4e8cefeaed2f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:54.878078 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-363f4db1-5a77-4296-a039-4e8cefeaed2f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1757 microversion: 2.1 time: 0.168169 Aug 03 03:04:54.878667 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3609/7096] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:54 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:55.902879 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ca20355f-608e-497a-97e4-ba16e75e8736 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:55.904731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ca20355f-608e-497a-97e4-ba16e75e8736 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:55.914229 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca20355f-608e-497a-97e4-ba16e75e8736 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:55.914686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca20355f-608e-497a-97e4-ba16e75e8736 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:55.915514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca20355f-608e-497a-97e4-ba16e75e8736 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:55.916718 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ca20355f-608e-497a-97e4-ba16e75e8736 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:56.081544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ca20355f-608e-497a-97e4-ba16e75e8736 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:56.093445 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ca20355f-608e-497a-97e4-ba16e75e8736 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1757 microversion: 2.1 time: 0.197049 Aug 03 03:04:56.094148 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3488/7097] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:55 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:57.117279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-83253206-45e3-4973-8c7a-727320a92f78 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:57.117919 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-83253206-45e3-4973-8c7a-727320a92f78 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:57.125659 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83253206-45e3-4973-8c7a-727320a92f78 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:57.126133 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83253206-45e3-4973-8c7a-727320a92f78 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:57.126943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83253206-45e3-4973-8c7a-727320a92f78 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:57.127400 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83253206-45e3-4973-8c7a-727320a92f78 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:57.272831 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-83253206-45e3-4973-8c7a-727320a92f78 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:57.281706 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-83253206-45e3-4973-8c7a-727320a92f78 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1757 microversion: 2.1 time: 0.168385 Aug 03 03:04:57.282289 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3610/7098] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:57 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:04:58.303733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1c0f525f-c5b5-486a-9713-429d8fbb096f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:04:58.304355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1c0f525f-c5b5-486a-9713-429d8fbb096f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:04:58.312119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c0f525f-c5b5-486a-9713-429d8fbb096f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:58.312579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c0f525f-c5b5-486a-9713-429d8fbb096f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:58.313366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c0f525f-c5b5-486a-9713-429d8fbb096f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:04:58.313819 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c0f525f-c5b5-486a-9713-429d8fbb096f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:04:58.466079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1c0f525f-c5b5-486a-9713-429d8fbb096f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:04:58.474395 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1c0f525f-c5b5-486a-9713-429d8fbb096f tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1760 microversion: 2.1 time: 0.174584 Aug 03 03:04:58.474990 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3489/7099] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:04:58 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1760 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:05:30.724001 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c37955b4-c052-4daa-9251-d315ef6262a6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1570264296"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:05:30.724615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c37955b4-c052-4daa-9251-d315ef6262a6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:05:30.727129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=12 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:05:30.727961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:05:30.733623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c37955b4-c052-4daa-9251-d315ef6262a6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:30.734101 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c37955b4-c052-4daa-9251-d315ef6262a6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:30.734918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c37955b4-c052-4daa-9251-d315ef6262a6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:30.735494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c37955b4-c052-4daa-9251-d315ef6262a6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:30.869181 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.network.security_group_api [None req-c37955b4-c052-4daa-9251-d315ef6262a6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Removing security group b130d691-9074-437d-b225-cd219983c6d0 from port 5841cec0-7bce-446e-86b4-d667a654aecc Aug 03 03:05:31.184953 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c37955b4-c052-4daa-9251-d315ef6262a6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "POST /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/action" status: 202 len: 0 microversion: 2.1 time: 0.465717 Aug 03 03:05:31.188770 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3611/7100] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:05:30 2022] POST /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:05:31.195391 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-3939818b-341d-47c9-b280-90f3d73de9be req-cae774a7-91bc-49e9-97af-6e7afd3dac05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d70b5a-dfa5-4672-9b60-45694d605f32", "tag": "5841cec0-7bce-446e-86b4-d667a654aecc"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:05:31.208488 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=12 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:05:31.210137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=36 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:05:31.213437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3939818b-341d-47c9-b280-90f3d73de9be req-cae774a7-91bc-49e9-97af-6e7afd3dac05 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:31.214305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3939818b-341d-47c9-b280-90f3d73de9be req-cae774a7-91bc-49e9-97af-6e7afd3dac05 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:31.232870 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-3939818b-341d-47c9-b280-90f3d73de9be req-cae774a7-91bc-49e9-97af-6e7afd3dac05 service nova] Creating event network-changed:5841cec0-7bce-446e-86b4-d667a654aecc for instance f0d70b5a-dfa5-4672-9b60-45694d605f32 on n-h2-826529-8 Aug 03 03:05:31.240104 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-3939818b-341d-47c9-b280-90f3d73de9be req-cae774a7-91bc-49e9-97af-6e7afd3dac05 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050389 Aug 03 03:05:31.242850 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3490/7101] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:05:32.576701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e44d4185-19df-4ab5-a228-5f58931a89f6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:05:32.577193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e44d4185-19df-4ab5-a228-5f58931a89f6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:05:32.579392 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-86c89474-a180-44e0-a90c-94c07478fd30 req-d9d45408-a77e-4336-b0c1-ef94193596f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d70b5a-dfa5-4672-9b60-45694d605f32", "tag": "5841cec0-7bce-446e-86b4-d667a654aecc"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:05:32.583874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e44d4185-19df-4ab5-a228-5f58931a89f6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:32.584340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e44d4185-19df-4ab5-a228-5f58931a89f6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:32.585127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e44d4185-19df-4ab5-a228-5f58931a89f6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:32.585572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e44d4185-19df-4ab5-a228-5f58931a89f6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:32.592931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-86c89474-a180-44e0-a90c-94c07478fd30 req-d9d45408-a77e-4336-b0c1-ef94193596f6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:32.594506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-86c89474-a180-44e0-a90c-94c07478fd30 req-d9d45408-a77e-4336-b0c1-ef94193596f6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:32.606964 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-86c89474-a180-44e0-a90c-94c07478fd30 req-d9d45408-a77e-4336-b0c1-ef94193596f6 service nova] Creating event network-changed:5841cec0-7bce-446e-86b4-d667a654aecc for instance f0d70b5a-dfa5-4672-9b60-45694d605f32 on n-h2-826529-8 Aug 03 03:05:32.613230 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-86c89474-a180-44e0-a90c-94c07478fd30 req-d9d45408-a77e-4336-b0c1-ef94193596f6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037963 Aug 03 03:05:32.614112 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3491/7102] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 03:05:32.680611 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-e44d4185-19df-4ab5-a228-5f58931a89f6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lazy-loading 'services' on Instance uuid f0d70b5a-dfa5-4672-9b60-45694d605f32 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 03:05:32.777777 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e44d4185-19df-4ab5-a228-5f58931a89f6 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments/e8bc279f-9b65-406d-93ce-0835755cda56" status: 202 len: 0 microversion: 2.1 time: 0.205956 Aug 03 03:05:32.778534 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3612/7103] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 03:05:32 2022] DELETE /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments/e8bc279f-9b65-406d-93ce-0835755cda56 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:05:32.788711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9eeabcb2-120e-4aee-aa72-230da73dc2d7 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:05:32.791543 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9eeabcb2-120e-4aee-aa72-230da73dc2d7 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:05:32.799993 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9eeabcb2-120e-4aee-aa72-230da73dc2d7 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:32.800880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9eeabcb2-120e-4aee-aa72-230da73dc2d7 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:32.801985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9eeabcb2-120e-4aee-aa72-230da73dc2d7 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:32.802674 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9eeabcb2-120e-4aee-aa72-230da73dc2d7 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:32.868317 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9eeabcb2-120e-4aee-aa72-230da73dc2d7 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084826 Aug 03 03:05:32.869224 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3492/7104] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 03:05:32 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:05:33.883326 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-90ac77b7-9cf2-4e79-9326-67a1b69e2057 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:05:33.885607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-90ac77b7-9cf2-4e79-9326-67a1b69e2057 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:05:33.892651 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90ac77b7-9cf2-4e79-9326-67a1b69e2057 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:33.893142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90ac77b7-9cf2-4e79-9326-67a1b69e2057 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:33.894014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90ac77b7-9cf2-4e79-9326-67a1b69e2057 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:33.894467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-90ac77b7-9cf2-4e79-9326-67a1b69e2057 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:33.925520 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-90ac77b7-9cf2-4e79-9326-67a1b69e2057 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048302 Aug 03 03:05:33.926090 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3613/7105] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 03:05:33 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:05:34.940446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0d6ce367-3cbe-4ca5-9e29-3dba70bf4c6e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:05:34.943462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0d6ce367-3cbe-4ca5-9e29-3dba70bf4c6e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:05:34.951410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d6ce367-3cbe-4ca5-9e29-3dba70bf4c6e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:34.951869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d6ce367-3cbe-4ca5-9e29-3dba70bf4c6e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:34.952669 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d6ce367-3cbe-4ca5-9e29-3dba70bf4c6e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:34.953103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d6ce367-3cbe-4ca5-9e29-3dba70bf4c6e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:34.986145 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0d6ce367-3cbe-4ca5-9e29-3dba70bf4c6e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051416 Aug 03 03:05:34.987121 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3493/7106] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 03:05:34 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:05:35.999199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2db6753-d711-4b9b-bef3-e0a8a3bc3ade tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:05:36.001363 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c2db6753-d711-4b9b-bef3-e0a8a3bc3ade tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:05:36.011012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2db6753-d711-4b9b-bef3-e0a8a3bc3ade tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:36.011486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2db6753-d711-4b9b-bef3-e0a8a3bc3ade tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:36.012301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2db6753-d711-4b9b-bef3-e0a8a3bc3ade tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:36.012759 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2db6753-d711-4b9b-bef3-e0a8a3bc3ade tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:36.043198 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c2db6753-d711-4b9b-bef3-e0a8a3bc3ade tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048119 Aug 03 03:05:36.043782 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3614/7107] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 03:05:35 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:05:37.057240 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1a3aea7f-7a84-44aa-aced-e9c3ccf3bae2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:05:37.059491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1a3aea7f-7a84-44aa-aced-e9c3ccf3bae2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:05:37.066278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a3aea7f-7a84-44aa-aced-e9c3ccf3bae2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:37.066740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a3aea7f-7a84-44aa-aced-e9c3ccf3bae2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:37.067562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a3aea7f-7a84-44aa-aced-e9c3ccf3bae2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:37.068008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a3aea7f-7a84-44aa-aced-e9c3ccf3bae2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:37.099237 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1a3aea7f-7a84-44aa-aced-e9c3ccf3bae2 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046939 Aug 03 03:05:37.099820 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3494/7108] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 03:05:37 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:05:38.112298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-77df2c51-46bf-4a22-905b-acc9979032b8 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:05:38.114623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-77df2c51-46bf-4a22-905b-acc9979032b8 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:05:38.121801 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77df2c51-46bf-4a22-905b-acc9979032b8 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:38.122356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77df2c51-46bf-4a22-905b-acc9979032b8 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:38.123290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77df2c51-46bf-4a22-905b-acc9979032b8 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:38.123747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-77df2c51-46bf-4a22-905b-acc9979032b8 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:38.154140 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-77df2c51-46bf-4a22-905b-acc9979032b8 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046461 Aug 03 03:05:38.154710 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3615/7109] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 3 03:05:38 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 03:05:38.165683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b1fa334b-7031-43c6-a371-cdc8c6d618bd tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:05:38.166193 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b1fa334b-7031-43c6-a371-cdc8c6d618bd tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:05:38.173284 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1fa334b-7031-43c6-a371-cdc8c6d618bd tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:38.174330 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1fa334b-7031-43c6-a371-cdc8c6d618bd tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:38.175388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1fa334b-7031-43c6-a371-cdc8c6d618bd tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:38.175844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b1fa334b-7031-43c6-a371-cdc8c6d618bd tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:38.256489 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-b1fa334b-7031-43c6-a371-cdc8c6d618bd tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] HTTP exception thrown: Instance f0d70b5a-dfa5-4672-9b60-45694d605f32 is not attached to volume e8bc279f-9b65-406d-93ce-0835755cda56 Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b1fa334b-7031-43c6-a371-cdc8c6d618bd tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Request method failure captured: Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: request: DELETE /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments/e8bc279f-9b65-406d-93ce-0835755cda56 HTTP/1.1 Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eSgIgM-Om_9yCABAhPylJCSN1OsUZ1V19pEPDyjvxqqo8MXwXBlz1VLD6WjoKTlfkoCkVOSrDiSyB19X0HVQbAkgu0fU_8hcLAVHcP7paNZexXAWCR3G-oE3FvuR3i8fuYCHl_hiYJ7ewDzbbYVlLvmgB2wT6PwPXd3U-YCHzIauaY Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c56b09fee41d40f085aed568f06d0ff7 Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestMinimumBasicScenario-1349369688 Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c56b09fee41d40f085aed568f06d0ff7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c56b09fee41d40f085aed568f06d0ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c56b09fee41d40f085aed568f06d0ff7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c56b09fee41d40f085aed568f06d0ff7"}]}] Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestMinimumBasicScenario-1349369688 Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c56b09fee41d40f085aed568f06d0ff7 Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1349369688 Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestMinimumBasicScenario-1349369688-project Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 10f727693d764715ad413026021a1a8b Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestMinimumBasicScenario-1349369688-project Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance f0d70b5a-dfa5-4672-9b60-45694d605f32 is not attached to volume e8bc279f-9b65-406d-93ce-0835755cda56 Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'server_id': 'f0d70b5a-dfa5-4672-9b60-45694d605f32', 'id': 'e8bc279f-9b65-406d-93ce-0835755cda56'} Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e8bc279f-9b65-406d-93ce-0835755cda56. Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0d70b5a-dfa5-4672-9b60-45694d605f32 is not attached to volume e8bc279f-9b65-406d-93ce-0835755cda56 Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:05:38.258214 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:05:38.262527 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 03:05:38.262527 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 03:05:38.262527 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0d70b5a-dfa5-4672-9b60-45694d605f32 is not attached to volume e8bc279f-9b65-406d-93ce-0835755cda56 Aug 03 03:05:38.262527 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:05:38.262527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b1fa334b-7031-43c6-a371-cdc8c6d618bd tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Returning 404 to user: Instance f0d70b5a-dfa5-4672-9b60-45694d605f32 is not attached to volume e8bc279f-9b65-406d-93ce-0835755cda56 {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 03:05:38.262527 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b1fa334b-7031-43c6-a371-cdc8c6d618bd tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments/e8bc279f-9b65-406d-93ce-0835755cda56" status: 404 len: 154 microversion: 2.1 time: 0.098277 Aug 03 03:05:38.262527 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3495/7110] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 3 03:05:38 2022] DELETE /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32/os-volume_attachments/e8bc279f-9b65-406d-93ce-0835755cda56 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 03:05:41.515238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c5fc7ff8-b413-4d50-b9e0-8e4dbcfd75e9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:05:41.515806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5fc7ff8-b413-4d50-b9e0-8e4dbcfd75e9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:05:41.525176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5fc7ff8-b413-4d50-b9e0-8e4dbcfd75e9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:41.525647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5fc7ff8-b413-4d50-b9e0-8e4dbcfd75e9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:41.526446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5fc7ff8-b413-4d50-b9e0-8e4dbcfd75e9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:41.526923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c5fc7ff8-b413-4d50-b9e0-8e4dbcfd75e9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:41.555722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c5fc7ff8-b413-4d50-b9e0-8e4dbcfd75e9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 03:05:41.633755 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c5fc7ff8-b413-4d50-b9e0-8e4dbcfd75e9 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 204 len: 0 microversion: 2.1 time: 0.122054 Aug 03 03:05:41.634269 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3616/7111] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 03:05:41 2022] DELETE /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 03:05:41.643353 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-541ef992-5956-45d0-b2eb-4c225d2d6f48 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:05:41.644064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-541ef992-5956-45d0-b2eb-4c225d2d6f48 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:05:41.651903 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-541ef992-5956-45d0-b2eb-4c225d2d6f48 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:41.652448 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-541ef992-5956-45d0-b2eb-4c225d2d6f48 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:41.653335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-541ef992-5956-45d0-b2eb-4c225d2d6f48 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:41.653858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-541ef992-5956-45d0-b2eb-4c225d2d6f48 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:41.796563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-541ef992-5956-45d0-b2eb-4c225d2d6f48 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:05:41.804866 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-541ef992-5956-45d0-b2eb-4c225d2d6f48 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1554 microversion: 2.1 time: 0.166225 Aug 03 03:05:41.805455 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3496/7112] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:05:41 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:05:42.827335 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2eb7855f-988d-4d69-82eb-50f3f7694d03 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:05:42.828057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2eb7855f-988d-4d69-82eb-50f3f7694d03 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:05:42.839412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2eb7855f-988d-4d69-82eb-50f3f7694d03 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:42.839889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2eb7855f-988d-4d69-82eb-50f3f7694d03 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:42.840692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2eb7855f-988d-4d69-82eb-50f3f7694d03 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:42.841151 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2eb7855f-988d-4d69-82eb-50f3f7694d03 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:42.982141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2eb7855f-988d-4d69-82eb-50f3f7694d03 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:05:42.990090 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2eb7855f-988d-4d69-82eb-50f3f7694d03 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1554 microversion: 2.1 time: 0.167131 Aug 03 03:05:42.990675 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3617/7113] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:05:42 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:05:44.016935 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-aa20f2b2-3837-478a-b2bb-3354c4dc5dfe tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:05:44.018437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-aa20f2b2-3837-478a-b2bb-3354c4dc5dfe tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:05:44.029814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa20f2b2-3837-478a-b2bb-3354c4dc5dfe tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:44.030271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa20f2b2-3837-478a-b2bb-3354c4dc5dfe tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:44.031253 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa20f2b2-3837-478a-b2bb-3354c4dc5dfe tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:44.032061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-aa20f2b2-3837-478a-b2bb-3354c4dc5dfe tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:44.126079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-aa20f2b2-3837-478a-b2bb-3354c4dc5dfe tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f727693d764715ad413026021a1a8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56b09fee41d40f085aed568f06d0ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:05:44.134239 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-aa20f2b2-3837-478a-b2bb-3354c4dc5dfe tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 200 len: 1512 microversion: 2.1 time: 0.126156 Aug 03 03:05:44.135180 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3497/7114] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:05:44 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 1512 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:05:44.193088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-b160b012-8138-4f83-ac42-2e0c76ee01eb req-246eb90f-e298-498c-a016-71c7aaee6b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d70b5a-dfa5-4672-9b60-45694d605f32", "name": "network-vif-deleted", "tag": "5841cec0-7bce-446e-86b4-d667a654aecc"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:05:44.204402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b160b012-8138-4f83-ac42-2e0c76ee01eb req-246eb90f-e298-498c-a016-71c7aaee6b9b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:44.204893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b160b012-8138-4f83-ac42-2e0c76ee01eb req-246eb90f-e298-498c-a016-71c7aaee6b9b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:44.218112 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-b160b012-8138-4f83-ac42-2e0c76ee01eb req-246eb90f-e298-498c-a016-71c7aaee6b9b service nova] Creating event network-vif-deleted:5841cec0-7bce-446e-86b4-d667a654aecc for instance f0d70b5a-dfa5-4672-9b60-45694d605f32 on n-h2-826529-8 Aug 03 03:05:44.225518 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-b160b012-8138-4f83-ac42-2e0c76ee01eb req-246eb90f-e298-498c-a016-71c7aaee6b9b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104371 Aug 03 03:05:44.226125 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3618/7115] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 03:05:45.157927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-46d50b5e-e1c4-44ef-bb55-0d34e9610ab1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:05:45.158808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-46d50b5e-e1c4-44ef-bb55-0d34e9610ab1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] [instance: f0d70b5a-dfa5-4672-9b60-45694d605f32] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:05:45.166388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46d50b5e-e1c4-44ef-bb55-0d34e9610ab1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:45.166842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46d50b5e-e1c4-44ef-bb55-0d34e9610ab1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:45.167654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46d50b5e-e1c4-44ef-bb55-0d34e9610ab1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:05:45.168092 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-46d50b5e-e1c4-44ef-bb55-0d34e9610ab1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:05:45.182730 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-46d50b5e-e1c4-44ef-bb55-0d34e9610ab1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] HTTP exception thrown: Instance f0d70b5a-dfa5-4672-9b60-45694d605f32 could not be found. Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-46d50b5e-e1c4-44ef-bb55-0d34e9610ab1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Request method failure captured: Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 HTTP/1.1 Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eSgIgM-Om_9yCABAhPylJCSN1OsUZ1V19pEPDyjvxqqo8MXwXBlz1VLD6WjoKTlfkoCkVOSrDiSyB19X0HVQbAkgu0fU_8hcLAVHcP7paNZexXAWCR3G-oE3FvuR3i8fuYCHl_hiYJ7ewDzbbYVlLvmgB2wT6PwPXd3U-YCHzIauaY Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c56b09fee41d40f085aed568f06d0ff7 Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestMinimumBasicScenario-1349369688 Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c56b09fee41d40f085aed568f06d0ff7", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c56b09fee41d40f085aed568f06d0ff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c56b09fee41d40f085aed568f06d0ff7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c56b09fee41d40f085aed568f06d0ff7"}]}] Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestMinimumBasicScenario-1349369688 Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c56b09fee41d40f085aed568f06d0ff7 Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1349369688 Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestMinimumBasicScenario-1349369688-project Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 10f727693d764715ad413026021a1a8b Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestMinimumBasicScenario-1349369688-project Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance f0d70b5a-dfa5-4672-9b60-45694d605f32 could not be found. Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': 'f0d70b5a-dfa5-4672-9b60-45694d605f32'} Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0d70b5a-dfa5-4672-9b60-45694d605f32 could not be found. Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0d70b5a-dfa5-4672-9b60-45694d605f32 could not be found. Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:05:45.184309 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:05:45.188916 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:05:45.188916 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:05:45.188916 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:05:45.188916 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 03:05:45.188916 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 03:05:45.188916 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0d70b5a-dfa5-4672-9b60-45694d605f32 could not be found. Aug 03 03:05:45.188916 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:05:45.188916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-46d50b5e-e1c4-44ef-bb55-0d34e9610ab1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Returning 404 to user: Instance f0d70b5a-dfa5-4672-9b60-45694d605f32 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 03:05:45.188916 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-46d50b5e-e1c4-44ef-bb55-0d34e9610ab1 tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32" status: 404 len: 111 microversion: 2.1 time: 0.031830 Aug 03 03:05:45.188916 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3498/7116] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:05:45 2022] GET /compute/v2.1/servers/f0d70b5a-dfa5-4672-9b60-45694d605f32 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 03:05:45.198288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-82d53869-551d-48b9-8770-425308274c3e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] Calling method '.version_select at 0x7f5b129f0af0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:05:45.224033 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-82d53869-551d-48b9-8770-425308274c3e tempest-TestMinimumBasicScenario-1349369688 tempest-TestMinimumBasicScenario-1349369688-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-186706266" status: 202 len: 0 microversion: 2.1 time: 0.031703 Aug 03 03:05:45.224611 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3619/7117] 10.222.0.67 () {58 vars in 1269 bytes} [Wed Aug 3 03:05:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-186706266 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:05:54.723463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-113a7feb-4234-4063-869b-5b14aba78eeb tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'create', calling method: .version_select at 0x7f5b13dd2550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2067844353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtMs4+7LFpBA3ZG/VY+X4oaZprAWll1EryAZYcvzXotOL3TlCQgd1FLSPLmwyz0FKcLm993JMh+gU86ZNPg5QEU4TlunBF8dIRu/LTqbVMj+Ot/Tq53rRmgd1rEDYGrsg=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:05:54.741231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-113a7feb-4234-4063-869b-5b14aba78eeb tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for project c54093784aa14146bb025b41f7ce4067. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:05:54.748166 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-113a7feb-4234-4063-869b-5b14aba78eeb tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for user 44df218d187c46489bad965cd6d0266a and project c54093784aa14146bb025b41f7ce4067. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:05:54.777265 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-113a7feb-4234-4063-869b-5b14aba78eeb tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.227466 Aug 03 03:05:54.777886 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3499/7118] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 03:05:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:06:01.275830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1327950526", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "e7687e37-3425-4e85-86a8-12b952813bd1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2067844353", "security_groups": [{"name": "tempest-secgroup-smoke-503095921"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:06:01.289116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:06:01.290053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:06:01.418629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] validate_networks() for [('e7687e37-3425-4e85-86a8-12b952813bd1', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 03:06:01.916442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 03:06:01.917021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 03:06:01.917473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 03:06:01.918081 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 03:06:01.918515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 03:06:01.932537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:01.933066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:01.933907 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:01.934349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:01.955033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for project c54093784aa14146bb025b41f7ce4067. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:06:01.961199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for user 44df218d187c46489bad965cd6d0266a and project c54093784aa14146bb025b41f7ce4067. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:06:01.976465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 03:06:01.981990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 03:06:02.030964 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-583e6e22-7f5f-470b-ab19-94ce7d337742 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.759183 Aug 03 03:06:02.032266 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3620/7119] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 03:06:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 03:06:02.040173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=42 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:06:02.045905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-15296bb7-840c-4eef-8c0d-0fbf3edf59bc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:02.046545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-15296bb7-840c-4eef-8c0d-0fbf3edf59bc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:02.053984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:06:02.120562 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-15296bb7-840c-4eef-8c0d-0fbf3edf59bc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:02.128469 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-15296bb7-840c-4eef-8c0d-0fbf3edf59bc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1267 microversion: 2.1 time: 0.089266 Aug 03 03:06:02.129268 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3500/7120] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:02 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:06:03.153176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9354b3fe-268b-4252-a4e6-ce03c2c9f2bc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:03.153816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9354b3fe-268b-4252-a4e6-ce03c2c9f2bc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:03.214636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9354b3fe-268b-4252-a4e6-ce03c2c9f2bc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:03.223991 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9354b3fe-268b-4252-a4e6-ce03c2c9f2bc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1267 microversion: 2.1 time: 0.075124 Aug 03 03:06:03.224599 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3621/7121] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:03 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1267 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:04.246420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cb4dd9c7-7fd7-40bd-86df-58ac47513949 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:04.247075 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cb4dd9c7-7fd7-40bd-86df-58ac47513949 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:04.307302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cb4dd9c7-7fd7-40bd-86df-58ac47513949 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:04.316436 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cb4dd9c7-7fd7-40bd-86df-58ac47513949 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1267 microversion: 2.1 time: 0.074108 Aug 03 03:06:04.317038 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3501/7122] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:04 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1267 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:05.336413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f1cdd0db-6064-4bc1-bb06-fe7c56864737 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:05.337071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f1cdd0db-6064-4bc1-bb06-fe7c56864737 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:05.392607 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f1cdd0db-6064-4bc1-bb06-fe7c56864737 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:05.399795 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f1cdd0db-6064-4bc1-bb06-fe7c56864737 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1267 microversion: 2.1 time: 0.067357 Aug 03 03:06:05.400383 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3622/7123] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:05 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1267 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:06.421239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-247f5703-6f9c-4066-a40b-3730ca42e4d0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:06.421864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-247f5703-6f9c-4066-a40b-3730ca42e4d0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:06.429535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-247f5703-6f9c-4066-a40b-3730ca42e4d0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:06.430000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-247f5703-6f9c-4066-a40b-3730ca42e4d0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:06.430798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-247f5703-6f9c-4066-a40b-3730ca42e4d0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:06.431286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-247f5703-6f9c-4066-a40b-3730ca42e4d0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:06.496390 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-247f5703-6f9c-4066-a40b-3730ca42e4d0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:06.504652 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-247f5703-6f9c-4066-a40b-3730ca42e4d0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1271 microversion: 2.1 time: 0.087453 Aug 03 03:06:06.505222 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3502/7124] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:06 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:07.525381 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-158055bd-9ae0-4677-a32d-9dac0e3ea640 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:07.526702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-158055bd-9ae0-4677-a32d-9dac0e3ea640 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:07.535635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-158055bd-9ae0-4677-a32d-9dac0e3ea640 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:07.536102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-158055bd-9ae0-4677-a32d-9dac0e3ea640 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:07.537117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-158055bd-9ae0-4677-a32d-9dac0e3ea640 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:07.537574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-158055bd-9ae0-4677-a32d-9dac0e3ea640 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:07.602531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-158055bd-9ae0-4677-a32d-9dac0e3ea640 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:07.610375 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-158055bd-9ae0-4677-a32d-9dac0e3ea640 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1325 microversion: 2.1 time: 0.088998 Aug 03 03:06:07.610979 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3623/7125] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:07 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1325 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:08.506338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-4056ef7c-a551-4f4c-b1c8-17659991b280 req-09f518de-ac48-4b3a-8646-b996328b0d6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c0e7ea8-aade-4273-a5ca-ffec7bfacb07", "tag": "a3a4b753-016f-4a46-8966-8cf2a23af736"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:06:08.517183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4056ef7c-a551-4f4c-b1c8-17659991b280 req-09f518de-ac48-4b3a-8646-b996328b0d6d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:08.518768 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4056ef7c-a551-4f4c-b1c8-17659991b280 req-09f518de-ac48-4b3a-8646-b996328b0d6d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:08.531186 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-4056ef7c-a551-4f4c-b1c8-17659991b280 req-09f518de-ac48-4b3a-8646-b996328b0d6d service nova] Creating event network-changed:a3a4b753-016f-4a46-8966-8cf2a23af736 for instance 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 on n-h1-826529-8 Aug 03 03:06:08.537538 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-4056ef7c-a551-4f4c-b1c8-17659991b280 req-09f518de-ac48-4b3a-8646-b996328b0d6d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036265 Aug 03 03:06:08.538160 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3503/7126] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:06:08.633433 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9dfaad23-3968-409d-9d0c-485938797f32 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:08.634075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9dfaad23-3968-409d-9d0c-485938797f32 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:08.641895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dfaad23-3968-409d-9d0c-485938797f32 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:08.642427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dfaad23-3968-409d-9d0c-485938797f32 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:08.643799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dfaad23-3968-409d-9d0c-485938797f32 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:08.644258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9dfaad23-3968-409d-9d0c-485938797f32 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:08.784813 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9dfaad23-3968-409d-9d0c-485938797f32 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:08.792687 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9dfaad23-3968-409d-9d0c-485938797f32 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1392 microversion: 2.1 time: 0.163319 Aug 03 03:06:08.793274 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3624/7127] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:08 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:09.816205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9a9532c1-a3f8-4630-9d19-454ec77c5a08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:09.816923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9a9532c1-a3f8-4630-9d19-454ec77c5a08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:09.823335 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a9532c1-a3f8-4630-9d19-454ec77c5a08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:09.823790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a9532c1-a3f8-4630-9d19-454ec77c5a08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:09.824577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a9532c1-a3f8-4630-9d19-454ec77c5a08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:09.825019 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9a9532c1-a3f8-4630-9d19-454ec77c5a08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:09.960025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9a9532c1-a3f8-4630-9d19-454ec77c5a08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:09.967745 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9a9532c1-a3f8-4630-9d19-454ec77c5a08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1392 microversion: 2.1 time: 0.156791 Aug 03 03:06:09.968326 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3504/7128] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:09 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:10.990597 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c52b4eae-1f1b-4cfe-9e1a-2f3fa5e77777 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:10.991286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c52b4eae-1f1b-4cfe-9e1a-2f3fa5e77777 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:10.998327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c52b4eae-1f1b-4cfe-9e1a-2f3fa5e77777 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:10.998738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c52b4eae-1f1b-4cfe-9e1a-2f3fa5e77777 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:10.999582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c52b4eae-1f1b-4cfe-9e1a-2f3fa5e77777 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:11.000029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c52b4eae-1f1b-4cfe-9e1a-2f3fa5e77777 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:11.137258 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c52b4eae-1f1b-4cfe-9e1a-2f3fa5e77777 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:11.145255 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c52b4eae-1f1b-4cfe-9e1a-2f3fa5e77777 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1392 microversion: 2.1 time: 0.159279 Aug 03 03:06:11.145842 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3625/7129] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:10 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:12.167801 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6a2013d2-b62a-471c-aa4f-5b52298d79a3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:12.168427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6a2013d2-b62a-471c-aa4f-5b52298d79a3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:12.179566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a2013d2-b62a-471c-aa4f-5b52298d79a3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:12.180024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a2013d2-b62a-471c-aa4f-5b52298d79a3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:12.180809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a2013d2-b62a-471c-aa4f-5b52298d79a3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:12.181260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6a2013d2-b62a-471c-aa4f-5b52298d79a3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:12.313804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6a2013d2-b62a-471c-aa4f-5b52298d79a3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:12.322285 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6a2013d2-b62a-471c-aa4f-5b52298d79a3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1392 microversion: 2.1 time: 0.158555 Aug 03 03:06:12.322858 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3505/7130] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:12 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:13.343382 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8ae4f53a-7374-4631-9e26-d913b92ef9d8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:13.343988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8ae4f53a-7374-4631-9e26-d913b92ef9d8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:13.346501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:06:13.353174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ae4f53a-7374-4631-9e26-d913b92ef9d8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:13.353650 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ae4f53a-7374-4631-9e26-d913b92ef9d8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:13.354459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ae4f53a-7374-4631-9e26-d913b92ef9d8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:13.354939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8ae4f53a-7374-4631-9e26-d913b92ef9d8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:13.502806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8ae4f53a-7374-4631-9e26-d913b92ef9d8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:13.510498 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8ae4f53a-7374-4631-9e26-d913b92ef9d8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1392 microversion: 2.1 time: 0.171211 Aug 03 03:06:13.511120 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3626/7131] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:13 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:14.531011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3da6afc7-42b0-426b-ba43-8023de53ea5c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:14.531635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3da6afc7-42b0-426b-ba43-8023de53ea5c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:14.535478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=8 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:06:14.541251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3da6afc7-42b0-426b-ba43-8023de53ea5c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:14.541713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3da6afc7-42b0-426b-ba43-8023de53ea5c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:14.542501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3da6afc7-42b0-426b-ba43-8023de53ea5c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:14.542983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3da6afc7-42b0-426b-ba43-8023de53ea5c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:14.684012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3da6afc7-42b0-426b-ba43-8023de53ea5c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:14.692329 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3da6afc7-42b0-426b-ba43-8023de53ea5c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1392 microversion: 2.1 time: 0.165289 Aug 03 03:06:14.692912 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3506/7132] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:14 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:14.991511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-54d6a30f-574e-4edb-9b3f-632f305e6131 req-1a062875-0ec1-488f-9c1a-55731abcfec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0e7ea8-aade-4273-a5ca-ffec7bfacb07", "name": "network-vif-plugged", "status": "completed", "tag": "a3a4b753-016f-4a46-8966-8cf2a23af736"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:06:15.003147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-54d6a30f-574e-4edb-9b3f-632f305e6131 req-1a062875-0ec1-488f-9c1a-55731abcfec6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:15.003644 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-54d6a30f-574e-4edb-9b3f-632f305e6131 req-1a062875-0ec1-488f-9c1a-55731abcfec6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:15.016574 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-54d6a30f-574e-4edb-9b3f-632f305e6131 req-1a062875-0ec1-488f-9c1a-55731abcfec6 service nova] Creating event network-vif-plugged:a3a4b753-016f-4a46-8966-8cf2a23af736 for instance 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 on n-h1-826529-8 Aug 03 03:06:15.022758 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-54d6a30f-574e-4edb-9b3f-632f305e6131 req-1a062875-0ec1-488f-9c1a-55731abcfec6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034882 Aug 03 03:06:15.023609 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3627/7133] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:06:15.713004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-43151a96-77fa-4c80-97f3-6a01b76e4518 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:15.713699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-43151a96-77fa-4c80-97f3-6a01b76e4518 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:15.722596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43151a96-77fa-4c80-97f3-6a01b76e4518 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:15.723217 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43151a96-77fa-4c80-97f3-6a01b76e4518 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:15.724093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43151a96-77fa-4c80-97f3-6a01b76e4518 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:15.724624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-43151a96-77fa-4c80-97f3-6a01b76e4518 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:15.861382 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-43151a96-77fa-4c80-97f3-6a01b76e4518 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:15.869630 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-43151a96-77fa-4c80-97f3-6a01b76e4518 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1392 microversion: 2.1 time: 0.161037 Aug 03 03:06:15.870204 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3507/7134] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:15 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:16.890694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=10 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:06:16.897129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-23e30d47-ceec-4fff-8ddb-623ef0e1106f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:16.898146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-23e30d47-ceec-4fff-8ddb-623ef0e1106f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:16.904741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23e30d47-ceec-4fff-8ddb-623ef0e1106f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:16.905206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23e30d47-ceec-4fff-8ddb-623ef0e1106f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:16.905987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23e30d47-ceec-4fff-8ddb-623ef0e1106f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:16.906439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-23e30d47-ceec-4fff-8ddb-623ef0e1106f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:17.049656 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-23e30d47-ceec-4fff-8ddb-623ef0e1106f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:17.057495 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-23e30d47-ceec-4fff-8ddb-623ef0e1106f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1564 microversion: 2.1 time: 0.167718 Aug 03 03:06:17.058071 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3628/7135] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:16 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:17.078198 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8537a1c-861e-4042-991e-a12d2bb92707 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:17.078853 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b8537a1c-861e-4042-991e-a12d2bb92707 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:17.087161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8537a1c-861e-4042-991e-a12d2bb92707 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:17.087626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8537a1c-861e-4042-991e-a12d2bb92707 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:17.088414 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8537a1c-861e-4042-991e-a12d2bb92707 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:17.088863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8537a1c-861e-4042-991e-a12d2bb92707 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:17.221740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b8537a1c-861e-4042-991e-a12d2bb92707 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:17.229414 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b8537a1c-861e-4042-991e-a12d2bb92707 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1564 microversion: 2.1 time: 0.155241 Aug 03 03:06:17.229992 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3508/7136] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:17 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:19.108505 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1b4c19d4-d472-4c98-ba5c-13644afc9d9e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:19.109316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1b4c19d4-d472-4c98-ba5c-13644afc9d9e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:19.111864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-56de99dd-cb53-4b0b-9dcc-0ce3b714f4cf req-c4159158-07bf-4257-8f9b-e5e0eedc1817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c0e7ea8-aade-4273-a5ca-ffec7bfacb07", "tag": "a3a4b753-016f-4a46-8966-8cf2a23af736"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:06:19.116981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b4c19d4-d472-4c98-ba5c-13644afc9d9e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:19.117446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b4c19d4-d472-4c98-ba5c-13644afc9d9e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:19.118243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b4c19d4-d472-4c98-ba5c-13644afc9d9e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:19.118691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b4c19d4-d472-4c98-ba5c-13644afc9d9e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:19.126519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-56de99dd-cb53-4b0b-9dcc-0ce3b714f4cf req-c4159158-07bf-4257-8f9b-e5e0eedc1817 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:19.127630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-56de99dd-cb53-4b0b-9dcc-0ce3b714f4cf req-c4159158-07bf-4257-8f9b-e5e0eedc1817 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:19.139841 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-56de99dd-cb53-4b0b-9dcc-0ce3b714f4cf req-c4159158-07bf-4257-8f9b-e5e0eedc1817 service nova] Creating event network-changed:a3a4b753-016f-4a46-8966-8cf2a23af736 for instance 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 on n-h1-826529-8 Aug 03 03:06:19.146453 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-56de99dd-cb53-4b0b-9dcc-0ce3b714f4cf req-c4159158-07bf-4257-8f9b-e5e0eedc1817 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038887 Aug 03 03:06:19.146740 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3509/7137] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:06:19.271571 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1b4c19d4-d472-4c98-ba5c-13644afc9d9e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:19.279322 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1b4c19d4-d472-4c98-ba5c-13644afc9d9e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1564 microversion: 2.1 time: 0.174928 Aug 03 03:06:19.280119 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3629/7138] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:19 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:42.536967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=23 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:06:42.537717 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=40 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:06:42.542406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-45b2c61e-1327-4326-bd3b-f044d11a3a8a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:06:42.544793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-45b2c61e-1327-4326-bd3b-f044d11a3a8a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:42.553199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45b2c61e-1327-4326-bd3b-f044d11a3a8a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:42.553662 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45b2c61e-1327-4326-bd3b-f044d11a3a8a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:42.554447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45b2c61e-1327-4326-bd3b-f044d11a3a8a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:42.554887 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-45b2c61e-1327-4326-bd3b-f044d11a3a8a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:42.607607 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-45b2c61e-1327-4326-bd3b-f044d11a3a8a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07/action" status: 200 len: 24572 microversion: 2.1 time: 0.072670 Aug 03 03:06:42.615653 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3510/7139] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:06:42 2022] POST /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07/action => generated 24572 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 03:06:53.720115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9747f89c-532b-4159-bf3a-78e53d1e4be2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:06:53.721230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9747f89c-532b-4159-bf3a-78e53d1e4be2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:53.724056 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:06:53.724746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=40 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:06:53.731556 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9747f89c-532b-4159-bf3a-78e53d1e4be2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:53.732028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9747f89c-532b-4159-bf3a-78e53d1e4be2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:53.732822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9747f89c-532b-4159-bf3a-78e53d1e4be2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:53.733277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9747f89c-532b-4159-bf3a-78e53d1e4be2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:53.806722 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9747f89c-532b-4159-bf3a-78e53d1e4be2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07/action" status: 202 len: 0 microversion: 2.1 time: 0.090530 Aug 03 03:06:53.807493 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3630/7140] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:06:53 2022] POST /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:06:53.817076 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cbca1858-aa2f-44d7-bba7-4d376e37c6be tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:53.817800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cbca1858-aa2f-44d7-bba7-4d376e37c6be tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:53.820756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:06:53.821630 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=4 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:06:53.830825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cbca1858-aa2f-44d7-bba7-4d376e37c6be tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:53.831324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cbca1858-aa2f-44d7-bba7-4d376e37c6be tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:53.832160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cbca1858-aa2f-44d7-bba7-4d376e37c6be tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:53.833137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cbca1858-aa2f-44d7-bba7-4d376e37c6be tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:53.980007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cbca1858-aa2f-44d7-bba7-4d376e37c6be tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:53.989278 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cbca1858-aa2f-44d7-bba7-4d376e37c6be tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1687 microversion: 2.1 time: 0.176816 Aug 03 03:06:53.989875 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3511/7141] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:53 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:55.013709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-463c03b8-41fe-4b34-b9e9-b6e8b2c49611 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:55.014346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-463c03b8-41fe-4b34-b9e9-b6e8b2c49611 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:55.021882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-463c03b8-41fe-4b34-b9e9-b6e8b2c49611 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:55.022354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-463c03b8-41fe-4b34-b9e9-b6e8b2c49611 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:55.023192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-463c03b8-41fe-4b34-b9e9-b6e8b2c49611 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:55.023688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-463c03b8-41fe-4b34-b9e9-b6e8b2c49611 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:55.156908 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-463c03b8-41fe-4b34-b9e9-b6e8b2c49611 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:55.165281 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-463c03b8-41fe-4b34-b9e9-b6e8b2c49611 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1667 microversion: 2.1 time: 0.157010 Aug 03 03:06:55.165865 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3631/7142] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:55 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:56.264452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-55babbc0-1ada-410a-aa07-6aa1b036e5f2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:06:56.266664 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-55babbc0-1ada-410a-aa07-6aa1b036e5f2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:56.275156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55babbc0-1ada-410a-aa07-6aa1b036e5f2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:56.275623 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55babbc0-1ada-410a-aa07-6aa1b036e5f2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:56.276425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55babbc0-1ada-410a-aa07-6aa1b036e5f2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:56.277221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-55babbc0-1ada-410a-aa07-6aa1b036e5f2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:56.331417 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-55babbc0-1ada-410a-aa07-6aa1b036e5f2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07/action" status: 200 len: 32644 microversion: 2.1 time: 0.071581 Aug 03 03:06:56.332016 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3512/7143] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:06:56 2022] POST /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07/action => generated 32644 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 03:06:56.343738 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c39e52ea-3a93-425b-9308-ffe334bb5d98 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:06:56.344283 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c39e52ea-3a93-425b-9308-ffe334bb5d98 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:56.351256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c39e52ea-3a93-425b-9308-ffe334bb5d98 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:56.351727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c39e52ea-3a93-425b-9308-ffe334bb5d98 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:56.352517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c39e52ea-3a93-425b-9308-ffe334bb5d98 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:56.352971 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c39e52ea-3a93-425b-9308-ffe334bb5d98 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:56.427289 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c39e52ea-3a93-425b-9308-ffe334bb5d98 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07/action" status: 202 len: 0 microversion: 2.1 time: 0.086955 Aug 03 03:06:56.428390 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3632/7144] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:06:56 2022] POST /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:06:56.439064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0bd8a92f-b291-47b7-bbd9-b73afa92cf11 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:56.440381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0bd8a92f-b291-47b7-bbd9-b73afa92cf11 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:56.448651 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0bd8a92f-b291-47b7-bbd9-b73afa92cf11 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:56.449154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0bd8a92f-b291-47b7-bbd9-b73afa92cf11 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:56.449951 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0bd8a92f-b291-47b7-bbd9-b73afa92cf11 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:56.450398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0bd8a92f-b291-47b7-bbd9-b73afa92cf11 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:56.609957 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0bd8a92f-b291-47b7-bbd9-b73afa92cf11 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:56.623423 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0bd8a92f-b291-47b7-bbd9-b73afa92cf11 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1674 microversion: 2.1 time: 0.189767 Aug 03 03:06:56.625356 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3513/7145] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:56 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1674 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:57.649856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e055679a-44c6-4f1e-bff4-b7760e112189 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:57.650565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e055679a-44c6-4f1e-bff4-b7760e112189 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:57.657193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e055679a-44c6-4f1e-bff4-b7760e112189 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:57.657688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e055679a-44c6-4f1e-bff4-b7760e112189 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:57.658596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e055679a-44c6-4f1e-bff4-b7760e112189 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:57.659776 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e055679a-44c6-4f1e-bff4-b7760e112189 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:57.813084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e055679a-44c6-4f1e-bff4-b7760e112189 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:57.826374 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e055679a-44c6-4f1e-bff4-b7760e112189 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1682 microversion: 2.1 time: 0.181471 Aug 03 03:06:57.827425 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3633/7146] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:57 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:06:57.938771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7371482e-adcf-4baf-afcf-bc359c31c45e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:06:57.941808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7371482e-adcf-4baf-afcf-bc359c31c45e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:57.949845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7371482e-adcf-4baf-afcf-bc359c31c45e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:57.950305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7371482e-adcf-4baf-afcf-bc359c31c45e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:57.951156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7371482e-adcf-4baf-afcf-bc359c31c45e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:57.951602 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7371482e-adcf-4baf-afcf-bc359c31c45e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:58.006985 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7371482e-adcf-4baf-afcf-bc359c31c45e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07/action" status: 200 len: 38399 microversion: 2.1 time: 0.072183 Aug 03 03:06:58.007694 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3514/7147] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:06:57 2022] POST /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07/action => generated 38399 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 03:06:59.311251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-60ba096b-ce2c-4d31-8137-165b66188057 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:59.311786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-60ba096b-ce2c-4d31-8137-165b66188057 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:59.314038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-bb8bbbbe-2165-4b52-a75e-05b3b44df26b req-efc87c5d-5f54-4faa-8494-5dd6d4a069d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c0e7ea8-aade-4273-a5ca-ffec7bfacb07", "tag": "a3a4b753-016f-4a46-8966-8cf2a23af736"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:06:59.321494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60ba096b-ce2c-4d31-8137-165b66188057 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:59.322422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60ba096b-ce2c-4d31-8137-165b66188057 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:59.323553 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60ba096b-ce2c-4d31-8137-165b66188057 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:59.324110 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-60ba096b-ce2c-4d31-8137-165b66188057 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:59.325254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bb8bbbbe-2165-4b52-a75e-05b3b44df26b req-efc87c5d-5f54-4faa-8494-5dd6d4a069d3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:59.325970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-bb8bbbbe-2165-4b52-a75e-05b3b44df26b req-efc87c5d-5f54-4faa-8494-5dd6d4a069d3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:59.343538 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-bb8bbbbe-2165-4b52-a75e-05b3b44df26b req-efc87c5d-5f54-4faa-8494-5dd6d4a069d3 service nova] Creating event network-changed:a3a4b753-016f-4a46-8966-8cf2a23af736 for instance 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 on n-h1-826529-8 Aug 03 03:06:59.349451 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-bb8bbbbe-2165-4b52-a75e-05b3b44df26b req-efc87c5d-5f54-4faa-8494-5dd6d4a069d3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039425 Aug 03 03:06:59.350171 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3515/7148] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:06:59.353601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-60ba096b-ce2c-4d31-8137-165b66188057 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 03:06:59.454626 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-60ba096b-ce2c-4d31-8137-165b66188057 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 204 len: 0 microversion: 2.1 time: 0.147044 Aug 03 03:06:59.456381 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3634/7149] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 03:06:59 2022] DELETE /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 03:06:59.465860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1c42390b-6982-41a8-b7d9-6838b00b4507 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:06:59.466861 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1c42390b-6982-41a8-b7d9-6838b00b4507 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:06:59.476216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c42390b-6982-41a8-b7d9-6838b00b4507 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:59.476969 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c42390b-6982-41a8-b7d9-6838b00b4507 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:59.477990 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c42390b-6982-41a8-b7d9-6838b00b4507 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:06:59.478636 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1c42390b-6982-41a8-b7d9-6838b00b4507 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:06:59.626271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1c42390b-6982-41a8-b7d9-6838b00b4507 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:06:59.634429 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1c42390b-6982-41a8-b7d9-6838b00b4507 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1688 microversion: 2.1 time: 0.173342 Aug 03 03:06:59.635231 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3516/7150] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:06:59 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:07:00.657980 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0899d2ef-265a-4760-a5ac-0c7fe5811b5d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:00.659368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0899d2ef-265a-4760-a5ac-0c7fe5811b5d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:00.666018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0899d2ef-265a-4760-a5ac-0c7fe5811b5d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:00.666486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0899d2ef-265a-4760-a5ac-0c7fe5811b5d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:00.667308 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0899d2ef-265a-4760-a5ac-0c7fe5811b5d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:00.667766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0899d2ef-265a-4760-a5ac-0c7fe5811b5d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:00.811406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0899d2ef-265a-4760-a5ac-0c7fe5811b5d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:07:00.819896 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0899d2ef-265a-4760-a5ac-0c7fe5811b5d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1688 microversion: 2.1 time: 0.166412 Aug 03 03:07:00.820480 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3635/7151] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:07:00 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:07:01.573059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-32ebcca8-440d-4ff6-ab85-dd5ad2ced58b req-101f389d-ca16-4157-947a-236cf528f0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0e7ea8-aade-4273-a5ca-ffec7bfacb07", "name": "network-vif-deleted", "tag": "a3a4b753-016f-4a46-8966-8cf2a23af736"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:07:01.584633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-32ebcca8-440d-4ff6-ab85-dd5ad2ced58b req-101f389d-ca16-4157-947a-236cf528f0a1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:01.585079 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-32ebcca8-440d-4ff6-ab85-dd5ad2ced58b req-101f389d-ca16-4157-947a-236cf528f0a1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:01.598309 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-32ebcca8-440d-4ff6-ab85-dd5ad2ced58b req-101f389d-ca16-4157-947a-236cf528f0a1 service nova] Creating event network-vif-deleted:a3a4b753-016f-4a46-8966-8cf2a23af736 for instance 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 on n-h1-826529-8 Aug 03 03:07:01.603777 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-32ebcca8-440d-4ff6-ab85-dd5ad2ced58b req-101f389d-ca16-4157-947a-236cf528f0a1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034438 Aug 03 03:07:01.604618 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3517/7152] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 03:07:01.842631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b07ce41e-a237-40d6-aab8-df0aaf818ee1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:01.847608 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b07ce41e-a237-40d6-aab8-df0aaf818ee1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:01.863893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b07ce41e-a237-40d6-aab8-df0aaf818ee1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:01.864716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b07ce41e-a237-40d6-aab8-df0aaf818ee1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:01.865764 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b07ce41e-a237-40d6-aab8-df0aaf818ee1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:01.866425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b07ce41e-a237-40d6-aab8-df0aaf818ee1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:01.907943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b07ce41e-a237-40d6-aab8-df0aaf818ee1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:01.909837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b07ce41e-a237-40d6-aab8-df0aaf818ee1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:01.910551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-b07ce41e-a237-40d6-aab8-df0aaf818ee1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lazy-loading 'fault' on Instance uuid 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 03:07:01.961473 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b07ce41e-a237-40d6-aab8-df0aaf818ee1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:07:01.969809 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b07ce41e-a237-40d6-aab8-df0aaf818ee1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 200 len: 1357 microversion: 2.1 time: 0.131921 Aug 03 03:07:01.975099 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3636/7153] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:07:01 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 1357 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:07:02.994872 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-446753e0-6232-4ac1-a9ba-8cbd3275461c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:02.995789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-446753e0-6232-4ac1-a9ba-8cbd3275461c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:03.004514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-446753e0-6232-4ac1-a9ba-8cbd3275461c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:03.004772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-446753e0-6232-4ac1-a9ba-8cbd3275461c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:03.005569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-446753e0-6232-4ac1-a9ba-8cbd3275461c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:03.006022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-446753e0-6232-4ac1-a9ba-8cbd3275461c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:03.021612 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-446753e0-6232-4ac1-a9ba-8cbd3275461c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] HTTP exception thrown: Instance 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 could not be found. Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-446753e0-6232-4ac1-a9ba-8cbd3275461c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Request method failure captured: Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 HTTP/1.1 Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eYRZcrYqn2ty7DONXuF2HUsCy9Tk6-nTi0ZXK99YSTeT1qlh867JeQ00loRexm5dFP-D1x5FSzJk8i8-zmuDFsD8UXFrpZZXx5rUxqORh5YT3u9BnNBjDjn0tOpv8YtQ4Bhdjr-teA_UAFNdQWDWRqd_io91Y_O1YGoIN7HAcGgup8 Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c54093784aa14146bb025b41f7ce4067 Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-280471232 Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c54093784aa14146bb025b41f7ce4067", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c54093784aa14146bb025b41f7ce4067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c54093784aa14146bb025b41f7ce4067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c54093784aa14146bb025b41f7ce4067"}]}] Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestNetworkAdvancedServerOps-280471232 Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c54093784aa14146bb025b41f7ce4067 Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-280471232 Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestNetworkAdvancedServerOps-280471232-project Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 44df218d187c46489bad965cd6d0266a Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestNetworkAdvancedServerOps-280471232-project Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 could not be found. Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '9c0e7ea8-aade-4273-a5ca-ffec7bfacb07'} Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 could not be found. Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 could not be found. Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:07:03.023784 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:07:03.029038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:07:03.029038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:07:03.029038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:07:03.029038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:07:03.029038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 03:07:03.029038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 03:07:03.029038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 could not be found. Aug 03 03:07:03.029038 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:07:03.029038 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-446753e0-6232-4ac1-a9ba-8cbd3275461c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Returning 404 to user: Instance 9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 03:07:03.029038 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-446753e0-6232-4ac1-a9ba-8cbd3275461c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07" status: 404 len: 111 microversion: 2.1 time: 0.035554 Aug 03 03:07:03.029038 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3518/7154] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:07:02 2022] GET /compute/v2.1/servers/9c0e7ea8-aade-4273-a5ca-ffec7bfacb07 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 03:07:06.662088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7a83bb12-13ec-43f0-bcf9-f1bb371bbef1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '.version_select at 0x7f5b243ff670>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:06.683869 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7a83bb12-13ec-43f0-bcf9-f1bb371bbef1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2067844353" status: 202 len: 0 microversion: 2.1 time: 0.025823 Aug 03 03:07:06.684464 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3637/7155] 10.222.0.67 () {58 vars in 1284 bytes} [Wed Aug 3 03:07:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2067844353 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:07:06.728538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-78215daa-4b85-46ec-b398-837d29be4609 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'create', calling method: .version_select at 0x7f5b244da040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1109949044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAs1K1vCie44KERknydrP6abdt2uN5XMYw59/zr7rrtKhr4l9aL4I7kocmI85yjV9uFoTGK7F8KvbUOc0aVxxacwVgSZrQWNhrjwlGSs4EvevXyWQdsiYf8wUffrDH8ciA=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:07:06.749040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-78215daa-4b85-46ec-b398-837d29be4609 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for project c54093784aa14146bb025b41f7ce4067. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:07:06.756208 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-78215daa-4b85-46ec-b398-837d29be4609 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for user 44df218d187c46489bad965cd6d0266a and project c54093784aa14146bb025b41f7ce4067. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:07:06.783123 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-78215daa-4b85-46ec-b398-837d29be4609 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.063071 Aug 03 03:07:06.783345 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3519/7156] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 03:07:06 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:07:13.105797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:07:13.110640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1746946248", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "37ebc19e-656f-49ae-bda8-bd1e1e9d6ebe"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1109949044", "security_groups": [{"name": "tempest-secgroup-smoke-37783174"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:07:13.232159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] validate_networks() for [('37ebc19e-656f-49ae-bda8-bd1e1e9d6ebe', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 03:07:13.712645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 03:07:13.713053 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 03:07:13.713471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 03:07:13.713932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 03:07:13.714371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 03:07:13.728383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:13.728865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:13.729707 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:13.730193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:13.756517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for project c54093784aa14146bb025b41f7ce4067. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:07:13.762377 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for user 44df218d187c46489bad965cd6d0266a and project c54093784aa14146bb025b41f7ce4067. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:07:13.778089 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 03:07:13.781330 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 03:07:13.835140 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b459ab00-6c95-4e15-bbe3-df56b329cc80 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.730932 Aug 03 03:07:13.840324 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3638/7157] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 03:07:13 2022] POST /compute/v2.1/servers => generated 404 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 03:07:13.847883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-58cb1ce8-3434-4fdb-a4f3-8b41fbb34054 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:13.848505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-58cb1ce8-3434-4fdb-a4f3-8b41fbb34054 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:13.851889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=32 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:07:13.910563 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-58cb1ce8-3434-4fdb-a4f3-8b41fbb34054 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:07:13.917924 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-58cb1ce8-3434-4fdb-a4f3-8b41fbb34054 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1267 microversion: 2.1 time: 0.075049 Aug 03 03:07:13.918712 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3520/7158] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:07:13 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1267 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:07:14.941742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e9074cf8-0410-47c5-a27d-8e1bf176566b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:14.943580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e9074cf8-0410-47c5-a27d-8e1bf176566b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:14.953234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9074cf8-0410-47c5-a27d-8e1bf176566b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:14.953723 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9074cf8-0410-47c5-a27d-8e1bf176566b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:14.954679 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9074cf8-0410-47c5-a27d-8e1bf176566b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:14.955206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e9074cf8-0410-47c5-a27d-8e1bf176566b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:15.056518 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e9074cf8-0410-47c5-a27d-8e1bf176566b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:07:15.066057 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e9074cf8-0410-47c5-a27d-8e1bf176566b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1327 microversion: 2.1 time: 0.130710 Aug 03 03:07:15.067013 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3639/7159] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:07:14 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1327 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:07:16.089803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-859f06b8-3949-4119-929f-c4dd392d52ed tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:16.090975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-859f06b8-3949-4119-929f-c4dd392d52ed tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:16.105846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-859f06b8-3949-4119-929f-c4dd392d52ed tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:16.108789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-859f06b8-3949-4119-929f-c4dd392d52ed tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:16.109852 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-859f06b8-3949-4119-929f-c4dd392d52ed tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:16.110484 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-859f06b8-3949-4119-929f-c4dd392d52ed tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:16.352231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-859f06b8-3949-4119-929f-c4dd392d52ed tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:07:16.360714 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-859f06b8-3949-4119-929f-c4dd392d52ed tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1391 microversion: 2.1 time: 0.276698 Aug 03 03:07:16.361816 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3521/7160] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:07:16 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1391 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:07:16.556388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-d2c74c92-904b-42b0-af90-973601a1dbaa req-b12bf65e-40c6-462e-95fd-0b56e3deb098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f18e082-3bec-4513-9fd2-27862cdf4eca", "tag": "798fea03-5869-46e0-85e1-8028129fc5c7"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:07:16.570244 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d2c74c92-904b-42b0-af90-973601a1dbaa req-b12bf65e-40c6-462e-95fd-0b56e3deb098 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:16.570704 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d2c74c92-904b-42b0-af90-973601a1dbaa req-b12bf65e-40c6-462e-95fd-0b56e3deb098 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:16.583403 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-d2c74c92-904b-42b0-af90-973601a1dbaa req-b12bf65e-40c6-462e-95fd-0b56e3deb098 service nova] Creating event network-changed:798fea03-5869-46e0-85e1-8028129fc5c7 for instance 3f18e082-3bec-4513-9fd2-27862cdf4eca on n-h2-826529-8 Aug 03 03:07:16.588457 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-d2c74c92-904b-42b0-af90-973601a1dbaa req-b12bf65e-40c6-462e-95fd-0b56e3deb098 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036020 Aug 03 03:07:16.589284 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3640/7161] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 03:07:17.382621 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6c462a50-4d1e-4918-b6b6-52cfc2c6b22a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:17.383304 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6c462a50-4d1e-4918-b6b6-52cfc2c6b22a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:17.390433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c462a50-4d1e-4918-b6b6-52cfc2c6b22a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:17.390895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c462a50-4d1e-4918-b6b6-52cfc2c6b22a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:17.391719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c462a50-4d1e-4918-b6b6-52cfc2c6b22a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:17.392161 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6c462a50-4d1e-4918-b6b6-52cfc2c6b22a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:17.537582 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6c462a50-4d1e-4918-b6b6-52cfc2c6b22a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:07:17.545101 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6c462a50-4d1e-4918-b6b6-52cfc2c6b22a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1391 microversion: 2.1 time: 0.166435 Aug 03 03:07:17.545683 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3522/7162] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:07:17 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:07:18.570176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-46f9b465-7766-4c8e-b178-f72e2847809b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:18.570886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-46f9b465-7766-4c8e-b178-f72e2847809b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:18.577282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46f9b465-7766-4c8e-b178-f72e2847809b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:18.577747 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46f9b465-7766-4c8e-b178-f72e2847809b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:18.578532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46f9b465-7766-4c8e-b178-f72e2847809b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:18.579022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-46f9b465-7766-4c8e-b178-f72e2847809b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:18.720007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-46f9b465-7766-4c8e-b178-f72e2847809b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:07:18.728458 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-46f9b465-7766-4c8e-b178-f72e2847809b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1391 microversion: 2.1 time: 0.164131 Aug 03 03:07:18.729078 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3641/7163] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:07:18 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:07:19.749987 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-37e3e094-5f23-4f93-a928-2bebe457c731 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:19.750649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-37e3e094-5f23-4f93-a928-2bebe457c731 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:19.758031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37e3e094-5f23-4f93-a928-2bebe457c731 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:19.758495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37e3e094-5f23-4f93-a928-2bebe457c731 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:19.759311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37e3e094-5f23-4f93-a928-2bebe457c731 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:19.759753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-37e3e094-5f23-4f93-a928-2bebe457c731 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:19.910459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-37e3e094-5f23-4f93-a928-2bebe457c731 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:07:19.919144 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-37e3e094-5f23-4f93-a928-2bebe457c731 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1391 microversion: 2.1 time: 0.173163 Aug 03 03:07:19.919854 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3523/7164] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:07:19 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:07:20.941043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-772f992e-1bdb-4db4-b941-aebb6bc8df01 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:20.941703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-772f992e-1bdb-4db4-b941-aebb6bc8df01 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:20.948885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-772f992e-1bdb-4db4-b941-aebb6bc8df01 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:20.949356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-772f992e-1bdb-4db4-b941-aebb6bc8df01 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:20.950158 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-772f992e-1bdb-4db4-b941-aebb6bc8df01 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:20.950615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-772f992e-1bdb-4db4-b941-aebb6bc8df01 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:21.094797 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-772f992e-1bdb-4db4-b941-aebb6bc8df01 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:07:21.103732 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-772f992e-1bdb-4db4-b941-aebb6bc8df01 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1391 microversion: 2.1 time: 0.167198 Aug 03 03:07:21.104308 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3642/7165] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:07:20 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:07:22.126016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-56490b7d-d15d-498f-a7db-b553bf09784b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:22.127697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-56490b7d-d15d-498f-a7db-b553bf09784b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:22.130174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-792dd275-a898-4a64-bce3-79f9084d0a19 req-1b904e26-a4ff-4fa0-951f-f97dcd332d08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f18e082-3bec-4513-9fd2-27862cdf4eca", "name": "network-vif-plugged", "status": "completed", "tag": "798fea03-5869-46e0-85e1-8028129fc5c7"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:07:22.135133 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56490b7d-d15d-498f-a7db-b553bf09784b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:22.135668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56490b7d-d15d-498f-a7db-b553bf09784b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:22.136596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56490b7d-d15d-498f-a7db-b553bf09784b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:22.137211 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-56490b7d-d15d-498f-a7db-b553bf09784b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:22.142393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-792dd275-a898-4a64-bce3-79f9084d0a19 req-1b904e26-a4ff-4fa0-951f-f97dcd332d08 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:22.142869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-792dd275-a898-4a64-bce3-79f9084d0a19 req-1b904e26-a4ff-4fa0-951f-f97dcd332d08 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:22.156885 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-792dd275-a898-4a64-bce3-79f9084d0a19 req-1b904e26-a4ff-4fa0-951f-f97dcd332d08 service nova] Creating event network-vif-plugged:798fea03-5869-46e0-85e1-8028129fc5c7 for instance 3f18e082-3bec-4513-9fd2-27862cdf4eca on n-h2-826529-8 Aug 03 03:07:22.162712 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-792dd275-a898-4a64-bce3-79f9084d0a19 req-1b904e26-a4ff-4fa0-951f-f97dcd332d08 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037128 Aug 03 03:07:22.163540 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3643/7166] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:07:22.340024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-56490b7d-d15d-498f-a7db-b553bf09784b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:07:22.349075 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-56490b7d-d15d-498f-a7db-b553bf09784b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1391 microversion: 2.1 time: 0.227178 Aug 03 03:07:22.349667 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3524/7167] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:07:22 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1391 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:07:23.371317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2b31a8b6-111a-471f-8ac1-9a0fb8e5c83b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:23.372070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2b31a8b6-111a-471f-8ac1-9a0fb8e5c83b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:23.378828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b31a8b6-111a-471f-8ac1-9a0fb8e5c83b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:23.379328 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b31a8b6-111a-471f-8ac1-9a0fb8e5c83b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:23.380137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b31a8b6-111a-471f-8ac1-9a0fb8e5c83b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:23.380622 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2b31a8b6-111a-471f-8ac1-9a0fb8e5c83b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:23.522397 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2b31a8b6-111a-471f-8ac1-9a0fb8e5c83b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:07:23.531256 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2b31a8b6-111a-471f-8ac1-9a0fb8e5c83b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1391 microversion: 2.1 time: 0.165034 Aug 03 03:07:23.531849 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3644/7168] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:07:23 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:07:24.555694 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5442f566-2378-4797-b78e-5a9feddc037f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:24.556313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5442f566-2378-4797-b78e-5a9feddc037f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:24.559035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:07:24.559842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:07:24.567581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5442f566-2378-4797-b78e-5a9feddc037f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:24.568041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5442f566-2378-4797-b78e-5a9feddc037f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:24.568828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5442f566-2378-4797-b78e-5a9feddc037f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:24.569275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5442f566-2378-4797-b78e-5a9feddc037f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:24.707011 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5442f566-2378-4797-b78e-5a9feddc037f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:07:24.714581 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5442f566-2378-4797-b78e-5a9feddc037f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1562 microversion: 2.1 time: 0.162809 Aug 03 03:07:24.715185 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3525/7169] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:07:24 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:07:24.735278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-30202404-c9ca-4b7d-be37-185254df7505 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:24.735978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-30202404-c9ca-4b7d-be37-185254df7505 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:24.738824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:07:24.739541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:07:24.741063 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:07:24.747327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30202404-c9ca-4b7d-be37-185254df7505 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:24.747808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30202404-c9ca-4b7d-be37-185254df7505 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:24.748617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30202404-c9ca-4b7d-be37-185254df7505 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:24.749398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-30202404-c9ca-4b7d-be37-185254df7505 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:24.895593 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-30202404-c9ca-4b7d-be37-185254df7505 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:07:24.903574 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-30202404-c9ca-4b7d-be37-185254df7505 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1562 microversion: 2.1 time: 0.172125 Aug 03 03:07:24.904071 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3645/7170] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:07:24 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:07:26.856379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-81c75726-c276-45db-98bc-84a4bbb09f75 req-4ded3043-8502-499a-86ee-9ef4d6d6e264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f18e082-3bec-4513-9fd2-27862cdf4eca", "tag": "798fea03-5869-46e0-85e1-8028129fc5c7"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:07:26.860545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-25479206-c88d-475d-9261-bba75161e6a6 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:07:26.861358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-25479206-c88d-475d-9261-bba75161e6a6 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:26.876429 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25479206-c88d-475d-9261-bba75161e6a6 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:26.877188 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25479206-c88d-475d-9261-bba75161e6a6 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:26.879678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-81c75726-c276-45db-98bc-84a4bbb09f75 req-4ded3043-8502-499a-86ee-9ef4d6d6e264 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:26.879835 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25479206-c88d-475d-9261-bba75161e6a6 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:26.880325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-25479206-c88d-475d-9261-bba75161e6a6 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:26.880635 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-81c75726-c276-45db-98bc-84a4bbb09f75 req-4ded3043-8502-499a-86ee-9ef4d6d6e264 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:26.896048 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-81c75726-c276-45db-98bc-84a4bbb09f75 req-4ded3043-8502-499a-86ee-9ef4d6d6e264 service nova] Creating event network-changed:798fea03-5869-46e0-85e1-8028129fc5c7 for instance 3f18e082-3bec-4513-9fd2-27862cdf4eca on n-h2-826529-8 Aug 03 03:07:26.902179 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-81c75726-c276-45db-98bc-84a4bbb09f75 req-4ded3043-8502-499a-86ee-9ef4d6d6e264 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049531 Aug 03 03:07:26.903609 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3646/7171] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:07:27.146399 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-25479206-c88d-475d-9261-bba75161e6a6 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:07:27.156206 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-25479206-c88d-475d-9261-bba75161e6a6 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1562 microversion: 2.1 time: 0.305315 Aug 03 03:07:27.157139 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3526/7172] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:07:26 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1562 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:07:39.775885 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:07:39.776462 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 03:07:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:07:50.411807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:07:50.412585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=38 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:07:50.416987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-25adece0-6753-4752-90c5-26bbdf4080a8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:07:50.419270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-25adece0-6753-4752-90c5-26bbdf4080a8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:07:50.426435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-25adece0-6753-4752-90c5-26bbdf4080a8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:50.426920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-25adece0-6753-4752-90c5-26bbdf4080a8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:50.427727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-25adece0-6753-4752-90c5-26bbdf4080a8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:07:50.428263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-25adece0-6753-4752-90c5-26bbdf4080a8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:07:50.483322 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-25adece0-6753-4752-90c5-26bbdf4080a8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca/action" status: 200 len: 24567 microversion: 2.1 time: 0.073322 Aug 03 03:07:50.483988 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3647/7173] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:07:50 2022] POST /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca/action => generated 24567 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 03:08:01.547356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ad699df6-01f0-42a5-9684-5cfc0dc63e3f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:08:01.549654 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ad699df6-01f0-42a5-9684-5cfc0dc63e3f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:01.551845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:08:01.552515 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=36 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:08:01.559844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ad699df6-01f0-42a5-9684-5cfc0dc63e3f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:01.560313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ad699df6-01f0-42a5-9684-5cfc0dc63e3f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:01.561107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ad699df6-01f0-42a5-9684-5cfc0dc63e3f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:01.561559 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ad699df6-01f0-42a5-9684-5cfc0dc63e3f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:01.639580 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ad699df6-01f0-42a5-9684-5cfc0dc63e3f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca/action" status: 202 len: 0 microversion: 2.1 time: 0.096415 Aug 03 03:08:01.640235 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3527/7174] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:08:01 2022] POST /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:08:01.649910 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f7fcc2f7-c647-453c-93ff-eae1387fb006 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:01.650640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f7fcc2f7-c647-453c-93ff-eae1387fb006 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:01.653424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:08:01.654140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:08:01.660752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7fcc2f7-c647-453c-93ff-eae1387fb006 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:01.661304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7fcc2f7-c647-453c-93ff-eae1387fb006 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:01.662134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7fcc2f7-c647-453c-93ff-eae1387fb006 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:01.662687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7fcc2f7-c647-453c-93ff-eae1387fb006 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:01.898853 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f7fcc2f7-c647-453c-93ff-eae1387fb006 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:01.906628 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f7fcc2f7-c647-453c-93ff-eae1387fb006 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1673 microversion: 2.1 time: 0.261913 Aug 03 03:08:01.907266 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3648/7175] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:01 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1673 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:02.929851 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-77daa873-152b-415b-a7a4-a4f76519765b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:02.931242 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-77daa873-152b-415b-a7a4-a4f76519765b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:02.937722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77daa873-152b-415b-a7a4-a4f76519765b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:02.938179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77daa873-152b-415b-a7a4-a4f76519765b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:02.938990 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77daa873-152b-415b-a7a4-a4f76519765b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:02.939441 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-77daa873-152b-415b-a7a4-a4f76519765b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:03.076818 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-77daa873-152b-415b-a7a4-a4f76519765b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:03.084576 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-77daa873-152b-415b-a7a4-a4f76519765b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1678 microversion: 2.1 time: 0.160060 Aug 03 03:08:03.085142 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3528/7176] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:02 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:04.106320 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-66e5a533-fc0c-44ec-83bc-e8213d7f9025 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:04.107029 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-66e5a533-fc0c-44ec-83bc-e8213d7f9025 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:04.115239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66e5a533-fc0c-44ec-83bc-e8213d7f9025 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:04.115716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66e5a533-fc0c-44ec-83bc-e8213d7f9025 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:04.116524 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66e5a533-fc0c-44ec-83bc-e8213d7f9025 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:04.116985 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-66e5a533-fc0c-44ec-83bc-e8213d7f9025 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:04.282079 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-66e5a533-fc0c-44ec-83bc-e8213d7f9025 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:04.291599 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-66e5a533-fc0c-44ec-83bc-e8213d7f9025 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1678 microversion: 2.1 time: 0.189398 Aug 03 03:08:04.292190 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3649/7177] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:04 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:08:05.317905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-17ffffae-4360-469c-8455-b88a6a4c772b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:05.318531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-17ffffae-4360-469c-8455-b88a6a4c772b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:05.326149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17ffffae-4360-469c-8455-b88a6a4c772b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:05.326646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17ffffae-4360-469c-8455-b88a6a4c772b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:05.327771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17ffffae-4360-469c-8455-b88a6a4c772b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:05.328225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-17ffffae-4360-469c-8455-b88a6a4c772b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:05.463493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-17ffffae-4360-469c-8455-b88a6a4c772b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:05.471649 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-17ffffae-4360-469c-8455-b88a6a4c772b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1678 microversion: 2.1 time: 0.157297 Aug 03 03:08:05.472232 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3529/7178] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:05 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:06.493134 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c683cc29-5c3f-4ee1-86b4-fa3769ad100e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:06.493763 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c683cc29-5c3f-4ee1-86b4-fa3769ad100e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:06.500857 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c683cc29-5c3f-4ee1-86b4-fa3769ad100e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:06.501323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c683cc29-5c3f-4ee1-86b4-fa3769ad100e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:06.502108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c683cc29-5c3f-4ee1-86b4-fa3769ad100e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:06.502570 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c683cc29-5c3f-4ee1-86b4-fa3769ad100e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:06.637636 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c683cc29-5c3f-4ee1-86b4-fa3769ad100e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:06.645187 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c683cc29-5c3f-4ee1-86b4-fa3769ad100e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1678 microversion: 2.1 time: 0.156063 Aug 03 03:08:06.645753 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3650/7179] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:06 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:07.667965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-daa94d27-4faf-4eba-b69f-577843595fb0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:07.668587 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-daa94d27-4faf-4eba-b69f-577843595fb0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:07.675668 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-daa94d27-4faf-4eba-b69f-577843595fb0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:07.676129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-daa94d27-4faf-4eba-b69f-577843595fb0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:07.676914 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-daa94d27-4faf-4eba-b69f-577843595fb0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:07.677356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-daa94d27-4faf-4eba-b69f-577843595fb0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:07.813605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-daa94d27-4faf-4eba-b69f-577843595fb0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:07.821836 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-daa94d27-4faf-4eba-b69f-577843595fb0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1678 microversion: 2.1 time: 0.158473 Aug 03 03:08:07.822409 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3530/7180] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:07 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:08.844629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-11821df6-4343-4dff-885d-40c6a590a5ae tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:08.845249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-11821df6-4343-4dff-885d-40c6a590a5ae tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:08.852846 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11821df6-4343-4dff-885d-40c6a590a5ae tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:08.853313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11821df6-4343-4dff-885d-40c6a590a5ae tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:08.854093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11821df6-4343-4dff-885d-40c6a590a5ae tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:08.854545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-11821df6-4343-4dff-885d-40c6a590a5ae tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:08.985581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-11821df6-4343-4dff-885d-40c6a590a5ae tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:08.994042 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-11821df6-4343-4dff-885d-40c6a590a5ae tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1678 microversion: 2.1 time: 0.154534 Aug 03 03:08:08.994622 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3651/7181] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:08 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:10.015600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2b614bd8-d9d2-4bfa-922b-d601b3e12674 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:10.016131 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2b614bd8-d9d2-4bfa-922b-d601b3e12674 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:10.023381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b614bd8-d9d2-4bfa-922b-d601b3e12674 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:10.023870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b614bd8-d9d2-4bfa-922b-d601b3e12674 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:10.024808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b614bd8-d9d2-4bfa-922b-d601b3e12674 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:10.025251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b614bd8-d9d2-4bfa-922b-d601b3e12674 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:10.160809 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2b614bd8-d9d2-4bfa-922b-d601b3e12674 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:10.169101 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2b614bd8-d9d2-4bfa-922b-d601b3e12674 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1678 microversion: 2.1 time: 0.157535 Aug 03 03:08:10.169672 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3531/7182] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:10 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:11.191346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-55d8a898-0756-4dd6-bec1-be7ddae78f6d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:11.191973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-55d8a898-0756-4dd6-bec1-be7ddae78f6d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:11.199746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55d8a898-0756-4dd6-bec1-be7ddae78f6d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:11.200219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55d8a898-0756-4dd6-bec1-be7ddae78f6d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:11.201017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55d8a898-0756-4dd6-bec1-be7ddae78f6d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:11.201477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-55d8a898-0756-4dd6-bec1-be7ddae78f6d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:11.339868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-55d8a898-0756-4dd6-bec1-be7ddae78f6d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:11.347594 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-55d8a898-0756-4dd6-bec1-be7ddae78f6d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1678 microversion: 2.1 time: 0.160422 Aug 03 03:08:11.348183 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3652/7183] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:11 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:12.369220 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9e5efa45-6a6a-4c78-88e5-cc2e6ce6140d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:12.369765 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9e5efa45-6a6a-4c78-88e5-cc2e6ce6140d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:12.377283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e5efa45-6a6a-4c78-88e5-cc2e6ce6140d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:12.377686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e5efa45-6a6a-4c78-88e5-cc2e6ce6140d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:12.378479 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e5efa45-6a6a-4c78-88e5-cc2e6ce6140d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:12.378939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9e5efa45-6a6a-4c78-88e5-cc2e6ce6140d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:12.517135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9e5efa45-6a6a-4c78-88e5-cc2e6ce6140d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:12.525563 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9e5efa45-6a6a-4c78-88e5-cc2e6ce6140d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1678 microversion: 2.1 time: 0.160963 Aug 03 03:08:12.526135 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3532/7184] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:12 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:08:13.547031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-75a45ac5-6d9f-4a6f-847f-f87142c6c790 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:13.547660 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-75a45ac5-6d9f-4a6f-847f-f87142c6c790 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:13.554952 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75a45ac5-6d9f-4a6f-847f-f87142c6c790 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:13.556076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75a45ac5-6d9f-4a6f-847f-f87142c6c790 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:13.556871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75a45ac5-6d9f-4a6f-847f-f87142c6c790 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:13.557323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-75a45ac5-6d9f-4a6f-847f-f87142c6c790 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:13.690554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-75a45ac5-6d9f-4a6f-847f-f87142c6c790 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:13.698383 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-75a45ac5-6d9f-4a6f-847f-f87142c6c790 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1678 microversion: 2.1 time: 0.155403 Aug 03 03:08:13.698984 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3653/7185] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:13 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:14.720472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-914725eb-5dbe-4496-a376-78eabd4512fd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:14.721124 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-914725eb-5dbe-4496-a376-78eabd4512fd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:14.729186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-914725eb-5dbe-4496-a376-78eabd4512fd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:14.729648 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-914725eb-5dbe-4496-a376-78eabd4512fd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:14.730471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-914725eb-5dbe-4496-a376-78eabd4512fd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:14.730942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-914725eb-5dbe-4496-a376-78eabd4512fd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:14.871393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-914725eb-5dbe-4496-a376-78eabd4512fd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:14.879109 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-914725eb-5dbe-4496-a376-78eabd4512fd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1678 microversion: 2.1 time: 0.162539 Aug 03 03:08:14.879693 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3533/7186] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:14 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:15.902252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4d81dd05-2e5b-4284-8948-892e4b3deafc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:15.902886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4d81dd05-2e5b-4284-8948-892e4b3deafc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:15.910047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d81dd05-2e5b-4284-8948-892e4b3deafc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:15.910523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d81dd05-2e5b-4284-8948-892e4b3deafc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:15.911351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d81dd05-2e5b-4284-8948-892e4b3deafc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:15.911817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d81dd05-2e5b-4284-8948-892e4b3deafc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:16.052045 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4d81dd05-2e5b-4284-8948-892e4b3deafc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:16.060139 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4d81dd05-2e5b-4284-8948-892e4b3deafc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1678 microversion: 2.1 time: 0.162605 Aug 03 03:08:16.060722 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3654/7187] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:15 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:17.083058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1f020de3-b820-434f-89cf-d50c36749388 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:17.083687 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1f020de3-b820-434f-89cf-d50c36749388 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:17.091454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f020de3-b820-434f-89cf-d50c36749388 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:17.091916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f020de3-b820-434f-89cf-d50c36749388 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:17.092714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f020de3-b820-434f-89cf-d50c36749388 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:17.093163 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1f020de3-b820-434f-89cf-d50c36749388 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:17.227985 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1f020de3-b820-434f-89cf-d50c36749388 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:17.235626 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1f020de3-b820-434f-89cf-d50c36749388 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1678 microversion: 2.1 time: 0.156606 Aug 03 03:08:17.236206 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3534/7188] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:17 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:18.257517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a879985a-a51c-4baf-8b6a-0943fae8bb81 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:18.258198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a879985a-a51c-4baf-8b6a-0943fae8bb81 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:18.266114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a879985a-a51c-4baf-8b6a-0943fae8bb81 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:18.266580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a879985a-a51c-4baf-8b6a-0943fae8bb81 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:18.267422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a879985a-a51c-4baf-8b6a-0943fae8bb81 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:18.267876 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a879985a-a51c-4baf-8b6a-0943fae8bb81 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:18.404637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a879985a-a51c-4baf-8b6a-0943fae8bb81 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:18.412419 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a879985a-a51c-4baf-8b6a-0943fae8bb81 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1678 microversion: 2.1 time: 0.158855 Aug 03 03:08:18.413017 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3655/7189] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:18 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:19.435321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8e35de0c-22bd-484e-8b9c-537a0457935f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:19.435938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8e35de0c-22bd-484e-8b9c-537a0457935f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:19.442122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e35de0c-22bd-484e-8b9c-537a0457935f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:19.442579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e35de0c-22bd-484e-8b9c-537a0457935f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:19.443388 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e35de0c-22bd-484e-8b9c-537a0457935f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:19.443832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8e35de0c-22bd-484e-8b9c-537a0457935f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:19.580254 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8e35de0c-22bd-484e-8b9c-537a0457935f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:19.588749 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8e35de0c-22bd-484e-8b9c-537a0457935f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1681 microversion: 2.1 time: 0.158833 Aug 03 03:08:19.589322 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3535/7190] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:19 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:45.783758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-39cf77b6-ce5b-414b-b921-97b47d9a2577 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:08:45.786015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-39cf77b6-ce5b-414b-b921-97b47d9a2577 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:45.788309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=16 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:08:45.788991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=48 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:08:45.795483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39cf77b6-ce5b-414b-b921-97b47d9a2577 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:45.795959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39cf77b6-ce5b-414b-b921-97b47d9a2577 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:45.796756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39cf77b6-ce5b-414b-b921-97b47d9a2577 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:45.797217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39cf77b6-ce5b-414b-b921-97b47d9a2577 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:45.894718 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-39cf77b6-ce5b-414b-b921-97b47d9a2577 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca/action" status: 200 len: 69002 microversion: 2.1 time: 0.115113 Aug 03 03:08:45.895452 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3656/7191] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:08:45 2022] POST /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca/action => generated 69002 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 03:08:53.097285 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-da3153dd-b7ba-4ea6-aae2-b7543bb584af tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:53.097814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-da3153dd-b7ba-4ea6-aae2-b7543bb584af tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:53.098984 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-6f22e605-ae22-45df-9f7e-e16fecf70e8e req-6e325dd2-817a-4db5-8723-2fe83c6f8512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f18e082-3bec-4513-9fd2-27862cdf4eca", "tag": "798fea03-5869-46e0-85e1-8028129fc5c7"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:08:53.100927 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=18 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:08:53.102128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:08:53.110260 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da3153dd-b7ba-4ea6-aae2-b7543bb584af tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:53.111112 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da3153dd-b7ba-4ea6-aae2-b7543bb584af tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:53.111970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da3153dd-b7ba-4ea6-aae2-b7543bb584af tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:53.112102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6f22e605-ae22-45df-9f7e-e16fecf70e8e req-6e325dd2-817a-4db5-8723-2fe83c6f8512 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:53.112464 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-6f22e605-ae22-45df-9f7e-e16fecf70e8e req-6e325dd2-817a-4db5-8723-2fe83c6f8512 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:53.113042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-da3153dd-b7ba-4ea6-aae2-b7543bb584af tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:53.125928 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-6f22e605-ae22-45df-9f7e-e16fecf70e8e req-6e325dd2-817a-4db5-8723-2fe83c6f8512 service nova] Creating event network-changed:798fea03-5869-46e0-85e1-8028129fc5c7 for instance 3f18e082-3bec-4513-9fd2-27862cdf4eca on n-h2-826529-8 Aug 03 03:08:53.132817 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-6f22e605-ae22-45df-9f7e-e16fecf70e8e req-6e325dd2-817a-4db5-8723-2fe83c6f8512 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036925 Aug 03 03:08:53.133937 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3657/7192] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 03:08:53.143287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-da3153dd-b7ba-4ea6-aae2-b7543bb584af tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 03:08:53.248871 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-da3153dd-b7ba-4ea6-aae2-b7543bb584af tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 204 len: 0 microversion: 2.1 time: 0.156128 Aug 03 03:08:53.251027 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3536/7193] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 03:08:53 2022] DELETE /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 03:08:53.260024 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-81eacb01-594f-49ea-bf49-75a1eeb12709 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:53.260745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-81eacb01-594f-49ea-bf49-75a1eeb12709 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:53.268023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81eacb01-594f-49ea-bf49-75a1eeb12709 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:53.268664 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81eacb01-594f-49ea-bf49-75a1eeb12709 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:53.269481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81eacb01-594f-49ea-bf49-75a1eeb12709 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:53.269939 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81eacb01-594f-49ea-bf49-75a1eeb12709 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:53.477514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-81eacb01-594f-49ea-bf49-75a1eeb12709 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:53.485539 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-81eacb01-594f-49ea-bf49-75a1eeb12709 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1687 microversion: 2.1 time: 0.230349 Aug 03 03:08:53.486133 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3658/7194] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:53 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1687 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:54.508523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-882a0c28-45b0-4890-9736-69faeb8a790c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:54.509233 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-882a0c28-45b0-4890-9736-69faeb8a790c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:54.516890 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-882a0c28-45b0-4890-9736-69faeb8a790c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:54.517343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-882a0c28-45b0-4890-9736-69faeb8a790c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:54.518410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-882a0c28-45b0-4890-9736-69faeb8a790c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:54.518864 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-882a0c28-45b0-4890-9736-69faeb8a790c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:54.706652 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-882a0c28-45b0-4890-9736-69faeb8a790c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:54.715671 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-882a0c28-45b0-4890-9736-69faeb8a790c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1687 microversion: 2.1 time: 0.209961 Aug 03 03:08:54.716274 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3537/7195] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:54 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1687 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:55.682732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-64b78317-c832-4b3d-8d24-2f7214de35e5 req-f934117b-7238-42fd-b9a9-0b616b8f85b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f18e082-3bec-4513-9fd2-27862cdf4eca", "name": "network-vif-deleted", "tag": "798fea03-5869-46e0-85e1-8028129fc5c7"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:08:55.696491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-64b78317-c832-4b3d-8d24-2f7214de35e5 req-f934117b-7238-42fd-b9a9-0b616b8f85b9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:55.696970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-64b78317-c832-4b3d-8d24-2f7214de35e5 req-f934117b-7238-42fd-b9a9-0b616b8f85b9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:55.713905 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-64b78317-c832-4b3d-8d24-2f7214de35e5 req-f934117b-7238-42fd-b9a9-0b616b8f85b9 service nova] Creating event network-vif-deleted:798fea03-5869-46e0-85e1-8028129fc5c7 for instance 3f18e082-3bec-4513-9fd2-27862cdf4eca on n-h2-826529-8 Aug 03 03:08:55.719910 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-64b78317-c832-4b3d-8d24-2f7214de35e5 req-f934117b-7238-42fd-b9a9-0b616b8f85b9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040855 Aug 03 03:08:55.720872 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3659/7196] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:08:55.737238 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-12af492c-b943-4f39-b0f7-bb6c722e3598 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:55.739078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-12af492c-b943-4f39-b0f7-bb6c722e3598 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:55.747838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12af492c-b943-4f39-b0f7-bb6c722e3598 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:55.748677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12af492c-b943-4f39-b0f7-bb6c722e3598 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:55.749790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12af492c-b943-4f39-b0f7-bb6c722e3598 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:55.750205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-12af492c-b943-4f39-b0f7-bb6c722e3598 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:55.821553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-12af492c-b943-4f39-b0f7-bb6c722e3598 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:08:55.831478 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-12af492c-b943-4f39-b0f7-bb6c722e3598 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 200 len: 1352 microversion: 2.1 time: 0.098054 Aug 03 03:08:55.832314 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3538/7197] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:55 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:08:56.855443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31f0f1f2-19bc-47c1-bac9-bef0d6b78303 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:08:56.856217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-31f0f1f2-19bc-47c1-bac9-bef0d6b78303 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 3f18e082-3bec-4513-9fd2-27862cdf4eca] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:08:56.862823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31f0f1f2-19bc-47c1-bac9-bef0d6b78303 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:56.863323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31f0f1f2-19bc-47c1-bac9-bef0d6b78303 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:56.864112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31f0f1f2-19bc-47c1-bac9-bef0d6b78303 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:08:56.864598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-31f0f1f2-19bc-47c1-bac9-bef0d6b78303 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:08:56.878840 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-31f0f1f2-19bc-47c1-bac9-bef0d6b78303 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] HTTP exception thrown: Instance 3f18e082-3bec-4513-9fd2-27862cdf4eca could not be found. Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31f0f1f2-19bc-47c1-bac9-bef0d6b78303 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Request method failure captured: Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca HTTP/1.1 Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eYRZcrYqn2ty7DONXuF2HUsCy9Tk6-nTi0ZXK99YSTeT1qlh867JeQ00loRexm5dFP-D1x5FSzJk8i8-zmuDFsD8UXFrpZZXx5rUxqORh5YT3u9BnNBjDjn0tOpv8YtQ4Bhdjr-teA_UAFNdQWDWRqd_io91Y_O1YGoIN7HAcGgup8 Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: c54093784aa14146bb025b41f7ce4067 Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-280471232 Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c54093784aa14146bb025b41f7ce4067", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c54093784aa14146bb025b41f7ce4067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c54093784aa14146bb025b41f7ce4067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c54093784aa14146bb025b41f7ce4067"}]}] Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestNetworkAdvancedServerOps-280471232 Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: c54093784aa14146bb025b41f7ce4067 Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-280471232 Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestNetworkAdvancedServerOps-280471232-project Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 44df218d187c46489bad965cd6d0266a Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestNetworkAdvancedServerOps-280471232-project Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 3f18e082-3bec-4513-9fd2-27862cdf4eca could not be found. Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '3f18e082-3bec-4513-9fd2-27862cdf4eca'} Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f18e082-3bec-4513-9fd2-27862cdf4eca could not be found. Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f18e082-3bec-4513-9fd2-27862cdf4eca could not be found. Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:08:56.880515 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:08:56.884820 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:08:56.884820 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:08:56.884820 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:08:56.884820 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:08:56.884820 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 03:08:56.884820 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 03:08:56.884820 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f18e082-3bec-4513-9fd2-27862cdf4eca could not be found. Aug 03 03:08:56.884820 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:08:56.884820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-31f0f1f2-19bc-47c1-bac9-bef0d6b78303 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Returning 404 to user: Instance 3f18e082-3bec-4513-9fd2-27862cdf4eca could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 03:08:56.884820 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-31f0f1f2-19bc-47c1-bac9-bef0d6b78303 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca" status: 404 len: 111 microversion: 2.1 time: 0.032906 Aug 03 03:08:56.884820 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3660/7198] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:08:56 2022] GET /compute/v2.1/servers/3f18e082-3bec-4513-9fd2-27862cdf4eca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 03:09:00.295995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d1f7a37c-016d-4362-8892-be5665fc28ac tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '.version_select at 0x7f5b130c54c0>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:00.326182 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d1f7a37c-016d-4362-8892-be5665fc28ac tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1109949044" status: 202 len: 0 microversion: 2.1 time: 0.034050 Aug 03 03:09:00.327233 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3539/7199] 10.222.0.67 () {58 vars in 1284 bytes} [Wed Aug 3 03:09:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1109949044 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:09:00.355845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-81f357c9-7737-4206-8ecb-c34ad31d458e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'create', calling method: .version_select at 0x7f5b13f9e280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-915119182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjTJaztR4f+ZqHVAnMa+kEzByj6nXUyzb8WHRu8wRoxOGlt7p1PT45i5iwPh+0+PTQhGJ9IMNTsjOV6Xx5xKXJsDqWhouwvLO5prgxQdxfpJyYYXdcJ0IGREBmaOZ5EAA=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:09:00.373313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-81f357c9-7737-4206-8ecb-c34ad31d458e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for project c54093784aa14146bb025b41f7ce4067. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:09:00.380671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-81f357c9-7737-4206-8ecb-c34ad31d458e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for user 44df218d187c46489bad965cd6d0266a and project c54093784aa14146bb025b41f7ce4067. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:09:00.407929 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-81f357c9-7737-4206-8ecb-c34ad31d458e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.056103 Aug 03 03:09:00.408541 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3661/7200] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 03:09:00 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:09:06.039702 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:09:06.045449 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1871575639", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "56659310-7d90-4ecc-b289-14fa26d5ff97"}], "key_name": "tempest-TestNetworkAdvancedServerOps-915119182", "security_groups": [{"name": "tempest-secgroup-smoke-1788864504"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:09:06.240054 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] validate_networks() for [('56659310-7d90-4ecc-b289-14fa26d5ff97', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 03:09:06.782348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 03:09:06.782777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 03:09:06.783296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 03:09:06.783893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 03:09:06.784311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 03:09:06.794279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:06.794727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:06.795646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:06.796088 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:06.816583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for project c54093784aa14146bb025b41f7ce4067. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:09:06.821983 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for user 44df218d187c46489bad965cd6d0266a and project c54093784aa14146bb025b41f7ce4067. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:09:06.836544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 03:09:06.839715 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 03:09:06.894162 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b7b7d049-ee4c-422e-a0ae-e6b95d3a4600 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.856392 Aug 03 03:09:06.894854 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3540/7201] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 03:09:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 03:09:06.910942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bf4cac6a-342f-4791-b994-94bc1053e042 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:06.911604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bf4cac6a-342f-4791-b994-94bc1053e042 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:06.915250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=16 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:09:06.997938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bf4cac6a-342f-4791-b994-94bc1053e042 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:07.007352 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bf4cac6a-342f-4791-b994-94bc1053e042 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1266 microversion: 2.1 time: 0.100117 Aug 03 03:09:07.007970 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3662/7202] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:06 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:09:08.033250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e971484a-3397-4e46-be7c-01804cfad2a4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:08.034794 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e971484a-3397-4e46-be7c-01804cfad2a4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:08.049420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e971484a-3397-4e46-be7c-01804cfad2a4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:08.050656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e971484a-3397-4e46-be7c-01804cfad2a4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:08.051895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e971484a-3397-4e46-be7c-01804cfad2a4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:08.053274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e971484a-3397-4e46-be7c-01804cfad2a4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:08.161629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e971484a-3397-4e46-be7c-01804cfad2a4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:08.166340 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e971484a-3397-4e46-be7c-01804cfad2a4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1336 microversion: 2.1 time: 0.140477 Aug 03 03:09:08.175345 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3541/7203] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:08 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1336 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:09:09.199911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c3270942-75dc-4d9a-85c0-382aed4ed65e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:09.201276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c3270942-75dc-4d9a-85c0-382aed4ed65e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:09.209462 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3270942-75dc-4d9a-85c0-382aed4ed65e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:09.209941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3270942-75dc-4d9a-85c0-382aed4ed65e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:09.211175 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3270942-75dc-4d9a-85c0-382aed4ed65e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:09.212015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c3270942-75dc-4d9a-85c0-382aed4ed65e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:09.385474 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c3270942-75dc-4d9a-85c0-382aed4ed65e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:09.399429 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c3270942-75dc-4d9a-85c0-382aed4ed65e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1392 microversion: 2.1 time: 0.204520 Aug 03 03:09:09.400442 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3663/7204] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:09 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1392 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:09:09.920404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-fadb6523-762a-4019-9293-b4cabd744507 req-13bb330d-0c69-445c-8c10-d5f915ddf54c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d7976f-03c6-4feb-b2e6-9258cc3ebb48", "tag": "87497305-2476-4735-b464-9424147257fc"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:09:09.930460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-fadb6523-762a-4019-9293-b4cabd744507 req-13bb330d-0c69-445c-8c10-d5f915ddf54c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:09.931050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-fadb6523-762a-4019-9293-b4cabd744507 req-13bb330d-0c69-445c-8c10-d5f915ddf54c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:09.943698 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-fadb6523-762a-4019-9293-b4cabd744507 req-13bb330d-0c69-445c-8c10-d5f915ddf54c service nova] Creating event network-changed:87497305-2476-4735-b464-9424147257fc for instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 on n-h1-826529-8 Aug 03 03:09:09.950021 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-fadb6523-762a-4019-9293-b4cabd744507 req-13bb330d-0c69-445c-8c10-d5f915ddf54c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121958 Aug 03 03:09:09.950659 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3542/7205] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:09:10.429965 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d40b9113-a07f-445e-b2bb-25cd4a034fa5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:10.430601 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d40b9113-a07f-445e-b2bb-25cd4a034fa5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:10.438871 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d40b9113-a07f-445e-b2bb-25cd4a034fa5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:10.439378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d40b9113-a07f-445e-b2bb-25cd4a034fa5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:10.440678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d40b9113-a07f-445e-b2bb-25cd4a034fa5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:10.441286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d40b9113-a07f-445e-b2bb-25cd4a034fa5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:10.583009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d40b9113-a07f-445e-b2bb-25cd4a034fa5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:10.591551 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d40b9113-a07f-445e-b2bb-25cd4a034fa5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1392 microversion: 2.1 time: 0.165687 Aug 03 03:09:10.592136 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3664/7206] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:10 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:09:11.613895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d2bd9eb6-9b53-48f8-a4bc-4fcdbfaed1ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:11.614686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d2bd9eb6-9b53-48f8-a4bc-4fcdbfaed1ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:11.623103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2bd9eb6-9b53-48f8-a4bc-4fcdbfaed1ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:11.623567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2bd9eb6-9b53-48f8-a4bc-4fcdbfaed1ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:11.624373 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2bd9eb6-9b53-48f8-a4bc-4fcdbfaed1ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:11.624855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d2bd9eb6-9b53-48f8-a4bc-4fcdbfaed1ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:11.767640 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d2bd9eb6-9b53-48f8-a4bc-4fcdbfaed1ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:11.778433 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d2bd9eb6-9b53-48f8-a4bc-4fcdbfaed1ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1392 microversion: 2.1 time: 0.168929 Aug 03 03:09:11.779077 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3543/7207] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:11 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:09:12.800729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e28817b3-fb67-45bf-a193-2567afecad78 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:12.801441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e28817b3-fb67-45bf-a193-2567afecad78 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:12.811059 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e28817b3-fb67-45bf-a193-2567afecad78 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:12.811825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e28817b3-fb67-45bf-a193-2567afecad78 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:12.813104 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e28817b3-fb67-45bf-a193-2567afecad78 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:12.813860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e28817b3-fb67-45bf-a193-2567afecad78 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:12.960353 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e28817b3-fb67-45bf-a193-2567afecad78 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:12.968831 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e28817b3-fb67-45bf-a193-2567afecad78 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1392 microversion: 2.1 time: 0.173271 Aug 03 03:09:12.969503 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3665/7208] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:12 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:09:13.990247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-305a2105-ee98-4f16-a2a8-29b46f66a51c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:13.990892 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-305a2105-ee98-4f16-a2a8-29b46f66a51c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:13.998891 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-305a2105-ee98-4f16-a2a8-29b46f66a51c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:13.999303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-305a2105-ee98-4f16-a2a8-29b46f66a51c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:14.000087 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-305a2105-ee98-4f16-a2a8-29b46f66a51c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:14.000524 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-305a2105-ee98-4f16-a2a8-29b46f66a51c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:14.149152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-305a2105-ee98-4f16-a2a8-29b46f66a51c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:14.158269 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-305a2105-ee98-4f16-a2a8-29b46f66a51c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1392 microversion: 2.1 time: 0.171958 Aug 03 03:09:14.158841 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3544/7209] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:13 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:09:15.180140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fccba1a5-918c-418d-917e-cbcc86d280ce tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:15.180774 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fccba1a5-918c-418d-917e-cbcc86d280ce tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:15.189268 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fccba1a5-918c-418d-917e-cbcc86d280ce tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:15.189734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fccba1a5-918c-418d-917e-cbcc86d280ce tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:15.190535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fccba1a5-918c-418d-917e-cbcc86d280ce tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:15.191016 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fccba1a5-918c-418d-917e-cbcc86d280ce tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:15.326520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fccba1a5-918c-418d-917e-cbcc86d280ce tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:15.334323 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fccba1a5-918c-418d-917e-cbcc86d280ce tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1392 microversion: 2.1 time: 0.158118 Aug 03 03:09:15.334933 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3666/7210] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:15 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:09:16.107437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-4b2caca0-38ea-436d-89ec-20f9824d4e0b req-b44b0833-649d-42c2-93bf-f0e280a2185a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d7976f-03c6-4feb-b2e6-9258cc3ebb48", "name": "network-vif-plugged", "status": "completed", "tag": "87497305-2476-4735-b464-9424147257fc"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:09:16.117454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4b2caca0-38ea-436d-89ec-20f9824d4e0b req-b44b0833-649d-42c2-93bf-f0e280a2185a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:16.117895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-4b2caca0-38ea-436d-89ec-20f9824d4e0b req-b44b0833-649d-42c2-93bf-f0e280a2185a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:16.130385 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-4b2caca0-38ea-436d-89ec-20f9824d4e0b req-b44b0833-649d-42c2-93bf-f0e280a2185a service nova] Creating event network-vif-plugged:87497305-2476-4735-b464-9424147257fc for instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 on n-h1-826529-8 Aug 03 03:09:16.136710 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-4b2caca0-38ea-436d-89ec-20f9824d4e0b req-b44b0833-649d-42c2-93bf-f0e280a2185a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092971 Aug 03 03:09:16.137885 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3545/7211] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:09:16.355451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-96df50d7-71c2-4461-ad6c-7209b3126f13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:16.356088 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-96df50d7-71c2-4461-ad6c-7209b3126f13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:16.359106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:09:16.364783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96df50d7-71c2-4461-ad6c-7209b3126f13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:16.365250 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96df50d7-71c2-4461-ad6c-7209b3126f13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:16.366056 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96df50d7-71c2-4461-ad6c-7209b3126f13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:16.366509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-96df50d7-71c2-4461-ad6c-7209b3126f13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:16.513439 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-96df50d7-71c2-4461-ad6c-7209b3126f13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:16.521120 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-96df50d7-71c2-4461-ad6c-7209b3126f13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1392 microversion: 2.1 time: 0.169936 Aug 03 03:09:16.521723 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3667/7212] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:16 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:09:17.544022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0c9cfa8e-e80f-41e9-acb8-00243619b9f0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:17.544741 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0c9cfa8e-e80f-41e9-acb8-00243619b9f0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:17.546742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:09:17.547606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:09:17.554641 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c9cfa8e-e80f-41e9-acb8-00243619b9f0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:17.555207 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c9cfa8e-e80f-41e9-acb8-00243619b9f0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:17.556048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c9cfa8e-e80f-41e9-acb8-00243619b9f0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:17.556653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0c9cfa8e-e80f-41e9-acb8-00243619b9f0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:17.695691 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0c9cfa8e-e80f-41e9-acb8-00243619b9f0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:17.704309 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0c9cfa8e-e80f-41e9-acb8-00243619b9f0 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1565 microversion: 2.1 time: 0.164617 Aug 03 03:09:17.704901 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3546/7213] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:17 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:09:17.725364 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a3868194-e959-4152-94be-0161241998ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:17.726083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a3868194-e959-4152-94be-0161241998ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:17.728221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:09:17.735519 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3868194-e959-4152-94be-0161241998ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:17.735988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3868194-e959-4152-94be-0161241998ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:17.736788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3868194-e959-4152-94be-0161241998ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:17.737243 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3868194-e959-4152-94be-0161241998ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:17.870336 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a3868194-e959-4152-94be-0161241998ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:17.878636 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a3868194-e959-4152-94be-0161241998ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1565 microversion: 2.1 time: 0.157230 Aug 03 03:09:17.879373 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3668/7214] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:17 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:09:19.560748 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-68b2539e-2d92-48cb-ad96-84ed1e8b1b13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:19.561966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-68b2539e-2d92-48cb-ad96-84ed1e8b1b13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:19.569420 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68b2539e-2d92-48cb-ad96-84ed1e8b1b13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:19.569881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68b2539e-2d92-48cb-ad96-84ed1e8b1b13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:19.570070 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-837c5502-c54b-463b-a921-8f5d6739de73 req-f1a2f3c9-ccf7-4916-b075-c78ebbf618db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d7976f-03c6-4feb-b2e6-9258cc3ebb48", "tag": "87497305-2476-4735-b464-9424147257fc"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:09:19.571411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68b2539e-2d92-48cb-ad96-84ed1e8b1b13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:19.572056 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-68b2539e-2d92-48cb-ad96-84ed1e8b1b13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:19.587783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-837c5502-c54b-463b-a921-8f5d6739de73 req-f1a2f3c9-ccf7-4916-b075-c78ebbf618db service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:19.588588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-837c5502-c54b-463b-a921-8f5d6739de73 req-f1a2f3c9-ccf7-4916-b075-c78ebbf618db service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:19.608764 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-837c5502-c54b-463b-a921-8f5d6739de73 req-f1a2f3c9-ccf7-4916-b075-c78ebbf618db service nova] Creating event network-changed:87497305-2476-4735-b464-9424147257fc for instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 on n-h1-826529-8 Aug 03 03:09:19.614100 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-837c5502-c54b-463b-a921-8f5d6739de73 req-f1a2f3c9-ccf7-4916-b075-c78ebbf618db service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050087 Aug 03 03:09:19.615131 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3669/7215] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:09:19.732352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-68b2539e-2d92-48cb-ad96-84ed1e8b1b13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:19.740258 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-68b2539e-2d92-48cb-ad96-84ed1e8b1b13 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1565 microversion: 2.1 time: 0.183930 Aug 03 03:09:19.751544 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3547/7216] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:19 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1565 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:09:42.988904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=5 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:09:42.989665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=38 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:09:42.994688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ae816c94-5d90-4ad3-a3af-d6105f1c43dd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:09:42.997084 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ae816c94-5d90-4ad3-a3af-d6105f1c43dd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:43.004667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae816c94-5d90-4ad3-a3af-d6105f1c43dd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:43.005072 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae816c94-5d90-4ad3-a3af-d6105f1c43dd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:43.005884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae816c94-5d90-4ad3-a3af-d6105f1c43dd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:43.006345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ae816c94-5d90-4ad3-a3af-d6105f1c43dd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:43.062418 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ae816c94-5d90-4ad3-a3af-d6105f1c43dd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48/action" status: 200 len: 24554 microversion: 2.1 time: 0.075289 Aug 03 03:09:43.063119 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3670/7217] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:09:42 2022] POST /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48/action => generated 24554 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 03:09:54.138596 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f68cdadf-d7af-4aa5-b23a-9dc0effedf58 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:09:54.141050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f68cdadf-d7af-4aa5-b23a-9dc0effedf58 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:54.143501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:09:54.144172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=36 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:09:54.152006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f68cdadf-d7af-4aa5-b23a-9dc0effedf58 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:54.152465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f68cdadf-d7af-4aa5-b23a-9dc0effedf58 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:54.153263 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f68cdadf-d7af-4aa5-b23a-9dc0effedf58 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:54.153709 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f68cdadf-d7af-4aa5-b23a-9dc0effedf58 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:54.197972 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f68cdadf-d7af-4aa5-b23a-9dc0effedf58 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:54.204522 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f68cdadf-d7af-4aa5-b23a-9dc0effedf58 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Old instance type m1.heat2, new instance type m1.heat {{(pid=125942) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 03:09:54.210964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f68cdadf-d7af-4aa5-b23a-9dc0effedf58 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 03:09:54.211397 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f68cdadf-d7af-4aa5-b23a-9dc0effedf58 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 03:09:54.211881 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f68cdadf-d7af-4aa5-b23a-9dc0effedf58 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 03:09:54.212296 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f68cdadf-d7af-4aa5-b23a-9dc0effedf58 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 03:09:54.212710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f68cdadf-d7af-4aa5-b23a-9dc0effedf58 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 03:09:54.278667 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f68cdadf-d7af-4aa5-b23a-9dc0effedf58 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48/action" status: 202 len: 0 microversion: 2.1 time: 0.143984 Aug 03 03:09:54.279525 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3548/7218] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:09:54 2022] POST /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:09:54.289171 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0b3488a0-b679-44d0-b679-5e0a6268091c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:54.289900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0b3488a0-b679-44d0-b679-5e0a6268091c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:54.292925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:09:54.293662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:09:54.300357 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b3488a0-b679-44d0-b679-5e0a6268091c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:54.300837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b3488a0-b679-44d0-b679-5e0a6268091c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:54.301678 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b3488a0-b679-44d0-b679-5e0a6268091c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:54.302139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0b3488a0-b679-44d0-b679-5e0a6268091c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:54.443365 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0b3488a0-b679-44d0-b679-5e0a6268091c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:54.451325 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0b3488a0-b679-44d0-b679-5e0a6268091c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1693 microversion: 2.1 time: 0.166521 Aug 03 03:09:54.451918 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3671/7219] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:54 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:09:55.474438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b8eebd50-ea4f-4a87-922b-e7194534959d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:55.475034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b8eebd50-ea4f-4a87-922b-e7194534959d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:55.482068 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8eebd50-ea4f-4a87-922b-e7194534959d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:55.482531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8eebd50-ea4f-4a87-922b-e7194534959d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:55.483348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8eebd50-ea4f-4a87-922b-e7194534959d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:55.483791 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b8eebd50-ea4f-4a87-922b-e7194534959d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:55.922511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b8eebd50-ea4f-4a87-922b-e7194534959d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:55.930988 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b8eebd50-ea4f-4a87-922b-e7194534959d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1693 microversion: 2.1 time: 0.460776 Aug 03 03:09:55.931576 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3549/7220] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:55 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1693 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:09:56.953125 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c66e8e9d-97cb-4992-87a8-f9a4ff106453 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:56.953758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c66e8e9d-97cb-4992-87a8-f9a4ff106453 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:56.962690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c66e8e9d-97cb-4992-87a8-f9a4ff106453 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:56.963192 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c66e8e9d-97cb-4992-87a8-f9a4ff106453 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:56.963992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c66e8e9d-97cb-4992-87a8-f9a4ff106453 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:56.964449 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c66e8e9d-97cb-4992-87a8-f9a4ff106453 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:57.098420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c66e8e9d-97cb-4992-87a8-f9a4ff106453 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:57.105962 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c66e8e9d-97cb-4992-87a8-f9a4ff106453 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1698 microversion: 2.1 time: 0.156813 Aug 03 03:09:57.106539 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3672/7221] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:56 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:09:58.127745 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7ef088d9-c271-460f-938e-413fde3d58ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:58.128368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7ef088d9-c271-460f-938e-413fde3d58ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:58.135611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ef088d9-c271-460f-938e-413fde3d58ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:58.136181 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ef088d9-c271-460f-938e-413fde3d58ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:58.137010 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ef088d9-c271-460f-938e-413fde3d58ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:58.137458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7ef088d9-c271-460f-938e-413fde3d58ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:58.275607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7ef088d9-c271-460f-938e-413fde3d58ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:58.284357 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7ef088d9-c271-460f-938e-413fde3d58ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1698 microversion: 2.1 time: 0.160541 Aug 03 03:09:58.285009 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3550/7222] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:58 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:09:59.306086 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0d475860-5ce6-49f5-94ff-026adea7c3fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:09:59.306729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0d475860-5ce6-49f5-94ff-026adea7c3fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:09:59.313843 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d475860-5ce6-49f5-94ff-026adea7c3fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:59.314975 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d475860-5ce6-49f5-94ff-026adea7c3fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:59.315832 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d475860-5ce6-49f5-94ff-026adea7c3fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:09:59.316325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0d475860-5ce6-49f5-94ff-026adea7c3fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:09:59.452440 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0d475860-5ce6-49f5-94ff-026adea7c3fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:09:59.462887 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0d475860-5ce6-49f5-94ff-026adea7c3fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1698 microversion: 2.1 time: 0.160724 Aug 03 03:09:59.463497 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3673/7223] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:09:59 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:00.485756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-40d861fd-8919-4482-8c95-bfd9c7c63a76 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:00.486492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-40d861fd-8919-4482-8c95-bfd9c7c63a76 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:00.493118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40d861fd-8919-4482-8c95-bfd9c7c63a76 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:00.493581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40d861fd-8919-4482-8c95-bfd9c7c63a76 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:00.494377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40d861fd-8919-4482-8c95-bfd9c7c63a76 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:00.494825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-40d861fd-8919-4482-8c95-bfd9c7c63a76 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:00.637595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-40d861fd-8919-4482-8c95-bfd9c7c63a76 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:00.646284 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-40d861fd-8919-4482-8c95-bfd9c7c63a76 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1698 microversion: 2.1 time: 0.165016 Aug 03 03:10:00.646958 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3551/7224] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:00 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1698 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:01.668182 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-71227032-1dc1-4de9-9e51-a0fb93608fb1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:01.668811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-71227032-1dc1-4de9-9e51-a0fb93608fb1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:01.676011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-71227032-1dc1-4de9-9e51-a0fb93608fb1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:01.676483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-71227032-1dc1-4de9-9e51-a0fb93608fb1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:01.677280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-71227032-1dc1-4de9-9e51-a0fb93608fb1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:01.677746 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-71227032-1dc1-4de9-9e51-a0fb93608fb1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:01.820040 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-71227032-1dc1-4de9-9e51-a0fb93608fb1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:01.827904 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-71227032-1dc1-4de9-9e51-a0fb93608fb1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1698 microversion: 2.1 time: 0.163760 Aug 03 03:10:01.828494 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3674/7225] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:01 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:10:02.849180 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c1465b7a-a124-460b-87a8-c556c354dff8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:02.849846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c1465b7a-a124-460b-87a8-c556c354dff8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:02.857024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1465b7a-a124-460b-87a8-c556c354dff8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:02.857520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1465b7a-a124-460b-87a8-c556c354dff8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:02.858319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1465b7a-a124-460b-87a8-c556c354dff8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:02.858771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1465b7a-a124-460b-87a8-c556c354dff8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:02.998043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c1465b7a-a124-460b-87a8-c556c354dff8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:03.005881 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c1465b7a-a124-460b-87a8-c556c354dff8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1698 microversion: 2.1 time: 0.161209 Aug 03 03:10:03.006456 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3552/7226] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:02 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:04.028206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a9e90cb0-6978-4747-a8c5-35c0f71b51e7 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:04.028765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a9e90cb0-6978-4747-a8c5-35c0f71b51e7 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:04.036021 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9e90cb0-6978-4747-a8c5-35c0f71b51e7 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:04.036497 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9e90cb0-6978-4747-a8c5-35c0f71b51e7 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:04.037288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9e90cb0-6978-4747-a8c5-35c0f71b51e7 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:04.037748 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a9e90cb0-6978-4747-a8c5-35c0f71b51e7 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:04.176213 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a9e90cb0-6978-4747-a8c5-35c0f71b51e7 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:04.183861 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a9e90cb0-6978-4747-a8c5-35c0f71b51e7 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1698 microversion: 2.1 time: 0.159935 Aug 03 03:10:04.184448 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3675/7227] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:04 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:05.207283 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-63b8177d-ee59-4e5d-a775-68aae2de56c1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:05.207907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-63b8177d-ee59-4e5d-a775-68aae2de56c1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:05.215306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63b8177d-ee59-4e5d-a775-68aae2de56c1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:05.215923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63b8177d-ee59-4e5d-a775-68aae2de56c1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:05.216713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63b8177d-ee59-4e5d-a775-68aae2de56c1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:05.217155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-63b8177d-ee59-4e5d-a775-68aae2de56c1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:05.376329 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-63b8177d-ee59-4e5d-a775-68aae2de56c1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:05.384651 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-63b8177d-ee59-4e5d-a775-68aae2de56c1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1698 microversion: 2.1 time: 0.181759 Aug 03 03:10:05.385532 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3553/7228] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:05 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1698 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:06.406444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-35c3707a-de32-4f4b-a456-811fcb244c75 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:06.407014 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-35c3707a-de32-4f4b-a456-811fcb244c75 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:06.414386 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35c3707a-de32-4f4b-a456-811fcb244c75 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:06.414860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35c3707a-de32-4f4b-a456-811fcb244c75 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:06.415685 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35c3707a-de32-4f4b-a456-811fcb244c75 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:06.416146 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35c3707a-de32-4f4b-a456-811fcb244c75 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:06.557012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-35c3707a-de32-4f4b-a456-811fcb244c75 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:06.565734 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-35c3707a-de32-4f4b-a456-811fcb244c75 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1698 microversion: 2.1 time: 0.163555 Aug 03 03:10:06.566323 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3676/7229] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:06 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:07.587281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f200f50d-57fe-44c8-a0ca-cf780b303371 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:07.587950 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f200f50d-57fe-44c8-a0ca-cf780b303371 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:07.594893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f200f50d-57fe-44c8-a0ca-cf780b303371 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:07.595372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f200f50d-57fe-44c8-a0ca-cf780b303371 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:07.596920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f200f50d-57fe-44c8-a0ca-cf780b303371 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:07.597361 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f200f50d-57fe-44c8-a0ca-cf780b303371 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:07.730800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f200f50d-57fe-44c8-a0ca-cf780b303371 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:07.739317 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f200f50d-57fe-44c8-a0ca-cf780b303371 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1698 microversion: 2.1 time: 0.156010 Aug 03 03:10:07.739889 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3554/7230] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:07 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:08.760600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e0183a37-b54c-41ed-a888-e6685503e96c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:08.761265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e0183a37-b54c-41ed-a888-e6685503e96c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:08.768814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0183a37-b54c-41ed-a888-e6685503e96c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:08.769284 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0183a37-b54c-41ed-a888-e6685503e96c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:08.770069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0183a37-b54c-41ed-a888-e6685503e96c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:08.770525 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e0183a37-b54c-41ed-a888-e6685503e96c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:08.904447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e0183a37-b54c-41ed-a888-e6685503e96c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:08.912105 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e0183a37-b54c-41ed-a888-e6685503e96c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1698 microversion: 2.1 time: 0.155486 Aug 03 03:10:08.912688 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3677/7231] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:08 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:09.933551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-07b94450-f4d9-4195-a7ec-c72c0e45dcc5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:09.934177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-07b94450-f4d9-4195-a7ec-c72c0e45dcc5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:09.941678 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07b94450-f4d9-4195-a7ec-c72c0e45dcc5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:09.942143 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07b94450-f4d9-4195-a7ec-c72c0e45dcc5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:09.942961 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07b94450-f4d9-4195-a7ec-c72c0e45dcc5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:09.943415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-07b94450-f4d9-4195-a7ec-c72c0e45dcc5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:10.085384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-07b94450-f4d9-4195-a7ec-c72c0e45dcc5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:10.093291 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-07b94450-f4d9-4195-a7ec-c72c0e45dcc5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1698 microversion: 2.1 time: 0.163691 Aug 03 03:10:10.093857 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3555/7232] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:09 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:11.116209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-757393d9-2782-4b57-bfc2-c63fa81f5cc4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:11.116899 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-757393d9-2782-4b57-bfc2-c63fa81f5cc4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:11.124240 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-757393d9-2782-4b57-bfc2-c63fa81f5cc4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:11.124711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-757393d9-2782-4b57-bfc2-c63fa81f5cc4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:11.125522 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-757393d9-2782-4b57-bfc2-c63fa81f5cc4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:11.125978 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-757393d9-2782-4b57-bfc2-c63fa81f5cc4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:11.268453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-757393d9-2782-4b57-bfc2-c63fa81f5cc4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:11.276842 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-757393d9-2782-4b57-bfc2-c63fa81f5cc4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1698 microversion: 2.1 time: 0.165484 Aug 03 03:10:11.277434 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3678/7233] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:11 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:12.299403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8d8a0dae-47ea-4510-80e5-26b19a1d7501 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:12.300173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8d8a0dae-47ea-4510-80e5-26b19a1d7501 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:12.307355 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d8a0dae-47ea-4510-80e5-26b19a1d7501 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:12.307817 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d8a0dae-47ea-4510-80e5-26b19a1d7501 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:12.308614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d8a0dae-47ea-4510-80e5-26b19a1d7501 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:12.309051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8d8a0dae-47ea-4510-80e5-26b19a1d7501 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:12.458065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8d8a0dae-47ea-4510-80e5-26b19a1d7501 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:12.465974 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8d8a0dae-47ea-4510-80e5-26b19a1d7501 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1698 microversion: 2.1 time: 0.171005 Aug 03 03:10:12.466565 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3556/7234] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:12 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1698 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:13.487828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8d40fc2f-ab87-404d-9a55-bf1affa618f1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:13.488456 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8d40fc2f-ab87-404d-9a55-bf1affa618f1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:13.495719 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d40fc2f-ab87-404d-9a55-bf1affa618f1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:13.496186 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d40fc2f-ab87-404d-9a55-bf1affa618f1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:13.496990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d40fc2f-ab87-404d-9a55-bf1affa618f1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:13.497448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8d40fc2f-ab87-404d-9a55-bf1affa618f1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:13.650019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8d40fc2f-ab87-404d-9a55-bf1affa618f1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:13.657830 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8d40fc2f-ab87-404d-9a55-bf1affa618f1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1698 microversion: 2.1 time: 0.174044 Aug 03 03:10:13.666794 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3679/7235] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:13 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1698 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:14.207154 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-b0124356-6350-47d6-b198-03188b71d732 req-240277c9-7882-4843-b25d-b2b2bddbec08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d7976f-03c6-4feb-b2e6-9258cc3ebb48", "name": "network-vif-unplugged", "status": "completed", "tag": "87497305-2476-4735-b464-9424147257fc"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:10:14.218538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b0124356-6350-47d6-b198-03188b71d732 req-240277c9-7882-4843-b25d-b2b2bddbec08 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:14.219097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-b0124356-6350-47d6-b198-03188b71d732 req-240277c9-7882-4843-b25d-b2b2bddbec08 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:14.232413 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-b0124356-6350-47d6-b198-03188b71d732 req-240277c9-7882-4843-b25d-b2b2bddbec08 service nova] Creating event network-vif-unplugged:87497305-2476-4735-b464-9424147257fc for instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 on n-h2-826529-8 Aug 03 03:10:14.239770 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [req-b0124356-6350-47d6-b198-03188b71d732 req-240277c9-7882-4843-b25d-b2b2bddbec08 service nova] Instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 03:10:14.250706 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-b0124356-6350-47d6-b198-03188b71d732 req-240277c9-7882-4843-b25d-b2b2bddbec08 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047500 Aug 03 03:10:14.251522 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3557/7236] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 03:10:14.682811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-de983d05-a016-487e-90d4-fdc8d63160ad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:14.683475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-de983d05-a016-487e-90d4-fdc8d63160ad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:14.690716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de983d05-a016-487e-90d4-fdc8d63160ad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:14.691210 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de983d05-a016-487e-90d4-fdc8d63160ad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:14.692096 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de983d05-a016-487e-90d4-fdc8d63160ad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:14.692489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-de983d05-a016-487e-90d4-fdc8d63160ad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:14.833692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-de983d05-a016-487e-90d4-fdc8d63160ad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:14.841541 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-de983d05-a016-487e-90d4-fdc8d63160ad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1697 microversion: 2.1 time: 0.163661 Aug 03 03:10:14.842234 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3680/7237] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:14 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:15.865086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8941da9d-d66c-4d7d-9331-c2b786beb998 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:15.865798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8941da9d-d66c-4d7d-9331-c2b786beb998 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:15.872257 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8941da9d-d66c-4d7d-9331-c2b786beb998 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:15.872722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8941da9d-d66c-4d7d-9331-c2b786beb998 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:15.873507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8941da9d-d66c-4d7d-9331-c2b786beb998 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:15.873958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8941da9d-d66c-4d7d-9331-c2b786beb998 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:16.010706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8941da9d-d66c-4d7d-9331-c2b786beb998 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:16.018439 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8941da9d-d66c-4d7d-9331-c2b786beb998 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1695 microversion: 2.1 time: 0.158585 Aug 03 03:10:16.019048 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3558/7238] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:15 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:16.291676 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-e09e9c66-6608-474a-a9f9-d543b28c7946 req-621724de-4929-433d-b8e4-08d7783a51c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d7976f-03c6-4feb-b2e6-9258cc3ebb48", "tag": "87497305-2476-4735-b464-9424147257fc"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:10:16.302141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e09e9c66-6608-474a-a9f9-d543b28c7946 req-621724de-4929-433d-b8e4-08d7783a51c9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:16.302605 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e09e9c66-6608-474a-a9f9-d543b28c7946 req-621724de-4929-433d-b8e4-08d7783a51c9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:16.314317 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-e09e9c66-6608-474a-a9f9-d543b28c7946 req-621724de-4929-433d-b8e4-08d7783a51c9 service nova] Creating event network-changed:87497305-2476-4735-b464-9424147257fc for instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 on n-h2-826529-8 Aug 03 03:10:16.319822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [req-e09e9c66-6608-474a-a9f9-d543b28c7946 req-621724de-4929-433d-b8e4-08d7783a51c9 service nova] Instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826529-8', 'n-h2-826529-8'} {{(pid=125941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 03:10:16.332417 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-e09e9c66-6608-474a-a9f9-d543b28c7946 req-621724de-4929-433d-b8e4-08d7783a51c9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044417 Aug 03 03:10:16.333029 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3681/7239] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:10:17.040309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0b1ff9dc-147b-47ab-b502-d4d66d12690a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:17.040995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0b1ff9dc-147b-47ab-b502-d4d66d12690a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:17.048272 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b1ff9dc-147b-47ab-b502-d4d66d12690a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:17.048659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b1ff9dc-147b-47ab-b502-d4d66d12690a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:17.050140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b1ff9dc-147b-47ab-b502-d4d66d12690a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:17.050754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0b1ff9dc-147b-47ab-b502-d4d66d12690a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:17.194981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0b1ff9dc-147b-47ab-b502-d4d66d12690a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:17.202727 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0b1ff9dc-147b-47ab-b502-d4d66d12690a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1692 microversion: 2.1 time: 0.166347 Aug 03 03:10:17.203421 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3559/7240] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:17 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:17.224736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-83259343-1041-4c39-ba2b-45d9b11b384f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:10:17.225509 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-83259343-1041-4c39-ba2b-45d9b11b384f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:17.232022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83259343-1041-4c39-ba2b-45d9b11b384f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:17.232495 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83259343-1041-4c39-ba2b-45d9b11b384f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:17.233278 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83259343-1041-4c39-ba2b-45d9b11b384f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:17.233730 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-83259343-1041-4c39-ba2b-45d9b11b384f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:17.293781 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-83259343-1041-4c39-ba2b-45d9b11b384f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48/action" status: 204 len: 0 microversion: 2.1 time: 0.073934 Aug 03 03:10:17.294541 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3682/7241] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:10:17 2022] POST /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 03:10:17.304140 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b4c1fb1a-d201-4559-b068-858b53b281f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:17.304767 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b4c1fb1a-d201-4559-b068-858b53b281f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:17.311249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4c1fb1a-d201-4559-b068-858b53b281f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:17.311783 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4c1fb1a-d201-4559-b068-858b53b281f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:17.312566 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4c1fb1a-d201-4559-b068-858b53b281f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:17.313084 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4c1fb1a-d201-4559-b068-858b53b281f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:17.457802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b4c1fb1a-d201-4559-b068-858b53b281f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:17.465509 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b4c1fb1a-d201-4559-b068-858b53b281f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1692 microversion: 2.1 time: 0.166832 Aug 03 03:10:17.466096 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3560/7242] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:17 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:17.487961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a194f5e3-9774-4b08-b1f8-7223fb317aad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:17.488673 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a194f5e3-9774-4b08-b1f8-7223fb317aad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:17.495010 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a194f5e3-9774-4b08-b1f8-7223fb317aad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:17.495480 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a194f5e3-9774-4b08-b1f8-7223fb317aad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:17.496271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a194f5e3-9774-4b08-b1f8-7223fb317aad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:17.496886 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a194f5e3-9774-4b08-b1f8-7223fb317aad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:17.636231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a194f5e3-9774-4b08-b1f8-7223fb317aad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:17.645333 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a194f5e3-9774-4b08-b1f8-7223fb317aad tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1692 microversion: 2.1 time: 0.163038 Aug 03 03:10:17.645931 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3683/7243] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:17 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:18.666719 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5c624c46-0593-4ba4-b9c4-3aa30544d4c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:18.667279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5c624c46-0593-4ba4-b9c4-3aa30544d4c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:18.674291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c624c46-0593-4ba4-b9c4-3aa30544d4c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:18.674755 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c624c46-0593-4ba4-b9c4-3aa30544d4c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:18.675560 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c624c46-0593-4ba4-b9c4-3aa30544d4c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:18.676006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5c624c46-0593-4ba4-b9c4-3aa30544d4c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:18.817000 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5c624c46-0593-4ba4-b9c4-3aa30544d4c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:18.825066 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5c624c46-0593-4ba4-b9c4-3aa30544d4c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1684 microversion: 2.1 time: 0.162301 Aug 03 03:10:18.825640 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3561/7244] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:18 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:21.009842 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-5bf52982-0ac8-4de5-a5b1-0b4ff4c595a8 req-deaf6f7a-a23a-4337-bacd-8b389a0266d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d7976f-03c6-4feb-b2e6-9258cc3ebb48", "name": "network-vif-plugged", "status": "completed", "tag": "87497305-2476-4735-b464-9424147257fc"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:10:21.021819 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5bf52982-0ac8-4de5-a5b1-0b4ff4c595a8 req-deaf6f7a-a23a-4337-bacd-8b389a0266d0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:21.022290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-5bf52982-0ac8-4de5-a5b1-0b4ff4c595a8 req-deaf6f7a-a23a-4337-bacd-8b389a0266d0 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:21.033970 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-5bf52982-0ac8-4de5-a5b1-0b4ff4c595a8 req-deaf6f7a-a23a-4337-bacd-8b389a0266d0 service nova] Creating event network-vif-plugged:87497305-2476-4735-b464-9424147257fc for instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 on n-h2-826529-8 Aug 03 03:10:21.038984 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-5bf52982-0ac8-4de5-a5b1-0b4ff4c595a8 req-deaf6f7a-a23a-4337-bacd-8b389a0266d0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033127 Aug 03 03:10:21.039744 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3684/7245] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:10:43.022795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a9e902bb-2238-4eda-846c-700f5824a992 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:10:43.025234 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a9e902bb-2238-4eda-846c-700f5824a992 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:43.027649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=32 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:10:43.028315 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:10:43.034482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9e902bb-2238-4eda-846c-700f5824a992 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:43.034966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9e902bb-2238-4eda-846c-700f5824a992 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:43.035804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9e902bb-2238-4eda-846c-700f5824a992 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:43.036286 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a9e902bb-2238-4eda-846c-700f5824a992 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:43.089374 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a9e902bb-2238-4eda-846c-700f5824a992 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48/action" status: 200 len: 24578 microversion: 2.1 time: 0.070902 Aug 03 03:10:43.090038 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3562/7246] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:10:43 2022] POST /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48/action => generated 24578 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 03:10:50.142406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=28 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:10:50.143234 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:10:50.147486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-640be3e7-079a-41f0-af37-daeb85692cec req-353a059f-fb77-4343-9687-5a3e1a7cb86c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d7976f-03c6-4feb-b2e6-9258cc3ebb48", "tag": "87497305-2476-4735-b464-9424147257fc"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:10:50.147947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c12f438f-5009-4b17-9f15-fda3cdd724ec tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:50.148538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c12f438f-5009-4b17-9f15-fda3cdd724ec tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:50.158169 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c12f438f-5009-4b17-9f15-fda3cdd724ec tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:50.158681 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c12f438f-5009-4b17-9f15-fda3cdd724ec tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:50.159055 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-640be3e7-079a-41f0-af37-daeb85692cec req-353a059f-fb77-4343-9687-5a3e1a7cb86c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:50.159475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c12f438f-5009-4b17-9f15-fda3cdd724ec tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:50.159585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-640be3e7-079a-41f0-af37-daeb85692cec req-353a059f-fb77-4343-9687-5a3e1a7cb86c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:50.159932 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c12f438f-5009-4b17-9f15-fda3cdd724ec tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:50.174159 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-640be3e7-079a-41f0-af37-daeb85692cec req-353a059f-fb77-4343-9687-5a3e1a7cb86c service nova] Creating event network-changed:87497305-2476-4735-b464-9424147257fc for instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 on n-h2-826529-8 Aug 03 03:10:50.181839 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-640be3e7-079a-41f0-af37-daeb85692cec req-353a059f-fb77-4343-9687-5a3e1a7cb86c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038500 Aug 03 03:10:50.183699 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3563/7247] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:10:50.199058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c12f438f-5009-4b17-9f15-fda3cdd724ec tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 03:10:50.325818 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c12f438f-5009-4b17-9f15-fda3cdd724ec tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "DELETE /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 204 len: 0 microversion: 2.1 time: 0.184511 Aug 03 03:10:50.326772 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3685/7248] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 03:10:50 2022] DELETE /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 03:10:50.335189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-667bcab2-72fb-4381-a6f1-8de91df5692e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:50.335896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-667bcab2-72fb-4381-a6f1-8de91df5692e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:50.343814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-667bcab2-72fb-4381-a6f1-8de91df5692e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:50.344271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-667bcab2-72fb-4381-a6f1-8de91df5692e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:50.345063 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-667bcab2-72fb-4381-a6f1-8de91df5692e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:50.345575 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-667bcab2-72fb-4381-a6f1-8de91df5692e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:50.488203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-667bcab2-72fb-4381-a6f1-8de91df5692e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:50.496155 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-667bcab2-72fb-4381-a6f1-8de91df5692e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1690 microversion: 2.1 time: 0.165093 Aug 03 03:10:50.496857 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3564/7249] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:50 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:51.525437 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bba1303e-e564-42f7-ba51-d7c8c579506e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:51.526868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bba1303e-e564-42f7-ba51-d7c8c579506e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:51.534465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bba1303e-e564-42f7-ba51-d7c8c579506e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:51.535048 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bba1303e-e564-42f7-ba51-d7c8c579506e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:51.535918 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bba1303e-e564-42f7-ba51-d7c8c579506e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:51.536478 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bba1303e-e564-42f7-ba51-d7c8c579506e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:51.703131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bba1303e-e564-42f7-ba51-d7c8c579506e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:51.711087 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bba1303e-e564-42f7-ba51-d7c8c579506e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1690 microversion: 2.1 time: 0.190117 Aug 03 03:10:51.711838 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3686/7250] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:51 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:10:52.422201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d1312d96-0cc2-4e47-b6ea-15bdb5634452 req-f8fe3f05-08e6-4269-9ee4-a97a32397102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d7976f-03c6-4feb-b2e6-9258cc3ebb48", "name": "network-vif-deleted", "tag": "87497305-2476-4735-b464-9424147257fc"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:10:52.434490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d1312d96-0cc2-4e47-b6ea-15bdb5634452 req-f8fe3f05-08e6-4269-9ee4-a97a32397102 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:52.434932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d1312d96-0cc2-4e47-b6ea-15bdb5634452 req-f8fe3f05-08e6-4269-9ee4-a97a32397102 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:52.449238 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d1312d96-0cc2-4e47-b6ea-15bdb5634452 req-f8fe3f05-08e6-4269-9ee4-a97a32397102 service nova] Creating event network-vif-deleted:87497305-2476-4735-b464-9424147257fc for instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 on n-h2-826529-8 Aug 03 03:10:52.454445 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d1312d96-0cc2-4e47-b6ea-15bdb5634452 req-f8fe3f05-08e6-4269-9ee4-a97a32397102 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112277 Aug 03 03:10:52.455146 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3565/7251] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:10:52.735574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6264c5dc-b8b5-4c60-a623-66cfac924fea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:52.736512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6264c5dc-b8b5-4c60-a623-66cfac924fea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:52.752438 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6264c5dc-b8b5-4c60-a623-66cfac924fea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:52.752941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6264c5dc-b8b5-4c60-a623-66cfac924fea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:52.753948 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6264c5dc-b8b5-4c60-a623-66cfac924fea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:52.754413 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6264c5dc-b8b5-4c60-a623-66cfac924fea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:52.801936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6264c5dc-b8b5-4c60-a623-66cfac924fea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:52.802422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6264c5dc-b8b5-4c60-a623-66cfac924fea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:52.803266 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-6264c5dc-b8b5-4c60-a623-66cfac924fea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lazy-loading 'fault' on Instance uuid 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 03:10:52.856379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6264c5dc-b8b5-4c60-a623-66cfac924fea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:10:52.865722 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6264c5dc-b8b5-4c60-a623-66cfac924fea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 200 len: 1356 microversion: 2.1 time: 0.134505 Aug 03 03:10:52.866231 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3687/7252] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:52 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 1356 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:10:53.937895 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eebc9c99-4149-430d-b2aa-3b982529bc5a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:53.938653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eebc9c99-4149-430d-b2aa-3b982529bc5a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 86d7976f-03c6-4feb-b2e6-9258cc3ebb48] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:10:53.945002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eebc9c99-4149-430d-b2aa-3b982529bc5a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:53.945460 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eebc9c99-4149-430d-b2aa-3b982529bc5a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:53.946241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eebc9c99-4149-430d-b2aa-3b982529bc5a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:10:53.946683 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eebc9c99-4149-430d-b2aa-3b982529bc5a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:10:53.960651 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-eebc9c99-4149-430d-b2aa-3b982529bc5a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] HTTP exception thrown: Instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 could not be found. Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eebc9c99-4149-430d-b2aa-3b982529bc5a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Request method failure captured: Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 HTTP/1.1 Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eYRZcrYqn2ty7DONXuF2HUsCy9Tk6-nTi0ZXK99YSTeT1qlh867JeQ00loRexm5dFP-D1x5FSzJk8i8-zmuDFsD8UXFrpZZXx5rUxqORh5YT3u9BnNBjDjn0tOpv8YtQ4Bhdjr-teA_UAFNdQWDWRqd_io91Y_O1YGoIN7HAcGgup8 Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c54093784aa14146bb025b41f7ce4067 Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-280471232 Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c54093784aa14146bb025b41f7ce4067", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c54093784aa14146bb025b41f7ce4067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c54093784aa14146bb025b41f7ce4067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c54093784aa14146bb025b41f7ce4067"}]}] Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestNetworkAdvancedServerOps-280471232 Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c54093784aa14146bb025b41f7ce4067 Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-280471232 Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestNetworkAdvancedServerOps-280471232-project Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 44df218d187c46489bad965cd6d0266a Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestNetworkAdvancedServerOps-280471232-project Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 could not be found. Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '86d7976f-03c6-4feb-b2e6-9258cc3ebb48'} Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 could not be found. Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 could not be found. Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:10:53.962291 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:10:53.966812 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:10:53.966812 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:10:53.966812 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:10:53.966812 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:10:53.966812 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 03:10:53.966812 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 03:10:53.966812 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 could not be found. Aug 03 03:10:53.966812 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:10:53.966812 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eebc9c99-4149-430d-b2aa-3b982529bc5a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Returning 404 to user: Instance 86d7976f-03c6-4feb-b2e6-9258cc3ebb48 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 03:10:53.966812 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eebc9c99-4149-430d-b2aa-3b982529bc5a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48" status: 404 len: 111 microversion: 2.1 time: 0.079787 Aug 03 03:10:53.966812 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3566/7253] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:10:53 2022] GET /compute/v2.1/servers/86d7976f-03c6-4feb-b2e6-9258cc3ebb48 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 03:10:57.531863 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-871891dd-c913-4589-84f9-0a4ee0f87dcf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '.version_select at 0x7f5b1030bdc0>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:10:57.560916 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-871891dd-c913-4589-84f9-0a4ee0f87dcf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-915119182" status: 202 len: 0 microversion: 2.1 time: 0.032501 Aug 03 03:10:57.562490 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3688/7254] 10.222.0.67 () {58 vars in 1281 bytes} [Wed Aug 3 03:10:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-915119182 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:10:57.586777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5a9fcda8-3ed4-4194-a4b2-89559b925404 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'create', calling method: .version_select at 0x7f5b244da790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1866417498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOkNz+NdUoJ8B4SxtO6L6VioSiT5nV9pIJoniw0LbnFEQ6sUUiArMF//Gq3Ie3PM68ymS8F0FS5+jjWE+kPqT7QtOZnS5O+cmq3g/EkxB+x+ixCvEkzgTBmUAD7yxctig=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:10:57.610214 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-5a9fcda8-3ed4-4194-a4b2-89559b925404 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for project c54093784aa14146bb025b41f7ce4067. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:10:57.616160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-5a9fcda8-3ed4-4194-a4b2-89559b925404 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for user 44df218d187c46489bad965cd6d0266a and project c54093784aa14146bb025b41f7ce4067. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:10:57.646964 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5a9fcda8-3ed4-4194-a4b2-89559b925404 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.064050 Aug 03 03:10:57.647582 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3567/7255] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 03:10:57 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 03:11:04.091376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:11:04.096201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-263196054", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "a8e27104-1801-46ba-9be7-0212584032cd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1866417498", "security_groups": [{"name": "tempest-secgroup-smoke-400854183"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:11:04.246346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] validate_networks() for [('a8e27104-1801-46ba-9be7-0212584032cd', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 03:11:04.825435 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 03:11:04.825866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 03:11:04.826354 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 03:11:04.826814 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 03:11:04.827371 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 03:11:04.837566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:04.838033 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:04.838931 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:04.839718 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:04.858856 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for project c54093784aa14146bb025b41f7ce4067. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:11:04.864785 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for user 44df218d187c46489bad965cd6d0266a and project c54093784aa14146bb025b41f7ce4067. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:11:04.879901 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 03:11:04.882582 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 03:11:04.930877 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a3c459dd-a5d7-45e9-8d0f-58cb4f7d27ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.841424 Aug 03 03:11:04.934952 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3689/7256] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 03:11:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 03:11:04.944298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ed76fcdc-9892-4e97-86b1-18617c786d84 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:04.945020 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ed76fcdc-9892-4e97-86b1-18617c786d84 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:04.949225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=16 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:11:05.021320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ed76fcdc-9892-4e97-86b1-18617c786d84 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:05.029834 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ed76fcdc-9892-4e97-86b1-18617c786d84 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1266 microversion: 2.1 time: 0.089558 Aug 03 03:11:05.030402 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3568/7257] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:04 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:06.059506 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-649bce51-127f-459d-8951-9f770627014b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:06.061817 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-649bce51-127f-459d-8951-9f770627014b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:06.070641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-649bce51-127f-459d-8951-9f770627014b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:06.071666 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-649bce51-127f-459d-8951-9f770627014b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:06.072765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-649bce51-127f-459d-8951-9f770627014b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:06.073598 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-649bce51-127f-459d-8951-9f770627014b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:06.158516 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-649bce51-127f-459d-8951-9f770627014b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:06.168929 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-649bce51-127f-459d-8951-9f770627014b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1326 microversion: 2.1 time: 0.114674 Aug 03 03:11:06.169634 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3690/7258] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:06 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:07.193564 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1b99a94d-ee6b-47fa-ada1-6442ef73fb03 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:07.194312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1b99a94d-ee6b-47fa-ada1-6442ef73fb03 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:07.204970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b99a94d-ee6b-47fa-ada1-6442ef73fb03 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:07.205403 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b99a94d-ee6b-47fa-ada1-6442ef73fb03 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:07.206252 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b99a94d-ee6b-47fa-ada1-6442ef73fb03 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:07.206777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1b99a94d-ee6b-47fa-ada1-6442ef73fb03 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:07.378422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1b99a94d-ee6b-47fa-ada1-6442ef73fb03 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:07.390886 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1b99a94d-ee6b-47fa-ada1-6442ef73fb03 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1391 microversion: 2.1 time: 0.200797 Aug 03 03:11:07.391541 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3569/7259] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:07 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1391 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:11:07.684926 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-08efdd7e-f15a-4532-9c5b-14acc7b30dbf req-f5089527-192e-457e-8631-1d326ec265ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5d1e52-b02e-4449-86e3-182797295c42", "tag": "125a8224-f96c-4566-975f-ebf87c2d417c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:11:07.699633 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-08efdd7e-f15a-4532-9c5b-14acc7b30dbf req-f5089527-192e-457e-8631-1d326ec265ca service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:07.700121 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-08efdd7e-f15a-4532-9c5b-14acc7b30dbf req-f5089527-192e-457e-8631-1d326ec265ca service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:07.712439 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-08efdd7e-f15a-4532-9c5b-14acc7b30dbf req-f5089527-192e-457e-8631-1d326ec265ca service nova] Creating event network-changed:125a8224-f96c-4566-975f-ebf87c2d417c for instance ff5d1e52-b02e-4449-86e3-182797295c42 on n-h1-826529-8 Aug 03 03:11:07.718252 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-08efdd7e-f15a-4532-9c5b-14acc7b30dbf req-f5089527-192e-457e-8631-1d326ec265ca service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037689 Aug 03 03:11:07.719273 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3691/7260] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:11:08.414734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3c8a2646-f6c6-4115-ab1a-c335582917eb tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:08.415514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3c8a2646-f6c6-4115-ab1a-c335582917eb tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:08.423850 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c8a2646-f6c6-4115-ab1a-c335582917eb tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:08.424321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c8a2646-f6c6-4115-ab1a-c335582917eb tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:08.425122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c8a2646-f6c6-4115-ab1a-c335582917eb tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:08.425626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c8a2646-f6c6-4115-ab1a-c335582917eb tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:08.564377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3c8a2646-f6c6-4115-ab1a-c335582917eb tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:08.572033 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3c8a2646-f6c6-4115-ab1a-c335582917eb tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1391 microversion: 2.1 time: 0.162016 Aug 03 03:11:08.572602 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3570/7261] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:08 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:09.596127 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-305810af-2025-49c7-8c77-302de0e9361c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:09.596850 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-305810af-2025-49c7-8c77-302de0e9361c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:09.603348 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-305810af-2025-49c7-8c77-302de0e9361c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:09.603828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-305810af-2025-49c7-8c77-302de0e9361c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:09.605332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-305810af-2025-49c7-8c77-302de0e9361c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:09.605799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-305810af-2025-49c7-8c77-302de0e9361c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:09.744031 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-305810af-2025-49c7-8c77-302de0e9361c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:09.752430 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-305810af-2025-49c7-8c77-302de0e9361c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1391 microversion: 2.1 time: 0.161722 Aug 03 03:11:09.753030 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3692/7262] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:09 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:10.775645 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5f0c4c6a-a2c7-43e2-9ddb-2ede8f184472 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:10.776245 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5f0c4c6a-a2c7-43e2-9ddb-2ede8f184472 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:10.784001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f0c4c6a-a2c7-43e2-9ddb-2ede8f184472 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:10.784500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f0c4c6a-a2c7-43e2-9ddb-2ede8f184472 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:10.785298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f0c4c6a-a2c7-43e2-9ddb-2ede8f184472 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:10.785746 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5f0c4c6a-a2c7-43e2-9ddb-2ede8f184472 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:10.928282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5f0c4c6a-a2c7-43e2-9ddb-2ede8f184472 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:10.937215 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5f0c4c6a-a2c7-43e2-9ddb-2ede8f184472 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1391 microversion: 2.1 time: 0.166259 Aug 03 03:11:10.937690 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3571/7263] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:10 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:11.957739 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4d5d0791-3001-4cc4-a604-1e9dfb61301d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:11.958367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4d5d0791-3001-4cc4-a604-1e9dfb61301d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:11.966967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d5d0791-3001-4cc4-a604-1e9dfb61301d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:11.967443 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d5d0791-3001-4cc4-a604-1e9dfb61301d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:11.968238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d5d0791-3001-4cc4-a604-1e9dfb61301d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:11.968695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4d5d0791-3001-4cc4-a604-1e9dfb61301d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:12.108672 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4d5d0791-3001-4cc4-a604-1e9dfb61301d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:12.116256 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4d5d0791-3001-4cc4-a604-1e9dfb61301d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1391 microversion: 2.1 time: 0.162438 Aug 03 03:11:12.116853 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3693/7264] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:11 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:12.483104 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ef29cecd-8884-4b92-ba4b-01609f247786 req-ce939863-81ba-41d0-8c4f-7801ed37e1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5d1e52-b02e-4449-86e3-182797295c42", "name": "network-vif-plugged", "status": "completed", "tag": "125a8224-f96c-4566-975f-ebf87c2d417c"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:11:12.496311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ef29cecd-8884-4b92-ba4b-01609f247786 req-ce939863-81ba-41d0-8c4f-7801ed37e1fb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:12.496807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ef29cecd-8884-4b92-ba4b-01609f247786 req-ce939863-81ba-41d0-8c4f-7801ed37e1fb service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:12.509067 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ef29cecd-8884-4b92-ba4b-01609f247786 req-ce939863-81ba-41d0-8c4f-7801ed37e1fb service nova] Creating event network-vif-plugged:125a8224-f96c-4566-975f-ebf87c2d417c for instance ff5d1e52-b02e-4449-86e3-182797295c42 on n-h1-826529-8 Aug 03 03:11:12.515358 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ef29cecd-8884-4b92-ba4b-01609f247786 req-ce939863-81ba-41d0-8c4f-7801ed37e1fb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036509 Aug 03 03:11:12.515970 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3572/7265] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:11:13.138256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-232ee039-2297-4f49-9ab1-1ddd4d391617 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:13.138833 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-232ee039-2297-4f49-9ab1-1ddd4d391617 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:13.146131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-232ee039-2297-4f49-9ab1-1ddd4d391617 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:13.146600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-232ee039-2297-4f49-9ab1-1ddd4d391617 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:13.147431 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-232ee039-2297-4f49-9ab1-1ddd4d391617 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:13.147885 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-232ee039-2297-4f49-9ab1-1ddd4d391617 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:13.287137 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-232ee039-2297-4f49-9ab1-1ddd4d391617 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:13.296151 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-232ee039-2297-4f49-9ab1-1ddd4d391617 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1391 microversion: 2.1 time: 0.162382 Aug 03 03:11:13.296741 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3694/7266] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:13 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:14.319167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b818eedf-72ca-427e-b833-71c45aff016e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:14.319875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b818eedf-72ca-427e-b833-71c45aff016e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:14.322680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:11:14.329701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b818eedf-72ca-427e-b833-71c45aff016e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:14.330157 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b818eedf-72ca-427e-b833-71c45aff016e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:14.330960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b818eedf-72ca-427e-b833-71c45aff016e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:14.331404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b818eedf-72ca-427e-b833-71c45aff016e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:14.474059 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b818eedf-72ca-427e-b833-71c45aff016e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:14.482405 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b818eedf-72ca-427e-b833-71c45aff016e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1564 microversion: 2.1 time: 0.167600 Aug 03 03:11:14.483017 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3573/7267] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:14 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:14.505155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-02150712-7470-468f-8449-32b2340c4332 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:14.505805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-02150712-7470-468f-8449-32b2340c4332 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:14.513641 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02150712-7470-468f-8449-32b2340c4332 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:14.514143 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02150712-7470-468f-8449-32b2340c4332 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:14.514959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02150712-7470-468f-8449-32b2340c4332 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:14.515422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-02150712-7470-468f-8449-32b2340c4332 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:14.662889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-02150712-7470-468f-8449-32b2340c4332 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:14.672224 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-02150712-7470-468f-8449-32b2340c4332 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1564 microversion: 2.1 time: 0.170922 Aug 03 03:11:14.672722 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3695/7268] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:14 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:16.373642 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-425ec7e2-4994-45c1-8bbb-b11cdfb2a12c req-652bafbf-b200-447f-b05e-37d8c7474c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5d1e52-b02e-4449-86e3-182797295c42", "tag": "125a8224-f96c-4566-975f-ebf87c2d417c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:11:16.377222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-918ac770-273c-4df0-a9b1-01736d797183 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:16.377859 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-918ac770-273c-4df0-a9b1-01736d797183 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:16.380288 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:11:16.384360 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:11:16.390714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-918ac770-273c-4df0-a9b1-01736d797183 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:16.391209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-918ac770-273c-4df0-a9b1-01736d797183 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:16.392009 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-918ac770-273c-4df0-a9b1-01736d797183 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:16.392451 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-918ac770-273c-4df0-a9b1-01736d797183 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:16.397617 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:11:16.406069 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-425ec7e2-4994-45c1-8bbb-b11cdfb2a12c req-652bafbf-b200-447f-b05e-37d8c7474c3e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:16.406540 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-425ec7e2-4994-45c1-8bbb-b11cdfb2a12c req-652bafbf-b200-447f-b05e-37d8c7474c3e service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:16.419813 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-425ec7e2-4994-45c1-8bbb-b11cdfb2a12c req-652bafbf-b200-447f-b05e-37d8c7474c3e service nova] Creating event network-changed:125a8224-f96c-4566-975f-ebf87c2d417c for instance ff5d1e52-b02e-4449-86e3-182797295c42 on n-h1-826529-8 Aug 03 03:11:16.425185 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-425ec7e2-4994-45c1-8bbb-b11cdfb2a12c req-652bafbf-b200-447f-b05e-37d8c7474c3e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056218 Aug 03 03:11:16.426250 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3696/7269] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:11:16.547012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-918ac770-273c-4df0-a9b1-01736d797183 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:16.554720 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-918ac770-273c-4df0-a9b1-01736d797183 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1564 microversion: 2.1 time: 0.191090 Aug 03 03:11:16.555330 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3574/7270] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:16 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1564 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:38.903595 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0deaeace-4605-4bc2-9e5b-c5ff320f4cda tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:11:38.905967 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0deaeace-4605-4bc2-9e5b-c5ff320f4cda tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:38.908251 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:11:38.909015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=36 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:11:38.916465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0deaeace-4605-4bc2-9e5b-c5ff320f4cda tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:38.916938 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0deaeace-4605-4bc2-9e5b-c5ff320f4cda tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:38.918349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0deaeace-4605-4bc2-9e5b-c5ff320f4cda tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:38.918812 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0deaeace-4605-4bc2-9e5b-c5ff320f4cda tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:38.973280 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0deaeace-4605-4bc2-9e5b-c5ff320f4cda tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42/action" status: 200 len: 24572 microversion: 2.1 time: 0.075472 Aug 03 03:11:38.974151 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3697/7271] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:11:38 2022] POST /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42/action => generated 24572 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 03:11:50.053177 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c3a0a3cf-7e04-4211-99ae-826671757563 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:11:50.055489 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:11:50.056199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=32 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:11:50.062321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3a0a3cf-7e04-4211-99ae-826671757563 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:50.062780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c3a0a3cf-7e04-4211-99ae-826671757563 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:50.086482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c3a0a3cf-7e04-4211-99ae-826671757563 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Going to try to stop instance {{(pid=125942) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 03:11:50.134212 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c3a0a3cf-7e04-4211-99ae-826671757563 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42/action" status: 202 len: 0 microversion: 2.1 time: 0.084904 Aug 03 03:11:50.135352 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3575/7272] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:11:50 2022] POST /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:11:50.149222 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-48c32e7e-6ae6-4ca4-ac71-76aaba1318ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:50.150576 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-48c32e7e-6ae6-4ca4-ac71-76aaba1318ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:50.156514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:11:50.157545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:11:50.166882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48c32e7e-6ae6-4ca4-ac71-76aaba1318ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:50.167376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48c32e7e-6ae6-4ca4-ac71-76aaba1318ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:50.168199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48c32e7e-6ae6-4ca4-ac71-76aaba1318ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:50.168841 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-48c32e7e-6ae6-4ca4-ac71-76aaba1318ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:50.312861 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-48c32e7e-6ae6-4ca4-ac71-76aaba1318ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:50.320651 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-48c32e7e-6ae6-4ca4-ac71-76aaba1318ea tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1693 microversion: 2.1 time: 0.179689 Aug 03 03:11:50.321218 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3698/7273] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:50 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1693 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:51.345965 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-70ff20a0-bbbc-403d-b4f3-f1b1598c42b5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:51.346731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-70ff20a0-bbbc-403d-b4f3-f1b1598c42b5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:51.353447 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-70ff20a0-bbbc-403d-b4f3-f1b1598c42b5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:51.353902 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-70ff20a0-bbbc-403d-b4f3-f1b1598c42b5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:51.354688 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-70ff20a0-bbbc-403d-b4f3-f1b1598c42b5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:51.355300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-70ff20a0-bbbc-403d-b4f3-f1b1598c42b5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:51.519931 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-70ff20a0-bbbc-403d-b4f3-f1b1598c42b5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:51.529760 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-70ff20a0-bbbc-403d-b4f3-f1b1598c42b5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1693 microversion: 2.1 time: 0.189024 Aug 03 03:11:51.539156 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3576/7274] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:51 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1693 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:11:52.550840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-806b2fa4-10d4-44c5-a294-36b2ca1a9452 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:52.551511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-806b2fa4-10d4-44c5-a294-36b2ca1a9452 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:52.558648 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-806b2fa4-10d4-44c5-a294-36b2ca1a9452 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:52.559188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-806b2fa4-10d4-44c5-a294-36b2ca1a9452 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:52.560229 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-806b2fa4-10d4-44c5-a294-36b2ca1a9452 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:52.560695 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-806b2fa4-10d4-44c5-a294-36b2ca1a9452 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:52.703027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-806b2fa4-10d4-44c5-a294-36b2ca1a9452 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:52.710720 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-806b2fa4-10d4-44c5-a294-36b2ca1a9452 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1693 microversion: 2.1 time: 0.163862 Aug 03 03:11:52.711326 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3699/7275] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:52 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:53.733962 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f9b316fe-8dfd-46c5-8cdf-11a359b18455 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:53.734589 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f9b316fe-8dfd-46c5-8cdf-11a359b18455 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:53.742034 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9b316fe-8dfd-46c5-8cdf-11a359b18455 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:53.742496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9b316fe-8dfd-46c5-8cdf-11a359b18455 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:53.743308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9b316fe-8dfd-46c5-8cdf-11a359b18455 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:53.743760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f9b316fe-8dfd-46c5-8cdf-11a359b18455 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:53.879981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f9b316fe-8dfd-46c5-8cdf-11a359b18455 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:53.889008 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f9b316fe-8dfd-46c5-8cdf-11a359b18455 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1693 microversion: 2.1 time: 0.159788 Aug 03 03:11:53.889595 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3577/7276] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:53 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:54.911895 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f7b78aa1-1daa-49df-b6a3-2c15c968c05d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:54.912517 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f7b78aa1-1daa-49df-b6a3-2c15c968c05d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:54.919669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7b78aa1-1daa-49df-b6a3-2c15c968c05d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:54.920140 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7b78aa1-1daa-49df-b6a3-2c15c968c05d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:54.920943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7b78aa1-1daa-49df-b6a3-2c15c968c05d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:54.921405 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f7b78aa1-1daa-49df-b6a3-2c15c968c05d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:55.062990 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f7b78aa1-1daa-49df-b6a3-2c15c968c05d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:55.070696 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f7b78aa1-1daa-49df-b6a3-2c15c968c05d tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1693 microversion: 2.1 time: 0.162677 Aug 03 03:11:55.071322 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3700/7277] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:54 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:56.093258 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-80be739d-ac2d-42c7-baaf-d1afca0393fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:56.093883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-80be739d-ac2d-42c7-baaf-d1afca0393fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:56.101176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80be739d-ac2d-42c7-baaf-d1afca0393fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:56.101632 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80be739d-ac2d-42c7-baaf-d1afca0393fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:56.102416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80be739d-ac2d-42c7-baaf-d1afca0393fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:56.102860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80be739d-ac2d-42c7-baaf-d1afca0393fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:56.245620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-80be739d-ac2d-42c7-baaf-d1afca0393fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:56.254051 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-80be739d-ac2d-42c7-baaf-d1afca0393fe tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1693 microversion: 2.1 time: 0.165377 Aug 03 03:11:56.254639 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3578/7278] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:56 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:57.276936 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ec6c52f7-78ab-40b1-9923-8b90986851ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:57.277476 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ec6c52f7-78ab-40b1-9923-8b90986851ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:57.285155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec6c52f7-78ab-40b1-9923-8b90986851ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:57.285657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec6c52f7-78ab-40b1-9923-8b90986851ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:57.286444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec6c52f7-78ab-40b1-9923-8b90986851ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:57.286924 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ec6c52f7-78ab-40b1-9923-8b90986851ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:57.429742 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ec6c52f7-78ab-40b1-9923-8b90986851ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:57.437660 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ec6c52f7-78ab-40b1-9923-8b90986851ca tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1693 microversion: 2.1 time: 0.165046 Aug 03 03:11:57.438249 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3701/7279] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:57 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:58.462155 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6edd327d-8da3-4756-abc2-45b8255c84cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:58.463062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6edd327d-8da3-4756-abc2-45b8255c84cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:58.472828 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6edd327d-8da3-4756-abc2-45b8255c84cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:58.473294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6edd327d-8da3-4756-abc2-45b8255c84cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:58.474096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6edd327d-8da3-4756-abc2-45b8255c84cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:58.474557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6edd327d-8da3-4756-abc2-45b8255c84cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:58.612622 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6edd327d-8da3-4756-abc2-45b8255c84cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:58.620301 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6edd327d-8da3-4756-abc2-45b8255c84cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1693 microversion: 2.1 time: 0.165100 Aug 03 03:11:58.620886 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3579/7280] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:58 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:11:59.641875 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1138f63d-b603-4046-b728-19bf73ab1cda tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:11:59.642501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1138f63d-b603-4046-b728-19bf73ab1cda tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:11:59.649113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1138f63d-b603-4046-b728-19bf73ab1cda tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:59.649577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1138f63d-b603-4046-b728-19bf73ab1cda tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:59.650356 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1138f63d-b603-4046-b728-19bf73ab1cda tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:11:59.651087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1138f63d-b603-4046-b728-19bf73ab1cda tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:11:59.790142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1138f63d-b603-4046-b728-19bf73ab1cda tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:11:59.798715 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1138f63d-b603-4046-b728-19bf73ab1cda tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1693 microversion: 2.1 time: 0.161462 Aug 03 03:11:59.799338 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3702/7281] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:11:59 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:12:00.821681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-c1a0c58d-00ee-4aad-960f-348e0c2da9cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:00.822300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-c1a0c58d-00ee-4aad-960f-348e0c2da9cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:00.829580 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1a0c58d-00ee-4aad-960f-348e0c2da9cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:00.830041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1a0c58d-00ee-4aad-960f-348e0c2da9cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:00.830825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1a0c58d-00ee-4aad-960f-348e0c2da9cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:00.831302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-c1a0c58d-00ee-4aad-960f-348e0c2da9cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:00.972885 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-c1a0c58d-00ee-4aad-960f-348e0c2da9cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:00.980531 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-c1a0c58d-00ee-4aad-960f-348e0c2da9cf tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1693 microversion: 2.1 time: 0.163019 Aug 03 03:12:00.981148 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3580/7282] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:00 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:12:02.002401 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5c73f76c-c595-4cea-b69d-af544416a6b9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:02.003047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5c73f76c-c595-4cea-b69d-af544416a6b9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:02.010309 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c73f76c-c595-4cea-b69d-af544416a6b9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:02.010770 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c73f76c-c595-4cea-b69d-af544416a6b9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:02.011668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c73f76c-c595-4cea-b69d-af544416a6b9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:02.012855 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5c73f76c-c595-4cea-b69d-af544416a6b9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:02.152066 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5c73f76c-c595-4cea-b69d-af544416a6b9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:02.160214 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5c73f76c-c595-4cea-b69d-af544416a6b9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1693 microversion: 2.1 time: 0.162472 Aug 03 03:12:02.160798 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3703/7283] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:01 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:12:03.182354 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b4bdcbfc-bbe2-4c9e-8787-53a1e7fdea2e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:03.182875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b4bdcbfc-bbe2-4c9e-8787-53a1e7fdea2e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:03.190213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4bdcbfc-bbe2-4c9e-8787-53a1e7fdea2e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:03.190671 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4bdcbfc-bbe2-4c9e-8787-53a1e7fdea2e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:03.191481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4bdcbfc-bbe2-4c9e-8787-53a1e7fdea2e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:03.191923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b4bdcbfc-bbe2-4c9e-8787-53a1e7fdea2e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:03.335360 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b4bdcbfc-bbe2-4c9e-8787-53a1e7fdea2e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:03.350965 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b4bdcbfc-bbe2-4c9e-8787-53a1e7fdea2e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1693 microversion: 2.1 time: 0.172116 Aug 03 03:12:03.352084 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3581/7284] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:03 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:12:04.383248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7e0bbd6b-f18d-420e-8d92-c5d7cb11de17 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:04.383898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7e0bbd6b-f18d-420e-8d92-c5d7cb11de17 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:04.391697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd6b-f18d-420e-8d92-c5d7cb11de17 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:04.392233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd6b-f18d-420e-8d92-c5d7cb11de17 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:04.393049 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd6b-f18d-420e-8d92-c5d7cb11de17 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:04.393502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7e0bbd6b-f18d-420e-8d92-c5d7cb11de17 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:04.527489 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7e0bbd6b-f18d-420e-8d92-c5d7cb11de17 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:04.536712 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7e0bbd6b-f18d-420e-8d92-c5d7cb11de17 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1693 microversion: 2.1 time: 0.157370 Aug 03 03:12:04.537321 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3704/7285] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:04 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:12:05.558495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d6811f99-89c4-47d3-8715-b8c00e75b2f8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:05.559697 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d6811f99-89c4-47d3-8715-b8c00e75b2f8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:05.567266 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6811f99-89c4-47d3-8715-b8c00e75b2f8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:05.567730 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6811f99-89c4-47d3-8715-b8c00e75b2f8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:05.568518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6811f99-89c4-47d3-8715-b8c00e75b2f8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:05.568968 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6811f99-89c4-47d3-8715-b8c00e75b2f8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:05.706611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d6811f99-89c4-47d3-8715-b8c00e75b2f8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:05.714114 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d6811f99-89c4-47d3-8715-b8c00e75b2f8 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1670 microversion: 2.1 time: 0.159581 Aug 03 03:12:05.714686 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3582/7286] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:05 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:12:06.811020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-725a8df8-7888-462c-b316-6e031c5f595f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:12:06.813237 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-725a8df8-7888-462c-b316-6e031c5f595f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:06.820177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-725a8df8-7888-462c-b316-6e031c5f595f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:06.820640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-725a8df8-7888-462c-b316-6e031c5f595f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:06.821415 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-725a8df8-7888-462c-b316-6e031c5f595f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:06.821860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-725a8df8-7888-462c-b316-6e031c5f595f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:06.877067 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-725a8df8-7888-462c-b316-6e031c5f595f tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42/action" status: 200 len: 38405 microversion: 2.1 time: 0.070104 Aug 03 03:12:06.877738 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3705/7287] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:12:06 2022] POST /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42/action => generated 38405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 03:12:06.890073 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-92a90241-6745-4b93-a0f9-51790cf3ef69 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:12:06.897541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92a90241-6745-4b93-a0f9-51790cf3ef69 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:06.897995 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-92a90241-6745-4b93-a0f9-51790cf3ef69 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:06.920390 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-92a90241-6745-4b93-a0f9-51790cf3ef69 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Going to try to start instance {{(pid=125942) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 03:12:06.963196 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-92a90241-6745-4b93-a0f9-51790cf3ef69 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42/action" status: 202 len: 0 microversion: 2.1 time: 0.077520 Aug 03 03:12:06.963826 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3583/7288] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:12:06 2022] POST /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:12:06.973006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-81869f0b-a888-4193-a6b7-83ccd35e0215 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:06.973760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-81869f0b-a888-4193-a6b7-83ccd35e0215 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:06.981172 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81869f0b-a888-4193-a6b7-83ccd35e0215 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:06.981645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81869f0b-a888-4193-a6b7-83ccd35e0215 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:06.982749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81869f0b-a888-4193-a6b7-83ccd35e0215 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:06.983242 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-81869f0b-a888-4193-a6b7-83ccd35e0215 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:07.133625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-81869f0b-a888-4193-a6b7-83ccd35e0215 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:07.141669 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-81869f0b-a888-4193-a6b7-83ccd35e0215 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1679 microversion: 2.1 time: 0.172911 Aug 03 03:12:07.142267 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3706/7289] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:06 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:12:08.165673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a861b513-0c2b-444c-98a8-45565bb02cfa tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:08.166381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a861b513-0c2b-444c-98a8-45565bb02cfa tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:08.172973 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a861b513-0c2b-444c-98a8-45565bb02cfa tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:08.173425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a861b513-0c2b-444c-98a8-45565bb02cfa tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:08.174205 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a861b513-0c2b-444c-98a8-45565bb02cfa tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:08.174646 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a861b513-0c2b-444c-98a8-45565bb02cfa tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:08.330051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a861b513-0c2b-444c-98a8-45565bb02cfa tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:08.337657 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a861b513-0c2b-444c-98a8-45565bb02cfa tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1683 microversion: 2.1 time: 0.177504 Aug 03 03:12:08.338224 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3584/7290] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:08 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:12:32.550220 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6aa37dd2-37a9-4ee7-b17f-7e8153f1d5a2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:12:32.552562 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6aa37dd2-37a9-4ee7-b17f-7e8153f1d5a2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:32.556441 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=18 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:12:32.557118 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=52 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:12:32.563873 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6aa37dd2-37a9-4ee7-b17f-7e8153f1d5a2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:32.564362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6aa37dd2-37a9-4ee7-b17f-7e8153f1d5a2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:32.565290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6aa37dd2-37a9-4ee7-b17f-7e8153f1d5a2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:32.565806 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6aa37dd2-37a9-4ee7-b17f-7e8153f1d5a2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:32.620663 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6aa37dd2-37a9-4ee7-b17f-7e8153f1d5a2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42/action" status: 200 len: 62969 microversion: 2.1 time: 0.074980 Aug 03 03:12:32.621342 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3707/7291] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:12:32 2022] POST /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42/action => generated 62969 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 03:12:39.785809 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:12:39.786773 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 03:12:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:12:40.010457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-be25ad84-17b9-4c92-a7aa-4d25fc291879 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:40.011178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-be25ad84-17b9-4c92-a7aa-4d25fc291879 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:40.012941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-e8d6df08-ffe3-4970-8dc5-8f843b0cc55d req-bc40bcc7-0835-4fc7-ac7e-88e74e50f992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5d1e52-b02e-4449-86e3-182797295c42", "tag": "125a8224-f96c-4566-975f-ebf87c2d417c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:12:40.013841 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=20 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:12:40.015035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:12:40.022884 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be25ad84-17b9-4c92-a7aa-4d25fc291879 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:40.023618 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be25ad84-17b9-4c92-a7aa-4d25fc291879 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:40.024567 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be25ad84-17b9-4c92-a7aa-4d25fc291879 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:40.025189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be25ad84-17b9-4c92-a7aa-4d25fc291879 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:40.027858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e8d6df08-ffe3-4970-8dc5-8f843b0cc55d req-bc40bcc7-0835-4fc7-ac7e-88e74e50f992 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:40.027858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e8d6df08-ffe3-4970-8dc5-8f843b0cc55d req-bc40bcc7-0835-4fc7-ac7e-88e74e50f992 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:40.041175 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-e8d6df08-ffe3-4970-8dc5-8f843b0cc55d req-bc40bcc7-0835-4fc7-ac7e-88e74e50f992 service nova] Creating event network-changed:125a8224-f96c-4566-975f-ebf87c2d417c for instance ff5d1e52-b02e-4449-86e3-182797295c42 on n-h1-826529-8 Aug 03 03:12:40.047351 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-e8d6df08-ffe3-4970-8dc5-8f843b0cc55d req-bc40bcc7-0835-4fc7-ac7e-88e74e50f992 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038214 Aug 03 03:12:40.049022 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3708/7292] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:12:40.055754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-be25ad84-17b9-4c92-a7aa-4d25fc291879 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 03:12:40.169554 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-be25ad84-17b9-4c92-a7aa-4d25fc291879 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 204 len: 0 microversion: 2.1 time: 0.161790 Aug 03 03:12:40.170352 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3585/7293] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 03:12:40 2022] DELETE /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 03:12:40.181538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c1387aa5-3a12-4bcf-891d-d925b7324437 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:40.182346 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c1387aa5-3a12-4bcf-891d-d925b7324437 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:40.190047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1387aa5-3a12-4bcf-891d-d925b7324437 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:40.190702 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1387aa5-3a12-4bcf-891d-d925b7324437 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:40.191668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1387aa5-3a12-4bcf-891d-d925b7324437 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:40.194206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c1387aa5-3a12-4bcf-891d-d925b7324437 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:40.352011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c1387aa5-3a12-4bcf-891d-d925b7324437 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:40.359858 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c1387aa5-3a12-4bcf-891d-d925b7324437 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1689 microversion: 2.1 time: 0.183427 Aug 03 03:12:40.360621 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3709/7294] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:40 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:12:41.382958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-eca46a32-51ba-43c9-a5dc-2d1437e19764 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:41.383666 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-eca46a32-51ba-43c9-a5dc-2d1437e19764 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:41.390782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eca46a32-51ba-43c9-a5dc-2d1437e19764 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:41.391290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eca46a32-51ba-43c9-a5dc-2d1437e19764 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:41.392804 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eca46a32-51ba-43c9-a5dc-2d1437e19764 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:41.393346 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-eca46a32-51ba-43c9-a5dc-2d1437e19764 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:41.531416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-eca46a32-51ba-43c9-a5dc-2d1437e19764 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:41.539239 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-eca46a32-51ba-43c9-a5dc-2d1437e19764 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1689 microversion: 2.1 time: 0.160618 Aug 03 03:12:41.539821 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3586/7295] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:41 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:12:42.458432 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-da85bb09-1b1f-43c0-a2b5-cd06be1ab37e req-724b5a14-7538-4c33-a20d-1c00e84de72f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5d1e52-b02e-4449-86e3-182797295c42", "name": "network-vif-deleted", "tag": "125a8224-f96c-4566-975f-ebf87c2d417c"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:12:42.469711 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-da85bb09-1b1f-43c0-a2b5-cd06be1ab37e req-724b5a14-7538-4c33-a20d-1c00e84de72f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:42.470770 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-da85bb09-1b1f-43c0-a2b5-cd06be1ab37e req-724b5a14-7538-4c33-a20d-1c00e84de72f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:42.483823 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-da85bb09-1b1f-43c0-a2b5-cd06be1ab37e req-724b5a14-7538-4c33-a20d-1c00e84de72f service nova] Creating event network-vif-deleted:125a8224-f96c-4566-975f-ebf87c2d417c for instance ff5d1e52-b02e-4449-86e3-182797295c42 on n-h1-826529-8 Aug 03 03:12:42.488916 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-da85bb09-1b1f-43c0-a2b5-cd06be1ab37e req-724b5a14-7538-4c33-a20d-1c00e84de72f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034935 Aug 03 03:12:42.489715 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3710/7296] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:12:42.561649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-04096839-0180-48a9-9a1d-e987fb31485a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:42.562201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-04096839-0180-48a9-9a1d-e987fb31485a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:42.569583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04096839-0180-48a9-9a1d-e987fb31485a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:42.570172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04096839-0180-48a9-9a1d-e987fb31485a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:42.571002 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04096839-0180-48a9-9a1d-e987fb31485a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:42.571445 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04096839-0180-48a9-9a1d-e987fb31485a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:42.604305 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04096839-0180-48a9-9a1d-e987fb31485a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:42.604753 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-04096839-0180-48a9-9a1d-e987fb31485a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:42.605202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-04096839-0180-48a9-9a1d-e987fb31485a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lazy-loading 'fault' on Instance uuid ff5d1e52-b02e-4449-86e3-182797295c42 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 03:12:42.647808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-04096839-0180-48a9-9a1d-e987fb31485a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:42.656058 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-04096839-0180-48a9-9a1d-e987fb31485a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 200 len: 1356 microversion: 2.1 time: 0.098288 Aug 03 03:12:42.656641 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3587/7297] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:42 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 1356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:12:43.680018 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f9e975eb-9b69-42a1-8824-e6deb0a48ad9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:43.680734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f9e975eb-9b69-42a1-8824-e6deb0a48ad9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: ff5d1e52-b02e-4449-86e3-182797295c42] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:43.687168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9e975eb-9b69-42a1-8824-e6deb0a48ad9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:43.687637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9e975eb-9b69-42a1-8824-e6deb0a48ad9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:43.688430 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9e975eb-9b69-42a1-8824-e6deb0a48ad9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:43.689392 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f9e975eb-9b69-42a1-8824-e6deb0a48ad9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:43.702764 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-f9e975eb-9b69-42a1-8824-e6deb0a48ad9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] HTTP exception thrown: Instance ff5d1e52-b02e-4449-86e3-182797295c42 could not be found. Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f9e975eb-9b69-42a1-8824-e6deb0a48ad9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Request method failure captured: Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 HTTP/1.1 Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eYRZcrYqn2ty7DONXuF2HUsCy9Tk6-nTi0ZXK99YSTeT1qlh867JeQ00loRexm5dFP-D1x5FSzJk8i8-zmuDFsD8UXFrpZZXx5rUxqORh5YT3u9BnNBjDjn0tOpv8YtQ4Bhdjr-teA_UAFNdQWDWRqd_io91Y_O1YGoIN7HAcGgup8 Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: c54093784aa14146bb025b41f7ce4067 Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-280471232 Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c54093784aa14146bb025b41f7ce4067", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c54093784aa14146bb025b41f7ce4067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c54093784aa14146bb025b41f7ce4067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c54093784aa14146bb025b41f7ce4067"}]}] Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestNetworkAdvancedServerOps-280471232 Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: c54093784aa14146bb025b41f7ce4067 Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-280471232 Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestNetworkAdvancedServerOps-280471232-project Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 44df218d187c46489bad965cd6d0266a Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestNetworkAdvancedServerOps-280471232-project Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance ff5d1e52-b02e-4449-86e3-182797295c42 could not be found. Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'ff5d1e52-b02e-4449-86e3-182797295c42'} Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5d1e52-b02e-4449-86e3-182797295c42 could not be found. Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5d1e52-b02e-4449-86e3-182797295c42 could not be found. Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:12:43.705112 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:12:43.709271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:12:43.709271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:12:43.709271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:12:43.709271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:12:43.709271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 03:12:43.709271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 03:12:43.709271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5d1e52-b02e-4449-86e3-182797295c42 could not be found. Aug 03 03:12:43.709271 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:12:43.709271 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f9e975eb-9b69-42a1-8824-e6deb0a48ad9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Returning 404 to user: Instance ff5d1e52-b02e-4449-86e3-182797295c42 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 03:12:43.709271 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f9e975eb-9b69-42a1-8824-e6deb0a48ad9 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42" status: 404 len: 111 microversion: 2.1 time: 0.031802 Aug 03 03:12:43.709271 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3711/7298] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:43 2022] GET /compute/v2.1/servers/ff5d1e52-b02e-4449-86e3-182797295c42 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 03:12:47.078554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4f17e82d-d4d7-42a5-9012-287d769d0cbc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '.version_select at 0x7f5b2445c430>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:47.106990 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4f17e82d-d4d7-42a5-9012-287d769d0cbc tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1866417498" status: 202 len: 0 microversion: 2.1 time: 0.034315 Aug 03 03:12:47.107604 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3588/7299] 10.222.0.67 () {58 vars in 1284 bytes} [Wed Aug 3 03:12:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1866417498 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:12:47.140367 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-13cc50ba-b0b5-4ddd-bac9-dde372c4f203 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'create', calling method: .version_select at 0x7f5b21c05e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2105039415", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwU08JhG/HmeNRpIYz4OwHgtPiqe88xqAjLUV9pJFCxs093kJhxHEyXrqC0TpUEjrqgJ2xbPX5PrNVqqMC4j9SQuha36KJuBNfusLExyvE4VA7RnkTCnD1uoCIRM5VeQA=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:12:47.157015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-13cc50ba-b0b5-4ddd-bac9-dde372c4f203 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for project c54093784aa14146bb025b41f7ce4067. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:12:47.163712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-13cc50ba-b0b5-4ddd-bac9-dde372c4f203 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for user 44df218d187c46489bad965cd6d0266a and project c54093784aa14146bb025b41f7ce4067. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:12:47.187422 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-13cc50ba-b0b5-4ddd-bac9-dde372c4f203 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050864 Aug 03 03:12:47.188035 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3712/7300] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 03:12:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:12:53.158100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-545615932", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "networks": [{"uuid": "bbe09523-6acb-4eeb-bc2b-4ee544f3d375"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2105039415", "security_groups": [{"name": "tempest-secgroup-smoke-1917036205"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:12:53.169538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:12:53.292096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] validate_networks() for [('bbe09523-6acb-4eeb-bc2b-4ee544f3d375', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 03:12:53.741539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 03:12:53.742022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 03:12:53.742511 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 03:12:53.743024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 03:12:53.743378 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 03:12:53.754495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:53.755369 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:53.756270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:53.756782 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:53.782030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for project c54093784aa14146bb025b41f7ce4067. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:12:53.789583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Getting quotas for user 44df218d187c46489bad965cd6d0266a and project c54093784aa14146bb025b41f7ce4067. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:12:53.803964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 03:12:53.806520 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 03:12:53.859138 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-80cd850e-dd78-406d-9aec-f8238bf5f4da tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.706461 Aug 03 03:12:53.860063 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3589/7301] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 03:12:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 03:12:53.870267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=16 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:12:53.879434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-00c0c405-7719-4c86-9694-7ebe70936a71 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:53.880701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-00c0c405-7719-4c86-9694-7ebe70936a71 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:53.959900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-00c0c405-7719-4c86-9694-7ebe70936a71 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:53.969507 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-00c0c405-7719-4c86-9694-7ebe70936a71 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1266 microversion: 2.1 time: 0.100116 Aug 03 03:12:53.978550 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3713/7302] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:53 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:12:54.994318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-67b663cc-9c29-4daf-8d84-48224401d4f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:54.995527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-67b663cc-9c29-4daf-8d84-48224401d4f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:55.006539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67b663cc-9c29-4daf-8d84-48224401d4f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:55.007128 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67b663cc-9c29-4daf-8d84-48224401d4f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:55.008175 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67b663cc-9c29-4daf-8d84-48224401d4f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:55.008883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-67b663cc-9c29-4daf-8d84-48224401d4f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:55.082733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-67b663cc-9c29-4daf-8d84-48224401d4f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:55.091285 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-67b663cc-9c29-4daf-8d84-48224401d4f5 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1324 microversion: 2.1 time: 0.103934 Aug 03 03:12:55.091874 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3590/7303] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:54 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1324 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:12:56.113933 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-27211925-6893-48d3-ad2b-4e99b4b748c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:56.114569 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-27211925-6893-48d3-ad2b-4e99b4b748c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:56.122402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27211925-6893-48d3-ad2b-4e99b4b748c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:56.123551 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27211925-6893-48d3-ad2b-4e99b4b748c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:56.124589 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27211925-6893-48d3-ad2b-4e99b4b748c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:56.125043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27211925-6893-48d3-ad2b-4e99b4b748c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:56.294665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-27211925-6893-48d3-ad2b-4e99b4b748c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:56.304157 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-27211925-6893-48d3-ad2b-4e99b4b748c3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1392 microversion: 2.1 time: 0.195016 Aug 03 03:12:56.304764 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3714/7304] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:56 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:12:56.692184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-670a364c-22e9-4c7e-b45c-e605e75d61ab req-aa2f89d5-b05f-4b43-af92-03205745ae05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60567483-b0a0-45bb-a998-3bcdadcdbec7", "tag": "52818412-866a-4151-94b8-96635431b2ac"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:12:56.715178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-670a364c-22e9-4c7e-b45c-e605e75d61ab req-aa2f89d5-b05f-4b43-af92-03205745ae05 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:56.715638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-670a364c-22e9-4c7e-b45c-e605e75d61ab req-aa2f89d5-b05f-4b43-af92-03205745ae05 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:56.735602 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-670a364c-22e9-4c7e-b45c-e605e75d61ab req-aa2f89d5-b05f-4b43-af92-03205745ae05 service nova] Creating event network-changed:52818412-866a-4151-94b8-96635431b2ac for instance 60567483-b0a0-45bb-a998-3bcdadcdbec7 on n-h1-826529-8 Aug 03 03:12:56.747536 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-670a364c-22e9-4c7e-b45c-e605e75d61ab req-aa2f89d5-b05f-4b43-af92-03205745ae05 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059065 Aug 03 03:12:56.748198 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3591/7305] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:12:57.325824 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-52f16093-8374-443f-b41d-17f043ecbbbd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:57.326458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-52f16093-8374-443f-b41d-17f043ecbbbd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:57.335448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52f16093-8374-443f-b41d-17f043ecbbbd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:57.336006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52f16093-8374-443f-b41d-17f043ecbbbd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:57.336818 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52f16093-8374-443f-b41d-17f043ecbbbd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:57.337276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-52f16093-8374-443f-b41d-17f043ecbbbd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:57.486226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-52f16093-8374-443f-b41d-17f043ecbbbd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:57.495021 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-52f16093-8374-443f-b41d-17f043ecbbbd tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1392 microversion: 2.1 time: 0.173458 Aug 03 03:12:57.495704 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3715/7306] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:57 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:12:58.517030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1e1a47b3-1a34-4be2-b7e0-6bcbbb7a5960 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:58.517776 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1e1a47b3-1a34-4be2-b7e0-6bcbbb7a5960 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:58.524167 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e1a47b3-1a34-4be2-b7e0-6bcbbb7a5960 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:58.524617 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e1a47b3-1a34-4be2-b7e0-6bcbbb7a5960 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:58.525387 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e1a47b3-1a34-4be2-b7e0-6bcbbb7a5960 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:58.525825 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1e1a47b3-1a34-4be2-b7e0-6bcbbb7a5960 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:58.662629 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1e1a47b3-1a34-4be2-b7e0-6bcbbb7a5960 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:58.670249 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1e1a47b3-1a34-4be2-b7e0-6bcbbb7a5960 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1392 microversion: 2.1 time: 0.158528 Aug 03 03:12:58.670826 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3592/7307] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:58 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:12:59.691498 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-54ae3f2c-c0c7-49ab-8c77-f56e10741512 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:12:59.692129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-54ae3f2c-c0c7-49ab-8c77-f56e10741512 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:12:59.698976 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54ae3f2c-c0c7-49ab-8c77-f56e10741512 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:59.699477 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54ae3f2c-c0c7-49ab-8c77-f56e10741512 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:59.700239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54ae3f2c-c0c7-49ab-8c77-f56e10741512 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:12:59.700808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-54ae3f2c-c0c7-49ab-8c77-f56e10741512 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:12:59.838454 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-54ae3f2c-c0c7-49ab-8c77-f56e10741512 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:12:59.847563 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-54ae3f2c-c0c7-49ab-8c77-f56e10741512 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1392 microversion: 2.1 time: 0.160323 Aug 03 03:12:59.848167 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3716/7308] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:12:59 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:13:00.869173 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b3e2abe7-751b-4a87-b599-5881b4334918 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:00.869816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b3e2abe7-751b-4a87-b599-5881b4334918 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:00.877085 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3e2abe7-751b-4a87-b599-5881b4334918 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:00.877631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3e2abe7-751b-4a87-b599-5881b4334918 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:00.878547 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3e2abe7-751b-4a87-b599-5881b4334918 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:00.879102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b3e2abe7-751b-4a87-b599-5881b4334918 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:01.033595 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b3e2abe7-751b-4a87-b599-5881b4334918 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:13:01.041960 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b3e2abe7-751b-4a87-b599-5881b4334918 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1392 microversion: 2.1 time: 0.177204 Aug 03 03:13:01.042531 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3593/7309] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:13:00 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:13:02.063319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b0d221c3-0c90-4a8f-8ab2-42edf5e2f912 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:02.064020 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b0d221c3-0c90-4a8f-8ab2-42edf5e2f912 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:02.071726 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0d221c3-0c90-4a8f-8ab2-42edf5e2f912 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:02.072189 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0d221c3-0c90-4a8f-8ab2-42edf5e2f912 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:02.072988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0d221c3-0c90-4a8f-8ab2-42edf5e2f912 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:02.073445 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b0d221c3-0c90-4a8f-8ab2-42edf5e2f912 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:02.216951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b0d221c3-0c90-4a8f-8ab2-42edf5e2f912 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:13:02.225788 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b0d221c3-0c90-4a8f-8ab2-42edf5e2f912 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1392 microversion: 2.1 time: 0.166439 Aug 03 03:13:02.226394 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3717/7310] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:13:02 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:13:02.965805 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d9625993-2a51-452b-a270-e8ca5faa3d7a req-64abac6b-357f-486b-afd6-6b0725aa34f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60567483-b0a0-45bb-a998-3bcdadcdbec7", "name": "network-vif-plugged", "status": "completed", "tag": "52818412-866a-4151-94b8-96635431b2ac"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:13:02.978320 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d9625993-2a51-452b-a270-e8ca5faa3d7a req-64abac6b-357f-486b-afd6-6b0725aa34f6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:02.978769 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d9625993-2a51-452b-a270-e8ca5faa3d7a req-64abac6b-357f-486b-afd6-6b0725aa34f6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:02.992059 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d9625993-2a51-452b-a270-e8ca5faa3d7a req-64abac6b-357f-486b-afd6-6b0725aa34f6 service nova] Creating event network-vif-plugged:52818412-866a-4151-94b8-96635431b2ac for instance 60567483-b0a0-45bb-a998-3bcdadcdbec7 on n-h1-826529-8 Aug 03 03:13:02.997405 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d9625993-2a51-452b-a270-e8ca5faa3d7a req-64abac6b-357f-486b-afd6-6b0725aa34f6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035704 Aug 03 03:13:02.997949 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3594/7311] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 03:13:03.247588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1b42fc2d-e76a-4646-98b4-42c9d56104df tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:03.248573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1b42fc2d-e76a-4646-98b4-42c9d56104df tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:03.251796 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:13:03.258019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b42fc2d-e76a-4646-98b4-42c9d56104df tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:03.258680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b42fc2d-e76a-4646-98b4-42c9d56104df tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:03.259692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b42fc2d-e76a-4646-98b4-42c9d56104df tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:03.260226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1b42fc2d-e76a-4646-98b4-42c9d56104df tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:03.416291 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1b42fc2d-e76a-4646-98b4-42c9d56104df tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:13:03.424152 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1b42fc2d-e76a-4646-98b4-42c9d56104df tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1392 microversion: 2.1 time: 0.181233 Aug 03 03:13:03.424741 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3718/7312] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:13:03 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:13:04.443041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:13:04.443845 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:13:04.448907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-266159d7-b9d2-489b-94a7-b883e0bb4d73 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:04.449635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-266159d7-b9d2-489b-94a7-b883e0bb4d73 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:04.457221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-266159d7-b9d2-489b-94a7-b883e0bb4d73 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:04.457679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-266159d7-b9d2-489b-94a7-b883e0bb4d73 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:04.458477 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-266159d7-b9d2-489b-94a7-b883e0bb4d73 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:04.458979 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-266159d7-b9d2-489b-94a7-b883e0bb4d73 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:04.596472 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-266159d7-b9d2-489b-94a7-b883e0bb4d73 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:13:04.604308 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-266159d7-b9d2-489b-94a7-b883e0bb4d73 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1564 microversion: 2.1 time: 0.162235 Aug 03 03:13:04.604894 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3595/7313] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:13:04 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:13:04.625804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ace3136b-3118-4666-a681-87487b6da5d2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:04.626511 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ace3136b-3118-4666-a681-87487b6da5d2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:04.628481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:13:04.634721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ace3136b-3118-4666-a681-87487b6da5d2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:04.635215 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ace3136b-3118-4666-a681-87487b6da5d2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:04.636001 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ace3136b-3118-4666-a681-87487b6da5d2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:04.636453 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ace3136b-3118-4666-a681-87487b6da5d2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:04.775701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ace3136b-3118-4666-a681-87487b6da5d2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:13:04.784536 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ace3136b-3118-4666-a681-87487b6da5d2 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1564 microversion: 2.1 time: 0.162566 Aug 03 03:13:04.785140 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3719/7314] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:13:04 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:13:06.744298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-01a2d38b-4fa3-47e8-8ef7-0774f40fcd53 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:06.745118 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-01a2d38b-4fa3-47e8-8ef7-0774f40fcd53 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:06.747035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-e935f29c-4fa3-41a4-99d9-a4ab77e292bf req-7a8bab07-5be4-4ede-82ab-01bc3f4610b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60567483-b0a0-45bb-a998-3bcdadcdbec7", "tag": "52818412-866a-4151-94b8-96635431b2ac"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:13:06.757942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01a2d38b-4fa3-47e8-8ef7-0774f40fcd53 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:06.758600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01a2d38b-4fa3-47e8-8ef7-0774f40fcd53 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:06.759685 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01a2d38b-4fa3-47e8-8ef7-0774f40fcd53 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:06.759888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e935f29c-4fa3-41a4-99d9-a4ab77e292bf req-7a8bab07-5be4-4ede-82ab-01bc3f4610b2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:06.760339 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-01a2d38b-4fa3-47e8-8ef7-0774f40fcd53 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:06.760458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-e935f29c-4fa3-41a4-99d9-a4ab77e292bf req-7a8bab07-5be4-4ede-82ab-01bc3f4610b2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:06.774209 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-e935f29c-4fa3-41a4-99d9-a4ab77e292bf req-7a8bab07-5be4-4ede-82ab-01bc3f4610b2 service nova] Creating event network-changed:52818412-866a-4151-94b8-96635431b2ac for instance 60567483-b0a0-45bb-a998-3bcdadcdbec7 on n-h1-826529-8 Aug 03 03:13:06.780626 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-e935f29c-4fa3-41a4-99d9-a4ab77e292bf req-7a8bab07-5be4-4ede-82ab-01bc3f4610b2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037327 Aug 03 03:13:06.781260 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3720/7315] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:13:06.918001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-01a2d38b-4fa3-47e8-8ef7-0774f40fcd53 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:13:06.932069 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-01a2d38b-4fa3-47e8-8ef7-0774f40fcd53 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1564 microversion: 2.1 time: 0.191778 Aug 03 03:13:06.933031 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3596/7316] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:13:06 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1564 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:13:30.198783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c891cd66-793e-48ce-afbd-8306975681c4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:13:30.201199 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c891cd66-793e-48ce-afbd-8306975681c4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:30.204114 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=5 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:13:30.204777 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=38 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:13:30.211564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c891cd66-793e-48ce-afbd-8306975681c4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:30.212108 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c891cd66-793e-48ce-afbd-8306975681c4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:30.212927 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c891cd66-793e-48ce-afbd-8306975681c4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:30.213388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c891cd66-793e-48ce-afbd-8306975681c4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:30.264565 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c891cd66-793e-48ce-afbd-8306975681c4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7/action" status: 200 len: 24545 microversion: 2.1 time: 0.071109 Aug 03 03:13:30.265233 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3721/7317] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:13:30 2022] POST /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7/action => generated 24545 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 03:13:36.703970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2456b34e-7056-49d9-9eee-80c2d412bc08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:13:36.704553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2456b34e-7056-49d9-9eee-80c2d412bc08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:36.706609 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:13:36.707321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=36 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:13:36.714004 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2456b34e-7056-49d9-9eee-80c2d412bc08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:36.714463 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2456b34e-7056-49d9-9eee-80c2d412bc08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:36.715282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2456b34e-7056-49d9-9eee-80c2d412bc08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:36.715726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2456b34e-7056-49d9-9eee-80c2d412bc08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:36.745466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-2456b34e-7056-49d9-9eee-80c2d412bc08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lazy-loading 'flavor' on Instance uuid 60567483-b0a0-45bb-a998-3bcdadcdbec7 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 03:13:36.816046 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2456b34e-7056-49d9-9eee-80c2d412bc08 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7/action" status: 202 len: 0 microversion: 2.1 time: 0.116161 Aug 03 03:13:36.816706 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3597/7318] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:13:36 2022] POST /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:13:36.825988 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-43d23cab-04cf-4869-931b-7cc59ec7f19e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:36.826712 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-43d23cab-04cf-4869-931b-7cc59ec7f19e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:36.834809 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43d23cab-04cf-4869-931b-7cc59ec7f19e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:36.835966 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43d23cab-04cf-4869-931b-7cc59ec7f19e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:36.836951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43d23cab-04cf-4869-931b-7cc59ec7f19e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:36.837500 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-43d23cab-04cf-4869-931b-7cc59ec7f19e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:36.981543 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-43d23cab-04cf-4869-931b-7cc59ec7f19e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:13:36.989189 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-43d23cab-04cf-4869-931b-7cc59ec7f19e tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1691 microversion: 2.1 time: 0.167785 Aug 03 03:13:36.989761 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3722/7319] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:13:36 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:13:38.011290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6820c495-f0b2-4696-b81a-413c23836754 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:38.011899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6820c495-f0b2-4696-b81a-413c23836754 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:38.018239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6820c495-f0b2-4696-b81a-413c23836754 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:38.018703 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6820c495-f0b2-4696-b81a-413c23836754 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:38.019523 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6820c495-f0b2-4696-b81a-413c23836754 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:38.019976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6820c495-f0b2-4696-b81a-413c23836754 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:38.155880 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6820c495-f0b2-4696-b81a-413c23836754 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:13:38.164141 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6820c495-f0b2-4696-b81a-413c23836754 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1674 microversion: 2.1 time: 0.158103 Aug 03 03:13:38.164760 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3598/7320] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:13:38 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:13:39.261523 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bb0d8b31-6d13-43f9-aabc-fbb662ef8853 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:13:39.263783 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bb0d8b31-6d13-43f9-aabc-fbb662ef8853 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:39.271631 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb0d8b31-6d13-43f9-aabc-fbb662ef8853 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:39.272103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb0d8b31-6d13-43f9-aabc-fbb662ef8853 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:39.274632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb0d8b31-6d13-43f9-aabc-fbb662ef8853 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:39.274632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bb0d8b31-6d13-43f9-aabc-fbb662ef8853 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:39.324321 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bb0d8b31-6d13-43f9-aabc-fbb662ef8853 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7/action" status: 200 len: 35663 microversion: 2.1 time: 0.067297 Aug 03 03:13:39.324991 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3723/7321] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:13:39 2022] POST /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7/action => generated 35663 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 03:13:39.336638 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-361c5ebe-f76f-4e0c-b51f-d064cd1b60a3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:13:39.337310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-361c5ebe-f76f-4e0c-b51f-d064cd1b60a3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:39.344309 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-361c5ebe-f76f-4e0c-b51f-d064cd1b60a3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:39.344774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-361c5ebe-f76f-4e0c-b51f-d064cd1b60a3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:39.345565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-361c5ebe-f76f-4e0c-b51f-d064cd1b60a3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:39.346016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-361c5ebe-f76f-4e0c-b51f-d064cd1b60a3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:39.412531 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-361c5ebe-f76f-4e0c-b51f-d064cd1b60a3 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7/action" status: 202 len: 0 microversion: 2.1 time: 0.079663 Aug 03 03:13:39.413819 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3599/7322] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:13:39 2022] POST /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:13:39.425398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f958c058-7558-46c9-9b3b-0b75a2b8e825 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:39.427973 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f958c058-7558-46c9-9b3b-0b75a2b8e825 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:39.437749 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f958c058-7558-46c9-9b3b-0b75a2b8e825 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:39.438581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f958c058-7558-46c9-9b3b-0b75a2b8e825 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:39.439410 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f958c058-7558-46c9-9b3b-0b75a2b8e825 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:39.439874 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f958c058-7558-46c9-9b3b-0b75a2b8e825 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:39.606448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f958c058-7558-46c9-9b3b-0b75a2b8e825 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:13:39.615226 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f958c058-7558-46c9-9b3b-0b75a2b8e825 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1680 microversion: 2.1 time: 0.195889 Aug 03 03:13:39.615765 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3724/7323] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:13:39 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:13:40.640221 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0ba6dd65-4ce0-4365-af84-50f4a73bbd1b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:40.640955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0ba6dd65-4ce0-4365-af84-50f4a73bbd1b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:40.647268 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ba6dd65-4ce0-4365-af84-50f4a73bbd1b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:40.648476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ba6dd65-4ce0-4365-af84-50f4a73bbd1b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:40.649250 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ba6dd65-4ce0-4365-af84-50f4a73bbd1b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:40.649690 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0ba6dd65-4ce0-4365-af84-50f4a73bbd1b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:40.787418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0ba6dd65-4ce0-4365-af84-50f4a73bbd1b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:13:40.796458 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0ba6dd65-4ce0-4365-af84-50f4a73bbd1b tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1680 microversion: 2.1 time: 0.161264 Aug 03 03:13:40.797038 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3600/7324] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:13:40 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:13:41.818444 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ac2bc1b1-bef3-45b4-b136-6a34814a8243 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:41.820074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ac2bc1b1-bef3-45b4-b136-6a34814a8243 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:41.828263 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ac2bc1b1-bef3-45b4-b136-6a34814a8243 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:41.828737 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ac2bc1b1-bef3-45b4-b136-6a34814a8243 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:41.829539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ac2bc1b1-bef3-45b4-b136-6a34814a8243 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:41.829997 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ac2bc1b1-bef3-45b4-b136-6a34814a8243 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:41.980564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ac2bc1b1-bef3-45b4-b136-6a34814a8243 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:13:41.988513 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ac2bc1b1-bef3-45b4-b136-6a34814a8243 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1683 microversion: 2.1 time: 0.174659 Aug 03 03:13:41.989019 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3725/7325] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:13:41 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:13:42.091626 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b2cf67f7-e291-4f76-b5ce-b295d316ba71 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:13:42.093871 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b2cf67f7-e291-4f76-b5ce-b295d316ba71 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:42.101176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2cf67f7-e291-4f76-b5ce-b295d316ba71 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:42.101513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2cf67f7-e291-4f76-b5ce-b295d316ba71 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:42.102308 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2cf67f7-e291-4f76-b5ce-b295d316ba71 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:42.102759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b2cf67f7-e291-4f76-b5ce-b295d316ba71 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:42.144942 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b2cf67f7-e291-4f76-b5ce-b295d316ba71 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "POST /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7/action" status: 200 len: 35663 microversion: 2.1 time: 0.057004 Aug 03 03:13:42.145643 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3601/7326] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:13:42 2022] POST /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7/action => generated 35663 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 03:13:43.239390 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1550af56-5732-45f4-9425-48b6357aa7c4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:43.240411 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1550af56-5732-45f4-9425-48b6357aa7c4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:43.241942 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-27b491a0-5db0-467e-9ed2-722a9bdf1924 req-e66a6529-347f-438e-ad61-5b27a1d9818d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60567483-b0a0-45bb-a998-3bcdadcdbec7", "tag": "52818412-866a-4151-94b8-96635431b2ac"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:13:43.248727 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1550af56-5732-45f4-9425-48b6357aa7c4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:43.249544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1550af56-5732-45f4-9425-48b6357aa7c4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:43.250492 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1550af56-5732-45f4-9425-48b6357aa7c4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:43.251116 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1550af56-5732-45f4-9425-48b6357aa7c4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:43.254101 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-27b491a0-5db0-467e-9ed2-722a9bdf1924 req-e66a6529-347f-438e-ad61-5b27a1d9818d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:43.254553 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-27b491a0-5db0-467e-9ed2-722a9bdf1924 req-e66a6529-347f-438e-ad61-5b27a1d9818d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:43.267890 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-27b491a0-5db0-467e-9ed2-722a9bdf1924 req-e66a6529-347f-438e-ad61-5b27a1d9818d service nova] Creating event network-changed:52818412-866a-4151-94b8-96635431b2ac for instance 60567483-b0a0-45bb-a998-3bcdadcdbec7 on n-h1-826529-8 Aug 03 03:13:43.273759 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-27b491a0-5db0-467e-9ed2-722a9bdf1924 req-e66a6529-347f-438e-ad61-5b27a1d9818d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034962 Aug 03 03:13:43.274681 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3602/7327] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 03:13:43.286565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1550af56-5732-45f4-9425-48b6357aa7c4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 03:13:43.378293 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1550af56-5732-45f4-9425-48b6357aa7c4 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "DELETE /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 204 len: 0 microversion: 2.1 time: 0.142663 Aug 03 03:13:43.379886 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3726/7328] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 03:13:43 2022] DELETE /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 03:13:43.390274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a633b9fd-afe7-4b3a-a9ac-8186f72a5141 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:43.391176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a633b9fd-afe7-4b3a-a9ac-8186f72a5141 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:43.404707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a633b9fd-afe7-4b3a-a9ac-8186f72a5141 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:43.405249 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a633b9fd-afe7-4b3a-a9ac-8186f72a5141 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:43.406100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a633b9fd-afe7-4b3a-a9ac-8186f72a5141 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:43.406863 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a633b9fd-afe7-4b3a-a9ac-8186f72a5141 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:43.557800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a633b9fd-afe7-4b3a-a9ac-8186f72a5141 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:13:43.565581 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a633b9fd-afe7-4b3a-a9ac-8186f72a5141 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1689 microversion: 2.1 time: 0.180270 Aug 03 03:13:43.566364 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3603/7329] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:13:43 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:13:44.587864 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a6e1cc74-a1a7-40fa-96f8-c3cf1b22981c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:44.588592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a6e1cc74-a1a7-40fa-96f8-c3cf1b22981c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:44.595670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6e1cc74-a1a7-40fa-96f8-c3cf1b22981c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:44.596148 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6e1cc74-a1a7-40fa-96f8-c3cf1b22981c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:44.596942 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6e1cc74-a1a7-40fa-96f8-c3cf1b22981c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:44.597404 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a6e1cc74-a1a7-40fa-96f8-c3cf1b22981c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:44.736634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a6e1cc74-a1a7-40fa-96f8-c3cf1b22981c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:13:44.745351 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a6e1cc74-a1a7-40fa-96f8-c3cf1b22981c tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1689 microversion: 2.1 time: 0.161666 Aug 03 03:13:44.746134 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3727/7330] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:13:44 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:13:45.768006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2b6a2374-75e1-43dd-926e-7a673d5adf9a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:45.768631 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2b6a2374-75e1-43dd-926e-7a673d5adf9a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:45.775868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b6a2374-75e1-43dd-926e-7a673d5adf9a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:45.776331 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b6a2374-75e1-43dd-926e-7a673d5adf9a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:45.777127 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b6a2374-75e1-43dd-926e-7a673d5adf9a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:45.777844 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2b6a2374-75e1-43dd-926e-7a673d5adf9a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:45.846642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2b6a2374-75e1-43dd-926e-7a673d5adf9a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44df218d187c46489bad965cd6d0266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54093784aa14146bb025b41f7ce4067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:13:45.856336 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2b6a2374-75e1-43dd-926e-7a673d5adf9a tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 200 len: 1502 microversion: 2.1 time: 0.092144 Aug 03 03:13:45.857666 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3604/7331] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:13:45 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 1502 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:13:45.903446 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-4c10ea0f-65ac-482f-874d-9ed16fb17953 req-87976913-1637-43a6-a1e6-6e30b7f67d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60567483-b0a0-45bb-a998-3bcdadcdbec7", "name": "network-vif-deleted", "tag": "52818412-866a-4151-94b8-96635431b2ac"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:13:45.920941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4c10ea0f-65ac-482f-874d-9ed16fb17953 req-87976913-1637-43a6-a1e6-6e30b7f67d3d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:45.921537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-4c10ea0f-65ac-482f-874d-9ed16fb17953 req-87976913-1637-43a6-a1e6-6e30b7f67d3d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:45.934813 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-4c10ea0f-65ac-482f-874d-9ed16fb17953 req-87976913-1637-43a6-a1e6-6e30b7f67d3d service nova] Creating event network-vif-deleted:52818412-866a-4151-94b8-96635431b2ac for instance 60567483-b0a0-45bb-a998-3bcdadcdbec7 on n-h1-826529-8 Aug 03 03:13:45.939723 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-4c10ea0f-65ac-482f-874d-9ed16fb17953 req-87976913-1637-43a6-a1e6-6e30b7f67d3d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040306 Aug 03 03:13:45.940523 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3728/7332] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:13:46.878681 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-18af8cce-aa5c-450d-b770-5587f9a6caa1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:46.879319 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-18af8cce-aa5c-450d-b770-5587f9a6caa1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] [instance: 60567483-b0a0-45bb-a998-3bcdadcdbec7] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:13:46.887141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18af8cce-aa5c-450d-b770-5587f9a6caa1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:46.887597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18af8cce-aa5c-450d-b770-5587f9a6caa1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:46.888376 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18af8cce-aa5c-450d-b770-5587f9a6caa1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:13:46.888816 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18af8cce-aa5c-450d-b770-5587f9a6caa1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:13:46.904135 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.wsgi [None req-18af8cce-aa5c-450d-b770-5587f9a6caa1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] HTTP exception thrown: Instance 60567483-b0a0-45bb-a998-3bcdadcdbec7 could not be found. Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-18af8cce-aa5c-450d-b770-5587f9a6caa1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Request method failure captured: Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: request: GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 HTTP/1.1 Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: Accept: application/json Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: Accept-Encoding: identity Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: Connection: close Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: Content-Length: 0 Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: Content-Type: application/json Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: Host: 10.222.0.67 Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: Openstack-System-Scope: None Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: User-Agent: python-urllib3/1.26.10 Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-Auth-Token: gAAAAABi6eYRZcrYqn2ty7DONXuF2HUsCy9Tk6-nTi0ZXK99YSTeT1qlh867JeQ00loRexm5dFP-D1x5FSzJk8i8-zmuDFsD8UXFrpZZXx5rUxqORh5YT3u9BnNBjDjn0tOpv8YtQ4Bhdjr-teA_UAFNdQWDWRqd_io91Y_O1YGoIN7HAcGgup8 Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Id: None Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-Domain-Name: None Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-Identity-Status: Confirmed Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-Is-Admin-Project: True Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Id: default Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Domain-Name: Default Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Id: c54093784aa14146bb025b41f7ce4067 Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-280471232 Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-Role: member,reader Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-Roles: member,reader Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c54093784aa14146bb025b41f7ce4067", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c54093784aa14146bb025b41f7ce4067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c54093784aa14146bb025b41f7ce4067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c54093784aa14146bb025b41f7ce4067"}]}] Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant: tempest-TestNetworkAdvancedServerOps-280471232 Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Id: c54093784aa14146bb025b41f7ce4067 Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-280471232 Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-User: tempest-TestNetworkAdvancedServerOps-280471232-project Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Id: default Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-User-Domain-Name: Default Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-User-Id: 44df218d187c46489bad965cd6d0266a Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: X-User-Name: tempest-TestNetworkAdvancedServerOps-280471232-project Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: method: > Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: exception: Instance 60567483-b0a0-45bb-a998-3bcdadcdbec7 could not be found. Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: action_args: {'id': '60567483-b0a0-45bb-a998-3bcdadcdbec7'} Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60567483-b0a0-45bb-a998-3bcdadcdbec7 could not be found. Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60567483-b0a0-45bb-a998-3bcdadcdbec7 could not be found. Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:13:46.905814 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:13:46.914834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:13:46.914834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:13:46.914834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:13:46.914834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:13:46.914834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 03:13:46.914834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 03:13:46.914834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60567483-b0a0-45bb-a998-3bcdadcdbec7 could not be found. Aug 03 03:13:46.914834 n-d-826529-8 devstack@n-api.service[125942]: ERROR nova.api.openstack.wsgi Aug 03 03:13:46.914834 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-18af8cce-aa5c-450d-b770-5587f9a6caa1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Returning 404 to user: Instance 60567483-b0a0-45bb-a998-3bcdadcdbec7 could not be found. {{(pid=125942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 03:13:46.914834 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-18af8cce-aa5c-450d-b770-5587f9a6caa1 tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7" status: 404 len: 111 microversion: 2.1 time: 0.032490 Aug 03 03:13:46.914834 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3605/7333] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:13:46 2022] GET /compute/v2.1/servers/60567483-b0a0-45bb-a998-3bcdadcdbec7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 03:13:50.016201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8b150d2f-98c3-4cd5-bf6f-229df767f7db tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] Calling method '.version_select at 0x7f5b102a6f70>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:13:50.042528 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8b150d2f-98c3-4cd5-bf6f-229df767f7db tempest-TestNetworkAdvancedServerOps-280471232 tempest-TestNetworkAdvancedServerOps-280471232-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2105039415" status: 202 len: 0 microversion: 2.1 time: 0.031470 Aug 03 03:13:50.043373 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3729/7334] 10.222.0.67 () {58 vars in 1284 bytes} [Wed Aug 3 03:13:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2105039415 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:14:01.804932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=18 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:14:01.805763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:14:02.006576 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-34b79c35-8734-44cb-a70d-9008787807fe tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Action: 'create', calling method: .version_select at 0x7f5b1306b9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1096744974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVUEj6SyczXL01O8yv2IGGRIcNp+h1AwS/INO2e/LVgQLddrsSGU4xu6dLz5DFFP1PuniM3xp7jtTSZ9NnpQPDgHMbIs+L3fSBGUrv64Y8PZ0G4eIyFC17mvjiDtCGTeg=="}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:14:02.024458 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-34b79c35-8734-44cb-a70d-9008787807fe tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Getting quotas for project cb3f415547664f468037910d72c11950. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:14:02.031321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-34b79c35-8734-44cb-a70d-9008787807fe tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Getting quotas for user 09d3a0a0db994610aedc1d41d926c0f5 and project cb3f415547664f468037910d72c11950. Resources: {'key_pairs'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:14:02.061233 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-34b79c35-8734-44cb-a70d-9008787807fe tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.262632 Aug 03 03:14:02.061874 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3606/7335] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 03:14:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:14:03.265690 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:14:03.267028 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:14:03.271459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1724585688", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1096744974", "security_groups": [{"name": "tempest-secgroup-smoke-638757354"}], "networks": [{"uuid": "d3d3b53c-90eb-4dd0-90d7-4f433ae3518d"}]}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:14:03.534852 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.network.neutron [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] validate_networks() for [('d3d3b53c-90eb-4dd0-90d7-4f433ae3518d', None, None, None, None, None)] {{(pid=125941) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 03:14:03.956913 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Flavor limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 03:14:03.957362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Image limits 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 03:14:03.957891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Flavor pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 03:14:03.958316 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Image pref 0:0:0 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 03:14:03.958858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.virt.hardware [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 03:14:03.970567 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:03.971057 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:03.971914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:03.972548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:03.993380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Getting quotas for project cb3f415547664f468037910d72c11950. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:14:03.999319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Getting quotas for user 09d3a0a0db994610aedc1d41d926c0f5 and project cb3f415547664f468037910d72c11950. Resources: {'cores', 'instances', 'ram'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:14:04.014512 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Going to run 1 instances... {{(pid=125941) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 03:14:04.017315 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 03:14:04.075393 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [acf78073-385a-42f9-bcef-bcc04a334249] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 03:14:05.085909 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [acf78073-385a-42f9-bcef-bcc04a334249] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 39588. Aug 03 03:14:05.092026 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1fd47d4c-39bf-4e5c-9a1b-950455df1d40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.828186 Aug 03 03:14:05.095286 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3730/7336] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 03:14:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 03:14:05.104984 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-23671190-8264-40c0-bc2d-b2dcdcab9e7e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:14:05.105625 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-23671190-8264-40c0-bc2d-b2dcdcab9e7e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:14:05.326696 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-23671190-8264-40c0-bc2d-b2dcdcab9e7e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:14:05.334077 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-23671190-8264-40c0-bc2d-b2dcdcab9e7e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1247 microversion: 2.1 time: 0.234368 Aug 03 03:14:05.335584 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3607/7337] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:14:05 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1247 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:14:06.360083 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-97e34443-7bcf-4684-9a0a-4204522cba3e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:14:06.360900 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-97e34443-7bcf-4684-9a0a-4204522cba3e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:14:06.368581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97e34443-7bcf-4684-9a0a-4204522cba3e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:06.368991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97e34443-7bcf-4684-9a0a-4204522cba3e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:06.369769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97e34443-7bcf-4684-9a0a-4204522cba3e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:06.370407 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-97e34443-7bcf-4684-9a0a-4204522cba3e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:06.457989 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-97e34443-7bcf-4684-9a0a-4204522cba3e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:14:06.466159 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-97e34443-7bcf-4684-9a0a-4204522cba3e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1305 microversion: 2.1 time: 0.111261 Aug 03 03:14:06.467011 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3731/7338] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:14:06 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:14:07.490499 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-72ce0fd4-626e-49e3-a117-8fcc85632438 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:14:07.493086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-72ce0fd4-626e-49e3-a117-8fcc85632438 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:14:07.500044 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-72ce0fd4-626e-49e3-a117-8fcc85632438 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:07.500679 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-72ce0fd4-626e-49e3-a117-8fcc85632438 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:07.501467 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-72ce0fd4-626e-49e3-a117-8fcc85632438 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:07.501921 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-72ce0fd4-626e-49e3-a117-8fcc85632438 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:07.708878 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-72ce0fd4-626e-49e3-a117-8fcc85632438 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:14:07.720433 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-72ce0fd4-626e-49e3-a117-8fcc85632438 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1372 microversion: 2.1 time: 0.235379 Aug 03 03:14:07.720945 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3608/7339] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:14:07 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1372 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:14:07.740317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-c0a22c2a-6628-40c4-88c6-8ffe4dc098ba req-62ff6f13-32fb-4fe5-9d25-f5777d1838a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5176fa-48b0-4fb6-92e9-8b0bc30ed525", "tag": "6d3cfed4-e72b-4959-973b-511691fbdfcf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:14:07.759538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c0a22c2a-6628-40c4-88c6-8ffe4dc098ba req-62ff6f13-32fb-4fe5-9d25-f5777d1838a9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:07.760238 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-c0a22c2a-6628-40c4-88c6-8ffe4dc098ba req-62ff6f13-32fb-4fe5-9d25-f5777d1838a9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:07.774440 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-c0a22c2a-6628-40c4-88c6-8ffe4dc098ba req-62ff6f13-32fb-4fe5-9d25-f5777d1838a9 service nova] Creating event network-changed:6d3cfed4-e72b-4959-973b-511691fbdfcf for instance 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 on n-h2-826529-8 Aug 03 03:14:07.780500 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-c0a22c2a-6628-40c4-88c6-8ffe4dc098ba req-62ff6f13-32fb-4fe5-9d25-f5777d1838a9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048696 Aug 03 03:14:07.781276 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3732/7340] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:14:08.742838 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3c62b285-3700-48bc-83a2-a3b9442f1350 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:14:08.743620 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3c62b285-3700-48bc-83a2-a3b9442f1350 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:14:08.752920 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c62b285-3700-48bc-83a2-a3b9442f1350 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:08.753446 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c62b285-3700-48bc-83a2-a3b9442f1350 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:08.754282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c62b285-3700-48bc-83a2-a3b9442f1350 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:08.754735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3c62b285-3700-48bc-83a2-a3b9442f1350 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:08.892784 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3c62b285-3700-48bc-83a2-a3b9442f1350 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:14:08.905434 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3c62b285-3700-48bc-83a2-a3b9442f1350 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1372 microversion: 2.1 time: 0.167085 Aug 03 03:14:08.906448 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3609/7341] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:14:08 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:14:09.943820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3bad0e50-0b3a-4874-9c15-cebc2a5dbd4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:14:09.945481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3bad0e50-0b3a-4874-9c15-cebc2a5dbd4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:14:09.953572 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3bad0e50-0b3a-4874-9c15-cebc2a5dbd4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:09.954274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3bad0e50-0b3a-4874-9c15-cebc2a5dbd4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:09.955463 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3bad0e50-0b3a-4874-9c15-cebc2a5dbd4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:09.956099 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3bad0e50-0b3a-4874-9c15-cebc2a5dbd4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:10.098537 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3bad0e50-0b3a-4874-9c15-cebc2a5dbd4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:14:10.106812 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3bad0e50-0b3a-4874-9c15-cebc2a5dbd4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1372 microversion: 2.1 time: 0.169037 Aug 03 03:14:10.107439 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3733/7342] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:14:09 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:14:11.129860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a8e73281-a263-4e48-9c46-59a792ae9658 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:14:11.130554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a8e73281-a263-4e48-9c46-59a792ae9658 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:14:11.138771 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8e73281-a263-4e48-9c46-59a792ae9658 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:11.139267 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8e73281-a263-4e48-9c46-59a792ae9658 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:11.140103 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8e73281-a263-4e48-9c46-59a792ae9658 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:11.140574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a8e73281-a263-4e48-9c46-59a792ae9658 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:11.314356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a8e73281-a263-4e48-9c46-59a792ae9658 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:14:11.323341 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a8e73281-a263-4e48-9c46-59a792ae9658 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1372 microversion: 2.1 time: 0.198316 Aug 03 03:14:11.323944 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3610/7343] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:14:11 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:14:12.344922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e604cd5d-6703-4b61-931a-0e4bc311d00b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:14:12.345575 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e604cd5d-6703-4b61-931a-0e4bc311d00b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:14:12.352955 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e604cd5d-6703-4b61-931a-0e4bc311d00b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:12.353427 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e604cd5d-6703-4b61-931a-0e4bc311d00b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:12.354262 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e604cd5d-6703-4b61-931a-0e4bc311d00b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:12.354798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e604cd5d-6703-4b61-931a-0e4bc311d00b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:12.511596 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e604cd5d-6703-4b61-931a-0e4bc311d00b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:14:12.519304 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e604cd5d-6703-4b61-931a-0e4bc311d00b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1372 microversion: 2.1 time: 0.178210 Aug 03 03:14:12.519952 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3734/7344] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:14:12 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:14:13.543546 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bc3af288-8ac6-4db3-a24d-e243d2a525c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:14:13.544459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bc3af288-8ac6-4db3-a24d-e243d2a525c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:14:13.551763 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc3af288-8ac6-4db3-a24d-e243d2a525c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:13.552222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc3af288-8ac6-4db3-a24d-e243d2a525c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:13.553007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc3af288-8ac6-4db3-a24d-e243d2a525c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:13.553506 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bc3af288-8ac6-4db3-a24d-e243d2a525c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:13.695540 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bc3af288-8ac6-4db3-a24d-e243d2a525c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:14:13.703116 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bc3af288-8ac6-4db3-a24d-e243d2a525c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1372 microversion: 2.1 time: 0.165707 Aug 03 03:14:13.703706 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3611/7345] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:14:13 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:14:14.393689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-710846da-4062-4e47-bf3c-a9bd5868331b req-ba759007-0fe7-4012-9621-4706c14535e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5176fa-48b0-4fb6-92e9-8b0bc30ed525", "name": "network-vif-plugged", "status": "completed", "tag": "6d3cfed4-e72b-4959-973b-511691fbdfcf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:14:14.399825 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:14:14.400545 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:14:14.411362 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-710846da-4062-4e47-bf3c-a9bd5868331b req-ba759007-0fe7-4012-9621-4706c14535e3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:14.411981 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-710846da-4062-4e47-bf3c-a9bd5868331b req-ba759007-0fe7-4012-9621-4706c14535e3 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:14.425426 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-710846da-4062-4e47-bf3c-a9bd5868331b req-ba759007-0fe7-4012-9621-4706c14535e3 service nova] Creating event network-vif-plugged:6d3cfed4-e72b-4959-973b-511691fbdfcf for instance 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 on n-h2-826529-8 Aug 03 03:14:14.431575 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-710846da-4062-4e47-bf3c-a9bd5868331b req-ba759007-0fe7-4012-9621-4706c14535e3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041579 Aug 03 03:14:14.432191 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3735/7346] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:14:14.724756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-044e87d9-fec5-4089-b53b-d766bcadcf4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:14:14.725940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-044e87d9-fec5-4089-b53b-d766bcadcf4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:14:14.733247 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-044e87d9-fec5-4089-b53b-d766bcadcf4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:14.733705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-044e87d9-fec5-4089-b53b-d766bcadcf4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:14.734501 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-044e87d9-fec5-4089-b53b-d766bcadcf4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:14.734976 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-044e87d9-fec5-4089-b53b-d766bcadcf4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:14.876916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-044e87d9-fec5-4089-b53b-d766bcadcf4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:14:14.885083 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-044e87d9-fec5-4089-b53b-d766bcadcf4f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1372 microversion: 2.1 time: 0.164332 Aug 03 03:14:14.885651 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3612/7347] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:14:14 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:14:15.908615 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-27bd1c6a-1555-4497-94e1-70817ad36786 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:14:15.909332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-27bd1c6a-1555-4497-94e1-70817ad36786 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:14:15.917584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27bd1c6a-1555-4497-94e1-70817ad36786 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:15.918054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27bd1c6a-1555-4497-94e1-70817ad36786 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:15.918860 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27bd1c6a-1555-4497-94e1-70817ad36786 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:15.919345 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-27bd1c6a-1555-4497-94e1-70817ad36786 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:16.062139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-27bd1c6a-1555-4497-94e1-70817ad36786 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:14:16.070083 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-27bd1c6a-1555-4497-94e1-70817ad36786 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1555 microversion: 2.1 time: 0.166806 Aug 03 03:14:16.070676 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3736/7348] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:14:15 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:14:16.091164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6b63314e-12a5-4887-87d1-76b753f513e5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:14:16.091975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6b63314e-12a5-4887-87d1-76b753f513e5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:14:16.093722 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:14:16.100102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b63314e-12a5-4887-87d1-76b753f513e5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:16.101210 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b63314e-12a5-4887-87d1-76b753f513e5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:16.102008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b63314e-12a5-4887-87d1-76b753f513e5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:16.102454 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6b63314e-12a5-4887-87d1-76b753f513e5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:16.239222 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6b63314e-12a5-4887-87d1-76b753f513e5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:14:16.247197 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6b63314e-12a5-4887-87d1-76b753f513e5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1555 microversion: 2.1 time: 0.160103 Aug 03 03:14:16.247786 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3613/7349] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:14:16 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:14:17.946573 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-d5b3595c-a93e-46f9-ba2f-e50599ae1598 req-671c2e72-9785-4a2c-b681-bc5e8f3f3e55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5176fa-48b0-4fb6-92e9-8b0bc30ed525", "tag": "6d3cfed4-e72b-4959-973b-511691fbdfcf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:14:17.957166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d5b3595c-a93e-46f9-ba2f-e50599ae1598 req-671c2e72-9785-4a2c-b681-bc5e8f3f3e55 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:14:17.957632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-d5b3595c-a93e-46f9-ba2f-e50599ae1598 req-671c2e72-9785-4a2c-b681-bc5e8f3f3e55 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:14:17.969874 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-d5b3595c-a93e-46f9-ba2f-e50599ae1598 req-671c2e72-9785-4a2c-b681-bc5e8f3f3e55 service nova] Creating event network-changed:6d3cfed4-e72b-4959-973b-511691fbdfcf for instance 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 on n-h2-826529-8 Aug 03 03:14:17.975043 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-d5b3595c-a93e-46f9-ba2f-e50599ae1598 req-671c2e72-9785-4a2c-b681-bc5e8f3f3e55 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032837 Aug 03 03:14:17.976478 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3737/7350] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:15:59.795283 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:15:59.795893 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 03:15:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:16:15.340005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:16:15.340826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=36 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:16:15.344923 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d5e2348f-303f-47a0-a8a5-06a17e1ac7fc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:16:15.345481 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d5e2348f-303f-47a0-a8a5-06a17e1ac7fc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:15.353049 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5e2348f-303f-47a0-a8a5-06a17e1ac7fc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:15.353505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5e2348f-303f-47a0-a8a5-06a17e1ac7fc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:15.354303 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5e2348f-303f-47a0-a8a5-06a17e1ac7fc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:15.354749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d5e2348f-303f-47a0-a8a5-06a17e1ac7fc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:15.381040 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-d5e2348f-303f-47a0-a8a5-06a17e1ac7fc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lazy-loading 'flavor' on Instance uuid 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 03:16:15.469442 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:16:15.469595 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 03:16:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525/action (ip 10.222.0.67) !!! Aug 03 03:16:15.573477 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d5e2348f-303f-47a0-a8a5-06a17e1ac7fc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "POST /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525/action" status: 202 len: 0 microversion: 2.1 time: 0.235481 Aug 03 03:16:15.574074 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3614/7351] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:16:15 2022] POST /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:16:15.583212 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c87329c-10f0-40cc-99d5-2fdb48e49def] AMQP server on 10.222.0.67:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 03 03:16:15.585254 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b324c37-7dbb-4b30-9a93-80ead1f0c21e] AMQP server on 10.222.0.67:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 03 03:16:15.585911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:16:15.586839 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=32 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:16:15.592349 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d55cda88-6a7f-4287-b72d-6ee9b519be33 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:15.593113 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d55cda88-6a7f-4287-b72d-6ee9b519be33 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:15.605979 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d55cda88-6a7f-4287-b72d-6ee9b519be33 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:15.606448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d55cda88-6a7f-4287-b72d-6ee9b519be33 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:15.607298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d55cda88-6a7f-4287-b72d-6ee9b519be33 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:15.607766 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d55cda88-6a7f-4287-b72d-6ee9b519be33 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:15.748897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d55cda88-6a7f-4287-b72d-6ee9b519be33 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:15.756799 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d55cda88-6a7f-4287-b72d-6ee9b519be33 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1680 microversion: 2.1 time: 0.178071 Aug 03 03:16:15.757367 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3738/7352] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:15 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:16.780117 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-98e5fb5b-b11b-4a51-a68c-28eb620f803a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:16.780832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-98e5fb5b-b11b-4a51-a68c-28eb620f803a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:16.788281 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98e5fb5b-b11b-4a51-a68c-28eb620f803a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:16.788746 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98e5fb5b-b11b-4a51-a68c-28eb620f803a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:16.789532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98e5fb5b-b11b-4a51-a68c-28eb620f803a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:16.789980 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98e5fb5b-b11b-4a51-a68c-28eb620f803a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:16.922555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-98e5fb5b-b11b-4a51-a68c-28eb620f803a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:16.930832 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-98e5fb5b-b11b-4a51-a68c-28eb620f803a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1680 microversion: 2.1 time: 0.156440 Aug 03 03:16:16.931421 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3615/7353] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:16 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:17.952961 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ba50b7e9-fcbe-4d93-9492-393b0d1946ee tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:17.953588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ba50b7e9-fcbe-4d93-9492-393b0d1946ee tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:17.969272 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c87329c-10f0-40cc-99d5-2fdb48e49def] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 39702. Aug 03 03:16:17.971368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba50b7e9-fcbe-4d93-9492-393b0d1946ee tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:17.971830 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba50b7e9-fcbe-4d93-9492-393b0d1946ee tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:17.973254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba50b7e9-fcbe-4d93-9492-393b0d1946ee tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:17.973775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ba50b7e9-fcbe-4d93-9492-393b0d1946ee tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:17.976926 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b324c37-7dbb-4b30-9a93-80ead1f0c21e] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 39704. Aug 03 03:16:18.122297 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ba50b7e9-fcbe-4d93-9492-393b0d1946ee tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:18.130020 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ba50b7e9-fcbe-4d93-9492-393b0d1946ee tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1680 microversion: 2.1 time: 0.181047 Aug 03 03:16:18.130613 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3739/7354] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:17 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:19.152628 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-7f2bcc0f-7b14-4dd1-9785-93a02d29ea98 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:19.153244 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-7f2bcc0f-7b14-4dd1-9785-93a02d29ea98 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:19.161046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f2bcc0f-7b14-4dd1-9785-93a02d29ea98 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:19.161726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f2bcc0f-7b14-4dd1-9785-93a02d29ea98 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:19.162538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f2bcc0f-7b14-4dd1-9785-93a02d29ea98 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:19.163026 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-7f2bcc0f-7b14-4dd1-9785-93a02d29ea98 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:19.299868 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-7f2bcc0f-7b14-4dd1-9785-93a02d29ea98 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:19.308604 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-7f2bcc0f-7b14-4dd1-9785-93a02d29ea98 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1680 microversion: 2.1 time: 0.160488 Aug 03 03:16:19.309178 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3616/7355] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:19 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:20.330303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-92a0a9e7-7c42-449b-a918-3afa891b71cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:20.330987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-92a0a9e7-7c42-449b-a918-3afa891b71cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:20.338663 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92a0a9e7-7c42-449b-a918-3afa891b71cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:20.339166 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92a0a9e7-7c42-449b-a918-3afa891b71cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:20.339963 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92a0a9e7-7c42-449b-a918-3afa891b71cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:20.340421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-92a0a9e7-7c42-449b-a918-3afa891b71cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:20.473837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-92a0a9e7-7c42-449b-a918-3afa891b71cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:20.481632 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-92a0a9e7-7c42-449b-a918-3afa891b71cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1680 microversion: 2.1 time: 0.155288 Aug 03 03:16:20.482210 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3740/7356] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:20 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:21.503348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fe714f13-d7a3-428a-b0bb-b325c9d3a3a7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:21.504514 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fe714f13-d7a3-428a-b0bb-b325c9d3a3a7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:21.511869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe714f13-d7a3-428a-b0bb-b325c9d3a3a7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:21.512324 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe714f13-d7a3-428a-b0bb-b325c9d3a3a7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:21.513097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe714f13-d7a3-428a-b0bb-b325c9d3a3a7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:21.513535 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fe714f13-d7a3-428a-b0bb-b325c9d3a3a7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:21.657754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fe714f13-d7a3-428a-b0bb-b325c9d3a3a7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:21.666378 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fe714f13-d7a3-428a-b0bb-b325c9d3a3a7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1680 microversion: 2.1 time: 0.166938 Aug 03 03:16:21.666977 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3617/7357] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:21 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:16:22.688588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0db7f0da-2b3b-4efd-8213-4e7384c93df1 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:22.689203 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0db7f0da-2b3b-4efd-8213-4e7384c93df1 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:22.696447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0db7f0da-2b3b-4efd-8213-4e7384c93df1 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:22.696914 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0db7f0da-2b3b-4efd-8213-4e7384c93df1 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:22.697697 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0db7f0da-2b3b-4efd-8213-4e7384c93df1 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:22.698153 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0db7f0da-2b3b-4efd-8213-4e7384c93df1 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:22.830665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0db7f0da-2b3b-4efd-8213-4e7384c93df1 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:22.838959 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0db7f0da-2b3b-4efd-8213-4e7384c93df1 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1680 microversion: 2.1 time: 0.154379 Aug 03 03:16:22.839543 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3741/7358] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:22 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:23.861610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ff46c997-21f5-4e28-a9ca-98893a143ce2 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:23.862227 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ff46c997-21f5-4e28-a9ca-98893a143ce2 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:23.869832 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff46c997-21f5-4e28-a9ca-98893a143ce2 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:23.870279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff46c997-21f5-4e28-a9ca-98893a143ce2 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:23.871089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff46c997-21f5-4e28-a9ca-98893a143ce2 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:23.871527 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ff46c997-21f5-4e28-a9ca-98893a143ce2 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:24.010294 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ff46c997-21f5-4e28-a9ca-98893a143ce2 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:24.018158 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ff46c997-21f5-4e28-a9ca-98893a143ce2 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1680 microversion: 2.1 time: 0.161135 Aug 03 03:16:24.018888 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3618/7359] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:23 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:25.041155 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-133c9d3c-b0cb-4bbf-9e27-439885d077a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:25.041694 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-133c9d3c-b0cb-4bbf-9e27-439885d077a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:25.048800 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-133c9d3c-b0cb-4bbf-9e27-439885d077a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:25.049273 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-133c9d3c-b0cb-4bbf-9e27-439885d077a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:25.050068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-133c9d3c-b0cb-4bbf-9e27-439885d077a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:25.050563 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-133c9d3c-b0cb-4bbf-9e27-439885d077a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:25.185566 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-133c9d3c-b0cb-4bbf-9e27-439885d077a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:25.193636 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-133c9d3c-b0cb-4bbf-9e27-439885d077a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1680 microversion: 2.1 time: 0.156374 Aug 03 03:16:25.194160 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3742/7360] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:25 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:16:26.215600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dbb51c5f-ff47-4413-82f1-d2d2aea0d282 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:26.216216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dbb51c5f-ff47-4413-82f1-d2d2aea0d282 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:26.226606 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbb51c5f-ff47-4413-82f1-d2d2aea0d282 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:26.227201 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbb51c5f-ff47-4413-82f1-d2d2aea0d282 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:26.228046 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbb51c5f-ff47-4413-82f1-d2d2aea0d282 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:26.228483 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dbb51c5f-ff47-4413-82f1-d2d2aea0d282 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:26.359169 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dbb51c5f-ff47-4413-82f1-d2d2aea0d282 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:26.367528 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dbb51c5f-ff47-4413-82f1-d2d2aea0d282 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1701 microversion: 2.1 time: 0.155839 Aug 03 03:16:26.368110 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3619/7361] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:26 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:27.391095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-47fc2ed7-331f-47cb-a2fa-f144c93d0dbc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:27.391733 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-47fc2ed7-331f-47cb-a2fa-f144c93d0dbc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:27.398926 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-47fc2ed7-331f-47cb-a2fa-f144c93d0dbc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:27.399398 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-47fc2ed7-331f-47cb-a2fa-f144c93d0dbc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:27.400191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-47fc2ed7-331f-47cb-a2fa-f144c93d0dbc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:27.400647 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-47fc2ed7-331f-47cb-a2fa-f144c93d0dbc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:27.538147 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-47fc2ed7-331f-47cb-a2fa-f144c93d0dbc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:27.545830 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-47fc2ed7-331f-47cb-a2fa-f144c93d0dbc tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1701 microversion: 2.1 time: 0.159047 Aug 03 03:16:27.546419 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3743/7362] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:27 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1701 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:28.568074 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ffcc5628-e530-42f7-9425-d5f893a09f02 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:28.568647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ffcc5628-e530-42f7-9425-d5f893a09f02 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:28.576064 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffcc5628-e530-42f7-9425-d5f893a09f02 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:28.576532 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffcc5628-e530-42f7-9425-d5f893a09f02 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:28.577363 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffcc5628-e530-42f7-9425-d5f893a09f02 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:28.577813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ffcc5628-e530-42f7-9425-d5f893a09f02 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:28.715789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ffcc5628-e530-42f7-9425-d5f893a09f02 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:28.729028 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ffcc5628-e530-42f7-9425-d5f893a09f02 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1696 microversion: 2.1 time: 0.165709 Aug 03 03:16:28.729873 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3620/7363] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:28 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:29.751408 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-faefe94a-ac1b-4a7c-ae8e-8231a7c8dcbd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:29.752564 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-faefe94a-ac1b-4a7c-ae8e-8231a7c8dcbd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:29.761501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faefe94a-ac1b-4a7c-ae8e-8231a7c8dcbd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:29.761983 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faefe94a-ac1b-4a7c-ae8e-8231a7c8dcbd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:29.762798 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faefe94a-ac1b-4a7c-ae8e-8231a7c8dcbd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:29.763290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-faefe94a-ac1b-4a7c-ae8e-8231a7c8dcbd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:29.913904 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-faefe94a-ac1b-4a7c-ae8e-8231a7c8dcbd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:29.921710 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-faefe94a-ac1b-4a7c-ae8e-8231a7c8dcbd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1696 microversion: 2.1 time: 0.174667 Aug 03 03:16:29.930548 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3744/7364] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:29 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:30.945640 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-24cd472d-cabd-4ff7-b69f-eaca41ba01b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:30.947156 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-24cd472d-cabd-4ff7-b69f-eaca41ba01b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:30.962447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24cd472d-cabd-4ff7-b69f-eaca41ba01b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:30.963533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24cd472d-cabd-4ff7-b69f-eaca41ba01b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:30.965470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24cd472d-cabd-4ff7-b69f-eaca41ba01b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:30.966193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-24cd472d-cabd-4ff7-b69f-eaca41ba01b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:30.981492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-66b9800d-88ae-4ba1-98f8-ac79d55cbca2 req-94e25b56-1cdf-4bcc-b883-931de01c703c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5176fa-48b0-4fb6-92e9-8b0bc30ed525", "name": "network-vif-plugged", "status": "completed", "tag": "6d3cfed4-e72b-4959-973b-511691fbdfcf"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:16:30.998739 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-66b9800d-88ae-4ba1-98f8-ac79d55cbca2 req-94e25b56-1cdf-4bcc-b883-931de01c703c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:30.999491 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-66b9800d-88ae-4ba1-98f8-ac79d55cbca2 req-94e25b56-1cdf-4bcc-b883-931de01c703c service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:31.017019 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-66b9800d-88ae-4ba1-98f8-ac79d55cbca2 req-94e25b56-1cdf-4bcc-b883-931de01c703c service nova] Creating event network-vif-plugged:6d3cfed4-e72b-4959-973b-511691fbdfcf for instance 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 on n-h2-826529-8 Aug 03 03:16:31.024149 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-66b9800d-88ae-4ba1-98f8-ac79d55cbca2 req-94e25b56-1cdf-4bcc-b883-931de01c703c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126023 Aug 03 03:16:31.024769 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3621/7365] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:16:31.144068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-24cd472d-cabd-4ff7-b69f-eaca41ba01b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:31.152464 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-24cd472d-cabd-4ff7-b69f-eaca41ba01b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1696 microversion: 2.1 time: 0.211675 Aug 03 03:16:31.153366 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3745/7366] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:30 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1696 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:16:32.179611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b45e2f0e-8ee4-4e8a-a9c1-506091fc489e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:32.181111 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b45e2f0e-8ee4-4e8a-a9c1-506091fc489e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:32.188151 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b45e2f0e-8ee4-4e8a-a9c1-506091fc489e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:32.188751 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b45e2f0e-8ee4-4e8a-a9c1-506091fc489e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:32.189554 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b45e2f0e-8ee4-4e8a-a9c1-506091fc489e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:32.190005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b45e2f0e-8ee4-4e8a-a9c1-506091fc489e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:32.365561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b45e2f0e-8ee4-4e8a-a9c1-506091fc489e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:32.374570 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b45e2f0e-8ee4-4e8a-a9c1-506091fc489e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1696 microversion: 2.1 time: 0.200852 Aug 03 03:16:32.375767 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3622/7367] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:32 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1696 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:33.397754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-293a3dfb-9052-4ac7-80ec-72abdc9a61ef tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:33.399434 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-293a3dfb-9052-4ac7-80ec-72abdc9a61ef tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:33.407359 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-293a3dfb-9052-4ac7-80ec-72abdc9a61ef tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:33.408212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-293a3dfb-9052-4ac7-80ec-72abdc9a61ef tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:33.409279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-293a3dfb-9052-4ac7-80ec-72abdc9a61ef tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:33.409811 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-293a3dfb-9052-4ac7-80ec-72abdc9a61ef tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:33.566052 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-293a3dfb-9052-4ac7-80ec-72abdc9a61ef tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:33.577156 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-293a3dfb-9052-4ac7-80ec-72abdc9a61ef tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1696 microversion: 2.1 time: 0.184048 Aug 03 03:16:33.578115 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3746/7368] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:33 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:34.600114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0342a0bb-a0be-4fa3-9517-e151a1952027 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:34.600734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0342a0bb-a0be-4fa3-9517-e151a1952027 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:34.610795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0342a0bb-a0be-4fa3-9517-e151a1952027 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:34.611297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0342a0bb-a0be-4fa3-9517-e151a1952027 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:34.612093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0342a0bb-a0be-4fa3-9517-e151a1952027 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:34.612548 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0342a0bb-a0be-4fa3-9517-e151a1952027 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:34.774493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0342a0bb-a0be-4fa3-9517-e151a1952027 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:34.785377 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0342a0bb-a0be-4fa3-9517-e151a1952027 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1696 microversion: 2.1 time: 0.189435 Aug 03 03:16:34.786858 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3623/7369] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:34 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1696 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:35.806781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-50df9def-faf8-4e9d-ba80-643999fb9f18 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:35.807577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-50df9def-faf8-4e9d-ba80-643999fb9f18 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:35.816784 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50df9def-faf8-4e9d-ba80-643999fb9f18 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:35.817795 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50df9def-faf8-4e9d-ba80-643999fb9f18 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:35.818834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50df9def-faf8-4e9d-ba80-643999fb9f18 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:35.819546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50df9def-faf8-4e9d-ba80-643999fb9f18 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:35.973393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-50df9def-faf8-4e9d-ba80-643999fb9f18 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:35.981859 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-50df9def-faf8-4e9d-ba80-643999fb9f18 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1696 microversion: 2.1 time: 0.178967 Aug 03 03:16:35.984642 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3747/7370] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:35 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:37.005132 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-207bc969-9b48-40a4-8bf4-bcb4fc7a8b40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:37.006381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-207bc969-9b48-40a4-8bf4-bcb4fc7a8b40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:37.014507 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-207bc969-9b48-40a4-8bf4-bcb4fc7a8b40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:37.015438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-207bc969-9b48-40a4-8bf4-bcb4fc7a8b40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:37.016415 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-207bc969-9b48-40a4-8bf4-bcb4fc7a8b40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:37.016894 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-207bc969-9b48-40a4-8bf4-bcb4fc7a8b40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:37.175411 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-207bc969-9b48-40a4-8bf4-bcb4fc7a8b40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:37.184194 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-207bc969-9b48-40a4-8bf4-bcb4fc7a8b40 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1696 microversion: 2.1 time: 0.183332 Aug 03 03:16:37.185371 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3624/7371] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:36 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:38.205881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4bb5dbe8-83b9-4ab0-9aa4-dcf1b876e474 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:38.206544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4bb5dbe8-83b9-4ab0-9aa4-dcf1b876e474 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:38.214332 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4bb5dbe8-83b9-4ab0-9aa4-dcf1b876e474 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:38.214808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4bb5dbe8-83b9-4ab0-9aa4-dcf1b876e474 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:38.215639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4bb5dbe8-83b9-4ab0-9aa4-dcf1b876e474 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:38.216097 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4bb5dbe8-83b9-4ab0-9aa4-dcf1b876e474 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:38.745252 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4bb5dbe8-83b9-4ab0-9aa4-dcf1b876e474 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:38.753175 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4bb5dbe8-83b9-4ab0-9aa4-dcf1b876e474 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1678 microversion: 2.1 time: 0.551399 Aug 03 03:16:38.753772 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3748/7372] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:38 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1678 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:39.775365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6df63313-451d-4bbf-98b0-e87c12925967 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:39.776005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6df63313-451d-4bbf-98b0-e87c12925967 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:39.783290 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6df63313-451d-4bbf-98b0-e87c12925967 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:39.783756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6df63313-451d-4bbf-98b0-e87c12925967 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:39.784525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6df63313-451d-4bbf-98b0-e87c12925967 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:39.784970 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6df63313-451d-4bbf-98b0-e87c12925967 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:39.916772 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6df63313-451d-4bbf-98b0-e87c12925967 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:39.924416 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6df63313-451d-4bbf-98b0-e87c12925967 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1678 microversion: 2.1 time: 0.153009 Aug 03 03:16:39.925001 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3625/7373] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:39 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:40.893698 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-022edb87-4958-4207-9e76-5103c48bc3c7 req-67919501-8a35-4a85-b4c2-26a178d718da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5176fa-48b0-4fb6-92e9-8b0bc30ed525", "name": "network-vif-unplugged", "status": "completed", "tag": "6d3cfed4-e72b-4959-973b-511691fbdfcf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:16:40.905226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-022edb87-4958-4207-9e76-5103c48bc3c7 req-67919501-8a35-4a85-b4c2-26a178d718da service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:40.905689 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-022edb87-4958-4207-9e76-5103c48bc3c7 req-67919501-8a35-4a85-b4c2-26a178d718da service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:40.917701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.compute.server_external_events [req-022edb87-4958-4207-9e76-5103c48bc3c7 req-67919501-8a35-4a85-b4c2-26a178d718da service nova] Unable to find a host for instance 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525. Dropping event network-vif-unplugged {{(pid=125941) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 03:16:40.918611 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-022edb87-4958-4207-9e76-5103c48bc3c7 req-67919501-8a35-4a85-b4c2-26a178d718da service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028814 Aug 03 03:16:40.919257 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3749/7374] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 03 03:16:40.946370 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-edc282e1-a5d5-45bc-81f2-68d6131709a6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:40.947129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-edc282e1-a5d5-45bc-81f2-68d6131709a6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:40.954225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-edc282e1-a5d5-45bc-81f2-68d6131709a6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:40.954764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-edc282e1-a5d5-45bc-81f2-68d6131709a6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:40.955579 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-edc282e1-a5d5-45bc-81f2-68d6131709a6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:40.956024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-edc282e1-a5d5-45bc-81f2-68d6131709a6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:41.095192 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-edc282e1-a5d5-45bc-81f2-68d6131709a6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:41.103171 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-edc282e1-a5d5-45bc-81f2-68d6131709a6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1621 microversion: 2.1 time: 0.161471 Aug 03 03:16:41.103752 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3626/7375] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:40 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1621 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:41.124290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bdce6141-17d6-4497-b76b-32824e25b233 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:16:41.124911 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bdce6141-17d6-4497-b76b-32824e25b233 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:41.131910 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdce6141-17d6-4497-b76b-32824e25b233 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:41.132383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdce6141-17d6-4497-b76b-32824e25b233 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:41.133176 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdce6141-17d6-4497-b76b-32824e25b233 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:41.133634 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-bdce6141-17d6-4497-b76b-32824e25b233 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:41.220625 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bdce6141-17d6-4497-b76b-32824e25b233 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125941) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 03:16:41.287532 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bdce6141-17d6-4497-b76b-32824e25b233 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "POST /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525/action" status: 202 len: 0 microversion: 2.1 time: 0.167147 Aug 03 03:16:41.291249 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3750/7376] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:16:41 2022] POST /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:16:41.296406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-18e4d3bc-a7b8-4ca7-92c3-217d45a03434 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:41.297035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-18e4d3bc-a7b8-4ca7-92c3-217d45a03434 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:41.304093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18e4d3bc-a7b8-4ca7-92c3-217d45a03434 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:41.304557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18e4d3bc-a7b8-4ca7-92c3-217d45a03434 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:41.305358 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18e4d3bc-a7b8-4ca7-92c3-217d45a03434 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:41.306219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-18e4d3bc-a7b8-4ca7-92c3-217d45a03434 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:41.452735 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-18e4d3bc-a7b8-4ca7-92c3-217d45a03434 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:41.462242 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-18e4d3bc-a7b8-4ca7-92c3-217d45a03434 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1629 microversion: 2.1 time: 0.169355 Aug 03 03:16:41.463043 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3627/7377] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:41 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1629 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:16:42.487485 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-50090704-6050-43eb-8ec5-2cae0d652cfb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:42.488050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-50090704-6050-43eb-8ec5-2cae0d652cfb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:42.494816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50090704-6050-43eb-8ec5-2cae0d652cfb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:42.495313 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50090704-6050-43eb-8ec5-2cae0d652cfb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:42.496092 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50090704-6050-43eb-8ec5-2cae0d652cfb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:42.496538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-50090704-6050-43eb-8ec5-2cae0d652cfb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:42.636992 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-50090704-6050-43eb-8ec5-2cae0d652cfb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:42.644556 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-50090704-6050-43eb-8ec5-2cae0d652cfb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1687 microversion: 2.1 time: 0.161974 Aug 03 03:16:42.645718 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3751/7378] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:42 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:43.668496 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ba4ad0b9-3e30-4198-8960-28d217e1ccbb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:43.669184 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ba4ad0b9-3e30-4198-8960-28d217e1ccbb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:43.676241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba4ad0b9-3e30-4198-8960-28d217e1ccbb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:43.677318 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba4ad0b9-3e30-4198-8960-28d217e1ccbb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:43.678086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba4ad0b9-3e30-4198-8960-28d217e1ccbb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:43.678536 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ba4ad0b9-3e30-4198-8960-28d217e1ccbb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:43.825808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ba4ad0b9-3e30-4198-8960-28d217e1ccbb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:43.836046 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ba4ad0b9-3e30-4198-8960-28d217e1ccbb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1687 microversion: 2.1 time: 0.171362 Aug 03 03:16:43.836817 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3628/7379] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:43 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:43.856027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-29fc2783-7a54-4849-8de5-15a795595fde req-7a38be6f-e67d-48fc-98e1-f332b5e12488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5176fa-48b0-4fb6-92e9-8b0bc30ed525", "tag": "6d3cfed4-e72b-4959-973b-511691fbdfcf"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:16:43.866264 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-29fc2783-7a54-4849-8de5-15a795595fde req-7a38be6f-e67d-48fc-98e1-f332b5e12488 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:43.866734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-29fc2783-7a54-4849-8de5-15a795595fde req-7a38be6f-e67d-48fc-98e1-f332b5e12488 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:43.878404 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-29fc2783-7a54-4849-8de5-15a795595fde req-7a38be6f-e67d-48fc-98e1-f332b5e12488 service nova] Creating event network-changed:6d3cfed4-e72b-4959-973b-511691fbdfcf for instance 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 on n-h1-826529-8 Aug 03 03:16:43.884395 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-29fc2783-7a54-4849-8de5-15a795595fde req-7a38be6f-e67d-48fc-98e1-f332b5e12488 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101306 Aug 03 03:16:43.885106 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3752/7380] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:16:44.859158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d0c8f7c7-fdba-495f-9a36-5976a8586501 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:44.861030 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d0c8f7c7-fdba-495f-9a36-5976a8586501 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:44.872024 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0c8f7c7-fdba-495f-9a36-5976a8586501 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:44.872905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0c8f7c7-fdba-495f-9a36-5976a8586501 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:44.873981 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0c8f7c7-fdba-495f-9a36-5976a8586501 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:44.874831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d0c8f7c7-fdba-495f-9a36-5976a8586501 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:44.881933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:16:45.036933 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d0c8f7c7-fdba-495f-9a36-5976a8586501 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:45.044904 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d0c8f7c7-fdba-495f-9a36-5976a8586501 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1687 microversion: 2.1 time: 0.190653 Aug 03 03:16:45.045825 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3629/7381] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:44 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1687 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:46.071937 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c783362c-1da5-4e94-89b1-8f137ff185d4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:46.072665 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c783362c-1da5-4e94-89b1-8f137ff185d4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:46.074684 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:16:46.080421 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c783362c-1da5-4e94-89b1-8f137ff185d4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:46.081150 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c783362c-1da5-4e94-89b1-8f137ff185d4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:46.082112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c783362c-1da5-4e94-89b1-8f137ff185d4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:46.083503 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c783362c-1da5-4e94-89b1-8f137ff185d4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:46.087754 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:16:46.256645 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c783362c-1da5-4e94-89b1-8f137ff185d4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:46.264958 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c783362c-1da5-4e94-89b1-8f137ff185d4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1687 microversion: 2.1 time: 0.199996 Aug 03 03:16:46.265553 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3753/7382] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:46 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1687 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:47.288437 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-efaa96af-117a-4d0e-8da9-1bb19ac2b3ac tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:47.289279 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-efaa96af-117a-4d0e-8da9-1bb19ac2b3ac tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:47.293600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=33 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:16:47.299938 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-efaa96af-117a-4d0e-8da9-1bb19ac2b3ac tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:47.300614 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-efaa96af-117a-4d0e-8da9-1bb19ac2b3ac tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:47.301889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-efaa96af-117a-4d0e-8da9-1bb19ac2b3ac tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:47.302332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-efaa96af-117a-4d0e-8da9-1bb19ac2b3ac tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:47.458114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-efaa96af-117a-4d0e-8da9-1bb19ac2b3ac tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:47.465962 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-efaa96af-117a-4d0e-8da9-1bb19ac2b3ac tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1687 microversion: 2.1 time: 0.182328 Aug 03 03:16:47.466893 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3630/7383] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:47 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:48.489180 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6b0b8a2e-8afe-4bb3-acf2-98bf3037b525 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:48.490827 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6b0b8a2e-8afe-4bb3-acf2-98bf3037b525 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:48.498300 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b0b8a2e-8afe-4bb3-acf2-98bf3037b525 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:48.499303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b0b8a2e-8afe-4bb3-acf2-98bf3037b525 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:48.500406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b0b8a2e-8afe-4bb3-acf2-98bf3037b525 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:48.500925 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6b0b8a2e-8afe-4bb3-acf2-98bf3037b525 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:48.665585 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6b0b8a2e-8afe-4bb3-acf2-98bf3037b525 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:48.673550 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6b0b8a2e-8afe-4bb3-acf2-98bf3037b525 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1687 microversion: 2.1 time: 0.188398 Aug 03 03:16:48.674141 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3754/7384] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:48 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:49.698025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-8544f336-2891-46a7-a82d-b55a79b8e1a5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:49.698676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-8544f336-2891-46a7-a82d-b55a79b8e1a5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:49.710372 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8544f336-2891-46a7-a82d-b55a79b8e1a5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:49.710944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8544f336-2891-46a7-a82d-b55a79b8e1a5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:49.711803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8544f336-2891-46a7-a82d-b55a79b8e1a5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:49.712248 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-8544f336-2891-46a7-a82d-b55a79b8e1a5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:49.867869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-8544f336-2891-46a7-a82d-b55a79b8e1a5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:49.875928 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-8544f336-2891-46a7-a82d-b55a79b8e1a5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1687 microversion: 2.1 time: 0.181858 Aug 03 03:16:49.876517 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3631/7385] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:49 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:50.898467 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-51b67d30-84b3-4904-b470-b4495d85005e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:50.899943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-51b67d30-84b3-4904-b470-b4495d85005e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:50.908141 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51b67d30-84b3-4904-b470-b4495d85005e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:50.908969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51b67d30-84b3-4904-b470-b4495d85005e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:50.910007 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51b67d30-84b3-4904-b470-b4495d85005e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:50.910838 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-51b67d30-84b3-4904-b470-b4495d85005e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:51.113970 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-51b67d30-84b3-4904-b470-b4495d85005e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:51.123098 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-51b67d30-84b3-4904-b470-b4495d85005e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1687 microversion: 2.1 time: 0.228543 Aug 03 03:16:51.125006 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3755/7386] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:50 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1687 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:52.145089 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e750f839-6350-4718-9b5c-fc21d8335f99 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:52.145789 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e750f839-6350-4718-9b5c-fc21d8335f99 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:52.154255 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e750f839-6350-4718-9b5c-fc21d8335f99 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:52.154713 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e750f839-6350-4718-9b5c-fc21d8335f99 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:52.155810 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e750f839-6350-4718-9b5c-fc21d8335f99 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:52.156256 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e750f839-6350-4718-9b5c-fc21d8335f99 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:52.300656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e750f839-6350-4718-9b5c-fc21d8335f99 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:52.311187 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e750f839-6350-4718-9b5c-fc21d8335f99 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1687 microversion: 2.1 time: 0.169511 Aug 03 03:16:52.311668 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3632/7387] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:52 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:53.336239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-3e59f822-2f70-4b6e-956b-fa557ecdf123 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:53.336893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-3e59f822-2f70-4b6e-956b-fa557ecdf123 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:53.344058 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e59f822-2f70-4b6e-956b-fa557ecdf123 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:53.344532 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e59f822-2f70-4b6e-956b-fa557ecdf123 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:53.345340 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e59f822-2f70-4b6e-956b-fa557ecdf123 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:53.345807 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-3e59f822-2f70-4b6e-956b-fa557ecdf123 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:53.494751 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-3e59f822-2f70-4b6e-956b-fa557ecdf123 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:53.503892 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-3e59f822-2f70-4b6e-956b-fa557ecdf123 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1687 microversion: 2.1 time: 0.172547 Aug 03 03:16:53.504761 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3756/7388] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:53 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:54.525911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-90f92f59-78cc-4ccd-a62d-86de8178888d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:54.526612 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-90f92f59-78cc-4ccd-a62d-86de8178888d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:54.535218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90f92f59-78cc-4ccd-a62d-86de8178888d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:54.536102 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90f92f59-78cc-4ccd-a62d-86de8178888d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:54.536899 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90f92f59-78cc-4ccd-a62d-86de8178888d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:54.537412 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-90f92f59-78cc-4ccd-a62d-86de8178888d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:54.678736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-90f92f59-78cc-4ccd-a62d-86de8178888d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:54.686337 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-90f92f59-78cc-4ccd-a62d-86de8178888d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1687 microversion: 2.1 time: 0.164489 Aug 03 03:16:54.686892 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3633/7389] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:54 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:55.708442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a8ec3d61-2ec4-40f6-bb2a-90097db8df5e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:55.709603 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a8ec3d61-2ec4-40f6-bb2a-90097db8df5e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:55.716583 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8ec3d61-2ec4-40f6-bb2a-90097db8df5e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:55.717050 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8ec3d61-2ec4-40f6-bb2a-90097db8df5e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:55.717836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8ec3d61-2ec4-40f6-bb2a-90097db8df5e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:55.718286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a8ec3d61-2ec4-40f6-bb2a-90097db8df5e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:55.856012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a8ec3d61-2ec4-40f6-bb2a-90097db8df5e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:55.863639 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a8ec3d61-2ec4-40f6-bb2a-90097db8df5e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1687 microversion: 2.1 time: 0.159089 Aug 03 03:16:55.864232 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3757/7390] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:55 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:56.210273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ae968318-b8b3-457d-a974-109cfaed55e6 req-f4e3cc84-79a2-41f1-9401-9a5e3aec6f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5176fa-48b0-4fb6-92e9-8b0bc30ed525", "name": "network-vif-plugged", "status": "completed", "tag": "6d3cfed4-e72b-4959-973b-511691fbdfcf"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:16:56.223659 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ae968318-b8b3-457d-a974-109cfaed55e6 req-f4e3cc84-79a2-41f1-9401-9a5e3aec6f3a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:56.225218 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ae968318-b8b3-457d-a974-109cfaed55e6 req-f4e3cc84-79a2-41f1-9401-9a5e3aec6f3a service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:56.236803 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ae968318-b8b3-457d-a974-109cfaed55e6 req-f4e3cc84-79a2-41f1-9401-9a5e3aec6f3a service nova] Creating event network-vif-plugged:6d3cfed4-e72b-4959-973b-511691fbdfcf for instance 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 on n-h1-826529-8 Aug 03 03:16:56.242239 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ae968318-b8b3-457d-a974-109cfaed55e6 req-f4e3cc84-79a2-41f1-9401-9a5e3aec6f3a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036300 Aug 03 03:16:56.243345 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3634/7391] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:16:56.886301 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4313c4c7-c113-42e1-8745-e092fe87d1d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:56.886949 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4313c4c7-c113-42e1-8745-e092fe87d1d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:56.893881 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4313c4c7-c113-42e1-8745-e092fe87d1d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:56.894351 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4313c4c7-c113-42e1-8745-e092fe87d1d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:56.895168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4313c4c7-c113-42e1-8745-e092fe87d1d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:56.895755 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4313c4c7-c113-42e1-8745-e092fe87d1d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:57.031233 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4313c4c7-c113-42e1-8745-e092fe87d1d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:57.039424 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4313c4c7-c113-42e1-8745-e092fe87d1d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1687 microversion: 2.1 time: 0.157631 Aug 03 03:16:57.040022 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3758/7392] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:56 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:16:58.062706 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0333fbd3-7600-4fc4-9fb2-a0b784fd360e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:16:58.063493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0333fbd3-7600-4fc4-9fb2-a0b784fd360e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:16:58.072313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0333fbd3-7600-4fc4-9fb2-a0b784fd360e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:58.072778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0333fbd3-7600-4fc4-9fb2-a0b784fd360e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:58.073578 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0333fbd3-7600-4fc4-9fb2-a0b784fd360e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:16:58.074028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0333fbd3-7600-4fc4-9fb2-a0b784fd360e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:16:58.214495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0333fbd3-7600-4fc4-9fb2-a0b784fd360e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:16:58.222378 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0333fbd3-7600-4fc4-9fb2-a0b784fd360e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1674 microversion: 2.1 time: 0.163886 Aug 03 03:16:58.222749 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3635/7393] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:16:58 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:10.829722 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=11 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:18:10.830526 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=35 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:18:10.833889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=11 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:18:10.834647 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=36 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:18:10.838573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-6168a5f1-03c4-4120-bc90-6a6327946529 req-39c67b47-9e57-407e-8326-69ce012d1db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5176fa-48b0-4fb6-92e9-8b0bc30ed525", "tag": "6d3cfed4-e72b-4959-973b-511691fbdfcf"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:18:10.847799 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f77b7b2b-d074-41ca-8405-cb214760e3c6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:10.848623 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f77b7b2b-d074-41ca-8405-cb214760e3c6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:10.850555 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6168a5f1-03c4-4120-bc90-6a6327946529 req-39c67b47-9e57-407e-8326-69ce012d1db9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:10.851179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-6168a5f1-03c4-4120-bc90-6a6327946529 req-39c67b47-9e57-407e-8326-69ce012d1db9 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:10.855654 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f77b7b2b-d074-41ca-8405-cb214760e3c6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:10.856128 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f77b7b2b-d074-41ca-8405-cb214760e3c6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:10.857193 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f77b7b2b-d074-41ca-8405-cb214760e3c6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:10.857637 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f77b7b2b-d074-41ca-8405-cb214760e3c6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:10.865527 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-6168a5f1-03c4-4120-bc90-6a6327946529 req-39c67b47-9e57-407e-8326-69ce012d1db9 service nova] Creating event network-changed:6d3cfed4-e72b-4959-973b-511691fbdfcf for instance 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 on n-h1-826529-8 Aug 03 03:18:10.871747 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-6168a5f1-03c4-4120-bc90-6a6327946529 req-39c67b47-9e57-407e-8326-69ce012d1db9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038844 Aug 03 03:18:10.872368 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3636/7394] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:18:10.886488 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f77b7b2b-d074-41ca-8405-cb214760e3c6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 03:18:10.980286 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f77b7b2b-d074-41ca-8405-cb214760e3c6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 204 len: 0 microversion: 2.1 time: 0.152393 Aug 03 03:18:10.981871 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3759/7395] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 03:18:10 2022] DELETE /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 03:18:10.993521 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-60407777-15ad-45f0-9559-bd8bc8d44fba tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:10.994624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-60407777-15ad-45f0-9559-bd8bc8d44fba tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:11.002239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60407777-15ad-45f0-9559-bd8bc8d44fba tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:11.002893 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60407777-15ad-45f0-9559-bd8bc8d44fba tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:11.003777 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60407777-15ad-45f0-9559-bd8bc8d44fba tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:11.004182 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-60407777-15ad-45f0-9559-bd8bc8d44fba tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:11.149790 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-60407777-15ad-45f0-9559-bd8bc8d44fba tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:11.158819 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-60407777-15ad-45f0-9559-bd8bc8d44fba tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1680 microversion: 2.1 time: 0.171282 Aug 03 03:18:11.166949 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3637/7396] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:10 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:12.185692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6fafe669-fa7d-4fb2-864c-57c5531642bf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:12.186424 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6fafe669-fa7d-4fb2-864c-57c5531642bf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:12.194307 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6fafe669-fa7d-4fb2-864c-57c5531642bf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:12.194782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6fafe669-fa7d-4fb2-864c-57c5531642bf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:12.195775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6fafe669-fa7d-4fb2-864c-57c5531642bf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:12.197303 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6fafe669-fa7d-4fb2-864c-57c5531642bf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:12.346323 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6fafe669-fa7d-4fb2-864c-57c5531642bf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:12.354607 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6fafe669-fa7d-4fb2-864c-57c5531642bf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 200 len: 1680 microversion: 2.1 time: 0.173909 Aug 03 03:18:12.355288 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3760/7397] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:12 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:12.886932 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-45ca4eaf-0b33-4267-9ea8-849bac987aeb req-6f52c9db-41b9-4ff7-95c2-4b0cb1a7d5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5176fa-48b0-4fb6-92e9-8b0bc30ed525", "name": "network-vif-deleted", "tag": "6d3cfed4-e72b-4959-973b-511691fbdfcf"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:18:12.898689 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-45ca4eaf-0b33-4267-9ea8-849bac987aeb req-6f52c9db-41b9-4ff7-95c2-4b0cb1a7d5c1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:12.899176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-45ca4eaf-0b33-4267-9ea8-849bac987aeb req-6f52c9db-41b9-4ff7-95c2-4b0cb1a7d5c1 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:12.912468 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-45ca4eaf-0b33-4267-9ea8-849bac987aeb req-6f52c9db-41b9-4ff7-95c2-4b0cb1a7d5c1 service nova] Creating event network-vif-deleted:6d3cfed4-e72b-4959-973b-511691fbdfcf for instance 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 on n-h1-826529-8 Aug 03 03:18:12.917203 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-45ca4eaf-0b33-4267-9ea8-849bac987aeb req-6f52c9db-41b9-4ff7-95c2-4b0cb1a7d5c1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034354 Aug 03 03:18:12.918679 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3638/7398] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 03:18:13.377557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1e95303-a869-4d2f-aff6-5cef8ff952e6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:13.378188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b1e95303-a869-4d2f-aff6-5cef8ff952e6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:13.385280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1e95303-a869-4d2f-aff6-5cef8ff952e6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:13.385745 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1e95303-a869-4d2f-aff6-5cef8ff952e6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:13.387289 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1e95303-a869-4d2f-aff6-5cef8ff952e6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:13.387757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b1e95303-a869-4d2f-aff6-5cef8ff952e6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:13.401512 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-b1e95303-a869-4d2f-aff6-5cef8ff952e6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] HTTP exception thrown: Instance 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 could not be found. Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1e95303-a869-4d2f-aff6-5cef8ff952e6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Request method failure captured: Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 HTTP/1.1 Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6ef0HmXta8pMW_hRng5S1lGG0YdpM7gGMEJPiliZNDOy81uFUIM-b_qrUVtTIIxz-xFk_zC0Y6AigXhg9NicA5Jx4aMfbbJmPmuFQgognMCephssqSXhYoB-HXK3bb5-yKDpJizQKdph13FBhk0FhE4JPJnvF8G5n9ZWDMIm2H7evwE Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: cb3f415547664f468037910d72c11950 Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestShelveInstance-1068244353 Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cb3f415547664f468037910d72c11950", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cb3f415547664f468037910d72c11950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cb3f415547664f468037910d72c11950"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cb3f415547664f468037910d72c11950"}]}] Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestShelveInstance-1068244353 Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: cb3f415547664f468037910d72c11950 Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestShelveInstance-1068244353 Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestShelveInstance-1068244353-project Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 09d3a0a0db994610aedc1d41d926c0f5 Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestShelveInstance-1068244353-project Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 could not be found. Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '1c5176fa-48b0-4fb6-92e9-8b0bc30ed525'} Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 could not be found. Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 could not be found. Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:18:13.403265 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:18:13.408866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:18:13.408866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:18:13.408866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:18:13.408866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 03:18:13.408866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 03:18:13.408866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 could not be found. Aug 03 03:18:13.408866 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:18:13.408866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b1e95303-a869-4d2f-aff6-5cef8ff952e6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Returning 404 to user: Instance 1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 03:18:13.408866 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b1e95303-a869-4d2f-aff6-5cef8ff952e6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525" status: 404 len: 111 microversion: 2.1 time: 0.031078 Aug 03 03:18:13.408866 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3761/7399] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:13 2022] GET /compute/v2.1/servers/1c5176fa-48b0-4fb6-92e9-8b0bc30ed525 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 03:18:13.587031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9b5461f7-27e9-4ebb-8d15-23e6c8379cf3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '.version_select at 0x7f5b1205a160>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:13.612019 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9b5461f7-27e9-4ebb-8d15-23e6c8379cf3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1096744974" status: 202 len: 0 microversion: 2.1 time: 0.030285 Aug 03 03:18:13.612554 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3639/7400] 10.222.0.67 () {58 vars in 1254 bytes} [Wed Aug 3 03:18:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1096744974 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 03:18:13.639327 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2a3b6620-57c0-4d9b-a3df-6a2f83b205ed tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Action: 'create', calling method: .version_select at 0x7f5b11d705e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1916238506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSMhsd2HXL6qjGMeq8XU9WPD9N34vFVeeaBeFFjrkWsOJ8kgNna136DR8+9d9WzmDvX3fdV2mITZ3NN628aP8fCZxjFeoDZEqXmQkdq58+ZtyHCq799s2gMGZO3g+OzCg=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:18:13.659068 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-2a3b6620-57c0-4d9b-a3df-6a2f83b205ed tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Getting quotas for project cb3f415547664f468037910d72c11950. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:18:13.664417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-2a3b6620-57c0-4d9b-a3df-6a2f83b205ed tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Getting quotas for user 09d3a0a0db994610aedc1d41d926c0f5 and project cb3f415547664f468037910d72c11950. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:18:13.689629 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2a3b6620-57c0-4d9b-a3df-6a2f83b205ed tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.054878 Aug 03 03:18:13.690333 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3762/7401] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 03:18:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:18:31.156808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=10 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:18:31.157572 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:18:31.161807 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1384575935", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1916238506", "security_groups": [{"name": "tempest-secgroup-smoke-1026292795"}], "networks": [{"uuid": "d3d3b53c-90eb-4dd0-90d7-4f433ae3518d"}], "block_device_mapping_v2": [{"uuid": "cd512477-c095-4981-8f8e-1c93682c9f80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:18:31.286078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] validate_networks() for [('d3d3b53c-90eb-4dd0-90d7-4f433ae3518d', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 03:18:31.734379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 03:18:31.734808 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 03:18:31.735313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 03:18:31.735728 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 03:18:31.736156 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 03:18:31.748313 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:31.749108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:31.750368 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:31.750849 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:31.773862 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Getting quotas for project cb3f415547664f468037910d72c11950. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:18:31.787830 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Getting quotas for user 09d3a0a0db994610aedc1d41d926c0f5 and project cb3f415547664f468037910d72c11950. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:18:31.851526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 03:18:31.853843 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd512477-c095-4981-8f8e-1c93682c9f80',volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 03:18:31.990980 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-658b2052-4dac-4467-a5b6-6a54f00b74cf tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.836088 Aug 03 03:18:31.991573 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3640/7402] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 03:18:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 03:18:32.001686 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:18:32.002781 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=4 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:18:32.003732 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:18:32.010460 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e26efed1-28db-45de-95c7-4ea1282b6747 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:32.011339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e26efed1-28db-45de-95c7-4ea1282b6747 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:32.074995 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e26efed1-28db-45de-95c7-4ea1282b6747 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:32.082466 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e26efed1-28db-45de-95c7-4ea1282b6747 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1089 microversion: 2.1 time: 0.082667 Aug 03 03:18:32.083177 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3763/7403] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:31 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1089 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:33.103342 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b220cea4-92ed-42a9-8a44-82e7374c8355 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:33.104541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b220cea4-92ed-42a9-8a44-82e7374c8355 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:33.113417 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b220cea4-92ed-42a9-8a44-82e7374c8355 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:33.114410 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b220cea4-92ed-42a9-8a44-82e7374c8355 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:33.115406 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b220cea4-92ed-42a9-8a44-82e7374c8355 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:33.116005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b220cea4-92ed-42a9-8a44-82e7374c8355 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:33.194274 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b220cea4-92ed-42a9-8a44-82e7374c8355 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:33.203000 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b220cea4-92ed-42a9-8a44-82e7374c8355 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1205 microversion: 2.1 time: 0.103634 Aug 03 03:18:33.203547 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3641/7404] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:33 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1205 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:34.227168 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-d145949a-0563-49e2-99c8-a3f9257f59e4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:34.228154 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-d145949a-0563-49e2-99c8-a3f9257f59e4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:34.238034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d145949a-0563-49e2-99c8-a3f9257f59e4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:34.238501 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d145949a-0563-49e2-99c8-a3f9257f59e4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:34.239548 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d145949a-0563-49e2-99c8-a3f9257f59e4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:34.240221 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-d145949a-0563-49e2-99c8-a3f9257f59e4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:34.507858 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-d145949a-0563-49e2-99c8-a3f9257f59e4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:34.516921 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-d145949a-0563-49e2-99c8-a3f9257f59e4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1273 microversion: 2.1 time: 0.295399 Aug 03 03:18:34.517522 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3764/7405] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:34 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1273 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:18:34.752573 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-168ec83f-6b67-4f8d-911d-3892d5ab0b7c req-9208179c-1542-4447-aa11-2254bc2b7747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df503135-a3a9-403b-b0a0-2fdba181cfe3", "tag": "47e665d1-aa64-4fc4-b782-3c012087124e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:18:34.765366 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-168ec83f-6b67-4f8d-911d-3892d5ab0b7c req-9208179c-1542-4447-aa11-2254bc2b7747 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:34.766007 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-168ec83f-6b67-4f8d-911d-3892d5ab0b7c req-9208179c-1542-4447-aa11-2254bc2b7747 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:34.779747 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-168ec83f-6b67-4f8d-911d-3892d5ab0b7c req-9208179c-1542-4447-aa11-2254bc2b7747 service nova] Creating event network-changed:47e665d1-aa64-4fc4-b782-3c012087124e for instance df503135-a3a9-403b-b0a0-2fdba181cfe3 on n-h2-826529-8 Aug 03 03:18:34.786115 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-168ec83f-6b67-4f8d-911d-3892d5ab0b7c req-9208179c-1542-4447-aa11-2254bc2b7747 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124028 Aug 03 03:18:34.786759 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3642/7406] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:18:35.539912 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-996ee51e-f87e-40cc-9353-2d6e68594737 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:35.540457 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-996ee51e-f87e-40cc-9353-2d6e68594737 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:35.549649 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-996ee51e-f87e-40cc-9353-2d6e68594737 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:35.550131 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-996ee51e-f87e-40cc-9353-2d6e68594737 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:35.551027 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-996ee51e-f87e-40cc-9353-2d6e68594737 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:35.551539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-996ee51e-f87e-40cc-9353-2d6e68594737 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:35.775872 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-996ee51e-f87e-40cc-9353-2d6e68594737 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:35.785383 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-996ee51e-f87e-40cc-9353-2d6e68594737 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1273 microversion: 2.1 time: 0.250288 Aug 03 03:18:35.786475 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3765/7407] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:35 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1273 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:36.808202 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-279257e1-fd31-44cf-8a22-0601e12d2ccb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:36.809001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-279257e1-fd31-44cf-8a22-0601e12d2ccb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:36.816475 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-279257e1-fd31-44cf-8a22-0601e12d2ccb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:36.816944 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-279257e1-fd31-44cf-8a22-0601e12d2ccb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:36.817742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-279257e1-fd31-44cf-8a22-0601e12d2ccb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:36.818187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-279257e1-fd31-44cf-8a22-0601e12d2ccb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:36.959780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-279257e1-fd31-44cf-8a22-0601e12d2ccb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:36.968161 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-279257e1-fd31-44cf-8a22-0601e12d2ccb tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1273 microversion: 2.1 time: 0.164425 Aug 03 03:18:36.968753 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3643/7408] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:36 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:18:37.989468 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7898ac69-d703-4624-88fd-8cc9e1a08ac6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:37.990105 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7898ac69-d703-4624-88fd-8cc9e1a08ac6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:37.997866 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7898ac69-d703-4624-88fd-8cc9e1a08ac6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:37.998249 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7898ac69-d703-4624-88fd-8cc9e1a08ac6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:37.999080 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7898ac69-d703-4624-88fd-8cc9e1a08ac6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:37.999534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7898ac69-d703-4624-88fd-8cc9e1a08ac6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:38.154688 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7898ac69-d703-4624-88fd-8cc9e1a08ac6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:38.163402 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7898ac69-d703-4624-88fd-8cc9e1a08ac6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1273 microversion: 2.1 time: 0.177778 Aug 03 03:18:38.164022 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3766/7409] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:37 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1273 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:39.189424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-fbc9597a-878e-4060-a45b-7af7ce91ea79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:39.190078 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-fbc9597a-878e-4060-a45b-7af7ce91ea79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:39.199846 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbc9597a-878e-4060-a45b-7af7ce91ea79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:39.200300 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbc9597a-878e-4060-a45b-7af7ce91ea79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:39.201086 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbc9597a-878e-4060-a45b-7af7ce91ea79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:39.201529 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-fbc9597a-878e-4060-a45b-7af7ce91ea79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:39.336338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-fbc9597a-878e-4060-a45b-7af7ce91ea79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:39.343861 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-fbc9597a-878e-4060-a45b-7af7ce91ea79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1261 microversion: 2.1 time: 0.158534 Aug 03 03:18:39.344585 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3644/7410] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:39 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:40.366111 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b61b6402-3cbb-48eb-82f1-42e7aa33cc04 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:40.366736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b61b6402-3cbb-48eb-82f1-42e7aa33cc04 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:40.374290 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b61b6402-3cbb-48eb-82f1-42e7aa33cc04 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:40.374753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b61b6402-3cbb-48eb-82f1-42e7aa33cc04 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:40.375619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b61b6402-3cbb-48eb-82f1-42e7aa33cc04 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:40.376226 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b61b6402-3cbb-48eb-82f1-42e7aa33cc04 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:40.513894 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-b61b6402-3cbb-48eb-82f1-42e7aa33cc04 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:40.521593 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b61b6402-3cbb-48eb-82f1-42e7aa33cc04 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1261 microversion: 2.1 time: 0.159367 Aug 03 03:18:40.522162 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3767/7411] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:40 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:41.542321 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-dac48a70-dedb-46f7-a062-76fbb5bd8ca8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:41.543031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-dac48a70-dedb-46f7-a062-76fbb5bd8ca8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:41.552187 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dac48a70-dedb-46f7-a062-76fbb5bd8ca8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:41.552653 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dac48a70-dedb-46f7-a062-76fbb5bd8ca8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:41.553433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dac48a70-dedb-46f7-a062-76fbb5bd8ca8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:41.553875 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-dac48a70-dedb-46f7-a062-76fbb5bd8ca8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:41.688999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-dac48a70-dedb-46f7-a062-76fbb5bd8ca8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:41.696611 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-dac48a70-dedb-46f7-a062-76fbb5bd8ca8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1261 microversion: 2.1 time: 0.158214 Aug 03 03:18:41.697214 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3645/7412] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:41 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:42.718675 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-8a64c5f6-d165-4e7d-91b0-dc3d6ef3cd79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:42.719248 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-8a64c5f6-d165-4e7d-91b0-dc3d6ef3cd79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:42.722054 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:18:42.729275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a64c5f6-d165-4e7d-91b0-dc3d6ef3cd79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:42.729741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a64c5f6-d165-4e7d-91b0-dc3d6ef3cd79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:42.730531 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a64c5f6-d165-4e7d-91b0-dc3d6ef3cd79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:42.731043 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-8a64c5f6-d165-4e7d-91b0-dc3d6ef3cd79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:42.864951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-8a64c5f6-d165-4e7d-91b0-dc3d6ef3cd79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:42.873134 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-8a64c5f6-d165-4e7d-91b0-dc3d6ef3cd79 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1261 microversion: 2.1 time: 0.159227 Aug 03 03:18:42.873705 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3768/7413] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:42 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:43.893960 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-be7830cb-11c5-438a-98e3-cf1e0c2b102e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:43.894585 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-be7830cb-11c5-438a-98e3-cf1e0c2b102e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:43.896577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:18:43.897350 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:18:43.904600 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be7830cb-11c5-438a-98e3-cf1e0c2b102e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:43.905113 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be7830cb-11c5-438a-98e3-cf1e0c2b102e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:43.905901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be7830cb-11c5-438a-98e3-cf1e0c2b102e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:43.906607 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-be7830cb-11c5-438a-98e3-cf1e0c2b102e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:44.042270 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-be7830cb-11c5-438a-98e3-cf1e0c2b102e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:44.051197 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-be7830cb-11c5-438a-98e3-cf1e0c2b102e tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1261 microversion: 2.1 time: 0.161171 Aug 03 03:18:44.051787 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3646/7414] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:43 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:45.073276 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6c99d306-a09e-472d-846c-45ea31554765 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:45.073898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6c99d306-a09e-472d-846c-45ea31554765 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:45.080888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c99d306-a09e-472d-846c-45ea31554765 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:45.081350 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c99d306-a09e-472d-846c-45ea31554765 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:45.082129 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c99d306-a09e-472d-846c-45ea31554765 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:45.082577 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6c99d306-a09e-472d-846c-45ea31554765 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:45.213683 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6c99d306-a09e-472d-846c-45ea31554765 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:45.222332 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6c99d306-a09e-472d-846c-45ea31554765 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1261 microversion: 2.1 time: 0.152997 Aug 03 03:18:45.223010 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3769/7415] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:45 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:46.243438 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b70ad3d6-c876-4496-8c49-31fc62cd3a5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:46.244061 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b70ad3d6-c876-4496-8c49-31fc62cd3a5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:46.252006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b70ad3d6-c876-4496-8c49-31fc62cd3a5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:46.252541 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b70ad3d6-c876-4496-8c49-31fc62cd3a5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:46.253332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b70ad3d6-c876-4496-8c49-31fc62cd3a5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:46.253779 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b70ad3d6-c876-4496-8c49-31fc62cd3a5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:46.392251 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b70ad3d6-c876-4496-8c49-31fc62cd3a5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:46.399842 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b70ad3d6-c876-4496-8c49-31fc62cd3a5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1261 microversion: 2.1 time: 0.160270 Aug 03 03:18:46.400421 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3647/7416] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:46 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:47.421734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c2a98d0d-7fef-49fc-a581-ae9d05746da4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:47.422580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c2a98d0d-7fef-49fc-a581-ae9d05746da4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:47.429554 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2a98d0d-7fef-49fc-a581-ae9d05746da4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:47.430022 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2a98d0d-7fef-49fc-a581-ae9d05746da4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:47.430801 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2a98d0d-7fef-49fc-a581-ae9d05746da4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:47.431286 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c2a98d0d-7fef-49fc-a581-ae9d05746da4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:47.568792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c2a98d0d-7fef-49fc-a581-ae9d05746da4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:47.577327 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c2a98d0d-7fef-49fc-a581-ae9d05746da4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1261 microversion: 2.1 time: 0.160063 Aug 03 03:18:47.578126 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3770/7417] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:47 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:47.612096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-053211f2-407f-417e-81f6-edf7cb58c02c req-99dc913b-9fb3-4308-bc54-2ee4ccd7bfde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df503135-a3a9-403b-b0a0-2fdba181cfe3", "name": "network-vif-plugged", "status": "completed", "tag": "47e665d1-aa64-4fc4-b782-3c012087124e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:18:47.622545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-053211f2-407f-417e-81f6-edf7cb58c02c req-99dc913b-9fb3-4308-bc54-2ee4ccd7bfde service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:47.623100 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-053211f2-407f-417e-81f6-edf7cb58c02c req-99dc913b-9fb3-4308-bc54-2ee4ccd7bfde service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:47.634712 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-053211f2-407f-417e-81f6-edf7cb58c02c req-99dc913b-9fb3-4308-bc54-2ee4ccd7bfde service nova] Creating event network-vif-plugged:47e665d1-aa64-4fc4-b782-3c012087124e for instance df503135-a3a9-403b-b0a0-2fdba181cfe3 on n-h2-826529-8 Aug 03 03:18:47.639895 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-053211f2-407f-417e-81f6-edf7cb58c02c req-99dc913b-9fb3-4308-bc54-2ee4ccd7bfde service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032112 Aug 03 03:18:47.640642 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3648/7418] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 03:18:48.599734 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9ff27a9b-eb64-4f13-8fc2-ca91ee09b2b9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:48.600352 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9ff27a9b-eb64-4f13-8fc2-ca91ee09b2b9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:48.607015 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ff27a9b-eb64-4f13-8fc2-ca91ee09b2b9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:48.607486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ff27a9b-eb64-4f13-8fc2-ca91ee09b2b9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:48.608275 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ff27a9b-eb64-4f13-8fc2-ca91ee09b2b9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:48.608729 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9ff27a9b-eb64-4f13-8fc2-ca91ee09b2b9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:48.747770 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-9ff27a9b-eb64-4f13-8fc2-ca91ee09b2b9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:48.756090 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9ff27a9b-eb64-4f13-8fc2-ca91ee09b2b9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1261 microversion: 2.1 time: 0.160800 Aug 03 03:18:48.756670 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3771/7419] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:48 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:49.778349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e1952dfb-7b8f-40be-a050-d44efb77baa7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:49.779107 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e1952dfb-7b8f-40be-a050-d44efb77baa7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:49.786025 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1952dfb-7b8f-40be-a050-d44efb77baa7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:49.786486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1952dfb-7b8f-40be-a050-d44efb77baa7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:49.787314 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1952dfb-7b8f-40be-a050-d44efb77baa7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:49.787760 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e1952dfb-7b8f-40be-a050-d44efb77baa7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:49.925855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e1952dfb-7b8f-40be-a050-d44efb77baa7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:49.933937 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e1952dfb-7b8f-40be-a050-d44efb77baa7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1444 microversion: 2.1 time: 0.160645 Aug 03 03:18:49.934515 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3649/7420] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:49 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:49.957239 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6becadd0-ab16-4b74-b1d7-719c08fa2ac5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:18:49.957868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6becadd0-ab16-4b74-b1d7-719c08fa2ac5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:18:49.965383 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6becadd0-ab16-4b74-b1d7-719c08fa2ac5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:49.965845 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6becadd0-ab16-4b74-b1d7-719c08fa2ac5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:49.966643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6becadd0-ab16-4b74-b1d7-719c08fa2ac5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:49.967139 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6becadd0-ab16-4b74-b1d7-719c08fa2ac5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:50.124361 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6becadd0-ab16-4b74-b1d7-719c08fa2ac5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:18:50.132336 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6becadd0-ab16-4b74-b1d7-719c08fa2ac5 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1444 microversion: 2.1 time: 0.180147 Aug 03 03:18:50.132925 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3772/7421] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:18:49 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1444 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:18:52.151813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-3b66bf57-696a-4c28-95af-2e8e480847a4 req-1f15a4ac-1d02-4377-9182-6e1e6da3e62b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df503135-a3a9-403b-b0a0-2fdba181cfe3", "tag": "47e665d1-aa64-4fc4-b782-3c012087124e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:18:52.162842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3b66bf57-696a-4c28-95af-2e8e480847a4 req-1f15a4ac-1d02-4377-9182-6e1e6da3e62b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:18:52.163574 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-3b66bf57-696a-4c28-95af-2e8e480847a4 req-1f15a4ac-1d02-4377-9182-6e1e6da3e62b service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:18:52.175433 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-3b66bf57-696a-4c28-95af-2e8e480847a4 req-1f15a4ac-1d02-4377-9182-6e1e6da3e62b service nova] Creating event network-changed:47e665d1-aa64-4fc4-b782-3c012087124e for instance df503135-a3a9-403b-b0a0-2fdba181cfe3 on n-h2-826529-8 Aug 03 03:18:52.180618 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-3b66bf57-696a-4c28-95af-2e8e480847a4 req-1f15a4ac-1d02-4377-9182-6e1e6da3e62b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032445 Aug 03 03:18:52.181248 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3650/7422] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:19:19.728920 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:19:19.729838 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 03:19:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:20:49.557315 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b324c37-7dbb-4b30-9a93-80ead1f0c21e] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 03:20:49.558463 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c87329c-10f0-40cc-99d5-2fdb48e49def] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 03:20:49.559074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=22 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:20:49.559865 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=54 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:20:49.635378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5e4d1631-248c-4c68-8672-7c3541f07957 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:20:49.635945 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5e4d1631-248c-4c68-8672-7c3541f07957 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:20:49.642417 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e4d1631-248c-4c68-8672-7c3541f07957 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:49.642884 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e4d1631-248c-4c68-8672-7c3541f07957 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:49.643708 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e4d1631-248c-4c68-8672-7c3541f07957 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:49.644164 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5e4d1631-248c-4c68-8672-7c3541f07957 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:49.668547 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.objects.instance [None req-5e4d1631-248c-4c68-8672-7c3541f07957 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lazy-loading 'flavor' on Instance uuid df503135-a3a9-403b-b0a0-2fdba181cfe3 {{(pid=125941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 03:20:49.741362 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5e4d1631-248c-4c68-8672-7c3541f07957 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [cdd76cec-8771-4bb9-81bc-395e6142e357] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 03:20:50.565733 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b324c37-7dbb-4b30-9a93-80ead1f0c21e] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 40220. Aug 03 03:20:50.566470 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c87329c-10f0-40cc-99d5-2fdb48e49def] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 40222. Aug 03 03:20:50.749708 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [None req-5e4d1631-248c-4c68-8672-7c3541f07957 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [cdd76cec-8771-4bb9-81bc-395e6142e357] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 40224. Aug 03 03:20:50.753378 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5e4d1631-248c-4c68-8672-7c3541f07957 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "POST /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3/action" status: 202 len: 0 microversion: 2.1 time: 1.197806 Aug 03 03:20:50.753945 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3773/7423] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:20:49 2022] POST /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3/action => generated 0 bytes in 1199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:20:50.761221 n-d-826529-8 devstack@n-api.service[125942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95a5e56a-7955-4bb2-902f-a217315250e4] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 03:20:50.762053 n-d-826529-8 devstack@n-api.service[125942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6768ec80-552a-4875-95fb-ee55c75da43d] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 03:20:50.762676 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:20:50.763551 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=50 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:20:50.769642 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f14deb8f-bb72-4a2a-9ded-c0962b090192 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:20:50.770362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f14deb8f-bb72-4a2a-9ded-c0962b090192 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:20:50.780172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f14deb8f-bb72-4a2a-9ded-c0962b090192 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:50.780710 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f14deb8f-bb72-4a2a-9ded-c0962b090192 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:50.781656 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f14deb8f-bb72-4a2a-9ded-c0962b090192 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:50.783261 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f14deb8f-bb72-4a2a-9ded-c0962b090192 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:51.004231 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f14deb8f-bb72-4a2a-9ded-c0962b090192 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:20:51.013567 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f14deb8f-bb72-4a2a-9ded-c0962b090192 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1569 microversion: 2.1 time: 0.254155 Aug 03 03:20:51.014155 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3651/7424] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:20:50 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1569 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:20:52.039674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fc76c5a6-a0a3-4ad4-a3f4-04bb812420ab tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:20:52.040232 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fc76c5a6-a0a3-4ad4-a3f4-04bb812420ab tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:20:52.047721 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc76c5a6-a0a3-4ad4-a3f4-04bb812420ab tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:52.048185 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc76c5a6-a0a3-4ad4-a3f4-04bb812420ab tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:52.049674 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc76c5a6-a0a3-4ad4-a3f4-04bb812420ab tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:52.050132 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fc76c5a6-a0a3-4ad4-a3f4-04bb812420ab tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:52.237592 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fc76c5a6-a0a3-4ad4-a3f4-04bb812420ab tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:20:52.245444 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fc76c5a6-a0a3-4ad4-a3f4-04bb812420ab tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1569 microversion: 2.1 time: 0.211441 Aug 03 03:20:52.246016 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3774/7425] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:20:52 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:20:53.267332 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-005ee470-8068-492c-a7a6-2a3d19b6830b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:20:53.267958 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-005ee470-8068-492c-a7a6-2a3d19b6830b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:20:53.282883 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-005ee470-8068-492c-a7a6-2a3d19b6830b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:53.283362 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-005ee470-8068-492c-a7a6-2a3d19b6830b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:53.284144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-005ee470-8068-492c-a7a6-2a3d19b6830b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:53.284581 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-005ee470-8068-492c-a7a6-2a3d19b6830b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:53.286460 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] [6768ec80-552a-4875-95fb-ee55c75da43d] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 40240. Aug 03 03:20:53.293304 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] [95a5e56a-7955-4bb2-902f-a217315250e4] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 40238. Aug 03 03:20:53.427041 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-005ee470-8068-492c-a7a6-2a3d19b6830b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:20:53.435460 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-005ee470-8068-492c-a7a6-2a3d19b6830b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1569 microversion: 2.1 time: 0.172184 Aug 03 03:20:53.436050 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3652/7426] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:20:53 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:20:54.457174 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ccfa67f5-0df5-4980-acd2-398ef04694c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:20:54.457823 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ccfa67f5-0df5-4980-acd2-398ef04694c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:20:54.464760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccfa67f5-0df5-4980-acd2-398ef04694c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:54.465217 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccfa67f5-0df5-4980-acd2-398ef04694c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:54.466006 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccfa67f5-0df5-4980-acd2-398ef04694c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:54.466475 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ccfa67f5-0df5-4980-acd2-398ef04694c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:54.608310 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ccfa67f5-0df5-4980-acd2-398ef04694c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:20:54.616190 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ccfa67f5-0df5-4980-acd2-398ef04694c9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1569 microversion: 2.1 time: 0.162987 Aug 03 03:20:54.616770 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3775/7427] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:20:54 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:20:55.639215 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-99082136-18b6-413f-8779-3b7da82a58ca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:20:55.639860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-99082136-18b6-413f-8779-3b7da82a58ca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:20:55.646740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-99082136-18b6-413f-8779-3b7da82a58ca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:55.647225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-99082136-18b6-413f-8779-3b7da82a58ca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:55.648042 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-99082136-18b6-413f-8779-3b7da82a58ca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:55.648714 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-99082136-18b6-413f-8779-3b7da82a58ca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:55.781909 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-99082136-18b6-413f-8779-3b7da82a58ca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:20:55.790282 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-99082136-18b6-413f-8779-3b7da82a58ca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1569 microversion: 2.1 time: 0.155090 Aug 03 03:20:55.790849 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3653/7428] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:20:55 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:20:56.811821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-95300614-f32a-412a-bf04-cb466acac17f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:20:56.812451 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-95300614-f32a-412a-bf04-cb466acac17f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:20:56.819535 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95300614-f32a-412a-bf04-cb466acac17f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:56.820011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95300614-f32a-412a-bf04-cb466acac17f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:56.821338 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95300614-f32a-412a-bf04-cb466acac17f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:56.821792 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-95300614-f32a-412a-bf04-cb466acac17f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:56.954162 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-95300614-f32a-412a-bf04-cb466acac17f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:20:56.961780 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-95300614-f32a-412a-bf04-cb466acac17f tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1569 microversion: 2.1 time: 0.153895 Aug 03 03:20:56.962357 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3776/7429] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:20:56 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:20:57.983513 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-98ed0b7a-7e13-436b-993e-d279e2193b5c tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:20:57.984141 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-98ed0b7a-7e13-436b-993e-d279e2193b5c tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:20:57.991171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98ed0b7a-7e13-436b-993e-d279e2193b5c tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:57.991635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98ed0b7a-7e13-436b-993e-d279e2193b5c tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:57.992424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98ed0b7a-7e13-436b-993e-d279e2193b5c tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:57.992937 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-98ed0b7a-7e13-436b-993e-d279e2193b5c tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:58.132549 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-98ed0b7a-7e13-436b-993e-d279e2193b5c tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:20:58.141073 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-98ed0b7a-7e13-436b-993e-d279e2193b5c tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1569 microversion: 2.1 time: 0.161455 Aug 03 03:20:58.141637 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3654/7430] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:20:57 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:20:59.162422 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2c3875ae-7891-4961-9bcf-2ab4fd0d7fd7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:20:59.163093 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2c3875ae-7891-4961-9bcf-2ab4fd0d7fd7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:20:59.170017 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c3875ae-7891-4961-9bcf-2ab4fd0d7fd7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:59.170491 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c3875ae-7891-4961-9bcf-2ab4fd0d7fd7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:59.171314 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c3875ae-7891-4961-9bcf-2ab4fd0d7fd7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:20:59.171771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2c3875ae-7891-4961-9bcf-2ab4fd0d7fd7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:20:59.307023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2c3875ae-7891-4961-9bcf-2ab4fd0d7fd7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:20:59.315653 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2c3875ae-7891-4961-9bcf-2ab4fd0d7fd7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1569 microversion: 2.1 time: 0.156814 Aug 03 03:20:59.316579 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3777/7431] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:20:59 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:20:59.669410 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:20:59.669626 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 03:20:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:20:59.789289 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:20:59.789812 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 03:20:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:20:59.805474 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:20:59.805882 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 03:20:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:21:00.337869 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-bbade75f-1435-45aa-85d5-6a0e5ee084fe tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:00.338605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-bbade75f-1435-45aa-85d5-6a0e5ee084fe tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:00.346327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bbade75f-1435-45aa-85d5-6a0e5ee084fe tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:00.346780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bbade75f-1435-45aa-85d5-6a0e5ee084fe tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:00.347597 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bbade75f-1435-45aa-85d5-6a0e5ee084fe tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:00.348045 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-bbade75f-1435-45aa-85d5-6a0e5ee084fe tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:00.485616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-bbade75f-1435-45aa-85d5-6a0e5ee084fe tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:00.493167 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-bbade75f-1435-45aa-85d5-6a0e5ee084fe tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1569 microversion: 2.1 time: 0.159291 Aug 03 03:21:00.493733 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3655/7432] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:00 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:01.515378 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-19d2eadc-6773-4521-8e91-9ce165902df9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:01.516012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-19d2eadc-6773-4521-8e91-9ce165902df9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:01.523075 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19d2eadc-6773-4521-8e91-9ce165902df9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:01.523544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19d2eadc-6773-4521-8e91-9ce165902df9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:01.524334 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19d2eadc-6773-4521-8e91-9ce165902df9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:01.524793 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-19d2eadc-6773-4521-8e91-9ce165902df9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:01.661074 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-19d2eadc-6773-4521-8e91-9ce165902df9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:01.669451 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-19d2eadc-6773-4521-8e91-9ce165902df9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1569 microversion: 2.1 time: 0.157962 Aug 03 03:21:01.670025 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3778/7433] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:01 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:02.691377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-540c4441-cac2-41ad-b826-20557461f813 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:02.692001 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-540c4441-cac2-41ad-b826-20557461f813 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:02.699814 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-540c4441-cac2-41ad-b826-20557461f813 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:02.700271 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-540c4441-cac2-41ad-b826-20557461f813 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:02.701051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-540c4441-cac2-41ad-b826-20557461f813 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:02.701495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-540c4441-cac2-41ad-b826-20557461f813 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:02.834003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-540c4441-cac2-41ad-b826-20557461f813 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:02.842326 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-540c4441-cac2-41ad-b826-20557461f813 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1569 microversion: 2.1 time: 0.154831 Aug 03 03:21:02.842932 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3656/7434] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:02 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:03.864898 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-040e39a0-cac6-4e92-ad36-82df1016850a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:03.865536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-040e39a0-cac6-4e92-ad36-82df1016850a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:03.872736 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-040e39a0-cac6-4e92-ad36-82df1016850a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:03.873208 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-040e39a0-cac6-4e92-ad36-82df1016850a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:03.874011 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-040e39a0-cac6-4e92-ad36-82df1016850a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:03.874470 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-040e39a0-cac6-4e92-ad36-82df1016850a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:04.013374 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-040e39a0-cac6-4e92-ad36-82df1016850a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:04.021347 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-040e39a0-cac6-4e92-ad36-82df1016850a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1569 microversion: 2.1 time: 0.160333 Aug 03 03:21:04.021926 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3779/7435] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:03 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:05.043865 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f60e0671-744b-427d-ab6b-34578649f7b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:05.044495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f60e0671-744b-427d-ab6b-34578649f7b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:05.051495 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f60e0671-744b-427d-ab6b-34578649f7b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:05.051955 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f60e0671-744b-427d-ab6b-34578649f7b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:05.052742 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f60e0671-744b-427d-ab6b-34578649f7b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:05.053179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f60e0671-744b-427d-ab6b-34578649f7b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:05.193831 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f60e0671-744b-427d-ab6b-34578649f7b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:05.201601 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f60e0671-744b-427d-ab6b-34578649f7b3 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1569 microversion: 2.1 time: 0.162692 Aug 03 03:21:05.202192 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3657/7436] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:05 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:06.176544 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-3fdd906c-67b1-4b53-82c0-7d87fa79db28 req-c53255a2-9cf9-472b-a0a5-1c0c4ccea7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df503135-a3a9-403b-b0a0-2fdba181cfe3", "name": "network-vif-unplugged", "status": "completed", "tag": "47e665d1-aa64-4fc4-b782-3c012087124e"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:21:06.187862 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3fdd906c-67b1-4b53-82c0-7d87fa79db28 req-c53255a2-9cf9-472b-a0a5-1c0c4ccea7e2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:06.188319 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3fdd906c-67b1-4b53-82c0-7d87fa79db28 req-c53255a2-9cf9-472b-a0a5-1c0c4ccea7e2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:06.199692 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.compute.server_external_events [req-3fdd906c-67b1-4b53-82c0-7d87fa79db28 req-c53255a2-9cf9-472b-a0a5-1c0c4ccea7e2 service nova] Unable to find a host for instance df503135-a3a9-403b-b0a0-2fdba181cfe3. Dropping event network-vif-unplugged {{(pid=125941) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 03:21:06.200622 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-3fdd906c-67b1-4b53-82c0-7d87fa79db28 req-c53255a2-9cf9-472b-a0a5-1c0c4ccea7e2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027945 Aug 03 03:21:06.201418 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3780/7437] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 03 03:21:06.223065 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-71f7a770-3067-45e5-984a-5723b951db5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:06.223699 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-71f7a770-3067-45e5-984a-5723b951db5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:06.232135 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71f7a770-3067-45e5-984a-5723b951db5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:06.232633 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71f7a770-3067-45e5-984a-5723b951db5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:06.233425 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71f7a770-3067-45e5-984a-5723b951db5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:06.233860 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-71f7a770-3067-45e5-984a-5723b951db5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:06.371795 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-71f7a770-3067-45e5-984a-5723b951db5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:06.379582 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-71f7a770-3067-45e5-984a-5723b951db5b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1510 microversion: 2.1 time: 0.160509 Aug 03 03:21:06.380173 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3658/7438] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:06 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:06.400056 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-00190092-032c-4d37-87f3-ba1b04a9f2a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:21:06.400699 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-00190092-032c-4d37-87f3-ba1b04a9f2a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:06.407447 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00190092-032c-4d37-87f3-ba1b04a9f2a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:06.408181 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00190092-032c-4d37-87f3-ba1b04a9f2a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:06.408977 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00190092-032c-4d37-87f3-ba1b04a9f2a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:06.409458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-00190092-032c-4d37-87f3-ba1b04a9f2a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:06.438897 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-00190092-032c-4d37-87f3-ba1b04a9f2a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125941) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 03:21:06.504646 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-00190092-032c-4d37-87f3-ba1b04a9f2a8 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "POST /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3/action" status: 202 len: 0 microversion: 2.1 time: 0.108449 Aug 03 03:21:06.505264 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3781/7439] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:21:06 2022] POST /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:21:06.513686 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b99038e2-aec4-4518-840c-de3c6823d0fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:06.514306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b99038e2-aec4-4518-840c-de3c6823d0fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:06.520708 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b99038e2-aec4-4518-840c-de3c6823d0fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:06.521164 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b99038e2-aec4-4518-840c-de3c6823d0fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:06.522080 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b99038e2-aec4-4518-840c-de3c6823d0fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:06.522486 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b99038e2-aec4-4518-840c-de3c6823d0fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:06.666432 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b99038e2-aec4-4518-840c-de3c6823d0fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:06.674265 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b99038e2-aec4-4518-840c-de3c6823d0fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1518 microversion: 2.1 time: 0.164736 Aug 03 03:21:06.674940 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3659/7440] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:06 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:07.697064 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-347001d7-2442-4154-8813-a573358d15db tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:07.697780 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-347001d7-2442-4154-8813-a573358d15db tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:07.704267 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-347001d7-2442-4154-8813-a573358d15db tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:07.704743 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-347001d7-2442-4154-8813-a573358d15db tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:07.705558 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-347001d7-2442-4154-8813-a573358d15db tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:07.706019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-347001d7-2442-4154-8813-a573358d15db tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:07.852775 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-347001d7-2442-4154-8813-a573358d15db tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:07.860754 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-347001d7-2442-4154-8813-a573358d15db tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1520 microversion: 2.1 time: 0.168575 Aug 03 03:21:07.861418 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3782/7441] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:07 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:08.881731 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d6f33de2-76de-4fdd-a452-36fe220dd509 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:08.882298 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d6f33de2-76de-4fdd-a452-36fe220dd509 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:08.889539 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6f33de2-76de-4fdd-a452-36fe220dd509 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:08.889999 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6f33de2-76de-4fdd-a452-36fe220dd509 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:08.890787 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6f33de2-76de-4fdd-a452-36fe220dd509 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:08.891273 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d6f33de2-76de-4fdd-a452-36fe220dd509 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:09.029172 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d6f33de2-76de-4fdd-a452-36fe220dd509 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:09.046520 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d6f33de2-76de-4fdd-a452-36fe220dd509 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1520 microversion: 2.1 time: 0.168679 Aug 03 03:21:09.047129 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3660/7442] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:08 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:10.068448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-447339d7-d47f-4584-8213-933c95726010 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:10.069071 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-447339d7-d47f-4584-8213-933c95726010 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:10.077257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-447339d7-d47f-4584-8213-933c95726010 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:10.077716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-447339d7-d47f-4584-8213-933c95726010 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:10.078520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-447339d7-d47f-4584-8213-933c95726010 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:10.079000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-447339d7-d47f-4584-8213-933c95726010 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:10.219325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-447339d7-d47f-4584-8213-933c95726010 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:10.227224 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-447339d7-d47f-4584-8213-933c95726010 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1520 microversion: 2.1 time: 0.162768 Aug 03 03:21:10.227800 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3783/7443] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:10 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:21:11.249733 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cae41a00-bd36-4770-aa58-0f0bea924325 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:11.250277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cae41a00-bd36-4770-aa58-0f0bea924325 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:11.257928 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cae41a00-bd36-4770-aa58-0f0bea924325 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:11.258416 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cae41a00-bd36-4770-aa58-0f0bea924325 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:11.259265 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cae41a00-bd36-4770-aa58-0f0bea924325 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:11.259711 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cae41a00-bd36-4770-aa58-0f0bea924325 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:11.406384 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cae41a00-bd36-4770-aa58-0f0bea924325 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:11.414333 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cae41a00-bd36-4770-aa58-0f0bea924325 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1520 microversion: 2.1 time: 0.169247 Aug 03 03:21:11.414930 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3661/7444] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:11 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:12.442765 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a17de1fe-d393-4ca4-be24-99992a6b75fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:12.443425 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a17de1fe-d393-4ca4-be24-99992a6b75fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:12.451269 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a17de1fe-d393-4ca4-be24-99992a6b75fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:12.451741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a17de1fe-d393-4ca4-be24-99992a6b75fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:12.452533 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a17de1fe-d393-4ca4-be24-99992a6b75fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:12.452993 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a17de1fe-d393-4ca4-be24-99992a6b75fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:12.591188 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-a17de1fe-d393-4ca4-be24-99992a6b75fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:12.599093 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a17de1fe-d393-4ca4-be24-99992a6b75fa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1576 microversion: 2.1 time: 0.160187 Aug 03 03:21:12.599673 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3784/7445] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:12 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:21:13.348052 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-dcb61109-e67f-4145-9380-a43d3d33e7f5 req-a21b9df5-5a86-4604-b8ef-584fd924d571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df503135-a3a9-403b-b0a0-2fdba181cfe3", "tag": "47e665d1-aa64-4fc4-b782-3c012087124e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:21:13.362675 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-dcb61109-e67f-4145-9380-a43d3d33e7f5 req-a21b9df5-5a86-4604-b8ef-584fd924d571 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:13.363241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-dcb61109-e67f-4145-9380-a43d3d33e7f5 req-a21b9df5-5a86-4604-b8ef-584fd924d571 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:13.383621 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-dcb61109-e67f-4145-9380-a43d3d33e7f5 req-a21b9df5-5a86-4604-b8ef-584fd924d571 service nova] Creating event network-changed:47e665d1-aa64-4fc4-b782-3c012087124e for instance df503135-a3a9-403b-b0a0-2fdba181cfe3 on n-h1-826529-8 Aug 03 03:21:13.389979 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-dcb61109-e67f-4145-9380-a43d3d33e7f5 req-a21b9df5-5a86-4604-b8ef-584fd924d571 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047243 Aug 03 03:21:13.390592 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3662/7446] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:21:13.620959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-dbdbcbbd-9905-454d-867d-9d9d75c9c4f6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:13.621662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-dbdbcbbd-9905-454d-867d-9d9d75c9c4f6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:13.628643 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbdbcbbd-9905-454d-867d-9d9d75c9c4f6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:13.629115 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbdbcbbd-9905-454d-867d-9d9d75c9c4f6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:13.629905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbdbcbbd-9905-454d-867d-9d9d75c9c4f6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:13.630366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-dbdbcbbd-9905-454d-867d-9d9d75c9c4f6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:13.768667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-dbdbcbbd-9905-454d-867d-9d9d75c9c4f6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:13.776484 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-dbdbcbbd-9905-454d-867d-9d9d75c9c4f6 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1576 microversion: 2.1 time: 0.159497 Aug 03 03:21:13.777624 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3785/7447] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:13 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:14.799870 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e740da3c-ab67-47ee-ae0b-a4f041b4beca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:14.800707 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e740da3c-ab67-47ee-ae0b-a4f041b4beca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:14.807119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e740da3c-ab67-47ee-ae0b-a4f041b4beca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:14.807571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e740da3c-ab67-47ee-ae0b-a4f041b4beca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:14.808349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e740da3c-ab67-47ee-ae0b-a4f041b4beca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:14.808780 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e740da3c-ab67-47ee-ae0b-a4f041b4beca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:14.941203 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e740da3c-ab67-47ee-ae0b-a4f041b4beca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:14.949486 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e740da3c-ab67-47ee-ae0b-a4f041b4beca tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1576 microversion: 2.1 time: 0.154008 Aug 03 03:21:14.950062 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3663/7448] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:14 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:15.969758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-56e18da3-5092-4b50-a2f2-2cf60d8db9f9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:15.970380 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-56e18da3-5092-4b50-a2f2-2cf60d8db9f9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:15.977282 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56e18da3-5092-4b50-a2f2-2cf60d8db9f9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:15.977741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56e18da3-5092-4b50-a2f2-2cf60d8db9f9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:15.978514 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56e18da3-5092-4b50-a2f2-2cf60d8db9f9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:15.978987 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-56e18da3-5092-4b50-a2f2-2cf60d8db9f9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:16.112387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-56e18da3-5092-4b50-a2f2-2cf60d8db9f9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:16.122289 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-56e18da3-5092-4b50-a2f2-2cf60d8db9f9 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1576 microversion: 2.1 time: 0.156393 Aug 03 03:21:16.123240 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3786/7449] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:15 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:17.146409 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5769e32d-7700-4cf0-aa62-d9e816ac0212 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:17.147097 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5769e32d-7700-4cf0-aa62-d9e816ac0212 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:17.154219 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5769e32d-7700-4cf0-aa62-d9e816ac0212 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:17.154677 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5769e32d-7700-4cf0-aa62-d9e816ac0212 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:17.155500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5769e32d-7700-4cf0-aa62-d9e816ac0212 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:17.155949 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5769e32d-7700-4cf0-aa62-d9e816ac0212 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:17.314940 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5769e32d-7700-4cf0-aa62-d9e816ac0212 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:17.324990 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5769e32d-7700-4cf0-aa62-d9e816ac0212 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1576 microversion: 2.1 time: 0.182169 Aug 03 03:21:17.325898 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3664/7450] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:17 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:18.351436 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-e5c4f8da-6cd2-4a4d-bc99-25204cfe14bd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:18.352067 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-e5c4f8da-6cd2-4a4d-bc99-25204cfe14bd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:18.359219 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e5c4f8da-6cd2-4a4d-bc99-25204cfe14bd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:18.359687 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e5c4f8da-6cd2-4a4d-bc99-25204cfe14bd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:18.360479 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e5c4f8da-6cd2-4a4d-bc99-25204cfe14bd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:18.360935 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-e5c4f8da-6cd2-4a4d-bc99-25204cfe14bd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:18.364882 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:21:18.493034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-e5c4f8da-6cd2-4a4d-bc99-25204cfe14bd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:18.500807 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-e5c4f8da-6cd2-4a4d-bc99-25204cfe14bd tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1576 microversion: 2.1 time: 0.153447 Aug 03 03:21:18.501421 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3787/7451] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:18 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:19.523393 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-ef9682ee-6690-4da7-b8d8-20eaff8a4f82 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:19.524035 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-ef9682ee-6690-4da7-b8d8-20eaff8a4f82 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:19.531759 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef9682ee-6690-4da7-b8d8-20eaff8a4f82 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:19.532225 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef9682ee-6690-4da7-b8d8-20eaff8a4f82 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:19.533278 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef9682ee-6690-4da7-b8d8-20eaff8a4f82 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:19.533726 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-ef9682ee-6690-4da7-b8d8-20eaff8a4f82 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:19.671705 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-ef9682ee-6690-4da7-b8d8-20eaff8a4f82 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:19.679210 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-ef9682ee-6690-4da7-b8d8-20eaff8a4f82 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1576 microversion: 2.1 time: 0.159727 Aug 03 03:21:19.679985 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3665/7452] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:19 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:20.700836 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c9a529ac-896b-4be7-80cb-27cf2f952a97 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:20.701471 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c9a529ac-896b-4be7-80cb-27cf2f952a97 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:20.703840 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:21:20.709277 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9a529ac-896b-4be7-80cb-27cf2f952a97 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:20.709752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9a529ac-896b-4be7-80cb-27cf2f952a97 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:20.710541 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9a529ac-896b-4be7-80cb-27cf2f952a97 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:20.711023 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c9a529ac-896b-4be7-80cb-27cf2f952a97 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:20.845339 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c9a529ac-896b-4be7-80cb-27cf2f952a97 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:20.852895 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c9a529ac-896b-4be7-80cb-27cf2f952a97 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1576 microversion: 2.1 time: 0.155989 Aug 03 03:21:20.853678 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3788/7453] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:20 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:21.876356 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1dd171a5-f8d0-490a-8c87-6df50335eac4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:21.877110 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1dd171a5-f8d0-490a-8c87-6df50335eac4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:21.880043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=31 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:21:21.885170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1dd171a5-f8d0-490a-8c87-6df50335eac4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:21.887338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1dd171a5-f8d0-490a-8c87-6df50335eac4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:21.887338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1dd171a5-f8d0-490a-8c87-6df50335eac4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:21.887802 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1dd171a5-f8d0-490a-8c87-6df50335eac4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:21.891149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=87 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:21:22.022144 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1dd171a5-f8d0-490a-8c87-6df50335eac4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:22.029901 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1dd171a5-f8d0-490a-8c87-6df50335eac4 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1576 microversion: 2.1 time: 0.157607 Aug 03 03:21:22.030483 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3666/7454] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:21 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:23.051959 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2425e183-bf85-49ea-85c6-7e511f2908d7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:23.052591 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2425e183-bf85-49ea-85c6-7e511f2908d7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:23.060808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2425e183-bf85-49ea-85c6-7e511f2908d7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:23.061279 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2425e183-bf85-49ea-85c6-7e511f2908d7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:23.062076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2425e183-bf85-49ea-85c6-7e511f2908d7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:23.062536 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2425e183-bf85-49ea-85c6-7e511f2908d7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:23.200304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2425e183-bf85-49ea-85c6-7e511f2908d7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:23.207925 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2425e183-bf85-49ea-85c6-7e511f2908d7 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1576 microversion: 2.1 time: 0.159881 Aug 03 03:21:23.208495 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3789/7455] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:23 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:23.390348 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-cc6a7b68-9f7b-4d51-b560-893fb76acc67 req-70b79a0c-e9e3-4636-a699-63f56521afc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df503135-a3a9-403b-b0a0-2fdba181cfe3", "name": "network-vif-plugged", "status": "completed", "tag": "47e665d1-aa64-4fc4-b782-3c012087124e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:21:23.400137 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-cc6a7b68-9f7b-4d51-b560-893fb76acc67 req-70b79a0c-e9e3-4636-a699-63f56521afc8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:23.400598 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-cc6a7b68-9f7b-4d51-b560-893fb76acc67 req-70b79a0c-e9e3-4636-a699-63f56521afc8 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:23.413042 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-cc6a7b68-9f7b-4d51-b560-893fb76acc67 req-70b79a0c-e9e3-4636-a699-63f56521afc8 service nova] Creating event network-vif-plugged:47e665d1-aa64-4fc4-b782-3c012087124e for instance df503135-a3a9-403b-b0a0-2fdba181cfe3 on n-h1-826529-8 Aug 03 03:21:23.418732 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-cc6a7b68-9f7b-4d51-b560-893fb76acc67 req-70b79a0c-e9e3-4636-a699-63f56521afc8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033066 Aug 03 03:21:23.419601 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3667/7456] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:21:24.228779 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-58bffc14-6379-4f46-b168-4b75cec25426 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:24.229893 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-58bffc14-6379-4f46-b168-4b75cec25426 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:24.236805 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58bffc14-6379-4f46-b168-4b75cec25426 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:24.237270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58bffc14-6379-4f46-b168-4b75cec25426 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:24.238047 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58bffc14-6379-4f46-b168-4b75cec25426 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:24.238494 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-58bffc14-6379-4f46-b168-4b75cec25426 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:24.372311 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-58bffc14-6379-4f46-b168-4b75cec25426 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:24.380404 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-58bffc14-6379-4f46-b168-4b75cec25426 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1576 microversion: 2.1 time: 0.155592 Aug 03 03:21:24.381013 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3790/7457] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:24 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:21:25.403613 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-4a7ab734-d7c5-485e-bf71-a381fc0e493b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:21:25.404341 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-4a7ab734-d7c5-485e-bf71-a381fc0e493b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:21:25.411043 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a7ab734-d7c5-485e-bf71-a381fc0e493b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:25.411505 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a7ab734-d7c5-485e-bf71-a381fc0e493b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:25.412287 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a7ab734-d7c5-485e-bf71-a381fc0e493b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:21:25.412736 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-4a7ab734-d7c5-485e-bf71-a381fc0e493b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:21:25.561334 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-4a7ab734-d7c5-485e-bf71-a381fc0e493b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:21:25.568975 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-4a7ab734-d7c5-485e-bf71-a381fc0e493b tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1563 microversion: 2.1 time: 0.171018 Aug 03 03:21:25.569548 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3668/7458] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:21:25 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:22:45.453404 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=5 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:22:45.454537 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=13 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:22:45.455379 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-03d13c01-9e03-4258-a173-cbbe28a70211 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:22:45.455905 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-03d13c01-9e03-4258-a173-cbbe28a70211 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:22:45.458257 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=5 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:22:45.459034 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=22 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:22:45.459557 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-7e1d2e40-5f66-4c92-ae71-8f06e8833d99 req-ed6b4347-cd12-4a4d-8625-68bb3a57cfaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df503135-a3a9-403b-b0a0-2fdba181cfe3", "tag": "47e665d1-aa64-4fc4-b782-3c012087124e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:22:45.465201 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03d13c01-9e03-4258-a173-cbbe28a70211 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:45.465769 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03d13c01-9e03-4258-a173-cbbe28a70211 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:45.466821 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03d13c01-9e03-4258-a173-cbbe28a70211 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:45.467941 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-03d13c01-9e03-4258-a173-cbbe28a70211 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:45.473964 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7e1d2e40-5f66-4c92-ae71-8f06e8833d99 req-ed6b4347-cd12-4a4d-8625-68bb3a57cfaf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:45.474424 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-7e1d2e40-5f66-4c92-ae71-8f06e8833d99 req-ed6b4347-cd12-4a4d-8625-68bb3a57cfaf service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:45.487103 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-7e1d2e40-5f66-4c92-ae71-8f06e8833d99 req-ed6b4347-cd12-4a4d-8625-68bb3a57cfaf service nova] Creating event network-changed:47e665d1-aa64-4fc4-b782-3c012087124e for instance df503135-a3a9-403b-b0a0-2fdba181cfe3 on n-h1-826529-8 Aug 03 03:22:45.493472 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-7e1d2e40-5f66-4c92-ae71-8f06e8833d99 req-ed6b4347-cd12-4a4d-8625-68bb3a57cfaf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041822 Aug 03 03:22:45.494848 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3669/7459] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:22:45.497710 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-03d13c01-9e03-4258-a173-cbbe28a70211 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 03:22:45.600232 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-03d13c01-9e03-4258-a173-cbbe28a70211 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "DELETE /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 204 len: 0 microversion: 2.1 time: 0.151733 Aug 03 03:22:45.604908 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3791/7460] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 03:22:45 2022] DELETE /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 03:22:45.612067 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e4e2783b-6f43-4fbd-b053-531809614d7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:22:45.613160 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e4e2783b-6f43-4fbd-b053-531809614d7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:22:45.621380 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4e2783b-6f43-4fbd-b053-531809614d7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:45.622186 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4e2783b-6f43-4fbd-b053-531809614d7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:45.623371 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4e2783b-6f43-4fbd-b053-531809614d7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:45.624062 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e4e2783b-6f43-4fbd-b053-531809614d7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:45.773749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-e4e2783b-6f43-4fbd-b053-531809614d7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:22:45.783039 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e4e2783b-6f43-4fbd-b053-531809614d7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1569 microversion: 2.1 time: 0.175660 Aug 03 03:22:45.783921 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3670/7461] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:22:45 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:22:46.806117 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ebe24c0b-66eb-45d7-b775-834f7e7d5082 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:22:46.806870 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ebe24c0b-66eb-45d7-b775-834f7e7d5082 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:22:46.815580 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebe24c0b-66eb-45d7-b775-834f7e7d5082 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:46.815974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebe24c0b-66eb-45d7-b775-834f7e7d5082 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:46.816782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebe24c0b-66eb-45d7-b775-834f7e7d5082 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:46.817235 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ebe24c0b-66eb-45d7-b775-834f7e7d5082 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:46.969810 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-ebe24c0b-66eb-45d7-b775-834f7e7d5082 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:22:46.979884 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ebe24c0b-66eb-45d7-b775-834f7e7d5082 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1569 microversion: 2.1 time: 0.177473 Aug 03 03:22:46.980466 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3792/7462] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:22:46 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:22:47.690459 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-ebdce691-b4f3-44b0-adf3-b7fab15bde1d req-25771d13-baed-4bb7-9f21-5a38470d8d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df503135-a3a9-403b-b0a0-2fdba181cfe3", "name": "network-vif-deleted", "tag": "47e665d1-aa64-4fc4-b782-3c012087124e"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:22:47.700344 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ebdce691-b4f3-44b0-adf3-b7fab15bde1d req-25771d13-baed-4bb7-9f21-5a38470d8d84 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:47.700800 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-ebdce691-b4f3-44b0-adf3-b7fab15bde1d req-25771d13-baed-4bb7-9f21-5a38470d8d84 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:47.712236 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-ebdce691-b4f3-44b0-adf3-b7fab15bde1d req-25771d13-baed-4bb7-9f21-5a38470d8d84 service nova] Creating event network-vif-deleted:47e665d1-aa64-4fc4-b782-3c012087124e for instance df503135-a3a9-403b-b0a0-2fdba181cfe3 on n-h1-826529-8 Aug 03 03:22:47.717226 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-ebdce691-b4f3-44b0-adf3-b7fab15bde1d req-25771d13-baed-4bb7-9f21-5a38470d8d84 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084679 Aug 03 03:22:47.717832 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3671/7463] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 03:22:48.001888 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c247e459-ac68-4570-a0af-2586e18971d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:22:48.003305 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c247e459-ac68-4570-a0af-2586e18971d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:22:48.012206 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c247e459-ac68-4570-a0af-2586e18971d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:48.012680 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c247e459-ac68-4570-a0af-2586e18971d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:48.013638 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c247e459-ac68-4570-a0af-2586e18971d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:48.014103 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c247e459-ac68-4570-a0af-2586e18971d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:48.080947 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c247e459-ac68-4570-a0af-2586e18971d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:22:48.090298 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c247e459-ac68-4570-a0af-2586e18971d0 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1220 microversion: 2.1 time: 0.091986 Aug 03 03:22:48.090894 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3793/7464] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:22:47 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:22:49.112610 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-b80e4052-1b15-4ec2-8ea7-27f68a9cac7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:22:49.113349 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-b80e4052-1b15-4ec2-8ea7-27f68a9cac7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:22:49.119842 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b80e4052-1b15-4ec2-8ea7-27f68a9cac7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:49.120310 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b80e4052-1b15-4ec2-8ea7-27f68a9cac7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:49.121096 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b80e4052-1b15-4ec2-8ea7-27f68a9cac7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:49.121538 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-b80e4052-1b15-4ec2-8ea7-27f68a9cac7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:49.187605 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-b80e4052-1b15-4ec2-8ea7-27f68a9cac7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:22:49.195646 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-b80e4052-1b15-4ec2-8ea7-27f68a9cac7d tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1220 microversion: 2.1 time: 0.088174 Aug 03 03:22:49.196217 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3672/7465] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:22:49 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:22:50.219923 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-106544fc-a7fe-49ad-b48c-84b270d64569 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:22:50.220557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-106544fc-a7fe-49ad-b48c-84b270d64569 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:22:50.227752 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-106544fc-a7fe-49ad-b48c-84b270d64569 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:50.228230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-106544fc-a7fe-49ad-b48c-84b270d64569 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:50.229035 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-106544fc-a7fe-49ad-b48c-84b270d64569 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:50.230060 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-106544fc-a7fe-49ad-b48c-84b270d64569 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:50.294211 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-106544fc-a7fe-49ad-b48c-84b270d64569 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:22:50.301964 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-106544fc-a7fe-49ad-b48c-84b270d64569 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1220 microversion: 2.1 time: 0.086066 Aug 03 03:22:50.302543 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3794/7466] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:22:50 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:22:51.323297 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-30072722-513d-4e18-84b5-e22ba36a6d73 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:22:51.324896 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-30072722-513d-4e18-84b5-e22ba36a6d73 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:22:51.332302 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30072722-513d-4e18-84b5-e22ba36a6d73 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:51.332764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30072722-513d-4e18-84b5-e22ba36a6d73 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:51.333565 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30072722-513d-4e18-84b5-e22ba36a6d73 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:51.334005 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-30072722-513d-4e18-84b5-e22ba36a6d73 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:51.405975 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-30072722-513d-4e18-84b5-e22ba36a6d73 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d3a0a0db994610aedc1d41d926c0f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3f415547664f468037910d72c11950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:22:51.414096 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-30072722-513d-4e18-84b5-e22ba36a6d73 tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 200 len: 1220 microversion: 2.1 time: 0.095367 Aug 03 03:22:51.414861 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3673/7467] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:22:51 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:22:52.437999 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a10b22bc-287a-4e60-b9fc-4f98bd364ffa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:22:52.438538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-a10b22bc-287a-4e60-b9fc-4f98bd364ffa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] [instance: df503135-a3a9-403b-b0a0-2fdba181cfe3] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:22:52.445246 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a10b22bc-287a-4e60-b9fc-4f98bd364ffa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:52.445741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a10b22bc-287a-4e60-b9fc-4f98bd364ffa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:52.446539 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a10b22bc-287a-4e60-b9fc-4f98bd364ffa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:22:52.447030 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-a10b22bc-287a-4e60-b9fc-4f98bd364ffa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:22:52.465661 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-a10b22bc-287a-4e60-b9fc-4f98bd364ffa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] HTTP exception thrown: Instance df503135-a3a9-403b-b0a0-2fdba181cfe3 could not be found. Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a10b22bc-287a-4e60-b9fc-4f98bd364ffa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Request method failure captured: Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 HTTP/1.1 Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6ef0HmXta8pMW_hRng5S1lGG0YdpM7gGMEJPiliZNDOy81uFUIM-b_qrUVtTIIxz-xFk_zC0Y6AigXhg9NicA5Jx4aMfbbJmPmuFQgognMCephssqSXhYoB-HXK3bb5-yKDpJizQKdph13FBhk0FhE4JPJnvF8G5n9ZWDMIm2H7evwE Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: cb3f415547664f468037910d72c11950 Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestShelveInstance-1068244353 Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cb3f415547664f468037910d72c11950", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cb3f415547664f468037910d72c11950"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cb3f415547664f468037910d72c11950"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cb3f415547664f468037910d72c11950"}]}] Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestShelveInstance-1068244353 Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: cb3f415547664f468037910d72c11950 Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestShelveInstance-1068244353 Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestShelveInstance-1068244353-project Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 09d3a0a0db994610aedc1d41d926c0f5 Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestShelveInstance-1068244353-project Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance df503135-a3a9-403b-b0a0-2fdba181cfe3 could not be found. Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': 'df503135-a3a9-403b-b0a0-2fdba181cfe3'} Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df503135-a3a9-403b-b0a0-2fdba181cfe3 could not be found. Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df503135-a3a9-403b-b0a0-2fdba181cfe3 could not be found. Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:22:52.467406 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:22:52.472325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:22:52.472325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:22:52.472325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:22:52.472325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 03:22:52.472325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 03:22:52.472325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df503135-a3a9-403b-b0a0-2fdba181cfe3 could not be found. Aug 03 03:22:52.472325 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:22:52.472325 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-a10b22bc-287a-4e60-b9fc-4f98bd364ffa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Returning 404 to user: Instance df503135-a3a9-403b-b0a0-2fdba181cfe3 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 03:22:52.472325 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-a10b22bc-287a-4e60-b9fc-4f98bd364ffa tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3" status: 404 len: 111 microversion: 2.1 time: 0.036615 Aug 03 03:22:52.472325 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3795/7468] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:22:52 2022] GET /compute/v2.1/servers/df503135-a3a9-403b-b0a0-2fdba181cfe3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 03:22:52.654727 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-86acd396-67bc-440e-b43a-d6fd42c87e2a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] Calling method '.version_select at 0x7f5b12055d30>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:22:52.704770 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-86acd396-67bc-440e-b43a-d6fd42c87e2a tempest-TestShelveInstance-1068244353 tempest-TestShelveInstance-1068244353-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1916238506" status: 202 len: 0 microversion: 2.1 time: 0.054389 Aug 03 03:22:52.710600 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3674/7469] 10.222.0.67 () {58 vars in 1254 bytes} [Wed Aug 3 03:22:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1916238506 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:23:10.712198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:23:10.714920 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:23:10.956728 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bdc56389-79c0-4848-a1d9-c6b5843edcd4 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Action: 'create', calling method: .version_select at 0x7f5b101ff1f0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1026767652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZIB2vCOVbnWKdYy2Uo6cf7neY/N2jL0t4q/sTIlFy1V+3eLlkbHS7vBe9e7PT+hNMWH9xCyg7av30Kna492NbcbuU2rCtguliJ5Dunsxr91XSpHhhUcZ34JX5eybkjEQ=="}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:23:10.975974 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-bdc56389-79c0-4848-a1d9-c6b5843edcd4 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Getting quotas for project 422d8e398c4944d49553bdc986ac256b. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:23:10.982788 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.quota [None req-bdc56389-79c0-4848-a1d9-c6b5843edcd4 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Getting quotas for user 9a289b92c1b74183b1e74c3dfcae5a6a and project 422d8e398c4944d49553bdc986ac256b. Resources: {'key_pairs'} {{(pid=125941) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:23:11.018780 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bdc56389-79c0-4848-a1d9-c6b5843edcd4 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.317069 Aug 03 03:23:11.019454 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3796/7470] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 3 03:23:10 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 03:23:12.170185 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=22 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:23:12.171047 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:23:12.175469 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1975826411", "imageRef": "b851b45e-5c09-4153-a051-b8cb3fbe48b3", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1026767652", "security_groups": [{"name": "tempest-secgroup-smoke-1397709107"}], "networks": [{"uuid": "d4c4285b-e6f5-4b18-8a7c-7bcfe3eca869"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:23:12.296482 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] validate_networks() for [('d4c4285b-e6f5-4b18-8a7c-7bcfe3eca869', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 03:23:12.723212 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 03:23:12.723611 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 03:23:12.724158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 03:23:12.724583 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 03:23:12.725003 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 03:23:12.736039 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:12.736525 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:12.737493 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:12.737967 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:12.761148 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Getting quotas for project 422d8e398c4944d49553bdc986ac256b. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:23:12.766598 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Getting quotas for user 9a289b92c1b74183b1e74c3dfcae5a6a and project 422d8e398c4944d49553bdc986ac256b. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:23:12.782837 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 03:23:12.785466 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b851b45e-5c09-4153-a051-b8cb3fbe48b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 03:23:12.843472 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f06b8762-1064-40c6-ae5e-b1830091b0fb tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.674922 Aug 03 03:23:12.844330 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3675/7471] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 03:23:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 03:23:12.856579 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2b00e300-20fa-46b2-812d-b07a6cb0a969 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:23:12.857922 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2b00e300-20fa-46b2-812d-b07a6cb0a969 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:23:12.928012 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2b00e300-20fa-46b2-812d-b07a6cb0a969 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:23:12.941595 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2b00e300-20fa-46b2-812d-b07a6cb0a969 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6" status: 200 len: 1249 microversion: 2.1 time: 0.089925 Aug 03 03:23:12.942869 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3797/7472] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:23:12 2022] GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:23:13.964917 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-a6480620-b9bb-427b-9ac2-8461b6776c4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:23:13.966179 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-a6480620-b9bb-427b-9ac2-8461b6776c4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:23:13.983504 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6480620-b9bb-427b-9ac2-8461b6776c4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:13.984129 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6480620-b9bb-427b-9ac2-8461b6776c4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:13.985599 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6480620-b9bb-427b-9ac2-8461b6776c4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:13.986050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-a6480620-b9bb-427b-9ac2-8461b6776c4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:14.091170 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-a6480620-b9bb-427b-9ac2-8461b6776c4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:23:14.099365 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-a6480620-b9bb-427b-9ac2-8461b6776c4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6" status: 200 len: 1319 microversion: 2.1 time: 0.139580 Aug 03 03:23:14.099958 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3676/7473] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:23:13 2022] GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:23:15.122177 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-39b5a552-cf8c-42ec-9e46-a8613521fb4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:23:15.122828 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-39b5a552-cf8c-42ec-9e46-a8613521fb4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:23:15.140294 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39b5a552-cf8c-42ec-9e46-a8613521fb4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:15.141102 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39b5a552-cf8c-42ec-9e46-a8613521fb4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:15.142095 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39b5a552-cf8c-42ec-9e46-a8613521fb4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:15.142717 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-39b5a552-cf8c-42ec-9e46-a8613521fb4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:15.357159 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-39b5a552-cf8c-42ec-9e46-a8613521fb4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:23:15.367011 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-39b5a552-cf8c-42ec-9e46-a8613521fb4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6" status: 200 len: 1375 microversion: 2.1 time: 0.249065 Aug 03 03:23:15.367946 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3798/7474] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:23:15 2022] GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 => generated 1375 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:23:15.666471 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-731025aa-c959-469e-91c1-6e9191167f49 req-5698e817-6b46-45fd-997f-d6f571271be6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121c470b-84f1-4224-a3d6-91cd6a22fdf6", "tag": "5350aec1-45e1-41ee-90d9-724748b44737"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:23:15.682490 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-731025aa-c959-469e-91c1-6e9191167f49 req-5698e817-6b46-45fd-997f-d6f571271be6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:15.683275 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-731025aa-c959-469e-91c1-6e9191167f49 req-5698e817-6b46-45fd-997f-d6f571271be6 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:15.701706 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-731025aa-c959-469e-91c1-6e9191167f49 req-5698e817-6b46-45fd-997f-d6f571271be6 service nova] Creating event network-changed:5350aec1-45e1-41ee-90d9-724748b44737 for instance 121c470b-84f1-4224-a3d6-91cd6a22fdf6 on n-h2-826529-8 Aug 03 03:23:15.707200 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-731025aa-c959-469e-91c1-6e9191167f49 req-5698e817-6b46-45fd-997f-d6f571271be6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044455 Aug 03 03:23:15.712052 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3677/7475] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:23:16.390009 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-5bf61d9a-7db6-4354-9601-a108a7150a26 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:23:16.390741 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-5bf61d9a-7db6-4354-9601-a108a7150a26 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:23:16.397916 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bf61d9a-7db6-4354-9601-a108a7150a26 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:16.398393 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bf61d9a-7db6-4354-9601-a108a7150a26 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:16.399241 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bf61d9a-7db6-4354-9601-a108a7150a26 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:16.399669 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-5bf61d9a-7db6-4354-9601-a108a7150a26 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:16.543002 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-5bf61d9a-7db6-4354-9601-a108a7150a26 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:23:16.550991 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-5bf61d9a-7db6-4354-9601-a108a7150a26 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6" status: 200 len: 1375 microversion: 2.1 time: 0.165554 Aug 03 03:23:16.551583 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3799/7476] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:23:16 2022] GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:23:17.575577 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-f2ac109e-f68c-472d-ac04-3a9e4ef3ce17 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:23:17.576398 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-f2ac109e-f68c-472d-ac04-3a9e4ef3ce17 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:23:17.583183 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2ac109e-f68c-472d-ac04-3a9e4ef3ce17 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:17.583798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2ac109e-f68c-472d-ac04-3a9e4ef3ce17 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:17.584673 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2ac109e-f68c-472d-ac04-3a9e4ef3ce17 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:17.585119 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-f2ac109e-f68c-472d-ac04-3a9e4ef3ce17 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:17.843241 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-f2ac109e-f68c-472d-ac04-3a9e4ef3ce17 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:23:17.852466 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-f2ac109e-f68c-472d-ac04-3a9e4ef3ce17 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6" status: 200 len: 1375 microversion: 2.1 time: 0.282856 Aug 03 03:23:17.858622 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3678/7477] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:23:17 2022] GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 => generated 1375 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:23:18.877791 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-1da6e334-e40b-4466-9278-b56c47ba12d5 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:23:18.878459 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-1da6e334-e40b-4466-9278-b56c47ba12d5 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:23:18.885714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1da6e334-e40b-4466-9278-b56c47ba12d5 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:18.886191 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1da6e334-e40b-4466-9278-b56c47ba12d5 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:18.887038 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1da6e334-e40b-4466-9278-b56c47ba12d5 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:18.887502 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-1da6e334-e40b-4466-9278-b56c47ba12d5 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:19.029402 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-1da6e334-e40b-4466-9278-b56c47ba12d5 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:23:19.037249 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-1da6e334-e40b-4466-9278-b56c47ba12d5 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6" status: 200 len: 1375 microversion: 2.1 time: 0.163409 Aug 03 03:23:19.037835 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3800/7478] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:23:18 2022] GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:23:20.058519 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-5edfb88f-9de1-4d19-8085-d3494645cd42 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:23:20.059213 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-5edfb88f-9de1-4d19-8085-d3494645cd42 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:23:20.066492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5edfb88f-9de1-4d19-8085-d3494645cd42 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:20.067098 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5edfb88f-9de1-4d19-8085-d3494645cd42 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:20.067907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5edfb88f-9de1-4d19-8085-d3494645cd42 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:20.068386 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-5edfb88f-9de1-4d19-8085-d3494645cd42 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:20.208667 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-5edfb88f-9de1-4d19-8085-d3494645cd42 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:23:20.217322 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-5edfb88f-9de1-4d19-8085-d3494645cd42 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6" status: 200 len: 1375 microversion: 2.1 time: 0.162993 Aug 03 03:23:20.217916 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3679/7479] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:23:20 2022] GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:23:20.862557 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-560d7507-0a99-4cd2-8e36-49e5f01c3109 req-fe211955-e181-41f1-be4f-ee1e1e788dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121c470b-84f1-4224-a3d6-91cd6a22fdf6", "name": "network-vif-plugged", "status": "completed", "tag": "5350aec1-45e1-41ee-90d9-724748b44737"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:23:20.873868 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-560d7507-0a99-4cd2-8e36-49e5f01c3109 req-fe211955-e181-41f1-be4f-ee1e1e788dae service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:20.874299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-560d7507-0a99-4cd2-8e36-49e5f01c3109 req-fe211955-e181-41f1-be4f-ee1e1e788dae service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:20.887398 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-560d7507-0a99-4cd2-8e36-49e5f01c3109 req-fe211955-e181-41f1-be4f-ee1e1e788dae service nova] Creating event network-vif-plugged:5350aec1-45e1-41ee-90d9-724748b44737 for instance 121c470b-84f1-4224-a3d6-91cd6a22fdf6 on n-h2-826529-8 Aug 03 03:23:20.894033 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-560d7507-0a99-4cd2-8e36-49e5f01c3109 req-fe211955-e181-41f1-be4f-ee1e1e788dae service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102408 Aug 03 03:23:20.894727 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3801/7480] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:23:21.238778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0622c536-15a5-4218-a68e-d0bd5b640387 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:23:21.239457 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0622c536-15a5-4218-a68e-d0bd5b640387 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:23:21.246778 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0622c536-15a5-4218-a68e-d0bd5b640387 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:21.247264 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0622c536-15a5-4218-a68e-d0bd5b640387 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:21.248050 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0622c536-15a5-4218-a68e-d0bd5b640387 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:21.248492 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0622c536-15a5-4218-a68e-d0bd5b640387 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:21.390740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0622c536-15a5-4218-a68e-d0bd5b640387 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:23:21.398952 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0622c536-15a5-4218-a68e-d0bd5b640387 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6" status: 200 len: 1375 microversion: 2.1 time: 0.164089 Aug 03 03:23:21.399435 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3680/7481] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:23:21 2022] GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:23:22.420753 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-63cdb428-a171-4b7d-bc3f-2428719b5e1f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:23:22.421387 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-63cdb428-a171-4b7d-bc3f-2428719b5e1f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:23:22.428619 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63cdb428-a171-4b7d-bc3f-2428719b5e1f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:22.429085 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63cdb428-a171-4b7d-bc3f-2428719b5e1f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:22.430207 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63cdb428-a171-4b7d-bc3f-2428719b5e1f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:22.430668 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-63cdb428-a171-4b7d-bc3f-2428719b5e1f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:22.579254 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-63cdb428-a171-4b7d-bc3f-2428719b5e1f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:23:22.586839 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-63cdb428-a171-4b7d-bc3f-2428719b5e1f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6" status: 200 len: 1560 microversion: 2.1 time: 0.170411 Aug 03 03:23:22.587470 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3802/7482] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:23:22 2022] GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:23:22.607911 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-2de7695d-b11c-4cfd-bf89-ca26b36a9f0c tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:23:22.608531 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-2de7695d-b11c-4cfd-bf89-ca26b36a9f0c tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:23:22.616343 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2de7695d-b11c-4cfd-bf89-ca26b36a9f0c tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:22.616826 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2de7695d-b11c-4cfd-bf89-ca26b36a9f0c tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:22.618022 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2de7695d-b11c-4cfd-bf89-ca26b36a9f0c tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:22.618792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-2de7695d-b11c-4cfd-bf89-ca26b36a9f0c tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:22.914684 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:23:22.915408 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:23:23.043901 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-2de7695d-b11c-4cfd-bf89-ca26b36a9f0c tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:23:23.051793 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-2de7695d-b11c-4cfd-bf89-ca26b36a9f0c tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6" status: 200 len: 1560 microversion: 2.1 time: 0.448509 Aug 03 03:23:23.052372 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3681/7483] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:23:22 2022] GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 => generated 1560 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:23:24.771484 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-83dd6a26-3b12-4d28-b306-8885ddd45f5e req-f6392105-b05a-40eb-9942-53c333b3b13d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121c470b-84f1-4224-a3d6-91cd6a22fdf6", "tag": "5350aec1-45e1-41ee-90d9-724748b44737"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:23:24.776731 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=6 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:23:24.784288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-83dd6a26-3b12-4d28-b306-8885ddd45f5e req-f6392105-b05a-40eb-9942-53c333b3b13d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:23:24.784758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-83dd6a26-3b12-4d28-b306-8885ddd45f5e req-f6392105-b05a-40eb-9942-53c333b3b13d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:23:24.796878 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-83dd6a26-3b12-4d28-b306-8885ddd45f5e req-f6392105-b05a-40eb-9942-53c333b3b13d service nova] Creating event network-changed:5350aec1-45e1-41ee-90d9-724748b44737 for instance 121c470b-84f1-4224-a3d6-91cd6a22fdf6 on n-h2-826529-8 Aug 03 03:23:24.801979 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-83dd6a26-3b12-4d28-b306-8885ddd45f5e req-f6392105-b05a-40eb-9942-53c333b3b13d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034244 Aug 03 03:23:24.802574 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3803/7484] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:24:19.740584 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:24:19.741281 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 03:24:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:25:21.437382 n-d-826529-8 devstack@n-api.service[125942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [95a5e56a-7955-4bb2-902f-a217315250e4] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 03:25:21.438292 n-d-826529-8 devstack@n-api.service[125942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6768ec80-552a-4875-95fb-ee55c75da43d] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 03:25:21.439031 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:25:21.439907 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=34 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:25:21.444016 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-e9dab1fa-06c8-4f3d-868e-a41f3214e24b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-792986039"}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:25:21.446423 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-e9dab1fa-06c8-4f3d-868e-a41f3214e24b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:21.453545 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9dab1fa-06c8-4f3d-868e-a41f3214e24b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:21.454008 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9dab1fa-06c8-4f3d-868e-a41f3214e24b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:21.454793 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9dab1fa-06c8-4f3d-868e-a41f3214e24b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:21.455277 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-e9dab1fa-06c8-4f3d-868e-a41f3214e24b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:21.657038 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-e9dab1fa-06c8-4f3d-868e-a41f3214e24b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "POST /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6/action" status: 202 len: 0 microversion: 2.1 time: 0.221255 Aug 03 03:25:21.657672 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3682/7485] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:25:21 2022] POST /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 03:25:27.238423 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c87329c-10f0-40cc-99d5-2fdb48e49def] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 03:25:27.240039 n-d-826529-8 devstack@n-api.service[125941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b324c37-7dbb-4b30-9a93-80ead1f0c21e] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 03:25:27.240709 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:25:27.241701 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=28 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:25:27.246588 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-3c02e8e3-e021-47c2-95a6-4f5b8e301468 req-3c24d986-3fbf-49f5-b569-53a5052f4353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121c470b-84f1-4224-a3d6-91cd6a22fdf6", "name": "network-vif-plugged", "status": "completed", "tag": "5350aec1-45e1-41ee-90d9-724748b44737"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:25:27.263126 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3c02e8e3-e021-47c2-95a6-4f5b8e301468 req-3c24d986-3fbf-49f5-b569-53a5052f4353 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:27.264331 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-3c02e8e3-e021-47c2-95a6-4f5b8e301468 req-3c24d986-3fbf-49f5-b569-53a5052f4353 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:27.279230 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-3c02e8e3-e021-47c2-95a6-4f5b8e301468 req-3c24d986-3fbf-49f5-b569-53a5052f4353 service nova] Creating event network-vif-plugged:5350aec1-45e1-41ee-90d9-724748b44737 for instance 121c470b-84f1-4224-a3d6-91cd6a22fdf6 on n-h2-826529-8 Aug 03 03:25:27.286353 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-3c02e8e3-e021-47c2-95a6-4f5b8e301468 req-3c24d986-3fbf-49f5-b569-53a5052f4353 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050255 Aug 03 03:25:27.288033 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3804/7486] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:25:35.229503 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:25:35.230282 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:25:35.235449 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2100288658", "imageRef": "067d3d2e-d5df-4c48-8e38-0b99517ae802", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1026767652", "security_groups": [{"name": "tempest-secgroup-smoke-1397709107"}], "networks": [{"uuid": "d4c4285b-e6f5-4b18-8a7c-7bcfe3eca869"}]}} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:25:35.261947 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] [95a5e56a-7955-4bb2-902f-a217315250e4] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 40740. Aug 03 03:25:35.262721 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] [6768ec80-552a-4875-95fb-ee55c75da43d] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 40742. Aug 03 03:25:35.355216 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.network.neutron [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] validate_networks() for [('d4c4285b-e6f5-4b18-8a7c-7bcfe3eca869', None, None, None, None, None)] {{(pid=125942) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 03:25:35.774889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Flavor limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 03:25:35.775365 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Image limits 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 03:25:35.775886 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Flavor pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 03:25:35.776311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Image pref 0:0:0 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 03:25:35.776734 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.virt.hardware [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 03:25:35.787971 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:35.788465 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:35.789351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:35.789747 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:35.807476 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Getting quotas for project 422d8e398c4944d49553bdc986ac256b. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 03:25:35.812813 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.quota [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Getting quotas for user 9a289b92c1b74183b1e74c3dfcae5a6a and project 422d8e398c4944d49553bdc986ac256b. Resources: {'cores', 'instances', 'ram'} {{(pid=125942) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 03:25:35.825381 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Going to run 1 instances... {{(pid=125942) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 03:25:35.827906 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='067d3d2e-d5df-4c48-8e38-0b99517ae802',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 03:25:35.880750 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-134d2e29-8601-4857-85d5-99ded71ee838 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.653359 Aug 03 03:25:35.881396 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3683/7487] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 3 03:25:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 03:25:35.893950 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-bbf9aed6-eae4-477c-8318-16b2f9475826 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:35.894682 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-bbf9aed6-eae4-477c-8318-16b2f9475826 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:35.922974 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b324c37-7dbb-4b30-9a93-80ead1f0c21e] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 40758. Aug 03 03:25:35.925476 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c87329c-10f0-40cc-99d5-2fdb48e49def] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 40756. Aug 03 03:25:35.958574 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-bbf9aed6-eae4-477c-8318-16b2f9475826 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:35.966131 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-bbf9aed6-eae4-477c-8318-16b2f9475826 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1249 microversion: 2.1 time: 0.077632 Aug 03 03:25:35.966759 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3805/7488] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:35 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1249 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:25:36.990178 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-0d27ca4a-e30f-4a86-adb4-b303efacbd66 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:36.991571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-0d27ca4a-e30f-4a86-adb4-b303efacbd66 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:37.000048 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d27ca4a-e30f-4a86-adb4-b303efacbd66 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:37.000764 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d27ca4a-e30f-4a86-adb4-b303efacbd66 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:37.002603 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d27ca4a-e30f-4a86-adb4-b303efacbd66 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:37.003470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-0d27ca4a-e30f-4a86-adb4-b303efacbd66 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:37.072108 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-0d27ca4a-e30f-4a86-adb4-b303efacbd66 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:37.089523 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-0d27ca4a-e30f-4a86-adb4-b303efacbd66 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1307 microversion: 2.1 time: 0.105978 Aug 03 03:25:37.095058 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3684/7489] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:36 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:25:37.215087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-679cc814-8eed-494e-9110-696c631e2f69 req-31635c69-d3e6-464f-bfe4-fb2d4ff9c136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121c470b-84f1-4224-a3d6-91cd6a22fdf6", "name": "network-vif-unplugged", "status": "completed", "tag": "5350aec1-45e1-41ee-90d9-724748b44737"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:25:37.232960 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-679cc814-8eed-494e-9110-696c631e2f69 req-31635c69-d3e6-464f-bfe4-fb2d4ff9c136 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:37.233534 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-679cc814-8eed-494e-9110-696c631e2f69 req-31635c69-d3e6-464f-bfe4-fb2d4ff9c136 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:37.251579 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-679cc814-8eed-494e-9110-696c631e2f69 req-31635c69-d3e6-464f-bfe4-fb2d4ff9c136 service nova] Creating event network-vif-unplugged:5350aec1-45e1-41ee-90d9-724748b44737 for instance 121c470b-84f1-4224-a3d6-91cd6a22fdf6 on n-h2-826529-8 Aug 03 03:25:37.260010 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-679cc814-8eed-494e-9110-696c631e2f69 req-31635c69-d3e6-464f-bfe4-fb2d4ff9c136 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054025 Aug 03 03:25:37.260776 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3806/7490] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:25:38.118635 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-cd3a956d-be43-435d-a9e4-8a915e7c3c43 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:38.119338 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-cd3a956d-be43-435d-a9e4-8a915e7c3c43 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:38.126803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd3a956d-be43-435d-a9e4-8a915e7c3c43 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:38.127433 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd3a956d-be43-435d-a9e4-8a915e7c3c43 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:38.128627 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd3a956d-be43-435d-a9e4-8a915e7c3c43 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:38.128754 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-cd3a956d-be43-435d-a9e4-8a915e7c3c43 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:38.318500 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-cd3a956d-be43-435d-a9e4-8a915e7c3c43 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:38.326915 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-cd3a956d-be43-435d-a9e4-8a915e7c3c43 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1375 microversion: 2.1 time: 0.212143 Aug 03 03:25:38.327837 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3685/7491] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:38 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1375 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:25:39.351000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-7b45b895-058c-468c-b969-51e31d79afde tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:39.352448 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-7b45b895-058c-468c-b969-51e31d79afde tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:39.359883 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b45b895-058c-468c-b969-51e31d79afde tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:39.360442 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b45b895-058c-468c-b969-51e31d79afde tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:39.362230 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b45b895-058c-468c-b969-51e31d79afde tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:39.362758 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-7b45b895-058c-468c-b969-51e31d79afde tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:39.508604 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-7b45b895-058c-468c-b969-51e31d79afde tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:39.516605 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-7b45b895-058c-468c-b969-51e31d79afde tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1375 microversion: 2.1 time: 0.170631 Aug 03 03:25:39.517200 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3807/7492] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:39 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:25:40.538114 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-d51431a7-48ce-4318-82d1-7e6e9796b985 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:40.539422 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-d51431a7-48ce-4318-82d1-7e6e9796b985 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:40.546740 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d51431a7-48ce-4318-82d1-7e6e9796b985 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:40.547269 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d51431a7-48ce-4318-82d1-7e6e9796b985 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:40.548051 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d51431a7-48ce-4318-82d1-7e6e9796b985 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:40.548498 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-d51431a7-48ce-4318-82d1-7e6e9796b985 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:40.700317 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-d51431a7-48ce-4318-82d1-7e6e9796b985 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:40.709190 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-d51431a7-48ce-4318-82d1-7e6e9796b985 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1375 microversion: 2.1 time: 0.175177 Aug 03 03:25:40.709998 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3686/7493] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:40 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:25:41.731804 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-4370d58e-1d39-471a-ad3e-901b6563ef4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:41.732581 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-4370d58e-1d39-471a-ad3e-901b6563ef4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:41.740546 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4370d58e-1d39-471a-ad3e-901b6563ef4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:41.741019 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4370d58e-1d39-471a-ad3e-901b6563ef4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:41.741822 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4370d58e-1d39-471a-ad3e-901b6563ef4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:41.742281 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-4370d58e-1d39-471a-ad3e-901b6563ef4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:41.884231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-4370d58e-1d39-471a-ad3e-901b6563ef4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:41.893663 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-4370d58e-1d39-471a-ad3e-901b6563ef4b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1375 microversion: 2.1 time: 0.166083 Aug 03 03:25:41.898823 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3808/7494] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:41 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:25:42.916593 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-3ef5dad4-4695-471c-af5f-ea4707adaaa0 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:42.917867 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-3ef5dad4-4695-471c-af5f-ea4707adaaa0 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:42.926792 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ef5dad4-4695-471c-af5f-ea4707adaaa0 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:42.927292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ef5dad4-4695-471c-af5f-ea4707adaaa0 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:42.928239 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ef5dad4-4695-471c-af5f-ea4707adaaa0 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:42.928700 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-3ef5dad4-4695-471c-af5f-ea4707adaaa0 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:43.104526 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-3ef5dad4-4695-471c-af5f-ea4707adaaa0 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:43.112948 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-3ef5dad4-4695-471c-af5f-ea4707adaaa0 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1375 microversion: 2.1 time: 0.200268 Aug 03 03:25:43.113855 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3687/7495] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:42 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1375 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:25:44.135595 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-fb0f0fd7-180a-4543-b9ae-71e8d69a6c22 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:44.138112 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-fb0f0fd7-180a-4543-b9ae-71e8d69a6c22 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:44.147584 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb0f0fd7-180a-4543-b9ae-71e8d69a6c22 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:44.148520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb0f0fd7-180a-4543-b9ae-71e8d69a6c22 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:44.149368 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb0f0fd7-180a-4543-b9ae-71e8d69a6c22 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:44.149834 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-fb0f0fd7-180a-4543-b9ae-71e8d69a6c22 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:44.297808 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-fb0f0fd7-180a-4543-b9ae-71e8d69a6c22 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:44.306999 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-fb0f0fd7-180a-4543-b9ae-71e8d69a6c22 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1375 microversion: 2.1 time: 0.176347 Aug 03 03:25:44.308516 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3809/7496] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:44 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1375 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:25:45.330094 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-79f39f3b-3253-4bd7-b4b2-f26696997ed2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:45.330858 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-79f39f3b-3253-4bd7-b4b2-f26696997ed2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:45.339594 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79f39f3b-3253-4bd7-b4b2-f26696997ed2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:45.340066 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79f39f3b-3253-4bd7-b4b2-f26696997ed2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:45.340913 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79f39f3b-3253-4bd7-b4b2-f26696997ed2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:45.341328 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-79f39f3b-3253-4bd7-b4b2-f26696997ed2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:45.479209 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-79f39f3b-3253-4bd7-b4b2-f26696997ed2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:45.487573 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-79f39f3b-3253-4bd7-b4b2-f26696997ed2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1375 microversion: 2.1 time: 0.161521 Aug 03 03:25:45.488074 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3688/7497] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:45 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:25:46.497419 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-2946ab45-4930-4cec-82e2-433e60b1f2dd req-193d637c-aedb-4875-ba87-9196f0adbb28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ad7332-2dea-4f94-a0d3-271529744b7c", "tag": "2c901fcd-ab2e-4722-8249-1999fe8f3e89"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:25:46.510725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9822edde-ec99-41c9-b71d-ccc3d0a7091b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:46.511380 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9822edde-ec99-41c9-b71d-ccc3d0a7091b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:46.513306 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=2 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:25:46.514418 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell0:SELECT=6 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:25:46.528274 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell0:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:25:46.531317 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2946ab45-4930-4cec-82e2-433e60b1f2dd req-193d637c-aedb-4875-ba87-9196f0adbb28 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:46.531786 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-2946ab45-4930-4cec-82e2-433e60b1f2dd req-193d637c-aedb-4875-ba87-9196f0adbb28 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:46.537966 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9822edde-ec99-41c9-b71d-ccc3d0a7091b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:46.538442 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9822edde-ec99-41c9-b71d-ccc3d0a7091b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:46.539322 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9822edde-ec99-41c9-b71d-ccc3d0a7091b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:46.539774 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9822edde-ec99-41c9-b71d-ccc3d0a7091b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:46.551979 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-2946ab45-4930-4cec-82e2-433e60b1f2dd req-193d637c-aedb-4875-ba87-9196f0adbb28 service nova] Creating event network-changed:2c901fcd-ab2e-4722-8249-1999fe8f3e89 for instance 16ad7332-2dea-4f94-a0d3-271529744b7c on n-h1-826529-8 Aug 03 03:25:46.557277 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-2946ab45-4930-4cec-82e2-433e60b1f2dd req-193d637c-aedb-4875-ba87-9196f0adbb28 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063797 Aug 03 03:25:46.557896 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3810/7498] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:25:46.684171 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9822edde-ec99-41c9-b71d-ccc3d0a7091b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:46.692399 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9822edde-ec99-41c9-b71d-ccc3d0a7091b tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1375 microversion: 2.1 time: 0.186795 Aug 03 03:25:46.693247 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3689/7499] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:46 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1375 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 03:25:47.713943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-c0c76606-ce96-46be-b672-653152ab11e2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:47.714559 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-c0c76606-ce96-46be-b672-653152ab11e2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:47.722624 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0c76606-ce96-46be-b672-653152ab11e2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:47.723135 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0c76606-ce96-46be-b672-653152ab11e2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:47.723940 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0c76606-ce96-46be-b672-653152ab11e2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:47.724388 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-c0c76606-ce96-46be-b672-653152ab11e2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:47.860771 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-c0c76606-ce96-46be-b672-653152ab11e2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:47.869441 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-c0c76606-ce96-46be-b672-653152ab11e2 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1375 microversion: 2.1 time: 0.159781 Aug 03 03:25:47.870025 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3811/7500] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:47 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:25:48.891158 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-9b66076c-6fe2-482b-810c-0686542ea921 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:48.891939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-9b66076c-6fe2-482b-810c-0686542ea921 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:48.899749 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b66076c-6fe2-482b-810c-0686542ea921 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:48.900199 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b66076c-6fe2-482b-810c-0686542ea921 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:48.901006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b66076c-6fe2-482b-810c-0686542ea921 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:48.901427 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-9b66076c-6fe2-482b-810c-0686542ea921 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:49.044006 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-9b66076c-6fe2-482b-810c-0686542ea921 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:49.052348 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-9b66076c-6fe2-482b-810c-0686542ea921 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1375 microversion: 2.1 time: 0.165069 Aug 03 03:25:49.052940 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3690/7501] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:48 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:25:50.073256 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-2d36402b-bd02-4d80-aa1b-ff4a59954a28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:50.073891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-2d36402b-bd02-4d80-aa1b-ff4a59954a28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:50.081671 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d36402b-bd02-4d80-aa1b-ff4a59954a28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:50.082142 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d36402b-bd02-4d80-aa1b-ff4a59954a28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:50.082951 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d36402b-bd02-4d80-aa1b-ff4a59954a28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:50.083420 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-2d36402b-bd02-4d80-aa1b-ff4a59954a28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:50.215670 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-2d36402b-bd02-4d80-aa1b-ff4a59954a28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:50.223379 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-2d36402b-bd02-4d80-aa1b-ff4a59954a28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1375 microversion: 2.1 time: 0.153961 Aug 03 03:25:50.223954 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3812/7502] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:50 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:25:50.598811 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-d61d52cd-48ca-42ae-aeec-859e7a3c011f req-959fdeb0-916b-4b51-bb36-e8313858ce21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ad7332-2dea-4f94-a0d3-271529744b7c", "name": "network-vif-plugged", "status": "completed", "tag": "2c901fcd-ab2e-4722-8249-1999fe8f3e89"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:25:50.609829 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d61d52cd-48ca-42ae-aeec-859e7a3c011f req-959fdeb0-916b-4b51-bb36-e8313858ce21 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:50.610292 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-d61d52cd-48ca-42ae-aeec-859e7a3c011f req-959fdeb0-916b-4b51-bb36-e8313858ce21 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:50.622625 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-d61d52cd-48ca-42ae-aeec-859e7a3c011f req-959fdeb0-916b-4b51-bb36-e8313858ce21 service nova] Creating event network-vif-plugged:2c901fcd-ab2e-4722-8249-1999fe8f3e89 for instance 16ad7332-2dea-4f94-a0d3-271529744b7c on n-h1-826529-8 Aug 03 03:25:50.627831 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-d61d52cd-48ca-42ae-aeec-859e7a3c011f req-959fdeb0-916b-4b51-bb36-e8313858ce21 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033376 Aug 03 03:25:50.628450 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3691/7503] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:25:51.245231 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-6dbcaff5-b739-49dd-be83-2177973a0a2a tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:51.245820 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-6dbcaff5-b739-49dd-be83-2177973a0a2a tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:51.253389 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dbcaff5-b739-49dd-be83-2177973a0a2a tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:51.253848 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dbcaff5-b739-49dd-be83-2177973a0a2a tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:51.254629 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dbcaff5-b739-49dd-be83-2177973a0a2a tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:51.255481 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-6dbcaff5-b739-49dd-be83-2177973a0a2a tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:51.393160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-6dbcaff5-b739-49dd-be83-2177973a0a2a tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:51.401160 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-6dbcaff5-b739-49dd-be83-2177973a0a2a tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1375 microversion: 2.1 time: 0.159907 Aug 03 03:25:51.401744 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3813/7504] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:51 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:25:52.425077 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-6dcc19ae-4ec8-4d20-8554-57d82e8f7654 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:52.425723 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-6dcc19ae-4ec8-4d20-8554-57d82e8f7654 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:52.432122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dcc19ae-4ec8-4d20-8554-57d82e8f7654 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:52.432571 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dcc19ae-4ec8-4d20-8554-57d82e8f7654 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:52.433347 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dcc19ae-4ec8-4d20-8554-57d82e8f7654 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:52.433786 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-6dcc19ae-4ec8-4d20-8554-57d82e8f7654 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:52.934452 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-6dcc19ae-4ec8-4d20-8554-57d82e8f7654 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:52.943531 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-6dcc19ae-4ec8-4d20-8554-57d82e8f7654 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1561 microversion: 2.1 time: 0.524171 Aug 03 03:25:52.944118 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3692/7505] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:52 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1561 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:25:52.964946 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-596bdb0c-8cb2-4fd9-960b-2eb362573e3f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:25:52.965600 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-596bdb0c-8cb2-4fd9-960b-2eb362573e3f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:25:52.972677 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-596bdb0c-8cb2-4fd9-960b-2eb362573e3f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:52.973136 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-596bdb0c-8cb2-4fd9-960b-2eb362573e3f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:52.973917 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-596bdb0c-8cb2-4fd9-960b-2eb362573e3f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:52.974366 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-596bdb0c-8cb2-4fd9-960b-2eb362573e3f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:53.164298 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-596bdb0c-8cb2-4fd9-960b-2eb362573e3f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:25:53.171817 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-596bdb0c-8cb2-4fd9-960b-2eb362573e3f tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1561 microversion: 2.1 time: 0.210779 Aug 03 03:25:53.172400 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3814/7506] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:25:52 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1561 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:25:54.857680 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-8efc4060-50bf-4023-ba0b-788c0b338418 req-c2415389-6827-4d3b-b640-559d9aab4efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ad7332-2dea-4f94-a0d3-271529744b7c", "tag": "2c901fcd-ab2e-4722-8249-1999fe8f3e89"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:25:54.868905 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8efc4060-50bf-4023-ba0b-788c0b338418 req-c2415389-6827-4d3b-b640-559d9aab4efa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:25:54.869517 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-8efc4060-50bf-4023-ba0b-788c0b338418 req-c2415389-6827-4d3b-b640-559d9aab4efa service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:25:54.881127 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-8efc4060-50bf-4023-ba0b-788c0b338418 req-c2415389-6827-4d3b-b640-559d9aab4efa service nova] Creating event network-changed:2c901fcd-ab2e-4722-8249-1999fe8f3e89 for instance 16ad7332-2dea-4f94-a0d3-271529744b7c on n-h1-826529-8 Aug 03 03:25:54.886224 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-8efc4060-50bf-4023-ba0b-788c0b338418 req-c2415389-6827-4d3b-b640-559d9aab4efa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092496 Aug 03 03:25:54.886842 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3693/7507] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:25:59.679594 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:25:59.680179 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 03:25:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:25:59.801927 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:25:59.802425 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 03:25:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:27:26.853106 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=24 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:27:26.853928 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=48 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:27:26.858304 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-b97fe79b-8c82-46c8-a82a-c688528ae0bc tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1426007440"}} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:27:26.860691 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-b97fe79b-8c82-46c8-a82a-c688528ae0bc tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:27:26.868198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b97fe79b-8c82-46c8-a82a-c688528ae0bc tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:26.868667 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b97fe79b-8c82-46c8-a82a-c688528ae0bc tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:26.869458 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b97fe79b-8c82-46c8-a82a-c688528ae0bc tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:26.869915 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-b97fe79b-8c82-46c8-a82a-c688528ae0bc tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:27.064385 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-b97fe79b-8c82-46c8-a82a-c688528ae0bc tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "POST /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c/action" status: 202 len: 0 microversion: 2.1 time: 0.213017 Aug 03 03:27:27.066108 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3815/7508] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 3 03:27:26 2022] POST /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 03:27:33.053462 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:27:33.055015 n-d-826529-8 devstack@n-api.service[125942]: DEBUG dbcounter [-] [125942] Writing DB stats nova_cell1:SELECT=54 {{(pid=125942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:27:33.062351 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-1e9c59a2-5fb3-4311-807d-30ef057c4865 req-96626613-620c-4872-8535-486a52868650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ad7332-2dea-4f94-a0d3-271529744b7c", "name": "network-vif-plugged", "status": "completed", "tag": "2c901fcd-ab2e-4722-8249-1999fe8f3e89"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:27:33.082725 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1e9c59a2-5fb3-4311-807d-30ef057c4865 req-96626613-620c-4872-8535-486a52868650 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:33.083592 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-1e9c59a2-5fb3-4311-807d-30ef057c4865 req-96626613-620c-4872-8535-486a52868650 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:33.095898 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-1e9c59a2-5fb3-4311-807d-30ef057c4865 req-96626613-620c-4872-8535-486a52868650 service nova] Creating event network-vif-plugged:2c901fcd-ab2e-4722-8249-1999fe8f3e89 for instance 16ad7332-2dea-4f94-a0d3-271529744b7c on n-h1-826529-8 Aug 03 03:27:33.101898 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-1e9c59a2-5fb3-4311-807d-30ef057c4865 req-96626613-620c-4872-8535-486a52868650 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051328 Aug 03 03:27:33.102744 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3694/7509] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:27:39.750340 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:27:39.750812 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 03:27:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:27:40.750837 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_api:SELECT=2 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:27:40.752782 n-d-826529-8 devstack@n-api.service[125941]: DEBUG dbcounter [-] [125941] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 03:27:40.757270 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-ced97151-afd8-4559-b80d-379ff5b2bd29 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:27:40.758321 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ced97151-afd8-4559-b80d-379ff5b2bd29 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:27:40.759312 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-0c4fdc6e-8546-4e0c-94cc-d0551b2d9b33 req-bdc33fbf-cc9e-4584-a37d-0e7905c53626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ad7332-2dea-4f94-a0d3-271529744b7c", "tag": "2c901fcd-ab2e-4722-8249-1999fe8f3e89"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:27:40.766630 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ced97151-afd8-4559-b80d-379ff5b2bd29 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:40.767261 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ced97151-afd8-4559-b80d-379ff5b2bd29 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:40.768991 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ced97151-afd8-4559-b80d-379ff5b2bd29 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:40.769520 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-ced97151-afd8-4559-b80d-379ff5b2bd29 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:40.770561 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0c4fdc6e-8546-4e0c-94cc-d0551b2d9b33 req-bdc33fbf-cc9e-4584-a37d-0e7905c53626 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:40.771058 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-0c4fdc6e-8546-4e0c-94cc-d0551b2d9b33 req-bdc33fbf-cc9e-4584-a37d-0e7905c53626 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:40.784736 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-0c4fdc6e-8546-4e0c-94cc-d0551b2d9b33 req-bdc33fbf-cc9e-4584-a37d-0e7905c53626 service nova] Creating event network-changed:2c901fcd-ab2e-4722-8249-1999fe8f3e89 for instance 16ad7332-2dea-4f94-a0d3-271529744b7c on n-h1-826529-8 Aug 03 03:27:40.791857 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-0c4fdc6e-8546-4e0c-94cc-d0551b2d9b33 req-bdc33fbf-cc9e-4584-a37d-0e7905c53626 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037628 Aug 03 03:27:40.792551 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3695/7510] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:27:40.802891 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-ced97151-afd8-4559-b80d-379ff5b2bd29 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Going to try to terminate instance {{(pid=125941) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 03:27:40.897812 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-ced97151-afd8-4559-b80d-379ff5b2bd29 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "DELETE /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 204 len: 0 microversion: 2.1 time: 0.148765 Aug 03 03:27:40.898823 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3816/7511] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 03:27:40 2022] DELETE /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 03:27:40.908189 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-1a6dfc6e-dcef-4b9d-8435-61cfb45cc134 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:27:40.908977 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-1a6dfc6e-dcef-4b9d-8435-61cfb45cc134 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:27:40.916939 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a6dfc6e-dcef-4b9d-8435-61cfb45cc134 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:40.917396 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a6dfc6e-dcef-4b9d-8435-61cfb45cc134 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:40.932149 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a6dfc6e-dcef-4b9d-8435-61cfb45cc134 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:40.932616 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-1a6dfc6e-dcef-4b9d-8435-61cfb45cc134 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:41.103377 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-1a6dfc6e-dcef-4b9d-8435-61cfb45cc134 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:27:41.112726 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-1a6dfc6e-dcef-4b9d-8435-61cfb45cc134 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1685 microversion: 2.1 time: 0.208653 Aug 03 03:27:41.113419 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3696/7512] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:27:40 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1685 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:27:42.136703 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-f5648969-43ef-407a-9ef0-7c4a62453b4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:27:42.137412 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-f5648969-43ef-407a-9ef0-7c4a62453b4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:27:42.146889 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5648969-43ef-407a-9ef0-7c4a62453b4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:42.147376 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5648969-43ef-407a-9ef0-7c4a62453b4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:42.148160 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5648969-43ef-407a-9ef0-7c4a62453b4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:42.148632 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-f5648969-43ef-407a-9ef0-7c4a62453b4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:42.289639 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-f5648969-43ef-407a-9ef0-7c4a62453b4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:27:42.297372 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-f5648969-43ef-407a-9ef0-7c4a62453b4e tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1685 microversion: 2.1 time: 0.164883 Aug 03 03:27:42.297957 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3817/7513] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:27:42 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:27:43.015798 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [req-140b672c-6fd9-48ef-bd13-12a3fc2d0cba req-de6e1b4a-88d9-4bde-8aec-3e8ee731503f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ad7332-2dea-4f94-a0d3-271529744b7c", "name": "network-vif-unplugged", "status": "completed", "tag": "2c901fcd-ab2e-4722-8249-1999fe8f3e89"}]} {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:27:43.037470 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-140b672c-6fd9-48ef-bd13-12a3fc2d0cba req-de6e1b4a-88d9-4bde-8aec-3e8ee731503f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:43.038122 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [req-140b672c-6fd9-48ef-bd13-12a3fc2d0cba req-de6e1b4a-88d9-4bde-8aec-3e8ee731503f service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:43.051734 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.compute.server_external_events [req-140b672c-6fd9-48ef-bd13-12a3fc2d0cba req-de6e1b4a-88d9-4bde-8aec-3e8ee731503f service nova] Creating event network-vif-unplugged:2c901fcd-ab2e-4722-8249-1999fe8f3e89 for instance 16ad7332-2dea-4f94-a0d3-271529744b7c on n-h1-826529-8 Aug 03 03:27:43.057286 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [req-140b672c-6fd9-48ef-bd13-12a3fc2d0cba req-de6e1b4a-88d9-4bde-8aec-3e8ee731503f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047283 Aug 03 03:27:43.058096 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3697/7514] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:27:43.195716 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-b6ac9c15-601b-486d-a33c-be7323878caa req-9a7fa486-228d-4cc1-9def-2867ce9b0fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ad7332-2dea-4f94-a0d3-271529744b7c", "name": "network-vif-deleted", "tag": "2c901fcd-ab2e-4722-8249-1999fe8f3e89"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:27:43.209190 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b6ac9c15-601b-486d-a33c-be7323878caa req-9a7fa486-228d-4cc1-9def-2867ce9b0fe2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:43.209657 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-b6ac9c15-601b-486d-a33c-be7323878caa req-9a7fa486-228d-4cc1-9def-2867ce9b0fe2 service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:43.222002 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-b6ac9c15-601b-486d-a33c-be7323878caa req-9a7fa486-228d-4cc1-9def-2867ce9b0fe2 service nova] Creating event network-vif-deleted:2c901fcd-ab2e-4722-8249-1999fe8f3e89 for instance 16ad7332-2dea-4f94-a0d3-271529744b7c on n-h1-826529-8 Aug 03 03:27:43.228016 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-b6ac9c15-601b-486d-a33c-be7323878caa req-9a7fa486-228d-4cc1-9def-2867ce9b0fe2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035868 Aug 03 03:27:43.231459 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3818/7515] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:27:43.320478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-93eb38da-2bc7-4c51-943d-addf39892f5d tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:27:43.321327 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-93eb38da-2bc7-4c51-943d-addf39892f5d tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:27:43.328693 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93eb38da-2bc7-4c51-943d-addf39892f5d tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:43.329325 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93eb38da-2bc7-4c51-943d-addf39892f5d tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:43.330311 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93eb38da-2bc7-4c51-943d-addf39892f5d tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:43.330761 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93eb38da-2bc7-4c51-943d-addf39892f5d tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:43.366191 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93eb38da-2bc7-4c51-943d-addf39892f5d tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:43.366649 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-93eb38da-2bc7-4c51-943d-addf39892f5d tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:43.367152 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-93eb38da-2bc7-4c51-943d-addf39892f5d tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lazy-loading 'fault' on Instance uuid 16ad7332-2dea-4f94-a0d3-271529744b7c {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 03:27:43.409153 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-93eb38da-2bc7-4c51-943d-addf39892f5d tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:27:43.417084 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-93eb38da-2bc7-4c51-943d-addf39892f5d tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 200 len: 1339 microversion: 2.1 time: 0.101138 Aug 03 03:27:43.417671 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3698/7516] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:27:43 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:27:44.441288 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-35ddb4ce-2d5e-4709-8ff4-1f3439ce6e31 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:27:44.442000 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-35ddb4ce-2d5e-4709-8ff4-1f3439ce6e31 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 16ad7332-2dea-4f94-a0d3-271529744b7c] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:27:44.448503 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35ddb4ce-2d5e-4709-8ff4-1f3439ce6e31 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:44.448969 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35ddb4ce-2d5e-4709-8ff4-1f3439ce6e31 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:44.449756 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35ddb4ce-2d5e-4709-8ff4-1f3439ce6e31 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:44.450209 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-35ddb4ce-2d5e-4709-8ff4-1f3439ce6e31 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:44.464257 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-35ddb4ce-2d5e-4709-8ff4-1f3439ce6e31 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] HTTP exception thrown: Instance 16ad7332-2dea-4f94-a0d3-271529744b7c could not be found. Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-35ddb4ce-2d5e-4709-8ff4-1f3439ce6e31 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Request method failure captured: Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c HTTP/1.1 Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eoZRbeiasEX7O-6KtzejmN3fd014gG0CThp1lOi3gHf8c8-WaSG5LsEyk3ZRo0nEt_e0QDrJ87xGTEJsSt-L2QggFogJwP-oP74SsRGRVLM89MlYKqfq4oFajmhxn55NmwwY_dWvI_NXk58o85H5KeUVyvfO5mLnGFA6Tf1-RZqOjk Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 422d8e398c4944d49553bdc986ac256b Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestSnapshotPattern-1086622436 Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_422d8e398c4944d49553bdc986ac256b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/422d8e398c4944d49553bdc986ac256b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/422d8e398c4944d49553bdc986ac256b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/422d8e398c4944d49553bdc986ac256b"}]}] Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestSnapshotPattern-1086622436 Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 422d8e398c4944d49553bdc986ac256b Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestSnapshotPattern-1086622436 Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestSnapshotPattern-1086622436-project Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 9a289b92c1b74183b1e74c3dfcae5a6a Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestSnapshotPattern-1086622436-project Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 16ad7332-2dea-4f94-a0d3-271529744b7c could not be found. Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '16ad7332-2dea-4f94-a0d3-271529744b7c'} Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ad7332-2dea-4f94-a0d3-271529744b7c could not be found. Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ad7332-2dea-4f94-a0d3-271529744b7c could not be found. Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:27:44.465869 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:27:44.471212 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:27:44.471212 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:27:44.471212 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:27:44.471212 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 03:27:44.471212 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 03:27:44.471212 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ad7332-2dea-4f94-a0d3-271529744b7c could not be found. Aug 03 03:27:44.471212 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:27:44.471212 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-35ddb4ce-2d5e-4709-8ff4-1f3439ce6e31 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Returning 404 to user: Instance 16ad7332-2dea-4f94-a0d3-271529744b7c could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 03:27:44.471212 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-35ddb4ce-2d5e-4709-8ff4-1f3439ce6e31 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c" status: 404 len: 111 microversion: 2.1 time: 0.031601 Aug 03 03:27:44.471212 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3819/7517] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:27:44 2022] GET /compute/v2.1/servers/16ad7332-2dea-4f94-a0d3-271529744b7c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 03:27:46.146012 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-463227ff-aafd-4543-8943-6fc67c5c3c28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:27:46.146518 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-463227ff-aafd-4543-8943-6fc67c5c3c28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:27:46.147555 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-ac36cc09-3f87-4bee-bceb-4f66519f5e65 req-8d7e5efd-2c77-4110-ac81-23fe1ae11c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121c470b-84f1-4224-a3d6-91cd6a22fdf6", "tag": "5350aec1-45e1-41ee-90d9-724748b44737"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:27:46.154228 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-463227ff-aafd-4543-8943-6fc67c5c3c28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:46.154701 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-463227ff-aafd-4543-8943-6fc67c5c3c28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:46.156093 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-463227ff-aafd-4543-8943-6fc67c5c3c28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:46.157280 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-463227ff-aafd-4543-8943-6fc67c5c3c28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:46.163197 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ac36cc09-3f87-4bee-bceb-4f66519f5e65 req-8d7e5efd-2c77-4110-ac81-23fe1ae11c0d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:46.163662 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-ac36cc09-3f87-4bee-bceb-4f66519f5e65 req-8d7e5efd-2c77-4110-ac81-23fe1ae11c0d service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:46.174510 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-ac36cc09-3f87-4bee-bceb-4f66519f5e65 req-8d7e5efd-2c77-4110-ac81-23fe1ae11c0d service nova] Creating event network-changed:5350aec1-45e1-41ee-90d9-724748b44737 for instance 121c470b-84f1-4224-a3d6-91cd6a22fdf6 on n-h2-826529-8 Aug 03 03:27:46.179595 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-ac36cc09-3f87-4bee-bceb-4f66519f5e65 req-8d7e5efd-2c77-4110-ac81-23fe1ae11c0d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035613 Aug 03 03:27:46.180268 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3820/7518] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:27:46.185385 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-463227ff-aafd-4543-8943-6fc67c5c3c28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Going to try to terminate instance {{(pid=125942) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 03:27:46.283101 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-463227ff-aafd-4543-8943-6fc67c5c3c28 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "DELETE /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6" status: 204 len: 0 microversion: 2.1 time: 0.141689 Aug 03 03:27:46.283892 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3699/7519] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 3 03:27:46 2022] DELETE /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 03:27:46.293757 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-0e8098e8-3ca8-4645-bcc0-4084add987b3 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:27:46.294483 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-0e8098e8-3ca8-4645-bcc0-4084add987b3 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:27:46.302760 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e8098e8-3ca8-4645-bcc0-4084add987b3 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:46.303272 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e8098e8-3ca8-4645-bcc0-4084add987b3 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:46.304082 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e8098e8-3ca8-4645-bcc0-4084add987b3 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:46.304538 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-0e8098e8-3ca8-4645-bcc0-4084add987b3 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:46.457087 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.policy [None req-0e8098e8-3ca8-4645-bcc0-4084add987b3 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125941) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:27:46.466766 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-0e8098e8-3ca8-4645-bcc0-4084add987b3 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6" status: 200 len: 1685 microversion: 2.1 time: 0.177339 Aug 03 03:27:46.478923 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3821/7520] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:27:46 2022] GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:27:47.491756 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-73a96851-c9a6-48bc-befd-bb3455aa84f9 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:27:47.492461 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-73a96851-c9a6-48bc-befd-bb3455aa84f9 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:27:47.504919 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73a96851-c9a6-48bc-befd-bb3455aa84f9 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:47.505379 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73a96851-c9a6-48bc-befd-bb3455aa84f9 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:47.506176 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73a96851-c9a6-48bc-befd-bb3455aa84f9 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:47.506624 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-73a96851-c9a6-48bc-befd-bb3455aa84f9 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:47.706916 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-73a96851-c9a6-48bc-befd-bb3455aa84f9 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:27:47.714578 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-73a96851-c9a6-48bc-befd-bb3455aa84f9 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6" status: 200 len: 1685 microversion: 2.1 time: 0.227243 Aug 03 03:27:47.715191 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3700/7521] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:27:47 2022] GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 => generated 1685 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:27:48.475565 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [req-76a15379-4bee-4cfb-ad91-2dd9d0284b27 req-bc853e3e-344e-4013-a8a4-cb9d1ac0efdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121c470b-84f1-4224-a3d6-91cd6a22fdf6", "name": "network-vif-deleted", "tag": "5350aec1-45e1-41ee-90d9-724748b44737"}]} {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 03:27:48.486299 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-76a15379-4bee-4cfb-ad91-2dd9d0284b27 req-bc853e3e-344e-4013-a8a4-cb9d1ac0efdc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:48.486816 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [req-76a15379-4bee-4cfb-ad91-2dd9d0284b27 req-bc853e3e-344e-4013-a8a4-cb9d1ac0efdc service nova] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:48.500263 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.compute.server_external_events [req-76a15379-4bee-4cfb-ad91-2dd9d0284b27 req-bc853e3e-344e-4013-a8a4-cb9d1ac0efdc service nova] Creating event network-vif-deleted:5350aec1-45e1-41ee-90d9-724748b44737 for instance 121c470b-84f1-4224-a3d6-91cd6a22fdf6 on n-h2-826529-8 Aug 03 03:27:48.505256 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [req-76a15379-4bee-4cfb-ad91-2dd9d0284b27 req-bc853e3e-344e-4013-a8a4-cb9d1ac0efdc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102734 Aug 03 03:27:48.505777 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3822/7522] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 3 03:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 03:27:48.737569 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-afd86d2a-5d3c-472e-a6dc-521869202f03 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:27:48.738196 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.compute.api [None req-afd86d2a-5d3c-472e-a6dc-521869202f03 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125942) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:27:48.755855 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-afd86d2a-5d3c-472e-a6dc-521869202f03 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:48.756544 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-afd86d2a-5d3c-472e-a6dc-521869202f03 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:48.757352 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-afd86d2a-5d3c-472e-a6dc-521869202f03 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:48.757803 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-afd86d2a-5d3c-472e-a6dc-521869202f03 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:48.794889 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-afd86d2a-5d3c-472e-a6dc-521869202f03 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:48.795478 n-d-826529-8 devstack@n-api.service[125942]: DEBUG oslo_concurrency.lockutils [None req-afd86d2a-5d3c-472e-a6dc-521869202f03 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:48.796032 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.objects.instance [None req-afd86d2a-5d3c-472e-a6dc-521869202f03 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lazy-loading 'fault' on Instance uuid 121c470b-84f1-4224-a3d6-91cd6a22fdf6 {{(pid=125942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 03:27:48.845337 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.policy [None req-afd86d2a-5d3c-472e-a6dc-521869202f03 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a289b92c1b74183b1e74c3dfcae5a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422d8e398c4944d49553bdc986ac256b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125942) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 03:27:48.854661 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-afd86d2a-5d3c-472e-a6dc-521869202f03 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6" status: 200 len: 1339 microversion: 2.1 time: 0.121640 Aug 03 03:27:48.856006 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3701/7523] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:27:48 2022] GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 => generated 1339 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 03:27:49.878465 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9c27d1c4-a796-4937-9ad3-4dba98f52ebe tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '>' {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:27:49.879198 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.compute.api [None req-9c27d1c4-a796-4937-9ad3-4dba98f52ebe tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] [instance: 121c470b-84f1-4224-a3d6-91cd6a22fdf6] Fetching instance by UUID {{(pid=125941) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 03:27:49.885486 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c27d1c4-a796-4937-9ad3-4dba98f52ebe tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:49.885943 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c27d1c4-a796-4937-9ad3-4dba98f52ebe tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:49.886714 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c27d1c4-a796-4937-9ad3-4dba98f52ebe tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 03:27:49.887178 n-d-826529-8 devstack@n-api.service[125941]: DEBUG oslo_concurrency.lockutils [None req-9c27d1c4-a796-4937-9ad3-4dba98f52ebe tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Lock "812a442e-24ba-4152-b2b0-f99907b19272" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 03:27:49.900627 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.wsgi [None req-9c27d1c4-a796-4937-9ad3-4dba98f52ebe tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] HTTP exception thrown: Instance 121c470b-84f1-4224-a3d6-91cd6a22fdf6 could not be found. Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9c27d1c4-a796-4937-9ad3-4dba98f52ebe tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Request method failure captured: Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: request: GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 HTTP/1.1 Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: Accept: application/json Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: Accept-Encoding: identity Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: Connection: close Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: Content-Length: 0 Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: Content-Type: application/json Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: Host: 10.222.0.67 Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: Openstack-System-Scope: None Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: User-Agent: python-urllib3/1.26.10 Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-Auth-Token: gAAAAABi6eoZRbeiasEX7O-6KtzejmN3fd014gG0CThp1lOi3gHf8c8-WaSG5LsEyk3ZRo0nEt_e0QDrJ87xGTEJsSt-L2QggFogJwP-oP74SsRGRVLM89MlYKqfq4oFajmhxn55NmwwY_dWvI_NXk58o85H5KeUVyvfO5mLnGFA6Tf1-RZqOjk Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Id: None Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-Domain-Name: None Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-Identity-Status: Confirmed Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-Is-Admin-Project: True Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Id: default Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Domain-Name: Default Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Id: 422d8e398c4944d49553bdc986ac256b Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-Project-Name: tempest-TestSnapshotPattern-1086622436 Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-Role: member,reader Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-Roles: member,reader Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:8080/v1/AUTH_422d8e398c4944d49553bdc986ac256b", "adminURL": "http://10.222.0.67:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/422d8e398c4944d49553bdc986ac256b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/422d8e398c4944d49553bdc986ac256b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/422d8e398c4944d49553bdc986ac256b"}]}] Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant: tempest-TestSnapshotPattern-1086622436 Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Id: 422d8e398c4944d49553bdc986ac256b Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-Tenant-Name: tempest-TestSnapshotPattern-1086622436 Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-User: tempest-TestSnapshotPattern-1086622436-project Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Id: default Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-User-Domain-Name: Default Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-User-Id: 9a289b92c1b74183b1e74c3dfcae5a6a Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: X-User-Name: tempest-TestSnapshotPattern-1086622436-project Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: method: > Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: exception: Instance 121c470b-84f1-4224-a3d6-91cd6a22fdf6 could not be found. Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: action_args: {'id': '121c470b-84f1-4224-a3d6-91cd6a22fdf6'} Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: {{(pid=125941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 121c470b-84f1-4224-a3d6-91cd6a22fdf6 could not be found. Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 121c470b-84f1-4224-a3d6-91cd6a22fdf6 could not be found. Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 03:27:49.902280 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:27:49.907076 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 03:27:49.907076 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 03:27:49.907076 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 03:27:49.907076 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 03:27:49.907076 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 03:27:49.907076 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 121c470b-84f1-4224-a3d6-91cd6a22fdf6 could not be found. Aug 03 03:27:49.907076 n-d-826529-8 devstack@n-api.service[125941]: ERROR nova.api.openstack.wsgi Aug 03 03:27:49.907076 n-d-826529-8 devstack@n-api.service[125941]: DEBUG nova.api.openstack.wsgi [None req-9c27d1c4-a796-4937-9ad3-4dba98f52ebe tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Returning 404 to user: Instance 121c470b-84f1-4224-a3d6-91cd6a22fdf6 could not be found. {{(pid=125941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 03:27:49.907076 n-d-826529-8 devstack@n-api.service[125941]: INFO nova.api.openstack.requestlog [None req-9c27d1c4-a796-4937-9ad3-4dba98f52ebe tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6" status: 404 len: 111 microversion: 2.1 time: 0.030299 Aug 03 03:27:49.907076 n-d-826529-8 devstack@n-api.service[125941]: [pid: 125941|app: 0|req: 3823/7524] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 3 03:27:49 2022] GET /compute/v2.1/servers/121c470b-84f1-4224-a3d6-91cd6a22fdf6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 03:27:50.077028 n-d-826529-8 devstack@n-api.service[125942]: DEBUG nova.api.openstack.wsgi [None req-53dadcae-f068-4174-b481-b609a508b674 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] Calling method '.version_select at 0x7f5b13e31700>' {{(pid=125942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 03:27:50.107826 n-d-826529-8 devstack@n-api.service[125942]: INFO nova.api.openstack.requestlog [None req-53dadcae-f068-4174-b481-b609a508b674 tempest-TestSnapshotPattern-1086622436 tempest-TestSnapshotPattern-1086622436-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1026767652" status: 202 len: 0 microversion: 2.1 time: 0.034904 Aug 03 03:27:50.108458 n-d-826529-8 devstack@n-api.service[125942]: [pid: 125942|app: 0|req: 3702/7525] 10.222.0.67 () {58 vars in 1257 bytes} [Wed Aug 3 03:27:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1026767652 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 03:29:19.689519 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:29:19.690148 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 03:29:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:30:59.760720 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:30:59.761348 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 03:30:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:30:59.817399 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:30:59.818007 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 03:30:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:30:59.819342 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:30:59.819488 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 03:30:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:32:39.697858 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:32:39.698467 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 03:32:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:32:55.500666 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:32:55.501285 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 03:32:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:32:56.899585 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:32:56.900101 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 03:32:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:34:19.770331 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:34:19.770886 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 03:34:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:34:19.827739 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:34:19.828310 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 03:34:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:34:19.852106 n-d-826529-8 devstack@n-api.service[125942]: Traceback (most recent call last): Aug 03 03:34:19.852285 n-d-826529-8 devstack@n-api.service[125942]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 03 03:34:19.852285 n-d-826529-8 devstack@n-api.service[125942]: timer() Aug 03 03:34:19.852285 n-d-826529-8 devstack@n-api.service[125942]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 03 03:34:19.852285 n-d-826529-8 devstack@n-api.service[125942]: cb(*args, **kw) Aug 03 03:34:19.852285 n-d-826529-8 devstack@n-api.service[125942]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Aug 03 03:34:19.852285 n-d-826529-8 devstack@n-api.service[125942]: waiter.switch() Aug 03 03:34:19.852285 n-d-826529-8 devstack@n-api.service[125942]: greenlet.error: cannot switch to a different thread Aug 03 03:35:59.705995 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:35:59.706630 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 03:35:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:36:15.509994 n-d-826529-8 devstack@n-api.service[125942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:36:15.509994 n-d-826529-8 devstack@n-api.service[125942]: Wed Aug 3 03:36:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 03:36:16.907663 n-d-826529-8 devstack@n-api.service[125941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 03:36:16.908298 n-d-826529-8 devstack@n-api.service[125941]: Wed Aug 3 03:36:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!